-
GMS Journal For Medical Education 2020Physicians with different professional backgrounds often diagnose a patients' problem collaboratively. In this article, we first introduce a process model for...
Physicians with different professional backgrounds often diagnose a patients' problem collaboratively. In this article, we first introduce a process model for collaborative diagnosing (CDR model), describe the development of a simulation used to empirically examine the facilitation of collaborative diagnostic reasoning. Based on a contemporary validity framework [1], we further suggest indicators for validity and collect initial evidence with respect to the scoring, generalization, extrapolation, and implication inferences to assess the validity of the simulation when used to assess effects of learning interventions. In a quasi-experimental study, we assessed objectivity and reliability of the simulation and compared medical students with low and advanced prior knowledge to practitioners with high prior knowledge with respect to their diagnostic accuracy, diagnostic efficiency, information sharing skills, and their intrinsic cognitive load. Additionally, we obtained authenticity ratings from practitioners with high prior knowledge. The results yielded satisfying initial evidence for the validity of the scoring and the extrapolation inferences as ratings are objective, and the simulation and the collaborative process is perceived as rather authentic. Additionally, participants on different levels of prior knowledge differ with respect to their diagnostic accuracy, diagnostic efficiency, information sharing skills, and their reported intrinsic cognitive load. With one exception (information sharing skills), the generalization inference seems to be valid as well. We conclude that collecting validity evidence for the simulation was an important step towards a better interpretation of the simulation. We found that the simulation is an authentic and valid representation of the chosen collaborative situation and that the collected validity evidence offers sufficient evidence for an initial validation of the simulation. Nevertheless, the validation process highlighted some important gaps that need further consideration. We further conclude that applying a validation model to the context of empirical research is promising and encourage other researchers to follow the example.
Topics: Adult; Child, Preschool; Clinical Competence; Education, Medical; Female; Humans; Patient Simulation; Pilot Projects; Reproducibility of Results; Students, Medical; Teaching; Young Adult
PubMed: 32984510
DOI: 10.3205/zma001344 -
Journal of Movement Disorders May 2023Embouchure dystonia (ED) is a task-specific movement disorder that leads to loss of fine motor control of the embouchure and tongue muscles in wind musicians. In...
OBJECTIVE
Embouchure dystonia (ED) is a task-specific movement disorder that leads to loss of fine motor control of the embouchure and tongue muscles in wind musicians. In contrast to musicians' hand dystonia, no validated severity rating for ED exists, posing a major obstacle for structured assessment in scientific and clinical settings. The aim of this study is to validate an ED severity rating scale (EDSRS) allowing for a standardized estimation of symptom severity in ED.
METHODS
The EDSRS was set up as a composite score of six items evaluating audio-visual disease symptoms during the performance of three standardized musical tasks (sustained notes, scales, and fourths) separately for each body side. For validation, 17 musicians with ED underwent standardized audiovisual recordings during performance. Anonymized and randomized recordings were assessed by two experts in ED (raters). Statistical analysis included metrics of consistency, reliability, and construct validity with the fluctuation of the fundamental frequency of the acoustic signal (F0) (extracted in an audio analysis of the sustained notes).
RESULTS
The EDSRS showed high internal consistency (Cronbach's α = 0.975-0.983, corrected item-total correlations r = 0.90-0.96), interrater reliability (intraclass correlation coefficient [ICC] for agreement/consistency = 0.94/0.96), intrarater reliability over time (ICC per rater = 0.93/0.87) and good precision (standard error of measurement = 2.19/2.65), and correlated significantly with F0 variability (r = 0.55-0.60, p = 0.011-0.023).
CONCLUSION
The developed EDSRS is a valid and reliable tool for the assessment of ED severity in the hands of trained expert raters. Its easy applicability makes it suitable not only for routine clinical practice but also for scientific studies.
PubMed: 37258280
DOI: 10.14802/jmd.22213 -
Revista Gaucha de Enfermagem 2022To construct and validate a mobile application for health education about COVID-19.
OBJECTIVE
To construct and validate a mobile application for health education about COVID-19.
METHOD
Methodological study, developed in six stages, in the state of Rio de Janeiro, between June 2020 and August 2021, with 20 health professionals, using an electronic form. Validation took place through the Content Validity Index, whose indexes should be greater than or equal to 80%.
RESULTS
The application called ROBOVID was constructed and validated by expert judges on the subject, with a Content Validity Index of 100% for the domains of content and cultural adequacy, and with a variation of 90 to 100% for the domains of language, illustration, and presentation, achieving 97% on the Overall Validity Index and 98% on the "ten golden rules" for use in health education.
CONCLUSION
The ROBOVID application proved to be a valid technological tool for health education about COVID-19 among the Brazilian population.
Topics: Humans; Brazil; Mobile Applications; Surveys and Questionnaires; COVID-19; Health Education
PubMed: 36350968
DOI: 10.1590/1983-1447.2022.20210289.en -
BMC Psychology Aug 2023Hoarding disorder is characterized by a persistent inability to part with possessions due to a perceived need to keep them, regardless of their actual value....
BACKGROUND
Hoarding disorder is characterized by a persistent inability to part with possessions due to a perceived need to keep them, regardless of their actual value. Arabic-speaking populations currently lack a validated tool specifically designed to assess hoarding symptoms.
OBJECTIVE
This study aimed to translate, adapt, and validate the Hoarding Rating Scale-Self Report (HRS-SR) into the Arabic-language.
METHODS
The study employed the gold standard approach to translation, involving forward translation by independent translators and back translation review. We conducted a cross-sectional study using an online survey completed by 500 participants from four Arabic-speaking countries. Psychometric analyses included internal consistency, test-retest reliability, convergent validity against generalized anxiety disorder (GAD-7), and confirmatory factor analysis.
RESULTS
With a McDonald's omega and Cronbach's alpha of approximately 0.80, the Arabic translation of the HRS-SR showed acceptable test-retest reliability as well as good internal consistency. The survey also showed strong convergent validity with the 7-item survey for GAD-7. Confirmatory factor analysis supported a one-factor structure, confirming that each item measured the same construct.
CONCLUSION
The HRS-SR is a trustworthy and valid tool for evaluating hoarding symptoms in Arabic-speaking people. This survey could be helpful for both clinical and academic research. Future research should examine cultural variations in hoarding behavior in Arabic-speaking populations and validate the questionnaire in clinical populations.
Topics: Humans; Self Report; Hoarding; Cross-Sectional Studies; Reproducibility of Results; Language
PubMed: 37587535
DOI: 10.1186/s40359-023-01277-1 -
Psicologia, Reflexao E Critica :... Sep 2022The Positive Mental Health (PMH) scale has been shown to be a reliable and valid tool for assessing positive mental health and well-being in different languages and...
The Positive Mental Health (PMH) scale has been shown to be a reliable and valid tool for assessing positive mental health and well-being in different languages and cultures. However, the PMH scale has not yet been translated into Arabic and validated for the Saudi Arabian population. Therefore, the current study aimed to translate the English version of the PMH scale into Arabic for the Saudi Arabian context and validate the translated scale. A total of 1148 adult participants from Saudi public universities took part in the study. Based on exploratory and confirmatory factor analyses in different subsamples, the results of the current study revealed that the unifactorial model satisfactorily fits the data. Additionally, the Arabic version of the PMH scale demonstrated sufficient levels of reliability and had a high negative correlation with the Beck Depression Inventory-II, indicating convergent validity. Taken together, the findings of the current study suggest that the Arabic version of the PMH scale has appropriate levels of validity and reliability for the Saudi Arabian population.
PubMed: 36125579
DOI: 10.1186/s41155-022-00232-0 -
Indian Journal of Otolaryngology and... Dec 2022Voice Handicap Index (VHI) is the most commonly used tool to assess the quality of life in voice disordered patients. A validated Tamil language version of VHI is not...
Voice Handicap Index (VHI) is the most commonly used tool to assess the quality of life in voice disordered patients. A validated Tamil language version of VHI is not developed yet. Hence, this study was undertaken to translate and validate the Voice Handicap Index in Tamil language, which can potentially benefit Tamil speaking patients with voice disorders. This was a translation and tool validation study done at a tertiary care teaching hospital using an analytical, follow up design according to WHO guidelines. Dysphonic (Group A) and Normal (Group B) respondents were purposively invited to fill a self administered VHI-Tamil questionnaire. The content validity, response process validity, internal consistency and clinical validity of the questionnaire was calculated using appropriate statistical analysis methods using SPSS version 24.0 software. Out of 117 respondents, 61 respondents were dysphonic (Group A) and 56 respondents were normal (Group B). Overall index for content validation was over 0.84, and response process validation was 1.00 in all domains. Overall internal consistency was excellent, with Cronbach's alpha of 0.993. Excellent test-retest reliability was identified using the Spearman rank correlation coefficient (r = 0.96; p-value < 0.001). For clinical validity, a statistically significant difference between the dysphonic and the normal groups, for the overall VHI-Tamil scores and each of the three domain scores was noted. VHI-Tamil was found to be reliable and valid for assessing the quality of life in patients with voice disorders. It can be recommended for future use among Tamil speaking population.
PubMed: 36742755
DOI: 10.1007/s12070-021-02469-0 -
EClinicalMedicine Dec 2023Despite progress in assuring provision of safe abortion, substantial disparities remain in quality of abortion care around the world. However, no consistent, valid,...
BACKGROUND
Despite progress in assuring provision of safe abortion, substantial disparities remain in quality of abortion care around the world. However, no consistent, valid, reliable method exists to routinely measure quality in abortion care across facility and out-of-facility settings, impeding learning and improvement. To address this need, the Abortion Service Quality Initiative developed the first global standard for measuring quality of abortion care in low-income and middle-income countries.
METHODS
This prospective cohort study was conducted in Bangladesh, Ethiopia, and Nigeria in 2020-2022. Participants included sites and providers offering abortion care, including health facilities, pharmacies, proprietary and patent medicine vendors (PPMVs), and hotlines, and clients aged 15-49 receiving abortion care from a selected site. 111 structure and process indicators were tested, which originated from a review of existing abortion quality indicators and from qualitative research to develop additional client-centred quality indicators. The indicators were tested against 12 clinical and client experience outcomes at the site-level (such as abortion-related deaths) and client-level (such as whether the client would recommend the service to a friend) that were expected to result from the abortion quality indicators. Indicators were selected for the final metric based on predictive validity assessed using Bayesian models to test associations between indicators and outcomes, content validity, and performance.
FINDINGS
We included 1915 abortion clients recruited from 131 sites offering abortion care across the three countries. Among the 111 indicators tested, 44 were associated with outcomes in Bayesian analyses and an additional 8 were recommended for inclusion by the study's Resource Group for face validity. These 52 indicators were evaluated on content validity, predictive validity, and performance, and 29 validated indicators were included in the final abortion care quality metric. The 29 validated indicators were feasibility tested among 53 clients and 24 providers from 9 facility sites in Ethiopia and 57 clients and 6 PPMVs from 9 PPMV sites in Nigeria. The median time required to complete each survey instrument indicated feasibility: 10 min to complete the client exit survey, 16 min to complete the provider survey, and 11 min to complete the site checklist. Overall, the indicators performed well. However, all providers in the feasibility test failed two indicators of provider knowledge to competently complete the abortion procedure, and these indicators were subsequently revised to improve performance.
INTERPRETATION
This study provides 29 validated abortion care quality indicators to assess quality in facility, pharmacy, and hotline settings in low-income and middle-income countries. Future research should validate the Abortion Care Quality (ACQ) Tool in additional abortion care settings, such as telemedicine, online medication abortion (MA) sellers, and traditional abortion providers, and in other geographical and legal settings.
FUNDING
The David and Lucile Packard Foundation and the Children's Investment Fund Foundation.
PubMed: 38125934
DOI: 10.1016/j.eclinm.2023.102347 -
BMC Pregnancy and Childbirth Jul 2021The Lederman Prenatal Self-Evaluation Questionnaire (PSEQ) is used to assess psychosocial adaptation to pregnancy, labor, childbirth, and maternity. The PSEQ is a tool...
BACKGROUND
The Lederman Prenatal Self-Evaluation Questionnaire (PSEQ) is used to assess psychosocial adaptation to pregnancy, labor, childbirth, and maternity. The PSEQ is a tool used in various countries and has been translated into Portuguese; however, it needs to be validated in Brazil. This study aimed to analyze the validity and reliability of the PSEQ in Brazilian pregnant women.
METHOD
This methodological validity study investigated internal consistency and reliability using Cronbach's alpha and intraclass correlation coefficients. Construct validity was assessed using Pearson's correlation between domains and confirmatory factor analysis. To assess concurrent validity, Pearson's correlation between the different domains of the PSEQ and Prenatal Psychosocial Profile-Portuguese Version (PPP-VP) was determined. The level of significance was set at 5%.
RESULTS
This study included 399 pregnant women in the northeastern region of Brazil. The internal consistency and reliability of the total PSEQ score were high (Cronbach's alpha = 0.89; intraclass correlation coefficient = 0.95). Validity analysis showed positive and significant correlations between all PSEQ domains, ranging from 0.14 to 0.56. Confirmatory factor analysis demonstrated the following values of goodness of fit: RMSEA = 0.05, SRMR = 0.08, CFI = 0.61, χ/df = 1.77. The discriminant and concurrent validities of the PSEQ were confirmed.
CONCLUSIONS
The Portuguese version of the PSEQ has adequate psychometric properties and is a valid and reliable tool to evaluate psychosocial adaptation to pregnancy in Brazilian pregnant women.
Topics: Adaptation, Psychological; Adolescent; Adult; Brazil; Factor Analysis, Statistical; Female; Humans; Labor, Obstetric; Parturition; Pregnancy; Psychometrics; Reproducibility of Results; Surveys and Questionnaires; Young Adult
PubMed: 34215199
DOI: 10.1186/s12884-021-03959-3 -
Psychology Research and Behavior... 2023The study aims to adapt and validate the Indonesian version of the commitment to change scale that was initially developed by Herscovitch and Meyer.
PURPOSE
The study aims to adapt and validate the Indonesian version of the commitment to change scale that was initially developed by Herscovitch and Meyer.
METHODS
Data were collected using an online application among faculty members of several universities who have experienced policy changes from the Indonesian government regarding research-related issues. A total of 204 responses were obtained. The data was validated using the Content Validity Index (CVI), the Confirmatory Factor Analysis (CFA), the Convergent and Discriminant correlations as well as the Cronbach's alpha.
RESULTS
The results demonstrated that commitment to change could be represented by three dimensions of affective, continuance and normative commitment to change, although there is one item that must be adjusted. The results of the Scale-Content Validity Index (S-CVI) show that the commitment to change scale has excellent content validity (S-CVI/Ave = 0.97). CFA results show a good fit, Cronbach's alpha obtains good results with ACTC (α = 0.71); CCTC (α = 0.83); NCTC (α = 0.77) and Construct Reliability (CR) values obtained are also quite good with ACTC = 0.85; CCTC = 0.86; NCTC = 0.86. From the results of the convergent and discriminant validity tests, it was found that the affective commitment to change positively correlates with job satisfaction and negatively correlates with job stress. However, both continuance and normative commitment to change scale does not correlate with the two variables.
CONCLUSION
The Indonesian version of the commitment to change scale shows good psychometric properties and has proven valid to provide the measurement of commitment to change, especially for the faculty members in Indonesia.
PubMed: 36726698
DOI: 10.2147/PRBM.S391379 -
Revue Scientifique Et Technique... Aug 1998Assay validation is a series of the following interrelated processes: an experimental process: reagents and protocols are optimised by experimentation to detect the... (Review)
Review
Assay validation is a series of the following interrelated processes: an experimental process: reagents and protocols are optimised by experimentation to detect the analyte with accuracy and precision, and to ensure repeatability and reproducibility in the assay. a relative process: its diagnostic sensitivity and diagnostic specificity are calculated relative to test results obtained from reference animal populations of known infection/exposure status. a conditional process: classification of animals in the target population as infected or uninfected is conditional upon how well the reference animal population used to validate the assay represents the population to which the assay will be applied (accurate predictions of the infection status of animals from test results and predictive values of positive and negative test results are conditional upon the estimated prevalence of disease/infection in the target population) an incremental process: confidence in the validity of an assay increases over time when use confirms that it is robust as demonstrated by accurate and precise results (the assay may also achieve increasing levels of validity as it is upgraded and extended by adding reference populations of known infection status) a continuous process: the assay remains valid only insofar as the assay continues to provide accurate and precise results as proved through statistical verification. Therefore, validation of diagnostic assays for infectious diseases does not end with a time-limited series of experiments based on a few reference samples. Rather, it is a process that also requires constant vigilance and maintenance, along with reassessment of its performance characteristics for each population of animals to which it is applied. It is certain that the current movement to develop and implement accreditation criteria for veterinary diagnostic laboratories may be of little worth unless there is some assurance that the assays conducted in such laboratories are properly validated. Fully accredited laboratories may generate highly reproducible test results, but the results may still misclassify animals as to their infection status due to an improper assay validation process. Therefore, assay validation is foundational to the core product of veterinary diagnostic laboratories--test results and their interpretation.
Topics: Animals; Communicable Diseases; Predictive Value of Tests; Prevalence; Quality Control; ROC Curve; Reference Standards; Reference Values; Reproducibility of Results; Sample Size; Sensitivity and Specificity; Serologic Tests
PubMed: 9713892
DOI: 10.20506/rst.17.2.1119