-
International Journal of Methods in... Jun 2010A primary challenge in psychiatric genetics is the lack of a completely validated system of classification for mental disorders. Appropriate statistical methods are...
INTRODUCTION
A primary challenge in psychiatric genetics is the lack of a completely validated system of classification for mental disorders. Appropriate statistical methods are needed to empirically derive more homogenous disorder subtypes.
METHODS
Using the framework of Robins and Guze's ('Establishment of diagnostic validity in psychiatric illness: its application to schizophrenia', American Journal of Psychiatry, 1970, 126(7), 983-987) five phases, latent variable models to derive and validate diagnostic groups are described. A process of iterative validation is proposed through which refined phenotypes would facilitate research on genetics, pathogenesis, and treatment, which would in turn aid further refinement of disorder definitions.
CONCLUSIONS
Latent variable methods are useful tools for defining and validating psychiatric phenotypes. Further methodological research should address sample size issues and application to iterative validation.
Topics: Diagnostic and Statistical Manual of Mental Disorders; Follow-Up Studies; Humans; Mental Disorders; Phenotype; Psychiatric Status Rating Scales; Reproducibility of Results; Sensitivity and Specificity; Validation Studies as Topic
PubMed: 20187060
DOI: 10.1002/mpr.301 -
Currents in Pharmacy Teaching & Learning Sep 2017The Accreditation Council for Pharmacy Education's Standards 2016 has placed greater emphasis on validating educational assessments. In this paper, we describe validity,... (Review)
Review
The Accreditation Council for Pharmacy Education's Standards 2016 has placed greater emphasis on validating educational assessments. In this paper, we describe validity, reliability, and validation principles, drawing attention to the conceptual change that highlights one validity with multiple evidence sources; to this end, we recommend abandoning historical (confusing) terminology associated with the term validity. Further, we describe and apply Kane's framework (scoring, generalization, extrapolation, and implications) for the process of validation, with its inferences and conclusions from varied uses of assessment instruments by different colleges and schools of pharmacy. We then offer five practical recommendations that can improve reporting of validation evidence in pharmacy education literature. We describe application of these recommendations, including examples of validation evidence in the context of pharmacy education. After reading this article, the reader should be able to understand the current concept of validation, and use a framework as they validate and communicate their own institution's learning assessments.
Topics: Education, Pharmacy; Educational Measurement; Humans; Psychometrics; Reproducibility of Results
PubMed: 29233326
DOI: 10.1016/j.cptl.2017.06.001 -
Sexual Medicine Reviews Apr 2022Fifteen years have passed since the International Society of Sexual Medicine first established the 3-pronged criteria for premature ejaculation (PE): a short ejaculation... (Review)
Review
INTRODUCTION
Fifteen years have passed since the International Society of Sexual Medicine first established the 3-pronged criteria for premature ejaculation (PE): a short ejaculation latency, lack of ejaculatory control, and bother/distress. Although the process of establishing valid criteria for any condition or disorder is an ongoing one, a dearth of targeted research on these criteria has hindered professional societies from updating and revising them.
OBJECTIVES
To review and critique existing criteria used in the diagnosis of PE, to identify specific problems with them, and to recommend studies that will address shortcomings.
METHODS
Each of the PE criteria was evaluated and compared against standard procedures for establishing validated measures. Following each analysis, targeted research to address the gaps has been recommended.
RESULTS
Each PE criterion has shortcomings and each can be improved by using standard validation procedures, as noted by the targeted research outcomes. Professional societies can play an important role by encouraging broad participation in research that generates new and relevant data supporting, validating, or challenging the existing criteria.
CONCLUSION
The concepts underlying the diagnostic criteria for PE have both broad consensus and functional utility. Nevertheless, much of the research investigating PE has uncritically adopted these criteria without concomitantly recognizing their limitations. These limitations prevent determining accurate prevalence rates, interpreting research findings with confidence, and establishing efficacious treatment outcomes. Rowland DL, Althof SE, McMahon CG. The Unfinished Business of Defining Premature Ejaculation: The Need for Targeted Research. Sex Med Rev 2022;10:323-340.
Topics: Ejaculation; Humans; Male; Premature Ejaculation; Sexual Behavior; Treatment Outcome
PubMed: 34996746
DOI: 10.1016/j.sxmr.2021.11.003 -
Anales Del Sistema Sanitario de Navarra 2011It is increasingly necessary to have a measuring instrument available in the health field that can be used in clinical practice and research. In order to guarantee the... (Review)
Review
It is increasingly necessary to have a measuring instrument available in the health field that can be used in clinical practice and research. In order to guarantee the quality of their measurements it is essential that the instruments should be subjected to a process of validation. This process consists in adapting the instrument culturally to the setting where its psychometric characteristics are to be administered and checked, such as: reliability, validity, sensitivity and feasibility. There are measuring instruments from the health field available in other languages but that have not been validated into Spanish. Besides, the methodology for validating an instrument is little understood by the health professionals, which explains the indiscriminate use of instruments that have only been adapted or validated in a way that is not very consistent. The aim of this review is to bring up to date the process of validating an instrument for measuring health, and what it involves, in a practical way. The accessibility of evaluation instruments that have been culturally adapted and validated in different languages will facilitate the comparison of results obtained with the same instrument and the development international studies in different cultures.
Topics: Health Status Indicators; Humans; Reproducibility of Results; Surveys and Questionnaires; Validation Studies as Topic
PubMed: 21532647
DOI: 10.4321/s1137-66272011000100007 -
Aging and Disease Jul 2022Osteoporotic fractures (OF) are a global public health problem currently. Many risk prediction models for OF have been developed, but their performance and... (Review)
Review
Osteoporotic fractures (OF) are a global public health problem currently. Many risk prediction models for OF have been developed, but their performance and methodological quality are unclear. We conducted this systematic review to summarize and critically appraise the OF risk prediction models. Three databases were searched until April 2021. Studies developing or validating multivariable models for OF risk prediction were considered eligible. Used the prediction model risk of bias assessment tool to appraise the risk of bias and applicability of included models. All results were narratively summarized and described. A total of 68 studies describing 70 newly developed prediction models and 138 external validations were included. Most models were explicitly developed (n=31, 44%) and validated (n=76, 55%) only for female. Only 22 developed models (31%) were externally validated. The most validated tool was Fracture Risk Assessment Tool. Overall, only a few models showed outstanding (n=3, 1%) or excellent (n=32, 15%) prediction discrimination. Calibration of developed models (n=25, 36%) or external validation models (n=33, 24%) were rarely assessed. No model was rated as low risk of bias, mostly because of an insufficient number of cases and inappropriate assessment of calibration. There are a certain number of OF risk prediction models. However, few models have been thoroughly internally validated or externally validated (with calibration being unassessed for most of the models), and all models showed methodological shortcomings. Instead of developing completely new models, future research is suggested to validate, improve, and analyze the impact of existing models.
PubMed: 35855348
DOI: 10.14336/AD.2021.1206 -
Psychological Reports Jan 2023The current paper reports four consecutive studies that were conducted to link sexual health with a new construct of sexual intelligence by developing and validating a...
The current paper reports four consecutive studies that were conducted to link sexual health with a new construct of sexual intelligence by developing and validating a new scale to measure sexual intelligence. Sexual intelligence was defined as "the ability to perceive, understand and respond to sexual needs and desires in a personal and social context." Sexual Intelligence Scale (SIS), comprising of 8 items in English and 2 factors (sexual knowledge & sexual behavior), was developed and validated by involving 959 respondents in the process of 4 consecutive studies. The validity of SIS was tested step by step for its face, content, factorial, convergent, discriminant, and predictive validities. The reliability was measured through internal consistency and item-total & item-scale correlations. The study found significantly higher levels of sexual intelligence in men as compared to women. Sexual intelligence, moreover, had significant positive correlations with age, education, emotional intelligence, social intelligence, sexual health, and satisfaction with life. Sexual health was linked with sexual intelligence and the SIS was accepted as a reliable and valid tool to measure sexual intelligence.
PubMed: 36640115
DOI: 10.1177/00332941231152388 -
Archivos Espanoles de Urologia Nov 2019To describe a roadmap of the most representative milestones and considerations in the validation of surgical simulators, especially those of laparoscopic surgery. And... (Review)
Review
OBJECTIVES
To describe a roadmap of the most representative milestones and considerations in the validation of surgical simulators, especially those of laparoscopic surgery. And additionally, help determine when in this process a simulator can be considered as validated.
METHODS
A non-systematic review was carried out searching terms like simulation, validation, training, assessment, skills and learning curve, as well as providing the experience accumulated by our center.
RESULTS
An ideal classical validation process should consist of the following steps: fidelity, verification/calibration/ reliability, subjective and objective strategies. Baseline tests of fidelity and verification/calibration/ technological reliability are not always detailed in the simulation literature. A simulator can be considered validated if, at least, satisfactorily completed any of the two main objective strategies, that is, constructive and/or criterion validity.
CONCLUSIONS
The methodologies to validate simulators as useful and reliable for the improvement of psychomotor/ technical skills are widely analyzed, although there is a variety of approaches depending on the scientific reference consulted, not being implemented equally in all works. This apparent arbitrariness should be considered in advance because it can lead the researcher to misunderstandings, especially when the simulator will be regarded as valid.
Topics: Clinical Competence; Computer Simulation; Humans; Laparoscopy; Learning Curve; Reproducibility of Results; Simulation Training
PubMed: 31697250
DOI: No ID Found -
Facial Plastic Surgery : FPS Apr 2017Interest in cosmetic surgery is increasing, with rhinoplasty being one of the most popular surgical procedures. It is essential that surgeons identify patients with...
Interest in cosmetic surgery is increasing, with rhinoplasty being one of the most popular surgical procedures. It is essential that surgeons identify patients with existing psychological conditions before any procedure. This study aimed to develop and validate the Interest in Aesthetic Rhinoplasty Scale (IARS). Four studies were conducted to develop the IARS and to evaluate different indices of validity (face, content, construct, criterion, and concurrent validities) and reliability (internal consistency, split-half coefficient, and temporal stability) of the scale. The four study samples included a total of 463 participants. Statistical analysis revealed satisfactory psychometric properties in all samples. Scores on the IARS were negatively correlated with self-esteem scores ( = -0.296; < 0.01) and positively associated with scores for psychopathologic symptoms ( = 0.164; < 0.05), social dysfunction ( = 0.268; < 0.01), and depression ( = 0.308; < 0.01). The internal and test-retest coefficients of consistency were found to be high (α = 0.93; intraclass coefficient = 0.94). Rhinoplasty patients were found to have significantly higher IARS scores than nonpatients ( < 0.001). Findings of the present studies provided evidence for face, content, construct, criterion, and concurrent validities and internal and test-retest reliability of the IARS. This evidence supports the use of the scale in clinical and research settings.
Topics: Adult; Esthetics; Female; Humans; Male; Mental Disorders; Patient Selection; Psychiatric Status Rating Scales; Psychometrics; Reproducibility of Results; Rhinoplasty; Young Adult
PubMed: 28388802
DOI: 10.1055/s-0036-1597999 -
The British Journal of Dermatology Apr 2008Atopic dermatitis (AD) has a wide spectrum of dermatological manifestations and despite various validated sets of diagnostic criteria that have been developed over the... (Review)
Review
BACKGROUND
Atopic dermatitis (AD) has a wide spectrum of dermatological manifestations and despite various validated sets of diagnostic criteria that have been developed over the past decades, there is disagreement about its definition. Nevertheless, clinical studies require valid diagnostic criteria for reliable and reproducible results.
OBJECTIVE
To summarize the evidence concerning the validity of diagnostic criteria for AD.
METHODS
All data sources were identified through searches on Medline, Embase and Cochrane databases. The Quality Assessment of Diagnostic Accuracy tool (QUADAS) was used. Results are presented in a receiver operating characteristic (ROC) plot.
RESULTS
Out of the 20 articles that met the criteria, 27 validation studies were identified. In two studies concerning Hanifin and Rajka diagnostic criteria sensitivity and specificity ranged from 87.9% to 96.0% and from 77.6% to 93.8%, respectively. Nineteen validation studies of the U.K. diagnostic criteria showed sensitivity and specificity ranging from 10% to 100% and 89.3% to 99.1%, respectively. Three validation studies concerning the Schultz-Larsen criteria showed sensitivity from 88% to 94.4% and specificity from 77.6% to 95.9%. In one article concerning the criteria of Diepgen, the sensitivity ranged from 83.0% to 87.7% and the specificity from 83.9% to 87.0%. One article studied the Kang and Tian criteria and reported 95.5% sensitivity and 100% specificity. One article validating the International Study of Asthma and Allergies in Childhood (ISAAC) criteria showed a positive and negative predictive value of 48.8% and 91.1%, respectively.
CONCLUSION
With this systematic review of the existing sets of diagnostic criteria for AD a varying number of validation studies with varying methodological quality was found. The U.K. diagnostic criteria are the most extensively validated. However, improvement of methodological design for validation studies and uniformity in well-validated and applicable diagnostic criteria are needed to improve future intervention studies and to compare study results.
Topics: Dermatitis, Atopic; Diagnostic Tests, Routine; Humans; International Classification of Diseases; Reference Standards
PubMed: 18241277
DOI: 10.1111/j.1365-2133.2007.08412.x -
Arquivos de Gastroenterologia 2023Thyroid dysfunction has been reported in association with several chronic diseases, including advanced liver disease. •The bundle discussed here is aimed at proposing... (Review)
Review
Thyroid dysfunction has been reported in association with several chronic diseases, including advanced liver disease. •The bundle discussed here is aimed at proposing systematic assistance according to the best evidence-based practices available. •The process of constructing and validating the bundle was carried out in the following stages: a) bibliographic survey; b) bundle elaboration; and c) content validation. •The bundle was considered valid to facilitate medical decision making, aiding physicians to manage, in a practical and effective manner, the thyroid function of patients with liver cirrhosis. Background - Thyroid dysfunction has been reported in association with several chronic diseases, including advanced liver disease. This disease and its management are often neglected in clinical practice. The bundle discussed here is aimed at proposing systematic assistance according to the best evidence-based practices available. Objective - To construct and validate a bundle to evaluate thyroid function in patients with liver cirrhosis. Methods - The process of constructing and validating the bundle was carried out in the following stages: a) bibliographic survey; b) bundle elaboration; and c) content validation. The bibliographic survey was carried out in an integrative review about evidence related with the thyroid function of patients with liver cirrhosis. The findings from the integrative review were considered as supporting evidence for the elaboration of the bundle. The tool then created used accessible language and was evidence-based, ensuring that information was based on current literature. Results - The bundle was restructured to provide guidance on the management of patients with liver dysfunctions, including: cirrhosis due to general causes, cirrhosis due to hepatitis C, non-alcoholic fatty liver disease, primary biliary cholangitis, and hepatocellular carcinoma. The orientations in the bundle included: exams to be requested to screen for thyroid disorders, and guidance about the treatment of these dysfunctions and their associated complications. We analyzed specialist evaluation of the bundle using the Content Validity Index (CVI). We carried out a binomial test to evaluate consistency and specialist agreement regarding the items in the bundle, considering values >0.61 as a good level. The items in the bundle were considered to be valid (CVI >0.80). The general CVI of the instrument was 0.95 (CI95%: 0.91-0.98). Conclusion - The bundle was considered valid to facilitate medical decision making, aiding physicians to manage, in a practical and effective approach, the thyroid function of patients with liver cirrhosis. This tool should not be used as a replacement for individual, evaluation of the physician providing assistance. We recommend the structured bundle to be added to medical practice, considering its simple application, low cost, and potential to contribute for the management of these patients.
Topics: Humans; Thyroid Gland; Liver Cirrhosis; Carcinoma, Hepatocellular; Liver Neoplasms; Chronic Disease
PubMed: 37556750
DOI: 10.1590/S0004-2803.202302023-22