-
BMC Neurology Mar 2014There are a number of instruments that describe severity and progression of multiple sclerosis and they are increasingly used as endpoints to assess the effectiveness of... (Review)
Review
Systematic literature review and validity evaluation of the Expanded Disability Status Scale (EDSS) and the Multiple Sclerosis Functional Composite (MSFC) in patients with multiple sclerosis.
BACKGROUND
There are a number of instruments that describe severity and progression of multiple sclerosis and they are increasingly used as endpoints to assess the effectiveness of therapeutic interventions. We examined to what extent the psychometric properties of two accepted instruments--EDSS and MSFC--meet methodological standards and the value they have in clinical trials.
METHODS
We conducted a systematic literature search in relevant databases [MEDLINE (PubMed), ISI Web of Science, EMBASE, PsycINFO & PSYNDEX, CINAHL] yielding 3,860 results. Relevant full-text publications were identified using abstract and then full-text reviews, and the literature was reviewed.
RESULTS
For evaluation of psychometric properties (validity, reliability, sensitivity of change) of EDSS and MSFC, 120 relevant full-text publications were identified, 54 of them assessed the EDSS, 26 the MSFC and 40 included both instruments. The EDSS has some documented weaknesses in reliability and sensitivity to change. The main limitations of the MSFC are learning effects and the z-scores method used to calculate the total score. However, the methodological criterion of validity applies sufficiently for both instruments.For use in clinical studies, we found the EDSS to be preferred as a primary and secondary outcome measure in recent studies (50 EDSS, 9 MSFC).
CONCLUSIONS
Recognizing their strengths and weaknesses, both EDSS and MSFC are suitable to detect the effectiveness of clinical interventions and to monitor disease progression. Almost all publications identify the EDSS as the most widely used tool to measure disease outcomes in clinical trials. Despite some limitations, both instruments are accepted as endpoints and neither are discussed as surrogate parameters in identified publications. A great advantage of the EDSS is its international acceptance (e.g. by EMA) as a primary endpoint in clinical trials and its broad use in trials, enabling cross-study comparisons.
Topics: Clinical Trials as Topic; Disability Evaluation; Humans; Multiple Sclerosis; Psychometrics
PubMed: 24666846
DOI: 10.1186/1471-2377-14-58 -
Psychometrika Mar 2022This commentary reflects on the articles included in the Psychometrika Special Issue on Network Psychometrics in Action. The contributions to the special issue are...
This commentary reflects on the articles included in the Psychometrika Special Issue on Network Psychometrics in Action. The contributions to the special issue are related to several possible future paths for research in this area. These include the development of models to analyze and represent interventions, improvement in exploratory and inferential techniques in network psychometrics, the articulation of psychometric theories in addition to psychometric models, and extensions of network modeling to novel data sources. Finally, network psychometrics is part of a larger movement in psychology that revolves around the analysis of human beings as complex systems, and it is timely that psychometricians start extending their rich modeling tradition to improve and extend the analysis of systems in psychology.
Topics: Humans; Psychometrics
PubMed: 35334037
DOI: 10.1007/s11336-022-09851-z -
Nutrients Apr 2022Addictive-like eating is prevalent, but a clear conceptualization and operationalization outside of an addiction framework is lacking. By adopting a biopsychological...
Addictive-like eating is prevalent, but a clear conceptualization and operationalization outside of an addiction framework is lacking. By adopting a biopsychological framework of food reward, this study sought to develop and evaluate a brief self-report questionnaire for the trait assessment of hedonic overeating and dyscontrol. Items in the Hedonic Overeating-Questionnaire (HEDO-Q) were constructed following a rational approach and psychometrically evaluated in a large random sample from the German population ( = 2531). A confirmatory factor analysis supported the unidimensional nature of the six-item HEDO-Q with the three postulated components of wanting, liking, and dyscontrol. Psychometric properties were favorable with good corrected item-total correlations, acceptable item difficulty and homogeneity, and high internal consistency. Population norms were provided. The HEDO-Q revealed strict measurement invariance for sex and partial invariance for age and weight status. Discriminant validity was demonstrated in distinguishing participants with versus without eating disturbances or obesity. Associations with the established measures of eating disorder and general psychopathology supported the convergent and divergent validity of the HEDO-Q. This first evaluation indicates good psychometric properties of the HEDO-Q in the general population. Future validation work is warranted on the HEDO-Q's stability, sensitivity to change, and predictive and construct validity.
Topics: Factor Analysis, Statistical; Feeding and Eating Disorders; Humans; Hyperphagia; Psychometrics; Reproducibility of Results; Surveys and Questionnaires
PubMed: 35565829
DOI: 10.3390/nu14091865 -
PloS One 2014Over the last decades, trust in physician has gained in importance. Studies have shown that trust in physician is associated with positive health behaviors in patients.... (Review)
Review
Over the last decades, trust in physician has gained in importance. Studies have shown that trust in physician is associated with positive health behaviors in patients. However, the validity of empirical findings fundamentally depends on the quality of the measures in use. Our aim was to provide an overview of trust in physician measures and to evaluate the methodological quality of the psychometric studies and the quality of psychometric properties of identified measures. We conducted an electronic search in three databases (Medline, EMBASE and PsycInfo). The secondary search strategy included reference and citation tracking of included full texts and consultation of experts in the field. Retrieved records were screened independently by two reviewers. Full texts that reported on testing of psychometric properties of trust in physician measures were included in the review. Study characteristics and psychometric properties were extracted. We evaluated the quality of design, methods and reporting of studies with the COnsensus based Standards for the selection of health status Measurement INstruments (COSMIN) checklist. The quality of psychometric properties was assessed with Terwee's 2007 quality criteria. After screening 3284 records and assessing 169 full texts for eligibility, fourteen studies on seven trust in physician measures were included. Most of the studies were conducted in the USA and used English measures. All but one measure were generic. Sample sizes range from 25 to 1199 participants, recruited in very heterogeneous settings. Quality assessments revealed several flaws in the methodological quality of studies. COSMIN scores were mainly fair or poor. The overall quality of measures' psychometric properties was intermediate. Several trust in physician measures have been developed over the last years, but further psychometric evaluation of these measures is strongly recommended. The methodological quality of psychometric property studies could be improved by adhering to quality criteria like the COSMIN checklist.
Topics: Humans; Physicians; Psychometrics; Trust
PubMed: 25208074
DOI: 10.1371/journal.pone.0106844 -
The Clinical Neuropsychologist Feb 2019This article reviews current approaches to neuropsychological assessment, identifies opportunities for development of new methods using modern psychometric theory and... (Review)
Review
OBJECTIVE
This article reviews current approaches to neuropsychological assessment, identifies opportunities for development of new methods using modern psychometric theory and advances in technology, and suggests a transition path that promotes application of novel methods without sacrificing validity.
METHODS
Theoretical/state-of-the-art review.
CONCLUSIONS
Clinical neuropsychological assessment today does not reflect advances in neuroscience, modern psychometrics, or technology. Major opportunities for improving practice include both psychometric and technological strategies. Modern psychometric approaches including item response theory (IRT) enable linking procedures that can place different measures on common scales; adaptive testing algorithms that can dramatically increase efficiency of assessment; examination of differential item functioning (DIF) to detect measures that behave differently in different groups; and person fit statistics to detect aberrant patterns of responding of high value for performance validity testing. Opportunities to introduce novel technologies include computerized adaptive testing, Web-based assessment, healthcare- and bio-informatics strategies, mobile platforms, wearables, and the 'internet-of-things'. To overcome inertia in current practices, new methods must satisfy requirements for back-compatibility with legacy instrumentation, enabling us to leverage the wealth of validity data already accrued for classic procedures. A path to achieve these goals involves creation of a global network to aggregate item-level data into a shared repository that will enable modern psychometric analyses to refine existing methods, and serve as a platform to evolve novel assessment strategies, which over time can revolutionize neuropsychological assessment practices world-wide.
Topics: Algorithms; Forecasting; Humans; Neuropsychological Tests; Psychometrics
PubMed: 30422045
DOI: 10.1080/13854046.2018.1521993 -
PloS One 2014Effective communication with health care providers has been found as relevant for physical and psychological health outcomes as well as the patients' adherence. However,... (Review)
Review
BACKGROUND
Effective communication with health care providers has been found as relevant for physical and psychological health outcomes as well as the patients' adherence. However, the validity of the findings depends on the quality of the applied measures. This study aimed to provide an overview of measures of physician-patient communication and to evaluate the methodological quality of psychometric studies and the quality of psychometric properties of the identified measures.
METHODS
A systematic review was performed to identify psychometrically tested instruments which measure physician-patient communication. The search strategy included three databases (EMBASE, PsycINFO, PubMed), reference and citation tracking and personal knowledge. Studies that report the psychometric properties of physician-patient communication measures were included. Two independent raters assessed the methodological quality of the selected studies with the COSMIN (COnsensus based Standards for the selection of health status Measurement INtruments) checklist. The quality of psychometric properties was evaluated with the quality criteria of Terwee and colleagues.
RESULTS
Data of 25 studies on 20 measures of physician-patient communication were extracted, mainly from primary care samples in Europe and the USA. Included studies reported a median of 3 out of the nine COSMIN criteria. Scores for internal consistency and content validity were mainly fair or poor. Reliability and structural validity were rated mainly of fair quality. Hypothesis testing scored mostly poor. The quality of psychometric properties of measures evaluated with Terwee et al.'s criteria was rated mainly intermediate or positive.
DISCUSSION
This systematic review identified a number of measures of physician-patient communication. However, further psychometric evaluation of the measures is strongly recommended. The application of quality criteria like the COSMIN checklist could improve the methodological quality of psychometric property studies as well as the comparability of the studies' results.
Topics: Communication; Humans; Physician-Patient Relations; Psychometrics
PubMed: 25532118
DOI: 10.1371/journal.pone.0112637 -
Journal of Psychiatric Research Mar 2022Measurement-based care (MBC) involves the regular administration of outcome assessments to track and evaluate treatment progress and requires psychometrically sound... (Review)
Review
Measurement-based care (MBC) involves the regular administration of outcome assessments to track and evaluate treatment progress and requires psychometrically sound instruments. While there are widely used patient-reported outcome measures (PROMs) for several psychiatric disorders and symptom categories (e.g., depression, anxiety), there is less consensus about self-report assessments for measurement-based care of schizophrenia. The present review provides an initial guide to this area by reporting on psychometric studies that introduce or evaluate PROMs designed for the ongoing treatment of schizophrenia. Out of an initial database of 6,153 articles, and review of 141 full-text articles, an analysis of 21 articles examining 12 measures is presented in this review. Findings suggest robust options exist for clinical and research institutions aiming to assess symptom outcomes in schizophrenia, with most measures showing strengths in internal consistency, test-retest reliability, and a number of measures with evidence of convergent or criterion validity. While there exist heterogeneous options, multiple measures demonstrated promising psychometric strengths. Future work validating consistent psychometric validity could involve measures which could be valuable in context of MBC for schizophrenia.
Topics: Humans; Patient Reported Outcome Measures; Psychometrics; Reproducibility of Results; Schizophrenia; Self Report
PubMed: 35007807
DOI: 10.1016/j.jpsychires.2021.12.053 -
Journal of Medical Internet Research Oct 2017Significant resources are being invested into eHealth technology to improve health care. Few resources have focused on evaluating the impact of use on patient outcomes A... (Review)
Review
BACKGROUND
Significant resources are being invested into eHealth technology to improve health care. Few resources have focused on evaluating the impact of use on patient outcomes A standardized set of metrics used across health systems and research will enable aggregation of data to inform improved implementation, clinical practice, and ultimately health outcomes associated with use of patient-facing eHealth technologies.
OBJECTIVE
The objective of this project was to conduct a systematic review to (1) identify existing instruments for eHealth research and implementation evaluation from the patient's point of view, (2) characterize measurement components, and (3) assess psychometrics.
METHODS
Concepts from existing models and published studies of technology use and adoption were identified and used to inform a search strategy. Search terms were broadly categorized as platforms (eg, email), measurement (eg, survey), function/information use (eg, self-management), health care occupations (eg, nurse), and eHealth/telemedicine (eg, mHealth). A computerized database search was conducted through June 2014. Included articles (1) described development of an instrument, or (2) used an instrument that could be traced back to its original publication, or (3) modified an instrument, and (4) with full text in English language, and (5) focused on the patient perspective on technology, including patient preferences and satisfaction, engagement with technology, usability, competency and fluency with technology, computer literacy, and trust in and acceptance of technology. The review was limited to instruments that reported at least one psychometric property. Excluded were investigator-developed measures, disease-specific assessments delivered via technology or telephone (eg, a cancer-coping measure delivered via computer survey), and measures focused primarily on clinician use (eg, the electronic health record).
RESULTS
The search strategy yielded 47,320 articles. Following elimination of duplicates and non-English language publications (n=14,550) and books (n=27), another 31,647 articles were excluded through review of titles. Following a review of the abstracts of the remaining 1096 articles, 68 were retained for full-text review. Of these, 16 described an instrument and six used an instrument; one instrument was drawn from the GEM database, resulting in 23 articles for inclusion. None included a complete psychometric evaluation. The most frequently assessed property was internal consistency (21/23, 91%). Testing for aspects of validity ranged from 48% (11/23) to 78% (18/23). Approximately half (13/23, 57%) reported how to score the instrument. Only six (26%) assessed the readability of the instrument for end users, although all the measures rely on self-report.
CONCLUSIONS
Although most measures identified in this review were published after the year 2000, rapidly changing technology makes instrument development challenging. Platform-agnostic measures need to be developed that focus on concepts important for use of any type of eHealth innovation. At present, there are important gaps in the availability of psychometrically sound measures to evaluate eHealth technologies.
Topics: Humans; Needs Assessment; Psychometrics; Surveys and Questionnaires; Telemedicine
PubMed: 29021128
DOI: 10.2196/jmir.7638 -
Clinical Psychology Review Jun 2019A robust body of theoretical and experimental work highlights the influence of alternative, substance-free rewards on decisions to use alcohol and other drugs. However,...
A robust body of theoretical and experimental work highlights the influence of alternative, substance-free rewards on decisions to use alcohol and other drugs. However, translational applications have been limited in part by the lack of consensus on how to measure substance-free reinforcement in applied and clinical settings. The current study summarizes extant research utilizing self-report reinforcement or reward methodologies, and critically reviews the psychometric properties of the available measures. These studies (N = 50) fell into three categories: measures of recent substance-related and substance-free activity participation and enjoyment (n = 32), measures of time or monetary resource allocation (n = 15), and rating scale measures of reward availability and experience (n = 8). The available research suggests that, consistent with experimental laboratory research and with behavioral economic predictions, there is an inverse relation between substance-free reinforcement and substance use. These studies also support the clinical utility of these measures in predicting substance use severity and course. Reinforcement measures could be improved by enhancing content validity, multimethod convergent validity, and generalizability.
Topics: Economics, Behavioral; Humans; Outcome Assessment, Health Care; Psychometrics; Reinforcement, Psychology; Substance-Related Disorders
PubMed: 30991244
DOI: 10.1016/j.cpr.2019.04.003 -
Asian Nursing Research Aug 2022The aim of this paper is to develop a scale for measuring the perinatal bereavement care competence of midwives and assess its psychometric properties. (Review)
Review
PURPOSE
The aim of this paper is to develop a scale for measuring the perinatal bereavement care competence of midwives and assess its psychometric properties.
METHODS
The Perinatal Bereavement Care Competence Scale was developed in four phases. (1) Item generation: 75 items were formulated based on a literature review and interviews with midwives. (2) Delphi expert consultation: 15 experts evaluated whether the items were clear/appropriate/relevant to the questionnaire dimensions, and the items were optimized. (3) Pilot test: The comprehensibility, acceptability, and time required to complete the questionnaire by midwives were assessed. (4) Evaluation of reliability and validity: The scale was validated by initial item analysis, exploratory and confirmatory factor analyses, and internal consistency reliability and test-retest reliability.
RESULTS
The final scale consisted of six dimensions and 25 items: maintaining belief (three items), knowing (four items), being with (six items), preserving dignity (four items), enabling (five items), and self-adjustment (three items). Exploratory factor analysis yielded a six-factor structure that was consistent with the theoretical framework and explained 70.8% of the total variance. Confirmatory factor analysis indicated a good fit for the six-factor model. Cronbach's α for the scale was 0.931, and the test-retest reliability coefficient was 0.968.
CONCLUSION
The Perinatal Bereavement Care Competence Scale is a valid and reliable instrument for measuring the competence of midwives in caring for bereaved parents who have experienced perinatal loss.
Topics: Bereavement; Factor Analysis, Statistical; Female; Grief; Humans; Midwifery; Perinatal Death; Pregnancy; Professional Competence; Psychometrics; Reproducibility of Results; Surveys and Questionnaires
PubMed: 35716897
DOI: 10.1016/j.anr.2022.06.002