-
Intensive & Critical Care Nursing Dec 2019This study aimed to develop a Post-Intensive Care Syndrome Questionnaire (PICSQ) and assess the psychometric properties of PICSQ in intensive care unit survivors.
OBJECTIVE
This study aimed to develop a Post-Intensive Care Syndrome Questionnaire (PICSQ) and assess the psychometric properties of PICSQ in intensive care unit survivors.
METHODS
PICSQ items were generated through relevant literature reviews, qualitative interviews among survivors, and multiple rounds of content validity evaluations by experts. Data were collected from 536 survivors at seven health care facilities in three cities of Korea from June to August 2018. The validity and reliability of PICSQ were assessed using exploratory factor analysis, confirmatory factor analysis, internal consistency and correlation coefficients.
RESULTS
The final PICSQ consisted of 18 items. Through exploratory factor analysis, three factors (mental, cognitive and physical) were derived. The reliability of PICSQ was represented by a Cronbach's α of 0.93, while the internal consistency of each factor was good (Cronbach's α = 0.84 to 0.90). The model fit of PICSQ was satisfactory and confirmatory factor analysis demonstrated good convergent and discriminant validity of the questionnaire.
CONCLUSION
Because PICSQ is valid and reliable, it is recommended for use in clinical practice and research to assess post-intensive care syndrome in intensive care survivors.
Topics: Adult; Aged; Critical Care; Female; Humans; Male; Middle Aged; Psychometrics; Reproducibility of Results; Republic of Korea; Surveys and Questionnaires; Validation Studies as Topic
PubMed: 31522829
DOI: 10.1016/j.iccn.2019.102756 -
Psychometrika Mar 2022This commentary reflects on the articles included in the Psychometrika Special Issue on Network Psychometrics in Action. The contributions to the special issue are...
This commentary reflects on the articles included in the Psychometrika Special Issue on Network Psychometrics in Action. The contributions to the special issue are related to several possible future paths for research in this area. These include the development of models to analyze and represent interventions, improvement in exploratory and inferential techniques in network psychometrics, the articulation of psychometric theories in addition to psychometric models, and extensions of network modeling to novel data sources. Finally, network psychometrics is part of a larger movement in psychology that revolves around the analysis of human beings as complex systems, and it is timely that psychometricians start extending their rich modeling tradition to improve and extend the analysis of systems in psychology.
Topics: Humans; Psychometrics
PubMed: 35334037
DOI: 10.1007/s11336-022-09851-z -
Current Opinion in Supportive and... Sep 2019Breathlessness is a multidimensional sensation for which a range of instruments exists for children, youth and adults, capable or unable to self-report distress with... (Review)
Review
PURPOSE OF REVIEW
Breathlessness is a multidimensional sensation for which a range of instruments exists for children, youth and adults, capable or unable to self-report distress with breathing. This review presents developments and applications of multidimensional assessments of breathlessness.
RECENT FINDINGS
Excluding unidimensional measures and instruments assessing the impact of breathlessness, at least eight psychometrically robust instruments exist, which comprehensively assess one or more specific domains of the sensation of breathlessness (intensity, sensory quality, affective distress). These instruments have evolved from modest beginnings (describing breathlessness in various patient cohorts) to a growing use as primary or secondary outcomes in observational, clinical, and experimental trials exploring breathlessness mechanisms and intervention effects. For adults and children unable to autonomously communicate breathing discomfort, instruments include combinations of physiological and behavioural markers of distress. Nonverbal (graphic scales) have potential use beyond paediatric applications.
SUMMARY
Traditionally, breathlessness has been considered as a 'black box' with unidimensional measures reflecting box size (intensity, unpleasantness). Multidimensional instruments reveal the composition of the black box of breathlessness allowing detailed descriptions of an individual's breathlessness experience, quantification of sensory qualities, affective distress, and emotional responses with the potential to capture change over time and treatment effects in each dimension.
Topics: Adult; Child; Dyspnea; Emotions; Humans; Psychometrics; Quality of Life; Reproducibility of Results; Self Report; Stress, Psychological; Surveys and Questionnaires
PubMed: 31145135
DOI: 10.1097/SPC.0000000000000436 -
Nutrients Apr 2022Addictive-like eating is prevalent, but a clear conceptualization and operationalization outside of an addiction framework is lacking. By adopting a biopsychological...
Addictive-like eating is prevalent, but a clear conceptualization and operationalization outside of an addiction framework is lacking. By adopting a biopsychological framework of food reward, this study sought to develop and evaluate a brief self-report questionnaire for the trait assessment of hedonic overeating and dyscontrol. Items in the Hedonic Overeating-Questionnaire (HEDO-Q) were constructed following a rational approach and psychometrically evaluated in a large random sample from the German population ( = 2531). A confirmatory factor analysis supported the unidimensional nature of the six-item HEDO-Q with the three postulated components of wanting, liking, and dyscontrol. Psychometric properties were favorable with good corrected item-total correlations, acceptable item difficulty and homogeneity, and high internal consistency. Population norms were provided. The HEDO-Q revealed strict measurement invariance for sex and partial invariance for age and weight status. Discriminant validity was demonstrated in distinguishing participants with versus without eating disturbances or obesity. Associations with the established measures of eating disorder and general psychopathology supported the convergent and divergent validity of the HEDO-Q. This first evaluation indicates good psychometric properties of the HEDO-Q in the general population. Future validation work is warranted on the HEDO-Q's stability, sensitivity to change, and predictive and construct validity.
Topics: Factor Analysis, Statistical; Feeding and Eating Disorders; Humans; Hyperphagia; Psychometrics; Reproducibility of Results; Surveys and Questionnaires
PubMed: 35565829
DOI: 10.3390/nu14091865 -
Journal of Vestibular Research :... 2024Inertial self-motion perception is thought to depend primarily on otolith cues. Recent evidence demonstrated that vestibular perceptual thresholds (including inertial...
BACKGROUND
Inertial self-motion perception is thought to depend primarily on otolith cues. Recent evidence demonstrated that vestibular perceptual thresholds (including inertial heading) are adaptable, suggesting novel clinical approaches for treating perceptual impairments resulting from vestibular disease.
OBJECTIVE
Little is known about the psychometric properties of perceptual estimates of inertial heading like test-retest reliability. Here we investigate the psychometric properties of a passive inertial heading perceptual test.
METHODS
Forty-seven healthy subjects participated across two visits, performing in an inertial heading discrimination task. The point of subjective equality (PSE) and thresholds for heading discrimination were identified for the same day and across day tests. Paired t-tests determined if the PSE or thresholds significantly changed and a mixed interclass correlation coefficient (ICC) model examined test-retest reliability. Minimum detectable change (MDC) was calculated for PSE and threshold for heading discrimination.
RESULTS
Within a testing session, the heading discrimination PSE score test-retest reliability was good (ICC = 0. 80) and did not change (t(1,36) = -1.23, p = 0.23). Heading discrimination thresholds were moderately reliable (ICC = 0.67) and also stable (t(1,36) = 0.10, p = 0.92). Across testing sessions, heading direction PSE scores were moderately correlated (ICC = 0.59) and stable (t(1,46) = -0.44, p = 0.66). Heading direction thresholds had poor reliability (ICC = 0.03) and were significantly smaller at the second visit (t(1,46) = 2.8, p = 0.008). MDC for heading direction PSE ranged from 6-9 degrees across tests.
CONCLUSION
The current results indicate moderate reliability for heading perception PSE and provide clinical context for interpreting change in inertial vestibular self-motion perception over time or after an intervention.
Topics: Humans; Male; Female; Adult; Psychometrics; Motion Perception; Reproducibility of Results; Young Adult; Middle Aged; Head Movements; Vestibule, Labyrinth
PubMed: 38640182
DOI: 10.3233/VES-230077 -
Implementation Science : IS Aug 2020Implementation research aims to facilitate the timely and routine implementation and sustainment of evidence-based interventions and services. A glaring gap in this... (Review)
Review
BACKGROUND
Implementation research aims to facilitate the timely and routine implementation and sustainment of evidence-based interventions and services. A glaring gap in this endeavour is the capability of researchers, healthcare practitioners and managers to quantitatively evaluate implementation efforts using psychometrically sound instruments. To encourage and support the use of precise and accurate implementation outcome measures, this systematic review aimed to identify and appraise studies that assess the measurement properties of quantitative implementation outcome instruments used in physical healthcare settings.
METHOD
The following data sources were searched from inception to March 2019, with no language restrictions: MEDLINE, EMBASE, PsycINFO, HMIC, CINAHL and the Cochrane library. Studies that evaluated the measurement properties of implementation outcome instruments in physical healthcare settings were eligible for inclusion. Proctor et al.'s taxonomy of implementation outcomes was used to guide the inclusion of implementation outcomes: acceptability, appropriateness, feasibility, adoption, penetration, implementation cost and sustainability. Methodological quality of the included studies was assessed using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Psychometric quality of the included instruments was assessed using the Contemporary Psychometrics checklist (ConPsy). Usability was determined by number of items per instrument.
RESULTS
Fifty-eight publications reporting on the measurement properties of 55 implementation outcome instruments (65 scales) were identified. The majority of instruments assessed acceptability (n = 33), followed by appropriateness (n = 7), adoption (n = 4), feasibility (n = 4), penetration (n = 4) and sustainability (n = 3) of evidence-based practice. The methodological quality of individual scales was low, with few studies rated as 'excellent' for reliability (6/62) and validity (7/63), and both studies that assessed responsiveness rated as 'poor' (2/2). The psychometric quality of the scales was also low, with 12/65 scales scoring 7 or more out of 22, indicating greater psychometric strength. Six scales (6/65) rated as 'excellent' for usability.
CONCLUSION
Investigators assessing implementation outcomes quantitatively should select instruments based on their methodological and psychometric quality to promote consistent and comparable implementation evaluations. Rather than developing ad hoc instruments, we encourage further psychometric testing of instruments with promising methodological and psychometric evidence.
SYSTEMATIC REVIEW REGISTRATION
PROSPERO 2017 CRD42017065348.
Topics: Checklist; Delivery of Health Care; Health Facilities; Humans; Psychometrics; Reproducibility of Results
PubMed: 32811517
DOI: 10.1186/s13012-020-01027-6 -
Clinical Psychology Review Dec 2020The need for sustained skill development and quality assurance when executing behavioral interventions is best demonstrated in the empirical evolution of Motivational... (Review)
Review
The need for sustained skill development and quality assurance when executing behavioral interventions is best demonstrated in the empirical evolution of Motivational Interviewing (MI). As a brief behavioral intervention that identifies the therapeutic process as an active treatment ingredient, it is critical for researchers, trainers, and administrators to use psychometrically sound and theoretically congruent tools to evaluate provider skills and fidelity when executing MI. Yet, no prior work has evaluated the breadth of MI tools employed across research contexts. Therefore, this review identified MI fidelity and skill development tools across measurement, training and efficacy/effectiveness studies and evaluated their psychometric strength and fit with current MI theory. We identified 199 empirical studies that employed an MI fidelity/skill tool and we found 21 tools with varying degrees of empirical support and theoretical congruence. Specifically, we identified five observer-, two trainee- and one client-rated tool with strong empirical support, and nine observer- and two client-rated tools with preliminary empirical support. We detailed the empirical strength, including the extent to which tools were linked to trainee/client outcomes across research contexts and offer recommendations on which MI tools to use in training, efficacy, and effectiveness trials.
Topics: Behavior Therapy; Humans; Motivational Interviewing; Psychometrics
PubMed: 32920371
DOI: 10.1016/j.cpr.2020.101909 -
Nursing & Health Sciences Mar 2021This systematic review aimed to critique the process of development and psychometric properties of tools measuring respectful or disrespectful maternity care experienced... (Review)
Review
This systematic review aimed to critique the process of development and psychometric properties of tools measuring respectful or disrespectful maternity care experienced by women during labor and birth in low- and middle-income countries. The MEDLINE, Embase, CINAHL, Web of Science, PubMed, and Cochrane Library electronic databases were systematically searched from their inception to February 2020. Methodological quality was assessed using the COnsensus-based Standards for the selection of health Measurement INstruments checklist. Six tools measuring respectful maternity care during the intrapartum period were identified. Measurement error, cross-cultural validity, and responsiveness were not evaluated by any tool developers, while structural validity, internal consistency, and hypothesis testing were the most frequently assessed measurement properties. Interestingly, this review could not identify any measures of disrespectful care even though most included measures focused on disrespect and abuse. No measure was of sufficient quality to determine women's experiences of disrespectful and respectful maternity care in low- and middle-income countries. New valid and reliable measures using rigorous approaches to tool development are required.
Topics: Checklist; Female; Humans; Maternal Health Services; Maternal-Child Nursing; Parturition; Pregnancy; Psychometrics
PubMed: 32677167
DOI: 10.1111/nhs.12756 -
JAMA Health Forum Apr 2022Psychometrically robust patient-reported outcome measures (PROMs) and patient-reported experience measures (PREMs) are critical to evaluating quality and performance...
IMPORTANCE
Psychometrically robust patient-reported outcome measures (PROMs) and patient-reported experience measures (PREMs) are critical to evaluating quality and performance across health services and systems. However, the adoption and implementation of PROMs and PREMs remain a challenge in many countries. The aim of this guide is to support instrument selection and implementation to measure health system performance.
OBSERVATIONS
The guide is split into 3 step-by-step sections. Step 1: Knowing What to Measure discusses what PROMs and PREMs capture and how they differ from related instruments. Step 2: Choosing the Right Instrument describes the critical psychometric properties of validity, reliability, and responsiveness, and provides resources to support instrument selection and evaluation. Step 3: Mitigating Potential PROM and PREM Implementation Barriers outlines key barriers and supports for instrument implementation at system, service, and individual levels.
CONCLUSIONS AND RELEVANCE
This guide aims to provide practical resources for the identification of psychometrically robust PROMs and PREMs, as well as support for their implementation to drive improvements across health systems globally.
Topics: Humans; Patient Reported Outcome Measures; Psychometrics; Reproducibility of Results; Surveys and Questionnaires
PubMed: 36218960
DOI: 10.1001/jamahealthforum.2022.0326 -
Asian Nursing Research Aug 2022The aim of this paper is to develop a scale for measuring the perinatal bereavement care competence of midwives and assess its psychometric properties. (Review)
Review
PURPOSE
The aim of this paper is to develop a scale for measuring the perinatal bereavement care competence of midwives and assess its psychometric properties.
METHODS
The Perinatal Bereavement Care Competence Scale was developed in four phases. (1) Item generation: 75 items were formulated based on a literature review and interviews with midwives. (2) Delphi expert consultation: 15 experts evaluated whether the items were clear/appropriate/relevant to the questionnaire dimensions, and the items were optimized. (3) Pilot test: The comprehensibility, acceptability, and time required to complete the questionnaire by midwives were assessed. (4) Evaluation of reliability and validity: The scale was validated by initial item analysis, exploratory and confirmatory factor analyses, and internal consistency reliability and test-retest reliability.
RESULTS
The final scale consisted of six dimensions and 25 items: maintaining belief (three items), knowing (four items), being with (six items), preserving dignity (four items), enabling (five items), and self-adjustment (three items). Exploratory factor analysis yielded a six-factor structure that was consistent with the theoretical framework and explained 70.8% of the total variance. Confirmatory factor analysis indicated a good fit for the six-factor model. Cronbach's α for the scale was 0.931, and the test-retest reliability coefficient was 0.968.
CONCLUSION
The Perinatal Bereavement Care Competence Scale is a valid and reliable instrument for measuring the competence of midwives in caring for bereaved parents who have experienced perinatal loss.
Topics: Bereavement; Factor Analysis, Statistical; Female; Grief; Humans; Midwifery; Perinatal Death; Pregnancy; Professional Competence; Psychometrics; Reproducibility of Results; Surveys and Questionnaires
PubMed: 35716897
DOI: 10.1016/j.anr.2022.06.002