-
Drug and Alcohol Dependence Feb 2023Self-report measures can improve evidence-based assessment practices in substance use disorder treatment, but many measures are burdensome and costly, limiting their... (Review)
Review
BACKGROUND
Self-report measures can improve evidence-based assessment practices in substance use disorder treatment, but many measures are burdensome and costly, limiting their utility in community practice and non-specialty healthcare settings. This systematic review identified and evaluated the psychometric properties of brief, free, and readily accessible self-report measures of substance use and related factors.
METHODS
We searched two electronic databases (PsycINFO and PubMed) in May 2021 for published literature on scales, measures, or instruments related to substance use, substance use treatment, and recovery, and extracted the names of all measures. Measures were included if they were: (1) brief (25 items or fewer), (2) freely accessible in a ready-to-use format, and (3) had published psychometric data.
RESULTS
An initial search returned 411 measures, of which 73 (18%) met criteria for inclusion. Included measures assessed a variety of substances (e.g., alcohol, nicotine, opioids, cannabinoids, cocaine) and measurement domains (e.g., use, severity, expectancies, withdrawal). Among these measures, 14 (19%) were classified as psychometrically "excellent," 27 (37%) were rated as "good," 32 (44%) were "adequate."
CONCLUSIONS
Despite the shift toward evidence-based assessment in substance use disorder treatment in the last twenty years, key areas of public health concern are lacking pragmatic, psychometrically valid measures. Among the brief measures we reviewed, less than a fifth met criteria for psychometric "excellence" and most of these instruments fell into one measurement domain: screening for problematic substance use. Future research should focus both on improving the evidence base for existing brief self-report measures and creating new low-burden measures for specific substances and treatment constructs.
Topics: Humans; Self Report; Substance-Related Disorders; Delivery of Health Care; Psychometrics; Nicotine
PubMed: 36535096
DOI: 10.1016/j.drugalcdep.2022.109729 -
BMC Public Health May 2023The Burnout Assessment Tool (BAT) is a new burnout measure developed to replace the Maslach Burnout Inventory (MBI). Studies have supported the psychometric properties...
BACKGROUND
The Burnout Assessment Tool (BAT) is a new burnout measure developed to replace the Maslach Burnout Inventory (MBI). Studies have supported the psychometric properties and cross-cultural measurement invariance of the BAT. However, some unresolved questions remain. These questions are the appropriate level of score interpretation, convergent validity with the MBI, and measurement invariance using sample groups from countries outside of Europe.
METHODS
We used a cross-sectional survey approach to obtain 794 participants from Australia (n = 200), the Netherlands (n = 199), South Africa (n = 197), and the United States (n = 198). In brief, we used bifactor modelling to investigate the appropriate score interpretation and convergent validity with the MBI. Hereafter, we used the Rasch model and ordinal logistic regression to investigate differential item functioning.
RESULTS
The bifactor model showed a large general factor and four small group factors, which suggests calculating and interpreting a general burnout score. This model further shows that the BAT and MBI measure the same burnout construct but that the BAT is a more comprehensive burnout measure. Most items fit the Rasch model, and few showed non-negligible differential item functioning.
CONCLUSIONS
Our results support the psychometric properties and cross-cultural measurement invariance of the BAT in Australia, the Netherlands, South Africa, and the United States. Furthermore, we provide some clarity on the three previously mentioned unresolved questions.
Topics: Humans; Psychometrics; Cross-Sectional Studies; Reproducibility of Results; Burnout, Psychological; Burnout, Professional; Surveys and Questionnaires
PubMed: 37143022
DOI: 10.1186/s12889-023-15604-z -
Frontiers in Public Health 2022Trauma, especially severe trauma, has become a significant public health problem worldwide. This postulates higher requirements on the core competence of trauma nurses....
BACKGROUND
Trauma, especially severe trauma, has become a significant public health problem worldwide. This postulates higher requirements on the core competence of trauma nurses. However, limited scales exist to assess it validly and reliably. This study aims to develop and evaluate the psychometric properties of the Trauma Nurse Core Competency Scale (TNCCS).
METHODS
This study included three stages. First, scale development was based on a broad literature review and two rounds of Delphi expert consultation. Then, a pre-investigation was conducted with 106 trauma nurses, and a formal scale was formed. Finally, scale evaluation of reliability and validity, based on a cross-sectional study, was tested with 1,107 trauma nurses. Content validity and structure validity were used to evaluate the validity of TNCCS. The Cronbach's α coefficient and the split-half reliability coefficient were used to evaluate the reliability of TNCCS.
RESULTS
The final scale contained 46 items under three dimensions, which were Knowledge and skills (21 items), Comprehensive literacy (20 items), and Professionalism & physical and mental health (5 items). The Content Validity Index (CVI) of the total scale was 0.980. The goodness-of-fit indices (χ/df = 3.547, RMSEA = 0.065, GFI = 0.929, CFI = 0.912, NFI = 0.904, IFI = 0.929) signified a good fit for this model. The Construct Reliability (CR) ranged from 0.89 to 0.98, and the Average Variance Extracted (AVE) ranged from 0.62 to 0.69. The Cronbach's α coefficient of the scale was 0.99, ranging from 0.90 to 0.98 for the subscales. The split-half reliability coefficient was 0.84.
CONCLUSIONS
The TNCCS demonstrated good validity and reliability, and it could be used to assess the core competency of trauma nurses. The present study has valuable implications for nursing managers to take corresponding measures to train and improve the core competence of trauma nurses.
Topics: Humans; Psychometrics; Reproducibility of Results; Surveys and Questionnaires; Cross-Sectional Studies
PubMed: 36523571
DOI: 10.3389/fpubh.2022.959176 -
Headache Jan 2020The short-form Headache Impact Test (HIT-6) is a widely used patient-reported outcome measure that assesses the negative effects of headaches on normal activity. It was... (Review)
Review
BACKGROUND
The short-form Headache Impact Test (HIT-6) is a widely used patient-reported outcome measure that assesses the negative effects of headaches on normal activity. It was developed using the general headache population and prior to the establishment of the now well-accepted FDA patient-reported guidance.
OBJECTIVE
The objective of this narrative review was to examine existing qualitative research in patients with migraine and headache, providing insight into the relevance and meaningfulness of HIT-6 items to the lives of migraine patients.
METHODS
Articles were identified through database searches (National Library of Medicine and Google Scholar) and review of reference lists of candidate articles.
RESULTS
A total of 3227 articles were identified through database and hand searching. Of these, 12 contained patient- or expert-generated qualitative information regarding headache patients' experience (8 specific to migraine [episodic and chronic] patients and 4 citing general headache patients). The combined publications described a total of 283 patient interviews. Overarching themes and specific information were identified that provide support of the relevance of content for each HIT-6 item to migraine patients' lives. Identified effects of headaches on patients with migraine included limitations in daily activities, needing to lie down during headaches, feeling tired, being irritated by headaches, difficulty concentrating, and the experience of pain. Further, previous research specific to the HIT-6 indicated that patients understood the instructions, items, and response scales as intended by the instrument authors.
CONCLUSIONS
This narrative literature review demonstrates qualitative research support for the relevance of the items of the HIT-6 in migraine patients, supporting its ongoing use in clinical migraine research and practice.
Topics: Humans; Migraine Disorders; Patient Reported Outcome Measures; Psychometrics; Qualitative Research; Quality of Life; Reproducibility of Results
PubMed: 31811654
DOI: 10.1111/head.13701 -
BMC Geriatrics Jun 2022The Dyspnoea-12 (D12) and Multidimensional dyspnea profile (MDP) are commonly used instruments for assessing multiple dimensions of breathlessness but have not been...
BACKGROUND
The Dyspnoea-12 (D12) and Multidimensional dyspnea profile (MDP) are commonly used instruments for assessing multiple dimensions of breathlessness but have not been validated in older people in the population. The aim of this study was to validate the D12 and MDP in 73-years old men in terms of the instruments' underlying factor structures, internal consistency, and validity.
METHODS
A postal survey was sent out to a population sample of 73-years old men (n = 1,193) in southern Sweden. The two-factor structures were evaluated with confirmatory factor analysis, internal consistency with Cronbach's alpha, and validity using Pearson´s correlations with validated scales of breathlessness, anxiety, depression, fatigue, physical/mental quality of life, body mass index (BMI), and cardiorespiratory disease.
RESULTS
A total 684 men were included. Respiratory and cardiovascular disease were reported by 17% and 38%, respectively. For D12 and MDP, the proposed two-factor structure was not fully confirmed in this population. Internal consistency was excellent for all D12 and MDP domain scores (Cronbach's alpha scores > 0.92), and the instruments' domains showed concurrent validity with other breathlessness scales, and discriminant validity with anxiety, depression, physical/mental quality of life, BMI, and cardiorespiratory disease.
CONCLUSIONS
In a population sample of 73-years old men, the D12 and MDP had good psychometrical properties in terms of reliability and validity, which supports that the instruments are valid for use in population studies of older men.
Topics: Aged; Dyspnea; Humans; Male; Psychometrics; Quality of Life; Reproducibility of Results; Sweden
PubMed: 35655151
DOI: 10.1186/s12877-022-03166-5 -
Psychometric assessment of the Persian version of the protective factors of resilience scale (PFRS).Brain and Behavior Jul 2023Resilience is defined as an individual's ability to recover from difficulties and overcome challenges and adversity. Recognizing and measuring internal and external...
BACKGROUND
Resilience is defined as an individual's ability to recover from difficulties and overcome challenges and adversity. Recognizing and measuring internal and external protective factors have been identified as important processes for building resilience, yet to date, no valid, and reliable scales of resilience in the Persian language have been developed that recognize both internal and external protective factors.
METHODS
The present study was to translate the protective factors of resilience scale (PFRS) from English to Persian and analyze its psychometric properties among Iranians. Convenience sampling was used to gather data from January 2021 to February 2021 through digital internet scales, and 6 scales, including PFRS, Ryff's psychological well-being scale, Rosenberg self-esteem scale, life orientation test-revised, positive and negative affect schedule, and short version of resilience scale (RS), were completed by 265 participants aged from 15 to 56. So, the aim of this study is to investigate the psychometric properties of protective factors of resilience scale among Iranians.
RESULTS
The results of the face, content, and construct validity revealed that the Persian version of the PFRS measure had acceptable validity and reliability. The Cronbach alpha for the whole scale was 0.88, and the value of the content validity index was above 0.7. A confirmatory factor analysis confirmed the three-factor structure model of the scale (fit indices: CMIN/df = 2.51, p < .01; comparative fit index = 0.94, goodness of fit index = 0.90, root mean squared error of approximation = 0.07).
CONCLUSION
In conclusion, the Persian version of the protective factors of resilience is a reliable and valid measurement to assess the protective factors and internal and external protective factors of resilience in Iranians.
Topics: Humans; Psychometrics; Iran; Reproducibility of Results; Protective Factors; Surveys and Questionnaires; Translating
PubMed: 37246489
DOI: 10.1002/brb3.3061 -
Child Abuse & Neglect May 2022Research has consistently shown a relationship between adverse childhood experiences (ACEs) and poor mental health outcomes, and recent research shows that sexual and...
Development and psychometric properties of the sexual and gender minority adverse childhood experiences (SGM-ACEs): Effect on sexual and gender minority adult mental health.
BACKGROUND
Research has consistently shown a relationship between adverse childhood experiences (ACEs) and poor mental health outcomes, and recent research shows that sexual and gender minority (SGM) individuals are at increased risk for ACEs. Moreover, SGM individuals may experience unique ACEs. Increased risk for exposure to traditional and SGM-specific ACEs are related to heterosexism.
OBJECTIVE
The purpose of this paper is two-fold. First, establish the need for an SGM specific ACEs framework that accounts for exposure to heterosexism. Second, assess the psychometric properties of the SGM-ACEs scale.
PARTICIPANTS AND SETTING
Data were collected using a multifaceted sampling strategy. In total, 1725 self-identified SGM Texans completed an online survey about ACEs, SGM-ACEs, mental health diagnoses, and demographic characteristics.
RESULTS
The most commonly reported SGM-ACEs were seeing or hearing of other SGM being physical harmed (71.2%), being bullied in school for being SGM (67.9%), and hearing religious leaders say homophobic, biphobic, or transphobic things (60.8%). The EFA showed that 7-items loaded onto a single factor and the CFA indicated a good model fit, with items showing a significant factor loading higher than 0.60. SGM-ACE showed adequate to good psychometric properties and predicted depression (AOR = 1.49, CI = 1.20, 1.86), anxiety (AOR = 1.61, CI = 1.25, 2.00), and PTSD (AOR = 1.97, CI = 1.47, 2.66), when controlling for ACEs and demographic factors.
CONCLUSIONS
The 7-item SGM-ACEs measure is a psychometrically sound and unidimensional measure that can be quickly used to assess common adverse childhood experiences related to heterosexism.
Topics: Adult; Adverse Childhood Experiences; Gender Identity; Humans; Mental Health; Psychometrics; Sexual and Gender Minorities
PubMed: 35231816
DOI: 10.1016/j.chiabu.2022.105570 -
Schizophrenia Bulletin Jan 2021Negative symptoms are a critical, but poorly understood, aspect of schizophrenia. Measurement of negative symptoms primarily relies on clinician ratings, an endeavor...
Negative symptoms are a critical, but poorly understood, aspect of schizophrenia. Measurement of negative symptoms primarily relies on clinician ratings, an endeavor with established reliability and validity. There have been increasing attempts to digitally phenotype negative symptoms using objective biobehavioral technologies, eg, using computerized analysis of vocal, speech, facial, hand and other behaviors. Surprisingly, biobehavioral technologies and clinician ratings are only modestly inter-related, and findings from individual studies often do not replicate or are counterintuitive. In this article, we document and evaluate this lack of convergence in 4 case studies, in an archival dataset of 877 audio/video samples, and in the extant literature. We then explain this divergence in terms of "resolution"-a critical psychometric property in biomedical, engineering, and computational sciences defined as precision in distinguishing various aspects of a signal. We demonstrate how convergence between clinical ratings and biobehavioral data can be achieved by scaling data across various resolutions. Clinical ratings reflect an indispensable tool that integrates considerable information into actionable, yet "low resolution" ordinal ratings. This allows viewing of the "forest" of negative symptoms. Unfortunately, their resolution cannot be scaled or decomposed with sufficient precision to isolate the time, setting, and nature of negative symptoms for many purposes (ie, to see the "trees"). Biobehavioral measures afford precision for understanding when, where, and why negative symptoms emerge, though much work is needed to validate them. Digital phenotyping of negative symptoms can provide unprecedented opportunities for tracking, understanding, and treating them, but requires consideration of resolution.
Topics: Behavior Rating Scale; Female; Humans; Interview, Psychological; Male; Middle Aged; Phenotype; Psychiatric Status Rating Scales; Psychometrics; Schizophrenia
PubMed: 32467967
DOI: 10.1093/schbul/sbaa065 -
Nursing Open Sep 2023To conduct, translate, and psychometric evaluation of the MISSCARE-Persian Survey.
AIM
To conduct, translate, and psychometric evaluation of the MISSCARE-Persian Survey.
DESIGN
A cross-sectional study was conducted in Iran in February-June 2021.
METHODS
The translation of the MISSCARE Survey was accomplished according to World Health Organization (WHO) guidelines. Construct validity was performed by (N = 300) exploratory factor analysis and confirmation. To assess the reliability, internal consistency was assessed using Cronbach's alpha coefficient, and relative stability was assessed using the interclass correlation coefficient (ICC). The study adhered to COSMIN guidelines.
RESULTS
The exploratory factor analysis, which resulted in the identification of three factors in the second part of the tool, explained 79.6% of the total variance. Confirmatory factor analysis indicated the model's good fit of information. The reliability of the first and second parts of the tool was 0.912 and 0.901, respectively. Additionally, the ICC was found to be 0.687 for the first and 0.706 for the second part of the tool.
Topics: Psychometrics; Cross-Sectional Studies; Reproducibility of Results; Surveys and Questionnaires; Translations
PubMed: 37565382
DOI: 10.1002/nop2.1827 -
Brain and Behavior Feb 2023Side effects in psychotherapy are common and have a negative impact on patients or clients. However, effective evaluation tools are still lacking and have not been fully...
BACKGROUND
Side effects in psychotherapy are common and have a negative impact on patients or clients. However, effective evaluation tools are still lacking and have not been fully studied. The present study aims to develop a scale with good reliability and validity to measure the side effects of psychotherapy.
METHODS
The 25 items in the Psychotherapy Side Effects Scale (PSES) were condensed and distributed to 420 subjects online to test its psychometric properties.
RESULTS
The internal consistency of the PSES was satisfactory to excellent (Cronbach's ɑ coefficient was .95, and the Guttman split-half coefficient was 0.88). A statistically significant negative correlation between the satisfaction score and the total score of the PSES was shown (r = -0.51, p < .001). The PSES could effectively discriminate between two groups with and without side effects (F = 250.95, p < .001) and was able to predict the occurrence of side effects in psychotherapy with an area under curve of 0.932 and a 95% confidence interval of 0.900-0.964 (p < .001). A cutoff was set at 36 points in total PSES score, from which the maximum Youden's index (= 0.72) could be obtained. The positive rate of the PSES was 24% (101/420).
CONCLUSION
The PSES showed good internal consistency, content validity, concurrent validity, discriminant validity and predictive validity in evaluating and identifying side effects in psychotherapy. More advanced reliability testing methods and structural validity testing for PESE need to be practiced in the future to better serve clinical practice.
Topics: Humans; Surveys and Questionnaires; Psychometrics; Reproducibility of Results; Psychotherapy
PubMed: 36621871
DOI: 10.1002/brb3.2885