-
Trauma, Violence & Abuse Jul 2024Despite the available evidence identifying the high prevalence rates of potentially traumatic experiences in forensic populations, there is still a lack of evidence... (Review)
Review
Despite the available evidence identifying the high prevalence rates of potentially traumatic experiences in forensic populations, there is still a lack of evidence supporting the use of suitable assessment tools, especially for young males in custody. For services to identify, support, and offer trauma interventions to this cohort, practitioners require reliable and valid assessment tools. This systematic review (Open Science Framework registration: https://osf.io/r6hbk) identifies those tools able to provide valid, reliable, and comparable data for this cohort. Five electronic databases and gray literature were searched to identify relevant measures. Inclusion criteria: studies of tools to assess for trauma with males aged between 12 and 25 years-old in a custodial setting, any year of publication, and available in English. Exclusion criteria: studies that did not measure psychological trauma or include a standalone trauma scale, or report primary data. A three-step quality assessment method was used to evaluate the methodological quality and psychometric properties of the measures. Fourteen studies were selected for review (which included 12 measures). The studies sampled a total of approximately 1,768 male participants and an age range of 12 to 25 years. The studies reported on various types of psychometric evidence and due to the lack of homogeneity, a narrative synthesis was used to discuss, interpret, and evaluate each measure. The overall quality of the psychometric properties of the measures in this review showed that the currently available instruments for the assessment of trauma with young males in custody is limited but promising.
Topics: Humans; Male; Adolescent; Child; Young Adult; Adult; Psychometrics; Prisoners; Mass Screening; Psychological Trauma
PubMed: 38158802
DOI: 10.1177/15248380231219251 -
Arhiv Za Higijenu Rada I Toksikologiju 2022In the absence of internationally recognised standardised criteria, several patient-reported outcome measures (PROMs) have been developed to measure occupational...
In the absence of internationally recognised standardised criteria, several patient-reported outcome measures (PROMs) have been developed to measure occupational burnout. The aim of this study was to extend our 2021 review of the psychometric validity of five PROMs to the Shirom-Melamed Burnout Measure (SMBM) and the Burnout Assessment Tool (BAT). To do that we ran a systematic literature search in the MEDLINE, PsycINFO, and Embase databases following our previous methodological framework and the COnsensus-based Standards for the selection of health Measurement Instruments (COSMIN). We assessed the level of evidence using the Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) guideline. We identified 694 publications on SMBM and 421 on BAT, but the final review includes eight papers on SMBM and three on BAT. Of the seven psychometric properties assessed for SMBM, content, structural, and criterion validity were rated as insufficient, whereas the quality of evidence for construct and internal consistency was high and moderate, respectively. Of the nine psychometric properties assessed for BAT, content, structural, criterion, and construct validity was moderate and internal consistency was high. One limitation of this study is that we did not assess cross-cultural validity, because the number of studies reviewed is too small and content validity can only be assessed based on the original PROM version rather than translation. To conclude, BAT is superior to SMBM in terms of psychometric validity, but the quality of evidence for some properties is low or very low, suggesting a need for additional validation studies.
Topics: Humans; Burnout, Professional; Psychometrics; Burnout, Psychological; Surveys and Questionnaires
PubMed: 38146759
DOI: 10.2478/aiht-2023-74-3769 -
Medical Journal of the Islamic Republic... 2023Due to the prevalence of autism spectrum disorder (ASD), these children must be screened as soon as possible and receive the necessary and appropriate treatment. The... (Review)
Review
BACKGROUND
Due to the prevalence of autism spectrum disorder (ASD), these children must be screened as soon as possible and receive the necessary and appropriate treatment. The purpose of this study was to examine all the ASD screening tools and examine their psychometric properties in available languages.
METHODS
This was a systematic review using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines to review the articles published between 2000 and 2023 and were published in PubMed, EMBASE, ProQuest, and Scopus databases. English keywords were as follows: autism spectrum disorders (ASD), screening/screen, tools, psychometric properties, validity, reliability, translations, pervasive developmental disorders (PDD), and children. The COnsensus -based Standards for the selection of health Measurement Instruments (COSMIN) checklist were used to investigate the psychometric properties of the studies.
RESULTS
Among the 476 primary studies, 35 ASD screening tools (132 articles related to the psychometric properties of 35 ASD screening tools in different languages) were identified based on our criteria, and their psychometric properties were examined. Various tools, including performance-based, direct observation, interactive play, and parent and teacher reports tools, were included in the list of tools.
CONCLUSION
Considering that each of these tools has advantages and limitations, they need to be selected and used according to the goals of the researchers and the therapists. Another important point is that many of these tools still need more extensive studies in relation to their psychometric properties.
PubMed: 38145177
DOI: 10.47176/mjiri.37.117 -
Brain Sciences Nov 2023Anxiety and stress plague populations worldwide. Voluntary regulated breathing practices offer a tool to address this epidemic. We examined peer-reviewed published... (Review)
Review
Anxiety and stress plague populations worldwide. Voluntary regulated breathing practices offer a tool to address this epidemic. We examined peer-reviewed published literature to understand effective approaches to and implementation of these practices. PubMed and ScienceDirect were searched to identify clinical trials evaluating isolated breathing-based interventions with psychometric stress/anxiety outcomes. Two independent reviewers conducted all screening and data extraction. Of 2904 unique articles, 731 abstracts, and 181 full texts screened, 58 met the inclusion criteria. Fifty-four of the studies' 72 interventions were effective. Components of effective and ineffective interventions were evaluated to develop a conceptual framework of factors associated with stress/anxiety reduction effectiveness. Effective breath practices avoided fast-only breath paces and sessions <5 min, while including human-guided training, multiple sessions, and long-term practice. Population, other breath paces, session duration ≥5 min, and group versus individual or at-home practices were not associated with effectiveness. Analysis of interventions that did not fit this framework revealed that extensive standing, interruptions, involuntary diaphragmatic obstruction, and inadequate training for highly technical practices may render otherwise promising interventions ineffective. Following this evidence-based framework can help maximize the stress/anxiety reduction benefits of breathing practices. Future research is warranted to further refine this easily accessible intervention for stress/anxiety relief.
PubMed: 38137060
DOI: 10.3390/brainsci13121612 -
Healthcare (Basel, Switzerland) Dec 2023This systematic review and reliability generalization meta-analysis synthesized psychometric literature on instrumentation assessing child-to-parent violence published... (Review)
Review
This systematic review and reliability generalization meta-analysis synthesized psychometric literature on instrumentation assessing child-to-parent violence published through September 2023 across four databases. In the screening, we identified studies reporting Cronbach's alpha internal consistency estimates for the child-to-parent violence scales. The eligible reliability coefficients ranged from 0.610 to 0.930, mostly exceeding the minimum threshold of 0.700. Random-effects models calculated pooled Cronbach's alphas separately for global, father-specific, and mother-specific subscales. The results demonstrated cumulative values of 0.83 (global: standard error = 0.0129), 0.800 (fathers: standard error = 0.0203), and 0.81 (mothers: standard error = 0.0179), denoting largely adequate reliability. However, significant between-study heterogeneity was observed. While the mean alpha levels seem acceptable for most tools, substantial variability coupled with the possibility of some studies violating reliability assumptions indicates that a conservative interpretation is warranted. Ongoing scale refinement and additional psychometric evaluations will strengthen the rigor methodology in this developing research domain. However, these results should be interpreted with caution, as there is a high level of heterogeneity, and it is possible that some studies have not verified the assumptions underlying Cronbach's alpha.
PubMed: 38132082
DOI: 10.3390/healthcare11243192 -
Journal of Eating Disorders Dec 2023Although eating disorder (ED) models display some differences in theory and treatment approach, cognitive-behavioural, schema-focused, and disorder-specific models all...
BACKGROUND
Although eating disorder (ED) models display some differences in theory and treatment approach, cognitive-behavioural, schema-focused, and disorder-specific models all highlight the fundamental nature of cognitions as key factors in ED development and maintenance processes. As such, it is vital that ED cognitions continue to be assessed and monitored as therapeutic targets and treatment outcomes as well as being examined as constructs in empirical research. This review aimed to systematically identify and evaluate the psychometric properties of existing self-report measures of ED cognitions.
METHODS
A systematic review protocol was registered using the international prospective register of systematic reviews (PROSPERO; CRD42023440840). Included studies described the development, validation and/or the psychometric evaluation of a measure (or subscale) that was specifically developed to solely assess ED cognitions (that is thoughts, expectations, assumptions, or beliefs), in English-speaking, adult populations. The search was conducted using three electronic databases: PsycINFO, MedLine, and Embase. Two independent reviewers conducted screening, selection and evaluation of the psychometric properties of relevant measures using a standardised, well-established quality appraisal tool.
RESULTS
Of the initial search of 7581 potential studies, 59 met inclusion criteria and described the psychometric evaluation of 31 measures (or subscales) of ED cognitions. The findings from the current review indicate that of the included measures, none currently meet all nine criteria of adequate psychometric properties. The Eating Beliefs Questionnaire (EBQ; and EBQ-18), and the Eating Disorder Inventory Body Dissatisfaction subscale (EDI [BD]) currently possess the most evidence supporting their validity, reliability, and clinical utility.
CONCLUSIONS
The findings of the current systematic review provide guidance for future researchers to focus efforts on improving evidence for the validity, reliability and utility of self-report measures of ED cognitions. Overall, the present study has provided a detailed and systematic evaluation to support researchers and clinicians in future selection of measures of ED cognitions dependent on the specific aims of their research and treatment.
PubMed: 38124134
DOI: 10.1186/s40337-023-00947-0 -
Dementia (London, England) Feb 2024Individualised goal-setting outcome measures can be a useful way of reflecting people living with dementia and family carers' differing priorities regarding...
Setting individualised goals for people living with dementia and their family carers: A systematic review of goal-setting outcome measures and their psychometric properties.
BACKGROUND
Individualised goal-setting outcome measures can be a useful way of reflecting people living with dementia and family carers' differing priorities regarding quality-of-life domains in the highly heterogeneous symptomatology of the disease. Evaluating goal-setting measures is challenging, and there is limited evidence for their psychometric properties.
AIM
(1) To describe what goal-setting outcomes have been used in this population; (2) To evaluate their validity, reliability, and feasibility in RCTs.
METHOD
We systematically reviewed studies that utilised goal-setting outcome measures for people living dementia or their family carers. We adapted a risk of bias and quality rating system based on the COSMIN guidelines to evaluate the measurement properties of outcomes when used within RCTs.
RESULTS
Thirty studies meeting inclusion criteria used four different goal-setting outcome measures: Goal Attainment Scaling (GAS), Bangor Goal Setting Interview (BGSI), Canadian Occupational Performance Measure (COPM) and Individually Prioritized Problems Assessment (IPPA); other papers have reported study-specific goal-setting attainment systems. Only GAS has been used as an outcome over periods greater than 9 months (up to a year). Within RCTs there was moderate quality evidence for sufficient content validity and construct validity for GAS, COPM and the BGSI. Reliability was only assessed in one RCT (using BGSI); in which two raters reviewed interview transcripts to rate goals with excellent inter-rater reliability. Feasibility was reported as good across the measures with a low level of missing data.
CONCLUSION
We found moderate quality evidence for good content and construct validity and feasibility of GAS, BGSI and COPM. While more evidence of reliability of these measures is needed, we recommend that future trials consider using individualised goal setting measures, to report the effect of interventions on outcomes that are most meaningful to people living with dementia and their families.
Topics: Humans; Caregivers; Dementia; Goals; Outcome Assessment, Health Care; Psychometrics; Reproducibility of Results
PubMed: 38105445
DOI: 10.1177/14713012231222309 -
PloS One 2023The increasing recognition of the complex impacts of a cancer diagnosis and its treatment has led to efforts to develop instruments to reflect survivors' needs...
PURPOSE
The increasing recognition of the complex impacts of a cancer diagnosis and its treatment has led to efforts to develop instruments to reflect survivors' needs accurately. However, evidence regarding the content and quality of instruments used to evaluate the unmet needs of lymphoma survivors is lacking. This review aimed to evaluate the psychometric properties and comprehensiveness of available self-report instruments to assess unmet needs and quality of life with adult lymphoma survivors.
METHODS
A systematic search of five databases (CINAHL, EMBASE, Medline, PsycInfo and Scopus) was conducted to identify instruments measuring unmet needs or quality of life outcomes. Original articles reporting the instrument's validation or development via citation screening were retrieved and screened against eligibility criteria. An appraisal of the instrument's measurement properties was conducted, guided by the COSMIN methodology and reported in accordance with PRISMA guidelines. A content comparison using the Supportive Care in Cancer Framework was performed.
RESULTS
Twelve instruments met the inclusion criteria; only one was explicitly developed for lymphoma (Functional Assessment of Cancer Therapy-Lymphoma). Four instruments focused on the construct of need, and eight focused on quality of life. The psychometric data in the published literature is not comprehensive; there is heterogeneity in their development, content and quality. No included instrument was examined for all COSMIN measurement properties, and methodological quality was variable; all instruments measured at least four domains of need. The emotional domain was reviewed by all instruments (n = 12), and the spiritual and informational domains received the least focus (n = 4 each).
CONCLUSION
This review provides a platform for instrument comparison, with suggestions for important factors to consider in systematically selecting unmet needs and quality of life self-report measures for adult lymphoma survivors. Considering the various discrepancies and limitations of the available instruments, using more than one instrument is recommended. In selecting measurement instruments, researchers should consider research objectives, study design, psychometric properties and the pros and cons of using more than one measure. Evaluating the participant burden and feasibility of completing the selected instrument is important for lymphoma survivors, a group burdened by cancer-related fatigue and cognitive impairment.
Topics: Adult; Humans; Quality of Life; Self Report; Cancer Survivors; Neoplasms; Lymphoma; Psychometrics; Reproducibility of Results
PubMed: 38100450
DOI: 10.1371/journal.pone.0290729 -
ACR Open Rheumatology Feb 2024Examine psychometric properties of frailty instruments used in adults with rheumatoid arthritis (RA) to inform selection of frailty instruments for clinical and research...
OBJECTIVE
Examine psychometric properties of frailty instruments used in adults with rheumatoid arthritis (RA) to inform selection of frailty instruments for clinical and research use.
METHODS
A systematic review was registered in PROSPERO. Studies measuring frailty in adults with RA published before May 25, 2022, were searched in six electronic databases. Level of evidence of psychometric properties were synthesized and graded for each frailty instrument using Consensus-Based Standards for the Selection of Health Measurement Instruments methodology.
RESULTS
There were 22 articles included in the review, and psychometric properties of 16 frailty instruments were examined. RA cohorts were predominantly female with moderate RA disease activity, mean age was 60.1 years, and frailty prevalence ranged widely from 10% to 85%. Construct validity was the only psychometric property routinely examined for frailty instruments in RA, and nearly all (14/16) performed favorably in this domain. Frailty correlated most frequently with older age, higher RA disease activity, and worse physical function. Internal consistency, measurement error, and content validity were examined infrequently. Reliability and responsiveness data were not reported. Six frailty instruments were rated highest in adults with RA: three adaptations of Fried's Criteria, 32-Item and 45-Item Frailty Indexes, and the Comprehensive Rheumatologic Assessment of Frailty.
CONCLUSION
Six frailty instruments possessed the highest-rated psychometric properties in RA. These instruments demonstrated construct validity of frailty with important outcomes in RA. Frailty assessment shows promise to inform risk stratification in RA, but studies are needed to evaluate reliability, responsiveness, and validity to support accuracy of frailty measurement in adults with RA who may have disease-related features that differentially impact outcomes.
PubMed: 38083820
DOI: 10.1002/acr2.11640 -
Journal of Deaf Studies and Deaf... Mar 2024There is great variability in the ways in which the speech intelligibility of d/Deaf and hard-of-hearing (DHH) children who use spoken language as part, or all, of their...
There is great variability in the ways in which the speech intelligibility of d/Deaf and hard-of-hearing (DHH) children who use spoken language as part, or all, of their communication system is measured. This systematic review examined the measures and methods that have been used when examining the speech intelligibility of children who are DHH and the characteristics of these measures and methods. A systematic database search was conducted of CENTRAL; CINAHL; Cochrane; ERIC; Joanna Briggs; Linguistics, Language and Behavior Abstracts; Medline; Scopus; and Web of Science databases, as well as supplemental searches. A total of 204 included studies reported the use of many different measures/methods which measured segmental aspects of speech, with the most common being Allen et al.'s (2001, The reliability of a rating scale for measuring speech intelligibility following pediatric cochlear implantation. Otology and Neurotology, 22(5), 631-633. https://doi.org/10.1097/00129492-200109000-00012) Speech Intelligibility Rating scale. Many studies included insufficient details to determine the measure that was used. Future research should utilize methods/measures with known psychometric validity, provide clear descriptions of the methods/measures used, and consider using more than one measure to account for limitations inherent in different methods of measuring the speech intelligibility of children who are DHH, and consider and discuss the rationale for the measure/method chosen.
Topics: Child; Humans; Speech Intelligibility; Deafness; Persons With Hearing Impairments; Reproducibility of Results; Cochlear Implantation; Speech Perception; Cochlear Implants
PubMed: 38079579
DOI: 10.1093/deafed/enad054