-
Amyotrophic Lateral Sclerosis &... Feb 2024This systematic review provides an updated summary of the existing literature on the validity of screening tools for cognitive and behavioral impairment in people with... (Review)
Review
This systematic review provides an updated summary of the existing literature on the validity of screening tools for cognitive and behavioral impairment in people with Amyotrophic Lateral Sclerosis (pwALS), and also focuses on their reliability. The following cognitive and behavioral screening tools were assessed in this review: the Edinburgh Cognitive and Behavioral ALS Screen (ECAS); the ALS Cognitive Behavioral Screen (ALS-CBS), the Mini Addenbrooke's Cognitive Examination (Mini-ACE), the Beaumont Behavioral Interview (BBI); the MND Behavior Scale (MiND-B); and the ALS-FTD Questionnaire (ALS-FTD-Q). A search, using Medline, PsychINFO and Embase (21/09/2023), generated 37 results after exclusion criteria were applied. Evidence of internal consistency, item-total correlations, inter-rater reliability, clinical validity, convergent validity, and structural validity were extracted and assessed and risk of bias was evaluated. The cognitive component of the ECAS was the tool with most evidence of reliability and validity for the assessment of cognitive impairment in ALS. It is well-suited to accommodate physical symptoms of ALS. For behavioral assessment, the BBI or ALS-FTD-Q had the most evidence of reliability and validity. The BBI is more thorough, but the ALS-FTD-Q is briefer. There is good but limited evidence for the reliability and validity of cognitive and behavioral screens. Further evidence of clinical and convergent validity would increase confidence in their clinical and research use.
PubMed: 38415696
DOI: 10.1080/21678421.2024.2314063 -
JMIR Serious Games Feb 2024Neuropsychological assessments traditionally include tests of executive functioning (EF) because of its critical role in daily activities and link to mental disorders.... (Review)
Review
BACKGROUND
Neuropsychological assessments traditionally include tests of executive functioning (EF) because of its critical role in daily activities and link to mental disorders. Established traditional EF assessments, although robust, lack ecological validity and are limited to single cognitive processes. These methods, which are suitable for clinical populations, are less informative regarding EF in healthy individuals. With these limitations in mind, immersive virtual reality (VR)-based assessments of EF have garnered interest because of their potential to increase test sensitivity, ecological validity, and neuropsychological assessment accessibility.
OBJECTIVE
This systematic review aims to explore the literature on immersive VR assessments of EF focusing on (1) EF components being assessed, (2) how these assessments are validated, and (3) strategies for monitoring potential adverse (cybersickness) and beneficial (immersion) effects.
METHODS
EBSCOhost, Scopus, and Web of Science were searched in July 2022 using keywords that reflected the main themes of VR, neuropsychological tests, and EF. Articles had to be peer-reviewed manuscripts written in English and published after 2013 that detailed empirical, clinical, or proof-of-concept studies in which a virtual environment using a head-mounted display was used to assess EF in an adult population. A tabular synthesis method was used in which validation details from each study, including comparative assessments and scores, were systematically organized in a table. The results were summed and qualitatively analyzed to provide a comprehensive overview of the findings.
RESULTS
The search retrieved 555 unique articles, of which 19 (3.4%) met the inclusion criteria. The reviewed studies encompassed EF and associated higher-order cognitive functions such as inhibitory control, cognitive flexibility, working memory, planning, and attention. VR assessments commonly underwent validation against gold-standard traditional tasks. However, discrepancies were observed, with some studies lacking reported a priori planned correlations, omitting detailed descriptions of the EF constructs evaluated using the VR paradigms, and frequently reporting incomplete results. Notably, only 4 of the 19 (21%) studies evaluated cybersickness, and 5 of the 19 (26%) studies included user experience assessments.
CONCLUSIONS
Although it acknowledges the potential of VR paradigms for assessing EF, the evidence has limitations. The methodological and psychometric properties of the included studies were inconsistently addressed, raising concerns about their validity and reliability. Infrequent monitoring of adverse effects such as cybersickness and considerable variability in sample sizes may limit interpretation and hinder psychometric evaluation. Several recommendations are proposed to improve the theory and practice of immersive VR assessments of EF. Future studies should explore the integration of biosensors with VR systems and the capabilities of VR in the context of spatial navigation assessments. Despite considerable promise, the systematic and validated implementation of VR assessments is essential for ensuring their practical utility in real-world applications.
PubMed: 38407958
DOI: 10.2196/50282 -
Children (Basel, Switzerland) Jan 2024Reactive attachment disorder (RAD) and disinhibited social engagement disorder (DSED) manifest in individuals facing attachment system challenges, particularly observed... (Review)
Review
A Systematic Review on Assessing Assessments: Unveiling Psychometric Properties of Instruments for Reactive Attachment Disorder and Disinhibited Social Engagement Disorder in Minors under Protective Measures.
BACKGROUND
Reactive attachment disorder (RAD) and disinhibited social engagement disorder (DSED) manifest in individuals facing attachment system challenges, particularly observed in minors under protective measures. The lack of standardized tools for assessing these difficulties and uncertainty about the most effective instruments from a psychometric perspective prompted this study.
AIM
Using the COSMIN checklist, we systematically reviewed instruments assessing RAD, adhering to PRISMA.
METHODOLOGY
Examined tools included the Disturbance Attachment Interview, Preschool Age Psychiatric Assessment, Relationship Patterns Questionnaire, Assessment of RAD and DSED, Development and Well-Being Assessment, and Reactive Attachment Disorder Questionnaire.
RESULTS
Of the 10 articles analyzed, the results highlight a research emphasis on internal consistency and structural and construct validity, sidelining other properties.
CONCLUSION
Most articles review structural validity and internal consistency. These measures are satisfactory but insufficiently evaluated. It is necessary to evaluate these tools using other indicators such as cross-cultural validity, measurement error, or responsiveness in adolescents under protective measures.
PubMed: 38397256
DOI: 10.3390/children11020144 -
PloS One 2024This systematic review aimed to establish the extent to which each Attention Deficit/Hyperactivity Disorder (ADHD) symptom criterion is being assessed without being...
This systematic review aimed to establish the extent to which each Attention Deficit/Hyperactivity Disorder (ADHD) symptom criterion is being assessed without being influenced (biased) by factors such as informant, sex/gender, and age. Measurement invariance (MI) testing using confirmatory factor analysis (CFA) is the prime statistical method to ascertain how these factors may affect the measurement and colour the perception or interpretation of symptom criteria. Such effects (non-invariance) can be operationalised in the form of altered association of a symptom criterion with the measured trait (expressed via variations in CFA loadings which represent the weight of each symptom criterion) due to the factor(s) and/or artificially alter the probability of endorsement of a particular symptom criterion (expressed via variations in the CFA threshold(s) representing how mild or severe a given symptom is). Based on a pre-registered protocol (CRD42022276105), we searched PubMed, Global Health, Embase and PsycInfo up to 21-02-23 for studies that included MI assessments on specific ADHD symptom criteria in individuals aged 0-18 years old, using parental and/or teacher report. Self-reports were excluded, given the poor reliability of self-report in ADHD. All included studies met specific COnsensus-based Standards for the selection of health Measurement Instruments (COSMIN) criteria. Results were synthesised in tabular form, grouping results by factors (e.g. informant) from 44 studies retained. Most comparisons indicated both metric (same loadings) and scalar invariance (same thresholds) with regard to informant, gender, age, temporal (repeated assessments) and co-morbidity. Therefore, the available evidence supports the current diagnostic criteria. However, findings could have been improved by systematic reporting of the direction of bias and its effect size. There appears to be a bias towards reporting MI instead of non-invariance. More studies in the literature are needed where the amalgamation of information provided by different informs and the association of specific symptoms with comorbidity are analysed.
Topics: Child; Humans; Adolescent; Infant, Newborn; Infant; Child, Preschool; Attention Deficit Disorder with Hyperactivity; Reproducibility of Results; Parents; Educational Personnel
PubMed: 38394179
DOI: 10.1371/journal.pone.0293677 -
BMJ Open Feb 2024To review patient-report/caregiver-report measures of rehabilitation service use following acquired brain injury (ABI).
OBJECTIVE
To review patient-report/caregiver-report measures of rehabilitation service use following acquired brain injury (ABI).
DATA SOURCES
Medline, APA PsycINFO, Embase and CINAHL were searched on November 2021 and November 2022. Authors were contacted if measures were not included in manuscripts/appendices.
STUDY SELECTION
Included articles were empirical research or a research protocol, available in English and described measures of patient report/caregiver report of rehabilitation service use post-ABI via quantitative or qualitative methods. Two reviewers independently screened 5290 records using DistillerSR. Discrepancies were resolved by team adjudication.
DATA EXTRACTION
Data extraction was piloted with high levels of agreement (k=.94). Data were extracted by a single member with team meetings to seek guidance as needed. Data included administration characteristics (reporter, mode of administration, recall period), psychometric evidence and dimensions assessed (types of services, setting, frequency, duration, intensity, qualitative aspects).
DATA SYNTHESIS
One hundred and fifty-two measures were identified from 85 quantitative, 56 qualitative and 3 psychometric studies. Psychometric properties were reported for four measures, all of which focused on satisfaction. Most measures inquired about the type of rehabilitation services used, with more than half assessing functional (eg, physical therapy) and behavioural health rehabilitation services, but fewer than half assessing community and academic reintegration (eg, special education, vocational rehabilitation) or cognitive (eg, neuropsychology) services. Fewer than half assessed qualitative aspects (eg, satisfaction). Recall periods ranged from 1 month to 'since the ABI event' or focused on current use. Of measures that could be accessed (n=71), many included a limited checklist of types of services used. Very few measures assessed setting, frequency, intensity or duration.
CONCLUSIONS
Despite widespread interest, the vast majority of measures have not been validated and are limited in scope. Use of gold-standard psychometric methods to develop and validate a comprehensive patient-report/caregiver-report measure of rehabilitation service use would have wide-ranging implications for improving rehabilitation research in ABI.
Topics: Humans; Caregivers; Brain Injuries; Rehabilitation, Vocational; Psychiatry; Checklist
PubMed: 38382949
DOI: 10.1136/bmjopen-2023-076537 -
Epilepsy & Behavior : E&B Apr 2024Children and young people with epilepsy are at higher risk of mental health disorders and atypical neurodevelopmental outcomes compared to the general population. It is... (Review)
Review
Children and young people with epilepsy are at higher risk of mental health disorders and atypical neurodevelopmental outcomes compared to the general population. It is essential to detect such comorbidities early in children with epilepsy and provide appropriate interventions, to improve clinical outcomes. We aimed to identify and evaluate the measurement properties of Patient-Reported Outcome Measures (PROMs) that have been validated specifically to measure mental health and neurodevelopmental outcomes in children and/or young people with epilepsy. We searched Embase, Medline, and PsycINFO in May 2023 for relevant studies. Mental health was defined as psychological symptoms (e.g., anxiety, depression, psychosis) and/or behavioural difficulties (e.g., conduct disorders). Neurodevelopmental outcomes included neurodevelopmental disorder traits such as attention-deficit hyperactivity disorder (ADHD) and autistic spectrum disorders. We assessed methodological quality using Consensus-based Standards for the selection of health Measurement Instruments (COSMIN) guidance. Twelve papers were identified that psychometrically evaluated 13 relevant PROMs (two epilepsy-specific, eleven generic). The appraisal of the PROMs was limited by the availability of only one or two published articles for each, and incomplete psychometric evaluations in some cases. The tool demonstrating the strongest evidence was The Neurological Disorders Depression Inventory-Epilepsy for Youth. The ADHD Rating Scale-IV and The Paediatric Symptom Checklist -17 demonstrated good evidence in favour of at least two measurement properties. This review identified only a small number of mental health and neurodevelopmental PROMs evaluated specifically in paediatric epilepsy. There is a need for further validation of mental health and neurodevelopmental PROMs in children with epilepsy.
Topics: Adolescent; Humans; Child; Mental Health; Psychotic Disorders; Epilepsy; Anxiety Disorders; Patient Reported Outcome Measures; Quality of Life
PubMed: 38368788
DOI: 10.1016/j.yebeh.2024.109671 -
Nursing Open Feb 2024Emergency nurses work in an environment of high cognitive mental workload. Excessive cognitive mental workload may result in patient harm and nurses' burnout. Therefore,... (Review)
Review
AIM
Emergency nurses work in an environment of high cognitive mental workload. Excessive cognitive mental workload may result in patient harm and nurses' burnout. Therefore, it is necessary to understand nurses' subjective experience of cognitive workload. This scoping review aimed to curate literature about the subjective experience of cognitive mental workload reported by nurses and psychometric measures of the phenomenon.
DESIGN
The scoping review was conducted in accordance with JBI methodology and reported using PRISMA extension for scoping review checklist.
METHODS
A priori protocol was created with Peer Review of Electronic Search Strategies checklist and registered in the OSF registry. Databases including PubMed, CINAHL, ProQuest, Scopus, Science Direct, Web of Science and Google Scholar were searched. Published reports were reviewed against the eligibility criteria by performing Title and Abstract screening, followed by Full-text screening. The initial search yielded 1373 studies. Of these, 57 studies met the criteria for inclusion in this study.
RESULTS
The search revealed five general measures of cognitive mental workload and their variations. Only one customised measure specifically for medical-surgical nurses was found in the study. Identified measures were collated and categorised into a framework for conceptual clarity. NASA Task Load Index and its variations were the most popular subjective measure of cognitive mental workload in nursing. However, no measure or self-report scale customised for emergency nurses was identified.
PATIENT OR PUBLIC CONTRIBUTION
The findings of this scoping review can inform future research into the cognitive mental workload of nurses. The findings have implications for workplace health and safety for nurses and patients.
Topics: Humans; Emergency Nursing; Workload; Burnout, Professional; Cognition
PubMed: 38366782
DOI: 10.1002/nop2.2111 -
Health and Quality of Life Outcomes Feb 2024(1) To identify instruments used to assess quality of life (QoL) in children and adolescents with neuromuscular diseases; (2) To identify the psychometric properties... (Review)
Review
OBJECTIVE
(1) To identify instruments used to assess quality of life (QoL) in children and adolescents with neuromuscular diseases; (2) To identify the psychometric properties contained in these instruments.
METHODS
This is a scoping review in which the electronic databases Embase, Scielo, Scopus, Pubmed and Lilacs were used as well as grey literature. The following terms were used in the search for articles published in the last 10 years: children, adolescents, neuromuscular disease, and quality of life.
RESULTS
In total, 15 articles were included and evaluated, indicating 7 instruments used to assess QoL (PedsQL™ Inventory 3.0 Neuromuscular Module, the PedsQL™ 4.0, the PedsQL DMD Module, the PedsQL ™ MFS, the SOLE, the KIDSCREEN and the LSI-A). The number of items ranged from 17 to 45. In addition, 6 instruments showed psychometric properties, but only 2 showed good and high quality, either in internal reliability or reproducibility.
CONCLUSION
Our results were able to map the main QoL assessment instruments of children and adolescents with neuromuscular disease and the most cited instrument was the PedsQL™ Inventory 3.0 Neuromuscular Module. Larger studies that assess psychometric properties and that are validated for most diseases are needed.
Topics: Child; Humans; Adolescent; Quality of Life; Reproducibility of Results; Psychometrics; Neuromuscular Diseases; Bibliometrics; Surveys and Questionnaires
PubMed: 38360791
DOI: 10.1186/s12955-024-02232-3 -
International Journal of Nursing... Jan 2024This study aimed to evaluate the measurement properties and methodological quality of assessment tools for Kinesophobia among patients with cardiovascular disease and...
OBJECTIVES
This study aimed to evaluate the measurement properties and methodological quality of assessment tools for Kinesophobia among patients with cardiovascular disease and provide a reference for healthcare professionals in selecting high-quality assessment tools.
METHODS
A systematic search was performed on specific databases: Embase, the Cochrane Library, PubMed, Web of Science, China National Knowledge Infrastructure, Wanfang database, China Biological Medicine disc, CINAHL, and China Science and Technology Journal Database, from inception to April 1, 2023. The researchers retrieved studies on the measurement attributes of the exercise fear scale in patients with cardiovascular diseases. They also traced back the references of the included studies to supplement relevant literature. According to the inclusion and exclusion criteria, screening and data extraction were independently undertaken by two reviewers. Two researchers individually used the Consensus-based Standards for the selection of health Measurement Instruments (COSMIN) Risk of Bias Checklist to assess the methodological quality of the scale, applied the COSMIN criteria to evaluate the measurement properties of the scale, and used a modified Grading, Recommendations, Assessment, Development, and Evaluation system to assess the certainty of evidence.
RESULTS
Seventeen studies were identified that reported the psychometric properties of six patient reported outcome measurement tools (included different languages version) The methodological quality of content validity was adequate in only two studies, the remaining patient-reported outcome measures demonstrated doubtful content validity. Limited information on cross-cultural validity/measurement invariance, measurement error, and responsiveness was retrieved. The Swedish version and the Chinese version of the Tampa Scale for Kinesiophobia Heart were graded "A." The remaining instruments were graded "B."
CONCLUSIONS
The methodological and measurement attributes of the Swedish and Chinese versions of the Tampa Scale for Kinesiophobia Heart are relatively high quality and can be tentatively recommended. The measurement properties of the remaining scales remain to be verified.
PubMed: 38352287
DOI: 10.1016/j.ijnss.2023.12.016 -
BMC Nephrology Feb 2024If any benefit is to be derived from the use of the health-related quality of life (HRQoL) questionnaires in chronic kidney disease (CKD) patients, they should be...
BACKGROUND
If any benefit is to be derived from the use of the health-related quality of life (HRQoL) questionnaires in chronic kidney disease (CKD) patients, they should be validated and culturally adapted to the target population. We aimed to critically appraise the psychometric properties of HRQoL questionnaires used in African populations with CKD.
METHODS
Web of Science, Embase, PubMed and PsycINFO databases were searched. Psychometric validation studies of HRQoL questionnaires reporting at least one psychometric property of the COSMIN checklist in CKD African population, published up to October 16, 2023 were included and independently assessed for methodological quality and level of measurement properties by using the COSMIN methodology.
RESULTS
From 1163 articles, 5 full-text were included. Only the Kidney Disease Quality-of-Life questionnaire was translated and cross-culturally adapted for studies of patients with CKD. Internal consistency was of doubtful quality in 4 studies and very good in 1. Its measurement was sufficient in 1 study and insufficient in 4. Test-retest reliability was of doubtful quality in 4 studies. Its measurement was sufficient in 3 studies and insufficient in 1. Structural validity was of inadequate quality in 1 study and very good quality in 1. Its measurement was sufficient in both. Construct validity was of inadequate quality in all studies. Their measurement was insufficient in 4 studies and sufficient in 1.
CONCLUSIONS
This review highlighted that only one HRQoL questionnaire used in studies of African populations with CKD underwent a small number of cultural adaptations and psychometric validations, generally of poor methodological quality. HRQoL validation studies in African CKD populations are needed to better take advantage of the benefits in patient care, population health management, and research.
Topics: Humans; Quality of Life; Psychometrics; Reproducibility of Results; Surveys and Questionnaires; Renal Insufficiency, Chronic
PubMed: 38331827
DOI: 10.1186/s12882-024-03482-5