-
Intensive Care Medicine Feb 2023To provide an overview and evaluate the performance of mortality prediction models for patients requiring extracorporeal membrane oxygenation (ECMO) support for...
PURPOSE
To provide an overview and evaluate the performance of mortality prediction models for patients requiring extracorporeal membrane oxygenation (ECMO) support for refractory cardiocirculatory or respiratory failure.
METHODS
A systematic literature search was undertaken to identify studies developing and/or validating multivariable prediction models for all-cause mortality in adults requiring or receiving veno-arterial (V-A) or veno-venous (V-V) ECMO. Estimates of model performance (observed versus expected (O:E) ratio and c-statistic) were summarized using random effects models and sources of heterogeneity were explored by means of meta-regression. Risk of bias was assessed using the Prediction model Risk Of BiAS Tool (PROBAST).
RESULTS
Among 4905 articles screened, 96 studies described a total of 58 models and 225 external validations. Out of all 58 models which were specifically developed for ECMO patients, 14 (24%) were ever externally validated. Discriminatory ability of frequently validated models developed for ECMO patients (i.e., SAVE and RESP score) was moderate on average (pooled c-statistics between 0.66 and 0.70), and comparable to general intensive care population-based models (pooled c-statistics varying between 0.66 and 0.69 for the Simplified Acute Physiology Score II (SAPS II), Acute Physiology and Chronic Health Evaluation II (APACHE II) score and Sequential Organ Failure Assessment (SOFA) score). Nearly all models tended to underestimate mortality with a pooled O:E > 1. There was a wide variability in reported performance measures of external validations, reflecting a large between-study heterogeneity. Only 1 of the 58 models met the generally accepted Prediction model Risk Of BiAS Tool criteria of good quality. Importantly, all predicted outcomes were conditional on the fact that ECMO support had already been initiated, thereby reducing their applicability for patient selection in clinical practice.
CONCLUSIONS
A large number of mortality prediction models have been developed for ECMO patients, yet only a minority has been externally validated. Furthermore, we observed only moderate predictive performance, large heterogeneity between-study populations and model performance, and poor methodological quality overall. Most importantly, current models are unsuitable to provide decision support for selecting individuals in whom initiation of ECMO would be most beneficial, as all models were developed in ECMO patients only and the decision to start ECMO had, therefore, already been made.
Topics: Adult; Humans; Prognosis; Extracorporeal Membrane Oxygenation; Organ Dysfunction Scores; Respiratory Insufficiency; Retrospective Studies; Hospital Mortality
PubMed: 36600027
DOI: 10.1007/s00134-022-06947-z -
Neuropsychology Review Sep 2022Several tools have been developed to assess executive function (EFs) and adaptive functioning, although in mainly Western populations. Information on tools for... (Review)
Review
Several tools have been developed to assess executive function (EFs) and adaptive functioning, although in mainly Western populations. Information on tools for low-and-middle-income country children is scanty. A scoping review of such instruments was therefore undertaken.We followed the Preferred Reporting Items for Systematic Review and Meta-Analysis- Scoping Review extension (PRISMA-ScR) checklist (Tricco et al., in Annals of Internal Medicine 169(7), 467-473, 2018). A search was made for primary research papers of all study designs that focused on development or adaptation of EF or adaptive function tools in low-and-middle-income countries, published between 1 January 1894 to 15 September 2020. 14 bibliographic databases were searched, including several non-English databases and the data were independently charted by at least 2 reviewers.The search strategy identified 5675 eligible abstracts, which was pruned down to 570 full text articles. These full-text articles were then manually screened for eligibility with 51 being eligible. 41 unique tools coming in 49 versions were reviewed. Of these, the Behaviour Rating Inventory of Executive Functioning (BRIEF- multiple versions), Wisconsin Card Sorting Test (WCST), Go/No-go and the Rey-Osterrieth complex figure (ROCF) had the most validations undertaken for EF tests. For adaptive functions, the tools with the most validation studies were the Vineland Adaptive Behaviour Scales (VABS- multiple versions) and the Child Function Impairment Rating Scale (CFIRS- first edition).There is a fair assortment of tests available that have either been developed or adapted for use among children in developing countries but with limited range of validation studies. However, their psychometric adequacy for this population was beyond the scope of this paper.
Topics: Brain; Child; Developing Countries; Executive Function; Humans; Neuropsychological Tests; Psychometrics
PubMed: 34870774
DOI: 10.1007/s11065-021-09529-w -
European Journal of Physical and... Jun 2023The objective of this study was to identify and review the subjective assessment tools validated in patients with fibromyalgia, identifying their most significant...
INTRODUCTION
The objective of this study was to identify and review the subjective assessment tools validated in patients with fibromyalgia, identifying their most significant structural characteristics, as well as the psychometric characteristics analyzed in each of the identified instruments.
EVIDENCE ACQUISITION
This systematic review was registered in PROSPERO with the following reference: CRD42022306878. It analyzed documents published until June 30, 2022, through the Medline, Pedro and Scopus, Dialnet, Cinahl and Latin Index databases. The keywords used were: 1) fibromyalgia; 2) assessment; 3) questionnaire; 4) reliability; 5) validity; 6) scale; and 7) validation study. Combined using the Boolean operators "AND" and "OR." The included articles were analyzed to extract: data on the structural characteristics of the questionnaires (including acronym, year of publication, number of items, sub-categories, time to complete the questionnaire, measurement range, cutoff score and cost) and psychometric characteristics of the selected questionnaires, including data on reliability (Cronbach's alpha and test-retest) and data on the validity of the questionnaires (content, construct and criterion validity).
EVIDENCE SYNTHESIS
Twenty-two studies containing 16 questionnaires were analyzed. The quality and risk of bias assessment was performed following the COSMIN checklist. In general, the quality of the subjective assessment studies validated in the population with fibromyalgia was good, with the exception of 5 studies, which did not exceed 5 points out of 10. The first questionnaire analyzed was published in 1991, and the last in 2020; the number of items ranged from 3 to 60. The most measured subcategories are function, overall impact and symptoms; other studies also include sleep and cognition disturbances. Only 6 studies described the time to complete them. The most analyzed psychometric characteristics were reliability (analyzed by 13 questionnaires), validity (analyzed by 7) and error measures (provided by only 3 of them).
CONCLUSIONS
There is a wide range of questionnaires specifically designed for patients with fibromyalgia that present good and/or excellent basic psychometric characteristics. The structural characteristics of the identified instruments were very heterogeneous, which makes it possible to select those that best adapt to the clinical/investigator scenario where the tool will be used.
Topics: Humans; Fibromyalgia; Reproducibility of Results; Surveys and Questionnaires; Psychometrics; Cognitive Dysfunction
PubMed: 37184415
DOI: 10.23736/S1973-9087.23.07762-6 -
Seminars in Arthritis and Rheumatism Feb 2022To summarize the published evidence in the literature on the role of ultrasound and elastography to assess skin involvement in systemic sclerosis (SSc). (Review)
Review
Ultrasound and elastography in the assessment of skin involvement in systemic sclerosis: A systematic literature review focusing on validation and standardization - WSF Skin Ultrasound Group.
OBJECTIVE
To summarize the published evidence in the literature on the role of ultrasound and elastography to assess skin involvement in systemic sclerosis (SSc).
METHODS
A systematic literature review (SLR) was performed within the "Skin Ultrasound Working Group" of the World Scleroderma Foundation, according to the Cochrane Handbook. A search was conducted in Pubmed, Cochrane Library and Embase databases from 1/1/1979 to 31/5/2021, using the participants, intervention, comparator and outcomes (PICO) framework. Only full-text articles involving adults, reported in any language, assessing ultrasound to quantify skin pathology in SSc patients. Two reviewers performed the assessment of risk of bias, data extraction and synthesis, independently.
RESULTS
Forty-six studies out of 3248 references evaluating skin ultrasound and elastography domains were included. B-mode ultrasound was used in 30 studies (65.2%), elastography in nine (19.6%), and both methods in seven (15.2%). The ultrasound outcome measure domains reported were thickness (57.8%) and echogenicity (17.2%); the elastography domain was stiffness (25%). Methods used for image acquisition and analysis were remarkably heterogeneous and frequently under-reported, precluding data synthesis across studies. The same applies to contextual factors and feasibility. Our data syntheses indicated evidence of good reliability and convergent validity for ultrasound thickness evaluation against mRSS and skin histological findings. Stiffness and echogenicity have limited evidence for validity against histological findings. Evidence for sensitivity to change, test-retest reliability, clinical trial discrimination or thresholds of meaning is limited or absent for reported ultrasound domains.
CONCLUSION
Ultrasound is a valid and reliable tool for skin thickness measurement in SSc but there are significant knowledge gaps regarding skin echogenicity assessment by ultrasound and skin stiffness evaluation by elastography in terms of feasibility, validity and discrimination. Standardization of image acquisition and analysis is needed to foster progress.
Topics: Adult; Elasticity Imaging Techniques; Humans; Reference Standards; Reproducibility of Results; Scleroderma, Systemic; Skin; Ultrasonography
PubMed: 35039184
DOI: 10.1016/j.semarthrit.2022.151954 -
International Journal For Equity in... Nov 2021Many programs are undertaken to facilitate the empowerment of vulnerable populations across the world. However, an overview of appropriate empowerment measurements to... (Review)
Review
BACKGROUND
Many programs are undertaken to facilitate the empowerment of vulnerable populations across the world. However, an overview of appropriate empowerment measurements to evaluate such initiatives remains incomplete to date. This systematic review aims to describe and summarise psychometric properties, feasibility and clinical utility of the available tools for measuring empowerment in psychosocially vulnerable populations.
METHODS
A systematic literature review following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines was completed. A descriptive approach was used for data analysis. Papers were eligible if they explored the development, validation, cross-cultural translation or the utility of an empowerment measurement tool in the context of psychosocially vulnerable populations.
RESULTS
Twenty-six included articles described twenty-six separate studies in which 16 empowerment measurement tools were developed, validated/translated, or used. There was heterogeneity in empowerment constructs, samples targeted, and psychometric properties measured. The measurement of reliability of the included instruments was satisfactory in most cases. However, the validity, responsiveness, interpretability, feasibility and clinical utility of the identified measurement tools were often not adequately described or measured.
CONCLUSION
This systematic review provides a useful snapshot of the strengths as well as limitations of existing health related empowerment measurement tools used with psychosocially vulnerable populations in terms of their measurement properties, and constructs captured. It highlights significant gaps in empowerment tool measurement, development and evaluation processes. In particular, the results suggest that in addition to systematic assessments of psychometric properties, the inclusion of feasibility and clinical utility as outcome measures are important to assess relevance to clinical practice.
Topics: Humans; Psychometrics; Reproducibility of Results
PubMed: 34789249
DOI: 10.1186/s12939-021-01585-1 -
Health Equity 2021Previous research has documented that Latinos report higher levels of stress than other ethnicities and are an increasing portion of the demographics of the United... (Review)
Review
Previous research has documented that Latinos report higher levels of stress than other ethnicities and are an increasing portion of the demographics of the United States. While there are many measures to assess stress and other stress-related conditions, there are no systematic reviews to date to assess whether the current measures of generalized stress are valid or reliable in Latinos in the United States. The purpose of this systematic review was to examine the current state of the literature assessing the psychometric properties in stress measures in this population. We used Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines to review the literature from January 1990 to May 2020 for studies, which measured the psychometric properties of scales measuring generalized stress in Latinos in the United States. Twelve studies measured the psychometric properties of eight scales of generalized stress. The 10-item Perceived Stress Scale, the Hispanic Stress Inventory, the Hispanic Women's Social Stressor Scale, and the Family Obligation Stress Scale show the strongest reliability and validity for measuring stress in Latinos in the United States. Most studies were done in traditional immigration destinations in the United States. While four scales which show acceptable reliability and validity for measuring stress in Latinos in the United States, continuing to develop and further validate these scales within Latino communities will be critical to understand and address Latino stress more comprehensively. Our findings can inform health research and clinical interventions for this at-risk community.
PubMed: 34036218
DOI: 10.1089/heq.2020.0112 -
Global Mental Health (Cambridge,... 2019Mental health issues, often manifested as behavioural difficulties, in children are estimated to be high in low and middle-income countries (LMIC) settings. There is a... (Review)
Review
BACKGROUND
Mental health issues, often manifested as behavioural difficulties, in children are estimated to be high in low and middle-income countries (LMIC) settings. There is a paucity of definitive data due to a lack of well-validated tools to use across settings. This review aims to provide evidence on what tools are used and which have been adapted and validated in LMIC settings.
METHODS
We performed a systematic review to identify tools used to assess or screen externalising behaviour problems in children and adolescents in LMIC and assess their cultural adaptations. We searched for studies measuring externalising behaviour in children from 0 to 19 years published up to September 2018. Articles were assessed to identify tools used and analysed using the Ecological Validity Framework.
RESULTS
We identified 82 articles from over 50 LMICs who had studied externalising behaviour in children. Twenty-seven tools were identified, with a predominance of studies using tools from the USA and Europe. Most studies did not describe an adaptation and evaluation process, with only one study following recommended criteria. New tools were identified which both screen and assess externalising behaviour which have not yet been utilised across settings.
CONCLUSIONS
Although tools from the USA and Europe are often utilised to screen and assess for externalising behaviour problems in children in LMICs, the conceptual frameworks behind the use of these tools in other cultural contexts are not always carefully examined. In order to have valid data across cultures, we should aim to adapt and validate tools before use. Provision of processes to validate tools across LMIC settings would be beneficial.
PubMed: 31391945
DOI: 10.1017/gmh.2019.11 -
International Journal of Health Sciences 2020The psychological construct of hope is an important determinant for mental health and well-being. The availability of valid and reliable instruments to measure hope is,... (Review)
Review
OBJECTIVE
The psychological construct of hope is an important determinant for mental health and well-being. The availability of valid and reliable instruments to measure hope is, therefore, critical. Despite a large number of psychometric studies on the Herth Hope Index (HHI), its construct validity has not yet been determined. Therefore, this paper aimed to conduct a systematic review of the psychometric properties of the HHI.
METHODS
Databases such as PubMed, Science Direct, Google Scholar, Magiran, SID, IranDoc, and IranMedex were evaluated systematically using the terms "HHI," "psychometric," "validity," "reliability," and related terms (with the use of OR and AND operators) and no restrictions on the year of publication. A total of 13 eligible studies were found published between 1992 and 2018 in the USA, Portugal, Switzerland, Iran, Germany, Petersburg, Japan, the Netherlands, Lima, Peru, and Norway. The methodology used in the available studies included principal component analysis (n = 6), maximum likelihood estimation (n = 5), and principal axis factoring (n = 1). One study did not point the methodology.
RESULTS
Four studies reported the total extracted variances to be less than 50%, six studies reported variance between 50% and 60%, and three papers reported variance that exceeded 60%. Of the papers that examined the factor structure of the HHI, two studies reported a one-factor solution, seven reported two factors, and four reported a three-factor solution. Although the HHI is the most widely translated and psychometrically tested tool in languages other than English, psychometric variations in factor solutions remain inconsistent.
CONCLUSION
Findings highlight the need for future research that appraises the validity of the HHI in different countries, and how the measure relates to other scales that evaluate hope.
PubMed: 32952505
DOI: No ID Found -
Frontiers in Public Health 2021To develop a thematic framework for the range of consequences arising from a diagnostic label from an individual, family/caregiver, healthcare professional, and... (Review)
Review
To develop a thematic framework for the range of consequences arising from a diagnostic label from an individual, family/caregiver, healthcare professional, and community perspective. Systematic scoping review of qualitative studies. We searched PubMed, Embase, PsycINFO, Cochrane, and CINAHL for primary studies and syntheses of primary studies that explore the consequences of labelling non-cancer diagnoses. Reference lists of included studies were screened, and forward citation searches undertaken. We included peer reviewed publications describing the perceived consequences for individuals labelled with a non-cancer diagnostic label from four perspectives: that of the individual, their family/caregiver, healthcare professional and/or community members. We excluded studies using hypothetical scenarios. Data extraction used a three-staged process: one third was used to develop a preliminary framework, the next third for framework validation, and the final third coded if thematic saturation was not achieved. Author themes and supporting quotes were extracted, and analysed from the perspective of individual, family/caregiver, healthcare professional, or community member. After deduplication, searches identified 7,379 unique articles. Following screening, 146 articles, consisting of 128 primary studies and 18 reviews, were included. The developed framework consisted of five overarching themes relevant to the four perspectives: (e.g., positive/negative psychological impact, social- and self-identity, stigma), (e.g., increased, decreased, relationship changes, professional interactions), (e.g., action and uncertainty), (e.g., beneficial or detrimental modifications), and . Perspectives of individuals were most frequently reported. This review developed and validated a framework of five domains of consequences following diagnostic labelling. Further research is required to test the external validity and acceptability of the framework for individuals and their family/caregiver, healthcare professionals, and community.
Topics: Delivery of Health Care; Health Personnel; Humans; Qualitative Research
PubMed: 35004561
DOI: 10.3389/fpubh.2021.725877 -
Diagnostics (Basel, Switzerland) Feb 2021Although many works have supported the utility of PET radiomics, several authors have raised concerns over the robustness and replicability of the results. This study... (Review)
Review
BACKGROUND
Although many works have supported the utility of PET radiomics, several authors have raised concerns over the robustness and replicability of the results. This study aimed to perform a systematic review on the topic of PET radiomics and the used methodologies.
METHODS
PubMed was searched up to 15 October 2020. Original research articles based on human data specifying at least one tumor type and PET image were included, excluding those that apply only first-order statistics and those including fewer than 20 patients. Each publication, cancer type, objective and several methodological parameters (number of patients and features, validation approach, among other things) were extracted.
RESULTS
A total of 290 studies were included. Lung (28%) and head and neck (24%) were the most studied cancers. The most common objective was prognosis/treatment response (46%), followed by diagnosis/staging (21%), tumor characterization (18%) and technical evaluations (15%). The average number of patients included was 114 (median = 71; range 20-1419), and the average number of high-order features calculated per study was 31 (median = 26, range 1-286).
CONCLUSIONS
PET radiomics is a promising field, but the number of patients in most publications is insufficient, and very few papers perform in-depth validations. The role of standardization initiatives will be crucial in the upcoming years.
PubMed: 33672285
DOI: 10.3390/diagnostics11020380