-
Bronchopulmonary dysplasia prediction models: a systematic review and meta-analysis with validation.Pediatric Research Jul 2023Prediction models could identify infants at the greatest risk of bronchopulmonary dysplasia (BPD) and allow targeted preventative strategies. We performed a systematic... (Meta-Analysis)
Meta-Analysis
Prediction models could identify infants at the greatest risk of bronchopulmonary dysplasia (BPD) and allow targeted preventative strategies. We performed a systematic review and meta-analysis with external validation of identified models. Studies using predictors available before day 14 of life to predict BPD in very preterm infants were included. Two reviewers assessed 7628 studies for eligibility. Meta-analysis of externally validated models was followed by validation using 62,864 very preterm infants in England and Wales. A total of 64 studies using 53 prediction models were included totalling 274,407 infants (range 32-156,587/study). In all, 35 (55%) studies predated 2010; 39 (61%) were single-centre studies. A total of 97% of studies had a high risk of bias, especially in the analysis domain. Following meta-analysis of 22 BPD and 11 BPD/death composite externally validated models, Laughon's day one model was the most promising in predicting BPD and death (C-statistic 0.76 (95% CI 0.70-0.81) and good calibration). Six models were externally validated in our cohort with C-statistics between 0.70 and 0.90 but with poor calibration. Few BPD prediction models were developed with contemporary populations, underwent external validation, or had calibration and impact analyses. Contemporary, validated, and dynamic prediction models are needed for targeted preventative strategies. IMPACT: This review aims to provide a comprehensive assessment of all BPD prediction models developed to address the uncertainty of which model is sufficiently valid and generalisable for use in clinical practice and research. Published BPD prediction models are mostly outdated, single centre and lack external validation. Laughon's 2011 model is the most promising but more robust models, using contemporary data with external validation are needed to support better treatments.
Topics: Infant; Infant, Newborn; Humans; Infant, Premature; Bronchopulmonary Dysplasia; Infant, Very Low Birth Weight; Infant, Premature, Diseases; England
PubMed: 36624282
DOI: 10.1038/s41390-022-02451-8 -
Thyroid : Official Journal of the... Oct 2022Molecular tests for thyroid nodules with indeterminate fine needle aspiration results are increasingly used in clinical practice; however, true diagnostic summaries of... (Meta-Analysis)
Meta-Analysis Review
Molecular tests for thyroid nodules with indeterminate fine needle aspiration results are increasingly used in clinical practice; however, true diagnostic summaries of these tests are unknown. A systematic review and meta-analysis were completed to (1) evaluate the accuracy of commercially available molecular tests for malignancy in indeterminate thyroid nodules and (2) quantify biases and limitations in studies that validate those tests. PubMed, EMBASE, and Web of Science were systematically searched through July 2021. English language articles that reported original clinical validation attempts of molecular tests for indeterminate thyroid nodules were included if they reported counts of true-negative, true-positive, false-negative, and false-positive results. We performed screening and full-text review, followed by assessment of eight common biases and limitations, extraction of diagnostic and histopathological information, and meta-analysis of clinical validity using a bivariate linear mixed-effects model. Forty-nine studies were included. Meta-analysis of Afirma Gene expression classifiers (GEC; = 38 studies) revealed a sensitivity of 0.92 (confidence interval: 0.90-0.94), specificity of 0.26 (0.20-0.32), negative likelihood ratio (LR-) of 0.32 (0.23-0.44), positive LR+ of 1.24 (1.15-1.35), and area under the curve (AUC) of 0.83 (0.74-0.89). Afirma Genomic Sequencing Classifier (GSC; = 10) had a sensitivity of 0.94 (0.89-0.96), specificity of 0.38 (0.27-0.50), LR- of 0.18 (0.10-0.30), LR+ of 1.52 (1.28-1.87), and AUC of 0.91 (0.62-0.92). ThyroSeq v1 and v2 ( = 10) had a sensitivity of 0.86 (0.82-0.90), specificity of 0.74 (0.59-0.85), LR- of 0.19 (0.13-0.26), LR+ of 3.52 (2.08-5.92), and AUC of 0.86 (0.81-0.90). ThyroSeq v3 ( = 6) had a sensitivity of 0.92 (0.86-0.95), specificity of 0.41 (0.18-0.69), LR- of 0.24 (0.09-0.62), LR+ of 1.67 (1.09-2.98), and AUC of 0.90 (0.63-0.92). Fourteen percent of studies conducted a blinded histopathologic review of excised thyroid nodules, and 8% made the decision to go to surgery blind to molecular test results. Meta-analyses reveal a high diagnostic accuracy of molecular tests for thyroid nodule assessment of malignancy risk; however, these studies are subject to several limitations. Limitations and their potential clinical impacts must be addressed and, when feasible, adjusted for using valid statistical methodologies.
Topics: Humans; Thyroid Nodule; Pathology, Molecular; Biopsy, Fine-Needle; Molecular Diagnostic Techniques; Bias; Thyroid Neoplasms
PubMed: 35999710
DOI: 10.1089/thy.2022.0269 -
International Journal of Environmental... Dec 2021Addressing HIV-related stigma requires the use of psychometrically sound measures. However, despite the Berger HIV stigma scale (HSS) being among the most widely used... (Review)
Review
Addressing HIV-related stigma requires the use of psychometrically sound measures. However, despite the Berger HIV stigma scale (HSS) being among the most widely used measures for assessing HIV-related stigma, no study has systematically summarised its psychometric properties. This review investigated the psychometric properties of the HSS. A systematic review of articles published between 2001 and August 2021 was undertaken (CRD42020220305) following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Additionally, we searched the grey literature and screened the reference lists of the included studies. Of the total 1241 studies that were screened, 166 were included in the review, of which 24 were development and/or validation studies. The rest were observational or experimental studies. All the studies except two reported some aspect of the scale's reliability. The reported internal consistency ranged from acceptable to excellent (Cronbach's alpha ≥ 0.70) in 93.2% of the studies. Only eight studies reported test-retest reliability, and the reported reliability was adequate, except for one study. Only 36 studies assessed and established the HSS's validity. The HSS appears to be a reliable and valid measure of HIV-related stigma. However, the validity evidence came from only 36 studies, most of which were conducted in North America and Europe. Consequently, more validation work is necessary for more precise insights.
Topics: HIV Infections; Humans; Psychometrics; Reproducibility of Results; Social Stigma; Surveys and Questionnaires
PubMed: 34948690
DOI: 10.3390/ijerph182413074 -
Journal of Vascular Surgery. Venous and... Apr 2015We conducted a systematic review of the literature about quality-of-life (QOL) scales in chronic venous disorders (CVDs) comprising leg ulcers to identify the respective... (Review)
Review
OBJECTIVE
We conducted a systematic review of the literature about quality-of-life (QOL) scales in chronic venous disorders (CVDs) comprising leg ulcers to identify the respective advantages and deficits of existing tools.
METHODS
A research protocol was built following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement and the PICO (population, intervention, comparator, and outcome) criteria. The following databases were screened: MEDLINE, SCOPUS, EMBASE, CINHAL, and Cochrane. Psychometric and linguistic validation studies in English were included, as were clinical trials that have used QOL scales in CVDs. The data search was up to date as of October 31, 2013.
RESULTS
Inclusion criteria were met in 103 of the 511 recorded references, in which 10 scales were identified: two for the full spectrum of CVDs, three for patients with CVDs without leg ulceration, four for leg ulcers, and one exclusively for patients with varicose veins. Among them, the ChronIc Venous Insufficiency Questionnaire (CIVIQ), Aberdeen Varicose Vein Questionnaire (AVVQ), and VEnous INsufficiency Epidemiological and Economic Study on Quality of Life (VEINES-QOL) scales were the most highly used according to the literature, and CIVIQ and VEINES-QOL were the most extensively validated scales and had the longest iterative validation process. A total of 31 psychometric and linguistic validations of the 10 QOL scales and 66 clinical trials that have used these scales were identified. The validation studies were based on acceptability, content validity, construct validity, reliability, and responsiveness. The clinical trials were composed of 25 randomized controlled trials and 41 observational studies. Only the randomized controlled trials are considered in the present article.
CONCLUSIONS
This systematic review confirmed that CVDs have an important effect on QOL. The majority of the studies addressed the application rather than the validation of the 10 identified scales. Two scales, CIVIQ and VEINES-QOL, emerged as being thoroughly validated instruments, although factorial stability was not demonstrated for the VEINES-QOL. Our findings confirm a paucity of validation studies.
Topics: Chronic Disease; Humans; Leg; Psychometrics; Quality of Life; Randomized Controlled Trials as Topic; Reproducibility of Results; Surveys and Questionnaires; Varicose Ulcer; Varicose Veins; Venous Insufficiency
PubMed: 26993844
DOI: 10.1016/j.jvsv.2014.08.005 -
Intensive Care Medicine Feb 2023To provide an overview and evaluate the performance of mortality prediction models for patients requiring extracorporeal membrane oxygenation (ECMO) support for...
PURPOSE
To provide an overview and evaluate the performance of mortality prediction models for patients requiring extracorporeal membrane oxygenation (ECMO) support for refractory cardiocirculatory or respiratory failure.
METHODS
A systematic literature search was undertaken to identify studies developing and/or validating multivariable prediction models for all-cause mortality in adults requiring or receiving veno-arterial (V-A) or veno-venous (V-V) ECMO. Estimates of model performance (observed versus expected (O:E) ratio and c-statistic) were summarized using random effects models and sources of heterogeneity were explored by means of meta-regression. Risk of bias was assessed using the Prediction model Risk Of BiAS Tool (PROBAST).
RESULTS
Among 4905 articles screened, 96 studies described a total of 58 models and 225 external validations. Out of all 58 models which were specifically developed for ECMO patients, 14 (24%) were ever externally validated. Discriminatory ability of frequently validated models developed for ECMO patients (i.e., SAVE and RESP score) was moderate on average (pooled c-statistics between 0.66 and 0.70), and comparable to general intensive care population-based models (pooled c-statistics varying between 0.66 and 0.69 for the Simplified Acute Physiology Score II (SAPS II), Acute Physiology and Chronic Health Evaluation II (APACHE II) score and Sequential Organ Failure Assessment (SOFA) score). Nearly all models tended to underestimate mortality with a pooled O:E > 1. There was a wide variability in reported performance measures of external validations, reflecting a large between-study heterogeneity. Only 1 of the 58 models met the generally accepted Prediction model Risk Of BiAS Tool criteria of good quality. Importantly, all predicted outcomes were conditional on the fact that ECMO support had already been initiated, thereby reducing their applicability for patient selection in clinical practice.
CONCLUSIONS
A large number of mortality prediction models have been developed for ECMO patients, yet only a minority has been externally validated. Furthermore, we observed only moderate predictive performance, large heterogeneity between-study populations and model performance, and poor methodological quality overall. Most importantly, current models are unsuitable to provide decision support for selecting individuals in whom initiation of ECMO would be most beneficial, as all models were developed in ECMO patients only and the decision to start ECMO had, therefore, already been made.
Topics: Adult; Humans; Prognosis; Extracorporeal Membrane Oxygenation; Organ Dysfunction Scores; Respiratory Insufficiency; Retrospective Studies; Hospital Mortality
PubMed: 36600027
DOI: 10.1007/s00134-022-06947-z -
European Journal of Physical and... Jun 2023The objective of this study was to identify and review the subjective assessment tools validated in patients with fibromyalgia, identifying their most significant...
INTRODUCTION
The objective of this study was to identify and review the subjective assessment tools validated in patients with fibromyalgia, identifying their most significant structural characteristics, as well as the psychometric characteristics analyzed in each of the identified instruments.
EVIDENCE ACQUISITION
This systematic review was registered in PROSPERO with the following reference: CRD42022306878. It analyzed documents published until June 30, 2022, through the Medline, Pedro and Scopus, Dialnet, Cinahl and Latin Index databases. The keywords used were: 1) fibromyalgia; 2) assessment; 3) questionnaire; 4) reliability; 5) validity; 6) scale; and 7) validation study. Combined using the Boolean operators "AND" and "OR." The included articles were analyzed to extract: data on the structural characteristics of the questionnaires (including acronym, year of publication, number of items, sub-categories, time to complete the questionnaire, measurement range, cutoff score and cost) and psychometric characteristics of the selected questionnaires, including data on reliability (Cronbach's alpha and test-retest) and data on the validity of the questionnaires (content, construct and criterion validity).
EVIDENCE SYNTHESIS
Twenty-two studies containing 16 questionnaires were analyzed. The quality and risk of bias assessment was performed following the COSMIN checklist. In general, the quality of the subjective assessment studies validated in the population with fibromyalgia was good, with the exception of 5 studies, which did not exceed 5 points out of 10. The first questionnaire analyzed was published in 1991, and the last in 2020; the number of items ranged from 3 to 60. The most measured subcategories are function, overall impact and symptoms; other studies also include sleep and cognition disturbances. Only 6 studies described the time to complete them. The most analyzed psychometric characteristics were reliability (analyzed by 13 questionnaires), validity (analyzed by 7) and error measures (provided by only 3 of them).
CONCLUSIONS
There is a wide range of questionnaires specifically designed for patients with fibromyalgia that present good and/or excellent basic psychometric characteristics. The structural characteristics of the identified instruments were very heterogeneous, which makes it possible to select those that best adapt to the clinical/investigator scenario where the tool will be used.
Topics: Humans; Fibromyalgia; Reproducibility of Results; Surveys and Questionnaires; Psychometrics; Cognitive Dysfunction
PubMed: 37184415
DOI: 10.23736/S1973-9087.23.07762-6 -
Seminars in Arthritis and Rheumatism Feb 2022To summarize the published evidence in the literature on the role of ultrasound and elastography to assess skin involvement in systemic sclerosis (SSc). (Review)
Review
Ultrasound and elastography in the assessment of skin involvement in systemic sclerosis: A systematic literature review focusing on validation and standardization - WSF Skin Ultrasound Group.
OBJECTIVE
To summarize the published evidence in the literature on the role of ultrasound and elastography to assess skin involvement in systemic sclerosis (SSc).
METHODS
A systematic literature review (SLR) was performed within the "Skin Ultrasound Working Group" of the World Scleroderma Foundation, according to the Cochrane Handbook. A search was conducted in Pubmed, Cochrane Library and Embase databases from 1/1/1979 to 31/5/2021, using the participants, intervention, comparator and outcomes (PICO) framework. Only full-text articles involving adults, reported in any language, assessing ultrasound to quantify skin pathology in SSc patients. Two reviewers performed the assessment of risk of bias, data extraction and synthesis, independently.
RESULTS
Forty-six studies out of 3248 references evaluating skin ultrasound and elastography domains were included. B-mode ultrasound was used in 30 studies (65.2%), elastography in nine (19.6%), and both methods in seven (15.2%). The ultrasound outcome measure domains reported were thickness (57.8%) and echogenicity (17.2%); the elastography domain was stiffness (25%). Methods used for image acquisition and analysis were remarkably heterogeneous and frequently under-reported, precluding data synthesis across studies. The same applies to contextual factors and feasibility. Our data syntheses indicated evidence of good reliability and convergent validity for ultrasound thickness evaluation against mRSS and skin histological findings. Stiffness and echogenicity have limited evidence for validity against histological findings. Evidence for sensitivity to change, test-retest reliability, clinical trial discrimination or thresholds of meaning is limited or absent for reported ultrasound domains.
CONCLUSION
Ultrasound is a valid and reliable tool for skin thickness measurement in SSc but there are significant knowledge gaps regarding skin echogenicity assessment by ultrasound and skin stiffness evaluation by elastography in terms of feasibility, validity and discrimination. Standardization of image acquisition and analysis is needed to foster progress.
Topics: Adult; Elasticity Imaging Techniques; Humans; Reference Standards; Reproducibility of Results; Scleroderma, Systemic; Skin; Ultrasonography
PubMed: 35039184
DOI: 10.1016/j.semarthrit.2022.151954 -
International Journal For Equity in... Nov 2021Many programs are undertaken to facilitate the empowerment of vulnerable populations across the world. However, an overview of appropriate empowerment measurements to... (Review)
Review
BACKGROUND
Many programs are undertaken to facilitate the empowerment of vulnerable populations across the world. However, an overview of appropriate empowerment measurements to evaluate such initiatives remains incomplete to date. This systematic review aims to describe and summarise psychometric properties, feasibility and clinical utility of the available tools for measuring empowerment in psychosocially vulnerable populations.
METHODS
A systematic literature review following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines was completed. A descriptive approach was used for data analysis. Papers were eligible if they explored the development, validation, cross-cultural translation or the utility of an empowerment measurement tool in the context of psychosocially vulnerable populations.
RESULTS
Twenty-six included articles described twenty-six separate studies in which 16 empowerment measurement tools were developed, validated/translated, or used. There was heterogeneity in empowerment constructs, samples targeted, and psychometric properties measured. The measurement of reliability of the included instruments was satisfactory in most cases. However, the validity, responsiveness, interpretability, feasibility and clinical utility of the identified measurement tools were often not adequately described or measured.
CONCLUSION
This systematic review provides a useful snapshot of the strengths as well as limitations of existing health related empowerment measurement tools used with psychosocially vulnerable populations in terms of their measurement properties, and constructs captured. It highlights significant gaps in empowerment tool measurement, development and evaluation processes. In particular, the results suggest that in addition to systematic assessments of psychometric properties, the inclusion of feasibility and clinical utility as outcome measures are important to assess relevance to clinical practice.
Topics: Humans; Psychometrics; Reproducibility of Results
PubMed: 34789249
DOI: 10.1186/s12939-021-01585-1 -
Health Equity 2021Previous research has documented that Latinos report higher levels of stress than other ethnicities and are an increasing portion of the demographics of the United... (Review)
Review
Previous research has documented that Latinos report higher levels of stress than other ethnicities and are an increasing portion of the demographics of the United States. While there are many measures to assess stress and other stress-related conditions, there are no systematic reviews to date to assess whether the current measures of generalized stress are valid or reliable in Latinos in the United States. The purpose of this systematic review was to examine the current state of the literature assessing the psychometric properties in stress measures in this population. We used Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines to review the literature from January 1990 to May 2020 for studies, which measured the psychometric properties of scales measuring generalized stress in Latinos in the United States. Twelve studies measured the psychometric properties of eight scales of generalized stress. The 10-item Perceived Stress Scale, the Hispanic Stress Inventory, the Hispanic Women's Social Stressor Scale, and the Family Obligation Stress Scale show the strongest reliability and validity for measuring stress in Latinos in the United States. Most studies were done in traditional immigration destinations in the United States. While four scales which show acceptable reliability and validity for measuring stress in Latinos in the United States, continuing to develop and further validate these scales within Latino communities will be critical to understand and address Latino stress more comprehensively. Our findings can inform health research and clinical interventions for this at-risk community.
PubMed: 34036218
DOI: 10.1089/heq.2020.0112 -
Journal of Medical Internet Research Apr 2016Young adults (18-35 years) remain among the lowest vegetable consumers in many western countries. The digital era offers opportunities to engage this age group in... (Meta-Analysis)
Meta-Analysis Review
BACKGROUND
Young adults (18-35 years) remain among the lowest vegetable consumers in many western countries. The digital era offers opportunities to engage this age group in interventions in new and appealing ways.
OBJECTIVE
This systematic review evaluated the efficacy and external validity of electronic (eHealth) and mobile phone (mHealth) -based interventions that promote vegetable intake in young adults.
METHODS
We searched several electronic databases for studies published between 1990 and 2015, and 2 independent authors reviewed the quality and risk of bias of the eligible papers and extracted data for analyses. The primary outcome of interest was the change in vegetable intake postintervention. Where possible, we calculated effect sizes (Cohen d and 95% CIs) for comparison. A random effects model was applied to the data for meta-analysis. Reach and representativeness of participants, intervention implementation, and program maintenance were assessed to establish external validity. Published validation studies were consulted to determine the validity of tools used to measure intake. We applied the Grading of Recommendations Assessment, Development and Evaluation (GRADE) system to evaluate the overall quality of the body of evidence.
RESULTS
Of the 14 studies that met the selection criteria, we included 12 in the meta-analysis. In the meta-analysis, 7 studies found positive effects postintervention for fruit and vegetable intake, Cohen d 0.14-0.56 (pooled effect size 0.22, 95% CI 0.11-0.33, I(2)=68.5%, P=.002), and 4 recorded positive effects on vegetable intake alone, Cohen d 0.11-0.40 (pooled effect size 0.15, 95% CI 0.04-0.28, I(2)=31.4%, P=.2). These findings should be interpreted with caution due to variability in intervention design and outcome measures. With the majority of outcomes documented as a change in combined fruit and vegetable intake, it was difficult to determine intervention effects on vegetable consumption specifically. Measurement of intake was most commonly by self-report, with 5 studies using nonvalidated tools. Longer-term follow-up was lacking from most studies (n=12). Risk of bias was high among the included studies, and the overall body of evidence was rated as low quality. The applicability of interventions to the broader young adult community was unclear due to poor description of external validity components.
CONCLUSIONS
Preliminary evidence suggests that eHealth and mHealth strategies may be effective in improving vegetable intake in young adults; whether these small effects have clinical or nutritional significance remains questionable. With studies predominantly reporting outcomes as fruit and vegetable intake combined, we suggest that interventions report vegetables separately. Furthermore, to confidently establish the efficacy of these strategies, better-quality interventions are needed for young adults, using valid measures of intake, with improved reporting on costs, sustainability and long-term effects of programs.
TRIAL REGISTRATION
PROSPERO International Prospective Register of Systematic Reviews: CRD42015017763; http://www.crd.york.ac.uk/PROSPERO/display_record.asp?ID=CRD42015017763 (Archived by WebCite at http://www.webcitation.org/6fLhMgUP4).
Topics: Adult; Cell Phone; Diet; Female; Fruit; Health Promotion; Humans; Male; Prospective Studies; Telemedicine; Vegetables; Young Adult
PubMed: 27059765
DOI: 10.2196/jmir.5082