-
Journal of Biomedical Informatics May 2020This review aims to: 1) evaluate the quality of model reporting, 2) provide an overview of methodology for developing and validating Early Warning Score Systems (EWSs)... (Review)
Review
OBJECTIVES
This review aims to: 1) evaluate the quality of model reporting, 2) provide an overview of methodology for developing and validating Early Warning Score Systems (EWSs) for adult patients in acute care settings, and 3) highlight the strengths and limitations of the methodologies, as well as identify future directions for EWS derivation and validation studies.
METHODOLOGY
A systematic search was conducted in PubMed, Cochrane Library, and CINAHL. Only peer reviewed articles and clinical guidelines regarding developing and validating EWSs for adult patients in acute care settings were included. 615 articles were extracted and reviewed by five of the authors. Selected studies were evaluated based on the Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) checklist. The studies were analyzed according to their study design, predictor selection, outcome measurement, methodology of modeling, and validation strategy.
RESULTS
A total of 29 articles were included in the final analysis. Twenty-six articles reported on the development and validation of a new EWS, while three reported on validation and model modification. Only eight studies met more than 75% of the items in the TRIPOD checklist. Three major techniques were utilized among the studies to inform their predictive algorithms: 1) clinical-consensus models (n = 6), 2) regression models (n = 15), and 3) tree models (n = 5). The number of predictors included in the EWSs varied from 3 to 72 with a median of seven. Twenty-eight models included vital signs, while 11 included lab data. Pulse oximetry, mental status, and other variables extracted from electronic health records (EHRs) were among other frequently used predictors. In-hospital mortality, unplanned transfer to the intensive care unit (ICU), and cardiac arrest were commonly used clinical outcomes. Twenty-eight studies conducted a form of model validation either within the study or against other widely-used EWSs. Only three studies validated their model using an external database separate from the derived database.
CONCLUSION
This literature review demonstrates that the characteristics of the cohort, predictors, and outcome selection, as well as the metrics for model validation, vary greatly across EWS studies. There is no consensus on the optimal strategy for developing such algorithms since data-driven models with acceptable predictive accuracy are often site-specific. A standardized checklist for clinical prediction model reporting exists, but few studies have included reporting aligned with it in their publications. Data-driven models are subjected to biases in the use of EHR data, thus it is particularly important to provide detailed study protocols and acknowledge, leverage, or reduce potential biases of the data used for EWS development to improve transparency and generalizability.
Topics: Adult; Early Warning Score; Humans; Intensive Care Units; Models, Statistical; Prognosis; Vital Signs
PubMed: 32278089
DOI: 10.1016/j.jbi.2020.103410 -
JMIR MHealth and UHealth Jan 2022Wearable devices hold great promise, particularly for data generation for cutting-edge health research, and their demand has risen substantially in recent years.... (Review)
Review
BACKGROUND
Wearable devices hold great promise, particularly for data generation for cutting-edge health research, and their demand has risen substantially in recent years. However, there is a shortage of aggregated insights into how wearables have been used in health research.
OBJECTIVE
In this review, we aim to broadly overview and categorize the current research conducted with affordable wearable devices for health research.
METHODS
We performed a scoping review to understand the use of affordable, consumer-grade wearables for health research from a population health perspective using the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) framework. A total of 7499 articles were found in 4 medical databases (PubMed, Ovid, Web of Science, and CINAHL). Studies were eligible if they used noninvasive wearables: worn on the wrist, arm, hip, and chest; measured vital signs; and analyzed the collected data quantitatively. We excluded studies that did not use wearables for outcome assessment and prototype studies, devices that cost >€500 (US $570), or obtrusive smart clothing.
RESULTS
We included 179 studies using 189 wearable devices covering 10,835,733 participants. Most studies were observational (128/179, 71.5%), conducted in 2020 (56/179, 31.3%) and in North America (94/179, 52.5%), and 93% (10,104,217/10,835,733) of the participants were part of global health studies. The most popular wearables were fitness trackers (86/189, 45.5%) and accelerometer wearables, which primarily measure movement (49/189, 25.9%). Typical measurements included steps (95/179, 53.1%), heart rate (HR; 55/179, 30.7%), and sleep duration (51/179, 28.5%). Other devices measured blood pressure (3/179, 1.7%), skin temperature (3/179, 1.7%), oximetry (3/179, 1.7%), or respiratory rate (2/179, 1.1%). The wearables were mostly worn on the wrist (138/189, 73%) and cost <€200 (US $228; 120/189, 63.5%). The aims and approaches of all 179 studies revealed six prominent uses for wearables, comprising correlations-wearable and other physiological data (40/179, 22.3%), method evaluations (with subgroups; 40/179, 22.3%), population-based research (31/179, 17.3%), experimental outcome assessment (30/179, 16.8%), prognostic forecasting (28/179, 15.6%), and explorative analysis of big data sets (10/179, 5.6%). The most frequent strengths of affordable wearables were validation, accuracy, and clinical certification (104/179, 58.1%).
CONCLUSIONS
Wearables showed an increasingly diverse field of application such as COVID-19 prediction, fertility tracking, heat-related illness, drug effects, and psychological interventions; they also included underrepresented populations, such as individuals with rare diseases. There is a lack of research on wearable devices in low-resource contexts. Fueled by the COVID-19 pandemic, we see a shift toward more large-sized, web-based studies where wearables increased insights into the developing pandemic, including forecasting models and the effects of the pandemic. Some studies have indicated that big data extracted from wearables may potentially transform the understanding of population health dynamics and the ability to forecast health trends.
Topics: COVID-19; Fitness Trackers; Humans; Pandemics; SARS-CoV-2; Wearable Electronic Devices
PubMed: 35076409
DOI: 10.2196/34384 -
Journal of Endodontics May 2018The aim of this systematic review was to investigate and compare the diagnostic accuracy including sensitivity, specificity, adjusted accuracy, adjusted positive... (Meta-Analysis)
Meta-Analysis Review
INTRODUCTION
The aim of this systematic review was to investigate and compare the diagnostic accuracy including sensitivity, specificity, adjusted accuracy, adjusted positive predictive value (PPV), and adjusted negative predictive value (NPV) of cold pulp testing (CPT), heat pulp testing (HPT), electric pulp testing (EPT), laser Doppler flowmetry (LDF), and pulse oximetry (PO).
METHODS
Three electronic databases were searched from January 1964 to December 2016. True-positive, false-positive, true-negative, and false-negative values were extracted from data in each study. Sensitivity, specificity, adjusted accuracy, adjusted PPV, and adjusted NPV were calculated from those values, if not presented. A random effects model was used to calculate pooled estimates of sensitivity, specificity, adjusted accuracy, adjusted PPV, and adjusted NPV.
RESULTS
A total of 125 articles were identified, and 28 studies were included for the final review. The pooled estimates of sensitivity for CPT, EPT, HPT, LDF, and PO were 0.87, 0.72, 0.78, 0.98, and 0.97, respectively. Those of specificity were 0.84, 0.93, 0.67, 0.95, and 0.95, respectively. Those of adjusted accuracy were 0.84, 0.82, 0.72, 0.97, and 0.97, respectively. For adjusted PPV, they were 0.81, 0.89, 0.62, 0.94, and 0.94, respectively, and for adjusted NPV, they were 0.87, 0.80, 0.79, 1.00, and 0.99, respectively.
CONCLUSIONS
LDF and PO were the most accurate diagnostic methods, and HPT was the least accurate diagnostic method. EPT showed high accuracy when testing vital teeth (specificity = 0.93) but low accuracy when assessing nonvital teeth (sensitivity = 0.72). CPT had moderate accuracy when evaluating vital (specificity = 0.84) and nonvital (sensitivity = 0.87) teeth.
Topics: Dental Pulp Test; Humans; Laser-Doppler Flowmetry; Oximetry; Reproducibility of Results; Sensitivity and Specificity
PubMed: 29571914
DOI: 10.1016/j.joen.2018.01.021 -
The Cochrane Database of Systematic... Mar 2018Health outcomes are improved when newborn babies with critical congenital heart defects (CCHDs) are detected before acute cardiovascular collapse. The main screening... (Meta-Analysis)
Meta-Analysis Review
BACKGROUND
Health outcomes are improved when newborn babies with critical congenital heart defects (CCHDs) are detected before acute cardiovascular collapse. The main screening tests used to identify these babies include prenatal ultrasonography and postnatal clinical examination; however, even though both of these methods are available, a significant proportion of babies are still missed. Routine pulse oximetry has been reported as an additional screening test that can potentially improve detection of CCHD.
OBJECTIVES
• To determine the diagnostic accuracy of pulse oximetry as a screening method for detection of CCHD in asymptomatic newborn infants• To assess potential sources of heterogeneity, including:○ characteristics of the population: inclusion or exclusion of antenatally detected congenital heart defects;○ timing of testing: < 24 hours versus ≥ 24 hours after birth;○ site of testing: right hand and foot (pre-ductal and post-ductal) versus foot only (post-ductal);○ oxygen saturation: functional versus fractional;○ study design: retrospective versus prospective design, consecutive versus non-consecutive series; and○ risk of bias for the "flow and timing" domain of QUADAS-2.
SEARCH METHODS
We searched the Cochrane Central Register of Controlled Trials (CENTRAL; 2017, Issue 2) in the Cochrane Library and the following databases: MEDLINE, Embase, the Cumulative Index to Nursing and Allied Health Literature (CINAHL), and Health Services Research Projects in Progress (HSRProj), up to March 2017. We searched the reference lists of all included articles and relevant systematic reviews to identify additional studies not found through the electronic search. We applied no language restrictions.
SELECTION CRITERIA
We selected studies that met predefined criteria for design, population, tests, and outcomes. We included cross-sectional and cohort studies assessing the diagnostic accuracy of pulse oximetry screening for diagnosis of CCHD in term and late preterm asymptomatic newborn infants. We considered all protocols of pulse oximetry screening (eg, different saturation thresholds to define abnormality, post-ductal only or pre-ductal and post-ductal measurements, test timing less than or greater than 24 hours). Reference standards were diagnostic echocardiography (echocardiogram) and clinical follow-up, including postmortem findings, mortality, and congenital anomaly databases.
DATA COLLECTION AND ANALYSIS
We extracted accuracy data for the threshold used in primary studies. We explored between-study variability and correlation between indices visually through use of forest and receiver operating characteristic (ROC) plots. We assessed risk of bias in included studies using the QUADAS-2 tool. We used the bivariate model to calculate random-effects pooled sensitivity and specificity values. We investigated sources of heterogeneity using subgroup analyses and meta-regression.
MAIN RESULTS
Twenty-one studies met our inclusion criteria (N = 457,202 participants). Nineteen studies provided data for the primary analysis (oxygen saturation threshold < 95% or ≤ 95%; N = 436,758 participants). The overall sensitivity of pulse oximetry for detection of CCHD was 76.3% (95% confidence interval [CI] 69.5 to 82.0) (low certainty of the evidence). Specificity was 99.9% (95% CI 99.7 to 99.9), with a false-positive rate of 0.14% (95% CI 0.07 to 0.22) (high certainty of the evidence). Summary positive and negative likelihood ratios were 535.6 (95% CI 280.3 to 1023.4) and 0.24 (95% CI 0.18 to 0.31), respectively. These results showed that out of 10,000 apparently healthy late preterm or full-term newborn infants, six will have CCHD (median prevalence in our review). Screening by pulse oximetry will detect five of these infants as having CCHD and will miss one case. In addition, screening by pulse oximetry will falsely identify another 14 infants out of the 10,000 as having suspected CCHD when they do not have it.The false-positive rate for detection of CCHD was lower when newborn pulse oximetry was performed longer than 24 hours after birth than when it was performed within 24 hours (0.06%, 95% CI 0.03 to 0.13, vs 0.42%, 95% CI 0.20 to 0.89; P = 0.027).Forest and ROC plots showed greater variability in estimated sensitivity than specificity across studies. We explored heterogeneity by conducting subgroup analyses and meta-regression of inclusion or exclusion of antenatally detected congenital heart defects, timing of testing, and risk of bias for the "flow and timing" domain of QUADAS-2, and we did not find an explanation for the heterogeneity in sensitivity.
AUTHORS' CONCLUSIONS
Pulse oximetry is a highly specific and moderately sensitive test for detection of CCHD with very low false-positive rates. Current evidence supports the introduction of routine screening for CCHD in asymptomatic newborns before discharge from the well-baby nursery.
Topics: Asymptomatic Diseases; Data Accuracy; False Positive Reactions; Heart Defects, Congenital; Humans; Infant, Newborn; Oximetry; Sensitivity and Specificity
PubMed: 29494750
DOI: 10.1002/14651858.CD011912.pub2 -
International Journal of Environmental... Aug 2022The current systematic review and meta-analysis was carried out to compare the diagnostic accuracy of pulp vitality and pulp sensibility tests in assessing pulpal... (Meta-Analysis)
Meta-Analysis Review
The current systematic review and meta-analysis was carried out to compare the diagnostic accuracy of pulp vitality and pulp sensibility tests in assessing pulpal health. PubMed/MEDLINE, Cochrane Central Register of Controlled Trials, Web of Science, Google Scholar and Open Grey databases were searched and after assessing eligibility criteria the data were extracted. True-positive, false-positive, true-negative, false-negative, sensitivity and specificity values were extracted or calculated if not presented. Quality of studies was evaluated based on the QUADAS 2 tool. Meta-analysis was performed in MetaDTA (v2.0; Shinyapps, RStudio PBC, Boston, MA, USA) and Review Manager 5.3 (RevMan web; The Cochrane Collaboration, London, UK). Ten articles were included for qualitative synthesis and five for meta-analysis. The pooled diagnostic odds ratio for pulse oximeter (PO), electric pulp tester (EPT), cold test (CT) and heat test (HT) was 628.5, 10.75, 17.24 and 3.47, respectively. Pairwise comparison demonstrated a higher pooled mean sensitivity and specificity with PO compared with EPT. Comparison between PO and CT and between PO and HT also demonstrated a higher pooled mean sensitivity and specificity for PO. Summary points on receiver operating characteristic curves confirmed the ability of PO to correctly screen negatives in presenting patients as compared to EPT, CT and HT but no study was rated as good on quality assessment. PO can be considered as the most accurate diagnostic method as compared to EPT, CT and HT. This review provides information about the reliability and diagnostic accuracy of using pulp vitality and sensibility tests for assessing pulp status.
Topics: Dentition, Permanent; Hot Temperature; Humans; Oximetry; Reproducibility of Results; Sensitivity and Specificity
PubMed: 35954958
DOI: 10.3390/ijerph19159599 -
Cardiology in the Young May 2021Medical advancements have encouraged minimally invasive surgical repair of congenital heart defects such as ventricular septal defects (VSDs), and the diagnostic process...
BACKGROUND
Medical advancements have encouraged minimally invasive surgical repair of congenital heart defects such as ventricular septal defects (VSDs), and the diagnostic process can now be carried out using non-traditional techniques such as pulse oximetry. This, in turn, has improved clinical outcomes with reduced complication rates post-surgery. However, the variations in type of VSDs, age of patient, comorbidities, and access to closure devices may limit the efficacy of surgical advancements.
METHODS
Articles were identified amongst Scopus, MEDLINE, and PubMed using various relevant search strings using PRISMA guidelines. Of the 115 articles initially extracted, 10 were eventually reviewed after duplicates and irrelevant studies were removed.
RESULTS
Of the 24 eligible articles, 10 papers were selected for analysis. Minimally invasive approaches to VSD repair was associated with satisfactory short-term outcomes when compared to open repair. For diagnosis of congenital VSD, whilst recent advances such as pulse oximetry method and genome analysis are more sensitive, the limited availability and access to such investigatory methods must be recognised.
CONCLUSION
Pulse oximetry and fetal echocardiography are established non-invasive diagnostic tools for VSD. The recent advances in minimally invasive treatment options including periventricular approach and transcatheter techniques have improved patient outcomes, yet at the expense of higher residual rates. Careful patient selection for each technique and follow-up should be planned through multidisciplinary team meetings.
Topics: Cardiac Catheterization; Echocardiography; Heart Defects, Congenital; Heart Septal Defects, Ventricular; Humans; Infant; Infant, Newborn; Patient Selection; Treatment Outcome
PubMed: 33327983
DOI: 10.1017/S1047951120004576 -
BMC Medicine Aug 2022During the COVID-19 pandemic, there have been concerns regarding potential bias in pulse oximetry measurements for people with high levels of skin pigmentation. We... (Meta-Analysis)
Meta-Analysis
BACKGROUND
During the COVID-19 pandemic, there have been concerns regarding potential bias in pulse oximetry measurements for people with high levels of skin pigmentation. We systematically reviewed the effects of skin pigmentation on the accuracy of oxygen saturation measurement by pulse oximetry (SpO) compared with the gold standard SaO measured by CO-oximetry.
METHODS
We searched Ovid MEDLINE, Ovid Embase, EBSCO CINAHL, ClinicalTrials.gov, and WHO International Clinical Trials Registry Platform (up to December 2021) for studies with SpO-SaO comparisons and measuring the impact of skin pigmentation or ethnicity on pulse oximetry accuracy. We performed meta-analyses for mean bias (the primary outcome in this review) and its standard deviations (SDs) across studies included for each subgroup of skin pigmentation and ethnicity and used these pooled mean biases and SDs to calculate accuracy root-mean-square (A) and 95% limits of agreement. The review was registered with the Open Science Framework ( https://osf.io/gm7ty ).
RESULTS
We included 32 studies (6505 participants): 15 measured skin pigmentation and 22 referred to ethnicity. Compared with standard SaO measurement, pulse oximetry probably overestimates oxygen saturation in people with the high level of skin pigmentation (pooled mean bias 1.11%; 95% confidence interval 0.29 to 1.93%) and people described as Black/African American (1.52%; 0.95 to 2.09%) (moderate- and low-certainty evidence). The bias of pulse oximetry measurements for people with other levels of skin pigmentation or those from other ethnic groups is either more uncertain or suggests no overestimation. Whilst the extent of mean bias is small or negligible for all subgroups evaluated, the associated imprecision is unacceptably large (pooled SDs > 1%). When the extent of measurement bias and precision is considered jointly, pulse oximetry measurements for all the subgroups appear acceptably accurate (with A < 4%).
CONCLUSIONS
Pulse oximetry may overestimate oxygen saturation in people with high levels of skin pigmentation and people whose ethnicity is reported as Black/African American, compared with SaO. The extent of overestimation may be small in hospital settings but unknown in community settings. REVIEW PROTOCOL REGISTRATION: https://osf.io/gm7ty.
Topics: COVID-19; Humans; Oximetry; Oxygen; Oxygen Saturation; Pandemics; Skin Pigmentation
PubMed: 35971142
DOI: 10.1186/s12916-022-02452-8 -
Chest Aug 2023Respiratory failure is a significant concern in neuromuscular diseases (NMDs). This CHEST guideline examines the literature on the respiratory management of patients...
BACKGROUND
Respiratory failure is a significant concern in neuromuscular diseases (NMDs). This CHEST guideline examines the literature on the respiratory management of patients with NMD to provide evidence-based recommendations.
STUDY DESIGN AND METHODS
An expert panel conducted a systematic review addressing the respiratory management of NMD and applied the Grading of Recommendations, Assessment, Development, and Evaluations approach for assessing the certainty of the evidence and formulating and grading recommendations. A modified Delphi technique was used to reach a consensus on the recommendations.
RESULTS
Based on 128 studies, the panel generated 15 graded recommendations, one good practice statement, and one consensus-based statement.
INTERPRETATION
Evidence of best practices for respiratory management in NMD is limited and is based primarily on observational data in amyotrophic lateral sclerosis. The panel found that pulmonary function testing every 6 months may be beneficial and may be used to initiate noninvasive ventilation (NIV) when clinically indicated. An individualized approach to NIV settings may benefit patients with chronic respiratory failure and sleep-disordered breathing related to NMD. When resources allow, polysomnography or overnight oximetry can help to guide the initiation of NIV. The panel provided guidelines for mouthpiece ventilation, transition to home mechanical ventilation, salivary secretion management, and airway clearance therapies. The guideline panel emphasizes that NMD pathologic characteristics represent a diverse group of disorders with differing rates of decline in lung function. The clinician's role is to add evaluation at the bedside to shared decision-making with patients and families, including respect for patient preferences and treatment goals, considerations of quality of life, and appropriate use of available resources in decision-making.
Topics: Humans; Quality of Life; Respiration, Artificial; Noninvasive Ventilation; Respiratory Insufficiency; Physicians
PubMed: 36921894
DOI: 10.1016/j.chest.2023.03.011 -
Sports Medicine (Auckland, N.Z.) Mar 2018Since the introduction (in 2006) of commercially available portable wireless muscle oximeters, the use of muscle near-infrared spectroscopy (NIRS) technology is gaining... (Meta-Analysis)
Meta-Analysis Review
BACKGROUND
Since the introduction (in 2006) of commercially available portable wireless muscle oximeters, the use of muscle near-infrared spectroscopy (NIRS) technology is gaining in popularity as an application to observe changes in muscle metabolism and muscle oxygenation during and after exercise or training interventions in both laboratory and applied sports settings.
OBJECTIVES
The objectives of this systematic review were to highlight the application of muscle oximetry in evaluating oxidative skeletal muscle performance to sport activities and emphasize how this technology has been applied to exercise and training.
METHODS
Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines were followed in a systematic fashion to search, assess and synthesize existing literature on this topic. The Scopus and MEDLINE/PubMed electronic databases were searched to 1 March 2017. Potential inclusions were screened against eligibility criteria relating to recreationally trained to elite athletes, with or without training programs, who must have assessed physiological variables monitored by commercial oximeters or NIRS instrumentation.
RESULTS
Of the 14,609 identified records, only 57 studies met the eligibility criteria. This systematic review highlighted a number of key findings in 16 sporting activities. Overall, NIRS information can be used as a marker of skeletal muscle oxidative capacity and for analyzing muscle performance factors.
CONCLUSIONS
Although NIRS instrumentation is promising in evaluating oxidative skeletal muscle performance when used in sport settings, there is still the need for further instrumental development and randomized/longitudinal trials to support the detailed advantages of muscle oximetry utilization in sports science.
Topics: Adolescent; Adult; Exercise; Exercise Test; Hand Strength; Heart Rate; Humans; Infant, Newborn; Male; Muscle, Skeletal; Oximetry; Oxygen; Oxygen Consumption; Running; Spectroscopy, Near-Infrared; Sports
PubMed: 29177977
DOI: 10.1007/s40279-017-0820-1 -
American Journal of Perinatology Nov 2023Congenital heart defects (CHDs) are the most common neonatal malformations and are a leading cause of infant death in developed countries. Finding safe and effective... (Meta-Analysis)
Meta-Analysis
Congenital heart defects (CHDs) are the most common neonatal malformations and are a leading cause of infant death in developed countries. Finding safe and effective diagnostic methods to screen for CHDs is important. The aim of this study was to evaluate the effectiveness of pulse oximetry (PO) and perfusion index (PI) in screening CHD. We conducted a systematic review of studies in PubMed, Embase, and the Cochrane Library published on or before October 1, 2021. Studies based on PICOS were included in this systematic review. The flow chart is made by PRISMA software. The quality of included studies was assessed by RevMan5 software (QUADAS-2: Quality Assessment of Diagnostic Accuracy Studies-2). The sensitivity, specificity, and other measurements of accuracy were pooled using Stata/SE 12.0 software. Five studies containing 46,965 neonates were included in this study. A randomized-effects model was used for the meta-analysis because of significant heterogeneity. The combined sensitivity and specificity were 0.82 (95% confidence interval [CI], 0.53-0.95) and 0.97 (95% CI, 0.57-1.00), respectively. The area under the curve was 0.92 (95% CI, 0.89-0.94). The combination PO and PI was significant in CHD screening. Once diagnosed by the combined method, it means that the neonate is most likely to have a CHD. KEY POINTS: · Pulse oximetry and PI screening.. · Congenital heart defects.. · A systematic review and meta-analysis..
Topics: Infant, Newborn; Infant; Humans; Perfusion Index; Neonatal Screening; Oximetry; Sensitivity and Specificity; Heart Defects, Congenital
PubMed: 35580627
DOI: 10.1055/s-0042-1748163