-
JAMA Neurology Nov 2023Published data about the impact of poststroke seizures (PSSs) on the outcomes of patients with stroke are inconsistent and have not been systematically evaluated, to the... (Meta-Analysis)
Meta-Analysis
IMPORTANCE
Published data about the impact of poststroke seizures (PSSs) on the outcomes of patients with stroke are inconsistent and have not been systematically evaluated, to the authors' knowledge.
OBJECTIVE
To investigate outcomes in people with PSS compared with people without PSS.
DATA SOURCES
MEDLINE, Embase, PsycInfo, Cochrane, LILACS, LIPECS, and Web of Science, with years searched from 1951 to January 30, 2023.
STUDY SELECTION
Observational studies that reported PSS outcomes.
DATA EXTRACTION AND SYNTHESIS
The Preferred Reporting Items for Systematic Reviews and Meta-Analyses checklist was used for abstracting data, and the Joanna Briggs Institute tool was used for risk-of-bias assessment. Data were reported as odds ratio (OR) and standardized mean difference (SMD) with a 95% CI using a random-effects meta-analysis. Publication bias was assessed using funnel plots and the Egger test. Outlier and meta-regression analyses were performed to explore the source of heterogeneity. Data were analyzed from November 2022 to January 2023.
MAIN OUTCOMES AND MEASURES
Measured outcomes were mortality, poor functional outcome (modified Rankin scale [mRS] score 3-6), disability (mean mRS score), recurrent stroke, and dementia at patient follow-up.
RESULTS
The search yielded 71 eligible articles, including 20 110 patients with PSS and 1 166 085 patients without PSS. Of the participants with PSS, 1967 (9.8%) had early seizures, and 10 605 (52.7%) had late seizures. The risk of bias was high in 5 studies (7.0%), moderate in 35 (49.3%), and low in 31 (43.7%). PSSs were associated with mortality risk (OR, 2.1; 95% CI, 1.8-2.4), poor functional outcome (OR, 2.2; 95% CI, 1.8-2.8), greater disability (SMD, 0.6; 95% CI, 0.4-0.7), and increased dementia risk (OR, 3.1; 95% CI, 1.3-7.7) compared with patients without PSS. In subgroup analyses, early seizures but not late seizures were associated with mortality (OR, 2.4; 95% CI, 1.9-2.9 vs OR, 1.2; 95% CI, 0.8-2.0) and both ischemic and hemorrhagic stroke subtypes were associated with mortality (OR, 2.2; 95% CI, 1.8-2.7 vs OR, 1.4; 95% CI, 1.0-1.8). In addition, early and late seizures (OR, 2.4; 95% CI, 1.6-3.4 vs OR, 2.7; 95% CI, 1.8-4.1) and stroke subtypes were associated with poor outcomes (OR, 2.6; 95% CI, 1.9-3.7 vs OR, 1.9; 95% CI, 1.0-3.6).
CONCLUSIONS AND RELEVANCE
Results of this systematic review and meta-analysis suggest that PSSs were associated with significantly increased mortality and severe disability in patients with history of stroke. Unraveling these associations is a high clinical and research priority. Trials of interventions to prevent seizures may be warranted.
Topics: Humans; Stroke; Seizures; Outcome Assessment, Health Care; Dementia
PubMed: 37721736
DOI: 10.1001/jamaneurol.2023.3240 -
Arthroscopy : the Journal of... Jul 2023To systematically review the literature to compare the efficacy and safety of platelet-rich plasma (PRP), bone marrow aspirate concentrate (BMAC), and hyaluronic acid... (Meta-Analysis)
Meta-Analysis Review
Patients With Knee Osteoarthritis Who Receive Platelet-Rich Plasma or Bone Marrow Aspirate Concentrate Injections Have Better Outcomes Than Patients Who Receive Hyaluronic Acid: Systematic Review and Meta-analysis.
PURPOSE
To systematically review the literature to compare the efficacy and safety of platelet-rich plasma (PRP), bone marrow aspirate concentrate (BMAC), and hyaluronic acid (HA) injections for the treatment of knee osteoarthritis (OA).
METHODS
A systematic review was performed by searching PubMed, the Cochrane Library, and Embase to identify Level I studies that compared the clinical efficacy of at least 2 of the following 3 injection therapies: PRP, BMAC, and HA for knee OA. The search phrase used was knee AND osteoarthritis AND randomized AND ("platelet rich plasma" OR "bone marrow aspirate" OR "hyaluronic acid"). Patients were primarily assessed based on patient-reported outcome scores (PROs) including the Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC), visual analog scale (VAS) for pain, and Subjective International Knee Documentation Committee (IKDC) score.
RESULTS
Twenty-seven studies (all Level I) met inclusion criteria, including 1,042 patients undergoing intra-articular injection(s) with PRP (mean age 57.7 years, mean follow-up 13.5 months), 226 patients with BMAC (mean age 57.0 years, mean follow-up 17.5 months), and 1,128 patients with HA (mean age 59.0 years, mean follow-up 14.4 months). Nonnetwork meta-analyses demonstrated significantly better postinjection WOMAC (P < .001), VAS (P < .01), and Subjective IKDC scores (P < .001) in patients who received PRP compared with patients who received HA. Similarly, network meta-analyses demonstrated significantly better postinjection WOMAC (P < .001), VAS (P = .03), and Subjective IKDC (P < .001) scores in patients who received BMAC compared with patients who received HA. There were no significant differences in postinjection outcome scores when comparing PRP with BMAC.
CONCLUSIONS
Patients undergoing treatment for knee OA with PRP or BMAC can be expected to experience improved clinical outcomes when compared with patients who receive HA.
LEVEL OF EVIDENCE
Level I, meta-analysis of Level I studies.
Topics: Humans; Middle Aged; Hyaluronic Acid; Osteoarthritis, Knee; Bone Marrow; Treatment Outcome; Injections, Intra-Articular; Platelet-Rich Plasma
PubMed: 36913992
DOI: 10.1016/j.arthro.2023.03.001 -
Neurology Aug 2023There is growing evidence for endovascular thrombectomy (EVT) in patients with large ischemic core infarct and large vessel occlusion (LVO). The objective of this study... (Meta-Analysis)
Meta-Analysis
BACKGROUND AND OBJECTIVES
There is growing evidence for endovascular thrombectomy (EVT) in patients with large ischemic core infarct and large vessel occlusion (LVO). The objective of this study was to compare the efficacy and safety of EVT vs medical management (MM) using a systematic review and meta-analysis of observational studies and randomized controlled trials (RCTs).
METHODS
We searched the PubMed, Embase, Cochrane Library, and Web of Science databases to obtain articles related to mechanical thrombectomy for large ischemic core from inception until February 10, 2023. The primary outcome was independent ambulation (modified Rankin Scale [mRS] 0-3). Effect sizes were computed as risk ratio (RR) with random-effect or fixed-effect models. The quality of articles was evaluated through the Cochrane risk assessment tool and the Newcastle-Ottawa Scale. This study was registered in PROSPERO (CRD42023396232).
RESULTS
A total of 5,395 articles were obtained through the search and articles that did not meet the inclusion criteria were excluded by review of the title, abstract, and full text. Finally, 3 RCTs and 10 cohort studies met the inclusion criteria. The RCT analysis showed that EVT improved the 90-day functional outcomes of patients with large ischemic core with high-quality evidence, including independent ambulation (mRS 0-3: RR 1.78, 95% CI 1.28-2.48, < 0.001) and functional independence (mRS 0-2: RR 2.59, 95% CI 1.89-3.57, < 0.001), but without significantly increasing the risk of symptomatic intracranial hemorrhage (sICH: RR 1.83, 95% CI 0.95-3.55, = 0.07) or early mortality (RR 0.95, 95% CI 0.78-1.16, = 0.61). Analysis of the cohort studies showed that EVT improved functional outcomes of patients without an increase in the incidence in sICH.
DISCUSSION
This systematic review and meta-analysis indicates that in patients with LVO stroke with a large ischemic core, EVT was associated with improved functional outcomes over MM without increasing sICH risk. The results of ongoing RCTs may provide further insight in this patient population.
Topics: Humans; Stroke; Brain Ischemia; Endovascular Procedures; Thrombectomy; Ischemic Stroke; Treatment Outcome; Randomized Controlled Trials as Topic; Observational Studies as Topic
PubMed: 37277200
DOI: 10.1212/WNL.0000000000207536 -
The Lancet. Respiratory Medicine Oct 2023Although outcomes of patients after cardiac arrest remain poor, studies have suggested that extracorporeal cardiopulmonary resuscitation (ECPR) might improve survival... (Meta-Analysis)
Meta-Analysis
Extracorporeal cardiopulmonary resuscitation versus conventional cardiopulmonary resuscitation in adults with cardiac arrest: a comparative meta-analysis and trial sequential analysis.
BACKGROUND
Although outcomes of patients after cardiac arrest remain poor, studies have suggested that extracorporeal cardiopulmonary resuscitation (ECPR) might improve survival and neurological outcomes. We aimed to investigate any potential benefits of using ECPR over conventional cardiopulmonary resuscitation (CCPR) in patients with out-of-hospital cardiac arrest (OHCA) and in-hospital cardiac arrest (IHCA).
METHODS
In this systematic review and meta-analysis, we searched MEDLINE via PubMed, Embase, and Scopus from Jan 1, 2000, to April 1, 2023, for randomised controlled trials and propensity-score matched studies. We included studies comparing ECPR with CCPR in adults (aged ≥18 years) with OHCA and IHCA. We extracted data from published reports using a prespecified data extraction form. We did random-effects (Mantel-Haenszel) meta-analyses and rated the certainty of evidence using the Grading of Recommendations, Assessments, Developments, and Evaluations (GRADE) approach. We rated the risk of bias of randomised controlled trials using the Cochrane risk-of-bias 2.0 tool, and that of observational studies using the Newcastle-Ottawa Scale. The primary outcome was in-hospital mortality. Secondary outcomes included complications during extracorporeal membrane oxygenation, short-term (from hospital discharge to 30 days after cardiac arrest) and long-term (≥90 days after cardiac arrest) survival with favourable neurological outcomes (defined as cerebral performance category scores 1 or 2), and survival at 30 days, 3 months, 6 months, and 1 year after cardiac arrest. We also did trial sequential analyses to evaluate the required information sizes in the meta-analyses to detect clinically relevant reductions in mortality.
FINDINGS
We included 11 studies (4595 patients receiving ECPR and 4597 patients receiving CCPR) in the meta-analysis. ECPR was associated with a significant reduction in overall in-hospital mortality (OR 0·67, 95% CI 0·51-0·87; p=0·0034; high certainty), without evidence of publication bias (p=0·19); the trial sequential analysis was concordant with the meta-analysis. When considering IHCA only, in-hospital mortality was lower in patients receiving ECPR than in those receiving CCPR (0·42, 0·25-0·70; p=0·0009), whereas when considering OHCA only, no differences were found (0·76, 0·54-1·07; p=0·12). Centre volume (ie, the number of ECPR runs done per year in each centre) was associated with reductions in odds of mortality (regression coefficient per doubling of centre volume -0·17, 95% CI -0·32 to -0·017; p=0·030). ECPR was also associated with an increased rate of short-term (OR 1·65, 95% CI 1·02-2·68; p=0·042; moderate certainty) and long-term (2·04, 1·41-2·94; p=0·0001; high certainty) survival with favourable neurological outcomes. Additionally, patients receiving ECPR had increased survival at 30-day (OR 1·45, 95% CI 1·08-1·96; p=0·015), 3-month (3·98, 1·12-14·16; p=0·033), 6-month (1·87, 1·36-2·57; p=0·0001), and 1-year (1·72, 1·52-1·95; p<0·0001) follow-ups.
INTERPRETATION
Compared with CCPR, ECPR reduced in-hospital mortality and improved long-term neurological outcomes and post-arrest survival, particularly in patients with IHCA. These findings suggest that ECPR could be considered for eligible patients with IHCA, although further research into patients with OHCA is warranted.
FUNDING
None.
Topics: Humans; Adult; Adolescent; Treatment Outcome; Cardiopulmonary Resuscitation; Out-of-Hospital Cardiac Arrest; Extracorporeal Membrane Oxygenation; Time Factors; Retrospective Studies
PubMed: 37230097
DOI: 10.1016/S2213-2600(23)00137-6 -
Circulation. Cardiovascular... Sep 2023Short-term (≤6 months) dual antiplatelet therapy (DAPT) and DAPT de-escalation become attractive for patients with acute coronary syndrome. (Meta-Analysis)
Meta-Analysis
BACKGROUND
Short-term (≤6 months) dual antiplatelet therapy (DAPT) and DAPT de-escalation become attractive for patients with acute coronary syndrome.
METHODS
A systemic search identified randomized controlled trials that included patients with acute coronary syndrome treated using (1) standard DAPT (12 months) with clopidogrel, prasugrel (standard/low dose), or ticagrelor; (2) extended DAPT (≥18 months); (3) short-term DAPT (≤6 months) followed by P2Y inhibitor or aspirin; (4) 12-month DAPT with unguided de-escalation from potent P2Y inhibitors to low-dose potent P2Y inhibitor or clopidogrel at 1 month; and (5) guided selection DAPT with genotype or platelet function tests. The primary efficacy outcome (major adverse cardiovascular events) was a composite of cardiovascular death, myocardial infarction, or stroke. The primary safety outcome was major or minor bleeding.
RESULTS
This meta-analysis included 32 randomized controlled trials with 103 497 patients. While there were no differences in efficacy between short, unguided de-escalation and guided selection strategies, unguided de-escalation was associated with reduced risk of major adverse cardiovascular events compared with standard DAPT with clopidogrel or ticagrelor (hazard ratio [95% CI], 0.67 [0.49-0.93] and 0.68 [0.50-0.93]). Both short DAPT followed by P2Y inhibitor and unguided de-escalation were associated with reduced risks in safety compared with other strategies, including guided selection (hazard ratio [95% CI], 0.66 [0.47-0.93] and 0.48 [0.33-0.71]). Short DAPT followed by a P2Y inhibitor was associated with reduced risk of major bleeding and all-cause death compared with standard, extended DAPT (eg, versus DAPT with clopidogrel; hazard ratio [95% CI], 0.64 [0.42-0.97] and 0.60 [0.44-0.82]). By rankogram, unguided de-escalation strategy was the safest and most effective strategy in reducing major adverse cardiovascular events and major or minor bleeding while short DAPT followed by P2Y inhibitor was ranked the best for major bleeding and all-cause death.
CONCLUSIONS
In patients with acute coronary syndrome, unguided de-escalation was associated with the lowest risk of major adverse cardiovascular events and major or minor bleeding outcomes, while short DAPT followed by P2Y inhibitor was associated with the lowest risk of major bleeding and all-cause death.
Topics: Humans; Acute Coronary Syndrome; Platelet Aggregation Inhibitors; Network Meta-Analysis; Clopidogrel; Ticagrelor; Treatment Outcome
PubMed: 37609850
DOI: 10.1161/CIRCINTERVENTIONS.123.013242 -
Health Technology Assessment... Jan 2024Atopic dermatitis is a chronic relapsing inflammatory skin condition. One of the most common skin disorders in children, atopic dermatitis typically manifests before the... (Meta-Analysis)
Meta-Analysis
BACKGROUND
Atopic dermatitis is a chronic relapsing inflammatory skin condition. One of the most common skin disorders in children, atopic dermatitis typically manifests before the age of 5 years, but it can develop at any age. Atopic dermatitis is characterised by dry, inflamed skin accompanied by intense itchiness (pruritus).
OBJECTIVES
To appraise the clinical and cost effectiveness of abrocitinib, tralokinumab and upadacitinib within their marketing authorisations as alternative therapies for treating moderate-to-severe atopic dermatitis compared to systemic immunosuppressants (first-line ciclosporin A or second-line dupilumab and baricitinib).
DATA SOURCES
Studies were identified from an existing systematic review (search date 2019) and update searches of electronic databases (MEDLINE, EMBASE, CENTRAL) to November 2021, from bibliographies of retrieved studies, clinical trial registers and evidence provided by the sponsoring companies of the treatments under review.
METHODS
A systematic review of the clinical effectiveness literature was carried out and a network meta-analysis undertaken for adults and adolescents at different steps of the treatment pathway. The primary outcome of interest was a combined response of Eczema Area and Severity Index 50 + Dermatology Life Quality Index ≥ 4; where this was consistently unavailable for a step in the pathway, an analysis of Eczema Area and Severity Index 75 was conducted. A de novo economic model was developed to assess cost effectiveness from the perspective of the National Health Service in England. The model structure was informed through systematic review of the economic literature and by consulting clinical experts. Effectiveness data were obtained from the network meta-analysis. Costs and utilities were obtained from the evidence provided by sponsoring companies and standard UK sources.
RESULTS
Network meta-analyses indicate that abrocitinib 200 mg and upadacitinib 30 mg may be more effective, and tralokinumab may be less effective than dupilumab and baricitinib as second-line systemic therapies. Abrocitinib 100 mg and upadacitinib 15 mg have a more similar effectiveness to dupilumab. Upadacitinib 30 and 15 mg are likely to be more effective than ciclosporin A as a first-line therapy. Upadacitinib 15 mg, abrocitinib 200 and 100 mg may be more effective than dupilumab in adolescents. The cost effectiveness of abrocitinib and upadacitinib for both doses is dependent on the subgroup of interest. Tralokinumab can be considered cost-effective as a second-line systemic therapy owing to greater cost savings per quality-adjusted life-year lost.
CONCLUSIONS
The primary strength of the analysis of the three new drugs compared with current practice for each of the subpopulations is the consistent approach to the assessment of clinical and cost effectiveness. However, the conclusions are limited by the high uncertainty around the clinical effectiveness and lack of data for the primary outcome for comparisons with baricitinib and for the adolescent and adult first-line populations.
FUTURE WORK AND LIMITATIONS
The most significant limitation that Eczema Area and Severity Index 50 + Dermatology Life Quality Index ≥ 4 could not be obtained for the adolescent and adult first-line systemic treatment populations is due to a paucity of data for dupilumab and ciclosporin A. A comparison of the new drugs against one another in addition to current practice would be beneficial to provide a robust view on which treatments are the most cost-effective.
STUDY REGISTRATION
This study is registered as PROSPERO CRD42021266219.
FUNDING
This award was funded by the National Institute for Health and Care Research (NIHR) Evidence Synthesis programme (NIHR award ref: 135138) and is published in full in ; Vol. 28, No. 4. See the NIHR Funding and Awards website for further award information.
Topics: Child; Adult; Adolescent; Humans; Child, Preschool; Dermatitis, Atopic; Cyclosporine; State Medicine; Treatment Outcome; Cost-Benefit Analysis; Eczema; Antibodies, Monoclonal; Purines; Heterocyclic Compounds, 3-Ring; Sulfonamides; Pyrazoles; Pyrimidines; Azetidines
PubMed: 38343072
DOI: 10.3310/LEXB9006 -
Sleep Medicine Reviews Dec 2023Youth is a vulnerable developmental period associated with an increased preference for eveningness and risk for developing psychopathology. Growing evidence suggests a... (Meta-Analysis)
Meta-Analysis Review
Youth is a vulnerable developmental period associated with an increased preference for eveningness and risk for developing psychopathology. Growing evidence suggests a link between eveningness and poorer mental health outcomes, but the findings in the current literature are inconsistent, and a comprehensive synthesis of evidence in this area remains lacking. This meta-analysis aimed to 1) synthesise the existing evidence on the association between circadian preference and mental health outcomes in youths and 2) explore potential sleep-related factors that may moderate the relationship between circadian preference and mental health outcomes. A systematic search of five electronic databases resulted in 81 observational studies included in the review. Eveningness was found to be significantly associated with general mental health (r = 0.20), mood-related disturbances (r = 0.17), and anxiety problems (r = 0.13). The qualitative review also identified that eveningness was associated with greater risks for psychotic symptoms and maladaptive eating behaviours. These findings highlighted the need to consider circadian preference in the clinical management of youth mental health problems. Further research is needed to examine the efficacy of a circadian-focused intervention in the context of youth mental health.
Topics: Humans; Adolescent; Sleep; Psychotic Disorders; Anxiety Disorders; Mood Disorders; Outcome Assessment, Health Care; Circadian Rhythm; Surveys and Questionnaires
PubMed: 37793219
DOI: 10.1016/j.smrv.2023.101851 -
BMJ Open Nov 2023Head-to-head clinical trials are common in psoriasis, but scarce in psoriatic arthritis (PsA), making treatment comparisons between therapeutic classes difficult. This... (Meta-Analysis)
Meta-Analysis
OBJECTIVES
Head-to-head clinical trials are common in psoriasis, but scarce in psoriatic arthritis (PsA), making treatment comparisons between therapeutic classes difficult. This study describes the relative effectiveness of targeted synthetic (ts) and biologic (b) disease-modifying antirheumatic drugs (DMARDs) on patient-reported outcomes (PROs) through network meta-analysis (NMA).
DESIGN
A systematic literature review (SLR) was conducted in January 2020. Bayesian NMAs were conducted to compare treatments on Health Assessment Questionnaire Disability Index (HAQ-DI) and 36-item Short Form (SF-36) Health Survey including Mental Component Summary (MCS) and Physical Component Summary (PCS) scores.
DATA SOURCES
Ovid MEDLINE (including Epub Ahead of Print, In-Process & Other Non-Indexed Citations and Daily),Embase and Cochrane Central Register of Controlled Trials.
ELIGIBILITY CRITERIA
Phase III randomised controlled trials (RCTs) evaluating patients with PsA receiving tsDMARDS, bDMARDs or placebo were included in the SLR; there was no restriction on outcomes.
DATA EXTRACTION AND SYNTHESIS
Two independent researchers reviewed all citations. Data for studies meeting all inclusion criteria were extracted into a standardised Excel-based form by one reviewer and validated by a second reviewer. A third reviewer was consulted to resolve any discrepancies, as necessary. Risk of bias was assessed using the The National Institute for Health and Care Excellence clinical effectiveness quality assessment checklist.
RESULTS
In total, 26 RCTs were included. For HAQ-DI, SF-36 PCS and SF-36 MCS scores, intravenous tumour necrosis factor (TNF) alpha inhibitors generally ranked higher than most other classes of therapies available to treat patients with PsA. For almost all outcomes, several interleukin (IL)-23, IL-17A, subcutaneous TNF and IL-12/23 agents offered comparable improvement, while cytotoxic T-lymphocyte-associated antigen 4, phosphodiesterase-4 and Janus kinase inhibitors often had the lowest efficacy.
CONCLUSIONS
While intravenous TNFs may provide some improvements in PROs relative to several other tsDMARDs and bDMARDs for the treatment of patients with PsA, differences between classes of therapies across outcomes were small.
Topics: Humans; Arthritis, Psoriatic; Antibodies, Monoclonal; Network Meta-Analysis; Antirheumatic Agents; Patient Reported Outcome Measures
PubMed: 37940157
DOI: 10.1136/bmjopen-2022-062306 -
Current Oncology Reports Sep 2023Breast cancer-related lymphedema (BCRL) is a debilitating progressive disease resulting in various impairments and dysfunctions. Complete decongestive therapy embodies... (Review)
Review
PURPOSE OF REVIEW
Breast cancer-related lymphedema (BCRL) is a debilitating progressive disease resulting in various impairments and dysfunctions. Complete decongestive therapy embodies conservative rehabilitation treatments for BCRL. Surgical procedures performed by plastic and reconstructive microsurgeons are available when conservative treatment fails. The purpose of this systematic review was to investigate which rehabilitation interventions contribute to the highest level of pre- and post-microsurgical outcomes.
RECENT FINDINGS
Studies published between 2002 and 2022 were grouped for analysis. This review was registered with PROSPERO (CRD42022341650) and followed the PRISMA guidelines. Levels of evidence were based upon study design and quality. The initial literature search yielded 296 results, of which, 13 studies met all inclusion criteria. Lymphovenous bypass anastomoses (LVB/A) and vascularized lymph node transplant (VLNT) emerged as dominant surgical procedures. Peri-operative outcome measures varied greatly and were used inconsistently. There is a dearth of high quality literature leading to a gap in knowledge as to how BCRL microsurgical and conservative interventions complement each other. Peri-operative guidelines are needed to bridge the knowledge and care gap between lymphedema surgeons and therapists. A core set of outcome measures for BCRL is vital to unify terminological differences in the multidisciplinary care of BCRL. Complete decongestive therapy embodies conservative rehabilitation treatments for breast cancer-related lymphedema (BCRL). Surgical procedures performed by microsurgeons are available when conservative treatment fails. This systematic review investigated which rehabilitation interventions contribute to the highest level of pre- and post-microsurgical outcomes. Thirteen studies met all inclusion criteria and revealed that there is a dearth of high quality literature leading to a gap in knowledge as to how BCRL microsurgical and conservative interventions complement each other. Furthermore, peri-operative outcome measures were inconsistent. Peri-operative guidelines are needed to bridge the knowledge and care gap between lymphedema surgeons and therapists.
Topics: Humans; Female; Breast Neoplasms; Lymphedema; Outcome Assessment, Health Care
PubMed: 37402044
DOI: 10.1007/s11912-023-01439-9 -
JAMA Network Open Sep 2023Artificial intelligence (AI) has gained considerable attention in health care, yet concerns have been raised around appropriate methods and fairness. Current AI...
IMPORTANCE
Artificial intelligence (AI) has gained considerable attention in health care, yet concerns have been raised around appropriate methods and fairness. Current AI reporting guidelines do not provide a means of quantifying overall quality of AI research, limiting their ability to compare models addressing the same clinical question.
OBJECTIVE
To develop a tool (APPRAISE-AI) to evaluate the methodological and reporting quality of AI prediction models for clinical decision support.
DESIGN, SETTING, AND PARTICIPANTS
This quality improvement study evaluated AI studies in the model development, silent, and clinical trial phases using the APPRAISE-AI tool, a quantitative method for evaluating quality of AI studies across 6 domains: clinical relevance, data quality, methodological conduct, robustness of results, reporting quality, and reproducibility. These domains included 24 items with a maximum overall score of 100 points. Points were assigned to each item, with higher points indicating stronger methodological or reporting quality. The tool was applied to a systematic review on machine learning to estimate sepsis that included articles published until September 13, 2019. Data analysis was performed from September to December 2022.
MAIN OUTCOMES AND MEASURES
The primary outcomes were interrater and intrarater reliability and the correlation between APPRAISE-AI scores and expert scores, 3-year citation rate, number of Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) low risk-of-bias domains, and overall adherence to the Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (TRIPOD) statement.
RESULTS
A total of 28 studies were included. Overall APPRAISE-AI scores ranged from 33 (low quality) to 67 (high quality). Most studies were moderate quality. The 5 lowest scoring items included source of data, sample size calculation, bias assessment, error analysis, and transparency. Overall APPRAISE-AI scores were associated with expert scores (Spearman ρ, 0.82; 95% CI, 0.64-0.91; P < .001), 3-year citation rate (Spearman ρ, 0.69; 95% CI, 0.43-0.85; P < .001), number of QUADAS-2 low risk-of-bias domains (Spearman ρ, 0.56; 95% CI, 0.24-0.77; P = .002), and adherence to the TRIPOD statement (Spearman ρ, 0.87; 95% CI, 0.73-0.94; P < .001). Intraclass correlation coefficient ranges for interrater and intrarater reliability were 0.74 to 1.00 for individual items, 0.81 to 0.99 for individual domains, and 0.91 to 0.98 for overall scores.
CONCLUSIONS AND RELEVANCE
In this quality improvement study, APPRAISE-AI demonstrated strong interrater and intrarater reliability and correlated well with several study quality measures. This tool may provide a quantitative approach for investigators, reviewers, editors, and funding organizations to compare the research quality across AI studies for clinical decision support.
Topics: Humans; Artificial Intelligence; Decision Support Systems, Clinical; Reproducibility of Results; Machine Learning; Clinical Relevance
PubMed: 37747733
DOI: 10.1001/jamanetworkopen.2023.35377