-
Canadian Association of Radiologists... Nov 2019The required training sample size for a particular machine learning (ML) model applied to medical imaging data is often unknown. The purpose of this study was to provide...
PURPOSE
The required training sample size for a particular machine learning (ML) model applied to medical imaging data is often unknown. The purpose of this study was to provide a descriptive review of current sample-size determination methodologies in ML applied to medical imaging and to propose recommendations for future work in the field.
METHODS
We conducted a systematic literature search of articles using Medline and Embase with keywords including "machine learning," "image," and "sample size." The search included articles published between 1946 and 2018. Data regarding the ML task, sample size, and train-test pipeline were collected.
RESULTS
A total of 167 articles were identified, of which 22 were included for qualitative analysis. There were only 4 studies that discussed sample-size determination methodologies, and 18 that tested the effect of sample size on model performance as part of an exploratory analysis. The observed methods could be categorized as pre hoc model-based approaches, which relied on features of the algorithm, or post hoc curve-fitting approaches requiring empirical testing to model and extrapolate algorithm performance as a function of sample size. Between studies, we observed great variability in performance testing procedures used for curve-fitting, model assessment methods, and reporting of confidence in sample sizes.
CONCLUSIONS
Our study highlights the scarcity of research in training set size determination methodologies applied to ML in medical imaging, emphasizes the need to standardize current reporting practices, and guides future work in development and streamlining of pre hoc and post hoc sample size approaches.
Topics: Biomedical Research; Diagnostic Imaging; Humans; Machine Learning; Sample Size
PubMed: 31522841
DOI: 10.1016/j.carj.2019.06.002 -
Advances in Therapy Aug 2023Several studies have emphasized the potential of artificial intelligence (AI) and its subfields, such as machine learning (ML), as emerging and feasible approaches to... (Meta-Analysis)
Meta-Analysis
INTRODUCTION
Several studies have emphasized the potential of artificial intelligence (AI) and its subfields, such as machine learning (ML), as emerging and feasible approaches to optimize patient care in oncology. As a result, clinicians and decision-makers are faced with a plethora of reviews regarding the state of the art of applications of AI for head and neck cancer (HNC) management. This article provides an analysis of systematic reviews on the current status, and of the limitations of the application of AI/ML as adjunctive decision-making tools in HNC management.
METHODS
Electronic databases (PubMed, Medline via Ovid, Scopus, and Web of Science) were searched from inception until November 30, 2022. The study selection, searching and screening processes, inclusion, and exclusion criteria followed the Preferred Reporting Items for Systematic Review and Meta-Analysis (PRISMA) guidelines. A risk of bias assessment was conducted using a tailored and modified version of the Assessment of Systematic Review (AMSTAR-2) tool and quality assessment using the Risk of Bias in Systematic Reviews (ROBIS) guidelines.
RESULTS
Of the 137 search hits retrieved, 17 fulfilled the inclusion criteria. This analysis of systematic reviews revealed that the application of AI/ML as a decision aid in HNC management can be thematized as follows: (1) detection of precancerous and cancerous lesions within histopathologic slides; (2) prediction of the histopathologic nature of a given lesion from various sources of medical imaging; (3) prognostication; (4) extraction of pathological findings from imaging; and (5) different applications in radiation oncology. In addition, the challenges in implementation of AI/ML models for clinical evaluations include the lack of standardized methodological guidelines for the collection of clinical images, development of these models, reporting of their performance, external validation procedures, and regulatory frameworks.
CONCLUSION
At present, there is a paucity of evidence to suggest the adoption of these models in clinical practice due to the aforementioned limitations. Therefore, this manuscript highlights the need for development of standardized guidelines to facilitate the adoption and implementation of these models in the daily clinical practice. In addition, adequately powered, prospective, randomized controlled trials are urgently needed to further assess the potential of AI/ML models in real-world clinical settings for the management of HNC.
Topics: Humans; Artificial Intelligence; Head and Neck Neoplasms; Machine Learning; Prospective Studies; Research Design
PubMed: 37291378
DOI: 10.1007/s12325-023-02527-9 -
Clinics (Sao Paulo, Brazil) 2024Autism Spectrum Disorder (ASD) is a heterogeneous neurodevelopmental disorder, with main manifestations related to communication, social interaction, and behavioral... (Meta-Analysis)
Meta-Analysis Review
INTRODUCTION
Autism Spectrum Disorder (ASD) is a heterogeneous neurodevelopmental disorder, with main manifestations related to communication, social interaction, and behavioral patterns. The slight dynamics of change in the child over time require that the onset of clinical manifestations presented by the child be more valued, with the aim of stabilizing the condition. Faced with a variety of methods for diagnosing ASD, the question arises as to which method should be used. This systematic review aims to recommend the best tools to perform screening and diagnosis.
METHODOLOGY
This systematic review followed the PRISMA guidelines. The databases MEDLINE, Embase, CENTRAL (Cochrane), and Lilacs were accessed, and gray and manual searches were performed. The search strategy was created with terms referring to autism and the diagnosis/broad filter. The studies were qualitatively evaluated and quantitatively. Statistical analysis was performed using Meta-diSc-2.0 software, the confidence interval was 95 %.
RESULTS
The M-CHAT-R/F tool demonstrated a sensitivity of 78 % (95 % CI 0.57‒0.91) and specificity of 0.98 (95 % CI 0.88-1.00). The diagnostic tools demonstrated sensitivity and specificity respectively of: ADOS, sensitivity of 87 % (95 % CI 0.79‒0.92) and specificity 75 % (95 % CI 0.73‒0.78); ADI-R demonstrated test sensitivity of 77 % (95 % CI 0.56‒0.90) and specificity 68 % (95 % CI 0.52‒0.81), CARS test sensitivity was 89 % (95 % CI 0.78‒0.95) and specificity 79 % (95 % CI 0.65‒0.88).
CONCLUSION
It is mandatory to apply a screening test, the most recommended being the M-CHAT-R/F. For diagnosis CARS and ADOS are the most recommended tools.
Topics: Child; Humans; Autism Spectrum Disorder; Sensitivity and Specificity; Mass Screening; Communication; Research Design
PubMed: 38484581
DOI: 10.1016/j.clinsp.2023.100323 -
BMC Oral Health Sep 2023Tooth extraction is a common procedure performed by oral and maxillofacial surgeons or dentists, often resulting in dental fear and anxiety. The use of relaxing music,... (Meta-Analysis)
Meta-Analysis
BACKGROUND
Tooth extraction is a common procedure performed by oral and maxillofacial surgeons or dentists, often resulting in dental fear and anxiety. The use of relaxing music, audiovisuals, and virtual reality (VR) technologies has been employed to reduce dental anxiety. This network meta-analysis (NMA) aimed to assess the comparative effectiveness of relaxing music, audiovisuals, and VR in reducing dental anxiety associated with tooth extraction.
METHODS
Four electronic databases were searched up to March 8, 2023, to identify randomized controlled trials (RCTs) evaluating different multimedia interventions, including the application of using relaxing music, audiovisuals, and VR technologies for dental anxiety. Studies utilizing various anxiety scales for tooth extraction were considered eligible. The pooled standard mean difference (SMD) and 95% confidence interval (CI) of anxiety scale scores were analyzed using Bayesian NMA.
RESULTS
A total of 11 RCTs were included in this NMA. The Bayesian NMA results demonstrated that relaxing music (SMD = -0.64, 95% CI: -1.04, -0.25) and VR (SMD = -0.54, 95% CI: -1.08, -0.02) were associated with a reduction in dental anxiety, while audiovisuals (SMD = -0.34, 95% CI: -0.97, 0.33) required further consideration. Ranking probabilities indicated that relaxing music might be the most acceptable method for individuals with dental anxiety. The frequentist NMA yielded consistent rankings in a sensitivity analysis.
CONCLUSIONS
Relaxing music shows the greatest potential for reducing dental anxiety related to tooth extraction when compared to other multimedia interventions.
Topics: Humans; Dental Anxiety; Music; Music Therapy; Network Meta-Analysis; Tooth Extraction
PubMed: 37735362
DOI: 10.1186/s12903-023-03407-y -
Systematic Reviews Nov 2020Recent studies have shown an increase in open defecation and slippage of open defecation-free certified villages in Ethiopia, despite significant progress the country... (Meta-Analysis)
Meta-Analysis Review
BACKGROUND
Recent studies have shown an increase in open defecation and slippage of open defecation-free certified villages in Ethiopia, despite significant progress the country made on sanitation programs. Hence, realizing of existing facts, this study was conducted aiming at a critical review of available literature and to provide consolidated data showing the level of slippage and its associated factors in Ethiopia.
METHODS
Systematic literature searches were performed from four international databases. The search involved articles published from December 1, 2013, up to June 4, 2019. The Cochran's Q and I test statistics were used to check heterogeneity among the studies. To negotiate heterogeneity from qualitative data, we used a mixed-method approach. The researchers also conducted a publication bias assessment and sensitivity analysis. A random effect meta-analysis was employed to determine the pooled estimates of open defecation free slippage rate with a 95% confidence interval (CI). The data analysis was performed using the CMA V.3 software program.
RESULT
After screening 1382 studies, 12 studies were finally included in this systematic review. The estimated pooled rate of open defecation-free slippage in Ethiopia was 15.9% (95% CI 12.9-19.4%). The main contributing factors for open defecation-free slippage were lack of technical support, financial constraints, low-quality building materials, improper program implementation, and lack of sanitation marketing.
CONCLUSION
It was estimated that 1 out of 6 Ethiopian households engaged in open defecation after they have certified open defecation-free status, implying the low possibility of achieving sustainable development goals of 2030, which aims to ensure sanitation for all. Therefore, the government of Ethiopia and donors should better give special attention to the following options: (1) awareness for open defecation-free slippage, (2) launch a post-open defecation-free program, and (3) encourage research on pro-poor sustainable sanitation technologies.
Topics: Ethiopia; Family Characteristics; Humans; Research Design; Rural Population; Sanitation
PubMed: 33143715
DOI: 10.1186/s13643-020-01511-6 -
Journal of Medical Internet Research Aug 2022The adoption and use of technology have significantly changed health care delivery. Patient experience has become a significant factor in the entire spectrum of...
BACKGROUND
The adoption and use of technology have significantly changed health care delivery. Patient experience has become a significant factor in the entire spectrum of patient-centered health care delivery. Digital health facilitates further improvement and empowerment of patient experiences. Therefore, the design of digital health is served by insights into the barriers to and facilitators of digital patient experience (PEx).
OBJECTIVE
This study aimed to systematically review the influencing factors and design considerations of PEx in digital health from the literature and generate design guidelines for further improvement of PEx in digital health.
METHODS
We performed an umbrella systematic review following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) methodology. We searched Scopus, PubMed, and Web of Science databases. Two rounds of small random sampling (20%) were independently reviewed by 2 reviewers who evaluated the eligibility of the articles against the selection criteria. Two-round interrater reliability was assessed using the Fleiss-Cohen coefficient (k1=0.88 and k2=0.80). Thematic analysis was applied to analyze the extracted data based on a small set of a priori categories.
RESULTS
The search yielded 173 records, of which 45 (26%) were selected for data analysis. Findings and conclusions showed a great diversity; most studies presented a set of themes (19/45, 42%) or descriptive information only (16/45, 36%). The digital PEx-related influencing factors were classified into 9 categories: patient capability, patient opportunity, patient motivation, intervention technology, intervention functionality, intervention interaction design, organizational environment, physical environment, and social environment. These can have three types of impacts: positive, negative, or double edged. We captured 4 design constructs (personalization, information, navigation, and visualization) and 3 design methods (human-centered or user-centered design, co-design or participatory design, and inclusive design) as design considerations.
CONCLUSIONS
We propose the following definition for digital PEx: "Digital patient experience is the sum of all interactions affected by a patient's behavioral determinants, framed by digital technologies, and shaped by organizational culture, that influence patient perceptions across the continuum of care channeling digital health." In this study, we constructed a design and evaluation framework that contains 4 phases-define design, define evaluation, design ideation, and design evaluation-and 9 design guidelines to help digital health designers and developers address digital PEx throughout the entire design process. Finally, our review suggests 6 directions for future digital PEx-related research.
Topics: Delivery of Health Care; Digital Technology; Humans; Meta-Analysis as Topic; Reproducibility of Results; Systematic Reviews as Topic; Telemedicine; User-Centered Design
PubMed: 35925651
DOI: 10.2196/37952 -
Frontiers in Immunology 2023This systematic review and meta-analysis aimed to investigate the role of neoadjuvant immunochemotherapy with or without radiotherapy [NIC(R)T] compared to traditional... (Meta-Analysis)
Meta-Analysis
Evaluation of neoadjuvant immunotherapy and traditional neoadjuvant therapy for resectable esophageal cancer: a systematic review and single-arm and network meta-analysis.
OBJECTIVE
This systematic review and meta-analysis aimed to investigate the role of neoadjuvant immunochemotherapy with or without radiotherapy [NIC(R)T] compared to traditional neoadjuvant therapies, without immunotherapy [NC(R)T].
SUMMARY BACKGROUND DATA
NCRT followed by surgical resection is recommended for patients with early-stage esophageal cancer. However, it is uncertain whether adding immunotherapy to preoperative neoadjuvant therapy would improve patient outcomes when radical surgery is performed following neoadjuvant therapy.
METHODS
We searched PubMed, Web of Science, Embase, and Cochrane Central databases, as well as international conference abstracts. Outcomes included R0, pathological complete response (pCR), major pathological response (mPR), overall survival (OS) and disease-free survival (DFS) rates.
RESULTS
We included data from 5,034 patients from 86 studies published between 2019 and 2022. We found no significant differences between NICRT and NCRT in pCR or mPR rates. Both were better than NICT, with NCT showing the lowest response rate. Neoadjuvant immunotherapy has a significant advantage over traditional neoadjuvant therapy in terms of 1-year OS and DFS, with NICT having better outcomes than any of the other three treatments. There were no significant differences among the four neoadjuvant treatments in terms of R0 rates.
CONCLUSIONS
Among the four neoadjuvant treatment modalities, NICRT and NCRT had the highest pCR and mPR rates. There were no significant differences in the R0 rates among the four treatments. Adding immunotherapy to neoadjuvant therapy improved 1-year OS and DFS, with NICT having the highest rates compared to the other three modalities.
SYSTEMATIC REVIEW REGISTRATION
https://inplasy.com/inplasy-2022-12-0060/, identifier INPLASY2022120060.
Topics: Humans; Neoadjuvant Therapy; Network Meta-Analysis; Esophageal Neoplasms; Immunotherapy
PubMed: 37251393
DOI: 10.3389/fimmu.2023.1170569 -
Frontiers in Immunology 2023With the continuous development of clinical medicine, an increasing number of non-pharmacological interventions have been applied for the treatment of knee... (Meta-Analysis)
Meta-Analysis
Effects of externally-applied, non-pharmacological Interventions on short- and long-term symptoms and inflammatory cytokine levels in patients with knee osteoarthritis: a systematic review and network meta-analysis.
BACKGROUND
With the continuous development of clinical medicine, an increasing number of non-pharmacological interventions have been applied for the treatment of knee osteoarthritis (KOA), with the results of several recent randomized controlled trials (RCTs) showing that a variety of externally-applied, non-pharmacological interventions (EANPI) can improve symptoms and inflammation in patients with KOA. However, the relative benefits and disadvantages of non-drug therapies remain uncertain, and an optimal treatment strategy has not yet been determined.
OBJECTIVE
This study applied network meta-analysis (NMA) to compare and rank the effectiveness of EANPI on the short- and long-term clinical symptoms and inflammatory cytokine levels in patients with KOA.
METHODS
Two independent researchers searched online databases and performed manual retrieval of related citations to identify RCTs that met the selection criteria for the network meta-analysis. These researchers retrieved studies indexed from database inception to August 2023 and performed data extraction and assessment of the risk of bias.
RESULTS
The analysis included 80 RCTs involving 8440 participants and nine externally-applied, non-pharmacological therapies, namely extracorporeal shock wave, radiofrequency, acupotomy, laser therapy, Tuina therapy, kinesio taping, electroacupuncture, platelet-rich plasma injection, and ozone therapy. The treatment courses ranged from 1 to 12 weeks, with follow-up periods ranging from 4 to 24 weeks. The results of the NMA indicated that each non-drug therapy was superior to sham intervention in improving all outcome indicators. Except for the visual analog scale (VAS) and Western Ontario MacMaster (WOMAC) pain outcomes, all non-drug therapies had better efficacy than pharmacological treatments. For short-term VAS and tumor necrosis factor-alpha (TNF-α), extracorporeal shock wave performed better than other therapies (90.2% and 85.2% respectively). Radiofrequency therapy may be the most promising method to reduce long-term VAS, short- and long-term WOMAC pain, and interleukin (IL)-1β level (84.8%, 97.8%, 90.1%, 94.8% respectively). Tuina therapy may be a significant choice for short- and long-term outcomes of WOMAC function and range of motion (ROM).
CONCLUSIONS
The results of the comprehensive comparison of the outcome indicators in 9 different EANPI indicated that radiofrequency and Tuina therapy were more effective and consistently ranked high in improving clinical symptoms in the short and long term. Radiofrequency is effective at relieving pain, and Tuina therapy can be given priority for treatment when hypofunction is the main symptom. EANPI to improve pain symptoms may be related to the regulation of inflammatory cytokine levels, which may be a potential mechanism of action.
SYSTEMATIC REVIEW REGISTRATION
https://www.crd.york.ac.uk/prospero/display_record.php?, identifier CRD42023464177.
Topics: Humans; Osteoarthritis, Knee; Cytokines; Network Meta-Analysis; Pain; Acupuncture Therapy
PubMed: 38155966
DOI: 10.3389/fimmu.2023.1309751 -
Annals of Surgical Oncology Sep 2023Optimal surgical management for gastric cancer remains controversial. We aimed to perform a network meta-analysis (NMA) of randomized clinical trials (RCTs) comparing... (Meta-Analysis)
Meta-Analysis Review
BACKGROUND AND OBJECTIVES
Optimal surgical management for gastric cancer remains controversial. We aimed to perform a network meta-analysis (NMA) of randomized clinical trials (RCTs) comparing outcomes after open gastrectomy (OG), laparoscopic-assisted gastrectomy (LAG), and robotic gastrectomy (RG) for gastric cancer.
METHODS
A systematic search of electronic databases was undertaken. An NMA was performed as per the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA)-NMA guidelines. Statistical analysis was performed using R and Shiny.
RESULTS
Twenty-two RCTs including 6890 patients were included. Overall, 49.6% of patients underwent LAG (3420/6890), 46.6% underwent OG (3212/6890), and 3.7% underwent RG (258/6890). At NMA, there was a no significant difference in recurrence rates following LAG (odds ratio [OR] 1.09, 95% confidence interval [CI] 0.77-1.49) compared with OG. Similarly, overall survival (OS) outcomes were identical following OG and LAG (OS: OG, 87.0% [1652/1898] vs. LAG: OG, 87.0% [1650/1896]), with no differences in OS in meta-analysis (OR 1.02, 95% CI 0.77-1.52). Importantly, patients undergoing LAG experienced reduced intraoperative blood loss, surgical incisions, distance from proximal margins, postoperative hospital stays, and morbidity post-resection.
CONCLUSIONS
LAG was associated with non-inferior oncological and surgical outcomes compared with OG. Surgical outcomes following LAG and RG superseded OG, with similar outcomes observed for both LAG and RG. Given these findings, minimally invasive approaches should be considered for the resection of local gastric cancer, once surgeon and institutional expertise allows.
Topics: Humans; Stomach Neoplasms; Network Meta-Analysis; Treatment Outcome; Randomized Controlled Trials as Topic; Gastrectomy; Laparoscopy; Postoperative Complications
PubMed: 37261563
DOI: 10.1245/s10434-023-13654-6 -
Pediatric Surgery International Apr 2023Ladd's Procedure has been the surgical intervention of choice in the management of congenital intestinal malrotation for the past century. Historically, the procedure... (Review)
Review
BACKGROUND
Ladd's Procedure has been the surgical intervention of choice in the management of congenital intestinal malrotation for the past century. Historically, the procedure included performing an appendectomy to prevent future misdiagnosis of appendicitis, since the location of the appendix will be shifted to the left side of the abdomen. This study consists of two parts. A review of the available literature on appendectomy as part of Ladd's procedure and then a survey sent to pediatric surgeons about their approach (to remove the appendix or not) while performing a Ladd's procedure and the clinical reasoning behind their approach.
METHODS
The study consists of 2 parts: (1) a systematic review was performed to extract articles that fulfill the inclusion criteria; (2) a short online survey was designed and sent by email to 168 pediatric surgeons. The questions in the survey were centered on whether a surgeon performs an appendectomy as part of the Ladd's procedure or not, as well as their reasoning behind either choice.
RESULTS
The literature search yielded five articles, the data from the available literature are inconsistent with performing appendectomy as part of Ladd's procedure. The challenge of leaving the appendix in place has been briefly described with minimal to no focus on the clinical reasoning. The survey demonstrated that 102 responses were received (60% response rate). Ninety pediatric surgeons stated performing an appendectomy as part of the procedure (88%). Only 12% of pediatric surgeons are not performing appendectomy during Ladd's procedure.
CONCLUSION
It is difficult to implement a modification in a successful procedure like Ladd's procedure. The majority of pediatric surgeons perform an appendectomy as part of its original description. This study has identified gaps in the literature pertaining to analyze the outcomes of performing Ladd's procedure without an appendectomy which should be explored in future research.
Topics: Child; Humans; Appendectomy; Laparoscopy; Intestinal Volvulus; Digestive System Surgical Procedures
PubMed: 37010655
DOI: 10.1007/s00383-023-05437-7