-
Journal of Graduate Medical Education Feb 2021In-training examinations (ITEs) are intended for low-stakes, formative assessment of residents' knowledge, but are increasingly used for high-stake purposes, such as to... (Review)
Review
BACKGROUND
In-training examinations (ITEs) are intended for low-stakes, formative assessment of residents' knowledge, but are increasingly used for high-stake purposes, such as to predict board examination failures.
OBJECTIVE
The aim of this review was to investigate the relationship between performance on ITEs and board examination performance across medical specialties.
METHODS
A search of the literature for studies assessing the strength of the relationship between ITE and board examination performance from January 2000 to March 2019 was completed. Results were categorized based on the type of statistical analysis used to determine the relationship between ITE performance and board examination performance.
RESULTS
Of 1407 articles initially identified, 89 articles underwent full-text review, and 32 articles were included in this review. There was a moderate-strong relationship between ITE and board examination performance, and ITE scores significantly predict board examination scores for the majority of studies. Performing well on an ITE predicts a passing outcome for the board examination, but there is less evidence that performing poorly on an ITE will result in failing the associated specialty board examination.
CONCLUSIONS
There is a moderate to strong correlation between ITE performance and subsequent performance on board examinations. That the predictive value for passing the board examination is stronger than the predictive value for failing calls into question the "common wisdom" that ITE scores can be used to identify "at risk" residents. The graduate medical education community should continue to exercise caution and restraint in using ITE scores for moderate to high-stakes decisions.
Topics: Clinical Competence; Education, Medical, Graduate; Educational Measurement; Humans; Internship and Residency; Specialty Boards
PubMed: 33680301
DOI: 10.4300/JGME-D-20-00111.1 -
European Radiology Oct 2020To review the diagnostic performance of contemporary imaging modalities for determining local disease extent and nodal metastasis in patients with newly diagnosed... (Meta-Analysis)
Meta-Analysis
OBJECTIVES
To review the diagnostic performance of contemporary imaging modalities for determining local disease extent and nodal metastasis in patients with newly diagnosed cervical cancer.
METHODS
Pubmed and Embase databases were searched for studies published from 2000 to 2019 that used ultrasound (US), CT, MRI, and/or PET for evaluating various aspects of local extent and nodal metastasis in patients with newly diagnosed cervical cancer. Sensitivities and specificities from the studies were meta-analytically pooled using bivariate and hierarchical modeling.
RESULTS
Of 1311 studies identified in the search, 115 studies with 13,999 patients were included. MRI was the most extensively studied modality (MRI, CT, US, and PET were evaluated in 78, 12, 9, and 43 studies, respectively). Pooled sensitivities and specificities of MRI for assessing all aspects of local extent ranged between 0.71-0.88 and 0.86-0.95, respectively. In assessing parametrial invasion (PMI), US demonstrated pooled sensitivity and specificity of 0.67 and 0.94, respectively-performance levels comparable with those found for MRI. MRI, CT, and PET performed comparably for assessing nodal metastasis, with low sensitivity (0.29-0.69) but high specificity (0.88-0.98), even when stratified to anatomical location (pelvic or paraaortic) and level of analysis (per patient vs. per site).
CONCLUSIONS
MRI is the method of choice for assessing any aspect of local extent, but where not available, US could be of value, particularly for assessing PMI. CT, MRI, and PET all have high specificity but poor sensitivity for the detection of lymph node metastases.
KEY POINTS
• Magnetic resonance imaging is the method of choice for assessing local extent. • Ultrasound may be helpful in determining parametrial invasion, especially in lower-resourced countries. • Computed tomography, magnetic resonance imaging, and positron emission tomography perform similarly for assessing lymph node metastasis, with high specificity but low sensitivity.
Topics: Female; Fluorodeoxyglucose F18; Humans; Lymphatic Metastasis; Magnetic Resonance Imaging; Neoplasm Invasiveness; Positron-Emission Tomography; Sensitivity and Specificity; Tomography, X-Ray Computed; Ultrasonography; Uterine Cervical Neoplasms
PubMed: 32415584
DOI: 10.1007/s00330-020-06909-3 -
Children (Basel, Switzerland) Mar 2023Artificial intelligence (AI)-based computer-aided detection and diagnosis (CAD) is an important research area in radiology. However, only two narrative reviews about... (Review)
Review
Artificial intelligence (AI)-based computer-aided detection and diagnosis (CAD) is an important research area in radiology. However, only two narrative reviews about general uses of AI in pediatric radiology and AI-based CAD in pediatric chest imaging have been published yet. The purpose of this systematic review is to investigate the AI-based CAD applications in pediatric radiology, their diagnostic performances and methods for their performance evaluation. A literature search with the use of electronic databases was conducted on 11 January 2023. Twenty-three articles that met the selection criteria were included. This review shows that the AI-based CAD could be applied in pediatric brain, respiratory, musculoskeletal, urologic and cardiac imaging, and especially for pneumonia detection. Most of the studies (93.3%, 14/15; 77.8%, 14/18; 73.3%, 11/15; 80.0%, 8/10; 66.6%, 2/3; 84.2%, 16/19; 80.0%, 8/10) reported model performances of at least 0.83 (area under receiver operating characteristic curve), 0.84 (sensitivity), 0.80 (specificity), 0.89 (positive predictive value), 0.63 (negative predictive value), 0.87 (accuracy), and 0.82 (F1 score), respectively. However, a range of methodological weaknesses (especially a lack of model external validation) are found in the included studies. In the future, more AI-based CAD studies in pediatric radiology with robust methodology should be conducted for convincing clinical centers to adopt CAD and realizing its benefits in a wider context.
PubMed: 36980083
DOI: 10.3390/children10030525 -
PloS One 2022Videolaryngoscope is regarded as the standard of care for airway management in well-resourced setups however the technology is largely inaccessible and costly in middle...
INTRODUCTION
Videolaryngoscope is regarded as the standard of care for airway management in well-resourced setups however the technology is largely inaccessible and costly in middle and low-income countries. An improvised and cost-effective form of customized videolaryngoscope was proposed and studied for patient care in underprivileged areas however there were no distinct conclusions on its performances.
METHOD
The study follows PRISMA guidelines for systematic review and the protocol in International Prospective Register for Systematic Reviews. The primary aim was to assess the first attempt success of customized videolaryngoscope for endotracheal intubation. The secondary objective was to evaluate the number of attempts, laryngoscopic view in terms of Cormack Lehane score and Percentage of glottic opening, use of external laryngeal maneuver and stylet and, the airway injuries after the endotracheal intubation.
RESULT
Five studies were analyzed for risk of bias using the National Institute of Health Quality Assessment Tool for cross-sectional studies. Most of the studies had a poor to a fair level of evidence with only one study with a good level of evidence. Certainty of evidence was "very low" for all eligible studies when graded using the Grading of Recommendation, Assessment, Development and Evaluation approach for systematic review.
CONCLUSIONS
The certainty of the evidence regarding performance of custom-made videolaryngoscope compared to conventional laryngoscope was very low and the study was performed in small numbers with fair to the poor risk of bias. It was difficult to establish and do further analysis regarding whether the customized form of videolaryngoscope will improve the first attempt success rate for tracheal intubation, reduce the number of attempts, improve the laryngoscopic view, require fewer external aids and reduce the incidences of airway injury with the given low-grade evidence. Some properly conducted randomised clinical trials will be required to further analyze the outcome and make the strong recommendations.
Topics: Humans; Intubation, Intratracheal; Laryngoscopes; Laryngoscopy; Video Recording
PubMed: 34990475
DOI: 10.1371/journal.pone.0261863 -
BMC Medical Informatics and Decision... Nov 2022Today, the use of data in administrative and clinical processes is quite challenging due to the large volume of data, data collection from various sources, and lack of...
BACKGROUND
Today, the use of data in administrative and clinical processes is quite challenging due to the large volume of data, data collection from various sources, and lack of data structure. As a data management tool, dashboards play an important role in timely visual display of critical information on key performances.
OBJECTIVES
This systematic review aimed to identify functional and non-functional requirements, as well as challenges of using dashboards in hospitals.
METHODS
In this systematic review, four databases, including the Web of Science, PubMed, EMBASE, and Scopus, were searched to find relevant articles from 2000 until May 30, 2020. The final search was conducted on May 30, 2020. Data collection was performed using a data extraction form and reviewing the content of relevant studies on the potentials and challenges of dashboard implementation.
RESULTS
Fifty-four out of 1254 retrieved articles were selected for this study based on the inclusion and exclusion criteria. The functional requirements for dashboards included reporting, reminders, customization, tracking, alert creation, and assessment of performance indicators. On the other hand, the non-functional requirements included the dashboard speed, security, ease of use, installation on different devices (e.g., PCs and laptops), integration with other systems, web-based design, inclusion of a data warehouse, being up-to-data, and use of data visualization elements based on the user's needs. Moreover, the identified challenges were categorized into four groups: data sources, dashboard content, dashboard design, implementation, and integration in other systems at the hospital level.
CONCLUSION
Dashboards, by providing information in an appropriate manner, can lead to the proper use of information by users. In order for a dashboard to be effective in clinical and managerial processes, particular attention must be paid to its capabilities, and the challenges of its implementation need to be addressed.
Topics: Humans; Hospitals; Databases, Factual
PubMed: 36348339
DOI: 10.1186/s12911-022-02037-8 -
Urology Annals 2022The ureteral insertion of a silicone tube was first performed in 1967. A validated ureteral stent symptom questionnaire (USSQ) is used for an objective assessment of... (Review)
Review
The ureteral insertion of a silicone tube was first performed in 1967. A validated ureteral stent symptom questionnaire (USSQ) is used for an objective assessment of patient-reported stent-related symptoms. As the impact of stent diameter on the incidence of stent-related symptoms is unclear, we aimed to perform a systematic review and meta-analysis comparing USSQ reported outcomes when using a 6 Fr diameter ureteric stent, versus smaller diameter stents (4.7-5 Fr) when inserted for ureteric stones. All randomized control trials and comparative studies of 6 Fr versus 4.7-5 Fr ureteric stents were reviewed. The USSQ outcomes were considered as the primary outcome measures while stent migration was considered as a secondary outcome measure. A total of 61 articles were identified of which four studies met the eligibility criteria. There was a statistically significant association between the use of wider (6 Fr) diameter stents and the incidence of urinary symptoms as measured by the urinary index score. Larger stent diameters were associated with a statistically significant increase in the pain index score. There was no statistically significant difference in the scores between the compared stent diameters with regard to work performance score, general health index score, additional problems index score, and stent migration. There were insufficient reported outcomes to perform a meta-analysis of sexual matters index score. Our meta-analysis shows that using smaller diameter ureteric stents is associated with reduced urinary symptoms and patient-reported pain. Other USSQ parameter outcomes are statistically similar in the 6 Fr ureteric stent cohort versus the 4.7-5 Fr ureteric stent cohort. Our meta-analysis was limited due to the limited number of studies and gross heterogeneity of reporting parameters in various studies. We hope a large-scale homogeneous randomized control trial will further shed more insight into the stent symptoms response to stent diameter.
PubMed: 36505999
DOI: 10.4103/ua.ua_158_21 -
Eating and Weight Disorders : EWD Oct 2022The Reading the Mind in the Eyes Test (RMET) is listed in the National Institute of Mental Health's Research Domain Criteria as a tool apt to measure the understanding... (Meta-Analysis)
Meta-Analysis Review
BACKGROUND
The Reading the Mind in the Eyes Test (RMET) is listed in the National Institute of Mental Health's Research Domain Criteria as a tool apt to measure the understanding of others' mental states. People diagnosed with anorexia nervosa (AN) showed poorer performances on the RMET than healthy controls. Less data are available concerning other eating disorders.
METHODS
Systematic review of four major databases from inception to July 15, 2021 following the PRISMA guidelines. Meta-analysis of cross-sectional observational studies comparing the scores of the RMET between patients with eating disorders and age- and-gender matched control groups.
RESULTS
Out of 21 studies, we retrieved 29 independent samples of patients diagnosed with an eating disorder. Patients with active AN (n = 580) showed worse performances on the RMET than controls (n = 1019). Year of publication accounted for 61% of the (substantial: I = 81%) heterogeneity in the meta-analysis. Earlier studies were more likely to find worse performances on the RMET of patients with active AN than later studies. Patients with bulimia nervosa (n = 185) performed poorly as compared to controls (n = 249), but the results were not statistically significant on the random-effect model. Obese patients with binge-eating disorder (n = 54) did not differ on the RMET from obese controls (n = 52). Patients with eating disorder not otherwise specified (n = 57) showed minimal differences compared to controls (n = 96). Study quality was good in six studies only.
CONCLUSIONS
Patients with eating disorders do not suffer from an impaired understanding of others' mental states, except for a still-to-be-identified subgroup of patients with active AN.
LEVEL OF EVIDENCE
I, systematic review and meta-analysis.
Topics: Anorexia Nervosa; Bulimia Nervosa; Cognition; Cross-Sectional Studies; Feeding and Eating Disorders; Humans; Obesity
PubMed: 35384555
DOI: 10.1007/s40519-022-01393-8 -
The British Journal of Surgery Jan 2024While fatigue is an inevitable aspect of performing surgical procedures, lack of consensus remains on its effect on surgical performance. The aim of this systematic...
BACKGROUND
While fatigue is an inevitable aspect of performing surgical procedures, lack of consensus remains on its effect on surgical performance. The aim of this systematic review was to assess the effect of non-muscular fatigue on surgical outcome.
METHODS
MEDLINE and Embase were searched up to 17 January 2023. Studies on students, learning, duty-hour restrictions, muscle fatigue, non-surgical or subjective outcome, the weekend effect, or time of admission were excluded. Studies were categorized based on real-life or simulated surgery. The Cochrane risk-of-bias tool was used to assess RCTs and the Newcastle-Ottawa scale was used to assess cohort studies. Due to heterogeneity among studies, data pooling was not feasible and study findings were synthesized narratively.
RESULTS
From the 7251 studies identified, 134 studies (including 1 684 073 cases) were selected for analysis (110 real-life studies and 24 simulator studies). Of the simulator studies, 46% (11 studies) reported a deterioration in surgical outcome when fatigue was present, using direct measures of fatigue. In contrast, only 35.5% (39 studies) of real-life studies showed a deterioration, observed in only 12.5% of all outcome measures, specifically involving aggregated surgical outcomes.
CONCLUSION
Almost half of simulator studies, along with one-third of real-life studies, consistently report negative effects of fatigue, highlighting a significant concern. The discrepancy between simulator/real-life studies may be explained by heightened motivation and effort investment in real-life studies. Currently, published fatigue and outcome measures, especially in real-life studies, are insufficient to fully define the impact of fatigue on surgical outcomes due to the absence of direct fatigue measures and crude, post-hoc outcome measures.
Topics: Humans; Outcome Assessment, Health Care; Cohort Studies; Surgeons; Learning
PubMed: 38097353
DOI: 10.1093/bjs/znad397 -
Critical Care Explorations Jan 2023To evaluate the methodologic rigor and predictive performance of models predicting ICU readmission; to understand the characteristics of ideal prediction models; and to... (Review)
Review
UNLABELLED
To evaluate the methodologic rigor and predictive performance of models predicting ICU readmission; to understand the characteristics of ideal prediction models; and to elucidate relationships between appropriate triage decisions and patient outcomes.
DATA SOURCES
PubMed, Web of Science, Cochrane, and Embase.
STUDY SELECTION
Primary literature that reported the development or validation of ICU readmission prediction models within from 2010 to 2021.
DATA EXTRACTION
Relevant study information was extracted independently by two authors using the Critical Appraisal and Data Extraction for Systematic Reviews of Prediction Modelling Studies checklist. Bias was evaluated using the Prediction model Risk Of Bias ASsessment Tool. Data sources, modeling methodology, definition of outcomes, performance, and risk of bias were critically evaluated to elucidate relevant relationships.
DATA SYNTHESIS
Thirty-three articles describing models were included. Six studies had a high overall risk of bias due to improper inclusion criteria or omission of critical analysis details. Four other studies had an unclear overall risk of bias due to lack of detail describing the analysis. Overall, the most common (50% of studies) source of bias was the filtering of candidate predictors via univariate analysis. The poorest performing models used existing clinical risk or acuity scores such as Acute Physiologic Assessment and Chronic Health Evaluation II, Sequential Organ Failure Assessment, or Stability and Workload Index for Transfer as the sole predictor. The higher-performing ICU readmission prediction models used homogenous patient populations, specifically defined outcomes, and routinely collected predictors that were analyzed over time.
CONCLUSIONS
Models predicting ICU readmission can achieve performance advantages by using longitudinal time series modeling, homogenous patient populations, and predictor variables tailored to those populations.
PubMed: 36699252
DOI: 10.1097/CCE.0000000000000848 -
Integrative Cancer Therapies 2022Remote medical scent detection of cancer and infectious diseases with dogs and rats has been an increasing field of research these last 20 years. If validated, the... (Review)
Review
BACKGROUND
Remote medical scent detection of cancer and infectious diseases with dogs and rats has been an increasing field of research these last 20 years. If validated, the possibility of implementing such a technique in the clinic raises many hopes. This systematic review was performed to determine the evidence and performance of such methods and assess their potential relevance in the clinic.
METHODS
Pubmed and Web of Science databases were independently searched based on PRISMA standards between 01/01/2000 and 01/05/2021. We included studies aiming at detecting cancers and infectious diseases affecting humans with dogs or rats. We excluded studies using other animals, studies aiming to detect agricultural diseases, diseases affecting animals, and others such as diabetes and neurodegenerative diseases. Only original articles were included. Data about patients' selection, samples, animal characteristics, animal training, testing configurations, and performances were recorded.
RESULTS
A total of 62 studies were included. Sensitivity and specificity varied a lot among studies: While some publications report low sensitivities of 0.17 and specificities around 0.29, others achieve rates of 1 sensitivity and specificity. Only 6 studies were evaluated in a double-blind screening-like situation. In general, the risk of performance bias was high in most evaluated studies, and the quality of the evidence found was low.
CONCLUSIONS
Medical detection using animals' sense of smell lacks evidence and performances so far to be applied in the clinic. What odors the animals detect is not well understood. Further research should be conducted, focusing on patient selection, samples (choice of materials, standardization), and testing conditions. Interpolations of such results to free running detection (direct contact with humans) should be taken with extreme caution. Considering this synthesis, we discuss the challenges and highlight the excellent odor detection threshold exhibited by animals which represents a potential opportunity to develop an accessible and non-invasive method for disease detection.
Topics: Humans; Dogs; Animals; Rats; Odorants; Neoplasms; Smell; Communicable Diseases; Randomized Controlled Trials as Topic
PubMed: 36541180
DOI: 10.1177/15347354221140516