-
BMJ Neurology Open 2023ChatGPT has shown promise in healthcare. To assess the utility of this novel tool in healthcare education, we evaluated ChatGPT's performance in answering neurology...
BACKGROUND AND OBJECTIVES
ChatGPT has shown promise in healthcare. To assess the utility of this novel tool in healthcare education, we evaluated ChatGPT's performance in answering neurology board exam questions.
METHODS
Neurology board-style examination questions were accessed from BoardVitals, a commercial neurology question bank. ChatGPT was provided a full question prompt and multiple answer choices. First attempts and additional attempts up to three tries were given to ChatGPT to select the correct answer. A total of 560 questions (14 blocks of 40 questions) were used, although any image-based questions were disregarded due to ChatGPT's inability to process visual input. The artificial intelligence (AI) answers were then compared with human user data provided by the question bank to gauge its performance.
RESULTS
Out of 509 eligible questions over 14 question blocks, ChatGPT correctly answered 335 questions (65.8%) on the first attempt/iteration and 383 (75.3%) over three attempts/iterations, scoring at approximately the 26th and 50th percentiles, respectively. The highest performing subjects were pain (100%), epilepsy & seizures (85%) and genetic (82%) while the lowest performing subjects were imaging/diagnostic studies (27%), critical care (41%) and cranial nerves (48%).
DISCUSSION
This study found that ChatGPT performed similarly to its human counterparts. The accuracy of the AI increased with multiple attempts and performance fell within the expected range of neurology resident learners. This study demonstrates ChatGPT's potential in processing specialised medical information. Future studies would better define the scope to which AI would be able to integrate into medical decision making.
PubMed: 37936648
DOI: 10.1136/bmjno-2023-000530 -
Nutrients Oct 2023The level of association between 25-hydroxyvitamin D (25[OH]D) levels and students' academic performance has not yet been established. The current study aimed to...
The level of association between 25-hydroxyvitamin D (25[OH]D) levels and students' academic performance has not yet been established. The current study aimed to investigate the association between serum 25(OH)D levels and academic performance among schoolchildren in Sudan. A cross-sectional study was conducted among schoolchildren during the 2021/2022 academic year from four randomly selected schools in Almatamah, River Nile State, northern Sudan. Sociodemographic data were collected using a questionnaire. Anthropometric measurements were performed in accordance with standard procedures. Academic performance was obtained from school records. Serum 25(OH)D levels were measured, and regression (multiple linear regression and multivariate logistic) analyses were performed. A total of 241 participants were enrolled in this study, of whom 129 (53.5%) were female. The mean standard deviation (SD) of the participants' ages was 15 ± 1.6 years. In multiple linear regression tests, being female, age, employment, and serum 25(OH)D level were positively associated with academic performance. The average overall academic score was 33.74%. Of the 241 participants, 95 (39.4%) and 149 (61.6%) had good and poor academic performances, respectively. In multivariable logistic regressions, age and 25(OH)D level were inversely associated with poor academic performance and vitamin D deficiency was associated with poor performance. The current study revealed a positive association between 25(OH)D levels and adolescents' academic performance. Effective interventional programs are needed to maintain sufficient vitamin D levels during childhood and adolescence and, as a consequence, to improve academic performance.
Topics: Humans; Female; Adolescent; Child; Adult; Male; Cross-Sectional Studies; Vitamin D; Calcifediol; Vitamin D Deficiency; Academic Performance
PubMed: 37960205
DOI: 10.3390/nu15214552 -
BMC Medical Education Aug 2023Deviated optical angles create visuospatial and psychomotor challenges during laparoscopic procedures, resulting in delayed operative time and possibly adverse events....
BACKGROUND
Deviated optical angles create visuospatial and psychomotor challenges during laparoscopic procedures, resulting in delayed operative time and possibly adverse events. If it is possible to train the skills needed to work under these deviated optical angles, this could benefit procedure time and patient safety. This study investigates the influence of the optical angle on development of basic laparoscopic surgical skills.
METHODS
A total of 58 medical students performed a four-session laparoscopic training course on a Virtual Reality Simulator. During each session, they performed an identical task under optical angles of 0°, 45° and - 45°. Performance parameters of task duration and damage were compared between the optical angles to investigate the effect of optical angle on performance development. The 4th session performance was compared to the 2nd session performance for each angle to determine improvement.
RESULTS
Participants performed the task significantly faster under the 0° optical angle compared to the plus and minus 45° optical angles during the last three sessions (z between - 2.95 and - 2.09, p < .05). Participants improved significantly and similarly for task duration during the training course under all optical angles. At the end of the training course however significant performance differences between the zero and plus/minus 45 optical angles remained. Performance for damage did not improve and was not affected by optical angle throughout the course.
CONCLUSION
Dedicated virtual reality training improves laparoscopic basic skills performance under deviated optical angles as it leads to shorter task duration, however a lasting performance impairment compared to the 0° optical angle remained. Training for performing under deviating optical angles can potentially shorter the learning curve in the operating room.
Topics: Humans; Learning Curve; Laparoscopy; Operating Rooms; Operative Time; Patient Safety
PubMed: 37644534
DOI: 10.1186/s12909-023-04555-z -
MedEdPORTAL : the Journal of Teaching... 2023Cervical intraepithelial neoplasia 3 is associated with a high degree of progression to cervical cancer. Its risk is markedly reduced after excisional treatment. Hence,...
INTRODUCTION
Cervical intraepithelial neoplasia 3 is associated with a high degree of progression to cervical cancer. Its risk is markedly reduced after excisional treatment. Hence, it is critical that providers accurately diagnose and treat this condition. We present a simulation-based module focused on resident mastery of performance of colposcopy and loop electrosurgical excision procedure (LEEP).
METHODS
Learners were obstetrics and gynecology residents. Guidelines on performance of colposcopy and LEEP were presented prior to module participation. We used pelvic task trainers, kielbasa sausages, and routine equipment for performance of colposcopy and LEEP. Colposcopy and LEEP sessions each lasted 30 minutes. Learners completed questionnaires before and after regarding comfort level on aspects of colposcopy and LEEP performance and level of agreement with statements on performing procedures independently. Comfort levels and degrees of agreement were based on 5-point Likert scales (1 = 3 = 5 = respectively).
RESULTS
Modules were held in November 2021 and May 2022. Thirty-four residents participated. Mean comfort scores significantly increased from 3.1 to 4.3 ( < .001) before and after the module for all steps. There was an increase in level of agreement with statements on being able to independently perform colposcopy (2.2 to 3.5, < .01) and LEEP (2.9 to 3.6, = .06).
DISCUSSION
Simulation-based modules on performance of colposcopy and LEEP significantly increased resident learner comfort in the performance of these procedures. Comfort in performing these procedures is important in providing comprehensive gynecologic care.
Topics: Pregnancy; Female; Humans; Colposcopy; Electrosurgery; Computer Simulation; Obstetrics; Pelvis
PubMed: 37691878
DOI: 10.15766/mep_2374-8265.11344 -
Frontiers in Psychology 2023Music Performance Anxiety (MPA) is one of the most widespread and debilitating challenges facing musicians, affecting significant numbers of performers in terms of both... (Review)
Review
Music Performance Anxiety (MPA) is one of the most widespread and debilitating challenges facing musicians, affecting significant numbers of performers in terms of both their personal and professional functioning. Although numerous interventions exist to target MPA, its prevalence remains unchanged since the first large-scale studies of the 1980s, indicating that available interventions are having limited impact. This review synthesizes and critiques existing literature in order to investigate possible reasons for the limited efficacy of current approaches to managing MPA. Key concepts discussed include conceptual and methodological challenges surrounding defining MPA, theoretical perspectives on MPA's etiology and manifestation, and the coping strategies and interventions used to manage MPA. MPA has predominantly been investigated pathologically and defined as a negative construct manifesting in unwanted symptoms. Based on this conceptualization, interventions largely seek to manage MPA through ameliorating symptoms. This review discusses possible reasons why this approach has broadly not proved successful, including the issue of relaxation being both unrealistic and counterproductive for peak performance, issues associated with intentionally changing one's state creating resistance thus exacerbating anxiety, and focusing on the presence of, rather than response to, symptoms. Despite 50 years of research, MPA remains an unsolved enigma and continues to adversely impact musicians both on and off the stage. Reconceptualizing MPA as a normal and adaptive response to the pressures of performance may offer a new perspective on it, in terms of its definition, assessment and management, with practical as well as theoretical implications.
PubMed: 38022988
DOI: 10.3389/fpsyg.2023.1194873 -
Frontiers in Psychology 2023Recent investigations on music performances have shown the relevance of singers' body motion for pedagogical as well as performance purposes. However, little is known...
Recent investigations on music performances have shown the relevance of singers' body motion for pedagogical as well as performance purposes. However, little is known about how the perception of voice-matching or task complexity affects choristers' body motion during ensemble singing. This study focussed on the body motion of choral singers who perform in duo along with a pre-recorded tune presented over a loudspeaker. Specifically, we examined the effects of the perception of voice-matching, operationalized in terms of sound spectral envelope, and task complexity on choristers' body motion. Fifteen singers with advanced choral experience first manipulated the spectral components of a pre-recorded short tune composed for the study, by choosing the settings they felt most and least together with. Then, they performed the tune in unison (i.e., singing the same melody simultaneously) and in canon (i.e., singing the same melody but at a temporal delay) with the chosen filter settings. Motion data of the choristers' upper body and audio of the repeated performances were collected and analyzed. Results show that the settings perceived as least together relate to extreme differences between the spectral components of the sound. The singers' wrists and torso motion was more periodic, their upper body posture was more open, and their bodies were more distant from the music stand when singing in unison than in canon. These findings suggest that unison singing promotes an expressive-periodic motion of the upper body.
PubMed: 38187406
DOI: 10.3389/fpsyg.2023.1220904 -
Scientific Reports Aug 2023Categorizing music pieces by composer is a challenging task in digital music processing due to their highly flexible structures, introducing subjective interpretation by...
Categorizing music pieces by composer is a challenging task in digital music processing due to their highly flexible structures, introducing subjective interpretation by individuals. This research utilized musical data from the MIDI and audio edited for synchronous tracks and organization dataset of virtuosic piano pieces. In this work, pitch and duration were the musical features of interest. The goal was to innovate an approach to representing a musical piece using SentencePiece and Word2vec, which are natural language processing-based techniques. We attempted to find correlated melodies that are likely to be formed by single interpretable units of music via co-occurring notes, and represented them as a musical word/subword vector. Composer classification was performed in order to ensure the efficiency of this musical data representation scheme. Among classification machine learning algorithms, k-nearest neighbors, random forest classifier, logistic regression, support vector machines, and multilayer perceptron were employed to compare performances. In the experiment, the feature extraction methods, classification algorithms, and music window sizes were varied. The results were that classification performance was sensitive to feature extraction methods. Musical word/subword vector standard deviation was the most effective feature, resulting in classification with a high F1-score, attaining 1.00. No significant difference was observed among model classification performances.
Topics: Humans; Music; Algorithms; Neural Networks, Computer; Machine Learning; Natural Language Processing
PubMed: 37580364
DOI: 10.1038/s41598-023-40332-0 -
Journal of Robotic Surgery Aug 2023RAPN training usually takes place in-vivo and methods vary across countries/institutions. No common system exists to objectively assess trainee capacity to perform RAPN...
RAPN training usually takes place in-vivo and methods vary across countries/institutions. No common system exists to objectively assess trainee capacity to perform RAPN at predetermined performance levels prior to in-vivo practice. The identification of objective performance metrics for RAPN training is a crucial starting point to improve training and surgical outcomes. The authors sought to examine the reliability, construct and discriminative validity of objective intraoperative performance metrics which best characterize the optimal and suboptimal performance of a reference approach for training novice RAPN surgeons. Seven Novice and 9 Experienced RAPN surgeons video recorded one or two independently performed RAPN procedures in the human. The videos were anonymized and two experienced urology surgeons were trained to reliably score RAPN performance, using previously developed metrics. The assessors were blinded to the performing surgeon, hospital and surgeon group. They independently scored surgeon RAPN performance. Novice and Experienced group performance scores were compared for procedure steps completed and errors made. Each group was divided at the median for Total Errors score, and subgroup scores (i.e., Novice HiErrs and LoErrs, Experienced HiErrs and LoErrs) were compared. The mean inter-rater reliability (IRR) for scoring was 0.95 (range 0.84-1). Compared with Novices, Experienced RAPN surgeons made 69% fewer procedural Total Errors. This difference was accentuated when the LoErr Expert RAPN surgeon's performance was compared with the HiErrs Novice RAPN surgeon's performance with an observed 170% fewer Total Errors. GEARS showed poor reliability (Mean IRR = 0.44; range 0.0-0.8), for scoring RAPN surgical performance. The RAPN procedure metrics reliably distinguish Novice and Experienced surgeon performances. They further differentiated performance levels within a group with similar experiences. Reliable and valid metrics will underpin quality-assured novice RAPN surgical training.
Topics: Humans; Robotic Surgical Procedures; Robotics; Reproducibility of Results; Surgeons; Clinical Competence; Nephrectomy
PubMed: 36689078
DOI: 10.1007/s11701-023-01521-1 -
Implementation Science Communications Nov 2023Screening lies at the heart of preventive care. However, COVID-19 dramatically disrupted routine screening efforts, resulting in excess mortality not directly...
BACKGROUND
Screening lies at the heart of preventive care. However, COVID-19 dramatically disrupted routine screening efforts, resulting in excess mortality not directly attributable to COVID-19. Screening rates during COVID varied markedly by facility and clinical condition, suggesting susceptibilities in screening and referral process workflow. To better understand these susceptibilities and identify new practices to mitigate interrupted care, we propose a qualitative study comparing facilities that exhibited high, low, and highly variable performance (respectively) in screening rates before and during the pandemic. We will be guided by Weaver et al.'s multi-team systems (MTS) model of coordination, using cancer and mental health screening rates as exemplars.
METHOD
Qualitative analysis of interviews and focus groups with primary care personnel, leadership, and patients at 10 VA medical centers. We will select sites based on rurality, COVID-19 caseload at the beginning of the pandemic, and performance on five outpatient clinical performance indicators of cancer and mental health screening. Sites will be categorized into one of five screening performance groups: high performers, low performers, improvers, plummeters, and highly variable. We will create process maps for each performance measure to create a workflow baseline and then interview primary care leadership to update the map at each site. We will clinician conduct focus groups to elicit themes regarding clinician coordination patterns (e.g., handoffs), strategies, and barriers/facilitators to screening during COVID. We will also conduct patient interviews to examine their screening experience during this period, for context. All interviews and focus groups will be audio-recorded, transcribed, and enhanced by field notes. We will analyze clinician transcripts and field notes using iterative, rapid analysis. Patient interviews will be analyzed using inductive/deductive content analysis.
DISCUSSION
Our study represents a unique opportunity to inform the multi-team systems literature by identifying specific forms of information exchange, collective problem solving, and decision-making associated with higher and improved clinical performance. Specifically, our study aims to detect the specific points in the screening and referral process most susceptible to disruption and coordination processes that, if changed, will yield the highest value. Findings apply to future pandemics or any event with the potential to disrupt care.
PubMed: 38012710
DOI: 10.1186/s43058-023-00507-2