-
JMIR Medical Informatics Jun 2024Integrating machine learning (ML) models into clinical practice presents a challenge of maintaining their efficacy over time. While existing literature offers valuable...
Integrating machine learning (ML) models into clinical practice presents a challenge of maintaining their efficacy over time. While existing literature offers valuable strategies for detecting declining model performance, there is a need to document the broader challenges and solutions associated with the real-world development and integration of model monitoring solutions. This work details the development and use of a platform for monitoring the performance of a production-level ML model operating in Mayo Clinic. In this paper, we aimed to provide a series of considerations and guidelines necessary for integrating such a platform into a team's technical infrastructure and workflow. We have documented our experiences with this integration process, discussed the broader challenges encountered with real-world implementation and maintenance, and included the source code for the platform. Our monitoring platform was built as an R shiny application, developed and implemented over the course of 6 months. The platform has been used and maintained for 2 years and is still in use as of July 2023. The considerations necessary for the implementation of the monitoring platform center around 4 pillars: feasibility (what resources can be used for platform development?); design (through what statistics or models will the model be monitored, and how will these results be efficiently displayed to the end user?); implementation (how will this platform be built, and where will it exist within the IT ecosystem?); and policy (based on monitoring feedback, when and what actions will be taken to fix problems, and how will these problems be translated to clinical staff?). While much of the literature surrounding ML performance monitoring emphasizes methodological approaches for capturing changes in performance, there remains a battery of other challenges and considerations that must be addressed for successful real-world implementation.
PubMed: 38941140
DOI: 10.2196/50437 -
JAMA Health Forum Jun 2024
Topics: Artificial Intelligence; Humans; Patient Safety; Hospitals
PubMed: 38941085
DOI: 10.1001/jamahealthforum.2024.1369 -
Alternative Therapies in Health and... Jun 2024The nursing work in the operating room is heavy, intensive, and irregular, and the quality of nursing work can directly affect the surgical effect and patient prognosis....
BACKGROUND
The nursing work in the operating room is heavy, intensive, and irregular, and the quality of nursing work can directly affect the surgical effect and patient prognosis. Therefore, nursing management in the operating room should be strengthened to protect patients' life safety effectively.
OBJECTIVE
To assess the effectiveness of applying the 6S management model in operating room nursing.
DESIGN
This was a retrospective study.
SETTING
This study was conducted at the Department of Anesthesia Surgery, Nanfang Hospital, Southern Medical University.
PARTICIPANTS
The research included 100 operating room nurses on duty between January 2020 and December 2022.
INTERVENTION
From January 2020 to June 2021, the hospital conducted routine training programs for nurses in the operating room. From July 2021 to December 2022, the hospital adopted the 6S management model for overseeing nursing work in the operating room.
PRIMARY OUTCOME MEASURES
(1) nursing quality score (2) nursing staff safety awareness (3) nursing disputes and complaints (4) incidence of adverse reactions (5) patient satisfaction with the quality of nursing care.
RESULTS
Following the adoption of the 6S management model, there was a noticeable improvement in the nursing quality scores, the nursing staff's awareness of safety, and the satisfaction levels of patients with the quality of care provided by operation nurses (P < .05). Additionally, the incidence of nursing disputes, complaints, and adverse events among patients decreased significantly compared to before the implementation of 6S (P = .01).
CONCLUSION
Implementing 6S management with a focus on the work of operation room nurses enhanced the competence of the nursing staff and improved management effectiveness, ultimately leading to increased patient satisfaction.
PubMed: 38940802
DOI: No ID Found -
Alternative Therapies in Health and... Jun 2024Medicine logistics, particularly cryogenic storage, maintains pharmaceutical efficacy and safety. Ensuring seamless transportation and storage prevents spoilage,...
BACKGROUND
Medicine logistics, particularly cryogenic storage, maintains pharmaceutical efficacy and safety. Ensuring seamless transportation and storage prevents spoilage, degradation, or contamination, safeguarding patient health.
OBJECTIVE
This study aimed to analyze the relationships among the components of the medication cold chain logistics system using grey relational analysis (GRA). Additionally, we utilized GRA to construct an adjacency matrix, facilitating a comprehensive understanding of the interdependencies within the system.
METHODS
Data from pertinent indices spanning 2021 and 2022 were utilized to conduct a quantitative analysis using GRA. This analysis aimed to identify the most influential elements affecting the growth of pharmaceutical cold chain logistics in a specific location. The negative aspects of the medication cold chain logistics system in particular areas were examined by assessing the grey relationship grades between various components and the medicine cold chain logistics system in those regions.
RESULTS
The analysis revealed significant insights into the correlated risk factors impacting medicine logistics operations. Through an examination of the financial status and operational processes of medicine logistics assets, four categories of risks were identified, encompassing transportation, storage, distribution, and quality management. These categories were established by analyzing the most significant risk factors across these operational domains. Additionally, GRA was employed to assess the factors influencing medicine logistics. The study found a strong relationship between key parameters, such as transportation risk and site facilities and equipment, and the growth of the pharmaceutical logistics sector. Operation risk emerged as the least influential factor, while site facilities and equipment, transportation risk, and operation risk demonstrated substantial influence on the region's medical logistics sector growth.
CONCLUSION
This study provides important recommendations to improve medicine logistics, aiming to mitigate adverse effects and elevate inventory management. Implementation can enhance efficiency and safety in the medicine supply chain, benefiting patient care and public health.
PubMed: 38940801
DOI: No ID Found -
Health Expectations : An International... Aug 2024The safety of medication use among older adults is a growing concern, given the aging population. Despite widespread attention, the exploration of medication literacy in...
BACKGROUND
The safety of medication use among older adults is a growing concern, given the aging population. Despite widespread attention, the exploration of medication literacy in older adults, particularly from the perspective of information literacy, is in its nascent stages.
METHODS
This study utilized the existing literature to define medication information literacy (MIL) as a theoretical framework. A two-round Delphi survey was conducted to identify the essential components of a MIL indicator system for older adults. The analytic hierarchy process (AHP) was then used to assign weights to each indicator.
RESULTS
The study observed relatively high response rates in both rounds of the questionnaire, which, along with expert authority coefficients (Cr) of 0.86 and 0.89, underscores the credibility and expertise of the panellists. Additionally, Kendall's coefficient of concordance (Kendall's W) ranging from 0.157 to 0.33 (p < 0.05) indicates a consensus among experts on the identified indicators. Utilizing the Delphi process, a MIL indicator system for older adults was developed, comprising five primary and 23 secondary indicators. These indicators were weighted, with medication information cognition and acquisition emerging as pivotal factors in enhancing medication literacy among older adults.
CONCLUSIONS
This study developed a MIL indicator system tailored for older adults using the Delphi approach. The findings can inform healthcare professionals in providing customized medication guidance and assist policymakers in crafting policies to enhance medication safety among older adults.
PATIENT OR PUBLIC CONTRIBUTION
Patient and public engagement played a pivotal role in the development of our medication information literacy indicator system for older adults. Their involvement contributed to shaping research questions, facilitating study participation, and enriching evidence interpretation. Collaborations with experts in geriatric nursing, medicine, and public health, along with discussions with caregivers and individuals with lived experience, provided invaluable insights into medication management among older adults. Their input guided our research direction and ensured the relevance and comprehensiveness of our findings.
Topics: Humans; Delphi Technique; Aged; Surveys and Questionnaires; Health Literacy; Female; Male; Information Literacy
PubMed: 38940704
DOI: 10.1111/hex.14127 -
Acta Medica Philippina 2024In 2008, the Department of Health (DOH) issued Administrative Order 2008-0023 that called for an "effective and efficient monitoring system that will link all patient...
BACKGROUND
In 2008, the Department of Health (DOH) issued Administrative Order 2008-0023 that called for an "effective and efficient monitoring system that will link all patient safety initiatives". However, there are still no explicit and harmonized targets to measure effectiveness and to provide benchmarks that assess whether previous efforts were helpful.
OBJECTIVE
The study aimed to describe the status of patient safety performance measures and indicators on the international patient safety goals (IPSGs) in select hospitals in the Philippines.
METHODS
Descriptive, cross-sectional design was used to investigate currently used performance measures and indicators. Data collection included administration of a Hospital Patient Safety Indicators Questionnaire (HPSIQ) that summarized the currently used patient safety measures and indicators in the sampled Level 2 and level 3 hospitals and triangulation by review of documents such as hospital databases, protocols on reporting, and manuals for information gathering regarding patient safety. Performance measures were categorized using the Donabedian framework. Core indicators were identified through review of standards that cut across the six IPSGs and evaluation of overarching processes and concepts in patient safety.
RESULTS
Forty-one level 2 and 3 hospitals participated in the study. Most performance indicators were process measures (52%), while structure (31%) and outcome measures (17%) accounted for the rest. There is an obvious lack of structural requirements for patient safety in the hospitals included in this study. Less than half the hospitals surveyed implement risk assessment and management consistently. Reporting of events, near-misses, and patient safety data are widely varied among hospitals. Data utilization for quality improvement is not fully established in many of the hospitals. Patient engagement is not integrated in service delivery and performance measurement but is crucial in promoting patient safety.
CONCLUSION
Mechanisms to improve hospitals' capacity to monitor, anticipate, and reduce risk of patient harm during the provision of healthcare should be provided. Having a unified set of definitions and protocols for measurement will facilitate reliable monitoring and improvement. Leadership and governance, both internal (e.g., hospital administrators) and external (e.g., DOH) that recognize a data-driven approach to policymaking and improvement of service delivery are crucial in promoting patient safety.
PubMed: 38939845
DOI: 10.47895/amp.vi0.6931 -
JACC. Advances Jan 2024Low-density lipoprotein cholesterol (LDL-C) is used to guide lipid-lowering therapy after a myocardial infarction (MI). Lack of LDL-C testing represents a missed...
BACKGROUND
Low-density lipoprotein cholesterol (LDL-C) is used to guide lipid-lowering therapy after a myocardial infarction (MI). Lack of LDL-C testing represents a missed opportunity for optimizing therapy and reducing cardiovascular risk.
OBJECTIVES
The purpose of this study was to estimate the proportion of Medicare beneficiaries who had their LDL-C measured within 90 days following MI hospital discharge.
METHODS
We conducted a retrospective cohort study of Medicare beneficiaries ≥66 years of age with an MI hospitalization between 2016 and 2020. The primary analysis used data from all beneficiaries with fee-for-service coverage and pharmacy benefits (532,767 MI hospitalizations). In secondary analyses, we used data from a 5% random sample of beneficiaries with fee-for-service coverage without pharmacy benefits (10,394 MI hospitalizations), and from beneficiaries with Medicare Advantage (176,268 MI hospitalizations). The proportion of beneficiaries who had their LDL-C measured following MI hospital discharge was estimated accounting for the competing risk of death.
RESULTS
In the primary analysis (mean age 76.9 years, 84.4% non-Hispanic White), 29.9% of beneficiaries had their LDL-C measured within 90 days following MI hospital discharge. Among Hispanic, Asian, non-Hispanic White, and non-Hispanic Black beneficiaries, the 90-day postdischarge LDL-C testing was 33.8%, 32.5%, 30.0%, and 26.0%, respectively. Postdischarge LDL-C testing within 90 days was highest in the Middle Atlantic (36.4%) and lowest in the West North Central (23.4%) U.S. regions. In secondary analyses, the 90-day postdischarge LDL-C testing was 26.9% among beneficiaries with fee-for-service coverage without pharmacy benefits, and 28.6% among beneficiaries with Medicare Advantage coverage.
CONCLUSIONS
LDL-C testing following MI hospital discharge among Medicare beneficiaries was low.
PubMed: 38939806
DOI: 10.1016/j.jacadv.2023.100753 -
JACC. Advances Apr 2024Adult congenital heart disease (ACHD) patients have significant morbidity and rise in cardiac admissions. Their outcome with high-dose influenza vaccination is unknown...
BACKGROUND
Adult congenital heart disease (ACHD) patients have significant morbidity and rise in cardiac admissions. Their outcome with high-dose influenza vaccination is unknown in comparison to those without ACHD.
OBJECTIVES
The purpose of this study was to compare all-cause mortality or cardiopulmonary hospitalizations in self-identified ACHD versus non-ACHD patients receiving high- or low-dose influenza vaccination within the INfluenza Vaccine to Effectively Stop cardioThoracic Events and Decompensated heart failure trial.
METHODS
We prospectively included ACHD patients in the INVESTED (INfluenza Vaccine to Effectively Stop cardioThoracic Events and Decompensated heart failure) trial. The primary endpoint was all-cause death or hospitalization for cardiovascular or pulmonary causes.
RESULTS
Of the 272 ACHD patients, 132 were randomly assigned to receive high-dose trivalent and 140 to standard-dose quadrivalent influenza vaccine. Compared to the non-ACHD cohort (n = 4,988), ACHD patients were more likely to be younger, women, smokers, have atrial fibrillation, and have a qualifying event of heart failure. The primary outcome was 49.8 events versus 42.8 events per 100 person-years (adjusted HR: 1.17; 95% CI: 0.95-1.45; = 0.144) in the ACHD group and non-ACHD group, respectively. The interaction between ACHD status and randomized treatment effect was not significant for the primary outcome ( = 0.858). Vaccine-related adverse events were similar in both groups.
CONCLUSIONS
Patients who self-identify as being ACHD had similar primary outcome of all-cause death or hospitalization for cardiovascular or pulmonary causes compared to non-ACHD cohort. High-dose influenza vaccination was similar to standard-dose influenza vaccination on the primary outcome in patients who self-identify as ACHD.
PubMed: 38939662
DOI: 10.1016/j.jacadv.2024.100897 -
International Journal of Public Health 2024When adverse events (AE) occur, there are different consequences for healthcare professionals. The environment in which professionals work can influence the experience....
OBJECTIVES
When adverse events (AE) occur, there are different consequences for healthcare professionals. The environment in which professionals work can influence the experience. This study aims to explore the experiences of second victims (SV) among health professionals in Argentina.
METHODS
A phenomenological study was used with in-depth interviews with healthcare professionals. Audio recordings and verbatim transcriptions were analyzed independently for themes, subthemes, and codes.
RESULTS
Three main themes emerged from the analysis: navigating the experience, the environment, and the turning point. Subthemes were identified for navigating the experience to describe the process: receiving the impact, transition, and taking action.
CONCLUSION
SVs undergo a process after an AE. The environment is part of this experience. It is a turning point in SVs' professional and personal lives. Improving the psychological safety (PS) environment is essential for ensuring the safety of SVs.
Topics: Humans; Qualitative Research; Argentina; Female; Male; Health Personnel; Adult; Interviews as Topic; Middle Aged; Workplace
PubMed: 38939516
DOI: 10.3389/ijph.2024.1607399 -
International Journal of Public Health 2024Acknowledging peer support as the cornerstone in mitigating the psychosocial burden arising from the second victim phenomenon, this study assesses the economic benefits...
OBJECTIVES
Acknowledging peer support as the cornerstone in mitigating the psychosocial burden arising from the second victim phenomenon, this study assesses the economic benefits of a Peer Support Program (PSP), compared to data of the Resilience In Stressful Events (RISE) program in the US, within the acute inpatient care sector in Germany.
METHODS
Employing a Markov model, this economic evaluation analyzes the cost benefits, including sick day and dropout costs, over a 1-year period, comparing scenarios with and without the Peer Support Program from a hospital perspective. The costs were calculated as an example based on a hospital with 1,000 employees. The estimations are considered conservative.
RESULTS
The anticipated outcomes demonstrate an average cost saving of €6,672 per healthcare worker participating in the Peer Support Program, leading to an annual budgetary impact of approximately €6,67 Mio. for the studied hospital.
CONCLUSION
The integration of a PSP proves economically advantageous for German hospitals, not only preserving financial resources but also reducing absenteeism, and mitigating turnover, thereby enhancing overall patient care.
Topics: Humans; Germany; Peer Group; Cost-Benefit Analysis; Social Support; Markov Chains; Absenteeism
PubMed: 38939515
DOI: 10.3389/ijph.2024.1607218