-
Health Technology Assessment... May 2012Many studies in health sciences research rely on collecting participant-reported outcomes and attention is increasingly being paid to the mode of data collection.... (Review)
Review
BACKGROUND
Many studies in health sciences research rely on collecting participant-reported outcomes and attention is increasingly being paid to the mode of data collection. Consideration needs to be given to the validity of response via different modes and the impact that choice of mode might have on study conclusions.
OBJECTIVES
(1) To provide an overview of the theoretical models of survey response and how they relate to health research; (2) to review all studies comparing two modes of administration for subjective outcomes and assess the impact of mode of administration on response quality; (3) to explore the impact of findings for key identified health-related measures; and (4) to inform the analysis of multimode studies.
DATA SOURCES
A broad range of databases (for example EMBASE, PsychINFO, MEDLINE, EconLit, SPORTDiscus, etc.) were chosen to allow as comprehensive a selection as possible, and they were searched up until the end of 2004.
REVIEW METHODS
The abstracts were reviewed against inclusion/exclusion criteria. Full papers were retrieved for all selected abstracts and then screened again using more detailed inclusion criteria related to the measures used. Papers that were still included were reviewed in full and detailed data extracted. At each stage, abstracts or papers were reviewed by a single reviewer.
RESULTS
The search strategy identified 39,253 unique references, of which 2156 were considered as full papers, with 381 finally included in the review. Two features of mode were clearly associated with bias in response; however, none of the features of mode was associated with changes in precision. How the measure was administered, by an interviewer or by the person themselves, was highly significantly associated with bias (p < 0.001). A difference in sensory stimuli was also significant (p = 0.03). When both of these were present the average overall bias was < 1 point on a percentage scale. In terms of mediating factors, there was some suggestion that there was an interaction between both telephone and computer for data collection and date of publication, supporting the theory that differences disappear as new technologies become commonplace. Single-item measures were also related to greater degrees of bias than multi-item scales (p = 0.01). Individual analysis of the Short Form questionnaire-36 items and Minnesota Multiphasic Personality Inventory (MMPI) showed a varied pattern across the different subscales, with conflicting results between the two types of study. None of the MMPI measures used to detect deviant responding showed a relationship with the mode features tested. The limits of agreement analysis showed how variable measures were between modes at an individual rather than a group mean level.
LIMITATIONS
The search strategy covered the period up to 2004, so any new and emerging technologies were not included. Not all potential mode features were tested and there was limited information on potential mediating factors.
CONCLUSIONS
Researchers need to be aware of the different mode features that could have an impact on their results when selecting a mode of data collection for subjective outcomes. Further mode comparison studies, which manipulate mode features and directly assess impact over time, would be beneficial.
Topics: Confidence Intervals; Data Collection; Health Surveys; Humans; Reproducibility of Results; Research Design; Self Report
PubMed: 22640750
DOI: 10.3310/hta16270 -
Thrombosis Research Apr 2024Long peripheral catheters (LPCs) and midline catheters (MCs) are indiscriminately labelled with different names, leading to misclassifications both in primary and... (Review)
Review
INTRODUCTION
Long peripheral catheters (LPCs) and midline catheters (MCs) are indiscriminately labelled with different names, leading to misclassifications both in primary and secondary studies. The available studies used different methods to report the incidence of catheter-related complications, affecting the possibility of properly comparing the catheter outcomes. The aim of this review was to explore the complications related to LPCs and MCs after reclassifying according to their length.
METHODS
Systematic literature review based on the Preferred Reporting Items for Systematic Reviews and Meta-Analyses, conducted on PubMed, Scopus and CINAHL databases. The study protocol was registered in the International Prospective Register of Systematic Reviews. Data regarding LPCs and MCs were compared. Catheter outcomes were classified into major and minor complications, recomputed and reported as cases/1000 catheter-days.
RESULTS
Fourteen studies were included. Over-half of the devices were correctly labelled by the authors, misclassifications affected particularly LPCs improperly labelled MCs. The cumulative incidence of catheter-related bloodstream infections was 0.3 and 0.4/1000 catheter-days, that of symptomatic catheter-related thrombosis was 0.9 and 1.8/1000 catheter-days for MCs and LPCs, respectively. Minor complications and catheter failure were higher for LPCs.
CONCLUSIONS
A misclassification exists in the labelling of MCs and LPCs. A widespread heterogeneity of diagnostic criteria adopted to classify the catheters' outcomes was found, exposing the risk of misestimating the incidence of complications and undermining the possibility of effectively comparing results of the published research. We proposed a list of definitions and relevant variables as a first step toward the development of standardized criteria to be adopted for research purposes.
Topics: Adult; Humans; Catheters; Thrombosis; Data Collection; Incidence; Catheterization, Peripheral; Catheters, Indwelling; Catheterization, Central Venous
PubMed: 38422981
DOI: 10.1016/j.thromres.2024.02.022 -
Future Oncology (London, England) 2015A systematic review of the literature for outcomes in pulmonary metastasectomy has revealed the variability in reporting and the paucity of data that would allow a clear... (Review)
Review
A systematic review of the literature for outcomes in pulmonary metastasectomy has revealed the variability in reporting and the paucity of data that would allow a clear understanding of the effectiveness of this operation. The authors, a surgeon and a mathematician, start from the experience of assessing the evidence on which the practice of pulmonary metastasectomy is based and give some simple examples on a more adequate approach to the collection and analysis of surgical data and the importance of its correct interpretation. Retrospective data analysis is constrained by the availability of data. While this can give insight on certain aspects, it is important to discern what data are necessary to give a complete understanding of the effectiveness of a practice. Typically well designed prospective studies and randomised controlled trials with a pre-specified data collection plan give more complete, consistent and reliable data than follow-up or retrospective studies. Pulmonary metastasectomy lends itself well as an example of practice based on uncertain evidence and biased reporting. All the available published studies are follow-up studies, there is no randomised controlled trial, so no control data to estimate its treatment effect on patient's survival. The pool of colorectal or sarcoma patients from which patients are selected to have a pulmonary metastasectomy is never reported on, thus it is hard to estimate the degree of selection and the influence of the surgeon's decision.
Topics: Data Collection; Data Interpretation, Statistical; Humans; Lung Neoplasms; Metastasectomy; Registries
PubMed: 25662323
DOI: 10.2217/fon.14.263 -
Research in Developmental Disabilities Dec 2015This paper presents the findings from a systematic review which investigated the use of phenomenological research interviews in studies involving people with... (Review)
Review
This paper presents the findings from a systematic review which investigated the use of phenomenological research interviews in studies involving people with intellectual disability. A search of four electronic databases and the subsequent application of inclusion criteria resulted in 28 relevant publications. Selected articles were reviewed and key data extracted using CASP guidelines, with findings presented by examining the influencing philosophy or theory, the method of recruitment and data collection, the relationship between researcher and participants, the rigour of data analysis and finally a statement of findings. The results show people with mild and moderate intellectual disability, included as participants in phenomenological research investigating a range of issues that are important in their lives. A critical discussion focuses on the main characteristics of phenomenology and points to implications for further research. Creating awareness of research among people with intellectual disability is important, and finding the best way to ensure findings are disseminated in accessible formats is recommended. Researchers are also challenged to consider Heideggerian hermeneutic phenomenology as a method with the potential to fully explore the experiences of people with intellectual disability.
Topics: Data Collection; Hermeneutics; Humans; Intellectual Disability; Qualitative Research
PubMed: 26392318
DOI: 10.1016/j.ridd.2015.09.001 -
BMC Psychiatry Oct 2022The experience sampling method (ESM) is an intensive longitudinal research method. Participants complete questionnaires at multiple times about their current or very...
BACKGROUND
The experience sampling method (ESM) is an intensive longitudinal research method. Participants complete questionnaires at multiple times about their current or very recent state. The design of ESM studies is complex. People with psychosis have been shown to be less adherent to ESM study protocols than the general population. It is not known how to design studies that increase adherence to study protocols. A lack of typology makes it is hard for researchers to decide how to collect data in a way that allows for methodological rigour, quality of reporting, and the ability to synthesise findings. The aims of this systematic review were to characterise the design choices made in ESM studies monitoring the daily lives of people with psychosis, and to synthesise evidence relating the data completeness to different design choices.
METHODS
A systematic review was conducted of published literature on studies using ESM with people with psychosis. Studies were included if they used digital technology for data collection and reported the completeness of the data set. The constant comparative method was used to identify design decisions, using inductive identification of design decisions with simultaneous comparison of design decisions observed. Weighted regression was used to identify design decisions that predicted data completeness. The review was pre-registered (PROSPERO CRD42019125545).
RESULTS
Thirty-eight studies were included. A typology of design choices used in ESM studies was developed, which comprised three superordinate categories of design choice: Study context, ESM approach and ESM implementation. Design decisions that predict data completeness include type of ESM protocol used, length of time participants are enrolled in the study, and if there is contact with the research team during data collection.
CONCLUSIONS
This review identified a range of design decisions used in studies using ESM in the context of psychosis. Design decisions that influence data completeness were identified. Findings will help the design and reporting of future ESM studies. Results are presented with the focus on psychosis, but the findings can be applied across different mental health populations.
Topics: Humans; Ecological Momentary Assessment; Psychotic Disorders; Research Design; Surveys and Questionnaires
PubMed: 36307752
DOI: 10.1186/s12888-022-04319-x -
The British Journal of Surgery Jun 2021Operating room recording, via video, audio and sensor-based recordings, is increasingly common. Yet, surgical data science is a new field without clear guidelines. The...
INTRODUCTION
Operating room recording, via video, audio and sensor-based recordings, is increasingly common. Yet, surgical data science is a new field without clear guidelines. The purpose of this study is to examine existing published studies of surgical recording modalities to determine which are available for use in the operating room, as a first step towards developing unified standards for this field.
METHODS
Medline, EMBASE, CENTRAL and PubMed databases were systematically searched for articles describing modalities of data collection in the operating room. Search terms included 'video-audio media', 'bio-sensing techniques', 'sound', 'movement', 'operating rooms' and others. Title, abstract and full-text screening were completed to identify relevant articles. Descriptive statistical analysis was performed for included studies.
RESULTS
From 3756 citations, 91 studies met inclusion criteria. These studies described 10 unique data-collection modalities for 17 different purposes in the operating room. Data modalities included video, audio, kinematic and eye-tracking among others. Data-collection purposes described included surgical trainee assessment, surgical error, surgical team communication and operating room efficiency.
CONCLUSION
Effective data collection and utilization in the operating room are imperative for the provision of superior surgical care. The future operating room landscape undoubtedly includes multiple modalities of data collection for a plethora of purposes. This review acts as a foundation for employing operating room data in a way that leads to meaningful benefit for patient care.
Topics: Data Collection; Humans; Operating Rooms; Surgical Procedures, Operative; Tape Recording; Video Recording
PubMed: 34157080
DOI: 10.1093/bjs/znab016 -
Journal of Medical Internet Research Jan 2021A population-level survey (PLS) is an essential and standard method used in public health research that supports the quantification of sociodemographic events, public...
BACKGROUND
A population-level survey (PLS) is an essential and standard method used in public health research that supports the quantification of sociodemographic events, public health policy development, and intervention designs. Data collection mechanisms in PLS seem to be a significant determinant in avoiding mistakes. Using electronic devices such as smartphones and tablet computers improves the quality and cost-effectiveness of public health surveys. However, there is a lack of systematic evidence to show the potential impact of electronic data collection tools on data quality and cost reduction in interviewer-administered surveys compared with the standard paper-based data collection system.
OBJECTIVE
This systematic review aims to evaluate the impact of the interviewer-administered electronic data collection methods on data quality and cost reduction in PLS compared with traditional methods.
METHODS
We conducted a systematic search of MEDLINE, CINAHL, PsycINFO, the Web of Science, EconLit, Cochrane CENTRAL, and CDSR to identify relevant studies from 2008 to 2018. We included randomized and nonrandomized studies that examined data quality and cost reduction outcomes, as well as usability, user experience, and usage parameters. In total, 2 independent authors screened the title and abstract, and extracted data from selected papers. A third author mediated any disagreements. The review authors used EndNote for deduplication and Rayyan for screening.
RESULTS
Our search produced 3817 papers. After deduplication, we screened 2533 papers, and 14 fulfilled the inclusion criteria. None of the studies were randomized controlled trials; most had a quasi-experimental design, for example, comparative experimental evaluation studies nested on other ongoing cross-sectional surveys. A total of 4 comparative evaluations, 2 pre-post intervention comparative evaluations, 2 retrospective comparative evaluations, and 4 one-arm noncomparative studies were included. Meta-analysis was not possible because of the heterogeneity in study designs, types, study settings, and level of outcome measurements. Individual paper synthesis showed that electronic data collection systems provided good quality data and delivered faster compared with paper-based data collection systems. Only 2 studies linked cost and data quality outcomes to describe the cost-effectiveness of electronic data collection systems. Field data collectors reported that an electronic data collection system was a feasible, acceptable, and preferable tool for their work. Onsite data error prevention, fast data submission, and easy-to-handle devices were the comparative advantages offered by electronic data collection systems. Challenges during implementation included technical difficulties, accidental data loss, device theft, security concerns, power surges, and internet connection problems.
CONCLUSIONS
Although evidence exists of the comparative advantages of electronic data collection compared with paper-based methods, the included studies were not methodologically rigorous enough to combine. More rigorous studies are needed to compare paper and electronic data collection systems in public health surveys considering data quality, work efficiency, and cost reduction.
INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)
RR2-10.2196/10678.
Topics: Cost-Benefit Analysis; Cross-Sectional Studies; Data Accuracy; Health Surveys; Humans; Public Health; Retrospective Studies
PubMed: 33480859
DOI: 10.2196/21382 -
AIDS and Behavior Aug 2016Reporting key details of respondent-driven sampling (RDS) survey implementation and analysis is essential for assessing the quality of RDS surveys. RDS is both a... (Review)
Review
Reporting key details of respondent-driven sampling (RDS) survey implementation and analysis is essential for assessing the quality of RDS surveys. RDS is both a recruitment and analytic method and, as such, it is important to adequately describe both aspects in publications. We extracted data from peer-reviewed literature published through September, 2013 that reported collected biological specimens using RDS. We identified 151 eligible peer-reviewed articles describing 222 surveys conducted in seven regions throughout the world. Most published surveys reported basic implementation information such as survey city, country, year, population sampled, interview method, and final sample size. However, many surveys did not report essential methodological and analytical information for assessing RDS survey quality, including number of recruitment sites, seeds at start and end, maximum number of waves, and whether data were adjusted for network size. Understanding the quality of data collection and analysis in RDS is useful for effectively planning public health service delivery and funding priorities.
Topics: Biological Products; Data Collection; HIV Infections; Homosexuality, Male; Humans; Male; Population Surveillance; Sample Size; Sampling Studies; Sexual Behavior; Surveys and Questionnaires
PubMed: 26992395
DOI: 10.1007/s10461-016-1346-5 -
Transboundary and Emerging Diseases Sep 2022Voluntary detection of emerging disease outbreaks is considered essential for limiting their potential impacts on livestock industries. However, many of the strategies...
Voluntary detection of emerging disease outbreaks is considered essential for limiting their potential impacts on livestock industries. However, many of the strategies employed by animal health authorities to capture data on potential emerging disease threats rely on farmers and veterinarians identifying situations of concern and then voluntarily taking appropriate actions to notify animal health authorities. To improve the performance of these systems, it is important to understand the range of socio-cultural factors influencing the willingness of individuals to engage with disease reporting such as trust in government, perceived economic impacts, social stigma and perceptions of 'good farming'. The objectives of this systematic review were to assess how different social research methodologies have been employed to understand the role these socio-cultural dimensions play in voluntary disease reporting and to discuss limitations to address in future research. The review uncovered 39 relevant publications that employed a range of quantitative and qualitative methodologies including surveys, interviews, focus groups, scenarios, observations, mixed-methods, interventions and secondary data analysis. While these studies provided valuable insights, one significant challenge remains eliciting accurate statements of behaviour and intentions rather than those that reflect desirable social norms. There is scope to develop methodological innovations to study the decision to report animal disease to help overcome the gap between what people say they do and their observable behaviour. A notable absence is studies exploring specific interventions designed to encourage disease reporting. Greater clarity in specifying the disease contexts, behavioural mechanisms and outcomes and the relationships between them would provide a more theoretically informed and policy relevant understanding of how disease reporting works, for which farmers, and in which disease contexts.
Topics: Animal Diseases; Animals; Farmers; Farms; Humans; Livestock; Surveys and Questionnaires; Veterinarians
PubMed: 34843177
DOI: 10.1111/tbed.14407 -
BMC Pregnancy and Childbirth Mar 2021Most post-licensure vaccine pharmacovigilance in low- and middle-income countries (LMICs) are passive reporting systems. These have limited utility for maternal...
BACKGROUND
Most post-licensure vaccine pharmacovigilance in low- and middle-income countries (LMICs) are passive reporting systems. These have limited utility for maternal immunization pharmacovigilance in LMIC settings and need to be supplemented with active surveillance. Our study's main objective was to identify existing perinatal data collection systems in LMICs that collect individual information on maternal and neonatal health outcomes and could be developed to inform active safety surveillance of novel vaccines for use during pregnancy.
METHODS
A scoping review was performed following the Arksey and O'Malley six-stage approach. We included studies describing electronic or mixed paper-electronic data collection systems in LMICs, including research networks, electronic medical records, and custom software platforms for health information systems. Medline PubMed, EMBASE, Global Health, Cochrane Library, LILACS, Bibliography of Asian Studies (BAS), and CINAHL were searched through August 2019. We also searched grey literature including through Google and websites of existing relevant perinatal data collection systems, as well as contacted authors of key studies and experts in the field to validate the information and identify additional sources of relevant unpublished information.
RESULTS
A total of 11,817 records were identified. The full texts of 264 records describing 96 data collection systems were assessed for eligibility. Eight perinatal data collection systems met our inclusion criteria: Global Network's Maternal Newborn Health Registry, International Network for the Demographic Evaluation of Populations and their Health; Perinatal Informatic System; Pregnancy Exposure Registry & Birth Defects Surveillance; SmartCare; Open Medical Record System; Open Smart Register Platform and District Health Information Software 2. These selected systems were qualitatively characterized according to seven different domains: governance; system design; system management; data management; data sources, outcomes and data quality.
CONCLUSION
This review provides a list of active maternal and neonatal data collection systems in LMICs and their characteristics as well as their outreach, strengths, and limitations. Findings could potentially help further understand where to obtain population-based high-quality information on outcomes to inform the conduct of maternal immunization active vaccine safety surveillance activities and research in LMICs.
Topics: Data Collection; Developing Countries; Female; Health Information Systems; Humans; Immunologic Factors; Infant Health; Infant, Newborn; Maternal Health; Pharmacovigilance; Pregnancy; Product Surveillance, Postmarketing; Vaccination; Vaccines
PubMed: 33731029
DOI: 10.1186/s12884-021-03686-9