-
BMJ Open Apr 2016To review the evidence for existing prognostic models in acute pulmonary embolism (PE) and determine how valid and useful they are for predicting patient outcomes. (Meta-Analysis)
Meta-Analysis Review
OBJECTIVE
To review the evidence for existing prognostic models in acute pulmonary embolism (PE) and determine how valid and useful they are for predicting patient outcomes.
DESIGN
Systematic review and meta-analysis.
DATA SOURCES
OVID MEDLINE and EMBASE, and The Cochrane Library from inception to July 2014, and sources of grey literature.
ELIGIBILITY CRITERIA
Studies aiming at constructing, validating, updating or studying the impact of prognostic models to predict all-cause death, PE-related death or venous thromboembolic events up to a 3-month follow-up in patients with an acute symptomatic PE.
DATA EXTRACTION
Study characteristics and study quality using prognostic criteria. Studies were selected and data extracted by 2 reviewers.
DATA ANALYSIS
Summary estimates (95% CI) for proportion of risk groups and event rates within risk groups, and accuracy.
RESULTS
We included 71 studies (44,298 patients). Among them, 17 were model construction studies specific to PE prognosis. The most validated models were the PE Severity Index (PESI) and its simplified version (sPESI). The overall 30-day mortality rate was 2.3% (1.7% to 2.9%) in the low-risk group and 11.4% (9.9% to 13.1%) in the high-risk group for PESI (9 studies), and 1.5% (0.9% to 2.5%) in the low-risk group and 10.7% (8.8% to12.9%) in the high-risk group for sPESI (11 studies). PESI has proved clinically useful in an impact study. Shifting the cut-off or using novel and updated models specifically developed for normotensive PE improves the ability for identifying patients at lower risk for early death or adverse outcome (0.5-1%) and those at higher risk (up to 20-29% of event rate).
CONCLUSIONS
We provide evidence-based information about the validity and utility of the existing prognostic models in acute PE that may be helpful for identifying patients at low risk. Novel models seem attractive for the high-risk normotensive PE but need to be externally validated then be assessed in impact studies.
Topics: Acute Disease; Health Status Indicators; Humans; Models, Theoretical; Predictive Value of Tests; Prognosis; Pulmonary Embolism; Risk Assessment; Severity of Illness Index; Venous Thromboembolism
PubMed: 27130162
DOI: 10.1136/bmjopen-2015-010324 -
Public Health Nutrition Dec 2014The aim of the present work was to determine what dietary assessment method can provide a valid and accurate estimate of nutrient intake by comparison with the gold... (Review)
Review
OBJECTIVE
The aim of the present work was to determine what dietary assessment method can provide a valid and accurate estimate of nutrient intake by comparison with the gold standard.
DESIGN
A MEDLINE, EMBASE, ISI Web of Science, Cochrane and related references literature review was conducted on dietary assessment methods for adolescents reporting the validity and/or reproducibility values. A study quality assessment on the retrieved FFQ was carried out according to two different scoring systems, judging respectively the quality of FFQ nutrition information and of FFQ validation and calibration.
SETTING
The present review considered adolescents attending high schools and recruited in hospitals or at home.
SUBJECTS
The target of the review was the healthy adolescent population in the age range 13-17 years.
RESULTS
Thirty-two eligible papers were included and analysed separately as 'original articles' (n 20) and 'reviews' (n 12). The majority (n 17) assessed the validation and reproducibility of FFQ. Almost all studies found the questionnaires to be valid and reproducible (r > 0·4), except for some food groups and nutrients. Different design and validation issues were highlighted, such as portion-size estimation, number of food items and statistics used.
CONCLUSIONS
The present review offers new insights in relation to the characteristics of assessment methods for dietary intake in adolescents. Further meta-analysis is required although the current review provides important indications on the development of a new FFQ, addressing the need for a valid, reproducible, user-friendly, cost-effective method of accurately assessing nutrient intakes in adolescents.
Topics: Adolescent; Diet; Diet Surveys; Feeding Behavior; Humans; Nutrition Assessment; Reproducibility of Results; Surveys and Questionnaires
PubMed: 24476625
DOI: 10.1017/S1368980013003157 -
Scandinavian Journal of Gastroenterology Mar 2018Reliable, valid, and feasible assessment tools are essential to ensure competence in colonoscopy. This study aims to provide an overview of the existing assessment... (Review)
Review
INTRODUCTION
Reliable, valid, and feasible assessment tools are essential to ensure competence in colonoscopy. This study aims to provide an overview of the existing assessment methods and the validity evidence that supports them.
METHODS
A systematic search was conducted in October 2016. Pubmed, EMBASE, and PsycINFO were searched for studies evaluating assessment methods to ensure competency in colonoscopy. Outcome variables were described and evidence of validity was explored using a contemporary framework.
RESULTS
Twenty-five observational studies were included in the systematic review. Most studies were based on small sample sizes. The studies were categorized after outcome measures into five groups: Clinical process related outcome metrics (n = 2), direct observational colonoscopy assessment (n = 8), simulator based metrics (n = 11), automatic computerized metrics (n = 2), and self-assessment (n = 1). Validity score varied among the studies and only five studies presented sufficient evidence to recommend the tool for clinical assessment.
CONCLUSIONS
The objectives vary throughout the presented tools. Some tools are global tools where others focus on procedural technical skill assessment or even part-task skills. There is a tendency in the most recent studies towards more specific assessment of technical skills. The majority of assessment methods lack sufficient validity evidence.
Topics: Certification; Clinical Competence; Colonoscopy; Humans; Observational Studies as Topic
PubMed: 29361859
DOI: 10.1080/00365521.2018.1428767 -
International Journal of Clinical... Jul 2018Hope is recognised as an important factor in health, illness, and well-being. Many scales to measure hope have been developed and used in various disciplines, yet, their... (Review)
Review
INTRODUCTION
Hope is recognised as an important factor in health, illness, and well-being. Many scales to measure hope have been developed and used in various disciplines, yet, their psychometric properties have not been systematically reviewed.
AIM
To systematically review the psychometric properties of hope scales.
DESIGN
Systematic review.
METHODS
Four electronic databases were searched followed by a hand search. The data were extracted and qualitatively evaluated by the COSMIN checklist, an instrument designed as a quality rating tool for systematic reviews of psychometric properties.
RESULTS
From 1271 retrieved abstracts, 68 papers met the inclusion criteria. The most used scale was the Snyder Hope Scale (46%) followed by the Herth Hope Index (16%). All other scales (n = 16) were evaluated in less than 10% of the papers. Structural validity (91%), internal consistency (88%), and hypothesis testing (74%) were the most reported properties. Reliability (34%), cross-cultural validity (34%), content validity (25%), and criterion validity (15%) were reported in less than 50% of the papers. Only two (3%) studies reported responsiveness, and none reported measurement error. Less than 35% of the validation studies achieved excellent or good quality for any of the measurement properties.
CONCLUSION
The results show that no robust and valid scale exists for measuring hope. It highlights important gaps in psychometric properties of hope scales. Despite more than 40 years of research and development of hope scales, the currently available scales do not meet the standards of psychometric evaluation. This calls for efforts to improve the quality of hope scales.
Topics: Checklist; Hope; Humans; Mental Health; Psychometrics; Reproducibility of Results; Self Efficacy; Spirituality; Surveys and Questionnaires
PubMed: 29920883
DOI: 10.1111/ijcp.13213 -
Psychotherapy and Psychosomatics 2016Since the cognitive revolution of the early 1950s, cognitions have been discussed as central components in the understanding and treatment of mental illnesses. Even... (Meta-Analysis)
Meta-Analysis Review
BACKGROUND
Since the cognitive revolution of the early 1950s, cognitions have been discussed as central components in the understanding and treatment of mental illnesses. Even though there is an extensive literature on the association between therapy-related cognitions such as irrational beliefs and psychological distress over the past 60 years, there is little meta-analytical knowledge about the nature of this association.
METHODS
The relationship between irrational beliefs and distress was examined based on a systematic review that included 100 independent samples, gathered in 83 primary studies, using a random-effect model. The overall effects as well as potential moderators were examined: (a) distress measure, (b) irrational belief measure, (c) irrational belief type, (d) method of assessment of distress, (e) nature of irrational beliefs, (f) time lag between irrational beliefs and distress assessment, (g) nature of stressful events, (h) sample characteristics (i.e. age, gender, income, and educational, marital, occupational and clinical status), (i) developer/validator status of the author(s), and (k) publication year and country.
RESULTS
Overall, irrational beliefs were positively associated with various types of distress, such as general distress, anxiety, depression, anger, and guilt (omnibus: r = 0.38). The following variables were significant moderators of the relationship between the intensity of irrational beliefs and the level of distress: irrational belief measure and type, stressful event, age, educational and clinical status, and developer/validator status of the author.
CONCLUSIONS
Irrational beliefs and distress are moderately connected to each other; this relationship remains significant even after controlling for several potential covariates.
Topics: Anxiety; Cognitive Behavioral Therapy; Depression; Female; Humans; Male; Stress, Psychological
PubMed: 26609889
DOI: 10.1159/000441231 -
Archives of Dermatological Research Aug 2023Many patient-reported outcome measures (PROMs) have been used to study quality of life (QOL) in the skin cancer population. Advanced melanoma and non-melanoma skin... (Review)
Review
Many patient-reported outcome measures (PROMs) have been used to study quality of life (QOL) in the skin cancer population. Advanced melanoma and non-melanoma skin cancer (NMSC) may be associated with increased morbidity, mortality, and treatment side effects; however, it is unclear which PROM is valid and appropriate to use in these populations for both clinical and research purposes. We aimed to identify the PROMs that have been used to measure QOL in advanced skin cancer patients and determine which of these PROMs have been validated to assess QOL outcomes in this population. A PubMed and EMBASE search was conducted from its inception to March 2021 according to PRISMA guidelines with a comprehensive list of search terms under three main topics: (1) PROM; (2) advanced skin cancer; and (3) staging and interventions. We included articles utilizing a PROM measuring QOL and having a patient population with advanced skin cancer defined as melanoma stage > T1a or non-melanoma AJCC stage T3 or greater. Advanced skin cancer patients were also defined as those with metastasis or requiring adjuvant therapy (systemic chemotherapy, radiation, and immunotherapy). Studies were excluded according to the following criteria: mix of low-risk and advanced skin cancer patients in the study population without stratification into low-risk and advanced groups, stage T1a melanoma or mix of stages without stratification, low-risk NMSC, no PROM (i.e., study specific questionnaires), non-English publication, review article or protocol paper, conference abstract, or populations including non-skin cancers. A total of 1,998 articles were identified. 82 met our inclusion criteria resulting in 22 PROMs: five generic health-related (QWB-SA, AQoL-8D, EQ-5D, SF-36, and PRISM), six general cancer (EORTC QLQ-C30, EORTC QLQ-C36, LASA, IOC, Rotterdam Symptom Checklist, and FACT-G), nine disease-focused or specialized (EORTC QLQ-H&N35, EORTC QLQ-MEL38, EORTC QLQ-BR23, Facial Disability Index, FACT-H&N, FACT-BRM, FACT-B, FACT-M, and scqolit), and two general dermatology (Skindex-16 and DLQI) PROMs. All PROMs have been generally validated except for EORTC QLQ-MEL38. Only two PROMs have been validated in the advanced melanoma population: FACT-M and EORTC QLQ-C36. No PROMS have been validated in the advanced NMSC population. The PROMs that were validated in the advanced melanoma population do not include QOL issues unique to advanced skin tumors such as odor, bleeding, itching, wound care burden, and public embarrassment. Breast cancer and head and neck cancer instruments were adapted but not validated for use in the advanced skin cancer population due to the lack of an adequate instrument for this population. This study highlights the need for PROM instrument validation or creation specifically geared toward the advanced skin cancer population. Future studies should aim to develop and validate a PROM to assess QOL in this population.
Topics: Humans; Quality of Life; Skin Neoplasms; Melanoma; Surveys and Questionnaires; Patient Reported Outcome Measures
PubMed: 36469125
DOI: 10.1007/s00403-022-02479-0 -
Journal of Clinical Medicine Aug 2021We comprehensively assessed the criterion-related validity of existing field-based fitness tests used to indicate adult health (19-64 years, with no known pathologies).... (Review)
Review
We comprehensively assessed the criterion-related validity of existing field-based fitness tests used to indicate adult health (19-64 years, with no known pathologies). The medical electronic databases MEDLINE (via PubMed) and Web of Science (all databases) were screened for studies published up to July 2020. Each original study's methodological quality was classified as high, low and very low, according to the number of participants, the description of the study population, statistical analysis and systematic reviews which were appraised via the AMSTAR rating scale. Three evidence levels were constructed (strong, moderate and limited evidence) according to the number of studies and the consistency of the findings. We identified 101 original studies (50 of high quality) and five systematic reviews examining the criterion-related validity of field-based fitness tests in adults. Strong evidence indicated that the 20 m shuttle run, 1.5-mile, 12 min run/walk, YMCA step, 2 km walk and 6 min walk test are valid for estimating cardiorespiratory fitness; the handgrip strength test is valid for assessing hand maximal isometric strength; and the Biering-Sørensen test to evaluate the endurance strength of hip and back muscles; however, the sit-and reach test, and its different versions, and the toe-to-touch test are not valid for assessing hamstring and lower back flexibility. We found moderate evidence supporting that the 20 m square shuttle run test is a valid test for estimating cardiorespiratory fitness. Other field-based fitness tests presented limited evidence, mainly due to few studies. We developed an evidence-based proposal of the most valid field-based fitness tests in healthy adults aged 19-64 years old.
PubMed: 34442050
DOI: 10.3390/jcm10163743 -
Journal of Clinical Medicine Jan 2023Cognitive impairment is a prevalent and debilitating symptom of multiple sclerosis (MS) but is not routinely addressed in clinical care. The Brief Cognitive Assessment... (Review)
Review
Cognitive impairment is a prevalent and debilitating symptom of multiple sclerosis (MS) but is not routinely addressed in clinical care. The Brief Cognitive Assessment for Multiple Sclerosis (BICAMS) was developed in 2012 to screen and monitor MS patients’ cognition. This systematic review and meta-analysis aimed to identify, synthesise, and critically appraise current BICAMS’ international validations. The literature search was conducted using PubMed, PsycINFO and Web of Science electronic databases in August 2022. Quantitative, peer-reviewed adult studies, which followed the BICAMS international validation protocol and were published in English, were included. The search identified a total of 203 studies, of which 26 were eligible for inclusion. These reported a total of 2833 adults with MS and 2382 healthy controls (HC). The meta-analysis showed that BICAMS identified impaired cognitive functioning in adults with MS compared to HC for all three subtests: information processing speed (g = 0.854, 95% CI = 0.765, 0.944, p < 0.001), immediate verbal recall (g = 0.566, 95% CI = 0.459, 0.673, p < 0.001) and immediate visual recall (g = 0.566, 95% CI = 0.487, 0.645, p < 0.001). Recruitment sites and strategies limit the generalisability of results. BICAMS is a valid and feasible international MS cognitive assessment.
PubMed: 36675637
DOI: 10.3390/jcm12020703 -
Implementation Science : IS Aug 2021The important role of leaders in the translation of health research is acknowledged in the implementation science literature. However, the accurate measurement of... (Review)
Review
BACKGROUND
The important role of leaders in the translation of health research is acknowledged in the implementation science literature. However, the accurate measurement of leadership traits and behaviours in health professionals has not been directly addressed. This review aimed to identify whether scales which measure leadership traits and behaviours have been found to be reliable and valid for use with health professionals.
METHODS
A systematic review was conducted. MEDLINE, EMBASE, PsycINFO, Cochrane, CINAHL, Scopus, ABI/INFORMIT and Business Source Ultimate were searched to identify publications which reported original research testing the reliability, validity or acceptability of a leadership-related scale with health professionals.
RESULTS
Of 2814 records, a total of 39 studies met the inclusion criteria, from which 33 scales were identified as having undergone some form of psychometric testing with health professionals. The most commonly used was the Implementation Leadership Scale (n = 5) and the Multifactor Leadership Questionnaire (n = 3). Of the 33 scales, the majority of scales were validated in English speaking countries including the USA (n = 15) and Canada (n = 4), but also with some translations and use in Europe and Asia, predominantly with samples of nurses (n = 27) or allied health professionals (n = 10). Only two validation studies included physicians. Content validity and internal consistency were evident for most scales (n = 30 and 29, respectively). Only 20 of the 33 scales were found to satisfy the acceptable thresholds for good construct validity. Very limited testing occurred in relation to test-re-test reliability, responsiveness, acceptability, cross-cultural revalidation, convergent validity, discriminant validity and criterion validity.
CONCLUSIONS
Seven scales may be sufficiently sound to be used with professionals, primarily with nurses. There is an absence of validation of leadership scales with regard to physicians. Given that physicians, along with nurses and allied health professionals have a leadership role in driving the implementation of evidence-based healthcare, this constitutes a clear gap in the psychometric testing of leadership scales for use in healthcare implementation research and practice.
TRIAL REGISTRATION
This review follows the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) (see Additional File 1) (PLoS Medicine. 6:e1000097, 2009) and the associated protocol has been registered with the PROSPERO International Prospective Register of Systematic Reviews (Registration Number CRD42019121544 ).
Topics: Health Personnel; Humans; Leadership; Psychometrics; Reproducibility of Results; Surveys and Questionnaires
PubMed: 34454567
DOI: 10.1186/s13012-021-01141-z -
African Health Sciences Sep 2015Well developed and validated lifestyle cardiovascular disease (CVD) risk factors questionnaires is the key to obtaining accurate information to enable planning of CVD... (Review)
Review
BACKGROUND
Well developed and validated lifestyle cardiovascular disease (CVD) risk factors questionnaires is the key to obtaining accurate information to enable planning of CVD prevention program which is a necessity in developing countries. We conducted this review to assess methods and processes used for development and content validation of lifestyle CVD risk factors questionnaires and possibly develop an evidence based guideline for development and content validation of lifestyle CVD risk factors questionnaires.
MATERIALS/METHODS
Relevant databases at the Stellenbosch University library were searched for studies conducted between 2008 and 2012, in English language and among humans. Using the following databases; pubmed, cinahl, psyc info and proquest. Search terms used were CVD risk factors, questionnaires, smoking, alcohol, physical activity and diet.
RESULTS
Methods identified for development of lifestyle CVD risk factors were; review of literature either systematic or traditional, involvement of expert and /or target population using focus group discussion/interview, clinical experience of authors and deductive reasoning of authors. For validation, methods used were; the involvement of expert panel, the use of target population and factor analysis.
CONCLUSION
Combination of methods produces questionnaires with good content validity and other psychometric properties which we consider good.
Topics: Cardiovascular Diseases; Diet; Exercise; Humans; Life Style; Male; Psychometrics; Reproducibility of Results; Risk Factors; Sensitivity and Specificity; Smoking; Smoking Prevention; Surveys and Questionnaires
PubMed: 26957984
DOI: 10.4314/ahs.v15i3.30