-
Indian Journal of Public Health 2023Cancer-related fatigue (CRF) is a common symptom experienced by all the cancer patients at all stages of the disease and in survivors. Fatigue from cancer is one of the... (Review)
Review
Cancer-related fatigue (CRF) is a common symptom experienced by all the cancer patients at all stages of the disease and in survivors. Fatigue from cancer is one of the understated, underestimated, and least managed. Several scales have been developed to measure CRF, but they vary in the quality of psychometric properties, ease of administration, and dimensions of CRF. This systematic review explores the validity and reliability of the different CRF measurement scales. A systematic review methodology was followed to identify the scales that have been validated to measure CRF. Three separate databases PubMed, CINAHL, and Google Scholar searches were performed using different medical subject heading terms. Articles were analyzed for validity and reliability. A total of 1294 articles from three different searches identified 15 scales (unidimensional and multidimensional). Each scale varied by its psychometric properties, items, scale type, dimension, site of cancer, and population in which it is validated. Most of the scales had been validated in mixed cancer populations. Some scales are insensitive to differences in fatigue to cancer stages. Few scales are burdensome for the advanced cancer patients. In this study, 15 CRF scales were identified. Validity and reliability are varied by each questionnaire. The ideal and accepted item numbers, scale, and domains are not established. The psychometric properties of each measure require further consideration. More studies are needed to explore fatigue scales with many populations.
Topics: Humans; Reproducibility of Results; India; Neoplasms; Surveys and Questionnaires; Fatigue
PubMed: 37929389
DOI: 10.4103/ijph.ijph_1025_22 -
Neuropsychology Review Dec 2022Minimal but increasing number of assessment instruments for Executive functions (EFs) and adaptive functioning (AF) have either been developed for or adapted and... (Review)
Review
A Systematic Review of the Validity and Reliability of Assessment Tools for Executive Function and Adaptive Function Following Brain Pathology among Children and Adolescents in Low- and Middle-Income Countries.
Minimal but increasing number of assessment instruments for Executive functions (EFs) and adaptive functioning (AF) have either been developed for or adapted and validated for use among children in low and middle income countries (LAMICs). However, the suitability of these tools for this context is unclear. A systematic review of such instruments was thus undertaken. The Systematic review was conducted following the Preferred Reporting Items for Systematic Review and Meta-Analysis (PRISMA) checklist (Liberati et al., in BMJ (Clinical Research Ed.), 339, 2009). A search was made for primary research papers reporting psychometric properties for development or adaptation of either EF or AF tools among children in LAMICs, with no date or language restrictions. 14 bibliographic databases were searched, including grey literature. Risk of bias assessment was done following the COSMIN (COnsensus-based Standards for the selection of health status Measurement INstruments) guidelines (Mokkink et al., in Quality of Life Research, 63, 32, 2014). For EF, the Behaviour Rating Inventory of Executive Functioning (BRIEF- multiple versions), Wisconsin Card Sorting Test (WCST), Go/No-go and the Rey-Osterrieth complex figure (ROCF) were the most rigorously validated. For AFs, the Vineland Adaptive Behaviour Scales (VABS- multiple versions) and the Child Function Impairment Rating Scale (CFIRS- first edition) were most validated. Most of these tools showed adequate internal consistency and structural validity. However, none of these tools showed acceptable quality of evidence for sufficient psychometric properties across all the measured domains, particularly so for content validity and cross-cultural validity in LAMICs. There is a great need for adequate adaptation of the most popular EF and AF instruments, or alternatively the development of purpose-made instruments for assessing children in LAMICs.Systematic Review Registration numbers: CRD42020202190 (EF tools systematic review) and CRD42020203968 (AF tools systematic review) registered on PROSPERO website ( https://www.crd.york.ac.uk/prospero/ ).
Topics: Adolescent; Child; Humans; Brain; Developing Countries; Executive Function; Psychometrics; Quality of Life; Reproducibility of Results; Surveys and Questionnaires
PubMed: 35349054
DOI: 10.1007/s11065-022-09538-3 -
NPJ Precision Oncology Aug 2023This study evaluates the quality of published research using artificial intelligence (AI) for ovarian cancer diagnosis or prognosis using histopathology data. A... (Review)
Review
This study evaluates the quality of published research using artificial intelligence (AI) for ovarian cancer diagnosis or prognosis using histopathology data. A systematic search of PubMed, Scopus, Web of Science, Cochrane CENTRAL, and WHO-ICTRP was conducted up to May 19, 2023. Inclusion criteria required that AI was used for prognostic or diagnostic inferences in human ovarian cancer histopathology images. Risk of bias was assessed using PROBAST. Information about each model was tabulated and summary statistics were reported. The study was registered on PROSPERO (CRD42022334730) and PRISMA 2020 reporting guidelines were followed. Searches identified 1573 records, of which 45 were eligible for inclusion. These studies contained 80 models of interest, including 37 diagnostic models, 22 prognostic models, and 21 other diagnostically relevant models. Common tasks included treatment response prediction (11/80), malignancy status classification (10/80), stain quantification (9/80), and histological subtyping (7/80). Models were developed using 1-1375 histopathology slides from 1-776 ovarian cancer patients. A high or unclear risk of bias was found in all studies, most frequently due to limited analysis and incomplete reporting regarding participant recruitment. Limited research has been conducted on the application of AI to histopathology images for diagnostic or prognostic purposes in ovarian cancer, and none of the models have been demonstrated to be ready for real-world implementation. Key aspects to accelerate clinical translation include transparent and comprehensive reporting of data provenance and modelling approaches, and improved quantitative evaluation using cross-validation and external validations. This work was funded by the Engineering and Physical Sciences Research Council.
PubMed: 37653025
DOI: 10.1038/s41698-023-00432-6 -
Journal of Research in Medical Sciences... 2021Food frequency questionnaires (FFQs) are inexpensive, easy to administer, and practical tools for dietary assessment in epidemiological studies. Several studies have... (Review)
Review
BACKGROUND
Food frequency questionnaires (FFQs) are inexpensive, easy to administer, and practical tools for dietary assessment in epidemiological studies. Several studies have investigated the validity and reproducibility of FFQs for the Iranian population. This systematic review aimed to assess the developed and validated FFQs for use in the Iranian population and compare their features and the validation studies in this regard.
MATERIALS AND METHODS
A comprehensive search was conducted in ISI Web of Knowledge, PubMed, Scopus, and Iranian databases without time constraints to retrieve the relevant English and non-English publications. Studies would be included if they were focused on the design and validation of FFQs in Iran.
RESULTS
In total, 782 articles were found, 22 of which met the eligibility criteria and evaluated 18 FFQs. Validation studies had been conducted on 18 out of 20 FFQs. The median of the correlation coefficients for the comparison of the FFQ intakes and the dietary reference method by nutrients varied within the range of 0.19-0.65, indicating reasonable validity. The median of the correlation coefficients for the comparison of two FFQs by nutrients was 0.28-0.85, showing appropriate reproducibility. However, low validity was observed in some nutrients and food groups, such as egg, legumes, iron, folate, and α-tocopherol. In seven studies, biomarkers were used for the assessment of nutrient intake using an FFQ with the median correlation coefficient of -0.07-0.42. In addition, the quality of methodology was evaluated in the FFQ validation studies, with 18 out of 20 studies reporting good and excellent quality.
CONCLUSION
Although the FFQs used to assess the dietary intake of the Iranian population have different features, they have acceptable validity and reproducibility. Nevertheless, some food groups and nutrients have poor validity and must be considered attentively.
PubMed: 34484382
DOI: 10.4103/jrms.JRMS_652_20 -
International Journal of Surgery... Oct 2021Work-based assessments including procedure based assessments, case based discussions, clinical evaluation exercises and direct observation of procedural skills are used... (Review)
Review
BACKGROUND
Work-based assessments including procedure based assessments, case based discussions, clinical evaluation exercises and direct observation of procedural skills are used in Higher Surgical Training Program. This systematic review aims to investigate the trainer and trainee's perception of the usefulness of workplace based assessments in Higher Surgical Training Programme.
MATERIALS AND METHODS
Embase, MEDLINE and PubMed databases were searched for relevant studies published up to Jan 15, 2021. The following search terms were used: procedure based assessments, case based discussions, clinical evaluation exercises, direct observation of procedural skills, Higher Surgical Training Program (with and without their abbreviations), surgical training, formative assessment. Usefulness was analysed according to van der Vleuten's utility formula, which is the product of educational impact, validity, reliability, acceptability, cost-effectiveness and feasibility.
RESULTS
23 studies were included; Six on procedure based assessments, two on case based discussions, one on mini clinical evaluation exercises, three on direct observation of procedural skills and eleven on multiple methods. Overall, procedure based assessments had positive Kirkpatrick level 1 or 2 impact were valid, reliable and acceptable. Mini clinical evaluation exercises showed positive Kirkpatrick level 1 satisfaction in trainees and trainers and were feasible. Case based discussions were shown to have both positive and negative Kirkpatrick levels 1 and 2 impact and were rated valid and reliable. Direct observation of procedural skills were valid with favourable Kirkpatrick level 1 impact with more usage and modification of the forms. Multiple methods as used in the intercollegiate surgical curriculum programme portfolio was found to be less encouraging in achieving positive higher level of educational impact. The barriers included lack of time, lack of faculty development and lack of engagement.
CONCLUSION
It is important that work-based assessments are used properly, so that trainees get the maximum benefit from them. None of the studies included in our systematic review demonstrated an impact on behaviour or society (Kirkpatrick level 3 and 4), towards which future research should be directed to.
Topics: Clinical Competence; Curriculum; Educational Measurement; Humans; Reproducibility of Results; Workplace
PubMed: 34597821
DOI: 10.1016/j.ijsu.2021.106127 -
Human Vaccines & Immunotherapeutics Dec 2024Healthcare workers (HCW) perceptions toward vaccines influence patient and community vaccine decision making. In an era of rising vaccine hesitancy, understanding HCW... (Review)
Review
Healthcare workers (HCW) perceptions toward vaccines influence patient and community vaccine decision making. In an era of rising vaccine hesitancy, understanding HCW vaccine confidence is critical. This systematic review aims to review instruments that have been validated to measure HCW vaccine confidence. We conducted a search in five databases in June 2023. Data was descriptively synthesized. Twelve articles describing 10 different tools were included. Most tools included dimensions or items on vaccine knowledge ( = 9), safety ( = 8), vaccine usefulness ( = 8), recommendation behavior ( = 8), and self-vaccination practice ( = 7). All, except one study, were conducted in high-income countries. There was variability in the quality of the validation process. There is limited existing literature on development and validation of tools for HCW vaccine confidence. Based on the tools currently available, the Pro-VC-Be tool is the most well validated. Further research needs to include low- and middle-income contexts.
Topics: Humans; Vaccines; Vaccination; Databases, Factual; Health Personnel; Income
PubMed: 38506574
DOI: 10.1080/21645515.2024.2322796 -
European Journal of Surgical Oncology :... Mar 2022Many prognostic models for Hepatocellular Carcinoma (HCC) have been developed to inform patients and doctors about individual prognosis. Previous reviews of these models... (Meta-Analysis)
Meta-Analysis Review
BACKGROUND
Many prognostic models for Hepatocellular Carcinoma (HCC) have been developed to inform patients and doctors about individual prognosis. Previous reviews of these models were qualitative and did not assess performance at external validation. We assessed the performance of prognostic models for HCC and set a benchmark for biomarker studies.
METHODS
All externally validated models predicting survival for patients with resected HCC were systematically reviewed. After selection, we extracted descriptive statistics and aggregated c-indices using meta-analysis.
RESULTS
Thirty-eight validated prognostic models were included. Models used on average 7 (IQR:4-9) prognostic factors. Tumor size, tumor number, and vascular invasion were almost always included. Alpha-fetoprotein (AFP) was commonly incorporated since 2007. Recently, the more subjective items ascites and encephalopathy have been dropped. Eight established models performed poor to moderate at external validation, with a pooled C-index below 0.7; including the Barcelona Clinic Liver Cancer (BCLC) system, the American Joint Committee on Cancer (AJCC) 7th edition, the Cancer of the Liver Italian (CLIP) Program, and the Japan Integrated Staging (JIS) score. Out of 24 prognostic models predicting OS, only 6 (25%) had good performance at external validation with pooled C-indices above 0.7; the Li-post (0.77), Li-OS (0.74), Yang-pre (0.74), Yang-post (0.76), Shanghai-score (0.70), and Wang-nomogram (0.71). Models improved over time, but overall performance and study quality remained low.
CONCLUSIONS
Six validated prognostic models demonstrated good performance for predicting survival after resection of HCC. These models can guide patients and doctors and are a benchmark for future models incorporating novel biomarkers.
Topics: Biomarkers; Carcinoma, Hepatocellular; China; Humans; Liver Neoplasms; Neoplasm Staging; Prognosis
PubMed: 34602315
DOI: 10.1016/j.ejso.2021.09.012 -
International Journal of Environmental... Nov 2022There is a great heterogeneity in the conceptualization and operationalization of social capital in empirical research targeting adolescents. There has not yet been an... (Review)
Review
There is a great heterogeneity in the conceptualization and operationalization of social capital in empirical research targeting adolescents. There has not yet been an attempt to systematically map and psychometrically evaluate the existing instruments for measuring social capital that have been developed and validated for adolescent samples. The aim of this systematic review was to identify and evaluate the design and psychometric properties of self-reported instruments for social capital, specifically developed and validated for use among adolescents. The design of this study was a systematic review guided by the COSMIN methodology for systematic reviews of Patient Reported Outcome Measures. The search included six electronic databases and no time frame was applied. Twenty studies were identified as describing the development and validation of a social capital instrument for adolescent samples. The results reveal common denominators, but also great variation in the design and validation of the instruments. Adolescents were only involved in the development procedures of four instruments. There is a lack of social capital instruments that cover both the multidimensionality of social capital and contextual relevance in relation to adolescents. Careful examination of instruments should thus precede a decision when designing studies and further instrument development involving the target group is encouraged.
Topics: Adolescent; Humans; Self Report; Social Capital; Psychometrics; Patient Reported Outcome Measures; Reproducibility of Results
PubMed: 36497690
DOI: 10.3390/ijerph192315596 -
Global Mental Health (Cambridge,... 2023Implementing culturally sensitive psychometric measures of depression may be an effective strategy to improve acceptance, response rate, and reliability of psychological... (Review)
Review
BACKGROUND
Implementing culturally sensitive psychometric measures of depression may be an effective strategy to improve acceptance, response rate, and reliability of psychological assessment among Indigenous populations. However, the psychometric properties of depression scales after cultural adaptation remain unclear.
METHODS
We screened the Ovid Medline, PubMed, Embase, Global Health, PsycInfo, and CINAHL databases through three levels of search terms: Depression, Psychometrics, and Indigenous, following the PRISMA guidelines. We assessed metrics for reliability (including Cronbach's alpha), validity (including fit indices), and clinical utility (including predictive value).
RESULTS
Across 31 studies included the review, 13 different depression scales were adapted through language or content modification. Sample populations included Indigenous from the Americas, Asia, Africa, and Oceania. Most cultural adaptations had strong psychometric properties; however, few and inconsistent properties were reported. Where available, alphas, inter-rater and test-retest reliability, construct validity, and incremental validity often indicated increased cultural sensitivity of adapted scales. There were mixed results for clinical utility, criterion validity, cross-cultural validity, sensitivity, specificity, area under the receiver operating characteristic curve, predictive value, and likelihood ratio.
CONCLUSIONS
Modifications to increase cultural relevance have the potential to improve fit and acceptance of a scale by the Indigenous population, however, these changes may decrease specificity and negative predictive value. There is an urgent need for suitable tools that are useful and reliable for identifying Indigenous individuals for clinical treatment of depression. This awaits future work for optimal specificity and validated cut-off points that take into account the high prevalence of depression in these populations.
PubMed: 37854390
DOI: 10.1017/gmh.2023.52 -
PloS One 2019Therapeutic Change Process Research (TCPR) connects within-therapeutic change processes to outcomes. The labour intensity of qualitative methods limit their use to small...
Therapeutic Change Process Research (TCPR) connects within-therapeutic change processes to outcomes. The labour intensity of qualitative methods limit their use to small scale studies. Automated text-analyses (e.g. text mining) provide means for analysing large scale text patterns. We aimed to provide an overview of the frequently used qualitative text-based TCPR methods and assess the extent to which these methods are reliable and valid, and have potential for automation. We systematically reviewed PsycINFO, Scopus, and Web of Science to identify articles concerning change processes and text or language. We evaluated the reliability and validity based on replicability, the availability of code books, training data and inter-rater reliability, and evaluated the potential for automation based on the example- and rule-based approach. From 318 articles we identified four often used methods: Innovative Moments Coding Scheme, the Narrative Process Coding Scheme, Assimilation of Problematic Experiences Scale, and Conversation Analysis. The reliability and validity of the first three is sufficient to hold promise for automation. While some text features (content, grammar) lend themselves for automation through a rule-based approach, it should be possible to automate higher order constructs (e.g. schemas) when sufficient annotated data for an example-based approach are available.
Topics: Automation; Data Mining; Humans; Records; Therapeutics
PubMed: 31805093
DOI: 10.1371/journal.pone.0225703