-
Military Psychology : the Official... 2023Criterion measures vary greatly in terms of their psychometric quality and ease of use. This paper serves two purposes. First, it provides a general summary of different... (Review)
Review
Criterion measures vary greatly in terms of their psychometric quality and ease of use. This paper serves two purposes. First, it provides a general summary of different approaches to criterion measurement in a military context. Second, it provides an extensive review of 16 specific types of criterion measurement methods (e.g., job performance rating scales, self-report questionnaires, job knowledge tests) on nine psychometric and ease-of-use evaluation factors. Eight criterion measurement experts read a summary of extant research and made ratings to evaluate each measurement method on the evaluation factors. Rater intra-class correlations (ICCs) were high, ranging from .75 to .95 across the evaluation dimensions with a median of .91. Data showed a quality-feasibility tradeoff, where criterion data that are easy to obtain often have technical flaws. Recommendations for military services and future directions in criterion measurement (e.g., applications of machine learning) are discussed.
Topics: Humans; Psychometrics; Self Report; Surveys and Questionnaires
PubMed: 37352453
DOI: 10.1080/08995605.2022.2050165 -
Journal of Affective Disorders Oct 2023Cognitive deficits are a core feature of bipolar disorder (BD) that persist during the euthymic phase and affect global functioning. However, nowadays, there is no... (Review)
Review
BACKGROUND
Cognitive deficits are a core feature of bipolar disorder (BD) that persist during the euthymic phase and affect global functioning. However, nowadays, there is no consensus on the optimal tool to capture cognitive deficits in BD. Therefore, this review aims to examine the psychometric properties of tools commonly used to assess cognitive functioning in BD.
METHODS
Literature search was conducted on PubMed and Web of Science databases on August 1, 2022 and on April 20, 2023, yielding 1758 de-duplicated records. Thirteen studies fulfilled the inclusion criteria and were included in the review.
RESULTS
All tools examined showed acceptable-to-good psychometric properties suggesting that both brief cognitive screeners and comprehensive batteries may be appropriate for detecting or monitoring cognitive changes in BD.
LIMITATIONS
Methodological differences between the included studies precluded a direct comparison of the results. Further research is needed to investigate the psychometric properties of cognitive tools that assess also affective and social cognition.
CONCLUSIONS
The tools examined appear sensitive enough to distinguish between BD patients with versus without cognitive deficits, however, an optimal tool has not yet been identified. The applicability and clinical utility of the tools may depend on multiple factors such as available resources. That said, web-based instruments are expected to become the first-choice instrument for cognitive screening as they can be applied on a large scale and at an affordable cost. As for second-level assessment instruments, the BACA shows robust psychometric properties and tests both affective and non-affective cognition.
Topics: Humans; Bipolar Disorder; Psychometrics; Neuropsychological Tests; Cognition; Cognitive Dysfunction
PubMed: 37331381
DOI: 10.1016/j.jad.2023.06.026 -
The Journal of Evidence-based Dental... Jan 2024Different dental patient-reported outcome measures (dPROMs) exist for children and adults, leading to an incompatibility in outcome assessment in these 2 age groups....
BACKGROUND
Different dental patient-reported outcome measures (dPROMs) exist for children and adults, leading to an incompatibility in outcome assessment in these 2 age groups. However, the dental patient-reported outcomes (dPROs) Oral Function, Orofacial Pain, Orofacial Appearance, and Psychosocial Impact are the same in the 2 groups, providing an opportunity for compatible dPRO assessment if dPROMs were identical. Therefore, we adapted the 5-item Oral Health Impact Profile (OHIP-5), a recommended dPROM for adults, to school-aged children to allow a standardized dPRO assessment in individuals aged 7 years and above.
AIM
It was the aim of this study to develop a 5-item OHIP for school-aged children (OHIP-5) and to investigate the instrument's score reliability and validity.
METHODS
German-speaking children (N = 95, mean age: 8.6 years +/- 1.3 years, 55% girls) from the Department of Pediatric Dentistry at the Medical University of Vienna, Austria and a private dental practice in Bergisch Gladbach, Germany participated. The original OHIP-5 was modified and adapted for school going children aged 7-13 years and this modified version was termed OHIP-5. It's score reliability was studied by determining scores' internal consistency and temporal stability by calculating Cronbach's alpha and intraclass correlation coefficients, respectively. Construct validity was assessed comparing OHIP-5 scores with OHIP-5 as well as Child Perceptions Questionnaire (CPQ-G) scores.
RESULTS
Score reliability for the OHIP-5 was "good" (Cronbach's alpha: 0.81) or "excellent" (Intraclass correlation coefficient: 0.92). High correlations between OHIP-5, OHIP-5, and CPQ-G scores were observed and hypotheses about a pattern of these correlations were confirmed, providing evidence for score validity.
CONCLUSION
The OHIP-5 and the original OHIP-5 are short and psychometrically sound instruments to measure the oral health related quality of life in school-aged children, providing an opportunity for a standardized oral health impact assessment with the same metric in school-aged children, adolescents, and adults.
Topics: Adult; Child; Female; Adolescent; Humans; Male; Quality of Life; Oral Health; Reproducibility of Results; Psychometrics; Surveys and Questionnaires
PubMed: 38401952
DOI: 10.1016/j.jebdp.2023.101947 -
BMC Public Health Nov 2023Compassion is closely linked to psychological well-being, and several assessment tools have been developed and studied to assess the level of compassion in different... (Review)
Review
BACKGROUND
Compassion is closely linked to psychological well-being, and several assessment tools have been developed and studied to assess the level of compassion in different populations and for more precise measurement. There is currently a scarcity of comprehensive knowledge about compassion-related assessment tools, and our research provides an overview of these tools.
AIMS
To identify scales used to measure compassion from different flows, and to assess their measurement properties and quality.
METHODS
Focusing on compassion assessment tools, the authors conducted a thorough search of 10 Chinese and English databases from their establishment until August 14, 2022. Data extracted included the author, year, country, objectives, target population, as well as the primary evaluation content. Using the COSMIN checklist, the methodological quality and measurement properties of the included studies were appraised. This scoping review was registered with the Open Science Framework and followed the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews) checklist.
RESULTS
There were 15,965 papers searched, and 36 compassion-related measurement tools were identified in this study. None of the 36 studies provided possessed all nine psychometric properties, as outlined by the COSMIN criteria. On the basis of a systematic evaluation of quality, measurement qualities were ranked. The results for internal consistency and content validity were relatively favorable, whereas the results for structural validity were variable and the results for the remaining attributes were either uncertain or negative. A Venn diagram was used to illustrate the overlapping groups of compassion measurement tools based on the three-way flow of compassion. An overview of the reference instrument and theoretical basis for the included studies was provided, and half of them did not contain any theoretical or scale-based evidence.
CONCLUSION
In this study, 36 compassion-related measuring instruments were identified, and the methodological quality and measurement properties of the included studies were acceptable. The included measurements were consistent with flows of compassion. A further focus of further research should be on developing theories in the compassion domain and developing instruments for measuring compassion that are multidimensional, multi-populations, and culturally relevant.
Topics: Humans; Self Report; Empathy; Checklist; Psychometrics; Psychological Well-Being; Reproducibility of Results
PubMed: 37996796
DOI: 10.1186/s12889-023-17178-2 -
Nursing Open Jul 2023To revise the Supportive Care Needs Survey for Partners and Caregivers of Cancer Patients (SCNS-P&C) and evaluate the psychometric properties of the Chinese Version of... (Review)
Review
AIM
To revise the Supportive Care Needs Survey for Partners and Caregivers of Cancer Patients (SCNS-P&C) and evaluate the psychometric properties of the Chinese Version of the Supportive Care Needs Survey for Caregivers of Children with Paediatric Cancer (SCNS-C-Ped-C) in caregivers of children with paediatric cancer.
DESIGN
A cross sectional design was used.
METHODS
In this methodological research, the reliability and validity of the SCNS-C-Ped-C were measured by a questionnaire survey among 336 caregivers of children with paediatric cancer in China. The construct validity was evaluated by exploratory factor analysis and internal consistency was examined by Cronbach's alpha, split-half reliability, and corrected item-to-total correlation coefficients.
RESULTS
The exploratory factor analysis revealed six factors consist of: Healthcare and Informational Needs, Daily Care and Communication Needs, Psychological and Spiritual Needs, Medical Service Needs, Economic Needs, and Emotional Needs, explaining 65.615% of the variance. The Cronbach's alpha was 0.968 at full scale and 0.603-0.952 on the six domains. The split-half reliability coefficient was 0.883 at full scale and 0.659-0.931 on the six domains.
CONCLUSIONS
The SCNS-C-Ped-C demonstrated both reliability and validity. It can be used to evaluate multi-dimensional supportive care needs for caregivers of children with paediatric cancer in China.
Topics: Humans; Child; Psychometrics; Caregivers; Reproducibility of Results; Cross-Sectional Studies; Needs Assessment; Neoplasms
PubMed: 36894867
DOI: 10.1002/nop2.1703 -
Journal of Cancer Survivorship :... Dec 2023Breast lymphoedema is a possible side effect of breast conserving surgery, but it is poorly understood. This is due, in part, to difficulty assessing the breast. This... (Review)
Review
PURPOSE
Breast lymphoedema is a possible side effect of breast conserving surgery, but it is poorly understood. This is due, in part, to difficulty assessing the breast. This systematic review described outcome measures that quantify breast lymphoedema signs and symptoms and evaluated the measurement properties for these outcome measures.
METHOD
Seven databases were searched using terms in four categories: breast cancer, lymphoedema and oedema, clinician reported (ClinROM) and patient reported outcome measures (PROM) and psychometric and measurement properties. Two reviewers independently reviewed studies and completed quality assessments. The Consensus-based Standards for the Selection of Health Measurement Instruments (COSMIN) methodology was used for studies including measurement property evidence.
RESULTS
Fifty-six papers were included with thirteen questionnaires, eight patient-reported rating scales, seven physical measures, seven clinician-rating scales and four imaging techniques used to quantify breast lymphoedema. Based on COSMIN methodology, one ClinROM had sufficient reliability, ultrasound measuring dermal thickness. Tissue dielectric constant (TDC) measuring local tissue water had promising reliability. Four questionnaires had sufficient content validity (BLYSS, BLSQ, BrEQ and LYMQOL-Breast).
CONCLUSIONS
Ultrasound is recommended to reliably assess breast lymphoedema signs. No PROM can be recommended with confidence, but BLYSS, BLSQ, BrEQ and LYMQOL-Breast are promising. Further research is recommended to improve evidence of measurement properties for outcome measures.
IMPLICATIONS FOR CANCER SURVIVORS
There are many approaches to assess breast lymphoedema, but currently, only ultrasound can be recommended for use, with others, such as TDC and questionnaires, showing promise. Further research is required for all approaches to improve evidence of measurement properties.
Topics: Humans; Female; Breast Neoplasms; Reproducibility of Results; Patient Reported Outcome Measures; Cancer Survivors; Lymphedema; Psychometrics
PubMed: 36301407
DOI: 10.1007/s11764-022-01278-w -
Psychometrika Dec 2023Establishing the invariance property of an instrument (e.g., a questionnaire or test) is a key step for establishing its measurement validity. Measurement invariance is...
Establishing the invariance property of an instrument (e.g., a questionnaire or test) is a key step for establishing its measurement validity. Measurement invariance is typically assessed by differential item functioning (DIF) analysis, i.e., detecting DIF items whose response distribution depends not only on the latent trait measured by the instrument but also on the group membership. DIF analysis is confounded by the group difference in the latent trait distributions. Many DIF analyses require knowing several anchor items that are DIF-free in order to draw inferences on whether each of the rest is a DIF item, where the anchor items are used to identify the latent trait distributions. When no prior information on anchor items is available, or some anchor items are misspecified, item purification methods and regularized estimation methods can be used. The former iteratively purifies the anchor set by a stepwise model selection procedure, and the latter selects the DIF-free items by a LASSO-type regularization approach. Unfortunately, unlike the methods based on a correctly specified anchor set, these methods are not guaranteed to provide valid statistical inference (e.g., confidence intervals and p-values). In this paper, we propose a new method for DIF analysis under a multiple indicators and multiple causes (MIMIC) model for DIF. This method adopts a minimal [Formula: see text] norm condition for identifying the latent trait distributions. Without requiring prior knowledge about an anchor set, it can accurately estimate the DIF effects of individual items and further draw valid statistical inferences for quantifying the uncertainty. Specifically, the inference results allow us to control the type-I error for DIF detection, which may not be possible with item purification and regularized estimation methods. We conduct simulation studies to evaluate the performance of the proposed method and compare it with the anchor-set-based likelihood ratio test approach and the LASSO approach. The proposed method is applied to analysing the three personality scales of the Eysenck personality questionnaire-revised (EPQ-R).
Topics: Psychometrics; Surveys and Questionnaires; Likelihood Functions; Uncertainty
PubMed: 37550561
DOI: 10.1007/s11336-023-09930-9 -
Neuropsychopharmacology Reports Dec 2023Problems associated with alcohol use are multidimensional with psychiatric, psychological, physical, and social aspects, which makes it challenging to choose appropriate... (Review)
Review
BACKGROUND
Problems associated with alcohol use are multidimensional with psychiatric, psychological, physical, and social aspects, which makes it challenging to choose appropriate assessment scales. However, there has been no systematic evaluation of existing alcohol scales.
METHODS
A systematic literature search was conducted for articles that assessed the psychometric properties of scales for alcohol use disorder on March 19, 2023, using Medline, EMBASE, and PsycINFO. Only scales whose original development papers were cited more than 20 times were included. The methodological quality and psychometric properties of the scales were evaluated using COnsensus-based Standards for the selection of health Measurement INstruments. The overall rating of the scales were assessed with a score ranging from 0 to 18.
RESULTS
In total, 314 studies and 40 scales were identified. These scales differ widely in measurement methods, target populations, and psychometric properties. The overall mean score was 6.3, and only the following three scales received >9 points suggesting a moderate level of evidence: Alcohol Use Disorders Identification Test (AUDIT), Alcohol Dependence Scale (ADS), and Short Alcohol Dependence Data Questionnaire (SADD). Measurement error and responsiveness were not evaluated or reported in the included scales.
CONCLUSIONS
Although the AUDIT, ADS, and SADD were rated the highest among the 40 scales, they showed, at most, a moderate level of evidence. These findings underscore the need to accumulate further evidence to assure the quality of the scales. It may be advisable to select and combine scales to meet the purpose of the assessment.
Topics: Humans; Alcoholism; Surveys and Questionnaires; Ethanol; Alcohol Drinking; Psychometrics
PubMed: 37392159
DOI: 10.1002/npr2.12363 -
Age and Ageing Oct 2023ageism harms individuals' health and wellbeing and can be costly to societies. Reliable and valid measures that can quantify ageism are critical for achieving accurate... (Review)
Review
OBJECTIVES
ageism harms individuals' health and wellbeing and can be costly to societies. Reliable and valid measures that can quantify ageism are critical for achieving accurate data on its global prevalence, determinants and impacts, and to evaluate the effectiveness of interventions to reduce it. Ageism scales exist; however, none have been demonstrated to validly measure ageism in a manner consistent with consensus definitions of the concept (i.e. as manifested in all of stereotypes, prejudices and discrimination), whilst also quantifying ageism against all groups, from a target and perpetrator perspective, and across diverse country settings. Our objective was to develop an item pool to meet this need.
METHODS
we completed the conceptualisation, item generation and content validity assessment phases of a new World Health Organisation (WHO) WHO-ageism item pool that aims to measure the multi-dimensional nature of ageism. These phases drew on a review of available evidence, an experts' workshop and structured content validity reviews conducted by experts in scale development and ageism drawn from every world region defined by WHO.
RESULTS
our resulting item pool is designed to provide a multi-dimensional measure of ageism against all ages measured from both a perpetration and experienced perspective and that can produce valid and reliable scores within diverse country contexts and comparable scores across these contexts.
CONCLUSIONS
our item pool is the first major step in providing a global and comprehensive measure of ageism. Future phases of research will refine the item pool and establish the statistical psychometric properties of the final tool.
Topics: Humans; Ageism; Concept Formation; Consensus; Psychometrics; World Health Organization
PubMed: 37902522
DOI: 10.1093/ageing/afad105 -
Brain and Behavior Jul 2023Family members of patient in the intensive care unit (ICU) experience a set of problems which are entitled Family Intensive Care Units Syndrome (FICUS). (Review)
Review
BACKGROUND
Family members of patient in the intensive care unit (ICU) experience a set of problems which are entitled Family Intensive Care Units Syndrome (FICUS).
OBJECTIVES
The aim of this study was to develop and psychometrically evaluate the FICUS Inventory (FICUSI) in Iran.
METHODS
This sequential exploratory mixed method study was conducted in 2020 in two main phases. In the first phase, FICUSI was developed based on the results of an integrative review and a qualitative study. In the second phase, the psychometric properties of FICUSI, namely, face, content, and construct validity, reliability, responsiveness, interpretability, and scoring, were evaluated. The sample for the construct validity evaluation consisted of 283 ICU family members.
RESULTS
The primary item pool of FICUSI had 144 items and was reduced to 65 items or omitting overlapping and similar items. The scale-level content validity index of FICUSI was 0.89. In the construct validity evaluation through exploratory factor analysis, 31 items with factor loading values more than 0.3 were loaded on two factors (namely psychological symptoms and nonpsychological symptoms) which explained 68.45% of the total variance. The Cronbach's alpha and the test-retest intraclass correlation coefficient of FICUSI were 0.95 and 0.97, respectively.
CONCLUSION
FICUSI is a valid and reliable instrument which can be used in clinical settings and studies for FICUS assessment. Further studies for the cross-cultural adaptation of FICUSI in other contexts are recommended.
RELEVANCE TO CLINICAL PRACTICE
Health care providers in clinical settings can use FICUSI to assess FICUS among the family caregivers of patients in ICU. Health care providers' better understanding of FICUS helps them understand the quality of their own services for the family members of patients in ICU.
Topics: Humans; Psychometrics; Reproducibility of Results; Intensive Care Units; Caregivers; Family; Surveys and Questionnaires
PubMed: 37279159
DOI: 10.1002/brb3.3101