-
The International Journal of Behavioral... Oct 2021Physical literacy (PL) in childhood is essential for a healthy active lifestyle, with teachers playing a critical role in guiding its development. Teachers can assist... (Review)
Review
BACKGROUND
Physical literacy (PL) in childhood is essential for a healthy active lifestyle, with teachers playing a critical role in guiding its development. Teachers can assist children to acquire the skills, confidence, and creativity required to perform diverse movements and physical activities. However, to detect and directly intervene on the aspects of children's PL that are suboptimal, teachers require valid and reliable measures. This systematic review critically evaluates the psychometric properties of teacher proxy-report instruments for assessing one or more of the 30 elements within the four domains (physical, psychological, cognitive, social) of the Australian Physical Literacy Framework (APLF), in children aged 5-12 years. Secondary aims were to: examine alignment of each measure (and relevant items) with the APLF and provide recommendations for teachers in assessing PL.
METHODS
Seven electronic databases (Academic Search Complete, CINAHL Complete, Education Source, Global Health, MEDLINE Complete, PsycINFO, and SPORTDiscus) were systematically searched originally in October 2019, with an updated search in April 2021. Eligible studies were peer-reviewed English language publications that sampled a population of children with mean age between 5 and 12 years and focused on developing and evaluating at least one psychometric property of a teacher proxy-report instrument for assessing one or more of the 30 APLF elements. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidance was followed for the conduct and reporting of this review. The methodological quality of included studies and quality of psychometric properties of identified tools were evaluated using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) guidance. Alignment of each measure (and relevant items) with the APLF domains and 30 elements was appraised.
RESULTS
Database searches generated 61,412 citations; reduced to 41 studies that evaluated the psychometric properties of 24 teacher proxy-report tools. Six tools were classified as single domain measures (i.e. assessing a single domain of the APLF), eleven as dual-domain measures, and seven as tri-domain measures. No single tool captured all four domains and 30 elements of the APLF. Tools contained items that aligned with all physical, psychological, and social elements; however, four cognitive elements were not addressed by any measure. No tool was assessed for all nine psychometric properties outlined by COSMIN. Included studies reported a median of 3 out of nine psychometric properties. Most reported psychometric properties were construct validity (n = 32; 78% of studies), structural validity (n = 26; 63% of studies), and internal consistency (n = 25; 61% of studies). There was underreporting of content validity, cross-cultural validity, measurement error, and responsiveness. Psychometric data across tools were mostly indeterminate for construct validity, structural validity, and internal consistency.
CONCLUSIONS
There is limited evidence to fully support the use of a specific teacher proxy-report tool in practice. Further psychometric testing and detailed reporting of methodological aspects in future validity and reliability studies is needed. Tools have been designed to assess some elements of the framework. However, no comprehensive teacher proxy-report tool exists to assess all 30 elements of the APLF, demonstrating the need for a new tool. It is our recommendation that such tools be developed and psychometrically tested.
TRIAL REGISTRATION
This systematic review was registered in the PROSPERO international prospective register of systematic reviews, with registration number CRD42019130936 .
Topics: Australia; Child; Child, Preschool; Consensus; Humans; Literacy; Psychometrics; Reproducibility of Results
PubMed: 34620185
DOI: 10.1186/s12966-021-01162-3 -
American Journal on Intellectual and... May 2024Measurement invariance (MI) is a psychometric property of an instrument indicating the degree to which scores from an instrument are comparable across groups. In recent... (Review)
Review
Measurement invariance (MI) is a psychometric property of an instrument indicating the degree to which scores from an instrument are comparable across groups. In recent years, there has been a marked uptick in publications using MI in intellectual and developmental disability (IDD) samples. Our goal here is to provide an overview of why MI is important to IDD researchers and to describe some challenges to evaluating it, with an eye towards nudging our subfield into a more thoughtful and measured interpretation of studies using MI.
Topics: Humans; Intellectual Disability; Developmental Disabilities; Psychometrics; Biomedical Research
PubMed: 38657963
DOI: 10.1352/1944-7558-129.3.191 -
PloS One 2023Research and clinical interest in self-compassion has grown due to its associations with physical and mental health benefits. Widely used measures of self-compassion...
Research and clinical interest in self-compassion has grown due to its associations with physical and mental health benefits. Widely used measures of self-compassion have conceptual and psychometric limitations that warrant attention. The purpose of this project was to develop a new self-compassion measure, the Brief Self-Compassion Inventory (BSCI), and test its psychometric properties. We developed items for the BSCI based on theory, prior research, and expert and cancer patient feedback. The BSCI was then tested with adults diagnosed with breast, gastrointestinal, lung, or prostate cancer (N = 404). Confirmatory factor analysis suggested a unidimensional structure, and internal consistency reliability was excellent. Construct validity of the BSCI was established through its correlations with psychological variables hypothesized to be related to self-compassion, such as mindfulness, acceptance of cancer, and other coping strategies. Furthermore, measurement invariance testing of the BSCI indicated that it could be used across patients of varying genders, cancer types, and stages of illness. In conclusion, the 5-item BSCI was determined to be psychometrically sound and suitable for use with adults of varying genders, cancer types, and stages of disease. The measure warrants testing with other medical and nonclinical populations.
Topics: Adult; Humans; Male; Self-Compassion; Reproducibility of Results; Psychometrics; Prostatic Neoplasms; Adaptation, Psychological; Surveys and Questionnaires
PubMed: 37172068
DOI: 10.1371/journal.pone.0285658 -
American Journal of Pharmaceutical... Jun 2022This study aimed to provide further validity evidence for the Kiersma-Chen Empathy Scale (KCES) by analyzing data collected from multiple administrations of the scale...
This study aimed to provide further validity evidence for the Kiersma-Chen Empathy Scale (KCES) by analyzing data collected from multiple administrations of the scale and conducting cognitive interviews of students in pharmacy and nursing programs to identify needed revisions. De-identified data from previous administrations of the KCES were used to evaluate the scale. Evidence of response process was enhanced through cognitive interviews with 20 pre-pharmacy and pharmacy students at Cedarville University. After survey revisions, the cognitive interview process was repeated with 10 University of Wyoming nursing students. Based on psychometric data and cognitive interviews, the KCES was revised as follows: key components of cognitive and affective empathy were retained, scaling was changed to reflect necessity and empathy ability, negatively worded items were removed, and the single scale was converted into two parallel subscales. This study used data from thousands of geographically and professionally diverse samples. Based on potential problems identified in quantitative analyses, cognitive interviews with nursing and pharmacy students were conducted, and modifications to the KCES were made. Further psychometric validation is needed regarding the KCES-R.
Topics: Education, Pharmacy; Empathy; Humans; Psychometrics; Students, Nursing; Students, Pharmacy; Surveys and Questionnaires
PubMed: 34507957
DOI: 10.5688/ajpe8685 -
Psychometrika Mar 2021In this article, we present the findings of an oral history project on the past, present, and future of psychometrics, as obtained through structured interviews with...
In this article, we present the findings of an oral history project on the past, present, and future of psychometrics, as obtained through structured interviews with twenty past Psychometric Society presidents. Perspectives on how psychometrics should be practiced vary strongly. Some presidents are psychology-oriented, whereas others have a more mathematical or statistical approach. The originally strong relationship between psychometrics and psychology has weakened, and contemporary psychometrics has become a diverse and multifaceted discipline. The presidents are confident psychometrics will continue to be relevant but believe psychometrics needs to become better at selling its strong points to relevant research areas. We recommend for psychometrics to cherish its plurality and make its goals and priorities explicit.
Topics: Psychometrics
PubMed: 33770319
DOI: 10.1007/s11336-021-09752-7 -
The Journal of Rural Health : Official... Jun 2022To develop and psychometrically evaluate a brief measure of the telemental health experience among people receiving psychiatric and psychological care-the Telepsych User...
PURPOSE
To develop and psychometrically evaluate a brief measure of the telemental health experience among people receiving psychiatric and psychological care-the Telepsych User Experience Scale (TUES).
METHODS
The TUES was administered at 6 months to 364 study participants who screened positive for posttraumatic stress disorder and/or bipolar disorder and used telepsych services. The factor structure of the TUES was examined using exploratory and confirmatory factor analyses. Psychometric testing of the final scale examined (1) internal reliability, (2) criterion validity, (3) convergent validity, and (4) test-retest reliability using omega coefficients, negative binomial regression, and correlations, respectively. A week after the 12-month follow-up survey was completed, a retest was administered to 29 patients to assess reliability.
FINDINGS
Factor analytic methods indicated a single latent factor (user experience) and correlated error variance (method effect of item wording) for 2 items. To enhance clinical utility, we removed the 2 negatively worded items, resulting in a 5-item scale. Confirmatory analyses indicated excellent fit of the final model, which retained the best performing items from each hypothesized construct. The TUES demonstrated evidence of internal consistency (omega = 0.88-0.90), convergent validity, (r = 0.58), and criterion validity through telepsych engagement (incidence rate ratio = 1.19, P < .001), though test-retest reliability was unacceptable (r = 0.41).
CONCLUSION
The TUES is a pragmatic instrument with evidence of validity and internal reliability. Replication is necessary, but this initial psychometric evaluation suggests the TUES is a promising, brief yet comprehensive measure of telemental health user experience with clinical populations in rural settings.
Topics: Factor Analysis, Statistical; Humans; Psychometrics; Reproducibility of Results; Rural Population; Surveys and Questionnaires
PubMed: 34957607
DOI: 10.1111/jrh.12640 -
Psychological Trauma : Theory,... Sep 2023Despite many strengths of trauma-informed care (TIC), critics argue TIC is necessary but alone insufficient, can be deficit focused, lacks construct operationalization,...
OBJECTIVE
Despite many strengths of trauma-informed care (TIC), critics argue TIC is necessary but alone insufficient, can be deficit focused, lacks construct operationalization, and requires greater inclusion of resilience theory. We sought to address these critiques by creating an assessment tool through an iterative and community-engaged process.
METHOD
We collected cross-sectional data between May and June 2019 with a convenience sample from 12 sites across the United States ( = 861). Data were analyzed through application of classical test theory and item response theory, using principal components analysis.
RESULTS
The final 40-item Organizational Trauma Resilience Assessment (OTRA) is sufficiently unidimensional and has a five-factor solution with strong validity and reliability.
CONCLUSION
We believe this instrument marks the first of its kind to synthesize tenets of organizational resilience with TIC principles. Creation of the OTRA progresses the TIC knowledge base and is a cost-effective and valid method for evaluating organizational culture of trauma resilience. (PsycInfo Database Record (c) 2023 APA, all rights reserved).
Topics: Humans; Resilience, Psychological; Psychometrics; Cross-Sectional Studies; Female; Adult; Male; Reproducibility of Results; Middle Aged; Psychological Trauma; United States; Organizational Culture
PubMed: 34928688
DOI: 10.1037/tra0001184 -
Implementation Science : IS Dec 2022Sustainability is concerned with the long-term delivery and subsequent benefits of evidence-based interventions. To further this field, we require a strong understanding... (Review)
Review
BACKGROUND
Sustainability is concerned with the long-term delivery and subsequent benefits of evidence-based interventions. To further this field, we require a strong understanding and thus measurement of sustainability and what impacts sustainability (i.e., sustainability determinants). This systematic review aimed to evaluate the quality and empirical application of measures of sustainability and sustainability determinants for use in clinical, public health, and community settings.
METHODS
Seven electronic databases, reference lists of relevant reviews, online repositories of implementation measures, and the grey literature were searched. Publications were included if they reported on the development, psychometric evaluation, or empirical use of a multi-item, quantitative measure of sustainability, or sustainability determinants. Eligibility was not restricted by language or date. Eligibility screening and data extraction were conducted independently by two members of the research team. Content coverage of each measure was assessed by mapping measure items to relevant constructs of sustainability and sustainability determinants. The pragmatic and psychometric properties of included measures was assessed using the Psychometric and Pragmatic Evidence Rating Scale (PAPERS). The empirical use of each measure was descriptively analyzed.
RESULTS
A total of 32,782 articles were screened from the database search, of which 37 were eligible. An additional 186 publications were identified from the grey literature search. The 223 included articles represented 28 individual measures, of which two assessed sustainability as an outcome, 25 covered sustainability determinants and one explicitly assessed both. The psychometric and pragmatic quality was variable, with PAPERS scores ranging from 14 to 35, out of a possible 56 points. The Provider Report of Sustainment Scale had the highest PAPERS score and measured sustainability as an outcome. The School-wide Universal Behaviour Sustainability Index-School Teams had the highest PAPERS score (score=29) of the measure of sustainability determinants.
CONCLUSIONS
This review can be used to guide selection of the most psychometrically robust, pragmatic, and relevant measure of sustainability and sustainability determinants. It also highlights that future research is needed to improve the psychometric and pragmatic quality of current measures in this field.
TRIAL REGISTRATION
This review was prospectively registered with Research Registry (reviewregistry1097), March 2021.
Topics: Humans; Public Health; Psychometrics
PubMed: 36514059
DOI: 10.1186/s13012-022-01252-1 -
Nursing Open Oct 2023This study aimed to develop the nurses' Work Values Scale (WVS) to determine how important certain values are for nurses and to psychometrically test the scale.
AIM
This study aimed to develop the nurses' Work Values Scale (WVS) to determine how important certain values are for nurses and to psychometrically test the scale.
DESIGN
Instrument development and validation study.
METHOD
A two-phase scale development process comprising item generation, scale improvement and psychometric property evaluation was used. In the first phase, scale items were identified. In the second phase, item and exploratory factor analyses were performed in Study 1, and confirmatory factor analysis, validity verification and reliability verification of the nurses' WVS were performed in Study 2.
RESULTS
As a result of the analysis, a scale of 30 items with four subdomains was developed. In convergent validity and reliability verification, it was shown that the nurses' WVS has acceptable validity and reliability.
NO PATIENT OR PUBLIC CONTRIBUTION
Patients or members of the public were not involved in this study.
Topics: Humans; Psychometrics; Reproducibility of Results; Factor Analysis, Statistical; Nurses
PubMed: 37518936
DOI: 10.1002/nop2.1950 -
PloS One 2022There is no specific tool for measuring the professional resilience of emergency nurses. Therefore, the present study aimed to design and psychometrically evaluate a new...
BACKGROUND
There is no specific tool for measuring the professional resilience of emergency nurses. Therefore, the present study aimed to design and psychometrically evaluate a new tool named the emergency nurses' professional resilience tool.
METHOD
This mixed-method sequential exploratory study was conducted in two phases: (1) item generation using literature review and evaluation of the results of a qualitative study and (2) psychometric evaluation of the developed scale. The face, content, and construct validity (exploratory and confirmatory factor analysis), reliability (internal consistency, relative, and absolute), and accountability were assessed in the population of Iranian nurses (N = 465) during March 2019-June 2020.
RESULTS
The tool designed for assessing the professional resilience of Iranian nurses included 37 items. The average scale content validity index (S-CVI/Ave) was equal to 0.94. The exploratory factor analysis revealed five factors, including professional competencies, emotional-cognitive characteristics, external support, in addition to behavioral and cognitive strategies, and explained 75.59% of the whole variance. Cronbach's alpha and intraclass correlation were 0.915 and 0.888, respectively. Construct validity for five factors was established with acceptable model fit indices [Chi-square/df = 1336.56/619, p < .001]; [Comparative Fit Index [CFI] = 0.96]; [Non-Normed Fit Index [NNFI] = 0.96]; [Root Mean Square Error of Approximation (RMSEA) = 0.074 and 90 Percent Confidence Interval = (0.069; 0.080)]; and [SRMR = 0.095].
CONCLUSIONS
According to the findings of the current study, the emergency nurses' professional resilience tool can be used by healthcare managers as a valid and reliable scale to evaluate the professional resilience of nurses to designate them as nurses working in emergency and disaster situations.
Topics: Humans; Iran; Nurses; Psychometrics; Reproducibility of Results; Surveys and Questionnaires
PubMed: 35671289
DOI: 10.1371/journal.pone.0269539