-
Medical Education Online Dec 2022This study intended to develop and assess the psychometric properties of a caring behavior scale on healthcare students and providers (CBS-HSP) in a Taiwanese... (Review)
Review
This study intended to develop and assess the psychometric properties of a caring behavior scale on healthcare students and providers (CBS-HSP) in a Taiwanese population. After a literature review was conducted and an expert panel was consulted for item generation, 104 items for the CBS-HSP scale were derived on a nine-point Likert scale, with 9 indicating 'extremely important' and 1 indicating 'extremely unimportant.' A pilot study was then conducted with seven hundred forty-eight healthcare students and providers in Taiwan for further data analysis. The statistic software used in the study was SPSS for the exploratory factor analysis (EFA) and AMOS for the confirmatory factor analysis (CFA). Also, to examine the psychometric properties of the scale, internal consistency, convergent validities, discriminant validities, and model fit indices were calculated in the study. The EFA results derived 31 items in four factors, with 65.742% of the total variance explained: 'support and attentiveness' (11 items; 48.714% of the variance explained), 'professional knowledge and skills' (8 items; 8.226% of the variance explained), 'gratifying needs and responsiveness' (7 items; 5.236% of the variance explained), and 'confidentiality and trust' (5 items; 3.566% of the variance explained). The Cronbach's alphas for the four subscales and the overall scale ranged from 0.894 to 0.964. The CFA results yielded the same 31 items, with the same four factors. The CFA results demonstrated good to excellent model fit in the χ2/df ratio (1.242), GFI (0.988), CFI (0.988), TFI (0.985), and RMSEA (0.031). The Cronbach's alphas ranged between 0.866 and 0.971; the composite alphas ranged between 0.854 and 0.964. The convergent and discriminant validities also proved the stability of the CBS-HSP scale. The research results indicated that the developed CBS-HSP appeared to be a reliable instrument to measure healthcare students' and providers' caring behaviors.
Topics: Delivery of Health Care; Factor Analysis, Statistical; Humans; Pilot Projects; Psychometrics; Reproducibility of Results; Students; Surveys and Questionnaires
PubMed: 35435142
DOI: 10.1080/10872981.2022.2066496 -
BMC Health Services Research Aug 2021The purpose of this study was to develop and administer surveys that assess patient and family caregiver experiences with care transitions and examine the psychometric... (Review)
Review
BACKGROUND
The purpose of this study was to develop and administer surveys that assess patient and family caregiver experiences with care transitions and examine the psychometric properties of the surveys. The surveys were designed to ask about 1) the transitional care services that matter most to patients and their caregivers and 2) care outcomes, including the overall quality of transitional care they received, patient self-reported health, and caregiver effort/stress.
METHODS
Survey items were developed based on a review of the literature, existing surveys, focus groups, site visits, stakeholder and expert input, and patient and caregiver cognitive interviews. We administered mail surveys with telephone follow up to patients recently discharged from 43 U.S. hospitals. Patients identified the caregivers who helped them during their hospital stay (Time 1 caregiver) and when they were home (Time 2 caregiver). Time 1 and Time 2 caregivers were surveyed by telephone only. The psychometric properties of the survey items and outcome composite measures were examined for each of the three surveys. Items that performed poorly across multiple analyses, including those with low variability and/or a high missing data, were dropped except when they were conceptually important.
RESULTS
The analysis datasets included responses from 9282 patients, 1245 Time 1 caregivers and 1749 Time 2 caregivers. The construct validity of the three proposed outcome composite measures-Overall Quality of Transitional Care (patient and caregiver surveys), Patient Overall Health (patient survey) and Caregiver Effort/Stress (caregiver surveys) -was supported by acceptable exploratory factor analysis results and acceptable internal consistency reliability. Site-level reliability was acceptable for the two patient outcome composite measures, but was low for Caregiver Effort/Stress (< 0.70). In all surveys, the Overall Quality of Transitional Care outcome composite measure was significantly correlated with other outcome composite measures and most of the single-item measures.
CONCLUSIONS
Overall, the final patient and caregiver surveys are psychometrically sound and can be used by health systems, hospitals, and researchers to assess the quality of care transitions and related outcomes. Results from these surveys can be used to improve care transitions, focusing on what matters most to patients and their family caregivers.
Topics: Caregivers; Humans; Patient Transfer; Psychometrics; Reproducibility of Results; Surveys and Questionnaires
PubMed: 34372847
DOI: 10.1186/s12913-021-06766-w -
Brain and Behavior Jul 2023Family members of patient in the intensive care unit (ICU) experience a set of problems which are entitled Family Intensive Care Units Syndrome (FICUS). (Review)
Review
BACKGROUND
Family members of patient in the intensive care unit (ICU) experience a set of problems which are entitled Family Intensive Care Units Syndrome (FICUS).
OBJECTIVES
The aim of this study was to develop and psychometrically evaluate the FICUS Inventory (FICUSI) in Iran.
METHODS
This sequential exploratory mixed method study was conducted in 2020 in two main phases. In the first phase, FICUSI was developed based on the results of an integrative review and a qualitative study. In the second phase, the psychometric properties of FICUSI, namely, face, content, and construct validity, reliability, responsiveness, interpretability, and scoring, were evaluated. The sample for the construct validity evaluation consisted of 283 ICU family members.
RESULTS
The primary item pool of FICUSI had 144 items and was reduced to 65 items or omitting overlapping and similar items. The scale-level content validity index of FICUSI was 0.89. In the construct validity evaluation through exploratory factor analysis, 31 items with factor loading values more than 0.3 were loaded on two factors (namely psychological symptoms and nonpsychological symptoms) which explained 68.45% of the total variance. The Cronbach's alpha and the test-retest intraclass correlation coefficient of FICUSI were 0.95 and 0.97, respectively.
CONCLUSION
FICUSI is a valid and reliable instrument which can be used in clinical settings and studies for FICUS assessment. Further studies for the cross-cultural adaptation of FICUSI in other contexts are recommended.
RELEVANCE TO CLINICAL PRACTICE
Health care providers in clinical settings can use FICUSI to assess FICUS among the family caregivers of patients in ICU. Health care providers' better understanding of FICUS helps them understand the quality of their own services for the family members of patients in ICU.
Topics: Humans; Psychometrics; Reproducibility of Results; Intensive Care Units; Caregivers; Family; Surveys and Questionnaires
PubMed: 37279159
DOI: 10.1002/brb3.3101 -
Nursing Open May 2022Student's uncivil behaviour is one of the most common problems in the educational setting, including nursing schools. It is essential to develop tools for measuring the...
AIM
Student's uncivil behaviour is one of the most common problems in the educational setting, including nursing schools. It is essential to develop tools for measuring the uncivil behaviour of nursing students to solve this problem. Therefore, this study aimed to evaluate psychometric properties of perceived nursing student's incivility questionnaire among the Iranian community.
DESIGN
In this methodological study, perceived nursing student's incivility questionnaire was completed by 360 nursing students and 121 nursing faculty members.
METHODS
Sampling was done from October 2019-November 2019. Content and construct validity of the questionnaire were evaluated. Reliability was estimated using Cronbach's alpha and McDonald's omega coefficients and composite reliability. The construct validity of nursing student's perceived incivility was investigated by exploratory and confirmatory factor analyses.
RESULTS
Content validity index 0.88 for the whole instrument. The three factors of violent behaviours, irresponsible behaviours and unsound behaviours explained more than 51.485% of the variance. Factor structure extracted using model fit indices (PCFI = 0.763, PNFI = 0.732, CMIN/DF = 2.501, RMSEA = 0.056, GFI = 0.941, AGFI = 0.918, CFI = 0.935) and convergent validity were also confirmed. Internal consistency and composite reliability were estimated to be more than 0.7. The results showed that Iranian perceived nursing student's incivility questionnaire is a three-dimensional construct with good validity and reliability.
Topics: Humans; Incivility; Iran; Psychometrics; Reproducibility of Results; Students, Nursing; Surveys and Questionnaires
PubMed: 35189043
DOI: 10.1002/nop2.1195 -
Annals of Physical and Rehabilitation... May 2023Postural control deficits are one of the most common impairments treated in pediatric physiotherapeutic practice. Adequate evaluation of these deficits is imperative to... (Review)
Review
BACKGROUND
Postural control deficits are one of the most common impairments treated in pediatric physiotherapeutic practice. Adequate evaluation of these deficits is imperative to identify postural control deficits, plan treatment and assess efficacy. Currently, there is no gold standard evaluation for postural control deficits. However, the number of studies investigating the psychometric properties of functional pediatric postural control tests has increased significantly.
OBJECTIVE
To facilitate the selection of an appropriate pediatric functional postural control test in research and clinical practice.
METHODS
Systematic review following the PRISMA guidelines. PubMed, Web of Science and Scopus were systematically searched (last update: June 2022; PROSPERO: CRD42021246995). Studies were selected using the PICOs-method (pediatric populations (P), functional assessment tools for postural control (I) and psychometric properties (O). The risk of bias was rated with the COSMIN checklist and the level of evidence was determined with GRADE. For each test, the postural control systems were mapped, and the psychometric properties were extracted.
RESULTS
Seventy studies investigating 26 different postural control tests were included. Most children were healthy or had cerebral palsy. Overall, the evidence for all measurement properties was low to very low. Most tests (95%) showed good reliability (ICC>0.70), but inconsistent validity results. Structural validity, internal consistency and responsiveness were only available for 3 tests. Only the Kids-BESTest and FAB covered all postural control systems.
CONCLUSION
Currently, 2 functional tests encompass the entire construct of postural control. Although reliability is overall good, validity results depend on task, age and pathology. Future research should focus on test batteries and should particularly explore structural validity and responsiveness in different populations with methodologically strong study designs.
Topics: Humans; Child; Psychometrics; Reproducibility of Results; Postural Balance; Research Design; Cerebral Palsy
PubMed: 36669385
DOI: 10.1016/j.rehab.2022.101729 -
Nursing Open Nov 2022To investigate the necessity of an item reduction and to evaluate estimates of dimensionality, reliability and validity of the Health and Suffering Scale among two...
AIM
To investigate the necessity of an item reduction and to evaluate estimates of dimensionality, reliability and validity of the Health and Suffering Scale among two groups of women, one undergoing rehabilitation for exhaustion and long-lasting pain and one reference group.
DESIGN
Psychometric evaluation of the scale using cross-sectional data.
METHOD
The Health and Suffering Scale is a self-report scale which measures perceived suffering in relation to health on a semantic visual analogue scale. Classical and modern test theory were applied for item reduction and to explore estimates of reliability and validity.
RESULTS
The Health and Suffering Scale was found to be unidimensional, nine of originally twenty items were part of a consistent factor structure and hierarchical order. These items were internally consistent, discriminated between patients and healthy respondents, and had an excellent level of separation of individuals experiencing various levels of health and suffering. Re-test reliability estimates were moderate.
Topics: Humans; Female; Reproducibility of Results; Cross-Sectional Studies; Psychometrics; Chronic Pain; Pain Measurement
PubMed: 34216090
DOI: 10.1002/nop2.980 -
European Journal of Psychotraumatology 2022There is no therapeutic competence and adherence scale for grief-focused cognitive behavioural therapy (grief-focused CBT). However, given the growing body of evidence... (Randomized Controlled Trial)
Randomized Controlled Trial
BACKGROUND
There is no therapeutic competence and adherence scale for grief-focused cognitive behavioural therapy (grief-focused CBT). However, given the growing body of evidence for the efficacy of grief-focused CBT, such a scale is needed both to ensure the internal validity of clinical trials and to facilitate psychotherapy process research.
OBJECTIVE
To develop and undertake a psychometric evaluation of a therapeutic adherence and competence scale for grief-focused CBT.
METHOD
The scale was developed in two steps. (I) Five experts on the treatment of prolonged grief disorder provided feedback on the relevance and appropriateness of the items. The scale was revised to reflect their feedback. The final therapeutic adherence and competence scale for grief (TACs-G) consisted of 15 adherence and 16 competence items. (II) Psychometric evaluation of the TACs-G was based on the rating of 48 randomly selected PG-CBT sessions by two independent raters. The videos were recorded in the context of a randomized controlled trial (RCT; DRKS00012317.) ICC was used to calculate inter-rater reliability and TACs-G stability over time (re-evaluation of 10 sessions after 12 months).
RESULTS
The five experts confirmed the relevance and appropriateness of the items. Interrater reliability was found to be high for the total adherence and competence scores (ICC = 0.889 and 0.782, respectively) and moderate to excellent for individual items (ICC = 0.509-1.00). The TACs-G stability over time was found to be strong for both adherence (ICC = 0.970) and competence total scores (ICC = 0.965).
CONCLUSIONS
The TACs-G for CBT is a reliable instrument that can be used not only to ensure internal validity but is also suited for psychotherapy process studies. Additionally, it provides a valuable database for targeted feedback in training settings.
HIGHLIGHTS
This is the first study to report on the development and psychometrical evaluation of a grief-focused adherence and competence scale.Although an increasing number of clinical trials do report the efficacy of grief-focused cognitive-behavioural therapy, none of these studies used a standardized adherence and competence scale to control internal validity.In the present study, we introduced a therapeutic adherence and competence scale for grief (TACs-G) that can be applied efficiently across different research settings (e.g. manipulation check, dissemination), and report results of good to excellent psychometric properties.The scale itself could prove useful beyond the research setting as it could possibly serve as a basis for feedback in training settings.
Topics: Cognitive Behavioral Therapy; Grief; Psychometrics; Reproducibility of Results; Treatment Adherence and Compliance
PubMed: 35759325
DOI: 10.1080/20008198.2022.2079873 -
Psychiatry Research Oct 2020Psychopathology research has increasingly sought to study the etiology and treatment of individual symptoms, rather than categorical diagnoses. However, it is unclear...
Psychopathology research has increasingly sought to study the etiology and treatment of individual symptoms, rather than categorical diagnoses. However, it is unclear whether commonly used measures have adequate psychometric properties for assessing individual symptoms. This study examined the test-retest reliability and familial concordance (an indicator of validity) of the symptoms of Major Depressive Disorder (MDD), a disorder consisting of nine core symptoms, most of which are aggregated (e.g., symptom 7 of the DSM criteria for MDD is worthlessness or guilt). Lifetime MDD symptoms were measured in 504 young adults (237 sibling pairs) using the Structured Clinical Interview for DSM-5 (SCID). Fifty-one people completed a second SCID within three weeks of their first SCID. Results indicated that aggregated and unaggregated symptoms demonstrated moderate to substantial test-retest reliability and generally significant, but slight to fair familial concordance (with the highest familial concordance being for markedly diminished interest or pleasure and its unaggregated components - decreased interest and decreased pleasure). Given the increasing focus on the differential validity of individual MDD symptoms, the present study suggests that interview-based assessments of depression can assess most individual symptoms with adequate levels of reliability and validity.
Topics: Adolescent; Adult; Depressive Disorder, Major; Diagnostic and Statistical Manual of Mental Disorders; Female; Humans; Interview, Psychological; Male; Psychometrics; Reproducibility of Results; Young Adult
PubMed: 32738552
DOI: 10.1016/j.psychres.2020.113313 -
Health & Social Care in the Community Nov 2022There has been increasing interest and research attention towards citizenship-based practices and care within health and social care settings. A framework for...
There has been increasing interest and research attention towards citizenship-based practices and care within health and social care settings. A framework for implementing citizenship-based interventions has helped support the participation in society of persons who have experienced major life disruptions. Yet, having ways to measure the impact of citizenship 'in action' within specific socio-cultural contexts has proved challenging. We report on the development of the Strathclyde Citizenship Measure (SCM) which seeks to establish a psychometrically sound measure of citizenship that is relevant to the Scottish context. We outline the three phases of developing the SCM: (1) item generation, (2) item reduction and piloting, and (3) measure validation. Having generated items for the SCM using concept mapping techniques, we piloted it with 407 participants who completed an online survey of a 60-item version of the SCM. The aims were to assess the validity of the items and reduce the number of items using principal components analysis for the final measure. This resulted in a 39 item SCM. We then sought to establish the psychometric properties of this shorter version of the SCM through testing its reliability, convergent, concurrent and discriminant validity. The 39 item SCM was administered online to 280 Scottish residents along with additional measures including the Warwick-Edinburgh Mental Well-being Scale (WEMWBS), the Depression, Anxiety and Stress Scale (DASS21), the Sense of Belonging Instrument (SOBI-A); the Big Five Personality Inventory (Shortened Version; BFI-10) and the Personal Social Capital Scale (PSCS-16). The factor structure and dimensionality of the SCM was examined using exploratory factor analysis and it was found to be reliable and valid. This paper explores the potential for the application of the SCM across health and social care settings and identifies future work to develop citizenship tools to facilitate dialogues about citizenship across health and social care practice settings.
Topics: Humans; Psychometrics; Reproducibility of Results; Citizenship; Surveys and Questionnaires; Social Support
PubMed: 35344232
DOI: 10.1111/hsc.13789 -
Journal of Patient-reported Outcomes Mar 2023The EuroQol Group has developed an extended version of the EQ-5D-Y-3L with five response levels for each of its five dimensions (EQ-5D-Y-5L). The psychometric...
OBJECTIVES
The EuroQol Group has developed an extended version of the EQ-5D-Y-3L with five response levels for each of its five dimensions (EQ-5D-Y-5L). The psychometric performance has been reported in several studies for the EQ-5D-Y-3L but not for the EQ-5D-Y-5L. This study aimed to psychometrically evaluate the EQ-5D-Y-3L and EQ-5D-Y-5L Chichewa (Malawi) versions.
METHODS
The EQ-5D-Y-3L, EQ-5D-Y-5L and PedsQL™ 4.0 Chichewa versions were administered to children and adolescents aged 8-17 years in Blantyre, Malawi. Both of the EQ-5D-Y versions were evaluated for missing data, floor/ceiling effects, and validity (convergent, discriminant, known-group and empirical).
RESULTS
A total of 289 participants (95 healthy, and 194 chronic and acute) self-completed the questionnaires. There was little problem with missing data (< 5%) except in children aged 8-12 years particularly for the EQ-5D-Y-5L. Ceiling effects was generally reduced in moving from the EQ-5D-Y-3L to the EQ-5D-Y-5L. For both EQ-5D-Y-3L and EQ-5D-Y-5L, convergent validity tested with PedsQL™ 4.0 was found to be satisfactory (correlation ≥ 0.4) at scale level but mixed at dimension /sub-scale level. There was evidence of discriminant validity (p > 0.05) with respect to gender and age, but not for school grade (p < 0.05). For empirical validity, the EQ-5D-Y-5L was 31-91% less efficient than the EQ-5D-Y-3L at detecting differences in health status using external measures.
CONCLUSIONS
Both versions of the EQ-5D-Y-3L and EQ-5D-Y-5L had issues with missing data in younger children. Convergent validity, discriminant validity with respect to gender and age, and known-group validity of either measures were also met for use among children and adolescents in this population, although with some limitations (discriminant validity by grade and empirical validity). The EQ-5D-Y-3L seems particularly suited for use in younger children (8-12 years) and the EQ-5D-Y-5L in adolescents (13-17 years). However, further psychometric testing is required for test re-test reliability and responsiveness that could not be carried out in this study due to COVID-19 restrictions.
Topics: Humans; Adolescent; Child; Quality of Life; Psychometrics; Malawi; Reproducibility of Results; COVID-19; Health Status
PubMed: 36892714
DOI: 10.1186/s41687-023-00560-4