-
Multivariate Behavioral Research 2022Cumulative sum (CUSUM) and change-point analysis (CPA) are two well-established statistical process control methods to detect changes in a sequence. Both have been used... (Review)
Review
Cumulative sum (CUSUM) and change-point analysis (CPA) are two well-established statistical process control methods to detect changes in a sequence. Both have been used in psychometric research to detect aberrant responses in a response sequence, e.g., test speededness, inattentiveness, or cheating. However, the pros and cons of CUSUM and CPA in different testing settings still remain unclear. In this paper, we conduct a comprehensive comparison of the performance of twelve CUSUM-based statistics and three CPA-based procedures in detecting test speededness. Two speededness mechanisms are considered, namely the graduate change model (GCM) and the hybrid model (HM), to test the robustness and flexibility of the two methods. Simulation studies show that the performances of the statistics are affected by the underlying data generating model, the severity of speededness, and the test length. Generally, under HM some CUSUM statistics perform much better than the CPA-based statistics. Under the GCM, the performance of the CPA statistics is dramatically improved. Taken together, due to the unknown mechanism of speededness in real applications, two CUSUM-based statistics are recommended when the test length is long (e.g., 80 items), regardless of the underlying mechanism being HM or GCM. In a relatively short (e.g., 40 items) or medium-length (e.g., 60 items) test, no statistic always ends up in the top three under both HM and GCM. In those cases, either one of the two CUSUM-based statistics mentioned above can be a reasonable choice because of their good (though not necessarily the best) performance in a wide range of conditions.
Topics: Computer Simulation; Psychometrics
PubMed: 32877253
DOI: 10.1080/00273171.2020.1809981 -
Nursing Open Oct 2023This study aimed to develop the nurses' Work Values Scale (WVS) to determine how important certain values are for nurses and to psychometrically test the scale.
AIM
This study aimed to develop the nurses' Work Values Scale (WVS) to determine how important certain values are for nurses and to psychometrically test the scale.
DESIGN
Instrument development and validation study.
METHOD
A two-phase scale development process comprising item generation, scale improvement and psychometric property evaluation was used. In the first phase, scale items were identified. In the second phase, item and exploratory factor analyses were performed in Study 1, and confirmatory factor analysis, validity verification and reliability verification of the nurses' WVS were performed in Study 2.
RESULTS
As a result of the analysis, a scale of 30 items with four subdomains was developed. In convergent validity and reliability verification, it was shown that the nurses' WVS has acceptable validity and reliability.
NO PATIENT OR PUBLIC CONTRIBUTION
Patients or members of the public were not involved in this study.
Topics: Humans; Psychometrics; Reproducibility of Results; Factor Analysis, Statistical; Nurses
PubMed: 37518936
DOI: 10.1002/nop2.1950 -
The Journal of Rural Health : Official... Jun 2022To develop and psychometrically evaluate a brief measure of the telemental health experience among people receiving psychiatric and psychological care-the Telepsych User...
PURPOSE
To develop and psychometrically evaluate a brief measure of the telemental health experience among people receiving psychiatric and psychological care-the Telepsych User Experience Scale (TUES).
METHODS
The TUES was administered at 6 months to 364 study participants who screened positive for posttraumatic stress disorder and/or bipolar disorder and used telepsych services. The factor structure of the TUES was examined using exploratory and confirmatory factor analyses. Psychometric testing of the final scale examined (1) internal reliability, (2) criterion validity, (3) convergent validity, and (4) test-retest reliability using omega coefficients, negative binomial regression, and correlations, respectively. A week after the 12-month follow-up survey was completed, a retest was administered to 29 patients to assess reliability.
FINDINGS
Factor analytic methods indicated a single latent factor (user experience) and correlated error variance (method effect of item wording) for 2 items. To enhance clinical utility, we removed the 2 negatively worded items, resulting in a 5-item scale. Confirmatory analyses indicated excellent fit of the final model, which retained the best performing items from each hypothesized construct. The TUES demonstrated evidence of internal consistency (omega = 0.88-0.90), convergent validity, (r = 0.58), and criterion validity through telepsych engagement (incidence rate ratio = 1.19, P < .001), though test-retest reliability was unacceptable (r = 0.41).
CONCLUSION
The TUES is a pragmatic instrument with evidence of validity and internal reliability. Replication is necessary, but this initial psychometric evaluation suggests the TUES is a promising, brief yet comprehensive measure of telemental health user experience with clinical populations in rural settings.
Topics: Factor Analysis, Statistical; Humans; Psychometrics; Reproducibility of Results; Rural Population; Surveys and Questionnaires
PubMed: 34957607
DOI: 10.1111/jrh.12640 -
Journal of Psychiatric and Mental... Oct 2020WHAT IS KNOWN ABOUT SHARED DECISION-MAKING?: There is increasing investigation of shared decision-making in mental health services. Exploration of shared decision-making...
WHAT IS KNOWN ABOUT SHARED DECISION-MAKING?: There is increasing investigation of shared decision-making in mental health services. Exploration of shared decision-making and relevant instrument is scant in China. WHAT THIS PAPER ADDS TO EXISTING KNOWLEDGE?: In this study, the Clinical Decision-making Involvement and Satisfaction (CDIS) was translated into Chinese and validated with patients and mental health professionals. The Chinese version of the CDIS is a reliable and valid instrument for measuring perception of involvement and satisfaction with treatment decision for schizophrenia WHAT ARE THE IMPLICATIONS FOR PRACTICE?: Mental health nurses could use the CDIS patient-rated and health professional-rated versions to compare their perceptions of the decision-making process. ABSTRACT: Introduction There is growing interest in shared decision-making in Chinese mental health services. However, few specific instruments are available to measure decision-making satisfaction and involvement. Aim To translate and validate Clinical Decision-making Involvement and Satisfaction (CDIS) in a Chinese population. Methods The translation process was completed based on the Brislin translation method. Convenience sampling of 505 participants including 212 people diagnosed with schizophrenia and 293 mental health professionals for psychometric testing (e.g., content and construct validity, and test-retest reliability). Results The CDIS Chinese version has good internal consistency and temporal stability. Factor analysis determined two factors including satisfaction and involvement subscales, explaining 60.08% of the total variance. The Cronbach's α was 0.70, and the intraclass correlation coefficient ranged from 0.83 to 0.89. The composite reliability value was 0.85, and the average variance extracted was 0.50. Critical Ratio values ranged from 5.28 to 17.95, and item-total correlation values ranged from 0.48 to 0.75. Discussion The CDIS Chinese version is a feasible and reliable instrument.
Topics: Adult; Attitude of Health Personnel; China; Clinical Decision-Making; Decision Making, Shared; Female; Humans; Male; Mental Health Services; Middle Aged; Patient Satisfaction; Psychiatric Nursing; Psychiatry; Psychometrics; Reproducibility of Results; Schizophrenia; Translating; Young Adult
PubMed: 31976586
DOI: 10.1111/jpm.12601 -
Early Intervention in Psychiatry Jul 2023To validate the French versions of the 16-items Prodromal Questionnaire (PQ-16) and the 9-items scale of Perceptual and Cognitive Aberrations (PCA) to facilitate...
Detection of clinical high risk for psychosis in child and adolescent mental health services: Validation of the first step with the French versions of the Prodromal Questionnaire (fPQ-16) and scale of Perceptual and Cognitive Aberrations (fPCA).
AIM
To validate the French versions of the 16-items Prodromal Questionnaire (PQ-16) and the 9-items scale of Perceptual and Cognitive Aberrations (PCA) to facilitate screening of psychosis risk in native French-speaking young individuals referred to Child and Adolescent Mental Health Services.
METHOD
Participants (N = 87, age range 10-18 years) were diagnosed with a non-psychotic disorder according to the Diagnostic and Statistical Manual of Mental Disorders. The French versions of the PQ-16 and PCA were developed using a forward-backward translation procedure. Psychometric properties were tested including (i) internal validity with Pearson correlations and Cronbach's coefficients, and (ii) external validity by correlations with each other's.
RESULTS
(i) Correlations between fPQ-16 and fPCA total scores and individual items were mostly >.4. Cronbach's coefficients were .80 for the fPQ-16 and .61 for the fPCA. (ii) The fPQ-16 and fPCA total scores were significantly correlated with a large effect size (r = 0.66).
CONCLUSION
The fPQ-16 and the fPCA are psychometrically acceptable instruments for the screening of potential psychotic symptoms in French-speaking children and young adolescents under 18 years old referred to Child and Adolescent Mental Health Services.
Topics: Humans; Adolescent; Child; Prodromal Symptoms; Reproducibility of Results; Psychotic Disorders; Psychometrics; Surveys and Questionnaires; Mental Health Services; Cognition
PubMed: 36638840
DOI: 10.1111/eip.13366 -
Journal of Obstetric, Gynecologic, and... Sep 2023To modify an existing instrument used to measure the attitudes of perinatal nursing caregivers about pregnant women with substance use disorder (SUD) and to...
OBJECTIVE
To modify an existing instrument used to measure the attitudes of perinatal nursing caregivers about pregnant women with substance use disorder (SUD) and to psychometrically test the new instrument: Caregiver Attitudes on Substance Use in Pregnancy (CASUD-OB).
DESIGN
Instrument modification and psychometric testing of results from a modified instrument.
SETTING
Multi-hospital health care system in the midwestern United States.
PARTICIPANTS
A total of 147 perinatal nursing caregivers (perinatal nurses: n = 131; unlicensed assistive personnel: n = 16) who worked on obstetric and neonatal nursing units.
METHODS
We modified the existing instrument, and 12 experts in perinatal nursing (1 who also had expertise in SUD in the perinatal period) evaluated the items for content validity. We administered the CASUD-OB via online survey between November 2019 and December 2019. We used item reduction, calculated item-total correlations, and conducted exploratory factor analysis to modify the instrument and assessed its internal consistency.
RESULTS
After psychometric testing, we reduced the number of items from 26 to 16. Through item reduction and exploratory factor analysis, we identified three subscales (Caregiver Bias, Caregiver Self-Awareness, and Caregiver Perception of Parental Fitness). The Cronbach's alpha for the overall instrument was .92.
CONCLUSION
This study provides preliminary evidence to suggest that the CASUD-OB may be a valid and reliable instrument for measuring nurses' attitudes toward pregnant women with SUD. Through additional testing, this instrument has the potential to become a valuable resource to evaluate quality improvement initiatives, staff education programs, and other interventions designed to transform the attitudes of nursing caregivers toward pregnant women with SUD.
Topics: Pregnancy; Infant, Newborn; Humans; Female; Caregivers; Psychometrics; Reproducibility of Results; Surveys and Questionnaires; Substance-Related Disorders; Attitude
PubMed: 37393066
DOI: 10.1016/j.jogn.2023.05.115 -
PloS One 2022There is no specific tool for measuring the professional resilience of emergency nurses. Therefore, the present study aimed to design and psychometrically evaluate a new...
BACKGROUND
There is no specific tool for measuring the professional resilience of emergency nurses. Therefore, the present study aimed to design and psychometrically evaluate a new tool named the emergency nurses' professional resilience tool.
METHOD
This mixed-method sequential exploratory study was conducted in two phases: (1) item generation using literature review and evaluation of the results of a qualitative study and (2) psychometric evaluation of the developed scale. The face, content, and construct validity (exploratory and confirmatory factor analysis), reliability (internal consistency, relative, and absolute), and accountability were assessed in the population of Iranian nurses (N = 465) during March 2019-June 2020.
RESULTS
The tool designed for assessing the professional resilience of Iranian nurses included 37 items. The average scale content validity index (S-CVI/Ave) was equal to 0.94. The exploratory factor analysis revealed five factors, including professional competencies, emotional-cognitive characteristics, external support, in addition to behavioral and cognitive strategies, and explained 75.59% of the whole variance. Cronbach's alpha and intraclass correlation were 0.915 and 0.888, respectively. Construct validity for five factors was established with acceptable model fit indices [Chi-square/df = 1336.56/619, p < .001]; [Comparative Fit Index [CFI] = 0.96]; [Non-Normed Fit Index [NNFI] = 0.96]; [Root Mean Square Error of Approximation (RMSEA) = 0.074 and 90 Percent Confidence Interval = (0.069; 0.080)]; and [SRMR = 0.095].
CONCLUSIONS
According to the findings of the current study, the emergency nurses' professional resilience tool can be used by healthcare managers as a valid and reliable scale to evaluate the professional resilience of nurses to designate them as nurses working in emergency and disaster situations.
Topics: Humans; Iran; Nurses; Psychometrics; Reproducibility of Results; Surveys and Questionnaires
PubMed: 35671289
DOI: 10.1371/journal.pone.0269539 -
Assessment Jul 2023The Cooper-Norcross Inventory of Preferences (C-NIP) is a commonly used and psychometrically validated measure of client preferences in therapy. However, the C-NIP...
The Cooper-Norcross Inventory of Preferences (C-NIP) is a commonly used and psychometrically validated measure of client preferences in therapy. However, the C-NIP version for therapists (C-NIP-T) has not yet been validated. This study aimed to develop a Chinese version of the C-NIP-T and test its factor structure, reliability, and concurrent validity. A national sample of 1,054 Chinese mental health professionals completed the C-NIP-T and provided relevant demographic information. Confirmatory factor analysis (CFA) and exploratory structural equation modeling (ESEM) were used to examine the factor structure of the C-NIP-T. ESEM provided stronger evidence than CFA for the hypothesized four-factor model. Internal consistency coefficients (Cronbach's α) of the four subscales ranged between .60 and .76. Full or partial scalar invariance was established across therapists' therapeutic orientations, gender, personal therapy, and clinical experience. There were significant differences in subscale scores among therapists who identified as cognitive/cognitive-behavioral, psychoanalytic/psychodynamic, and humanistic/client-centered, supporting the concurrent validity of the C-NIP-T. The C-NIP-T is a psychometrically sound measure that can be used to assess therapists' preferences about therapy.
Topics: Humans; Surveys and Questionnaires; Psychometrics; Reproducibility of Results; Health Personnel; Factor Analysis, Statistical
PubMed: 35996847
DOI: 10.1177/10731911221118317 -
Nursing Ethics Aug 2020Considering the extensive debate that is currently taking place in Spain regarding euthanasia, it is important to examine the attitude of professionals who perform most...
BACKGROUND
Considering the extensive debate that is currently taking place in Spain regarding euthanasia, it is important to examine the attitude of professionals who perform most of their duties at the bedside of these patients and their families.
OBJECTIVES
The aim of the present study was to present an adaptation and validation of the Euthanasia Attitude Scale and to evaluate its psychometric properties among a sample of nursing students in Spain.
RESEARCH DESIGN
A cross-sectional study design was conducted.
PARTICIPANTS AND RESEARCH CONTEXT
Non-probabilistic sampling was used to recruit 396 Spanish nursing students.
METHODS
A self-report questionnaire, including socio-demographic data and the Euthanasia Attitude Scale, were used for data collection. The psychometric properties of the Euthanasia Attitude Scale were assessed, including reliability and validity. Fit indices of the overall model were computed.
ETHICAL CONSIDERATIONS
This study was approved by the Hospital Ethical Committee. Students were informed of the aims and procedures and provided written informed consent prior to data collection.
RESULTS
The factorial solution comprised four domains and the scale demonstrated adequate internal consistency (Cronbach's alpha = .878). For the exploratory factor analysis, the Kaiser-Meyer-Olkin index of sampling adequacy was .905 and the Bartlett's Test of Sphericity was 2972.79 (p < .001). The initial factorial solution revealed four factors with eigenvalues of 6.78 for the first factor, 1.90 for the second one, 1.29 for the third, and 1.10 for the fourth factor. Moreover, there was a significant relationship between religiosity and the domains of the Euthanasia Attitude Scale.
DISCUSSION
This study obtained a Cronbach's alpha coefficient of .88 which is in consonance with the findings reported by other studies whereby none of the items were removed and the initial structure based on four domains was conserved, with a factorial solution that explains 52.79% of the total variance. The displacement of some items of the domain may be explained by certain religious and/or cultural components as, in accordance with other studies, people with firm religious beliefs are more inclined to refuse euthanasia.
CONCLUSION
According to the findings of this study, the Euthanasia Attitude Scale is a reliable and valid instrument to measure the attitudes toward euthanasia in a sample of Spanish nursing students. This Spanish adaptation will be valuable in future studies examining the attitude and implication of nurses, understanding that nurses are key figures in the euthanasia debate.
Topics: Adolescent; Adult; Attitude to Death; Cross-Sectional Studies; Euthanasia; Female; Humans; Male; Middle Aged; Psychometrics; Reproducibility of Results; Self Report; Spain; Surveys and Questionnaires; Translating
PubMed: 31448684
DOI: 10.1177/0969733019864162 -
International Journal of Nursing... Oct 2023This study's aim is to develop and psychometrically assess the Sickness Presenteeism Scale-Nurse.
AIM
This study's aim is to develop and psychometrically assess the Sickness Presenteeism Scale-Nurse.
BACKGROUND
Evaluation of the effects of sickness presenteeism on nurses' performance and productivity is important for healthcare quality.
DESIGN
This was an instrument development and validation study.
METHODS
Scale items were created based on literature review and qualitative research. Data were collected from 619 nurses between October and December 2021. The factor structure of the scale was determined by explanatory and confirmatory factor analysis performed with different sample groups. Convergent and discriminant validity were investigated, and reliability was evaluated with Cronbach's α values, adjusted item-total correlation, composite-reliability and split-half reliability.
RESULTS
Explanatory factor analysis showed that Sickness Presenteeism Scale-Nurse consisted of four sub-dimensions and 21 items and explained 57.9% of the total variance. This factor structure was confirmed by confirmatory factor analysis. The convergent and discriminant validity was confirmed. The total Cronbach's α value of the scale was calculated as 0.928, with Cronbach's α values of the sub-dimensions calculated as 0.815-0.903; composite reliability values were calculated as 0.804-0.903.
CONCLUSIONS
The Sickness Presenteeism Scale-Nurse is a valid and reliable measurement instrument that can be used to evaluate the effect of nurses' sickness presenteeism behaviour on job performance.
Topics: Humans; Presenteeism; Psychometrics; Reproducibility of Results; Quality of Health Care; Factor Analysis, Statistical; Surveys and Questionnaires
PubMed: 37243487
DOI: 10.1111/ijn.13168