-
Worldviews on Evidence-based Nursing Apr 2021One critical factor in effective implementation of evidence-based practices (EBPs) in nursing is an organizational context that facilitates and supports implementation...
BACKGROUND
One critical factor in effective implementation of evidence-based practices (EBPs) in nursing is an organizational context that facilitates and supports implementation efforts. Measuring implementation climate can add useful insights on the extent to which the organizational context supports EBP implementation.
AIMS
This study cross-validates and examines the psychometric properties of the Implementation Climate Scale (ICS), which measures nurses' perceptions of their unit's climate for EBP implementation.
METHODS
This study analyzed ICS data from two cross-sectional studies, including 203 nurses from California and 301 nurses from Florida. Analyses included evaluation of internal consistency, multilevel aggregation statistics, and confirmatory factor analyses.
RESULTS
The 18-item ICS demonstrated comparable psychometric properties to the original measure development paper in both samples. Confirmatory factor analyses provided support for the scale's factor structure in both samples.
LINKING EVIDENCE TO PRACTICE
The ICS is a pragmatic measure that can be used to assess unit implementation climate in nursing contexts. Results from the ICS from nurses and nurse leaders can provide insights into implementation-specific barriers and facilitators within the organizational context.
Topics: Adult; California; Female; Florida; Humans; Leadership; Male; Middle Aged; Nursing; Organizational Culture; Psychometrics; Surveys and Questionnaires
PubMed: 33765356
DOI: 10.1111/wvn.12500 -
Child Psychiatry and Human Development Oct 2020The Coping Questionnaire (CQ)-child and parent version-is an idiographic measure of youth's perceived ability to cope in anxiety provoking situations. Participants...
The Coping Questionnaire (CQ)-child and parent version-is an idiographic measure of youth's perceived ability to cope in anxiety provoking situations. Participants (N = 442; aged 7-17) met DSM-IV criteria for separation anxiety disorder, generalized anxiety disorder, or social anxiety disorder. The internal consistency of the CQ was supported, and retest reliability and parent/child agreement were, as expected, modest. The CQ scores were significantly correlated in the expected direction with measures of anxiety symptoms and functioning, providing evidence of convergent and divergent validity. The criterion validity of the CQ also was supported: the CQ scores were significantly correlated with the clinical severity rating of the youth's principal diagnosis on ADIS. There was a significant correlation between change in CQ scores and in anxiety severity and symptoms following treatment. Results support the CQ as a measure to assess coping efficacy in anxious youths as part of evidence-based assessment.
Topics: Adaptation, Psychological; Adolescent; Anxiety; Child; Female; Humans; Male; Parents; Psychiatric Status Rating Scales; Psychometrics; Reproducibility of Results
PubMed: 32157488
DOI: 10.1007/s10578-020-00975-w -
Evaluation & the Health Professions Sep 2022The Nursing Quality of Life Scale (NQOLS) is a 28-item self-report measure evaluating the four dimensions of nurses' quality of life, namely, the physical, emotional,...
The Nursing Quality of Life Scale (NQOLS) is a 28-item self-report measure evaluating the four dimensions of nurses' quality of life, namely, the physical, emotional, working, and social dimensions. The purpose of this study is to assess the psychometric properties, including validity and reliability, of the NQOLS. The study enrolled 1105 nurses who provided direct assistance to patients. The NQOLS factorial structure was tested using a cross-validation approach via Exploratory Structural Equational Modeling, which confirmed the instrument's four-dimension structure. Reliability was assessed using omega coefficients, proving excellent for all factors. Cluster analysis identified five distinct groups, each composed of participants sharing a substantial similarity with respect to their profile in the NQOLS. These five identifiable clusters presented significant differences not only in the NQOLS but also in the risk of work-related stress, emotional labor, and burnout. The results show that NQOLS is a simple, reliable, lean tool for measuring nurses' overall QoL, whose various parts can additionally be used to answer specific research questions.
Topics: Cluster Analysis; Humans; Nurses; Psychometrics; Quality of Life; Reproducibility of Results; Surveys and Questionnaires
PubMed: 35081784
DOI: 10.1177/01632787221075660 -
Journal of Clinical and Experimental... Jul 2020Tests of verbal memory (list learning) are particularly useful for clinicians and researchers globally, yet there are no psychometrically robust tests that are built...
BACKGROUND
Tests of verbal memory (list learning) are particularly useful for clinicians and researchers globally, yet there are no psychometrically robust tests that are built indigenously for Arabic-speaking populations, which comprise more than 370 million.
OBJECTIVE
To develop a verbal memory Arabic test using a systematic procedure of item selection and then provide evidence of validity and reliability in an Arabic-speaking sample in Lebanon.
METHOD
In study 1, we conducted a word prototypicality study (n = 77), and identified 932 words across 7 semantic categories. Following quantitative analyzes and qualitative judgments by an expert panel, we selected a sufficient number of words and categories, and constructed and piloted the items, instructions, and protocol for the Verbal Memory Arabic Test (VMAT). In study 2, we administered the VMAT on a community sample (n = 199; screened for depression and cognitive impairment) and patients with Multiple Sclerosis (n = 16).
RESULTS
Scores decreased with age as expected, they discriminated well between healthy and clinical populations (matched on age, sex, and years of education), and showed acceptable consistency within items and across time. : The VMAT is the first Arabic test developed indigenously. It can be used in clinical and research settings with Arabic-speaking populations to assess verbal learning.
Topics: Adult; Arabs; Cognitive Dysfunction; Depression; Female; Humans; Lebanon; Male; Memory and Learning Tests; Middle Aged; Multiple Sclerosis; Pilot Projects; Psychometrics; Reference Values; Reproducibility of Results; Verbal Learning
PubMed: 32567997
DOI: 10.1080/13803395.2020.1773408 -
Nursing Open Jan 2022This study aimed to culturally adapt and psychometrically validate the PROMIS Social Relationships Short Forms (PROMIS-SR) among Chinese patients with breast cancer.
AIM
This study aimed to culturally adapt and psychometrically validate the PROMIS Social Relationships Short Forms (PROMIS-SR) among Chinese patients with breast cancer.
DESIGN
A cross-sectional study.
METHOD
The PROMIS-SR was translated into simplified Chinese by strictly adhering to the Functional Assessment of Chronic Illness Therapy translation method and was subsequently tested among patients with breast cancer (N = 965). Eligible patients filled out the demographic information questionnaire, the PROMIS-SR, and the Functional Assessment of Cancer Therapy-Breast.
RESULTS
Confirmatory factor analysis (CFA) provided support for the original structure of the PROMIS-SR. All instruments reported strong known-group, cross-cultural and convergent validity, as hypothesized. Correlation coefficients ranged from 0.67 to 0.85, and Cronbach's α of all items were high (0.90-0.94).
Topics: China; Cross-Sectional Studies; Humans; Interpersonal Relations; Psychometrics; Reproducibility of Results
PubMed: 34569191
DOI: 10.1002/nop2.1077 -
Journal of Psychiatric Practice Sep 2019Depression imposes a notable societal burden, with limited treatment success despite multiple available psychotherapy and medications choices. Potential reasons may...
Findings From a Trial of the Smartphone and OnLine Usage-based eValuation for Depression (SOLVD) Application: What Do Apps Really Tell Us About Patients with Depression? Concordance Between App-Generated Data and Standard Psychiatric Questionnaires for Depression and Anxiety.
OBJECTIVE
Depression imposes a notable societal burden, with limited treatment success despite multiple available psychotherapy and medications choices. Potential reasons may include the heterogeneity of depression diagnoses and the presence of comorbid anxiety symptoms. Despite technological advances and the introduction of many mobile phone applications (apps) claiming to relieve depression, major gaps in knowledge still exist regarding what apps truly measure and how they correlate with psychometric questionnaires. The goal of this study was to evaluate whether mobile daily mood self-ratings may be useful in monitoring and classifying depression symptoms in a clinically depressed population compared with standard psychometric instruments including the Patient Health Questionaire-9 (PHQ-9), the Hamilton Rating Scale for Depression (HAM-D), and the Hamilton Anxiety Rating Scale (HAM-A).
METHOD
For this study, 22 patients with major depressive disorder with or without comorbid anxiety disorder were recruited. The diagnosis of depression was confirmed through the Mini International Neuropsychiatric Interview (MINI). Over an 8-week period, daily moods were self-reported through the Smartphone and OnLine Usage-based eValuation for Depression (SOLVD) application, a custom-designed application that was downloaded onto patients' mobile devices. Depression and anxiety symptoms were also measured biweekly using the HAM-D, HAM-A, and PHQ-9.
RESULTS
Significant correlations were observed among self-evaluated mood, daily steps taken, SMS (text) frequency, average call duration, and biweekly psychometric scores (|r|>0.5, P<0.05). The correlation coefficients were higher in individuals with more severe depressive symptoms.
CONCLUSIONS
Although this study, given its limited sample size, was exploratory in nature, it helps fill a significant gap in our knowledge of the concordance between ratings obtained on the Ham-D, Ham-A, and the PHQ-9 psychometric instruments and data obtained via a smartphone app. These questionnaires represent gold-standard, commonly used psychiatric research/clinical instruments, and, thus, this information can serve as a foundation for digital phenotyping for depression and pave the way for interventional studies using smartphone applications.
Topics: Adult; Anxiety Disorders; Comparative Effectiveness Research; Depression; Depressive Disorder, Major; Female; Humans; Male; Mobile Applications; Psychiatric Status Rating Scales; Psychometrics; Self Report; Smartphone; Surveys and Questionnaires; Telemedicine
PubMed: 31505521
DOI: 10.1097/PRA.0000000000000420 -
Journal of Clinical Child and... 2020Research suggests that irritability and defiance are distinct dimensions of youth oppositionality that are differentially associated with internalizing and conduct...
Research suggests that irritability and defiance are distinct dimensions of youth oppositionality that are differentially associated with internalizing and conduct problems, respectively. Because much of this evidence has emerged with limited psychometric evaluation, we conducted the first multi-informant examination of selected Child Behavior Checklist (CBCL) and Youth Self Report (YSR) items for measuring irritability and defiance in a large clinical sample. Clinically referred youths ( = 1,030; ages 6-15; 43% female, 42% ethnic minority) were assessed prior to treatment using multi-informant rating scales and diagnostic interviews. Analyses examined factor structure, invariance, internal consistency, multi-informant patterns, and convergent, discriminant, and criterion validity with internalizing and externalizing problems/disorders. A correlated 2-factor model of irritability (stubborn/sullen/irritable, mood, temper) and defiance (argues, disobeys-home, disobeys-school) fit well for both informants. Adequate measurement invariance and scale consistency was consistently found for parent-report but not youth-report. With both informants, all hypothesized convergent and discriminant validity associations were supported: irritability and defiance with internalizing and conduct scales, respectively. However, hypothesized criterion validity associations were largely found only by parent-report: irritability with anxiety and depressive disorders, defiance with conduct disorder, and both with oppositional defiant disorder. Results consistently supported the reliability and validity of the CBCL irritability and defiance scales, with somewhat less consistent support for the YSR scales. Thus, CBCL items may provide psychometrically sound assessment of irritability and defiance, whereas further research is needed to advance youth-report and multi-informant strategies. Results also provide further support for a two subdimension model of oppositional defiant disorder symptoms that includes irritability and defiance.
Topics: Adolescent; Attention Deficit and Disruptive Behavior Disorders; Child; Conduct Disorder; Female; Humans; Irritable Mood; Male; Psychometrics; Reproducibility of Results
PubMed: 31276433
DOI: 10.1080/15374416.2019.1622119 -
Asian Journal of Psychiatry Jan 2020Suicide is increasing in young Iranian population, which necessitates the employing of valid, yet abridged instruments assessing the constellation of suicide-related...
BACKGROUND
Suicide is increasing in young Iranian population, which necessitates the employing of valid, yet abridged instruments assessing the constellation of suicide-related behaviors. The study aimed at validating Suicide Behavior Questionnaire-Revised (SBQ-R) among Iranian undergraduates.
METHODS
A total of 487 undergraduates were surveyed in 2018. Construct validity of SBQ-R was examined via confirmatory factor analysis (CFA), and Spearman's correlation with two single-item indices of suicide acceptability (SA) and lifetime suicidal ideation (LSI) was determined. Logistic regression and Kruskal-Wallis tests were used to examine the cut-off points (≥ 7 and ≥ 8) and categorizations as per item 1.
RESULTS
The mean SBQ-R score was 5.79 ± 3.55. Cut-off points ≥ 7 and ≥ 8 categorized 150 (30.8%) and 123 (25.2%) samples with suicide risk, respectively. Women obtained significantly higher scores on all indices, except items 1 and 4. CFA confirmed the model with sound goodness-of-fit, with factor loadings of 0.70 to 0.83. Composite reliability and average variance extracted were 0.87 and 0.63, respectively. The SBQ-R's correlation with SA and LSI confirmed its concurrent validity. Regression analysis confirmed the ability of both cut-off points to distinguish the participants with high SA and LSI; however, the cut-off point ≥ 8 produced better results regarding high LSI. Based on item 1, normal versus low- and high-risk samples were significantly different in terms of SA, LSI, and adjusted total score of SBQ-R (P < 0.0001).
CONCLUSION
SBQ-R is an economic and psychometrically sound tool, which can be utilized to identify suicide-related behaviors and risks in young Iranian population.
Topics: Adolescent; Adult; Female; Humans; Iran; Male; Psychometrics; Reproducibility of Results; Suicide; Surveys and Questionnaires; Young Adult
PubMed: 31704597
DOI: 10.1016/j.ajp.2019.101856 -
Headache Jan 2022To evaluate the content validity and psychometric properties of the Activity Impairment in Migraine Diary (AIM-D). (Observational Study)
Observational Study
OBJECTIVE
To evaluate the content validity and psychometric properties of the Activity Impairment in Migraine Diary (AIM-D).
BACKGROUND
Measuring treatment effects on migraine impairment requires a psychometrically sound patient-reported outcome (PRO) measure developed consistent with U.S. Food and Drug Administration guidance.
METHODS
The AIM-D was created from concepts that emerged during qualitative interviews with five clinicians experienced in treating migraine and concept elicitation (CE) interviews with 40 adults with episodic migraine (EM) or chronic migraine (CM). The initial version was refined based on three waves of cognitive interviews with 38 adults with EM or CM and input from a panel of clinical and measurement experts. The AIM-D was psychometrically evaluated using data from 316 adults with EM or CM who participated in a 13-week prospective observational study. Study participants completed PRO assessments including the AIM-D and a daily headache diary. Exploratory and confirmatory factor analysis were used to determine the factor structure. The reliability, validity, and responsiveness of the AIM-D were assessed. Additional PRO measures including the Patient Global Impression - Severity (PGI-S), Migraine Specific Quality of Life Questionnaire, Version 2.1 Role Function-Restrictive domain, and Headache Impact Test were used for psychometric evaluation of the AIM-D.
RESULTS
Based on CE interviews with adults with migraine and input from an expert panel, activity impairment was identified as the target in the preliminary conceptual framework, which had two domains: performance of daily activities (PDAs) and physical impairment (PI). Revision of the draft AIM-D through multiple rounds of cognitive interviews and expert panel meetings resulted in a content valid 11-item version. Exploratory factor analysis supported both one- and two-domain structures for the AIM-D, which were further supported by confirmatory factor analysis (factor loadings all >0.90). The AIM-D domains (PDA and PI) and total score showed high internal consistency reliability (Cronbach's alpha 0.95-0.97), acceptable test-retest reliability for weekly average scores (intraclass correlation coefficient >0.60 for participants with no change in PGI-S between baseline and week 2), and good convergent and known-groups validity. There was evidence of responsiveness based on changes in PGI-S score and monthly migraine days.
CONCLUSION
The AIM-D is a content valid and psychometrically sound measure designed to evaluate activity impairment and is suitable for use in clinical trials of preventive treatments for EM or CM.
Topics: Adolescent; Adult; Aged; Aged, 80 and over; Chronic Disease; Female; Humans; Male; Middle Aged; Migraine Disorders; Patient Reported Outcome Measures; Psychometrics; Qualitative Research; Reproducibility of Results; Young Adult
PubMed: 34962305
DOI: 10.1111/head.14229 -
Journal of Neurodevelopmental Disorders Jan 2023Unusual responses to sensory stimuli are considered a diagnostic symptom of autism spectrum disorder with mounting research efforts put towards understanding,... (Review)
Review
BACKGROUND
Unusual responses to sensory stimuli are considered a diagnostic symptom of autism spectrum disorder with mounting research efforts put towards understanding, characterizing, and treating such symptoms.
METHODS
This paper examines self and caregiver report tools used to measure sensory features in ASD through a systematic review of the psychometric evidence for their use. A total of 31 empirical papers were reviewed across 20 assessment tools. Substantial differences were identified in the specific sensory features defined across assessment tools. Sensory assessment questionnaires were evaluated against quality psychometric evidence criteria to provide a use recommendation.
RESULTS
Five assessments were identified to be "appropriate with conditions," while no sensory assessment tools were identified to have sufficient quality psychometric evidence to provide a recommendation of "Appropriate" for measuring sensory features in ASD.
CONCLUSION
Evidence from this review highlights potentially significant shortcomings among the current methods used to measure sensory features in ASD and suggests the need for more efforts in developing psychometrically sound sensory assessment tools for use in ASD populations.
Topics: Humans; Autism Spectrum Disorder; Psychometrics; Caregivers; Surveys and Questionnaires
PubMed: 36698071
DOI: 10.1186/s11689-022-09473-7