-
Clinical Psychology Review Dec 2020The need for sustained skill development and quality assurance when executing behavioral interventions is best demonstrated in the empirical evolution of Motivational... (Review)
Review
The need for sustained skill development and quality assurance when executing behavioral interventions is best demonstrated in the empirical evolution of Motivational Interviewing (MI). As a brief behavioral intervention that identifies the therapeutic process as an active treatment ingredient, it is critical for researchers, trainers, and administrators to use psychometrically sound and theoretically congruent tools to evaluate provider skills and fidelity when executing MI. Yet, no prior work has evaluated the breadth of MI tools employed across research contexts. Therefore, this review identified MI fidelity and skill development tools across measurement, training and efficacy/effectiveness studies and evaluated their psychometric strength and fit with current MI theory. We identified 199 empirical studies that employed an MI fidelity/skill tool and we found 21 tools with varying degrees of empirical support and theoretical congruence. Specifically, we identified five observer-, two trainee- and one client-rated tool with strong empirical support, and nine observer- and two client-rated tools with preliminary empirical support. We detailed the empirical strength, including the extent to which tools were linked to trainee/client outcomes across research contexts and offer recommendations on which MI tools to use in training, efficacy, and effectiveness trials.
Topics: Behavior Therapy; Humans; Motivational Interviewing; Psychometrics
PubMed: 32920371
DOI: 10.1016/j.cpr.2020.101909 -
BMC Health Services Research May 2023Using a validated instrument to measure palliative care (PC) educational needs of health professionals is an important step in understanding how best to educate a...
BACKGROUND
Using a validated instrument to measure palliative care (PC) educational needs of health professionals is an important step in understanding how best to educate a well-versed PC workforce within a national health system. The End-of-life Professional Caregiver Survey (EPCS) was developed to measure U.S. interprofessional PC educational needs and has been validated for use in Brazil and China. As part of a larger research project, this study aimed to culturally adapt and psychometrically test the EPCS among physicians, nurses, and social workers practicing in Jamaica.
METHODS
Face validation involved expert review of the EPCS with recommendations for linguistic item modifications. Content validation was carried out by six Jamaica-based experts who completed a formal content validity index (CVI) for each EPCS item to ascertain relevancy. Health professionals practicing in Jamaica (n = 180) were recruited using convenience and snowball sampling to complete the updated 25-item EPCS (EPCS-J). Internal consistency reliability was assessed using Cronbach's [Formula: see text] coefficient and McDonald's [Formula: see text]. Construct validity was examined through confirmatory factor analysis (CFA) and exploratory factor analysis (EFA).
RESULTS
Content validation led to elimination of three EPCS items based on a CVI < 0.78. Cronbach's [Formula: see text] ranged from 0.83 to 0.91 and McDonald's [Formula: see text] ranged from 0.73 to 0.85 across EPCS-J subscales indicating good internal consistency reliability. The corrected item-total correlation for each EPCS-J item was > 0.30 suggesting good reliability. The CFA demonstrated a three-factor model with acceptable fit indices (RMSEA = 0.08, CFI = 0.88, SRMR = 0.06). The EFA determined a three-factor model had the best model fit, with four items moved into the effective patient care subscale from the other two EPCS-J subscales based on factor loading.
CONCLUSIONS
The psychometric properties of the EPCS-J resulted in acceptable levels of reliability and validity indicating that this instrument is suitable for use in measuring interprofessional PC educational needs in Jamaica.
Topics: Humans; Caregivers; Psychometrics; Reproducibility of Results; Jamaica; Surveys and Questionnaires
PubMed: 37193983
DOI: 10.1186/s12913-023-09497-2 -
International Journal of Environmental... Nov 2022There is a great heterogeneity in the conceptualization and operationalization of social capital in empirical research targeting adolescents. There has not yet been an... (Review)
Review
There is a great heterogeneity in the conceptualization and operationalization of social capital in empirical research targeting adolescents. There has not yet been an attempt to systematically map and psychometrically evaluate the existing instruments for measuring social capital that have been developed and validated for adolescent samples. The aim of this systematic review was to identify and evaluate the design and psychometric properties of self-reported instruments for social capital, specifically developed and validated for use among adolescents. The design of this study was a systematic review guided by the COSMIN methodology for systematic reviews of Patient Reported Outcome Measures. The search included six electronic databases and no time frame was applied. Twenty studies were identified as describing the development and validation of a social capital instrument for adolescent samples. The results reveal common denominators, but also great variation in the design and validation of the instruments. Adolescents were only involved in the development procedures of four instruments. There is a lack of social capital instruments that cover both the multidimensionality of social capital and contextual relevance in relation to adolescents. Careful examination of instruments should thus precede a decision when designing studies and further instrument development involving the target group is encouraged.
Topics: Adolescent; Humans; Self Report; Social Capital; Psychometrics; Patient Reported Outcome Measures; Reproducibility of Results
PubMed: 36497690
DOI: 10.3390/ijerph192315596 -
PloS One 2023Stigma remains a significant problem globally, creating barriers to services for individuals in need, regardless of access to services. The stigma of COVID-19 primarily... (Review)
Review
Stigma remains a significant problem globally, creating barriers to services for individuals in need, regardless of access to services. The stigma of COVID-19 primarily happened because it is a new disease with several unknowns, and these unknowns generate fear. This study aimed to conduct a psychometric development and evaluate the Public COVID-19 Stigma Scale that follows the Indonesian community's cultural background. This study used research and development design to measure the COVID-19 stigma through six steps that include seven dimensions and is culturally sensitive, starting from a literature review through to psychometric evaluation. This study was community based and was conducted in 26 regions in the Sumedang Regency. The research and development step ran from July 2021 to November 2022, with a total of 1,686 respondents. The results showed that the social stigma scale for COVID-19 consisted of 11 valid and reliable items that were separated into seven dimensions: social distancing (1 item), traditional prejudice (7 items), exclusionary sentiments (2 items), negative affect (2 items), treatment carryover (1 item), disclosure carryover (2 items), and perception of dangerousness (1 item). Further research needs to be conducted to examine the level of stigma and determine interventions to overcome the social stigma around COVID-19 in the community.
Topics: Humans; Social Stigma; Indonesia; Psychometrics; Surveys and Questionnaires; COVID-19; Reproducibility of Results
PubMed: 37018328
DOI: 10.1371/journal.pone.0283870 -
JAMA Health Forum Apr 2022Psychometrically robust patient-reported outcome measures (PROMs) and patient-reported experience measures (PREMs) are critical to evaluating quality and performance...
IMPORTANCE
Psychometrically robust patient-reported outcome measures (PROMs) and patient-reported experience measures (PREMs) are critical to evaluating quality and performance across health services and systems. However, the adoption and implementation of PROMs and PREMs remain a challenge in many countries. The aim of this guide is to support instrument selection and implementation to measure health system performance.
OBSERVATIONS
The guide is split into 3 step-by-step sections. Step 1: Knowing What to Measure discusses what PROMs and PREMs capture and how they differ from related instruments. Step 2: Choosing the Right Instrument describes the critical psychometric properties of validity, reliability, and responsiveness, and provides resources to support instrument selection and evaluation. Step 3: Mitigating Potential PROM and PREM Implementation Barriers outlines key barriers and supports for instrument implementation at system, service, and individual levels.
CONCLUSIONS AND RELEVANCE
This guide aims to provide practical resources for the identification of psychometrically robust PROMs and PREMs, as well as support for their implementation to drive improvements across health systems globally.
Topics: Humans; Patient Reported Outcome Measures; Psychometrics; Reproducibility of Results; Surveys and Questionnaires
PubMed: 36218960
DOI: 10.1001/jamahealthforum.2022.0326 -
Journal of Psychiatric Research Mar 2022Measurement-based care (MBC) involves the regular administration of outcome assessments to track and evaluate treatment progress and requires psychometrically sound... (Review)
Review
Measurement-based care (MBC) involves the regular administration of outcome assessments to track and evaluate treatment progress and requires psychometrically sound instruments. While there are widely used patient-reported outcome measures (PROMs) for several psychiatric disorders and symptom categories (e.g., depression, anxiety), there is less consensus about self-report assessments for measurement-based care of schizophrenia. The present review provides an initial guide to this area by reporting on psychometric studies that introduce or evaluate PROMs designed for the ongoing treatment of schizophrenia. Out of an initial database of 6,153 articles, and review of 141 full-text articles, an analysis of 21 articles examining 12 measures is presented in this review. Findings suggest robust options exist for clinical and research institutions aiming to assess symptom outcomes in schizophrenia, with most measures showing strengths in internal consistency, test-retest reliability, and a number of measures with evidence of convergent or criterion validity. While there exist heterogeneous options, multiple measures demonstrated promising psychometric strengths. Future work validating consistent psychometric validity could involve measures which could be valuable in context of MBC for schizophrenia.
Topics: Humans; Patient Reported Outcome Measures; Psychometrics; Reproducibility of Results; Schizophrenia; Self Report
PubMed: 35007807
DOI: 10.1016/j.jpsychires.2021.12.053 -
Nutrients Oct 2022The Mediterranean Lifestyle (MLS) has been related to better health and quality of life. However, there is no consensus on how to assess this lifestyle. The main... (Review)
Review
The Mediterranean Lifestyle (MLS) has been related to better health and quality of life. However, there is no consensus on how to assess this lifestyle. The main objective of this work was to systematically review the methodology used in different studies on the evaluation of the MLS. The specific objectives were (1) to analyze the MLS components evaluated in previous studies, (2) to explore the assessment instruments available for the analysis of the MLS, and (3) to identify the psychometric properties of these instruments. The search was carried out using the PubMed, Scopus, Web of Science, and ScienceDirect databases with the purpose of identifying those published articles in which the MLS was assessed. The review included 26 studies linked to the assessment of the MLS. Of these studies, only four exclusively used a tool to analyze MLS components globally. These studies included two questionnaires and three different indexes. None of them, however, evaluated all of the recognized MLS components, and food preparation was the least frequently evaluated component. Given the clear importance of analyzing MLS adherence and the lack of consensus in previous research, an evaluation tool needs to be created to comprehensively assess all of the MLS dimensions by means of appropriate psychometric properties.
Topics: Consensus; Life Style; Psychometrics; Quality of Life; Surveys and Questionnaires
PubMed: 36235832
DOI: 10.3390/nu14194179 -
Asian Nursing Research Aug 2022The aim of this paper is to develop a scale for measuring the perinatal bereavement care competence of midwives and assess its psychometric properties. (Review)
Review
PURPOSE
The aim of this paper is to develop a scale for measuring the perinatal bereavement care competence of midwives and assess its psychometric properties.
METHODS
The Perinatal Bereavement Care Competence Scale was developed in four phases. (1) Item generation: 75 items were formulated based on a literature review and interviews with midwives. (2) Delphi expert consultation: 15 experts evaluated whether the items were clear/appropriate/relevant to the questionnaire dimensions, and the items were optimized. (3) Pilot test: The comprehensibility, acceptability, and time required to complete the questionnaire by midwives were assessed. (4) Evaluation of reliability and validity: The scale was validated by initial item analysis, exploratory and confirmatory factor analyses, and internal consistency reliability and test-retest reliability.
RESULTS
The final scale consisted of six dimensions and 25 items: maintaining belief (three items), knowing (four items), being with (six items), preserving dignity (four items), enabling (five items), and self-adjustment (three items). Exploratory factor analysis yielded a six-factor structure that was consistent with the theoretical framework and explained 70.8% of the total variance. Confirmatory factor analysis indicated a good fit for the six-factor model. Cronbach's α for the scale was 0.931, and the test-retest reliability coefficient was 0.968.
CONCLUSION
The Perinatal Bereavement Care Competence Scale is a valid and reliable instrument for measuring the competence of midwives in caring for bereaved parents who have experienced perinatal loss.
Topics: Bereavement; Factor Analysis, Statistical; Female; Grief; Humans; Midwifery; Perinatal Death; Pregnancy; Professional Competence; Psychometrics; Reproducibility of Results; Surveys and Questionnaires
PubMed: 35716897
DOI: 10.1016/j.anr.2022.06.002 -
International Journal of Environmental... Dec 2021Addressing HIV-related stigma requires the use of psychometrically sound measures. However, despite the Berger HIV stigma scale (HSS) being among the most widely used... (Review)
Review
Addressing HIV-related stigma requires the use of psychometrically sound measures. However, despite the Berger HIV stigma scale (HSS) being among the most widely used measures for assessing HIV-related stigma, no study has systematically summarised its psychometric properties. This review investigated the psychometric properties of the HSS. A systematic review of articles published between 2001 and August 2021 was undertaken (CRD42020220305) following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Additionally, we searched the grey literature and screened the reference lists of the included studies. Of the total 1241 studies that were screened, 166 were included in the review, of which 24 were development and/or validation studies. The rest were observational or experimental studies. All the studies except two reported some aspect of the scale's reliability. The reported internal consistency ranged from acceptable to excellent (Cronbach's alpha ≥ 0.70) in 93.2% of the studies. Only eight studies reported test-retest reliability, and the reported reliability was adequate, except for one study. Only 36 studies assessed and established the HSS's validity. The HSS appears to be a reliable and valid measure of HIV-related stigma. However, the validity evidence came from only 36 studies, most of which were conducted in North America and Europe. Consequently, more validation work is necessary for more precise insights.
Topics: HIV Infections; Humans; Psychometrics; Reproducibility of Results; Social Stigma; Surveys and Questionnaires
PubMed: 34948690
DOI: 10.3390/ijerph182413074 -
PloS One 2022The Existence Scale (ES) is a theory-based measure assessing personal fulfillment and finding meaning in life. This study aims to translate the ES into Arabic language...
The Existence Scale (ES) is a theory-based measure assessing personal fulfillment and finding meaning in life. This study aims to translate the ES into Arabic language and test its psychometric properties in Jordan populations. A methodological design was performed on a convenience sample of 551 participants by three samples of nurses, schoolteachers, and undergraduate students. Data collection was carried out between February and May 2019. Translation and back translation, face validity (Important Score>1.5), content validity ratio (CVR>0.62) and index (CVI/Ave>0.80), construct, convergent, and discriminant validity were obtained. Furthermore, Cronbach's alpha, composite reliability, and average variance extracted were investigated in this study. The results showed that five items were deleted based on content validity ratio and four items were deleted based on their low factor loading. The exploratory factor analysis showed four subscales for the translated ES (37 items), explaining 61.57% of the variance collectively. The confirmatory factor analysis supported the four subscales with acceptable goodness of fit indices. The result of the total Cronbach's alpha for the ES was 0.93, and for subscales it ranged from 0.88 to 0.93. Composite reliability and average variance extracted results for the translated ES were supportive of the reliability. These results confirm that the translated Arabic version of the ES (37 items) in Jordan populations is acceptable regarding validity and reliability.
Topics: Factor Analysis, Statistical; Humans; Language; Psychometrics; Reproducibility of Results; Surveys and Questionnaires
PubMed: 35436311
DOI: 10.1371/journal.pone.0267321