-
Journal of Surgical Education 2015To systematically review literature pertaining to microsurgical skill assessment tools to determine those specific to, and validated for, microsurgery training. (Review)
Review
OBJECTIVES
To systematically review literature pertaining to microsurgical skill assessment tools to determine those specific to, and validated for, microsurgery training.
DESIGN
Multiple databases were searched with preset terms. The search dates included all years up to May 2014. The eligibility criteria included the presence of statistical comparison with a control group and the presence of a measure of validation. The articles and their references were independently reviewed by 2 assessors. Each assessment tool was evaluated for content, construct, face, and criterion validities as well observation/expectant bias and interrater/intrarater reliability. For individual studies, we screened for expectant and selection bias.
RESULTS
Of the 261 articles reviewed, 10 articles and 1 abstract were included. Those excluded were predominantly assessment tools that did not evaluate microsurgical skill or articles where no assessment tool was described. The assessment tools identified in this review include a self-assessment tool where trainees rate their skill confidence from 1 to 5, stereoscopic visual acuity as a predictor for microsurgical performance, an objective motion-tracking electronic device--the Imperial College of Surgical Assessment Device, and 6 global rating scales. Content, construct, and face validities were consistently demonstrated in addition to observation/expectant bias and interrater reliability. Criterion validity was only demonstrated for half of the instruments and intrarater reliability for only 1.
CONCLUSIONS
Overall, 10 articles and 1 abstract described validated methods. Reliability and validity were demonstrated by 6 global rating scales (University of Western Ontario microsurgical skills acquisition, structured assessment of microsurgery skills, and video-based objective structured assessment of technical skill). Motion analysis using the Imperial College of Surgical Assessment Device is a valid objective measure of skill.
Topics: Clinical Competence; Depth Perception; Humans; Internship and Residency; Microsurgery; Reproducibility of Results; Task Performance and Analysis
PubMed: 25086464
DOI: 10.1016/j.jsurg.2014.06.009 -
The Spanish Journal of Psychology Jun 2020Self-consciousness development takes place mainly in adolescence because the brain undergoes certain structural changes that facilitate abstract thinking and...
Self-consciousness development takes place mainly in adolescence because the brain undergoes certain structural changes that facilitate abstract thinking and metacognition, thus favoring the development of identity. Despite the importance of self-consciousness for mental health, there are no specific measurement instruments for Spanish adolescents. The objective of this study was to explore the dimensions of self-consciousness among Spanish adolescents aged between 13 and 18 years and validate the Chinese Adolescent Self-Consciousness Questionnaire (ASC) in this population. A second-order confirmatory factor analysis (CFA) was conducted in accordance with previous validations of the ASC, using R Studio and the Lavaan package, to test its adequacy in a Spanish sample. Internal consistency and temporal stability were also tested, and evidence of validity was found. The results showed a good fit to the model eliminating four items with poor fit indices, CFI = .90, TLI = .89, RMSEA = .078, 95% CI [.076, .080]. Higher self-consciousness was associated with greater self-esteem and lower depressive symptomatology. No significant gender differences were found. This study provides a valid measure to evaluate self-consciousness in Spanish adolescents. The relationship established between self-consciousness and anxiety and depression requires further study as self-consciousness is involved in the development and maintenance of adolescent psychopathology.
Topics: Adolescent; Adolescent Development; Anxiety; Awareness; Consciousness; Depression; Female; Humans; Male; Psychometrics; Self Concept; Spain
PubMed: 32600483
DOI: 10.1017/SJP.2020.17 -
BMJ Open Sport & Exercise Medicine 2020Global navigation satellite systems (GNSS) and local positioning systems (LPS) are to date common tools to measure external training load in athletes. The aim of this... (Review)
Review
BACKGROUND/OBJECTIVE
Global navigation satellite systems (GNSS) and local positioning systems (LPS) are to date common tools to measure external training load in athletes. The aim of this scoping review was to map out and critically appraise the methods used to validate different GNSS and LPS used in team sports.
METHOD
A total of 48 studies met the eligibility criteria and were included in the review. The reference systems applied in the validations, and the parameters investigated were extracted from the studies.
RESULTS
The results show a substantial range of reference systems used to validate GNSS and LPS and a substantial number of investigated parameters. The majority of the validation studies have employed relatively simple field-based research designs, with use of measure tape/known distance as reference measure for distance. Timing gates and radar guns were frequently used as reference system for average and peak speed. Fewer studies have used reference system that allow for validation of instantaneous dynamic position, such as infrared camera-based motion capture systems.
CONCLUSIONS
Because most validation studies use simple and cost-effective reference systems which do not allow to quantify the exact path athletes travel and hence misjudge the true path length and speed, caution should be taken when interpreting the results of validation studies, especially when comparing results between studies. Studies validating instantaneous dynamic position-based measures is warranted, since they may have a wider application and enable comparisons both between studies and over time.
PubMed: 33062300
DOI: 10.1136/bmjsem-2020-000794 -
Data in Brief Aug 2017Data that defines IGHV (immunoglobulin heavy chain variable) germline gene inference using sequences of IgM-encoding transcriptomes obtained by Illumina MiSeq sequencing...
Data that defines IGHV (immunoglobulin heavy chain variable) germline gene inference using sequences of IgM-encoding transcriptomes obtained by Illumina MiSeq sequencing technology are described. Such inference is used to establish personalized germline gene sets for in-depth antibody repertoire studies and to detect new antibody germline genes from widely available immunoglobulin-encoding transcriptome data sets. Specifically, the data has been used to validate (Parallel antibody germline gene and haplotype analyses support the validity of immunoglobulin germline gene inference and discovery (DOI: 10.1016/j.molimm.2017.03.012) (Kirik et al., 2017) [1]) the inference process. This was accomplished based on analysis of the inferred germline genes' association to the donors' different haplotypes as defined by their different, expressed IGHJ alleles and/or IGHD genes/alleles. The data is important for development of validated germline gene databases containing entries inferred from immunoglobulin-encoding transcriptome sequencing data sets, and for generation of valid, personalized antibody germline gene repertoires.
PubMed: 28725665
DOI: 10.1016/j.dib.2017.06.031 -
BJU International Oct 2015To identify and review the currently available simulators for prostate surgery and to explore the evidence supporting their validity for training purposes.
OBJECTIVES
To identify and review the currently available simulators for prostate surgery and to explore the evidence supporting their validity for training purposes.
MATERIALS AND METHODS
A review of the literature between 1999 and 2014 was performed. The search terms included a combination of urology, prostate surgery, robotic prostatectomy, laparoscopic prostatectomy, transurethral resection of the prostate (TURP), simulation, virtual reality, animal model, human cadavers, training, assessment, technical skills, validation and learning curves. Furthermore, relevant abstracts from the American Urological Association, European Association of Urology, British Association of Urological Surgeons and World Congress of Endourology meetings, between 1999 and 2013, were included. Only studies related to prostate surgery simulators were included; studies regarding other urological simulators were excluded.
RESULTS
A total of 22 studies that carried out a validation study were identified. Five validated models and/or simulators were identified for TURP, one for photoselective vaporisation of the prostate, two for holmium enucleation of the prostate, three for laparoscopic radical prostatectomy (LRP) and four for robot-assisted surgery. Of the TURP simulators, all five have demonstrated content validity, three face validity and four construct validity. The GreenLight laser simulator has demonstrated face, content and construct validities. The Kansai HoLEP Simulator has demonstrated face and content validity whilst the UroSim HoLEP Simulator has demonstrated face, content and construct validity. All three animal models for LRP have been shown to have construct validity whilst the chicken skin model was also content valid. Only two robotic simulators were identified with relevance to robot-assisted laparoscopic prostatectomy, both of which demonstrated construct validity.
CONCLUSIONS
A wide range of different simulators are available for prostate surgery, including synthetic bench models, virtual-reality platforms, animal models, human cadavers, distributed simulation and advanced training programmes and modules. The currently validated simulators can be used by healthcare organisations to provide supplementary training sessions for trainee surgeons. Further research should be conducted to validate simulated environments, to determine which simulators have greater efficacy than others and to assess the cost-effectiveness of the simulators and the transferability of skills learnt. With surgeons investigating new possibilities for easily reproducible and valid methods of training, simulation offers great scope for implementation alongside traditional methods of training.
Topics: Animals; Dogs; Education, Medical, Continuing; Humans; Laparoscopy; Male; Models, Biological; Prostate; Prostatectomy; Robotic Surgical Procedures; Surgeons; User-Computer Interface
PubMed: 24588806
DOI: 10.1111/bju.12721 -
International Journal of Educational... 2022Towards the transition to blended and remote education, evaluating the levels of students' digital competence and designing educational programs to advance them is of...
Towards the transition to blended and remote education, evaluating the levels of students' digital competence and designing educational programs to advance them is of paramount importance. Existing validated digital competence scales usually ignore either important digital skills needed or new socio-technological innovations. This study proposes and validates a comprehensive digital competence scale for students in higher education. The suggested instrument includes skills of online learning and collaboration, social media, smart and mobile devices, safety, and data protection. The scale was evaluated on a sample of 156 undergraduate and postgraduate students just before and at the beginning of the COVID-19 crisis. The final scale is composed of 28 items and six digital competence components. The evaluation study revealed valid results in terms of model fit criteria, factor loadings, internal validity, and reliability. Individual factors like the students' field of study, computer experience and age revealed significant associations to the scale components, while gender revealed no significant differences. The suggested scale can be useful to the design of new actions and policies towards remote education and the digital skills' development of adult learners.
PubMed: 35602658
DOI: 10.1186/s41239-022-00330-0 -
International Journal of Medical... Aug 2022Persuasive design principles are increasingly employed in mHealth apps for motivating users and promoting healthy behaviours among individuals. However, how the... (Review)
Review
BACKGROUND
Persuasive design principles are increasingly employed in mHealth apps for motivating users and promoting healthy behaviours among individuals. However, how the persuasive design principles are perceived by the mHealth app users remains unclear.
AIM
To develop and validate the content validity of an instrument designed to measure the user's perceptions of the persuasive design principles assimilated in a breastfeeding mHealth app.
METHODS
A critical review of the literature guided the development of the research instrument. The developed instrument was refined and validated through a two-round modified Delphi process. Ten experts drawn from academic and clinical settings evaluated the items through two content validity indicators, relevance, and clarity and provided narrative feedback. The content validity of the instrument was determined by calculating the Content Validity Index (CVI). Content validity indicators at the scale-level (S-CVI) and item-level (I-CVI) were calculated.
RESULTS
The results demonstrated high content validity index of individual items in the instrument. All items in the instrument reached an excellent I-CVI ≥ 0.78 for both relevance and clarity except one item. The overall content validity index of the instrument using the average approach was moderate to high (S-CVI/Ave was 0.89 and 0.92 for relevance and clarity, respectively). The developed research instrument is composed of 5 constructs representing 24 items: (1) primary task support, (2) dialogue support, (3) system credibility support, (4) social support and (5) perceived persuasiveness.
CONCLUSIONS
Using a modified Delphi approach, the development and validation of the research instrument demonstrated moderate to high content validity for measuring users' perceptions of the persuasive design principles assimilated in a breastfeeding mHealth app. The evidence from this study supports that the research instrument is valid, relevant, and clear.
Topics: Breast Feeding; Delphi Technique; Female; Humans; Mobile Applications; Perception; Reproducibility of Results; Surveys and Questionnaires; Telemedicine
PubMed: 35597101
DOI: 10.1016/j.ijmedinf.2022.104789 -
Sleep Science (Sao Paulo, Brazil) 2022Currently, daytime sleepiness is a prevalent condition worldwide. Locally validated instruments for measuring sleepiness are required. The objective of this study was to...
INTRODUCTION
Currently, daytime sleepiness is a prevalent condition worldwide. Locally validated instruments for measuring sleepiness are required. The objective of this study was to validate a version of the Karolinska sleepiness scale that was translated into the Spanish spoken in Colombia.
METHODS
Individuals who attended a sleep laboratory for a polysomnography study and people in the general population were included. The validation process was performed in 6 phases: translation and back translation of the original version of the scale (English), face validity (n=13), pilot test (n=20), criteria validity (n=139) by means of polysomnography and the Epworth sleepiness scale, reproducibility (n=34), and sensitivity to change (n=40).
RESULTS
Regarding its discriminant validity, the Colombian version of the Karolinska sleepiness scale is correlated with the Epworth sleepiness scale, provided that a Mann-Whitney z=2661 (p=0.0078) was obtained. The scale has an acceptable reproducibility, Spearman Rho=0.55 (p=0.0002), and sensitivity to change, as shown through a two-tailed t test (p=0.0000).
CONCLUSIONS
The Karolinska Sleepiness Scale was successfully adapted to the Spanish variation spoken in Colombian and to the conditions of adult Colombians; thus, it constitutes a valid, reliable, and easy to use instrument for the assessment of patients with hypersomnia.
PubMed: 35273753
DOI: 10.5935/1984-0063.20220006 -
Statistical Methods in Medical Research Sep 2018In establishing prognostic models, often aided by machine learning methods, much effort is concentrated in identifying good predictors. However, the same level of rigor...
In establishing prognostic models, often aided by machine learning methods, much effort is concentrated in identifying good predictors. However, the same level of rigor is often absent in improving the outcome side of the models. In this study, we focus on this rather neglected aspect of model development. We are particularly interested in the use of longitudinal information as a way of improving the outcome side of prognostic models. This involves optimally characterizing individuals' outcome status, classifying them, and validating the formulated prediction targets. None of these tasks are straightforward, which may explain why longitudinal prediction targets are not commonly used in practice despite their compelling benefits. As a way of improving this situation, we explore the joint use of empirical model fitting, clinical insights, and cross-validation based on how well formulated targets are predicted by clinically relevant baseline characteristics (antecedent validators). The idea here is that all these methods are imperfect but can be used together to triangulate valid prediction targets. The proposed approach is illustrated using data from the longitudinal assessment of manic symptoms study.
Topics: Algorithms; Bipolar Disorder; Machine Learning; Models, Statistical; Outcome Assessment, Health Care; Precision Medicine; Prognosis
PubMed: 28067113
DOI: 10.1177/0962280216684163 -
Psychological Reports Jun 2017This study aims to validate Korean versions of the 9-item Utrecht Work Engagement Scale, testing for its factor pattern validity through Exploratory Factor Analysis and...
This study aims to validate Korean versions of the 9-item Utrecht Work Engagement Scale, testing for its factor pattern validity through Exploratory Factor Analysis and Confirmatory Factor Analysis, reliability, and convergent and discriminant validity. The 9-item Utrecht Work Engagement Scale was translated according to the guidelines of the International Test Commission and tested with two Korean samples. First, the Exploratory Factor Analysis found that both two-factor and three-factor solutions were viable options with the first sample. Second, comparison validations of these two solutions were tested by confirming the dimensionality of their structures through the Confirmatory Factor Analyses with the second sample, with the conclusion that the three-factor model solution was the most parsimonious model. Finally, the three-factor model of the 9-item Utrecht Work Engagement Scale was demonstrated to have good discriminant validity and convergent validity, as well as internal consistency of its subscales.
Topics: Adult; Factor Analysis, Statistical; Female; Humans; Male; Middle Aged; Models, Theoretical; Psychometrics; Reproducibility of Results; Republic of Korea; Surveys and Questionnaires; Work Engagement; Workplace
PubMed: 28558613
DOI: 10.1177/0033294117697085