-
JMIR Formative Research Jun 2024Large-scale crisis events such as COVID-19 often have secondary impacts on individuals' mental well-being. University students are particularly vulnerable to such...
BACKGROUND
Large-scale crisis events such as COVID-19 often have secondary impacts on individuals' mental well-being. University students are particularly vulnerable to such impacts. Traditional survey-based methods to identify those in need of support do not scale over large populations and they do not provide timely insights. We pursue an alternative approach through social media data and machine learning. Our models aim to complement surveys and provide early, precise, and objective predictions of students disrupted by COVID-19.
OBJECTIVE
This study aims to demonstrate the feasibility of language on private social media as an indicator of crisis-induced disruption to mental well-being.
METHODS
We modeled 4124 Facebook posts provided by 43 undergraduate students, spanning over 2 years. We extracted temporal trends in the psycholinguistic attributes of their posts and comments. These trends were used as features to predict how COVID-19 disrupted their mental well-being.
RESULTS
The social media-enabled model had an F1-score of 0.79, which was a 39% improvement over a model trained on the self-reported mental state of the participant. The features we used showed promise in predicting other mental states such as anxiety, depression, social, isolation, and suicidal behavior (F1-scores varied between 0.85 and 0.93). We also found that selecting the windows of time 7 months after the COVID-19-induced lockdown presented better results, therefore, paving the way for data minimization.
CONCLUSIONS
We predicted COVID-19-induced disruptions to mental well-being by developing a machine learning model that leveraged language on private social media. The language in these posts described psycholinguistic trends in students' online behavior. These longitudinal trends helped predict mental well-being disruption better than models trained on correlated mental health questionnaires. Our work inspires further research into the potential applications of early, precise, and automatic warnings for individuals concerned about their mental health in times of crisis.
PubMed: 38916951
DOI: 10.2196/52316 -
PLoS Computational Biology Jun 2024Biological structures are defined by rigid elements, such as bones, and elastic elements, like muscles and membranes. Computer vision advances have enabled automatic...
Biological structures are defined by rigid elements, such as bones, and elastic elements, like muscles and membranes. Computer vision advances have enabled automatic tracking of moving animal skeletal poses. Such developments provide insights into complex time-varying dynamics of biological motion. Conversely, the elastic soft-tissues of organisms, like the nose of elephant seals, or the buccal sac of frogs, are poorly studied and no computer vision methods have been proposed. This leaves major gaps in different areas of biology. In primatology, most critically, the function of air sacs is widely debated; many open questions on the role of air sacs in the evolution of animal communication, including human speech, remain unanswered. To support the dynamic study of soft-tissue structures, we present a toolkit for the automated tracking of semi-circular elastic structures in biological video data. The toolkit contains unsupervised computer vision tools (using Hough transform) and supervised deep learning (by adapting DeepLabCut) methodology to track inflation of laryngeal air sacs or other biological spherical objects (e.g., gular cavities). Confirming the value of elastic kinematic analysis, we show that air sac inflation correlates with acoustic markers that likely inform about body size. Finally, we present a pre-processed audiovisual-kinematic dataset of 7+ hours of closeup audiovisual recordings of siamang (Symphalangus syndactylus) singing. This toolkit (https://github.com/WimPouw/AirSacTracker) aims to revitalize the study of non-skeletal morphological structures across multiple species.
PubMed: 38913743
DOI: 10.1371/journal.pcbi.1012222 -
Frontiers in Human Neuroscience 2024Psycholinguistic models of metaphor processing remain a subject of debate. A prime-probe design using Chinese materials with a specific time span (300 ms) was applied to...
Psycholinguistic models of metaphor processing remain a subject of debate. A prime-probe design using Chinese materials with a specific time span (300 ms) was applied to test the mechanisms of metaphor processing. Conventional and familiarized metaphors were designed as primes, followed by a probe word semantically related to the prime metaphor (MT), a probe word related to the literal meaning of the final word of the prime metaphor (LT), control/unrelated probe word (UT), or non-word. Event-related potentials (ERPs) elicited by the probes were recorded to examine metaphor processing. In N400, results revealed that UT and LT elicited significantly more negative waveforms than MT in both primes. MTs and LTs showed no difference between conventional and familiarized metaphors, suggesting that metaphorical meaning may be accessed directly, regardless of whether conventional or familiarized metaphors. The results were generally compatible with the direct processing model.
PubMed: 38911227
DOI: 10.3389/fnhum.2024.1269153 -
PloS One 2024To understand the neurocognitive mechanisms that underlie heterogeneity in cognitive ageing, recent scientific efforts have led to a growing public availability of...
To understand the neurocognitive mechanisms that underlie heterogeneity in cognitive ageing, recent scientific efforts have led to a growing public availability of imaging cohort data. The Advanced BRain Imaging on ageing and Memory (ABRIM) project aims to add to these existing datasets by taking an adult lifespan approach to provide a cross-sectional, normative database with a particular focus on connectivity, myelinization and iron content of the brain in concurrence with cognitive functioning, mechanisms of reserve, and sleep-wake rhythms. ABRIM freely shares MRI and behavioural data from 295 participants between 18-80 years, stratified by age decade and sex (median age 52, IQR 36-66, 53.20% females). The ABRIM MRI collection consists of both the raw and pre-processed structural and functional MRI data to facilitate data usage among both expert and non-expert users. The ABRIM behavioural collection includes measures of cognitive functioning (i.e., global cognition, processing speed, executive functions, and memory), proxy measures of cognitive reserve (e.g., educational attainment, verbal intelligence, and occupational complexity), and various self-reported questionnaires (e.g., on depressive symptoms, pain, and the use of memory strategies in daily life and during a memory task). In a sub-sample (n = 120), we recorded sleep-wake rhythms using an actigraphy device (Actiwatch 2, Philips Respironics) for a period of 7 consecutive days. Here, we provide an in-depth description of our study protocol, pre-processing pipelines, and data availability. ABRIM provides a cross-sectional database on healthy participants throughout the adult lifespan, including numerous parameters relevant to improve our understanding of cognitive ageing. Therefore, ABRIM enables researchers to model the advanced imaging parameters and cognitive topologies as a function of age, identify the normal range of values of such parameters, and to further investigate the diverse mechanisms of reserve and resilience.
Topics: Humans; Male; Female; Aged; Middle Aged; Adult; Magnetic Resonance Imaging; Brain; Aged, 80 and over; Adolescent; Aging; Young Adult; Memory; Cognition; Cross-Sectional Studies; Neuroimaging; Research Design; Data Collection
PubMed: 38905233
DOI: 10.1371/journal.pone.0306006 -
Frontiers in Psychology 2024Frequency distributions are known to widely affect psycholinguistic processes. The effects of word frequency in turns-at-talk, the nucleus of social action in...
Frequency distributions are known to widely affect psycholinguistic processes. The effects of word frequency in turns-at-talk, the nucleus of social action in conversation, have, by contrast, been largely neglected. This study probes into this gap by applying corpus-linguistic methods on the conversational component of the British National Corpus (BNC) and the Freiburg Multimodal Interaction Corpus (FreMIC). The latter includes continuous pupil size measures of participants of the recorded conversations, allowing for a systematic investigation of patterns in the contained speech and language on the one hand and their relation to concurrent processing costs they may incur in speakers and recipients on the other hand. We test a first hypothesis in this vein, analyzing whether word frequency distributions within turns-at-talk are correlated with interlocutors' processing effort during the production and reception of these turns. Turns are found to generally show a regular distribution pattern of word frequency, with highly frequent words in turn-initial positions, mid-range frequency words in turn-medial positions, and low-frequency words in turn-final positions. Speakers' pupil size is found to tend to increase during the course of a turn at talk, reaching a climax toward the turn end. Notably, the observed decrease in word frequency within turns is inversely correlated with the observed increase in pupil size in speakers, but not in recipients, with steeper decreases in word frequency going along with steeper increases in pupil size in speakers. We discuss the implications of these findings for theories of speech processing, turn structure, and information packaging. Crucially, we propose that the intensification of processing effort in speakers during a turn at talk is owed to an informational climax, which entails a progression from high-frequency, low-information words through intermediate levels to low-frequency, high-information words. At least in English conversation, interlocutors seem to make use of this pattern as one way to achieve efficiency in conversational interaction, creating a regularly recurring distribution of processing load across speaking turns, which aids smooth turn transitions, content prediction, and effective information transfer.
PubMed: 38899128
DOI: 10.3389/fpsyg.2024.1208029 -
Epilepsy & Behavior Reports 2024Around 40% of patients who undergo a left temporal lobe epilepsy (LTLE) surgery suffer from anomia (word-finding difficulties), a condition that negatively impacts...
Around 40% of patients who undergo a left temporal lobe epilepsy (LTLE) surgery suffer from anomia (word-finding difficulties), a condition that negatively impacts quality of life. Despite these observations, language rehabilitation is still understudied in LTLE. We assessed the effect of a four-week rehabilitation on four drug-resistant LTLE patients after their surgery. The anomia rehabilitation was based on cognitive descriptions of word finding deficits in LTLE. Its primary ingredients were psycholinguistic tasks and a psychoeducation approach to help patients cope with daily communication issues. We repeatedly assessed naming skills for trained and untrained words, before and during the therapy using an A-B design with follow-up and replication. Subjective anomia complaint and standardized language assessments were also collected. We demonstrated the effectiveness of the rehabilitation program for trained words despite the persistence of seizures. Furthermore, encouraging results were observed for untrained items. Variable changes in anomia complaint were observed. One patient who conducted the protocol as self-rehabilitation responded similarly to the others, despite the different manner of intervention. These results open promising avenues for helping epileptic patients suffering from anomia. For example, this post-operative program could easily be adapted to be conducted preoperatively.
PubMed: 38881885
DOI: 10.1016/j.ebr.2024.100681 -
Language and Speech Jun 2024Human communication is inherently multimodal. Auditory speech, but also visual cues can be used to understand another talker. Most studies of audiovisual speech...
Human communication is inherently multimodal. Auditory speech, but also visual cues can be used to understand another talker. Most studies of audiovisual speech perception have focused on the perception of speech segments (i.e., speech sounds). However, less is known about the influence of visual information on the perception of suprasegmental aspects of speech like lexical stress. In two experiments, we investigated the influence of different visual cues (e.g., facial articulatory cues and beat gestures) on the audiovisual perception of lexical stress. We presented auditory lexical stress continua of disyllabic Dutch stress pairs together with videos of a speaker producing stress on the first or second syllable (e.g., articulating or ). Moreover, we combined and fully crossed the face of the speaker producing lexical stress on either syllable with a gesturing body producing a beat gesture on either the first or second syllable. Results showed that people successfully used visual articulatory cues to stress in muted videos. However, in audiovisual conditions, we were not able to find an effect of visual articulatory cues. In contrast, we found that the temporal alignment of beat gestures with speech robustly influenced participants' perception of lexical stress. These results highlight the importance of considering suprasegmental aspects of language in multimodal contexts.
PubMed: 38877720
DOI: 10.1177/00238309241258162 -
Molecular Autism Jun 2024Autism and different neurodevelopmental conditions frequently co-occur, as do their symptoms at sub-diagnostic threshold levels. Overlapping traits and shared genetic...
BACKGROUND
Autism and different neurodevelopmental conditions frequently co-occur, as do their symptoms at sub-diagnostic threshold levels. Overlapping traits and shared genetic liability are potential explanations.
METHODS
In the population-based Norwegian Mother, Father, and Child Cohort study (MoBa), we leverage item-level data to explore the phenotypic factor structure and genetic architecture underlying neurodevelopmental traits at age 3 years (N = 41,708-58,630) using maternal reports on 76 items assessing children's motor and language development, social functioning, communication, attention, activity regulation, and flexibility of behaviors and interests.
RESULTS
We identified 11 latent factors at the phenotypic level. These factors showed associations with diagnoses of autism and other neurodevelopmental conditions. Most shared genetic liabilities with autism, ADHD, and/or schizophrenia. Item-level GWAS revealed trait-specific genetic correlations with autism (items r range = - 0.27-0.78), ADHD (items r range = - 0.40-1), and schizophrenia (items r range = - 0.24-0.34). We find little evidence of common genetic liability across all neurodevelopmental traits but more so for several genetic factors across more specific areas of neurodevelopment, particularly social and communication traits. Some of these factors, such as one capturing prosocial behavior, overlap with factors found in the phenotypic analyses. Other areas, such as motor development, seemed to have more heterogenous etiology, with specific traits showing a less consistent pattern of genetic correlations with each other.
CONCLUSIONS
These exploratory findings emphasize the etiological complexity of neurodevelopmental traits at this early age. In particular, diverse associations with neurodevelopmental conditions and genetic heterogeneity could inform follow-up work to identify shared and differentiating factors in the early manifestations of neurodevelopmental traits and their relation to autism and other neurodevelopmental conditions. This in turn could have implications for clinical screening tools and programs.
Topics: Humans; Norway; Female; Male; Phenotype; Child, Preschool; Cohort Studies; Neurodevelopmental Disorders; Mothers; Autistic Disorder; Genetic Predisposition to Disease; Adult; Fathers; Genome-Wide Association Study; Attention Deficit Disorder with Hyperactivity; Schizophrenia; Genetic Heterogeneity
PubMed: 38849897
DOI: 10.1186/s13229-024-00599-0 -
Heliyon Jun 2024The present research study aimed to investigate the psycholinguistic aspects of interlanguage (IL) variability in English as a second language learners from Iran. Three...
The present research study aimed to investigate the psycholinguistic aspects of interlanguage (IL) variability in English as a second language learners from Iran. Three morphological forms were specifically examined in this study: the plural "-s," past tense forms, and present tense forms. In order to investigate the learners' cognitive processes, the researchers used a mixed-method approach, combining qualitative semi-structured interviews with quantitative analysis of written task performance. Under various task conditions, learners exhibited two opposing patterns of IL variability (increasing and decreasing) in their morphological forms. Various degrees of accuracy were noted for every kind of morpheme. Different students allocated their attention differently to form and meaning in both under pressure and relaxed task environments. The observed variations could have been caused by limited working memory and attention capacity in addition to L1 transfer. The research indicated that the field of second language acquisition could benefit from an explanatory approach to comprehend IL variability from the learner's perspective. It provides recommendations for larger-scale research projects in a variety of educational contexts, along with pedagogical implications.
PubMed: 38845964
DOI: 10.1016/j.heliyon.2024.e31582 -
Cognitive Research: Principles and... Jun 2024Multilingual speakers can find speech recognition in everyday environments like restaurants and open-plan offices particularly challenging. In a world where speaking...
Multilingual speakers can find speech recognition in everyday environments like restaurants and open-plan offices particularly challenging. In a world where speaking multiple languages is increasingly common, effective clinical and educational interventions will require a better understanding of how factors like multilingual contexts and listeners' language proficiency interact with adverse listening environments. For example, word and phrase recognition is facilitated when competing voices speak different languages. Is this due to a "release from masking" from lower-level acoustic differences between languages and talkers, or higher-level cognitive and linguistic factors? To address this question, we created a "one-man bilingual cocktail party" selective attention task using English and Mandarin speech from one bilingual talker to reduce low-level acoustic cues. In Experiment 1, 58 listeners more accurately recognized English targets when distracting speech was Mandarin compared to English. Bilingual Mandarin-English listeners experienced significantly more interference and intrusions from the Mandarin distractor than did English listeners, exacerbated by challenging target-to-masker ratios. In Experiment 2, 29 Mandarin-English bilingual listeners exhibited linguistic release from masking in both languages. Bilinguals experienced greater release from masking when attending to English, confirming an influence of linguistic knowledge on the "cocktail party" paradigm that is separate from primarily energetic masking effects. Effects of higher-order language processing and expertise emerge only in the most demanding target-to-masker contexts. The "one-man bilingual cocktail party" establishes a useful tool for future investigations and characterization of communication challenges in the large and growing worldwide community of Mandarin-English bilinguals.
Topics: Humans; Multilingualism; Speech Perception; Adult; Female; Male; Young Adult; Attention; Perceptual Masking; Psycholinguistics
PubMed: 38834918
DOI: 10.1186/s41235-024-00562-w