-
Neurobiology of Stress May 2024Acute stress has various effects on cognition, executive function and certain forms of cost/benefit decision making. Recent studies in rodents indicate that acute stress... (Review)
Review
Acute stress has various effects on cognition, executive function and certain forms of cost/benefit decision making. Recent studies in rodents indicate that acute stress differentially alters reward-related decisions involving particular types of costs and slows choice latencies. Yet, how stress alters decisions where rewards are linked to punishment is less clear. We examined how 1 h restraint stress, followed by behavioral testing 10 min later altered action-selection on two tasks involving reward-seeking under threat of punishment in well-trained male and female rats. One study used a risky decision-making task involving choice between a small/safe reward and a large/risky one that could coincide with shock, delivered with a probability that increased over blocks of trials. Stress increased risk aversion and punishment sensitivity, reducing preference for the larger/risky reward, while increasing decision latencies and trial omissions in both sexes, when rats were teste. A second study used a "behavioral control" task, requiring inhibition of approach towards a readily available reward associated with punishment. Here, food pellets were delivered over discrete trials, half of which coincided with a 12 s audiovisual cue, signalling that reward retrieval prior to cue termination would deliver shock. Stress exerted sex- and timing-dependent effects on inhibitory control. Males became more impulsive and received more shocks on the stress test, whereas females were unaffected on the stress test, and were actually less impulsive when tested 24 h later. None of the effects of restraint stress were recapitulated by systemic treatment with physiological doses of corticosterone. These findings suggest acute stress induces qualitatively distinct and sometimes sex-dependent effects on punished reward-seeking that are critically dependent on whether animals must either choose between different actions or withhold them to obtain rewards and avoid punishment.
PubMed: 38623397
DOI: 10.1016/j.ynstr.2024.100633 -
Biomedicine & Pharmacotherapy =... Sep 2023The endocannabinoid system is prominently implicated in the control of cocaine reinforcement due to its relevant role in synaptic plasticity and neurotransmitter...
The endocannabinoid system is prominently implicated in the control of cocaine reinforcement due to its relevant role in synaptic plasticity and neurotransmitter modulation in the mesocorticolimbic system. The inhibition of fatty acid amide hydrolase (FAAH), and the resulting increase in anandamide and other N-acylethanolamines, represents a promising strategy for reducing drug seeking. In the present study, we aimed to assess the effects of the FAAH inhibitor URB597 (1 mg/kg) on crucial features of cocaine addictive-like behaviour in mice. Therefore, we tested the effects of URB597 on acquisition of cocaine (0.6 mg/kg/inf) self-administration, compulsive-like cocaine intake and cue-induced drug-seeking behaviour during withdrawal. URB597 reduced cocaine intake under conditioned punishment while having no impact on acquisition. This result was associated to increased cannabinoid receptor 1 gene expression in the ventral striatum and medium spiny neurons activation in the nucleus accumbens shell. Moreover, URB597 mitigated cue-induced drug-seeking behaviour during prolonged abstinence and prevented the withdrawal-induced increase in FAAH gene expression in the ventral striatum. In this case, URB597 decreased activation of medium spiny neurons in the nucleus accumbens core. Our findings evidence the prominent role of endocannabinoids in the development of cocaine addictive-like behaviours and support the potential of FAAH inhibition as a therapeutical target for the treatment of cocaine addiction.
Topics: Animals; Mice; Amidohydrolases; Punishment; Substance Withdrawal Syndrome; Cocaine-Related Disorders
PubMed: 37499453
DOI: 10.1016/j.biopha.2023.115194 -
Nature Communications Sep 2023Theoretical and empirical accounts suggest that adolescence is associated with heightened reward learning and impulsivity. Experimental tasks and computational models...
Theoretical and empirical accounts suggest that adolescence is associated with heightened reward learning and impulsivity. Experimental tasks and computational models that can dissociate reward learning from the tendency to initiate actions impulsively (action initiation bias) are thus critical to characterise the mechanisms that drive developmental differences. However, existing work has rarely quantified both learning ability and action initiation, or it has relied on small samples. Here, using computational modelling of a learning task collected from a large sample (N = 742, 9-18 years, 11 countries), we test differences in reward and punishment learning and action initiation from childhood to adolescence. Computational modelling reveals that whilst punishment learning rates increase with age, reward learning remains stable. In parallel, action initiation biases decrease with age. Results are similar when considering pubertal stage instead of chronological age. We conclude that heightened reward responsivity in adolescence can reflect differences in action initiation rather than enhanced reward learning.
Topics: Child; Humans; Adolescent; Punishment; Cognition; Learning; Computer Simulation; Reward
PubMed: 37709750
DOI: 10.1038/s41467-023-41124-w -
PLoS Computational Biology Apr 2024Reputations can foster cooperation by indirect reciprocity: if I am good to you then others will be good to me. But this mechanism for cooperation in one-shot...
Reputations can foster cooperation by indirect reciprocity: if I am good to you then others will be good to me. But this mechanism for cooperation in one-shot interactions only works when people agree on who is good and who is bad. Errors in actions or assessments can produce disagreements about reputations, which can unravel the positive feedback loop between social standing and pro-social behaviour. Cooperators can end up punished and defectors rewarded. Public reputation systems and empathy are two possible mechanisms to promote agreement about reputations. Here we suggest an alternative: Bayesian reasoning by observers. By taking into account the probabilities of errors in action and observation and their prior beliefs about the prevalence of good people in the population, observers can use Bayesian reasoning to determine whether or not someone is good. To study this scenario, we develop an evolutionary game theoretical model in which players use Bayesian reasoning to assess reputations, either publicly or privately. We explore this model analytically and numerically for five social norms (Scoring, Shunning, Simple Standing, Staying, and Stern Judging). We systematically compare results to the case when agents do not use reasoning in determining reputations. We find that Bayesian reasoning reduces cooperation relative to non-reasoning, except in the case of the Scoring norm. Under Scoring, Bayesian reasoning can promote coexistence of three strategic types. Additionally, we study the effects of optimistic or pessimistic biases in individual beliefs about the degree of cooperation in the population. We find that optimism generally undermines cooperation whereas pessimism can, in some cases, promote cooperation.
Topics: Bayes Theorem; Humans; Cooperative Behavior; Game Theory; Computational Biology; Bias
PubMed: 38662682
DOI: 10.1371/journal.pcbi.1011979 -
Frontiers in Psychology 2024The Sensitivity to Punishment and Sensitivity to Reward Questionnaire (SPSRQ) is a self-report tool widely used to assess individuals' level of reinforcement...
Exploratory and confirmatory factor analysis of the sensitivity to punishment and sensitivity to reward questionnaire-revised and its psychometric evaluation among Chinese person with substance use disorder.
The Sensitivity to Punishment and Sensitivity to Reward Questionnaire (SPSRQ) is a self-report tool widely used to assess individuals' level of reinforcement sensitivity. Drug addiction is strongly associated with reinforcement sensitivity, but there is a lack of measurement tools to assess reinforcement sensitivity in drug users, necessitating the revision and application of the SPSRQ among drug users. This study recruited 819 drug users (mean age = 34.74; 56.41% female) from five compulsory rehabilitation centers in Hunan Province, China. The applicability of the SPSRQ among person with substance use disorder was assessed by conducting reliability analyses and validity analyses, with retesting performed by 127 individuals after 6 weeks. Exploratory factor analysis for the SPSRQ showed a stable two-factor structure in person with substance use disorder. Confirmatory factor analysis indicated acceptable goodness of fit indexes for the two-factor structure. The SPSRQ also demonstrated good reliability and convergent and discriminant validity evidence. The two-factor structure of the SPSRQ also demonstrated measurement invariance across gender. Further comparative analysis found that the degree of reward sensitivity was higher for males than for females. Generally, the SPSRQ has shown evidence of good reliability and validity in Chinese drug-dependent populations, and it is suitable for research and application with Chinese person with substance use disorder. These findings about the personality traits of people with substance use disorder provide a solid basis for further research.
PubMed: 38933588
DOI: 10.3389/fpsyg.2024.1351450 -
Philosophical Transactions of the Royal... Mar 2024Human communities teem with a variety of social norms. In order to change unjust and harmful social norms, it is crucial to identify the psychological processes that...
Human communities teem with a variety of social norms. In order to change unjust and harmful social norms, it is crucial to identify the psychological processes that give rise to them. Most researchers take it for granted that social norms are uniquely human. By contrast, we approach this matter from a comparative perspective, leveraging recent research on animal social behaviour. While there is currently only suggestive evidence for norms in nonhuman communities, we argue that human social norms are likely produced by a wide range of mechanisms, many of which we share with nonhuman animals. Approaching this variability from a comparative perspective can help norm researchers expand and reframe the range of hypotheses they test when attempting to understand the causes of socially normative behaviours in humans. First, we diagnose some of the theoretical obstacles to developing a comparative science of social norms, and offer a few basic constructs and distinctions to help norm researchers overcome these obstacles. Then we develop a six-dimensional model of the psychological and social factors that contribute to variability in both human and potential nonhuman norms. This article is part of the theme issue 'Social norm change: drivers and consequences'.
Topics: Humans; Animals; Social Behavior; Social Norms; Behavior, Animal
PubMed: 38244597
DOI: 10.1098/rstb.2023.0026 -
Acta Psychologica Apr 2024This paper explores theories of motivation, including instinct theory, arousal theory, incentive theory, intrinsic theory, extrinsic theory, the ARCS model,... (Review)
Review
This paper explores theories of motivation, including instinct theory, arousal theory, incentive theory, intrinsic theory, extrinsic theory, the ARCS model, self-determination theory, expectancy-value theory, and goal-orientation theory. Each theory is described in detail, along with its key concepts, assumptions, and implications for behavior. Intrinsic theory suggests that individuals are motivated by internal factors like enjoyment and satisfaction, while extrinsic theory suggests that external factors like rewards and social pressure drive behavior. Arousal theory says that to feel motivated, people try to keep an optimal level of activation or excitement. Incentive theory suggests that behavior is driven by the promise of rewards or the threat of punishment. The ARCS model, designed to motivate learners, incorporates elements of attention, relevance, confidence, and satisfaction. Self-determination theory proposes that individuals are motivated by their needs for autonomy, competence, and relatedness. The expectation-value theory suggests that behavior is influenced by individuals' beliefs about their ability to succeed and the value they place on the task. The goal-orientation theory suggests that individuals have different goals for engaging in a behavior. By understanding these different theories of motivation, educators, coaches, managers, and individuals may analyze what drives behavior and how to harness it to achieve their goals. In essence, a nuanced comprehension of these diverse motivation theories equips individuals across varied domains with a strategic toolkit to navigate the complex landscape of human behavior, fostering a more profound understanding of what propels actions and how to channel these insights toward the attainment of overarching goals.
Topics: Humans; Motivation; Personal Autonomy; Reward; Punishment; Social Behavior
PubMed: 38354564
DOI: 10.1016/j.actpsy.2024.104177 -
Physiology & Behavior Dec 2023Individuals differ in their ability to learn from reinforcement and in avoiding punishment, which can be measured by the Probabilistic Selection Task (PST). Recently,...
Individuals differ in their ability to learn from reinforcement and in avoiding punishment, which can be measured by the Probabilistic Selection Task (PST). Recently, some studies have demonstrated that this learning bias is regulated by the dopaminergic system, and that stress can differentially affect the use of positive (i.e., reinforcement) and negative (i.e., avoiding punishment) feedback. The current two studies examined whether performance on the PST can predict measures of goal-directed behaviour as assessed by a cognitive flexibility task (Wisconsin Card Sorting Test) and the acquisition of fear responses, when individuals are exposed to a stressor (Socially Evaluated Cold Pressor Test). A total of 26 and 59 healthy participants completed Experiments I and II, respectively. In those who were best at learning from reinforcement, stress increased the processing (i.e., higher skin conductance responses) of non-threatening stimuli during fear acquisition compared to the non-stressful condition, which was not recapitulated in those who were best at avoiding punishment. Additionally, PST performance did not interact with stress to modulate cognitive flexibility, although stress negatively impaired this domain, consistent with previous findings. Furthermore, independent of stress, both positive and negative learning biases were correlated with cognitive flexibility errors. Our results demonstrate that the PST has predictive value for better understanding the determinants of reinforcement and avoidance learning.
Topics: Humans; Reinforcement, Psychology; Fear; Punishment; Task Performance and Analysis; Reward
PubMed: 37866645
DOI: 10.1016/j.physbeh.2023.114384 -
Science Advances Dec 2023In the mammalian brain, midbrain dopamine neuron activity is hypothesized to encode reward prediction errors that promote learning and guide behavior by causing rapid...
In the mammalian brain, midbrain dopamine neuron activity is hypothesized to encode reward prediction errors that promote learning and guide behavior by causing rapid changes in dopamine levels in target brain regions. This hypothesis (and alternatives regarding dopamine's role in punishment-learning) has limited direct evidence in humans. We report intracranial, subsecond measurements of dopamine release in human striatum measured, while volunteers (i.e., patients undergoing deep brain stimulation surgery) performed a probabilistic reward and punishment learning choice task designed to test whether dopamine release encodes only reward prediction errors or whether dopamine release may also encode adaptive punishment learning signals. Results demonstrate that extracellular dopamine levels can encode both reward and punishment prediction errors within distinct time intervals via independent valence-specific pathways in the human brain.
Topics: Animals; Humans; Dopamine; Punishment; Reward; Learning; Brain; Mammals
PubMed: 38039368
DOI: 10.1126/sciadv.adi4927 -
Neuropsychopharmacology : Official... Feb 2024Serotonin is critical for adapting behavior flexibly to meet changing environmental demands. Cognitive flexibility is important for successful attainment of goals, as...
Serotonin is critical for adapting behavior flexibly to meet changing environmental demands. Cognitive flexibility is important for successful attainment of goals, as well as for social interactions, and is frequently impaired in neuropsychiatric disorders, including obsessive-compulsive disorder. However, a unifying mechanistic framework accounting for the role of serotonin in behavioral flexibility has remained elusive. Here, we demonstrate common effects of manipulating serotonin function across two species (rats and humans) on latent processes supporting choice behavior during probabilistic reversal learning, using computational modelling. The findings support a role of serotonin in behavioral flexibility and plasticity, indicated, respectively, by increases or decreases in choice repetition ('stickiness') or reinforcement learning rates following manipulations intended to increase or decrease serotonin function. More specifically, the rate at which expected value increased following reward and decreased following punishment (reward and punishment 'learning rates') was greatest after sub-chronic administration of the selective serotonin reuptake inhibitor (SSRI) citalopram (5 mg/kg for 7 days followed by 10 mg/kg twice a day for 5 days) in rats. Conversely, humans given a single dose of an SSRI (20 mg escitalopram), which can decrease post-synaptic serotonin signalling, and rats that received the neurotoxin 5,7-dihydroxytryptamine (5,7-DHT), which destroys forebrain serotonergic neurons, exhibited decreased reward learning rates. A basic perseverative tendency ('stickiness'), or choice repetition irrespective of the outcome produced, was likewise increased in rats after the 12-day SSRI regimen and decreased after single dose SSRI in humans and 5,7-DHT in rats. These common effects of serotonergic manipulations on rats and humans-identified via computational modelling-suggest an evolutionarily conserved role for serotonin in plasticity and behavioral flexibility and have clinical relevance transdiagnostically for neuropsychiatric disorders.
Topics: Humans; Rats; Animals; Serotonin; Citalopram; Selective Serotonin Reuptake Inhibitors; Reinforcement, Psychology; Reversal Learning
PubMed: 37914893
DOI: 10.1038/s41386-023-01762-6