-
Behaviour Research and Therapy Jul 2023The restriction of energy intake is a central and persistent symptom of anorexia nervosa. Recent models of the disorder suggest that food restrictions are learned... (Randomized Controlled Trial)
Randomized Controlled Trial
The restriction of energy intake is a central and persistent symptom of anorexia nervosa. Recent models of the disorder suggest that food restrictions are learned avoidance behaviours, which are acquired and maintained by classical and operant conditioning. The present study aims to test this learning model of food restriction. It investigates whether introducing negative consequences for the intake of tasty high-calorie food and introducing positive consequences for its avoidance can create food avoidance, increase fear of food, and decrease eating desires in healthy individuals. 104 women were randomly assigned to an experimental or control condition and completed an appetitive conditioning and avoidance learning task. While the experimental condition received money after avoiding the tasty high-calorie food item and heard an aversive sound after not avoiding food intake, the control condition never received these consequences. In the extinction phase, reward and punishment discontinued for both conditions. We measured avoidance frequency, mouse movements, fear, eating desires and stimulus liking. Participants in the experimental condition avoided the food more often than controls and showed increased fear, reduced eating desires and less liking for cues associated with food intake. These results support the notion that food avoidance behaviours, reduced eating desires and fear of food can be learned via classical and operant conditioning. Conditioning paradigms might be a useful tool to study the development and maintenance of food restriction in anorexia nervosa.
Topics: Female; Humans; Avoidance Learning; Conditioning, Classical; Conditioning, Operant; Cues; Food
PubMed: 37267783
DOI: 10.1016/j.brat.2023.104340 -
Psychopharmacology Jan 2023During operant conditioning, animals associate actions with outcomes. However, patterns and rates of operant responding change over learning, which makes it difficult to...
RATIONALE
During operant conditioning, animals associate actions with outcomes. However, patterns and rates of operant responding change over learning, which makes it difficult to distinguish changes in learning from general changes in performance or movement. Thus, understanding how task parameters influence movement execution is essential.
OBJECTIVES
To understand how specific operant task parameters influenced the repetition of future operant responses, we investigated the ability of operant conditioning schedules and contingencies to promote reproducible bouts of five lever presses in mice.
METHODS
Mice were trained on one of the four operant tasks to test three distinct hypotheses: (1) whether a cue presented concurrently with sucrose delivery influenced the pattern of lever pressing; (2) whether requiring animals to collect earned sucrose promoted the organization of responses into bouts; and (3) whether only reinforcing bouts where interresponse time (IRT) variances were below a target promoted reproducible patterns of operant behavior.
RESULTS
(1) Signaling reinforcer delivery with a cue increased learning rates but resulted in mice pressing the lever in fast succession until the cue turned on, rather than executing discrete bouts. (2) Requiring mice to collect the reinforcer between bouts had little effect on behavior. (3) A training strategy that directly reinforced bouts with low variance IRTs was not more effective than a traditional fixed ratio schedule at promoting reproducible action execution.
CONCLUSIONS
Together, our findings provide insights into the parameters of behavioral training that promote reproducible actions and that should be carefully selected when designing operant conditioning experiments.
Topics: Mice; Animals; Reinforcement Schedule; Conditioning, Operant; Time Factors; Sucrose
PubMed: 36572717
DOI: 10.1007/s00213-022-06298-z -
Neuron Mar 2019Since noxious stimulation usually leads to the perception of pain, pain has traditionally been considered sensory nociception. But its variability and sensitivity to a... (Review)
Review
Since noxious stimulation usually leads to the perception of pain, pain has traditionally been considered sensory nociception. But its variability and sensitivity to a broad array of cognitive and motivational factors have meant it is commonly viewed as inherently imprecise and intangibly subjective. However, the core function of pain is motivational-to direct both short- and long-term behavior away from harm. Here, we illustrate that a reinforcement learning model of pain offers a mechanistic understanding of how the brain supports this, illustrating the underlying computational architecture of the pain system. Importantly, it explains why pain is tuned by multiple factors and necessarily supported by a distributed network of brain regions, recasting pain as a precise and objectifiable control signal.
Topics: Avoidance Learning; Brain; Cognition; Conditioning, Classical; Conditioning, Operant; Humans; Learning; Motivation; Nociception; Pain; Pain Perception; Reinforcement, Psychology
PubMed: 30897355
DOI: 10.1016/j.neuron.2019.01.055 -
Scientific Reports Oct 2023Despite the popularity of fiber photometry (FP), its integration with operant behavior paradigms is progressing slowly. This can be attributed to the complex protocols...
Despite the popularity of fiber photometry (FP), its integration with operant behavior paradigms is progressing slowly. This can be attributed to the complex protocols in operant behavior - resulting in a combination of diverse non-predictable behavioral responses and scheduled events, thereby complicating data analysis. To overcome this, we developed Pyfiber, an open-source python library which facilitates the merge of FP with operant behavior by relating changes in fluorescent signals within a neuronal population to behavioral responses and events. Pyfiber helps to 1. Extract events and responses that occur in operant behavior, 2. Extract and process the FP signals, 3. Select events of interest and align them to the corresponding FP signals, 4. Apply appropriate signal normalization and analysis according to the type of events, 5. Run analysis on multiple individuals and sessions, 6. Collect results in an easily readable format. Pyfiber is suitable for use with many different fluorescent sensors and operant behavior protocols. It was developed using Doric lenses FP systems and Imetronic behavioral systems, but it possesses the capability to process data from alternative systems. This work sets a solid foundation for analyzing the relationship between different dimensions of complex behavioral paradigms with fluorescent signals from brain regions of interest.
Topics: Humans; Brain; Photometry; Neurons; Conditioning, Operant
PubMed: 37783729
DOI: 10.1038/s41598-023-43565-1 -
ELife Aug 2023Head-fixed behavioral experiments in rodents permit unparalleled experimental control, precise measurement of behavior, and concurrent modulation and measurement of...
Head-fixed behavioral experiments in rodents permit unparalleled experimental control, precise measurement of behavior, and concurrent modulation and measurement of neural activity. Here, we present OHRBETS (Open-Source Head-fixed Rodent Behavioral Experimental Training System; pronounced 'Orbitz'), a low-cost, open-source platform of hardware and software to flexibly pursue the neural basis of a variety of motivated behaviors. Head-fixed mice tested with OHRBETS displayed operant conditioning for caloric reward that replicates core behavioral phenotypes observed during freely moving conditions. OHRBETS also permits optogenetic intracranial self-stimulation under positive or negative operant conditioning procedures and real-time place preference behavior, like that observed in freely moving assays. In a multi-spout brief-access consumption task, mice displayed licking as a function of concentration of sucrose, quinine, and sodium chloride, with licking modulated by homeostatic or circadian influences. Finally, to highlight the functionality of OHRBETS, we measured mesolimbic dopamine signals during the multi-spout brief-access task that display strong correlations with relative solution value and magnitude of consumption. All designs, programs, and instructions are provided freely online. This customizable platform enables replicable operant and consummatory behaviors and can be incorporated with methods to perturb and record neural dynamics in vivo.
Topics: Mice; Animals; Conditioning, Operant; Reward; Behavior, Animal; Sucrose; Consummatory Behavior
PubMed: 37555578
DOI: 10.7554/eLife.86183 -
The Neuroscientist : a Review Journal... Apr 2015People with incomplete spinal cord injury (SCI) frequently suffer motor disabilities due to spasticity and poor muscle control, even after conventional therapy. Abnormal... (Review)
Review
People with incomplete spinal cord injury (SCI) frequently suffer motor disabilities due to spasticity and poor muscle control, even after conventional therapy. Abnormal spinal reflex activity often contributes to these problems. Operant conditioning of spinal reflexes, which can target plasticity to specific reflex pathways, can enhance recovery. In rats in which a right lateral column lesion had weakened right stance and produced an asymmetrical gait, up-conditioning of the right soleus H-reflex, which increased muscle spindle afferent excitation of soleus, strengthened right stance and eliminated the asymmetry. In people with hyperreflexia due to incomplete SCI, down-conditioning of the soleus H-reflex improved walking speed and symmetry. Furthermore, modulation of electromyographic activity during walking improved bilaterally, indicating that a protocol that targets plasticity to a specific pathway can trigger widespread plasticity that improves recovery far beyond that attributable to the change in the targeted pathway. These improvements were apparent to people in their daily lives. They reported walking faster and farther, and noted less spasticity and better balance. Operant conditioning protocols could be developed to modify other spinal reflexes or corticospinal connections; and could be combined with other therapies to enhance recovery in people with SCI or other neuromuscular disorders.
Topics: Animals; Conditioning, Operant; Electromyography; H-Reflex; Humans; Muscle, Skeletal; Neuronal Plasticity; Rats; Recovery of Function; Spinal Cord Injuries; Walking
PubMed: 24636954
DOI: 10.1177/1073858414527541 -
The Journal of Neuroscience : the... May 2023The mesolimbic dopamine system is implicated in signaling reward-related information as well as in actions that generate rewarding outcomes. These implications are...
The mesolimbic dopamine system is implicated in signaling reward-related information as well as in actions that generate rewarding outcomes. These implications are commonly investigated in either pavlovian or operant reinforcement paradigms, where only the latter requires instrumental action. To parse contributions of reward- and action-related information to dopamine signals, we directly compared the two paradigms: male rats underwent either pavlovian or operant conditioning while dopamine release was measured in the nucleus accumbens, a brain region central for processing this information. Task conditions were identical with the exception of the operant-lever response requirement. Rats in both groups released the same quantity of dopamine at the onset of the reward-predictive cue. However, only the operant-conditioning group showed a subsequent, sustained plateau in dopamine concentration throughout the entire 5 s cue presentation (preceding the required action). This dopamine ramp was unaffected by probabilistic reward delivery, occurred exclusively before operant actions, and was not related to task performance or task acquisition as it persisted throughout the 2 week daily behavioral training. Instead, the ramp flexibly increased in duration with longer cue presentation, seemingly modulating the initial cue-onset-triggered dopamine release, that is, the reward prediction error (RPE) signal, as both signal amplitude and sustainment diminished when reward timing was made more predictable. Thus, our findings suggest that RPE and action components of dopamine release can be differentiated temporally into phasic and ramping/sustained signals, respectively, where the latter depends on the former and presumably reflects the anticipation or incentivization of appetitive action, conceptually akin to motivation. It is unclear whether the components of dopamine signals that are related to reward-associated information and reward-driven approach behavior can be separated. Most studies investigating the dopamine system use either pavlovian or operant conditioning, which both involve the delivery of reward and necessitate appetitive approach behavior. Thus, used exclusively, neither paradigm can disentangle the contributions of these components to dopamine release. However, by combining both paradigms in the same study, we find that anticipation of a reward-driven operant action induces a modulation of reward-prediction-associated dopamine release, producing so-called dopamine ramps. Therefore, our findings provide new insight into dopamine ramps and suggest that dopamine signals integrate reward and appetitive action in a temporally distinguishable, yet dependent, manner.
Topics: Rats; Male; Animals; Dopamine; Nucleus Accumbens; Rats, Sprague-Dawley; Reinforcement, Psychology; Reward; Conditioning, Operant; Motivation; Cues
PubMed: 37185100
DOI: 10.1523/JNEUROSCI.1527-22.2023 -
Frontiers in Neural Circuits 2017Recent advances in neuroimaging and genetics have made mice an advantageous animal model for studying the neurophysiology of sensation, cognition, and locomotion. A key...
Recent advances in neuroimaging and genetics have made mice an advantageous animal model for studying the neurophysiology of sensation, cognition, and locomotion. A key benefit of mice is that they provide a large population of test subjects for behavioral screening. Reflex-based assays of hearing in mice, such as the widely used acoustic startle response, are less accurate than operant conditioning in measuring auditory processing. To date, however, there are few cost-effective options for scalable operant conditioning systems. Here, we describe a new system for automated operant conditioning, the Psibox. It is assembled from low cost parts, designed to fit within typical commercial wire-top cages, and allows large numbers of mice to train independently in their home cages on positive reinforcement tasks. We found that groups of mice trained together learned to accurately detect sounds within 2 weeks of training. In addition, individual mice isolated from groups also showed good task performance. The Psibox facilitates high-throughput testing of sensory, motor, and cognitive skills in mice, and provides a readily available animal population for studies ranging from experience-dependent neural plasticity to rodent models of mental disorders.
Topics: Animals; Auditory Perception; Behavior, Animal; Behavioral Research; Conditioning, Operant; Female; Male; Mice; Mice, Inbred C57BL; Models, Animal
PubMed: 28298887
DOI: 10.3389/fncir.2017.00010 -
Journal of Neurophysiology Jan 2023Retinoic acid, the active metabolite of vitamin A, is important for vertebrate cognition and hippocampal plasticity, but few studies have examined its role in...
Retinoic acid, the active metabolite of vitamin A, is important for vertebrate cognition and hippocampal plasticity, but few studies have examined its role in invertebrate learning and memory, and its actions in the invertebrate central nervous system are currently unknown. Using the mollusc , we examined operant conditioning of the respiratory behavior, controlled by a well-defined central pattern generator (CPG), and used citral to inhibit retinoic acid signaling. Both citral- and vehicle-treated animals showed normal learning, but citral-treated animals failed to exhibit long-term memory at 24 h. Cohorts of citral- or vehicle-treated animals were dissected into semi-intact preparations, either 1 h after training, or after the memory test 24 h later. Simultaneous electrophysiological recordings from the CPG pacemaker cell (right pedal dorsal 1; RPeD1) and an identified motorneuron (VI) were made while monitoring respiratory activity (pneumostome opening). Activity of the CPG pneumostome opener interneuron (input 3 interneuron; IP3) was also monitored indirectly. Vehicle-treated conditioned preparations showed significant changes in network parameters immediately after learning, such as reduced motorneuron bursting activity (from IP3 input), delayed pneumostome opening, and decoupling of coincident IP3 input within the network. However, citral-treated preparations failed to exhibit these network changes and more closely resembled naïve preparations. Importantly, these citral-induced differences were manifested immediately after training and before any overt changes in the behavioral response (memory impairment). These studies shed light on where and when retinoid signaling might affect a central pattern-generating network to promote memory formation during conditioning of a homeostatic behavior. We provide novel evidence for how conditioning-induced changes in a CPG network are disrupted when retinoid signaling is inhibited. Inhibition of retinoic acid signaling prevents long-term memory formation following operant conditioning, but has no effect on learning. Simultaneous electrophysiological and behavioral analyses indicate network changes immediately following learning, but these changes are prevented with inhibition of retinoid signaling, before any overt changes in behavior. These data suggest sites for retinoid actions during memory formation.
Topics: Animals; Retinoids; Memory, Long-Term; Acyclic Monoterpenes; Conditioning, Operant; Tretinoin; Lymnaea
PubMed: 36448682
DOI: 10.1152/jn.00270.2022 -
Alcohol (Fayetteville, N.Y.) Mar 2018Alcohol operant self-administration paradigms are critical tools for studying the neural circuits implicated in both alcohol-seeking and consummatory behaviors and for...
Alcohol operant self-administration paradigms are critical tools for studying the neural circuits implicated in both alcohol-seeking and consummatory behaviors and for understanding the neural basis underlying alcohol-use disorders. In this study, we investigate the predictive value of two operant models of oral alcohol self-administration in mice, one in which alcohol is delivered into a cup following nose-poke responses with no accurate measurement of consumed alcohol solution, and another paradigm that provides access to alcohol via a sipper tube following lever presses and where lick rate and consumed alcohol volume can be measured. The goal was to identify a paradigm where operant behaviors such as lever presses and nose pokes, as well as other tracked behavior such as licks and head entries, can be used to reliably predict blood alcohol concentration (BAC). All mice were first exposed to alcohol in the home cage using the "drinking in the dark" (DID) procedure for 3 weeks and then were trained in alcohol self-administration using either of the operant paradigms for several weeks. Even without sucrose fading or food pre-training, mice acquired alcohol self-administration with both paradigms. However, neither lever press nor nose-poke rates were good predictors of alcohol intake or BAC. Only the lick rate and consumed alcohol were consistently and significantly correlated with BAC. Using this paradigm that accurately measures alcohol intake, unsupervised cluster analysis revealed three groups of mice: high-drinking (43%), low-drinking (37%), and non-drinking mice (20%). High-drinking mice showed faster acquisition of operant responding and achieved higher BACs than low-drinking mice. Lick rate and volume consumed varied with the alcohol concentration made available only for high- and low-drinking mice, but not for non-drinking mice. In addition, high- and low-drinking mice showed similar patterns during extinction and significant cue-induced reinstatement of seeking. Only high-drinking mice showed insensitivity to quinine adulteration, indicating a willingness to drink alcohol despite pairing with aversive stimuli. Thus, this study shows that relying on active presses is not an accurate determination of drinking behavior in mice. Only paradigms that allow for accurate measurements of consumed alcohol and/or lick rate are valid models of operant alcohol self-administration, where compulsive-like drinking could be accurately determined based on changes in alcohol intake when paired with bitter-tasting stimuli.
Topics: Alcohol Drinking; Animals; Behavior, Addictive; Conditioning, Operant; Dose-Response Relationship, Drug; Ethanol; Extinction, Psychological; Female; Forecasting; Male; Mice; Mice, Inbred C57BL; Self Administration
PubMed: 29310048
DOI: 10.1016/j.alcohol.2017.08.008