Post-learning infusion of anisomycin into the anterior cingulate cortex impairs instrumental acquisition through an effect on reinforcer valuation

The integrity of the rodent anterior cingulate cortex (ACC) is essential for various aspects of instrumental behavior, but it is not clear if the ACC is important for the acquisition of a simple instrumental response. Here, it was demonstrated that post-session infusions of anisomycin into the rat ACC completely prevented the acquisition of instrumental responding. The experimental use of post-session intracranial infusions of plasticity inhibitors is assumed to affect local consolidation of plasticity, but not behavioral task performance. However, in associative appetitive conditioning, post-session intracranial infusion of pharmaco-active compounds could actually interfere with subsequent task performance indirectly through retrospective effects on the valuation of ingested rewards. Thus, it was subsequently demonstrated that the intracranial infusion of anisomycin into the ACC after sucrose pellet consumption significantly reduced subsequent pellet consumption, suggesting that the infusion of anisomycin into the ACC produced conditioned taste avoidance. In the third experiment, an innovative procedure was introduced that dissociated the effects of intracranial infusions after conditioning sessions on task-learning and unconditioned stimulus valuation. With this procedure, the infusion of anisomycin into the ACC after instrumental sessions did not affect instrumental reinforcer valuation or the acquisition of instrumental responding, suggesting that plasticity in the ACC is not necessary for the acquisition of instrumental behavior.The anterior cingulate cortex (ACC) in the rodent brain is the area of association cortex that is most intimately associated with movement control, as it has direct corticospinal projections to motor neurons (Miller 1987) and is intricately connected with motor and premotor cortex (Brecht et al. 2004; Wang et al. 2008), and movement-related discharges in motivated tasks have been observed in the ACC (Jung et al. 1998; Kargo et al. 2007). On the basis of these findings, the ACC has been described as the limbic motor cortex (Craig 2003). Indeed, it has been demonstrated that neural activity in the ACC codes for performed actions and observed appetitive outcomes (Lapish et al. 2008), suggesting that the ACC could be important for instrumental conditioning. However, it is currently unclear whether the role of the ACC in instrumental conditioning is restricted to relatively complex instrumental tasks with response conflict (Lapish et al. 2008) and high response efforts (Rudebeck et al. 2006), or whether it extends generally to the acquisition of a simple appetitively motivated instrumental response as well. For example, it has been reported that the acquisition of instrumental responding under variable ratio 2 schedule of reinforcement was impaired after presession intra-ACC infusions of the N-methyl-d-aspartate (NMDA) receptor antagonist AP-5 (McKee et al. 2007).However, the practical investigation of the neural basis of learning is complicated by what can be considered as “side effects” of manipulations that are intended to interfere selectively with learning mechanisms. Both pretraining lesions and presession infusions of pharmacological agents into specific brain regions can produce interference with basic task performance in addition to impairing task-related learning. This problem can be overcome by the use of infusions of pharmacological agents after a behavioral conditioning session, specifically to target the consolidation of learning. Positive effects of post-session intracranial infusions of protein synthesis inhibitors such as anisomycin (Rosenblum et al. 1993), or NMDA, and dopamine receptor antagonists such as AP-5 or SCH 23390 (Dalley et al. 2005) on the acquisition of conditioned responses can be interpreted more confidently in terms of interference with learning, at least when combined with negative effects in delayed-infusion control groups. Certainly, positive effects of post-session infusions on learning in the absence of effects of delayed control infusions cannot be attributed to interference with task performance.Nevertheless, post-session intracranial infusions may still cause confounding effects on conditioned behavior in appetitive conditioning experiments, by changing the valuation of the unconditioned stimulus (US), or reward, in subsequent sessions. Such manipulations could reduce the valuation of rewards either through interference with consolidation or reconsolidation of the sensory or motivational properties of the US (Wang et al. 2005; Pedroza-Llinás et al. 2009), which would lead to persistent neophobia, or through retrospective devaluation of the task reward through the post-ingestion induction of an aversive state. Neither effect would be expected to be apparent in delayed-infusion control conditions. Furthermore, considering that animals typically earn far fewer rewards in conditioning sessions than they would maximally consume if rewards were freely available, such effects would not necessarily be visible in terms of consumption of earned rewards and unaffected latencies to collect rewards.In view of these considerations, the effect of the infusion of anisomycin into the rat ACC after instrumental sessions on the acquisition of conditioned responding was investigated. Based on the obtained results, it was further investigated whether the infusion of anisomycin into the ACC after free consumption of a novel reward would affect subsequent pellet consumption. Finally, a third experiment was conducted that introduced an innovative procedure that was designed to dissociate the effects of intracranial infusion of protein synthesis inhibitors after conditioning sessions on task-learning and US valuation.     

Lesions of the dorsolateral or dorsomedial striatum impair performance of a previously acquired simple discrimination task

Previous evidence has suggested a specific role for the dorsal striatum, especially the dorsolateral region of the dorsal striatum, in stimulus-response learning. In a previous study, we found an impairment in animals with dorsolateral striatal lesions on a simple discrimination task (CS+/CS-), thought to require the involvement of both stimulus-reward and stimulus-response learning. It is possible that the generally poor performance of dorsolateral lesioned animals on this experiment precluded adequate exposure to stimulus-reward pairings necessary for solving this task, and, thus, had little to do with stimulus-response learning. To test this hypothesis, the performance of animals with dorsolateral and dorsomedial striatal lesions was assessed on a previously acquired simple discrimination task. To independently assess the effects of each lesion on the performance of stimulus-reward learning, dorsolateral and dorsomedial lesioned animals were assessed on a previously acquired conditioned place preference task (CPP). In agreement with our earlier experiment, and the stimulus-response interpretation of dorsolateral striatal function, animals with dorsolateral striatal lesions were found to be impaired during post-lesion performance of the simple discrimination task, but not CPP learning. Additionally, dorsomedial lesioned animals were found to be impaired in performance of the simple discrimination task, but not on the CPP task. Possible explanations for the differences between the role of the dorsomedial striatum in acquisition and expression of the simple discrimination task are proposed.     

Inhibiting PKMζ reveals dorsal lateral and dorsal medial striatum store the different memories needed to support adaptive behavior

Evidence suggests that two regions of the striatum contribute differential support to instrumental response selection. The dorsomedial striatum (DMS) is thought to support expectancy-mediated actions, and the dorsolateral striatum (DLS) is thought to support habits. Currently it is unclear whether these regions store task-relevant information or just coordinate the learning and retention of these solutions by other brain regions. To address this issue, we developed a two-lever concurrent variable-interval reinforcement operant conditioning task and used it to assess the trained rat's sensitivity to contingency shifts. Consistent with the view that these two regions make different contributions to actions and habits, injecting the NMDA antagonist DL-AP5 into the DMS just prior to the shift impaired the rat's performance but enhanced performance when injected into the DLS. To determine if these regions support memory content, we first trained rats on a biased concurrent schedule (Lever 1: VI 40" and Lever 2: VI 10"). With the intent of "erasing" the memory content stored in striatum, after this training we inhibited the putative memory-maintenance protein kinase C isozyme protein kinase Mζ (PKMζ). Infusing zeta inhibitory peptide (ZIP) into the DLS enhanced the rat's ability to adapt to the contingency shift 2 d later, whereas injecting it into the DMS had the opposite effect. Infusing GluR2(3Y) into the DMS 1 h before ZIP infusions prevented ZIP from impairing the rat's sensitivity to the contingency shift. These results support the hypothesis that the DMS stores information needed to support actions and the DLS stores information needed to support habits.     

Acetylcholine activity in selective striatal regions supports behavioral flexibility

Daily living often requires individuals to flexibly respond to new circumstances. There is considerable evidence that the striatum is part of a larger neural network that supports flexible adaptations. Cholinergic interneurons are situated to strongly influence striatal output patterns which may enable flexible adaptations. The present experiments investigated whether acetylcholine actions in different striatal regions support behavioral flexibility by measuring acetylcholine efflux during place reversal learning. Acetylcholine efflux selectively increased in the dorsomedial striatum, but not dorsolateral or ventromedial striatum during place reversal learning. In order to modulate the M2-class of autoreceptors, administration of oxotremorine sesquifumurate (100 nM) into the dorsomedial striatum, concomitantly impaired reversal learning and an increase in acetylcholine output. These effects were reversed by the m(2) muscarinic receptor antagonist, AF-DX-116 (20 nM). The effects of oxotremorine sesquifumurate and AF-DX-116 on acetylcholine efflux were selective to behaviorally-induced changes as neither treatment affected acetylcholine output in a resting condition. In contrast to reversal learning, acetylcholine efflux in the dorsomedial striatum did not change during place acquisition. The results reveal an essential role for cholinergic activity and define its locus of control to the dorsomedial striatum in cognitive flexibility.     

Differential involvement of M1-type and M4-type muscarinic cholinergic receptors in the dorsomedial striatum in task switching

Previous experiments have demonstrated that the rat dorsomedial striatum is one brain area that plays a crucial role in learning when conditions require a shift in strategies. Further evidence indicates that muscarinic cholinergic receptors in this brain area support adaptations in behavioral responses. Unknown is whether specific muscarinic receptor subtypes in the dorsomedial striatum contribute to a flexible shift in response patterns. The present experiments investigated whether blockade of M1-type and/or M4-type cholinergic receptors in the dorsomedial striatum underlie place reversal learning. Experiment 1 investigated the effects of the M1-type muscarinic cholinergic antagonist, muscarinic-toxin 7 (MT-7) infused into the dorsomedial striatum in place acquisition and reversal learning. Experiment 2 investigated the effects of the M4-type muscarinic cholinergic antagonist, muscarinic-toxin 3 (MT-3) injected into the dorsomedial striatum in place acquisition and reversal learning. All testing occurred in a modified cross-maze across two consecutive sessions. Bilateral injections of MT-7 into the dorsomedial striatum at 1 or 2 microg, but not 0.05 microg impaired place reversal learning. Analysis of the errors revealed that MT-7 at 1 and 2 microg significantly increased regressive errors, but not perseverative errors. An injection of MT-7 2 microg into the dorsomedial striatum prior to place acquisition did not affect learning. Experiment 2 revealed that dorsomedial striatal injections of MT-3 (0.05, 1 or 2 microg) did not affect place acquisition or reversal learning. The findings suggest that activation of M1-type muscarinic cholinergic receptors in the dorsomedial striatum, but not M4-type muscarinic cholinergic receptors facilitate the flexible shifting of response patterns by maintaining or learning a new choice pattern once selected.     

NMDA and muscarinic receptors of the nucleus accumbens have differential effects on taste memory formation

Animals recognize a taste cue as aversive when it has been associated with post-ingestive malaise; this associative learning is known as conditioned taste aversion (CTA). When an animal consumes a new taste and no negative consequences follow, it becomes recognized as a safe signal, leading to an increase in its consumption in subsequent presentations (attenuation of neophobia, AN). It has been shown that the nucleus accumbens (NAcc) has an important role in taste learning. To elucidate the involvement of N-methyl-D-aspartate (NMDA) and muscarinic receptors in the NAcc during safe and aversive taste memory formation, we administrated bilateral infusions of DL-2-amino-5-phosphonopentanoic acid (APV) or scopolamine in the NAcc shell or core respectively. Our results showed that pre-training injections of APV in the NAcc core and shell disrupted aversive but not safe taste memory formation, whereas pre-training injections of scopolamine in the NAcc shell, but not core, disrupted both CTA and AN. These results suggest that muscarinic receptors seem to be necessary for processing taste stimuli for either safe or aversive taste memory, whereas NMDA receptors are only involved in the aversive taste memory trace formation.     

A behavioral economic analysis of concurrently available money and cigarettes.

In economic terms, consumption of a reinforcer is determined by its price and the availability and price of other reinforcers. This study examined the effects of response-requirement (i.e., price) manipulations on the self-administration of two concurrently available reinforcers. Six cigarette smokers participated in 4-hr sessions in which money and puffs on a cigarette were concurrently available according to fixed-ratio schedules of reinforcement. Once stable responding was obtained with both reinforcers available at Fixed Ratio 100, the response requirement for one reinforcer was systematically varied (Fixed Ratio 1,000 and 2,500), while the other reinforcer remained scheduled at Fixed Ratio 100. Increasing the fixed-ratio size for a reinforcer decreased its consumption, with a greater decrease occurring for monetary reinforcement. This finding was quantified in economic terms as own-price elasticity, with elasticity coefficients greater for money than cigarettes. The effects of fixed-ratio size on response output also differed across the two reinforcers. Although greater responding occurred for money at Fixed Ratio 100, increases in fixed-ratio size (for money) decreased responding for money, whereas the same increase in fixed-ratio size (for puffs) increased responding for puffs. Finally, increasing the fixed-ratio size for one reinforcer had little effect on consumption of the other concurrently available reinforcer. This finding was quantified as cross-price elasticity, with elasticity coefficients near 0.0 for most subjects, indicating little or no reinforcer interaction. The results indicate that the reinforcing effects of cigarettes and money in the setting studied here differed, and that the effects produced by changing the price of one reinforcer did not interact with the consumption of the other concurrently available reinforcer.     

Parallel associative processing in the dorsal striatum: segregation of stimulus-response and cognitive control subregions

Although evidence suggests that the dorsal striatum contributes to multiple learning and memory functions, there nevertheless remains considerable disagreement on the specific associative roles of different neuroanatomical subregions. We review evidence indicating that the dorsolateral striatum (DLS) is a substrate for stimulus–response habit formation – incremental strengthening of simple S–R bonds – via input from sensorimotor neocortex while the dorsomedial striatum (DMS) contributes to behavioral flexibility – the cognitive control of behavior – via prefrontal and limbic circuits engaged in relational and spatial information processing. The parallel circuits through dorsal striatum interact with incentive/affective motivational processing in the ventral striatum and portions of the prefrontal cortex leading to overt responding under specific testing conditions. Converging evidence obtained through a detailed task analysis and neurobehavioral assessment is beginning to illuminate striatal subregional interactions and relations to the rest of the mammalian brain.     

The role of nucleus accumbens dopamine in outcome encoding in instrumental and Pavlovian conditioning

Considerable evidence suggests that dopamine in the core subregion of the nucleus accumbens is not only involved in Pavlovian conditioning but also supports instrumental performance. However, it is largely unknown whether NAc dopamine is required for outcome encoding which plays an important role both in Pavlovian stimulus-outcome learning and instrumental action-outcome learning. Therefore, we tested rats with 6-hydroxydopamine (6-OHDA) induced dopamine depletion of the NAc core for their sensitivity to outcome devaluation in a Pavlovian and an instrumental task. Results indicate that 6-OHDA-lesioned animals were sensitive to outcome devaluation in an instrumental task. This finding provides support to the notion that NAc core dopamine may not be crucial in encoding action-outcome associations. However, during instrumental conditioning lever pressing rates in 6-OHDA-lesioned animals were markedly lower which could reflect an impaired behavioral activation. By contrast, after outcome-specific devaluation in a Pavlovian task, performance in 6-OHDA-lesioned animals was impaired, i.e. their magazine-directed responding was non-selectively reduced. One possibility to explain non-selective responding is that NAc core DA depletion impaired the ability of conditioned stimuli to activate the memory of the current value of the reinforcer.     

Acquisition of instrumental conditioned reinforcement is resistant to the devaluation of the unconditioned stimulus

The associative mechanisms responsible for the efficacy of Pavlovian stimuli during first- and second-order conditioning have been extensively studied, but little is known about the representations underlying instrumental conditioned reinforcement. The present study investigated the associative structure underlying conditioned reinforcement, by employing an unconditioned stimulus (US) devaluation procedure on a commonly used instrumental task: the acquisition of a new response with conditioned reinforcement. Whilst US-directed behaviour was abolished following devaluation, the conditioned stimulus acting as a conditioned reinforcer supported the acquisition of instrumental responding. In this preparation then, the conditioned reinforcer appears to be impervious to devaluation of its associated US, suggesting that the underlying representation maintaining behaviour is independent of the current value of the US and may reflect the activation of a central appetitive motivational state.     

Relations between Pavlovian-instrumental transfer and reinforcer devaluation

Relations between posttraining reinforcer devaluation and Pavlovian-instrumental transfer were examined in 2 experiments. When a single reinforcer was used, extended training of the instrumental response increased transfer but reduced devaluation effects. When multiple instrumental reinforcers were used, both reinforcer-specific transfer and devaluation effects were less influenced by the amount of instrumental training. Finally, although reinforcer devaluation decreased both Pavlovian conditioned responses and baseline instrumental responding, it had no effect on either single-reinforcer or reinforcer-specific transfer. These results indicate that transfer and reinforcer devaluation can reflect different aspects of associative learning and that the nature of associative learning can be influenced by parameters such as the amount of training and the use of multiple reinforcers.     

The influence of NMDA receptors in the dorsomedial striatum on response reversal learning

In mammals, the dorsomedial striatum is one brain area shown to be critical for the flexible shifting of response patterns. At present, the neurochemical mechanisms that underlie learning during a shift in response patterns are unknown. The present study examined the effects of NMDA competitive antagonist, DL-2-amino-5-phosphonopentanoic acid (AP-5), injected into the dorsomedial striatum on the acquisition and reversal of a response discrimination. Male Long-Evans rats were tested across two consecutive days in a modified cross-maze. Rats received an infusion of either saline or AP-5 (5 or 25 nmol) 5 min prior to each test session. In the acquisition phase rats learned to turn in one direction (right or left) to receive a cereal reinforcement. In the reversal learning phase rats learned to turn in the opposite direction as in the acquisition phase. In both phases, criterion was achieved when a rat made 10 consecutive correct trials. Infusions of AP-5 did not impair acquisition, but impaired reversal learning of a response discrimination in a dose-dependent fashion. The reversal learning deficit induced by AP-5 resulted from reversions back to the originally learned response pattern following the initial shift. These results suggest that activation of NMDA receptors in the dorsomedial striatum are critical for the flexible shifting of response patterns by enhancing the reliable execution of a new response pattern under changing task contingencies.     

Long-term memory for instrumental responses does not undergo protein synthesis-dependent reconsolidation upon retrieval

Recent evidence indicates that certain forms of memory, upon recall, may return to a labile state requiring the synthesis of new proteins in order to preserve or reconsolidate the original memory trace. While the initial consolidation of "instrumental memories" has been shown to require de novo protein synthesis in the nucleus accumbens, it is not known whether memories of this type undergo protein synthesis-dependent reconsolidation. Here we show that low doses of the protein synthesis inhibitor anisomycin (ANI; 5 or 20 mg/kg) administered systemically in rats immediately after recall of a lever-pressing task potently impaired performance on the following daily test sessions. We determined that the nature of this impairment was attributable to conditioned taste aversion (CTA) to the sugar reinforcer used in the task rather than to mnemonic or motoric impairments. However, by substituting a novel flavored reinforcer (chocolate pellets) prior to the administration of doses of ANI (150 or 210 mg/kg) previously shown to cause amnesia, a strong CTA to chocolate was induced sparing any aversion to sugar. Importantly, when sugar was reintroduced on the following session, we found that memory for the task was not significantly affected by ANI. Thus, these data suggest that memory for a well-learned instrumental response does not require protein synthesis-dependent reconsolidation as a means of long-term maintenance.     

Effects of acute and chronic flunitrazepam on delay discounting in pigeons

Delay to delivery of a reinforcer can decrease responding for that reinforcer and increase responding for smaller reinforcers that are available concurrently and delivered without delay; acute administration of drugs can alter responding for large, delayed reinforcers, although the impact of chronic treatment on delay discounting is not well understood. In this experiment, the effects of repeated administration of the benzodiazepine flunitrazepam were studied in 6 pigeons responding on one key to receive food that was delivered immediately and on a second key to receive a larger amount of food that was delivered following delays which increased across a single session. Pigeons responded predominantly for the large reinforcer when there were no delays and when delays were short; however, as delays increased, responding for the large reinforcer decreased. Acutely, flunitrazepam (0.32, 1.0 and 3.2 mg/kg) dose-dependently increased responding for the large reinforcer, shifting the discounting curve rightward and upward. Repeated administration of flunitrazepam (0.32, 1.0 and 3.2 mg/kg, each for six sessions, separated by one session during which vehicle was administered) did not markedly alter its effects on responding for the large reinforcer, indicating that the development of tolerance to this effect of flunitrazepam is modest under these conditions.     

Contributions of dorsal striatal subregions to spatial alternation behavior

Considerable evidence has shown a clear dissociation between the dorsomedial (DMS) and the dorsolateral (DLS) striatum in instrumental conditioning. In particular, DMS activity is necessary to form action-outcome associations, whereas the DLS is required for developing habitual behavior. However, few studies have investigated whether a similar dissociation exists in more complex goal-directed learning processes. The present study examined the role of the two structures in such complex learning by analyzing the effects of excitotoxic DMS and DLS lesions during the acquisition and extinction of spatial alternation behavior, in a continuous alternation T-maze task. We demonstrate that DMS and DLS lesions have opposite effects, the former impairing and the latter improving animal performance during learning and extinction. DMS lesions may impair the acquisition of spatial alternation behavior by disrupting the signal necessary to link a goal with a specific spatial sequence. In contrast, DLS lesions may accelerate goal-driven strategies by minimizing the influence of external stimuli on the response, thus increasing the impact of action-reward contingencies. Taken together, these results suggest that DMS- and DLS-mediated learning strategies develop in parallel and compete for the control of the behavioral response early in learning.     

The effect of the instrumental training contingency on susceptibility to reinforcer devaluation

Two experiments investigated performance of instrumental lever pressing by rats following post-conditioning devaluation of the sucrose reinforcer produced by establishing an aversion to it. In Experiment I rats responded less in an extinction test after being averted from the sucrose following training on a ratio schedule, but not following an equivalent amount of training on an interval schedule. This was true even though the devalued sucrose would not act as an effective reinforcer on either the ratio or interval schedule. Experiment II provided a further investigation of the insensitivity of interval responding to reinforcer devaluation by comparing test performance under simple extinction with responding when the devalued reinforcer was presented on either a response-contingent or non-contingent schedule during the test. Once again simple extinction performance was unaffected by prior reinforcer devaluation. Furthermore, neither non-contingent nor contingent presentations of the devalued reinforcer significantly depressed responding below the level seen in the extinction condition. Ratio, but not interval performance appears to be controlled by knowledge about the instrumental contingency that encodes specific properties of the training reinforcer.     

Toxicosis affects instrumental behaviour in rats

Three experiments examined the effect of toxicosis on instrumental responding. These studies were prompted by Morrison and Collyer's (1974, Experiment 1) finding that the induction of toxicosis after an instrumental conditioning session produces greater response suppression if the response is reinforced by a novel saccharin solution rather than familiar water during conditioning. Experiments 1 and 2 investigated whether this suppression was mediated by the Pavlovian contingency between the contextual cues and the saccharin solution or the instrumental relationship between the response and the reward. A role for the instrumental contingency was indicated by the greater suppression of the response producing novel saccharin rather than water when the context of both responses was equally associated with the saccharin and illness. Experiment 3 found that extinction of the aversion to a novel reinforcer following aversive conditioning would re-establish an action previously associated with that reinforcer, in contrast to an action whose reinforcer remained aversive. This result was a further indication that the instrumental contingency between the response and reward contributes to response suppression.     

Effects of parafascicular excitotoxic lesions on two-way active avoidance and odor-discrimination

To investigate whether the parafascicular (PF) nucleus of the thalamus is involved in different learning and memory tasks, two experiments were carried out in adult male Wistar rats that were submitted to pre-training bilateral N-methyl-d-aspartate PF infusions (0.15M, pH 7.4; 1.2 microl/side, 0.2 microl/min). In Experiment 1, we evaluated the effects of PF lesions in two identical 30-trial training sessions, separated by a 24-h interval, of a two-way active avoidance conditioning. PF-lesioned rats exhibited impaired performance in both sessions, measured by number of avoidance responses. In Experiment 2, the effects of PF lesions were assessed in a training session (5 trials) and a 24-h retention test (2 retention trials and 2 relearning trials) of an odor-discrimination task. PF lesions did not significantly disrupt the acquisition or the first retention trial, which was not rewarded. However, lesioned animals' performance was clearly affected in subsequent trials, following the introduction of the single non-rewarded trial. Current data are discussed considering evidence that lesions of the PF nucleus affect learning and memory functions mediated by anatomically related areas of the frontal cortex and striatum.     

Acetylcholine actions in the dorsomedial striatum support the flexible shifting of response patterns

There is accumulating evidence that the dorsomedial striatum plays a significant role in the learning of a new response pattern and the inhibiting of old response patterns when conditions demand a shift in strategies. This paper proposes that activity of cholinergic neurons in the dorsomedial striatum is critical for enabling behavioral flexibility when there is a change in task contingencies. Recent experimental findings are provided supporting this idea. Measuring acetylcholine efflux from the dorsomedial striatum during the acquisition and reversal learning of a spatial discrimination shows that acetylcholine efflux selectively increases during reversal learning as a rat begins to learn a newly reinforced spatial location, but returns to near basal levels when a rat reliably executes the new choice pattern. Experimental findings are also described indicating that the blockade of muscarinic cholinergic receptors in the dorsomedial striatum does not impair acquisition of an egocentric response discrimination, but impairs reversal learning of an egocentric response discrimination. Based on these results, increased cholinergic activity at muscarinic receptors is part of a neurochemical process in the dorsomedial striatum that allows inhibition of a previously relevant response pattern while learning a new response pattern. In situations that demand behavioral flexibility, muscarinic cholinergic activity in the dorsomedial striatum may directly influence corticostriatal plasticity to produce changes in response patterns.     

Post-Conditioning Devaluation of an Instrumental Reinforcer has no Effect on Extinction Performance

The extent to which a representation of the reinforcer controls an instrumental response can be assessed by studying the effect of post-conditioning changes in the reinforcer value. In the first experiment rats were trained to press a lever for sucrose pellets on a variable-interval (VI) schedule. The sucrose was subsequently devalued by pairing with Lithium Chloride (LiCl). This had no effect on lever pressing in extinction, although it profoundly reduced reacquisition responding and consumption. In Experiment II rats were trained to shuttle between the two distinctive chambers of a choice-box, in which lever pressing was reinforced in one chamber by sucrose and in the other chamber by food pellets programmed on independent VI schedules. A LiCl-induced taste-aversion was conditioned to the sucrose, and although this markedly affected reacquisition, extinction responding in the sucrose chamber and chamber preference were unaffected. These results indicate that instrumental performance can be independent of the current value of the reinforcer, and are discussed with reference to stimulus-response theory and second-order Pavlovian conditioning.