Discrete and contextual cue alterations eliminate the instrumental appetitive-to-aversive transfer impairment in phenytoin-treated rats

We have shown previously that the antiepileptic phenytoin impairs transfer in an instrumental learning task (Banks et al., 1999). The present study examined the effects of contextual alterations on appetitive-to-aversive transfer performance of rats treated with either phenytoin or tang. Adult rats were tested in tone-signaled appetitive and aversive instrumental tasks, where the animal bar-pressed to obtain a food reward (sugar pellet) or to avoid shock. Rats were trained on the appetitive task for 31 days. Beginning on the twenty-first day, rats were gavaged with either phenytoin or tang twice daily. Animals were then transferred to aversive training, with the phenytoin or tang treatment continuing throughout the 25 testing days. For some animals, contextual changes were introduced as they shifted from appetitive to aversive training, while for other animals these changes were not made. Phenytoin-treated rats that were presented with changes in context as they transferred from the appetitive to the aversive task learned the avoidance response to levels substantially higher than drug-treated rats not presented with the contextual changes. These results indicate that phenytoin impairs avoidance learning following transfer from the appetitive task, and that this impairment can be eliminated by introducing changes in context at the point of transfer. In the tang-treated control subjects, on the other hand, there was no improvement in transfer learning performance associated with the changes in contextual cues. This pattern of results suggests that contextual encoding processes in rats being trained in an instrumental appetitive-to-aversive paradigm are dramatically affected by phenytoin.     

The effects of estradiol on avoidance learning in ovariectomized adult rats

The present study examined the effects of ovariectomy and subsequent estradiol replacement on learning in young adult rats using a set of instrumental avoidance paradigms differing in the nature and extent of prior experience in the learning context. Thus, one group of animals was placed directly into avoidance learning (AV). A second group was trained on an appetitive task first, and then transferred into the aversive context (AP-AV). The third group was exposed to the training context without any specific appetitive response requirement, and then required to learn an active avoidance response (Context-AV). We found that estradiol (OVX+E) impaired avoidance acquisition in all cases relative ovariectomized controls (OVX). In contrast, while avoidance learning is improved following appetitive training or context exposure in both OVX+E and OVX animals, the OVX+E animals profit to a greater extent from the appetitive or context experience than do the OVX controls. We suggest that this difference may be due to enhanced attentional processes or improved hippocampal processing of contextual factors. Thus, estradiol negatively influences simple associative avoidance learning in ovariectomized rats, but appears to promote positive transfer.     

The Effects of Estradiol on Avoidance Learning in Ovariectomized Adult Rats

The present study examined the effects of ovariectomy and subsequent estradiol replacement on learning in young adult rats using a set of instrumental avoidance paradigms differing in the nature and extent of prior experience in the learning context. Thus, one group of animals was placed directly into avoidance learning (AV). A second group was trained on an appetitive task first, and then transferred into the aversive context (AP-AV). The third group was exposed to the training context without any specific appetitive response requirement, and then required to learn an active avoidance response (Context-AV). We found that estradiol (OVX+E) impaired avoidance acquisition in all cases relative ovariectomized controls (OVX). In contrast, while avoidance learning is improved following appetitive training or context exposure in both OVX+E and OVX animals, the OVX+E animals profit to a greater extent from the appetitive or context experience than do the OVX controls. We suggest that this difference may be due to enhanced attentional processes or improved hippocampal processing of contextual factors. Thus, estradiol negatively influences simple associative avoidance learning in ovariectomized rats, but appears to promote positive transfer.     

Lesions of the Rat Nucleus Basalis Magnocellularis Disrupt Appetitive-to-Aversive Transfer Learning

Rats with selective lesions of the nucleus basalis magnocellularis (NBM) and sham-lesion control animals were tested in an operant appetitive-to-aversive transfer task. We hypothesized that NBM lesions would not affect performance in the appetitive phase, but that performance would be impaired during subsequent transfer to the aversive phase of the task. Additional groups of NBM lesion and control rats were tested in the avoidance condition only, where we hypothesized that NBM lesions would not disrupt performance. These hypotheses were based on the argument that the NBM is not necessary for simple association learning that does not tax attention. Both the appetitive phase of the transfer task and the avoidance only task depend only on simple associative learning and are argued not to tax attention. Consequently, performance in these tasks was predicted to be spared following NBM lesions. Complex, attention-demanding associative learning, however, is argued to depend on the NBM. Performance in the aversive phase of the transfer task is both attentionally demanding and associatively more complex than in either the appetitive or aversive tasks alone; thus, avoidance performance in the NBM lesion group was predicted to be impaired following transfer from prior appetitive conditioning. Results supported our hypotheses, with the NBM lesion group acquiring the appetitive response normally, but showing impaired performance following transfer to the aversive conditioning phase of the transfer task. Impairments were not attributable to disrupted avoidance learning per se, as avoidance behavior was normal in the NBM lesion group tested in the avoidance condition only.     

Lesions of the rat nucleus basalis magnocellularis disrupt appetitive-to-aversive transfer learning

Rats with selective lesions of the nucleus basalis magnocellularis (NBM) and sham-lesion control animals were tested in an operant appetitive-to-aversive transfer task. We hypothesized that NBM lesions would not affect performance in the appetitive phase, but that performance would be impaired during subsequent transfer to the aversive phase of the task. Additional groups of NBM lesion and control rats were tested in the avoidance condition only, where we hypothesized that NBM lesions would not disrupt performance. These hypotheses were based, on the argument that the NBM is not necessary for simple association learning that does not tax attention. Both the appetitive phase of the transfer task and the avoidance only task depend only on simple associative learning and are argued not to tax attention. Consequently, performance in these tasks was predicted to be spared following NBM lesions. Complex, attention-demanding associative learning, however, is argued to depend on the NBM. Performance, in the aversive phase of the transfer task is both attentionally demanding and associatively more complex than in either the appetitive or aversive tasks alone; thus, avoidance performance in the NBM lesion group was predicted to be impaired following transfer from prior appetitive conditioning. Results supported our hypotheses, with the NBM lesion group acquiring the appetitive response normally, but showing impaired performance following transfer to the aversive conditioning phase of the transfer task. Impairments were not attributable to disrupted avoidance learning per se, as avoidance behavior was normal in the NBM lesion group tested in the avoidance condition only.     

Differential involvement of the central amygdala in appetitive versus aversive learning

Understanding the function of the distinct amygdaloid nuclei in learning comprises a major challenge. In the two studies described herein, we used c-Fos immunolabeling to compare the engagement of various nuclei of the amygdala in appetitive and aversive instrumental training procedures. In the first experiment, rats that had already acquired a bar-pressing response to a partial food reinforcement were further trained to learn that an acoustic stimulus signaled either continuous food reinforcement (appetitive training) or a footshock (aversive training). The first training session of the presentation of the acoustic stimulus resulted in significant increases of c-Fos immunolabeling throughout the amygdala; however, the pattern of activation of the nuclei of the amygdala differed according to the valence of motivation. The medial part of the central amygdala (CE) responded, surprisingly, to the appetitive conditioning selectively. The second experiment was designed to extend the aversive versus appetitive conditioning to mice, trained either for place preference or place avoidance in an automated learning system (INTELLICAGE). Again, much more intense c-Fos expression was observed in the medial part of the CE after the appetitive training as compared to the aversive training. These data, obtained in two species and by means of novel experimental approaches balancing appetitive versus aversive conditioning, support the hypothesis that the central nucleus of the amygdala is particularly involved in appetitively motivated learning processes.     

Stimulus selection in passive avoidance learning and retention: weanling, periadolescent, and young adult rats

Periadolescent rats exhibit a number of behavioral differences in comparison with younger or older animals. For instance, periadolescents tend to show enhanced acquisition of simple active avoidance tasks, but impaired acquisition of more complex appetitive and aversive discriminations. In this experiment, rats were trained on a simple passive avoidance task at one of three ages, as weanlings (25 days), periadolescents (35 days), or young adults (45 days). Training occurred in the presence of both a redundant discriminative stimulus and a specified, redundant contextual stimulus. The periadolescents did not differ from either younger or older rats in rate of learning the passive avoidance task. The retention performance of these animals was then tested following a change in either, neither, or both of the redundant cues. When a measure of performance that controls for baseline activity was used, it was observed that periadolescents were not disrupted by a change in the redundant discriminative stimulus, a cue change that clearly disrupted performance in 25- and 45-day-old animals, and tended to be more disrupted by the contextual change than younger or older rats. It is hypothesized that the alterations in performance exhibited by periadolescents may be related to an ontogenetic alteration in stimulus selection modulated by the catecholaminergic systems.     

Posttraining glucocorticoid receptor agonist enhances memory in appetitive and aversive Pavlovian discrete-cue conditioning paradigms

Glucocorticoid modulation of emotional memory has repeatedly been shown in aversive learning paradigms, but has received little attention in appetitive tasks. It has also been suggested that it may be selective for contextual cues. In order to investigate if glucocorticoids can modulate memory in discrete-cue conditioning of both appetitive and aversive tasks, two experiments were carried out. Male Lister-Hooded rats received pairings of an auditory cue and either food-reward (experiment 1) or footshock (experiment 2), followed immediately by posttraining injections of the glucocorticoid receptor agonist dexamethasone (0.3, 0.6, and 1.2 mg/kg) or vehicle. Dexamethasone (1.2 mg/kg) led to significantly enhanced learning. These results give support to the notion that glucocorticoids play a role in the modulation of both appetitive and aversive emotional memories and show that their role in learning goes beyond the construction of context representations. The modulation of appetitive and aversive discrete-cue learning may be subserved by a common mechanism.     

Deficits in trace cued fear conditioning in galanin-treated rats and galanin-overexpressing transgenic mice

Galanin inhibits the release of several neurotransmitters and produces performance deficits in a variety of spatial and aversive learning and memory tasks. The experiments in this study investigated the role galanin has in emotional learning and memory using a standard delay cued and contextual fear conditioning task. Rats were administered galanin into the lateral ventricles before training, and scored for freezing behavior in the same context and in a novel context with and without an auditory cue (CS) that had been paired previously with an aversive stimulus (US). Galanin-overexpressing transgenic mice were tested in an identical behavioral protocol. The galanin-administered rats and the transgenic mice were not significantly different from their respective controls on this task. A more challenging trace cued and contextual fear conditioning procedure was administered to separate groups of galanin-treated rats and galanin-overexpressing transgenic mice. Subjects were trained with the same CS and US, however, a 2.5-sec delay was inserted between CS offset and US onset. Following the trace conditioning, rats administered galanin and mice overexpressing galanin both exhibited significantly less freezing to the CS in the novel context as compared with their control groups. These results indicate that the observed disruption of cued fear conditioning was specific to the more difficult trace conditioning task. These findings are the first demonstration that galanin impairs performance on an emotional memory task and support the hypothesis that galanin-induced deficits are specific to more difficult cognitive tasks.     

Overshadowing of a context aversion by a novel incentive in operant conditioning

Two experiments examined the processes underlying the suppression of instrumental behaviours by lithium in rats, as reported by Meachum (1988 and this issue). Experiment 1 examined whether presenting a novel sucrose solution prior to lithium chloride administration would overshadow aversion learning to either the stimuli of the operant chamber or to familiar food pellets. After lever pressing had been established, and in the absence of responding, animals received free deliveries of a novel sucrose solution, familiar food pellets, or both, or they were exposed to only the cues of the operant chamber, prior to lithium injections. Lever pressing for food pellets was then assessed. It was found that the animals receiving the novel sucrose, either alone or with the familiar food pellets, pressed more for pellets than either the group receiving only food pellets or the group exposed to only the context. In addition, there was no appreciable difference in the response rates between the context-only group and the group that received the familiar food pellets. These outcomes were interpreted in terms of the novel sucrose overshadowing aversion learning to the context. Experiment 2 investigated whether in fact aversive contextual conditioning could be obtained using the present parameters. This was accomplished by directly manipulating the contexts. In this experiment animals were trained to lever press in two distinctive contexts. Subsequently, one context was paired with the novel sucrose, and the second was experienced in the absence of reinforcement prior to toxicosis. During a subsequent non-reinforced test it was found that responding in the context paired with the novel sucrose was considerably higher than responding in the context that was experienced alone. These findings stand in contrast to the taste-mediated contextual potentiation observed when a consumatory response is used to assess aversive contextual conditioning.     

Conditional Control of Fluid Consumption in an Occasion Setting Paradigm Is Independent of Pavlovian Associations

Drug states, flavors, and contextual cues were each trained as conditional discriminative stimuli to control a saccharin-LiCl association. In transfer tests, drug states transferred control over consumption to other flavored solutions and to food. Contexts and flavors transferred control only to other flavored solutions. Pavlovian control groups given direct pairings of context-LiCl or flavor-LiCl did not show reliable transfer. However, these control groups did show greater or the same aversion to the specific context or flavor predicting LiCl compared to the context or flavor discrimination groups. The dissociation of the discrimination and Pavlovian groups on transfer versus preference tests suggests that performance on the occasion setting task cannot be due to simple excitation or learning about a unique compound cue. Data from extinction procedures provide further support for the dissociation between simple excitation and occasion setting.     

Complex effects of NMDA receptor antagonist APV in the basolateral amygdala on acquisition of two-way avoidance reaction and long-term fear memory

Although much has been learned about the role of the amygdala in Pavlovian fear conditioning, relatively little is known about an involvement of this structure in more complex aversive learning, such as acquisition of an active avoidance reaction. In the present study, rats with a pretraining injection of the N-methyl-D-aspartate (NMDA) receptor antagonist, 2-amino-5-phosphonopentanoic acid (APV), into the basolateral amygdala (BLA) were found to be impaired in two-way active avoidance learning. During multitrial training in a shuttle box, the APV-injected rats were not different from the controls in sensitivity to shock or in acquisition of freezing to contextual cues. However, APV injection led to impaired retention of contextual fear when tested 48 h later, along with an attenuation of c-Fos expression in the amygdala. These results are consistent with the role of NMDA receptors of the BLA in long-term memory of fear, previously documented in Pavlovian conditioning paradigms. The APV-induced impairment in the active avoidance learning coincided with deficits in directionality of the escape reaction and in attention to conditioned stimuli. These data indicate that normal functioning of NMDA receptors in the basolateral amygdala is required during acquisition of adaptive instrumental responses in a shuttle box but is not necessary for acquisition of short-term contextual fear in this situation.     

Generalization peak shift in rats under conditions of positive reinforcement and avoidance

Rats were trained to discriminate between two click frequencies. One frequency was associated with either variable-interval food reinforcement (Experiment 1) or free-operant avoidance (Experiment 2). The other frequency was associated with the absence of food in Experiment 1 and the absence of shock in Experiment 2. On a click frequency generalization test, the rats in both experiments showed positive peak shift with the shape of the relative gradients being very similar. This is the first reported instance of peak shift in rats when responding was maintained by an avoidance contingency. Nondifferentially trained controls showed that this shift was due exclusively to associative processes, with nonassociative stimulus factors in themselves apparently making no contribution to increased rates at particular stimulus values. These results show the comparability of appetitive and aversive control and support the position that gradient differences do not result from approach versus avoidance per se.     

Evidence for expectancy as a mediator of avoidance and anxiety in a laboratory model of human avoidance learning

A laboratory model was developed to study human avoidance learning. Participants could avoid an electric shock signalled by a 5-s conditioned stimulus (CS) by pressing one of a set of response buttons. Self-reported shock expectancy and skin conductance were recorded during a subsequent 10-s interval before shock. Shock expectancy declined when the correct avoidance response was learned and returned when the response was unavailable. Learning transferred to another shock CS. Parallel effects were observed on skin conductance once performance anxiety was controlled by requiring responding on all trials. Learning was faster when the Pavlovian contingencies were trained before introduction of the instrumental response. The results support a cognitive model of anxiety in which performance of an avoidance response reduces expectancy of an aversive outcome and thereby reduces anxiety.     

Evidence for expectancy as a mediator of avoidance and anxiety in a laboratory model of human avoidance learning

A laboratory model was developed to study human avoidance learning. Participants could avoid an electric shock signalled by a 5-s conditioned stimulus (CS) by pressing one of a set of response buttons. Self-reported shock expectancy and skin conductance were recorded during a subsequent 10-s interval before shock. Shock expectancy declined when the correct avoidance response was learned and returned when the response was unavailable. Learning transferred to another shock CS. Parallel effects were observed on skin conductance once performance anxiety was controlled by requiring responding on all trials. Learning was faster when the Pavlovian contingencies were trained before introduction of the instrumental response. The results support a cognitive model of anxiety in which performance of an avoidance response reduces expectancy of an aversive outcome and thereby reduces anxiety.     

Sex differences in aversive memory in rats: Possible role of extinction and reactive emotional factors

Studies usually show better spatial learning in males and stronger emotional memory in females. Spatial memory differences could relate to diverse strategies, while dissimilar stress reactions could cause emotional memory differences. We compared male and female rats in two emotional (classical emotional conditioning and aversive discrimination memory) and two emotionally “neutral” tasks: (1) plus-maze discriminative avoidance, containing two open and two enclosed arms, one of which presenting aversive stimuli (light/noise). No differences were found in learning, retrieving, or basal emotional levels, while only male rats presented extinction of the task; (2) contextual fear conditioning – a cage was paired to mild foot shocks. Upon reexposure, freezing behavior was decreased in females; (3) spontaneous alternation – the animals were expected to alternate among the arms of a four-arm maze. No differences between genders were found and (4) open-field habituation was addressed in an arena which the rats were allowed to explore for 10 min. Habituation was similar between genders. Differences were found only in tasks with strong emotional contexts, where different fear responses and stress effects could be determinant. The lack of extinction of discriminative avoidance by females points out to stronger consolidation and/or impaired extinction of aversive memories.     

Post-training disruption of Arc protein expression in the anterior cingulate cortex impairs long-term memory for inhibitory avoidance training

The activity-regulated-cytoskeletal-associated protein (Arc) has a well established role in memory consolidation and synaptic plasticity in the hippocampus and amygdala. However the role of Arc within the anterior cingulate cortex (ACC), an area of the brain involved in processing memory for pain, has yet to be examined. Here we sought to determine if Arc protein within neurons of the rat ACC is necessary for the consolidation of a single-trial, contextual inhibitory avoidance (IA) task. Immunohistochemistry and western blotting revealed an increase in Arc protein within the ACC following IA training in a shock-specific manner, suggesting that ACC Arc expression may play a critical role in the consolidation of the aversive task. To directly test this hypothesis, male Sprague-Dawley rats were trained on the IA task and given post-training intra-ACC infusions of Arc antisense oligodeoxynucleotides (ODNs), designed to suppress Arc translation, or control scrambled ODNs that do not suppress Arc translation. Memory retention was tested 48h after training. Arc antisense-induced disruption of Arc protein expression in the ACC impaired long-term memory for the IA task as compared to rats given intra-ACC infusions of the scrambled control ODNS, suggesting that Arc expression in the ACC is important for the consolidation of emotional memory. Results further indicate that knock down of Arc 6h after training impairs IA memory. This is consistent with time course findings indicating elevated Arc expression at 3 and 6h after IA training but not 12 or 48h. Taken together, these findings support the hypothesis that Arc expression in the ACC participates in synaptic plasticity that underlies long-term memory.     

No Time of Day Modulation or Time Stamp on Multiple Memory Tasks in Rats

Various demonstrations of “time stamp” effects in the animal learning literature have reinforced the idea that circadian information is encoded as part of a combined internal/external representation of context and that this contextual information is utilized for complex retrieval processes supporting memory. The goal of the present series of experiments is to assess this idea by manipulating training/testing circadian times on a battery of learning and memory tasks commonly used in the rodent. The data obtained from five experiments using four different learning and memory paradigms provide no evidence for “time stamp” effects on place memory, context memory (aversive or appetitive), or S-R habit learning.     

Cholinergic activity in the insular cortex is necessary for acquisition and consolidation of contextual memory

Experiences with a high emotional content (aversive) tend to be stored as long-term memories; however, there are also contextual recollections, which form a significant part of our memories. Different research has shown that the insular cortex (IC) plays an important role during aversive memory formation, yet its role during incidental/non-aversive learning like pre-exposure contextual memory formation has received little attention. The objective of this research was to establish the role of cholinergic activity in the IC through its muscarinic receptors during the formation of inhibitory avoidance (IA) memory, as well as during pre-exposure contextual memory, using a paradigm such as latent inhibition (LI). Rats with bilateral cannulae directed into the IC were trained in the LI paradigm of IA or IA task alone. The muscarinic antagonist receptor scopolamine was infused bilaterally into the IC 5 min before the pre-exposure into the dark chamber of the IA cage, one day before the conventional IA training or during the IA training day. During the IA test, the entrance latency into the dark chamber of the IA cage was measured as an index of contextual memory. The results showed that scopolamine infused before and after IA training disrupts inhibitory avoidance memory. Also, it showed that the pre-exposed saline-infused animals (LI) had a lower entrance latency compared to the group not pre-exposed (IA). However, the group that received scopolamine into the IC before, but not after, the pre-exposure to the dark chamber, presented a similar latency to the IA group, showing a blockade of the latent inhibition of the IA. These results suggest that cholinergic activity in the insular cortex is necessary during the acquisition and consolidation of avoidance memory, but appears necessary only during the acquisition of pre-exposure non-aversive contextual memory.     

Asymmetrical effects of Pavlovian excitatory and inhibitory aversive transfer on Pavlovian appetitive responding and acquisition

Predictions of a theory of Pavlovian motivational transfer, which incorporates principles of both the theory of reciprocal inhibition and the Rescorla-Wagner model, were tested in several Pavlovian aversive to Pavlovian appetitive transfer tasks. As predicted, the presence of a signal for an aversive event, conditioned stimulus (AV CS+), reliably suppressed performance of appetitive conditioned responses (CRs) whether imposed during acquisition or on independently established responding. Acquisition of appetitive responding to a novel CS reinforced in compound with an AV CS+, however, was enhanced (“superconditioning”). This observation suggests that the effects of a discrepancy between expectation and actual outcome on a conditioning trial are influenced by the affective value of both the expectation and the reinforcer. These transfer effects were not symmetrical for an inhibitory aversive stimulus (AV CS?). An AV CS? did not enhance appetitive responding compared to a random control condition, nor did the AV CS? reduce (i.e., block) appetitive conditioning to a novel CS when appetitive reinforcement occurred in the presence of the AV CS?. Comparison of the two shock-exposed conditions with a naive control condition suggests that previous results that were apparently consistent with inhibitory aversive enhancement and blocking of appetitive conditioning may have been due to aversive context conditioning.