Successive olfactory reversal learning in honeybees

Honeybees Apis mellifera can associate an originally neutral odor with a reinforcement of sucrose solution. Forward pairings of odor and reinforcement enable the odor to release the proboscis extension reflex in consecutive tests. Bees can also be conditioned differentially: They learn to respond to a reinforced odor and not to a nonreinforced one. They can also learn to reverse their choice. Here we ask whether honeybees can learn successive olfactory differential conditioning tasks involving different overlapping pairs of odors. The conditioning schedules were established in order to train the animals with 3, 2, 1, or 0 reversals previous to a last differential conditioning phase in which two additional reversals were present. We studied whether or not successive reversal learning is possible and whether or not learning olfactory discrimination reversals affects the solving of subsequent discrimination reversals. Therefore we compared the responses of bees that had experienced reversals with those of bees that had not experienced such reversals when both are confronted with a new reversal situation. In experiment 1 we showed that bees that had experienced three previous reversals were better in solving the final reversal task than bees with no previous reversal experience. In experiment 2, we showed that one reversal learning is enough for bees to perform better in the final reversal task. The successive different reversals trained in our experiments resemble the natural foraging situation in which a honeybee forager has to switch successively from an initial floral species to different ones. The fact that experiencing such changes seems to improve a bee's performance in dealing with further new exploited food sources has therefore an adaptive impact for the individual and for the colony as a whole.     

Lesions of orbitofrontal cortex and basolateral amygdala complex disrupt acquisition of odor-guided discriminations and reversals

Recent work indicates that both orbitofrontal cortex (OFC) and the basolateral complex of the amygdala (ABL) are involved in processes by which cues are associated with predicted outcomes. To examine the respective roles of these structures in discrimination learning, rats with bilateral sham or neurotoxic lesions of either OFC or ABL were trained on a series of four 2-odor discrimination problems in a thirst-motivated go, no-go task. After acquisition of the series of odor problems, the rats were trained on serial reversals of the final odor problem. Performance on each problem was assessed by monitoring accuracy of choice behavior, and also by measuring latency to respond for fluid outcomes after odor sampling. During discrimination learning, rats in both lesioned groups had similar deficits, failing to show normal changes in response latency during learning, while at the same time exhibiting normal choice behavior relative to controls. Choice behavior was affected only during the reversal phase of training, in which OFC and ABL lesions produced distinctive deficits. Rats with ABL lesions were impaired on the first reversal (S1−/S2+), but were unimpaired at acquiring a reversal back to the original odor-outcome contigencies (S1+/S2−), whereas rats with OFC lesions were impaired on both types of reversals. These findings suggest that OFC and ABL serve partially overlapping roles in the use of incentive information that supports normal discrimination performance.     

Olfactory discrimination, reversal learning, and stimulus control in rats.

Rats were trained to discriminate lights, tones, or odors and then given a series of discrimination reversals. Only rats trained with odors showed positive transfer on the first reversal and acquisition of a reversal set. Other experiments demonstrated that rats preferentially attend to odors when presented in compound with lights or tones; that odors exert more discriminative control than tones in tests using compound stimuli of competing sign; and that after pretraining on the positive stimulus, acquisition of an odor but not a light discrimination occurs with virtually no errors. These results demonstrate the importance of stimulus modality in the establishment of stimulus control and the need for more careful analysis of stimulus factors in cross-species comparisons of learning ability.     

NMDA receptor-dependent processes in the medial prefrontal cortex are important for acquisition and the early stage of consolidation during trace, but not delay eyeblink conditioning

Permanent lesions in the medial prefrontal cortex (mPFC) affect acquisition of conditioned responses (CRs) during trace eyeblink conditioning and retention of remotely acquired CRs. To clarify further roles of the mPFC in this type of learning, we investigated the participation of the mPFC in mnemonic processes both during and after daily conditioning using local microinfusion of the GABA(A) receptor agonist muscimol or the NMDA receptor antagonist APV into the rat mPFC. Muscimol infusions into the mPFC before daily conditioning significantly retarded CR acquisition and reduced CR expression if applied after sufficient learning. APV infusion also impaired acquisition of CRs, but not expression of well-learned CRs. When infusions were made immediately after daily conditioning, acquisition of the CR was partially impaired in both the muscimol and APV infusion groups. In contrast, rats that received muscimol infusions 3 h after daily conditioning exhibited improvement in their CR performance comparable to that of the control group. Both the pre- and post-conditioning infusion of muscimol had no effect on acquisition in the delay paradigm. These results suggest that the mPFC participates in both acquisition of a CR and the early stage of consolidation of memory in trace, but not delay eyeblink conditioning by NMDA receptor-mediated operations.     

Muscimol,AP5, or scopolamine infused into perirhinal cortex impairs two-choice visual discrimination learning in rats

The perirhinal cortex (PRh) has been strongly implicated in object recognition memory and visual stimulus representation. Studies of object recognition have revealed evidence for the involvement of several neurotransmitter subsystems, including those involving NMDA (N-methyl-d-aspartic acid) and muscarinic cholinergic receptors. In the present study, we assessed the possible involvement of PRh and related receptor subsystems in two-choice visual discrimination learning by Lister Hooded rats tested in touchscreen-equipped operant boxes. In Experiment 1, daily pre-training inactivation of PRh with the GABA_A receptor agonist muscimol (0.5 μg/hemisphere) significantly impaired acquisition of the two-choice visual discrimination. In Experiment 2, daily pre-training blockade of either NMDA or muscarinic receptors in PRh with AP5 (5.9 μg/hemisphere) or scopolamine (10 μg/hemisphere), respectively, impaired task acquisition. These results parallel the findings from object recognition studies and suggest a generality of neurotransmitter receptor involvement underlying the role of PRh in both object recognition memory and visual discrimination learning. The involvement of PRh in both types of tasks may be related to its role in complex visual stimulus representation.     

Impaired discrimination learning in mice lacking the NMDA receptor NR2A subunit

N-Methyl-D-aspartate receptors (NMDARs) mediate certain forms of synaptic plasticity and learning. We used a touchscreen system to assess NR2A subunit knockout mice (KO) for (1) pairwise visual discrimination and reversal learning and (2) acquisition and extinction of an instrumental response requiring no pairwise discrimination. NR2A KO mice exhibited significantly retarded discrimination learning. Performance on reversal was impaired in NR2A KO mice during the learning phase of the task; with no evidence of heightened perseverative responses. Acquisition and extinction of an instrumental behavior requiring no pairwise discrimination was normal in NR2A KO mice. The present findings demonstrate a significant and selective deficit in discrimination learning following loss of NR2A.     

The influence of NMDA receptors in the dorsomedial striatum on response reversal learning

In mammals, the dorsomedial striatum is one brain area shown to be critical for the flexible shifting of response patterns. At present, the neurochemical mechanisms that underlie learning during a shift in response patterns are unknown. The present study examined the effects of NMDA competitive antagonist, DL-2-amino-5-phosphonopentanoic acid (AP-5), injected into the dorsomedial striatum on the acquisition and reversal of a response discrimination. Male Long-Evans rats were tested across two consecutive days in a modified cross-maze. Rats received an infusion of either saline or AP-5 (5 or 25 nmol) 5 min prior to each test session. In the acquisition phase rats learned to turn in one direction (right or left) to receive a cereal reinforcement. In the reversal learning phase rats learned to turn in the opposite direction as in the acquisition phase. In both phases, criterion was achieved when a rat made 10 consecutive correct trials. Infusions of AP-5 did not impair acquisition, but impaired reversal learning of a response discrimination in a dose-dependent fashion. The reversal learning deficit induced by AP-5 resulted from reversions back to the originally learned response pattern following the initial shift. These results suggest that activation of NMDA receptors in the dorsomedial striatum are critical for the flexible shifting of response patterns by enhancing the reliable execution of a new response pattern under changing task contingencies.     

Differential effects of inactivation of the orbitofrontal cortex on strategy set-shifting and reversal learning

Different subregions of the rodent prefrontal cortex (PFC) mediate dissociable types of behavioral flexibility. For example, lesions of the medial or orbitofrontal (OFC) regions of the PFC impair extradimensional shifts and reversal learning, respectively, when novel stimuli are used during different phases of the task. In the present study, we assessed the effects of inactivation of the OFC on strategy set-shifting and reversal learning, using a maze based set-shifting task mediated by the medial PFC. Long–Evans rats were trained initially on a visual-cue discrimination to obtain food. On the subsequent day, rats had to shift to using a response strategy (e.g., always turn left). On Day 3 (reversal), rats were required to reverse the direction of their turn (e.g., always turn right). Infusions of the local anesthetic bupivacaine into the OFC did not impair initial visual discrimination learning, nor did it impair performance on the set-shift. In contrast, inactivation of the OFC did impair reversal learning; yet, these rats ceased using the previously acquired response rule as readily as controls. Instead, rats receiving OFC inactivations made a disproportionate number of erroneous arm entries towards the visual-cue, suggested that these animals reverted back to using the original visual-cue based strategy. These findings, in addition to previous data, further support the notion that the OFC and medial PFC play dissociable roles in reversal learning and set-shifting. Furthermore, the lack of effect of OFC inactivations on the set-shift indicates that this type of behavioral flexibility does not require cognitive operations related to reversal learning.     

The role of the dorsal CA1 and ventral CA1 in memory for the temporal order of a sequence of odors

Memory for the temporal order of a sequence of odors was assessed in male rats. A sequence of five odors mixed in sand was presented in digging cups one at a time to each rat in a sequence that varied on each trial. A reward was buried in each cup. Following the fifth odor, two of the previous five odors were presented simultaneously and the rat needed to choose the odor that occurred earliest in the sequence to receive a reward. Temporal separations of 1, 2, or 3 were used which represented the number of odors that occurred between the two odors in the sequence. Once pre-operative criterion was reached, rats received a control, dorsal CA1 (dCA1), or ventral CA1 (vCA1) lesion and were retested on the task. On post-operative trials, only the vCA1 group was impaired relative to both control and dCA1 groups. All groups of rats could discriminate between the odors. The data suggest that the vCA1, but not dorsal CA1, is involved in separating sensory events (odors) in time so that one odor can be remembered separate from another odor.     

The effect of partially valid cues on children's discrimination learning

Second grade children were administered a two-choice discrimination learning task in which irrelevant dimensions were correlated .50, .75, or 1.00 with the 100 percent rewarded cue. The results indicated that when a cue was partially correlated with reward .75, learning was retarded. When all cues were relevant and redundant (r = 1.00), learning was most rapid. These results supported an implication of Hypothesis Testing Theory that partially correlated or partially valid cues would not be eliminated rapidly, thus retarding acquisition of the correct response.     

Context specificity of operant discriminative performance in pigeons: II. Necessary and sufficient conditions

Six experiments were performed to explore the necessary and sufficient conditions for producing context specificity of discriminative operant performance in pigeons. In Experiment 1, pigeons learned a successive discrimination (red S+/blue S−) in two chambers that had a particular odor present and between which they were frequently switched. The birds subsequently learned the reversal (blue S+/ red S−) in one of these chambers with a different odor present. When switched to the alternative chamber, although the odor and the reinforcement contingency were still appropriate to the reversal, performance appropriate to the original discrimination recurred in subjects for which the houselights were on during training and testing but not for those for which the houselights were off. This indicated the importance of visual contextual cues in producing context specificity. Experiment 2 showed that the frequent switching between boxes in initial training was of no consequence, presumably because the apparatus cues were highly salient to the subjects. Experiment 3 showed significantly less context specificity when odor cues were omitted. Experiment 4 showed that simply using a different reinforced stimulus in each phase of training was ineffective in producing context specificity. Experiment 5 showed that the generalization test procedure used in Experiment 4 was sensitive to context specificity when discrimination-reversal training was used with different odors in the two training phases. Experiment 6 replicated the results of Experiment 4, but then showed that when different odors accompanied the two training phases, context specificity was obtained with the single-stimulus paradigm. Thus in both single-stimulus and discrimination-reversal paradigms, redundant odor cues potentiated learning about apparatus cues.     

Fos protein expression in olfactory-related brain areas after learning and after reactivation of a slowly acquired olfactory discrimination task in the rat

Fos protein immunodetection was used to investigate the neuronal activation elicited in some olfactory-related areas after either learning of an olfactory discrimination task or its reactivation 10 d later. Trained rats (T) progressively acquired the association between one odor of a pair and water-reward in a four-arm maze. Two groups of pseudotrained rats were used: PO rats were not water restricted and were submitted to the olfactory stimuli in the maze without any reinforcement, whereas PW rats were water-deprived and systematically received water in the maze without any odorous stimulation. When the discrimination task was well mastered, a significantly lower Fos immunoreactivity was observed in T rats compared to PW and PO rats in most of the analyzed brain areas, which could reflect the post-acquisition consolidation process. Following memory reactivation, differences in Fos immunoreactivity between trained and some pseudotrained rats were found in the anterior part of piriform cortex, CA3, and orbitofrontal cortex. We also observed that Fos labeling was significantly higher in trained rats after memory reactivation than after acquisition of the olfactory task in most of the brain areas examined. Our results support the assumption of a differential involvement of neuronal networks after either learning or reactivation of an olfactory discrimination task.     

The effects of dopamine D(1) receptor blockade in the prelimbic-infralimbic areas on behavioral flexibility

This study examined the effects of a dopamine D₁ antagonist, SCH23390, infused into the prelimbic–infralimbic areas on the acquisition of a response and visual-cue discrimination task, as well as a shift from a response to a visual-cue discrimination and vice versa. Each test was carried out in a cross-maze. The response discrimination required learning to always turn in the same direction (right or left) for a cereal reinforcement. The visual-cue discrimination required learning to always enter the arm with the visual cue. In experiment 1, rats were tested on the response discrimination task, followed by the visual-cue discrimination task. In experiment 2, the testing order was reversed. Bilateral infusions of SCH23390 (0.1 or 1 μg/0.5 μL) into the prelimbic–infralimbic areas did not impair acquisition of the response or visual-cue discrimination tasks. SCH23390 injections at 1 μg, but not 0.1 μg impaired performance when shifting from a response to a visual-cue discrimination, and vice versa. Analysis of the errors revealed that the deficit was due to perseveration of the previously learned strategy. These results suggest that activation of dopamine D₁ receptors in the prelimbic–infralimbic areas may be critical for the suppression of a previously relevant strategy and/or generating new strategies.     

Size and reversal learning in the beagle dog as a measure of executive function and inhibitory control in aging

Several studies converge on the idea that executive processes age earlier than other cognitive processes. As part of a larger effort to investigate age-related changes in executive processes in the dog, inhibitory control was measured in young, middle-aged, old, and senior dogs using size discrimination learning and reversal procedures. Compared to young and middle-aged dogs, old and senior dogs were impaired on both the initial learning of the size task and the reversal of original reward contingencies. Impaired performance in the two aged groups was characterized as a delay in learning the correct stimulus-reward contingencies and, among the senior dogs in particular, an increase in perseverative responding. These separate patterns of reversal impairments in the old and senior dogs may reflect different rates of aging in subregions of the frontal cortex.     

Serotonin transporter knockout rats show improved strategy set-shifting and reduced latent inhibition

Behavioral flexibility is a cognitive process depending on prefrontal areas allowing adaptive responses to environmental changes. Serotonin transporter knockout (5-HTT(-/-)) rodents show improved reversal learning in addition to orbitofrontal cortex changes. Another form of behavioral flexibility, extradimensional strategy set-shifting (EDSS), heavily depends on the medial prefrontal cortex. This region shows functional changes in 5-HTT(-/-) rodents as well. Here we subjected 5-HTT(-/-) rats and their wild-type counterparts to an EDSS paradigm and a supplementary latent inhibition task. Results indicate that 5-HTT(-/-) rats also show improved EDSS, and indicate that reduced latent inhibition may contribute as an underlying mechanism.     

An inexpensive and automated method for presenting olfactory or tactile stimuli to rats in a two-choice discrimination task

An inexpensive and automated method for presentation of olfactory or tactile stimuli in a two-choice task for rats was implemented with the use of a computer-controlled bidirectional motor. The motor rotated a disk that presented two stimuli of different texture for tactile discrimination, or different odor for olfactory discrimination. Because the solid olfactory stimuli were placed outside the chamber in metal pods with a mesh at front for odor sampling, "washout" of odors between trials was not necessary. To avoid differential auditory cues from motor rotation, the stimuli were arranged such that on each trial the motor always rotated exactly one quarter revolution (in 1 s), left or right, to present the next stimulus at trial start. To illustrate the use of the equipment, 2 rats were trained on tactile discrimination and 2 rats on olfactory discrimination. The rats sampled the stimulus on the disk through a port on the back wall by sniffing at it (olfactory) or touching it (tactile). The task was a go-left/go-right discrimination with the stimulus on the disk being discriminative for which lever provided reinforcement. The rats reached a stable level above 90% correct after 21 and 32 training sessions for tactile and olfactory discrimination, respectively. The article outlines how the equipment was constructed from low-cost components. Inputs from and outputs to the equipment were implemented through the parallel port of a personal computer without the use of a commercial interface board. The method of automated and low-cost presentation of olfactory or tactile stimuli should be of use for a variety of experimental situations such as matching-to-sample and cross-modal discrimination.     

Perseverative effects of parabrachial lesions: a mechanism of reduced activation?

The acquisition of a spatial reversal task and two reversals of it and the acquisition of an active two-way avoidance task were tested in three groups of male Sprague-Dawley rats: two experimental and one control group. The experimental group received chemical lesions of the parabrachial nuclei (group NPB) or of the dorsal hippocampus (group HC), using ibotenic acid. (Ibotenic acid is a compound which, contrary to kainic acid, fails to produce distant lesions, but, in conformity with kainic acid, spares the majority if not all fibers of passage.) The control group (group CG) received injections of the vehicle solution only. Animals of group NPB, in comparison to those of the other two groups, acquired the reversal task more quickly, but in the acquisition of its two reversals they needed considerably more time and made more perseverative errors. Likewise, only group NPB was significantly impaired in the acquisition of the avoidance task. From these results and from available evidence on connections of the parabrachial neurons with regions specifically involved in variables of the tested tasks (such as the prefrontal cortex), it is concluded that the parabrachial region exerts an activating influence on forebrain areas.     

Training domestic dogs (Canis lupus familiaris) on a novel discrete trials odor-detection task

Dogs can be trained to reliably detect a wide variety of odors. Little scientific research, however, has been published on the rate at which dogs can learn to detect an odor, the variables influencing this rate, and how this rate may vary across dogs. In two experiments, we developed a procedure that allows the study of individual differences in the acquisition of an odor detection task in dogs. We demonstrate that differential reinforcement can be used to train a rooting response in a bin under the control of a novel odorant in discrete trials. In initial testing, we showed that as a group, twenty dogs performed significantly above chance within 24 trials, with two dogs meeting an individual criterion for above chance performance. In a follow-up experiment, we compared burying accessible food inside the target bin (with inaccessible food in the non-target bin) to the experimenter delivering food by hand following correct responses. We assessed the effect of this procedural variation on both an odor discrimination and a visual discrimination. Dogs learned faster on the odor task when the experimenter delivered food, compared to when food was placed directly in the bins. Performance on the visual task was lower than on the odor task and was unaffected by how food was delivered. Our discrete-trials procedure with experimenter-delivered food may be a useful method to study rapid acquisition of an odor-detection in dogs.     

Rats depend on habit memory for discrimination learning and retention

We explored the circumstances in which rats engage either declarative memory (and the hippocampus) or habit memory (and the dorsal striatum). Rats with damage to the hippocampus or dorsal striatum were given three different two-choice discrimination tasks (odor, object, and pattern). These tasks differed in the number of trials required for learning (~10, 60, and 220 trials). Dorsal striatum lesions impaired discrimination performance to a greater extent than hippocampal lesions. Strikingly, performance on the task learned most rapidly (the odor discrimination) was severely impaired by dorsal striatum lesions and entirely spared by hippocampal lesions. These findings suggest that discrimination learning in the rat is primarily supported by the dorsal striatum (and habit memory) and that rats engage a habit-based memory system even for a task that takes only a few trials to acquire. Considered together with related studies of humans and nonhuman primates, the findings suggest that different species will approach the same task in different ways.