Adjusting foraging strategies: a comparison of rural and urban common mynas (<Emphasis Type="Italic">Acridotheres tristis</Emphasis>)

Establishment in urbanized environments is associated with changes in physiology, behaviour, and problem-solving. We compared the speed of learning in urban and rural female common mynas, Acridotheres tristis, using a standard visual discrimination task followed by a reversal learning phase. We also examined how quickly each bird progressed through different stages of learning, including sampling and acquisition within both initial and reversal learning, and persistence following reversal. Based on their reliance on very different food resources, we expected urban mynas to learn and reversal learn more quickly but to sample new contingencies for proportionately longer before learning them. When quantified from first presentation to criterion achievement, urban mynas took more 20-trial blocks to learn the initial discrimination, as well as the reversed contingency, than rural mynas. More detailed analyses at the level of stage revealed that this was because urban mynas explored the novel cue-outcome contingencies for longer, and despite transitioning faster through subsequent acquisition, remained overall slower than rural females. Our findings draw attention to fine adjustments in learning strategies in response to urbanization and caution against interpreting the speed to learn a task as a reflection of cognitive ability.     

Differential involvement of M1-type and M4-type muscarinic cholinergic receptors in the dorsomedial striatum in task switching

Previous experiments have demonstrated that the rat dorsomedial striatum is one brain area that plays a crucial role in learning when conditions require a shift in strategies. Further evidence indicates that muscarinic cholinergic receptors in this brain area support adaptations in behavioral responses. Unknown is whether specific muscarinic receptor subtypes in the dorsomedial striatum contribute to a flexible shift in response patterns. The present experiments investigated whether blockade of M1-type and/or M4-type cholinergic receptors in the dorsomedial striatum underlie place reversal learning. Experiment 1 investigated the effects of the M1-type muscarinic cholinergic antagonist, muscarinic-toxin 7 (MT-7) infused into the dorsomedial striatum in place acquisition and reversal learning. Experiment 2 investigated the effects of the M4-type muscarinic cholinergic antagonist, muscarinic-toxin 3 (MT-3) injected into the dorsomedial striatum in place acquisition and reversal learning. All testing occurred in a modified cross-maze across two consecutive sessions. Bilateral injections of MT-7 into the dorsomedial striatum at 1 or 2 microg, but not 0.05 microg impaired place reversal learning. Analysis of the errors revealed that MT-7 at 1 and 2 microg significantly increased regressive errors, but not perseverative errors. An injection of MT-7 2 microg into the dorsomedial striatum prior to place acquisition did not affect learning. Experiment 2 revealed that dorsomedial striatal injections of MT-3 (0.05, 1 or 2 microg) did not affect place acquisition or reversal learning. The findings suggest that activation of M1-type muscarinic cholinergic receptors in the dorsomedial striatum, but not M4-type muscarinic cholinergic receptors facilitate the flexible shifting of response patterns by maintaining or learning a new choice pattern once selected.     

Acetylcholine actions in the dorsomedial striatum support the flexible shifting of response patterns

There is accumulating evidence that the dorsomedial striatum plays a significant role in the learning of a new response pattern and the inhibiting of old response patterns when conditions demand a shift in strategies. This paper proposes that activity of cholinergic neurons in the dorsomedial striatum is critical for enabling behavioral flexibility when there is a change in task contingencies. Recent experimental findings are provided supporting this idea. Measuring acetylcholine efflux from the dorsomedial striatum during the acquisition and reversal learning of a spatial discrimination shows that acetylcholine efflux selectively increases during reversal learning as a rat begins to learn a newly reinforced spatial location, but returns to near basal levels when a rat reliably executes the new choice pattern. Experimental findings are also described indicating that the blockade of muscarinic cholinergic receptors in the dorsomedial striatum does not impair acquisition of an egocentric response discrimination, but impairs reversal learning of an egocentric response discrimination. Based on these results, increased cholinergic activity at muscarinic receptors is part of a neurochemical process in the dorsomedial striatum that allows inhibition of a previously relevant response pattern while learning a new response pattern. In situations that demand behavioral flexibility, muscarinic cholinergic activity in the dorsomedial striatum may directly influence corticostriatal plasticity to produce changes in response patterns.     

Spatial and reversal learning in the Morris water maze are largely resistant to six hours of REM sleep deprivation following training

This first test of the role of REM (rapid eye movement) sleep in reversal spatial learning is also the first attempt to replicate a much cited pair of papers reporting that REM sleep deprivation impairs the consolidation of initial spatial learning in the Morris water maze. We hypothesized that REM sleep deprivation following training would impair both hippocampus-dependent spatial learning and learning a new target location within a familiar environment: reversal learning. A 6-d protocol was divided into the initial spatial learning phase (3.5 d) immediately followed by the reversal phase (2.5 d). During the 6 h following four or 12 training trials/day of initial or reversal learning phases, REM sleep was eliminated and non-REM sleep left intact using the multiple inverted flowerpot method. Contrary to our hypotheses, REM sleep deprivation during four or 12 trials/day of initial spatial or reversal learning did not affect training performance. However, some probe trial measures indicated REM sleep-deprivation-associated impairment in initial spatial learning with four trials/day and enhancement of subsequent reversal learning. In naive animals, REM sleep deprivation during normal initial spatial learning was followed by a lack of preference for the subsequent reversal platform location during the probe. Our findings contradict reports that REM sleep is essential for spatial learning in the Morris water maze and newly reveal that short periods of REM sleep deprivation do not impair concurrent reversal learning. Effects on subsequent reversal learning are consistent with the idea that REM sleep serves the consolidation of incompletely learned items.     

物质成瘾及其戒除:基于反转学习的视角

物质成瘾与反转学习损伤密切相关,成瘾者往往不能灵活地适应变化的刺激—结果的联结,这可能进一步加剧成瘾者的物质使用。近年来研究发现,物质成瘾者的反转学习相关的腹外侧前额和背外侧前额等脑区激活异常,这些异常与成瘾者的冲动性和强迫性有关。此外,个体的反转学习能力对其成瘾行为具有一定预测性。今后应增加对不同类型物质成瘾者的反转学习脑机制及物质相关线索对成瘾者反转学习影响的研究,并且进一步探讨成瘾者的冲动性和强迫性对其反转学习的调节及个体反转学习能力对其成瘾行为的预测。     

The effect of training procedures on the overlearning reversal effect in young children

The performance of 80 preschool children on a reversal problem was studied as a function of amount of training and type of training procedure used during acquisition and reversal. In the extinction phase of reversal learning, subjects given a correction procedure during the reversal problem made fewer perseverative errors than subjects given noncorrection. In the reversal midplateau phase of reversal learning, overtraining facilitated reversal learning for subjects receiving noncorrection during the acquistion problem, but not for subjects receiving correction. A shift in training procedure between acquisition and reversal increased the number of subjects who reached criterion immediately after perseveration. Since these results are difficult to explain in terms of traditional learning theories, an alternative response-switching strategy explanation was proposed.     

The neuropsychology of ventral prefrontal cortex: decision-making and reversal learning

Converging evidence from human lesion, animal lesion, and human functional neuroimaging studies implicates overlapping neural circuitry in ventral prefrontal cortex in decision-making and reversal learning. The ascending 5-HT and dopamine neurotransmitter systems have a modulatory role in both processes. There is accumulating evidence that measures of decision-making and reversal learning may be useful as functional markers of ventral prefrontal cortex integrity in psychiatric and neurological disorders. Whilst existing measures of decision-making may have superior sensitivity, reversal learning may offer superior selectivity, particularly within prefrontal cortex. Effective decision-making on existing measures requires the ability to adapt behaviour on the basis of changes in emotional significance, and this may underlie the shared neural circuitry with reversal learning.     

Verbal discrimination reversal in a whole/part re-pairing transfer paradigm

Whole/part transfer and re-pairing of rights and wrongs were employed in a study of verbal discrimination reversal learning. The whole/part and re-pairing procedures were used to create reversal conditions (0%, 50%, or 100% reversal) that were similar at the outset of reversal learning in that all correct alternatives on the reversal list were higher in situational frequency than their respective incorrect alternatives. Similarly, reversal lists were constructed that were similar in that all incorrect alternatives on the reversal list were higher in situational frequency than their respective correct alternatives. The results were consistent with the existing literature on verbal discrimination reversal, as performance was impaired when items reversed functions (50% and 100% reversal). There was little evidence that uniform frequency relations between rights and wrongs affected ease of reversal learning.     

Functional lateralization, interhemispheric transfer and position bias in serial reversal learning in pigeons (Columba livia)

In the present study we investigated lateralization of color reversal learning in pigeons. After monocular acquisition of a simple color discrimination with either the left or right eye, birds were tested in a serial reversal procedure. While there was only a slight and non-significant difference in choice accuracy during original color discrimination, a stable superiority of birds using the right eye emerged in serial reversals. Both groups showed a characteristic ‘learning-to-learn’ effect, but right-eyed subjects improved faster and reached a lower asymptotic error rate. Subsequent testing for interocular transfer demonstrated a difference between pre- and post-shift choice accuracy in pigeons switching from right to left eye but not vice versa. This can be accounted for by differences in maximum performance using either the left or right eye along with an equally efficient but incomplete interocular transfer in both directions. Detailed analysis of the birds’ response patterns during serial reversals revealed a preference for the right of two response keys in both groups. This bias was most pronounced at the beginning of a session. It decreased within sessions, but became more pronounced in late reversals, thus indicating a successful strategy for mastering the serial reversal task. Interocular transfer of response patterns revealed an unexpected asymmetry. Birds switching from right to left eye continued to prefer the right side, whereas pigeons shifting from left to right eye were now biased towards the left side. The results suggest that lateralized performance during reversal learning in pigeons rests on a complex interplay of learning about individual stimuli, stimulus dimensions, and lateralized response strategies. Received: 4 June 1999 / Accepted after revision: 18 August 1999     

Reversal Learning Deficits in Criminal Offenders: Effects of Psychopathy,Substance use,and Childhood Maltreatment History

Deficits in reinforcement learning are presumed to underlie the impulsive and incorrigible behavior exhibited by psychopathic criminals. However, previous studies documenting reversal learning impairments in psychopathic individuals have not investigated this relationship across a continuous range of psychopathy severity, nor have they examined how reversal learning impairments relate to different psychopathic traits, such as the interpersonal-affective and lifestyle-antisocial dimensions. Furthermore, previous studies have not considered the role that childhood maltreatment and substance use may have in this specific cognitive deficit. Using a standard reversal learning task in a sample of N = 114 incarcerated male offenders, we demonstrate a significant relationship between psychopathy severity and reversal learning errors. Furthermore, we show a significant interaction between psychopathy and childhood maltreatment, but not substance use, such that individuals high in psychopathy with an extensive history of maltreatment committed the greatest number of reversal learning errors. These findings extend the current understanding of reversal learning performance among psychopathic individuals, and highlight the importance of considering childhood maltreatment when studying psychopathy.     

Effects of acute restraint stress on set-shifting and reversal learning in male rats

Exposure to acute stress alters cognition; however, few studies have examined the effects of acute stress on executive functions such as behavioral flexibility. The goal of the present experiments was to determine the effects of acute periods of stress on two distinct forms of behavioral flexibility: set-shifting and reversal learning. Male Sprague-Dawley rats were trained and tested in an operant-chamber-based task. Some of the rats were exposed to acute restraint stress (30 min) immediately before either the set-shifting test day or the reversal learning test day. Acute stress had no effect on set-shifting, but it significantly facilitated reversal learning, as assessed by both trials to criterion and total errors. In a second experiment, the roles of glucocorticoid (GR) and mineralocorticoid receptors (MR) in the acute-stress-induced facilitation of reversal learning were examined. Systemic administration of the GR-selective antagonist RU38486 (10 mg/kg) or the MR-selective antagonist spironolactone (50 mg/kg) 30 min prior to acute stress failed to block the facilitation on reversal learning. The present results demonstrate a dissociable effect of acute stress on set-shifting and reversal learning and suggest that the facilitation of reversal learning by acute stress may be mediated by factors other than corticosterone.     

Differential involvement of hippocampal calcineurin during learning and reversal learning in a Y-maze task

The regulation and function of the calcium-dependent phosphatase calcineurin (CaN, protein phosphatase 2B) in learning and memory remain unclear, although recent work indicates that CaN may play a differential role in training and reversal training. To gain more insight into the involvement of CaN in these two types of learning, hippocampal CaN activity, protein levels, and expression patterns were studied in mice subjected to a reference memory version of the Y-maze task. We show that (1) training but not habituation induces a decrease in cytosolic CaN activity, (2) the recovery of cytosolic CaN activity is reversal training specific and does not reflect normal restoration of basal levels unrelated to subsequent learning, (3) cytosolic protein levels for the catalytic subunit of CaN (CaNA) are decreased at the early phase of training, but not at the early phase of reversal training, (4) CaNA immunoreactivity in the dorsal hippocampus is enhanced in the CA1 and CA3 area (but not in the dentate gyrus [DG] or subiculum [SUB]) only during reversal training. These findings indicate that memory formation is accompanied by reduced CaN activity, whereas adapting to changes in a familiar environment is accompanied by restored CaN activity. Moreover, reversal training selectively affects hippocampal CA3 and CA1 regions, suggesting a specific function of these hippocampal subregions in reversal learning.     

Short-term retention of response outcome as a determinant of serial reversal learning

The correlation between short-term retention of the outcome of the preceding response and overall learning proficiency was investigated for serial reversal learning. Pigeons were trained to asymptote on a serial reversal problem and then were presented a percentage reinforcement schedule where only some correct trials were rewarded. Nonrewarded correct trials were treated exactly as incorrect trials. The difference in error probability following the two types of correct trials was then used as a measure of short-term retention. When intertrial intervals (ITI) were short (6 sec), substantial differences occurred. When the ITI's were increased, the difference in accuracy declined regularly to no difference at an ITI of 60 sec. This demonstration of a short-term retention gradient, coupled with the finding that overall reversal learning was much better with the shorter ITI's, suggests that a primary mechanism of improvement in serial reversal learning is the acquisition of a conditional discrimination based on the outcome of the preceding response.     

Transfer after pretraining with the negative stimulus

Two groups of rats trained in the jumping stand acquired a horizontal stripes vs. vertical stripes discrimination and then learned its reversal. The groups differed in their pretraining. One group had previously learned a black vs. white discrimination; the other a discrimination in which the S- was the same as that used in the horizontal against vertical problem. S- pretraining facilitated not only acquisition but also the reversal of the orientation discrimination thereby confirming a prediction that reversal learning will be rapid when the original problem is learned chiefly in terms of the S-. It is suggested that overtraining may facilitate reversal learning, in some cases at least, by inducing animals to concentrate on the S-.     

Overtraining, extinction and shift learning in a concurrent discrimination in rats

Two experiments examined the influence of overtraining on the reversal of a concurrent discrimination. After rats are trained to criterion on two different discriminations in the same apparatus, the reversal of one of these proceeds more rapidly than when both are reversed. If the reversal is conducted after overtraining on the original discriminations, then the opposite pattern of results is observed. That is, learning about the reversal of both discriminations is more rapid than when only a single discrimination is reversed. Experiment 1 replicated this effect and suggested that it is not caused by differences in the rate of extinction during reversal learning. In order to test a cue-association account for these findings, Experiment 2 examined the effect of exchanging the negative stimuli of a concurrent discrimination. This manipulation had a disruptive influence on performance, but only when subjects were not overtrained on the original discrimination.     

Dissociations among ABA, ABC, and AAB recovery effects

In a human predictive learning experiment, the strengths of ABA, ABC, and AAB recovery effects after discrimination reversal learning were compared. Initially, a discrimination between two stimuli (X+, Y−) was trained in Context A. During Phase 2, participants received discrimination reversal training (X−, Y+) either in Context A (Group AAB) or in Context B (Group ABA, Group ABC). Testing occurred in the reversal context and in a neutral context (Group AAB, Group ABC) or in the reversal context and in the acquisition context (Group ABA). Recovery effects were similar in ABA and ABC procedures, whereas no AAB recovery effect occurred. Furthermore, the rate of discrimination reversal learning during Phase 2 was unaffected by whether training was conducted in the same or in a different context as initial learning. Results indicate that contextual stimuli are processed before interfering information is presented. These representations, however, do not acquire the ability to control performance.     

Serial reversal learning and the evolution of behavioral flexibility in three species of North American corvids (Gymnorhinus cyanocephalus, Nucifraga columbiana, Aphelocoma californica)

In serial reversal learning, subjects learn to respond differentially to 2 stimuli. When the task is fully acquired, reward contingencies are reversed, requiring the subject to relearn the altered associations. This alternation of acquisition and reversal can be repeated many times, and the ability of a species to adapt to this regimen has been considered as an indication of behavioral flexibility. Serial reversal learning of 2-choice discriminations was contrasted in 3 related species of North American corvids: pinyon jays (Gymnorhinus cyanocephalus), which are highly social; Clark's nutcrackers (Nucifraga columbiana), which are relatively solitary but specialized for spatial memory; and western scrub jays (Aphelocoma californica), which are ecological generalists. Pinyon jays displayed significantly lower error rates than did nutcrackers or scrub jays after reversal of reward contingencies for both spatial and color stimuli. The effect was most apparent in the 1st session following each reversal and did not reflect species differences in the rate of initial discrimination learning. All 3 species improved their performance over successive reversals and showed significant transfer between color and spatial tasks, suggesting a generalized learning strategy. The results are consistent with an evolutionary association between behavioral flexibility and social complexity.     

Spatial and visual learning deficits in Alzheimer's and Parkinson's disease

Experimental paradigms adopted from animal models were used to compare the neuropsychological mechanisms underlying the dementias of Alzheimer's and Parkinson's diseases. Two tasks were selected because characteristic profiles of impairment in nonhuman primates are seen following selective lesions of frontal cortex, temporal cortex, and fornix. The tasks consisted of a spatial and a visual learning problem, each with two components: (1) original learning and (2) reversal of the original learning. The Alzheimer's patients were significantly impaired on original learning and reversal learning in the visual modality compared with demented Parkinson's patients, even though both groups were equated for severity of dementia. On the spatial tasks, both the Alzheimer's and the demented Parkinson's patients were impaired on reversal learning but not on original learning. The profile of deficits on the visual tasks may serve to differentiate Alzheimer's from Parkinson's dementia and may reflect selective orbitofrontal system lesions in the former.     

The effects of verbal instruction on affective and expectancy learning

The current research assessed the effects of verbal instruction on affective and expectancy learning during repeated contingency reversals (Experiment 1) and during extinction (Experiment 2) in a picture-picture paradigm. Affective and expectancy learning displayed contingency reversal and extinction, but changes were slower for affective learning. Instructions facilitated reversal and extinction of expectancy learning but did not impact on affective learning. These findings suggest a differential susceptibility of affective and expectancy learning to verbal instruction and question previous reports that verbal instructions can accelerate the extinction of non-prepared fear learning in humans.     

The involvement of the orbitofrontal cortex in learning under changing task contingencies

Previous investigations examining the rat prefrontal cortex subregions in attentional-set shifting have commonly employed two-choice discriminations. To better understand how varying levels of difficulty influence the contribution of the prefrontal cortex to learning, the present studies examined the effects of orbitofrontal cortex inactivation in a two- or four-choice odor reversal learning test. Long-Evans rats were trained to dig in cups that contained distinct odors. In the two-choice odor discrimination, one odor cup was always associated with a cereal reinforcement in acquisition while the opposite odor cup was associated with a cereal reinforcement in reversal learning. In the four-choice odor discrimination, an additional two cups containing distinct odors were used that were never associated with reinforcement in acquisition or reversal learning. Bilateral infusions of the GABA-A agonist, muscimol (0.5 microg) into the orbitofrontal cortex did not impair acquisition of either the two- or four-choice discrimination task. However, muscimol infusions into the orbitofrontal cortex impaired two- and four-choice reversal learning. In the two-choice odor reversal, muscimol treatment selectively increased perseverative errors. In the four-choice odor reversal, muscimol treatment increased perseverative, regressive, as well as irrelevant errors. These findings suggest that the orbital prefrontal cortex not only enables task switching by supporting the initial inhibition of a previously relevant choice pattern, but under increasing task demands also enables the reliable execution of a new choice pattern and reduction of interference to irrelevant stimuli.