Serial reversal learning and the evolution of behavioral flexibility in three species of North American corvids (Gymnorhinus cyanocephalus, Nucifraga columbiana, Aphelocoma californica)

In serial reversal learning, subjects learn to respond differentially to 2 stimuli. When the task is fully acquired, reward contingencies are reversed, requiring the subject to relearn the altered associations. This alternation of acquisition and reversal can be repeated many times, and the ability of a species to adapt to this regimen has been considered as an indication of behavioral flexibility. Serial reversal learning of 2-choice discriminations was contrasted in 3 related species of North American corvids: pinyon jays (Gymnorhinus cyanocephalus), which are highly social; Clark's nutcrackers (Nucifraga columbiana), which are relatively solitary but specialized for spatial memory; and western scrub jays (Aphelocoma californica), which are ecological generalists. Pinyon jays displayed significantly lower error rates than did nutcrackers or scrub jays after reversal of reward contingencies for both spatial and color stimuli. The effect was most apparent in the 1st session following each reversal and did not reflect species differences in the rate of initial discrimination learning. All 3 species improved their performance over successive reversals and showed significant transfer between color and spatial tasks, suggesting a generalized learning strategy. The results are consistent with an evolutionary association between behavioral flexibility and social complexity.     

Learning processes in matching and oddity: the oddity preference effect and sample reinforcement

Eight pigeons learned either matching (to sample) or oddity (from sample) with or without reward for sample responding. The training stimuli were coarse-white, fine-black, or smooth-mauve gravels in pots with buried grain as the reinforcer. Oddity without sample reward was learned most rapidly, followed by matching with sample reward, oddity with sample reward, and matching without sample reward. Transfer was related to acquisition rate: The oddity group without sample reward showed full (equal to baseline) color and texture transfer; the matching group with sample reward showed partial texture transfer; other groups showed no transfer. Sample reward was shown to determine rate of acquisition of matching and oddity and the oddity preference effect. The results are discussed in terms of item-specific associations operating early in learning prior to any relational learning between sample and comparison stimuli.     

物质成瘾及其戒除:基于反转学习的视角

物质成瘾与反转学习损伤密切相关,成瘾者往往不能灵活地适应变化的刺激—结果的联结,这可能进一步加剧成瘾者的物质使用。近年来研究发现,物质成瘾者的反转学习相关的腹外侧前额和背外侧前额等脑区激活异常,这些异常与成瘾者的冲动性和强迫性有关。此外,个体的反转学习能力对其成瘾行为具有一定预测性。今后应增加对不同类型物质成瘾者的反转学习脑机制及物质相关线索对成瘾者反转学习影响的研究,并且进一步探讨成瘾者的冲动性和强迫性对其反转学习的调节及个体反转学习能力对其成瘾行为的预测。     

The effect of overlearning on transfer of training

The effect of overlearning on transfer of training on the A-B:A-B_r paradigm was studied in paired-associate learning with meaningful material (adjective pairs). One group of subjects was trained to criterion on list A-B, and two additional groups were given 100 per cent and 200 per cent overlearning on list A-B. Rate of learning list A-B_r was found to be directly related to amount of overlearning. Negative transfer on list A-B_r was found for errors with the criterion group, while positive transfer was found for the 100 per cent and 200 per cent overlearning groups. The results were consistent with previous paired-associate experiments, and with results of some maze, reversal learning experiments with infrahuman subjects.

The notation “A-B:A-B_r” will be used for the transfer paradigm in which the same stimuli and responses are used in both the original acquisition phase of paired associate learning and in the subsequent transfer of training phase. In the transfer phase, however, the responses (i.e. B) are rearranged so that they are paired with different stimuli (i.e. A). The notation “A-B:A-C” will be used for the transfer paradigm in which a new set of responses (i.e. C) are paired with the old set of stimuli in the transfer of training phase.     

Adult age differences in the perception and learning of artistic style categories

Adult age differences in conceptual behavior were studied using informationally complex stimuli from real-world categories: paintings by two impressionist artists. In Experiment 1 we examined perceptions of category structure by having subjects sort paintings according to style similarity. Young adults were observed to depend more on abstract information in making style judgments, whereas older adults relied more on similarity in content. This resulted in different category structures between age groups, but similarity judgments in both groups appeared to correspond to actual style differences between the two artists. In Experiment 2, learning efficiency was shown to increase with a painting's category centrality, but older adults had particular trouble learning noncentral items. At transfer, both age groups were able to use abstracted central tendency information to categorize new paintings, although young adults appeared to have better access to information about specific category exemplars from acquisition. The results are generally consistent with those from studies using simpler artificial stimuli.     

Syntactic decoding times of learning disabled children

Syntactic decoding reaction times of 20 learning disabled children comprising two groups of subjects (mean age of 8 and 13 yr., respectively) were compared to the responses of normal controls matched for age and sex. An analysis of variance procedure showed that the learning disabled children and their normal peers did not differ significantly in responses to the experimental stimuli. This held true regardless of linguistic complexity, suggesting that delays in processing elementary syntactic constructions are not a concomitant of learning disabilities.     

A probe trial procedure for the study of children's discrimination learning and transfer

A discrimination reversal problem was presented to 192 children varying in age from 3 to 5 years. At the end of both the initial learning and transfer trials, probe trials were introduced to ascertain the response rule describing children's choices. Results were analyzed in terms of a binary division of the children according to their responses to the probe stimuli; children who responded errorlessly (concept responders) were contrasted with children who made errors on the probes (instance responders). Using this criterion, it was found that many children transferred in a way different from the way they learned the initial problem. There was no difference in the proportion of younger and older children responding conceptually to the original problem, but older children were more likely to transfer conceptually when standard geometric blocks were used as stimuli. Future studies must consider the possiblity that learning and transfer may be accomplished by different processes whose application differs with age, the nature of the stimuli, and the stage of training.     

Age and forgetting rate with pictorial stimuli

The rate of forgetting standardized line drawings of common objects was assessed in groups of young (M age = 22 years) and older (M age = 70.5 years) subjects. The two groups forgot equal quantities of pictorial stimuli over successive intervals of 10 min, 2 hr, and 48 hr, after being matched for original learning. In contrast, the older subjects showed the expected age decrement in reproduction of geometric designs from memory. These findings indicate that aging does not affect retention of pictures when differences in learning and retrieval abilities are controlled.     

5~6岁自闭症儿童与正常儿童的辨别反转学习研究

采用条件性辨别反转范式,考察自闭症儿童与正常儿童的反转灵活性。44名5~6岁儿童（24名自闭症儿童,20名正常儿童）参加了辨别反转学习。结果显示：⑴在习得阶段,两类儿童都能辨别两个不同的条件性刺激;⑵在晚期反转阶段,正常儿童在晚期反转阶段升高了对新的条件性厌恶刺激的主观预期值,辨别了新的条件性刺激,而自闭症儿童在晚期反转阶段对新的条件性厌恶刺激的主观预期值没有显著性变化,无法辨别新的条件性刺激。研究结果表明,5~6岁自闭症儿童反转灵活性存在缺陷。     

Involvement of the rat anterior cingulate cortex in control of instrumental responses guided by reward expectancy

The anterior cingulate cortex (ACC) plays a critical role in stimulus-reinforcement learning and reward-guided selection of actions. Here we conducted a series of experiments to further elucidate the role of the ACC in instrumental behavior involving effort-based decision-making and instrumental learning guided by reward-predictive stimuli. In Experiment 1, rats were trained on a cost-benefit T-maze task in which they could either choose to climb a barrier to obtain a high reward (four pellets) in one arm or a low reward (two pellets) in the other with no barrier present. In line with previous studies, our data reveal that rats with quinolinic acid lesions of the ACC selected the response involving less work and smaller reward. Experiment 2 demonstrates that breaking points of instrumental performance under a progressive ratio schedule were similar in sham-lesioned and ACC-lesioned rats. Thus, lesions of the ACC did not interfere with the effort a rat is willing to expend to obtain a specific reward in this test. In a subsequent task, we examined effort-based decision-making in a lever-press task where rats had the choice between pressing a lever to receive preferred food pellets under a progressive ratio schedule, or free feeding on a less preferred food, i.e. lab chow. Results show that sham- and ACC-lesioned animals had similar breaking points and ingested comparable amounts of less-preferred food. Together, the results of Experiment 1 and 2 suggest that the ACC plays a role in evaluating how much effort to expend for reward; however, the ACC is not necessary in all situations requiring an assessment of costs and benefits. In Experiment 3 we investigated learning and reversal learning of instrumental responses guided by reward predictive stimuli. A reaction time (RT) task demanding conditioned lever release was used in which the upcoming reward magnitude (five vs. one food pellet) was signalled in advance by discriminative visual stimuli. Results revealed that rats with ACC lesions were able to discriminate reward magnitude-predictive stimuli and to adapt instrumental behavior to reversed stimulus-reward magnitude contingencies. Thus, in a simple discrimination task as used here, the ACC appears not to be required to discriminate reward magnitude-predictive stimuli and to use the learned significance of the stimuli to guide instrumental behavior.     

Benign joint hypermobility syndrome: psychological features and psychopathological symptoms in a sample pain-free at evaluation1

30 subjects with BJHS (Hypermobile) (M age = 32.3 yr., SD = 10.4) and two control groups, 25 healthy subjects (Healthy) (M age = 33.9 yr., SD = 9.3) and 30 fibromyalgic patients (Fibromyalgic) (M age = 32.2 yr., SD=9.4), were given the Symptom Checklist-90-R, the Illness Behavior Questionnaire, the Female Functional Symptoms Frequency (FFF) and the Male Functional Symptoms Frequency (MFF), derived from the DSM-III-R, evaluating functional somatic disturbances and their intensity, and the Symptom Questionnaire. The mean scores for the Hypermobile group showed significant psychological distress and increased frequency and intensity of somatic symptoms. Scores on Anxiety and Somatic Symptoms, General Hypochondriasis, Disease Conviction, Affective Disturbance, Denial, and Irritability were significantly higher in the Hypermobile than in the Healthy group. Elevated scores were found for the Fibromyalgic group on the Illness Behavior Questionnaire subscales for Psychological vs Somatic Focus, Disease Affirmation, and Discriminating Factors when compared with the Hypermobile group. Considerable emotional symptoms were detected which should not be underestimated by physicians when establishing an integrated biopsychosocial therapy.     

Pavlovian reward learning underlies value driven attentional capture

Recent evidence shows that distractors that signal high compared to low reward availability elicit stronger attentional capture, even when this is detrimental for task-performance. This suggests that simply correlating stimuli with reward administration, rather than their instrumental relationship with obtaining reward, produces value-driven attentional capture. However, in previous studies, reward delivery was never response independent, as only correct responses were rewarded, nor was it completely task-irrelevant, as the distractor signaled the magnitude of reward that could be earned on that trial. In two experiments, we ensured that associative reward learning was completely response independent by letting participants perform a task at fixation, while high and low rewards were automatically administered following the presentation of task-irrelevant colored stimuli in the periphery (Experiment 1) or at fixation (Experiment 2). In a following non-reward test phase, using the additional singleton paradigm, the previously reward signaling stimuli were presented as distractors to assess truly task-irrelevant value driven attentional capture. The results showed that high compared to low reward-value associated distractors impaired performance, and thus captured attention more strongly. This suggests that genuine Pavlovian conditioning of stimulus-reward contingencies is sufficient to obtain value-driven attentional capture. Furthermore, value-driven attentional capture can occur following associative reward learning of temporally and spatially task-irrelevant distractors that signal the magnitude of available reward (Experiment 1), and is independent of training spatial shifts of attention towards the reward signaling stimuli (Experiment 2). This confirms and strengthens the idea that Pavlovian reward learning underlies value driven attentional capture.     

Effects of different practice conditions on acquisition, retention, and transfer of soccer skills by 9-year-old schoolchildren

This study was designed to examine effects of three practice models, blocked, variable, and combined, on the acquisition, retention, and transfer of new motor skills. 67 subjects (M age = 9.5 yr., SD = .3) from the fourth year of primary school (31 boys and 26 girls) were assigned at random to three different practice groups (Blocked = 22, Variable = 23, Combined = 22) to study acquisition of two skills, dribbling a soccer ball and kicking a soccer ball at a stationary target using the dominant foot. All participants received a pretest and posttest, a transfer test, and a retention test 2 wk. later. Analysis showed significant improvement after practice of kicking skills by the three groups but not in the dribbling skills, for which only the combined practice group showed any notable improvement. At the end of acquisition, the combined practice group had significantly better performance on the dribbling task than the other two groups. However, the only differences noted in performance of kicking the ball with the dominant foot were by combined practice and blocked groups.     

Lingual vibrotactile/auditory magnitude estimation and cross-modal matching: comparison of suprathreshold responses in men and women

The purpose of this study was to investigate the response patterns of men and women to suprathreshold lingual-vibrotactile and auditory stimulation. The psychophysical methods of magnitude estimation and cross-modal matching were used on a group of 10 men (M age = 19.6 yr.) and 10 women (M age = 20.2 yr.). Analysis showed that the men and women performed differently on the magnitude-estimation tasks and similarly on the cross-modal matching tasks. These results suggested that sex differences on suprathreshold psychophysical scaling may be related to the way men and women use numbers as opposed to possible differences in the perception of suprathreshold sensory stimuli by men and women.     

Developmental transition of EEG spectra to alpha band in a sample of children with developmental disabilities

Developmental transition of EEG spectra to alpha band of 14 children with developmental disabilities (from 7 yr. and 3 mo. to 16 yr. and 1 mo. of age at the first EEG recording: M= 13.2, SD=2.6; 6 girls and 8 boys) was studied by auto-power spectrum analysis longitudinally. The results showed the mean age (14.1 yr. to 14.8 yr. in the four regions of the frontal, central, parietal, and occipital regions) for subjects and their mean frequency (4.2 Hz to 4.7 Hz in the 4 regions) at which EEG shift started from theta band, and those means (15.1 yr. to 15.7 yr. and 9.5 Hz to 9.6 Hz in the 4 regions) at which EEG shift reached the alpha band. Prior EEG research on healthy children has shown that approximately 10 years of age is critical for developmental transition of EEG spectra to alpha frequencies. It is suggested that the present data showed a delay of this critical age for this sample of children with developmental disabilities relative to 10 years for healthy children reported by Katada, et al. and Benninger, et al.     

The involvement of the orbitofrontal cortex in learning under changing task contingencies

Previous investigations examining the rat prefrontal cortex subregions in attentional-set shifting have commonly employed two-choice discriminations. To better understand how varying levels of difficulty influence the contribution of the prefrontal cortex to learning, the present studies examined the effects of orbitofrontal cortex inactivation in a two- or four-choice odor reversal learning test. Long-Evans rats were trained to dig in cups that contained distinct odors. In the two-choice odor discrimination, one odor cup was always associated with a cereal reinforcement in acquisition while the opposite odor cup was associated with a cereal reinforcement in reversal learning. In the four-choice odor discrimination, an additional two cups containing distinct odors were used that were never associated with reinforcement in acquisition or reversal learning. Bilateral infusions of the GABA-A agonist, muscimol (0.5 microg) into the orbitofrontal cortex did not impair acquisition of either the two- or four-choice discrimination task. However, muscimol infusions into the orbitofrontal cortex impaired two- and four-choice reversal learning. In the two-choice odor reversal, muscimol treatment selectively increased perseverative errors. In the four-choice odor reversal, muscimol treatment increased perseverative, regressive, as well as irrelevant errors. These findings suggest that the orbital prefrontal cortex not only enables task switching by supporting the initial inhibition of a previously relevant choice pattern, but under increasing task demands also enables the reliable execution of a new choice pattern and reduction of interference to irrelevant stimuli.     

Serial reversal learning in bumblebees (Bombus impatiens)

Bumblebees are capable of rapidly learning discriminations, but flexibility in bumblebee learning is less well understood. We tested bumblebees (Bombus impatiens) on a serial reversal learning task. A serial reversal task requires learning of an initial discrimination between two differentially rewarded stimuli, followed by multiple reversals of the reward contingency between stimuli. A reduction in errors with repeated reversals in a serial reversal task is an indicator of behavioural flexibility. Bees were housed in a large indoor environment and tested during foraging flights. Testing free-flying bees allowed for large numbers of trials and reversals. All bees were trained to perform a simultaneous discrimination between two colours for a nectar reward, followed by nine reversals of this discrimination. Results showed that bumblebees reduced errors and improved their performance across successive reversals. A reduction in perseverative errors was the major cause of the improvement in performance. Bees showed a slight increase in error rate in their final trials, perhaps as a consequence of increasing proactive interference, but proactive interference may also have contributed to the overall improvement in performance across reversals. Bumblebees are thus capable of behavioural flexibility comparable to that of other animals and may use proactive interference as a mechanism of behavioural flexibility in varying environments.     

Training attention improves decision making in individuals with elevated self-reported depressive symptoms

Depression is often characterized by attentional biases toward negative items and away from positive items, which likely affects reward and punishment processing. Recent work has reported that training attention away from negative stimuli reduced this bias and reduced depressive symptoms. However, the effect of attention training on subsequent learning has yet to be explored. In the present study, participants were required to learn to maximize reward during decision making. Undergraduates with elevated self-reported depressive symptoms received attention training toward positive stimuli prior to performing the decision-making task (n = 20; active training). The active-training group was compared to two other groups: undergraduates with elevated self-reported depressive symptoms who received placebo training (n = 22; placebo training) and a control group with low levels of depressive symptoms (n = 33; nondepressive control). The placebo-training depressive group performed worse and switched between options more than did the nondepressive controls on the reward maximization task. However, depressives that received active training performed as well as the nondepressive controls. Computational modeling indicated that the placebo-trained group learned more from negative than from positive prediction errors, leading to more frequent switching. The nondepressive control and active-training depressive groups showed similar learning from positive and negative prediction errors, leading to less-frequent switching and better performance. Our results indicate that individuals with elevated depressive symptoms are impaired at reward maximization, but that the deficit can be improved with attention training toward positive stimuli.     

Adult age differences in frontostriatal representation of prediction error but not reward outcome

Emerging evidence from decision neuroscience suggests that although younger and older adults show similar frontostriatal representations of reward magnitude, older adults often show deficits in feedback-driven reinforcement learning. In the present study, healthy adults completed reward-based tasks that did or did not depend on probabilistic learning, while undergoing functional neuroimaging. We observed reductions in the frontostriatal representation of prediction errors during probabilistic learning in older adults. In contrast, we found evidence for stability across adulthood in the representation of reward outcome in a task that did not require learning. Together, the results identify changes across adulthood in the dynamic coding of relational representations of feedback, in spite of preserved reward sensitivity in old age. Overall, the results suggest that the neural representation of prediction error, but not reward outcome, is reduced in old age. These findings reveal a potential dissociation between cognition and motivation with age and identify a potential mechanism for explaining changes in learning-dependent decision making in old adulthood.     

Age effects shrink when motor learning is predominantly supported by nondeclarative, automatic memory processes: evidence from golf putting

Can motor learning be equivalent in younger and older adults? To address this question, 48 younger (M = 23.5 years) and 48 older (M = 65.0 years) participants learned to perform a golf-putting task in two different motor learning situations: one that resulted in infrequent errors or one that resulted in frequent errors. The results demonstrated that infrequent-error learning predominantly relied on nondeclarative, automatic memory processes whereas frequent-error learning predominantly relied on declarative, effortful memory processes: After learning, infrequent-error learners verbalized fewer strategies than frequent-error learners; at transfer, a concurrent, attention-demanding secondary task (tone counting) left motor performance of infrequent-error learners unaffected but impaired that of frequent-error learners. The results showed age-equivalent motor performance in infrequent-error learning but age deficits in frequent-error learning. Motor performance of frequent-error learners required more attention with age, as evidenced by an age deficit on the attention-demanding secondary task. The disappearance of age effects when nondeclarative, automatic memory processes predominated suggests that these processes are preserved with age and are available even early in motor learning.