Adjusting foraging strategies: a comparison of rural and urban common mynas (<Emphasis Type="Italic">Acridotheres tristis</Emphasis>)

Establishment in urbanized environments is associated with changes in physiology, behaviour, and problem-solving. We compared the speed of learning in urban and rural female common mynas, Acridotheres tristis, using a standard visual discrimination task followed by a reversal learning phase. We also examined how quickly each bird progressed through different stages of learning, including sampling and acquisition within both initial and reversal learning, and persistence following reversal. Based on their reliance on very different food resources, we expected urban mynas to learn and reversal learn more quickly but to sample new contingencies for proportionately longer before learning them. When quantified from first presentation to criterion achievement, urban mynas took more 20-trial blocks to learn the initial discrimination, as well as the reversed contingency, than rural mynas. More detailed analyses at the level of stage revealed that this was because urban mynas explored the novel cue-outcome contingencies for longer, and despite transitioning faster through subsequent acquisition, remained overall slower than rural females. Our findings draw attention to fine adjustments in learning strategies in response to urbanization and caution against interpreting the speed to learn a task as a reflection of cognitive ability.     

Individual differences in cognitive control: The role of psychoticism and working memory in set‐shifting

Set‐shifting refers to a process of cognitive control which is shown through flexible behavioural adaptation to changes in task parameters or demands, such as the switching of an explicit rule (extra‐dimensional rule shifting) or the reversal of a reinforcement‐contingency (reversal‐learning). Set‐shifting deficits are widely documented in specific neuropsychological disorders, but seldom investigated in relation to normally‐occurring individual differences. In a sample of healthy adults (N=78, 28% male), we demonstrate that Working Memory and trait Psychoticism have independent involvement in extra‐dimensional rule shifting as measured using an analogue of the Wisconsin Card Sorting Test. Only Psychoticism, however, was involved in reversal‐learning, as assessed using a recent modification of the Iowa Gambling Task. Individual differences in extra‐dimensional rule shifting were explained in terms of rule abstraction speed, while individual differences in reversal‐learning were explained in terms of response perseveration. These results clarify component processes in different forms of set‐shifting, and highlight the role of individual differences, especially personality, in cognitive control.     

Touch screen assays of behavioural flexibility and error characteristics in Eastern grey squirrels (<Emphasis Type="Italic">Sciurus carolinensis</Emphasis>)

Behavioural flexibility allows animals to adjust their behaviours according to changing environmental demands. Such flexibility is frequently assessed by the discrimination–reversal learning task. We examined grey squirrels’ behavioural flexibility, using a simultaneous colour discrimination–reversal learning task on a touch screen. Squirrels were trained to select their non-preferred colour in the discrimination phase, and their preferred colour was rewarded in a subsequent reversal phase. We used error rates to divide learning in each phase into three stages (perseveration, chance level and ‘learned’) and examined response inhibition and head-switching during each stage. We found consistent behavioural patterns were associated with each learning stage: in the perseveration stage, at the beginning of each training phase, squirrels showed comparable response latencies to correct and incorrect stimuli, along with a low level of head-switching. They quickly overcame perseveration, typically in one to three training blocks. In the chance-level stage, response latencies to both stimuli were low, but during initial discrimination squirrels showed more head-switches than in the previous stage. This suggests that squirrels were learning the current reward contingency by responding rapidly to a stimulus, but with increased attention to both stimuli. In the learned stage, response latencies to the correct stimulus and the number of head-switches were at their highest, whereas incorrect response latencies were at their lowest, and differed significantly from correct response latencies. These results suggest increased response inhibition and attention allowed the squirrels to minimise errors. They also suggest that errors in the ‘learned’ stage were related to impulsive emission of the pre-potent or previously learned responses.     

Neonatal odor-shock conditioning alters the neural network involved in odor fear learning at adulthood

Adult learning and memory functions are strongly dependent on neonatal experiences. We recently showed that neonatal odor-shock learning attenuates later life odor fear conditioning and amygdala activity. In the present work we investigated whether changes observed in adults can also be observed in other structures normally involved, namely olfactory cortical areas. For this, pups were trained daily from postnatal (PN) 8 to 12 in an odor-shock paradigm, and retrained at adulthood in the same task. (14)C 2-DG autoradiographic brain mapping was used to measure training-related activation in amygdala cortical nucleus (CoA), anterior (aPCx), and posterior (pPCx) piriform cortex. In addition, field potentials induced in the three sites in response to paired-pulse stimulation of the olfactory bulb were recorded in order to assess short-term inhibition and facilitation in these structures. Attenuated adult fear learning was accompanied by a deficit in 2-DG activation in CoA and pPCx. Moreover, electrophysiological recordings revealed that, in these sites, the level of inhibition was lower than in control animals. These data indicate that early life odor-shock learning produces changes throughout structures of the adult learning circuit that are independent, at least in part, from those involved in infant learning. Moreover, these enduring effects were influenced by the contingency of the infant experience since paired odor-shock produced greater disruption of adult learning and its supporting neural pathway than unpaired presentations. These results suggest that some enduring effects of early life experience are potentiated by contingency and extend beyond brain areas involved in infant learning.     

Propensity for risk taking and trait impulsivity in the Iowa Gambling Task

The Iowa Gambling Task (IGT) is sensitive to decision making impairments in several clinical groups with frontal impairment. However the complexity of the IGT, particularly in terms of its learning requirements, makes it difficult to know whether disadvantageous (risky) selections in this task reflect deliberate risk taking or a failure to recognise risk. To determine whether propensity for risk taking contributes to IGT performance, we correlated IGT selections with a measure of propensity for risk taking from the Balloon Analogue Risk Task (BART), taking into account potential moderating effects of IGT learning requirements, and trait impulsivity, which is associated with learning difficulties. We found that IGT and BART performance were related, but only in the later stages of the IGT, and only in participants with low trait impulsivity. This finding suggests that IGT performance may reflect different underlying processes in individuals with low and high trait impulsivity. In individuals with low trait impulsivity, it appears that risky selections in the IGT reflect in part, propensity for risk seeking, but only after the development of explicit knowledge of IGT risks after a period of learning.     

Serial reversal learning in bumblebees (Bombus impatiens)

Bumblebees are capable of rapidly learning discriminations, but flexibility in bumblebee learning is less well understood. We tested bumblebees (Bombus impatiens) on a serial reversal learning task. A serial reversal task requires learning of an initial discrimination between two differentially rewarded stimuli, followed by multiple reversals of the reward contingency between stimuli. A reduction in errors with repeated reversals in a serial reversal task is an indicator of behavioural flexibility. Bees were housed in a large indoor environment and tested during foraging flights. Testing free-flying bees allowed for large numbers of trials and reversals. All bees were trained to perform a simultaneous discrimination between two colours for a nectar reward, followed by nine reversals of this discrimination. Results showed that bumblebees reduced errors and improved their performance across successive reversals. A reduction in perseverative errors was the major cause of the improvement in performance. Bees showed a slight increase in error rate in their final trials, perhaps as a consequence of increasing proactive interference, but proactive interference may also have contributed to the overall improvement in performance across reversals. Bumblebees are thus capable of behavioural flexibility comparable to that of other animals and may use proactive interference as a mechanism of behavioural flexibility in varying environments.     

The effects of extinction,noncontingent reinforcement and differential reinforcement of other behavior as control procedures

Several techniques have been used in applied research as controls for the introduction of a reinforcement contingency, including extinction, noncontingent reinforcement (NCR), and differential reinforcement of other behavior (DRO). Little research, however, has examined the relative strengths and limitations of these "reversal" controls. We compared the effects of extinction with those of NCR and DRO in both multi-element and reversal designs, with respect to (a) rate and amount of response decrement, (b) rate of response recovery following reintroduction of reinforcement, and (c) any positive or negative side effects associated with transitions. Results indicated that extinction generally produced the most consistent and rapid reversal effects, with few observed negative side effects.     

Emotion-based learning on a simplified card game: the Iowa and Bangor Gambling Tasks

The Iowa Gambling Task (IGT) has been widely used in the assessment of neurological patients with frontal lesions. Emphasis has been placed on the complexity of the task (i.e., four decks of varying contingency pattern) with the suggestion that the participant must use emotion-based learning to deal with a complex decision-making process. The present study used a single deck card game (the Bangor Gambling Task, BGT), matched in many respects with the Iowa Gambling Task, in which the contingencies varied over time (gradually becoming worse for the participant) rather than across deck (as in the IGT). Forty participants performed both tasks. Performance on the tasks showed many similarities, with participants showing a comparable pattern of incremental learning on both tasks, reaching an analogous final level of performance. More importantly, there was a high correlation (r(2) = .93) in performance between the two tasks, the most salient feature of which was that virtually every participant who fell below categorisation of impaired IGT performance, also did very poorly on the BGT. These findings bear on the question of whether arguments about the 'complexity' of the Iowa Gambling Task necessarily explain why it appears to require emotion-based learning. The Bangor Gambling Task might also be a useful tool for clinical neuropsychologists, in the assessment of patients with executive dysfunction-given that the task is easier and quicker to administer than the Iowa Gambling Task, but appears to share the same performance features.     

How to explain receptivity to conjunction-fallacy inhibition training: Evidence from the Iowa Gambling Task

Intuitive predictions and judgments under conditions of uncertainty are often mediated by judgment heuristics that sometimes lead to biases. Using the classical conjunction bias example, the present study examines the relationship between receptivity to metacognitive executive training and emotion-based learning ability indexed by Iowa Gambling Task (IGT) performance. After completing a computerised version of the IGT, participants were trained to avoid conjunction bias on a frequency judgment task derived from the works of Tversky and Kahneman. Pre- and post-test performances were assessed via another probability judgment task. Results clearly showed that participants who produced a biased answer despite the experimental training (individual patterns of the biased → biased type) mainly had less emotion-based learning ability in IGT. Better emotion-based learning ability was observed in participants whose response pattern was biased → logical. These findings argue in favour of the capacity of the human mind/brain to overcome reasoning bias when trained under executive programming conditions and as a function of emotional warning sensitivity.     

Contingency learning with evaluative stimuli: testing the generality of contingency learning in a performance paradigm

In two experiments, we tested the generality of the learning effects in the recently-introduced color-word contingency learning paradigm. Participants made speeded evaluative judgments to valenced target words. Each of a set of distracting nonwords was presented most often with either positive or negative target words. We observed that participants responded faster on trials that respected these contingencies than on trials that contradicted the contingencies. The contingencies also produced changes in liking: in a subsequent explicit evaluative rating task, participants rated positively-conditioned nonwords more positively than negatively-conditioned nonwords. Interestingly, contingency effects in the performance task correlated with this explicit rating effect in both experiments. In Experiment 2, all effects reported were independent of subjective and objective contingency awareness (which was completely lacking), even when awareness was measured at the item level. Our results reveal that learning in this type of performance task extends to nonword-valence contingencies and to responses different from those emitted during the performance task. We discuss the implications of these findings for theories about the processes that underlie contingency learning in performance tasks and for research on evaluative conditioning.     

Paradoxical effects of education on the Iowa Gambling Task

Suitable normative information on the Iowa Gambling Task (IGT) is not currently available, though it is clear that there is great individual variability in performance on this assessment tool. Given that the task is presumed to measure the emotion-based learning systems that are thought to form the biological basis of 'intuition,' there is some reason to think that education (especially tertiary education) might explicitly de-emphasise the role of emotion-based learning in decision-making. This suggests the paradoxical finding that better-educated participants should show poorer performance on the IGT. We recruited 30 participants (all female, all aged 18-25) to participate in a 'real money' version of the IGT. There was no significant difference in performance in blocks 1-3 of the task (trials 1-60). However, there was a substantial effect of education on the final two blocks (trials 61-100), such that the less-well-educated participants produced twice as much of an improvement over baseline as did their university-educated colleagues. A range of possible explanations for this remarkable finding are discussed. The most likely appears to be that tertiary education specifically discourages the use of emotion-based learning systems in decision-making. These findings bear on the extent to which education has a role to play in our reliance on cognition and emotion in decision-making, including the likely role of education in the generation and maintenance of false beliefs.     

Judgements of a 2 × 2 contingency table: Sequential processing and the learning curve

Shanks (1985) has used a video game to investigate how subjects estimate the effect of their behaviour in a task defined by a 2×2 contingency table. The subjects were able to distinguish positive and negative contingencies from zero contingencies. In addition, they showed a learning curve and a bias to rate zero contingencies with a high outcome density higher than low-density zero contingencies. He interpreted these data as being consistent with associative models derived from animal learning. In Experiment 1 we replicated these results using a task and instructions similar to his. In a second experiment we showed that the subjects' tendency to overestimate high-density zero contingencies did not arise because the “game” was so difficult that it interfered with processing the events. In this experiment subjects were given tables of the outcome frequencies that had been determined by the earlier subjects. These subjects were, if anything, less accurate in rating the zero contingencies. We point out several logical problems with Shanks's initial task. The task did not represent a true 2×2 contingency, and aspects of it were physically impossible. In Experiment 3 we modified the task to represent a true 2×2 contingency. Using this task, we found a similar pattern of results, except that there was no evidence of the learning curve predicted by the associative models. We conclude that there is little in our data to rule out a “rule-based” analysis of contingency judgements.     

No evidence of risk-taking or impulsive behaviour in a person with episodic amnesia: Implications for the role of the hippocampus in future-regarding decision-making

Does advantageous decision-making require one to explicitly remember the outcome of a series of past decisions or to imagine future personal consequences of one's choices? Findings that amnesic people with hippocampal damage cannot form a clear preference for advantageous decks over many learning trials on the Iowa Gambling Task (IGT) have been taken to suggest that complex decision-making on the IGT depends on declarative (episodic) memory and hippocampal integrity. Alternatively, impaired IGT performance in amnesic individuals could be secondary to risk-taking and/or impulsive behaviour resulting from impaired episodic future thinking (i.e. prospection) known to accompany amnesia. We tested this possibility in the amnesic individual K.C. using the IGT and the Toronto Gambling Task (TGT), a novel task that dissociates impulsivity from risk-taking without placing demands on declarative memory. K.C. did not develop a preference for advantageous over disadvantageous decks on the IGT and, instead, showed a slight preference for short-term gains and an inability to acquire a more adaptive appreciation of longer-term losses. He also did not display impulsive or risk-taking behaviour on the TGT, despite a profound inability to imagine personal future experiences. These findings suggest that impaired decision-making on the IGT in amnesia is unlikely to reflect a predilection to act in the moment or failure to take future consequences into account. Instead, some forms of future-regarding decision-making may be dissociable, with performance on tasks relying on declarative learning or on episodic-constructive processes more likely to be impaired.     

Best not to bet on the horserace: A comment on Forrin and MacLeod (2017) and a relevant stimulus-response compatibility view of colour-word contingency learning asymmetries

One powerfully robust method for the study of human contingency learning is the colour-word contingency learning paradigm. In this task, participants respond to the print colour of neutral words, each of which is presented most often in one colour. The contingencies between words and colours are learned, as indicated by faster and more accurate responses when words are presented in their expected colour relative to an unexpected colour. In a recent report, Forrin and MacLeod (2017b, Memory & Cognition) asked to what extent this performance (i.e., response time) measure of learning might depend on the relative speed of processing of the word and the colour. With keypress responses, learning effects were comparable when responding to the word and to the colour (contrary to predictions). However, an asymmetry appeared in a second experiment with vocal responses, with a contingency effect only present for colour identification. In a third experiment, the colour was preexposed, and contingency effects were again roughly symmetrical. In their report, they suggested that a simple speed-of-processing (or “horserace”) model might explain when contingency effects are observed in colour and word identification. In the present report, an alternative view is presented. In particular, it is argued that the results are best explained by appealing to the notion of relevant stimulus–response compatibility, which also resolves discrepancies between horserace model predictions and participant results. The article presents simulations with the Parallel Episodic Processing model to demonstrate this case.     

Heart rate reactivity during contingency learning in 5‐ to 10‐month‐old at‐risk and non‐risk babies

The study investigated the dynamic relation between contingency learning and heart rate with risk and non‐risk babies 5‐ to 10‐months‐old. Four groups were compared in a two contingency treatments (contingent, yoked) × two risk status design. Concurrent heart rate was monitored during three phases of a contingency learning task (baseline, contingency/stimulation, extinction) and analysis focused on phase transitions. Non‐risk babies presented with contingent stimulation showed an immediate increase in cardiac rate associated with a subsequent response increase to the contingency. Risk infants presented with contingent stimulation showed delayed cardiac reactivity accompanied by a smaller response increase to the contingency. Yoked controls decreased responding in the contingent period with no significant changes in cardiac reactivity at phase transitions. The findings of the study are discussed in relation to individual differences in physiological regulation and to differential sensitization in a contingency learning task.     

Implicit learning of a speed-contingent target feature

Previous human implicit learning studies have mostly investigated implicit associations between two consecutive stimuli or between a stimulus and the subsequent response (e.g., Cleeremans, Destrebecqz, & Boyer, Trends in Cognitive Sciences, 2(10), 406–416, 1998). In the present study, participants’ response speed was used as a cue to predict an upcoming target feature. We called this new type of cueing, “cueing-by-response” (CBR). We investigated whether CBR could be learned implicitly. Participants performed two tasks: participants quickly responded to a target in the simple detection task and determined the orientation of a new target in the consecutive visual search task. We applied a contingency that the target location in the visual search task was determined by the participant’s response speed in the preceding simple detection task. The results demonstrated that participants learned the contingency without conscious awareness; they searched for the target more efficiently in the visual search task as the experiment progressed. But when the target appeared in a random location, this efficiency disappeared. Moreover, the experimental group exhibited faster response speeds to the target in the visual search task compared with the control groups, which had no contingency. These results suggest that individuals may use the relative speed of their own response as a predictive cue to guide spatial attention toward upcoming target locations, and CBR can be implicitly learned.     

Being there on time: Reinforcer effects on timing and locating

In research on timing, reinforcers often are assumed to influence discrimination of elapsed time. We asked whether changes in choice used to measure timing arise because of joint control by elapsed time and reinforcers, rather than from the direct modification of control by elapsed time by reinforcers. Pigeons worked on a concurrent-choice task in which 1 response was 9 times more likely to produce a reinforcer, reversing between locations when 19 s had elapsed since the marker event. Across conditions, we manipulated the percentage of reinforcers arranged before the probability reversal from 5 to 95%. These changes in reinforcer percentages altered control by location-based elements of the contingency, but not by time-based elements. Choice was well described by a model that assumes that control by the contingency is weakened by generalization across the time and location of reinforcers, and that these generalizations become more likely at later times since a marker. These findings add to a growing body of research that suggests that reinforcers share the same function as other environmental events in determining how the environment controls behavior.     

A demonstration of observational learning in rats using a bidirectional control

Hungry rats observed a conspecific demonstrator pushing a single manipulandum, a joystick, to the right or to the left for food reward and were then allowed access to the joystick from a different orientation. The effects of right-pushing vs left-pushing observation experience on (1) response acquisition, (2) reversal of a left-right discrimination, and (3) responding in extinction, were examined. Rats that had observed left-pushing made more left responses during acquisition than rats that had observed right-pushing, and rats that had observed demonstrators pushing in the direction that had previously been reinforced took longer to reach criterion reversal and made more responses in extinction than rats that had observed demonstrators pushing in the opposite direction to that previously reinforced. These results provide evidence that rats are capable of learning a response, or a response-reinforcer contingency, through conspecific observation.     

Step changes in the intertrial interval in the midsession reversal task: Predicting pigeons' performance with the learning-to-time model

Our goal was to assess the role of timing in pigeons' performance in the midsession reversal task. In discrete-trial sessions, pigeons learned to discriminate between 2 stimuli, S1 and S2. Choices of S1 were reinforced only in the first half of the session and choices of S2 were reinforced only in the second half. Typically, pigeons choose S2 before the contingency reverses (anticipatory errors) and S1 after (perseverative errors), suggesting that they time the interval from the beginning of the session to the contingency reversal. To test this hypothesis, we exposed pigeons to a midsession reversal task and, depending on the group, either increased or decreased the ITI duration. We then contrasted the pigeons' performance with the predictions of the Learning-to-Time (LeT) model: In both conditions, preference was expected to reverse at the same time as in the previous sessions. When the ITI was doubled, pigeons' preference reversal occurred at half the trial number but at the same time as in the previous sessions. When the ITI was halved, pigeons' preference reversal occurred at a later trial but at an earlier time than in the previous sessions. Hence, pigeons' performance was only partially consistent with the predictions of LeT, suggesting that besides timing, other sources of control, such as the outcome of previous trials, seem to influence choice.     

Location serves as a conditional cue when harp seals (Pagophilus groenlandicus) solve object discrimination reversal problems.

We examined the capacity of harp seals (Pagophilus groenlandicus) to use spatial context (i.e., their tank) as a conditional cue to solve a two-choice visual discrimination reversal task. Seals were trained to touch one of two 3D objects. Two of four seals experienced a context shift that coincided with each of five reversals in the reward value of the two stimuli (i.e., a reversal of S+ and S-); these seals solved the six discriminations in significantly fewer trials than did seals that did not experience a context shift with the contingency reversal. Thus, harp seals use contextual cues when encoding information. The findings are discussed in terms of harp seals' adaptations to the pack-ice environment, the constraints of the learning tasks, and the nature of the subjects that were raised in captivity.