The influence of CS-US interval on several different indices of learning in appetitive conditioning

Four experiments examined the effects of varying the conditioned stimulus-unconditioned stimulus (CS-US) interval (and US density) on learning in an appetitive magazine approach task with rats. Learning was assessed with conditioned response (CR) measures, as well as measures of sensory-specific stimulus-outcome associations (Pavlovian-instrumental transfer, potentiated feeding, and US devaluation). The results from these studies indicate that there exists an inverse relation between CS-US interval and magazine approach CRs, but that sensory-specific stimulus-outcome associations are established over a wide range of relatively long, but not short, CS-US intervals. These data suggest that simple CR measures provide different information about what is learned than measures of the specific stimulus-outcome association, and that time is a more critical variable for the former than latter component of learning.     

Differential outcomes effect in children: Demonstration and mechanisms

The present paper reports three experiments that examine the role of sample stimulus-outcome (S-O) and of comparison or choice response stimulus-outcome (R-O) relations in the differential outcomes discrimination learning of five-year-old children. In these experiments, S-O relations or R-O relations were maintained or removed across two different conditional discrimination tasks. The results indicated that only children who received training in either S-O or R-O relations showed positive transfer between the conditional discriminations. These data support a two-process (‘outcome expectancy’) account of differential outcomes phenomena in which each sub-problem in a discriminative conditional choice task has its own unique reinforcer, but they also indicate that both unique sample-outcome associations and unique choice-outcome associations are important contributing features to enhanced discriminative learning under differential outcomes procedures in humans. Comparison to a control in Experiments 2 and 3 indicated that merely having had previous experience with the stimuli or having previously discriminated the stimuli did not contribute to cross-discrimination transfer in the absence of prior explicit association between those stimuli and the specific differential outcomes.     

Implicit statistical learning in language processing: Word predictability is the key

Fundamental learning abilities related to the implicit encoding of sequential structure have been postulated to underlie language acquisition and processing. However, there is very little direct evidence to date supporting such a link between implicit statistical learning and language. In three experiments using novel methods of assessing implicit learning and language abilities, we show that sensitivity to sequential structure – as measured by improvements to immediate memory span for structurally-consistent input sequences – is significantly correlated with the ability to use knowledge of word predictability to aid speech perception under degraded listening conditions. Importantly, the association remained even after controlling for participant performance on other cognitive tasks, including short-term and working memory, intelligence, attention and inhibition, and vocabulary knowledge. Thus, the evidence suggests that implicit learning abilities are essential for acquiring long-term knowledge of the sequential structure of language – i.e., knowledge of word predictability – and that individual differences on such abilities impact speech perception in everyday situations. These findings provide a new theoretical rationale linking basic learning phenomena to specific aspects of spoken language processing in adults, and may furthermore indicate new fruitful directions for investigating both typical and atypical language development.     

Temporal predictability facilitates causal learning

Temporal predictability refers to the regularity or consistency of the time interval separating events. When encountering repeated instances of causes and effects, we also experience multiple cause-effect temporal intervals. Where this interval is constant it becomes possible to predict when the effect will follow from the cause. In contrast, interval variability entails unpredictability. Three experiments investigated the extent to which temporal predictability contributes to the inductive processes of human causal learning. The authors demonstrated that (a) causal relations with fixed temporal intervals are consistently judged as stronger than those with variable temporal intervals, (b) that causal judgments decline as a function of temporal uncertainty, and (c) that this effect remains undiminished with increased learning time. The results therefore clearly indicate that temporal predictability facilitates causal discovery. The authors considered the implications of their findings for various theoretical perspectives, including associative learning theory, the attribution shift hypothesis, and causal structure models.     

Learning style,judgements of learning,and learning of verbal and visual information

The concept of learning style is immensely popular despite the lack of evidence showing that learning style influences performance. This study tested the hypothesis that the popularity of learning style is maintained because it is associated with subjective aspects of learning, such as judgements of learning (JOLs). Preference for verbal and visual information was assessed using the revised Verbalizer‐Visualizer Questionnaire (VVQ). Then, participants studied a list of word pairs and a list of picture pairs, making JOLs (immediate, delayed, and global) while studying each list. Learning was tested by cued recall. The results showed that higher VVQ verbalizer scores were associated with higher immediate JOLs for words, and higher VVQ visualizer scores were associated with higher immediate JOLs for pictures. There was no association between VVQ scores and recall or JOL accuracy. As predicted, learning style was associated with subjective aspects of learning but not objective aspects of learning.     

Elaborative feedback: Engaging reward and task-relevant brain regions promotes learning in pseudoword reading aloud

Although much is known about the cognitive and neural basis of establishing letter-sound mappings in learning word forms, relatively little is known about what makes for the most effective feedback during this process. We sought to determine the neural basis by which elaborative feedback (EF), which contains both reward-related and content-specific information, may be more helpful than feedback containing only one kind of information (simple positive feedback, PF) or the other (content feedback, CF) in learning orthography-phonology (spelling-sound) mappings for novel letter strings. Compared to CF, EF activated the ventromedial prefrontal cortex, implicated in reward processing. Compared to PF, EF activated the posterior middle temporal, superior temporal, and supramarginal gyri—regions implicated in orthography-phonology conversion. In the same comparison, EF also activated the left fusiform gyrus/visual word form area—implicated in orthographic processing. Also EF, but not CF or PF, modulated activity in the caudate nucleus. In a postscan questionnaire, EF and PF were rated as more pleasant than CF, suggesting that modulation of the caudate for EF may be due to the coupling of reward and skill content. These findings suggest the enhanced effectiveness of EF may be due to concurrent activation of reward-related and task-relevant brain regions.     

Negative emotional outcomes impair older adults' reversal learning

In a typical reversal-learning experiment, one learns stimulus-outcome contingencies that then switch without warning. For instance, participants might have to repeatedly choose between two faces, one of which yields points whereas the other does not, with a reversal at some point in which face yields points. The current study examined age differences in the effects of outcome type on reversal learning. In the first experiment, the participants' task was either to select the person who would be in a better mood or to select the person who would yield more points. Reversals in which face was the correct option occurred several times. Older adults did worse in blocks in which the correct response was to select the person who would not be angry than in blocks in which the correct response was to select the person who would smile. Younger adults did not show a difference by emotional valence. In the second study, the negative condition was switched to have the same format as the positive condition (to select who will be angry). Again, older adults did worse with negative than positive outcomes, whereas younger adults did not show a difference by emotional valence. A third experiment replicated the lack of valence effects in younger adults with a harder probabilistic reversal-learning task. In the first two experiments, older adults performed about as well as younger adults in the positive conditions but performed worse in the negative conditions. These findings suggest that negative emotional outcomes selectively impair older adults' reversal learning.     

Pavlovian to instrumental transfer of control in a human learning task

Pavlovian learning tasks have been widely used as tools to understand basic cognitive and emotional processes in humans. The present studies investigated one particular task, Pavlovian-to-instrumental transfer (PIT), with human participants in an effort to examine potential cognitive and emotional effects of Pavlovian cues upon instrumentally trained performance. In two experiments, subjects first learned two separate instrumental response-outcome relationships (i.e., R1-O1 and R2-O2) and then were exposed to various stimulus-outcome relationships (i.e., S1-O1, S2-O2, S3-O3, and S4-) before the effects of the Pavlovian stimuli on instrumental responding were assessed during a non-reinforced test. In Experiment 1, instrumental responding was established using a positive-reinforcement procedure, whereas in Experiment 2, a quasi-avoidance learning task was used. In both cases, the Pavlovian stimuli exerted selective control over instrumental responding, whereby S1 and S2 selectively elevated the instrumental response with which it shared an outcome. In addition, in Experiment 2, S3 exerted a nonselective transfer of control effect, whereby both responses were elevated over baseline levels. These data identify two ways, one specific and one general, in which Pavlovian processes can exert control over instrumental responding in human learning paradigms, suggesting that this method may serve as a useful tool in the study of basic cognitive and emotional processes in human learning.     

Selective learning of spatial configuration and object identity in visual search

To conduct an efficient visual search, visual attention must be guided to a target appropriately. Previous studies have suggested that attention can be quickly guided to a target when the spatial configurations of search objects or the object identities have been repeated. This phenomenon is termed contextual cuing. In this study, we investigated the effect of learning spatial configurations, object identities, and a combination of both configurations and identities on visual search. The results indicated that participants could learn the contexts of spatial configurations, but not of object identities, even when both configurations and identities were completely correlated (Experiment 1). On the other hand, when only object identities were repeated, an effect of identity learning could be observed (Experiment 2). Furthermore, an additive effect of configuration learning and identity learning was observed when, in some trials, each context was the relevant cue for predicting the target (Experiment 3). Participants could learn only the context that was associated with target location (Experiment 4). These findings indicate that when multiple contexts are redundant, contextual learning occurs selectively, depending on the predictability of the target location.     

The procedural learning of action order is independent of temporal learning

How does learning the timing of actions influence our ability to learn the order of actions? A sequence of responses cued by spatial stimuli was learned in a serial reaction time task where the response-to-stimulus intervals (RSIs) were random, constant, or followed a fixed sequence. In this final sequenced-RSI condition, the response and RSI sequences were consistently matched in phase and could be integrated into a common sequence representation. The main result was that the response sequence was learned to a similar degree in all RSI training conditions, indicating that neither the predictability of RSIs nor the integration of the phase-matched response and timing sequences benefited learning of the response sequence. Nevertheless, temporal learning and integration speeded up performance without strengthening the representation of response order.     

Statistical learning in a serial reaction time task: access to separable statistical cues by individual learners.

The ability of adult learners to exploit the joint and conditional probabilities in a serial reaction time task containing both deterministic and probabilistic information was investigated. Learners used the statistical information embedded in a continuous input stream to improve their performance for certain transitions by simultaneously exploiting differences in the predictability of 2 or more underlying statistics. Analysis of individual learners revealed that although most acquired the underlying statistical structure veridically, others used an alternate strategy that was partially predictive of the sequences. The findings show that learners possess a robust learning device well suited to exploiting the relative predictability of more than I source of statistical information at the same time. This work expands on previous studies of statistical learning, as well as studies of artificial grammar learning and implicit sequence learning.     

Dopaminergic modulation of incentive motivation in adolescence: age-related changes in signaling, individual differences, and implications for the development of self-regulation

Behavioral activation that is associated with incentive-reward motivation increases in adolescence relative to childhood and adulthood. This quadratic developmental pattern is generally supported by behavioral and experimental neuroscience findings. It is suggested that a focus on changes in dopamine neurotransmission is informative in understanding the mechanism for this adolescent increase in reward-related behavioral activation and subsequent decline into adulthood. Evidence is presented to indicate that incentive-reward motivation is modulated by mesoaccumbens dopamine, and that it increases in adolescence before declining into adulthood because of normative developmental changes at the molecular level. Potential mechanisms of variation in functional mesoaccumbens dopamine transmission are discussed with a focus on the interplay between tonic and phasic modes of dopamine transmission in modulating both general incentive-motivational biases and the efficacy of reward learning during exposure to novel reward experiences. Interactions between individual difference factors and these age-related trends are discussed.     

Open field activity after learning in mice

The possible increase of open field activity after learning in mice was examined in five experiments, where the following factors were assessed: (1) and (2) the duration of an open field activity increase (3) the influence of the familiarity of the environment (4) the influence of floor texture during activity measurements and (5) the result of motor activation per se compared to the result of learning. The results indicate that the activity increase lasted 60 min. The phenomenon was related to the learning paradigm used and to the familiarity of the environment and was affected by floor texture. Motor activation per se did not activate the mice as much as the learning of a task. It is suggested that an open field activity increase in mice after learning is associated both with the strain due to the acquisition of a new response and with the strain due to the activity measurement.     

Implicit learning as an ability

The ability to automatically and implicitly detect complex and noisy regularities in the environment is a fundamental aspect of human cognition. Despite considerable interest in implicit processes, few researchers have conceptualized implicit learning as an ability with meaningful individual differences. Instead, various researchers (e.g., Reber, 1993; Stanovich, 2009) have suggested that individual differences in implicit learning are minimal relative to individual differences in explicit learning. In the current study of English 16–17 year old students, we investigated the association of individual differences in implicit learning with a variety of cognitive and personality variables. Consistent with prior research and theorizing, implicit learning, as measured by a probabilistic sequence learning task, was more weakly related to psychometric intelligence than was explicit associative learning, and was unrelated to working memory. Structural equation modeling revealed that implicit learning was independently related to two components of psychometric intelligence: verbal analogical reasoning and processing speed. Implicit learning was also independently related to academic performance on two foreign language exams (French, German). Further, implicit learning was significantly associated with aspects of self-reported personality, including intuition, Openness to Experience, and impulsivity. We discuss the implications of implicit learning as an ability for dual-process theories of cognition, intelligence, personality, skill learning, complex cognition, and language acquisition.     

Functional specialization within the striatum along both the dorsal/ventral and anterior/posterior axes during associative learning via reward and punishment

The goal of the present study was to elucidate the role of the human striatum in learning via reward and punishment during an associative learning task. Previous studies have identified the striatum as a critical component in the neural circuitry of reward-related learning. It remains unclear, however, under what task conditions, and to what extent, the striatum is modulated by punishment during an instrumental learning task. Using high-resolution functional magnetic resonance imaging (fMRI) during a reward- and punishment-based probabilistic associative learning task, we observed activity in the ventral putamen for stimuli learned via reward regardless of whether participants were correct or incorrect (i.e., outcome). In contrast, activity in the dorsal caudate was modulated by trials that received feedback--either correct reward or incorrect punishment trials. We also identified an anterior/posterior dissociation reflecting reward and punishment prediction error estimates. Additionally, differences in patterns of activity that correlated with the amount of training were identified along the anterior/posterior axis of the striatum. We suggest that unique subregions of the striatum--separated along both a dorsal/ventral and anterior/posterior axis--differentially participate in the learning of associations through reward and punishment.     

积极情绪提高背景线索学习的适应性

背景线索的学习缺乏适应性, 这种缺乏表现在两个方面：其一是难以在已习得的场景表征上捆绑一个新目标位置(Re-learning), 也就是场景表征的更新受阻; 其二是在习得一组场景表征后, 难以学习另一组全新场景(New-learning)。研究表明, 在旧场景表征上捆绑一个新目标位置的能力可能与注意范围大小有关, 而学习全新场景则需要重置学习功能。积极情绪可以有效扩大注意范围, 并改善对旧有认知模式的固着, 因此积极情绪启动将有可能提升背景线索学习的适应性。本研究采用效价为中性和积极的情绪性图片来启动对应的情绪, 探索旧场景捆绑新目标位置时和学习全新场景时, 背景线索的学习情况, 验证积极情绪是否可以提高背景线索学习中的适应性。实验发现, 积极情绪无法促进旧场景上捆绑新目标位置的背景线索学习(Re-learning), 但是可以促进全新场景的学习(New-learning)。该结果说明, 积极情绪可以提高被试的场景学习能力进而促进对全新场景的学习, 却无法减少由表征相似性引起的旧表征的自动检索, 进而无法改善旧表征的更新过程。     

Concreteness effects in bilingual and monolingual word learning

Previous studies have demonstrated that bilingualism can facilitate novel-word learning. However, the mechanisms behind this bilingual advantage remain unknown. Here, we examined whether bilinguals may be more sensitive to semantic information associated with the novel words. To that end, we manipulated the concreteness of the referent in the word-learning paradigm, since concrete words have been shown to activate the semantic system more robustly than abstract words do. The results revealed that the bilingual advantage was stronger for novel words learned in association with concrete rather than abstract referents. These findings suggest that bilingual advantages for word learning may be rooted, at least in part, in bilinguals' greater sensitivity to semantic information during learning.     

The role of nucleus accumbens dopamine in outcome encoding in instrumental and Pavlovian conditioning

Considerable evidence suggests that dopamine in the core subregion of the nucleus accumbens is not only involved in Pavlovian conditioning but also supports instrumental performance. However, it is largely unknown whether NAc dopamine is required for outcome encoding which plays an important role both in Pavlovian stimulus-outcome learning and instrumental action-outcome learning. Therefore, we tested rats with 6-hydroxydopamine (6-OHDA) induced dopamine depletion of the NAc core for their sensitivity to outcome devaluation in a Pavlovian and an instrumental task. Results indicate that 6-OHDA-lesioned animals were sensitive to outcome devaluation in an instrumental task. This finding provides support to the notion that NAc core dopamine may not be crucial in encoding action-outcome associations. However, during instrumental conditioning lever pressing rates in 6-OHDA-lesioned animals were markedly lower which could reflect an impaired behavioral activation. By contrast, after outcome-specific devaluation in a Pavlovian task, performance in 6-OHDA-lesioned animals was impaired, i.e. their magazine-directed responding was non-selectively reduced. One possibility to explain non-selective responding is that NAc core DA depletion impaired the ability of conditioned stimuli to activate the memory of the current value of the reinforcer.     

Several types of learning increase open field activity in mice

Experimental and control groups of mice were initially matched on the basis of their open field activity. Experimental groups were trained in one of six types of learning tasks: (1) active avoidance conditioning with light and sound signals as conditioned stimuli and electric shocks as uncoditioned stimulus, (2) learning of a linear 5-point maze, (3) learning of a T-maze, (4) passive avoidance conditioning, (5) learning of non-aggressive behavior, and (6) learning of aggressive behavior. In all cases, learning was associated with a significant increase of the open field activity over that of the untrained but otherwise similarly treated control mice. This effect was most marked during the learning phase and disappeared when the acquired behavior had become firmly established. It is suggested that several types of learning are associated with an increase of arousal level, possibly mediated by the activation of central catecholamine neurons.     

The tight coupling between category and causal learning

The main goal of the present research was to demonstrate the interaction between category and causal induction in causal model learning. We used a two-phase learning procedure in which learners were presented with learning input referring to two interconnected causal relations forming a causal chain (Experiment 1) or a common-cause model (Experiments 2a, b). One of the three events (i.e., the intermediate event of the chain, or the common cause) was presented as a set of uncategorized exemplars. Although participants were not provided with any feedback about category labels, they tended to induce categories in the first phase that maximized the predictability of their causes or effects. In the second causal learning phase, participants had the choice between transferring the newly learned categories from the first phase at the cost of suboptimal predictions, or they could induce a new set of optimally predictive categories for the second causal relation, but at the cost of proliferating different category schemes for the same set of events. It turned out that in all three experiments learners tended to transfer the categories entailed by the first causal relation to the second causal relation.