Expectancy-learning and evaluative learning in human classical conditioning: affective priming as an indirect and unobtrusive measure of conditioned stimulus valence

It has been argued that in classical conditioning two processes might be operative. First, one may learn that the conditioned stimulus (CS+) is a valid predictor for the occurrence of the biologically negative or positive event (US; expectancy-learning). Second, one may learn to perceive the conditioned stimulus itself as a negative or positive stimulus, depending on the valence of the event it has been associated with (evaluative learning). Until the present, however, both forms of learning have been investigated using rather different conditioning procedures. Using a differential aversive conditioning preparation with pictures of human faces as CSs and an electrocutaneous stimulus as US, we were able to demonstrate that both forms of learning can co-occur. Moreover, the extent of evaluative learning in this aversive conditioning procedure did not significantly differ from the amount of evaluative learning in an evaluative conditioning procedure with positive and negative adjectives as USs, which was administered to the same participants. In the present study evaluative learning was not only indexed by direct evaluative ratings, but we introduced affective priming as an indirect and unobtrusive, reaction time based measure of stimulus valence. Finally, imagery instructions during acquisition did not facilitate expectancy-learning nor evaluative learning.     

Past experience influences the processing of stimulus compounds in human Pavlovian conditioning

In two human skin conductance conditioning experiments we investigated whether processing of stimulus compounds can be influenced by past experience. Participants were either pre-trained with a discrimination problem that could be solved elementally (A+, B−, AB+, C− in Experiment 1 and A+, AB+, C−, CB− in Experiment 2) or one that required a configural solution (AB+, BC−, CD+, DA− in Experiment 1 and A−, AB+, C+, CB− in Experiment 2). After pre-training, participants were shown an EX+, FX− discrimination. Subsequently, responding to individual components (E and F) was tested. After elemental pre-training, participants showed larger responses to the component from the previously reinforced compound (E) than to the component from the nonreinforced compound (F) whereas no such difference was found after configural pre-training. This means that the kind of pre-training influenced whether the later discrimination problem was processed elementally or configurally. The results indicate that organisms can flexibly process stimulus compounds in different ways.     

Some determinants of latent inhibition in human predictive learning

The present experiments assessed the effects of different manipulations between cue preexposure and cue-outcome pairings on latent inhibition (LI) in a predictive learning task with human participants. To facilitate LI, preexposure and acquisition with the target cues took place while participants performed a secondary task. Presentation of neither the target cues nor the target outcome was anticipated based on the instructions. Experiment 1 demonstrated the LI effect in the new experimental preparation. Experiment 2 analyzed the impact on LI of different activities that participants performed during the interval between preexposure and acquisition. Experiment 3 assessed LI as a function of changes in the secondary task cues made between preexposure and acquisition, namely presenting novel cues and reversing the cue-outcome contingencies. All of the manipulations in Experiments 2 and 3 resulted in a decrease in LI. The attenuation of LI by these manipulations challenges most current theories of learning and is best accommodated by Conditioned Attention Theory (Lubow, Weiner, & Schnur, 1981).     

Stress associated changes in Pavlovian-instrumental transfer in humans

Predictive learning is known to influence instrumental responding for reward. Cues associated with an instrumental outcome can influence performance in two ways: (a) by selectively promoting actions associated with the outcome predicted by the cue (specific transfer), and (b) by increasing motivation and the vigour of instrumental responding (general transfer). To examine these two distinct processes in humans we developed a novel behavioural task in which participants were able to liberate junk-food snacks from a virtual vending machine. Additionally, the relationship between stress and cue-driven reward seeking was examined using participant scores on the Depression Anxiety and Stress Scale (DASS). Reward-paired cues were found to separately bias action selection and influence the rate of responding for rewards. Furthermore, the effects of reward-paired cues on the rate of responding for reward was influenced by increased stress and anxiety. Increased levels of stress and anxiety were associated particularly with changes in cue-driven response vigour; whereas high levels of stress and anxiety were associated with elevated responding above baseline in the presence of a cue associated with a non-rewarding outcome, participants with low levels of anxiety and stress showed appropriate suppression of responding during this cue. These differences in performance between high and low anxiety and stress participants provides initial evidence that, as has been demonstrated in rodents, stress affects the influence of cue-driven response vigour in humans.     

Second-order conditioning of human causal learning

This article provides the first demonstration of a reliable second-order conditioning (SOC) effect in human causal learning tasks. It demonstrates the human ability to infer relationships between a cause and an effect that were never paired together during training. Experiments 1a and 1b showed a clear and reliable SOC effect, while Experiments 2a and 2b demonstrated that first-order extinction did not affect SOC. These results were similar to those found in animal and human conditioning and suggested that a similar associative mechanism could explain these effects. However, they can also be used to look into the underlying causal mental model people build and store while they are learning this task. From a cognitive view, overall results suggest that an independent rather than a chain causal mental model is stored after second-order learning in human causal tasks.     

Not all risk taking behavior is bad: Associative sensitivity predicts learning during risk taking among high sensation seekers

Risk taking behavior can be both adaptive and maladaptive depending on context. The majority of studies on risk taking, however, focus on clinical populations and dangerous or harmful risk taking. Individual differences in learning during risk taking are rarely examined in relation to task performance. The present study examined risk taking and associated outcomes in an exploration-based instrumental learning task (Balloon Emotional Learning Task; BELT), which presented a series of balloons in which participants pump up for points. Consistent with prior work, sensation seeking predicted increased risk taking behavior. Importantly, however, a significant interaction between sensation seeking and associative sensitivity, an attentional construct defined as the frequency and remoteness of automatic cognitive activity, was found. Specifically, among individuals high in sensation seeking, associative sensitivity predicted fewer balloon explosions and an increase in points earned on the balloon condition with the most potential for feedback driven learning. Thus, these findings suggest that sensation seekers are a heterogeneous group, and secondary traits such as associative sensitivity moderate risk taking and learning according to context.     

Context-outcome associations mediate context-switch effects in a human predictive learning task

Four experiments explored the role of contexts in information retrieval after different levels of acquisition training in human predictive learning. Participants were trained where cue (X) was followed by an outcome in context A while a different cue (Y) was followed by the absence of the outcome in context B. When 4 training trials with each cue were conducted, testing the stimuli in the alternative contexts decreased predictive judgments to X and increased predictive judgments to Y. These effects disappeared both when training was increased up to 18 trials (Experiments 1a and 1b), and when the outcome was presented in both contexts A and B (Experiments 2 and 4). When the outcome was presented in both contexts, the nonreinforced cue Y, trained in the presumably excitatory context B, became a conditioned inhibitor (Experiment 3). Additional experience with one of the contexts, but not with both, made the context-switch effect reappear (Experiment 4). These results suggest that irrelevant contexts may enter into direct associations with the outcome before prolonged training leads participants to discard them as predictors.     

Return of fear in a human differential conditioning paradigm caused by a return to the original acquistion context

In a differential human fear conditioning paradigm evidence for ABA-renewal was obtained manipulating the lighting in the experimental room. During acquisition in either a dark or illuminated room, one neutral slide was sometimes paired with a loud aversive noise whereas another slide was not. Subsequently, extinction took place in the opposite lighting context. When afterwards the participants were tested again in the original acquisition context, measurements revealed a recovery of the conditioned electrodermal response and an increase in the retrospective verbal US-expectancy ratings. No response recovery was obtained in an AAA-group that received acquisition, extinction and test trials in one and the same context. Several theoretical explanations for this type of return of fear as well as implications for clinical practice are discussed.     

Examining the sex- and circadian dependency of a learning phenotype in mice with glycine transporter 1 deletion in two Pavlovian conditioning paradigms

Behavioural characterisation of transgenic mice has been instrumental in search of therapeutic targets for the modulation of cognitive function. However, little effort has been devoted to phenotypic characterisation across environmental conditions and genomic differences such as sex and strain, which is essential to translational research. The present study is an effort in this direction. It scrutinised the stability and robustness of the phenotype of enhanced Pavlovian conditioning reported in mice with forebrain neuronal deletion of glycine transporter 1 by evaluating the possible presence of sex and circadian dependency, and its consistency across aversive and appetitive conditioning paradigms. The Pavlovian phenotype was essentially unaffected by the time of testing between the two circadian phases, but it was modified by sex in both conditioning paradigms. We observed that the effect size of the phenotype was strongest in female mice tested during the dark phase in the aversive paradigm. Critically, the presence of the phenotype in female mutants was accompanied by an increase in resistance to extinction. Similarly, enhanced conditioned responding once again emerged solely in female mutants in the appetitive conditioning experiment, which was again associated with an increased resistance to extinction across days, but male mutants exhibited an opposite trend towards facilitation of extinction. The present study has thus added hitherto unknown qualifications and specifications of a previously reported memory enhancing phenotype in this mouse line by identifying the determinants of the magnitude and direction of the expressed phenotype. This in-depth comparative approach is of value to the interpretation of behavioural findings in general.     

Exploring evaluative conditioning using a working memory task

Johnsrude, Owen, Zhao, and White (1999) demonstrated that evaluative conditioning (EC) can occur even while participants conduct a working memory task. This is consistent with claims that EC can occur outside awareness, and hence is an automatic process. In their study, three abstract patterns were paired differentially with a candy reinforcer: 90, 50, or 10%. On reinforced trials a red ball was presented in one of three locations on a computer screen. Participants were instructed to keep a tally for each location. We argue that if EC is automatic, then it will not consume cognitive/attentional resources, and hence co-occurrence of red ball and reinforcer should be irrelevant. Results from four experiments indicate that learning is only evident when the red ball and reinforcer co-occur or when the complexity of the working memory task is reduced. Together, the results suggest that EC is governed by specific attentional constraints on working memory. This interpretation questions the automatic nature of EC.     

Transfer of avoidance responding to a sensory preconditioned cue: Evidence for the role of S-S and R-S knowledge in avoidance learning

In avoidance learning studies, a warning signal (Sd) is directly paired with an aversive unconditioned stimulus (US) unless a particular response is performed. Research by Augustson and Dougher (1997) demonstrated that not only warning signals but also stimuli that are indirectly paired with the aversive event are capable of affecting the avoidance response. In the present study, we extended these results by incorporating a sensory preconditioning paradigm in an avoidance learning procedure. Sensory preconditioning training influenced the selection of avoidance responses in the presence of warning signals that were never paired directly with the aversive events. Moreover, results suggest that the selection of the avoidance responses was based on an integration of knowledge about the relation between the Sd and the US (S-S knowledge) and knowledge about the relation between the avoidance response and the US (R-S knowledge). As the expectancy-based theory of Lovibond (2006) is the only theory of avoidance that incorporates both knowledge structures, the results provide unique support for this theory.     

Contiguity and contingency in instrumental conditioning

There have been several attempts to construct molar theories of conditioning on the empirical basis that response-reinforcement contingency is important in determining conditioning. Such theories claim to explain behavior in terms of molar level processes which transcend the molecular level and, therefore, are not reducible to molecular processes or their interaction. These molar theories are critically examined and found to be seriously flawed because they fail to account for the effects of delaying reinforcement (degree of contiguity). Observed molar level relations, such as the matching law, do not require a molar theory, but may be more usefully considered as a product of molecular processes.     

Stronger renewal in human fear conditioning when tested with an acquisition retrieval cue than with an extinction retrieval cue

It was previously demonstrated in our laboratory that conditioned fear in humans can renew after extinction, when this procedure took place in a different context (ABA-renewal [Vansteenwegen et al. (2005). Return of fear in a human differential conditioning paradigm caused by a return to the original acquisition context. Behaviour Research and Therapy, 43(3), 323–336]). Using the same experimental design, we now tested the power of retrieval cues to interact with this contextual renewal phenomenon. Two groups went through acquisition and extinction (in a different context). They were then tested in the original acquisition context and in the presence of a retrieval cue. In the acquisition-cue group, this cue previously featured during the acquisition procedure; in the extinction-cue group, the cue previously featured during the extinction procedure. As expected, renewal of conditioned electro-dermal responding and retrospective expectancy ratings was strongest in the acquisition-cue group. Theoretical and clinical implications of this finding are discussed.     

Blocking of conditioning of tentacle lowering in the snail (Helix aspersa)

Experiment 1 established the effectiveness of an appetitive conditioning of odours procedure with snails (Helix aspersa) that was subsequently used for the study of blocking. In this important phenomenon, the conditioning of a CS1 (where CS is the conditioned stimulus) prior to conditioning of a compound, CS1CS2, blocked the conditioning to the CS2. Experiments 2a, 2b, and 2c demonstrated this associative effect using three different experimental controls. Experiments 3a and 3b replicated the blocking effect and allowed us to reject an explanation of blocking based on generalized effects of several treatments of diverse stimuli in blocking and control groups (the pseudoblocking effect). The implications of these results for the study of invertebrate cognition by means of conditioning techniques are discussed.     

Outcome-specific transfer between predictive and instrumental learning is unaffected by extinction but reversed by counterconditioning in human participants

Three experiments were conducted to explore the effects of different interference treatments upon outcome-specific transfer from predictive learning to instrumental responding. A computer game was designed in which participants had to defend Andalusia from navy and air-force attacks. Participants learned the relationship between two instrumental responses (two keys in a standard keyboard) and two different outcomes (destruction of the ships or destruction of the planes). Then, they learned to predict which of two different cues predicted either outcome. Finally, participants were allowed to give either of the two instrumental responses in the presence of each cue. Outcome-specific transfer was shown as a preference for the response that shared the outcome with the current cue. Extinction of the cue before the transfer test had no effect upon transfer, regardless of the level of extinction (Experiments 1-3). However, pairing the cue with the alternative outcome (counterconditioning) reversed the outcome-based transfer effect (Experiment 3). The implications of these results for the contents of extinction in human predictive learning are discussed.     

Is evaluative conditioning really resistant to extinction? Evidence for changes in evaluative judgements without changes in evaluative representations

Evaluative conditioning (EC) is defined as the change in the evaluation of a conditioned stimulus (CS) due to its pairing with a positive or negative unconditioned stimulus (US). Although several individual studies suggest that EC is unaffected by unreinforced presentations of the CS without the US, a recent meta-analysis indicates that EC effects are less pronounced for post-extinction measurements than post-acquisition measurements. The disparity in research findings suggests that extinction of EC may depend on yet unidentified conditions. In an attempt to uncover these conditions, three experiments (N = 784) investigated the influence of unreinforced post-acquisition CS presentations on EC effects resulting from simultaneous versus sequential pairings and pairings with single versus multiple USs. For all four types of CS–US pairings, EC effects on self-reported evaluations were reduced by unreinforced CS presentations, but only when the CSs had been rated after the initial presentation of CS–US pairings. EC effects on an evaluative priming measure remained unaffected by unreinforced CS presentations regardless of whether the CSs had been rated after acquisition. The results suggest that reduced EC effects resulting from unreinforced CS presentations are due to judgement-related processes during the verbal expression of CS evaluations rather than genuine changes in the underlying evaluative representations.     

A comparison of classical eyelid conditioning in adults and infants

In a classical conditioning procedure an eyeblink-eliciting tap to the glabella (the flat region of skin between the eyebrows) was presented 500 ms after the onset of a mild l-kHz tone. As tone-tap presentations proceeded, the probability of an eyeblink during the latter part of the tone increased in both infants (median age 8 months) and adults, but the infants were slower to condition than the adults and were more variable. Overall, the latency of the conditioned response to tone was significantly longer for infants than for adults, but the latency of the unconditioned response to tap was significantly shorter for infants than for adults.     

Reinstatement of fear responses in human aversive conditioning

The treatment of choice for a number of anxiety disorders is exposure therapy. However, successful reduction of fear through exposure is sometimes followed by a (partial) return of symptoms of fear (return of fear, ROF; Clin. Psychol. Rev. 9 (1989) 147). Several possible learning mechanisms have been suggested to explain ROF (e.g. mechanisms related to spontaneous recovery, renewal, reacquisition and reinstatement). The present study focuses on reinstatement, which refers to the observation that mere US-only presentations can 'reinstate' previously extinguished fear responses. Although animal research has repeatedly demonstrated this phenomenon, little is known about fear reinstatement in humans. The present study employed a differential aversive conditioning procedure: after acquisition and a subsequent extinction procedure, a series of four unpredicted US-only trials was scheduled in the reinstatement group. The control group did not receive additional US presentations. A significant reinstatement effect was observed for US-expectancy ratings and fear ratings in the reinstatement group, but not in the control group. No differences were observed in a reaction time measure of resource allocation to the conditioned stimuli. These findings constitute a first demonstration of reinstatement of conditioned fear responses in humans. Implications for exposure treatment and suggestions for future research are discussed.