Pavlovian conditioning and rule learning

The experiment reviewed here was an attempt to show that two differential Pavlovian conditioning designs, namely positive and negative patterning, can best be understood as rule learning. First, it is shown that positive patterning is equivalent to the logical rule of conjunction (AND) and that negative patterning is equivalent to the logical rule of exclusive disjunction (XOR). It is assumed that in order to learn both kinds of discrimination subjects learn to use the according rule. If this is the case, the observed differentiation should be independent of the number of reinforcements for each individual stimulus. Second, subjects should be able to transfer the rule to new stimuli. Forty human subjects were randomly divided into four groups (N=10 each). Two factors were manipulated independently between subjects: (1) positive vs negative patterning, and (2) 2 vs 4 pairs of trained stimuli. Second interval skin conductance responses were measured. During initial acquisition positive as well as negative patterning occurred independently of number of pairs of trained stimuli (with total amount of training kept constant). Furthermore, AND as well as XOR could be transfered to new stimuli.     

Trial and intertrial durations in Pavlovian conditioning: issues of learning and performance

Four experiments assessed the effects of trial (T) and intertrial (I) durations on magazine approach behavior in rats. In Experiments 1 and 2, different groups of animals were conditioned with various combinations of I and T durations. The rate of acquisition, in terms of the number of trials required to reach various acquisition criteria, generally was faster in groups trained with large I:T ratios. There also were differences in rate of acquisition and terminal response rates between groups trained with identical I:T ratios but with different absolute I and T durations. Differences evident at the end of conditioning persisted during a common test with various combinations of I and T durations. Experiments 3 and 4 provided a more specific test of the predictions of 2 general classes of theories and found results that were consistent with those theories that characterize group differences as indicative of differences in learning, rather than in performance.     

The role of nucleus accumbens dopamine in outcome encoding in instrumental and Pavlovian conditioning

Considerable evidence suggests that dopamine in the core subregion of the nucleus accumbens is not only involved in Pavlovian conditioning but also supports instrumental performance. However, it is largely unknown whether NAc dopamine is required for outcome encoding which plays an important role both in Pavlovian stimulus-outcome learning and instrumental action-outcome learning. Therefore, we tested rats with 6-hydroxydopamine (6-OHDA) induced dopamine depletion of the NAc core for their sensitivity to outcome devaluation in a Pavlovian and an instrumental task. Results indicate that 6-OHDA-lesioned animals were sensitive to outcome devaluation in an instrumental task. This finding provides support to the notion that NAc core dopamine may not be crucial in encoding action-outcome associations. However, during instrumental conditioning lever pressing rates in 6-OHDA-lesioned animals were markedly lower which could reflect an impaired behavioral activation. By contrast, after outcome-specific devaluation in a Pavlovian task, performance in 6-OHDA-lesioned animals was impaired, i.e. their magazine-directed responding was non-selectively reduced. One possibility to explain non-selective responding is that NAc core DA depletion impaired the ability of conditioned stimuli to activate the memory of the current value of the reinforcer.     

Pavlovian to instrumental transfer of control in a human learning task

Pavlovian learning tasks have been widely used as tools to understand basic cognitive and emotional processes in humans. The present studies investigated one particular task, Pavlovian-to-instrumental transfer (PIT), with human participants in an effort to examine potential cognitive and emotional effects of Pavlovian cues upon instrumentally trained performance. In two experiments, subjects first learned two separate instrumental response-outcome relationships (i.e., R1-O1 and R2-O2) and then were exposed to various stimulus-outcome relationships (i.e., S1-O1, S2-O2, S3-O3, and S4-) before the effects of the Pavlovian stimuli on instrumental responding were assessed during a non-reinforced test. In Experiment 1, instrumental responding was established using a positive-reinforcement procedure, whereas in Experiment 2, a quasi-avoidance learning task was used. In both cases, the Pavlovian stimuli exerted selective control over instrumental responding, whereby S1 and S2 selectively elevated the instrumental response with which it shared an outcome. In addition, in Experiment 2, S3 exerted a nonselective transfer of control effect, whereby both responses were elevated over baseline levels. These data identify two ways, one specific and one general, in which Pavlovian processes can exert control over instrumental responding in human learning paradigms, suggesting that this method may serve as a useful tool in the study of basic cognitive and emotional processes in human learning.     

Constraints on Pavlovian aversive conditioning: Implications for avoidance learning in the rat

Four experiments investigated the relative degree of control exerted by several conditional stimuli when each stimulus: (a) preceded shock, (b) followed shock, and preceded a shock-free interval, (c) was independent of shock, or (d) was novel. When the onset of an auditory stimulus had preceded shock (Experiments 1, 2A, and 3), it always exerted conditioned excitatory control. When the same stimulus preceded a shock-free interval, it never exerted conditioned inhibitory control. When the onset of light (Experiments 2B, 4), silence (2C), or darkness (1, 2D) preceded a shock-free interval, it always exerted conditioned inhibitory control. However, when one of the latter stimuli preceded shock, it failed to exert excitatory control. Several models of this phenomenon were tested. The implications of these results for the species-specific defence reaction and two-factor theory accounts of avoidance learning were outlined.     

Pavlovian conditioning: the CS-UR relation

A new Pavlovian procedure used fluid-elicited throat-movement responses of the pigeon (N=66) to study the effects on conditioning of the temporal relation of the conditioned stimulus (CS) to the unconditioned stimulus-unconditioned response (US-UR). Because the throat-movement response has a substantial latency and duration, the relation of the CS to the US and UR could be independently evaluated. Four experiments indicated that, operationally, the relation of the CS to the UR--not to the US--is critical for conditioning in this preparation. The conventional emphasis on CS-US relations is based on procedures that confound the occurrence of the US with the UR and that foster generalization decrement between training and testing. The authors indicate how several conditioning phenomena may be reinterpreted in terms of CS-UR relations.     

Limbic networks and associative learning: I. Entorhinal contributions to instrumental conditioning

The hippocampal formation is a highly delineated brain structure that is believed to play a prominent role in learning and memory. The present experiment evaluated the contributions of medial and lateral perforant path input to bar press-conditioning under (a) continuous and (b) differential reinforcement of low rates of responding (DRL) schedules, and (c) shuttlebox avoidance conditioning. Bilateral deafferentation of either pathway had no effect on the acquisition of bar press responses or on performance under the DRL schedule. Deafferentation of the medial pathway facilitated acquisition of avoidance responses in a manner much like the effects seen in hippocampectomized animals. It is suggested that the medial perforant path participates in the expression of correlated patterns of neuronal discharge known to develop within the hippocampus and that this “model” serves to modulate the temporal characteristics of simple conditioned reflexes. Loss of the modulatory influence of the model may affect acquisition and extinction rates. Contributions of other hippocampal circuits are discussed in relation to established deficits. Preliminary results of this experiment were presented at the second annual convention of the American Psychological Society, Dallas, Texas, June 1990.     

Limbic networks and associative learning: I. Entorhinal contributions to instrumental conditioning

The hippocampal formation is a highly delineated brain structure that is believed to play a prominent role in learning and memory. The present experiment evaluated the contributions of medial and lateral perforant path input to bar press-conditioning under (a) continuous and (b) differential reinforcement of low rates of responding (DRL) schedules, and (c) shuttlebox avoidance conditioning. Bilateral deafferentation of either pathway had no effect on the acquisition of bar press responses or on performance under the DRL schedule. Deafferentation of the medial pathway facilitated acquisition of avoidance responses in a manner much like the effects seen in hippocampectomized animals. It is suggested that the medial perforant path participates in the expression of correlated patterns of neuronal discharge known to develop within the hippocampus and that this “model” serves to modulate the temporal characteristics of simple conditioned reflexes. Loss of the modulatory influence of the model may affect acquisition and extinction rates. Contributions of other hippocampal circuits are discussed in relation to established deficits. Preliminary results of this experiment were presented at the second annual convention of the American Psychological Society, Dallas, Texas, June 1990.     

Relative validity effects with either one or two more valid cues in Pavlovian and instrumental conditioning

Two experiments investigated the relative validity effect with either 1 or 2 continuously reinforced cues in Wistar rats using appetitive Pavlovian and instrumental preparations. Discrimination training involved 3 compound cues containing a common element (1AX: 1BX: 2CX). In the first true-discrimination group (TD-1), CX was followed by food, but AX and BX were not. In the second true-discrimination group (TD-2), AX and BX but not CX were followed by food. In the third, pseudodiscrimination group (PD), food followed 50% of each compound. Compared with the PD group, there were lower levels of responding to X in Groups TD-1 and TD-2, which did not differ. That is, both TD treatments showed equivalent relative validity effects. There was evidence for a relative validity effect on the context. The Rescorla-Wagner model incorrectly predicts a smaller relative validity effect after the TD-2 than the TD-1 treatment. Comparator theory predicts these results.     

Naloxone and Pavlovian fear conditioning

Previous research has shown that pretreating rats with the opiate antagonist naloxone increases the freezing that follows painful electric shock. Three experiments, using freezing behavior as a dependent variable, were carried out to determine whether the drug might cause this effect by enhancing fear conditioning. Two of the studies employed a differential context fear-conditioning paradigm. Naloxone did not affect freezing behavior during the preshock adaptation period. In Experiment 1, naloxone was found to increase resistance to extinction in the S+ context. In Experiment 2, naloxone was found to increase freezing in the S+ context. This effect was dependent upon administering naloxone during training but not dependent on administering it during testing. The third study employed a generalization paradigm. It was found that naloxone's effect on postshock freezing was dependent on the place of testing; as the contextual cues of the test chamber were changed from those of the conditioning chamber, the effect of naloxone on freezing was reduced. The results of these experiments lend strong support to the hypothesis that naloxone increases freezing by enhancing the conditioning of fear to contextual stimuli associated with shock.     

Differential dependence of Pavlovian incentive motivation and instrumental incentive learning processes on dopamine signaling

Here we attempted to clarify the role of dopamine signaling in reward seeking. In Experiment 1, we assessed the effects of the dopamine D(1)/D(2) receptor antagonist flupenthixol (0.5 mg/kg i.p.) on Pavlovian incentive motivation and found that flupenthixol blocked the ability of a conditioned stimulus to enhance both goal approach and instrumental performance (Pavlovian-to-instrumental transfer). In Experiment 2 we assessed the effects of flupenthixol on reward palatability during post-training noncontingent re-exposure to the sucrose reward in either a control 3-h or novel 23-h food-deprived state. Flupenthixol, although effective in blocking the Pavlovian goal approach, was without effect on palatability or the increase in reward palatability induced by the upshift in motivational state. This noncontingent re-exposure provided an opportunity for instrumental incentive learning, the process by which rats encode the value of a reward for use in updating reward-seeking actions. Flupenthixol administered prior to the instrumental incentive learning opportunity did not affect the increase in subsequent off-drug reward-seeking actions induced by that experience. These data suggest that although dopamine signaling is necessary for Pavlovian incentive motivation, it is not necessary for changes in reward experience, or for the instrumental incentive learning process that translates this experience into the incentive value used to drive reward-seeking actions, and provide further evidence that Pavlovian and instrumental incentive learning processes are dissociable.     

Simultaneous and sequential Feature Negative discriminations: Elemental learning and occasion setting in human Pavlovian conditioning

Using a conditioned suppression task, we investigated simultaneous (XA−/A+) vs. sequential (X → A−/A+) Feature Negative (FN) discrimination learning in humans. We expected the simultaneous discrimination to result in X (or alternatively the XA configuration) becoming an inhibitor acting directly on the US, and the sequential discrimination in X becoming a negative occasion setter acting indirectly on the A-US link. After simultaneous FN training, X+ training completely abolished discriminative XA/A responding (Experiment 1), and X transferred inhibition to new targets B regardless of their training history (B+ or YB−/B+) (Experiment 2), suggesting X became a simple inhibitor. After sequential FN training, X showed the predicted selective transfer to a target B that also had been modulated (Y → B−/B+), not to a simple excitor (B+) (Experiment 4), but turning X into an excitor (X+) likewise disrupted discriminative X → A/A responding (Experiment 3). This suggests that X acquired a combination of modulatory and direct inhibitory properties, and that the joint contribution of both components is necessary for the suppression of the target-induced US activation.     

Evaluation of the relation between Pavlovian occasion-setting and instrumental discriminative stimuli: a blocking analysis

Experiments with rat subjects used a blocking design (A+, then AB+) to assess the relation between Pavlovian occasion-setting and instrumental discriminative stimuli. Prior conditioning of both associative and occasion-setting functions of A in a serial feature-positive procedure blocked acquisition of an instrumental discriminative function by a novel stimulus (B) trained in compound with A. However, neither prior conditioning of only an A-US (unconditioned stimulus) association nor prior conditioning of Stimulus A using a Pavlovian simultaneous feature-positive procedure, which does not endow A with an occasion-setting function, blocked acquisition of an instrumental discriminative function by B. Prior acquisition of an instrumental discriminative function by A blocked acquisition of a Pavlovian occasion-setting function by a novel stimulus (B) trained in compound with A, but did not block acquisition of an association between B and the US. These outcomes indicate that Pavlovian occasion-setting and instrumental discriminative properties of a stimulus are functionally equivalent and that both Pavlovian occasion-setting and instrumental discriminative properties of a stimulus are functionally independent of simple associative relations between that stimulus and other events.     

Sequential and simultaneous feature positive discriminations: occasion setting and configural learning in human Pavlovian conditioning

Using a conditioned suppression preparation, the authors investigated sequential (X --> A+/A-) versus simultaneous (XA+/A-) feature positive (FP) discrimination learning in humans. The sequential discrimination was expected to be resolved by means of a Feature X Modulated Target A-US association and the simultaneous discrimination by a feature X-US association. After sequential FP training, extinction of Feature X did not affect discriminative X --> A/A responding (Experiment 1), and X transferred its modulatory ability only to new targets, B, that had also been modulated (Experiment 2). This suggests that the sequential FP discrimination indeed resulted in occasion setting. Unlike expected, Feature X Extinction did not affect discriminative XA/A responding after simultaneous FP training (Experiment 3), while at the same time Feature X did show the predicted nonselective transfer to new targets, B (Experiment 4). J. M. Pearce's (1987) configural learning theory can account for most but not all findings of Experiments 3 and 4.     

Aversive CS control of instrumental avoidance as a function of selected parameters and method of Pavlovian conditioning

Effects of aversive CSs upon dogs' instrumental avoidance responding were assessed as a function of the Pavlovian conditioning parameters using off-baseline (Experiment 1) and on-baseline (Experiment 2) conditioning procedures. In each experiment, three UCS intensitites (2, 6, and 10 mA) were crossed factorially with two CS-UCS intervals (10 and 90 sec) yielding six groups. After 4 days of conditioning, the CS-produced effects on avoidance were determined primarily by an interaction between Pavlovian procedure (off- versus on-baseline) and UCS intensity. With off-baseline conditioning, CS-produced facilitation of avoidance was an increasing function of the UCS intensity. However, with on-baseline conditioning, only the CS paired with weak UCS facilitated avoidance, and the CS paired with the strong UCS suppressed responding. This reversing parametric function poses problems for two-process motivational theories of avoidance.     

A general theory of learning and conditioning: Part I

In the first of two parts in which a general mathematical theory of non-symbolic learning and conditioning is constructed, the sections of the theory dealing with non-symbolic learning and conditioning are presented, and a number of its qualitative implications are compared with available experimental results. In general, the agreement is found to be rather close.     

A general theory of learning and conditioning: Part II

The second of two parts of this article extends a mathematical theory of non-symbolic learning and conditioning to cases where reward and punishment are involved. The preceding results are generalized to the case where stimuli and responses are related psychophysically, thus constituting a theory of transfer, generalization, and discrimination.