Applying memories of reinforcement outcomes mainly to Pavlovian conditioning

A theory devised initially on the basis of instrumental reward schedule data, such as the PREE, was extended to deal with various Pavlovian findings. These Pavlovian findings include blocking, unblocking, relative validity, positive and negative patterning, renewal, reinstatement, reacquisition, and inhibition. In addition, the sequential model was discussed in relation to the rule-learning view of Hulse and Dorsky (1977) employing data from a report by Bloom and Capaldi (1961).     

A partial reinforcement extinction effect despite equal rates of reinforcement during Pavlovian conditioning

In 4 experiments rats received appetitive Pavlovian conditioning followed by extinction. Food accompanied every trial with the conditioned stimulus (CS) for the continuously reinforced groups and only half of the trials for the partially reinforced groups. In contrast to previous experiments that have compared the effects of partial and continuous reinforcement, the rate at which food was delivered during the CS was the same for both groups. The strength of the conditioned response during extinction weakened more rapidly in the continuously than in the partially reinforced groups. The results demonstrate that the partial reinforcement extinction effect is a consequence of the nonreinforced trials with the CS, rather than the rate at which the unconditioned stimulus is delivered during the CS.     

Heart rate reactivity in HAD and LAD rats during Pavlovian fear conditioning

Recently, we reported that High-Alcohol-Drinking (HAD) rats exhibited selective deficits in active avoidance learning under alcohol-naive conditions, and that administration of moderate doses of alcohol (0.5 and 1.0 g/kg) facilitated learning in these rats (Blankenship et al., 2000; Rorick et al., 2003b). We hypothesized that the deficits resulted from excessive fear in the aversive learning context and that the anxiolytic properties of alcohol may have contributed to the improved learning that was observed after alcohol administration. This hypothesis was supported by a recent study in which prolonged freezing in HAD rats was seen after a classical fear conditioning procedure (Rorick et al., 2003a). To provide additional evidence that HAD rats indeed exhibit behaviors consistent with the expression of increased fear in aversive learning contexts, we employed a Pavlovian fear conditioning task to measure heart rate in HAD and Low-Alcohol-Drinking (LAD) rats. In this study, HAD (HAD-1 and HAD-2) and LAD (LAD-1 and LAD-2) rats were assigned to one of three pre-exposure conditions: Context Only, Context/Tone, or Sequential (Context Only followed by Context/Tone) Pre-Exposure. Following pre-exposure, fear conditioning acquisition and extinction procedures were identical for all groups. Results indicated that although no baseline differences were observed between HAD and LAD rats, HAD rats receiving Context-Only pre-exposure exhibited excessive heart rate reactivity to the tone conditional stimulus during fear conditioning acquisition, compared to LAD rats receiving the same pre-exposure conditions. These findings support the hypothesis that HAD rats exhibit behaviors consistent with increased fear in aversive learning contexts, as measured by autonomic conditioning.     

Intracerebral scopolamine administration attenuates Pavlovian heart rate conditioning in the rabbit

Scopolamine hydrobromide was injected into the a) septum, b) dorsal hippocampus, or c) lateral ventricles of conscious rabbits via bilateral chronic indwelling cannulas. The cardiac orienting reflex (OR) and heart rate (HR) classical conditioning were assessed. A fourth group of animals received injections of the vehicle solution into these same brain areas and were otherwise similarly trained. Scopolamine had no effect on the cardiac OR produced by unreinforced tone stimuli. The OR consisted of pronounced bradycardia that habituated over successive trials in all groups. The HR change during classical conditioning also consisted of bradycardia. However, these conditional HR changes were attenuated by scopolamine injected into the septum and lateral ventricles, but were not affected by injections into the dorsal hippocampus. These results suggest that centrally applied scopolamine may affect a central nervous system associative process, and not a mechanism directly involved in primary bradycardia.     

Concomitant Pavlovian conditioning of heart rate and leg flexion responses in the rat

Pavlovian conditioning was studied in male Fischer 344 rats using tones as the conditioned stimulus (CS) and footshock as the unconditioned stimulus (UCS). Different groups of animals received (a) contiguous CS-UCS pairings with a 0.5 sec CS, (b) contiguous CS-UCS pairings with a 4.0 sec CS, or (c) a random sequence of noncontiguous tones and shocks using either a 0.5 sec or a 4.0 sec CS. Heart rate (HR) and leg flexion (LF) responses were recorded. Leg flexion conditioning occurred only in the 0.5 sec contiguous group. Decelerative HR CRs occurred only in the 4.0 sec contiguous group. Accelerative HR changes occurred in the other two groups but were significantly greater in the 0.5 sec contiguous group. These results are similar to but not identical to those obtained during eyeblink or nictitating membrane conditioning in rabbits, and suggest that the topography of the Pavlovian HR CR is dependent on the simultaneous occurrence of other classically conditioned responses.     

Pavlovian conditioning and rule learning

The experiment reviewed here was an attempt to show that two differential Pavlovian conditioning designs, namely positive and negative patterning, can best be understood as rule learning. First, it is shown that positive patterning is equivalent to the logical rule of conjunction (AND) and that negative patterning is equivalent to the logical rule of exclusive disjunction (XOR). It is assumed that in order to learn both kinds of discrimination subjects learn to use the according rule. If this is the case, the observed differentiation should be independent of the number of reinforcements for each individual stimulus. Second, subjects should be able to transfer the rule to new stimuli. Forty human subjects were randomly divided into four groups (N=10 each). Two factors were manipulated independently between subjects: (1) positive vs negative patterning, and (2) 2 vs 4 pairs of trained stimuli. Second interval skin conductance responses were measured. During initial acquisition positive as well as negative patterning occurred independently of number of pairs of trained stimuli (with total amount of training kept constant). Furthermore, AND as well as XOR could be transfered to new stimuli.     

Unblocking in Pavlovian fear conditioning

Six experiments used rats to study blocking and unblocking of fear learning. An excitatory stimulus (A) blocked fear learning to a neutral stimulus (B). Unblocking of B occurred if the AB compound signaled an increase in unconditioned stimulus (US) intensity or number. Assessments of associative change during blocking showed that more was learned about B than A. Such assessments during unblocking revealed that more was learned about B than A following an increase in US intensity but not US number. These US manipulations had no differential effects on single-cue learning. The results show that variations in US intensity or number produce unblocking of fear learning, but for each there is a different profile of associative change and a potentially different mechanism.     

Naloxone and Pavlovian fear conditioning

Previous research has shown that pretreating rats with the opiate antagonist naloxone increases the freezing that follows painful electric shock. Three experiments, using freezing behavior as a dependent variable, were carried out to determine whether the drug might cause this effect by enhancing fear conditioning. Two of the studies employed a differential context fear-conditioning paradigm. Naloxone did not affect freezing behavior during the preshock adaptation period. In Experiment 1, naloxone was found to increase resistance to extinction in the S+ context. In Experiment 2, naloxone was found to increase freezing in the S+ context. This effect was dependent upon administering naloxone during training but not dependent on administering it during testing. The third study employed a generalization paradigm. It was found that naloxone's effect on postshock freezing was dependent on the place of testing; as the contextual cues of the test chamber were changed from those of the conditioning chamber, the effect of naloxone on freezing was reduced. The results of these experiments lend strong support to the hypothesis that naloxone increases freezing by enhancing the conditioning of fear to contextual stimuli associated with shock.     

Backward conditioning in Pavlovian type studies

Authors of almost all learning texts have indicated that unconditional/ stimulus-conditional stimulus (UCS-CS) trials (backward conditioning) utilized in classical conditioning experiments will not result in establishing a conditional response (CR) (excitation). Recently, it has been proposed that backward conditioning can take place although whether UCS-CS trials result in excitation or inhibition has been left unspecified. It is proposed that the diversity of findings can be attributed to inadequate methodology and the use of a classical-instrumental transfer paradigm. When only traditional Pavlovian conditioning studies are examined, the experimental findings suggest that UCS-CS trials will result in inhibition.     

Pavlovian compound conditioning in the rabbit

Two experiments are reported on eyelid conditioning in the rabbit involving compounds of isolable CSs. In Experiment 1 it was demonstrated that subjects could be trained to respond discriminatively on the basis of specific configurations when no other reliable component cues were available. In Experiment II, a novel test procedure failed to provide further evidence that subjects utilized specific configurational cues when reliable isolable components were available. The findings were discussed in terms of the assumption that any stimulus compound involves both isolable and configurational components with the former being more “salient” than the latter.     

Pavlovian conditioning with proximal stimuli

This experiment was conducted with the objective of demonstrating that the effective stimuli in Pavlovian Conditioning are not environmental stimuli but internal physiological processes elicited by environmental input (proximal stimuli). In order to achieve the objective, afterimages in color vision were used: looking at a diffuse lightened circle after seeing a red circle yields an image of a green circle. A differential conditioning paradigm with two sequential compounds was run. In one group (G⁺B^?: n₁=10), a red circle followed by a green circle was paired with shock, whereas a red circle followed by a blue circle remained unpaired. A second group (G^?B⁺: n₂=10) received red-blue paired trials and unpaired red-green trials. Immediately after that training, subjects were tested with a new, never trained sequential compound: a red circle followed by a diffuse lightened circle. Furthermore, they were tested with the already trained compounds. Taking the environmental point of view, the never trained stimulus should elicit an orienting response lying inbetween the excitatory reaction to the paired stimulus and the inhibitory reaction to the unpaired stimulus. From the proximal point of view, the diffuse light should elicit an excitatory reaction in group G⁺B^? and an inhibitory reaction in group G^?B⁺. Electrodermal conditioned anticipatory and omission responses were measured. The results supported the proximal hypothesis. Hence, defining input in environmental terms may be the wrong way. Instead, in conceptualizing the stimulus in conditioning, the following should be considered: the processing organism itself is creating the effective stimuli.     

Contemporary study of Pavlovian conditioning

Pavlov's first report on conditioning emphasized its role in allowing the animal to adjust to its environment. Contemporary theories have seen this adjustment in terms of developing accurate knowledge of the environment. Three aspects of that thinking are explored: how the animal acquires initial knowledge, how it changes its knowledge when conditions of the world change, and how it makes use of multiple knowledge representations.     

Pavlovian conditioning with ethanol and lithium: effects on heart rate and taste aversion in rats

Rats received paired injections of either ethanol or saline as the conditioned stimulus and lithium chloride as the unconditioned stimulus (US) in a Pavlovian differential conditioning paradigm. Lithium chloride evoked a large deceleration in heart rate (80-100 beats per minute) as an unconditioned response. As a result of 10 conditioning trials, the substance paired with LiCl elicited a lower average heart rate than that elicited by the unpaired substance. Moreover, animals that received ethanol-LiCl injections subsequently were more averse to the taste of ethanol than animals receiving saline-LiCl pairings. However, there were no differences in ethanol's ability to serve as the US to induce an aversion to a novel flavor solution (i.e., the Avfail phenomenon was not observed). The overall pattern of results underscores the value of using multiple indexes of learning in drug-drug conditioning paradigms.     

Forward and backward second-order Pavlovian conditioning in honeybees

Second-order conditioning (SOC) is the association of a neutral stimulus with another stimulus that had previously been combined with an unconditioned stimulus (US). We used classical conditioning of the proboscis extension response (PER) in honeybees (Apis mellifera) with odors (CS) and sugar (US). Previous SOC experiments in bees were inconclusive, and, therefore, we attempted to demonstrate SOC in the following three experiments: (Experiment 1) After differential conditioning (pairing odor A with US and presenting odor B without US), the bees experienced two pairs of partially overlapping odors, either a new odor C followed by a previously reinforced odor A (C-A) or a new odor C followed by a previously nonreinforced odor B (C-B). (Experiment 2) After differential conditioning, bees were presented with C-A or A-C. (Experiment 3) Bees were first presented with C-A or A-C before differential conditioning and were tested with odor C. We observed: (Experiment 1) 40% of the bees showed PER to the C-A presentation, but only 20% showed PER to the C-B presentation. (Experiment 2) 40% of the bees showed PER to the C-A presentation, while only 20% showed PER to the reversed sequence A-C. Experiments 1 and 2 showed that a previously reinforced odor can be a secondary reinforcer for excitatory SOC only with forward-pairing. (Experiment 3) PER toward C was lower (15%) in bees presented with A-C than with C-A (25%). This showed that backward SOC is not as effective as forward SOC. These results help to delineate different conditions that are critical for the phenomenon of SOC.     

Contextual Pavlovian conditioning in the crab Chasmagnathus

In contextual conditioning, a complex pattern of information is processed to associate the characteristics of a particular place with incentive or aversive reinforcements. This type of learning has been widely studied in mammals, but studies of other taxa are scarce. The context-signal memory (CSM) paradigm of the crab Chasmagnathus has been extensively used as a model of learning and memory. Although initially interpreted as habituation, some characteristics of contextual conditioning have been described. However, no anticipatory response has been detected for animals exposed to the training context. Thus, CSM could be interpreted either as an associative habituation or as contextual conditioning that occurs without a context-evoked anticipatory response. Here, we describe a training protocol developed for contextual Pavlovian conditioning (CPC). For each training trial, the context (conditioned stimulus, CS) was discretely presented and finished together with the unconditioned stimulus (US). In agreement with the CSM paradigm, a robust freezing response was acquired during the 15 training trials, and clear retention was found when tested with the US presentation after short (2 and 4 h) and long (1–4 days) delays. This CPC memory showed forward but not simultaneous presentation conditioning and was context specific and protein synthesis dependent. Additionally, a weak CPC memory was enhanced during consolidation. One day after training, CPC was extinguished by repeated CS presentation, while one presentation induced a memory labilisation–reconsolidation process. Finally, we found an anticipatory conditioned response (CR) during the CS presentation for both short-term (4 h) and long-term memory (24 h). These findings support the conditioning nature of the new paradigm.     

Pavlovian heart rate and jaw movement conditioning in the rabbit: effects of medial prefrontal lesions

An experiment was conducted in which jaw movements (JM) and heart rate (HR) were concomitantly assessed in rabbits during simple Pavlovian conditioning. A 2-s 1200-Hz tone was the conditioned stimulus (CS) and an intraoral 1-cc pulse of 0.5 M sucrose-water solution was the unconditioned stimulus (US). Sham and medial prefrontal (mPFC)-lesioned animals received paired CS/US training with a 70- to 75-dB CS and were compared with sham- and mPFC-lesioned animals that received explicitly unpaired CS/US presentations. The percentages of JM CRs were significantly greater in the paired than the unpaired groups, but mPFC lesions had no effect on this measure. Conditioned HR decelerations occurred only in the paired groups and then only during the first session of training. Moreover, these CS-evoked cardiac decelerations were somewhat attenuated by the mPFC lesion. CS-evoked HR accelerations, which were significantly greater in unpaired than in paired animals, occurred during the four subsequent sessions. These results suggest that a CS-evoked cardioinhibitory process, mediated by the mPFC, is engendered by Pavlovian appetitive conditioning, as has been previously demonstrated for aversive conditioning. However, during JM conditioning these inhibitory changes are quickly replaced by tachycardia, possibly related to increased nonspecific somatomotor activity, since the tachycardia was somewhat greater in the unpaired animals.