Mechanisms underlying retarded emergence of conditioned responding following inhibitory training: evidence for the comparator hypothesis

The comparator hypothesis posits that conditioned responding is determined by a comparison at the time of testing between the associative strengths of the conditioned stimulus (CS) and stimuli proximal to the CS at the time of conditioning. The hypothesis treats all associations as being excitatory and treats conditioned inhibition as the behavioral consequence of a CS that is less excitatory than its comparator stimuli. Conditioned lick suppression by rats was used to differentiate four possible sources of retarded responding to an inhibitory CS. These include habituation to the unconditioned stimulus (US), latent inhibition to the CS, blocking of the CS-US association by the conditioning context, and enhanced excitatory associations to the comparator stimuli. Prior research has demonstrated the first three phenomena. Therefore, we employed parameters expected to highlight the fourth one--the comparator process. In Experiment 1, our negative contingency training was shown to produce a conditioned inhibitor that passed inhibitory summation and retardation tests. In Experiment 2 we found transfer of retardation from an inhibitory CS to a novel stimulus when the location where retardation-test training occurred was excitatory, which is indicative of contextual blocking and/or comparator effects. In Experiment 3, extinction of the conditioning context was found to attenuate retardation regardless of whether extinction occurred before or after the CS-US pairings of the retardation test. This indicates that much of the present retardation was due to the comparator process rather than to contextual blocking. Experiment 4 demonstrated that habituation to the US did not contribute to retardation in the present case. Collectively, these studies suggest that retardation following inhibitory training can be explained without recourse to any of the traditional mechanisms of conditioned inhibition.     

The comparator hypothesis of conditioned response generation: manifest conditioned excitation and inhibition as a function of relative excitatory strengths of CS and conditioning context at the time of testing

In the present research water-deprived rats were used in a conditioned lick suppression paradigm to test and further develop Rescorla's (1968) contingency theory, which posits that excitatory associations are formed when a conditioned stimulus (CS) signals an increase in unconditioned stimulus (US) likelihood and that inhibitory associations develop when the CS signals a decrease in US likelihood. In Experiment 1 we found that responding to a CS varied inversely with the associative status of the context in which the CS was trained and that this response was unaltered when testing occurred in a distinctively dissimilar context with a different conditioning history, provided associative summation with the test context was minimized. These results suggest that manifest excitatory and inhibitory conditioned responding is modulated by the associative value of the training context rather than that of the test context. In Experiment 2 it was demonstrated that postconditioning decreases in the associative value of the CS training context reduced the effective inhibitory value of the CS even when testing occurred outside of the training context. Moreover, this contextual deflation effect was specific to the CS training context as opposed to any other excitatory context. Collectively, these studies support the comparator hypothesis, which states that conditioned responding is determined by a comparison of the associative strengths of the CS and its training context that occurs at the time of testing rather than at the time of conditioning. This implies that all associations are excitatory and that responding indicative of conditioned inhibition reflects a CS-US association that is below (or near) the associative strength of its comparator stimulus. It is suggested that response rules which go beyond a monotonic relation between associative value and response strength can partially relieve learning theories of their explanatory burdens, thereby allowing for simpler models of acquisition.     

Response rates track the history of reinforcement times

When conditioning involves a consistent temporal relationship between the conditioned stimulus (CS) and unconditioned stimulus (US), the expression of conditioned responses within a trial peaks at the usual time of the US relative to the CS. Here we examine the temporal profile of responses during conditioning with variable CS-US intervals. We conditioned stimuli with either uniformly distributed or exponentially distributed random CS-US intervals. In the former case, the frequency of each CS-US interval within a specified range is uniform but the momentary probability of the US (the hazard function) increases as time elapses during the trial; with the latter distribution, short CS-US intervals are more frequent than longer intervals, but the momentary probability of the US is constant across time within the trial. We report that, in a magazine approach paradigm, rats' response rates remained stable as time elapses during the CS when the CS-US intervals were uniformly distributed, whereas their response rates declined when the CS-US intervals were exponentially distributed. In other words, the profile of responding during the CS matched the frequency distribution of the US times, not the momentary probability of the US during the CS. These results are inconsistent with real-time associative models, which predict that associative strength tracks the momentary probability of the US, but may provide support for timing models of conditioning in which conditioned responding is tied to remembered times of reinforcement.     

Pavlovian second-order conditioned analgesia

Three experiments with rat subjects assessed conditioned analgesia in a Pavlovian second-order conditioning procedure by using inhibition of responding to thermal stimulation as an index of pain sensitivity. In Experiment 1, rats receiving second-order conditioning showed longer response latencies during a test of pain sensitivity in the presence of the second-order conditioned stimulus (CS) than rats receiving appropriate control procedures. Experiment 2 found that extinction of the first-order CS had no effect on established second-order conditioned analgesia. Experiment 3 evaluated the effects of post second-order conditioning pairings of morphine and the shock unconditioned stimulus (US). Rats receiving paired morphine-shock presentations showed significantly shorter response latencies during a hot-plate test of pain sensitivity in the presence of the second-order CS than did groups of rats receiving various control procedures; second-order analgesia was attenuated. These data extend the associative account of conditioned analgesia to second-order conditioning situations and are discussed in terms of the mediation of both first- and second-order analgesia by an association between the CS and a representation or expectancy of the US, which may directly activate endogenous pain inhibition systems.     

An animal model of fetishism

An animal model of sexual fetishism was developed with male Japanese quail based on persistence of conditioned sexual responding during extinction to an inanimate object made of terrycloth (Experiments 1 and 3). This persistent responding occurred only in subjects that came to copulate with the terrycloth object, suggesting that the copulatory behavior served to maintain the fetishistic behavior. Sexual conditioning was carried out by pairing a conditioned stimulus (CS) with the opportunity to copulate with a female (the unconditioned stimulus or US). Copulation with the CS object and persistent responding did not develop if the CS was a light (Experiment 1) or if conditioning was carried out with a food US (Experiment 2). In addition, subjects that showed persistence in responding to the terrycloth CS did not persist in their responding to a light CS (Experiment 3). The results are consistent with the hypothesis that conditioned copulatory behavior creates a form of self-maintenance that leads to persistent responding to an inanimate object. The development of an animal model of such fetishistic behavior should facilitate experimental analysis of the phenomenon.     

The Rescorla-Wagner model: losses in associative strength in compound conditioned stimuli

This series of experiments demonstrated that compound conditioned stimuli (CSs) highly conditioned in isolation lose conditioned response strength when compound-CS-unconditioned stimulus (US) pairings are given. This loss in conditioned responding was a positive function of the number of compound-CS-US pairings and was greater for the more salient stimulus. Finally, if a previously neutral stimulus was compounded with two previously conditioned cues, the neutral stimulus could acquire conditioned inhibitory properties with only compound-CS-US pairings. These results provide support for some aspects of the Rescorla-Wagner model.     

Appetitive differential conditioning of the rabbit’s jaw movement response

Two experiments examined appetitive differential conditioning of the rabbit’s jaw movement response (JMR) in a two-phase procedure. The first phase entailed reinforced training with one conditioned stimulus (CS+), and the second phase involved intermixed presentations of CS+ and an unreinforced stimulus (CS?). In Experiment 1, CS+ was a 600-Hz tone, and CS-was either a 660-,1,000-, or 2,100-Hz tone. In Experiment 2, the magnitude of the water unconditioned stimulus (US) paired with CS+ was either 1, 3, or 9 ml. The experiments revealed that 1) the level of responding to CS-rose for several days and then declined over the remainder of training; 2) the physical similarity between CS+ and CS?directly affected the level of responding to CS?but had no discernable effect on the level of responding to CS+ ; and 3) US magnitude positively affected the level of responding to CS + and, to a lesser extent, CS?. The results are discussed in terms of their implications for Spence’s gradient interaction theory and Pavlov’s external inhibition hypothesis.     

Timing at the Start of Associative Learning

Some theories of associative learning imply that time plays a fundamental role in the acquisition process. Consistent with these theories, this paper presents evidence that the time from the onset of a conditioned stimulus (CS) until presentation of the unconditioned stimulus (US) is learned very rapidly at the start of training. We report two autoshaping studies and a study on aversive conditioning in goldfish in which we examine timing at the start of conditioning. We also review data from a number of other conditioning preparations, including fear-potentiated startle, appetitive conditioning in rats, and eyeblink conditioning in rabbits, that report conditioned response (CR) timing early in training. Acquisition speed and the very first expressions of conditioned responding often show sensitivity to the time of US presentation. In instances where temporal control is slowly expressed, it is likely due to performance factors, not to slow learning about time. In fact, the learning about time may be a necessary condition for associative learning.     

Differential effects of two ways of devaluing the unconditioned stimulus after Pavlovian appetitive conditioning

Three experiments with rat subjects investigated the effects of two methods of devaluing a food unconditioned stimulus (US) after pairings of an auditory conditioned stimulus (CS) with that US. Experiment 1 found no effect of postconditioning pairings of the food US with lithium chloride (LiCl) on general activity to a tone CS, even though those pairings substantially reduced food consumption. Experiments 2 and 3 compared the effects on conditioned responding of postconditioning pairings of food with LiCl and with high-speed rotation. In these experiments the general activity measure was supplemented by a detailed visual analysis of the rats' behavior. Experiment 2 found that food-rotation pairings had larger effects than food-LiCl pairings on general activity responding and on two detailed behavioral measures but that food-LiCl pairings had larger effects on food consumption and on one behavioral measure. Experiment 3 replicated the findings of Experiment 2 and found that the ability of the CS to serve as a reinforcer for second-order conditioning after US devaluation was reduced more by food-LiCl pairings.     

Excitation and inhibition in unblocking

In four experiments the nature of learning established with unblocking procedures in the appetitive conditioning of rats was examined. Measures of learning included response topography, effects of selective satiation, and summation and retardation tests of conditioned inhibition. One cue (A) was first paired with either a single unconditioned stimulus event, US1, or a sequence of two events, US1----US2. US2 was either qualitatively similar to (US2-Same) or different from (US2-Diff) US1. Then, a compound of A and a novel cue (X) was reinforced with US1 or US1----US2. Conditioning to X was blocked if either the single US1 or the US1----US2 sequence was used in both phases. If X accompanied an upshift in the reinforcer, from US1 to US1----US2, it acquired conditioned responding, especially when US2-Diff was used. Responding in the latter case was the consequence of both X-US1 and X-US2 associations. In Experiments 1-3, if X accompanied a downshift from US1----US2-Same to US1, it acquired conditioned responding that was based on X-US1 associations, but if it accompanied a downshift from US1----US2-Diff to US1, it acquired conditioned inhibition based on X-US2 associations. In Experiment 4, X acquired net inhibition at short US1-US2 intervals and net excitation at longer intervals, with downshifts from either US1----US2-Same or US1----US2-Diff to US1. However, the interval gradient was broader with downshifts from US1----US2-Diff. These data, and several other contradictory findings in the unblocking literature, are consistent with the views that (a) the surprising addition or deletion of US2 in unblocking experiments both facilitates the acquisition of excitatory X-US1 associations and establishes either excitatory or inhibitory, respectively, X-US2 associations, and (b) that the gradient of X-US1 facilitation is broader than that of X-US2 association.     

Acquisition of instrumental conditioned reinforcement is resistant to the devaluation of the unconditioned stimulus

The associative mechanisms responsible for the efficacy of Pavlovian stimuli during first- and second-order conditioning have been extensively studied, but little is known about the representations underlying instrumental conditioned reinforcement. The present study investigated the associative structure underlying conditioned reinforcement, by employing an unconditioned stimulus (US) devaluation procedure on a commonly used instrumental task: the acquisition of a new response with conditioned reinforcement. Whilst US-directed behaviour was abolished following devaluation, the conditioned stimulus acting as a conditioned reinforcer supported the acquisition of instrumental responding. In this preparation then, the conditioned reinforcer appears to be impervious to devaluation of its associated US, suggesting that the underlying representation maintaining behaviour is independent of the current value of the US and may reflect the activation of a central appetitive motivational state.     

Non-differential return of fear in humans after a reinstatement procedure

The present experiment investigated reinstatement of fear in humans using a differential fear conditioning preparation. In this experiment, one neutral stimulus (conditioned stimulus; CS+) was paired with an aversive stimulus (unconditioned stimulus; US) during the acquisition phase, while another neutral stimulus was not (CS−). This procedure led to a difference in responding between the CS+ and the CS− (i.e., differential conditioning). After this acquisition phase, an extinction phase followed, during which both CSs were presented without the US, resulting in a decrease in differential conditioned responding. Reinstatement refers to the return of extinguished conditioned responses due to the experience of US-only trials after the extinction phase. This phenomenon was investigated by presenting half of the participants (reinstatement group) with unpredictable USs after the extinction phase. The control group did not receive these USs after the extinction procedure. The results show that return of fear was clearly apparent after the reinstating USs. This return of fear was, however, not limited to the CS+. An increase in ‘conditioned’ responding was also observed for the control stimulus. This interesting observation will be discussed against the background of a number of recent theoretical conceptualizations of reinstatement.     

Lesions of rat infralimbic cortex enhance recovery and reinstatement of an appetitive Pavlovian response

The prefrontal cortex (PFC) has a well-established role in the inhibition of inappropriate responding, and evidence suggests that the infralimbic (IL) region of the rat medial PFC (MPFC) may be involved in some aspects of extinction of conditioned fear. MPFC lesions including, but not those sparing the IL cortex increase spontaneous recovery of extinguished conditioned fear when tested 24 h after an initial extinction session. The current experiment extended these findings by use of appetitive rather than aversive conditioning. Ten IL-lesioned and 11 sham-operated rats were trained on a Pavlovian task in which a conditioned stimulus (CS) was followed by food pellets (the unconditioned stimulus or US). IL lesions had no effect on extinction of the conditioned response (CR, magazine entries) during the first extinction session. However, the level of spontaneous recovery between the first extinction session and a second, 24 h later, was increased in IL-lesioned rats relative to sham animals. In contrast, evidence of savings measured between the extinction sessions did not differ between groups. Furthermore, reinstatement of the CR following unsignaled delivery of the US was also increased in IL-lesioned rats.     

Blocking and unblocking of conditioned analgesia

Two experiments with rat subjects assessed the blocking phenomenon using inhibition of responding to painful thermal stimulation as an index of conditioned analgesia established through conditioned stimulus (CS)-shock pairings. In Experiment 1, a group of rats receiving the standard blocking procedure ($\text{A+}\text{AB+}$) showed shorter response latencies during a hot plate test of pain sensitivity in the presence of the added CS than groups of rats receiving various blocking control procedures. Experiment 2 replicated the blocking outcome of Experiment 1 and also demonstrated that the addition of a second shock unconditioned stimulus (US) during the compound conditioning phase attenuated the blocking effect; i.e., unblocking was observed. However, the deletion of a second shock US during compound conditioning in a group that had received two shocks on each trial in the first phase of the experiment failed to result in unblocking. These data extend the associative account of conditioned analgesia to situations involving stimulus selection and the implications for the analysis of aversive learning are discussed.     

Conditioning of the rabbit's nictitating membrane response to a CSA-CSB-US serial compound: manipulations of CSB's associative character.

Response acquisition to a trace conditioned stimulus (CSA) can be facilitated by insertion of a second stimulus (CSB) at the end of the trace interval just before the unconditioned stimulus (US). This effect may arise from serial mediation of trace conditioning, second-order conditioning, or both. Whereas serial mediation relies only on the presence of CSB, associative transfer relies on CSB's associative strength. In the present experiments, the presence of CSB was fixed, whereas CSB's associative strength was manipulated by (a) extinction of CSB, (b) latent inhibition of CSB, and (c) prior CSB-US pairings. In the first 2 cases, the level of responding to CSA was reduced in a fashion parallel to that of CSB. However, in the third case, partial blocking of conditioned response (CR) acquisition to CSA was observed. The results are discussed with reference to the role of associative transfer to both facilitating and blocking CR acquisition to CSA.     

Temporal coding in conditioned inhibition: analysis of associative structure of inhibition

Two experiments with rats as subjects were conducted to investigate the associative structure of temporal control of conditioned inhibition through posttraining manipulation of the training excitor-unconditioned stimulus (US) temporal relationship. Experiment 1 found that following simultaneous Pavlovian inhibition training (i.e., A --> US/XA-no US) in which a conditioned stimulus (CS A) was established as a delay excitor, maximal inhibition was observed on a summation test when CS X was compounded with a delay transfer CS. Furthermore, posttraining shifts in the A-US temporal relationship from delay to trace resulted in maximal inhibition of a trace transfer CS. Experiment 2 found complementary results to Experiment 1 with an A-US posttraining shift from serial to simultaneous. These results suggest that temporal control of inhibition is mediated by the training excitor-US temporal relationship.     

Conditioning the unconditioned response: modification of the rabbit's (Oryctolagus cuniculus) unconditioned nictitating membrane response

Conditioning-specific reflex modification (CRM) occurs when classical conditioning modifies responding to an unconditioned stimulus (US) in the absence of a conditioned stimulus (CS). Three experiments monitored rabbit nictitating (Oryctolagus cuniculus) membrane unconditioned responses to 5 intensities and 4 durations of periorbital electrical stimulation before and after CS or US manipulation. CRM occurred after 12 days of CS-US pairings but not following unpaired CS/US presentations or restraint. CRM survived CS-alone and CS/US-unpaired extinction of the conditioned response (CR) but not presentations of the US alone, although CRs remained intact. Thus, CRs could be weakened without eliminating CRM and CRM could be weakened without eliminating CRs. Data indicate CRM is a reliable, associative effect that is more than a generalized CR and may not be explained by habituation, stimulus generalization, contextual conditioning, or bidirectional conditioning.     

Contextual Control of Latent Inhibition by the Reinforcer

Three experiments examined the contextual control of latent inhibition (LI) by the unconditioned stimulus (US) using a within-subjects conditioned suppression procedure with rats. The effect of reducing the context change produced by the introduction of the shock US was investigated by presenting this US during preexposure to the conditioned stimulus (CS). Although limited CS preexposure in the absence of the US had no impact on subsequent conditioning, preexposure in the presence of the shock retarded both excitatory and inhibitory conditioning. We conclude that the introduction of the US during the conditioning phase of a normal LI experiment can produce a contextual change that reduces the observed magnitude of LI.     

Effect of unconditioned stimulus magnitude on the emergence of conditioned responding

Although unconditioned stimulus (US) magnitude influences conditioning, no experiment has addressed whether it influences a decision point at which the organism first responds (Gallistel & Gibbon, 2000). Two appetitive conditioning experiments with rats confirmed that the rate of food cup entries and proportion of head jerking were related to the number of pellets (US) provided after the conditioned stimulus. In addition, the onset of responding measured by the number of reinforcers to a criterion or by a quantitatively identified change point also reflected US magnitude. Two aversive conditioning experiments also found that the amount and onset of freezing were related to footshock intensity. All experiments identified a trial at which responding increased abruptly in individual subjects. However, the point where the increase occurred was earlier with larger USs.     

Simultaneous backward conditioned inhibition and mediated conditioning

Demonstrations of retrospective revaluation suggest that remembered stimuli undergo a reduction in association with the unconditioned stimulus (US) present during learning. Conversely, demonstrations of mediated conditioning in flavor-conditioning experiments with rats suggest that remembered stimuli undergo an increase in association with the US present during learning. In a food allergy prediction task with 23 undergraduates, we demonstrated simultaneous backward conditioned inhibition and mediated conditioning effects. These results are compatible with the hypothesis that the direction of change (decrease or increase) in associative strength depends on whether the remembered stimulus was of a different category (conditioned stimulus/antecedent) or the same category (US/outcome) as the presented US.