Interaction between preexposure and overshadowing: Further analysis of the extended comparator hypothesis

Three experiments with rats used conditioned suppression of barpress to test predictions of the extended comparator hypothesis, which assumes that the effectiveness of (first-order) comparator stimuli in modulating responding to a target conditioned stimulus (CS) is itself modulated by other (second-order) comparator stimuli. Experiment 1 demonstrated that both pretraining exposure to the target CS alone (i.e., CS-preexposure effect, also known as latent inhibition) and pretraining exposure to a compound of the target CS and nontarget CS (i.e., compound-CS-preexposure effect) counteract overshadowing, and that posttraining deflation (i.e., extinction) of the overshadowing stimulus attenuates responding to the target CS when overshadowing is preceded by a CS-preexposure treatment (i.e., yields a CS-preexposure effect), but not when overshadowing is preceded by a compound-CS-preexposure treatment. Experiment 2 examined the consequences of posttraining associative inflation of the overshadowing stimulus or the preexposure companion stimulus following conjoint compound-CS-preexposure and overshadowing treatment. Experiment 3 examined the consequences of posttraining inflation of the overshadowing stimulus or the context following conjoint CS-alone preexposure and overshadowing treatment. The results support the expression-focused comparator view in contrast to recent acquisition-focused models of retrospective revaluation.     

The role of contextual associations in producing the partial reinforcement acquisition deficit

Three conditioned suppression experiments with rats as subjects assessed the contributions of the conditioned stimulus (CS)-context and context-unconditioned stimulus (US) associations to the degraded stimulus control by the CS that is observed following partial reinforcement relative to continuous reinforcement training. In Experiment 1, posttraining associative deflation (i.e., extinction) of the training context after partial reinforcement restored responding to a level comparable to the one produced by continuous reinforcement. In Experiment 2, posttraining associative inflation of the context (achieved by administering unsignaled outcome presentations in the context) enhanced the detrimental effect of partial reinforcement. Experiment 3 found that the training context must be an effective competitor to produce the partial reinforcement acquisition deficit. When the context was down-modulated, the target regained behavioral control thereby demonstrating higher-order retrospective revaluation. The results are discussed in terms of retrospective revaluation, and are used to contrast the predictions of a performance-focused model with those of an acquisition-focused model.     

Conditioned inhibition produced by extinction-mediated recovery from the relative stimulus validity effect: a test of acquisition and performance models of empirical retrospective revaluation

Empirical retrospective revaluation is a phenomenon of Pavlovian conditioning and human causal judgment in which posttraining changes in the conditioned response (Pavlovian task) or causal rating (causal judgment task) of a cue occurs in the absence of further training with that cue. Two experiments tested the contrasting predictions made by 2 families of models concerning retrospective revaluation effects. In a conditioned lick-suppression task, rats were given relative stimulus validity training, consisting of reinforcing a compound of conditioned stimuli (CSs) A and X and nonreinforcement of a compound of CSs B and X, which resulted in low conditioned responding to CS X. Massive posttraining extinction of CS A not only enhanced excitatory responding to CS X, but caused CS B to pass both summation (Experiment 1) and retardation (Experiment 2) tests for conditioned inhibition. The inhibitory status of CS B is predicted by the performance-focused extended comparator hypothesis (J. C. Denniston, H. I. Savastano, & R. R. Miller, 2001), but not by acquisition-focused models of empirical retrospective revaluation (e.g., A. Dickinson & J. Burke, 1996; L. J. Van Hamme & E. A. Wasserman, 1994).     

Mechanisms underlying retarded emergence of conditioned responding following inhibitory training: evidence for the comparator hypothesis

The comparator hypothesis posits that conditioned responding is determined by a comparison at the time of testing between the associative strengths of the conditioned stimulus (CS) and stimuli proximal to the CS at the time of conditioning. The hypothesis treats all associations as being excitatory and treats conditioned inhibition as the behavioral consequence of a CS that is less excitatory than its comparator stimuli. Conditioned lick suppression by rats was used to differentiate four possible sources of retarded responding to an inhibitory CS. These include habituation to the unconditioned stimulus (US), latent inhibition to the CS, blocking of the CS-US association by the conditioning context, and enhanced excitatory associations to the comparator stimuli. Prior research has demonstrated the first three phenomena. Therefore, we employed parameters expected to highlight the fourth one--the comparator process. In Experiment 1, our negative contingency training was shown to produce a conditioned inhibitor that passed inhibitory summation and retardation tests. In Experiment 2 we found transfer of retardation from an inhibitory CS to a novel stimulus when the location where retardation-test training occurred was excitatory, which is indicative of contextual blocking and/or comparator effects. In Experiment 3, extinction of the conditioning context was found to attenuate retardation regardless of whether extinction occurred before or after the CS-US pairings of the retardation test. This indicates that much of the present retardation was due to the comparator process rather than to contextual blocking. Experiment 4 demonstrated that habituation to the US did not contribute to retardation in the present case. Collectively, these studies suggest that retardation following inhibitory training can be explained without recourse to any of the traditional mechanisms of conditioned inhibition.     

The comparator hypothesis of conditioned response generation: manifest conditioned excitation and inhibition as a function of relative excitatory strengths of CS and conditioning context at the time of testing

In the present research water-deprived rats were used in a conditioned lick suppression paradigm to test and further develop Rescorla's (1968) contingency theory, which posits that excitatory associations are formed when a conditioned stimulus (CS) signals an increase in unconditioned stimulus (US) likelihood and that inhibitory associations develop when the CS signals a decrease in US likelihood. In Experiment 1 we found that responding to a CS varied inversely with the associative status of the context in which the CS was trained and that this response was unaltered when testing occurred in a distinctively dissimilar context with a different conditioning history, provided associative summation with the test context was minimized. These results suggest that manifest excitatory and inhibitory conditioned responding is modulated by the associative value of the training context rather than that of the test context. In Experiment 2 it was demonstrated that postconditioning decreases in the associative value of the CS training context reduced the effective inhibitory value of the CS even when testing occurred outside of the training context. Moreover, this contextual deflation effect was specific to the CS training context as opposed to any other excitatory context. Collectively, these studies support the comparator hypothesis, which states that conditioned responding is determined by a comparison of the associative strengths of the CS and its training context that occurs at the time of testing rather than at the time of conditioning. This implies that all associations are excitatory and that responding indicative of conditioned inhibition reflects a CS-US association that is below (or near) the associative strength of its comparator stimulus. It is suggested that response rules which go beyond a monotonic relation between associative value and response strength can partially relieve learning theories of their explanatory burdens, thereby allowing for simpler models of acquisition.     

Degraded contingency revisited: posttraining extinction of a cover stimulus attenuates a target cue's behavioral control

In a Pavlovian conditioning situation, unsignaled outcome presentations interspersed among cue-outcome pairings attenuate conditioned responding to the cue (i.e., the degraded contingency effect). However, if a nontarget cue signals these added outcomes, responding to the target cue is partially restored (i.e., the cover stimulus effect). In 2 conditioned suppression experiments using rats, the effect of posttraining extinction of the cover stimulus was examined. Experiment 1 found that this treatment yielded reduced responding to the target cue. Experiment 2 replicated this finding, while demonstrating that this basic effect was not due to acquired equivalence between the target cue and the cover stimulus. These results are consistent with the extended comparator hypothesis interpretation of the degraded contingency and cover stimulus effects.     

Testing response generation rules

Robbins (1988) reported data that he viewed as inconsistent with Miller and Schachtman's (1985a) comparator hypothesis of conditioned response generation. Here we explain why we do not find his experiments a compelling test of the comparator hypothesis. We also briefly review other studies that tested the same predictions of the comparator hypothesis that Robbins examined. We conclude that there is considerable evidence that following excitatory or inhibitory conditioning with a target conditioned stimulus (CS) and unconditioned stimulus (US), extinction of other cues that were present during CS training ordinarily increases excitatory responding and decreases inhibitory responding to the CS. However, consistent with Robbins's conclusion, there is scant evidence that after CS-US training, enhancing the associative value of other cues that were present during CS training influences excitatory or inhibitory responding to the CS. The implications of these conclusions for the comparator hypothesis as an explanation of differences in acquired behavior and as a heuristic tool are considered.     

Counteraction between overshadowing and degraded contingency treatments: support for the extended comparator hypothesis

Four experiments using rats in a Pavlovian lick-suppression preparation investigated the effects of combining 2 treatments known for their response-decrementing effects, namely, overshadowing and degraded contingency. Contrary to most contemporary learning theories, the extended comparator hypothesis predicts that these 2 treatments will counteract each other, and therefore, less of a decrement in conditioned responding should be observed than with either treatment alone. Experiments 1 and 2 confirmed this prediction in first-order conditioning and sensory preconditioning preparations, respectively. Experiment 3 demonstrated that posttraining extinction of the training context resulted in a recovery from degraded contingency and reversed the counteractive effect on overshadowing. Finally, Experiment 4 demonstrated that posttraining extinction of the overshadowing stimulus resulted in recovery from simple overshadowing and also reversed the counteractive effect on degraded contingency. These results are consistent with the extended comparator hypothesis but not traditional or recent acquisition-focused models.     

Trial spacing is a determinant of cue interaction

Four conditioned lick suppression experiments with rats examined the effect of trial spacing on cue interaction. Experiments 1 and 2 found overshadowing to be eliminated with massed compound stimulus-outcome pairings and the usual trial spacing effect to be reversed with compound acquisition trials. Experiment 3 found that whether acquisition compound-outcome pairings were massed or spaced determined the effect of posttraining extinction treatment. Extinction of the overshadowing cue reduced responding following massed training and increased responding following spaced training. Extinction of the context decreased responding following massed training. Experiment 4 found the conditioning and devaluation results to be associative and stimulus specific. These results are in accord with the extended comparator hypothesis (J. C. Denniston, H. I. Savastano, & R. R. Miller, 2001).     

Prevention of the degraded-contingency effect by signalling training trials

Presentation of unsignalled unconditioned stimuli (USs) interspersed among Pavlovian excitatory conditioning trials weakens conditioned responding to a target conditioned stimulus (CS; Rescorla, 1968). However, signalling these intertrial USs with another cue (a cover stimulus) has been shown to alleviate this degraded-contingency effect (e.g. Durlach, 1982, 1983). In contrast to signalling the inter-trial USs, the present experiments examined the effect on the degraded-contingency effect of signalling the target CS-US pairings. Experiment 1, using parameters selected to avoid overshadowing, found that consistently presenting a cover stimulus immediately prior to the target CS-US pairings during degraded-contingency training alleviated the degraded-contingency effect. Experiment 2 examined the underlying mechanism responsible for this cover-stimulus effect through posttraining associative inflation of the cover stimulus or the context, and found that inflation of the cover stimulus attenuated responding to the target CS (i.e. empirical retrospective revaluation). The results are discussed in terms of various acquisition- and expression-focused models of acquired responding.     

Overshadowing of subsequent events and recovery thereafter

Four experiments using a conditioned lick suppression preparation with rats were conducted to examine whether overshadowing of subsequent events could be obtained in Pavlovian backward conditioning (i.e. unconditioned stimulus [US] before conditioned stimulus [CS]), and to determine whether such overshadowing could be reversed without further training with the overshadowed CS, as has been reported in overshadowing of antecedent events. In Experiment 1, a backward-conditioned CS overshadowed a second backward-conditioned CS. Two posttraining manipulations, extinction of the overshadowing CS (Experiment 2) and shifting of the temporal relationship of the overshadowing CS to the US (Experiment 3), increased responding to the overshadowed CS. These results constitute the first unambiguous demonstration of stimulus competition between subsequent events using first-order conditioning, and they show that, like overshadowing with forward conditioning, such overshadowing is due, at least in part if not completely, to a failure to express information that had been acquired.     

Temporal coding in conditioned inhibition: analysis of associative structure of inhibition

Two experiments with rats as subjects were conducted to investigate the associative structure of temporal control of conditioned inhibition through posttraining manipulation of the training excitor-unconditioned stimulus (US) temporal relationship. Experiment 1 found that following simultaneous Pavlovian inhibition training (i.e., A --> US/XA-no US) in which a conditioned stimulus (CS A) was established as a delay excitor, maximal inhibition was observed on a summation test when CS X was compounded with a delay transfer CS. Furthermore, posttraining shifts in the A-US temporal relationship from delay to trace resulted in maximal inhibition of a trace transfer CS. Experiment 2 found complementary results to Experiment 1 with an A-US posttraining shift from serial to simultaneous. These results suggest that temporal control of inhibition is mediated by the training excitor-US temporal relationship.     

Associative transfer and stimulus selection in classical conditioning of the rabbit's nictitating membrane response to serial compound CSs

Four experiments were conducted to determine whether in conditioning to a serial compound, CS1-CS2-UCS, there are (a) associative mechanisms operating to extend conditioning beyond the bounds of a CS-UCS contiguity gradient and (b) stimulus selection processes acting to attenuate the potency of CS-UCS contiguity. In Experiments 1 and 2, the CS2-UCS interval was held at .35 sec while the CS1-UCS interval was varied across groups from .75 to 2.75 sec. CS1 test trials revealed substantial CR acquisition at all CS1-UCS intervals. Moreover, Experiment 2 indicated that when the contribution of cross-modal generalization from CS2 to CS1 was factored out, there still remained a substantial level of conditioning, which Experiment 3 indicated was attributable to an associative mechanism like higher-order or sensory conditioning. The observation of CR acquisition at CS1-UCS intervals of 4.75, 8.75, and 18.75 sec in Experiment 4 suggested that serial compound training yields conditioning to CSs located well beyond the single CS contiguity gradient for the rabbit's nictitating membrane response. Experiments 1 and 2 also indicated the presence of stimulus selection processes because, at the shorter CS1-UCS intervals (.75 and 1.25 sec), the levels of test-trial responding to CS2 fell below those observed to the less contiguous CS1.     

Return of fear after retrospective inferences about the absence of an unconditioned stimulus during extinction

We examined whether the effect of an extinction phase can be influenced retrospectively by information about the cause of the absence of the unconditioned stimulus (US) during that phase. Participants were subjected to a differential fear conditioning procedure, followed by an extinction procedure. Afterwards, half of the participants were presented with information about a technical failure, which explained why the US had been absent during the extinction phase. The other participants received information that was unrelated to the US. During a subsequent presentation of the target conditioned stimulus (CS), only the former group of participants showed renewed anticipatory skin conductance responding and a return of US expectancy. The results are in accordance with a propositional account of associative learning and highlight the importance of retrospective reasoning as a cause of relapse after exposure therapy.     

Facilitation of instrumental behavior by a Pavlovian appetitive conditioned stimulus

Three experiments examined appetitive Pavlovian-instrumental interactions by presenting separately trained conditioned stimuli (CSs) during reinforced instrumental responding in rabbits. Intra-oral reinforcement was used to minimize interference from peripheral responses such as magazine approach. In experiment 1, the rabbits were first trained to perform an instrumental head-raising response for sucrose reward. A conditioned jaw movement response was then established to a 2-sec CS by pairing it with sucrose; a control stimulus was unpaired with sucrose. Instrumental responding maintained by a variable-interval 40-sec schedule was enhanced during 10-sec presentations of the paired, but not the unpaired, CS. Responding on a variable-ratio 15 schedule was unaffected except on trials on which the pre-CS baseline response rate was low; in such cases the paired CS caused a long-lasting acceleration of responding. Noncontingent presentation of the sucrose reinforcer itself briefly suppressed responding but had no long-term effect. In Experiment 2, a CS that had been conditioned at a 10-sec duration produced the same pattern of effects as in the first study, indicating that facilitation resulted from CS presentation rather than from the frustrative effects of non-reinforcement of the CS. In Experiment 3 an inhibitory CS blocked facilitation by the excitatory CS but did not itself affect instrumental responding. These results support the view that Pavlovian processes play a positive role in instrumental performance and suggest that previous findings of suppression by a short-duration CS reflect peripheral interference. The dependence of facilitation on the baseline level of responding is discussed in terms of associative and motivational theories of Pavlovian mediation.     

Overshadowing and stimulus duration

In 3 experiments, the authors investigated the effect of stimulus duration on overshadowing. Experiments 1 and 2 examined responding to a target conditioned stimulus (CS1) when it was conditioned in compound with a coterminating overshadowing stimulus (CS2) that was longer, shorter, or of the same duration (the long, short, and matched groups, respectively). Equal overshadowing of conditioning to CS1 was obtained in all 3 conditions relative to a control group conditioned to the light alone. There were, however, differences in responding to CS2 as a function of its absolute duration. Experiment 3 examined the contribution of the food-food interval/CS onset-food interval ratio to these findings. In Experiments 1 and 2, the ratio differed for the overshadowing CS but not for the target CS. In Experiment 3, this arrangement was reversed, but the pattern of results remained the same. The implications of these findings for trial-based and real-time models of conditioning are discussed.     

Blocking acquisition of the rabbit's nictitating membrane response to serial conditioned stimuli

Three experiments demonstrated that prior training with one stimulus (CS1) would block acquisition of the rabbit's nictitating membrane response (NMR) to another stimulus (CS2) which was more contiguous to the US during serial compound training (CS1-CS2-US). Specifically, the CS1-US interval was 800 msec, which produces only a modest rate of CR acquisition, while the CS2-US interval was 400 msec, which is an optimal value for the NMR preparation. Experiment 1 demonstrated blocking when CS1 overlapped CS2, and Experiment 3 demonstrated blocking when CS1 and CS2 were presented in a strictly sequential fashion. Experiment 2 showed that the magnitude of blocking in the serial compound was comparable to that obtained in a simultaneous compound in which both the CS1-US and CS2-US intervals were 800 msec, thus making CS2 less contiguous with the US than in the serial compound. Moreover, the level of responding to CS2 in all serial compound groups (blocking and control) was lower than in the simultaneous compound groups. The present findings provide further evidence that the associative consequences of CS-US contiguity can be highly attenuated by processes of attention or competition for associative strength.     

Differential effects of two ways of devaluing the unconditioned stimulus after Pavlovian appetitive conditioning

Three experiments with rat subjects investigated the effects of two methods of devaluing a food unconditioned stimulus (US) after pairings of an auditory conditioned stimulus (CS) with that US. Experiment 1 found no effect of postconditioning pairings of the food US with lithium chloride (LiCl) on general activity to a tone CS, even though those pairings substantially reduced food consumption. Experiments 2 and 3 compared the effects on conditioned responding of postconditioning pairings of food with LiCl and with high-speed rotation. In these experiments the general activity measure was supplemented by a detailed visual analysis of the rats' behavior. Experiment 2 found that food-rotation pairings had larger effects than food-LiCl pairings on general activity responding and on two detailed behavioral measures but that food-LiCl pairings had larger effects on food consumption and on one behavioral measure. Experiment 3 replicated the findings of Experiment 2 and found that the ability of the CS to serve as a reinforcer for second-order conditioning after US devaluation was reduced more by food-LiCl pairings.     

Recovery of an overshadowed association achieved by extinction of the overshadowing stimulus

Three experiments are reported in which conditioned lick suppression by water-deprived rats was used as an index of associative strength. In Experiment 1, overshadowing of a light by a tone was observed when the light-tone compound stimulus was paired with foot shock. After initial compound pairings, the tone-shock association was extinguished in one group of subjects. Subsequently, these animals demonstrated significantly higher levels of suppression to the light relative to a control group in which the tone had not been extinguished. Experiment 2 replicated this effect while failing to find evidence to support the possibilities that extinction presentations of the overshadowing tone act as retrieval cues for the light-shock association, or that, via second-order conditioning, the light-shock association is actually formed during extinction of the tone. Experiment 3 determined that the recovery from overshadowing observed in Experiments 1 and 2 was specific to the extinction of the overshadowing stimulus rather than the extinction of any excitatory cue. Collectively, these results suggest that the debilitated response to an overshadowed stimulus does not represent an acquisition failure, but rather the failure of an acquired association to be manifest in behavior.     

The effects of ITI fillers in autoshaping

The present experiments used pigeons in an autoshaping procedure to examine the effects of a nonreinforced, nontarget stimulus presented during the intertrial interval on responding to a target CS. Experiments 1 and 2 found that a filler stimulus presented during a substantial portion of the ITI retarded responding to the target CS relative to a group not exposed to the filler. This group difference in performance was subsequently abolished by continued training and omitting the filler in the former group (Experiment 1) or adding a filler for the latter group (Experiment 2). Experiment 3 found that when the “filler” occupied most of the interreinforcement interval, CS-US pairings embedded within the “filler” stimulus yielded superior autoshaping relative to a group that received CS-US pairings embedded in static apparatus cues in the absence of the filler. The results are discussed with reference to the ways that a nontarget stimulus during the ITI can influence contextual modulation of responding to a discrete CS and the necessity for comparator theories to incorporate a “local context” view of cycle time to explain the present findings.