Scaling relative incentive value in consummatory behavior

Surprising downshifts from more preferred (training incentive) to less preferred incentives (test incentive) are usually accompanied by emotional activation and suppression of conditioned behavior in rats. Two experiments were designed to determine whether consummatory behavior is similarly affected by downshifts of equal proportions. Within limits, the degree of consummatory responding during incentive downshift was similar with equal ratios of test concentration to training concentration. Thus, 32–4% and 16–2% downshifts (1:8 test/training ratios) caused similar levels of consummatory behavior, despite differences in the absolute concentrations of the solutions involved in the downshift. An interpretation based on sensory contrast was discarded because of the long intervals between training and test solutions (40 min and 24 h in Experiments 1 and 2, respectively). It is suggested that Weber’s law regulates behavioral suppression after reward downshifts. A theoretical framework for the interpretation of these data is presented.     

Associations in Pavlovian conditioned inhibition

Two experiments with rat subjects used a variety of transfer tests to examine the associations learned when Pavlovian inhibition is established by an A+, AX− paradigm. Experiment 1 found in a conditioned suppression situation that inhibition conditioned to X with one exciter (A) readily transferred to another exciter (B) which had been paired with the same shock US. Transfer occurred even when the response to A had been extinguished prior to testing with B. However, X did not inhibit a general activity response produced by a B which had been subsequently paired with a food US. Experiment 2 employed a Pavlovian conditioning situation in which A and B, when separately paired with the same food US, evoked dissimilar responses. Nevertheless, an inhibitor trained in an A+, AX− paradigm successfully inhibited the different response evoked by B. However, such an X did not inhibit the behaviors acquired by A or B when they were subsequently paired with a shock US. The transfer of Pavlovian inhibition across conditioned stimuli and responses but not across unconditioned stimuli is consistent with the notion that a conditioned inhibitor acts to prevent activation of a US representation which would normally be activated by conditioned exciters.     

Mechanisms underlying retarded emergence of conditioned responding following inhibitory training: evidence for the comparator hypothesis

The comparator hypothesis posits that conditioned responding is determined by a comparison at the time of testing between the associative strengths of the conditioned stimulus (CS) and stimuli proximal to the CS at the time of conditioning. The hypothesis treats all associations as being excitatory and treats conditioned inhibition as the behavioral consequence of a CS that is less excitatory than its comparator stimuli. Conditioned lick suppression by rats was used to differentiate four possible sources of retarded responding to an inhibitory CS. These include habituation to the unconditioned stimulus (US), latent inhibition to the CS, blocking of the CS-US association by the conditioning context, and enhanced excitatory associations to the comparator stimuli. Prior research has demonstrated the first three phenomena. Therefore, we employed parameters expected to highlight the fourth one--the comparator process. In Experiment 1, our negative contingency training was shown to produce a conditioned inhibitor that passed inhibitory summation and retardation tests. In Experiment 2 we found transfer of retardation from an inhibitory CS to a novel stimulus when the location where retardation-test training occurred was excitatory, which is indicative of contextual blocking and/or comparator effects. In Experiment 3, extinction of the conditioning context was found to attenuate retardation regardless of whether extinction occurred before or after the CS-US pairings of the retardation test. This indicates that much of the present retardation was due to the comparator process rather than to contextual blocking. Experiment 4 demonstrated that habituation to the US did not contribute to retardation in the present case. Collectively, these studies suggest that retardation following inhibitory training can be explained without recourse to any of the traditional mechanisms of conditioned inhibition.     

Conditioned inhibition produced by extinction-mediated recovery from the relative stimulus validity effect: a test of acquisition and performance models of empirical retrospective revaluation

Empirical retrospective revaluation is a phenomenon of Pavlovian conditioning and human causal judgment in which posttraining changes in the conditioned response (Pavlovian task) or causal rating (causal judgment task) of a cue occurs in the absence of further training with that cue. Two experiments tested the contrasting predictions made by 2 families of models concerning retrospective revaluation effects. In a conditioned lick-suppression task, rats were given relative stimulus validity training, consisting of reinforcing a compound of conditioned stimuli (CSs) A and X and nonreinforcement of a compound of CSs B and X, which resulted in low conditioned responding to CS X. Massive posttraining extinction of CS A not only enhanced excitatory responding to CS X, but caused CS B to pass both summation (Experiment 1) and retardation (Experiment 2) tests for conditioned inhibition. The inhibitory status of CS B is predicted by the performance-focused extended comparator hypothesis (J. C. Denniston, H. I. Savastano, & R. R. Miller, 2001), but not by acquisition-focused models of empirical retrospective revaluation (e.g., A. Dickinson & J. Burke, 1996; L. J. Van Hamme & E. A. Wasserman, 1994).     

Conditioning across the duration of a backward conditioned stimulus

Five conditioned suppression experiments examined the extent to which an appetitively motivated lever-press response can be punished by different components of a backward conditioned stimulus (CS). Using a 0-s unconditioned stimulus (US)-CS interval, Experiments 1 and 2 showed that the initial 3 s of a normally 30-s backward CS served as a more effective punisher than the CS as a whole. Experiment 3 found no such effect if the US-CS interval were 3 s rather than 0 s. Experiments 4A and 4B found that if the US-CS interval were 0 s, the initial part of the backward CS acquired excitatory properties although the CS as a whole passed a summation test for conditioned inhibition. By contrast, the 3-s US-CS interval supported inhibitory conditioning across the whole duration of the backward CS. Taken together, these findings support a modified version of Wagner's sometimes opponent process model, which suggests that different components of a backward CS become either excitatory or inhibitory depending on the components' temporal proximity to the US.     

Unblocking in Pavlovian fear conditioning

Six experiments used rats to study blocking and unblocking of fear learning. An excitatory stimulus (A) blocked fear learning to a neutral stimulus (B). Unblocking of B occurred if the AB compound signaled an increase in unconditioned stimulus (US) intensity or number. Assessments of associative change during blocking showed that more was learned about B than A. Such assessments during unblocking revealed that more was learned about B than A following an increase in US intensity but not US number. These US manipulations had no differential effects on single-cue learning. The results show that variations in US intensity or number produce unblocking of fear learning, but for each there is a different profile of associative change and a potentially different mechanism.     

Variations in explicitly unpaired training are differentially effective in producing conditioned inhibition

To evaluate a contingency interpretation of conditioned inhibition (CI), rats were given “explicity unpaired” training in which the locus and duration of a CS within the inter-US (shock) interval were systematically manipulated for different groups. Summation and retardation tests in Experiment 1 indicated that stronger CI resulted from both a backward and a trace CS than from a midlocus CS of equal or greater duration. Complementing these findings, the same tests in Experiment 2 showed that, by comparison with novel-stimulus controls, CI developed to a trace CS but not to a mid-locus CS, nor to a trace CS that was accompanied by an immediate signal for the US. These findings argue against a contingency interpretation of CI and favor a contiguity interpretation stressing the short-term rehearsal of stimulus events. Such rehearsal of the US allows a backward CS, but not a mid-locus CS with an extended US-CS interval, to be discriminated as a signal for nonreinforcement, and thus to develop as a conditioned inhibitor. Similarly, excitatory conditioning to the memory trace of a CS allows the nominal trace CS to develop as a signal for nonreinforcement, and thus as a conditioned inhibitor, but not when its memory trace is overshadowed by another CS that immediately precedes the US. In short, the development of CI is facilitated when excitation is mediated by the memorial processing of either the US or a discrete CS for the US rather than by contextual cues.     

Context-outcome associations mediate context-switch effects in a human predictive learning task

Four experiments explored the role of contexts in information retrieval after different levels of acquisition training in human predictive learning. Participants were trained where cue (X) was followed by an outcome in context A while a different cue (Y) was followed by the absence of the outcome in context B. When 4 training trials with each cue were conducted, testing the stimuli in the alternative contexts decreased predictive judgments to X and increased predictive judgments to Y. These effects disappeared both when training was increased up to 18 trials (Experiments 1a and 1b), and when the outcome was presented in both contexts A and B (Experiments 2 and 4). When the outcome was presented in both contexts, the nonreinforced cue Y, trained in the presumably excitatory context B, became a conditioned inhibitor (Experiment 3). Additional experience with one of the contexts, but not with both, made the context-switch effect reappear (Experiment 4). These results suggest that irrelevant contexts may enter into direct associations with the outcome before prolonged training leads participants to discard them as predictors.     

Element pretraining influences the content of appetitive serial compound conditioning in rats

Four experiments with rat subjects in a Pavlovian appetitive conditioning procedure examined the effects of prior pairings of S2 with the unconditioned stimulus (US) on the nature of the associations formed in S1----S2----US serial compound conditioning. Experiments 1 and 2 showed that prior training of S2 prevented the acquisition of stimulus-stimulus (S-S) associations between S1 and stimulus features of S2, but enhanced the acquisition of stimulus-response (S-R) associations between S1 and the emotional conditioned response (CR) evoked by S2. Experiments 3 and 4 showed that the effects of S2 pretraining were not due to S2 training itself, but rather to its endowing S2 with the ability to evoke a strong CR during the early stages of serial compound conditioning. In Experiment 3, suppression of the CR to a pretrained S2 during serial compound conditioning permitted the establishment of S-S associations. In Experiment 4, the induction of a CR in the presence of an untrained S2 during serial compound conditioning prevented the acquisition of S-S associations. Implications of these data for our understanding of compound conditioning are discussed.     

Backward conditioning: mediation by the context

The information acquired in backward conditioning (i.e., outcome-->cue) was assessed in 3 Pavlovian lick-suppression experiments with water-deprived rats as subjects. Experiment 1 confirmed previous research that few outcome-->cue pairings made the cue into a conditioned excitor and additionally showed that massive posttraining extinction of the training context attenuated a backward-trained cue's excitatory value. Experiment 2 found that many outcome-->cue pairings made the cue into a conditioned inhibitor and that the same context manipulation attenuated this inhibitory value. Experiment 3 confirmed the observations of Experiments 1 and 2 and demonstrated that these effects of context extinction were specific to backward-trained cues conditioned in the extinguished context. These results are interpreted in terms of cue-->context and context-->outcome associations.     

Some types of conditioned inhibitors carry collateral excitatory associations

Two experiments using summation tests in conditioned suppression with rats examined whether conditioned inhibitors generated by five different conditioning procedures have an associative structure which includes collateral excitatory associations. The existence of collateral conditioned excitation was inferred from an increase in the amount of manifest conditioned inhibition after a conditioned inhibitory stimulus (CS-) extinction treatment. The five CS-s evaluated were differential, explicitly unpaired, conditional, backward, and trace. With abbreviated conditioning (Experiment 1), the differential and explicitly unpaired CS-s exhibited conditioned inhibitory properties; the conditional, backward, and trace CS-s did not. Repeated extinction presentations of the CS- in the absence of the unconditioned stimulus unmasked conditioned inhibition to the conditional, backward, and trace CS-s revealing moderate degrees of conditioned inhibition for all five CS-s. After more extensive conditioning (Experiment 2), the explicitly unpaired and conditional CS-s were strongly inhibitory and the differential and trace CS-s were moderately inhibitory. The backward CS- was not inhibitory. Repeated presentations of the CS- in extinction unmasked conditioned inhibition to trace and backward CS-s. All five CS-s were now nearly equally inhibitory. That the measured inhibitory power of backward, trace, and conditional (after few trials) CS-s can be modulated by a CS- extinction treatment suggests that they have similar associative structures and carry, in addition to inhibitory associations, collateral excitatory associations that mask the expression of conditioned inhibition.     

Blocking and unblocking of conditioned analgesia

Two experiments with rat subjects assessed the blocking phenomenon using inhibition of responding to painful thermal stimulation as an index of conditioned analgesia established through conditioned stimulus (CS)-shock pairings. In Experiment 1, a group of rats receiving the standard blocking procedure ($\text{A+}\text{AB+}$) showed shorter response latencies during a hot plate test of pain sensitivity in the presence of the added CS than groups of rats receiving various blocking control procedures. Experiment 2 replicated the blocking outcome of Experiment 1 and also demonstrated that the addition of a second shock unconditioned stimulus (US) during the compound conditioning phase attenuated the blocking effect; i.e., unblocking was observed. However, the deletion of a second shock US during compound conditioning in a group that had received two shocks on each trial in the first phase of the experiment failed to result in unblocking. These data extend the associative account of conditioned analgesia to situations involving stimulus selection and the implications for the analysis of aversive learning are discussed.     

Reduced blocking as a result of increasing the number of blocking cues

Weak behavioral control (blocking) occurs when a target stimulus (X) is paired with an outcome in the presence of a well-established signal for the outcome (i.e., a blocking stimulus). Conventional Pavlovian conditioning theories explain this effect by asserting that a discrepancy between expected and experienced outcomes is necessary for learning about X and that no such discrepancy exists in blocking situations. These theories anticipate that the effect of additional well-established signals for the unconditioned stimulus (US) should be additive. In two conditioned barpress suppression experiments using rats as subjects, the opposite result was observed. Experiment 1 provided evidence that blocking was reduced when two blocking stimuli were present during X-US pairings relative to when one blocking stimulus was present. Experiment 2 elaborated on the mechanisms underlying the observations in Experiment 1, while explaining the discrepancy between the results of Experiment 1 and prior reports of the additivity of blocking stimuli. nt]mis|The research was supported by National Institute of Mental Health Grant 33881.     

Retrospective revaluation effects following serial compound training and target extinction

Using a conditioned suppression task, two experiments examined retrospective revaluation effects after serial compound training in a release from overshadowing design. In Experiment 1, serial X → A+ training produced suppression to target A, which was enhanced when preceded by feature X, whereas X by itself elicited no suppression. Subsequent A− presentations extinguished responding to A, but had no effect on either responding to X → A or X alone. However, the addition of A− trials did enhance the ability of feature X to elicit suppression to a novel target, B, suggesting retrospective revaluation of X’s properties. Experiment 2 showed that the enhanced transfer effect, observed in Experiment 1, was independent of the training history of the target (B− or Y → B+/B−). Together, these results suggest that feature X did not retrospectively acquire excitatory strength or occasion setting power, but rather a generalized ability to increase responding to any other cue.     

Temporal coding in conditioned inhibition: analysis of associative structure of inhibition

Two experiments with rats as subjects were conducted to investigate the associative structure of temporal control of conditioned inhibition through posttraining manipulation of the training excitor-unconditioned stimulus (US) temporal relationship. Experiment 1 found that following simultaneous Pavlovian inhibition training (i.e., A --> US/XA-no US) in which a conditioned stimulus (CS A) was established as a delay excitor, maximal inhibition was observed on a summation test when CS X was compounded with a delay transfer CS. Furthermore, posttraining shifts in the A-US temporal relationship from delay to trace resulted in maximal inhibition of a trace transfer CS. Experiment 2 found complementary results to Experiment 1 with an A-US posttraining shift from serial to simultaneous. These results suggest that temporal control of inhibition is mediated by the training excitor-US temporal relationship.     

Is the context specificity of latent inhibition a sufficient explanation of learned irrelevance?

In three experiments, rats were pre-exposed either to uncorrelated presentations of a light and sucrose pellets (group CS/US) or to equivalent presentations of the light and pellets in separate sessions (control). In Experiment 1, subsequent conditioning to the light proceeded more slowly in group CS/US than in the control group, whether this conditioning was excitatory, with the light signalling the delivery of pellets, or inhibitory, with the light signalling their absence. Bonardi and Hall (1996) have argued that this learned irrelevance effect may be reducible to latent inhibition, which would be stronger in group CS/US because they are both pre-exposed and conditioned to the CS in the presence of traces of previous USs occurring in the same session. This analysis implies that group CS/US should have conditioned more rapidly to the CS than controls on the first trial of each session in Experiment 1, but this did not happen. It also implies that the learned irrelevance effect should be reversed if conditioning trials are given at a rate of one per day . Experiments 2 and 3 found no support for this prediction. We conclude that learned irrelevance effects cannot always be reduced to latent inhibition.     

Comparing excitatory backward and forward conditioning

Three Pavlovian lick suppression studies with rats were conducted to compare the role of the conditioning context in excitatory backward and forward conditioning. The experiments explored the possibility that excitatory backward conditioning, but not forward conditioning, is mediated by the context. That is, in excitatory backward conditioning, the conditioning context may function as an excitatory mediator, which supports second-order conditioning of the target cue. This possibility contrasts with traditional accounts, which suggests that common processes underlie excitatory backward and forward conditioning. Experiment 1 found that conditioned responding following backward conditioning was attenuated as a result of posttraining extinction of the training context, but the same manipulation elevated responding after forward conditioning. Experiments 2 and 3 found that posttraining and pretraining associative inflation of the context (presenting unsignalled USs) increased conditioned responding to the target of a backward conditioning procedure but either had no effect or reduced responding to the target of a forward conditioning procedure. Thus, excitatory backward and forward conditioning appear to differ in their dependence on the status of the conditioning context.     

Determinants of Response Recovery in Extinction Following Response Elimination

Elimination of autoshaped responding by random or negatively-contingent response-reductive procedures may leave a previously acquired association intact; however, two previous studies suggest that response elimination by backward conditioning may have more permanent effects. In Experiments 1 and 3, the autoshaped responding of pigeons was eliminated by a backward or negative contingency. Although speed of recovery during a subsequent extinction phase was greater following the backward contingency in Experiment 3, level of recovery did not differ as a function of response elimination procedure in either experiment. A possible basis for the discrepancy between the present and previous findings is the contingency arranged between the conditioned and unconditioned stimuli (CS and US, respectively) during forward conditioning. In Experiments 1 and 2, probability of US presentation following the CS (p(US|CS) = 0.4 or 1.0) was varied within (Experiment 1) or between (Experiment 2) groups of birds. In both cases, level of recovery was higher following training under (p(US|CS) = 0.4). The results are consistent with a memory retrieval theory in which unreinforced trials function as a retrieval cue for not responding.     

Automaintenance,contrast, and contingencies: Effects of local vs. overall and prior vs. impending reinforcement context

The pigeon's keypeck was investigated in a variety of multiple schedules of response-independent or -dependent reinforcement. Experiments 1 and 2 found that keypecking developed to a reinforcement-associated cue that signaled an increase in local rate of reinforcement, but signaled either no change or a decrease in the overall rate of reinforcement, defined as that prevailing in the cue's absence. In Experiment 3 a greater rate of responding to a target stimulus was observed when it was preceded by a second signal—associated with the same, or a lower, rate of reinforcement—and followed by extinction than when this temporal sequence was reversed. In Experiment 4 responding to a target cue increased when either a temporally prior or a subsequent reinforcement-associated cue was changed to signal extinction. Experiment 5 examined the conditioned reinforcing effectiveness of target cues in two types of situations varying the local context of reinforcement. Stimuli associated with selected target components of a response-dependent multiple schedule of reinforcement could appear as the terminal-link consequences in a two-link chain schedule. Enhanced responding during a target cue which accompanied the introduction of an extinction period following this cue was paralleled by an increase in the conditioned reinforcement effects of this cue. No such increase was found for target cues in which an enhancement of responding had been produced by the interposition of an extinction period prior to the cue.     

The Influence of Retention Interval on the US Preexposure Effect: Changes in Contextual Blocking over Time

A number of studies manipulating the length of the interval between conditioning and testing indicate spontaneous recovery from overshadowing, suggesting that certain instances of overshadowing represent a deficit in memory retrieval rather than a failure of animals to form an association between the overshadowed stimulus and the US. The present series of experiments examined the influence of lengthening the retention interval on blocking, another stimulus selection phenomenon that is typically interpreted as an acquisition deficit. The results indicated that when subjects were tested shortly (3 days) after training conditioning to a taste blocked subsequent conditioning to an odor conditioned in compound with that taste (Experiment 1), whereas prior conditioning to an odor did not block subsequent conditioning to a taste conditioned in compound with that odor (Experiment 2). This pattern of results was essentially unchanged when testing occurred at a longer (21-day) retention interval. However, there was evidence of a US preexposure effect in Experiment 2 when subjects in the US ONLY control condition were tested at the 3-day retention interval, but not when testing occurred 21 days after conditioning. Experiments 3 and 4 examined whether this loss of the US preexposure effect over time might actually represent a change in the degree of contextual blocking as the retention interval is lengthened. Exposure to the conditioning context either during the interval between Phase 1 and Phase 2 of conditioning (Experiment 3) or prior to Phase 1 of conditioning (Experiment 4) alleviated this US preexposure effect suggesting that the loss of the US preexposure effect as the retention interval is lengthened observed in Experiment 2 is due to changes in the degree of blocking by contextual stimuli over time. The results are discussed in terms of differential susceptibility of forgetting of two functional roles played by a contextual stimuli in the current situation-context as a CS and context as a retrieval cue for other CS-US associations.