Prevention of the degraded-contingency effect by signalling training trials

Presentation of unsignalled unconditioned stimuli (USs) interspersed among Pavlovian excitatory conditioning trials weakens conditioned responding to a target conditioned stimulus (CS; Rescorla, 1968). However, signalling these intertrial USs with another cue (a cover stimulus) has been shown to alleviate this degraded-contingency effect (e.g. Durlach, 1982, 1983). In contrast to signalling the inter-trial USs, the present experiments examined the effect on the degraded-contingency effect of signalling the target CS-US pairings. Experiment 1, using parameters selected to avoid overshadowing, found that consistently presenting a cover stimulus immediately prior to the target CS-US pairings during degraded-contingency training alleviated the degraded-contingency effect. Experiment 2 examined the underlying mechanism responsible for this cover-stimulus effect through posttraining associative inflation of the cover stimulus or the context, and found that inflation of the cover stimulus attenuated responding to the target CS (i.e. empirical retrospective revaluation). The results are discussed in terms of various acquisition- and expression-focused models of acquired responding.     

Interaction between preexposure and overshadowing: Further analysis of the extended comparator hypothesis

Three experiments with rats used conditioned suppression of barpress to test predictions of the extended comparator hypothesis, which assumes that the effectiveness of (first-order) comparator stimuli in modulating responding to a target conditioned stimulus (CS) is itself modulated by other (second-order) comparator stimuli. Experiment 1 demonstrated that both pretraining exposure to the target CS alone (i.e., CS-preexposure effect, also known as latent inhibition) and pretraining exposure to a compound of the target CS and nontarget CS (i.e., compound-CS-preexposure effect) counteract overshadowing, and that posttraining deflation (i.e., extinction) of the overshadowing stimulus attenuates responding to the target CS when overshadowing is preceded by a CS-preexposure treatment (i.e., yields a CS-preexposure effect), but not when overshadowing is preceded by a compound-CS-preexposure treatment. Experiment 2 examined the consequences of posttraining associative inflation of the overshadowing stimulus or the preexposure companion stimulus following conjoint compound-CS-preexposure and overshadowing treatment. Experiment 3 examined the consequences of posttraining inflation of the overshadowing stimulus or the context following conjoint CS-alone preexposure and overshadowing treatment. The results support the expression-focused comparator view in contrast to recent acquisition-focused models of retrospective revaluation.     

Effect of telencephalon ablation on the reinforcing and eliciting properties of species-specific events in Betta splendens

In male Betta splendens, aggressive behavior is drastically attenuated following telencephalon ablation. Because instrumental training and Pavlovian conditioning experiments with intact fish have suggested that associative factors may play an important role in the performance of agonistic behaviors, the effect of ablation on instrumental learning and Pavlovian conditioning was studied. In Experiment 1, ablation had no effect on the learning of the instrumental tunnel-swimming response reinforced by mirror presentation (i.e., viewing a conspecific), although the mirror presentations in yoked-control groups elicited fewer responses in ablates than in normal and sham-operated control fish. Yoked controls further established that instrumental responding was maintained by the reinforcement contingency and was not merely the result of increased motor activity. Experiment 2 studied Pavlovian conditioning of the components of the agonistic display. Unconditioned fin erection, gill erection, and tail beating (i.e., unconditioned responses, URs) to the mirror US all were less frequent in ablates than in normals or shams. Of these, only gill cover erection showed evidence of true conditioning (i.e., conditioned responses; CRs) in which responses to the conditioned stimulus (CS) are due to the pairings of CS and US (unconditioned stimulus). However, ablates suffered no impairment of conditioned gill erections. Ablates performed fewer fin erections to the CS; however, fin erection responses were not due to CS-US pairings but were attributable to pseudoconditioning. These results are related to hypotheses postulating the involvement of learning mechanisms in ablation-produced deficits and normal aggressive behavior.     

The role of contextual associations in producing the partial reinforcement acquisition deficit

Three conditioned suppression experiments with rats as subjects assessed the contributions of the conditioned stimulus (CS)-context and context-unconditioned stimulus (US) associations to the degraded stimulus control by the CS that is observed following partial reinforcement relative to continuous reinforcement training. In Experiment 1, posttraining associative deflation (i.e., extinction) of the training context after partial reinforcement restored responding to a level comparable to the one produced by continuous reinforcement. In Experiment 2, posttraining associative inflation of the context (achieved by administering unsignaled outcome presentations in the context) enhanced the detrimental effect of partial reinforcement. Experiment 3 found that the training context must be an effective competitor to produce the partial reinforcement acquisition deficit. When the context was down-modulated, the target regained behavioral control thereby demonstrating higher-order retrospective revaluation. The results are discussed in terms of retrospective revaluation, and are used to contrast the predictions of a performance-focused model with those of an acquisition-focused model.     

The hide-and-seek of retrospective revaluation: recovery from blocking is context dependent in human causal learning

In a typical blocking procedure, pairings of a compound consisting of 2 stimuli, A and X, with the outcome are preceded by pairings of only A with the outcome (i.e., A+ then AX+). This procedure is known to diminish responding to the target cue (X) relative to a control group that does not receive the preceding training with blocking cue A. We report 2 experiments that investigated the effect of extinguishing a blocking cue on responding to the target cue in a human causal learning paradigm (i.e., A+ and AX+ training followed by A- training). The results indicate that extinguishing a blocking cue increases conditioned responding to the target cue. Moreover, this increase appears to be context dependent, such that increased responding to the target is limited to the context in which extinction of the blocking cue took place. We discuss these findings in the light of associative and propositional learning theories.     

Duration of signals for intertrial reinforcement and nonreinforcement in random control procedures

In the random control procedure, responding to a conditioned stimulus (target CS) is prevented when the probability of unsignaled, unconditioned stimuli (USs) in the intertrial interval (ITI) is equal to the probability of the US in the presence of the target CS. Three experiments used an autoshaping procedure with White Carneaux pigeons to examine the effects of the temporal duration of signals for the ITI USs (cover CSs) and for concomitant periods of nonreinforcement. In Experiment 1, a short duration cover, but not a long duration cover, resulted in responding to the target CS. In Experiment 2, an explicit CS- cue during periods of nonreinforcement did not affect target acquisition. In Experiment 3, a long CS-, but not a short cover CS, was a sufficient condition for the acquisition of responding to the target CS. These results imply that the acquisition of responding to a target CS requires a discriminable period of nonreinforcement that is long relative to the target CS duration.     

The basic laws of conditioning differ for elemental cues and cues trained in compound

The cue-duration effect (i.e., longer cues result in less conditioned responding than shorter cues) was examined as a function of whether cues were trained alone or in compound. Compound (AX) or elemental (X) cues of either long or short duration were paired with the unconditioned stimulus. In testing with X alone, the cue-duration effect was observed with elementally trained cues, but not with compound cues. Instead, stronger responding resulted from training with long compound cues relative to short compound cues (i.e., a reversed cue-duration effect). Moreover, an overshadowing effect (i.e., decreased responding due to compound conditioning) was observed when conditioning was conducted with a short cue, but compound conditioning resulted in enhanced responding when it was conducted with a long cue (i.e., reversed overshadowing). These findings are consistent with other recent demonstrations that some laws of learning that apply to elementally trained cues do not similarly apply to cues trained in compound.     

Counteraction between overshadowing and degraded contingency treatments: support for the extended comparator hypothesis

Four experiments using rats in a Pavlovian lick-suppression preparation investigated the effects of combining 2 treatments known for their response-decrementing effects, namely, overshadowing and degraded contingency. Contrary to most contemporary learning theories, the extended comparator hypothesis predicts that these 2 treatments will counteract each other, and therefore, less of a decrement in conditioned responding should be observed than with either treatment alone. Experiments 1 and 2 confirmed this prediction in first-order conditioning and sensory preconditioning preparations, respectively. Experiment 3 demonstrated that posttraining extinction of the training context resulted in a recovery from degraded contingency and reversed the counteractive effect on overshadowing. Finally, Experiment 4 demonstrated that posttraining extinction of the overshadowing stimulus resulted in recovery from simple overshadowing and also reversed the counteractive effect on degraded contingency. These results are consistent with the extended comparator hypothesis but not traditional or recent acquisition-focused models.     

Automaintenance,contrast, and contingencies: Effects of local vs. overall and prior vs. impending reinforcement context

The pigeon's keypeck was investigated in a variety of multiple schedules of response-independent or -dependent reinforcement. Experiments 1 and 2 found that keypecking developed to a reinforcement-associated cue that signaled an increase in local rate of reinforcement, but signaled either no change or a decrease in the overall rate of reinforcement, defined as that prevailing in the cue's absence. In Experiment 3 a greater rate of responding to a target stimulus was observed when it was preceded by a second signal—associated with the same, or a lower, rate of reinforcement—and followed by extinction than when this temporal sequence was reversed. In Experiment 4 responding to a target cue increased when either a temporally prior or a subsequent reinforcement-associated cue was changed to signal extinction. Experiment 5 examined the conditioned reinforcing effectiveness of target cues in two types of situations varying the local context of reinforcement. Stimuli associated with selected target components of a response-dependent multiple schedule of reinforcement could appear as the terminal-link consequences in a two-link chain schedule. Enhanced responding during a target cue which accompanied the introduction of an extinction period following this cue was paralleled by an increase in the conditioned reinforcement effects of this cue. No such increase was found for target cues in which an enhancement of responding had been produced by the interposition of an extinction period prior to the cue.     

Associative status of the training context determines the effectiveness of compound extinction

Studies of extinction of a target cue in compound with another excitor have produced evidence of both deepened and attenuated extinction relative to elemental extinction. The present experiments sought to resolve this discrepancy by assessing the effect of the extinction context-unconditioned stimulus (US) association on compound extinction. In an ABC renewal situation with rats, Experiment 1 replicated the observation that enhanced extinction (i.e., reduced conditioned suppression) occurs as a result of nonreinforcement in compound with a concurrent excitor. In Experiment 2, inflation of the extinction context-US association through unsignaled, intertrial US presentations reversed the effect of a concurrent excitor (i.e., extinction with a concurrent excitor was less effective than elemental extinction). Experiment 3 compared compound extinction and second-order conditioning with respect to the effect of context inflation, and produced results incompatible with the view that second-order conditioning contributed to the results of Experiment 2. In Experiment 4, a concurrent excitor enhanced extinction in ABC renewal and attenuated extinction in AAC renewal. The present results suggest that the effect of a concurrent excitor during extinction depends on the strength of the extinction context-US association, thereby confirming predictions of the sometimes -competing retrieval model of associative acquisition and extinction.     

Proactive interference between cues trained with a common outcome in first-order Pavlovian conditioning

The nature of interference between cues (X, A) trained apart with a common outcome (O; an unconditioned stimulus) was explored by assessing proactive interference in first-order Pavlovian conditioning (i.e., A-O, X-O, resulting in attenuated responding to X). Three lick-suppression studies were conducted with water-deprived rats. Posttraining extinction of the interfering cue (A) attenuated proactive interference (Experiment 1), which mirrors the observation that extinction of the competing cue can reduce competition between cues trained together (e.g., recovery from overshadowing). Proactive interference was also attenuated with manipulations known to attenuate interference between outcomes trained apart (e.g., counterconditioning), namely reminder cues (Experiment 2) and renewal (Experiment 3). The findings suggest that similar processes underlie interference between cues trained apart, between cues trained together, and between outcomes trained apart.     

Does temporal contiguity moderate contingency learning in a speeded performance task?

In four experiments, we varied the time between the onset of distracting nonwords and target colour words in a word-word version of the colour-word contingency learning paradigm. Contingencies were created by pairing a distractor nonword more often with one target colour word than with other colour words. A contingency effect corresponds to faster responses to the target colour word on high-contingency trials (i.e., distractor nonword followed by the target colour word with which it appears most often) than on low-contingency trials (i.e., distractor nonword followed by a target colour word with which it appears only occasionally). Roughly equivalent-sized contingency effects were found at stimulus-onset asynchronies (SOAs) of 50, 250, and 450?ms in Experiment 1, and 50, 500, and 1,000?ms in Experiment 2. In Experiment 3, a contingency effect was observed at SOAs of -50, -200, and -350?ms. In Experiment 4, interstimulus interval (ISI) was varied along with SOA, and learning was equivalent for 200-, 700-, and 1,200-ms SOAs. Together, these experiments suggest that the distracting stimulus does not need to be presented in close temporal contiguity with the response to induce learning. Relations to past research on causal judgement and implications for further contingency learning research are discussed.     

Responding to a conditioned stimulus depends on the current associative status of other cues present during training of that specific stimulus.

The comparator hypothesis is a response rule stating that responding to a Pavlovian conditioned stimulus (CS) reflects the associative strength of the CS relative to that of other cues (comparator stimuli) that were present during CS training. Thus, modulation of the associative strength of a CS's comparator stimulus should alter responding to that CS. These studies examined the stimulus specificity of this effect using within-subjects designs. Rats were trained on 2 CSs, each with a unique comparator stimulus, to determine the degree to which posttraining extinction of the comparator stimulus for one CS influences responding to the other CS. Using negative contingency (Experiments 1 and 2), overshadowing (Experiment 3), and local context (Experiment 4) preparations, stimulus specificity was observed. In each case, posttraining extinction of the comparator stimulus for one CS had greater impact on responding to that CS than on responding to the alternate CS.     

Evidence for the automatic processing of prelexical codes in an orthographic but not a phonological task

The automatic activation of phonological and orthographic information in auditory and visual word processing was examined using a task-set procedure. Participants engaged in a phonological task (i.e., determining whether the letter “a” in a word sounded like /e/ or /æ/) or an orthographic task (i.e., determining whether the sound /s/ in a word was spelled with an “s” or a “c”). Participants were cued regarding which task to perform simultaneously with, or 750 ms before, a clear or degraded target. The stimulus clarity effect (i.e., clear words responded to faster than degraded words) was absorbed into the time that it took participants to identify the task on the basis of the cue in a simultaneous cue–target as compared to a delayed cue–target condition, but only for the orthographic task. These data are consistent with the claim that prelexical processing occurs in a capacity-free manner upon stimulus presentation when participants are trying to extract orthographic codes from words presented in the visual and auditory modalities. Such affirmative data were not obtained when participants attempted to extract phonological codes from words, since here the effects of stimulus clarity and cue delay were additive.     

Conditioned inhibition produced by extinction-mediated recovery from the relative stimulus validity effect: a test of acquisition and performance models of empirical retrospective revaluation

Empirical retrospective revaluation is a phenomenon of Pavlovian conditioning and human causal judgment in which posttraining changes in the conditioned response (Pavlovian task) or causal rating (causal judgment task) of a cue occurs in the absence of further training with that cue. Two experiments tested the contrasting predictions made by 2 families of models concerning retrospective revaluation effects. In a conditioned lick-suppression task, rats were given relative stimulus validity training, consisting of reinforcing a compound of conditioned stimuli (CSs) A and X and nonreinforcement of a compound of CSs B and X, which resulted in low conditioned responding to CS X. Massive posttraining extinction of CS A not only enhanced excitatory responding to CS X, but caused CS B to pass both summation (Experiment 1) and retardation (Experiment 2) tests for conditioned inhibition. The inhibitory status of CS B is predicted by the performance-focused extended comparator hypothesis (J. C. Denniston, H. I. Savastano, & R. R. Miller, 2001), but not by acquisition-focused models of empirical retrospective revaluation (e.g., A. Dickinson & J. Burke, 1996; L. J. Van Hamme & E. A. Wasserman, 1994).     

Does temporal contiguity moderate contingency learning in a speeded performance task?

In four experiments, we varied the time between the onset of distracting nonwords and target colour words in a word–word version of the colour–word contingency learning paradigm. Contingencies were created by pairing a distractor nonword more often with one target colour word than with other colour words. A contingency effect corresponds to faster responses to the target colour word on high-contingency trials (i.e., distractor nonword followed by the target colour word with which it appears most often) than on low-contingency trials (i.e., distractor nonword followed by a target colour word with which it appears only occasionally). Roughly equivalent-sized contingency effects were found at stimulus-onset asynchronies (SOAs) of 50, 250, and 450 ms in Experiment 1, and 50, 500, and 1,000 ms in Experiment 2. In Experiment 3, a contingency effect was observed at SOAs of –50, –200, and –350 ms. In Experiment 4, interstimulus interval (ISI) was varied along with SOA, and learning was equivalent for 200-, 700-, and 1,200-ms SOAs. Together, these experiments suggest that the distracting stimulus does not need to be presented in close temporal contiguity with the response to induce learning. Relations to past research on causal judgement and implications for further contingency learning research are discussed.     

Stimulus and temporal cues in classical conditioning

In 2 experiments, separate groups of rats were given stimulus conditioning, temporal conditioning, untreated control and (in Experiment 2) learned irrelevance control procedures, followed by a compound with both stimulus and temporal cues. Stimulus conditioning consisted of a random 15-s duration conditioned stimulus (CS) followed by food; temporal conditioning consisted of food-food intervals of fixed 90 s (Experiment 1) or fixed 75 + random 15 s (Experiment 2). The stimulus group abruptly increased responding after CS onset, and the temporal group gradually increased responding over the food-food interval. When the food-food interval was fixed 90 s, the temporal cue exerted stronger control in the compound, whereas when the food-food interval was fixed 75 + random 15 s, the stimulus cue exerted stronger control. The strength of conditioning, temporal gradients of responding, and cue competition effects appear to reflect simultaneous timing of multiple intervals.     

An inhibitory within-compound association attenuates overshadowing

According to the comparator hypothesis (Miller & Matzel, 1988), cue competition depends on the association between a target stimulus (X) and a competing cue (e.g., an overshadowing cue [A]). Thus, it was expected that overshadowing would be reduced by establishing an inhibitory-like relationship between X and A before compound conditioning. In three lever press suppression experiments with rats, this expectation was supported. Experiment 1 showed that establishing an inhibitory X-A relationship reduced overshadowing. In Experiment 2, degrading the inhibitory-like relationship before conditioning allowed reinforced AX compound trials to result in overshadowing. Experiment 3 replicated the results of Experiment 2 when the inhibitory relationship was degraded after compound conditioning. The results support the view that within-compound associations are necessary not only for retrospective revaluation, but also for conventional cue competition.     

Attentional Bias for Threat: Evidence for Delayed Disengagement from Emotional Faces

The present paper reports three new experiments suggesting that the valence of a face cue can influence attentional effects in a cueing paradigm. Moreover, heightened trait anxiety resulted in increased attentional dwell-time on emotional facial stimuli, relative to neutral faces. Experiment 1 presented a cueing task, in which the cue was either an "angry", "happy", or "neutral" facial expression. Targets could appear either in the same location as the face (valid trials) or in a different location to the face (invalid trials). Participants did not show significant variations across the different cue types (angry, happy, neutral) in responding to a target on valid trials. However, the valence of the face did affect response times on invalid trials. Specifically, participants took longer to respond to a target when the face cue was "angry" or "happy" relative to neutral. In Experiment 2, the cue-target stimulus onset asynchrony (SOA) was increased and an overall inhibition of return (IOR) effect was found (i.e., slower responses on valid trials). However, the "angry" face cue eliminated the IOR effect for both high and low trait anxious groups. In Experiment 3, threat-related and jumbled facial stimuli reduced the magnitude of IOR for high, but not for low, trait-anxious participants.These results suggest that: (i) attentional bias in anxiety may reflect a difficulty in disengaging from threat-related and emotional stimuli, and (ii) threat-related and ambiguous cues can influence the magnitude of the IOR effect.     

Trial spacing is a determinant of cue interaction

Four conditioned lick suppression experiments with rats examined the effect of trial spacing on cue interaction. Experiments 1 and 2 found overshadowing to be eliminated with massed compound stimulus-outcome pairings and the usual trial spacing effect to be reversed with compound acquisition trials. Experiment 3 found that whether acquisition compound-outcome pairings were massed or spaced determined the effect of posttraining extinction treatment. Extinction of the overshadowing cue reduced responding following massed training and increased responding following spaced training. Extinction of the context decreased responding following massed training. Experiment 4 found the conditioning and devaluation results to be associative and stimulus specific. These results are in accord with the extended comparator hypothesis (J. C. Denniston, H. I. Savastano, & R. R. Miller, 2001).