Duration of signals for intertrial reinforcement and nonreinforcement in random control procedures

In the random control procedure, responding to a conditioned stimulus (target CS) is prevented when the probability of unsignaled, unconditioned stimuli (USs) in the intertrial interval (ITI) is equal to the probability of the US in the presence of the target CS. Three experiments used an autoshaping procedure with White Carneaux pigeons to examine the effects of the temporal duration of signals for the ITI USs (cover CSs) and for concomitant periods of nonreinforcement. In Experiment 1, a short duration cover, but not a long duration cover, resulted in responding to the target CS. In Experiment 2, an explicit CS- cue during periods of nonreinforcement did not affect target acquisition. In Experiment 3, a long CS-, but not a short cover CS, was a sufficient condition for the acquisition of responding to the target CS. These results imply that the acquisition of responding to a target CS requires a discriminable period of nonreinforcement that is long relative to the target CS duration.     

Determinants of Response Recovery in Extinction Following Response Elimination

Elimination of autoshaped responding by random or negatively-contingent response-reductive procedures may leave a previously acquired association intact; however, two previous studies suggest that response elimination by backward conditioning may have more permanent effects. In Experiments 1 and 3, the autoshaped responding of pigeons was eliminated by a backward or negative contingency. Although speed of recovery during a subsequent extinction phase was greater following the backward contingency in Experiment 3, level of recovery did not differ as a function of response elimination procedure in either experiment. A possible basis for the discrepancy between the present and previous findings is the contingency arranged between the conditioned and unconditioned stimuli (CS and US, respectively) during forward conditioning. In Experiments 1 and 2, probability of US presentation following the CS (p(US|CS) = 0.4 or 1.0) was varied within (Experiment 1) or between (Experiment 2) groups of birds. In both cases, level of recovery was higher following training under (p(US|CS) = 0.4). The results are consistent with a memory retrieval theory in which unreinforced trials function as a retrieval cue for not responding.     

Conditioning across the duration of a backward conditioned stimulus

Five conditioned suppression experiments examined the extent to which an appetitively motivated lever-press response can be punished by different components of a backward conditioned stimulus (CS). Using a 0-s unconditioned stimulus (US)-CS interval, Experiments 1 and 2 showed that the initial 3 s of a normally 30-s backward CS served as a more effective punisher than the CS as a whole. Experiment 3 found no such effect if the US-CS interval were 3 s rather than 0 s. Experiments 4A and 4B found that if the US-CS interval were 0 s, the initial part of the backward CS acquired excitatory properties although the CS as a whole passed a summation test for conditioned inhibition. By contrast, the 3-s US-CS interval supported inhibitory conditioning across the whole duration of the backward CS. Taken together, these findings support a modified version of Wagner's sometimes opponent process model, which suggests that different components of a backward CS become either excitatory or inhibitory depending on the components' temporal proximity to the US.     

Learning in cod (Gadus morhua): long trace interval retention

Basic knowledge about learning capacities and awareness in fish is lacking. In this study we investigated which temporal gaps Atlantic cod could tolerate between two associated events, using an appetitive trace-conditioning paradigm with blinking light as conditioned stimulus (CS) and dry fish food as unconditioned stimulus (US). CS–US presentations were either temporally overlapping (delay conditioning, CS duration 24 s, interstimulus interval 12 s) or separated by 20, 60, or 120 s (trace conditioning, CS duration 12 s) or 2 h (control, CS duration 12 s). The percentage of fish in the feeding area increased strongly during CS presentation in all delay, 20 s, and 60 s trace groups and in one out of two 120 s trace groups, but not in the control groups. In the 20 and 60 s trace procedures, the fish crowded together in the small feeding area during the trace interval, showing strong anticipatory behaviour. In all the conditioned groups, the fish responded to the CS within eight trials, demonstrating rapid learning. At 88 and 70 days after the end of the conditioning experiments, the delay and 20 s trace groups, respectively, were presented the CS six times at 2-h intervals without reward. All groups responded to the light signal, demonstrating memory retention after at least 3 months. This study demonstrates that Atlantic cod has an impressively good ability to associate two time-separated events and long time retention of learnt associations.     

Recovery of the US representation over time during extinction

Four experiments used a conditioned suppression procedure in rats to explore changes in the US representation over time during the course of extinction. They employed two previously reported effects: reinstatement of responding to an extinguished CS by separate US presentation, and the erasure of that effect by interposed nonreinforcement of a second excitatory CS. These effects have been interpreted as enhancing and depressing the US representation, respectively. Experiment 1 found the erasing effect to decrease but still to remain substantial after over a 4-day period, suggesting a partial recovery with time of a deliberately depressed US representation. Experiment 2 implicated this change as a contributor to the phenomenon of spontaneous recovery by showing that recovery to be sensitive to erasure effects. Experiments 3 and 4 found evidence for an interaction between the state of the US representation and the amount of associative change which results from nonreinforcement of an excitatory CS. When the US representation was strong, either because of reinstatement or the passage of time, nonreinforcement of a CS was especially effective in producing associative change. When the US representation had been depressed by erasure, those nonreinforcements produced relatively less associative loss. Moreover, these effects upon associations were reasonably stable in the sense that they left asymptotic differences in the strength of associations after extinction. Together with previous findings, these results point to an important role for the US representation in the performance and learning which occurs during extinction.     

Timing of fear expression in trace and delay conditioning measured by fear-potentiated startle in rats

In two experiments, the time course of the expression of fear in trace (hippocampus-dependent) versus delay (hippocampus-independent) conditioning was characterized with a high degree of temporal specificity using fear-potentiated startle. In experiment 1, groups of rats were given delay fear conditioning or trace fear conditioning with a 3- or 12-sec trace interval between conditioned stimulus (CS) offset and unconditioned stimulus (US) onset. During test, the delay group showed fear-potentiated startle in the presence of the CS but not after its offset, whereas the trace groups showed fear-potentiated startle both during the CS and after its offset. Experiment 2 compared the time course of fear expression after trace conditioning with the time course in two delay conditioning groups: one matched to the trace conditioning group with respect to CS duration, and the other with respect to ISI. In all groups, fear was expressed until the scheduled occurrence of the US and returned to baseline rapidly thereafter. Thus, in both trace and delay fear conditioning, ISI is a critical determinant of the time course of fear expression. These results are informative as to the possible role of neural structures, such as the hippocampus, in memory processes related to temporal information.     

Post-training ethanol disrupts trace conditioned fear in rats: effects of timing of ethanol, dose and trace interval duration

Ethanol has complex effects on memory performance, although hippocampus-dependent memory may be especially vulnerable to disruption by acute ethanol intoxication occurring during or shortly after a training episode. In the present experiments, the effects of post-training ethanol on delay and trace fear conditioning were examined in adolescent rats. In Experiment 1, 30-day-old Sprague-Dawley rats were given delay or trace conditioning trials in which a 10s flashing light CS was paired with a 0.5 mA shock US. For trace groups, the trace interval was 10 s. On days 31-33, animals were administered ethanol once daily (0.0 or 2.5 g/kg via intragastric intubation), and on day 34 animals were tested for CS-elicited freezing. Results showed that post-training ethanol affected the expression of trace, but had no effect on delay conditioned fear. Experiment 2 revealed that this effect was dose-dependent; doses lower than 2.5 g/kg were without effect. Experiment 3 evaluated whether proximity of ethanol to the time of training or testing was critical. Results show that ethanol administration beginning 24h after training was more detrimental to trace conditioned freezing than administration that was delayed by 48 h. Finally, in Experiment 4 animals were trained with one of three different trace intervals: 1, 3 or 10s. Results indicate that post-training administration of 2.5 g/kg ethanol disrupted trace conditioned fear in subjects trained with a 10s, but not with a 1 or 3s, trace interval. Collectively the results suggest that ethanol administration impairs post-acquisition memory processing of hippocampus-dependent trace fear conditioning.     

Both trace and delay conditioning of evaluative responses depend on contingency awareness

Whereas previous evaluative conditioning (EC) studies produced inconsistent results concerning the role of contingency knowledge, there are classical eye-blink conditioning studies suggesting that declarative processes are involved in trace conditioning but not in delay conditioning. In two EC experiments pairing neutral sounds (conditioned stimuli; CSs) with affective pictures (unconditioned stimuli; USs), we tested whether the type of conditioning procedure affects the relationship between awareness and EC. Auditory CSs and visual USs were either overlapping and co-terminating (Delay Conditioning Group), or they were separated by a short temporal gap (Trace Conditioning Group). In both groups, contingency awareness was manipulated by varying the duration at which the US was presented during conditioning. Furthermore, in addition to a post-conditioning measure of awareness, US detectability was measured concurrently during the learning phase in Experiment 2. US exposure duration affected both measures of awareness. The data of both experiments demonstrate that EC does not occur if the USs are presented at very brief durations, but reliable EC effects can be observed at longer US exposure durations. As there were no differences between trace and delay conditioning, the data suggest that contingency awareness plays a crucial role in trace and in delay conditioning of evaluative responses. These results challenge automatic association-formation accounts of EC, but they are in line with ‘single-process’ accounts assuming EC to be dependent on conscious declarative knowledge about CS–US contingencies.     

Trace decay and the priming of short-term memory in long-delay taste aversion learning: Disruptive effects of novel exteroceptive stimulation

A variation of Kalat and Rozin's two-presentation paradigm was used to test the hypothesis that the first, as opposed to the second, presentation of a flavor conditioned stimulus (CS) constitutes the functional CS in two-presentation experiments involving moderate interflavor intervals (IFIs), and results in flavor aversions that are a function of the primary, as opposed to the secondary, conditioned stimulus-unconditioned stimulus (CS-US) interval. Contrary to the hypothesis, it was shown in Experiment 1 that holding the primary CS-US interval constant at 4 hr for each of three groups, while decreasing the secondary CS-US interval (i.e., the interval between the second flavor presentation and the illness) from 3.75 hr to 2.5 hr to .5 hr, resulted in the flavor aversion increasing as the secondary CS-US interval decreased. However, the aversion acquired by the group with a 0.5 hr secondary CS-US interval was also found to be significantly weaker than that acquired by a single-presentation 0.5 hr control group. In Experiment 2 it was demonstrated that animals exposed to novel exteroceptive stimulation (NES) immediately prior to a second flavor presentation that preceded the US by 0.5 hr acquired an aversion as strong as that acquired by a 0.5-hr control group. In Experiment 3 it was demonstrated that, in the absence of a second flavor presentation, animals exposed to novel exteroceptive stimulation 0.5 hr prior to the US acquired a weaker flavor aversion than did animals not exposed to novel exteroceptive stimulation during the 4-hr flavor CS-illness US interval. The contrasting effects of novel exteroceptive stimulation observed in Experiments 2 and 3 were replicated in Experiment 4. The results suggest, consistent with the trace-decay hypothesis and Wagner's (1976) general model of stimulus processing, that exposure to novel exteroceptive stimulation disrupts continued processing of the short-term memory (STM) trace of the initial presentation of a flavor CS, and hence minimizes stimulus preexposure effects attributable to the priming of STM.     

Mechanisms of second-order conditioning with a backward conditioned stimulus

Five conditioned suppression experiments with rats examined the conditions under which backward pairings endow a first-order conditioned stimulus (CS1) with the ability to serve as a secondary reinforcer. Experiments 2-5B found evidence for excitatory second-order conditioning (SOC) if, during first-order pairings, the US-CS1 interval was 0 s rather than 3 s. Levels of SOC were comparable after forward and backward pairings (Experiments 1-3), and were unaffected by extinction of CS1 after SOC (Experiment 3). These results suggest that forward and backward CS1s support SOC for the same reason, and they call into question the need to invoke any special mechanism such as memory integration.     

A role for CS-US contingency in Pavlovian conditioning

Two experiments evaluated the role of conditioned stimulus-unconditioned stimulus (CS-US) contingency in appetitive Pavlovian conditioning in rats. In both experiments, some groups received a positively contingent CS signaling an increased likelihood of the US relative to the absence of the CS. These groups were compared with control treatments in which the likelihood of the US was the same in the presence and absence of the CS. A trial marker served as a trial context. Experiment 1 found contingency sensitivity. There was a reciprocal relationship between responding to the CS and the trial marker. Experiment 2 showed that this result was not stimulus or response specific. These results are consistent with associative explanations and the idea that rats are sensitive to CS-US contingency.     

Conditioned stimulus informativeness governs conditioned stimulus-unconditioned stimulus associability

In a conditioning protocol, the onset of the conditioned stimulus ([CS]) provides information about when to expect reinforcement (unconditioned stimulus [US]). There are two sources of information from the CS in a delay conditioning paradigm in which the CS-US interval is fixed. The first depends on the informativeness, the degree to which CS onset reduces the average expected time to onset of the next US. The second depends only on how precisely a subject can represent a fixed-duration interval (the temporal Weber fraction). In three experiments with mice, we tested the differential impact of these two sources of information on rate of acquisition of conditioned responding (CS-US associability). In Experiment 1, we showed that associability (the inverse of trials to acquisition) increased in proportion to informativeness. In Experiment 2, we showed that fixing the duration of the US-US interval or the CS-US interval or both had no effect on associability. In Experiment 3, we equated the increase in information produced by varying the C/T ratio with the increase produced by fixing the duration of the CS-US interval. Associability increased with increased informativeness, but, as in Experiment 2, fixing the CS-US duration had no effect on associability. These results are consistent with the view that CS-US associability depends on the increased rate of reward signaled by CS onset. The results also provide further evidence that conditioned responding is temporally controlled when it emerges.     

The Topography of Sexually Conditioned Behaviour: Effects of a Trace Interval

In a trace conditioning procedure, subjects were presented with a 30-sec conditioned stimulus (CS) followed by a 30-sec trace interval. Delayed conditioning consisted of a 60-sec CS presentation followed by an unconditioned stimulus (US). Although conditioning developed with both procedures, the topography of the conditioned response differed. Sexual conditioned approach was evident in all of the subjects during the presentation of the CS. Traceconditioned subjects moved away from the area where the CS had been presented during the trace interval but remained closer to the CS location than did an unpaired control. This reduction in the spatial specificity of the conditioned response was interpreted from a behaviour systems perspective. The trace interval presumably increased the perceived separation between the CS and the US and therefore elicited conditioned behaviour less specifically directed towards the CS.     

Effects of Early Hippocampal Lesions on Trace, Delay, and Long-Delay Eyeblink Conditioning in Developing Rats

The effects of bilateral hippocampal aspiration lesions on later acquisition of eyeblink conditioning were examined in developing Long-Evans rat pups. Lesions on postnatal day (PND) 10 were followed by evaluation of trace eyeblink conditioning (Experiment 1) and delay eyeblink conditioning (Experiment 2) on PND 25. Pairings of a tone conditioned stimulus (CS) and periocular shock unconditioned stimulus (US, 100 ms) were presented in one of three conditioning paradigms: trace (380 ms CS, 500 ms trace interval, 880 ms interstimulus interval [ISI]), standard delay (380 ms CS, 280 ms ISI), or long delay (980 ms CS, 880 ms ISI). The results of two experiments indicated that hippocampal lesions impaired trace eyeblink conditioning more than either type of delay conditioning. In light of our previous work on the ontogeny of trace, delay, and long-delay eyeblink conditioning (Ivkovich, Paczkowski, & Stanton, 2000) showing that trace and long-delay eyeblink conditioning had similar ontogenetic profiles, the current data suggest that during ontogeny hippocampal maturation may be more important for the short-term memory component than for the long-ISI component of trace eyeblink conditioning. The late development of conditioning over long ISIs may depend on a separate process such as protracted development of cerebellar cortex.     

Temporal coding in conditioned inhibition: analysis of associative structure of inhibition

Two experiments with rats as subjects were conducted to investigate the associative structure of temporal control of conditioned inhibition through posttraining manipulation of the training excitor-unconditioned stimulus (US) temporal relationship. Experiment 1 found that following simultaneous Pavlovian inhibition training (i.e., A --> US/XA-no US) in which a conditioned stimulus (CS A) was established as a delay excitor, maximal inhibition was observed on a summation test when CS X was compounded with a delay transfer CS. Furthermore, posttraining shifts in the A-US temporal relationship from delay to trace resulted in maximal inhibition of a trace transfer CS. Experiment 2 found complementary results to Experiment 1 with an A-US posttraining shift from serial to simultaneous. These results suggest that temporal control of inhibition is mediated by the training excitor-US temporal relationship.     

Effects of contingency violations on the extinction of a conditioned fear inhibitor and a conditioned fear excitor

Rats were used in a conditioned-suppression paradigm to assess the effects of contingency variations on responding to a conditioned inhibitor (CS-) and a conditioned excitor (CS+). In Experiment 1, various unconditioned stimulus (US) frequencies were equated across the presence and absence of a CS- in the context of either background cues (continuous-trial procedure) or an explicit neutral event (discrete-trial procedure). With both procedures, a CS-alone treatment enhanced inhibition, whereas treatments involving 50% or 100% reinforcement for the CS- eliminated inhibition without conditioning excitation to that CS. The latter outcome also occurred in Experiment 2, with discrete-trial training equating considerably reduced US frequencies for the presence and absence of the CS-. In further evidence that inhibition was eliminated without conditioning excitation to the CS-, Experiment 3 showed that a novel CS did not acquire excitation when 25%, 50%, or 100% reinforcement was equated across the presence and absence of that CS in the context of a discrete-trial event. Using the procedures of Experiment 1, Experiment 4 showed that a CS+ was extinguished by a CS-alone treatment but was substantially maintained by treatments involving 50% or 100% uncorrelated reinforcement. These effects for a CS+ and a CS- implicate CS-US contiguity, rather than contingency, as the factor determining the extinction of a CS.     

Timed excitatory conditioning under zero and negative contingencies

Rats (rattus norvegicus) anticipated the arrival of a food pellet unconditioned stimulus (US) even when the conditioned stimulus (CS) signaled no overall change or a substantial decrease in the overall rate of US occurrence. Pellet USs were scheduled probabilistically in the intertrial interval at either an equivalent rate (Experiment 1) or a four times higher rate (Experiments 2 and 3) than in the CS, which included one fixed-time target US. Conditioning has been said to involve learning "whether" (contingency) the CS signals a change in the US, and if so, "when" (contiguity) the US is scheduled to arrive. Our results suggest that "when" trumps "whether," challenging the received view that a positive CS-US contingency is necessary for successful conditioning.     

Pharmacological dissociation of trace and long-delay fear conditioning in young rats

In most studies comparing trace and delay conditioning, CS duration is kept constant across training conditions but the interstimulus interval (ISI), the time from CS onset to US onset, is confounded. In the infrequently used long-delay condition, however, ISI is kept constant across the trace and delay conditions but CS duration varies. A recent study reported that trace and long-delay fear conditioning have the same developmental trajectory, with both emerging later in development than standard-delay conditioning (). Past studies have shown that trace conditioning is mediated by the cholinergic system; given the parallel developmental emergence of trace and long-delay conditioning, the present study examined whether the cholinergic system also mediates long-delay conditioning. Two experiments, both involving Sprague-Dawley-derived rats and using freezing as a measure of learned fear, showed that the cholinergic system is critically involved in trace conditioning but is not involved in long-delay conditioning. Specifically, pre-training injections of the muscarinic receptor antagonist scopolamine impaired acquisition of a CS-US association in 32-day-old rats trained with a trace procedure but had no effect on rats this age trained with a long-delay procedure (Experiment 1). Similarly, pre-training injections of physostigmine, a cholinesterase inhibitor, enhanced acquisition of trace conditioning in 25-day-old rats but had no effect on long-delay conditioning in rats this age (Experiment 2). Taken together, the results indicate that despite the similarities between trace and long-delay conditioning in terms of developmental emergence and level of conditioned responding, they are mediated by different physiological systems.     

Manipulation of CS-US conditional probability and of the US-US trace interval on conditioning to the CS and to a background stimulus in a CER situation

Two experiments examined the relationship between conditioning to the CS and background using a novel CER paradigm, in which a long background stimulus played the role of more conventional contextual cues. Experiment 1 manipulated the probability of US occurrence given the CS (p(US/CS)). Conditioning to the background was not a monotonically decreasing function of p(US/CS) at all shock intensities, and conditioning to the CS was remarkably insensitive to the value of p(US/CS) when assessed off the baseline. Experiment 2 manipulated the trace interval between the CS and US. Although conditioning to the CS decreased as the trace interval increased, conditioning to the background was dependent upon whether it served as the interstimulus interval (ISI; interval between the CS and US) or intertrial interval (ITI; interval between CS-US pairs) stimulus. Conditioning to the ISI background decreased as the trace interval increased, but conditioning to the ITI background at first increased, but then decreased as the trace interval was further increased. These results are discussed with respect to the adequacy of contemporary models of conditioning.     

The Influence of Retention Interval on the US Preexposure Effect: Changes in Contextual Blocking over Time

A number of studies manipulating the length of the interval between conditioning and testing indicate spontaneous recovery from overshadowing, suggesting that certain instances of overshadowing represent a deficit in memory retrieval rather than a failure of animals to form an association between the overshadowed stimulus and the US. The present series of experiments examined the influence of lengthening the retention interval on blocking, another stimulus selection phenomenon that is typically interpreted as an acquisition deficit. The results indicated that when subjects were tested shortly (3 days) after training conditioning to a taste blocked subsequent conditioning to an odor conditioned in compound with that taste (Experiment 1), whereas prior conditioning to an odor did not block subsequent conditioning to a taste conditioned in compound with that odor (Experiment 2). This pattern of results was essentially unchanged when testing occurred at a longer (21-day) retention interval. However, there was evidence of a US preexposure effect in Experiment 2 when subjects in the US ONLY control condition were tested at the 3-day retention interval, but not when testing occurred 21 days after conditioning. Experiments 3 and 4 examined whether this loss of the US preexposure effect over time might actually represent a change in the degree of contextual blocking as the retention interval is lengthened. Exposure to the conditioning context either during the interval between Phase 1 and Phase 2 of conditioning (Experiment 3) or prior to Phase 1 of conditioning (Experiment 4) alleviated this US preexposure effect suggesting that the loss of the US preexposure effect as the retention interval is lengthened observed in Experiment 2 is due to changes in the degree of blocking by contextual stimuli over time. The results are discussed in terms of differential susceptibility of forgetting of two functional roles played by a contextual stimuli in the current situation-context as a CS and context as a retrieval cue for other CS-US associations.