Response rates track the history of reinforcement times

When conditioning involves a consistent temporal relationship between the conditioned stimulus (CS) and unconditioned stimulus (US), the expression of conditioned responses within a trial peaks at the usual time of the US relative to the CS. Here we examine the temporal profile of responses during conditioning with variable CS-US intervals. We conditioned stimuli with either uniformly distributed or exponentially distributed random CS-US intervals. In the former case, the frequency of each CS-US interval within a specified range is uniform but the momentary probability of the US (the hazard function) increases as time elapses during the trial; with the latter distribution, short CS-US intervals are more frequent than longer intervals, but the momentary probability of the US is constant across time within the trial. We report that, in a magazine approach paradigm, rats' response rates remained stable as time elapses during the CS when the CS-US intervals were uniformly distributed, whereas their response rates declined when the CS-US intervals were exponentially distributed. In other words, the profile of responding during the CS matched the frequency distribution of the US times, not the momentary probability of the US during the CS. These results are inconsistent with real-time associative models, which predict that associative strength tracks the momentary probability of the US, but may provide support for timing models of conditioning in which conditioned responding is tied to remembered times of reinforcement.     

Attenuation of age-related conditioning deficits in humans by extension of the interstimulus interval

Young (17-22 years) and older (61-86 years) persons underwent classical conditioning of the eye-blink response to a tone conditioned stimulus (CS) and an airpuff unconditioned stimulus (UCS) at 1 of 3 interstimulus intervals (ISIs; 400, 650, and 900 ms). As in a previous study, older subjects conditioned more slowly and emitted fewer conditioned responses at the optimal 400-ms ISI. At longer ISIs, however, this age-related disruption of classical conditioning was attenuated. These differences in conditioning were not due to nonassociative factors, such as sensitivity to the tone CS or airpuff UCS or to differences in spontaneous blink rate, nor were they due to differences in general cognitive abilities. The results are discussed in terms of the role of temporal relationships between stimuli in conditioning across the life span.     

Stimulus and temporal cues in classical conditioning

In 2 experiments, separate groups of rats were given stimulus conditioning, temporal conditioning, untreated control and (in Experiment 2) learned irrelevance control procedures, followed by a compound with both stimulus and temporal cues. Stimulus conditioning consisted of a random 15-s duration conditioned stimulus (CS) followed by food; temporal conditioning consisted of food-food intervals of fixed 90 s (Experiment 1) or fixed 75 + random 15 s (Experiment 2). The stimulus group abruptly increased responding after CS onset, and the temporal group gradually increased responding over the food-food interval. When the food-food interval was fixed 90 s, the temporal cue exerted stronger control in the compound, whereas when the food-food interval was fixed 75 + random 15 s, the stimulus cue exerted stronger control. The strength of conditioning, temporal gradients of responding, and cue competition effects appear to reflect simultaneous timing of multiple intervals.     

Classical conditioning as a nonstationary,multivariate time series analysis: A spreadsheet model

The implementation of the Gallistel (1990) model of classical conditioning on a spreadsheet with matrix operations is described. The model estimates the Poisson rate of unconditioned stimulus (US) occurrence in the presence of each conditioned stimulus (CS). The computations embody three implicit principles:additivity (of the rates predicted by each CS),provisional stationarity (the rate predicted by a given CS has been constant over all the intervals when that CS was present), andpredictor minimization (when more than one solution is possible, the model minimizes the number of CSs with a nonzero effect on US rate). The Kolmogorov-Smirnov statistic is used to test for non-stationarity. There are no free parameters in the learning model itself and only two parameters in the formally specified decision process, which translates what has been leamed into conditioned responding. The model predicts a wide range of conditioning phenomena, notably: blocking, overshadowing, overprediction, predictive sufficiency, inhibitory conditioning, latent inhibition, the invariance in the rate of conditioning under scalar transformation of CS-US and US-US intervals, and the effects of partial reinforcement on acquisition and extinction.     

The importance of contextual elements in taste-aversion learning

The effect of exteroceptive contextual cues, presented during the conditioned stimulus (CS) and unconditioned stimulus (US) intervals, upon the later development of conditioned saccharin aversions was studied in two experiments. It was found that the presence of the contextual cues during the CS + US and CS intervals resulted in a greater degree of saccharin aversion; the presence of these cues during the US interval was relatively less important. These findings are discussed in terms of conditioning models and retrieval models derived from animal learning and human information-processing data.     

Overshadowing of subsequent events and recovery thereafter

Four experiments using a conditioned lick suppression preparation with rats were conducted to examine whether overshadowing of subsequent events could be obtained in Pavlovian backward conditioning (i.e. unconditioned stimulus [US] before conditioned stimulus [CS]), and to determine whether such overshadowing could be reversed without further training with the overshadowed CS, as has been reported in overshadowing of antecedent events. In Experiment 1, a backward-conditioned CS overshadowed a second backward-conditioned CS. Two posttraining manipulations, extinction of the overshadowing CS (Experiment 2) and shifting of the temporal relationship of the overshadowing CS to the US (Experiment 3), increased responding to the overshadowed CS. These results constitute the first unambiguous demonstration of stimulus competition between subsequent events using first-order conditioning, and they show that, like overshadowing with forward conditioning, such overshadowing is due, at least in part if not completely, to a failure to express information that had been acquired.     

Eye-blink conditioning is associated with changes in synaptic ultrastructure in the rabbit interpositus nuclei

Eye-blink conditioning involves the pairing of a conditioned stimulus (usually a tone) to an unconditioned stimulus (air puff), and it is well established that an intact cerebellum and interpositus nucleus, in particular, are required for this form of classical conditioning. Changes in synaptic number or structure have long been proposed as a mechanism that may underlie learning and memory, but localizing these changes has been difficult. Thus, the current experiment took advantage of the large amount of research conducted on the neural circuitry that supports eye-blink conditioning by examining synaptic changes in the rabbit interpositus nucleus. Synaptic quantifications included total number of synapses per neuron, numbers of excitatory versus inhibitory synapses, synaptic curvature, synaptic perforations, and the maximum length of the synapses. No overall changes in synaptic number, shape, or perforations were observed. There was, however, a significant increase in the length of excitatory synapses in the conditioned animals. This increase in synaptic length was particularly evident in the concave-shaped synapses. These results, together with previous findings, begin to describe a sequence of synaptic change in the interpositus nuclei following eye-blink conditioning that would appear to begin with structural change and end with an increase in synaptic number.     

Neural circuitry and plasticity mechanisms underlying delay eyeblink conditioning

Pavlovian eyeblink conditioning has been used extensively as a model system for examining the neural mechanisms underlying associative learning. Delay eyeblink conditioning depends on the intermediate cerebellum ipsilateral to the conditioned eye. Evidence favors a two-site plasticity model within the cerebellum with long-term depression of parallel fiber synapses on Purkinje cells and long-term potentiation of mossy fiber synapses on neurons in the anterior interpositus nucleus. Conditioned stimulus and unconditioned stimulus inputs arise from the pontine nuclei and inferior olive, respectively, converging in the cerebellar cortex and deep nuclei. Projections from subcortical sensory nuclei to the pontine nuclei that are necessary for eyeblink conditioning are beginning to be identified, and recent studies indicate that there are dynamic interactions between sensory thalamic nuclei and the cerebellum during eyeblink conditioning. Cerebellar output is projected to the magnocellular red nucleus and then to the motor nuclei that generate the blink response(s). Tremendous progress has been made toward determining the neural mechanisms of delay eyeblink conditioning but there are still significant gaps in our understanding of the necessary neural circuitry and plasticity mechanisms underlying cerebellar learning.     

Undernutrition during the brain growth period of the rat significantly delays the development of processes mediating Pavlovian trace conditioning

Pavlovian trace conditioning procedures allow one to assess the ability of animals to associate events that are temporally separated because the conditioned stimulus terminates prior to the occurrence of the unconditioned stimulus. We report that undernutrition during Postnatal Days 2-18 significantly delays the development of trace conditioning to a visual stimulus. Previously undernourished 20-day-old rats conditioned when no temporal interval separated the termination of the CS and US onset (0-s trace interval). However, it was not until the undernourished pups were 30 days old that they conditioned when the trace interval was 10 or 30 s. In contrast, control pups only 20 days old were able to condition when a 10-s trace interval separated the CS and US events, and 25-day-old control pups conditioned when the interval was either 10 or 30 s. These results suggest that undernutrition delays the development of processes that enable the rat to sustain a representation of a visual CS during the trace interval.     

Some types of conditioned inhibitors carry collateral excitatory associations

Two experiments using summation tests in conditioned suppression with rats examined whether conditioned inhibitors generated by five different conditioning procedures have an associative structure which includes collateral excitatory associations. The existence of collateral conditioned excitation was inferred from an increase in the amount of manifest conditioned inhibition after a conditioned inhibitory stimulus (CS-) extinction treatment. The five CS-s evaluated were differential, explicitly unpaired, conditional, backward, and trace. With abbreviated conditioning (Experiment 1), the differential and explicitly unpaired CS-s exhibited conditioned inhibitory properties; the conditional, backward, and trace CS-s did not. Repeated extinction presentations of the CS- in the absence of the unconditioned stimulus unmasked conditioned inhibition to the conditional, backward, and trace CS-s revealing moderate degrees of conditioned inhibition for all five CS-s. After more extensive conditioning (Experiment 2), the explicitly unpaired and conditional CS-s were strongly inhibitory and the differential and trace CS-s were moderately inhibitory. The backward CS- was not inhibitory. Repeated presentations of the CS- in extinction unmasked conditioned inhibition to trace and backward CS-s. All five CS-s were now nearly equally inhibitory. That the measured inhibitory power of backward, trace, and conditional (after few trials) CS-s can be modulated by a CS- extinction treatment suggests that they have similar associative structures and carry, in addition to inhibitory associations, collateral excitatory associations that mask the expression of conditioned inhibition.     

The comparator hypothesis of conditioned response generation: manifest conditioned excitation and inhibition as a function of relative excitatory strengths of CS and conditioning context at the time of testing

In the present research water-deprived rats were used in a conditioned lick suppression paradigm to test and further develop Rescorla's (1968) contingency theory, which posits that excitatory associations are formed when a conditioned stimulus (CS) signals an increase in unconditioned stimulus (US) likelihood and that inhibitory associations develop when the CS signals a decrease in US likelihood. In Experiment 1 we found that responding to a CS varied inversely with the associative status of the context in which the CS was trained and that this response was unaltered when testing occurred in a distinctively dissimilar context with a different conditioning history, provided associative summation with the test context was minimized. These results suggest that manifest excitatory and inhibitory conditioned responding is modulated by the associative value of the training context rather than that of the test context. In Experiment 2 it was demonstrated that postconditioning decreases in the associative value of the CS training context reduced the effective inhibitory value of the CS even when testing occurred outside of the training context. Moreover, this contextual deflation effect was specific to the CS training context as opposed to any other excitatory context. Collectively, these studies support the comparator hypothesis, which states that conditioned responding is determined by a comparison of the associative strengths of the CS and its training context that occurs at the time of testing rather than at the time of conditioning. This implies that all associations are excitatory and that responding indicative of conditioned inhibition reflects a CS-US association that is below (or near) the associative strength of its comparator stimulus. It is suggested that response rules which go beyond a monotonic relation between associative value and response strength can partially relieve learning theories of their explanatory burdens, thereby allowing for simpler models of acquisition.     

S-R associations, their extinction, and recovery in an animal model of anxiety: a new associative account of phobias without recall of original trauma

Associative accounts of the etiology of phobias have been criticized because of numerous cases of phobias in which the client does not remember a relevant traumatic event (i.e., Pavlovian conditioning trial), instructions, or vicarious experience with the phobic object. In three lick suppression experiments with rats as subjects, we modeled an associative account of such fears. Experiment 1 assessed stimulus-response (S-R) associations in first-order fear conditioning. After behaviorally complete devaluation of the unconditioned stimulus, the target stimulus still produced strong conditioned responses, suggesting that an S-R association had been formed and that this association was not significantly affected when the outcome was devalued through unsignaled presentations of the unconditioned stimulus. Experiments 2 and 3 examined extinction and recovery of S-R associations. Experiment 2 showed that extinguished S-R associations returned when testing occurred outside of the extinction context (i.e., renewal) and Experiment 3 found that a long delay between extinction and testing also produced a return of the extinguished S-R associations (i.e., spontaneous recovery). These experiments suggest that fears for which people cannot recall a cause are explicable in an associative framework, and indicate that those fears are susceptible to relapse after extinction treatment just like stimulus-outcome (S-O) associations.     

Learning in cod (Gadus morhua): long trace interval retention

Basic knowledge about learning capacities and awareness in fish is lacking. In this study we investigated which temporal gaps Atlantic cod could tolerate between two associated events, using an appetitive trace-conditioning paradigm with blinking light as conditioned stimulus (CS) and dry fish food as unconditioned stimulus (US). CS–US presentations were either temporally overlapping (delay conditioning, CS duration 24 s, interstimulus interval 12 s) or separated by 20, 60, or 120 s (trace conditioning, CS duration 12 s) or 2 h (control, CS duration 12 s). The percentage of fish in the feeding area increased strongly during CS presentation in all delay, 20 s, and 60 s trace groups and in one out of two 120 s trace groups, but not in the control groups. In the 20 and 60 s trace procedures, the fish crowded together in the small feeding area during the trace interval, showing strong anticipatory behaviour. In all the conditioned groups, the fish responded to the CS within eight trials, demonstrating rapid learning. At 88 and 70 days after the end of the conditioning experiments, the delay and 20 s trace groups, respectively, were presented the CS six times at 2-h intervals without reward. All groups responded to the light signal, demonstrating memory retention after at least 3 months. This study demonstrates that Atlantic cod has an impressively good ability to associate two time-separated events and long time retention of learnt associations.     

Within-compound associations between the context and the conditioned stimulus

Three experiments were conducted to test for the presence of associations between contextual cues and the nominal conditioned stimulus (CS) in fear conditioning. Rats were given tone-footshock pairings and were tested for their fear of the nominal CS, the tone, in a different context. Experiments 1 and 2 demonstrated that rats given nonreinforced exposure to the training context following conditioning were less fearful of the CS. Experiment 3 indicated that additional footshock presentations in the training context following conditioning produced greater fear of the CS. In both procedures postconditioning treatments designed to directly alter only the associative strength of the training context yielded parallel changes in the conditioned response to the CS. These data suggest that within-compound associations are formed between the context and the CS during classical conditioning.     

UCS revaluation and conditioning models of acquired fears

Recent developments in the study of Pavlovian conditioning in humans have suggested that the strength of a conditioned response (CR) is affected not only by associative processes that link the conditioned stimulus (CS) with the unconditioned stimulus (UCS), but also by processes which lead the individual to revalue the UCS itself. These latter processes can frequently lead to dramatic changes in CR strength independently of any experience with the CS-UCS contingency. This paper discusses a number of ways in which UCS revaluation can be effected in human subjects, and discusses their implications for conditioning models of acquired fears.     

Eyeblink classical conditioning: hippocampal formation is for neutral stimulus associations as cerebellum is for association-response

Extensive evidence has been amassed that the cerebellum, hippocampus, and associated circuitry are activated during classical conditioning of the nictitating membrane/eyeblink response. In this article, the authors argue that the cerebellum is essential to all eyeblink classical conditioning paradigms. In addition, the septohippocampal system plays a critical role when the classical conditioning paradigm requires the formation of associations in addition to the simple association between the conditioned and unconditioned stimuli. When only a simple conditioned stimulus--unconditioned stimulus association is needed, the septohippocampal system has a more limited, modulatory role. The neutral stimulus association versus simple association-response distinction is one of the ways in which declarative or relational memory can be separated from nondeclarative or nonrelational memory in classical conditioning paradigms.     

Temporal specificity of fear conditioning: effects of different conditioned stimulus-unconditioned stimulus intervals on the fear-potentiated startle effect

Separate groups of rats were given 30 pairings of a light (conditioned stimulus, CS) and 500-ms shock (unconditioned stimulus, US) at CS-US intervals of 0, 25, 50, 100, 200, 800, 3,200, 12,800, or 51,200 ms. Other groups had lights and shocks inconsistently paired. The startle reflex was elicited 2-4 days later with a noise burst alone or 25-51,200 ms after light onset. After CS-US pairings over a wide range of intervals (25-51,200 ms), startle was potentiated in testing, sometimes as rapidly as 50 ms after light onset. Magnitude of potentiation and resistance to extinction were generally greater with longer CS-US intervals. In several groups, potentiation was maximal at a test interval that matched the CS-US interval used in training. This temporal specificity sharpened with increasing numbers of training trials but even occurred with a single training trial in which a 51,200-ms CS-US interval was used. The data indicate that even during simple fear conditioning, animals rapidly learn a temporal CS-US relationship. This has important implications for understanding the neural mechanisms of fear conditioning.     

Auditory specific fear conditioning results in increased levels of synaptophysin in the basolateral amygdala

Auditory fear conditioning is one of the most well characterized models used in studies of learning and memory. In order to ensure the animals have been conditioned to fear the auditory stimulus, animals are generally tested for their response to this stimulus in a different context to that used for training. For this reason it is often unclear how much contextual fear conditioning the animals also acquire when they are trained. In this study, we have established a protocol for fear conditioning in mice which is explicit for auditory cues; mice trained using this protocol, show a very low fear response to contextual cues encountered during training. We have undertaken analysis to look for potential brain changes associated with this model by measuring levels of the synaptic vesicle protein, synaptophysin, in the basolateral nuclei of the amygdala following auditory fear conditioning. Our results show levels of synaptophysin were significantly higher in mice which learnt to associate the auditory stimulus with fear, in comparison to all non-learning control animals. These findings support the idea that synaptic plasticity associated with formation of fear conditioning to a single specific conditioned stimulus occurs within the basolateral nuclei of the amygdala. Furthermore, our results demonstrate the usefulness of this model in looking for changes in the brain specific for a defined learning event.     

Mediodorsal thalamic lesions impair trace eyeblink conditioning in the rabbit

Rabbits received lesions of the mediodorsal nucleus of the thalamus (MDN) or sham lesions and were subjected to classical eyeblink (EB) and heart rate (HR) conditioning. All animals received trace conditioning, with a.5-sec tone conditioned stimulus, a .5-sec trace period, and a 50-msec periorbital shock unconditioned stimulus. Animals with MDN lesions acquired the EB conditioned response (CR) more slowly than sham-lesioned animals. However, previous studies have shown that MDN damage does not affect delay conditioning using either .5-sec or 1-sec interstimulus intervals. The lesions had no significant effect on the HR CR. These results suggest that information processed by MDN and relayed to the prefrontal cortex is required for somatomotor response selection under nonoptimal learning conditions.     

Contextual Fear after Signalled versus Unsignalled Shocks: Effect of Extent of Prior Experience with Context and Signal

In the first two experiments, rats were differentially familiarized with a discrete stimulus and/ or a context prior to receiving either shocks signalled by that stimulus or unsignalled shocks in that context. As indexed by freezing, in none of the pre-exposure conditions did the signalled-shock rats consistently acquire less contextual fear than the unsignalled-shock animals. Both pre-exposure to the stimulus and relatively short pre-exposure to the future conditioning context resulted in more contextual fear in the signalled-shock than in the unsignalled-shock subjects. In a third experiment, freezing in the target conditioning context was especially enhanced in rats that had been familiarized with a stimulus, conditioned with the stimulus as a signal for shock, and subsequently further conditioned to the stimulus in a different, non-target context. The level of freezing to the stimulus in a neutral test context was positively related to the level of freezing in the target conditioning context in all experiments. These results were discussed in terms of context-shock, stimulus-shock, and context-stimulus associations.