Timing at the Start of Associative Learning

Some theories of associative learning imply that time plays a fundamental role in the acquisition process. Consistent with these theories, this paper presents evidence that the time from the onset of a conditioned stimulus (CS) until presentation of the unconditioned stimulus (US) is learned very rapidly at the start of training. We report two autoshaping studies and a study on aversive conditioning in goldfish in which we examine timing at the start of conditioning. We also review data from a number of other conditioning preparations, including fear-potentiated startle, appetitive conditioning in rats, and eyeblink conditioning in rabbits, that report conditioned response (CR) timing early in training. Acquisition speed and the very first expressions of conditioned responding often show sensitivity to the time of US presentation. In instances where temporal control is slowly expressed, it is likely due to performance factors, not to slow learning about time. In fact, the learning about time may be a necessary condition for associative learning.     

Mediodorsal thalamic lesions impair trace eyeblink conditioning in the rabbit

Rabbits received lesions of the mediodorsal nucleus of the thalamus (MDN) or sham lesions and were subjected to classical eyeblink (EB) and heart rate (HR) conditioning. All animals received trace conditioning, with a.5-sec tone conditioned stimulus, a .5-sec trace period, and a 50-msec periorbital shock unconditioned stimulus. Animals with MDN lesions acquired the EB conditioned response (CR) more slowly than sham-lesioned animals. However, previous studies have shown that MDN damage does not affect delay conditioning using either .5-sec or 1-sec interstimulus intervals. The lesions had no significant effect on the HR CR. These results suggest that information processed by MDN and relayed to the prefrontal cortex is required for somatomotor response selection under nonoptimal learning conditions.     

Timing of conditioned responses utilizing electrical stimulation in the region of the interpositus nucleus as a CS

A large body of evidence indicates that the cerebellum is essential for the acquisition, retention, and expression of the standard delay conditioned eyeblink response and that the basic memory trace appears to be established in the anterior interpositus nucleus (IP). Adaptive timing of the conditioned response (CR) is a prominent feature of classical conditioning—the CR peaks at the time of onset of the unconditioned stimulus (US) over a wide range of CS-US interstimulus intervals (ISI). A key issue is whether this timing is established by the cerebellar circuitry or prior to the cerebellum. In this study timing of conditioned eyeblink responses established via electrical stimulation of the interpositus nucleus as a conditioned stimulus (CS) was analyzed prior to and following modification of the CS-US interval in well-trained rabbits. Consistent with previous results, learning under these conditions is very rapid and robust. The CR peak eyeblink latencies are initially timed to the US onset and adjust accordingly to lengthening or shortening of the CS-US interval, just as with peripheral CSs. The acquisition of conditioned eyeblink responses by direct electrical stimulation of the IP as a CS thus retains temporal flexibility following shifts in the CS-US delay, as found in standard classical eyeblink conditioning procedures.     

Timing of Conditioned Responses Utilizing Electrical Stimulation in the Region of the Interpositus Nucleus as a CS

A large body of evidence indicates that the cerebellum is essential for the acquisition, retention, and expression of the standard delay conditioned eyeblink response and that the basic memory trace appears to be established in the anterior interpositus nucleus (IP). Adaptive timing of the conditioned response (CR) is a prominent feature of classical conditioning-the CR peaks at the time of onset of the unconditioned stimulus (US) over a wide range of CS-US interstimulus intervals (ISI). A key issue is whether this timing is established by the cerebellar circuitry or prior to the cerebellum. In this study timing of conditioned eyeblink responses established via electrical stimulation of the interpositus nucleus as a conditioned stimulus (CS) was analyzed prior to and following modification of the CS-US interval in well-trained rabbits. Consistent with previous results, learning under these conditions is very rapid and robust. The CR peak eyeblink latencies are initially timed to the US onset and adjust accordingly to lengthening or shortening of the CS-US interval, just as with peripheral CSs. The acquisition of conditioned eyeblink responses by direct electrical stimulation of the IP as a CS thus retains temporal flexibility following shifts in the CS-US delay, as found in standard classical eyeblink conditioning procedures.     

Reversal of motor learning in the vestibulo-ocular reflex in the absence of visual input

Motor learning in the vestibulo-ocular reflex (VOR) and eyeblink conditioning use similar neural circuitry, and they may use similar cellular plasticity mechanisms. Classically conditioned eyeblink responses undergo extinction after prolonged exposure to the conditioned stimulus in the absence of the unconditioned stimulus. We investigated the possibility that a process similar to extinction may reverse learned changes in the VOR. We induced a learned alteration of the VOR response in rhesus monkeys using magnifying or miniaturizing goggles, which caused head movements to be accompanied by visual image motion. After learning, head movements in the absence of visual stimulation caused a loss of the learned eye movement response. When the learned gain was low, this reversal of learning occurred only when head movements were delivered, and not when the head was held stationary in the absence of visual input, suggesting that this reversal is mediated by an active, extinction-like process.     

Cortical barrel lesions impair whisker-CS trace eyeblink conditioning

Whisker deflection is an effective conditioned stimulus (CS) for trace eyeblink conditioning that has been shown to induce a learning-specific expansion of whisker-related cortical barrels, suggesting that memory storage for an aspect of the trace association resides in barrel cortex. To examine the role of the barrel cortex in acquisition and retrieval of trace eyeblink associations, the barrel cortex was lesioned either prior to (acquisition group) or following (retention group) trace conditioning. The acquisition lesion group was unable to acquire the trace conditioned response, suggesting that the whisker barrel cortex is vital for learning trace eyeblink conditioning with whisker deflection as the CS. The retention lesion group exhibited a significant reduction in expression of the previously acquired conditioned response, suggesting that an aspect of the trace association may reside in barrel cortex. These results demonstrate that the barrel cortex is important for both acquisition and retention of whisker trace eyeblink conditioning. Furthermore, these results, along with prior anatomical whisker barrel analyses suggest that the barrel cortex is a site for long-term storage of whisker trace eyeblink associations.     

Changing the rate and hippocampal dependence of trace eyeblink conditioning: slow learning enhances survival of new neurons

Trace eyeblink conditioning in which a conditioned stimulus and unconditioned stimulus are separated by a gap, is hippocampal dependent and can rescue new neurons in the adult dentate gyrus from death (e.g., Beylin et al., 2001; Gould et al., 1999). Tasks requiring more training trials for reliable expression of the conditioned response are most effective in enhancing survival of neurons (Waddell & Shors, 2008). To dissociate hippocampal dependence from acquisition rate, we facilitated hippocampal-dependent trace eyeblink conditioning in two ways: a shorter trace interval and signaling the intertrial interval with a post-US cue. Trace conditioning with a shorter trace interval (250ms) requires an intact hippocampus, and acquisition is faster relative to rats trained with a 500ms trace interval (e.g., Weiss et al., 1999). Using excitotoxic hippocampal lesions, we confirmed that eyeblink conditioning with the 250 or 500ms trace interval is hippocampal dependent. However, training with the post-US cue was not hippocampal dependent. The majority of lesion rats in this condition reached criterion of conditioned responding. To determine whether hippocampal dependence is sufficient to rescue adult-generated neurons in the dentate gyrus, rats were injected with BrdU and trained in one of the three trace eyeblink arrangements one week later. Of these training procedures, only the 500ms trace interval enhanced survival of new cells; acquisition of this task proceeded slowly relative to the 250ms and post-US cue conditions. These data demonstrate that rate of acquisition and not hippocampal dependence determines the impact of learning on adult neurogenesis.     

Effects of emotional valence and arousal manipulation on eyeblink classical conditioning and autonomic measures

Using a classical eyeblink conditioning paradigm, we have previously shown that the rate of acquisition of a conditioned response may be manipulated by engaging subjects in background tasks of varying complexity concurrent to conditioning. To further examine the influence of the background environment on conditioning, a picture set designed to elicit emotional responses, the International Affective Picture System (IAPS), was presented to subjects during classical eyeblink conditioning. The results suggest that eyeblink conditioning does appear to be sensitive to contextual manipulations of arousal. Pictures rated as very arousing were found to engage subjects enough to enhance learning, although not to the point that autonomic functions were significantly altered between picture groups. We suggest that group differences in learning may be a result of either novelty of, or vigilance to, interesting pictures rather than as a direct result of physiological arousal.     

Effects of Emotional Valence and Arousal Manipulation on Eyeblink Classical Conditioning and Autonomic Measures

Using a classical eyeblink conditioning paradigm, we have previously shown that the rate of acquisition of a conditioned response may be manipulated by engaging subjects in background tasks of varying complexity concurrent to conditioning. To further examine the influence of the background environment on conditioning, a picture set designed to elicit emotional responses, the International Affective Picture System (IAPS), was presented to subjects during classical eyeblink conditioning. The results suggest that eyeblink conditioning does appear to be sensitive to contextual manipulations of arousal. Pictures rated as very arousing were found to engage subjects enough to enhance learning, although not to the point that autonomic functions were significantly altered between picture groups. We suggest that group differences in learning may be a result of either novelty of, or vigilance to, interesting pictures rather than as a direct result of physiological arousal.     

Counterconditioning of appetitive and defensive CRs in rabbits

Two experiments examined interactions between conditioned appetitive and defensive responses in the rabbit. In Experiment I, a conditioned jaw-movement response was established by following presentations of a clicker CS with intra-oral sucrose delivery on 50% of trials. The jaw-movement response was then maintained on this partial reinforcement schedule during a counterconditioning phase. A group which received para-orbital shock paired with the CS on non-sucrose trials showed acquisition of eyeblink responding and suppression of jaw-movement responding to the CS, in comparison to control groups which received either no shock or unpaired presentations of the CS and shock. Experiment II was identical in design to Experiment I except that the roles of the sucrose and shock reinforcers were reversed. The paired group acquired a conditioned jaw-movement response when sucrose was added in the counterconditioning phase, but in contrast to Experiment I showed a slight enhancement of the previously established eyeblink response. The asymmetry of appetitive and defensive counterconditioning was discussed in relation to opponent-process theories of motivation and reinforcement.     

Fear develops to the conditioned stimulus and to the context during classical eyeblink conditioning in rats

In classical eyeblink conditioning, non-specific emotional responses to the aversive shock unconditioned stimulus (US), which are presumed to coincide with the development of fear, occur early in conditioning and precede the emergence of eyeblink responses. This twoprocess learning model was examined by concurrently measuring fear and eyeblink conditioning in the freely moving rat. Freezing served as an index of fear in animals and was measured during the inter-trial intervals in the training context and during a tone conditioned stimulus (CS) presented in a novel context. Animals that received CS-US pairings exhibited elevated levels of fear to the context and CS early in training that decreased over sessions, while eyeblink conditioned responses (CRs) developed gradually during acquisition and decreased during extinction. Random CS-US presentations produced a similar pattern of fear responses to the context and CS as paired presentations despite low eyeblink CR percentages, indicating that fear responding was decreased independent of high levels of learned eyeblink responding The results of paired training were consistent with two-process models of conditioning that postulate that early emotional responding facilitates subsequent motor learning, but measures from random control animals demonstrate that partial CS-US contingencies produce decrements in fear despite low levels of eyeblink CRs. These findings suggest, a relationship between CS-US contingency and fear levels during eyeblink conditioning, and may serve to clarify further the role that fear conditioning plays in this simple paradigm.     

Fear Develops to the Conditioned Stimulus and to the Context during Classical Eyeblink Conditioning in Rats

In classical eyeblink conditioning, non-specific emotional responses to the aversive shock unconditioned stimulus (US), which are presumed to coincide with the development of fear, occur early in conditioning and precede the emergence of eyeblink responses. This two-process learning model was examined by concurrently measuring fear and eyeblink conditioning in the freely moving rat. Freezing served as an index of fear in animals and was measured during the inter-trial intervals in the training context and during a tone conditioned stimulus (CS) presented in a novel context. Animals that received CS-US pairings exhibited elevated levels of fear to the context and CS early in training that decreased over sessions, while eyeblink conditioned responses (CRs) developed gradually during acquisition and decreased during extinction. Random CS-US presentations produced a similar pattern of fear responses to the context and CS as paired presentations despite low eyeblink CR percentages, indicating that fear responding was decreased independent of high levels of learned eyeblink responding. The results of paired training were consistent with two-process models of conditioning that postulate that early emotional responding facilitates subsequent motor learning, but measures from random control animals demonstrate that partial CS-US contingencies produce decrements in fear despite low levels of eyeblink CRs. These findings suggest a relationship between CS-US contingency and fear levels during eyeblink conditioning, and may serve to clarify further the role that fear conditioning plays in this simple paradigm.     

The prefrontal-thalamic axis and classical conditioning.

Using the New Zealand albino rabbit as an animal model, it has been determined that the medial prefrontal cortex is intimately involved in, and may be necessary for, acquisition of classically conditioned bradycardia. The interconnected nuclei of the medial thalamus, most notably the mediodorsal nucleus, conversely appear to be associated with the development of the tachycardia that accompanies classical conditioning of the eyeblink and nictitating membrane response. Neuroanatomical, electrophysiological, brain stimulation, and lesion data are reviewed, which support the conclusion that the prefrontal-thalamic axis is intimately involved in acquisition of classically conditioned visceral changes.     

The prefrontal-thalamic axis and classical conditioning

Using the New Zealand albino rabbit as an animal model, it has been determined that the medial prefrontal cortex is intimately involved in, and may be necessary for, acquisition of classically conditioned bradycardia. The interconnected nuclei of the medial thalamus, most notably the mediodorsal nucleus, conversely appear to be associated with the development of the tachycardia that accompanies classical conditioning of the eyeblink and nictitating membrane response. Neuroanatomical, electrophysiological, brain stimulation, and lesion data are reviewed, which support the conclusion that the prefrontal-thalamic axis is intimately involved in acquisition of classically conditioned visceral changes.     

CS-dependent response probability in an auditory masked-detection task: considerations based on models of Pavlovian conditioning.

Experimental studies were performed using a Pavlovian-conditioned eyeblink response to measure detection of a variable-sound-level tone (T) in a fixed-sound-level masking noise (N) in rabbits. Results showed an increase in the asymptotic probability of conditioned responses (CRs) to the reinforced TN trials and a decrease in the asymptotic rate of eyeblink responses to the non-reinforced N presentations as a function of the sound level of the T. These observations are consistent with expected behaviour in an auditory masked detection task, but they are not consistent with predictions from a traditional application of the Rescorla-Wagner or Pearce models of associative learning. To implement these models, one typically considers only the actual stimuli and reinforcement on each trial. We found that by considering perceptual interactions and concepts from signal detection theory, these models could predict the CS dependence on the sound level of the T. In these alternative implementations, the animals response probabilities were used as a guide in making assumptions about the "effective stimuli".     

Acute stress rapidly and persistently enhances memory formation in the male rat

Previous studies, as well as the present one, report that acute exposure to intermittent tailshocks enhances classical eyeblink conditioning in male rats when trained 24 h after stressor cessation. In Experiment 1, it was determined that the facilitating effect of stress on conditioning could also be obtained in response to a stressor of acute inescapable swim stress but not inescapable noise or the unconditioned stimulus of periorbital eyelid stimulation. These selective responses arose despite comparable enhancements of the stress-related hormone corticosterone in response to tailshocks, periorbital eyelid stimulation, noise stress, and supraelevation in response to swim stress. Although corticosterone is necessary for the enhanced learning in response to stress (Beylin & Shors, 1999), these results suggest that it is not sufficient. In addition, the results suggest that the enhancement is not dependent on common characteristics between the stressor and the conditioning stimuli (stimulus generalization). In Experiment 2, it was determined that the facilitating effect of the stressor on conditioning occurs within 30 min of stressor cessation. Thus, the mechanism responsible for facilitating memory formation is rapidly induced as well as persistently expressed. In Experiment 3, it was determined that exposure to the stressor does not enhance performance of the conditioned response after the response has been acquired. Thus, exposure to the stressor enhances the formation of new associations rather than affecting retention or performance of the motor response. These studies extend the circumstances under which stress is known to enhance associative learning and implicate neural mechanisms of memory enhancement that are rapidly induced and persistently expressed.     

Acquisition of the classically conditioned eyeblink response in humans over the life span

Human subjects ranging in age from 18 to 85 years underwent classical conditioning of the eyeblink response to a tone conditioned stimulus (CS) and an air-puff unconditioned stimulus (UCS). There was a decline in percentage of conditioned responses with age. This decline was most noticeable in subjects over age 50. These conditioning deficits were not due to age-related changes in sensitivity to the tone CS or the air-puff UCS, nor could the conditioning deficits be attributed to an age-related decline in general cognitive abilities or to changes in spontaneous blink rates. The results are discussed in terms of using the classically conditioned eyeblink in humans in conjunction with the classically conditioned nictitating membrane response in rabbits as a model system for studying the neurobiology of age-related conditioning deficits.     

Neural circuitry and plasticity mechanisms underlying delay eyeblink conditioning

Pavlovian eyeblink conditioning has been used extensively as a model system for examining the neural mechanisms underlying associative learning. Delay eyeblink conditioning depends on the intermediate cerebellum ipsilateral to the conditioned eye. Evidence favors a two-site plasticity model within the cerebellum with long-term depression of parallel fiber synapses on Purkinje cells and long-term potentiation of mossy fiber synapses on neurons in the anterior interpositus nucleus. Conditioned stimulus and unconditioned stimulus inputs arise from the pontine nuclei and inferior olive, respectively, converging in the cerebellar cortex and deep nuclei. Projections from subcortical sensory nuclei to the pontine nuclei that are necessary for eyeblink conditioning are beginning to be identified, and recent studies indicate that there are dynamic interactions between sensory thalamic nuclei and the cerebellum during eyeblink conditioning. Cerebellar output is projected to the magnocellular red nucleus and then to the motor nuclei that generate the blink response(s). Tremendous progress has been made toward determining the neural mechanisms of delay eyeblink conditioning but there are still significant gaps in our understanding of the necessary neural circuitry and plasticity mechanisms underlying cerebellar learning.     

Blocking in Rabbit Eyeblink Conditioning Is Not Due to Learned Inattention: Indirect Support for an Error Correction Mechanism of Blocking

Blocking is a classical conditioning task in which prior training to one cue such as a tone reduces learning about a second cue such as a light, when subsequently trained as a tone-light compound. Blocking has been theorized to come about through a US-modulated error correction mechanism by Rescorla & Wagner (1972) as well as through a mechanism of learned inattention as theorized by Mackintosh (1973). In the case of eyeblink conditioning, an error correction mechanism has been hypothesized to take place in the cerebellum while some form of inattention has been hypothesized to take place in the hippocampal region. The hypothesis we are testing is whether the mechanism of learned inattention is involved in blocking in rabbit eyeblink conditioning. If blocking in eyeblink conditioning is produced by a mechanism of learned inattention, then training to a previously blocked cue should be slower than training to that cue in a na?ve animal. Rabbits that had received tone training followed by tone-light training exhibited blocking. Rabbits that had been previously blocked to the light acquired conditioned responses to the light at the same rate as naive rabbits. This finding failed to support the hypothesis that blocking in rabbit eyeblink conditioning is due to learned inattention, but does support the Rescorla-Wagner mechanism of error correction. The present finding along with previous work on error correction mechanism in the cerebellar-brainstem circuit (Kim et al., 1998) lend support to the theory that blocking, at least in rabbit eyeblink conditioning, seems to be due to an error correction mechanism rather than a learned inattention mechanism.