Mechanisms underlying retarded emergence of conditioned responding following inhibitory training: evidence for the comparator hypothesis

The comparator hypothesis posits that conditioned responding is determined by a comparison at the time of testing between the associative strengths of the conditioned stimulus (CS) and stimuli proximal to the CS at the time of conditioning. The hypothesis treats all associations as being excitatory and treats conditioned inhibition as the behavioral consequence of a CS that is less excitatory than its comparator stimuli. Conditioned lick suppression by rats was used to differentiate four possible sources of retarded responding to an inhibitory CS. These include habituation to the unconditioned stimulus (US), latent inhibition to the CS, blocking of the CS-US association by the conditioning context, and enhanced excitatory associations to the comparator stimuli. Prior research has demonstrated the first three phenomena. Therefore, we employed parameters expected to highlight the fourth one--the comparator process. In Experiment 1, our negative contingency training was shown to produce a conditioned inhibitor that passed inhibitory summation and retardation tests. In Experiment 2 we found transfer of retardation from an inhibitory CS to a novel stimulus when the location where retardation-test training occurred was excitatory, which is indicative of contextual blocking and/or comparator effects. In Experiment 3, extinction of the conditioning context was found to attenuate retardation regardless of whether extinction occurred before or after the CS-US pairings of the retardation test. This indicates that much of the present retardation was due to the comparator process rather than to contextual blocking. Experiment 4 demonstrated that habituation to the US did not contribute to retardation in the present case. Collectively, these studies suggest that retardation following inhibitory training can be explained without recourse to any of the traditional mechanisms of conditioned inhibition.     

Temporal specificity of fear conditioning: effects of different conditioned stimulus-unconditioned stimulus intervals on the fear-potentiated startle effect

Separate groups of rats were given 30 pairings of a light (conditioned stimulus, CS) and 500-ms shock (unconditioned stimulus, US) at CS-US intervals of 0, 25, 50, 100, 200, 800, 3,200, 12,800, or 51,200 ms. Other groups had lights and shocks inconsistently paired. The startle reflex was elicited 2-4 days later with a noise burst alone or 25-51,200 ms after light onset. After CS-US pairings over a wide range of intervals (25-51,200 ms), startle was potentiated in testing, sometimes as rapidly as 50 ms after light onset. Magnitude of potentiation and resistance to extinction were generally greater with longer CS-US intervals. In several groups, potentiation was maximal at a test interval that matched the CS-US interval used in training. This temporal specificity sharpened with increasing numbers of training trials but even occurred with a single training trial in which a 51,200-ms CS-US interval was used. The data indicate that even during simple fear conditioning, animals rapidly learn a temporal CS-US relationship. This has important implications for understanding the neural mechanisms of fear conditioning.     

Rapid reaquisition in conditioning of the rabbit's nictitating membrane response.

Reacquisition after extinction often appears faster than original acquisition. However, data from conditioned suppression studies indicate that this effect may arise from spontaneous recovery and reinstatement of unextinguished contextual stimuli related to the unconditioned stimulus (US). In the present experiments using the rabbit nictitating membrane preparation, spontaneous recovery was eradicated before reaquisition training. US contextual stimuli were controlled by retaining the US during extinction through explicit unpairings of the conditioned stimulus (CS) and US. Attempts were also made to drive the associative strength of the CS into the inhibitory region by differential conditioning and conditioned inhibition procedures. In all cases, reacquisition was very rapid in comparison with a rest control. The results are discussed with respect to their implications for CS and US processing models of conditioning.     

The decrement in conditioned fear with increased trials of simultaneous conditioning is not specific to the simultaneous procedure

Three experiments using a conditioned punishment paradigm with rat subjects examined the possibility that the nonmonotonic acquisition function previously found to characterize simultaneous conditioning was due to the noninformative nature of the conditioned stimulus (CS). In Experiment 1 the suppressive effects of a CS previously presented with an unconditioned stimulus (US) in a simultaneous and forward (informative) manner were compared following 20 and an additional 60 conditioning trials. Excitatory conditioning similarly diminished with increased trials for both the simultaneous and forward procedures. Experiment 2 employed a between-groups design. Simultaneous, forward, and trace conditioning procedures were compared following 20 or 100 trials. Each of the three 100-trial groups showed less resistance to extinction than their 20-trial counterparts. Experiment 3 determined that the decrement in excitatory conditioning for the 100-trial groups was not due to the greater number of US presentations, per se, but rather to the number of CS-US pairings. The nonmonotonic acquisition function observed with all three conditioning procedures indicated that informational factors were not responsible for the decrement observed in simultaneous conditioning. The pattern of results suggested that subjects receiving extended conditioning trials were better able to discriminate between training and testing.     

Revisiting the learning-without-awareness question in human Pavlovian autonomic conditioning: focus on extinction in a dichotic listening paradigm.

Numerous studies have indicated that, consistent with current "cognitive" accounts of information processing, human Pavlovian autonomic discrimination acquisition cannot occur without awareness of the CS-US relationship. However, extinction studies have suggested that awareness is not necessary, findings that, in information-processing terms, have been explained by assuming that the processing by the extinction stage is parallel (automatic) rather than serial (controlled). This explanation was tested in an 80-subject study. The first, acquisition phase was a standard semantic differential conditioning arrangement with a 96-db white noise as US, and a "long" CS-US interval of 8 s, with ten trials each of CS+ (paired with US) and CS- (unpaired) trials. In extinction (USs omitted), in order to obtain non-autonomic indices of processing and thereby test the information-processing account of "unaware" autonomic conditioning during extinction, a dichotic listening task was implemented, with the CSs presented in the unattended channel (ear), while the subject had to perform a semantic differential reaction task in an attended-to channel (other ear). In early extinction, the electrodermal response occurring at an interval of 9-15 s after CS onset (i.e., following placement of the US during acquisition) and the finger-pulse-volume response occurring at an interval of 4-11 s after CS onset both showed reliable conditioning, but reaction-time and subjective-report data for the recognized critical words indicated serial rather than parallel processing of the CSs during extinction.     

Response rates track the history of reinforcement times

When conditioning involves a consistent temporal relationship between the conditioned stimulus (CS) and unconditioned stimulus (US), the expression of conditioned responses within a trial peaks at the usual time of the US relative to the CS. Here we examine the temporal profile of responses during conditioning with variable CS-US intervals. We conditioned stimuli with either uniformly distributed or exponentially distributed random CS-US intervals. In the former case, the frequency of each CS-US interval within a specified range is uniform but the momentary probability of the US (the hazard function) increases as time elapses during the trial; with the latter distribution, short CS-US intervals are more frequent than longer intervals, but the momentary probability of the US is constant across time within the trial. We report that, in a magazine approach paradigm, rats' response rates remained stable as time elapses during the CS when the CS-US intervals were uniformly distributed, whereas their response rates declined when the CS-US intervals were exponentially distributed. In other words, the profile of responding during the CS matched the frequency distribution of the US times, not the momentary probability of the US during the CS. These results are inconsistent with real-time associative models, which predict that associative strength tracks the momentary probability of the US, but may provide support for timing models of conditioning in which conditioned responding is tied to remembered times of reinforcement.     

Fear Develops to the Conditioned Stimulus and to the Context during Classical Eyeblink Conditioning in Rats

In classical eyeblink conditioning, non-specific emotional responses to the aversive shock unconditioned stimulus (US), which are presumed to coincide with the development of fear, occur early in conditioning and precede the emergence of eyeblink responses. This two-process learning model was examined by concurrently measuring fear and eyeblink conditioning in the freely moving rat. Freezing served as an index of fear in animals and was measured during the inter-trial intervals in the training context and during a tone conditioned stimulus (CS) presented in a novel context. Animals that received CS-US pairings exhibited elevated levels of fear to the context and CS early in training that decreased over sessions, while eyeblink conditioned responses (CRs) developed gradually during acquisition and decreased during extinction. Random CS-US presentations produced a similar pattern of fear responses to the context and CS as paired presentations despite low eyeblink CR percentages, indicating that fear responding was decreased independent of high levels of learned eyeblink responding. The results of paired training were consistent with two-process models of conditioning that postulate that early emotional responding facilitates subsequent motor learning, but measures from random control animals demonstrate that partial CS-US contingencies produce decrements in fear despite low levels of eyeblink CRs. These findings suggest a relationship between CS-US contingency and fear levels during eyeblink conditioning, and may serve to clarify further the role that fear conditioning plays in this simple paradigm.     

Fear develops to the conditioned stimulus and to the context during classical eyeblink conditioning in rats

In classical eyeblink conditioning, non-specific emotional responses to the aversive shock unconditioned stimulus (US), which are presumed to coincide with the development of fear, occur early in conditioning and precede the emergence of eyeblink responses. This twoprocess learning model was examined by concurrently measuring fear and eyeblink conditioning in the freely moving rat. Freezing served as an index of fear in animals and was measured during the inter-trial intervals in the training context and during a tone conditioned stimulus (CS) presented in a novel context. Animals that received CS-US pairings exhibited elevated levels of fear to the context and CS early in training that decreased over sessions, while eyeblink conditioned responses (CRs) developed gradually during acquisition and decreased during extinction. Random CS-US presentations produced a similar pattern of fear responses to the context and CS as paired presentations despite low eyeblink CR percentages, indicating that fear responding was decreased independent of high levels of learned eyeblink responding The results of paired training were consistent with two-process models of conditioning that postulate that early emotional responding facilitates subsequent motor learning, but measures from random control animals demonstrate that partial CS-US contingencies produce decrements in fear despite low levels of eyeblink CRs. These findings suggest, a relationship between CS-US contingency and fear levels during eyeblink conditioning, and may serve to clarify further the role that fear conditioning plays in this simple paradigm.     

Revisiting the learning-without-awareness question in human pavlovian autonomic conditioning: Focus on extinction in a dichotic listening paradigm

Numerous studies have indicated that, consistent with current “cognitive” accounts of information processing, human Pavlovian autonomic discrimination acquisition cannot occur without awareness of the CS-US relationship. However, extinction studies have suggested that awareness is not necessary, findings that, in information-processing terms, have been explained by assuming that the processing by the extinction stage is parallel (automatic) rather than serial (controlled). This explanation was tested in an 80-subject study. The first, acquisition phase was a standard semantic differential conditioning arrangement with a 96-db white noise as US, and a “long” CS-US interval of 8 s, with ten trials each of CS+ (paired with US) and CS− (unpaired) trials. In extinction (USs omitted), in order to obtain non-autonomic indices of processing and thereby test the information-processing account of “unaware” autonomic conditioning during extinction, a dichotic listening task was implemented, with the CSs presented in the unattended channel (ear), while the subject had to perform a semantic differential reaction task in an attended-to channel (other ear). In early extinction, the electrodermal response occurring at an interval of 9–15 s after CS onset (i.e., following placement of the US during acquisition) and the finger-pulse-volume response occurring at an interval of 4–11 s after CS onset both showed reliable conditioning, but reaction-time and subjective-report data for the recognized critical words indicated serial rather than parallel processing of the CSs during extinction.     

Evaluative conditioning in the picture-picture paradigm with random assignment of conditioned stimuli to unconditioned stimuli

Human participants were allocated to 1 of 3 groups. In the conditioning group, each conditioned stimulus (CS)-unconditioned stimulus (US) pair was presented 7 times during the acquisition phase. Participants who were assigned to the extinction group saw 5 additional presentations of each CS in isolation after the 7 presentations of each CS-US pair. In the latent inhibition group, the CS-only trials were presented before the CS-US trials. Overall, a significant evaluative conditioning effect was observed. This effect cannot be dismissed on the basis of the arguments developed by A. P. Field and G. C. L. Davey (1997, 1998, 1999), and the results thus provide strong evidence for the associative nature of evaluative conditioning. The results are also in line with other findings, which showed that evaluative conditioning is resistant to extinction.     

Testing response generation rules

Robbins (1988) reported data that he viewed as inconsistent with Miller and Schachtman's (1985a) comparator hypothesis of conditioned response generation. Here we explain why we do not find his experiments a compelling test of the comparator hypothesis. We also briefly review other studies that tested the same predictions of the comparator hypothesis that Robbins examined. We conclude that there is considerable evidence that following excitatory or inhibitory conditioning with a target conditioned stimulus (CS) and unconditioned stimulus (US), extinction of other cues that were present during CS training ordinarily increases excitatory responding and decreases inhibitory responding to the CS. However, consistent with Robbins's conclusion, there is scant evidence that after CS-US training, enhancing the associative value of other cues that were present during CS training influences excitatory or inhibitory responding to the CS. The implications of these conclusions for the comparator hypothesis as an explanation of differences in acquired behavior and as a heuristic tool are considered.     

Classical conditioning as a nonstationary,multivariate time series analysis: A spreadsheet model

The implementation of the Gallistel (1990) model of classical conditioning on a spreadsheet with matrix operations is described. The model estimates the Poisson rate of unconditioned stimulus (US) occurrence in the presence of each conditioned stimulus (CS). The computations embody three implicit principles:additivity (of the rates predicted by each CS),provisional stationarity (the rate predicted by a given CS has been constant over all the intervals when that CS was present), andpredictor minimization (when more than one solution is possible, the model minimizes the number of CSs with a nonzero effect on US rate). The Kolmogorov-Smirnov statistic is used to test for non-stationarity. There are no free parameters in the learning model itself and only two parameters in the formally specified decision process, which translates what has been leamed into conditioned responding. The model predicts a wide range of conditioning phenomena, notably: blocking, overshadowing, overprediction, predictive sufficiency, inhibitory conditioning, latent inhibition, the invariance in the rate of conditioning under scalar transformation of CS-US and US-US intervals, and the effects of partial reinforcement on acquisition and extinction.     

Recent and Remote Extinction Cues Reduce Spontaneous Recovery

Five appetitive conditioning experiments with rats examined the ability of extinction cues (ECs) to reduce spontaneous recovery after extinction procedures that varied the temporal relation between the ECs and the conditioned stimulus (CS) and included presentations of additional events (e.g. other stimuli correlated with extinction, CSs, and the US). In extinction, two different ECs were presented either closely in time before (i.e. recent to), or more distant (i.e. remote) from a nonreinforced CS. Both recent and remote ECs reduced spontaneous recovery to the CS when present during testing (Experiments 1-4). Each EC reduced recovery despite the addition during extinction of a second EC and CS (Experiments 1, 3, and 4), and the US (Experiment 3). Experiments 4 and 5 investigated the recent and remote ECs' tendency to control a serial occasion setting discrimination involving the target CS under explicit training conditions. Neither EC gained such discriminative control. Possible explanations of the results are discussed, including configural learning, occasion setting, and contextual cue control.     

Contextual control of the extinction of conditioned fear

Rats received 15 pairings of a CS and shock in one context, and then a series of CS-alone trials in a second context. Even though this extinction procedure produced a complete loss of conditioned suppression, when the animals were returned to the site of original conditioning, suppression was renewed to a level comparable to that of animals that had not undergone extinction. Controls indicated that the renewed suppression was not due solely to pseudoconditioning, suggesting that the CS-US association had survived extinction. Renewed suppression was also demonstrated in a third context that was never associated with shock. Loss of suppression did not necessarily depend upon inhibitory conditioning of the extinction context. The data suggest that extinction of conditioned fear is specific to the context in which it occurs. They also suggest the possibility that animals might discriminate episodes in which a CS is reinforced and nonreinforced independently of the excitatory or inhibitory status of cues, like contextual stimuli, that are coincidentally present during those episodes.     

Learning with arbitrary versus ecological conditioned stimuli: Evidence from sexual conditioning

Laboratory investigations of Pavlovian conditioning typically involve the association of an arbitrary conditioned stimulus (CS) with an unconditioned stimulus (US) that has no inherent relation to the CS. However, arbitrary CSs are unlikely to become conditioned outside the laboratory, because they do not occur often enough with the US to result in an association. Learning under natural circumstances is likely only if the CS has a preexisting relation to the US. Recent studies of sexual conditioning have shown that in contrast to an arbitrary CS, an ecologically relevant CS is resistant to blocking, extinction, and increases in the CS-US interval and results in sensitized responding and stronger second-order conditioning. Although the mechanisms of these effects are not fully understood, these findings have shown that signature learning phenomena are significantly altered when the kinds of stimuli that are likely to become conditioned under natural circumstances are used. The implications of these findings for an ecological approach to the study of learning are discussed.     

非条件刺激降低再评估对条件性恐惧消退的影响

诸多情绪障碍治疗的关键在于促进条件性恐惧反应的消退, 研究证明非条件刺激再评估能够引起恐惧反应的变化。本研究将非条件刺激降低再评估范式应用于消退训练, 以主观预期值、皮电反应作为恐惧反应指标, 考察恐惧习得后非条件刺激强度降低对条件性恐惧消退的影响, 并运用评价性条件作用探讨非条件刺激再评估的作用机制。结果表明：在消退阶段, 降低组对条件刺激的皮电反应显著低于控制组。同时评价性条件作用结果显示：经过非条件刺激再评估, 降低组较控制组对条件刺激的评价更为正性。说明非条件刺激降低再评估有效改变条件刺激的负性效价, 降低个体的恐惧反应、促进恐惧消退。     

Malleability of conditioned associations: path dependence

Using conditioned suppression of barpressing to investigate the stability of a conditioned stimulus-unconditioned stimulus (CS-US) association, we gave water-deprived rats either a few pairings of the CS with a strong footshock US or many pairings with a weak footshock US so that barpress suppression in response to the CS was equated. Experiment 1 established training parameters that yielded this equivalence. Specifically, rapid acquisition to a preasymptotic level of responding with strong shock produced suppression comparable to the asymptotic level reached more slowly with weak shock. Experiment 2 showed that although equivalent performance was obtained from extensive conditioning with a weak shock or limited conditioning with strong shock, only extensive conditioning with weak shock resulted in retarded acquisition of an association between that same CS and a footshock level perceived as midway between the two initial training shock intensities as implied by asymptotic performance in Experiment 1. Experiment 3 demonstrated that the observed retardation in animals given many conditioning trials with weak shock was CS specific. Collectively, these findings indicate that the malleability of learned behavior is not simply a function of initial associative strength but is dependent on path during initial acquisition.     

Conditioning the unconditioned response: modification of the rabbit's (Oryctolagus cuniculus) unconditioned nictitating membrane response

Conditioning-specific reflex modification (CRM) occurs when classical conditioning modifies responding to an unconditioned stimulus (US) in the absence of a conditioned stimulus (CS). Three experiments monitored rabbit nictitating (Oryctolagus cuniculus) membrane unconditioned responses to 5 intensities and 4 durations of periorbital electrical stimulation before and after CS or US manipulation. CRM occurred after 12 days of CS-US pairings but not following unpaired CS/US presentations or restraint. CRM survived CS-alone and CS/US-unpaired extinction of the conditioned response (CR) but not presentations of the US alone, although CRs remained intact. Thus, CRs could be weakened without eliminating CRM and CRM could be weakened without eliminating CRs. Data indicate CRM is a reliable, associative effect that is more than a generalized CR and may not be explained by habituation, stimulus generalization, contextual conditioning, or bidirectional conditioning.     

Associative effects of US preexposure: modulation of conditioned responding by an excitatory training context

In two experiments we examined factors that contribute to retarded emergence of conditioned responding to a conditioned stimulus (CS) trained in a context in which unsignaled unconditioned stimuli (USs) had previously been administered. In both experiments water-deprived rats were used in a conditioned lick suppression task to measure the conditioned response elicitation potential of the CS and the training context. From Experiment 1 we determined that nonreinforced exposure to the excitatory context after US preexposure and prior to CS-US pairings in that context eliminated the conditioned response deficit observed on a subsequent test of the CS. The recovery from the US preexposure deficit was nearly as great in animals that received nonreinforced exposure to the excitatory training context after the CS-US pairings but prior to the ultimate test of the CS. From Experiment 2 we determined that the recovery induced by contextual deflation after CS training was specific to deflation of the context in which the CS was trained as opposed to another excitatory context. In total, these experiments suggest that context-US associations partially mask the expression of a learned CS-US association. These results are discussed in terms of recent models of conditioned response generation.     

External inhibition in a goldfish(carassius auratus) classical conditioning situation

Goldfish were classically conditioned with a light as the CS and shock as the US. The UR was a decrease in respiration. After 15 or 60 conditioning trials the fish were tested with novel stimuli (clicks) during the CS-US interval. High and moderate intensity novel stimuli produced a significant decrease in CRs (external inhibition) for fish with 60 conditioning trials (5.5 or 10.5 sec CS-US interval), but not fish with 15 conditioning trials. Low intensity novel stimuli produced no evidence for disinhibition (an increase in CRs). Control groups(e.g., groups with random presentations of the CS and US) showed that the external inhibition for fish with 60 conditioning trials was inhibition of a true CR.