Signaling and affective functions of conditioned aversive stimuli in an appetitive choice discrimination: US intensity effects

Different groups of rats received Pavlovian aversive conditioning in which US-shock intensity (0.25–1.0 mA) and CS-US correlation (+, 0, ?) were factorially varied. Then, the CS was administered for each group contingent upon the reinforced response in an appetitive choice discrimination. Absolute and ratio measures of speed of running in the presence of the CS showed that, at the start of discrimination training, CS+ suppressed and CS- facilitated performance. However, later in training but prior to any evidence of choice learning, these speed effects reversed, with the magnitude of both the initial and reversed effects being a positive function of US intensity. Consistent with the reversal of speeds, associative (choice) measures showed that CS+ facilitated and CS- retarded discrimination learning relative to CSo and, within limits, these effects were also amplified by stronger USs. The findings suggest that a CS has both affective (motivational) and signaling (associative) functions and that both are influenced by US intensity; however, the CS's affective property is rapidly extinguished in the presence of a hedonicly different reinforcer, while leaving the CS's signaling property largely intact. Hence, the CS functions as a transformed signal for the new (appetitive) reinforcer and facilitates or retards learning by mediating the reinforcer's presence (CS+) or absence (CS-).     

Asymmetrical effects of Pavlovian excitatory and inhibitory aversive transfer on Pavlovian appetitive responding and acquisition

Predictions of a theory of Pavlovian motivational transfer, which incorporates principles of both the theory of reciprocal inhibition and the Rescorla-Wagner model, were tested in several Pavlovian aversive to Pavlovian appetitive transfer tasks. As predicted, the presence of a signal for an aversive event, conditioned stimulus (AV CS+), reliably suppressed performance of appetitive conditioned responses (CRs) whether imposed during acquisition or on independently established responding. Acquisition of appetitive responding to a novel CS reinforced in compound with an AV CS+, however, was enhanced (“superconditioning”). This observation suggests that the effects of a discrepancy between expectation and actual outcome on a conditioning trial are influenced by the affective value of both the expectation and the reinforcer. These transfer effects were not symmetrical for an inhibitory aversive stimulus (AV CS?). An AV CS? did not enhance appetitive responding compared to a random control condition, nor did the AV CS? reduce (i.e., block) appetitive conditioning to a novel CS when appetitive reinforcement occurred in the presence of the AV CS?. Comparison of the two shock-exposed conditions with a naive control condition suggests that previous results that were apparently consistent with inhibitory aversive enhancement and blocking of appetitive conditioning may have been due to aversive context conditioning.     

Transfer of the signaling properties of aversive CSs to an instrumental appetitive discrimination

Rats received Pavlovian conditioning in which, based on a shock US, white noise was established for different groups as an aversive CS+, CSo, or CS?. Then, half of each group received the CS contingent upon either the food-reinforced or nonreinforced response in an easy, choice discrimination. Correct responses, i.e., number of reinforcements, to criterion showed that a CS+ for the reinforced response facilitated learning, whereas a CS? retarded learning; conversely, a CS+ for the nonreinforced response retarded learning, whereas a CS? facilitated learning. The same contingency difference occurred with errors to criterion for CS? subjects but was obscured for CS+ subjects apparently by an avoidance-producing effect of the CS+. In support of the generality of the transfer effect, Z-score transforms of the correct-response data showed that the magnitude of transfer was comparable to that obtained in more difficult discriminations. Collectively, the findings indicate that an aversive CS can function as a transformed signal for the presence (CS+) or absence (CS?) of an appetitive reinforcer and that the signal's control of behavior is via a within-chain mediational process.     

Odor as a conditioned inhibitor: Applicability of the Rescorla-Wagner model to feeding behavior

Hooded rats were given conditioned inhibition training in which the taste of saccharin alone was always followed by induced illness, but the taste of saccharin plus the odor of amyl acetate was not. In a series of three subsequent tests—summation, enhancement of conditioning, and retardation—it was demonstrated that the odor had acquired active inhibitory properties. The results paralleled those obtained with more traditionally studied stimuli and techniques and hence were found to be readily predictable from a recent model of conditioning set forth by Rescorla and Wagner (1972).     

Feedback during exposure to inescapable shocks and subsequent shock-escape performance

In two experiments, we assessed the ability of a feedback stimulus during helplessness training to reduce the performance deficits common to inescapable shock. In each experiment, four groups of rats were exposed to either escapable shock (E), inescapable shock with a feedback stimulus following shock termination (Y-FS), inescapable shock with no feedback stimulus (Y-NFS), or no shock (N). The feedback stimulus eliminated the interference effects of inescapable shock when tested with an FR-3 lever press escape task (Experiment 1) or on an FR-1 task with a 3-s delay between the response and shock termination (Experiment 2). These results suggest that stress-induced biochemical changes may mediate the interference effects seen in inescapably shocked rats.     

Variations in explicitly unpaired training are differentially effective in producing conditioned inhibition

To evaluate a contingency interpretation of conditioned inhibition (CI), rats were given “explicity unpaired” training in which the locus and duration of a CS within the inter-US (shock) interval were systematically manipulated for different groups. Summation and retardation tests in Experiment 1 indicated that stronger CI resulted from both a backward and a trace CS than from a midlocus CS of equal or greater duration. Complementing these findings, the same tests in Experiment 2 showed that, by comparison with novel-stimulus controls, CI developed to a trace CS but not to a mid-locus CS, nor to a trace CS that was accompanied by an immediate signal for the US. These findings argue against a contingency interpretation of CI and favor a contiguity interpretation stressing the short-term rehearsal of stimulus events. Such rehearsal of the US allows a backward CS, but not a mid-locus CS with an extended US-CS interval, to be discriminated as a signal for nonreinforcement, and thus to develop as a conditioned inhibitor. Similarly, excitatory conditioning to the memory trace of a CS allows the nominal trace CS to develop as a signal for nonreinforcement, and thus as a conditioned inhibitor, but not when its memory trace is overshadowed by another CS that immediately precedes the US. In short, the development of CI is facilitated when excitation is mediated by the memorial processing of either the US or a discrete CS for the US rather than by contextual cues.     

On the directionality of key pecking during signals for appetitive and aversive events

Pigeons were exposed to a signal paired with either blackout or blackout plus shock and to another signal paired with food superimposed on a baseline of concurrent variable-interval reinforcement of pecks on two keys. The signals were changes of color of one of the two keys. The rate of pecking both keys during the signal paired with blackout or blackout plus shock was lower than the baseline rate of pecking (a conditioned emotional response), but the decrease in pecking was greater on the signal key. When the intensity of shock was increased, the rate of pecking did not decrease further on the signal key but did decrease on the other key. Rate of pecking during the signal paired with food increased sharply on the signal key (an autoshaping effect) and decreased sharply on the other key. These results support a view that there are two effects of the interaction between classical and instrumental conditioning, a stimulus-directed effect and a generalemotional effect.     

Mechanisms of blocking by contextual stimuli

The influence of contextual stimuli on the conditioning and performance of responding to a discrete stimulus was examined in the US preexposure paradigm using both context shift manipulations and a measure of context conditioning. Four groups of rats received both repeated exposure to an electric shock US in one context (Context 1), and repeated nonshocked exposure to a second context (Context 2). Two additional groups of rats received exposure to these contexts, but never received shock presentations. Rats exposed to shock learned to escape from the stimuli of Context 1, but did not escape from the stimuli provided by Context 2. Rats not exposed to shock failed to escape from either context. All rats then received a single CER conditioning session in which four pairings of a 3-min noise CS and shock US were presented. Half the rats received those CS-US pairings in the excitatory Context 1, while the remaining rats received those pairings in the neutral Context 2. Finally, half the rats in each of the CER conditioning treatments received extinction test trials of the noise CS in Context 1, while the remaining rats received those test trials in Context 2. Thus, this design factorially manipulated the presence of excitatory or neutral contextual stimuli during both conditioning and testing of a discrete CS. In comparison with the two groups of rats never preexposed to shock alone, attenuation in acquisition of conditioned suppression observed during test trials occurred only when CER conditioning had been administered in the excitatory Context 1, and this effect was manifested when testing occurred in either the excitatory Context 1 or the neutral Context 2. These results support the model of R. A. Rescorla and A. R. Wagner (1972) (in A. H. Black & W. F. Prokasy (Eds.) Classical Conditioning II, pp. 64–99, New York: Appleton-Century-Crofts) which asserts that contextual stimuli and sicrete CSs compete for limited associative strength supportable by a given US.     

The effectiveness of visual and gustatory conditioned stimuli in human classical aversive conditioning with electric shock

Thirty-six undergraduate volunteers, divided into three equal groups, were given electric shock while sipping a colored, unflavored solution (Group I): a flavored, colorless solution (Group 2); or a colored, flavored solution (Group 3), in order to determine whether human Ss respond differentially to visual and gustatory cues when the UCS is aversive electric shock. Using a standard classical discrimination procedure, the CS + was blue water for Group 1, citric acid solution for Group 2, and blue citric acid solution for Group 3. For all groups the CS- was plain water, which was never paired with electric shock. The dependent variables were derived from Staats' A-R-D theory: attitudinal change (A) and a performance measure of sip-size taken during conditioning trials (D) both confirmed the hypothesis that taste can be an effective CS when the UCS is shock, in contrast to results typically obtained with rats where visual but not taste cues are effective with a shock UCS.     

Compounds of conditioned fear stimuli

A differential conditioning procedure was used with rats to establish different levels of suppression to two different stimuli. One stimulus was paired with shock every time it was presented, while the other stimulus cued shock on only 25% of its presentations. When these two component stimuli were subsequently tested as a simultaneous compound, two different types of component-compound relationships were observed. Some subjects showed greater suppression to the compound than they did to either component stimulus, while other subjects showed an intermediate level of suppression to the compound. The difference in type of component-compound relationship appeared to be related to the degree of stability (over trials) of each subject's reaction to the probabilistic (25%) cue.When a similar discrimination was established based on the intensity of the shock, rather than its probability of occurrence, all subjects showed more suppression to the compound than to its individual component stimuli. These results are discussed in terms of their implications for choice of model for characterizing the interaction of conditioned states.     

Irrelevant incentive learning revisited: Associating flavors and exteroceptive cues with positive incentives

In “irrelevant incentive learning” information stored about an incentive when it is not desired is used later when the incentive is desired. In “habit learning” responses learned under one motive state continue to be made under a new motive state even though they produce goal events that are not appropriate to that motive state. Experiment 1 showed that both types of learning occur simultaneously whether flavor or texture cues are used and whether or not position is also a relevant cue. Thus, contrary to previous suggestions, irrelevant incentive learning is not limited to interoceptive cues, nor is habit learning limited to exteroceptive cues. In both Experiments 1 and 2 it was also shown that motivation affects what is learned as well as affecting current performance. This contrasts with views of motivation as solely a determinant of performance.     

The optional shift performance of reflective and impulsive girls

The optional shift performance of 52 reflective and 50 impulsive second-grade girls was assessed under two response-consequence conditions: (a) reward for correct responses only, and (b) reward for correct responses and a penalty for incorrect responses. Reflection—impulsivity was defined on the basis of performance on the Matching Familiar Figures test. The reflectives showed a significantly greater percentage of reversal shifts than the impulsives. The impulsives showed more reversal shifts under the penalty condition than the reward alone condition whereas the performance of the reflectives was the same in both consequence conditions. A test of statistical association indicated that reflection—impulsivity may be as strongly related to reversal shift performance as age and perceptual pretraining. The results are interpreted as indicating that individual differences in perceptual search strategies may have an important influence on the problem-solving behavior of children.     

Transfer of the partial reinforcement extinction effect between escape (shock) and appetitive (food) conditioning

In the first experiment rats were given partial reinforcement or continuous reinforcement in either an escape or an appetitive paradigm. Subsequently, the rats received continuous reinforcement training under motivational conditions opposite those experienced earlier. Finally, responses were extinguished according to the motivational conditions experienced in the second phase. The results indicated that partial reinforcement in the initial phase operated to increase resistance to extinction in the last. In a second experiment this intermotivational partial reinforcement extinction effect was shown to survive interpolated experiences with extinction, a 1-week rest period, and continuous reinforcement reacquisition. A third experiment examined the influence of intramodal versus intermodal nonreinforcement-reinforcement sequences on the intermotivational partial reinforcement extinction effect. Interactive effects between similarity of aversive outcome (escape nonreinforcement, appetitive nonreinforcement) and reinforcement type (negative, positive) were found. The theoretical implications of the data from all three experiments are discussed.     

The development of orientation categories between 2 and 4 months of age

Recent research has indicated that infants are capable of responding to stimuli in a manner indicating that they categorize them. Infant perception of orientation was examined within a framework of categorization. In one experiment, it was shown that 4-month-old infants generalized habituation from one range of oblique grating stimuli to another, consistent with the interpretation that any two oblique stimuli were perceived as more similar than a vertical and an oblique. Four-month-old infants' generalization was not due to a simple inability to discriminate between obliques (Experiment 2) so the results of Experiment 1 reflect in large part true categorization behavior and not categorical perception. Results for 2- and 3-month old infants suggest that "vertical" serves as a reference stimulus in infant orientation perception such that gross distinctions between vertical and nonvertical precede the development of the "oblique" category. The category boundary between oblique and vertical did not successfully predict better between-than within-category discrimination in 4-month-old infants (Experiment 3) under the conditions of these experiments.     

Visual discrimination learning with a 1-min delay of reward

Eight rats were successfully trained in a black-white discrimination with a 1-min delay of reward. The procedure was unusual in that the rat spent the delay outside the apparatus in its home cage. Immediately after the rat responded, whether correctly or incorrectly, it was removed from the choice compartment and placed in its home cage. When the delay ended, it was returned to the startbox. If the preceding response had been correct, the rat received a reward of sugar water; otherwise, it was allowed to make another choice response. Mediation by external cues was excluded because there was no difference in the way the rats were treated after a correct or an incorrect response until the delay interval ended. Mediation by proprioceptive stimuli was excluded because position was an irrelevant cue.     

Perceptual-cognitive explorations of a toroidal set of free-form stimuli

A polar-coordinate analogue of Fourier synthesis generates organic-appearing “free forms” that can be continuously deformed along any desired number of difficult-to-verbalize dimensions. Since the dimensions are also circular, the forms correspond to points on the surface of a torus which, though conveniently finite, is free of bounding edges. Two experiments explore a particular two-dimensional set of 81 such forms. The first shows that perceived pair-wise similarities among the individual forms are well explained purely in terms of the distances among their corresponding points in the toroidal parameter space. The second, however, establishes that forms that tend to be grouped together as having the same cognitive interpretation define regions in parameter space that are variously shaped or even bimodal and, hence, that cannot be explained solely on the basis of the fixed set of pair-wise similarities. The stimuli appear to offer a novel combination of cognitive richness and low-dimensional parametric control.     

Discrimination and generalization by rats of temporal stimuli lasting for minutes

In three experiments, rats learned to respond differentially to reinforced and nonreinforced trials when the length of the intertrial interval (ITI) predicted the trial outcome (reinforcement or nonreinforcement). Rats in control groups, for whom the length of the ITI did not predict the outcome, did not show differential performance on nonreinforced and reinforced trials. Generalization gradients obtained following discrimination training were comparable to those obtained following discrimination training with other types of discriminative stimuli. That is, groups which had shown differential performance in discrimination training yielded generalization gradients with fastest speeds at the previously reinforced ITIs, slowest speeds at the previously nonreinforced ITIs, and intermediate speeds at ITIs of intermediate length. Control groups yielded flat gradients across all ITIs tested. These effects were shown for relative time discrimination (short time = reinforcement, long time = nonreinforcement, or the reverse) and also for an absolute time discrimination (long and short time = reinforcement, middle time = nonreinforcement or the reverse). This method was effective for time duration measured in minutes rather than seconds, as is more commonly the case.