Effects of stimulus similarity in discrimination training upon wavelength generalization in pigeons.

Thirty pigeons were given variable interval training to peck a 555-nm. light and then were tested for wavelength generalization. The subjects were later assigned to 1 of 3 groups, matched for both relative generalization slope and response rate. One group then received successive discrimination training between the 555-nm. stimulus (S+) and a vertical white line on a 555-nm. background (S minus); another group experienced the same S+ but a vertical white line on a black background as S minus. A third group received a comparable amount of single stimulus training with the 555-nm. value. On a second wavelength generalization test, the first group yielded greater sharpening of generalization than the second group, whereas the third group showed no change from Test 1. These results indicate that the sharpening of generalization gradients by discrimination training is directly related to the similarity of the discrimination training stimuli.     

Within-compound associations in a variety of compound conditioning procedures

Three experiments used a flavor-aversion preparation to demonstrate the occurrence of within-compound associations in various conditioning procedures. In Experiment 1 rats first received two separate two-flavor compounds, each followed by a mild US. They then received one element from one compound paired with a strong US and one element from the other compound nonreinforced. A subsequent choice test of the other two flavors from the compounds revealed that the consumption of each test flavor reflected the conditioning history of the element with which it had been paired. Rats drank less of the flavor whose associate had been paired with the strong US than of the flavor whose associate had been nonreinforced. In Experiment 2 within-compound associations were observed using a similar design in a blocking procedure in which one element from each of the two compounds was conditioned previously. Experiment 3 identified within-compound associations in a procedure where reinforced single element presentations were intermixed with nonreinforced compound presentations, as in a conditioned inhibition paradigm. These results suggest that within-compound associations occur in several important conditioning procedures which use multiple CS presentations.     

Dissociative effects of different types and amounts of nonreinforced CS exposure on avoidance extinction and the CER

Two experiments examined the effectiveness of two amounts of flooding or response-prevention on hastening avoidance response extinction and on reducing CS-produced suppression of bar-pressing for food. In Experiment 1, 20 and 30 flooding trials were both shown to be effective in hastening the extinction of a well-learned shuttlebox avoidance response. In Experiment 2, rats trained under comparable conditions to those in Experiment 1 were tested following flooding for the CER in a different apparatus. The results indicated that 30, but not 20, flooding trials were sufficient to reduce the CER. In each experiment the results of additional control groups equated with the flooded groups for nonreinforced CS exposure also revealed a dissociation between the effectiveness of this CS time control procedure in hastening avoidance response extinction and in reducing the CER. Further comparisons showed that although 30 flooding trials did reduce the CER, the same total duration of nonreinforced CS Exposure in the form of avoidance extinction trials did not. Thus the context in which CS exposure occurs may affect the dynamics of extinction of the CER. The experiments are discussed in the broader context of dissociation of various indices of fear in humans.     

Importance of trials versus accumulating time across trials in partially reinforced appetitive conditioning

Four experiments with rats examined partial reinforcement in appetitive conditioning. In Experiment 1, adding nonreinforced trials to a continuous reinforcement schedule slowed acquisition, whereas deleting reinforcers did not. Trial massing suppressed performance and learning. In Experiment 2, conditioning with a short conditioned stimulus (CS) was rapid, and partial reinforcement with a short CS was as effective as continuous reinforcement with equal accumulated time in the CS. In Experiment 3, conditioning was nevertheless influenced by the probability of reinforcement. In Experiments 3 and 4, conditioning was especially disrupted when nonreinforced trials preceded reinforced trials closely in time. The results underscore the importance of temporal variables in conditioning but are more consistent with trial-based accounts than time-accumulation accounts of conditioning.     

The effects of ITI fillers in autoshaping

The present experiments used pigeons in an autoshaping procedure to examine the effects of a nonreinforced, nontarget stimulus presented during the intertrial interval on responding to a target CS. Experiments 1 and 2 found that a filler stimulus presented during a substantial portion of the ITI retarded responding to the target CS relative to a group not exposed to the filler. This group difference in performance was subsequently abolished by continued training and omitting the filler in the former group (Experiment 1) or adding a filler for the latter group (Experiment 2). Experiment 3 found that when the “filler” occupied most of the interreinforcement interval, CS-US pairings embedded within the “filler” stimulus yielded superior autoshaping relative to a group that received CS-US pairings embedded in static apparatus cues in the absence of the filler. The results are discussed with reference to the ways that a nontarget stimulus during the ITI can influence contextual modulation of responding to a discrete CS and the necessity for comparator theories to incorporate a “local context” view of cycle time to explain the present findings.     

Occasional reinforced trials during extinction can slow the rate of rapid reacquisition

Two appetitive conditioning experiments with rats examined reacquisition after conditioned responding was eliminated by either extinction or by a partial reinforcement procedure in which reinforced trials were occasionally presented among many nonreinforced trials. In Experiment 1, reacquisition to a conditional stimulus (CS) that had been conditioned and extinguished was more rapid than acquisition in a group that had received no prior conditioning. However, the addition of occasional reinforced trials to extinction slowed this rapid reacquisition effect. Experiment 2 replicated the result and showed that a procedure in which the CS and the unconditional stimulus (US) were unpaired in extinction interfered even further with reacquisition. The results suggest that rapid reacquisition is ordinarily produced when reinforced trials provide a contextual cue that can renew responding by signaling other acquisition trials (Ricker & Bouton, 1996). The effects of partial reinforcement in extinction are surprising from several theoretical perspectives and have useful clinical implications.     

Transfer of the signaling properties of aversive CSs to an instrumental appetitive discrimination

Rats received Pavlovian conditioning in which, based on a shock US, white noise was established for different groups as an aversive CS+, CSo, or CS?. Then, half of each group received the CS contingent upon either the food-reinforced or nonreinforced response in an easy, choice discrimination. Correct responses, i.e., number of reinforcements, to criterion showed that a CS+ for the reinforced response facilitated learning, whereas a CS? retarded learning; conversely, a CS+ for the nonreinforced response retarded learning, whereas a CS? facilitated learning. The same contingency difference occurred with errors to criterion for CS? subjects but was obscured for CS+ subjects apparently by an avoidance-producing effect of the CS+. In support of the generality of the transfer effect, Z-score transforms of the correct-response data showed that the magnitude of transfer was comparable to that obtained in more difficult discriminations. Collectively, the findings indicate that an aversive CS can function as a transformed signal for the presence (CS+) or absence (CS?) of an appetitive reinforcer and that the signal's control of behavior is via a within-chain mediational process.     

Competition between a Simultaneous and a Serial Feature in Appetitive Feature positive and Feature negative Discriminations

Two experiments with rats examined competition between simultaneous and serial features for behavioural control in an appetitive discrimination. In Experiment 1, an auditory target was reinforced when presented in isolation. For different groups, the target was non-reinforced when simultaneously accompanied by a visual feature (first group), when preceded by a serial visual feature (second group), or when both accompanied by a simultaneous feature and preceded by a serial feature (third group). Tests performed after discrimination learning revealed inhibitory control by the simultaneous feature in the first group and by the serial feature in the second group. In the third group, the simultaneous feature acquired inhibitory control over the target in isolation, whereas the serial feature did not. However, the serial feature further reduced responding to the target-simultaneous feature compound relative to responding shown to the compound in isolation. In Experiment 2, the same training procedure was used in three groups as in Experiment 1, except that the target was nonreinforced in isolation and reinforced in the presence of a simultaneous and/or serial feature. Tests revealed that the feature acquired excitatory control in the first and second groups. In the third group, both features acquired excitatory control, although the control exerted by the simultaneous feature was less strong than that observed in the group trained with only the simultaneous feature. The theoretical implications of these results regarding competition between occasion setters and Pavlovian excitors and inhibitors were discussed.     

Establishing discriminative stimulus control within generalized oddity performance,without reinforcement

In two oddity learning studies with children, subjects were reinforced for oddity (or nonoddity) responding on line-tilt or dot numerosity problems. Interposed form and color problems were not reinforced. No instructions to make oddity choices were given. In Experiment I it was found that reinforcement for oddity or nonoddity responding on tilt and numerosity problems produced the corresponding tendency toward oddity or nonoddity performance on these problems and also on the nonreinforced form and color problems. These results show a generalized oddity phenomenon similar to generalized imitation. In Experiment II a third type of nonreinforced problem was presented in this same format: compound stimuli permitting either a color or a form solution. It was found that immediate prior training with nonreinforced form problems, interpolated among the reinforced tilt and numerosity problems, led to form-oddity choices in the compound problems. Similarily, color pretraining produced color-oddity choices. These results show that selective discriminative stimulus control can be obtained in oddity learning, without reinforcement for choices on either of the two dimensions involved.     

The effects of single-component extinction of a three-component serial CS on resistance to extinction of the conditioned avoidance response

Central to a fear interpretation of how avoidance responses are maintained in the absence of further CS-UCS pairings is the underlying assumption of an existing gradient of fear across the CS-UCS interval. Extrapolations based on this gradient lead to a number of differential predictions concerning the topography of avoidance responding during extinction. The present research was concerned with the differential effects of extinguishing separate components of the CS complex upon responding to the complete CS complex during extinction. In Phase 1 of the study, rats were classically conditioned to a three-component serial CS (S₁/S₂/S₃) followed by shock. Each subject was then given avoidance training in a one-way apparatus to a criterion of one successful avoidance. In Phase 2, subjects were divided into four groups, with three of the groups receiving nonreinforced exposure for 25 trials to one of the components of the serial CS (S₁, S₂, or S₃). The fourth group (S₀) was exposed for the same period of time to the apparatus cues. In Phase 3, the total stimulus complex was reintroduced in its original order, and animals were tested until extinction of the instrumental response was reached. The results are consistent with the hypothesis that a fear gradient exists in extinction and decreases in magnitude as the distance from the point of UCS onset increases.     

The role of local context in autoshaping

Three experiments used an autoshaping procedure with pigeons to examine the effects of nonreinforced, nontarget stimuli (ITI-fillers) during the intertrial interval on responding to a reinforced target CS. Experiment 1 replicated a previous demonstration that an ITI-filler that occupied a substantial portion of the ITI attenuated responding to the target CS relative to a group trained with a similar ITI but lacking the ITI-filler. Experiment 2 found that the superiority of responding typically found with a long ITI relative to a short ITI, that is, the trial-spacing effect, can be reversed by imposing a filler stimulus during the ITI in the former condition. Experiment 3, using a within-subject design, found that when one background stimulus condition occupied a majority of the interreinforcement interval, pairings of one target CS with reinforcement that were embedded within this background condition, that is, a long duration local context occurred for this CS, yielded better performance that a second, reinforced, target CS paired with reinforcement in the shorter duration background condition. These results confirmed predictions derived from a local context view of cycle time. Comparator theories of classical conditioning require incorporation of this notion into their conceptualization of effective cycle time in order to explain the present findings.     

Contextual control of the extinction of conditioned fear

Rats received 15 pairings of a CS and shock in one context, and then a series of CS-alone trials in a second context. Even though this extinction procedure produced a complete loss of conditioned suppression, when the animals were returned to the site of original conditioning, suppression was renewed to a level comparable to that of animals that had not undergone extinction. Controls indicated that the renewed suppression was not due solely to pseudoconditioning, suggesting that the CS-US association had survived extinction. Renewed suppression was also demonstrated in a third context that was never associated with shock. Loss of suppression did not necessarily depend upon inhibitory conditioning of the extinction context. The data suggest that extinction of conditioned fear is specific to the context in which it occurs. They also suggest the possibility that animals might discriminate episodes in which a CS is reinforced and nonreinforced independently of the excitatory or inhibitory status of cues, like contextual stimuli, that are coincidentally present during those episodes.     

Counterconditioning of appetitive and defensive CRs in rabbits

Two experiments examined interactions between conditioned appetitive and defensive responses in the rabbit. In Experiment I, a conditioned jaw-movement response was established by following presentations of a clicker CS with intra-oral sucrose delivery on 50% of trials. The jaw-movement response was then maintained on this partial reinforcement schedule during a counterconditioning phase. A group which received para-orbital shock paired with the CS on non-sucrose trials showed acquisition of eyeblink responding and suppression of jaw-movement responding to the CS, in comparison to control groups which received either no shock or unpaired presentations of the CS and shock. Experiment II was identical in design to Experiment I except that the roles of the sucrose and shock reinforcers were reversed. The paired group acquired a conditioned jaw-movement response when sucrose was added in the counterconditioning phase, but in contrast to Experiment I showed a slight enhancement of the previously established eyeblink response. The asymmetry of appetitive and defensive counterconditioning was discussed in relation to opponent-process theories of motivation and reinforcement.     

Within-compound associations between the context and the conditioned stimulus

Three experiments were conducted to test for the presence of associations between contextual cues and the nominal conditioned stimulus (CS) in fear conditioning. Rats were given tone-footshock pairings and were tested for their fear of the nominal CS, the tone, in a different context. Experiments 1 and 2 demonstrated that rats given nonreinforced exposure to the training context following conditioning were less fearful of the CS. Experiment 3 indicated that additional footshock presentations in the training context following conditioning produced greater fear of the CS. In both procedures postconditioning treatments designed to directly alter only the associative strength of the training context yielded parallel changes in the conditioned response to the CS. These data suggest that within-compound associations are formed between the context and the CS during classical conditioning.     

A comparison of pecking generated by serial, delay, and trace autoshaping procedures

Pigeons were exposed to serial, delay, and trace autoshaping procedures. In Experiment I, all conditioned stimuli (CSs) were changes in illumination of the response key. The number of trials to acquisition of the keypeck increased from serial, to 4-sec delay, 8-sec delay, and 8-sec trace procedures, in that order. In Experiment II, which used a longer intertrial interval, trials to criterion increased from 8-sec delay, to 28-sec delay, 8-sec trace, and 28-sec trace procedures, in that order. In Experiment III, two groups received serial procedures in which the first CS was either a tone or a houselight, and the second was a keylight. The tone group acquired the key peck more rapidly than the houselight group. Early in conditioning in these experiments, and when the conditioned stimulus was a change in the keylight, there was a short latency to the onset of pecking and pecking was directed at the CS. After extensive conditioning, or when the CS was relatively diffuse, pecking still occurred, but had a longer latency and was not reliably directed toward the conditioned stimulus.     

Memories and anticipations control responding by rats (<Emphasis Type="Italic">Rattus norvegicus</Emphasis>) in a Pavlovian procedure

In Experiment 1 each rat received two different fixed series of three trials each. The unconditioned stimulus occurred on Trial 1 of one series and on Trial 3 of the other series, all other trials being nonreinforced. Previous Pavlovian investigations have shown that rats can remember the immediately prior reward outcome and anticipate the immediately subsequent reward outcome. Experiment 1 demonstrated that rats could remember and anticipate even more remote reward outcomes. In Experiment 2 two groups received a series of two nonrewarded trials followed by a rewarded trial. It was demonstrated that a change in the conditioned stimulus (CS) from Trial 2 to Trial 3, which occurred in one group, produced weaker responding than in the other group that did not experience such CS change. On the basis of these findings it was suggested that the rats organized the trials of a series into a unit or chunk. This was concluded for two reasons. First, remembering and anticipating remote reward outcomes strongly suggests that responding is being controlled by events extending beyond the current trial. Secondly, the experimental manipulations employed in the Pavlovian situation here are similar to those used in prior human learning and animal instrumental learning investigations concerned with chunking. Thus, it would appear that chunking is a ubiquitous phenomenon appearing in human serial learning (e.g., Bower and Winzenz 1969; Crowder 1976), in animal instrumental learning (e.g., Capaldi 1992; Hulse and Dorsky 1977; Terrace 1987), and now in Pavlovian learning.     

Extensive extinction in multiple contexts eliminates the renewal of conditioned fear in rats

Two studies examined whether nonreinforcement of a stimulus in multiple contexts, instead of a single context, would decrease renewal of conditioned fear in rats (as assessed by conditioned suppression of lever pressing). In Experiment 1, renewal was measured after 36 nonreinforced CS trials delivered during six extinction sessions in a single context or two extinction sessions in each of three different contexts. The number of extinction contexts did not have an effect on renewal. In Experiment 2, groups received either 36 or 144 nonreinforced CS trials during six or twenty-four extinction sessions in a single context or three different contexts. Again, renewal was not influenced by the number of extinction contexts when only 36 trials were given. However, when 144 trials were used, renewal was completely eliminated when extinction was divided between 3 contexts, but was not weakened when the sessions took place in a single context. The results suggest that the use of multiple treatment settings in exposure-based therapies is only likely to reduce relapse if a sufficient number of sessions are provided in each of the treatment settings.     

Blocking and unblocking of conditioned analgesia

Two experiments with rat subjects assessed the blocking phenomenon using inhibition of responding to painful thermal stimulation as an index of conditioned analgesia established through conditioned stimulus (CS)-shock pairings. In Experiment 1, a group of rats receiving the standard blocking procedure ($\text{A+}\text{AB+}$) showed shorter response latencies during a hot plate test of pain sensitivity in the presence of the added CS than groups of rats receiving various blocking control procedures. Experiment 2 replicated the blocking outcome of Experiment 1 and also demonstrated that the addition of a second shock unconditioned stimulus (US) during the compound conditioning phase attenuated the blocking effect; i.e., unblocking was observed. However, the deletion of a second shock US during compound conditioning in a group that had received two shocks on each trial in the first phase of the experiment failed to result in unblocking. These data extend the associative account of conditioned analgesia to situations involving stimulus selection and the implications for the analysis of aversive learning are discussed.     

Food delivery as a conditional stimulus: Feature-learning and memory in pigeons

Three experiments investigated the learning and memory of discriminations based on presence versus absence of a pre-trial food delivery. In Experiment 1 half the illuminations of a response key were followed by food regardless of the subject's behavior. In one group an extra food delivery preceded only reinforced trials (feature-positive condition), whereas in a second group it preceded only nonreinforced trials (feature-negative condition). Key pecks and approaches revealed more rapid and superior discrimination learning in the first group. Experiment 2 replicated the results of Experiment 1 but yielded no evidence that greater “unexpectedness” of pretrial food conditions facilitates discriminative performance. In Experiment 3, individual pigeons trained on a conditional discrimination exhibited a within-subject feature-positive superiority. Delay between pretrial and trial stimuli interacted with feature-positive versus feature-negative training in both the between-group (Experiment 2) and within-subject (Experiment 3) procedures: performance was decremented at both short and long delays in the feature-positive condition but was decremented only at longer delays in the feature-negative condition. The feature-positive superiority obtained here is incompatible with explanations based on either the general concept of “perceptual organization” or on the conditional nature of feature-negative discriminations.     

Spontaneous configuring in conditioned flavor aversion

A series of experiments investigated spontaneous configuring using the conditioned flavor aversion paradigm with rat subjects. In Experiment 1, extended training of a two-flavor compound stimulus did not produce spontaneous differentiation of conditioned responding to that compound and its elements. In Experiment 2 we found that extended nonreinforced exposure to a compound stimulus generated spontaneous element-compound differentiation when the elements were later conditioned. Rats that received extended preexposure to the compound showed less conditioned responding to the compound than to either of its elements. However, rats that had not received preexposure to the compound showed greater conditioned responding to the compound than to either of its elements (summation). In Experiment 3, nonreinforced preexposure to the compound stimulus prior to minimal reinforced compound training produced spontaneous compound-element differentiation, but extended reinforced compound training eliminated that differentiation. In Experiment 4, extended partial reinforcement training with a compound produced differentiation of the compound from its elements. Implications of these data for the mechanisms responsible for spontaneous configuring and for the summation assumptions common to most learning theories are discussed.