An assessment of the role of handling cues in "spontaneous recovery" after extinction

Three experiments examined the assertion that presession handling cues that accompany training with reinforcement might account for spontaneous recovery when they reoccur following extinction. In Experiment 1, after extensive training on a variable-interval schedule, key pecking in pigeons was extinguished following either normal or distinctively different handling and transportational cues. Those cues resulted in enhanced spontaneous recovery 24 hr later when normal cues were reinstated. In Experiment 2, however, subjects tested following the normal handling cues showed no more spontaneous recovery than did subjects that spent the entire extinction-test interval in the experimental chambers and thus were tested without handling cues altogether. In Experiment 3, a group whose test for recovery began 10 min after being placed in the chambers yielded as much spontaneous recovery as did a group tested normally. Furthermore, a group for which extinction began at mid-session and for which handling therefore could not be a discriminative cue for extinction showed no more spontaneous recovery than did the other two groups. Handling cues thus contributed to spontaneous recovery only after explicit discrimination training, as provided in Experiment 1.     

EFFECTS OF D‐AMPHETAMINE IN A TEMPORAL DISCRIMINATION PROCEDURE: SELECTIVE CHANGES IN TIMING OR RATE DEPENDENCY?

Two experiments evaluated rate dependency and a neuropharmacological model of timing as explanations of the effects of amphetamine on behavior under discriminative control by time. Four pigeons pecked keys during 60-trial sessions. On each trial, the houselight was lit for a particular duration (5 to 30 s), and then the key was lit for 30 s. In Experiment 1, the key could be lit either green or blue. If the key was lit green and the sample was 30 s, or if the key was lit blue and the sample was 5 s, pecks produced food on a variable-interval 20-s schedule. The rate of key pecking increased as a function of sample duration when the key was green and decreased as a function of sample duration when the key was blue. Acute d-amphetamine (0.1 to 3.0 mg/kg) decreased higher rates of key pecking and increased lower rates of key pecking as predicted by rate dependency, but did not shift the timing functions leftward (toward overestimation) as predicted by the neuropharmacological model. These results were replicated in Experiment 2, in which the key was lit only one color during sessions, indicating that the effects were not likely due to disruption of discriminative control by key color. These results are thus consistent with rate dependency but not with the predictions of the neuropharmacological model.     

Resurgence of temporal patterns of responding

The resurgence of temporal patterns of key pecking by pigeons was investigated in two experiments. In Experiment 1, positively accelerated and linear patterns of responding were established on one key under a discrete-trial multiple fixed-interval variable-interval schedule. Subsequently, only responses on a second key produced reinforcers according to a variable-interval schedule. When reinforcement on the second key was discontinued, positively accelerated and linear response patterns resurged on the first key, in the presence of the stimuli previously correlated with the fixed- and variable-interval schedules, respectively. In Experiment 2, resurgence was assessed after temporal patterns were directly reinforced. Initially, responding was reinforced if it approximated an algorithm-defined temporal pattern during trials. Subsequently, reinforcement depended on pausing during trials and, when it was discontinued, resurgence of previously reinforced patterns occurred for each pigeon and for 2 of 3 pigeons during a replication. The results of both experiments demonstrate the resurgence of temporally organized responding and replicate and extend previous findings on resurgence of discrete responses and spatial response sequences.     

Temporal discrimination and a free-operant psychophysical procedure.

Pigeons were presented a series of keylight time periods (separated by blackouts) during which two response keys were lit, one by blue light and the other either by orange or green. Blue-key responses changed the color on the other key. Orange-key responses sometimes produced food during the first half of a time period; green-key responses sometimes produced food during the second half. In three experiments, the probability of a green-key response increased as a function of elapsed time. Experiment 1 compared performance when the duration of the keylight periods was varied across a wide range. Discrimination of performance was similar across the range of durations. Experiment 2 varied both relative reinforcement rate and the local reinforcement rate for orange-key and green-key responses. These manipulations produced changes in response bias but not discrimination sensitivity. Experiment 3 varied the local temporal placement of reinforcers within time periods and demonstrated that choice behavior was affected by differential reinforcement at different points during the time periods. The results were consistent with previous research on duration discrimination that used psychophysical trials procedures.     

The role of intermittent food in the induction of attack in pigeons

The present experiments evaluated whether transitions in reinforcer probability are necessary to induce attack in pigeons. In Experiment I, three of six pigeons exposed to response-contingent constant-probability food schedules and a photograph of a conspecific as a target exhibited sustained postreinforcement attack on the target. The postreinforcement pattern of attack developed over the course of the experiment and was accompanied by a reduction in the rate of postreinforcement key pecking and an increase in the postreinforcement pause in key pecking. These effects on key pecking resulted in unprogrammed variations in the probability of reinforcement which may have been responsible for the induction of attack. In Experiment II, the attack-inducing properties of a constant-probability response-independent food schedule were compared to a periodic food schedule matched for overall rate of food delivery and to a no-food condition. In addition to attack, the spatial location of the subjects was monitored during each interfood interval. The periodic and aperiodic food schedules generated very different patterns of spatial location. Postfood attack was induced by both food schedules, although the constant-probability schedule induced attack in fewer birds. The no-food condition was not effective in inducing attack in any birds. These experiments indicate that intermittent food schedules without reductions in reinforcer probability are sufficient to induce attack in some pigeons, although not as effective as schedules with transitions in reinforcer probability.     

Positive and negative conditioned suppression in the pigeon: Effects of the locus and modality of the CS

In Experiment I, four pigeons were exposed to trials in which a 12-sec key light illumination was followed by free food. These trials were superimposed upon a baseline of key pecking for food reinforcement on a variable-interval schedule. When the signal for food was on the operant key, response rate was substantially higher during the signal than during the baseline procedure. When the signal was on a second, signal key, operant responding was suppressed during the signal and substantial pecking of the signal key occurred. The sum of signal key and operant key pecks far exceeded the operant baseline rate of responding. An explanation of opposite results obtained with rats and pigeons as subjects in experiments of this type was suggested in terms of the spatial relation between the signal for free food and the operant target which usually characterizes these experiments. Experiment II assessed the importance of signal location when shock rather than food was the US. Suppression of operant key pecking was unaffected by signal location. Experiment III assessed the relative effectiveness of visual and auditory stimuli (clicks) as signals for food and shock, and found that all combinations of signal and US were equally effective in suppressing operant key responding. The three experiments together suggested that the identification of important effects of species—typical behavior in one experimental situation does not imply that there will be like effects in similar situations.     

No evidence for overshadowing or facilitation of spatial pattern learning by visual cues

Two experiments were conducted to examine the effects of redundant and relevant visual cues on spatial pattern learning. Rats searched for hidden food items on the tops of poles that formed a square (Experiment 1) or a checkerboard (Experiment 2) pattern. The experimental groups were trained with visual cues that specified the locations of the baited poles. All groups were tested without visual cues so that any overshadowing or facilitation of spatial pattern learning by visual cues could be detected. Spatial choices were controlled by the spatial pattern and by the visual cues in both experiments. However, there was no evidence of overshadowing or facilitation of spatial pattern learning by visual cues in either experiment. The results are consistent with the idea that the representation of the spatial pattern that guides choices is not controlled by the same learning processes as those that produce associations between visual cues and food locations.     

Observational learning of a conditional hue discrimination in pigeons

Three experiments examined a relationship between cooperation and observational learning in pigeons using procedures similar to Skinner (1962). In Experiment 1, dyads cooperated by searching and pecking nearly simultaneously on the correct pair of adjacent keys of a 2 × 2 matrix. The dyads learned to search for the correct keys in a coordinated fashion, but only if they were permitted to watch one another's performance. Experiment 2 disconfirmed the hypothesis that the coordinated performance of cooperating pigeons reflects an unlearned response tendency to peck at locations close to where the other bird is pecking. Experiment 3 demonstrated that prior cooperation training involving an observer and demonstrator pigeon facilitated subsequent observational learning of a conditional hue discrimination. Cooperation training appeared to facilitate observational learning by establishing the demonstrator's peck response as an instructional stimulus which indicated the reward significance of the discriminative stimuli.     

Training attention: Interactions between central cues and reflexive attention

Three experiments are reported in which we investigate whether the recently reported interactions between central cues (e.g., arrows) and reflexive attention are attributable to the overlearned spatial properties of certain central cues. In all three experiments, a nonpredictive cue with arbitrary spatial properties (a colour patch) is presented prior to a detection target in the left or right visual field. Reaction times to detect targets are compared before and after a training session in which participants are trained to associate each colour patch with left and right space, either via a target detection task in which colour predicts target location 100% of the time (Experiments 1 and 3), or via a left/right motor movement as a function of colour (Experiments 2 and 3). In the first two experiments, a small but highly significant training effect is observed. Participants are approximately 10 ms faster to detect targets at congruent locations relative to incongruent locations after training relative to before training, despite the fact that cue colour was nonpredictive during the test sessions. In Experiment 3, the length of the training session is increased and the magnitude of the training effect also increases as a result. Implications for the interaction between central cues and reflexive attention, as well as premotor theory of attention, are discussed.     

MATCHING-TO-SAMPLE PERFORMANCE IN RATS: A CASE OF MISTAKEN IDENTITY?

Three rats had previously acquired a simultaneous matching-to-sample performance with steady and blinking lights. In training, the sample stimulus had always appeared on the middle of three horizontally arranged keys with the comparison stimuli on the side keys. In Experiment 1, the sample stimulus appeared on any of the three keys with the comparison stimuli on the remaining two. The matching-to-sample performance broke down with variable sample and comparison locations; the sample stimulus did not control responding to the comparison stimuli when it appeared on a side key, but it retained control when it appeared on the middle key (as in training). In Experiment 2, the rats were trained with the sample always on the left key. When the sample appeared on either of the trained locations (left or middle key), it retained control for both locations. When the sample then appeared on any of the three keys, as in Experiment 1, sample control did not transfer to the untrained location (right key). The experiments demonstrate that training with fixed sample and comparison locations may establish spatial location as an additional controlling aspect of the stimuli displayed on the keys; stimulus location had become part of the definition of the controlling stimuli. The rats' performance seemed best described as specific discriminations involving the visual stimuli and their spatial locations rather than as identity matching.     

Punishment of observing by the negative discriminative stimulus

To determine the effect of a negative discriminative stimulus on the response producing it, two pigeons were each studied in a three-key conditioning chamber. During alternating periods of unpredictable duration, pecking the center (food) key either was reinforced with grain on a variable-interval schedule or was never reinforced. On equal but independent variable-interval schedules, pecking either of the side (observing) keys changed the color of all keys for 30 sec from yellow to either green or red. When the schedule on the center key was variable-interval reinforcement, the color was green (positive discriminative stimulus); when no reinforcements were scheduled, the color was red (negative discriminative stimulus). Since pecking the side keys did not affect grain deliveries, changes in the rate of pecking could not be ascribed to changes in the frequency of primary reinforcement. In subsequent sessions, red was withheld as one of the possible consequences of pecking a given side key. When red was omitted, the rate on that key increased, and when red was restored, the rate decreased. It was concluded that red illumination of the keys, the negative discriminative stimulus, had a suppressive effect on the response that produced it.     

Effect of delay-interval stimuli on delayed symbolic matching to sample in the pigeon

In Experiment 1, food-deprived pigeons received delayed symbolic matching to sample training in a darkened Skinner box. Trials began with the illumination of the grain feeder lamp (no food sample), or illumination of this lamp, accompanied by the raising of the feeder tray (food sample). After a delay of a few seconds, the two side response keys were illuminated, one with red and one with green light, with positions counterbalanced over trials. Pecking the red (green) comparison produced grain reinforcement if the trial had started with food (no food); pecking red after a no-food sample or green after a food sample was not reinforced. Once matching performance was stable, four stimuli were presented during the delay interval, and their effects on matching accuracy were evaluated. Both illumination of the houselight and the center key with white geometric forms decreased matching accuracy, whereas presentation of a tone and vibration of the test chamber did not. In Experiment 2, pecking the red center key was reinforced with food according to a variable interval schedule. The effects of occasional brief presentations of the four stimuli used in the first experiment on ongoing pecking were assessed. The houselight and form disturbed key pecking, but the tone and vibration did not. Thus, stimuli that interfered with delayed matching also interfered with simple operant behavior. Implications of these results for theories of remembering are discussed.     

Resistance To Change As A Function Of Stimulus-reinforcer And Location-reinforcer Contingencies

Pigeons responded on two keys in each component of a multiple concurrent schedule. In one series of conditions the distribution of reinforcers between keys within one component was varied so as to produce changes in ratios of reinforcer totals for key locations when summed across components. In a second series, reinforcer allocation between components was varied so as to produce changes in ratios of reinforcer totals for components, summed across key locations. In each condition, resistance to change was assessed by presenting response-independent reinforcers during intercomponent blackouts and (for the first series) by extinction of responding on both keys in both components. Resistance to change for response totals within a component was always greater for the component with the larger total reinforcer rate. However, resistance to change for response totals at a key location was not a positive function of total reinforcement for pecking that key; indeed, relative resistance to extinction for the two locations showed a weak negative relation to ratios of reinforcer totals for key location. These results confirm the determination of resistance to change by stimulus—reinforcer contingencies.     

On the directionality of key pecking during signals for appetitive and aversive events

Pigeons were exposed to a signal paired with either blackout or blackout plus shock and to another signal paired with food superimposed on a baseline of concurrent variable-interval reinforcement of pecks on two keys. The signals were changes of color of one of the two keys. The rate of pecking both keys during the signal paired with blackout or blackout plus shock was lower than the baseline rate of pecking (a conditioned emotional response), but the decrease in pecking was greater on the signal key. When the intensity of shock was increased, the rate of pecking did not decrease further on the signal key but did decrease on the other key. Rate of pecking during the signal paired with food increased sharply on the signal key (an autoshaping effect) and decreased sharply on the other key. These results support a view that there are two effects of the interaction between classical and instrumental conditioning, a stimulus-directed effect and a generalemotional effect.     

Pigeons' spatial memory: factors affecting delayed matching of key location.

The delayed-matching-to-sample procedure was modified to study pigeons' spatial memory. Nine pecking keys, arranged as a three-by-three matrix, served as the spatial cues. Trials began with a brief "ready" stimulus (dimming of the houselight). Then a randomly chosen key was lit briefly as a sample. After a short delay the sample key was lit again along with one of the other eight keys. A peck at the key that had served as the sample produced grain reinforcement, where as a peck to the other key produced only the intertrial interval. After delayed matching of key location was learned, the effects of sample and delay duration, number of keys illuminated as sample and comparisons, and organization of three-key samples were studied. Matching accuracy decreased as sample duration decreased, delay increased, the number of locations serving as samples increased, the number and proximity of comparisons increased, and when the three-key samples were "discontinuous" rather than "lines".     

Cued and uncued terminal links in concurrent-chains schedules

Pigeons were trained on a concurrent-chains schedule. The initial links were concurrent variable-interval schedules arranged on two side keys. Each terminal link was a fixed-interval schedule arranged on the center key. In cued conditions, different center-key colors signaled the two terminal-link schedules. In uncued conditions, the same center-key color appeared for both terminal links. Experiment 1 arranged unequal initial links and equal terminal links. Preference for the shorter initial-link schedule was greater when the terminal links were uncued. Experiment 2 arranged equal initial links and unequal terminal links. Preference for the shorter terminal-link schedule was greater when the terminal links were cued. Although the results of Experiment 2 successfully replicated previous research, the results of Experiment 1 are not easily reconciled with conditioned-reinforcement or discriminative-stimulus accounts of the role of terminal-link cues. Rather, terminal-link cues appear to decrease sensitivity to initial-link contingencies.     

The role of preliminary magazine training in acquisition of the autoshaped key peck

A series of experiments tested the hypothesis that initial key pecks in the autoshaping procedure are generalized pecks at the illuminated grain hopper. Experiment I found that autoshaping readily occurred when the chamber was continuously illuminated by a house-light. In Experiment II, pigeons given magazine training and autoshaping with an unlighted grain hopper failed to autoshape in 200 trials. Acquisition of autoshaped key pecking was retarded in Experiment III when stimulus control by the magazine light was reduced. In the fourth study, pigeons were given magazine training with either a red or white magazine light and then given autoshaping with concurrently presented red and white keys. For all pigeons in this experiment, the first key peck occurred on the key of the same color as that pigeon's magazine light. The results of these experiments were interpreted as supporting an account of autoshaping that identifies initial key pecks as arising due to generalization of pecking at the lighted grain hopper to pecking at the lighted key.     

Delay or rate of food delivery as determiners of response rate

Pigeons were confronted with two keys: a green food key and a white changeover key. Food became available for a peck to the green key after variable intervals of time (mean = 113 seconds). A single peck on the changeover key changed the color of the food key to red for a fixed period of time during which the timing of the variable-interval schedule in green was suspended and the switching option eliminated and after which the conditions associated with green were reinstated. In Experiment 1 a single food presentation was obtainable during each red-key period after a minimum delay timed from the switch. This delay and the duration of the red-key period were held constant during a condition but varied between conditions (delay = 2.5, 7.5, 15, or 30 seconds; red-period duration = 30, 60, 120, 240, or 480 seconds). In Experiment 2 additional food presentations were scheduled during a 240-second red-key period with the delay to the first food delivery held constant at 30 seconds, and the delays to later food deliveries varied over conditions. Considering the data from both experiments, the rate of switching to red was a decreasing function of the delay to the first food, the delay to the second food, and perhaps the delay to the third food after a switch. There was no clear evidence that the rate of food in the red-key period made an independent contribution. The ordering of response rates among conditions was consistent with the view that each food presentation after a response adds an incremental effect to the rate of the response and that each food presentation's contribution is a decreasing function of its delay timed from the response.     

Mechanisms underlying the effects of unsignaled delayed reinforcement on key pecking of pigeons under variable-interval schedules.

Three experiments were conducted to test an interpretation of the response-rate-reducing effects of unsignaled nonresetting delays to reinforcement in pigeons. According to this interpretation, rates of key pecking decrease under these conditions because key pecks alternate with hopper-observing behavior. In Experiment 1, 4 pigeons pecked a food key that raised the hopper provided that pecks on a different variable-interval-schedule key met the requirements of a variable-interval 60-s schedule. The stimuli associated with the availability of the hopper (i.e., houselight and keylight off, food key illuminated, feedback following food-key pecks) were gradually removed across phases while the dependent relation between hopper availability and variable-interval-schedule key pecks was maintained. Rates of pecking the variable-interval-schedule key decreased to low levels and rates of food-key pecks increased when variable-interval-schedule key pecks did not produce hopper-correlated stimuli. In Experiment 2, pigeons initially pecked a single key under a variable-interval 60-s schedule. Then the dependent relation between hopper presentation and key pecks was eliminated by arranging a variable-time 60-s schedule. When rates of pecking had decreased to low levels, conditions were changed so that pecks during the final 5 s of each interval changed the keylight color from green to amber. When pecking produced these hopper-correlated stimuli, pecking occurred at high rates, despite the absence of a peck-food dependency. When peck-produced changes in keylight color were uncorrelated with food, rates of pecking fell to low levels. In Experiment 3, details (obtained delays, interresponse-time distributions, eating times) of the transition from high to low response rates produced by the introduction of a 3-s unsignaled delay were tracked from session to session in 3 pigeons that had been initially trained to peck under a conventional variable-interval 60-s schedule. Decreases in response rates soon after the transition to delayed reinforcement were accompanied by decreases in eating times and alterations in interresponse-time distributions. As response rates decreased and became stable, eating times increased and their variability decreased. These findings support an interpretation of the effects of delayed reinforcement that emphasizes the importance of hopper-observing behavior.     

Choice between response units: The rate constancy model

In a conjoint schedule, reinforcement is available simultaneously on two or more schedules for the same response. The present experiments provided food for key pecking on both a random-interval and a differential-reinforcement-of-low-rate (DRL) schedule. Experiment 1 involved ordinary DRL schedules; Experiment 2 added an external stimulus to indicate when the required interresponse time had elapsed. In both experiments, the potential reinforcer frequency from each component was varied by means of a second-order fixed-ratio schedule, and the DRL time parameter was changed as well. Response rates were described by a model stating that time allocation to each component matches the relative frequency of reinforcement for that component. When spending time in a given component, the subject is assumed to respond at the rate characteristic of baseline performance. This model appeared preferable to the absolute-rate version of the matching law. The model was shown to be applicable to multiple-response concurrent schedules as well as to conjoint schedules, and it described some of the necessary conditions for response matching, undermatching, and bias. In addition, the pigeons did not optimize reinforcer frequency.