Effects of d-amphetamine, diazepam, and pentobarbital on the schedule-controlled pecking and locomotor activity of pigeons

Pigeons were trained on a variant of the autoshaping procedure devised by Matthews and Lerer (1987) in which a keylight stimulus ramp of increasing brightness signaled the passing of a 30-s interfood interval. This procedure generates two distinct behavioral components: key pecking and locomotor activity. The effects of three psychoactive drugs on these behavior classes were measured. d-Amphetamine had negligible effects on both types of behavior, whereas diazepam and pentobartital increased key pecking and decreased activity in a dose-dependent fashion. In Experiment 2, the possibility that drug effects were suppressed by excessively strong stimulus control exerted in Experiment 1 was tested by decreasing the discriminability of the stimulus ramp. The direction of the effects of diazepam and pentobarbital was the same as in Experiment 1 but the magnitude of the effects tended to be larger. The effects of d-amphetamine, however, remained quite small, suggesting that, under these conditions, locomotor activity and key pecking are less sensitive to d-amphetamine. In Experiments 3 and 4, key pecking was eliminated by removing the keylight. Reinforcers were presented at fixed intervals in Experiment 3 and at variable intervals in Experiment 4. The drug effects on activity observed in Experiments 1 and 2 disappeared in both Experiments 3 and 4. The results suggest that diazepam and pentobarbital affect activity indirectly by increasing key-pecking behavior, which, in turn, competitively decreases activity.     

Control of pigeons' pecking by trace stimuli

In Experiment I, pigeons' pecking a white key was reinforced with grain when white was immediately preceded by a vertical white line on a green surround, but not by green alone. This procedure produced control of pecking by the line. Next, pecking white was reinforced after vertical line on green, but not after green alone or other orientations of the white line on green. The line-tilt dimension initially did not control pecking, a result that showed that interdimensional (line versus no line) training does not always result in dimensional control. Line-tilt control was eventually established but was accompanied by a decrease in interdimensional control. In Experiment II, interdimensional training, with or without a trace interval intervening between line on green or green alone and white, was followed by tests for line-tilt control. While interdimensional control was unaffected by the trace interval, line-tilt control tended to be less with the trace interval. This dissociation of interdimensional and dimensional control, as well as the failure of interdimensional training to produce dimensional control in Experiment I, suggests that the line stimulus is multidimensional.     

Analyzing the random control procedure: Effects of paired and unpaired CSs and USs on autoshaping the chick's key peck with heat reinforcement

A series of five experiments using a total of 264 subjects investigated the effects of paired and unpaired key light (CS) and heat (US) stimuli on autoshaping the chick's key peck. Experiment 1 established that paired presentations of CS and US promoted a more rapid rise in key pecking than did randomly presented CSs and USs and that the specific sequence of stimuli under the random control procedure affected key pecking performance. Experiment 2 used a trace conditioning procedure to determine the role of the CS-US interval on autoshaping and to define empirically unpaired CSs and USs. Key pecking declined as the trace delay interval was increased from 0 to 25 sec; at 25 sec, no conditioning of key pecking occurred. Experiments 3–5 assessed the effects on autoshaped key pecking of (a) number of daily CS-US pairings, (b) added unpaired CS presentations, and (c) added unpaired US presentations, since paired and random control schedules differed in all of these respects. Reduction in the number of CS-US pairings slowed the acquisition of key pecking as did the concurrent addition of nonreinforced CSs and unsignaled USs. These results support theories of association formation that stress the effects of both paired and unpaired CSs and USs.     

A comparison of pecking generated by serial, delay, and trace autoshaping procedures

Pigeons were exposed to serial, delay, and trace autoshaping procedures. In Experiment I, all conditioned stimuli (CSs) were changes in illumination of the response key. The number of trials to acquisition of the keypeck increased from serial, to 4-sec delay, 8-sec delay, and 8-sec trace procedures, in that order. In Experiment II, which used a longer intertrial interval, trials to criterion increased from 8-sec delay, to 28-sec delay, 8-sec trace, and 28-sec trace procedures, in that order. In Experiment III, two groups received serial procedures in which the first CS was either a tone or a houselight, and the second was a keylight. The tone group acquired the key peck more rapidly than the houselight group. Early in conditioning in these experiments, and when the conditioned stimulus was a change in the keylight, there was a short latency to the onset of pecking and pecking was directed at the CS. After extensive conditioning, or when the CS was relatively diffuse, pecking still occurred, but had a longer latency and was not reliably directed toward the conditioned stimulus.     

Key pecking in pigeons produced by pairing keylight with inaccessible grain

In Experiment I, keylight was paired with inaccessible grain delivery (under two conditions of keylight intensity) to determine if autoshaping would occur in the absence of primary reinforcement. In Experiment II, the procedure was repeated with accessible grain, for comparison. In Experiment III, the procedures were repeated with explicitly unpaired presentations of keylight and either inaccessible or accessible grain. The results indicated that key pecking occurred as quickly in the presence of keylight pairings with inaccessible grain as with accessible grain, though (except for one bird) key pecking was not maintained with inaccessible grain. Furthermore, compared to the dim keylight, the bright keylight greatly suppressed key pecking when paired with inaccessible grain, and reduced the rate of key pecking when paired with accessible grain. Little key pecking occurred in groups exposed to explicitly unpaired presentations of keylight (whether bright or dim) and grain (whether accessible or inaccessible). When the birds in Experiment III were retested with explicitly paired presentations of keylight and grain, little key pecking was observed, suggesting suppressive effects of prior explicitly unpaired presentations. It is suggested that the effects of key-brightness manipulation were produced by the association of grain with cues other than the response key, or by distraction produced by partial illumination of the grain hopper.     

Recency, repeatability, and reinforcer retrenchment: an experimental analysis of resurgence

Four experiments were conducted with pigeons to assess the experimental conditions necessary for the occurrence of resurgence. The general procedure consisted of the following conditions: Condition 1--reinforcement of key pecking; Condition 2--reinforcement of treadle pressing and concurrent extinction of key pecking; and Condition 3--the resurgence condition wherein resurgence was defined as the recovery of key pecking. In Experiments 1 and 2, the resurgence condition was conventional extinction. The effect of recency on resurgence magnitude was examined in Experiment 1 by manipulating the number of sessions of Condition 2, above. Resurgence was not a function of recency with the parameters used. Repeating the three conditions revealed resurgence to be a repeatable effect in Experiment 2. In Experiment 3, a variable-time schedule was in effect for the resurgence condition. Resurgence was not produced by response-independent food delivery. In Experiment 4, the resurgence condition was a variable-interval schedule for treadle pressing that arranged a lower reinforcement rate than in Condition 2 (92% reduction in reinforcers per minute). Resurgence was lower in magnitude relative to conventional extinction, although resurgence was obtained with 2 out of 3 pigeons. The results are discussed in terms of the variables controlling resurgence and the relations between behavioral history, resurgence, and other forms of response recovery.     

Topographical variations in behavior during autoshaping, automaintenance, and omission training

Three pigeons were exposed to an autoshaping and automaintenance procedure while a computer-controlled tracking system continuously recorded the position of the bird's head as it moved freely in the experimental chamber. Although only 2 birds pecked the key during the conditional stimulus (red keylight), all 3 birds exhibited stable patterns of approaching the conditional stimulus and withdrawing from the intertrial stimulus (white keylight). Subsequent exposure to an omission procedure, in which pecks on the red key cancelled the presentation of food upon the termination of the red keylight, greatly reduced key pecking, but approaching and pecking in the vicinity of the conditional stimulus were maintained at high levels. When the omission contingency was removed key pecking increased. During all phases the birds withdrew from the area of the white key and engaged in repetitive back-and-forth or circuiting movements during this intertrial stimulus. The data document (a) the strong control the conditional stimulus in autoshaping and automaintenance exerts over approach to the key and pecking motions whether or not the conditional stimulus elicits key pecking at a high level; and (b) withdrawal from the vicinity of the key and the occurrence of stereotypic behavior during the intertrial interval.     

Within-session delay-of-reinforcement gradients

Within-session delay-of-reinforcement gradients were generated with pigeons by progressively increasing delays to reinforcement within each session. In Experiment 1, the effects of imposing progressive delays on variable-interval and fixed-interval schedules were investigated while controlling for simultaneous decreases in reinforcer rate across the session via a within-subject yoked-control procedure. Rate of key pecking decreased as a negatively decelerated function of delay of reinforcement within a session. These rate decreases were greater than those during a yoked-interval session in which the rate of immediate reinforcement decreased at the same rate as it did under the progressive-delay procedure. In Experiment 2, delay-of-reinforcement gradients were shallower when the progressive delay intervals were signaled by a blackout than when they were unsignaled. The delay gradients obtained in each experiment were similar to those generated under conditions in which different delays of reinforcement are imposed across blocks of sessions. The present procedure offers a technique for rapidly generating delay-of-reinforcement gradients that might serve as baselines for assessing the effects of other behavioral and pharmacological variables.     

The role of preliminary magazine training in acquisition of the autoshaped key peck

A series of experiments tested the hypothesis that initial key pecks in the autoshaping procedure are generalized pecks at the illuminated grain hopper. Experiment I found that autoshaping readily occurred when the chamber was continuously illuminated by a house-light. In Experiment II, pigeons given magazine training and autoshaping with an unlighted grain hopper failed to autoshape in 200 trials. Acquisition of autoshaped key pecking was retarded in Experiment III when stimulus control by the magazine light was reduced. In the fourth study, pigeons were given magazine training with either a red or white magazine light and then given autoshaping with concurrently presented red and white keys. For all pigeons in this experiment, the first key peck occurred on the key of the same color as that pigeon's magazine light. The results of these experiments were interpreted as supporting an account of autoshaping that identifies initial key pecks as arising due to generalization of pecking at the lighted grain hopper to pecking at the lighted key.     

Conditioned suppression, punishment, and aversion

Three experiments were conducted to assess the aversive properties of a visual stimulus in the presence of which one group of birds received response-contingent shock (discriminated punishment) while a yoked group of birds received non-contingent shocks (conditioned suppression). In Experiment 1, presentation of the visual stimulus contingent on key pecking reduced the response rate (conditioned punishment effect) for birds under the conditioned suppression procedure but did not reduce the response rate of birds under the discriminative punishment procedure. Non-contingent shocks also produced greater suppression of responding maintained by positive reinforcement in the presence of a visual stimulus than did response-contingent shocks. In Experiment 2, a greater shock intensity (2 mA) was used. All the differences between the two groups found in Experiment 1 were also found in Experiment 2. Experiment 3 demonstrated that response-contingent shock did not result in a conditioned punishment effect even when positive reinforcers were unavailable during the discriminative punishment schedule. The exteroceptive stimulus that was paired with shock in the conditioned suppression procedure acquired the ability to punish behavior. The exteroceptive stimulus in the discriminative punishment schedule did not acquire this ability.     

Key pecking as a function of response-shock and shock-shock intervals in unsignalled avoidance

Five pigeons were exposed to an unsignalled avoidance procedure where key pecks were maintained through shock postponement. Functions obtained showed an inverse relationship between rate of responding and length of the response-shock interval, while changes in the shock-shock interval had no systematic effect on response rates. The rate of shocks delivered generally decreased with increases in length of both response-shock and shock-shock intervals. Results show that key pecking in pigeons, maintained through an unsignalled avoidance procedure, was affected by changes in response-shock and shock-shock intervals in the same manner as other responses in pigeons and in rats.     

Mechanisms underlying the effects of unsignaled delayed reinforcement on key pecking of pigeons under variable-interval schedules.

Three experiments were conducted to test an interpretation of the response-rate-reducing effects of unsignaled nonresetting delays to reinforcement in pigeons. According to this interpretation, rates of key pecking decrease under these conditions because key pecks alternate with hopper-observing behavior. In Experiment 1, 4 pigeons pecked a food key that raised the hopper provided that pecks on a different variable-interval-schedule key met the requirements of a variable-interval 60-s schedule. The stimuli associated with the availability of the hopper (i.e., houselight and keylight off, food key illuminated, feedback following food-key pecks) were gradually removed across phases while the dependent relation between hopper availability and variable-interval-schedule key pecks was maintained. Rates of pecking the variable-interval-schedule key decreased to low levels and rates of food-key pecks increased when variable-interval-schedule key pecks did not produce hopper-correlated stimuli. In Experiment 2, pigeons initially pecked a single key under a variable-interval 60-s schedule. Then the dependent relation between hopper presentation and key pecks was eliminated by arranging a variable-time 60-s schedule. When rates of pecking had decreased to low levels, conditions were changed so that pecks during the final 5 s of each interval changed the keylight color from green to amber. When pecking produced these hopper-correlated stimuli, pecking occurred at high rates, despite the absence of a peck-food dependency. When peck-produced changes in keylight color were uncorrelated with food, rates of pecking fell to low levels. In Experiment 3, details (obtained delays, interresponse-time distributions, eating times) of the transition from high to low response rates produced by the introduction of a 3-s unsignaled delay were tracked from session to session in 3 pigeons that had been initially trained to peck under a conventional variable-interval 60-s schedule. Decreases in response rates soon after the transition to delayed reinforcement were accompanied by decreases in eating times and alterations in interresponse-time distributions. As response rates decreased and became stable, eating times increased and their variability decreased. These findings support an interpretation of the effects of delayed reinforcement that emphasizes the importance of hopper-observing behavior.     

Stimulus-food relations and free-operant postponement of timeout from response-independent food presentation

Grain was briefly presented to food-deprived pigeons intermittently and response-independently except during signaled timeouts. During Experiment 1, key pecks postponed the next timeout for a specified interval. Rates of pecking during time in were inversely related to the length of time pecking postponed the next timeout. Response-independent presentation of temporal distributions of timeouts exactly matched to a preceding postponement condition decreased pecking rates during Experiment 2. These results indicate that key pecking of pigeons can be controlled by response-dependent postponement of timeout, but that responses elicited by stimulus-reinforcer relations inherent in timeout-postponement procedures may substantially modify rates and patterns of pecking.     

The effects of reinforcement upon the prepecking behaviors of pigeons in the autoshaping experiment

The autoshaping procedure confounds the effects of pairing a keylight and food with the effect of adventitious food reinforcement of responses that typically occur before the pecking response. In Experiment I, acquisition of the orientation to the key, the approach toward the key, and the peck at the key were systematically monitored. Orientations to the key and approaches toward the key frequently occurred in contiguity with food presentation before peck acquisition. In Experiment II, a negative contingency procedure was used to assess the sensitivity of the approach toward the key to its consequences. When the approach toward the key resulted in nonreinforcement, the probability of occurrence of that response decreased to zero despite repeated light-food pairings. In Experiment III, peck probability was shown to be determined during the approach toward the key by the presence of stimuli that had previously been either paired or nonpaired with food. In Experiment IV, it was shown that the effects of the stimulus present during the approach toward the key were not due solely to the effects of pairing that stimulus with food. Autoshaped key pecking appears to be determined by the interacting effects of stimulus-reinforcer and response-reinforcer variables upon orientations to, approaches toward, and pecks at the lighted key.     

Time-place learning by pigeons, Columba livia

In each of two experiments, 2 pigeons received discrimination training in which food reinforcement for key pecking was conditional upon both spatial and temporal cues. In Experiment 1, food was available for periods of 30 s at each of three locations (pecking keys) during trials that lasted 90 s. In Experiment 2, food was available for periods of 15 min at each of four locations (pecking keys) during a 60-min trial. In both experiments, pigeons' key pecking was jointly controlled by the spatial and temporal cues. These data, and other recent experiments, suggest that animals learn relationships between temporal and spatial cues that predict stable patterns of food availability.     

Species differences in spatial memory among Clark's nutcrackers, scrub jays, and pigeons.

An operant nonmatching to sample procedure was used to compare the spatial memory abilities of 3 avian species. A trial consisted of the presentation of a spatially defined sample, a delay interval, and a 2-choice test during which the correct location was the new location. A single spatial location served as the sample in Experiment 1. The delay interval was manipulated using a titration procedure. In Experiment 2, 1, 2, or 3 sequentially illuminated locations served as the sample. The delay was 1 of 4 predetermined intervals. In Experiment 3, sample presentation was the same as Experiment 2, but the delay interval was titrated. In all of the experiments, the performance of nutcrackers was consistently better than the performance of scrub jays and pigeons (Experiment 1) and was correlated with differences in their foraging ecology.     

A comparison of the key-peck and treadle-press operants in the pigeon: differential-reinforcement-of-low-rate schedule of reinforcement

Key pecking and treadle pressing in pigeons were compared under concurrent (key-treadle) and single-operant differential-reinforcement-of-low-rate schedules of food reinforcement ranging from 5 to 60 sec (concurrent procedure) or 5 to 120 sec (single-operant procedure). Under both procedures, the two operants followed the same general law: decreasing response rate and reinforcement rate and increasing number of responses per reinforcement as a function of increasing schedule interval. High correlations were found between key pecking and treadle pressing for the measures of response rate, reinforcement rate, and responses per reinforcement. Regression equations allowed the prediction of treadle pressing from key pecking. More bursting occurred in responding to the key, and key pecking showed a more precise temporal discrimination than treadle pressing. A test for sequential dependencies between key and treadle responses showed significant dependencies not only under the concurrent procedure but also in data created artificially by merging key and treadle sequences from different pigeons under the concurrent procedure and from the same pigeon under the single-operant procedure. It seems likely that the sequential dependencies found were due to the independent action of the schedule on each operant and that behavioral dependencies did not occur with the concurrent training procedure. The key-peck operant does not appear to have any special qualities that preclude its use in discovering general laws of behavior, at least under the differential-reinforcement-of-low-rate schedule. The usefulness of the key peck in other situations requires direct experimental study.     

Acquisition of the autoshaped key peck as a function of amount of preliminary magazine training

Three experiments evaluated the effect of magazine training on acquisition of the pigeon's key peck during autoshaping. In Experiment I, pigeons were exposed to two days of extended magazine training, followed on the third day by keylight-only presentations. All pigeons pecked the keylight early in the keylight-only session. Experiment II examined the relationship between the number of magazine-training trials and trials to the first peck. Pigeons were given either 0, 3, 10, or 25 magazine-training trials followed by the standard autoshaping procedure. The number of trials to the first peck was related to the number of magazine-training trials. In Experiment III, pigeons were exposed to the standard autoshaping procedure without prior magazine training. The data from Experiment III suggested that key pecking will occur only after the response of eating from the lighted hopper has occurred. Taken together, these results suggest that initial magazine training is an important variable in autoshaping. Key pecking is discussed as a generalized consummatory response.     

Physical restraint produces rapid acquisition of the pigeon's key peck

The acquisition and maintenance of autoshaped key pecking in pigeons was studied as a function of intertrial interval. At each of six intervals, which ranged from 12 seconds to 384 seconds, four pigeons were physically restrained during training while four other pigeons were not restrained. Restrained subjects acquired key pecking faster and with less intragroup variability at each interval. The effects of restraint were specific to acquisition and were not evident in maintained responding after five postacquisition sessions.     

The autoshaping procedure as a residual block clock

In the first experiment, 4 pigeons were each presented with a recurring sequence of four key colors followed by the delivery of grain (block clock). Once the rate of pecking had stabilized, three of the colors were replaced, during different series of sessions, by a darkening of the key. The rate of pecking was reduced within those segments of the interval between deliveries of food during which the key was dark; when the key was dark during the final portion of the interval, rates were reduced throughout the entire interval. In the second experiment, 3 new pigeons were exposed to a different sequence of colors, and the final stimulus was replaced in successive conditions by a novel color, a darkened key, and a restoration of the original color. The data indicated that darkening the key had a more severe, more extensive, and more persistent effect than did a mere change in color. These results suggest that it may be fruitful to conceptualize the autoshaping procedure as a special version of the block clock in which pecking is suppressed throughout the greater part of the interval by darkening the key. In the final condition, the same stimulus appeared in each of the last three portions of the interval. The rate of pecking was lower during the last two portions than when distinctive colors were presented, with the peak rate now appearing in the fifth of seven equal temporal components.