Removal of an obstacle: Problem-solving behavior in pigeons

The importance of a subject's personal history in the solution of an obstruction problem was demonstrated with pigeons. Four birds were trained to peck a key located outside the chamber by poking their heads through an opening in a screen. During tests, a white block was placed in front of the opening, so that it was not possible to peck the key without removing the block. All birds failed to remove the block. However, all birds that were subsequently trained to push the white block around the chamber in the absence of the key and a few of the birds trained similarly but with a black block solved the problem by pushing the block aside and pecking the key. One bird showed the abrupt descent in the learning curve that has been considered a characteristic of “insightful” problem solving. All birds maintained their successful performance after a 1-month interval with no intervening tests.     

Responding under positive and negative response contingencies in pigeons and crows

Four crows were trained to key peck for food. Then, they were exposed to a positive response contingency that required them to peck the key when it was illuminated briefly (the trial) in order to receive food. This procedure resulted in consistent within-trial pecking. When the contingency changed so that food was presented at the end of a trial when no response occurred, but the trial terminated immediately and food was omitted when a response occurred (negative response contingency), responding decreased markedly. Eight pigeons were studied under the same change in contingencies. These birds varied in their response histories from naive to having several years' experience. The previously naive pigeons also showed rapid declines in responding under the negative contingency; the responding of the birds with extended training histories declined much more slowly. Eventually, however, six of the eight pigeons showed little or no responding under the negative contingency, while they responded consistently when re-exposed to the positive contingency. These findings question the power and the generality of the negative automaintenance phenomenon.     

Dissecting the conditioned pecking response: an integrated system for the analysis of pecking response parameters.

The conventional pecking response key, although an excellent transducer of response rate, can provide minimal information on the topography, coordination, or localization of conditioned pecking. We describe the hardware and software components of a system that, in addition to recording response rates, permits simultaneous "on-line" monitoring of head acceleration, jaw movement, terminal peck location, and duration of pecking response. Head movements are monitored with a miniature accelerometer, jaw movements with a magnetosensitive transducer, and peck location with modified touch screen technology. Initial experiments with the system suggest that it will be useful in studies of response differentiation, acquisition and maintenance of complex discriminations, and interaction of conditioned and unconditioned stimuli in the control of pecking response probability and response topography.     

Parameters affecting the maintenance of negatively reinforced key pecking

Three negative reinforcement experiments employing a key-peck response are described. In Experiment I, pigeons shocked on the average of twice per minute (imposed condition) could produce, by pecking a key, an alternate condition with correlated stimuli. Delayed shocks were added, across sessions, to the alternate condition until pecking stopped. Two of three pigeons continued to peck despite a 100% increase in shock frequency. In Experiment II, pigeons were shocked in the imposed condition four times per minute. The postresponse delay to shock was held constant by delivering, in the alternate condition, the next shock, or the next two, three, or four shocks from the imposed-condition shock schedule. All three subjects continued to peck with no change in delay to the first two postresponse shocks but with a 75% reduction in shock frequency. In Experiment III, a response produced an immediate shock followed by a shock-free period. Three of four subjects continued to respond despite reduced delay to shock. Delay-to-shock or shock-frequency reduction was sufficient to maintain key pecking, but neither was necessary. The conditions that negatively reinforce the pigeon's key peck were similar to conditions that negatively reinforce the rat's bar press.     

Trace autoshaping: Acquisition, maintenance, and path dependence at long trace intervals

The pigeon's tendency to acquire and maintain signal-directed key pecking under a trace conditioning procedure was parametrically examined. In Experiment 1, the percentage of CS trials with a key peck response was a decreasing function of the trace interval for separate groups of pigeons. The majority of subjects acquired signal-directed key pecking with trace intervals as long as 36 sec. In Experiment 2, differential maintenance of key pecking occurred across trace intervals in a within-subject procedure. Maintenance of key pecking at 36- and 60-sec trace intervals was path dependent in that responding depended on the subject's performance under the preceding trace interval.     

Auto-maintenance in the pigeon: sustained pecking despite contingent non-reinforcement

If a response key is regularly illuminated for several seconds before food is presented, pigeons will peck it after a moderate number of pairings; this “auto-shaping” procedure of Brown and Jenkins (1968) was explored further in the present series of four experiments. The first showed that pecking was maintained even when pecks turned off the key and prevented reinforcement (auto-maintenance); the second controlled for possible effects of generalization and stimulus change. Two other experiments explored procedures that manipulated the tendency to peck the negatively correlated key by introducing alternative response keys which had no scheduled consequences. The results indicate that pecking can be established and maintained by certain stimulus-reinforcer relationships, independent of explicit or adventitious contingencies between response and reinforcer.     

An operant discrimination task allowing variability of reinforced response patterning

Five pigeons were trained to perform a discrimination task allowing variability of reinforced response patterning. The task consisted of moving a stimulus light within an 4×4 matrix of lights from the top left position to the bottom right position by pecking on two keys in succession in order to obtain a reinforcement. A peck on one key moved the light one position to the right and a peck on the other key moved it one position down. After preliminary training on alternating fixed-ratio 3 schedules of reinforcement, the birds could peck on either key in any order, but more than three responses on a key resulted in a blackout followed by the return of the stimulus light to the start position. Results indicate that initially the birds used a wide variety of response patterns to obtain reinforcement, but with continued practice, response patterns became more stereotyped.     

Attention and “visual field dependency” in the pigeon

Three pigeons were trained in an upright conditioning chamber to peck a key transilluminated by a vertical line. This training was followed by a line orientation generalization test. During the test, the chamber was tilted laterally 22.5 degrees from upright. The chamber floor remained horizontal with respect to gravity. Under these conditions, the subjects responded more often in the presence of a visually vertical (parallel to chamber walls) line orientation than in the presence of a gravitationally vertical line orientation. Subsequent reinforcement of pecking in the presence of a line that was always gravitationally vertical but not always visually vertical temporarily abolished this "visual field dependency" and resulted in generalization gradients with peak responding in the presence of the gravitationally vertical line orientation. The results are discussed in terms of selective attention to the gravitational and visual components of line orientation.     

The effects of reinforcement upon the prepecking behaviors of pigeons in the autoshaping experiment

The autoshaping procedure confounds the effects of pairing a keylight and food with the effect of adventitious food reinforcement of responses that typically occur before the pecking response. In Experiment I, acquisition of the orientation to the key, the approach toward the key, and the peck at the key were systematically monitored. Orientations to the key and approaches toward the key frequently occurred in contiguity with food presentation before peck acquisition. In Experiment II, a negative contingency procedure was used to assess the sensitivity of the approach toward the key to its consequences. When the approach toward the key resulted in nonreinforcement, the probability of occurrence of that response decreased to zero despite repeated light-food pairings. In Experiment III, peck probability was shown to be determined during the approach toward the key by the presence of stimuli that had previously been either paired or nonpaired with food. In Experiment IV, it was shown that the effects of the stimulus present during the approach toward the key were not due solely to the effects of pairing that stimulus with food. Autoshaped key pecking appears to be determined by the interacting effects of stimulus-reinforcer and response-reinforcer variables upon orientations to, approaches toward, and pecks at the lighted key.     

Acquisition of the autoshaped key peck as a function of amount of preliminary magazine training

Three experiments evaluated the effect of magazine training on acquisition of the pigeon's key peck during autoshaping. In Experiment I, pigeons were exposed to two days of extended magazine training, followed on the third day by keylight-only presentations. All pigeons pecked the keylight early in the keylight-only session. Experiment II examined the relationship between the number of magazine-training trials and trials to the first peck. Pigeons were given either 0, 3, 10, or 25 magazine-training trials followed by the standard autoshaping procedure. The number of trials to the first peck was related to the number of magazine-training trials. In Experiment III, pigeons were exposed to the standard autoshaping procedure without prior magazine training. The data from Experiment III suggested that key pecking will occur only after the response of eating from the lighted hopper has occurred. Taken together, these results suggest that initial magazine training is an important variable in autoshaping. Key pecking is discussed as a generalized consummatory response.     

A yoked-chamber comparison of concurrent and multiple schedules

Pigeons were exposed to alternative pairs of variable-interval schedules correlated with red and green lights on one key (the food key). In one experimental chamber, responses on a white key (the changeover key) changed the color of the food key and initiated a 2-sec changeover delay. Pigeons in a second chamber obtained food by pecking on a colored key whenever the pigeons in the first (concurrent) chamber had obtained food for a peck on that key color. There was no changeover key in the second (multiple) chamber: changeover responses in the first chamber alternated the schedules and colors in both chambers. The pigeons in both chambers emitted the same proportion of responses on each of the variable-interval schedules, and mastered discrimination reversals at the same rate. The pigeons differed only in their absolute response rates, which were greater under the concurrent schedules. In a second experiment, changes in key color occurred automatically, with different proportions of time allocated to the two variable-interval schedules. Matching of relative response frequency to relative reinforcement frequency was affected by the relative amounts of time in each component, by rate of changeovers, and by manipulations of the variable-interval scheduling.     

Autoshaped key pecking maintained by access to a social space.

When four experimentally naive pigeons were exposed to occasional forward pairings of a keylight followed by a doorlight (that signaled access to a large social space), all subjects began to peck the lit key. In a second experiment, where the keylight either preceded the presentation of the doorlight or was presented independently of it, key pecking was maintained only in the former circumstance. The unconditioned stimulus in these experiments--arrival in the social space--did not elicit pecking. Hence, the conditioned response of key pecking and the unconditioned response of entering the social space differed. This demonstration of autoshaping with a social-space unconditioned stimulus argues against a stimulus-substitution account of the findings.     

The role of preliminary magazine training in acquisition of the autoshaped key peck

A series of experiments tested the hypothesis that initial key pecks in the autoshaping procedure are generalized pecks at the illuminated grain hopper. Experiment I found that autoshaping readily occurred when the chamber was continuously illuminated by a house-light. In Experiment II, pigeons given magazine training and autoshaping with an unlighted grain hopper failed to autoshape in 200 trials. Acquisition of autoshaped key pecking was retarded in Experiment III when stimulus control by the magazine light was reduced. In the fourth study, pigeons were given magazine training with either a red or white magazine light and then given autoshaping with concurrently presented red and white keys. For all pigeons in this experiment, the first key peck occurred on the key of the same color as that pigeon's magazine light. The results of these experiments were interpreted as supporting an account of autoshaping that identifies initial key pecks as arising due to generalization of pecking at the lighted grain hopper to pecking at the lighted key.     

Autoshaping: further study of "negative automaintenance"

The key pecking of pigeons was autoshaped to three key colors paired with food in discrete trials. Then, the effects of three different color-correlated contingencies were compared: reward (presentation of food contingent on pecking), omission (presentation of food prevented by pecking), and extinction (no food). Two measures of performance were used: initial response (the number of trials with each color on which at least one peck was made) and multiple response (the total number of pecks per trial). In general, the reward color produced more pecking than the omission color, the omission color more than the extinction color, and the extinction color more than on blank trials with an unlighted key, although (relative to reward) omission produced a higher level of initial than of multiple responding. These results point clearly to the importance of stimulus-reinforcer continguity in the control of pecking.     

The influence of "preparedness" on autoshaping, schedule performance, and choice.

Two groups of experimentally naive pigeons were exposed to an autoshaping procedure in which the response key was mounted on the wall (the conventional location) or on the floor of the chamber. In two experiments, subjects readily responded to the wall key, but floor-key subjects required shaping. A subsequent experiment compared performance of wall- and floor-key groups on an ascending series of fixed-ratio schedule values, resistance to extinction, differential reinforcement of other behavior, and reversal of key assignment. Each experiment was followed by several sessions of fixed-ratio training; the performance of the wall- and floor-key groups was almost identical throughout. In the final experiment, a fixed-ratio requirement could be completed on either or both keys. Birds initially chose the key on which they had responded during the preceding (reversal of key assignment) experiment. However, within a few sessions both groups showed almost exclusive preference for the floor key. Preference for a key located on the floor may follow from the fact that pigeons are ground feeders and may thus be more "prepared" to peck the floor than to peck a wall. However, autoshaping, under the conditions prevailing here, occurred much more readily to the wall key, suggesting that pecking a vertical surface is more highly prepared. Difficulties in determining relative preparedness seem moot, however, given the lack of between-group differences in the intervening experiments. It is thus unlikely that schedule performances critically depend upon the specific operant response involved.     

Key pecking under response-independent food presentation after long simple and compound stimuli

Sixteen pigeons were trained to peck a key using a response-independent (auto-shaping) procedure of food presentation. The 4-sec grain presentations were independent of responding but a keylight stimulus preceded each, with a 4-min interval between the grain presentation and the next stimulus. Subjects were divided into four groups, with two durations of the keylight (30 or 120 sec) and either one or four successive colors on the response key preceding food delivery. In Phase 2, the birds were continued with the same keylight duration but were presented the alternative number of key colors. All pigeons pecked the key during the stimulus. Birds in the two groups with the 30-sec stimulus duration began to respond significantly sooner than birds with the 120-sec duration. There were no significant differences in rate of pecking between groups by the last five days of Phase 1. In Phase 1, the pigeons exposed to the four stimulus components showed an increase in rate of pecking over the four components as grain presentation approached. The pigeons with one stimulus component did not exhibit this regularity. Analogous conditions in Phase 2 had similar results except for one group. The implications of the occurrence of key pecking due to response-independent food delivery for multiple and chained schedules were pointed out.     

Mechanisms underlying the effects of unsignaled delayed reinforcement on key pecking of pigeons under variable-interval schedules.

Three experiments were conducted to test an interpretation of the response-rate-reducing effects of unsignaled nonresetting delays to reinforcement in pigeons. According to this interpretation, rates of key pecking decrease under these conditions because key pecks alternate with hopper-observing behavior. In Experiment 1, 4 pigeons pecked a food key that raised the hopper provided that pecks on a different variable-interval-schedule key met the requirements of a variable-interval 60-s schedule. The stimuli associated with the availability of the hopper (i.e., houselight and keylight off, food key illuminated, feedback following food-key pecks) were gradually removed across phases while the dependent relation between hopper availability and variable-interval-schedule key pecks was maintained. Rates of pecking the variable-interval-schedule key decreased to low levels and rates of food-key pecks increased when variable-interval-schedule key pecks did not produce hopper-correlated stimuli. In Experiment 2, pigeons initially pecked a single key under a variable-interval 60-s schedule. Then the dependent relation between hopper presentation and key pecks was eliminated by arranging a variable-time 60-s schedule. When rates of pecking had decreased to low levels, conditions were changed so that pecks during the final 5 s of each interval changed the keylight color from green to amber. When pecking produced these hopper-correlated stimuli, pecking occurred at high rates, despite the absence of a peck-food dependency. When peck-produced changes in keylight color were uncorrelated with food, rates of pecking fell to low levels. In Experiment 3, details (obtained delays, interresponse-time distributions, eating times) of the transition from high to low response rates produced by the introduction of a 3-s unsignaled delay were tracked from session to session in 3 pigeons that had been initially trained to peck under a conventional variable-interval 60-s schedule. Decreases in response rates soon after the transition to delayed reinforcement were accompanied by decreases in eating times and alterations in interresponse-time distributions. As response rates decreased and became stable, eating times increased and their variability decreased. These findings support an interpretation of the effects of delayed reinforcement that emphasizes the importance of hopper-observing behavior.     

Aggression during the fixed-ratio and extinction components of a multiple schedule of reinforcement

Pigeons were trained to key peck for food on multiple reinforcement schedules including components of continuous and fixed-ratio reinforcement and extinction. At the end of the chamber opposite the response key was a restrained target pigeon. The target restraining equipment was designed to record automatically blows struck against the target. When the experimental pigeons were paired with restrained target pigeons they attacked the target. Attack occurred during extinction after both continuous and fixed-ratio reinforcement. Attack also occurred occasionally during fixed-ratio 25 and fixed-ratio 40 and frequently during fixed-ratio 60 and fixed-ratio 120. No attack occurred during fixed-ratio 15 and continuous reinforcement. After a history of stable responding without a target bird present, the introduction of a target bird resulted in severely strained key-peck responding characterized by long periods of neither key pecking nor aggressing.     

Behavioral control by an imprinted stimulus

Newly hatched ducklings were exposed to imprinting procedures and subsequently trained to peck a key by presenting the imprinting stimulus as the reinforcing (response contingent) event. It was found that the key peck was learned only when imprinting procedures were initiated during the first 6 to 8 hr after hatch. Additional studies revealed that: (1) the duckling's distress vocalizations were reduced in the presence of the imprinting stimulus and enhanced in its absence; (2) when the ducklings had constant access to the imprinted stimulus (via a key peck), pecking responses occurred in bursts and relatively few distress vocalizations occurred; (3) the initial effect of extinction procedures was an increase in key peck rate. When, however, repeated key pecks failed to produce the imprinted stimulus, distress vocalization ensued and peck rate declined; (4) both the presentation of an unfamiliar mechanical figure and delivery of electrical shock enhanced distress vocalization and key pecks; (5) for some ducklings, certain familiar objects in the environment influenced distress calls in a manner comparable to the imprinted stimulus in that distress calls increased when these objects were removed.