Conditioning of within-trial patterns of key pecking in pigeons

The possibility of conditioning systematic patterns of responding during brief discrete trials was studied by requiring hungry pigeons to key peck and then pause or to pause and then key peck in order to gain access to food. These schedules were highly effective in promoting decelerated and accelerated rates of responding, respectively, within individual trials; indeed, performance was quite similar to that observed when explicit external stimuli were correlated with “peck” and “pause” portions of the daily trials. Finally, schedules of reinforcement that did not selectively reinforce peck-pause or pause-peck patterns neither generated these patterns nor maintained them at the previous high levels. The results, therefore, confirm Shimp's (1976) proposal that organized groupings of discrete responses may function as operants—even in the absence of strict response-reinforcer contiguity.     

Punishment of autoshaped key-peck responses of pigeons

The effects of different voltages of response-dependent and response-independent electric shock on the frequency of key-peck responses engendered by an autoshaping procedure were studied. In Experiments I and II, each response produced a brief electric shock, and response frequency generally decreased more with higher-voltage shock. Preshock frequencies of responding were generally recovered across successive sessions of relatively low-voltage shock delivery but not at higher shock voltages. The effects of response-dependent and response-independent shock were compared in Experiment III by using a yoked-control procedure in which each pigeon received each type of shock delivery at different times. Response-dependent shock generally produced greater decreases in response frequency. In the final experiment, one response-independent shock per autoshaping trial was scheduled. The number of autoshaped responses per trial was related to shock voltages. These results suggest that response-dependent and response-independent electric shock effectively decrease frequency of autoshaped responses.     

Pigeons' preferences for stimulus information: effects of amount of information

A concurrent-chain procedure was used to study pigeons' preferences as a function of amount of information. Pigeons chose between two terminal links. Both terminal links ended in food reinforcement with probability (p) and in blackout with probability (1–p). One terminal link (noninformative link) was signalled by a stimulus uncorrelated with either food or blackout. The other terminal link (informative link) was signalled by stimuli correlated with these outcomes. Amount of information conveyed by these stimuli was varied across conditions by changing the probability of reinforcement (p) and blackout (1–p). The pigeons strongly preferred the informative link, and preferences were greater at p values above 0.50 than for their complements. The pigeons engaged in different behaviors during the stimulus periods, suggesting that the value of informative stimuli may be in their function as discriminative stimuli for interim activities and terminal responses.     

Choice and foraging

In Experiment 1, six naive pigeons were trained on a foraging schedule characterized by different states beginning with a search state in which completion of a fixed-interval on a white key led to a choice state. In the choice state the subject could, by appropriate responding on a fixed ratio of three, either accept or reject the schedule of reinforcement that was offered (either a variable-interval five-second or a variable-interval 20-second). If the subject accepted the schedule, it entered a “handling state” in which the appropriate variable-interval schedule was presented. Completion of the variable-interval schedule produced food. The independent variable was the fixed-interval value in the search state, and the dependent variable was the rate of acceptance of the long variable-interval in the choice state. Experiment 2 was identical except that the search state required completion of a variable-interval, instead of a fixed-interval, schedule. The rate of acceptance of the long variable-interval schedule in both experiments was a direct function of the length of the search state, in accordance with both optimality theory and the delay-reduction hypothesis.     

Preferences among stimulus matches in the pigeon

Three pigeons were trained to peck two to five illuminated response keys. A peck to any of the keys changed the stimulus on the key. When all keys showed the same stimulus (i.e., a stimulus match), an additional key was illuminated with white light. A peck on this key produced three-second access to grain, a three-second intertrial interval, and the next trial. For most sessions, no particular stimulus match was required. Although there were often several stimuli available, each bird preferred a particular stimulus match. With up to 12 stimuli available, birds matched a particular stimulus 60% to 100% of the time.     

Memory for recent behavior in the pigeon

Variations of the symbolic delayed-matching-to-sample procedure were used to study a pigeon's memory for a small number of pecks. In the first experiment a choice of a left or right sidekey after a delay or retention interval was reinforced if a bird had not pecked at all or had pecked exactly once, before the delay, respectively. In the second experiment a choice of a red or green sidekey, regardless of its position, was reinforced if a bird had not pecked at all or had pecked exactly twice, respectively. In the first experiment a bird could orient toward the correct choice during the delay, whereas it could not in the second experiment. In a third experiment a feature-probing method was used to study a pigeon's memory for a number of pecks in the context of certain other pecks. The results showed that a pigeon can remember a small number of pecks for one-half to one minute or more and that the percent correct is a decreasing function of the log retention interval. When a second number of pecks is different from the first number, memory for the first number lasts only a few seconds. When a second number is the same, memory lasts considerably longer. The more recent number of pecks is remembered better. The results are interpreted in terms of a theory which holds that a reinforcer, in general, may act on a subjects' memory for recent behavior to generate patterns of behavior.     

Pigeons' spatial memory: factors affecting delayed matching of key location.

The delayed-matching-to-sample procedure was modified to study pigeons' spatial memory. Nine pecking keys, arranged as a three-by-three matrix, served as the spatial cues. Trials began with a brief "ready" stimulus (dimming of the houselight). Then a randomly chosen key was lit briefly as a sample. After a short delay the sample key was lit again along with one of the other eight keys. A peck at the key that had served as the sample produced grain reinforcement, where as a peck to the other key produced only the intertrial interval. After delayed matching of key location was learned, the effects of sample and delay duration, number of keys illuminated as sample and comparisons, and organization of three-key samples were studied. Matching accuracy decreased as sample duration decreased, delay increased, the number of locations serving as samples increased, the number and proximity of comparisons increased, and when the three-key samples were "discontinuous" rather than "lines".     

Delayed choice responding by pigeons when the correct response is not predictable from the sample stimulus.

Food-deprived pigeons were presented with a row of four response keys situated above a grain hopper aperture. At the start of a trial, three of four keys were randomly selected and illuminated white for six seconds. After a variable blackout period, one of the three previously white keys and the previously dark key were illuminated green, and the remaining white keys were reilluminated as before. A response to the green key that was previously white was reinforced with three-second access to gain, a response to any other key resulted in a three-second blackout and the start of a new trial. Five of six subjects responded to the correct green key more often than chance at an interstimulus interval of 1.5 seconds, and they displayed maximal performance at different intertrial interval values ranging from 15 to 60 seconds. Choice accuracy decreased for all but one subject as the interstimulus interval was increased. For the range of interstimulus interval durations employed, decrements in choice accuracy were qualitatively similar to, but lower than those typically obtained from, delayed-matching-to-sample or delayed-pair comparison procedures.     

A search for symmetry in the conditional discriminations of rhesus monkeys, baboons, and children.

Procedures for generating arbitrary matching-to-sample performances may generate only conditional discriminations. Rational grounds for this distinction are proposed, based on the properties that any equivalence relation must possess. Empirical tests are described for determining whether subjects trained on conditional discriminations are also engaged in true matching to sample. A series of studies than leads to the conclusion that proof of true matching to sample by monkeys, pigeons, or baboons is yet to be provided. Whether the absence of such proof reflects experiential factors or species-defined limitations is not presently clear.     

Responses and pauses: discrimination and a choice catastrophe.

Pigeons produced a stimulus change either by responding or by not responding for a specified time period (by pausing). They then had to choose between two responses to obtain food. One choice was correct if the first component had been completed by a response; the other was correct if the component had been completed by a pause. The pigeons usually chose correctly, thereby indicating that they used their own prior behavior as a discriminative stimulus. Fixed pause requirements did not produce equal first component completions by a response and by a pause. To obtain equality, the pause requirement was titrated as a function of current performance. Titration resulted in equal completions and also produced accurate discrimination. In addition to showing that pigeons discriminated whether they had responded or paused, the data displayed and discontinuous functions predicted by catastrophe theory. Another procedure used forced choice rather than titration to produce equal completions by pausing and responding and also showed accurate discrimination of behavior.