Some properties of spaced responding in pigeons

Pigeons exposed to a schedule which reinforces interresponse times (IRTs) longer than a given value (DRL schedule) eventually reach a stable pattern of responding which is shown to be a function both of the DRL value and of previous experience with other DRL values. On any given DRL schedule, the stable performance of most pigeons which have been previously exposed to a variety of such schedules, shows an IRT distribution with median equal to the DRL value. For DRL values longer than about 30 sec, however, the median IRT falls short of the DRL value; this failure of adjustment to longer values appears to be a species characteristic of pigeons. The function relating reinforcement rate to 1/DRL value is also shown to be approximately linear over the same range, with variable slope (less than 45°) and a downturn in the vicinity of DRL 30.     

Yoked variable-ratio and variable-interval responding in pigeons

Pigeons' key pecks were maintained by variable-ratio or variable-interval schedules of food reinforcement. For pairs of pigeons in one group, variable-ratio reinforcement was arranged for one pigeon's pecks; for the second pigeon, reinforcement was arranged according to a variable-interval schedule yoked to the interreinforcement times produced by the first pigeon. For pairs of pigeons in another group, variable-interval reinforcement was arranged for one pigeon's pecks; for the second pigeon, reinforcement was arranged according to a variable-ratio schedule yoked to the interreinforcement responses produced by the first pigeon. For each pair, the yoking procedure was maintained for four or five consecutive sessions of 50 reinforcements each. In more than three-quarters of the pairs, variable-ratio response rates were higher than variable-interval rates within two sessions; in all cases, the rate difference developed within four sessions.     

Effects of timeout on spaced responding in pigeons

Three pigeons were trained under a differential-reinforcement-of-low-rate schedule of 20 sec, and then exposed to a schedule under which responses terminating interresponse times less than 20 sec produced timeout and responses terminating interresponse times greater than 20 sec produced reinforcement. Response-produced timeouts selectively decreased the probability of short interresponse times and thereby produced a higher frequency of reinforcement. The suppressive effect of timeout was independent of timeout duration, with timeouts of 5, 10, or 20 sec. Similar effects were found when the minimum interresponse time that could be terminated by response-produced reinforcement was increased to 30 sec. The suppressive effects of timeout on responding maintained by these schedules were similar to previous reports in which responding was punished with electric shock.     

An analysis of coordinated responding of pigeons

Experimental analyses of coordinated responding (i.e., cooperation) have been derived from a procedure described by Skinner (1962) in which reinforcers were delivered to a pair of subjects (a dyad) if both responded within a short interval, thus satisfying a coordination contingency. Although it has been suggested that this contingency enhances rates of temporally coordinated responding, limitations of past experiments have raised questions concerning this conclusion. The present experiments addressed some of these limitations by holding the schedule of reinforcement (Experiment 1: fixed ratio 1; Experiment 2; variable interval 20 s) constant across phases and between dyad members and by varying, in different conditions, the number of response keys (one to three) across which coordination could occur. Greater percentages of coordinated responding occurred under the coordinated-reinforcement phases than under independent-reinforcement phases in most conditions. The one exception during the one-key condition of Experiment 1 appeared to be a consequence of variability introduced by the independent-reinforcement phase procedure. Furthermore, coordination percentages decreased with increasing response options under both schedules. These results confirm and extend the finding that coordination contingencies control higher rates of temporally coordinated responding than independent-reinforcement contingencies do.     

Effects of d-amphetamine and chlordiazepoxide on spaced responding in pigeons

The effects of d-amphetamine and chlordiazepoxide were studied in pigeons on performance (1) under a schedule that reinforced responses on a key (food key) if they were more than 20 sec apart, (2) under the same schedule when responses also were required on a collateral key during the interresponse time on the food key, and (3) under the same schedule when responses were required on a collateral key during the interresponse time on the food key and collateral-key responses could produce a stimulus correlated with the availability of food. Under all three spaced-responding schedules, d-amphetamine and chlordiazepoxide at low dose levels slightly increased the frequency of short interresponse times on the food key for about half the birds, and either did not affect the interresponse time patterns of the other birds, or lengthened the durations slightly. At higher dose levels, d-amphetamine and chlordiazepoxide increased the frequency of long interresponse times or abolished responding in all birds. Changes in the pattern of interresponse times on the food key did not seem to depend on changes in the rate or pattern of collateral-key responses.     

The role of the magazine-response contingency on signal-directed responding in pigeons

Three experiments used a procedure for directly delivering water into the thirsty pigeon's mouth to explore the role that the instrumental magazine contingency plays in autoshaped responding. Magazine training was accomplished by requiring birds to contact a “magazine” key when it was illuminated, in order to obtain intraoral injections of water. Other subjects received water injections independent of a magazine-response contingency. Subsequently, magazine-trained subjects showed a transient enhancement in responding to the illumination of another “signal” key, whether that stimulus was presented alone or paired with water delivery. The overall level of maintained autoshaped responding was little influenced by the instrumental magazine contingency, although the within-trial time course of signal-directed responding was affected. When illumination of the signal key preceded access to water only when the signal was not contacted, pigeons directed many responses toward the signal key. However, there was no evidence that the instrumental magazine contingency enhanced responding on this omission schedule of reinforcement. These results thus confirm a small, but measurable contribution of the magazine-response contingency to signal-directed responding; they fail to support the conclusion that the instrumental magazine contingency greatly affects the outcomes of autoshaping studies.     

Predictable long-delay matching-to-sample trials result in long-latency sample responding by pigeons

When a delayed matching-to-sample task does not involve short-delay trials interspersed among the long-delay trials, there is evidence that pigeons show long latencies in responding to the sample (sample observing response). They may even stop responding altogether. Two experiments were conducted to confirm the phenomenon and determine what aspect of the procedure is responsible for it. In Experiment 1 pigeons were trained on a delayed matching-to-sample task in which the delay remined constant throughout each session and was increased as each bird reached a performance criterion. The results indicated that sampleresponse latency increased in a regular fashion as delay increased. When the delay increased to 8.0 s, responding to the sample often stopped for long periods of time. In Experiment 2 pigeons were exposed to constant delay sessions (LONG), or mixed delay sessions with the delay length signaled (COR) or unsignaled (UNC). Sample-response latencies increased with increasing delay on long-delay trials for the LONG and the COR groups but not for the UNC group. Results supported the hypothesis that predictability of the long delay and not the loss of association between sample responses and reinforcement was responsible for the increased sample-response latency.     

Effects of a brief stimulus accompanying reinforcement on instrumental responding in pigeons

The responding of pigeons on a variable interval schedule of reinforcement was investigated in four experiments. In some conditions in each experiment reinforced keypecks were accompanied by a brief (0.5-sec) flash of the houselight. This procedure resulted in a low rate of response in comparison with that found in conditions when response-contingent light flashes occurred uncorrelated with reinforcement (Experiments 1 and 2) or when no light flash was presented (Experiment 3). Experiment 4 allowed a comparison between the effects of a signal accompanying the reinforced response and one accompanying the delivery of “free” food. Signaling the delivery of earned food produced a lower rate of response than did signaling the delivery of free food. The role of stimulus-reinforcer and response-reinforcer associations in producing these effects is discussed.     

Social learning of optimal responding and producer-scrounger strategies in flocks of pigeons

Social learning of optimal responding and producer-scrounger strategies in flocks of pigeons. This experiment evaluated the effect of varying the effort required in order to access food upon the acquisition of a novel response, and upon utilizing producer-scrounger strategies, in flocks of pigeons exposed to an expert conspecific. Flocks of na?ve observers were exposed to a pigeon trained to open the seals on food deposits. The colors of the seals were correlated with differing required efforts. Later, the trained pigeon was removed while the color-effort correlation was maintained. The results showed that the observers acquired the response of opening the seals and that they executed it discriminatingly, responding in a greater proportion to the color that signaled the least required effort. They also assumed the roles of both producers and scroungers, which varied as a function of the composition of the group. The data obtained are congruent with prior findings regarding social learning, and also with the concepts proposed by the optimal foraging theory.     

Temporally spaced responding by pigeons: development and effects of deprivation and extinction

In the first five or six sessions on a DRL 20-sec schedule of reinforcement there developed a stable performance characterized by a relatively constant conditional probability of occurrence (IRTs/op) of interresponse times (IRTs) of durations greater than 5 or 6 sec. Extinction and the level of deprivation changed both the overall rate of responding and the form of the function relating the duration of an IRT to its value of IRTs/op. The value of IRTs/op decreased more rapidly for short than for longer IRTs, resulting in the emergence of a finer discrimination of IRT duration.     

Effects of reinforcer magnitude on responding under differential-reinforcement-of-low-rate schedules of rats and pigeons

Experiment I investigated the effects of reinforcer magnitude on differential-reinforcement-of-low-rate (DRL) schedule performance in three phases. In Phase 1, two groups of rats (n = 6 and 5) responded under a DRI. 72-s schedule with reinforcer magnitudes of either 30 or 300 microl of water. After acquisition, the water amounts were reversed for each rat. In Phase 2, the effects of the same reinforcer magnitudes on DRL 18-s schedule performance were examined across conditions. In Phase 3, each rat responded unider a DR1. 18-s schedule in which the water amotnts alternated between 30 and 300 microl daily. Throughout each phase of Experiment 1, the larger reinforcer magnitude resulted in higher response rates and lower reinforcement rates. The peak of the interresponse-time distributions was at a lower value tinder the larger reinforcer magnitude. In Experiment 2, 3 pigeons responded under a DRL 20-s schedule in which reinforcer magnitude (1-s or 6-s access to grain) varied iron session to session. Higher response rates and lower reinforcement rates occurred tinder the longer hopper duration. These results demonstrate that larger reinforcer magnitudes engender less efficient DRL schedule performance in both rats and pigeons, and when reinforcer magnitude was held constant between sessions or was varied daily. The present results are consistent with previous research demonstrating a decrease in efficiency as a function of increased reinforcer magnituide tinder procedures that require a period of time without a specified response. These findings also support the claim that DRI. schedule performance is not governed solely by a timing process.     

Avoidance responding as a function of stimulus duration and relation to free shock

Response-independent pairings of a tone and a brief shock were superimposed on uncued avoidance responding in four groups of rhesus monkeys. For one group, tone presentations were immediately followed by an unavoidable electric shock; for the remaining groups, gaps of 5, 20, and 80 sec intervened between tone termination and shock delivery. These temporal values subsume paradigms usually treated as discrete procedures; the conditioned emotional response procedure (0-sec gap between tone and shock), trace procedure (5-sec gap) and safety-signal training (80-sec gap). Within each group, tone durations of 10, 20, 40, and 80 sec were examined. A response pattern marked by maximum response rate in the initial 5 sec of the tone followed by deceleration before shock was observed when shock immediately followed the tone, but not when gaps were interposed between the tone and shock. Response rates in the first 5 sec of the tone were a function of both tone duration and duration of the gap. When the gap was 0 to 5 sec, initial response rates were highest in longer duration tones; this relationship between tone duration and initial tone response rate was not observed for longer gaps.     

Variability of response location for pigeons responding under continuous reinforcement, intermittent reinforcement, and extinction

The effect of several reinforcement schedules on the variability in topography of a pigeon's key-peck response was determined. The measure of topography was the location of a key peck within a 10-in. wide by 0.75-in. high response key. Food reinforcement was presented from a magazine located below the center of the response key. Variability in response locus decreased to a low value during training in which each response produced reinforcement. Variability increased when fixed intervals, variable intervals, random intervals, or extinction were scheduled.     

Delayed choice responding by pigeons when the correct response is not predictable from the sample stimulus.

Food-deprived pigeons were presented with a row of four response keys situated above a grain hopper aperture. At the start of a trial, three of four keys were randomly selected and illuminated white for six seconds. After a variable blackout period, one of the three previously white keys and the previously dark key were illuminated green, and the remaining white keys were reilluminated as before. A response to the green key that was previously white was reinforced with three-second access to gain, a response to any other key resulted in a three-second blackout and the start of a new trial. Five of six subjects responded to the correct green key more often than chance at an interstimulus interval of 1.5 seconds, and they displayed maximal performance at different intertrial interval values ranging from 15 to 60 seconds. Choice accuracy decreased for all but one subject as the interstimulus interval was increased. For the range of interstimulus interval durations employed, decrements in choice accuracy were qualitatively similar to, but lower than those typically obtained from, delayed-matching-to-sample or delayed-pair comparison procedures.     

Why pigeons say what they do: reinforcer magnitude and response requirement effects on say responding in say-do correspondence

The effects of reinforcer magnitude and response requirement on pigeons' say choices in an experimental homologue of human say-do correspondence were assessed in two experiments. The procedure was similar to a conditional discrimination procedure except the pigeons chose both a sample stimulus (the say component) and a comparison stimulus that corresponded to it (the do component). Correspondence was trained on red, green, and white key colors before the duration of food presentations following correspondence on each key color (Experiment 1) and the number of key pecks required as the say response on each key color (Experiment 2) were manipulated in an attempt to influence the initial say response. The frequency of say responses on each key color coincided with programmed changes in the duration of food presentations and the key-peck requirements assigned to each key color. Correspondence accuracy remained stable in all conditions, even those in which the say responding occurred primarily on two of the three key colors. Implications for human behavior are discussed.     

Reflexivity in pigeons

A recent theory of pigeons' equivalence-class formation (Urcuioli, 2008) predicts that reflexivity, an untrained ability to match a stimulus to itself, should be observed after training on two "mirror-image" symbolic successive matching tasks plus identity successive matching using some of the symbolic matching stimuli. One group of pigeons was trained in this fashion; a second group was trained similarly but with successive oddity (rather than identity). Subsequently, comparison-response rates on novel matching versus mismatching sequences with the remaining symbolic matching stimuli were measured on nonreinforced probe trials. Higher rates were observed on matching than on mismatching probes in the former group. The opposite effect--higher rates on mismatching than matching probes--was mostly absent in the latter group, despite being predicted by the theory. Nevertheless, the ostensible reflexivity effect observed in former group may be the first time this phenomenon has been demonstrated in any animal.     

Self-reinforcement in pigeons

Pigeons were trained to reward their own performances by eating from a freely available food source only after pecking a disc. The self-reinforcement pattern was established by fading in the work requirement and punishing noncontingent self-feeding by food withdrawal. The animals maintained faultless self-reinforcement for hundreds of trials after the punishment contingency was removed so that the birds could safely feed themselves without performing any pecking responses. In successive induction and extinction of the phenomenon, the number of responses per self-reward was observed to covary with self-reinforcement rate. By progressively raising the work requirements an animal was trained to adopt increasingly higher performance standards of self-reward. After maintaining a high response output for each self-reward the animal promptly discarded all self-imposed work contingencies and quickly resumed them again, though less durably, following additional training.