Reinforcement omission on fixed-interval schedules

Experiments with pigeons and rats showed that: (1) When a brief blackout was presented in lieu of reinforcement at the end of 25% of intervals on a fixed-interval 2-min schedule, response rate was reliably and persistently higher during the following 2-min intervals (omission effect). This effect was largely due to a decrease in time to first response after reinforcement omission. (2) When blackout duration was varied, within sessions, over the range 2 to 32 sec, time to first response was inversely related to the duration of the preceding blackout, for pigeons, and for rats during the first few sessions after the transition from FI 2-min to FI 2-min with reinforcement omission. Post-blackout pause was independent of blackout duration for rats at asymptote. These results were interpreted in terms of differential depressive effects of reinforcement and blackout on subsequent responding.     

Reinforcement duration and the peak shift in post-discrimination gradients

Pigeons were trained to key-peck for food, first with single-stimulus training and then with successive discrimination (multiple schedule) training. In the multiple schedule, two different wavelengths were each correlated with equally frequent variable-interval reinforcement but different durations (6 sec vs. 2 sec) of access to grain. For some birds, the different durations of feeding cycle were cued by different intensities of the food hopper light. For some of these “cued” birds, single-stimulus training had been carried out with 6-sec feedings and when multiple-schedule training was introduced, the novel stimulus was correlated with 2-sec feedings. For the others, 2-sec feedings were originally used, and the novel stimulus was then present during the 6-sec reinforcement duration. The cueing procedure enhanced discrimination performance, and was necessary for the consistent production of a peak shift. In addition, the condition in which original training had been carried out with 6-sec feedings, and thus reinforcement duration was reduced in the presence of the novel stimulus, led to the best performance.     

Choice as time allocation

When pigeons' standing on one or the other side of a chamber was reinforced on two concurrent variable-interval schedules, the ratio of time spent on the left to time spent on the right was directly proportional to the ratio of reinforcements produced by standing on the left to reinforcements produced by standing on the right. The constant of proportionality was less than unity for all pigeons, indicating a bias toward the right side of the chamber. The biased matching relation obtained here is comparable to the matching relation obtained with concurrent reinforcement of key pecks. The present results, together with related research, suggest that the ratio of time spent in two activities equals the ratio of the “values” of the activities. The value of an activity is the product of several parameters, such as rate and amount of reinforcement, contingent on that activity.     

Behavioral contrast in one component of a multiple schedule as a function of the reinforcement conditions operating in the following component

The key pecks of four pigeons were reinforced on a variable-interval 5-min schedule which operated in each of the four components of a multiple schedule, indicated by red, green, yellow, and blue stimuli and presented in such an order that the red stimulus always preceded the yellow and the green stimulus always preceded the blue. After establishing baseline rates, the reinforcement schedule associated with the blue and yellow components was altered so that one was now an extinction schedule and the other was a variable-interval 1-min schedule. In a second experimental stage, the blue stimulus was interchanged with the yellow so that the red stimulus preceded the blue and the green stimulus preceded the yellow. In both experimental stages the response rate in the variable-interval 5-min component that preceded the extinction component was higher than the response rate in the variable-interval 5-min component that preceded the variable-interval 1-min component. The results were discussed in relation to the importance of stimulus ordering in experiments concerned with investigating behavioral contrast.     

Concurrent schedules of primary and conditioned reinforcement in rats

Rats responded on a fixed-interval schedule during which a 3-sec stimulus preceded each water reinforcement. The stimulus was then scheduled concurrently for responses on the same lever according to either a variable ratio. Although water reinforcement continued on a fixed-interval schedule, the pattern of responding became typical of a variable-interval or variable-ratio schedule. When the 3-sec stimulus was presented on a variable-interval or variable-ratio schedule, but was omitted on the fixed-interval schedule, the response rate decreased. When the stimulus occurred after the same time periods as those of the variable-interval schedule, but at least 7-sec after the last response, the rate decreased. The rate became higher when the fixed-interval schedule was discontinued and each presentation of the 3-sec stimulus was followed by water on a variable-interval schedule. When both water and the 3-sec stimulus were discontinued for a period of time, resulting in extinction of the lever response, and the 3-sec stimulus alone then presented on a variable-interval or variable-ratio schedule after lever responses, rate increased and then gradually decreased.     

Variability of response location for pigeons responding under continuous reinforcement, intermittent reinforcement, and extinction

The effect of several reinforcement schedules on the variability in topography of a pigeon's key-peck response was determined. The measure of topography was the location of a key peck within a 10-in. wide by 0.75-in. high response key. Food reinforcement was presented from a magazine located below the center of the response key. Variability in response locus decreased to a low value during training in which each response produced reinforcement. Variability increased when fixed intervals, variable intervals, random intervals, or extinction were scheduled.     

Escape and avoidance of shock by pigeons pecking a key

Pigeons had been trained to peck a key when each peck removed a slowly increasing series of electric shocks. Without loss of the established key-pecking response, the birds were gradually weaned from this procedure to one where intense shocks were presented suddenly, duplicating features that had proved ineffective for initial shaping of the response. Finally, a procedure was introduced in which key pecks could avoid shock. Avoidance responding was maintained in two of three pigeons.