Reinforcement omission on fixed-interval schedules

Experiments with pigeons and rats showed that: (1) When a brief blackout was presented in lieu of reinforcement at the end of 25% of intervals on a fixed-interval 2-min schedule, response rate was reliably and persistently higher during the following 2-min intervals (omission effect). This effect was largely due to a decrease in time to first response after reinforcement omission. (2) When blackout duration was varied, within sessions, over the range 2 to 32 sec, time to first response was inversely related to the duration of the preceding blackout, for pigeons, and for rats during the first few sessions after the transition from FI 2-min to FI 2-min with reinforcement omission. Post-blackout pause was independent of blackout duration for rats at asymptote. These results were interpreted in terms of differential depressive effects of reinforcement and blackout on subsequent responding.     

Choice as time allocation

When pigeons' standing on one or the other side of a chamber was reinforced on two concurrent variable-interval schedules, the ratio of time spent on the left to time spent on the right was directly proportional to the ratio of reinforcements produced by standing on the left to reinforcements produced by standing on the right. The constant of proportionality was less than unity for all pigeons, indicating a bias toward the right side of the chamber. The biased matching relation obtained here is comparable to the matching relation obtained with concurrent reinforcement of key pecks. The present results, together with related research, suggest that the ratio of time spent in two activities equals the ratio of the “values” of the activities. The value of an activity is the product of several parameters, such as rate and amount of reinforcement, contingent on that activity.     

Behavioral contrast in one component of a multiple schedule as a function of the reinforcement conditions operating in the following component

The key pecks of four pigeons were reinforced on a variable-interval 5-min schedule which operated in each of the four components of a multiple schedule, indicated by red, green, yellow, and blue stimuli and presented in such an order that the red stimulus always preceded the yellow and the green stimulus always preceded the blue. After establishing baseline rates, the reinforcement schedule associated with the blue and yellow components was altered so that one was now an extinction schedule and the other was a variable-interval 1-min schedule. In a second experimental stage, the blue stimulus was interchanged with the yellow so that the red stimulus preceded the blue and the green stimulus preceded the yellow. In both experimental stages the response rate in the variable-interval 5-min component that preceded the extinction component was higher than the response rate in the variable-interval 5-min component that preceded the variable-interval 1-min component. The results were discussed in relation to the importance of stimulus ordering in experiments concerned with investigating behavioral contrast.