Reinforcement omission on fixed-interval schedules

Experiments with pigeons and rats showed that: (1) When a brief blackout was presented in lieu of reinforcement at the end of 25% of intervals on a fixed-interval 2-min schedule, response rate was reliably and persistently higher during the following 2-min intervals (omission effect). This effect was largely due to a decrease in time to first response after reinforcement omission. (2) When blackout duration was varied, within sessions, over the range 2 to 32 sec, time to first response was inversely related to the duration of the preceding blackout, for pigeons, and for rats during the first few sessions after the transition from FI 2-min to FI 2-min with reinforcement omission. Post-blackout pause was independent of blackout duration for rats at asymptote. These results were interpreted in terms of differential depressive effects of reinforcement and blackout on subsequent responding.     

Choice as time allocation

When pigeons' standing on one or the other side of a chamber was reinforced on two concurrent variable-interval schedules, the ratio of time spent on the left to time spent on the right was directly proportional to the ratio of reinforcements produced by standing on the left to reinforcements produced by standing on the right. The constant of proportionality was less than unity for all pigeons, indicating a bias toward the right side of the chamber. The biased matching relation obtained here is comparable to the matching relation obtained with concurrent reinforcement of key pecks. The present results, together with related research, suggest that the ratio of time spent in two activities equals the ratio of the “values” of the activities. The value of an activity is the product of several parameters, such as rate and amount of reinforcement, contingent on that activity.     

Escape and avoidance of shock by pigeons pecking a key

Pigeons had been trained to peck a key when each peck removed a slowly increasing series of electric shocks. Without loss of the established key-pecking response, the birds were gradually weaned from this procedure to one where intense shocks were presented suddenly, duplicating features that had proved ineffective for initial shaping of the response. Finally, a procedure was introduced in which key pecks could avoid shock. Avoidance responding was maintained in two of three pigeons.