Reinforcement omission on fixed-interval schedules

Experiments with pigeons and rats showed that: (1) When a brief blackout was presented in lieu of reinforcement at the end of 25% of intervals on a fixed-interval 2-min schedule, response rate was reliably and persistently higher during the following 2-min intervals (omission effect). This effect was largely due to a decrease in time to first response after reinforcement omission. (2) When blackout duration was varied, within sessions, over the range 2 to 32 sec, time to first response was inversely related to the duration of the preceding blackout, for pigeons, and for rats during the first few sessions after the transition from FI 2-min to FI 2-min with reinforcement omission. Post-blackout pause was independent of blackout duration for rats at asymptote. These results were interpreted in terms of differential depressive effects of reinforcement and blackout on subsequent responding.     

Effects of instructions and reinforcement-feedback on human operant behavior maintained by fixed-interval reinforcement

In three experiments, human subjects were trained on a five-component multiple schedule with different fixed intervals of monetary reinforcement scheduled in the different components. Subjects uninstructed about the fixed-interval schedules manifested high and generally equivalent rates regardless of the particular component. By comparison, subjects given instructions about the schedules showed orderly progressions of rates and temporal patterning as a function of the interreinforcement intervals, particularly when feedback about reinforcement was delivered but also when reinforcement-feedback was withheld. Administration of the instructions-reinforcement combination to subjects who had already developed poorly differentiated behavior, however, did not make their behavior substantially better differentiated. When cost was imposed for responding, both instructed and uninstructed subjects showed low and differentiated rates regardless of their prior histories. It was concluded that instructions can have major influences on the establishment and maintenance of human operant behavior.     

Reinforcement duration and the peak shift in post-discrimination gradients

Pigeons were trained to key-peck for food, first with single-stimulus training and then with successive discrimination (multiple schedule) training. In the multiple schedule, two different wavelengths were each correlated with equally frequent variable-interval reinforcement but different durations (6 sec vs. 2 sec) of access to grain. For some birds, the different durations of feeding cycle were cued by different intensities of the food hopper light. For some of these “cued” birds, single-stimulus training had been carried out with 6-sec feedings and when multiple-schedule training was introduced, the novel stimulus was correlated with 2-sec feedings. For the others, 2-sec feedings were originally used, and the novel stimulus was then present during the 6-sec reinforcement duration. The cueing procedure enhanced discrimination performance, and was necessary for the consistent production of a peak shift. In addition, the condition in which original training had been carried out with 6-sec feedings, and thus reinforcement duration was reduced in the presence of the novel stimulus, led to the best performance.     

Choice as time allocation

When pigeons' standing on one or the other side of a chamber was reinforced on two concurrent variable-interval schedules, the ratio of time spent on the left to time spent on the right was directly proportional to the ratio of reinforcements produced by standing on the left to reinforcements produced by standing on the right. The constant of proportionality was less than unity for all pigeons, indicating a bias toward the right side of the chamber. The biased matching relation obtained here is comparable to the matching relation obtained with concurrent reinforcement of key pecks. The present results, together with related research, suggest that the ratio of time spent in two activities equals the ratio of the “values” of the activities. The value of an activity is the product of several parameters, such as rate and amount of reinforcement, contingent on that activity.     

Behavioral contrast in one component of a multiple schedule as a function of the reinforcement conditions operating in the following component

The key pecks of four pigeons were reinforced on a variable-interval 5-min schedule which operated in each of the four components of a multiple schedule, indicated by red, green, yellow, and blue stimuli and presented in such an order that the red stimulus always preceded the yellow and the green stimulus always preceded the blue. After establishing baseline rates, the reinforcement schedule associated with the blue and yellow components was altered so that one was now an extinction schedule and the other was a variable-interval 1-min schedule. In a second experimental stage, the blue stimulus was interchanged with the yellow so that the red stimulus preceded the blue and the green stimulus preceded the yellow. In both experimental stages the response rate in the variable-interval 5-min component that preceded the extinction component was higher than the response rate in the variable-interval 5-min component that preceded the variable-interval 1-min component. The results were discussed in relation to the importance of stimulus ordering in experiments concerned with investigating behavioral contrast.     

Variability of response location for pigeons responding under continuous reinforcement, intermittent reinforcement, and extinction

The effect of several reinforcement schedules on the variability in topography of a pigeon's key-peck response was determined. The measure of topography was the location of a key peck within a 10-in. wide by 0.75-in. high response key. Food reinforcement was presented from a magazine located below the center of the response key. Variability in response locus decreased to a low value during training in which each response produced reinforcement. Variability increased when fixed intervals, variable intervals, random intervals, or extinction were scheduled.     

Escape and avoidance of shock by pigeons pecking a key

Pigeons had been trained to peck a key when each peck removed a slowly increasing series of electric shocks. Without loss of the established key-pecking response, the birds were gradually weaned from this procedure to one where intense shocks were presented suddenly, duplicating features that had proved ineffective for initial shaping of the response. Finally, a procedure was introduced in which key pecks could avoid shock. Avoidance responding was maintained in two of three pigeons.     

Stimulus control in the goldfish after massed extinction

Compared with the data of goldfish trained only with stimuli correlated with reinforcement, interspersed reinforcement-stimulus and extinction-stimulus trials resulted in sharper stimulus control and a marked reduction in the percentage of key-presses emitted in the presence of stimuli located near the extinction stimulus on the test dimension. If non-reinforced trials were not interspersed with reinforced trials, there was no sharpening of stimulus control and less reduction in key presses in the presence of stimuli near the extinction stimulus on the test dimension.