Reinforcement duration and the peak shift in post-discrimination gradients

Pigeons were trained to key-peck for food, first with single-stimulus training and then with successive discrimination (multiple schedule) training. In the multiple schedule, two different wavelengths were each correlated with equally frequent variable-interval reinforcement but different durations (6 sec vs. 2 sec) of access to grain. For some birds, the different durations of feeding cycle were cued by different intensities of the food hopper light. For some of these “cued” birds, single-stimulus training had been carried out with 6-sec feedings and when multiple-schedule training was introduced, the novel stimulus was correlated with 2-sec feedings. For the others, 2-sec feedings were originally used, and the novel stimulus was then present during the 6-sec reinforcement duration. The cueing procedure enhanced discrimination performance, and was necessary for the consistent production of a peak shift. In addition, the condition in which original training had been carried out with 6-sec feedings, and thus reinforcement duration was reduced in the presence of the novel stimulus, led to the best performance.     

Behavioral contrast in one component of a multiple schedule as a function of the reinforcement conditions operating in the following component

The key pecks of four pigeons were reinforced on a variable-interval 5-min schedule which operated in each of the four components of a multiple schedule, indicated by red, green, yellow, and blue stimuli and presented in such an order that the red stimulus always preceded the yellow and the green stimulus always preceded the blue. After establishing baseline rates, the reinforcement schedule associated with the blue and yellow components was altered so that one was now an extinction schedule and the other was a variable-interval 1-min schedule. In a second experimental stage, the blue stimulus was interchanged with the yellow so that the red stimulus preceded the blue and the green stimulus preceded the yellow. In both experimental stages the response rate in the variable-interval 5-min component that preceded the extinction component was higher than the response rate in the variable-interval 5-min component that preceded the variable-interval 1-min component. The results were discussed in relation to the importance of stimulus ordering in experiments concerned with investigating behavioral contrast.     

Variability of response location for pigeons responding under continuous reinforcement, intermittent reinforcement, and extinction

The effect of several reinforcement schedules on the variability in topography of a pigeon's key-peck response was determined. The measure of topography was the location of a key peck within a 10-in. wide by 0.75-in. high response key. Food reinforcement was presented from a magazine located below the center of the response key. Variability in response locus decreased to a low value during training in which each response produced reinforcement. Variability increased when fixed intervals, variable intervals, random intervals, or extinction were scheduled.     

Some determinants of inhibitory stimulus control

Interspersed reinforcement and extinction during discrimination learning generate a U-shaped gradient of inhibition about the stimulus correlated with extinction. The present work showed that extinction is not a necessary determinant of inhibitory stimulus control. In Exp. I, a reduction in the rate of reinforcement, through a shift from a multiple variable-interval 1-min variable-interval 1-min schedule to a multiple variable-interval 1-min variable-interval 5-min schedule, resulted in a post-discrimination line orientation gradient of inhibition about the stimulus correlated with the variable-interval 5-min schedule. In Exp. II, the rates of reinforcement, correlated with a pair of stimuli, were held constant during a shift from a multiple variable-interval 1-min variable-interval 1-min schedule to a multiple variable-interval 1-min differential-reinforcement-of-low-rate schedule. Inhibitory stimulus control about the stimulus correlated with the differential reinforcement of low rate was obtained. In both experiments, a reduction in the rate of responding during one stimulus and behavioral contrast during the other stimulus preceded the observation of inhibitory stimulus control.     

Stimulus control in the goldfish after massed extinction

Compared with the data of goldfish trained only with stimuli correlated with reinforcement, interspersed reinforcement-stimulus and extinction-stimulus trials resulted in sharper stimulus control and a marked reduction in the percentage of key-presses emitted in the presence of stimuli located near the extinction stimulus on the test dimension. If non-reinforced trials were not interspersed with reinforced trials, there was no sharpening of stimulus control and less reduction in key presses in the presence of stimuli near the extinction stimulus on the test dimension.