Inhibitory stimulus control in concurrent schedules

Six pigeons were exposed to two keys, a main key and a changeover key. Pecking the main key was reinforced on a variable-interval 5-min schedule when the key was blue and never reinforced when the key displayed a vertical line on a blue background. Each peck on the changeover key changed the stimulus displayed on the main key. Each subject was given two generalization tests, consisting of presentations on the main key of six orientations of the line on the blue background, with no reinforcements being given. In one test changeover-key pecks changed the stimulus; in the other test the changeover key was covered and the experimenter controlled stimulus changes. Both responses to the six stimuli and time spent in the presence of the stimuli gave U-shaped gradients when the changeover key was operative. With most subjects, absolute rates of responding to each stimulus produced unsystematic gradients, whether or not the changeover key was operative.     

Concurrent performances: stimulus-control gradients during schedules of signalled and unsignalled concurrent reinforcement

On one key, pigeons' pecks were reinforced according to a variable-interval schedule in the presence of vertical lines, and were not reinforced in the presence of oblique lines. On a second key, pecks were reinforced according to a variable-interval schedule in the presence of blue, according to a signalled variable-interval schedule in the presence of red, and were not reinforced in the presence of white. Subsequently, during extinction, stimulus-control gradients were obtained by presenting eight different line orientations on the first key concurrent with each of the three colors on the second key. On the first key, line-orientation gradients tended to be lower, narrower, and less shifted in peak or area when the second-key stimulus was blue or red, the stimuli respectively correlated with unsignalled and signalled reinforcement, than when it was white, the stimulus correlated with extinction. Thus, the effect on first-key line-orientation gradients depended on second-key stimuli correlated with concurrent reinforcement, whether or not these stimuli were also correlated with concurrent responding. As a function of first-key line orientation, an inverted gradient was obtained on the second key during blue; during both red and white, rates of pecking on the second key were near zero.     

Stimulus generalization and delay of reinforcement during one component of a multiple schedule

The key pecking of six pigeons was reinforced according to a variable-interval 1-min schedule during each of two successively presented stimuli. When the key was illuminated by a black line on a white background, reinforcement was delayed for 10 sec. When the key was illuminated by a plain white light, reinforcement was not delayed. All subjects responded at a lower rate during the presentation of the black line. A subsequent generalization test along the line-orientation dimension produced a U-shaped gradient, with the nadir located at or near the training stimulus, for each subject. These gradients suggested that the lower rate of response during the stimulus associated with delayed reinforcement may have been due to an inhibition of responding.     

Factors influencing inhibitory stimulus control: differential reinforcement of other behavior during discrimination training

Pigeons were trained to respond on a multiple variable-interval 1-min variable-interval 1-min schedule, then switched to a multiple variable-interval 1-min differential-reinforcement-of-other-behavior discrimination training. The rate of reinforcement was held constant during the shift from non-differential reinforcement to discrimination training. Behavioral contrast and post-discrimination inhibitory stimulus control followed the observation of a reduction in the rate of responding to the stimulus correlated with reinforcement for the non-occurrence of pecking.     

Behavioral contrast in one component of a multiple schedule as a function of the reinforcement conditions operating in the following component

The key pecks of four pigeons were reinforced on a variable-interval 5-min schedule which operated in each of the four components of a multiple schedule, indicated by red, green, yellow, and blue stimuli and presented in such an order that the red stimulus always preceded the yellow and the green stimulus always preceded the blue. After establishing baseline rates, the reinforcement schedule associated with the blue and yellow components was altered so that one was now an extinction schedule and the other was a variable-interval 1-min schedule. In a second experimental stage, the blue stimulus was interchanged with the yellow so that the red stimulus preceded the blue and the green stimulus preceded the yellow. In both experimental stages the response rate in the variable-interval 5-min component that preceded the extinction component was higher than the response rate in the variable-interval 5-min component that preceded the variable-interval 1-min component. The results were discussed in relation to the importance of stimulus ordering in experiments concerned with investigating behavioral contrast.     

Reciprocal response interactions in concurrent variable-interval and discrete-trial fixed-ratio schedules

Abstract.— Pecking a red key by pigeons was reinforced with grain on a continuously accessible variable-interval schedule. Pecking a second key was reinforced on a discrete-trial fixed-ratio schedule; occasionally the second key was illuminated green and after a single run on the fixed-ratio schedule a reinforcer was presented and the green light was turned off. The experiment investigated the effects of acquisition, extinction, and re-acquisition of pecking the second key. All pigeons changed over immediately from pecking the red key to pecking the green key whenever the green light controlled a high rate of pecking this key. Pecking the red key was completely suppressed during pecking the green key. The experiment shows that a changeover from one response to a second response can come under discriminative control of a stimulus during which the second response is intermittently reinforced. All pigeons frequently emitted observing and orienting behaviors towards the dark key that was occasionally lit green.     

Changeover behavior and preference in concurrent schedules

Pigeons were trained on a multiple schedule of reinforcement in which separate concurrent schedules occurred in each of two components. Key pecking was reinforced with milo. During one component, a variable-interval 40-s schedule was concurrent with a variable-interval 20-s schedule; during the other component, a variable-interval 40-s schedule was concurrent with a variable-interval 80-s schedule. During probe tests, the stimuli correlated with the two variable-interval 40-s schedules were presented simultaneously to assess preference, measured by the relative response rates to the two stimuli. In Experiment 1, the concurrently available variable-interval 20-s schedule operated normally; that is, reinforcer availability was not signaled. Following this baseline training, relative response rate during the probes favored the variable-interval 40-s alternative that had been paired with the lower valued schedule (i.e., with the variable-interval 80-s schedule). In Experiment 2, a signal for reinforcer availability was added to the high-value alternative (i.e., to the variable-interval 20-s schedule), thus reducing the rate of key pecking maintained by that schedule but leaving the reinforcement rate unchanged. Following that baseline training, relative response rates during probes favored the variable-interval 40-s alternative that had been paired with the higher valued schedule. The reversal in the pattern of preference implies that the pattern of changeover behavior established during training, and not reinforcement rate, determined the preference patterns obtained on the probe tests.     

The role of discriminative stimuli in concurrent performances

Key pecking in pigeons was examined under concurrent and parallel arrangements of two independent and simultaneously available variable-interval schedules. Pecks on the changeover key alternated the schedule of reinforcement for responses on the main key. Under concurrent schedules, discriminative stimuli were paired with the reinforcement schedule arranged in each component and changeover responses also alternated these stimuli. Under parallel schedules, changeover responses alternated the effective reinforcement schedule, but did not change the discriminative stimulus. On concurrent procedures, changeover response rate was inversely related to the difference in reinforcement rate between the two components, whereas on parallel schedules no consistent relationship was found. With both schedules, absolute response and reinforcement rates were positively related, although for a given set of reinforcement frequencies, rates were often higher on the concurrent schedules. On concurrent schedules, relative response rates and relative times were equal to relative reinforcement rates. On parallel schedules these ratios were positively related, but response and time ratios were much smaller than were obtained with comparable concurrent schedules. This inequality was most pronounced when absolute reinforcement frequencies were lowest.     

Preference for signalled reinforcement

Key pecking was reinforced on a two-component multiple schedule. A variable-interval schedule controlled reinforcement in both components. During one component, access to reinforcement was preceded by a tone; in the other component, a standard unsignalled schedule was in effect. After performance stabilized, subjects were given a choice between the signalled and unsignalled schedules. They were placed in the chamber with the unsignalled schedule in effect on the right key. A single response on the left, or changeover, key produced the signalled schedule for 1 min. Both pigeons in Experiment I pecked the changeover key at a rate sufficient to remain under the signalled schedule for over 90% of the session. Removing and reintroducing the tone demonstrated that the changeover-key responses were due to the occurrence of the tone. In Experiment II, when pecking the changeover key produced the unsignalled schedule, pecking the changeover key declined. The results may be explained either in terms of Hendry's information hypothesis or as escape from an intermittent positive reinforcement schedule.     

Concurrent performances: synthesizing rate constancies by manipulating contingencies for a single response

An earlier experiment scheduled variable-interval reinforcement for pigeons' pecks on one key, and variable-interval reinforcement alternating with extinction, in a multiple schedule, for pecks on a second key. During the second key's extinction component, first-key pecking was relatively slow and continuous, rarely interrupted by second-key pecking; during the variable-interval component, first-key pecking was frequently interrupted by second-key pecking. When changeover delays operated, so that reinforced pecks on one key could not follow closely upon changeovers from the other key, rapid first-key pecking between interruptions compensated sufficiently for the time lost in second-key pecking that the overall rate of first-key pecking remained roughly constant across the alternating multiple-schedule components. The present experiments duplicated, on a single key, the temporal pattern of first-key pecking generated in the earlier experiments: components of continuous key availability were alternated with components of interrupted key availability. Approximately constant overall rates of responding were observed with a single-key equivalent of a changeover delay scheduled after interruptions and with manipulations of the on-off durations of the interruption cycle. Rate constancies in the original concurrent situation presumably depended on analogous contingencies that operated upon the concurrent responses, rather than on any constant “reserve” of responses.     

Discrimination of a response-independent component in a multiple schedule

Pigeons were trained to respond in non-differential reinforcement pre-discrimination training, with a multiple variable-interval 1-min variable-interval 1-min schedule. Each bird then received discrimination training with a multiple variable-interval 1-min variable-time 1-min schedule. Thus, discrimination training was between response-dependent (variable-interval) and response-independent (variable-time) schedules with the rate of reinforcement equated. In Experiment I, only three sessions of non-differential reinforcement preceded discrimination training and for half the birds, a 0° line was correlated with the response-dependent schedule; for the remaining birds the 0° line was correlated with the response-independent schedule. Post-discrimination gradients of excitatory stimulus control were obtained from the former group, while the latter group showed little evidence of post-discrimination stimulus control by the 0° line. Differential responding to the variable-time schedule was not accompanied by behavioral contrast to the variable-interval schedule. In Experiment II, 20 sessions of non-differential reinforcement preceded discrimination training and the 0° line was correlated with variable-time reinforcement for each bird. Differential responding to the 0° line was accompanied by negative induction to the variable-interval schedule and by inhibitory stimulus control about the 0° line during a post-discrimination generalization test.     

Peak shift as a function of multiple schedules of reinforcement

Pigeons were trained to respond to two stimuli on the wavelength continuum, 550 nm and 570 nm, each correlated with an independent schedule of reinforcement. The multiple schedule component in effect during 550 nm (S1) was always a variable-interval 1-min. During the 570-nm stimulus (S2) the second component of the schedule was either variable-interval 30-sec, 1-min, 2-min, 5-min, or extinction for different groups of birds. Generalization gradients were obtained after this training, with the following results: (1) response rate to S1 during training was related to the reinforcement frequency associated with S2; the distribution of responding during generalization testing was a function of the schedules of reinforcement used during training and the response rates they produced. Decreases in the relative frequency of reinforcement correlated with S2 resulted in increases in the distribution shift of responses away from S2 during generalization testing.     

Punishment of observing by the negative discriminative stimulus

To determine the effect of a negative discriminative stimulus on the response producing it, two pigeons were each studied in a three-key conditioning chamber. During alternating periods of unpredictable duration, pecking the center (food) key either was reinforced with grain on a variable-interval schedule or was never reinforced. On equal but independent variable-interval schedules, pecking either of the side (observing) keys changed the color of all keys for 30 sec from yellow to either green or red. When the schedule on the center key was variable-interval reinforcement, the color was green (positive discriminative stimulus); when no reinforcements were scheduled, the color was red (negative discriminative stimulus). Since pecking the side keys did not affect grain deliveries, changes in the rate of pecking could not be ascribed to changes in the frequency of primary reinforcement. In subsequent sessions, red was withheld as one of the possible consequences of pecking a given side key. When red was omitted, the rate on that key increased, and when red was restored, the rate decreased. It was concluded that red illumination of the keys, the negative discriminative stimulus, had a suppressive effect on the response that produced it.     

Separating the effects of salience and disparity on the rate of observing

Pigeons producing deliveries of grain on a mixed variable-interval, extinction schedule by pecking a center key could also produce discriminative stimuli on concurrent variable-interval schedules by pecking the left or right observing key. The stimuli produced by each observing key were varied independently. In the first experiment, the negative discriminative stimulus was at the far end of the spectrum from the key illumination accompanying the mixed schedule and from the positive discriminative stimulus. When the magnitude of the difference between the latter two stimuli (salience) was varied, more pecks occurred on the observing key producing the larger of the two differences than on the key producing the smaller difference. In the second experiment, the stimulus accompanying the mixed schedule was at the far end of the spectrum, and the magnitude of the difference between the two discriminative stimuli (disparity) was varied. The proportion of pecks occurring on each observing key shifted systematically in the direction of the key producing the larger difference. The salience of the discriminative stimuli and their disparity each has an independent influence on the frequency of observing when the other is controlled, but the effect of the salience appears to be the more substantial.     

Effects on concurrent performances of a stimulus correlated with reinforcer availability

A multiple schedule was arranged in which each component consisted of two, concurrent variable-interval schedules of reinforcement. A changeover-key procedure was used, and the components of the multiple schedule were distinguished (initially) by the color of the changeover key. During one component of the multiple schedule, the availability of a reinforcer arranged by one of the variable-interval schedules was marked by an exteroceptive stimulus, provided that that variable-interval schedule was not at the time assigned to the main key. During the other component of the multiple schedule, no reinforcer-correlated stimuli were ever presented. During the latter component of the multiple schedule, the distribution of responses and time for the concurrent variable-interval schedules suggested control by the distribution of reinforcements. During the former component, most main-key responses were emitted on the key in the presence of which reinforcer-correlated stimuli were presented. Changeover rate in the presence of that key color was depressed. The discriminative control over the changeover was easily established and was reversible.     

Frequency of reinforcement as a determinant of extinction-induced aggression during errorless discrimination learning.

Seven pigeons were trained to discriminate without errors between a green keylight and a dark key. The key-pecking response was reinforced in the presence of green, and extinction was in effect in the presence of the dark key. The opportunity to attack a restrained target pigeon was present only during extinction. Both variable-interval 30-sec and fixed-ratio 1 schedules of reinforcement during the positive stimulus induced a higher rate of attack during extinction than a variable-interval 5-min schedule. The highest rate of attack during extinction occurred during the first 20 sec after the positive stimulus terminated. Hence, the withdrawal of the positive condition, rather than the consequences of the pecking response during extinction, appears to be one of the primary factors responsible for attack between pigeons during extinction. Behavioral contrast, defined as a decrease in the rate of responding when the positive stimulus was presented alone, was obtained from the four birds that displayed the lowest overall rates of attack while the three birds with the highest attack rates did not display behavioral contrast. For the birds without contrast, components of the attack response during the positive stimulus presumably competed with and reduced the rate of pecking the key, thereby recluding behavioral contrast.     

Behavioral interactions and stimulus control during conditional discriminations

Two pigeons were exposed to factorial combinations of two values of line tilt and two frequencies of houselight flashes. During each of four baseline stages, key pecking in the presence of all four combinations was reinforced according to a variable-interval schedule. The baseline phases were followed by four different conditional discrimination training procedures in which reinforcement availability for pecking in the presence of the line tilts depended upon the houselight frequency. The subjects acquired each conditional discrimination. Behavioral contrast occurred during the acquisition and abolition of the discriminations. Generalization tests, given after each conditional discrimination, revealed that both the line tilt and houselight frequency dimensions controlled pecking only after conditional discriminations in which reinforcement availability depended upon the value of both dimensions.     

Stimulus control and delayed reinforcement

Pigeons were tested for generalization along the line-orientation dimension, after being trained on various two-component multiple schedules. The first component contained either a variable-interval 1-min schedule of immediate reinforcement or an extinction schedule and was associated with a plain white key (S1). The second component contained a variable-interval 1-min schedule of delayed reinforcement and was associated with a black line on a white background (S2). The major results showed that (a) decremental gradients were obtained around the stimulus associated with the delayed reinforcement component when S1 was associated with extinction, but that incremental gradients were obtained when S1 was associated with immediate reinforcement, (b) the subjects' pretraining did not affect the generalization gradients if sufficient training on the terminal multiple schedule was provided, and (c) changing the S1 schedule from immediate reinforcement to extinction produced behavioral contrast if reinforcement was delayed for 10 sec during S2, but not if it was delayed for 20 sec.     

Behavioral contrast produced by a signaled decrease in local rate of reinforcement

Pigeons' key pecking in the presence of one stimulus (S1) was reinforced according to a response-dependent variable-interval schedule. Pecking rate during S1 increased (behavioral contrast) when a second stimulus (S2) [associated with either a response-dependent fixed-interval schedule (Experiment I) or a response-independent reinforcement schedule in which reinforcement availability was signaled by visual (Experiment II) or temporal (Experiment III) stimuli] alternated with S1. These experiments suggest that a discriminable, signaled decrease in local reinforcement rate during S2 is an antecedent of the behavioral contrast response rate increases during S1.     

Facilitation of food-reinforced responding by a signal for response-independent food

Five pigeons whose key pecking was maintained by 4-sec access to grain on a variable-interval 2-min schedule received Pavlovian differential conditioning trials superimposed upon the instrumental baseline. The conditioned stimuli were changes in the stimulus on the key from white to red, or to a white horizontal line against a dark background. The positive conditioned stimulus was 20 sec long, and was followed immediately by 8-sec access to grain. The negative conditioned stimulus, also 20 sec long, was never paired with response-independent food. All pigeons responded more rapidly in the presence of the positive conditioned stimulus than in the presence of the negative one. The positive conditioned stimulus produced an increase in response rate over the pre-conditioned stimulus period. The negative conditioned stimulus had no marked effect upon response rate. When the roles of the positive and negative stimuli were reversed, and the duration of the response-independent reinforcement was reduced to 4 sec, the new positive conditioned stimulus came to facilitate responding, and the new negative conditioned stimulus no longer produced facilitation. A second discrimination reversal produced similar outcomes. When a third reversal was initiated, and the duration of response-independent reinforcement was reduced to 2 sec, the difference between the effects of the positive and negative stimuli diminished.