A molecular analysis of multiple schedule interactions: negative contrast

The present experiments investigated the relationship between changes in the relative reinforced interresponse-time distributions and the occurrence of positive and negative contrast in multiple variable-interval—variable-interval and multiple variable-interval—extinction schedules of reinforcement. Experiment I demonstrated that changes in the interresponse-time distributions were consistently correlated with response-rate changes referred to as positive and negative contrast. Corresponding changes in the reinforced interresponse-time distributions suggested that negative contrast resulted as an inductive effect of selectively reinforcing long interresponse times in the altered component at the moment the baseline schedule was reintroduced. Experiment II demonstrated that the magnitude of the negative-contrast effect could be significantly decreased if the altered component schedule was modified in order to prevent the reinforcement of these interresponse times during the first few sessions of baseline recovery. The results supported a proposal that interresponse time—reinforcer relations may act as amplifiers or attenuators of negative contrast.     

Delayed reinforcement in a multiple schedule

Three rats and a pigeon were first trained on a two-component multiple schedule in which reinforcement in the two components occurred immediately after a response. Later, reinforcement in one component was delayed by a few seconds. During both stages of the experiment, reinforcement was scheduled by equal variable- (pigeon) or random-interval (rats) schedules in the two components. The main effect of the delayed reinforcement was to increase the rate of responding in the unchanged (non-delay) component. This behavioral contrast effect did not appear in all cases to be dependent upon a reduction in the rate of responding or the frequency of reinforcement in the delay component. This finding suggests that a reduction in response rate and/or reinforcement frequency in one component of a multiple schedule may not be a necessary prerequisite for the occurrence of behavioral contrast. This finding is, however, consistent with an explanation that suggests that behavioral contrast results from the introduction of a less-preferred condition in one component of a multiple schedule, since it is known that animals “prefer” immediate to delayed reinforcement.     

Hunger and contrast in a multiple schedule

Pigeons working for food on a multiple variable-interval 1-min-variable-interval 4-min schedule were subjected to variations in body weight, presumably causing changes in hunger. The proportion of responses in each component approached and eventually reached the proportion of reinforcements as body weight increased. This effect follows from the matching-law interpretation of contrast in multiple schedules.     

Discrimination of a response-independent component in a multiple schedule

Pigeons were trained to respond in non-differential reinforcement pre-discrimination training, with a multiple variable-interval 1-min variable-interval 1-min schedule. Each bird then received discrimination training with a multiple variable-interval 1-min variable-time 1-min schedule. Thus, discrimination training was between response-dependent (variable-interval) and response-independent (variable-time) schedules with the rate of reinforcement equated. In Experiment I, only three sessions of non-differential reinforcement preceded discrimination training and for half the birds, a 0° line was correlated with the response-dependent schedule; for the remaining birds the 0° line was correlated with the response-independent schedule. Post-discrimination gradients of excitatory stimulus control were obtained from the former group, while the latter group showed little evidence of post-discrimination stimulus control by the 0° line. Differential responding to the variable-time schedule was not accompanied by behavioral contrast to the variable-interval schedule. In Experiment II, 20 sessions of non-differential reinforcement preceded discrimination training and the 0° line was correlated with variable-time reinforcement for each bird. Differential responding to the 0° line was accompanied by negative induction to the variable-interval schedule and by inhibitory stimulus control about the 0° line during a post-discrimination generalization test.     

Development of a complex multiple schedule in the chimpanzee

The development of chimpanzee behavior on a four-component, three-lever multiple schedule is described. Component schedules included the Sidman avoidance procedure with a concurrent discriminated avoidance schedule on a second lever, fixed ratio performance for food, differential reinforcement of low rate for water requiring a dual response chain, and a symbol discrimination task for continuous food reinforcement using three levers. The avoidance component of this schedule was employed during the January 31, 1961 suborbital space flight of the chimpanzee “Ham.” On November 29, 1961, the chimpanzee “Enos” performed on the multiple schedule during three orbits around the earth in a Mercury capsule.     

An evaluation of a three‐component multiple schedule to indicate attention availability

Students may engage in high rates of social approach responses at inappropriate times throughout the school day. One intervention that has been used to teach students appropriate and inappropriate times to access attention is a multiple schedule of reinforcement. In this study, we evaluated the efficacy of a multiple schedule that indicated when attention was available or not available in a bilingual preschool classroom during small‐group instruction. Results showed that the intervention was effective in bringing students’ social approaches under stimulus control.     

Time-dependent contrast effects in a multiple schedule of food reinforcement

Four rats were rewarded for running in a wheel under two alternating conditions of food reinforcement. These periods of frequent and infrequent reinforcement, each accompanied by a particular stimulus, were presented a number of times in each daily session. Following shifts from high to low frequency of reinforcement, responding decreased suddenly and markedly, and then recovered within the next few minutes. The magnitude of this temporary depression was an increasing function of the duration of the immediately preceding component of high-frequency reinforcement. A transient elevation in performance, which did not vary with the duration of the prior component, was noted in two subjects following shifts from low to high frequency of reinforcement. The elevation and depression effects did not appear simultaneously during the 48 experimental sessions. A possible relation between the difficulty of the discrimination and the extent of contrast effects is discussed.     

Pavlovian contingencies and resistance to change in a multiple schedule

According to theoretical accounts of behavioral momentum, the Pavlovian stimulus—reinforcer contingency determines resistance to change. To assess this prediction, 8 pigeons were exposed to an unsignaled delay-of-reinforcement schedule (a tandem variable-interval fixed-time schedule), a signaled delay-of-reinforcement schedule (a chain variable-interval fixed-time schedule), and an immediate, zero-delay schedule of reinforcement in a three-component multiple schedule. The unsignaled delay and signaled delay schedules employed equal fixed-time delays, with the only difference being a stimulus change in the signaled delay schedule. Overall rates of reinforcement were equated for the three schedules. The Pavlovian contingency was identical for the unsignaled and immediate schedules, and response—reinforcer contiguity was degraded for the unsignaled schedule. Results from two disruption procedures (prefeeding subjects prior to experimental sessions and adding a variable-time schedule to timeout periods separating baseline components) demonstrated that response—reinforcer contiguity does play a role in determining resistance to change. The results from the extinction manipulation were not as clear. Responding in the unsignaled delay component was consistently less resistant to change than was responding in both the immediate and presignaled segments of the signaled delay components, contrary to the view that Pavlovian contingencies determine resistance to change. Probe tests further supported the resistance-to-change results, indicating consistency between resistance to change and preference, both of which are putative measures of response strength.     

An evaluation of antecedent exercise on behavior maintained by automatic reinforcement using a three-component multiple schedule

We evaluated antecedent exercise for treating the automatically reinforced problem behavior of 4 individuals with autism. We conducted preference assessments to identify leisure and exercise items that were associated with high levels of engagement and low levels of problem behavior. Next, we conducted three 3-component multiple-schedule sequences: an antecedent-exercise test sequence, a noncontingent leisure-item control sequence, and a social-interaction control sequence. Within each sequence, we used a 3-component multiple schedule to evaluate preintervention, intervention, and postintervention effects. Problem behavior decreased during the postintervention component relative to the preintervention component for 3 of the 4 participants during the exercise-item assessment; however, the effects could not be attributed solely to exercise for 1 of these participants.     

Temporal control of behavior: schedule interactions

In Experiment I the response that terminated the postreinforcement pauses occurring under a fixed-interval 60-second schedule was reinforced, if the pause duration exceeded 30 seconds. The percentage of such pauses, rather than increasing, decreased. There were complex effects on the discriminative control of the pause by the reinforcer terminating the previous fixed interval, depending on whether the fixed interval and the added reinforcer were the same or different. In Experiments II(a) and II(b), each reinforcement initiated an alternative fixed-interval interresponse-time-greater-than-t-sec schedule, the schedule values being systematically varied. When the response following a pause exceeding a given duration was reinforced, fewer such pauses occurred than when they were not reinforced, i.e., on the comparable simple fixed-interval schedule. There was no systematic relationship between mean interrinforcement interval and duration of the postreinforcement pause. The pause duration initiated by reinforcement was directly related to the dependency controlling the shortest pause at that time, regardless of changes in mean interreinforcement interval.     

Observing behavior in squirrel monkeys under a multiple schedule of reinforcement availability

Observing behavior of two squirrel monkeys was examined under a multiple schedule of four components. Lever (observing) responses produced either a stimulus indicating the availability of food or another stimulus indicating food was not available. Key responses in the presence of the food-available stimulus produced food on a continuous reinforcement schedule. In the absence of food-available stimuli, responding on the key had no scheduled consequences. Observing responses produced food-available stimuli according to three different random-interval schedules with mean interstimulus availability times of 1, 2, and 4 min. In the fourth component of the multiple schedule (observing extinction) food-available stimuli never occurred. Each component of the schedule was correlated with a distinctive auditory stimulus. Observing rates decreased with decreasing frequency of the food-available stimulus. Observing rates during extinction continued decreasing when the brief stimulus indicating food unavailability was no longer produced by lever pressing. When the brief stimulus was reinstated response rates increased abruptly.     

Effects of ethanol on multiple fixed-interval fixed-ratio schedule performances: dynamic interactions at different fixed-ratio values.

Key pecking by three pigeons was maintained under a multiple fixed-interval fixed-ratio schedule of food presentation. The fixed-interval value remained at 3 minutes, while the fixed-ratio size was increased systematically in 30-response increments from 30 to either 120 (two pigeons) or 150 (one pigeon). At least two lower fixed-ratio values were also redetermined. The effects of ethanol (5 to 2.5 g/kg) were assessed at each of the different schedule parameters. Both overall and running response rates under the fixed-ratio schedule decreased with increases in the size of the fixed-ratio schedule; pause duration under the fixed-ratio schedule was directly related to increases in fixed-ratio size. Overall and running rates of responding under the fixed-interval schedule changed little with increases in the size of the fixed-ratio schedule. Despite the relative invariance of fixed-interval responding across the different fixed-ratio values, the effects of ethanol on responding under the fixed-interval schedule differed depending on the size of the fixed-ratio schedule. Greater increases occurred in both overall and in lower local rates of responding under the fixed-interval schedule when the fixed-ratio value was 120 or 150. The effects of ethanol on responding under the fixed-ratio schedule also depended on the size of the fixed ratio. Increases in responding under the fixed-ratio schedule were typically greater at the higher fixed-ratio values where response rates were lower. When the effects of ethanol were redetermined at the lower fixed-ratio parameter values, rates and patterns of responding were comparable to those obtained initially. However, the dose-effect curves for responding under both fixed-ratio and fixed-interval schedules were shifted up and to the right of those determined during the ascending series. The effects of ethanol can depend on rate or responding, behavioral history, and the context in which behavior occurs.     

Performance of children under a multiple random-ratio random-interval schedule of reinforcement

Three children, aged 1.5, 2.5, and 4.5 years, pressed telegraph keys under a two-component multiple random-ratio random-interval schedule of reinforcement. In the first condition, responses on the left key were reinforced under a random-interval schedule and responses on the right key were reinforced under a random-ratio schedule. In the second condition, the schedule components were reversed. In the third condition, the original arrangement was reinstated. For all subjects, rates of responding were higher in the random-ratio component despite higher rates of reinforcement in the random-interval component. The average interreinforcement interval of the random-interval component was increased in the fourth condition, resulting in more similar rates of reinforcement for both schedule components, and then returned to its original value in the fifth condition. In both conditions, all subjects continued to exhibit higher rates of responding in the ratio component than in the interval component. Although these observations are consistent with results from studies with pigeons, it is argued that the response-rate differences between the interval and ratio schedule components are sufficient to demonstrate schedule sensitivity.