Effects of conditioned reinforcement frequency in an intermittent free-feeding situation,

Key-pecking intermittently produced a set of brief exteroceptive stimulus changes under two-component multiple schedules of conditioned reinforcement. Throughout the study, free access to grain was concurrently provided on an intermittent basis via a variable-interval tape. Free food presentations scheduled by the tape were delivered if no peck had been emitted for 6 sec, and the brief stimulus changes produced by responding under the multiple schedules were those which accompanied food presentation. The second component of each multiple schedule was always associated with a 1-min, variable-interval schedule of conditioned reinforcement. The schedule associated with the first component was systematically varied and conditioned reinforcement was either absent (extinction) or programmed on a 1-, 3-, 6-, or 12-min variable-interval schedule. Under these conditions, rate of responding in the manipulated component decreased monotonically with a decrease in the frequency of conditioned reinforcement. In addition, contrast effects were often obtained in the constant, second component. These results are similar to those obtained with similar multiple schedules of primary reinforcement.     

Successive independence and behavioral contrast in a closed economy.

Two pigeons had access to multiple concurrent schedules of reinforcement for 24 hours per day in their home cages. The variable-interval schedules comprising the multiple concurrent schedules were varied across 16 conditions. In three sets of conditions, one schedule was varied while its concurrent alternative and the concurrent schedules in the other component were held constant. Behavioral contrast was observed; that is, as the rate of reinforcement arranged by the varied schedule decreased, response rates on the constant schedules typically increased. These conditions formed part of two larger sets of conditions in which the concurrent schedules in one multiple-schedule component remained constant while the concurrent schedules in the other component were varied. Successive independence was found, in that behavior allocation during the constant component did not vary as a function of the reinforcer ratios in the varied component. Successive independence between components in multiple concurrent schedules is a robust result that occurs in closed economies and under conditions that promote behavioral contrast.     

Positive interaction (induction) in multiple variable-interval, differential-reinforcement-of-high-rate schedules

The effect of increases in the rate of responding in one component of a multiple schedule upon the rate of responding in a second component was investigated. Pigeons were exposed to a multiple schedule where both components were initially variable-interval schedules having the same parameter value. After rate of key pecking stabilized, one component was changed to a schedule that differentially reinforced high rates of responding. Rate of reinforcement in this varied component was adjusted to remain equal to rate of reinforcement in the constant (variable-interval) component. Four of five pigeons showed a maintained increase in rate of responding during both the constant and varied components, even though rates of reinforcement did not change.     

Concurrent second-order schedules of reinforcement

Responses on one key (the main key) of a two-key chamber produced food according to a second-order variable-interval schedule with fixed-interval schedule components. A response on a second key (the changeover key) alternated colors on the main key and provided a second independent second-order variable-interval schedule with fixed-interval components. The fixed-interval component on one variable-interval schedule was held constant at 8 sec, while the fixed interval on the other variable-interval schedule was varied from 0 to 32 sec. Under some conditions, a brief stimulus terminated each fixed interval and generated fixed-interval patterns; in other conditions, the brief stimulus was omitted. Relative response rate and relative time deviated substantially from scheduled relative reinforcement rate and, to a lesser extent, from obtained relative reinforcement rate under both brief-stimulus and no-stimulus conditions. Matching was observed with equal components on both schedules; with unequal components, increasingly greater proportions of time and responses than the matching relation would predict were spent on the variable-interval schedule containing the shorter component. Preference for the shorter fixed interval was typically more extreme under brief-stimulus than under no-stimulus schedules. The results limit the extension of the matching relation typically observed under simple concurrent variable-interval schedules to concurrent second-order variable-interval schedules.     

Contrast effects in response rate and accuracy of delayed matching to sample

Behavioural contrast is an inverse relation between the response rate in one component of a multiple schedule and the reinforcer rate in an alternated component. To explore possible contrast effects in accuracy as well as response rate, four pigeons were trained in multiple schedules where key pecking produced delayed matching-to-sample trials on a variable-interval schedule. Reinforcer probability for correct matches was constant at .3 in one component, and the conditions of reinforcement were varied in the second component. In Experiment 1, the varied component arranged the same contingencies as the constant component but with reinforcer probabilities of .9 or .1 across conditions. In the varied component, both response rate and accuracy of delayed matching were directly related to reinforcer probability; in the constant component, however, contrast effects on response rate were weak, and there was no evidence of contrast in accuracy of matching. In Experiment 2, the varied component was either variable interval with immediate food reinforcement or extinction. Reliable contrast effects were obtained in both response rate and in accuracy of matching in the constant component, and their magnitudes were correlated within and between subjects. The results of Experiment 2 join previous findings of covariation in the effects of reinforcement on free-operant responding and accuracy of discrimination.     

Undermatching and contrast within components of multiple schedules

Six multiple variable-interval schedules each comprised one variable-interval sixty second component and an alternated component which was varied. Four pigeons' responses were recorded in five successive subintervals of each component. Response rate changes across subintervals revealed instances of local contrast and small local induction effects in the changed component. In the constant component, smaller local contrast and larger local induction effects obtained. Accordingly, the magnitude of behavioral contrast, defined as an inverse relation between response rate in the constant component and reinforcement rate in the changed component, did not change reliably across subintervals of the constant component. Ratios of response rates in initial subintervals were highly sensitive to reinforcement ratios. Sensitivity decreased sharply over the first two-fifths of the components and remained constant for the remainder. The results demonstrated that changes in multiple schedule sensitivity are a function of time since the alternation of successive components.     

Response rate, reinforcement frequency, and behavioral contrast

Pigeons responded for food on a multiple schedule in which periods of green-key illumination alternated with periods of red-key illumination. When behavior had stabilized with a variable-interval 2-min schedule of reinforcement operating during both stimuli, low rates of responding (interresponse times greater than 2 sec) were differentially reinforced during the green component. Conditions during the red stimulus were unchanged. Response rates during the green component fell without changing the frequency of reinforcement but there were no unequivocal contrast effects during the red stimulus. The frequency of reinforcement during the green component was then reduced by changing to a variable-interval 8-min schedule without reducing the response rates in that component, which were held at a low level by the spacing requirement. Again, the conditions during the red stimulus were unchanged but response rates during that stimulus increased. These results show that reductions in reinforcement frequency, independently of response rate, can produce interactions in multiple schedules.     

Peak shift as a function of multiple schedules of reinforcement

Pigeons were trained to respond to two stimuli on the wavelength continuum, 550 nm and 570 nm, each correlated with an independent schedule of reinforcement. The multiple schedule component in effect during 550 nm (S1) was always a variable-interval 1-min. During the 570-nm stimulus (S2) the second component of the schedule was either variable-interval 30-sec, 1-min, 2-min, 5-min, or extinction for different groups of birds. Generalization gradients were obtained after this training, with the following results: (1) response rate to S1 during training was related to the reinforcement frequency associated with S2; the distribution of responding during generalization testing was a function of the schedules of reinforcement used during training and the response rates they produced. Decreases in the relative frequency of reinforcement correlated with S2 resulted in increases in the distribution shift of responses away from S2 during generalization testing.     

Brief-stimulus presentations on multiform tandem schedules

Three experiments examined the influence of a brief stimulus (a light) on the behavior of food-deprived rats whose lever pressing on tandem schedules comprising components of different schedule types resulted in food presentation. In Experiment 1, either a tandem variable-ratio variable-interval or a tandem variable-interval variable-ratio schedule was used. The variable-interval requirement in the tandem variable-ratio variable-interval schedule was yoked to the time taken to complete the variable-ratio component in the tandem variable-interval variable-ratio schedule, and the length of the variable-interval component in the latter schedule was yoked to the variable-ratio component in the former schedule. If a brief stimulus occurred following completion of the first component, then behavior was differentiated in the two components; subjects responded more quickly in the variable-ratio than in the variable-interval component. If the stimulus was removed, then response rate was determined by the nature of the final component. Similar results were obtained in Experiments 2 and 3 with the use of a three-component tandem variable-ratio variable-interval variable-ratio schedule or tandem variable-interval variable-ratio variable-interval schedule. Thus, a brief stimulus that was not explicitly paired with reinforcement engendered behavior typical of the component schedule preceding its presentation.     

Relative reinforcer magnitude under a nonindependent concurrent schedule of cocaine reinforcement in rhesus monkeys.

Lever pressing by three rhesus monkeys was maintained under a two-lever concurrent schedule of cocaine reinforcement. Responding on one lever (constant-dose lever) produced a constant dose of 0.05 or 0.1 mg/kg/injection arranged according to a variable-interval 1-min schedule. Responding on the other lever (variable-dose lever) produced a comparison dose of cocaine (0.013 to 0.8 mg/kg/injection), also under a variable-interval 1-min schedule. The two variable-interval schedules were made nonindependent by arranging that the assignment of a reinforcer by one schedule inactivated the second schedule until the assigned reinforcer had been obtained. This modification ensured that the two cocaine doses were obtained with approximately equal frequency, regardless of the distribution of the subject's responding. Preference, indicated by relative response frequency on the variable-dose lever, was almost always for the larger of the doses and was a monotonic function of the comparison dose, except at the highest doses. Preferences at the highest comparison doses may have resulted from the low overall response rates exhibited at these doses. Relative response frequencies on the variable-dose lever roughly matched relative reinforcer magnitude (mg/kg/injection available on the variable-dose lever divided by the sum of mg/kg/injections available on each lever).     

Behavioral contrast and response independent reinforcement

Four pigeons received pre-training that included presentation of the reinforcer independently of behavior and then baseline training on a variable-interval schedule of reinforcement. With the introduction of a multiple schedule, in which the first stimulus was associated with a response contingent and a second stimulus with a response independent, 1-min variable-interval schedule, a reduction in response rate was obtained in the second component, which was not accompanied by a behavioral contrast effect in the first component. A further three pigeons were given the same pre-training and baseline training before the introduction of an otherwise identical multiple schedule, in which no reinforcement occured in the second component. Behavioral contrast was obtained from all three subjects. The results indicated that under conditions of constant reinforcement density a reduction in responding is not a sufficient condition for the occurrence of behavioral contrast.     

Behavioral contrast in competitive and noncompetitive environments

Three experiments examined the effects of opportunities for an alternative response (drinking) on positive behavioral contrast of rats' food-reinforced bar pressing. In both Experiments 1 and 2 the baseline multiple variable-interval schedules were rich (variable interval 10-s), and contrast was examined both with and without a water bottle present. In Experiment 1, the rats were not water deprived. When one component of the multiple schedule was changed to extinction, the rate of bar pressing increased in the constant component (positive behavioral contrast). The magnitude of contrast was larger when the bottle was absent than when it was present, as predicted by the matching law. Drinking did not shift from the constant variable-interval component to the extinction component, as might have been expected from competition theory. In Experiment 2, the rats were water deprived. Contrast was larger when the bottle was present than when it was absent, and drinking did shift to the extinction component, as predicted by competition theory. In Experiment 3, water-deprived rats responded on leaner multiple variable-interval schedules (60-s) in the presence of a water bottle. When one component was changed to extinction, contrast did not occur, and drinking did not shift to the extinction component. The present results suggest that there are at least two different sources of behavioral contrast: “competitive” contrast, observed when an alternative response occurs with high probability, and “noncompetitive” contrast, observed when an alternative response occurs with low probability. The results, in conjunction with earlier studies, also suggest that the form of the alternative response and the rate of food reinforcement provided by the multiple schedule combine to determine the amount of contrast.     

Sensitivity to relative reinforcer rate in concurrent schedules: independence from relative and absolute reinforcer duration

Twelve pigeons responded on two keys under concurrent variable-interval (VI) schedules. Over several series of conditions, relative and absolute magnitudes of reinforcement were varied. Within each series, relative rate of reinforcement was varied and sensitivity of behavior ratios to reinforcer-rate ratios was assessed. When responding at both alternatives was maintained by equal-sized small reinforcers, sensitivity to variation in reinforcer-rate ratios was the same as when large reinforcers were used. This result was observed when the overall rate of reinforcement was constant over conditions, and also in another series of concurrent schedules in which one schedule was kept constant at VI ached 120 s. Similarly, reinforcer magnitude did not affect the rate at which response allocation approached asymptote within a condition. When reinforcer magnitudes differred between the two responses and reinforcer-rate ratios were varied, sensitivity of behavior allocation was unaffected although response bias favored the schedule that arranged the larger reinforcers. Analysis of absolute response rates ratio sensitivity to reinforcement occurrred on the two keys showed that this invariance of response despite changes in reinforcement interaction that were observed in absolute response rates on the constant VI 120-s schedule. Response rate on the constant VI 120-s schedule was inversely related to reinforcer rate on the varied key and the strength of this relation depended on the relative magnitude of reinforcers arranged on varied key. Independence of sensitivity to reinforcer-rate ratios from relative and absolute reinforcer magnitude is consistent with the relativity and independence assumtions of the matching law.     

Behavioral contrast and relative reinforcement frequency in two multiple schedules

After preliminary variable-interval training, one group of pigeons was trained on a series of multiple variable-interval low-rate reinforcement schedules, while another group was trained on a series of multiple variable-interval fixed-ratio reinforcement schedules. Contrast effects were observed as variable-interval baseline rate changed in a direction away from the change in reinforcement frequency in the other component. The effects of the variable-interval component on performance in the low-rate and fixed-ratio reinforcement components in the multiple schedules were assessed by comparing the birds' performances on each of these schedules alone. Fixed-ratio reinforcement schedules showed a susceptibility to contrast effects, low-rate reinforcement schedules did not. The rate of reinforcement in fixed-ratio schedules at which no interaction occurred in the multiple schedules was higher than that in variable-interval 1-min schedules, suggesting that pigeons may prefer time-based, rather than response-based, reinforcement.     

Some effects of fixed-interval duration on response rate in a two-component chain schedule

In Exp. I three pigeons were trained on a two-component chain schedule. Responding on a 1-min variable-interval schedule in the initial component led to a sequence of two fixed-interval schedules in the terminal component. The rate of reinforcement in the terminal component was kept constant while the values of the two fixed intervals were varied. Three combinations of fixed-interval schedules were studied, FI 0.25, FI 1.75 (minutes) or FI 1.00, FI 1.00, or FI 1.75, FI 0.25. The rate for each subject declined in the initial component as the value of the first fixed interval was increased. Experiment II was conducted to assess the role of the second fixed-interval schedule in the terminal component in determining the rate of responding in the initial component. For each chain schedule the rate of responding in the initial component was determined both with and without the second of the sequence of fixed intervals. In all three cases the rate of responding in the initial component decreased when the second fixed interval was removed. Increasing the first fixed interval in Exp. I had a greater effect on variable-interval performance than did the removal of the second fixed interval in Exp. II.     

Multiple and concurrent schedule performance: independence from concurrent and successive schedule contexts

Six pigeons were trained on multiple variable-interval schedules and performance was measured in the presence or absence of another variable-interval schedule (the common schedule) arranged concurrently with both components. Manipulations included varying the rate of reinforcement on the common schedule, leaving the common schedule unchanged while the components of the multiple schedule were varied, varying the multiple schedule components in the absence of the common schedule, and varying one component of the multiple schedule while the other component and the common schedule were unchanged. The normal rate-increasing and rate-decreasing effects of reinforcement rate increase were found, except that changing one multiple schedule component did not affect the response rate in the successively available common schedule component. Both concurrent and multiple schedule performance undermatched obtained reinforcement-rate ratios, but the degree of undermatching in multiple schedules was reliably greater. Allocation of responses between multiple schedule components was unaffected by the concurrent availability of reinforcement, and allocation of responses between concurrent schedules was unaffected by the successive availability of different reinforcement rates.     

Interaction of frequency and magnitude of reinforcement on concurrent performances

Frequency and magnitude of reinforcement were varied in concurrent variable-interval variable-interval schedules of reinforcement. The relative response rate to the two stimuli did not support the notion that choice approximately matches relative total access to food (the product of frequency and magnitude of reinforcement in one schedule divided by the sum of products of frequency and magnitude in both schedules). Relative response rates matched relative reinforcement value when that measure was adjusted to give more emphasis to reinforcement frequency than to reinforcement duration.     

Behavioral interactions in multiple variable-interval schedules

In Experiment I, two groups of four pigeons each were exposed to multiple schedules in which one component was always a variable-interval schedule with a mean interreinforcement interval of 30 or 180 seconds. The other component was either an equal variable-interval schedule or extinction. Response rates in the unchanged component always increased when reinforcement was no longer scheduled in the changed component, and decreased in seven of eight cases when the variable-interval schedule was re-introduced. The per cent rate change in the unchanged component was inversely related to the frequency of reinforcement and to the ongoing response rate in the unchanged component. Rate changes in the unchanged component were not consistently correlated with changes in any single feature of the relative-frequency interresponse-time distributions. In Experiment II, the same pigeons were exposed to variable-interval schedules and multiple variable-interval variable-interval schedules with equal mean interreinforcement intervals. Response rates were similar under both conditions.     

Multiple determinants of the effects of reinforcement magnitude on free-operant response rates

Four experiments examined the effects of increasing the number of food pellets given to hungry rats for a lever-press response. On a simple variable-interval 60-s schedule, increased number of pellets depressed response rates (Experiment 1). In Experiment 2, the decrease in response rate as a function of increased reinforcement magnitude was demonstrated on a variable-interval 30-s schedule, but enhanced rates of response were obtained with the same increase in reinforcement magnitude on a variable-ratio 30 schedule. In Experiment 3, higher rates of responding were maintained by the component of a concurrent variable-interval 60-s variable-interval 60-s schedule associated with a higher reinforcement magnitude. In Experiment 4, higher rates of response were produced in the component of a multiple variable-interval 60-s variable-interval 60-s schedule associated with the higher reinforcement magnitude. It is suggested that on simple schedules greater reinforcer magnitudes shape the reinforced pattern of responding more effectively than do smaller reinforcement magnitudes. This effect is, however, overridden by another process, such a contrast, when two magnitudes are presented within a single session on two-component schedules.     

Control rate of response or reinforcement and amphetamine's effect on behavior.

The roles of control response rate and reinforcement frequency in producing amphetamine's effect on operant behavior were evaluated independently in rats. Two multiple schedules were arranged in which one variable, either response rate or reinforcement frequency, was held constant and the other variable manipulated. A multiple differential-reinforcement-of-low-rate seven-second yoked variable-interval schedule was used to equate reinforcement frequencies at different control response rates between multiple-schedule components. Amphetamine increased responding under the variable-interval component. In contrast, amphetamine decreased responding equivalently between components of a multiple random-ratio schedule that produced similar control response rates at different reinforcement frequencies. The results provide experimental support to the rate-dependency principle that control rate of responding is an important determinant of amphetamine's effect on operant behavior.