Concurrent schedules: Effects of time- and response-allocation constraints

Five pigeons were trained on concurrent variable-interval schedules arranged on two keys. In Part 1 of the experiment, the subjects responded under no constraints, and the ratios of reinforcers obtainable were varied over five levels. In Part 2, the conditions of the experiment were changed such that the time spent responding on the left key before a subsequent changeover to the right key determined the minimum time that must be spent responding on the right key before a changeover to the left key could occur. When the left key provided a higher reinforcer rate than the right key, this procedure ensured that the time allocated to the two keys was approximately equal. The data showed that such a time-allocation constraint only marginally constrained response allocation. In Part 3, the numbers of responses emitted on the left key before a changeover to the right key determined the minimum number of responses that had to be emitted on the right key before a changeover to the left key could occur. This response constraint completely constrained time allocation. These data are consistent with the view that response allocation is a fundamental process (and time allocation a derivative process), or that response and time allocation are independently controlled, in concurrent-schedule performance.     

Behavioral economics of drug self-administration. II. A unit-price analysis of cigarette smoking.

In behavioral economics, the ratio of response requirement to reinforcer magnitude is referred to as unit price. Previous research with nonhuman subjects has demonstrated that (a) comparable amounts of food are consumed at the same unit price even though different response requirements and reinforcer magnitudes comprise that unit price and (b) increases in unit price decrease food consumption in a positively decelerating fashion. The present study assessed the generality of these findings to the cigarette smoking of 5 human volunteers. During approximately 18 3-hr sessions, various combinations of response requirement (fixed-ratio 200, 400, and 1,600) and reinforcer magnitude (1, 2, and 4 puffs per bout) were arranged. Consumption (i.e., the number of puffs) generally was comparable at the same unit price independent of the response requirement and reinforcer magnitude comprising that unit price. In addition, increasing unit price generally decreased consumption in a positively decelerating fashion. These results extend the generality of the unit-price analysis to human cigarette smoking. Moreover, these results further support the position that reinforcer magnitude and response requirement are functionally equivalent and interact to determine consumption. The concept of unit price, by integrating and summarizing the effects of those two operations, provides a more parsimonious explanation of the results than do separate evaluations of the effects of response requirement and reinforcer magnitude.     

Performance of humans in concurrent avoidance/positive-reinforcement schedules

Performance maintained under concurrent schedules consisting of a variable-interval avoidance component and a variable-interval positive-reinforcement component was studied in three human subjects using points exchangeable for money as the reinforcer. The rate of responding in the avoidance component increased, and the rate of responding in the positive-reinforcement component declined, as a function of the frequency of point-losses avoided in the avoidance component. The performance of all three subjects conformed to equations proposed by Herrnstein to describe behavior in concurrent schedules. The logarithms of the ratios of the response rates in the two components, and the logarithms of the ratios of the times spent in the two components, were linearly related to the logarithms of the ratios of the frequency of loss avoidance in the avoidance component to the frequency of reinforcement in the positive-reinforcement component. When a changeover delay of 5.0 sec was imposed, the slopes of the linear functions were close to 1.0 in the case of two subjects, whereas the third subject exhibited significant undermatching. For two subjects the changeover delay was then reduced to 2.0 sec; in both cases the slopes of the linear functions were lower than under the 5.0-sec condition. One subject participated in a third phase, in which no changeover delay was imposed; there was a further reduction in the slopes of the linear functions.     

Interval and ratio reinforcement of a complex sequential operant in pigeons

Pigeons were required to produce exactly four pecks on each of two keys in any order for reinforcement. Correct response sequences were reinforced on either fixed-interval two-minute or fixed-ratio four schedules, with each correct sequence treated as a single response. Each pigeon developed a particular dominant sequence that accounted for more than 80% of all sequences. Sequence stereotypy was relatively unaffected by the temporal properties of the fixed-interval and fixed-ratio schedules. Response time (time from the first response in each sequence to the last) was also relatively unaffected by the temporal properties of the schedules. In contrast, response latency (time from end of one sequence to the beginning of the next) was markedly affected by the schedules. Latencies were long early in the interreinforcement interval and got shorter as the interreinforcement interval progressed. These data suggest that stereotyped response sequences become functional behavioral units, resistant to disruption or alteration by reinforcement variables that ordinarily influence the temporal spacing of individual responses.     

Choice and multiple reinforcers

Pigeons chose between equivalent two-component mixed and multiple terminal-link schedules of reinforcement in the concurrent-chains procedure. The pigeons preferred the multiple schedule over the mixed when the components of the compound schedules were differentiated in terms of density of reinforcement, but the pigeons were indifferent when the components were differentiated in terms of number of reinforcers per cycle. Taken together, these results indicate that a local variable, the interval to the first reinforcer, but not a molar variable, the number of reinforcers, was sufficient to differentiate the components and thereby evoke preference.     

Stimulus discriminability in free-operant and discrete-trial detection procedures.

Six pigeons were trained to discriminate different light intensities in four experimental procedures. Experiment 1 compared stimulus discriminability in a yes-no signal-detection task with discriminability measures obtained from two free-operant procedures. Discriminability estimates were significantly lower in the detection procedure. Experiment 2 showed this lowered discriminability to be a function of the delay between stimulus presentation and the availability of the choice-response keys in the standard detection task. In addition, reinforcement sensitivity was lowest when correct choice responses were intermittently, rather than continuously, reinforced.     

Human performance on conjunctive fixed-interval fixed-ratio schedules

Eighteen young adults performed a lever-pulling task for money. Subjects were initially exposed to a fixed-interval 80-second schedule and subsequently to one of three conjunctive schedules in which the added fixed-ratio requirement was set at either 10, 80, or 120 responses. Three fixed-interval response patterns emerged: high constant rate, intermediate rate, or low rate, with most subjects displaying the last. Conjunctive performance was related to the subjects' prior fixed-interval patterns and the conjunctive ratio requirements. Low-rate subjects tended to optimize reinforcement (maximum reinforcers for minimum responses) on conjunctive schedules. Response rate was directly related to ratio requirements. Subjects' performance closely corresponded to their verbal statements of the contingencies.     

A comparison of responding maintained under second-order schedules of intramuscular cocaine injection or food presentation in squirrel monkeys.

Key pressing by squirrel monkeys was maintained under second-order schedules of either intramuscular cocaine injection or food presentation. Under one schedule, each completion of a 10-response fixed-ratio unit produced a brief visual stimulus; the first fixed-ratio unit completed after 30 minutes elapsed produced the stimulus paired with either cocaine injection or food presentation. Generally, short pauses followed by high rates of responding were maintained within the fixed-ratio units, and responding was positively accelerated over the 30-minute interval. Under another schedule, each completion of a 3-minute fixed-interval unit produced the brief stimulus; completion of the 10th fixed-interval unit produced the stimulus paired with either cocaine injection or food presentation. Generally, short pauses followed by high rates of responding were maintained within the fixed-ratio units, and responding was positively accelerated over the 30-minute interval. Under another schedule, each completion of a 3-minute fixed-interval unit produced the brief stimulus; completion of the 10th fixed-interval unit produced the stimulus paired with either cocaine injection or food presentation. Rates of responding increased within the fixed-interval units, and to a greater extent over the entire 10 fixed-interval units. Patterns of responding depended more on the schedule of reinforcement than on whether cocaine or food maintained responding. Omitting the brief stimuli following all but the last fixed-ratio or fixed-interval units decreased average rates and altered the patterns of responding. Substituting a visual stimulus that was never paired with cocaine or food following all but the last fixed-ratio or fixed-interval units decreased response rates to a lesser extent and did not substantially alter patterns of responding. When the duration of the paired stimulus was varied from .3 to 30.0 seconds, the highest response rates occurred at intermediate durations (1.0 to 10.0 seconds). The manner in which the stimulus changes affected performances depended more on the schedule of reinforcement than on whether cocaine injection or food presentation maintained responding.     

Concurrent schedule assessment of food preference in cows

Six dairy cows (Bos taurus) were trained on several pairs of concurrent variable-interval schedules with different types of food available on each alternative. The required response was a plate press made by the animal's muzzle. Performance generally replicated that found with other species. The generalized matching law accounted for the preference data, showing that food preference could be quantitatively analyzed as a special case of response bias. The preference functions showed that the response- and time-allocation ratios were not as extreme as obtained reinforcement rate ratios (undermatching).     

Reinforcement magnitude and the inhibiting effect of reinforcement

In a two-key concurrent variable-interval schedule (using pigeons), if the reinforcement frequency for one response is held constant while that for the other is increased, the rate of response on the constant key decreases. The immediate reinforcement for key pecking can usually be conceptualized as the change from a condition in which the key light is on and the food hopper light is off to one in which the key light is off and the hopper light is on. The prechange condition is associated with a delay to food of one-half the average interreinforcement interval in effect during this condition. The postchange condition is associated with a delay to food of about .5 seconds. The programming of additional reinforcement results in a decrease in the delay to food associated with the prechange stimulus condition, and thus a decrease in the value of the improvement that results from the change. This would appear to be analogous to a decrease in the amount of reinforcement, and thus sufficient explanation for the decrease in the rate of the response.