Competitive fixed-interval performance in humans

Two persons responded in the same session in separate cubicles, but under a single schedule of reinforcement. Each time reinforcement was programmed, only the first response to occur, that is, the response of only one of the subjects, was reinforced. “Competitive” behavior that developed under these conditions was examined in three experiments. In Experiment 1 subjects responded under fixed-interval (FI) 30-s, 60-s, and 90-s schedules of reinforcement. Under the competition condition, relative to baseline conditions, the response rates were higher and the pattern was “break-and-run.” In Experiment 2, subjects were exposed first to a conventional FI schedule and then to an FI competition schedule. Next, they were trained to respond under either a differential-reinforcement-of-low-rate (DRL) or fixed-ratio (FR) schedule, and finally, the initial FI competition condition was reinstated. In this second exposure to the FI competition procedure, DRL subjects responded at lower rates than were emitted during the initial exposure to that condition and FR subjects responded at higher rates. For all subjects, however, responding gradually returned to the break-and-run pattern that had occurred during the first FI competition condition. Experiment 3 assessed potential variables contributing to the effects of the competitive FI contingencies during Experiments 1 and 2. Subjects were exposed to FI schedules where (a) probability of reinforcement at completion of each fixed interval was varied, or (b) a limited hold was in effect for reinforcement. Only under the limited hold was responding similar to that observed in previous experiments.     

Varying response-reinforcer contiguity in a recycling conjunctive schedule

Three experiments describe the effects of manipulating the frequency of response-reinforcer contiguity in a recycling conjunctive schedule. The schedule arranged that a reinforcer was delivered after 30 s provided at least one response had occurred; otherwise the next cycle started immediately. In Experiment 1, this schedule produced the typical pause–respond–pause pattern, with most responses at mid-interval; and, when a limited number of contiguities between responses and food delivery were added, the pattern became more like the monotonic scallop seen on fixed-interval schedules. In Experiment 2, the schedule was initially presented with an additional contingency that allowed contiguity on every trial. Fixed-interval-like behavior occurred and tended to persist as contiguities were gradually eliminated. In Experiment 3, the recycling conjunctive schedule alternated with a condition in which a large number of contiguities occurred. The pause–respond–pause pattern and fixed-interval-like performance occurred with few or many contiguities, respectively. The results of all three experiments illustrate how contiguity interacts with a small number of other variables to determine performance on interval schedules and illuminate previous findings with fixed-interval and fixed-time schedules.     

TEMPORAL CONTROL ON INTERVAL SCHEDULES: WHAT DETERMINES THE POSTREINFORCEMENT PAUSE?

On fixed-interval or response-initiated delay schedules of reinforcement, the average pause following food presentation is proportional to the interfood interval. Moreover, when a number of intervals of different durations occur in a programmed cyclic series, postreinforcement pauses track the changes in interval value. What controls the duration of postreinforcement pauses under these conditions? Staddon, Wynne, and Higa (1991), in their linear waiting model, propose control by the preceding interfood interval. Another possibility is that delay to reinforcement, signaled by a key peck and/or stimulus change, determines the subsequent pause. The experiments reported here examined the role of these two possible time markers by studying the performance of pigeons under a chained cyclic fixed-interval procedure. The data support the linear waiting model, but suggest that more than the immediately preceding interfood interval plays a role in temporal control.     

FIXED-INTERVAL PERFORMANCE AND SELF-CONTROL IN INFANTS

Twenty-six infants, 3 to 23 months old, were trained on fixed-interval schedules ranging from 10 s to 80 s. The operant response was touching an illuminated location on a touch-sensitive screen, and 20 s of cartoon presentation was the reinforcer. The subjects were also trained in a six-phase self-control procedure in which the critical phases involved choice between 20 s of cartoon available after a 0.5-s delay (impulsive choice) and 40 s of cartoon delayed for 40 s (self-controlled choice). All the youngest children (3 to 5 months) showed long postreinforcement pauses on the fixed-interval schedule, with most intervals involving the emission of a single, reinforced, response, and all made self-controlled choices. Older subjects (9 to 23 months) either produced the same pattern as the younger ones on the fixed-interval schedule (classified as pause-sensitive subjects) or produced short pauses and higher steady response rates (classified as pause-insensitive subjects). All pause-sensitive subjects made self-controlled choices in the self-control condition, and all pause-insensitive subjects made impulsive ones.     

Effects of a variable-ratio conditioning history on sensitivity to fixed-interval contingencies in rats.

We investigated the possibility that human-like fixed-interval performances would appear in rats given a variable-ratio history (Wanchisen, Tatham, & Mooney, 1989). Nine rats were trained under single or compound variable-ratio schedules and then under a fixed-interval 30-s schedule. The histories produced high fixed-interval rates that declined slowly over 90 sessions; differences as a function of the particular history were absent. Nine control animals given only fixed-interval training responded at lower levels initially, but rates increased with training. Despite differences in absolute rates, rates within the intervals and postreinforcement pauses indicated equivalent development of the accelerated response patterns suggestive of sensitivity to fixed-interval contingencies. The finding that the histories elevated rates without retarding development of differentiated patterns suggests that the effective response unit was a burst of several lever presses and that the fixed-interval contingencies acted on these units in the same way as for single responses. Regardless of history, the rats did not manifest the persistent, undifferentiated responding reported for humans under comparable schedules. We concluded that the shortcomings of animal models of human fixed-interval performances cannot be easily remedied by including a variable-ratio conditioning history within the model.     

Behavioral and pharmacological modulation of respiration in rhesus monkeys.

Changes in respiration associated with schedule-controlled behavior were determined in seated rhesus monkeys prepared with a pressure-displacement head plethysmograph for monitoring ventilation continuously during behavioral experiments. Subjects were trained to press a lever under fixed-ratio 40 and fixed-interval 300-s schedules of stimulus termination. Episodic increases in ventilation were closely associated with periods of responding under both schedules. Recurring episodes of increased ventilation occurred during fixed-ratio responding, and were separated by brief 10-s timeouts during which ventilation decreased. Under the fixed-interval schedule, both ventilation and response rate typically increased as the 300-s interval elapsed. The effects of cocaine, caffeine, and two adenosine agonists, 5'-N-ethylcarboxamidadenosine (NECA) and 2-(carboxyethylphenylamino)adenosine-5'-carboxamide (CGS 21680), on behavior and respiration were determined using a cumulative-dosing procedure. Drug-induced suppression of behavior eliminated the episodic increases in ventilation during the performance components of both schedules. Schedule-related increases in ventilation were compared to those produced by elevated levels of CO2 in inspired air. Exposure to 4% CO2 mixed in air increased ventilation in all subjects, and the combined effects of CO2 exposure and schedule-controlled responding on respiration appeared to be additive. The results suggest that behavioral activities may increase ventilation through increased metabolic demand and increased CO2 production.     

Temporal discrimination learning of operant feeding in goldfish (Carassius auratus)

Operant temporal discrimination learning was investigated in goldfish. In the first experiment, there was a fixed daily change in illumination. Eight subjects were trained to operate a lever that reinforced each press with food. The period during which responses were reinforced was then progressively reduced until it was 1 hr in every 24. The final 1-hr feeding schedule was maintained over 4 weeks. The feeding period commenced at the same time each day throughout. The food dispensers were then made inactive, and a period of extinction ensued for 6 days. The pattern of responding suggested that the fish were able to exhibit temporal discrimination in anticipation of feeding time. This pattern of responding persisted for a limited number of days during the extinction procedure. The second experiment produced evidence that operant temporal discrimination could develop under continuous illumination.     

Varying the temporal placement of a drinking opportunity in a fixed-interval schedule.

Three rats, lever pressing for food delivered on a fixed-interval 128-s schedule, were presented with a 16-s opportunity to drink from a retractable water source. The temporal placement of the water probe within the reinforcement cycle was varied sequentially, in steps of 16 s. Although the lever-pressing pattern was modulated by the intercalated water probe, water consumption during the probe itself was a decreasing function of time from the following reinforcer. These results were interpreted as evidence against the notion that schedule-induced drinking is a "ubiquitous" phenomenon and are congruent with results from other "intruded stimulus" experiments.     

Responding maintained under fixed-interval and fixed-time schedules of electric shock presentation

Following initial histories under a schedule of electric shock postponement, lever pressing in squirrel monkeys was maintained under fixed-interval and fixed-time schedules of electric shock presentation. No difference in either rate or pattern of responding was obtained when these schedules were presented as components of a multiple schedule. When they were presented singly for long periods of time, the fixed-interval schedule consistently maintained a higher response rate than the fixed-time schedule. The pattern of responding under both schedules was similar, typically consisting of a pause at the beginning of each interval followed by either a steady or a positively accelerating rate of responding. The results suggest that the response-shock dependency is of critical importance in the maintenance of high rates of responding under schedules of electric shock presentation, and support the general view that such responding may be conceptualized as operant behavior under control of many of the same variables that control responding under comparable schedules of food or water reinforcement.     

Variability of response location on fixed-ratio and fixed-interval schedules of reinforcement

Variability of response location was studied in monkeys performing in a six-lever chamber. Fixed-ratio schedules, ranging from FR 1 to FR 300, generated a high degree of stereotypy of response location. In contrast, fixed-interval schedules of comparable reinforcement frequencies (0.06 to 4 minutes) generated much greater variability. These results failed to confirm any simple relationship between response variability and intermittence of reinforcement. Rather, variability seems to be determined by the particular characteristics of the reinforcement schedule.