Competitive fixed-interval performance in humans

Two persons responded in the same session in separate cubicles, but under a single schedule of reinforcement. Each time reinforcement was programmed, only the first response to occur, that is, the response of only one of the subjects, was reinforced. “Competitive” behavior that developed under these conditions was examined in three experiments. In Experiment 1 subjects responded under fixed-interval (FI) 30-s, 60-s, and 90-s schedules of reinforcement. Under the competition condition, relative to baseline conditions, the response rates were higher and the pattern was “break-and-run.” In Experiment 2, subjects were exposed first to a conventional FI schedule and then to an FI competition schedule. Next, they were trained to respond under either a differential-reinforcement-of-low-rate (DRL) or fixed-ratio (FR) schedule, and finally, the initial FI competition condition was reinstated. In this second exposure to the FI competition procedure, DRL subjects responded at lower rates than were emitted during the initial exposure to that condition and FR subjects responded at higher rates. For all subjects, however, responding gradually returned to the break-and-run pattern that had occurred during the first FI competition condition. Experiment 3 assessed potential variables contributing to the effects of the competitive FI contingencies during Experiments 1 and 2. Subjects were exposed to FI schedules where (a) probability of reinforcement at completion of each fixed interval was varied, or (b) a limited hold was in effect for reinforcement. Only under the limited hold was responding similar to that observed in previous experiments.     

Additional-delay schedules: A continuum of temporal contingencies by varying food delay

Pigeons performed on discrete-trial, temporally defined schedules in which the food delay (D) was adjusted according to the latency of the key peck (X) and two schedule parameters (t and A). The schedule function was D = A(t − X), where D is the experienced delay between a response and a reinforcer. The schedule parameter t is the maximum value below which the present contingencies occur. A is the additional delay to reinforcement for each second the response latency is shorter than the t value. When A = 0 s, the schedule is a continuous reinforcement schedule with immediate reinforcement. When A = 1 s, the schedule is a conjunctive fixed-ratio 1 fixed-time t-s schedule. When A approaches infinity, the schedule becomes a differential reinforcement of long latency schedule. The latencies for subjects with t = 10 s and t = 30 s were observed with the present schedules having seven values for A between 0 s and 11 s. In addition, the latencies for subjects for which t = 30 s were observed at an A value of 31 s to 41 s. As the A value increased, the latencies approached the t value for subjects for which t = 10 s. The latencies for 30-s-t subjects did not approach t, even when the A value was 41 s. The latencies for 10-s-t subjects at 11-s A value were longer than those under yoked conditions having exactly the same delays/interreinforcement intervals. These results demonstrated a continuum of latency related to the schedule continuum (value of A) at a small t value.     

Contrast and undermatching as a function of reinforcer duration and quality during multiple schedules

Eight pigeons pecked keys under multiple variable-interval two-minute variable-interval two-minute schedules. In Experiment 1, the reinforcers were 2, 4, or 8 seconds access to a food magazine. In Experiments 2 and 3, the reinforcers were grains that had been determined to be most-, moderately-, or non-preferred. Both positive and negative behavioral contrast occurred when the reinforcers in one component were held constant and the duration or type of reinforcer obtained in the other component varied. Undermatching occurred when the relative rate of responding during a component was plotted as a function of the relative duration of the reinforcers in that component.     

FIXED-INTERVAL PERFORMANCE AND SELF-CONTROL IN INFANTS

Twenty-six infants, 3 to 23 months old, were trained on fixed-interval schedules ranging from 10 s to 80 s. The operant response was touching an illuminated location on a touch-sensitive screen, and 20 s of cartoon presentation was the reinforcer. The subjects were also trained in a six-phase self-control procedure in which the critical phases involved choice between 20 s of cartoon available after a 0.5-s delay (impulsive choice) and 40 s of cartoon delayed for 40 s (self-controlled choice). All the youngest children (3 to 5 months) showed long postreinforcement pauses on the fixed-interval schedule, with most intervals involving the emission of a single, reinforced, response, and all made self-controlled choices. Older subjects (9 to 23 months) either produced the same pattern as the younger ones on the fixed-interval schedule (classified as pause-sensitive subjects) or produced short pauses and higher steady response rates (classified as pause-insensitive subjects). All pause-sensitive subjects made self-controlled choices in the self-control condition, and all pause-insensitive subjects made impulsive ones.     

Temporal discrimination learning of operant feeding in goldfish (Carassius auratus)

Operant temporal discrimination learning was investigated in goldfish. In the first experiment, there was a fixed daily change in illumination. Eight subjects were trained to operate a lever that reinforced each press with food. The period during which responses were reinforced was then progressively reduced until it was 1 hr in every 24. The final 1-hr feeding schedule was maintained over 4 weeks. The feeding period commenced at the same time each day throughout. The food dispensers were then made inactive, and a period of extinction ensued for 6 days. The pattern of responding suggested that the fish were able to exhibit temporal discrimination in anticipation of feeding time. This pattern of responding persisted for a limited number of days during the extinction procedure. The second experiment produced evidence that operant temporal discrimination could develop under continuous illumination.     

Behavioral and pharmacological modulation of respiration in rhesus monkeys.

Changes in respiration associated with schedule-controlled behavior were determined in seated rhesus monkeys prepared with a pressure-displacement head plethysmograph for monitoring ventilation continuously during behavioral experiments. Subjects were trained to press a lever under fixed-ratio 40 and fixed-interval 300-s schedules of stimulus termination. Episodic increases in ventilation were closely associated with periods of responding under both schedules. Recurring episodes of increased ventilation occurred during fixed-ratio responding, and were separated by brief 10-s timeouts during which ventilation decreased. Under the fixed-interval schedule, both ventilation and response rate typically increased as the 300-s interval elapsed. The effects of cocaine, caffeine, and two adenosine agonists, 5'-N-ethylcarboxamidadenosine (NECA) and 2-(carboxyethylphenylamino)adenosine-5'-carboxamide (CGS 21680), on behavior and respiration were determined using a cumulative-dosing procedure. Drug-induced suppression of behavior eliminated the episodic increases in ventilation during the performance components of both schedules. Schedule-related increases in ventilation were compared to those produced by elevated levels of CO2 in inspired air. Exposure to 4% CO2 mixed in air increased ventilation in all subjects, and the combined effects of CO2 exposure and schedule-controlled responding on respiration appeared to be additive. The results suggest that behavioral activities may increase ventilation through increased metabolic demand and increased CO2 production.     

Social reinforcement of operant behavior in rats: a methodological note.

An apparatus was developed to study social reinforcement in the rat. Four Long-Evans female rats were trained to press a lever via shaping, with the reinforcer being access to a castrated male rat. Responding under a fixed-ratio schedule and in extinction was also observed. Social access was found to be an effective reinforcer. When social reinforcement was compared with food reinforcement under similar conditions of deprivation and reinforcer duration, no significant differences were observed.     

Effects of ratio reinforcement schedules on discrimination performance by Japanese monkeys

In Experiment 1, Japanese monkeys were trained on three conditional position-discrimination problems with colors as the conditional cues. Within each session, each problem was presented for two blocks of ten reinforcements; correct responses were reinforced under continuous-reinforcement, fixed-ratio 5, and variable-ratio 5 schedules, each assigned to one of the three problems. The assignment of schedules to problems was rotated a total of three times (15 sessions per assignment) after 30 sessions of acquisition training. Accuracy of discrimination increased to a moderate level with fewer trials under CRF than under ratio schedules. In contrast, the two ratio schedules, fixed and variable, were more effective in maintaining accurate discrimination than was CRF. With further training, as asymptotes were reached, accuracy was less affected by the schedule differences. These results demonstrated an interaction between the effects of reinforcement schedules and the level of acquisition. In Experiment 2, ratio sizes were gradually increased to 30. Discrimination accuracy was maintained until the ratio reached 20; ratio 30 strained the performance. Under FR conditions, accuracy increased as correct choice responses cumulated after reinforcement.     

Relation between level of food deprivation and rate of schedule-induced attack

The relation between food deprivation and schedule-induced attack was investigated in four White Carneaux pigeons. Attack toward a mirror target was induced by a schedule of reinforcement in which 3-sec food presentations occurred at alternate intervals of 15 and 120 sec (multiple fixed-time 15-sec fixed-time 120-sec schedule). A continuous tone was presented during the 15-sec periods; it was absent during the 120-sec periods. Each pigeon was tested at 65, 80, and 95% of its free-feeding weight in ascending, descending, and ascending orders, respectively. Two relations were apparent; an inverse relation between body weight and rate of attack, and a tendency for rate of attack to increase during the experiment. Reduction or elimination of attack when the mirror was covered with brown paper for some sessions indicated that the results were due neither to changes in activity that might covary with weight nor to habituation to the experimental situation.     

Alternative response training, differential reinforcement of other behavior, and extinction in squirrel monkeys (Saimiri sciureus)

In Experiment I, (a) extinction, (b) extinction plus reinforcement of a discrete alternative response, and (c) differential reinforcement of other behavior were each correlated with a different stimulus in a three-component multiple schedule. The alternative-response procedure more rapidly and completely suppressed behavior than did differential reinforcement of other behavior. Differential reinforcement of other behavior was slightly more effective than extinction alone. In Experiment II, reinforcement of specific alternative behavior during extinction and differential reinforcement of other behavior were used in two components, while one component continued to provide reinforcement for the original response. Once again, the alternative-response procedure was most effective in reducing responding as long as it remained in effect. However, the responding partially recovered when reinforcement for competing behavior was discontinued. In general, responding was less readily reduced by differential reinforcement of other behavior than by the specific alternative-response procedure.