Concurrent-schedule performance: Effects of relative and overall reinforcer rate

Six pigeons were trained to respond on two keys, each of which provided reinforcers on an arithmetic variable-interval schedule. These concurrent schedules ran nonindependently with a 2-s changeover delay. Six sets of conditions were conducted. Within each set of conditions the ratio of reinforcers available on the two alternatives was varied, but the arranged overall reinforcer rate remained constant. Each set of conditions used a different overall reinforcer rate, ranging from 0.22 reinforcers per minute to 10 reinforcers per minute. The generalized matching law fit the data from each set of conditions, but sensitivity to reinforcer frequency (a) decreased as the overall reinforcer rate decreased for both time allocation and response allocation based analyses of the data. Overall response rates did not vary with changes in relative reinforcer rate, but decreased with decreases in overall reinforcer rate. Changeover rates varied as a function of both relative and overall reinforcer rates. However, as explanations based on changeover rate seem unable to deal with the changes in generalized matching sensitivity, discrimination accounts of choice may offer a more promising interpretation.     

Variable-interval schedules of timeout from avoidance

Rats were trained on concurrent schedules in which pressing one lever postponed shock and pressing the other occasionally produced a 2-min timeout during which the shock-postponement schedule was suspended and its correlated stimuli were removed. Throughout, the shock-postponement schedule maintained proficient levels of avoidance. Nevertheless, in Experiment 1 responding on the timeout lever was established rapidly, was maintained at stable levels on variable-interval schedules, was extinguished by withholding timeout, was reestablished when timeout was reintroduced, and was brought under discriminative control with a multiple variable-interval extinction schedule of timeout. These results are in contrast with Verhave's (1962) conclusion that timeout is an ineffective reinforcer when presented to rats on intermittent schedules. In Experiment 2 the consequence of responding on the timeout lever was altered so that the shock-postponement schedule remained in effect even though the stimulus conditions associated with timeout were produced for 2 min. Responding extinguished, indicating that suspension of the shock-postponement schedule, not stimulus change, was the source of reinforcement. By establishing the reinforcing efficacy of timeout with standard variable-interval schedules, these experiments illustrate a procedure for studying negative reinforcement in the same way as positive reinforcement.     

Competitive fixed-interval performance in humans

Two persons responded in the same session in separate cubicles, but under a single schedule of reinforcement. Each time reinforcement was programmed, only the first response to occur, that is, the response of only one of the subjects, was reinforced. “Competitive” behavior that developed under these conditions was examined in three experiments. In Experiment 1 subjects responded under fixed-interval (FI) 30-s, 60-s, and 90-s schedules of reinforcement. Under the competition condition, relative to baseline conditions, the response rates were higher and the pattern was “break-and-run.” In Experiment 2, subjects were exposed first to a conventional FI schedule and then to an FI competition schedule. Next, they were trained to respond under either a differential-reinforcement-of-low-rate (DRL) or fixed-ratio (FR) schedule, and finally, the initial FI competition condition was reinstated. In this second exposure to the FI competition procedure, DRL subjects responded at lower rates than were emitted during the initial exposure to that condition and FR subjects responded at higher rates. For all subjects, however, responding gradually returned to the break-and-run pattern that had occurred during the first FI competition condition. Experiment 3 assessed potential variables contributing to the effects of the competitive FI contingencies during Experiments 1 and 2. Subjects were exposed to FI schedules where (a) probability of reinforcement at completion of each fixed interval was varied, or (b) a limited hold was in effect for reinforcement. Only under the limited hold was responding similar to that observed in previous experiments.     

Additional-delay schedules: A continuum of temporal contingencies by varying food delay

Pigeons performed on discrete-trial, temporally defined schedules in which the food delay (D) was adjusted according to the latency of the key peck (X) and two schedule parameters (t and A). The schedule function was D = A(t − X), where D is the experienced delay between a response and a reinforcer. The schedule parameter t is the maximum value below which the present contingencies occur. A is the additional delay to reinforcement for each second the response latency is shorter than the t value. When A = 0 s, the schedule is a continuous reinforcement schedule with immediate reinforcement. When A = 1 s, the schedule is a conjunctive fixed-ratio 1 fixed-time t-s schedule. When A approaches infinity, the schedule becomes a differential reinforcement of long latency schedule. The latencies for subjects with t = 10 s and t = 30 s were observed with the present schedules having seven values for A between 0 s and 11 s. In addition, the latencies for subjects for which t = 30 s were observed at an A value of 31 s to 41 s. As the A value increased, the latencies approached the t value for subjects for which t = 10 s. The latencies for 30-s-t subjects did not approach t, even when the A value was 41 s. The latencies for 10-s-t subjects at 11-s A value were longer than those under yoked conditions having exactly the same delays/interreinforcement intervals. These results demonstrated a continuum of latency related to the schedule continuum (value of A) at a small t value.     

Contrast and undermatching as a function of reinforcer duration and quality during multiple schedules

Eight pigeons pecked keys under multiple variable-interval two-minute variable-interval two-minute schedules. In Experiment 1, the reinforcers were 2, 4, or 8 seconds access to a food magazine. In Experiments 2 and 3, the reinforcers were grains that had been determined to be most-, moderately-, or non-preferred. Both positive and negative behavioral contrast occurred when the reinforcers in one component were held constant and the duration or type of reinforcer obtained in the other component varied. Undermatching occurred when the relative rate of responding during a component was plotted as a function of the relative duration of the reinforcers in that component.     

FIXED-INTERVAL PERFORMANCE AND SELF-CONTROL IN INFANTS

Twenty-six infants, 3 to 23 months old, were trained on fixed-interval schedules ranging from 10 s to 80 s. The operant response was touching an illuminated location on a touch-sensitive screen, and 20 s of cartoon presentation was the reinforcer. The subjects were also trained in a six-phase self-control procedure in which the critical phases involved choice between 20 s of cartoon available after a 0.5-s delay (impulsive choice) and 40 s of cartoon delayed for 40 s (self-controlled choice). All the youngest children (3 to 5 months) showed long postreinforcement pauses on the fixed-interval schedule, with most intervals involving the emission of a single, reinforced, response, and all made self-controlled choices. Older subjects (9 to 23 months) either produced the same pattern as the younger ones on the fixed-interval schedule (classified as pause-sensitive subjects) or produced short pauses and higher steady response rates (classified as pause-insensitive subjects). All pause-sensitive subjects made self-controlled choices in the self-control condition, and all pause-insensitive subjects made impulsive ones.     

Temporal discrimination learning of operant feeding in goldfish (Carassius auratus)

Operant temporal discrimination learning was investigated in goldfish. In the first experiment, there was a fixed daily change in illumination. Eight subjects were trained to operate a lever that reinforced each press with food. The period during which responses were reinforced was then progressively reduced until it was 1 hr in every 24. The final 1-hr feeding schedule was maintained over 4 weeks. The feeding period commenced at the same time each day throughout. The food dispensers were then made inactive, and a period of extinction ensued for 6 days. The pattern of responding suggested that the fish were able to exhibit temporal discrimination in anticipation of feeding time. This pattern of responding persisted for a limited number of days during the extinction procedure. The second experiment produced evidence that operant temporal discrimination could develop under continuous illumination.     

Behavioral and pharmacological modulation of respiration in rhesus monkeys.

Changes in respiration associated with schedule-controlled behavior were determined in seated rhesus monkeys prepared with a pressure-displacement head plethysmograph for monitoring ventilation continuously during behavioral experiments. Subjects were trained to press a lever under fixed-ratio 40 and fixed-interval 300-s schedules of stimulus termination. Episodic increases in ventilation were closely associated with periods of responding under both schedules. Recurring episodes of increased ventilation occurred during fixed-ratio responding, and were separated by brief 10-s timeouts during which ventilation decreased. Under the fixed-interval schedule, both ventilation and response rate typically increased as the 300-s interval elapsed. The effects of cocaine, caffeine, and two adenosine agonists, 5'-N-ethylcarboxamidadenosine (NECA) and 2-(carboxyethylphenylamino)adenosine-5'-carboxamide (CGS 21680), on behavior and respiration were determined using a cumulative-dosing procedure. Drug-induced suppression of behavior eliminated the episodic increases in ventilation during the performance components of both schedules. Schedule-related increases in ventilation were compared to those produced by elevated levels of CO2 in inspired air. Exposure to 4% CO2 mixed in air increased ventilation in all subjects, and the combined effects of CO2 exposure and schedule-controlled responding on respiration appeared to be additive. The results suggest that behavioral activities may increase ventilation through increased metabolic demand and increased CO2 production.     

Effects of ratio reinforcement schedules on discrimination performance by Japanese monkeys

In Experiment 1, Japanese monkeys were trained on three conditional position-discrimination problems with colors as the conditional cues. Within each session, each problem was presented for two blocks of ten reinforcements; correct responses were reinforced under continuous-reinforcement, fixed-ratio 5, and variable-ratio 5 schedules, each assigned to one of the three problems. The assignment of schedules to problems was rotated a total of three times (15 sessions per assignment) after 30 sessions of acquisition training. Accuracy of discrimination increased to a moderate level with fewer trials under CRF than under ratio schedules. In contrast, the two ratio schedules, fixed and variable, were more effective in maintaining accurate discrimination than was CRF. With further training, as asymptotes were reached, accuracy was less affected by the schedule differences. These results demonstrated an interaction between the effects of reinforcement schedules and the level of acquisition. In Experiment 2, ratio sizes were gradually increased to 30. Discrimination accuracy was maintained until the ratio reached 20; ratio 30 strained the performance. Under FR conditions, accuracy increased as correct choice responses cumulated after reinforcement.     

Relation between level of food deprivation and rate of schedule-induced attack

The relation between food deprivation and schedule-induced attack was investigated in four White Carneaux pigeons. Attack toward a mirror target was induced by a schedule of reinforcement in which 3-sec food presentations occurred at alternate intervals of 15 and 120 sec (multiple fixed-time 15-sec fixed-time 120-sec schedule). A continuous tone was presented during the 15-sec periods; it was absent during the 120-sec periods. Each pigeon was tested at 65, 80, and 95% of its free-feeding weight in ascending, descending, and ascending orders, respectively. Two relations were apparent; an inverse relation between body weight and rate of attack, and a tendency for rate of attack to increase during the experiment. Reduction or elimination of attack when the mirror was covered with brown paper for some sessions indicated that the results were due neither to changes in activity that might covary with weight nor to habituation to the experimental situation.