Fixed-interval performance and self-control in children.

Operant responses of 16 children (mean age 6 years and 1 month) were reinforced according to different fixed-interval schedules (with interreinforcer intervals of 20, 30, or 40 s) in which the reinforcers were either 20-s or 40-s presentations of a cartoon. In another procedure, they received training on a self-control paradigm in which both reinforcer delay (0.5 s or 40 s) and reinforcer duration (20 s or 40 s of cartoons) varied, and subjects were offered a choice between various combinations of delay and duration. Individual differences in behavior under the self-control procedure were precisely mirrored by individual differences under the fixed-interval schedule. Children who chose the smaller immediate reinforcer on the self-control procedure (impulsive) produced short postreinforcement pauses and high response rates in the fixed-interval conditions, and both measures changed little with changes in fixed-interval value. Conversely, children who chose the larger delayed reinforcer in the self-control condition (the self-controlled subjects) exhibited lower response rates and long postreinforcement pauses, which changed systematically with changes in the interval, in their fixed-interval performances.     

Temporal control by progressive-interval schedules of reinforcement.

Progressive-interval performances are described using measures that have proven to be successful in the analysis of fixed-interval responding. Five rats were trained with schedules in which the durations of consecutive intervals increased arithmetically as each interval was completed (either 6-s or 12-s steps for different subjects). The response patterns that emerged with extended training (90 sessions) indicated that performances had come under temporal control. Postreinforcement pausing increased as a function of the interval duration, the pauses were proportional to the prevailing duration, and the likelihood of the first response within an interval increased as the interval elapsed. To assess the resistance of these patterns to disruption, subjects were trained with a schedule that generated high response rates and short pauses (variable ratio). When the progressive-interval schedule was reinstated, pausing was attenuated and rates were elevated, but performances reverted to earlier patterns with continued exposure. The results indicated that temporal control by progressive-interval schedules, although slow to develop, is similar in many respects to that for fixed-interval schedules.     

The effects of smoked marijuana on progressive-interval schedule performance in humans.

In three experiments, 8 human subjects participated in a study of the effects of smoked marijuana on progressive-interval schedule performance. A two-component chained progressive-interval fixed-interval schedule of point delivery was used. In the progressive-interval component, the interval length began at 20 s and increased either geometrically or arithmetically (by either 20 s, 40 s, 80 s, 100 s, or 160 s) on each subsequent interval. After this interval elapsed, a single button press produced the fixed-interval component, with a total of five reinforcers of varying magnitude ($0.05, $0.20, or $0.40) available on a fixed-interval 20-s schedule. After the five reinforcer deliveries, the schedule returned to the initial progressive-interval component. Several relationships were found among rates of responding, postreinforcement pauses and drug administration in the progressive-interval component: (a) Postreinforcement pauses increased as the temporal requirements of the progressive-interval schedule increased; (b) rates of responding during successive progressive-interval components rapidly decreased to low rates of responding after the first few progressions; (c) postreinforcement pauses decreased systematically as dose of smoked marijuana increased; and (d) rates of responding increased after smoking active marijuana but not after smoking placebo cigarettes. Results are discussed in the context of behavioral control and relevance to other studies that have investigated the effects of smoked marijuana on schedule performance.     

Changing the response unit from a single peck to a fixed number of pecks in fixed-interval schedules

Each of three pigeons was studied first under a standard fixed-interval schedule. With the fixed interval held constant, the schedule was changed to a second-order schedule in which the response unit was the behavior on a small fixed-ratio schedule (first a fixed-ratio 10 and then a fixed-ratio 20 schedule). That is, every completion of the fixed-ratio schedule produced a 0.7-sec darkening of the key and reset the response count to zero for the next ratio. The first fixed-ratio completed after the fixed-interval schedule elapsed produced the 0.7-sec blackout followed immediately by food. These manipulations were carried out under two different fixed-interval durations for each bird ranging from 3 min to 12 min. The standard fixed-interval schedules produced the typical pause after reinforcement followed by responding at a moderate rate until the next reinforcement. The second-order schedules also engendered a pause after reinforcement, but responding occurred in bursts separated by brief pauses after each blackout. For a particular fixed-interval duration, post-reinforcement pauses increased slightly as the number of pecks in the response unit increased despite large differences in the rate and pattern of key pecking. Post-reinforcement pause increased with the fixed-interval duration under all response units. These data confirm that the allocation of time between pausing and responding is relatively independent of the rate and topography of responding after the pause.     

Choice in situations of time-based diminishing returns: immediate versus delayed consequences of action.

Pigeons chose between two schedules of food presentation, a fixed-interval schedule and a progressive-interval schedule that began at 0 s and increased by 20 s with each food delivery provided by that schedule. Choosing one schedule disabled the alternate schedule and stimuli until the requirements of the chosen schedule were satisfied, at which point both schedules were again made available. Fixed-interval duration remained constant within individual sessions but varied across conditions. Under reset conditions, completing the fixed-interval schedule not only produced food but also reset the progressive interval to its minimum. Blocks of sessions under the reset procedure were interspersed with sessions under a no-reset procedure, in which the progressive schedule value increased independent of fixed-interval choices. Median points of switching from the progressive to the fixed schedule varied systematically with fixed-interval value, and were consistently lower during reset than during no-reset conditions. Under the latter, each subject's choices of the progressive-interval schedule persisted beyond the point at which its requirements equaled those of the fixed-interval schedule at all but the highest fixed-interval value. Under the reset procedure, switching occurred at or prior to that equality point. These results qualitatively confirm molar analyses of schedule preference and some versions of optimality theory, but they are more adequately characterized by a model of schedule preference based on the cumulated values of multiple reinforcers, weighted in inverse proportion to the delay between the choice and each successive reinforcer.     

Effects of social context, reinforcer probability, and reinforcer magnitude on humans' choices to compete or not to compete.

In the first two experiments, subjects' choices to earn points (exchangeable for money) either by competing with a fictitious opponent or by not competing were studied. Buskist, Barry, Morgan, and Rossi's (1984) competitive fixed-interval schedule was modified to include a second response option, a noncompetitive fixed-interval schedule. After choosing to enter either option, the opportunity for reinforcers became available after the fixed-interval's duration had elapsed. Under the no-competition condition, points were always available after the interval had elapsed. Under the competition condition, points were available based on a predetermined probability of delivery. Experiments 1 and 2 examined how reinforcer probabilities and reinforcer magnitudes affected subjects' choices to compete. Several general conclusions can be made about the results: (a) Strong preferences to compete were observed at high and moderate reinforcer probabilities; (b) competing was observed even at very low reinforcer probabilities; (c) response rates were always higher in the competition component than in the no-competition component; and (d) response rates and choices to compete were insensitive to reinforcer-magnitude manipulations. In Experiment 3, the social context of this choice schedule was removed to determine whether the high levels of competing observed in the first two experiments were due to a response preference engendered by the social context provided by the experimenters through instructions. In contrast to the first two experiments, these subjects preferred the 60-s fixed-interval schedule (formerly the no-competition option), indicating that the instructions themselves were responsible for the preference to compete. This choice paradigm may be useful to future researchers interested in the effects of other independent variables (e.g., drugs, social context, instructions) on competitive behavior.     

Species differences in temporal control of behavior II: human performance

Human subjects responded on two panels. A differential-reinforcement-of-low-rate schedule with a limited-hold contingency operated on Panel A. In Condition 1, responses on Panel B produced a stimulus on the panel that signalled whether reinforcement was available on Panel A. In Condition 2, responses on Panel B briefly illuminated a digital clock. In both conditions, performance on Panel A was very efficient; with few exceptions, Panel A was pressed only when reinforcement was available. Thus, in effect, a fixed-interval schedule operated on Panel B. In Condition 1, a “break-and-run” response pattern occurred on Panel B; with increasing temporal parameters, the duration of the postreinforcement pause on Panel B increased linearly while overall response rate and running rate (calculated by excluding the postreinforcement pauses) remained approximately constant. In Condition 2, the response pattern on Panel B was scalloped; the postreinforcement pause was a negatively accelerated increasing function of schedule value, while overall response rate and running rate were negatively accelerated decreasing functions of schedule value. The performance of subjects in Condition 2, but not in Condition 1, was highly sensitive to the contingencies in operation, and resembled that of other species on the fixed-interval schedule.     

The effects of schedule history and the opportunity for adjunctive responding on behavior during a fixed-interval schedule of reinforcement.

The effects of schedule history and the availability of an adjunctive response (polydipsia) on fixed-interval schedule performance were investigated. Two rats first pressed levers under a schedule of food reinforcement with an interresponse time greater than 11 s, and 2 others responded under a fixed-ratio 40 schedule. All 4 were then exposed to a fixed-interval 15-s schedule. Water was continuously available under these conditions, but after responding became stable on the fixed-interval schedule, access was experimentally manipulated. With water freely available, subjects did not display characteristic fixed-interval response rates and patterns (i.e., scalloping or break-and-run). Instead, they exhibited predictable, stable patterns of behavior as a function of their schedule histories: Subjects with the interresponse-time history exhibited low response rates, and those with the fixed-ratio history exhibited high rates. Manipulating the amount of water available resulted in marked changes in response rates for rats with the interresponse-time history but not for those with the fixed-ratio history. The results illustrate the multiple causation of behavior by its previous and current schedules of reinforcement and other concurrent factors.     

A comparison of responding maintained under second-order schedules of intramuscular cocaine injection or food presentation in squirrel monkeys.

Key pressing by squirrel monkeys was maintained under second-order schedules of either intramuscular cocaine injection or food presentation. Under one schedule, each completion of a 10-response fixed-ratio unit produced a brief visual stimulus; the first fixed-ratio unit completed after 30 minutes elapsed produced the stimulus paired with either cocaine injection or food presentation. Generally, short pauses followed by high rates of responding were maintained within the fixed-ratio units, and responding was positively accelerated over the 30-minute interval. Under another schedule, each completion of a 3-minute fixed-interval unit produced the brief stimulus; completion of the 10th fixed-interval unit produced the stimulus paired with either cocaine injection or food presentation. Generally, short pauses followed by high rates of responding were maintained within the fixed-ratio units, and responding was positively accelerated over the 30-minute interval. Under another schedule, each completion of a 3-minute fixed-interval unit produced the brief stimulus; completion of the 10th fixed-interval unit produced the stimulus paired with either cocaine injection or food presentation. Rates of responding increased within the fixed-interval units, and to a greater extent over the entire 10 fixed-interval units. Patterns of responding depended more on the schedule of reinforcement than on whether cocaine or food maintained responding. Omitting the brief stimuli following all but the last fixed-ratio or fixed-interval units decreased average rates and altered the patterns of responding. Substituting a visual stimulus that was never paired with cocaine or food following all but the last fixed-ratio or fixed-interval units decreased response rates to a lesser extent and did not substantially alter patterns of responding. When the duration of the paired stimulus was varied from .3 to 30.0 seconds, the highest response rates occurred at intermediate durations (1.0 to 10.0 seconds). The manner in which the stimulus changes affected performances depended more on the schedule of reinforcement than on whether cocaine injection or food presentation maintained responding.     

Effects of a variable-ratio conditioning history on sensitivity to fixed-interval contingencies in rats.

We investigated the possibility that human-like fixed-interval performances would appear in rats given a variable-ratio history (Wanchisen, Tatham, & Mooney, 1989). Nine rats were trained under single or compound variable-ratio schedules and then under a fixed-interval 30-s schedule. The histories produced high fixed-interval rates that declined slowly over 90 sessions; differences as a function of the particular history were absent. Nine control animals given only fixed-interval training responded at lower levels initially, but rates increased with training. Despite differences in absolute rates, rates within the intervals and postreinforcement pauses indicated equivalent development of the accelerated response patterns suggestive of sensitivity to fixed-interval contingencies. The finding that the histories elevated rates without retarding development of differentiated patterns suggests that the effective response unit was a burst of several lever presses and that the fixed-interval contingencies acted on these units in the same way as for single responses. Regardless of history, the rats did not manifest the persistent, undifferentiated responding reported for humans under comparable schedules. We concluded that the shortcomings of animal models of human fixed-interval performances cannot be easily remedied by including a variable-ratio conditioning history within the model.     

Discriminative functions of schedule stimuli and memory: a combination of schedule and choice procedures

Pigeons responded under a combination brief-stimulus schedule and choice procedure. Normally, a fixed-interval schedule was in effect, where completion randomly produced either a brief stimulus or food. Intermittently, this schedule was interrupted by a choice arrangement. Two choice keys were lit, either a short or a long time since a prior event (food or stimulus). One choice response produced food if the time had been short, and the alternate response produced food if the time had been long. Across conditions, the duration of the fixed-interval schedule was varied, the stimuli that comprised the brief-stimulus operation were changed, and the stimuli were presented as paired and nonpaired with food. The focus of the study was the control of both schedule performance and choice responding across conditions. The results showed that choice accuracy was correlated with the degree of fixed-interval curvature, the response pattern of a pause followed by a gradually accelerated rate. As fixed-interval schedule duration was increased, both the degree of fixed-interval curvature and choice accuracy decreased. The particular brief stimulus used affected schedule and choice performance, with a more salient stimulus producing a greater degree of curvature and higher accuracy. Pairing and nonpairing operations produced striking differences in performance with the less salient brief stimulus, but not with the more salient stimulus. The results suggest that brief-stimulus schedule performance may be conceptualized in the context of memory research.     

Choice between fixed-interval schedules: Graded versus step-like choice functions

Pigeons chose between two fixed-interval schedules of food reinforcement. A single peck on one of two lighted keys started the fixed-interval schedule correlated with that key. The schedule had to be completed before the next choice opportunity. The durations of the fixed intervals were varied over conditions from 15 s to 40 s. To maximize the rate of reinforcement, the pigeons had to choose exclusively the shorter of the two schedules. Nevertheless, choice was not all-or-none. Instead, relative choice, and the rates of producing the fixed intervals, varied in a graded fashion with the disparity between the two schedules. Choice ratios under this procedure (single response to choose) were highly sensitive to the ratios of the fixed-interval schedules.     

Temporal control of behavior: schedule interactions

In Experiment I the response that terminated the postreinforcement pauses occurring under a fixed-interval 60-second schedule was reinforced, if the pause duration exceeded 30 seconds. The percentage of such pauses, rather than increasing, decreased. There were complex effects on the discriminative control of the pause by the reinforcer terminating the previous fixed interval, depending on whether the fixed interval and the added reinforcer were the same or different. In Experiments II(a) and II(b), each reinforcement initiated an alternative fixed-interval interresponse-time-greater-than-t-sec schedule, the schedule values being systematically varied. When the response following a pause exceeding a given duration was reinforced, fewer such pauses occurred than when they were not reinforced, i.e., on the comparable simple fixed-interval schedule. There was no systematic relationship between mean interrinforcement interval and duration of the postreinforcement pause. The pause duration initiated by reinforcement was directly related to the dependency controlling the shortest pause at that time, regardless of changes in mean interreinforcement interval.     

Effects of differences in interreinforcer intervals between past and current schedules on fixed-interval responding

Undergraduates were exposed to a mixed fixed-ratio differential-reinforcement-of-low-rate schedule. Values of the schedule components were adjusted so that interreinforcer intervals in one component were longer than those in another component. Following this, a mixed fixed-interval 5-s fixed-interval 20-s schedule (Experiment 1) or six fixed-interval schedules in which the values ranged from 5 to 40 s (Experiment 2) were in effect. In both experiments, response rates under the fixed-interval schedules were higher when the interreinforcer intervals approximated those produced under the fixed-ratio schedule, whereas the rates were lower when the interreinforcer intervals approximated those produced under the different-reinforcement-of-low-rate schedule. The present results demonstrate that the effects of behavioral history were under control of the interreinforcer intervals as discriminative stimuli.     

Sequential patterns in post-reinforcement pauses on fixed-interval schedules of food

Responding by one pigeon was reinforced with food on fixed-interval schedules of 30, 60, and 300 sec duration. A second pigeon was studied under fixed-interval durations of 60 and 300 sec. For both birds, the average post-reinforcement pause was one-half the duration of the fixed interval. Autocorrelation coefficients revealed first-order sequential dependencies in series of post-reinforcement pauses. On the 300-sec fixed-interval schedule, successive post-reinforcement tended to alternate between long and short durations. At the shorter fixed-interval durations there was less evidence of alternation sequences. A second experiment was conducted to determine if the time intervals between the first response after reinforcement and the next reinforcement (the work periods) were responsible for the alternation patterns in the series of post-reinforcement pauses. To evaluate the role of the work period, several procedures were used to modify the work period from that obtained on the fixed-interval 300-sec schedule. Adding a schedule to the fixed-interval schedule that set the minimum amount of time that could elapse between the first response after reinforcement and the next reinforcement eliminated the alternation pattern. Control schedules indicated that the elimination of alternation patterns resulted from constraints on the work period per se and not from confounded changes in the interreinforcement intervals.     

Teaching Generalized Self-Control to Attention Deficit Boys With Mothers as Adjunct Therapists

Two boys, diagnosed Attention Deficit Disorder with Hyperactivity and described as impulsive and lacking self-control, participated in the study. In a mental health setting, a self-instructional training program tailored to the specific behavioral deficits of each subject was introduced sequentially in a multiple-baseline design. Self-instructional training consisted of both conceptual and task-specific verbalizations, and targeted completion of classroom work. Mothers were trained as adjunct therapists and conducted a home training program. Results indicate that both subjects made substantial improvement in percent of daily classroom work completed, were reported as more self-controlled and less disruptive by mothers and teachers, and received higher grades at the end of treatment.     

A functional analysis of chained fixed-interval schedule performance

Three pigeons were trained on two-link chained fixed-interval fixed-interval schedules. Numbers of responses, time spent responding, and the total time spent in each component were measured. The data were analyzed according to the matching law for multiple and concurrent schedules. In most conditions, the ratio of response rates in the two links was a constant proportion of the ratio that would be predicted in a multiple schedule with the same components. Data on pauses during the interval schedules showed that, in most conditions, the pause duration was a linear function of the interval length, and greater in the initial link than in the terminal link. The experiment thus demonstrated a quantitative functional analysis of performance on a chained schedule.     

Human self-control and the density of reinforcement

Choice responding in adult humans on a discrete-trial button-pressing task was examined as a function of amount, delay, and overall density (points per unit time) of reinforcement. Reinforcement consisted of points that were exchangeable for money. In T 0 conditions, an impulsive response produced 4 points immediately and a self-control response produced 10 points after a delay of 15 s. In T 15 conditions, a constant delay of 15 s was added to both prereinforcer delays. Postreinforcer delays, which consisted of 15 s added to the end of each impulsive trial, equated trial durations regardless of choice, and was manipulated in both T 0 and T 15 conditions. In all conditions, choice was predicted directly from the relative reinforcement densities of the alternatives. Self-control was observed in all conditions except T 0 without postreinforcer delays, where the impulsive choices produced the higher reinforcement density. These results support previous studies showing that choice is a direct function of the relative reinforcement densities when conditioned (point) reinforcers are used. In contrast, where responding produces intrinsic (immediately consumable) reinforcers, immediacy of reinforcement appears to account for preference when density does not.