TEMPORAL CONTROL ON INTERVAL SCHEDULES: WHAT DETERMINES THE POSTREINFORCEMENT PAUSE?

On fixed-interval or response-initiated delay schedules of reinforcement, the average pause following food presentation is proportional to the interfood interval. Moreover, when a number of intervals of different durations occur in a programmed cyclic series, postreinforcement pauses track the changes in interval value. What controls the duration of postreinforcement pauses under these conditions? Staddon, Wynne, and Higa (1991), in their linear waiting model, propose control by the preceding interfood interval. Another possibility is that delay to reinforcement, signaled by a key peck and/or stimulus change, determines the subsequent pause. The experiments reported here examined the role of these two possible time markers by studying the performance of pigeons under a chained cyclic fixed-interval procedure. The data support the linear waiting model, but suggest that more than the immediately preceding interfood interval plays a role in temporal control.     

Choice in situations of time-based diminishing returns: immediate versus delayed consequences of action.

Pigeons chose between two schedules of food presentation, a fixed-interval schedule and a progressive-interval schedule that began at 0 s and increased by 20 s with each food delivery provided by that schedule. Choosing one schedule disabled the alternate schedule and stimuli until the requirements of the chosen schedule were satisfied, at which point both schedules were again made available. Fixed-interval duration remained constant within individual sessions but varied across conditions. Under reset conditions, completing the fixed-interval schedule not only produced food but also reset the progressive interval to its minimum. Blocks of sessions under the reset procedure were interspersed with sessions under a no-reset procedure, in which the progressive schedule value increased independent of fixed-interval choices. Median points of switching from the progressive to the fixed schedule varied systematically with fixed-interval value, and were consistently lower during reset than during no-reset conditions. Under the latter, each subject's choices of the progressive-interval schedule persisted beyond the point at which its requirements equaled those of the fixed-interval schedule at all but the highest fixed-interval value. Under the reset procedure, switching occurred at or prior to that equality point. These results qualitatively confirm molar analyses of schedule preference and some versions of optimality theory, but they are more adequately characterized by a model of schedule preference based on the cumulated values of multiple reinforcers, weighted in inverse proportion to the delay between the choice and each successive reinforcer.     

Order and chaos in fixed-interval schedules of reinforcement

Fixed-interval schedule performance is characterized by high levels of variability. Responding is absent at the onset of the interval and gradually increases in frequency until reinforcer delivery. Measures of behavior also vary drastically and unpredictably between successive intervals. Recent advances in the study of nonlinear dynamics have allowed researchers to study irregular and unpredictable behavior in a number of fields. This paper reviews several concepts and techniques from nonlinear dynamics and examines their utility in predicting the behavior of pigeons responding to a fixed-interval schedule of reinforcement. The analysis provided fairly accurate a priori accounts of response rates, accounting for 92.8% of the variance when predicting response rate 1 second in the future and 64% of the variance when predicting response rates for each second over the entire next interreinforcer interval. The nonlinear dynamics account suggests that even the “noisiest” behavior might be the product of purely deterministic mechanisms.     

RESPONSE INTERRUPTION AND DRL FOR THE REDUCTION OF RAPID EATING

We assessed the efficacy of several procedures for reducing the rate of eating responses during mealtime by three institutionalized mentally retarded clients. A time-based (15 s) response interruption procedure was implemented which resulted in little change in eating responses for 2 of 3 subjects. A spaced-responding DRL 15-s procedure resulted in decreases in eating responses to target levels only after a prompting procedure was added. Procedures were evaluated using a multiple baseline across subjects design with assessment of generalization to nontreated meals. A change in eating behavior during breakfast occurred only after direct training in the breakfast setting. Maintenance data were collected at 1- and 5-month follow-up periods.     

The relationship between feeding rate and patch choice.

Rats in a laboratory foraging simulation searched for sequential opportunities to feed in two patches that differed in the rate at which food pellets were delivered (controlled by fixed-interval schedules) and in the size of the pellets. The profitability of feeding in each patch was calculated in terms of time (grams per minute) and in terms of effort (grams per bar press). These values were the result of the imposed fixed interval, the size of the pellets, and the rate at which the rats pressed the bar in each condition. The rats ate more food and larger meals, but not more frequent meals, at the patch offering the higher rate of food consumption, calculated as grams per minute. The relative intake at any patch was a function of the relative rate of intake during meals at that patch compared to the other patch. Rats respond to explicit manipulations of feeding time in the same manner as they respond to manipulations of feeding effort.     

Tolerance to cocaine's rate-increasing effects upon repeated administration.

Four squirrel monkeys responded daily under a fixed-interval 5-min or 8-min schedule of food-pellet delivery. Cocaine (0.03 to 1.7 mg/kg) and saline were injected before occasional daily sessions (acute administration). Some doses of cocaine produced substantial overall increases in response rate for 3 of the subjects; effects were less substantial for the remaining subject, who exhibited modest increases in response rate early in the session and during the middle portion of the intervals. A dose that increased response rate when administered acutely was then administered before each session (chronic administration). Chronic administration resulted in a reduction in the increases in response rate seen under acute administration for all subjects.     

RESPONDING MAINTAINED UNDER INTERMITTENT SCHEDULES OF ELECTRIC-SHOCK PRESENTATION: “SAFETY” OR SCHEDULE EFFCTS?

Four experiments were conducted in which lever pressing by squirrel monkeys was maintained under multiple, mixed, or chained schedules of electric-shock presentation. In the first two experiments, a multiple schedule was employed in which a fixed-interval schedule of shock presentation alternated with a signaled two-minute component. Initially, no events were scheduled during the two-minute component (a safety period). In the first experiment, the safety period was “degraded” by introducing and systematically increasing the frequency of periodic shocks presented during that component. In the second experiment, the proportion of overall safe time to unsafe time was decreased by decreasing the value of the fixed-interval schedule while holding constant shock frequency during the two-minute component. In the third experiment, the overall arrangement was changed from a multiple to a mixed schedule in an attempt to determine whether fixed-interval responding would be maintained when a single exteroceptive stimulus was associated with both components. In the fourth experiment, the overall arrangement was changed from a multiple to a chained schedule in an effort to determine whether fixed-interval responding would be maintained when its consequence was presentation of a signaled “unsafe” period. Fixed-interval responding was well maintained under all experimental conditions; the varied relationships obtained lend more support to conceptualizations of shock-maintained behavior as exemplifying schedule-controlled behavior than to suggestions that such behavior may be readily accounted for by “safety theory.”     

Effects of ratio contingencies on responding maintained by schedules of electric-shock presentation (response-produced shock)

Squirrel monkeys' lever pressing was established under fixed-interval schedules of electric-shock presentation (response-produced shock). After appropriate temporal patterns of lever pressing were engendered, either fixed-ratio schedules of shock presentation were added to the fixed interval, or yoked variable-ratio schedules were substituted for the fixed-interval schedules. When fixed-ratio schedules were added, there was an initial rise in response rate and schedule-appropriate patterns of responding developed. After many sessions, however, responding ceased abruptly, in some cases with remarkable quickness. When variable-ratio schedules were substituted, responded declined gradually and eventually was poorly maintained. Ratio contingencies may not support responding as well as interval contingencies when electric shock is the maintaining event.     

Effects of instructional constraints on human fixed-interval performance

Several groups of human subjects were exposed to a variety of experimental conditions involving a fixed-interval 27-second schedule of reinforcement in compound with instructions to constrain in the number of responses within the interreinforcement interval and/or the duration of the experimental session. One group was further exposed to a contingency involving the placement of responses within the IRI. A diversity of patterns of performance was observed, including those typically associated with animal subjects exposed to FI schedules. Generally, the imposition of instructions to minimize session duration reduced post-reinforcement pausing and increased overall reinforcement density from those levels obtained with only instructions to expend a given number of responses per reinforcer. The results are seen to underscore the sensitivity of human fixed-interval performance and the contribution of extra-experimental contingencies.