Food deliveries during the pause on fixed-interval schedules

Pigeons were trained on fixed-interval schedules of food delivery. In Experiments I and II, the fixed interval was initiated by the previous fixed-interval reinforcer; in Experiment III, the fixed interval was initiated by the first key peck following the preceding fixed-interval reinforcer (a chain fixed-ratio one, fixed-interval schedule). During the postreinforcement pause, variable-time schedules delivered food independent of any specific response. Rate of food delivery during the pause had only small effects on pause duration in Experiments I and II. In Experiment III, however, pause duration increased systematically with the rate of food delivery during the pause. These data suggest that the momentary proximity to reinforcement delivered via the fixed-interval schedule exerts potent control over pause termination. Additional analysis revealed that pause termination was unaffected by the intermittent delivery of food during the pause. Such data suggest that the temporal control by fixed-interval schedules is highly resistant to interference.     

Alternative fixed-ratio fixed-interval schedules of reinforcement

Five rats were trained under alternative fixed-ratio fixed-interval schedules, in which food reinforcement was provided for the completion of either a fixed-ratio or a fixed-interval requirement, whichever was met first. Overall response rate and running rate (the rate of responding after the postreinforcement pause) decreased for all subjects as the fixed-ratio value increased. As the proportion of reinforcements obtained from the fixed-ratio component increased and the alternative schedule approached a simple fixed ratio, overall response rate and running rate both increased; conversely, as the proportion of reinforcements obtained from the fixed-interval component increased and the alternative schedule approached a simple fixed interval, response rates decreased. Postreinforcement pause length increased linearly as the average time between reinforcements increased, regardless of the schedule parameters. A break-run pattern of responding was predominant at low- and medium-valued fixed ratios. All subjects displayed at least occasional positively accelerated responding within interreinforcement intervals at higher fixed-ratio values.     

Behavioral contrast in fixed-interval components: effects of extinction-component duration.

Seven albino rats were exposed to a multiple schedule of reinforcement in which the two components (fixed interval and extinction) alternated such that a presentation of the extinction component followed each fixed-interval reinforcement. In baseline sessions, the duration of the extinction component was constant and always one-third of the fixed-interval value. Probe sessions contained a probe segment in which the duration of the extinction component was increased; the response rate in fixed-interval components during the probe segment was compared with the response rate in the segments preceding and following the probe. The effect of increasing the duration of the extinction component was studied under three values of fixed interval: 30 s, 120 s, and 18 s, in three successive conditions. Response rate within fixed intervals was a direct function of duration of the extinction component. Pausing at the beginning of the fixed interval decreased as extinction duration increased. These effects were larger and more consistent for the shorter fixed-interval values (18 s and 30 s). These results indicate a functional relation between relative component duration and responding. For the component providing more frequent reinforcement, this could be stated as an inverse relationship between relative component duration and response rate. This relation is similar to findings regarding the ratio of trial and intertrial duration in Pavlovian conditioning procedures, and suggests that behavioral contrast may be related to Pavlovian contingencies underlying the multiple schedule.     

Changing the response unit from a single peck to a fixed number of pecks in fixed-interval schedules

Each of three pigeons was studied first under a standard fixed-interval schedule. With the fixed interval held constant, the schedule was changed to a second-order schedule in which the response unit was the behavior on a small fixed-ratio schedule (first a fixed-ratio 10 and then a fixed-ratio 20 schedule). That is, every completion of the fixed-ratio schedule produced a 0.7-sec darkening of the key and reset the response count to zero for the next ratio. The first fixed-ratio completed after the fixed-interval schedule elapsed produced the 0.7-sec blackout followed immediately by food. These manipulations were carried out under two different fixed-interval durations for each bird ranging from 3 min to 12 min. The standard fixed-interval schedules produced the typical pause after reinforcement followed by responding at a moderate rate until the next reinforcement. The second-order schedules also engendered a pause after reinforcement, but responding occurred in bursts separated by brief pauses after each blackout. For a particular fixed-interval duration, post-reinforcement pauses increased slightly as the number of pecks in the response unit increased despite large differences in the rate and pattern of key pecking. Post-reinforcement pause increased with the fixed-interval duration under all response units. These data confirm that the allocation of time between pausing and responding is relatively independent of the rate and topography of responding after the pause.     

Conjunctive schedules of reinforcement: III. A fixed-interval adjusting fixed-ratio schedule

Key pecking of three pigeons was studied under a conjunctive schedule that specified both a fixed-interval and an adjusting fixed-ratio requirement. The fixed-interval schedule was 6 min for one pigeon and 3 min for the other two. The size of the ratio requirement was determined within each cycle of the fixed interval by the duration of the pause before responding began. The fixed-ratio value was at maximum at the start of each fixed interval and decreased linearly until the first response occurred (adjusting fixed-ratio schedule). A peck produced food when the number of responses remaining on the fixed-ratio schedule was completed and when the fixed interval had elapsed. If no response occurred during the interval, the fixed-ratio requirement decreased to one and a single response after the interval elapsed produced food. The initial value of the adjusting fixed-ratio schedule was studied over a range of 0 to 900. Increases in the adjusting fixed-ratio schedule to about 300 responses increased both pause duration and running response rate and also modified the pattern of responding from that obtained under the fixed-interval schedule. Higher values of the adjusting fixed ratio generally decreased pause duration and running response rate and also disrupted responding. Interreinforcement time under the conjunctive schedule was increased substantially when the adjusting fixed-ratio size exceeded 300 responses.     

On the form of the relation between response rates in a multiple schedule

Three pigeons received training on multiple variable-interval schedules with brief alternating components, concurrently with a fixed-interval schedule of food reinforcement on a second key. Fixed-interval performance exhibited typical increases in rate within the interval, and was independent of multiple-schedule responding. Responding on the multiple-schedule key decreased as a function of proximity to reinforcement on the fixed-interval key. The overall relative rate of responding in one component of the multiple schedule roughly matched the overall relative rate of reinforcement. Within the fixed interval, response rate during one multiple-schedule component was a monotonic, negatively accelerated function of response rate during the other component. To a first approximation, the data were described by a power function, where the exponent depended on the relative rate of reinforcement obtained in the two components. The relative rate of responding in one component of the multiple schedule increased as a function of proximity to fixed-interval reinforcement, and often exceeded the overall obtained relative rate of reinforcement. The form of the function relating response rates is discussed in relation to findings on rate-dependent effects of drugs, chaining, and the relation between response rate and reinforcement rate in single-schedule conditions.     

Drug effects on fixed-interval responding with pause requirements for food presentation.

In pigeons performing under a multiple schedule of food presentation, low key-pecking rates (0.18 to 0.29 responses per second) were maintained during 3-min fixed-interval components by requiring a 4-, 5-, or 6-sec pause preceding the food-delivery response (tandem DRL), while higher rates (0.70 to 1.37 responses per second) were maintained in alternative fixed-interval components by requiring a pause of no more than 40 msec preceding the food-delivery response (tandem DRH). Thus, reinforcement density was equal but overall response rates markedly different in the two schedule components. Pentobarbital (3, 10 mg/kg) had effects on overall rates of responding consistent with a rate-dependency interpretation (low rates were increased while higher rates were decreased), but d-amphetamine (0.03 to 3 mg/kg) either failed to increase low overall rates in the tandem DRL components or increased them only slightly. Effects of both drugs on local responding within the fixed-intervals were always related in an orderly way to control response rate, but the extent of rate increases produced by d-amphetamine was modifed in some birds by pause requirements such that the drug increased comparable rates less when these occurred in the tandem DRL component than when they occurred in the tandem DRH components. Control rate is an important determinant of drug effects, independent DRH components. Control rate is an important determinant of drug effects, independent of reinforcement density maintaining rates, and independent of environmental influences, such as response-spacing requirements for food presentation, that can modify the extent of some drug-produced rate changes.     

Sequential patterns in post-reinforcement pauses on fixed-interval schedules of food

Responding by one pigeon was reinforced with food on fixed-interval schedules of 30, 60, and 300 sec duration. A second pigeon was studied under fixed-interval durations of 60 and 300 sec. For both birds, the average post-reinforcement pause was one-half the duration of the fixed interval. Autocorrelation coefficients revealed first-order sequential dependencies in series of post-reinforcement pauses. On the 300-sec fixed-interval schedule, successive post-reinforcement tended to alternate between long and short durations. At the shorter fixed-interval durations there was less evidence of alternation sequences. A second experiment was conducted to determine if the time intervals between the first response after reinforcement and the next reinforcement (the work periods) were responsible for the alternation patterns in the series of post-reinforcement pauses. To evaluate the role of the work period, several procedures were used to modify the work period from that obtained on the fixed-interval 300-sec schedule. Adding a schedule to the fixed-interval schedule that set the minimum amount of time that could elapse between the first response after reinforcement and the next reinforcement eliminated the alternation pattern. Control schedules indicated that the elimination of alternation patterns resulted from constraints on the work period per se and not from confounded changes in the interreinforcement intervals.     

The effects of number of responses on the postreinforcement pause in fixed-interval schedules

The present study manipulated the number of responses in a modified fixed-interval schedule by imposing a blackout after each unreinforced response during the interval. The blackout duration was varied, and the duration of the fixed interval was held constant. The subjects were initially exposed to a fixed-interval 300-sec schedule. Blackout durations of 0, 10, and 50 sec were used. Following this, a fixed-interval 30-sec schedule was used with blackout durations of 0, 1, and 5 sec. Under the fixed-interval 300-sec schedule, the number of interreinforcement responses varied over a wider range than occurred under the fixed-interval 30-sec schedule. The duration of the postreinforcement pause decreased as blackout durations were increased and number of responses decreased on the fixed-interval 300-sec schedule, but pause length did not vary with changes in blackout duration and number of responses for the fixed-interval 30-sec schedule. The differences in the effects of blackout duration and response manipulation on the two fixed-interval schedules were attributed to relatively greater changes in the number of interreinforcement responses for the fixed-interval 300-sec schedule.     

A comparison of measures of responding under fixed-interval schedules

Average response rate, post-reinforcement pause, elapsed time to the fourth response, average quarter-life, and running rate were examined to see how they reflected changes in fixed-interval performance. Rats were exposed to a mixed schedule of water presentation comprising fixed-interval schedules of two durations. Changes in responding were produced by varying the duration of the shorter component. The five measures were derived only from the longer schedule component. Post-reinforcement pause, elapsed time to the fourth response in the interval, and quarter-life all showed high, positive inter-correlations (0.78<r<0.99). Running rate and post-reinforcement pause were not as highly correlated. Quarter-life reliably reflected changes in fixed-interval performance but changes in the quarter-life value did not necessarily result from similar changes in fixed-interval response pattern. The two measures that adequately described changes in response patterning were post-reinforcement pause and running rate. These two measures also had the advantage of being simple both computationally and in terms of the instrumentation involved in their recording.     

Conjunctive schedules of reinforcement II: response requirements and stimulus effects

Responding of three pigeons was maintained under conjunctive fixed-ratio, fixed-interval schedules where a key peck produced food after both schedule requirements were completed. The individual schedule requirements were then successively removed and reinstated with responding maintained under the following conditions: conjunctive fixed-ratio, fixed-time; fixed-time; and fixed-interval schedules. Patterns of responding changed in accord with the successive removal of the schedule requirements. Compared to the conjunctive fixed-ratio, fixed-interval schedule, pause duration increased and response rate decreased under conjunctive fixed-ratio, fixed-time schedules and under fixed-time schedules alone. Overall mean rates of responding were highest and pause duration lowest under fixed-interval schedules. When changes in the keylight colors were correlated with completion of the fixed-ratio, the end of the fixed-interval, or both of these conditions, the pattern of responding was modified and indicated a greater degree of control by the individual schedules. Although two birds showed large increases in interreinforcement time when they were initially exposed to the conjunctive schedule, when responding stabilized this measure was largely invariant for all birds across most schedule conditions.     

A functional analysis of chained fixed-interval schedule performance

Three pigeons were trained on two-link chained fixed-interval fixed-interval schedules. Numbers of responses, time spent responding, and the total time spent in each component were measured. The data were analyzed according to the matching law for multiple and concurrent schedules. In most conditions, the ratio of response rates in the two links was a constant proportion of the ratio that would be predicted in a multiple schedule with the same components. Data on pauses during the interval schedules showed that, in most conditions, the pause duration was a linear function of the interval length, and greater in the initial link than in the terminal link. The experiment thus demonstrated a quantitative functional analysis of performance on a chained schedule.     

Effects of chlorpromazine on fixed-ratio responding: modification by fixed-interval discriminative stimuli.

Effects of chlorpromazine (1 to 100 mg/kg) were assessed on two pigeons' responding under various modifications of a multiple schedule of food delivery. During a fixed-interval component, the first response after 5 min produced food; during the subsequent, fixed-ratio component, the 30th response produced food. Modifications of the schedule entailed changes in stimulus conditions imposed during the fixed-ratio component that did not systematically alter characteristics of performance under non-drug conditions. In the first phase of the experiment, distinctive visual stimuli were correlated with each schedule component (conventional multiple schedule); chlorpromazine produced small decreases in fixed-ratio responding (20% at 30 mg/kg). When each response during the fixed-ratio component produced the stimulus correlated with the fixed-interval schedule (fixed-interval discriminative stimulus) for 1.2 s, effects of chlorpromazine were not different from those under the conventional multiple schedule. Chlorpromazine produced greater decreases in fixed-ratio responding (55% at 30 mg/kg) when either the first response of each fixed ratio changed the stimulus correlated with the fixed-ratio schedule to the fixed-interval discriminative stimulus for the remainder of the fixed-ratio component, or when the fixed-interval discriminative stimulus was presented independently of responding according to a matched temporal sequence. When the fixed-interval discriminative stimulus was present continuously during the fixed-ratio component (mixed schedule), chlorpromazine produced even more substantial decreases in fixed-ratio responding (greater than 80% at 30 mg/kg). Effects of chlorpromazine on fixed-interval responding were also modified by the schedules of fixed-interval discriminative stimulus presentation. The effects of chlorpromazine were a joint function of the stimuli prevailing during the multiple schedule and the degree to which responding influenced these stimuli.     

Temporal control of behavior: schedule interactions

In Experiment I the response that terminated the postreinforcement pauses occurring under a fixed-interval 60-second schedule was reinforced, if the pause duration exceeded 30 seconds. The percentage of such pauses, rather than increasing, decreased. There were complex effects on the discriminative control of the pause by the reinforcer terminating the previous fixed interval, depending on whether the fixed interval and the added reinforcer were the same or different. In Experiments II(a) and II(b), each reinforcement initiated an alternative fixed-interval interresponse-time-greater-than-t-sec schedule, the schedule values being systematically varied. When the response following a pause exceeding a given duration was reinforced, fewer such pauses occurred than when they were not reinforced, i.e., on the comparable simple fixed-interval schedule. There was no systematic relationship between mean interrinforcement interval and duration of the postreinforcement pause. The pause duration initiated by reinforcement was directly related to the dependency controlling the shortest pause at that time, regardless of changes in mean interreinforcement interval.     

Temporal inhibition: effects of changes in rate of reinforcement and rate of responding

Pigeons were trained to key peck on several multiple schedules in which the first of two components was always a simple fixed-interval schedule. The rate of responding at the beginning of the constant fixed-interval schedule was found to decrease with increases in the rate of reinforcement associated with the other component of the multiple schedule, but remained unchanged with decreases in the rate of responding associated with the other component. These results were interpreted as being consistent with the view that the presence and magnitude of the temporal inhibitory effects observed in a given fixed-interval schedule are a function of the properties of reinforcing stimuli, rather than of changes in the rate of responding associated with the time interval immediately preceding the fixed interval in question.     

Drug-behavior interaction history: modification of the effects of morphine on punished behavior.

Squirrel monkeys were trained to respond under a multiple fixed-interval, fixed-interval schedule in which the first response after 5 min terminated a visual stimulus in the presence of which electric shocks could occur. During one component of the schedule, correlated with one color of stimulus lights, every 30th response also produced electric shock; responding was suppressed during this component to approximately 10 to 12% of that occurring in the alternate component in which responding was not punished. In contrast to previous research, morphine (0.03 to 1.0 mg/kg) increased punished responding. Unpunished responding, however, was either not affected or decreased at doses of morphine that increased punished responding. Increases in rate of punished responding also occurred when the single-schedule punishment condition was studied alone in these animals. Subsequent experimentation, which systematically analyzed the development of the rate-enhancing effects of morphine on punished responding, involved the study of drug effects in additional monkeys trained initially under a single-schedule punishment condition. The effects of morphine on punished responding were studied before, after, and then during exposure to the multiple schedule that included a component in which responding was not punished. Increases in response rate with morphine did not occur until it was administered during exposure to the multiple schedule that included a component in which responding was not punished. As with the other monkeys, once the rate increases in punished responding occurred under the multiple schedule, these effects of morphine persisted, even when the multiple schedule was removed.(ABSTRACT TRUNCATED AT 250 WORDS)     

Behavioral aftereffects of reinforcement and its omission as a function of reinforcement magnitude

Rats responded on a multiple fixed-interval fixed-interval schedule of reinforcement. Each complete cycle of the multiple schedule was separated from the next by a relatively long period of timeout from all schedule contingencies. A response at the end of the second component of each cycle was always reinforced with an invariant reinforcement magnitude, while reinforcement magnitude and reinforcement omission were systematically varied in the first component. Response rate in the first component was a monotonic function of reinforcement magnitude in that component. These changes in response rate in the first component did not affect response rate in the second component. When reinforcement was omitted on 50% of occasions in the first component, following reinforcement there was a reduction in response rate in the second component that was monotonically related to reinforcement magnitude. Following reinforcement omission there was an increase in response rate in the second component that was unrelated to reinforcement magnitude. When reinforcement was omitted on 100% of occasions in the first component, behavioral contrast was observed.     

The response-reinforcement dependency in fixed-interval schedules of reinforcement

Pigeons were exposed to four different schedules of food reinforcement that arranged a fixed minimum time interval between reinforcements (60 sec or 300 sec). The first was a standard fixed-interval schedule. The second was a schedule in which food was presented automatically at the end of the fixed time interval as long as a response had occurred earlier. The third and fourth schedules were identical to the first two except that the first response after reinforcement changed the color on the key. When the schedule required a peck after the interval elapsed, the response pattern consisted of a pause after reinforcement followed by responding at a high rate until reinforcement. When a response was not required after the termination of the interval, the pattern consisted of a pause after reinforcement, followed by responses and then by a subsequent pause until reinforcement. Having the first response after reinforcement change the color on the key had little effect on performance. Post-reinforcement pause duration varied with the minimum interreinforcement interval but was unaffected by whether or not a response was required after the interval elapsed.     

Tolerance to effects of cocaine on behavior under a response-initiated fixed-interval schedule

Tolerance to effects of cocaine can be modulated by schedules of reinforcement. With multiple ratio schedules, research has shown an inverse relationship between ratio requirement and amount of tolerance that resulted from daily administration of the drug. In contrast, tolerance to the effects of cocaine on behavior under multiple interval schedules generally has developed regardless of interval value. Under interval schedules reinforcement depends on the animal making one response following a time interval. Thus, as time to respond increases, the time to reinforcement decreases. On the other hand, fixed ratio schedules require a specified number of responses to be made prior to reinforcement. Therefore, delaying the initiation of responding does not coincide with a significant decrease in the time to reinforcement. In the current experiment, 6 pigeons were trained to respond under a three-component multiple schedule, with a different tandem fixed-ratio 1 fixed-interval schedule in each component. The multiple schedule required one response, which was followed by one of three fixed-interval values (5, 15, or 60 s). Thus, the multiple schedule was interval-like because after the fixed-ratio 1, only one more response was required for reinforcement, but it was also ratio-like because the length of the pause at the beginning of each interreinforcer interval affected the time until the next reinforcer. Acute administration of cocaine generally resulted in dose-dependent decreases in responding. Chronic (i.e., daily) administration of a rate-decreasing dose resulted in tolerance patterns similar to those usually obtained with multiple ratio schedules. That is, the magnitude of tolerance was related inversely to schedule size. These results suggest that delay to reinforcement from the initial response may play a role in the development of schedule-parameter-related tolerance.     

Responding under fixed-ratio and multiple fixed-interval fixed-ratio schedules of electric shock presentation

Squirrel monkeys, initially trained under a schedule of electric shock postponement and then under fixed-interval schedules of electric shock presentation, were studied under multiple fixed-interval fixed-ratio and under fixed-ratio schedules of shock presentation. Under the fixed-interval (10-min) component of the multiple schedule, a pause was followed by a gradual increase in responding to a rate maintained until shock presentation; under the fixed-ratio (3-, 10-, or 30-response) component of the multiple schedule, a brief pause was typically followed by a relatively high and uniform rate of responding until shock was presented. When the 60-sec timeout periods, which usually followed shock presentation, were eliminated from the multiple schedule for one monkey, responding was only transiently affected. In the one monkey studied, responding was maintained under a fixed-ratio schedule alone (with timeout periods), but rates of responding were lower than under the fixed-ratio component of the multiple schedule. Characteristic patterns of responding, similar to those engendered under schedules of food presentation or shock termination, can be maintained under fixed-ratio schedules of shock presentation; further, patterns of responding can be controlled by discriminative stimuli in multiple schedules.