d-amphetamine and fixed-interval performance: effects of operant history.

Sixteen rats were initially exposed for 50 sessions to either a fixed-ratio 40 or an interresponse-time-greater-than-11-second food reinforcement schedule, then shifted to a fixed-interval 15-second food reinforcement schedule. Animals with fixed-ratio 40 histories lever pressed at much higher rates under the fixed-interval schedule than did animals with inter-response-time-greater-than-11-second histories. This difference persisted across 93 sessions of fixed-interval exposure. The effects of d=amphetamine were assessed after 15 and 59 sessions of fixed-interval exposure. On both occasions, the low-rate responding of animals with interresponse-time-greater-than-11-second histories was typically increased by all doses of the drug, while the high-rate responding of animals with fixed-ratio 40 histories was typically decreased by all doses of the drug. These results suggest that control response rate under the fixed-interval schedule, which may be affected by a history of responding under another schedule, is the primary determinant of the relative effects of d-amphetamine.     

Progressive-ratio schedules: effects of later schedule requirements on earlier performances

Four rats were studied with variants of a progressive-ratio schedule with a step size of 6 in which different terminal components followed completion of the 20th ratio: (a) a reversal of the progression, (b) a fixed-ratio 6 schedule, or (c) extinction. Responding in the progressive-ratio components of these schedules was compared to performances under conventional progressive-ratio baselines. Under baseline conditions, postreinforcement pauses increased exponentially as a function of increasing ratio size, whereas running rates showed modest declines. The procedure of linking the progressive-ratio schedule to the reversed progression or to the fixed-ratio component resulted in decreased pausing. Linking the progressive-ratio schedule to the extinction component had the opposite effect, that of producing weakened progressive-ratio performances as evidenced by increased pausing. Subjects whose responses were reinforced on half of the ratios also showed exponential increases; however, pauses were substantially shorter following ratios on which the reinforcer was omitted. The results suggested that progressive-ratio pausing reflects the influence of remote as well as local contingencies.     

Low-response-rate conditioning history and fixed-interval responding in rats.

Bar presses by one group of rats were conditioned under a differential-reinforcement-of-low-rate reinforcement schedule immediately prior to conditioning under a fixed-interval schedule. In a second group of rats, bar presses were conditioned first under a differential-reinforcement-of-low-rate schedule and then under a fixed-ratio schedule prior to conditioning under a fixed-interval schedule. Low response rates occurred under the fixed-interval schedule only when it was immediately preceded by low-rate conditioning. Otherwise, fixed-interval responding was similar to responding under the fixed-ratio schedule. This finding suggests that responses of laboratory animals are sensitive to immediate history, and, unlike human responses, are relatively insensitive to a history of low-rate conditioning when it is followed by high-rate conditioning.     

Alternative fixed-ratio fixed-interval schedules of reinforcement

Five rats were trained under alternative fixed-ratio fixed-interval schedules, in which food reinforcement was provided for the completion of either a fixed-ratio or a fixed-interval requirement, whichever was met first. Overall response rate and running rate (the rate of responding after the postreinforcement pause) decreased for all subjects as the fixed-ratio value increased. As the proportion of reinforcements obtained from the fixed-ratio component increased and the alternative schedule approached a simple fixed ratio, overall response rate and running rate both increased; conversely, as the proportion of reinforcements obtained from the fixed-interval component increased and the alternative schedule approached a simple fixed interval, response rates decreased. Postreinforcement pause length increased linearly as the average time between reinforcements increased, regardless of the schedule parameters. A break-run pattern of responding was predominant at low- and medium-valued fixed ratios. All subjects displayed at least occasional positively accelerated responding within interreinforcement intervals at higher fixed-ratio values.     

Varying the temporal placement of a drinking opportunity in a fixed-interval schedule.

Three rats, lever pressing for food delivered on a fixed-interval 128-s schedule, were presented with a 16-s opportunity to drink from a retractable water source. The temporal placement of the water probe within the reinforcement cycle was varied sequentially, in steps of 16 s. Although the lever-pressing pattern was modulated by the intercalated water probe, water consumption during the probe itself was a decreasing function of time from the following reinforcer. These results were interpreted as evidence against the notion that schedule-induced drinking is a "ubiquitous" phenomenon and are congruent with results from other "intruded stimulus" experiments.     

Food deliveries during the pause on fixed-interval schedules

Pigeons were trained on fixed-interval schedules of food delivery. In Experiments I and II, the fixed interval was initiated by the previous fixed-interval reinforcer; in Experiment III, the fixed interval was initiated by the first key peck following the preceding fixed-interval reinforcer (a chain fixed-ratio one, fixed-interval schedule). During the postreinforcement pause, variable-time schedules delivered food independent of any specific response. Rate of food delivery during the pause had only small effects on pause duration in Experiments I and II. In Experiment III, however, pause duration increased systematically with the rate of food delivery during the pause. These data suggest that the momentary proximity to reinforcement delivered via the fixed-interval schedule exerts potent control over pause termination. Additional analysis revealed that pause termination was unaffected by the intermittent delivery of food during the pause. Such data suggest that the temporal control by fixed-interval schedules is highly resistant to interference.     

Temporal control by progressive-interval schedules of reinforcement.

Progressive-interval performances are described using measures that have proven to be successful in the analysis of fixed-interval responding. Five rats were trained with schedules in which the durations of consecutive intervals increased arithmetically as each interval was completed (either 6-s or 12-s steps for different subjects). The response patterns that emerged with extended training (90 sessions) indicated that performances had come under temporal control. Postreinforcement pausing increased as a function of the interval duration, the pauses were proportional to the prevailing duration, and the likelihood of the first response within an interval increased as the interval elapsed. To assess the resistance of these patterns to disruption, subjects were trained with a schedule that generated high response rates and short pauses (variable ratio). When the progressive-interval schedule was reinstated, pausing was attenuated and rates were elevated, but performances reverted to earlier patterns with continued exposure. The results indicated that temporal control by progressive-interval schedules, although slow to develop, is similar in many respects to that for fixed-interval schedules.     

Effects of a variable-ratio conditioning history on sensitivity to fixed-interval contingencies in rats.

We investigated the possibility that human-like fixed-interval performances would appear in rats given a variable-ratio history (Wanchisen, Tatham, & Mooney, 1989). Nine rats were trained under single or compound variable-ratio schedules and then under a fixed-interval 30-s schedule. The histories produced high fixed-interval rates that declined slowly over 90 sessions; differences as a function of the particular history were absent. Nine control animals given only fixed-interval training responded at lower levels initially, but rates increased with training. Despite differences in absolute rates, rates within the intervals and postreinforcement pauses indicated equivalent development of the accelerated response patterns suggestive of sensitivity to fixed-interval contingencies. The finding that the histories elevated rates without retarding development of differentiated patterns suggests that the effective response unit was a burst of several lever presses and that the fixed-interval contingencies acted on these units in the same way as for single responses. Regardless of history, the rats did not manifest the persistent, undifferentiated responding reported for humans under comparable schedules. We concluded that the shortcomings of animal models of human fixed-interval performances cannot be easily remedied by including a variable-ratio conditioning history within the model.     

The effects of d-amphetamine on the temporal control of operant responding in rats during a preshock stimulus.

The operant behavior of six rats was maintained by a random-interval schedule of reinforcement. Three-minute periods of noise were superimposed on this behavior, each period ending with the delivery of an unavoidable shock. Overall rates of responding were generally lower during the periods of noise than in its absence (conditioned suppression). These suppressed response rates also exhibited temporal patterning, with responding becoming less frequent as each noise period progressed. The effects of d-amphetamine on this behavioral baseline were then assessed. In four animals the relative response rates during the noise and in its absence suggested that the drug produced a dose-related decrease in the amount of conditioned suppression. However, this effect was often due to a decrease in the rates of responding in the absence of the preshock stimulus, rather than to an increase in response rates during the stimulus. Temporal patterning in response rates during the preshock stimulus was abolished, an effect that was interpreted in terms of rate-dependent effect of d-amphetamine. This study thus extends rate-dependent analyses of the effects of amphetamines to the patterns of operant behavior that occur during a preshock stimulus, and which have been discussed in terms of the disrupting effects of anxiety on operant behavior.     

Effects of d-amphetamine and caffeine on schedule-controlled and schedule-induced responding.

The effects of d-amphetamine and caffeine were studied on rates and patterns of lever pressing and schedule-induced licking under fixed-interval schedules of food pellet presentation. In addition, the effects of caffeine were studied on lever pressing and licking under a multiple fixed-ratio fixed-interval schedule. Caffeine reduced mean overall rates of licking at lower doses than it reduced mean overall rates of pressing under the fixed-interval schedules, but the effects of caffeine on both licking and lever pressing depended largely on the control rate of responding. d-Amphetamine reduced mean overall rates of lever pressing and licking at about the same dose, but the effects of d-amphetamine also were a function of the control rate of responding.     

Varying response-reinforcer contiguity in a recycling conjunctive schedule

Three experiments describe the effects of manipulating the frequency of response-reinforcer contiguity in a recycling conjunctive schedule. The schedule arranged that a reinforcer was delivered after 30 s provided at least one response had occurred; otherwise the next cycle started immediately. In Experiment 1, this schedule produced the typical pause–respond–pause pattern, with most responses at mid-interval; and, when a limited number of contiguities between responses and food delivery were added, the pattern became more like the monotonic scallop seen on fixed-interval schedules. In Experiment 2, the schedule was initially presented with an additional contingency that allowed contiguity on every trial. Fixed-interval-like behavior occurred and tended to persist as contiguities were gradually eliminated. In Experiment 3, the recycling conjunctive schedule alternated with a condition in which a large number of contiguities occurred. The pause–respond–pause pattern and fixed-interval-like performance occurred with few or many contiguities, respectively. The results of all three experiments illustrate how contiguity interacts with a small number of other variables to determine performance on interval schedules and illuminate previous findings with fixed-interval and fixed-time schedules.     

The roles of stimulus control and reinforcement frequency in modulating the behavioral effects of d-amphetamine in the rat.

The behavioral effects of d-amphetamine have been shown to be modulated by stimulus control, with less impairment of performance occurring when control is great. When the fixed-consecutive-number schedule is used (on which at least a specified consecutive number of responses must be made on one operandum before a single response on another will produce a reinforcer), response rate tends to be invariant but reinforcement frequency is not. This study asks whether the differences in reinforcement frequency that usually accompany changes in stimulus control could themselves be responsible for the performance differences. Two versions of the fixed-consecutive-number schedule of reinforcement were combined into a multiple schedule within which stimulus control was varied but differences in reinforcement frequency were minimized by omitting some reinforcer deliveries during the component that usually had the higher reinforcement frequency. In one component, a compound discriminative stimulus was added with the eighth consecutive response on the first lever; a single response on the second lever was then reinforced. In the other component, no such stimulus was presented. With no added stimulus, large decreases occurred in the number of runs satisfying the minimum requirement for reinforcement at doses of drug that produced only minimal changes when an added stimulus controlled behavior. Thus, increased stimulus control diminishes the behavioral changes produced by d-amphetamine even when the possible contribution by baseline reinforcement rate is minimized.     

Control over response number by a targeted percentile schedule: reinforcement loss and the acute effects of d-amphetamine.

Two fixed-consecutive-number-like procedures were used to examine effects of acute d-amphetamine administration on control over response number. In both procedures, rats were required to press the left lever at least once and then press the right lever to complete a trial. The consecutive left-lever presses on each trial comprised a "run." Under the targeted percentile schedule, reinforcement was provided if the current run length was closer to the target length (16) than half of the most recent 24 runs. This differentially reinforced run length while holding reinforcement probability constant at .5. A second group acquired the differentiation under the targeted percentile schedule, but were then shifted to a procedure that yoked reinforcement probability by subject and run length to that obtained under the targeted percentile schedule. The two procedures generated practically identical control run lengths, response rates, reinforcement probabilities, and reinforcement rates. Administration of d-amphetamine disrupted percentile responding to a greater degree than yoked control responding. This disruption decreased reinforcement frequency less in the former than the latter procedure. The similar baseline responding under these two procedures suggests that this difference in sensitivity was due to behavioral adjustments to drug prompted by reduction of reinforcement density in the yoked control but not the percentile schedule. These adjustments attenuate the drug's effects under the former, but not the latter, procedure.     

Variable-ratio conditioning history produces high- and low-rate fixed-interval performance in rats

Four rats were exposed to an A-B-A-B series of 30 sessions each of variable-ratio 20 (A) and fixed-interval 30-s (B) schedules. Four other rats received 120 sessions of fixed-interval 30 s. The rats with a history of variable-ratio responding subsequently showed primarily high or low response-rate patterns on the fixed-interval schedule without evidence of classical scalloping (i.e., increased rates of responding throughout the interreinforcement interval), except infrequently in 1 rat. The rats exposed to only the fixed-interval 30-s schedule displayed the expected sequence of scalloping giving way to lower rate break-run or simply low-rate responding over time. This experiment shows that when naive rats are exposed to even a simple history of reinforcement (in this case, a variable-ratio 20), their subsequent fixed-interval performance is very different from comparable performance in naive rats, and might be said to be more similar to the responding of adult humans. The argument is made that care should be taken in comparing the fixed-interval performance of humans and nonhumans because humans have a complex history of reinforcement, whereas laboratory nonhumans are typically naive.     

Effects of schedule of reinforcement on a pentobarbital discrimination in rats.

The purpose of this study was to determine the effects of the schedule of reinforcement on a pentobarbital discrimination in rats. Five rats were trained to discriminate 10 mg/kg pentobarbital from saline under a multiple fixed-interval 180-s fixed-ratio 20 schedule of reinforcement. During both saline and pentobarbital training sessions, subjects emitted a higher percentage of correct responses under the fixed-ratio component as compared to the fixed-interval component of the multiple schedule. Determination of the pentobarbital dose-response curve under the fixed-ratio component resulted in a steep curve characterized by responding on the saline lever at low doses and on the drug lever at higher doses. Under the fixed-interval component, a graded dose-effect curve was produced, with considerable responding on both levers after intermediate doses of pentobarbital. The administration of phencyclidine and MK-801 resulted in an intermediate level of drug-lever responding for some subjects. Administration of d-amphetamine resulted in saline (nondrug) appropriate responding. The results of this study demonstrate that the schedule of reinforcement is a determinant of drug stimulus control, just as it is a determinant of other drug effects.     

Effects of ethanol on multiple fixed-interval fixed-ratio schedule performances: dynamic interactions at different fixed-ratio values.

Key pecking by three pigeons was maintained under a multiple fixed-interval fixed-ratio schedule of food presentation. The fixed-interval value remained at 3 minutes, while the fixed-ratio size was increased systematically in 30-response increments from 30 to either 120 (two pigeons) or 150 (one pigeon). At least two lower fixed-ratio values were also redetermined. The effects of ethanol (5 to 2.5 g/kg) were assessed at each of the different schedule parameters. Both overall and running response rates under the fixed-ratio schedule decreased with increases in the size of the fixed-ratio schedule; pause duration under the fixed-ratio schedule was directly related to increases in fixed-ratio size. Overall and running rates of responding under the fixed-interval schedule changed little with increases in the size of the fixed-ratio schedule. Despite the relative invariance of fixed-interval responding across the different fixed-ratio values, the effects of ethanol on responding under the fixed-interval schedule differed depending on the size of the fixed-ratio schedule. Greater increases occurred in both overall and in lower local rates of responding under the fixed-interval schedule when the fixed-ratio value was 120 or 150. The effects of ethanol on responding under the fixed-ratio schedule also depended on the size of the fixed ratio. Increases in responding under the fixed-ratio schedule were typically greater at the higher fixed-ratio values where response rates were lower. When the effects of ethanol were redetermined at the lower fixed-ratio parameter values, rates and patterns of responding were comparable to those obtained initially. However, the dose-effect curves for responding under both fixed-ratio and fixed-interval schedules were shifted up and to the right of those determined during the ascending series. The effects of ethanol can depend on rate or responding, behavioral history, and the context in which behavior occurs.     

Temporal control in rats: analysis of nonlocalized effects from short interfood intervals.

The present experiment analyzed temporal control of postreinforcement pause duration during within-session changes in the criterion for reinforcement (interfood interval, IFI). Analysis of interval-by-interval changes in the pause revealed localized and nonlocalized effects from short intervals that caused specific changes in performance. In Phase 1, rats were presented with five consecutive 15-s IFIs intercalated into a series of 60-s IFIs. The 15-s set decreased the pause in adjacent and more remote 60-s intervals. In Phase 2, two sets of 15-s intervals were intercalated. The spacing between the two sets varied so that 0, 5, 10, or 15 60-s IFIs separated the sets. The postreinforcement pause tracked all changes in the IFI duration, and the localized effect from a short set extended beyond the next interval to the next few 60-s IFIs. Effects from one set, however, did not combine with a second set: Changes in the pause after two sets were the same regardless of the spacing between sets.     

Signaled reinforcement effects on fixed-interval performance of rats with lever depressing or releasing as a target response

The effect of a diffuse auditory signal filling a brief delay between a response and reinforcement depends upon the nature of the trained target response. Rats in a signaled condition responded slower than rats in an unsignaled condition if the target response was lever release. If the target response was lever depression, however, rats in the signaled condition responded faster than rats in the unsignaled condition at the end of training     

The effects of number of responses on the postreinforcement pause in fixed-interval schedules

The present study manipulated the number of responses in a modified fixed-interval schedule by imposing a blackout after each unreinforced response during the interval. The blackout duration was varied, and the duration of the fixed interval was held constant. The subjects were initially exposed to a fixed-interval 300-sec schedule. Blackout durations of 0, 10, and 50 sec were used. Following this, a fixed-interval 30-sec schedule was used with blackout durations of 0, 1, and 5 sec. Under the fixed-interval 300-sec schedule, the number of interreinforcement responses varied over a wider range than occurred under the fixed-interval 30-sec schedule. The duration of the postreinforcement pause decreased as blackout durations were increased and number of responses decreased on the fixed-interval 300-sec schedule, but pause length did not vary with changes in blackout duration and number of responses for the fixed-interval 30-sec schedule. The differences in the effects of blackout duration and response manipulation on the two fixed-interval schedules were attributed to relatively greater changes in the number of interreinforcement responses for the fixed-interval 300-sec schedule.