Temporal tracking on cyclic-interval reinforcement schedules

Pigeons were exposed to four cycles per session of a schedule in which the duration of successive interreinforcement intervals differed by t-sec. A cycle was composed of seven increasing and seven decreasing intervals, from 2t to 8t sec in length. In Exp. 1, postreinforcement pause tracked interval duration on five cyclic schedules, with values of t ranging from 2 to 40 sec. Tracking was better at shorter t values, and when discriminative stimuli signalled increasing and decreasing parts of the cycle. Pooled data for the whole experiment showed postreinforcement pause to bear a power function relationship to interval length, with a smaller exponent than the comparable function for fixed-interval schedules. Tests in a second experiment showed that pigeons trained on an arithmetic progression could also track schedules in which successive intervals followed either a logarithmic or a geometric progression, although tracking was more stable in the logarithmic case.     

INFLUENCES ON COCAINE TOLERANCE ASSESSED UNDER A MULTIPLE CONJUNCTIVE SCHEDULE OF REINFORCEMENT

Under multiple schedules of reinforcement, previous research has generally observed tolerance to the rate‐decreasing effects of cocaine that has been dependent on schedule‐parameter size in the context of fixed‐ratio (FR) schedules, but not under the context of fixed‐interval (FI) schedules of reinforcement. The current experiment examined the effects of cocaine on key‐pecking responses of White Carneau pigeons maintained under a three‐component multiple conjunctive FI (10 s, 30 s, & 120 s) FR (5 responses) schedule of food presentation. Dose‐effect curves representing the effects of presession cocaine on responding were assessed in the context of (1) acute administration of cocaine (2) chronic administration of cocaine and (3) daily administration of saline. Chronic administration of cocaine generally resulted in tolerance to the response‐rate decreasing effects of cocaine, and that tolerance was generally independent of relative FI value, as measured by changes in ED50 values. Daily administration of saline decreased ED50 values to those observed when cocaine was administered acutely. The results show that adding a FR requirement to FI schedules is not sufficient to produce schedule‐parameter‐specific tolerance. Tolerance to cocaine was generally independent of FI‐parameter under the present conjunctive schedules, indicating that a ratio requirement, per se, is not sufficient for tolerance to be dependent on FI parameter.     

The effects of interval duration on temporal tracking and alternation learning

On cyclic-interval reinforcement schedules, animals typically show a postreinforcement pause that is a function of the immediately preceding time interval (temporal tracking). Animals, however, do not track single-alternation schedules-when two different intervals are presented in strict alternation on successive trials. In this experiment, pigeons were first trained with a cyclic schedule consisting of alternating blocks of 12 short intervals (5 s or 30 s) and 12 long intervals (180 s), followed by three different single-alternation interval schedules: (a) 30 s and 180 s, (b) 5 s and 180 s, and (c) 5 s and 30 s. Pigeons tracked both schedules with alternating blocks of 12 intervals. With the single-alternation schedules, when the short interval duration was 5 s, regardless of the duration of the longer interval, pigeons learned the alternation pattern, and their pause anticipated the upcoming interval. When the shorter interval was 30 s, even when the ratio of short to long intervals was kept at 6:1, pigeons did not initially show anticipatory pausing-a violation of the principle of timescale invariance.     

Multiple fixed-interval schedules: transient contrast and temporal inhibition

Pigeons were exposed to four cycles per session of a multiple schedule in which each cycle involved twelve 60-sec fixed intervals followed by four 180-sec intervals [(12 FI 60-sec)(4 FI 180-sec) schedule]. Post-reinforcement pauses were shorter during the first few short intervals of each cycle than during later short intervals, and increased over the four long intervals of each cycle (positive and negative transient contrast). A (12 FI 15-sec)(4 FI 45-sec) schedule showed similar results. These two schedules differed in some other respects indicating effects of absolute FI duration on stimulus control. Differences in contrast properties between both these procedures and multiple variable-interval schedules were related to the pause-producing property of reinforcement on FI (temporal inhibition). Behavior under two other multiple fixed-interval schedules—(2 FI 360-sec)(1 FI 720-sec) and (3 FI 360-sec)(1 FI 720-sec)—differed in certain respects from both the (12 FI x-sec)(4 FI 3x-sec) schedules. These differences may be related to differences in the number of successive fixed intervals within a component (run length).     

Drug discrimination under two concurrent fixed-interval fixed-interval schedules

Pigeons were trained to discriminate 5.0 mg/kg pentobarbital from saline under a two-key concurrent fixed-interval (FI) 100-s FI 200-s schedule of food presentation, and later tinder a concurrent FI 40-s FI 80-s schedule, in which the FI component with the shorter time requirement reinforced responding on one key after drug administration (pentobarbital-biased key) and on the other key after saline administration (saline-biased key). After responding stabilized under the concurrent FI 100-s FI 200-s schedule, pigeons earned an average of 66% (after pentobarbital) to 68% (after saline) of their reinforcers for responding under the FI 100-s component of the concurrent schedule. These birds made an average of 70% of their responses on both the pentobarbital-biased key after the training dose of pentobarbital and the saline-biased key after saline. After responding stabilized under the concurrent FI 40-s FI 80-s schedule, pigeons earned an average of 67% of their reinforcers for responding under the FI 40 component after both saline and the training dose of pentobarbital. These birds made an average of 75% of their responses on the pentobarbital-biased key after the training dose of pentobarbital, but only 55% of their responses on the saline-biased key after saline. In test sessions preceded by doses of pentobarbital, chlordiazepoxide, ethanol, phencyclidine, or methamphetamine, the dose-response curves were similar under these two concurrent schedules. Pentobarbital, chlordiazepoxide, and ethanol produced dose-dependent increases in responding on the pentobarbital-biased key as the doses increased. For some birds, at the highest doses of these drugs, the dose-response curve turned over. Increasing doses of phencyclidine produced increased responding on the pentobarbital-biased key in some, but not all, birds. After methamphetamine, responding was largely confined to the saline-biased key. These data show that pigeons can perform drug discriminations under concurrent schedules in which the reinforcement frequency under the schedule components differs only by a factor of two, and that when other drugs are substituted for the training drugs they produce dose-response curves similar to the curves produced by these drugs under other concurrent interval schedules.     

Some effects of fixed-interval duration on response rate in a two-component chain schedule

In Exp. I three pigeons were trained on a two-component chain schedule. Responding on a 1-min variable-interval schedule in the initial component led to a sequence of two fixed-interval schedules in the terminal component. The rate of reinforcement in the terminal component was kept constant while the values of the two fixed intervals were varied. Three combinations of fixed-interval schedules were studied, FI 0.25, FI 1.75 (minutes) or FI 1.00, FI 1.00, or FI 1.75, FI 0.25. The rate for each subject declined in the initial component as the value of the first fixed interval was increased. Experiment II was conducted to assess the role of the second fixed-interval schedule in the terminal component in determining the rate of responding in the initial component. For each chain schedule the rate of responding in the initial component was determined both with and without the second of the sequence of fixed intervals. In all three cases the rate of responding in the initial component decreased when the second fixed interval was removed. Increasing the first fixed interval in Exp. I had a greater effect on variable-interval performance than did the removal of the second fixed interval in Exp. II.     

Role of nonreinforcement in the fixed-interval performance of pigeons

Fixed-interval (FI) schedules have been used extensively to study timing abilities. In FI schedules, animals typically show higher response rates immediately after nonreinforced (N) cycles rather than reinforced (R) cycles (the reinforcement-omission effect), and they exhibit the highest rate approximately at the time when the reinforcer is scheduled to occur (peak performance). The present experiments were designed to determine the extent to which factors other than timing contribute significantly to these two learning phenomena. Pigeons were trained in an FI 16-sec schedule in which half the cycles were R and half were N. When successive cycles were separated by a 2-sec interval, responding early in the FI interval was higher after an N cycle than after an R cycle. This reinforcement-omission effect was eliminated when the interval between cycles was increased to 12 sec, because of an increase in performance after R cycles. In addition, timing of the 16-sec interval was assessed by interpolating 32-sec test cycles (all N cycles) at two rates—either 1 test cycle every other session, or 25 test cycles per session. Peak performance, presumably indexing the animal’s ability to time the 16-sec interval, emerged only with 25 test cycles per day, but not with 1 test cycle every other day, despite extensive training with the target, 16-sec-long interval. These results suggest that transient demotivation and time-based discrimination contribute significantly to the reinforcement-omission effect and peak performance, respectively.     

Choice and multiple reinforcers

Pigeons chose between equivalent two-component mixed and multiple terminal-link schedules of reinforcement in the concurrent-chains procedure. The pigeons preferred the multiple schedule over the mixed when the components of the compound schedules were differentiated in terms of density of reinforcement, but the pigeons were indifferent when the components were differentiated in terms of number of reinforcers per cycle. Taken together, these results indicate that a local variable, the interval to the first reinforcer, but not a molar variable, the number of reinforcers, was sufficient to differentiate the components and thereby evoke preference.     

Some determinants of remote behavioral history effects in humans

Undergraduates were exposed to a series of reinforcement schedules: first, to a fixed-ratio (FR) schedule in the presence of one stimulus and to a differential-reinforcement-of-low-rate (DRL) schedule in the presence of another (multiple FR DRL training), then to a fixed-interval (FI) schedule in the presence of a third stimulus (FI baseline), next to the FI schedule under the stimuli previously correlated with the FR and DRL schedules (multiple FI FI testing), and, finally, to a single session of the multiple FR DRL schedule again (multiple FR DRL testing). Response rates during the multiple FI FI schedule were higher under the former FR stimulus than under the former DRL stimulus. This effect of remote histories was prolonged when either the number of FI-baseline sessions was small or zero, or the time interval between the multiple FR DRL training and the multiple FI FI testing was short. Response rates under these two stimuli converged with continued exposure to the multiple FI FI schedule in most cases, but quickly differentiated when the schedule returned to the multiple FR DRL.     

Stimulus generalization of behavioral history: Interspecies generality and persistence of generalization gradients

Four pigeons were exposed to a tandem variable-interval (VI) fixed-ratio (FR) schedule in the presence of a 50-pixel (about 15 mm) square or an 80-pixel (about 24 mm) square and to a tandem VI differential-reinforcement-of-low-rate (DRL) schedule when a second 80-pixel or 50-pixel square was present. The values of the VI and FR schedules were adjusted to equate reinforcement rates in the two tandem schedules. Following this, a square-size continuum generalization test was administered under a fixed-interval (FI) schedule or extinction. In the first testing session, response frequency was a graded function of the similarity of the test stimuli to the training stimuli for all pigeons. These systematic generalization gradients persisted longer under the FI schedule than under extinction.     

Response persistence under ratio and interval reinforcement schedules

In Experiment 1, rats were exposed to progressive-ratio schedules of food reinforcement while other rats were exposed simultaneously to yoked-interval schedules that arranged equivalent interreinforcer intervals but required only a single response at the end of the interval for food delivery. In Experiment 2, a within-subject yoked-control procedure was employed in which pigeons were exposed to alternating sessions (one per day) of progressive-ratio schedules and yoked-interval schedules as described above. In both experiments, responding under the yoked-interval schedule persisted beyond the point at which responding under the progressive-ratio schedule had ceased. The progressive-ratio schedules controlled break-and-run distributions, and the yoked-interval schedules controlled more even distributions of responses in time. Response rates decreased and postreinforcement pauses increased over time within individual sessions under both schedules. The results suggest that responding maintained by interval schedules is more persistent than that maintained by ratio schedules. The limitations and implications of this conclusion are discussed in the context of other investigations of response strength and behavioral momentum.     

Behavioral interactions in multiple variable-interval schedules

In Experiment I, two groups of four pigeons each were exposed to multiple schedules in which one component was always a variable-interval schedule with a mean interreinforcement interval of 30 or 180 seconds. The other component was either an equal variable-interval schedule or extinction. Response rates in the unchanged component always increased when reinforcement was no longer scheduled in the changed component, and decreased in seven of eight cases when the variable-interval schedule was re-introduced. The per cent rate change in the unchanged component was inversely related to the frequency of reinforcement and to the ongoing response rate in the unchanged component. Rate changes in the unchanged component were not consistently correlated with changes in any single feature of the relative-frequency interresponse-time distributions. In Experiment II, the same pigeons were exposed to variable-interval schedules and multiple variable-interval variable-interval schedules with equal mean interreinforcement intervals. Response rates were similar under both conditions.     

Income maximizing on concurrent ratio-interval schedules of reinforcement

Three experiments examined the effect of food availability on pigeons' choice behavior under concurrent schedules of reinforcement. In Experiment 1, 3 pigeons earned their daily food ration by choosing, in 30-min sessions, between concurrent variable-ratio 30 variable-interval 40-s schedules. Food presentations during both schedules lasted 2 or 12 s, depending upon the condition. Relative variable-ratio response rate was inversely related to hopper duration. In Experiment 2, 4 pigeons received their daily feeding by responding on the same schedule pair as in Experiment 1 (with 4-s food presentations) in sessions that varied in length from 10 to 30 min, depending on the condition. The length of a vertical slit projected on a response key increased with time so that “passage of time” might be more easily discriminable. As session duration decreased, relative variable-ratio response rate increased. In Experiment 3, 4 pigeons chose between two variable-interval 40-s schedules. One schedule operated without regard to the schedule selected, whereas the other operated only when the subject responded in its presence (dependent). Although these schedules had the same feedback function, preference for the dependent variable interval increased as session duration decreased from 30 to 10 min. The preference changes in these studies reveal the operation of an income-maximizing process in choice.     

Random interval schedules of reinforcement

A method for generating a reinforcement schedule that closely approximates idealized VI schedules in which reinforcement assignments occur randomly in time (RI schedules) is described. Response rates of pigeons exposed for 20 sessions to this schedule appeared very similar to response rates characteristic of arithmetic series VIs. The distribution function describing these schedules was derived and its relations to other VI distributions, as well as to FI and random ratio (RR) were shown.     

Preference for unsegmented interreinforcement intervals in concurrent chains

Five pigeons were trained under concurrent-chain schedules in which a pair of independent, concurrent variable-interval 60-s schedules were presented in the initial link and either both variable-interval or both fixed-interval schedules were presented in the terminal link. Except for the baseline, one of the terminal-link schedules was always a two-component chained schedule and the other was either a simple or a tandem schedule of equal mean interreinforcement interval. The values of the fixed-interval schedules were either 15 s or 60 s; that of the variable-interval schedules was always 60 s. A 1.5-s changeover delay operated during the initial link in some conditions. The pigeons preferred a simple or a tandem schedule to a chain. For the fixed-interval schedules, this preference was greater when the fixed interval was 60 s than when it was 15 s. For the variable-interval schedules, the preferences were less pronounced and occurred only when the changeover delay was in effect. For a given type of schedule and interreinforcement interval, similar preferences were obtained whether the nonchained schedule was a tandem or simple schedule. The changeover delay generally inflated preference and lowered the changeover rate, especially when the terminal-link schedules were either short (15 s) or aperiodic (variable-interval). The results were consistent with the notion that segmenting the interreinforcement interval of a schedule into a chain lowers the preference for it.     

Pentobarbital and d-amphetamine effects on concurrent performances.

The effects of pentobarbital and d-amphetamine were studied in pigeons responding under several concurrent fixed-ratio variable-interval and concurrent fixed-ratio fixed-interval schedules of food presentation. Drug effects were compared with different fixed ratios, fixed and variable intervals, changeover delays, and with the schedules operating singly. Doses of d-amphetamine that increased or did not affect responding under the interval schedules decreased responding under the fixed-ratio schedule, whereas doses of pentobarbital that increased responding under the fixed-ratio schedule decreased or eliminated responding under the interval schedules. These effects depended both on the schedule of food delivery and the parameters of schedules arranged concurrently. Pentobarbital increased responding under the fixed-ratio schedule with 4-minute and 10-minute interval schedules arranged concurrently, but not with 1.5-minute schedules. d-Amphetamine decreased concurrent ratio and interval responding with the 1.5-minute interval schedules, but either increased or did not affect responding with the longer intervals. Changes in the parameter of one schedule altered responding controlled by that schedule and also other concurrent performances. As a consequence, the effects of drugs on each behavior were altered.     

Conjunctive schedules of reinforcement: I. Rate-dependent effects of pentobarbital and d-amphetamine

Key pecking of pigeons was maintained under conjunctive schedules of food presentation in which both a fixed-interval and a fixed-ratio schedule had to be completed before a peck produced food. For two pigeons, pecks on a single key completed both schedule requirements (fixed-interval 3-min, fixed-ratio 50 for one bird, fixed-interval 5-min, fixed-ratio 50 for the second). For two other pigeons, each requirement was scheduled on a separate key. On the two-key schedule, a peck after 5 min on the key scheduling the fixed-interval requirement produced food if at least 10 pecks had occurred on the ratio key (conjunctive fixed-interval 5-min, fixed-ratio 10). When each requirement was scheduled on a separate key, response rates on the fixed-ratio key were generally higher in the early portion of the interval and declined as the interval progressed; responding on the fixed-interval key, once initiated, typically remained at a constant rate throughout the interval. Responding under the single-key schedule was characterized by a high rate early in the interval; this then changed to a lower rate that continued until a peck produced food. For all pigeons, increases in response rates with pentobarbital and d-amphetamine were inversely related to the control rate of responding. When equivalent rates on each key of the two-key schedule were compared, both drugs increased rates on the fixed-ratio key less. Although the effects of both drugs were rate dependent, each drug differentially modified the pattern of responding under the single-key schedule.     

The Probability of Small Schedule Values and Preference for Random-Interval Schedules

Preference for working on variable schedules and temporal discrimination were simultaneously examined in two experiments using a discrete-trial, concurrent-chains arrangement with fixed interval (FI) and random interval (RI) terminal links. The random schedule was generated by first sampling a probability distribution after the programmed delay to reinforcement on the FI schedule had elapsed, and thus the RI never produced a component schedule value shorter than the FI and maintained a rate of reinforcement half that of the FI. Despite these features, the FI was not strongly preferred. The probability of obtaining the smallest programmed delay to reinforcement on the RI schedule was manipulated in Experiment 1, and the interaction of this probability and initial link length was examined in Experiment 2. As the probability of obtaining small values in the RI increased, preference for the schedule increased while the discriminated time of reinforcer availability in the terminal link decreased. Both of these effects were attenuated by lengthening the initial links. The results support the view that in addition to the delay to reinforcement, the probability of obtaining a short delay is an important choice-affecting variable that likely contributes to the robust preferences for variable, as opposed to fixed, schedules of reinforcement.     

Concurrent random-interval schedules and the matching law

In Experiment I, a group of eight pigeons performed on concurrent random-interval schedules constructed by holding probability equal and varying cycle time to produce ratios of reinforcer densities of 1:1, 3:1, and 5:1 for key pecking. Schedules for a second group of seven were constructed with equal cycle times and unequal probabilities. Both groups deviated from simple matching, but the two forms of the schedules appeared to produce no consistent patterns of deviation. The data were found to be consistent with those obtained in concurrent variable-interval situations. The parameters of the matching equation in the form of Y=k X^a were estimated; the value of k was unity and a was 0.84. In Experiment II, six pigeons were exposed to two conc RI RI schedules in which one component increasingly approximated an FI schedule. The value of k was not 1.0. Concurrent RI RI schedules were shown to represent a continuum from conc FI VI to conc VI VI schedules. The use of the exponential equation in testing “matching laws” suggests that a<1 will continue to be observed, and this will set limits on the form of new laws and the assumed or rational values of the component variables in these laws.     

Effects of reinforcement amount on attack induced under a fixed-interval schedule in pigeons

Key pecking by pigeons was maintained on a chained fixed-interval 4-min (12-min for 1 subject) fixed-ratio 1 schedule of food presentation. Attacks toward a restrained and protected conspecific were recorded. In the first experiment, the amount of food presented per interval was manipulated across phases by varying the number of fixed ratios required in the terminal link of the chain. Measures of attack for all pigeons during the fixed-interval component increased monotonically as a function of food amount. In the second experiment, two different food amounts alternated within each experimental session under a multiple schedule. For both pigeons in this experiment, measures of attack were higher during the component that delivered the larger food amount per interval. The differences in levels of attack induced by the two food amounts in Experiment 2, however, were not as great as in Experiment 1; apparently this was because attack during the first interval of each component was controlled in part (P-5626) or entirely (P-7848) by the reinforcement amount delivered at the end of the previous component. Attack was also a function of the location of the interfood interval within the session. For both pigeons, attack tended to decrease throughout the session. The results of both experiments suggest that attack is an increasing function of reinforcement amount under fixed-interval schedules, but that this function may be influenced by the manner in which reinforcement amount is manipulated, by the duration of the interfood interval, and by the location of the interfood interval within the experimental session. In general, these results are compatible with theories of induced attack and other schedule-induced behavior that emphasize aversive after-effects of reinforcement presentation.