Preference for fixed-interval schedules: effects of unequal initial links

Six homing pigeons were trained on concurrent chain schedules in which the terminal links were fixed-interval schedules of 5 sec or 15 sec. One initial-link schedule was always VI 27-sec; the other was varied over conditions from VI 27-sec to VI 181-sec. Preference measured in the initial links varied as a joint function of the initial- and terminal-link schedules. When the initial links were varied with constant, but unequal, terminal links, the slope of the function relating the logarithm of the initial-link response ratio to the logarithm of the terminal-link entry ratio differed from that obtained with equal terminal links. This result indicates that biases attributable to the terminal-link schedules were not constant. The rate of change of preference, or degree of undermatching, in the initial links depended on whether the shorter initial link led to the shorter or the longer terminal link. These results raise the question of whether bias and undermatching in concurrent schedule performance are independent measures.     

Preference for fixed-interval schedules of reinforcement

Pigeons were trained on a two-link concurrent chain schedule in which responding on either of two keys in the initial link occasionally produced a terminal link, signaled by a change in the color of that key and a darkening of the other. Further responding on the lighted key was reinforced with food according to a fixed-interval schedule. For one of the keys, this fixed interval was always 20 sec, while for the other it was held at values of 5, 14, 30, or 60 sec for several weeks. In the initial link, all pigeons responded relatively more often on the key with the shorter fixed interval than was predicted by the matching hypothesis. Responding in the initial link showed a large negative recency effect: pigeons responded less frequently on the key that provided their last reinforcement than predicted from the overall response rates.     

Preference for mixed-interval versus fixed-interval schedules

Pigeons were trained on a two-link concurrent chain schedule in which responses on two keys were reinforced according to independent variable-interval schedules by the production of a change in key color. Further responses on the key on which the stimulus change had been produced gave a single food reinforcement and a return to concurrent variable-interval conditions. On one key the terminal link was a two-valued mixed-interval schedule, while on the other, the terminal link was a fixed-interval schedule. When the mixed-interval values were kept constant and the fixed-interval values varied, relative response rates in the initial concurrent links matched relative reinforcement rates in the terminal links when these were computed from cubic transformations of the reciprocals of the intervals comprising the terminal link schedules.     

Preference for fixed-interval schedules: an alternative model

Pigeons were trained under concurrent chain schedules in which the initial links were equal aperiodic schedules and the terminal links were fixed-interval schedules. Choice proportions in the initial links were measured in 26 experimental conditions. The data showed the inadequacy of previous models of concurrent chain performance. A new model was suggested in which choice is a joint function of terminal-link times, overall reinforcement rates, and terminal-link entries. This model accounted for 94% of the variance in the present data and for substantial percentages of the variance in previously reported data. The model simplifies to matching between response ratios and obtained reinforcement rate ratios for simple concurrent schedule performance.     

Preference for mixed-interval versus fixed-interval schedules: number of component intervals

Six pigeons were trained under a concurrent chains procedure so that preference for fixed-interval versus mixed-interval schedules with varying numbers of component intervals could be examined. The smallest and largest intervals in the terminal links were the same value as those used by Davison (1969). Relative choice in all cases approximated the relative means of the squares of the harmonic intervals to reinforcement in the terminal links, and no effect of number of component intervals was demonstrated. Mixed-interval versus fixed-interval choice could not be predicted from extant data on fixed-interval versus fixed-interval choice.     

Preference for less frequent shock under fixed-interval schedules of electric-shock presentation.

Lever pressing by 2 squirrel monkeys was maintained under fixed-interval 6-min and fixed-interval 2-min schedules of electric-shock presentation. Preference for these schedules was assessed during three experimental phases. In all phases, responses on one lever produced shock according to one or the other fixed-interval schedule, and responses on a second, changeover, lever switched between schedules. The opportunity to change over was presented during separate choice periods (during which the fixed-interval schedules did not operate) that followed the first through fourth shocks in each schedule. If no changeover occurred during those choice periods, a changeover automatically occurred following the fifth shock. In Phase I, durations of the choice periods were fixed. In Phase II, the choice periods equaled a proportion of their respective fixed interval. During Phase III (completed with 1 monkey) a response on the changeover lever during a given choice period reinstated the most recent fixed interval, and a failure to respond resulted in a changeover. During each of these phases, distinct preferences developed for the 6-min schedule. These results suggest that the maintenance of lever pressing by fixed-interval presentation of electric shock may not be an example of positive reinforcement, and that the response-maintaining characteristics of shock presentation may derive from other properties of the schedule.     

Contrast effects in multiple fixed-interval reinforcement schedules

Pigeons were exposed to a multiple fixed-interval one-minute fixed-interval three-minute schedule of reinforcement following training on either a multiple fixed-interval one-minute fixed-interval one-minute schedule or a multiple fixed-interval three-minute fixed-interval three-minute schedule. For all birds, large negative local contrast effects developed during the first of four three-minute intervals in a component; response rate was depressed and postreinforcement pause lengthened in this interval. Positive local contrast effects were evident during the first of 12 one-minute intervals in a component for five of six birds; at asymptote, the pause was very short and response rate slightly elevated during this interval. Overall positive contrast was generally transient and varied considerably across subjects, while overall negative contrast effects, if they occurred, appeared only after a large number of sessions.     

Drug discrimination under two concurrent fixed-interval fixed-interval schedules

Pigeons were trained to discriminate 5.0 mg/kg pentobarbital from saline under a two-key concurrent fixed-interval (FI) 100-s FI 200-s schedule of food presentation, and later tinder a concurrent FI 40-s FI 80-s schedule, in which the FI component with the shorter time requirement reinforced responding on one key after drug administration (pentobarbital-biased key) and on the other key after saline administration (saline-biased key). After responding stabilized under the concurrent FI 100-s FI 200-s schedule, pigeons earned an average of 66% (after pentobarbital) to 68% (after saline) of their reinforcers for responding under the FI 100-s component of the concurrent schedule. These birds made an average of 70% of their responses on both the pentobarbital-biased key after the training dose of pentobarbital and the saline-biased key after saline. After responding stabilized under the concurrent FI 40-s FI 80-s schedule, pigeons earned an average of 67% of their reinforcers for responding under the FI 40 component after both saline and the training dose of pentobarbital. These birds made an average of 75% of their responses on the pentobarbital-biased key after the training dose of pentobarbital, but only 55% of their responses on the saline-biased key after saline. In test sessions preceded by doses of pentobarbital, chlordiazepoxide, ethanol, phencyclidine, or methamphetamine, the dose-response curves were similar under these two concurrent schedules. Pentobarbital, chlordiazepoxide, and ethanol produced dose-dependent increases in responding on the pentobarbital-biased key as the doses increased. For some birds, at the highest doses of these drugs, the dose-response curve turned over. Increasing doses of phencyclidine produced increased responding on the pentobarbital-biased key in some, but not all, birds. After methamphetamine, responding was largely confined to the saline-biased key. These data show that pigeons can perform drug discriminations under concurrent schedules in which the reinforcement frequency under the schedule components differs only by a factor of two, and that when other drugs are substituted for the training drugs they produce dose-response curves similar to the curves produced by these drugs under other concurrent interval schedules.     

Temporal control in fixed-interval schedules

The peak procedure was used to study temporal control in pigeons exposed to seven fixed-interval schedules ranging from 7.5 to 480 s. The focus was on behavior in individual intervals. Quantitative properties of temporal control depended on whether the aspect of behavior considered was initial pause duration, the point of maximum acceleration in responding, the point of maximum deceleration, the point at which responding stopped, or several different statistical derivations of a point of maximum responding. Each aspect produced different conclusions about the nature of temporal control, and none conformed to what was known previously about the way ongoing responding was controlled by time under conditions of differential reinforcement. Existing theory does not explain why Weber's law so rarely fit the results or why each type of behavior seemed unique. These data fit with others suggesting that principles of temporal control may depend on the role played by the particular aspect of behavior in particular situations.     

The effects of terminal-link fixed-interval and variable-interval schedules on responding under concurrent chained schedules

Previous work using variable-interval schedules in the terminal links of concurrent chained schedules suggested that relative choice proportion in the initial links equalled relative rate of reinforcement in the terminal links. With fixed-interval terminal-link schedules, however, matching was not obtained. The present study held pairs of fixed-interval terminal-link schedules in a constant ratio but varied absolute sizes. Relative choice for the smaller terminal-link fixed-interval schedule was a negatively accelerated, increasing function of absolute size of the fixed-interval pairs. Matching was found only with the fixed-interval pair of 5 and 10 sec. When pairs of variable-interval schedules were arranged so that the harmonic mean of the intervals equalled the fixed-interval parameter values, relative choice functions were like those for fixed-interval schedules.     

Reinforcement omission on fixed-interval schedules

Experiments with pigeons and rats showed that: (1) When a brief blackout was presented in lieu of reinforcement at the end of 25% of intervals on a fixed-interval 2-min schedule, response rate was reliably and persistently higher during the following 2-min intervals (omission effect). This effect was largely due to a decrease in time to first response after reinforcement omission. (2) When blackout duration was varied, within sessions, over the range 2 to 32 sec, time to first response was inversely related to the duration of the preceding blackout, for pigeons, and for rats during the first few sessions after the transition from FI 2-min to FI 2-min with reinforcement omission. Post-blackout pause was independent of blackout duration for rats at asymptote. These results were interpreted in terms of differential depressive effects of reinforcement and blackout on subsequent responding.     

Performance in multiple fixed-interval schedules

The performances of five pigeons were studied under a variety of multiple fixed-interval schedules in which both component duration and reinforcement rate were varied. The three series of experimental conditions were: (a) when the ratio of component durations equalled the reciprocal of the ratio of component reinforcement rates; (b) when the component durations were equal; and (c) when the ratio of component durations equalled the ratio of component reinforcement rates. Relative response rates were related to relative reinforcement rates in the same manner as in multiple variable-interval schedules, but no effect of component duration was found.     

Ratio requirement and reinforcer effects in concurrent fixed-interval fixed-ratio schedules

The fixed-ratio requirement was varied in concurrent fixed-interval fixed-ratio schedules. Fixed-interval responding was reinforced by food. In different phases, fixed-ratio responding was reinforced by food or water. There was a direct relation between the ratio requirement and interval response rates when both responses were reinforced with food, but essentially no relation when the reinforcers were different. The role of reinforcers in concurrent schedules merits detailed study.     

Performance in concurrent fixed-interval schedules

Six pigeons were trained on a variety of concurrent fixed-interval fixed-interval schedules. Matching between response or time ratios and ratios of obtained numbers of reinforcements was found for eight of 12 schedules studied. Cumulative records showed both typical burst-and-break patterns and also atypical response patterns in which response rate was constant between reinforcements on a schedule. Matching occurred only when the same pattern was present on both concurrent schedules. When different response patterns were generated by the two schedules, the pigeons consistently emitted fewer responses to the shorter fixed-interval than required by matching.     

Alternative fixed-ratio fixed-interval schedules of reinforcement

Five rats were trained under alternative fixed-ratio fixed-interval schedules, in which food reinforcement was provided for the completion of either a fixed-ratio or a fixed-interval requirement, whichever was met first. Overall response rate and running rate (the rate of responding after the postreinforcement pause) decreased for all subjects as the fixed-ratio value increased. As the proportion of reinforcements obtained from the fixed-ratio component increased and the alternative schedule approached a simple fixed ratio, overall response rate and running rate both increased; conversely, as the proportion of reinforcements obtained from the fixed-interval component increased and the alternative schedule approached a simple fixed interval, response rates decreased. Postreinforcement pause length increased linearly as the average time between reinforcements increased, regardless of the schedule parameters. A break-run pattern of responding was predominant at low- and medium-valued fixed ratios. All subjects displayed at least occasional positively accelerated responding within interreinforcement intervals at higher fixed-ratio values.     

Summation of responding maintained by fixed-interval schedules

A light and tone were separately correlated with responding maintained by fixed-interval schedules, in which the level of responding varied continuously throughout the duration of the interval. Responding during the presence of the single stimuli and their compound was compared during the successive segments of the interval. The following results were obtained: (1) more responses were emitted during compounding than were emitted during either stimulus alone in all segments of the interval; (2) increases in the number of responses across the interval during compounding paralleled increases during single-stimulus presentations. The sum of the responses emitted during the single stimuli was similar to the number of responses emitted during compounding, suggesting that the response tendencies correlated with the single stimuli combined in a summative or additive fashion.     

Eccentric stimuli on multiple fixed-interval schedules

The effects of presenting a different (“eccentric”) stimulus for one interval during either or both components of a cyclic multiple fixed-interval fixed-interval schedule, with 12 short and four long intervals per cycle, were studied in three experiments. Eccentric stimuli in the short-interval component reliably produced a persistent, substantial elevation in key-peck rate. The effect appears to depend on schedule context and an initial “disinhibiting” effect of the eccentric stimulus.     

Stimulus functions in chained fixed-interval schedules

Pigeons were required to complete three successive fixed-interval components to obtain food. When the same exteroceptive stimulus was correlated with the three components, responding was positively accelerated between food deliveries. When different exteroceptive stimuli were correlated with each component in a fixed sequence, prolonged pauses developed in the first component; low response rates developed in the second component; and responding was positively accelerated in the second and third components. When different exteroceptive stimuli were correlated with each component in a variable sequence, responding was positively accelerated in each component. Because the response and reinforcement contingencies were the same in all three procedures, the differences in performances must be due to the changes in the sequence of stimuli.     

Responding under discrete-trial fixed-interval schedules of reinforcement

A fixed-interval schedule of reinforcement was modified by dividing each interval into 4-sec trial periods. No more than one response could occur during each trial because the operandum was inactivated for the remainder of any trial in which a response occurred. For example, under a 28-sec schedule, no more than seven responses could be emitted between reinforcements. Probabilities of responding by pigeons under six values of this discrete-trial fixed-interval schedule were best described by a two-state model: responding was either absent or infrequent immediately after reinforcement; then, at some variable time after reinforcement, there was an abrupt transition to a high and constant probability of responding on each trial. Performances under the discrete-trial procedure were less affected by uncontrolled sources of variance than performances under equivalent free-operant fixed-interval schedules.