Alternative fixed-ratio fixed-interval schedules of reinforcement

Five rats were trained under alternative fixed-ratio fixed-interval schedules, in which food reinforcement was provided for the completion of either a fixed-ratio or a fixed-interval requirement, whichever was met first. Overall response rate and running rate (the rate of responding after the postreinforcement pause) decreased for all subjects as the fixed-ratio value increased. As the proportion of reinforcements obtained from the fixed-ratio component increased and the alternative schedule approached a simple fixed ratio, overall response rate and running rate both increased; conversely, as the proportion of reinforcements obtained from the fixed-interval component increased and the alternative schedule approached a simple fixed interval, response rates decreased. Postreinforcement pause length increased linearly as the average time between reinforcements increased, regardless of the schedule parameters. A break-run pattern of responding was predominant at low- and medium-valued fixed ratios. All subjects displayed at least occasional positively accelerated responding within interreinforcement intervals at higher fixed-ratio values.     

Human performance on conjunctive fixed-interval fixed-ratio schedules

Eighteen young adults performed a lever-pulling task for money. Subjects were initially exposed to a fixed-interval 80-second schedule and subsequently to one of three conjunctive schedules in which the added fixed-ratio requirement was set at either 10, 80, or 120 responses. Three fixed-interval response patterns emerged: high constant rate, intermediate rate, or low rate, with most subjects displaying the last. Conjunctive performance was related to the subjects' prior fixed-interval patterns and the conjunctive ratio requirements. Low-rate subjects tended to optimize reinforcement (maximum reinforcers for minimum responses) on conjunctive schedules. Response rate was directly related to ratio requirements. Subjects' performance closely corresponded to their verbal statements of the contingencies.     

Performance in concurrent fixed-interval schedules

Six pigeons were trained on a variety of concurrent fixed-interval fixed-interval schedules. Matching between response or time ratios and ratios of obtained numbers of reinforcements was found for eight of 12 schedules studied. Cumulative records showed both typical burst-and-break patterns and also atypical response patterns in which response rate was constant between reinforcements on a schedule. Matching occurred only when the same pattern was present on both concurrent schedules. When different response patterns were generated by the two schedules, the pigeons consistently emitted fewer responses to the shorter fixed-interval than required by matching.     

Responding under fixed-ratio and multiple fixed-interval fixed-ratio schedules of electric shock presentation

Squirrel monkeys, initially trained under a schedule of electric shock postponement and then under fixed-interval schedules of electric shock presentation, were studied under multiple fixed-interval fixed-ratio and under fixed-ratio schedules of shock presentation. Under the fixed-interval (10-min) component of the multiple schedule, a pause was followed by a gradual increase in responding to a rate maintained until shock presentation; under the fixed-ratio (3-, 10-, or 30-response) component of the multiple schedule, a brief pause was typically followed by a relatively high and uniform rate of responding until shock was presented. When the 60-sec timeout periods, which usually followed shock presentation, were eliminated from the multiple schedule for one monkey, responding was only transiently affected. In the one monkey studied, responding was maintained under a fixed-ratio schedule alone (with timeout periods), but rates of responding were lower than under the fixed-ratio component of the multiple schedule. Characteristic patterns of responding, similar to those engendered under schedules of food presentation or shock termination, can be maintained under fixed-ratio schedules of shock presentation; further, patterns of responding can be controlled by discriminative stimuli in multiple schedules.     

Drug discrimination under two concurrent fixed-interval fixed-interval schedules

Pigeons were trained to discriminate 5.0 mg/kg pentobarbital from saline under a two-key concurrent fixed-interval (FI) 100-s FI 200-s schedule of food presentation, and later tinder a concurrent FI 40-s FI 80-s schedule, in which the FI component with the shorter time requirement reinforced responding on one key after drug administration (pentobarbital-biased key) and on the other key after saline administration (saline-biased key). After responding stabilized under the concurrent FI 100-s FI 200-s schedule, pigeons earned an average of 66% (after pentobarbital) to 68% (after saline) of their reinforcers for responding under the FI 100-s component of the concurrent schedule. These birds made an average of 70% of their responses on both the pentobarbital-biased key after the training dose of pentobarbital and the saline-biased key after saline. After responding stabilized under the concurrent FI 40-s FI 80-s schedule, pigeons earned an average of 67% of their reinforcers for responding under the FI 40 component after both saline and the training dose of pentobarbital. These birds made an average of 75% of their responses on the pentobarbital-biased key after the training dose of pentobarbital, but only 55% of their responses on the saline-biased key after saline. In test sessions preceded by doses of pentobarbital, chlordiazepoxide, ethanol, phencyclidine, or methamphetamine, the dose-response curves were similar under these two concurrent schedules. Pentobarbital, chlordiazepoxide, and ethanol produced dose-dependent increases in responding on the pentobarbital-biased key as the doses increased. For some birds, at the highest doses of these drugs, the dose-response curve turned over. Increasing doses of phencyclidine produced increased responding on the pentobarbital-biased key in some, but not all, birds. After methamphetamine, responding was largely confined to the saline-biased key. These data show that pigeons can perform drug discriminations under concurrent schedules in which the reinforcement frequency under the schedule components differs only by a factor of two, and that when other drugs are substituted for the training drugs they produce dose-response curves similar to the curves produced by these drugs under other concurrent interval schedules.     

Preference in concurrent variable-interval fixed-ratio schedules

Five pigeons were trained on concurrent variable-interval fixed-ratio schedules in three experiments. Experiment 1 used two variable-interval schedules and one fixed-ratio schedule, and the ratio requirement was varied. Using the generalized matching law, sensitivity to reinforcement was close to 1.0, but performance was biased toward the variable-interval schedule with the lower reinforcement rate. In Experiment 2, which used one variable-interval and one fixed-ratio schedule, the interval schedule was varied. All birds showed sensitivities to reinforcement of less than 1.0 and of less than the values obtained in Experiment 1. The performance was also biased toward the fixed-ratio schedule. Because the generalized matching law could not account for the differences in the data from Experiments 1 and 2, an extension of this law was suggested and successfully tested in Experiment 3. The proposed dual-sensitivity model was also shown to clarify some previously reported results.     

Cocaine and food as reinforcers: effects of reinforcer magnitude and response requirement under second-order fixed-ratio and progressive-ratio schedules.

Reinforcer magnitude and fixed-ratio requirement were varied under two second-order schedules. Under one, the first sequence of a fixed number of responses completed after the lapse of a 10-min fixed interval produced reinforcement. Under the second, a second-order progressive-ratio schedule, the fixed number of responses increased after each reinforcement. Either cocaine (0 to 300 micrograms/kg/inj) or food (0 to 5,700 mg/delivery) reinforcers were delivered. Under some conditions, a 2-s illumination of stimulus lights occurred on completion of each ratio sequence. Under the second-order schedule, as cocaine dose or amount of food increased, rates of responding increased; at the highest values, rates of responding decreased. Increases in the ratio requirement from 10 to 170 responses minimally decreased overall response rates. Under the second-order progressive-ratio schedule, increases in dose of cocaine or amount of food increased rates of responding; at the highest amounts of food, rates of responding decreased but response rates at the highest dose of cocaine remained relatively high. The highest ratio requirement that was completed (breaking point) depended on the dose of cocaine but was less dependent on the amount of food. Removing brief-stimulus presentations had a greater effect on completion of ratio requirements with cocaine compared to food.     

The effects of terminal-link fixed-interval and variable-interval schedules on responding under concurrent chained schedules

Previous work using variable-interval schedules in the terminal links of concurrent chained schedules suggested that relative choice proportion in the initial links equalled relative rate of reinforcement in the terminal links. With fixed-interval terminal-link schedules, however, matching was not obtained. The present study held pairs of fixed-interval terminal-link schedules in a constant ratio but varied absolute sizes. Relative choice for the smaller terminal-link fixed-interval schedule was a negatively accelerated, increasing function of absolute size of the fixed-interval pairs. Matching was found only with the fixed-interval pair of 5 and 10 sec. When pairs of variable-interval schedules were arranged so that the harmonic mean of the intervals equalled the fixed-interval parameter values, relative choice functions were like those for fixed-interval schedules.     

Timeout and concurrent fixed-ratio schedules with human subjects

Human subjects given choices among 10 different pairs of concurrent fixed-ratio schedules preferred the smaller ratio. After a preference had been determined, timeout of increasing duration followed the completion of the preferred schedule. The larger the fixed-ratio difference, the longer the timeout necessary to produce the shift to the previously nonpreferred ratio. Responses by two of three subjects were unaffected by changes from response-dependent to response-independent pay.     

Variability of response location on fixed-ratio and fixed-interval schedules of reinforcement

Variability of response location was studied in monkeys performing in a six-lever chamber. Fixed-ratio schedules, ranging from FR 1 to FR 300, generated a high degree of stereotypy of response location. In contrast, fixed-interval schedules of comparable reinforcement frequencies (0.06 to 4 minutes) generated much greater variability. These results failed to confirm any simple relationship between response variability and intermittence of reinforcement. Rather, variability seems to be determined by the particular characteristics of the reinforcement schedule.     

Effects of concurrent schedules on human fixed-interval performance

Young adults performed a lever-pressing task for money on two schedules of reinforcement: concurrent fixed-interval 1 min—differential-reinforcement-of-low-rate 20-sec, and concurrent fixed-interval 1-min—fixed ratio 100 responses. All subjects were trained on both schedules. Fixed-interval performance concurrent with the differential reinforcement procedure was characterized by high constant rates with no post-reinforcement pauses. Fixed-interval performance concurrent with fixed ratio was characterized by low rates and lengthy post-reinforcement pauses. These results differ from those obtained in prior studies on the effects of conditioning history upon subsequent fixed-interval performance. The prior work, using non-concurrent procedures, had shown that fixed-interval performance following differential reinforcement of low rates was characterized by post-reinforcement pauses and low rates, while fixed-interval performance following fixed ratio exhibited high constant rates and no post-reinforcement pause. The present results suggest that alternative concurrent contingencies are another major determinant of human fixed-interval performance.     

Matching under concurrent fixed-ratio variable-interval schedules of food presentation

Four pigeons were exposed to concurrent fixed-ratio, variable-interval schedules of food presentation. The fixed-ratio requirement was either 25, 50, 75, or 100 responses, with the variable-interval schedule parameter held constant at 4 minutes. A delay time was imposed between a changeover from one schedule to the other and subsequent food availability. The delay time was varied at each ratio requirement over four values; no delay, 0-second delay, 1.5-second delay, and 5.0-second delay. As the fixed-ratio requirement or the delay time increased, a greater proportion of the total responses and time spent responding occurred under the variable-interval schedule relative to the proportion of food deliveries under that schedule. Neither relative overall response rate nor relative time spent responding equalled the relative frequency of food presentation, as would be predicted by a linear “matching” model. Rather, these data were described by power functions with slopes of approximately 1.0 and intercepts greater than 1.0. In the terms of Baum's (1974) analysis, these deviations from linear matching represent bias in favor of responding under the interval schedule. Bias, as reflected in the intercept of the power function, was greater for the ratio of time than the ratio of responses.     

Effects of d-amphetamine and pentobarbital under concurrent fixed-ratio schedules.

Pigeons were studied under a two-key concurrent fixed-ratio schedule of food presentation. During the first five sessions, the fixed-ratio requirements were 30 responses on one key (major key) and 120 responses on the other key (minor key): responding occurred almost exclusively on the major key. When the fixed-ratio requirements were then made equal at 30 responses on both keys, responding continued to predominate on the major key. The asymmetric distribution of responses persisted when the concurrent fixed-ratio fixed-ratio schedule was interrupted with periods during which the major key was associated with extinction while the other key remained associated with a fixed-ratio schedule. Additionally, in some subjects the fixed-ratio requirements were increased. These schedule modifications decreased the asymmetry in responding but did not eliminate it. d-Amphetamine decreased rates on both keys and slightly increased the asymmetric distribution of responses, while pentobarbital reversed the distribution of responses by increasing low rates and decreasing high rates. The pigeons maintained their original asymmetric distribution of responses during the 1 1/2-year-long study, despite schedule alterations and drug administrations.     

Conjunctive schedules of reinforcement: III. A fixed-interval adjusting fixed-ratio schedule

Key pecking of three pigeons was studied under a conjunctive schedule that specified both a fixed-interval and an adjusting fixed-ratio requirement. The fixed-interval schedule was 6 min for one pigeon and 3 min for the other two. The size of the ratio requirement was determined within each cycle of the fixed interval by the duration of the pause before responding began. The fixed-ratio value was at maximum at the start of each fixed interval and decreased linearly until the first response occurred (adjusting fixed-ratio schedule). A peck produced food when the number of responses remaining on the fixed-ratio schedule was completed and when the fixed interval had elapsed. If no response occurred during the interval, the fixed-ratio requirement decreased to one and a single response after the interval elapsed produced food. The initial value of the adjusting fixed-ratio schedule was studied over a range of 0 to 900. Increases in the adjusting fixed-ratio schedule to about 300 responses increased both pause duration and running response rate and also modified the pattern of responding from that obtained under the fixed-interval schedule. Higher values of the adjusting fixed ratio generally decreased pause duration and running response rate and also disrupted responding. Interreinforcement time under the conjunctive schedule was increased substantially when the adjusting fixed-ratio size exceeded 300 responses.     

Contrast effects in multiple fixed-interval reinforcement schedules

Pigeons were exposed to a multiple fixed-interval one-minute fixed-interval three-minute schedule of reinforcement following training on either a multiple fixed-interval one-minute fixed-interval one-minute schedule or a multiple fixed-interval three-minute fixed-interval three-minute schedule. For all birds, large negative local contrast effects developed during the first of four three-minute intervals in a component; response rate was depressed and postreinforcement pause lengthened in this interval. Positive local contrast effects were evident during the first of 12 one-minute intervals in a component for five of six birds; at asymptote, the pause was very short and response rate slightly elevated during this interval. Overall positive contrast was generally transient and varied considerably across subjects, while overall negative contrast effects, if they occurred, appeared only after a large number of sessions.     

Neurochemical changes correlated with behavior maintained under fixed-interval and fixed-ratio schedules of reinforcement.

Key pecking of 4 pigeons was maintained under a multiple 3-min fixed-interval, 30-response fixed-ratio schedule of food presentation. Only one schedule was in effect during an experimental session, and each was correlated with a different keylight stimulus and location (left vs. right). The different schedule components alternated across days or weeks. Cerebrospinal fluid was collected from chronically implanted intracerebroventricular cannulae following sessions with the different schedules, as well as following sessions in which reinforcement was withheld (extinction), when response-independent food was delivered, and when the experimental chamber was dark and there were no scheduled events. Metabolites of the neurotransmitters serotonin, norepinephrine, and dopamine were assayed in cerebrospinal fluid using high-performance liquid chromatography with electrochemical detection. Compared to the fixed-ratio condition, responding maintained under the fixed-interval schedule resulted in consistently higher levels of the serotonin metabolite 5-hydroxyindoleacetic acid and of the dopamine metabolite homovanillic acid in all pigeons. Levels of 3-methoxy-4-hydroxyphenylethylene glycol, a metabolite of norepinephrine, and dihydroxyphenylacetic acid, another dopamine metabolite, were also higher in 3 of the 4 pigeons following exposure to the fixed-interval schedules when compared to levels of these metabolites after exposure to the fixed-ratio schedule. Extinction of fixed-ratio responding resulted in large increases in 5-hydroxyindoleacetic acid compared to levels of this metabolite under the fixed-ratio schedule, whereas this serotonin metabolite decreased during extinction of responding under the fixed-interval schedule. Control procedures suggested that the neurochemical changes were not related to the rate of responding but were a function of the specific experimental conditions. Distinctive neurochemical changes that accompany schedule-controlled responding show the sensitivity of the neurochemical environment to behavioral contingencies and demonstrate further the profound impact that such contingencies have on biobehavioral processes.     

Oral self-administration of pentobarbital by rhesus monkeys: relative reinforcing effects under concurrent fixed-ratio schedules.

During daily 3-hr sessions, orally delivered pentobarbital solutions and water, or two separate pentobarbital solutions, were concurrently available to rhesus monkeys according to fixed-ratio schedules of mouth contacts with a spout. First water, and then each of four "comparison-concentration" pentobarbital solutions (0.0625, 0.25, 1, and 4 mg/mL), was successively available from one spout for a block of sessions under a fixed-ratio-64 (three monkeys) or fixed-ratio-16 (one monkey) schedule. Under an identically sized fixed-ratio schedule, deliveries of a "standard-concentration" pentobarbital solution were concurrently available from a second spout. The concentration of the standard solution remained unchanged throughout testing of the series of comparison solutions. Each of three pentobarbital concentrations (4, 1, and 0.25 mg/mL) in turn served as the standard concentration. Within each pair of concurrently available solutions, the higher drug concentration maintained more behavior than the lower concentration. Thus when monkeys were provided with concurrent access to different pentobarbital concentrations, relative reinforcing effects were directly related to drug concentration. Further, the amount of behavior maintained by a particular drug concentration was dependent on the concentration of the concurrently available drug solution. Thus, the relative effectiveness of a reinforcer in maintaining behavior is a function of both the reinforcer's magnitude and the availability of alternative reinforcers in the environment.     

The effects of brief-stimulus presentations in fixed-ratio second-order schedules

Pigeons' responses were reinforced according to a three-component multiple schedule. In Component 1, key pecks produced food according to a fixed-ratio second-order schedule with fixed-ratio units. Here, a fixed number of fixed-ratio units produced food, and the brief stimulus terminating each unit also accompanied food. Responses in Component 2 produced food on an identical schedule except that the brief stimulus was not paired with food. Component 3 contained a simple fixed-ratio schedule whose response requirement equaled that of Components 1 and 2. Across conditions the size of the fixed-ratio unit (five, ten, twenty, forty, and eighty responses) and the total number of responses per reinforcement were parametrically manipulated. The highest response rates and shortest preratio pauses were observed in Component 3 (no brief stimulus). The lowest rates and longest pauses were found in the component with paired brief-stimulus presentations, indicating that the food-paired brief stimulus suppressed responding. The suppressive effects were greatest when the fixed-ratio units were small (e.g., fixed-ratio 5) and the total fixed-ratio requirement was large (e.g., fixed-ratio 160). Under no conditions did the paired brief stimulus facilitate responding. The nonpaired brief stimulus also suppressed responding but to a lesser extent. The suppressive effects of nonpaired brief stimuli were greatest when the fixed-ratio units were small and the total response requirement was large. These data suggest that the suppressive effects of the brief stimuli may have masked the conditioned-reinforcing effects reported in other studies, and that conditions that maximize suppression in second-order schedules involve the use of fixed-ratio schedule units and the presentation of many brief stimuli per reinforcer.