Ratio requirement and reinforcer effects in concurrent fixed-interval fixed-ratio schedules

The fixed-ratio requirement was varied in concurrent fixed-interval fixed-ratio schedules. Fixed-interval responding was reinforced by food. In different phases, fixed-ratio responding was reinforced by food or water. There was a direct relation between the ratio requirement and interval response rates when both responses were reinforced with food, but essentially no relation when the reinforcers were different. The role of reinforcers in concurrent schedules merits detailed study.     

Ratio size and cocaine concentration effects on oral cocaine-reinforced behavior.

Monkeys were given a choice between cocaine solutions and water under concurrent fixed-ratio reinforcement schedules. The operant response was spout contact. Six rhesus monkeys served as subjects. The cocaine concentration was varied from 0.0125 to 0.8 mg/ml, and the fixed-ratio value was varied from 8 to 128. Cocaine maintained higher response rates than did water over a wide range of conditions. Response rate and number of cocaine deliveries per session were inverted U-shaped functions of concentration. These functions were shifted to the right as the fixed ratio was increased. The number of cocaine deliveries was more persistent as fixed-ratio value was increased when the unit dose was larger rather than smaller. Cocaine consumption was analyzed as a function of unit price (fixed-ratio value divided by cocaine concentration), and unit price accounted for between 77% and 92% of the variance in cocaine consumption for individual monkeys. The current data support the claim that a drug's reinforcing effects increase directly with dose and underscore the need to gather parametric data when examining the effects of experimental manipulations on a drug-reinforced baseline.     

Ratio responding as a function of concurrent avoidance schedules, yoked shocks, and ratio value

Fixed-ratio food-reinforced responding in rats was studied alone and with concurrent shock avoidance or with concurrent response-independent shocks matched to those that occurred in the avoidance condition. Under each condition, fixed-ratio size was increased over successive daily sessions. Fixed-ratio response rate generally passed through a maximum as a function of fixed-ratio size. Decreased fixed-ratio responding at values beyond the maximum occurred when (1) the time to complete a fixed ratio approximated the response-shock interval of the avoidance schedule, (2) the shock rate increased, and/or (3) the ratio requirements were so high that ratio strain occurred. Avoidance rates decreased slightly as fixed-ratio size increased.     

Altering the proportion of components in a mixed fixed-ratio schedule

Pigeons were trained under a schedule consisting of a number of fixed-ratio 100 components followed by a single fixed-ratio 10 component. The proportion of fixed-ratio 100 to fixed-ratio 10 components was varied according to several ascending and descending series within the range of 99:1 to 1:1. When this proportion was reduced to about 20:1 and below, the pause following each fixed-ratio 100 gradually decreased in length. Primes, a burst of responses at the start of the fixed-ratio 100 component, increased in frequency, and then decreased when the proportion became extremely low. Also, when the relative frequency of fixed-ratio 10 components was very high, primes were seldom observed in the first fixed-ratio 100 component following a fixed-ratio 10 component, but were distributed evenly throughout the remaining fixed-ratio 100 components.     

The effects of number of responses on pause length with temporal variables controlled

A change in the size of a fixed-ratio schedule involves a simultaneous change in number of responses, in time to complete the ratio (work time), and in the interval between successive reinforcements (interreinforcement interval). Previous studies have suggested the importance of work time and the interreinforcement interval in controlling the length of the post-reinforcement pause. The present study sought to determine whether number of responses is also a significant factor. Pigeons were trained on a multiple fixed-ratio x fixed-ratio 2 plus timeout schedule in which the size of the fixed-ratio x was manipulated. When the work times (Experiment I) or interreinforcement intervals (Experiment II) were equated for the two components, the pause before the fixed-ratio x was longer than the pause before the fixed-ratio 2 plus timeout. As fixed-ratio x size increased, the relative difference in the lengths of the two types of pauses also increased. Because the fixed-ratio x component contained a larger number of responses than the fixed-ratio 2 plus timeout component, the relatively longer pause preceding the fixed-ratio x indicates that number of responses played a significant role in determining the length of the post-reinforcement pause.     

Effects of ethanol on multiple fixed-interval fixed-ratio schedule performances: dynamic interactions at different fixed-ratio values.

Key pecking by three pigeons was maintained under a multiple fixed-interval fixed-ratio schedule of food presentation. The fixed-interval value remained at 3 minutes, while the fixed-ratio size was increased systematically in 30-response increments from 30 to either 120 (two pigeons) or 150 (one pigeon). At least two lower fixed-ratio values were also redetermined. The effects of ethanol (5 to 2.5 g/kg) were assessed at each of the different schedule parameters. Both overall and running response rates under the fixed-ratio schedule decreased with increases in the size of the fixed-ratio schedule; pause duration under the fixed-ratio schedule was directly related to increases in fixed-ratio size. Overall and running rates of responding under the fixed-interval schedule changed little with increases in the size of the fixed-ratio schedule. Despite the relative invariance of fixed-interval responding across the different fixed-ratio values, the effects of ethanol on responding under the fixed-interval schedule differed depending on the size of the fixed-ratio schedule. Greater increases occurred in both overall and in lower local rates of responding under the fixed-interval schedule when the fixed-ratio value was 120 or 150. The effects of ethanol on responding under the fixed-ratio schedule also depended on the size of the fixed ratio. Increases in responding under the fixed-ratio schedule were typically greater at the higher fixed-ratio values where response rates were lower. When the effects of ethanol were redetermined at the lower fixed-ratio parameter values, rates and patterns of responding were comparable to those obtained initially. However, the dose-effect curves for responding under both fixed-ratio and fixed-interval schedules were shifted up and to the right of those determined during the ascending series. The effects of ethanol can depend on rate or responding, behavioral history, and the context in which behavior occurs.     

Temporal patterns of responding in small fixed-ratio schedules

Pigeons were exposed to an ascending series of small fixed-ratio schedules from fixed-ratio 1 to 7. Two of those pigeons were later placed on a fixed-ratio 30 schedule. The two primary dependent variables were the postreinforcement pause and the interresponse time. Changes in these variables under small fixed ratios were sometimes opposite to changes reported with large fixed ratios. For example, postreinforcement pauses decreased in length as the fixed-ratio requirement increased from fixed-ratio 1 to fixed-ratio 3. Also, the interresponse times early in the small fixed-ratio schedule were shorter than those immediately preceding reinforcement. These findings question the role of interresponse-time reinforcement in determining temporal patterns of responding under small fixed-ratio schedules. They also suggest that there may be a limited region in which the independent variable, fixed-ratio size, does not operate as previously described.     

The effects of brief-stimulus presentations in fixed-ratio second-order schedules

Pigeons' responses were reinforced according to a three-component multiple schedule. In Component 1, key pecks produced food according to a fixed-ratio second-order schedule with fixed-ratio units. Here, a fixed number of fixed-ratio units produced food, and the brief stimulus terminating each unit also accompanied food. Responses in Component 2 produced food on an identical schedule except that the brief stimulus was not paired with food. Component 3 contained a simple fixed-ratio schedule whose response requirement equaled that of Components 1 and 2. Across conditions the size of the fixed-ratio unit (five, ten, twenty, forty, and eighty responses) and the total number of responses per reinforcement were parametrically manipulated. The highest response rates and shortest preratio pauses were observed in Component 3 (no brief stimulus). The lowest rates and longest pauses were found in the component with paired brief-stimulus presentations, indicating that the food-paired brief stimulus suppressed responding. The suppressive effects were greatest when the fixed-ratio units were small (e.g., fixed-ratio 5) and the total fixed-ratio requirement was large (e.g., fixed-ratio 160). Under no conditions did the paired brief stimulus facilitate responding. The nonpaired brief stimulus also suppressed responding but to a lesser extent. The suppressive effects of nonpaired brief stimuli were greatest when the fixed-ratio units were small and the total response requirement was large. These data suggest that the suppressive effects of the brief stimuli may have masked the conditioned-reinforcing effects reported in other studies, and that conditions that maximize suppression in second-order schedules involve the use of fixed-ratio schedule units and the presentation of many brief stimuli per reinforcer.     

Pause relationships in multiple and chained fixed-ratio schedules

On a multiple fixed-ratio 10 fixed-ratio 100 schedule, pigeons pause for relatively long periods of time before the fixed-ratio 100 schedule. Only a short pause occurs before the fixed-ratio 10 schedule. A chain fixed-ratio 10 fixed-ratio 100 schedule produces the reverse pattern, i.e., a short pause before the fixed-ratio 100 schedule and a long pause before the fixed-ratio 10 schedule. Procedurally, the only difference between the two schedules is that the fixed-ratio 10 component is always terminated by some unconditioned reinforcer in the multiple schedule but never in the chained schedule. In the present experiment, the percentage of fixed-ratio 10 components which included reinforcement was gradually decreased for birds on the multiple schedule and gradually increased for birds on the chained schedule. It was found that percentage reinforcement within the fixed-ratio 10 component was inversely related to the duration of the pause before the fixed-ratio 10 component and directly related to the duration of the pause before the fixed-ratio 100 component. Thus, the relative rate of reinforcement paired with a particular stimulus was seen to be an important factor in determining response latency to that stimulus.     

Effects of methadone on alternative fixed-ratio fixed-interval performance: latent influences on schedule-controlled responding.

Effects of methadone on pigeons' key pecking were examined under four conditions selected to analyze the control of behavior under alternative fixed-ratio fixed-interval schedules. In Condition 1, pigeons pecked under one of three different alternative schedules (alternative fixed-ratio 50 fixed-interval 90 s, alternative fixed-ratio 75 fixed-interval 90 s and alternative fixed-ratio 200 fixed-interval 90 s) each week. In Condition 2, fixed-ratio 50 or fixed-ratio 75 schedules were in effect during baseline sessions, and alternative fixed-ratio 50 fixed-interval 90-s or alternative fixed-ratio 75 fixed-interval 90-s schedules were in effect during sessions in which methadone was administered. In Condition 3, effects of methadone on key pecking maintained under fixed-ratio 50 and fixed-ratio 75 schedules were examined, whereas in Condition 4 the effects of methadone on key pecking under a fixed-interval 90-s schedule as well as fixed-ratio 50 and fixed-ratio 75 schedules were investigated. Control by the fixed-interval contingency was assessed by computing the proportion of total session reinforcers delivered under the fixed-interval schedule. Methadone administration (0.5-4.0 mg/kg) shifted the predominant source of schedule control under the alternative schedule from the fixed-ratio schedule to the fixed-interval contingency. This shift was dependent on methadone dose and fixed-ratio size. Control by the fixed-interval contingency was greatest following extensive exposure to the interval component embedded within the alternative schedule (Condition 1), but was apparent to a lesser degree with even very limited exposure to the alternative fixed-ratio fixed-interval schedule (Condition 2). Interreinforcement intervals comparable to those under fixed-interval schedule were not observed under the fixed-ratio schedules presented alone (Condition 3). Repeated exposure to the fixed-interval contingency outside the context of the alternative fixed-ratio fixed-interval schedule did not engender performance changes under a fixed-ratio schedule which would mimic those of increased fixed-interval contingency control (Condition 4). These data suggest that drug administration can be used to unmask the influence of contingencies that are latent under baseline conditions and reveal influences of both past and present environmental variables.     

Schedule control of the vocal behavior of Cebus monkeys

The vocal behavior of three Cebus monkeys was maintained by fixed-ratio schedules of response dependent reinforcement at values between fixed-ratio 1 and fixed-ratio 15. In one monkey that was exposed to variable-interval, fixed-interval, and conjunctive fixed-ratio fixed-interval schedules of reinforcement, vocal responding occurred at a low rate, but schedule-appropriate patterns were maintained. The rates and patterns of responding engendered indicated that the vocal operant can be brought under schedule control in the monkey by the use of response-dependent reinforcement.     

Fixed-ratio discrimination: effects of intermittent reinforcement

Four pigeons had discrimination training that required the choice of a left side-key after completing a fixed-ratio 10 on the center key, and a right side-key choice after fixed-ratio 20. Correct choices were reinforced on various fixed-interval, fixed-ratio, random-interval, and random-ratio schedules. When performance was examined across successive 15-second intervals (fixed-interval and fixed-ratio schedules) accuracy was high in the first 15-second interval, decreased in one or several of the next 15-second intervals, and then increased again as reinforcement was approached. When performance was examined across correct trials on fixed-interval and fixed-ratio schedules, accuracy was lowest immediately after reinforcement, followed by a systematic increase in accuracy as the number of correct choices increased. These patterns were due primarily to errors on fixed-ratio 20 trials. Systematic accuracy patterns did not occur on random-interval or random-ratio schedules. The results indicate that when choice patterns differed on fixed-interval and fixed-ratio schedules, the differences were due to the method of data analysis.     

Aggression during the fixed-ratio and extinction components of a multiple schedule of reinforcement

Pigeons were trained to key peck for food on multiple reinforcement schedules including components of continuous and fixed-ratio reinforcement and extinction. At the end of the chamber opposite the response key was a restrained target pigeon. The target restraining equipment was designed to record automatically blows struck against the target. When the experimental pigeons were paired with restrained target pigeons they attacked the target. Attack occurred during extinction after both continuous and fixed-ratio reinforcement. Attack also occurred occasionally during fixed-ratio 25 and fixed-ratio 40 and frequently during fixed-ratio 60 and fixed-ratio 120. No attack occurred during fixed-ratio 15 and continuous reinforcement. After a history of stable responding without a target bird present, the introduction of a target bird resulted in severely strained key-peck responding characterized by long periods of neither key pecking nor aggressing.     

Conjunctive schedules of reinforcement: III. A fixed-interval adjusting fixed-ratio schedule

Key pecking of three pigeons was studied under a conjunctive schedule that specified both a fixed-interval and an adjusting fixed-ratio requirement. The fixed-interval schedule was 6 min for one pigeon and 3 min for the other two. The size of the ratio requirement was determined within each cycle of the fixed interval by the duration of the pause before responding began. The fixed-ratio value was at maximum at the start of each fixed interval and decreased linearly until the first response occurred (adjusting fixed-ratio schedule). A peck produced food when the number of responses remaining on the fixed-ratio schedule was completed and when the fixed interval had elapsed. If no response occurred during the interval, the fixed-ratio requirement decreased to one and a single response after the interval elapsed produced food. The initial value of the adjusting fixed-ratio schedule was studied over a range of 0 to 900. Increases in the adjusting fixed-ratio schedule to about 300 responses increased both pause duration and running response rate and also modified the pattern of responding from that obtained under the fixed-interval schedule. Higher values of the adjusting fixed ratio generally decreased pause duration and running response rate and also disrupted responding. Interreinforcement time under the conjunctive schedule was increased substantially when the adjusting fixed-ratio size exceeded 300 responses.     

Second-order schedules with fixed-ratio components: variation of component size

Key pecking by pigeons was reinforced with food under second-order schedules with fixed-ratio units. A constant total number of key pecks was required for reinforcement under each condition, but the size and, inversely, number of fixed-ratio components were varied. The total response requirement of 256 pecks was divided into fixed-ratio units of 128, 64, 32, 8, and 2 responses. A brief stimulus, which always preceded food reinforcement, was presented upon completion of each fixed-ratio unit. Under most conditions, the pattern of within-unit responding was typical of that under simple fixed-ratio schedules. Overall response rate was an inverted U-shaped function of component size. That is, response rates were highest under moderate sized units (fixed ratio 128 and 64). This relationship is consistent with previous determinations of rate as a function of fixed-ratio value for simple fixed-ratio schedules.     

Second-order schedules of token reinforcement with pigeons: effects of fixed- and variable-ratio exchange schedules

Pigeons' key pecks produced food under second-order schedules of token reinforcement, with light-emitting diodes serving as token reinforcers. In Experiment 1, tokens were earned according to a fixed-ratio 50 schedule and were exchanged for food according to either fixed-ratio or variable-ratio exchange schedules, with schedule type varied across conditions. In Experiment 2, schedule type was varied within sessions using a multiple schedule. In one component, tokens were earned according to a fixed-ratio 50 schedule and exchanged according to a variable-ratio schedule. In the other component, tokens were earned according to a variable-ratio 50 schedule and exchanged according to a fixed-ratio schedule. In both experiments, the number of responses per exchange was varied parametrically across conditions, ranging from 50 to 400 responses. Response rates decreased systematically with increases in the fixed-ratio exchange schedules, but were much less affected by changes in the variable-ratio exchange schedules. Response rates were consistently higher under variable-ratio exchange schedules than tinder comparable fixed-ratio exchange schedules, especially at higher exchange ratios. These response-rate differences were due both to greater pre-ratio pausing and to lower local rates tinder the fixed-ratio exchange schedules. Local response rates increased with proximity to food under the higher fixed-ratio exchange schedules, indicative of discriminative control by the tokens.     

Modifying drug-reinforced behavior by altering the economic conditions of the drug and a nondrug reinforcer.

Six rhesus monkeys were trained to self-administer orally delivered phencyclidine (0.25 mg/mL) and saccharin (0.03% wt/vol) under concurrent fixed-ratio 16 schedules. In Condition 1 the fixed-ratio requirement for phencyclidine was changed from 16 to 4, 8, 16, 32, 64, 128 and 16 while the fixed-ratio requirement for saccharin deliveries remained constant at 16. In Condition 2 the fixed-ratio value for saccharin was systematically altered while the fixed-ratio requirement for phencyclidine remained at 16, and in Condition 3 the fixed-ratio requirements for both phencyclidine and saccharin were altered simultaneously. Water was then substituted for saccharin, and the series of fixed-ratio manipulations was replicated. The phencyclidine concentration was reduced to 0.125 mg/mL and Conditions 1 and 3 were repeated. When the fixed-ratio requirement for phencyclidine was increased and the fixed-ratio requirement for saccharin or water remained fixed at 16, phencyclidine deliveries decreased when saccharin (vs. water) was concurrently available. The magnitude of the decrease ranged from 20% to 90% (of the concurrent water condition) as the fixed-ratio requirement for phencyclidine increased from 4 to 128. When the fixed-ratio requirement for phencyclidine remained at 16 and the fixed-ratio requirements for concurrent saccharin or water varied between 4 and 128, phencyclidine deliveries decreased by 30% to 40% due to the concurrent availability of saccharin (vs. water). This decrease occurred only at the three lowest fixed-ratio values when saccharin intake was relatively high. When the fixed-ratio requirements for both phencyclidine and concurrent saccharin or water were varied simultaneously, phencyclidine deliveries were reduced from 20% to 45% when saccharin (vs. water) was concurrently present. There was little effect of reducing the phencyclidine concentration when the data were analyzed in terms of unit price (responses per milligram). Thus, changes in the fixed-ratio requirement or drug concentration were functionally similar, and unit price of phencyclidine was the variable that was influenced by the presence of concurrent saccharin. These data indicate that drug-reinforced behavior is substantially reduced when the environment is enriched with an alternative nondrug reinforcer. The economic context in which these substances are presented is an important determinant of drug-reinforced behavior.     

Strategies of schedule preference in chimpanzees

Two chimpanzees were required to choose between a fixed-ratio schedule and a progressive-ratio schedule which increased in response requirement by 20 responses each time it was chosen. Each choice of the fixed ratio reset the progressive ratio to its minimum value. The fixed-ratio requirement was varied from 40 to 1000 responses. The subjects' preferences for the progressive-ratio schedule varied as a function of the magnitude of the fixed-ratio requirement. An analysis of the preference data indicated that the animals tended to minimize reinforcement cost rather than match the progressive-ratio requirement to the fixed-ratio requirement. In a second experiment, selection of the fixed ratio did not reset the progressive-ratio requirement to its minimum value. In this case, the animals matched the progressive-ratio requirement to the fixed-ratio requirement. A model based on reinforcement cost is presented which permits accurate prediction of preferences between fixed and progressively increasing ratio schedules.     

Demand for food on fixed-ratio schedules as a function of the quality of concurrently available reinforcement

Six rats lever pressed for food on concurrent fixed-ratio schedules, in a two-compartment chamber. In one compartment, mixed diet pellets were delivered on fixed-ratio schedules of 1, 6, 11, and 16; in the other, either no food was delivered, or sucrose or mixed diet pellets were delivered on fixed-ratio 8. The number of pellets obtained in the first compartment declined as a function of fixed-ratio size in that compartment in all three conditions, but the decline was greatest overall with mixed diet pellets concurrently available in the other compartment, and least with no food concurrently available. The result is discussed in terms of economic demand theory, and is consistent with the prediction that elasticity of demand for a commodity (defined in operant terms as the ratio of the proportionate change in number of reinforcements per session to the proportionate change in fixed-ratio size) is greater the more substitutable for that commodity are any concurrently available commodities.     

Effects of chlorpromazine on fixed-ratio responding: modification by fixed-interval discriminative stimuli.

Effects of chlorpromazine (1 to 100 mg/kg) were assessed on two pigeons' responding under various modifications of a multiple schedule of food delivery. During a fixed-interval component, the first response after 5 min produced food; during the subsequent, fixed-ratio component, the 30th response produced food. Modifications of the schedule entailed changes in stimulus conditions imposed during the fixed-ratio component that did not systematically alter characteristics of performance under non-drug conditions. In the first phase of the experiment, distinctive visual stimuli were correlated with each schedule component (conventional multiple schedule); chlorpromazine produced small decreases in fixed-ratio responding (20% at 30 mg/kg). When each response during the fixed-ratio component produced the stimulus correlated with the fixed-interval schedule (fixed-interval discriminative stimulus) for 1.2 s, effects of chlorpromazine were not different from those under the conventional multiple schedule. Chlorpromazine produced greater decreases in fixed-ratio responding (55% at 30 mg/kg) when either the first response of each fixed ratio changed the stimulus correlated with the fixed-ratio schedule to the fixed-interval discriminative stimulus for the remainder of the fixed-ratio component, or when the fixed-interval discriminative stimulus was presented independently of responding according to a matched temporal sequence. When the fixed-interval discriminative stimulus was present continuously during the fixed-ratio component (mixed schedule), chlorpromazine produced even more substantial decreases in fixed-ratio responding (greater than 80% at 30 mg/kg). Effects of chlorpromazine on fixed-interval responding were also modified by the schedules of fixed-interval discriminative stimulus presentation. The effects of chlorpromazine were a joint function of the stimuli prevailing during the multiple schedule and the degree to which responding influenced these stimuli.