Progressive-ratio schedules: effects of later schedule requirements on earlier performances

Four rats were studied with variants of a progressive-ratio schedule with a step size of 6 in which different terminal components followed completion of the 20th ratio: (a) a reversal of the progression, (b) a fixed-ratio 6 schedule, or (c) extinction. Responding in the progressive-ratio components of these schedules was compared to performances under conventional progressive-ratio baselines. Under baseline conditions, postreinforcement pauses increased exponentially as a function of increasing ratio size, whereas running rates showed modest declines. The procedure of linking the progressive-ratio schedule to the reversed progression or to the fixed-ratio component resulted in decreased pausing. Linking the progressive-ratio schedule to the extinction component had the opposite effect, that of producing weakened progressive-ratio performances as evidenced by increased pausing. Subjects whose responses were reinforced on half of the ratios also showed exponential increases; however, pauses were substantially shorter following ratios on which the reinforcer was omitted. The results suggested that progressive-ratio pausing reflects the influence of remote as well as local contingencies.     

Strategies of schedule preference in chimpanzees

Two chimpanzees were required to choose between a fixed-ratio schedule and a progressive-ratio schedule which increased in response requirement by 20 responses each time it was chosen. Each choice of the fixed ratio reset the progressive ratio to its minimum value. The fixed-ratio requirement was varied from 40 to 1000 responses. The subjects' preferences for the progressive-ratio schedule varied as a function of the magnitude of the fixed-ratio requirement. An analysis of the preference data indicated that the animals tended to minimize reinforcement cost rather than match the progressive-ratio requirement to the fixed-ratio requirement. In a second experiment, selection of the fixed ratio did not reset the progressive-ratio requirement to its minimum value. In this case, the animals matched the progressive-ratio requirement to the fixed-ratio requirement. A model based on reinforcement cost is presented which permits accurate prediction of preferences between fixed and progressively increasing ratio schedules.     

Cocaine and food as reinforcers: effects of reinforcer magnitude and response requirement under second-order fixed-ratio and progressive-ratio schedules.

Reinforcer magnitude and fixed-ratio requirement were varied under two second-order schedules. Under one, the first sequence of a fixed number of responses completed after the lapse of a 10-min fixed interval produced reinforcement. Under the second, a second-order progressive-ratio schedule, the fixed number of responses increased after each reinforcement. Either cocaine (0 to 300 micrograms/kg/inj) or food (0 to 5,700 mg/delivery) reinforcers were delivered. Under some conditions, a 2-s illumination of stimulus lights occurred on completion of each ratio sequence. Under the second-order schedule, as cocaine dose or amount of food increased, rates of responding increased; at the highest values, rates of responding decreased. Increases in the ratio requirement from 10 to 170 responses minimally decreased overall response rates. Under the second-order progressive-ratio schedule, increases in dose of cocaine or amount of food increased rates of responding; at the highest amounts of food, rates of responding decreased but response rates at the highest dose of cocaine remained relatively high. The highest ratio requirement that was completed (breaking point) depended on the dose of cocaine but was less dependent on the amount of food. Removing brief-stimulus presentations had a greater effect on completion of ratio requirements with cocaine compared to food.     

Effects of anorectic drugs on food intake under progressive-ratio and free-access conditions in rats

The effects of two anorectic drugs, dexfenfluramine and phentermine, on food intake under different food-access conditions were examined. Experiment 1 compared the effects of these drugs on food intake under a progressive-ratio (PR) schedule and free-access conditions. Dexfenfluramine decreased food intake under both conditions, but the doses required to decrease intake under free-access conditions were higher than those required to reduce intake under the PR condition. Intermediate doses of phentermine sometimes increased breaking points, and higher doses decreased them. Phentermine decreased food intake at the same doses under both access conditions. Thus the potency of dexfenfluramine, but not phentermine, to decrease food-maintained behavior depended upon the food-access condition. Experiment 2 used a novel mixed progressive-ratio schedule of food delivery to study the duration of drug effects. Sessions consisted of five components separated by 3-hr timeouts. The ratio requirement reset at the beginning of each component and a new breaking point was obtained. Both dexfenfluramine and phentermine dose-dependently decreased breaking points early in the session. In some rats, compensatory increases in breaking point were observed. That is, breaking points later in the session increased over control levels, resulting in no change in the total number of food pellets earned for the session compared to control. The present findings suggest that the effects of some anorectic drugs depend upon the access conditions for food; increasing the effort to obtain food may enhance their ability to decrease food-maintained behavior.     

Enhancement of progressive-ratio performance by chlordiazepoxide and phenobarbital

The key pecking of two pigeons was reinforced with food on a progressive-ratio schedule, which required an increasing number of responses for each successive reinforcement: 8, 16, 24, 32, etc. When the subject failed to complete the next ratio in the sequence within 60 min, the session terminated. The number of responses in the final completed ratio was defined as the "breaking point". After the breaking point had stabilized (60 sessions), it served as a baseline to assess the effects of varying doses (5 to 80 mg/kg) of chlordiazepoxide and phenobarbital, administered intramuscularly 30 min before the sessions. Both drugs increased the breaking point. The dose-effect curves were inverted U-shaped, with maximum enhancement of performance occurring at 20 mg/kg for chlordiazepoxide and at 40 mg/kg for phenobarbital. A comparable enhancement was not obtained during a non-drug "probe" session, which was conducted after the subjects' body weights had been temporarily reduced from 80% to 70% of their free-feeding weights. The drug-induced enhancement of breaking point was related to the initial values of the performance and may represent a reduction in the aversiveness of the schedule.     

Effects of increment size and reinforcer volume on progressive ratio performance

The progressive ratio schedule requires the subject to emit an increasing number of responses for each successive reinforcement. Eventually, the response requirement becomes so large that the subject fails to respond for a period of 15 min and thereby terminates the session. This point is arbitrarily defined as the “breaking point” of the subject's performance. The measure is quantified in terms of the number of responses in the final completed (i.e., reinforced) ratio run of the session. Previous work has shown that this measure varies as a function of several motivational variables and may thus be useful as an index of reinforcement strength. The present study is an extension of that work. The subjects were four rats. In the first experiment, the effects of the size of the increment by which each ratio run increased were studied. In two additional experiments, the volume of a liquid reinforcer was varied using both large and small ratio increments. The results indicate that the number of responses in the final completed ratio run increases as a function of the size of the ratio increment. However, the number of reinforcements obtained by the animals per session declines sharply. When large ratio increments are used, the number of responses in the final ratio increases as a function of the volume of the reinforcer, but when small increments are used, progressive satiation results in a decline in performance with the larger volumes of liquid.     

Response persistence under ratio and interval reinforcement schedules

In Experiment 1, rats were exposed to progressive-ratio schedules of food reinforcement while other rats were exposed simultaneously to yoked-interval schedules that arranged equivalent interreinforcer intervals but required only a single response at the end of the interval for food delivery. In Experiment 2, a within-subject yoked-control procedure was employed in which pigeons were exposed to alternating sessions (one per day) of progressive-ratio schedules and yoked-interval schedules as described above. In both experiments, responding under the yoked-interval schedule persisted beyond the point at which responding under the progressive-ratio schedule had ceased. The progressive-ratio schedules controlled break-and-run distributions, and the yoked-interval schedules controlled more even distributions of responses in time. Response rates decreased and postreinforcement pauses increased over time within individual sessions under both schedules. The results suggest that responding maintained by interval schedules is more persistent than that maintained by ratio schedules. The limitations and implications of this conclusion are discussed in the context of other investigations of response strength and behavioral momentum.     

Human choice in "counterintuitive" situations: fixed- versus progressive-ratio schedules.

College undergraduates were given repeated opportunities to choose between a fixed-ratio and a progressive-ratio schedule of reinforcement. Completions of a progressive-ratio schedule produced points (exchangeable for money) and incremented that response requirement by 20 responses with each consecutive choice. In the reset condition, completion of a fixed ratio produced the same number of points and also reset the progressive ratio back to its initial value. In the no-reset condition, the progressive ratio continued to increase by increments of 20 throughout the session with each successive selection of this schedule, irrespective of fixed-ratio choices. Subjects' schedule choices were sensitive to parametric manipulations of the size of the fixed-ratio schedule and were consistent with predictions made on the basis of minimizing the number of responses emitted per point earned, which is a principle of most optimality theories. Also, the present results suggest that if data from human performances are to be compared with results for other species, humans should be exposed to schedules of reinforcement for long periods of time, as is commonly done with nonhuman subjects.     

A preliminary analysis of adaptive responding under open and closed economies

In the current investigation, we evaluated the effects of open and closed economies on the adaptive behavior of 2 individuals with developmental disabilities. Across both types of economy, progressive-ratio (PR) schedules were used in which the number of responses required to obtain reinforcement increased as the session progressed. In closed-economy sessions, participants were able to obtain reinforcement only through interaction with the PR schedule requirements (i.e., more work resulted in more reinforcer access). In open-economy sessions, participants obtained reinforcers by responding on the PR schedule and were given supplemental (free) access to the reinforcers after completion of the session. In general, more responding was associated with the closed economy.     

Reversal of preference under progressive-ratio schedules by punishment

A progressive-ratio reinforcement schedule, in which successive reinforcements required an additional 50 responses, was programmed on one key. A response on a second key reset the progressive-ratio schedule to the first step. Before punishment, all pigeons consistently reset the schedule after reinforcement on the first step, thereby minimizing the number of responses required for reinforcement. Punishment was a brief electric shock contingent upon each response on the reset key. The first effect of punishment was to change the frequency of extra responses on the reset key. Under higher intensities of punishment, the pigeons completed the advanced steps of the progressive-ratio schedule before resetting to the first step. Completions of advanced steps were accompanied by decreases in the overall rate of responding and the rate of reinforcement. When the punishment contingency was removed, the major features of pre-punishment performance were recovered.     

Pigeons' choices in situations of diminishing returns: fixed- versus progressive-ratio schedules.

In two different discrete-trial procedures, pigeons were faced with choices between fixed-ratio and progressive-ratio schedules. The latter schedules entail diminishing returns, a feature analogous to foraging situations in the wild. In the first condition (no reset), subjects chose between a progressive-ratio schedule that increased in increments of 20 throughout a session and a fixed-ratio schedule that was constant across blocks of sessions. The size of the fixed ratio was varied parametrically through an ascending and then a descending series. In the reset condition, the same fixed-ratio values were used, but each selection (and completion) of the fixed ratio reset the progressive-ratio schedule back to its minimal value. In the no-reset procedure, the pigeons tended to cease selecting the progressive ratio when it equaled or slightly exceeded the fixed-ratio value, whereas in reset, they chose the fixed ratio well in advance of that equality point. These results indicate sensitivity to molar as well as to molecular reinforcement rates, and those molar relationships are similar to predictions based on the marginal value theorem of optimal foraging theory (e.g., Charnov, 1976). However, although previous results with monkeys (Hineline & Sodetz, 1987) appeared to minimize responses per reinforcement, the present results corresponded more closely to predictions based on sums-of-reciprocals of distance from point of choice to each of the next four reinforcers. Results obtained by Hodos and Trumbule (1967) with chimpanzees in a similar procedure were intermediate between these two relationships. Variability of choices, as well as median choice points, differed between the reset and no-reset conditions.(ABSTRACT TRUNCATED AT 250 WORDS)     

Reinforcement magnitude and pausing on progressive-ratio schedules

Rats responded under progressive-ratio schedules for sweetened milk reinforcers; each session ended when responding ceased for 10 min. Experiment 1 varied the concentration of milk and the duration of postreinforcement timeouts. Postreinforcement pausing increased as a positively accelerated function of the size of the ratio, and the rate of increase was reduced as a function of concentration and by timeouts of 10 s or longer. Experiment 2 varied reinforcement magnitude within sessions (number of dipper operations per reinforcer) in conjunction with stimuli correlated with the upcoming magnitude. In the absence of discriminative stimuli, pausing was longer following a large reinforcer than following a small one. Pauses were reduced by a stimulus signaling a large upcoming reinforcer, particularly at the highest ratios, and the animals tended to quit responding when the past reinforcer was large and the stimulus signaled that the next one would be small. Results of both experiments revealed parallels between responding under progressive-ratio schedules and other schedules containing ratio contingencies. Relationships between pausing and magnitude suggest that ratio pausing is under the joint control of inhibitory properties of the past reinforcer and excitatory properties of stimuli correlated with the upcoming reinforcer, rather than under the exclusive control of either factor alone.     

Molar optimization versus delayed reinforcement as explanations of choice between fixed-ratio and progressive-ratio schedules.

In a discrete-trials procedure, pigeons chose between a fixed-ratio 81 schedule and a progressive-ratio schedule by making a single peck at the key correlated with one or the other of these schedules. The response requirement on the progressive-ratio schedule began at 1 and increased by 10 each time the progressive-ratio schedule was chosen. Each time the fixed-ratio schedule was chosen, the requirement on the progressive-ratio schedule was reset to 1 response. In conditions where there was no intertrial interval, subjects chose the progressive-ratio schedule for an average of about five consecutive trials (during which the response requirement increased to 41), and then chose the fixed-ratio schedule. This ratio was larger than that predicted by an optimality analysis that assumes that subjects respond in a pattern that minimizes the response-reinforcer ratio or one that assumes that subjects respond in a pattern that maximizes the overall rate of reinforcement. In conditions with a 25-s or 50-s intertrial interval, subjects chose the progressive-ratio schedule for an average of about eight consecutive trials before choosing the fixed-ratio schedule. This change in performance with the addition of an intertrial interval was also not predicted by an optimality analysis. On the other hand, the results were consistent with the theory that choice is determined by the delays to the reinforcers delivered on the present trial and on subsequent trials.     

Free operant avoidance in rats under increased nitrogen pressures.

Rats performed on a free operant avoidance schedule with a response-shock interval of 20 sec. and a shock-shock interval of 2 sec. Avoidance response rates increased and shock frequency decreased when the rats were exposed to elevated pressures of both air and a nitrogen-oxygen mixture in a hyperbaric chamber. Increases in response rates were related to raised partial pressures of nitrogen at 89.0 psi and 111.3 psi. Conditional probabilities of interresponse times indicated that increases in response rates were not due to disruption of temporal discrimination. Increased avoidance rates under pressure suggested direct excitatory effects of high pressures of nitrogen.     

Concurrent nonindependent fixed‐ratio schedules of alcohol self‐administration: Effects of schedule size on choice

Choice behavior was studied under concurrent nonindependent fixed‐ratio fixed‐ratio (nFR) schedules of reinforcement, as these schedules result in frequent changeover responses. With these schedules, responses on either operandum count toward the completion of the ratio requirements of both schedules. Five monkeys were subjects, and two pairs of liquid reinforcers were concurrently available: 16% (w/v) and 0% ethanol or 16% and 8% ethanol. For each pair of reinforcers, the nFR sizes were systematically altered across sessions while keeping the schedule size equal for both liquids. Responding varied as a function of reinforcer pair and nFR size. With the 16% and 0% pair, higher response rates were maintained by 16% and were an inverted U‐shape function of nFR size. With 16% and 8%, a greater number of responses initially occurred on the schedule that delivered 8% ethanol. However, as nFR size increased, preference reversed such that responses that delivered 16% ethanol were greater. When the nFR size was subsequently decreased, preference reverted back to 8%. Number of responses emitted per delivery was a dependent variable and, in behavioral economic terms, was the price paid for each liquid delivery. With 16% and 0%, changeover responses initially increased and then decreased as schedule size became larger. In contrast, with the 16% and 8% pair, changeover responses increased directly with schedule size. Responding under nFR schedules is sensitive to differences in reinforcer magnitude and demonstrates that relative reinforcing effects can change as a function of schedule size.     

Effects of reinforcement history on responding under progressive-ratio schedules of reinforcement.

The effects of experimental history on responding under a progressive-ratio schedule of reinforcement were examined. Sixteen pigeons were divided into four equal groups. Groups 1 to 3 were trained to peck a key for food under a fixed-ratio, variable-ratio, or differential-reinforcement-of-low-rate schedule of reinforcement. After training, these pigeons were shifted to a progressive-ratio schedule, later were shifted back to their original schedule (with decreased rates of reinforcement), and finally were returned to the progressive-ratio schedule. Pigeons in Group 4 (control) were maintained on the progressive-ratio schedule for the entire experiment. To test for potential "latent history" effects, pigeons responding under the progressive-ratio schedule were injected with d-amphetamine and given behavioral-momentum tests of prefeeding and extinction. Experimental histories affected responding in the immediate transition to the progressive-ratio schedule; response rates of pigeons with variable-ratio and fixed-ratio histories were higher than rates of pigeons with differential-reinforcement-of-low-rate and progressive-ratio-only histories. Pigeons with differential-reinforcement-of-low-rate histories, and to a lesser degree pigeons with variable-ratio and fixed-ratio histories, also had shorter postreinforcement pauses than pigeons with only a progressive-ratio history. No consistent long-term effects of prior contingencies on responding under the progressive-ratio schedule were evident. d-Amphetamine and resistance-to-change tests failed to reveal consistent latent history effects. The data suggest that history effects are sometimes transitory and not susceptible to latent influences.     

Variability of magnitude estimates: A timing theory analysis

Three procedures for magnitude estimation were investigated, and a sufficient number of responses were obtained to make reasonable estimates of both the mean and variance of the responses. The conventional magnitude estimate procedure, without a standard signal, appeared to produce the most sensible data. The best method of establishing the central tendency of the data appears to be the plot of the mean ratio of successive responses against the intensity ratio of the corresponding signal intensities. When this is done, the average response ratio increases roughly as a power function of the signal ratios. The coefficient of variation, σ/m, varies from about 0.1 for small signal ratios and increases to 0.3 at about 20 dB and greater signal separations. The distribution of response ratios appears to be reasonably well approximated by a beta distribution. The change in σ/m with signal ratio is suggestive of an attention mechanism in which the sample size depends on the location of the attention band. The ratio estimation procedure suffers badly from discrete number tendencies.     

Oral drug self-administration in rhesus monkeys: interactions between drug amount and fixed-ratio size.

During daily 3-hr sessions, 5 rhesus monkeys drank drug solutions and water that were concurrently available. The drug solutions were: 1 milligram per milliliter (mg/mL) pentobarbital (2 monkeys), 1 mg/mL pentobarbital plus 0.5% ethanol (1 monkey), 1 mg/mL pentobarbital plus 1% ethanol (1 monkey), and 8% ethanol (1 monkey). The drug solution and water were available under identical two-component tandem fixed-ratio continuous-reinforcement N schedules. Two variables were manipulated: the size of the fixed-ratio component and the number of liquid deliveries (N) in the second component. Deliveries of the drug solution maintained higher rates of responding than did deliveries of the drug vehicle, water. The number of drug deliveries per session increased with increases in the number of deliveries per fixed ratio and decreased with increases in fixed-ratio size. Analysis of the results in terms of the proportion of deliveries to responses showed that the number of drug deliveries per session was directly related to the size of this quotient. Finally, when fixed-ratio size was repeatedly doubled, the following orderly relationship emerged: The greater the number of available drug deliveries per fixed ratio, the less was the percent decrease in the number of fixed ratios completed per session. It was concluded that increases in the number of liquid deliveries per fixed ratio resulted in increases in reinforcing efficacy.