Pigeons' choices in situations of diminishing returns: fixed- versus progressive-ratio schedules.

In two different discrete-trial procedures, pigeons were faced with choices between fixed-ratio and progressive-ratio schedules. The latter schedules entail diminishing returns, a feature analogous to foraging situations in the wild. In the first condition (no reset), subjects chose between a progressive-ratio schedule that increased in increments of 20 throughout a session and a fixed-ratio schedule that was constant across blocks of sessions. The size of the fixed ratio was varied parametrically through an ascending and then a descending series. In the reset condition, the same fixed-ratio values were used, but each selection (and completion) of the fixed ratio reset the progressive-ratio schedule back to its minimal value. In the no-reset procedure, the pigeons tended to cease selecting the progressive ratio when it equaled or slightly exceeded the fixed-ratio value, whereas in reset, they chose the fixed ratio well in advance of that equality point. These results indicate sensitivity to molar as well as to molecular reinforcement rates, and those molar relationships are similar to predictions based on the marginal value theorem of optimal foraging theory (e.g., Charnov, 1976). However, although previous results with monkeys (Hineline & Sodetz, 1987) appeared to minimize responses per reinforcement, the present results corresponded more closely to predictions based on sums-of-reciprocals of distance from point of choice to each of the next four reinforcers. Results obtained by Hodos and Trumbule (1967) with chimpanzees in a similar procedure were intermediate between these two relationships. Variability of choices, as well as median choice points, differed between the reset and no-reset conditions.(ABSTRACT TRUNCATED AT 250 WORDS)     

Evaluation of absolute and relative reinforcer value using progressive-ratio schedules

We evaluated behavior exhibited by individuals with developmental disabilities using progressive-ratio (PR) schedules. High- and low-preference stimuli were determined based on the results of a paired-stimulus preference assessment and were evaluated in subsequent reinforcer and PR assessments using concurrent and single schedules of presentation. In Experiment 1, results showed that for 2 of 3 participants, stimuli determined to be low-preference functioned as reinforcers when evaluated independent of high-preference stimuli. Further, the results from Experiment 2 showed that low-preference stimuli also functioned as reinforcers under gradually increasing PR requirements. Results suggest that for cases in which a high-preference stimulus is unavailable or impractical, the contingent delivery of relatively less preferred stimuli may maintain appropriate behavior, even as schedule requirements increase.     

Human choice in "counterintuitive" situations: fixed- versus progressive-ratio schedules.

College undergraduates were given repeated opportunities to choose between a fixed-ratio and a progressive-ratio schedule of reinforcement. Completions of a progressive-ratio schedule produced points (exchangeable for money) and incremented that response requirement by 20 responses with each consecutive choice. In the reset condition, completion of a fixed ratio produced the same number of points and also reset the progressive ratio back to its initial value. In the no-reset condition, the progressive ratio continued to increase by increments of 20 throughout the session with each successive selection of this schedule, irrespective of fixed-ratio choices. Subjects' schedule choices were sensitive to parametric manipulations of the size of the fixed-ratio schedule and were consistent with predictions made on the basis of minimizing the number of responses emitted per point earned, which is a principle of most optimality theories. Also, the present results suggest that if data from human performances are to be compared with results for other species, humans should be exposed to schedules of reinforcement for long periods of time, as is commonly done with nonhuman subjects.     

An evaluation of the value of choice with preschool children

The current study examined the reinforcing effects of choosing among alternatives in a four-part evaluation. In the first study, initial-link responses in a concurrent-chains arrangement resulted in access to terminal links in which the completion of an academic task resulted in (a) the choice of a reinforcer (choice), (b) the delivery of an identical reinforcer (no choice), or (c) no material reinforcer (control). Three patterns of responding emerged: persistent preference for choice (3 participants); initial preference for choice, which did not persist (2 participants); and preference for no choice (1 participant). Additional evaluations determined if preference for choice could be enhanced (Study 2) or established (Study 3) by including more stimuli from which to choose. Choice-link selections systematically increased for all participants when more items were available from which to choose. Study 4 identified the precise value of the opportunity to choose by progressively increasing the response requirement during the choice terminal links for 3 children and determining the point at which these children stopped selecting the choice link. All children continued to select the choice link even when the work required in the choice link was much greater than that arranged in the no-choice link.     

Progressive-ratio schedules: effects of later schedule requirements on earlier performances

Four rats were studied with variants of a progressive-ratio schedule with a step size of 6 in which different terminal components followed completion of the 20th ratio: (a) a reversal of the progression, (b) a fixed-ratio 6 schedule, or (c) extinction. Responding in the progressive-ratio components of these schedules was compared to performances under conventional progressive-ratio baselines. Under baseline conditions, postreinforcement pauses increased exponentially as a function of increasing ratio size, whereas running rates showed modest declines. The procedure of linking the progressive-ratio schedule to the reversed progression or to the fixed-ratio component resulted in decreased pausing. Linking the progressive-ratio schedule to the extinction component had the opposite effect, that of producing weakened progressive-ratio performances as evidenced by increased pausing. Subjects whose responses were reinforced on half of the ratios also showed exponential increases; however, pauses were substantially shorter following ratios on which the reinforcer was omitted. The results suggested that progressive-ratio pausing reflects the influence of remote as well as local contingencies.     

Second-order schedules of token reinforcement with pigeons: effects of fixed- and variable-ratio exchange schedules

Pigeons' key pecks produced food under second-order schedules of token reinforcement, with light-emitting diodes serving as token reinforcers. In Experiment 1, tokens were earned according to a fixed-ratio 50 schedule and were exchanged for food according to either fixed-ratio or variable-ratio exchange schedules, with schedule type varied across conditions. In Experiment 2, schedule type was varied within sessions using a multiple schedule. In one component, tokens were earned according to a fixed-ratio 50 schedule and exchanged according to a variable-ratio schedule. In the other component, tokens were earned according to a variable-ratio 50 schedule and exchanged according to a fixed-ratio schedule. In both experiments, the number of responses per exchange was varied parametrically across conditions, ranging from 50 to 400 responses. Response rates decreased systematically with increases in the fixed-ratio exchange schedules, but were much less affected by changes in the variable-ratio exchange schedules. Response rates were consistently higher under variable-ratio exchange schedules than tinder comparable fixed-ratio exchange schedules, especially at higher exchange ratios. These response-rate differences were due both to greater pre-ratio pausing and to lower local rates tinder the fixed-ratio exchange schedules. Local response rates increased with proximity to food under the higher fixed-ratio exchange schedules, indicative of discriminative control by the tokens.     

Determining preschoolers' preferences for choice-making opportunities: choice of task versus choice of consequence

Individuals may prefer contexts with the option to choose between 2 reinforcing stimuli or between 2 tasks relative to contexts in which others select the same events. We evaluated children's preferences for conditions characterized by (a) the opportunity to choose between tasks and (b) the opportunity to choose between putative reinforcers delivered following the completion of a task relative to no-choice and no-reinforcement control conditions. Three of 4 participants preferred the consequence-choice condition; the task-choice condition was no more preferred than the no-choice condition in any case.     

Molar optimization versus delayed reinforcement as explanations of choice between fixed-ratio and progressive-ratio schedules.

In a discrete-trials procedure, pigeons chose between a fixed-ratio 81 schedule and a progressive-ratio schedule by making a single peck at the key correlated with one or the other of these schedules. The response requirement on the progressive-ratio schedule began at 1 and increased by 10 each time the progressive-ratio schedule was chosen. Each time the fixed-ratio schedule was chosen, the requirement on the progressive-ratio schedule was reset to 1 response. In conditions where there was no intertrial interval, subjects chose the progressive-ratio schedule for an average of about five consecutive trials (during which the response requirement increased to 41), and then chose the fixed-ratio schedule. This ratio was larger than that predicted by an optimality analysis that assumes that subjects respond in a pattern that minimizes the response-reinforcer ratio or one that assumes that subjects respond in a pattern that maximizes the overall rate of reinforcement. In conditions with a 25-s or 50-s intertrial interval, subjects chose the progressive-ratio schedule for an average of about eight consecutive trials before choosing the fixed-ratio schedule. This change in performance with the addition of an intertrial interval was also not predicted by an optimality analysis. On the other hand, the results were consistent with the theory that choice is determined by the delays to the reinforcers delivered on the present trial and on subsequent trials.     

Preference for reinforcers under progressive- and fixed-ratio schedules: a comparison of single and concurrent arrangements

Progressive-ratio (PR) schedules were used to identify the break point (i.e., the last schedule value completed) for 2 reinforcers under single and concurrent schedules. After the respective break points were established, the same reinforcers were presented under concurrent fixed-ratio (FR) schedules that were yoked to the break points obtained with the PR schedules. Results suggested that the participants responded more for the high-preference item than for the low-preference item, regardless of the presentation arrangement (single or concurrent presentations). This pattern of responding was maintained when the reinforcers were presented under dissimilar FR schedules. The results suggest that responding for differentially preferred stimuli may vary as a function of differences in schedule requirements.     

A comparison of response patterns on fixed-, variable-, and random-ratio schedules

The behavior of individual pigeons on fixed-ratio, variable-ratio, and random-ratio schedules was examined. Within each type of ratio schedule the size of the ratio was varied in an irregular sequence. At various ratio sizes (5, 10, 40, 80) no differences were found among overall response rates (postreinforcement pause plus running response rate) as a function of ratio type. This similarity in overall response rates held despite noticeable differences in the microstructure of performance both within and across subjects; the primary performance difference on the three types of ratio schedules was the relatively longer postreinforcement pause duration on the fixed-ratio schedule. We concluded that the gross temporal characteristics of performance determined by the relative weightings of the postreinforcement pause and running response rate were primarily controlled by the type of ratio schedule (fixed, variable, or random), whereas the overall rate of responding was controlled by the size of the ratio.     

A comparison of token and tandem schedules of reinforcement on response patterns for adolescents with autism

Token schedules of reinforcement are ubiquitous in clinical settings, yet little research has thoroughly evaluated the effects of token schedules on responding in clinical settings. Basic research has shown token schedules of reinforcement produce lower response rates and larger pre‐ratio pauses compared to tandem schedules. The purpose of the current study was to determine whether the same effects are produced with adolescents with autism or related disorders. We examined response patterns under otherwise identical FR token and FR tandem schedules. Tokens suppressed responding for one participant only under high schedule values and for a second participant under common clinical schedule values; no difference in responding occurred between token and tandem schedules for two participants. These results support the systematic evaluation of token schedules of reinforcement in clinical settings. Additional applied research is needed on token schedules to further our understanding of the underlying mechanisms that contribute to the overall effectiveness of token economies.     

Effects of anorectic drugs on food intake under progressive-ratio and free-access conditions in rats

The effects of two anorectic drugs, dexfenfluramine and phentermine, on food intake under different food-access conditions were examined. Experiment 1 compared the effects of these drugs on food intake under a progressive-ratio (PR) schedule and free-access conditions. Dexfenfluramine decreased food intake under both conditions, but the doses required to decrease intake under free-access conditions were higher than those required to reduce intake under the PR condition. Intermediate doses of phentermine sometimes increased breaking points, and higher doses decreased them. Phentermine decreased food intake at the same doses under both access conditions. Thus the potency of dexfenfluramine, but not phentermine, to decrease food-maintained behavior depended upon the food-access condition. Experiment 2 used a novel mixed progressive-ratio schedule of food delivery to study the duration of drug effects. Sessions consisted of five components separated by 3-hr timeouts. The ratio requirement reset at the beginning of each component and a new breaking point was obtained. Both dexfenfluramine and phentermine dose-dependently decreased breaking points early in the session. In some rats, compensatory increases in breaking point were observed. That is, breaking points later in the session increased over control levels, resulting in no change in the total number of food pellets earned for the session compared to control. The present findings suggest that the effects of some anorectic drugs depend upon the access conditions for food; increasing the effort to obtain food may enhance their ability to decrease food-maintained behavior.     

Further evaluation of low-ranked items in stimulus-choice preference assessments

The generality of the findings reported by DeLeon, Iwata, and Roscoe (1997) was examined by conducting two stimulus-choice preference assessments, the second of which evaluated low-ranked items from the initial assessment. Results for the 2 participants suggested that supplementary assessments of low-ranked items may be useful for identifying a wider variety of reinforcing stimuli.     

Examining the discriminative and strengthening effects of reinforcers in concurrent schedules

Reinforcers may increase operant responding via a response-strengthening mechanism whereby the probability of the preceding response increases, or via some discriminative process whereby the response more likely to provide subsequent reinforcement becomes, itself, more likely. We tested these two accounts. Six pigeons responded for food reinforcers in a two-alternative switching-key concurrent schedule. Within a session, equal numbers of reinforcers were arranged for responses to each alternative. Those reinforcers strictly alternated between the two alternatives in half the conditions, and were randomly allocated to the alternatives in half the conditions. We also varied, across conditions, the alternative that became available immediately after a reinforcer. Preference after a single reinforcer always favored the immediately available alternative, regardless of the local probability of a reinforcer on that alternative (0 or 1 in the strictly alternating conditions, .5 in the random conditions). Choice then reflected the local reinforcer probabilities, suggesting some discriminative properties of reinforcement. At a more extended level, successive same-alternative reinforcers from an alternative systematically shifted preference towards that alternative, regardless of which alternative was available immediately after a reinforcer. There was no similar shift when successive reinforcers came from alternating sources. These more temporally extended results may suggest a strengthening function of reinforcement, or an enhanced ability to respond appropriately to "win-stay" contingencies over "win-shift" contingencies.     

Preratio pausing: effects of an alternative reinforcer on fixed- and variable-ratio responding

Seven rats responding under fixed-ratio or variable-ratio schedules of food reinforcement had continuous access to a drinking tube inserted into the operant chamber. Under different conditions they could drink either tap water or one of two saccharin solutions. In a baseline condition, the drinking bottle was empty. Preratio pausing was observed with both schedules, more so with the fixed-ratio than the variable-ratio schedule, and increasing the concentration of the saccharin solution increased the duration of pausing. Comparisons with baseline performances revealed that the additional pausing was largely, but not entirely, spent drinking. The results support the view that pausing under ratio schedules is a consequence of competition between the scheduled reinforcer and alternative reinforcers that also are available within the experimental environment.     

Local preference in concurrent schedules: the effects of reinforcer sequences

We investigated the effects that sequences of reinforcers obtained from the same response key have on local preference in concurrent variable-interval schedules with pigeons as subjects. With an overall reinforcer rate of one every 27 s, on average, reinforcers were scheduled dependently, and the probability that a reinforcer would be arranged on the same alternative as the previous reinforcer was manipulated. Throughout the experiment, the overall reinforcer ratio was 1:1, but across conditions we varied the average lengths of same-key reinforcer sequences by varying this conditional probability from 0 to 1. Thus, in some conditions, reinforcer locations changed frequently, whereas in others there tended to be very long sequences of same-key reinforcers. Although there was a general tendency to stay at the just-reinforced alternative, this tendency was considerably decreased in conditions where same-key reinforcer sequences were short. Some effects of reinforcers are at least partly to be accounted for by their signaling subsequent reinforcer locations.     

Concurrent nonindependent fixed‐ratio schedules of alcohol self‐administration: Effects of schedule size on choice

Choice behavior was studied under concurrent nonindependent fixed‐ratio fixed‐ratio (nFR) schedules of reinforcement, as these schedules result in frequent changeover responses. With these schedules, responses on either operandum count toward the completion of the ratio requirements of both schedules. Five monkeys were subjects, and two pairs of liquid reinforcers were concurrently available: 16% (w/v) and 0% ethanol or 16% and 8% ethanol. For each pair of reinforcers, the nFR sizes were systematically altered across sessions while keeping the schedule size equal for both liquids. Responding varied as a function of reinforcer pair and nFR size. With the 16% and 0% pair, higher response rates were maintained by 16% and were an inverted U‐shape function of nFR size. With 16% and 8%, a greater number of responses initially occurred on the schedule that delivered 8% ethanol. However, as nFR size increased, preference reversed such that responses that delivered 16% ethanol were greater. When the nFR size was subsequently decreased, preference reverted back to 8%. Number of responses emitted per delivery was a dependent variable and, in behavioral economic terms, was the price paid for each liquid delivery. With 16% and 0%, changeover responses initially increased and then decreased as schedule size became larger. In contrast, with the 16% and 8% pair, changeover responses increased directly with schedule size. Responding under nFR schedules is sensitive to differences in reinforcer magnitude and demonstrates that relative reinforcing effects can change as a function of schedule size.