Independence of terminal-link entry rate and immediacy in concurrent chains

In Phase 1, 4 pigeons were trained on a three-component multiple concurrent-chains procedure in which components differed only in terms of relative terminal-link entry rate. The terminal links were variable-interval schedules and were varied across four conditions to produce immediacy ratios of 4:1, 1:4, 2:1, and 1:2. Relative terminal-link entry rate and relative immediacy had additive and independent effects on initial-link response allocation, and the data were well-described by a generalized-matching model. Regression analyses showed that allowing sensitivity to immediacy to vary across components produced only trivial increases in variance accounted for. Phase 2 used a three-component concurrent-schedules procedure in which the schedules were the same as the initial links of Phase 1. Across two conditions, the relative reinforcer magnitude was varied. Sensitivity to relative reinforcer rate was independent of relative magnitude, confirming results of prior studies. Sensitivity to relative reinforcer rate in Phase 2 did not vary systematically across subjects compared to sensitivity to relative entry rate in Phase 1, and regression analyses confirmed again that only small increases in variance accounted for were obtained when sensitivities were estimated independently compared with a single estimate for both phases. Overall, the data suggest that conditioned and primary reinforcers have functionally equivalent effects on choice and support the independence of relative terminal-link entry rate and immediacy as determiners of response allocation. These results are consistent with current models for concurrent chains, including Grace's (1994) contextual choice model and Mazur's (2001) hyperbolic value-added model.     

Within-subject comparison of real and hypothetical money rewards in delay discounting

A within-subject design, using human participants, compared delay discounting functions for real and hypothetical money rewards. Both real and hypothetical rewards were studied across a range that included $10 to $250. For 5 of the 6 participants, no systematic difference in discount rate was observed in response to real and hypothetical choices, suggesting that hypothetical rewards may often serve as a valid proxy for real rewards in delay discounting research. By measuring discounting at an unprecedented range of real rewards, this study has also systematically replicated the robust finding in human delay discounting research that discount rates decrease with increasing magnitude of reward. A hyperbolic decay model described the data better than an exponential model.     

Contiguity and conditioned reinforcement in probabilistic choice

In a baseline condition, pigeons chose between an alternative that always provided food following a 30-s delay (100% reinforcement) and an alternative that provided food half of the time and blackout half of the time following 30-s delays (50% reinforcement). The different outcomes were signaled by different-colored keylights. On average, each alternative was chosen approximately equally often, replicating the finding of suboptimal choice in probabilistic reinforcement procedures. The efficacy of the delay stimuli (keylights) as conditioned reinforcers was assessed in other conditions by interposing a 5-s gap (keylights darkened) between the choice response and one or more of the delay stimuli. The strength of conditioned reinforcement was measured by the decrease in choice of an alternative when the alternative contained a gap. Preference for the 50% alternative decreased in conditions in which the gap preceded either all delay stimuli, both delay stimuli for the 50% alternative, or the food stimulus for the 50% alternative, but preference was not consistently affected in conditions in which the gap preceded only the 100% delay stimulus or the blackout stimulus for the 50% alternative. These results support the notion that conditioned reinforcement underlies the finding of suboptimal preference in probabilistic reinforcement procedures, and that the signal for food on the 50% reinforcement alternative functions as a stronger conditioned reinforcer than the signal for food on the 100% reinforcement alternative. In addition, the results fail to provide evidence that the signal for blackout functions as a conditioned punisher.     

Choice in a successive-encounters procedure and hyperbolic decay of reinforcement

Pigeons responded in a successive-encounters procedure that consisted of a search state, a choice state, and a handling state. The search state was either a fixed-interval or mixed-interval schedule presented on the center key of a three-key chamber. Upon completion of the search state, the choice state was presented, in which the center key was off and the two side keys were lit. A pigeon could either accept a delay followed by food (by pecking the right key) or reject this option and return to the search state (by pecking the left key). During the choice state, a red right key represented the long alternative (a long handling delay followed by food), and a green right key represented the short alternative (a short handling delay followed by food). In some conditions, both the short and long alternatives were fixed-time schedules, and in other conditions both were mixed-time schedules. Contrary to the predictions of both optimal foraging theory and delay-reduction theory, the percentage of trials on which pigeons accepted the long alternative depended on whether the search and handling schedules were fixed or mixed. They were more likely to accept the long alternative when the search states were fixed-interval rather than mixed-interval schedules, and more likely to reject the long alternative when the handling states were fixed-time rather than mixed-time schedules. This pattern of results was in qualitative agreement with the predictions of the hyperbolic-decay model, which states that the value of a reinforcer is inversely related to the delay between a choice response and reinforcer delivery.     

DELAY‐AMOUNT TRADEOFFS IN CHOICES BY PIGEONS AND RATS: HYPERBOLIC VERSUS EXPONENTIAL DISCOUNTING

An adjusting‐delay procedure was used to study the choices of pigeons and rats when both delay and amount of reinforcement were varied. In different conditions, the choice alternatives included one versus two reinforcers, one versus three reinforcers, and three versus two reinforcers. The delay to one alternative (the standard alternative) was kept constant in a condition, and the delay to the other (the adjusting alternative) was increased or decreased many times a session so as to estimate an indifference point—a delay at which the two alternatives were chosen about equally often. Indifference functions were constructed by plotting the adjusting delay as a function of the standard delay for each pair of reinforcer amounts. The experiments were designed to test the prediction of a hyperbolic decay equation that the slopes of the indifference functions should increase as the ratio of the two reinforcer amounts increased. Consistent with the hyperbolic equation, the slopes of the indifference functions depended on the ratios of the two reinforcer amounts for both pigeons and rats. These results were not compatible with an exponential decay equation, which predicts slopes of 1 regardless of the reinforcer amounts. Combined with other data, these findings provide further evidence that delay discounting is well described by a hyperbolic equation for both species, but not by an exponential equation. Quantitative differences in the y‐intercepts of the indifference functions from the two species suggested that the rate at which reinforcer strength decreases with increasing delay may be four or five times slower for rats than for pigeons.