DISCOUNTING OF DELAYED FOOD REWARDS IN PIGEONS AND RATS: IS THERE A MAGNITUDE EFFECT?

Temporal discounting refers to the decrease in the present, subjective value of a reward as the time to its receipt increases. Results from humans have shown that a hyperbola-like function describes the form of the discounting function when choices involve hypothetical monetary rewards. In addition, magnitude effects have been reported in which smaller reward amounts are discounted more steeply than larger amounts. The present research examines the cross-species generality of these findings using real rewards, namely food pellets, with both pigeons and rats. As with humans, an adjusting amount procedure was used to estimate the amount of immediate reward judged equal in value to a delayed reward. Different amounts of delayed food rewards (ranging from 5 to 32 pellets in pigeons and from 5 to 20 pellets in rats) were studied at delays varying from 1 s to 32 s. A simple hyperbola, similar to the hyperbola-like mathematical function that describes the discounting of hypothetical monetary rewards in humans, described the discounting of food rewards in both pigeons and rats. These results extend the generality of the mathematical model of discounting. Rates of discounting delayed food rewards were higher for pigeons than for rats. Unlike humans, however, neither pigeons nor rats showed a reliable magnitude effect: Rate of discounting did not vary systematically as a function of the amount of the delayed reward.     

Effects of reinforcer delays on choice as a function of income level

Three rats earned their daily food ration by responding during individual trials either on a lever that delivered one food pellet immediately or on a second lever that delivered three pellets after a delay that was continuously adjusted to ensure substantial responding to both alternatives. Choice of the delayed reinforcer increased when the number of trials per session was reduced. This result suggests that models seeking closure on choice effects must include a parameter reflecting how preference changes with sessionwide income. Moreover, models positing that reinforcer probability and immediacy (1/delay) function equivalently in choice are called into question by the finding that probability and immediacy produce opposing effects when income level is changed.     

Impulsive choice and pre‐exposure to delays: iv. effects of delay‐ and immediacy‐exposure training relative to maturational changes in impulsivity

Impulsive choice describes preference for smaller, sooner rewards over larger, later rewards. Excessive delay discounting (i.e., rapid devaluation of delayed rewards) underlies some impulsive choices, and is observed in many maladaptive behaviors (e.g., substance abuse, gambling). Interventions designed to reduce delay discounting may provide therapeutic gains. One such intervention provides rats with extended training with delayed reinforcers. When compared to a group given extended training with immediate reinforcers, delay‐exposed rats make significantly fewer impulsive choices. To what extent is this difference due to delay‐exposure training shifting preference toward self‐control or immediacy‐exposure training (the putative control group) shifting preference toward impulsivity? The current study compared the effects of delay‐ and immediacy‐exposure training to a no‐training control group and evaluated within‐subject changes in impulsive choice across 51 male Wistar rats. Delay‐exposed rats made significantly fewer impulsive choices than immediacy‐exposed and control rats. Between‐group differences in impulsive choice were not observed in the latter two groups. While delay‐exposed rats showed large, significant pre‐ to posttraining reductions in impulsive choice, immediacy‐exposed and control rats showed small reductions in impulsive choice. These results suggest that extended training with delayed reinforcers reduces impulsive choice, and that extended training with immediate reinforcers does not increase impulsive choice.     

An experimental analysis of the cost of food in a closed economy.

Rats lived in individual chambers in which the only food available was delivered for lever pressing. During Stage I, a fixed number of presses was required for each food pellet. As this fixed ratio of presses per food pellet was increased daily, a rat's daily intake of food was reduced. During Stage II, the cost of a food pellet was increased by replacing each fixed ratio with its interval equivalent. Each interval was a rat's mean time between the first press of a ratio and the delivery of a pellet during Stage I. During Stage II, only two presses were every required for a food pellet: The first press initiated a delay and the second activated the pellet dispenser after that delay elapsed. Food intakes for the series of fixed ratios and a rat's series of delay equivalents were very similar when plotted as a function of delay, but not when plotted as a function of presses per pellet. Consequently, the fixed ratio reduced food intake because larger ratios increased delay to food from the first press of a ratio. Observations and an analysis of interresponse times further revealed that as the fixed ratio increased, and local as well as overall rate of food intake decreased, lever pressing became more stereotyped. Because this increased stereotypy resulted in greatly increased rates of lever pressing, delay to food was minimized, and perhaps more importantly, so too was the reduction of a rat's baseline daily intake.     

Behavioral economics of concurrent ethanol-sucrose and sucrose reinforcement in the rat: effects of altering variable-ratio requirements.

These experiments examined the own-price and cross-price elasticities of a drug (ethanol mixed with 10% sucrose) and a nondrug (10% sucrose) reinforcer. Rats were presented with ethanol-sucrose and sucrose, both available on concurrent independent variable-ratio (VR) 8 schedules of reinforcement. In Experiment 1, the variable ratio for the ethanol mix was systematically raised to 10, 12, 14, 16, 20, and 30, while the variable ratio for sucrose remained at 8. Five of the 6 rats increased ethanol-reinforced responding at some of the increments and defended baseline levels of ethanol intake. However, the rats eventually ceased ethanol-reinforced responding at the highest variable ratios. Sucrose-reinforced responding was not systematically affected by the changes in variable ratio for ethanol mix. In Experiment 2, the variable ratio for sucrose was systematically increased while the ethanol-sucrose response requirement remained constant. The rats decreased sucrose-reinforced responding and increased ethanol-sucrose-reinforced responding, resulting in a two- to 10-fold increase in ethanol intake. Experiment 3 examined the substitutability of qualitatively identical reinforcers: 10% sucrose versus 10% sucrose. Increases in variable-ratio requirements at the preferred lever resulted in a switch in lever preference. Experiment 4 examined whether 10% ethanol mix substituted for 5% ethanol mix, with increasing variable-ratio requirements of the 5% ethanol. All rats eventually responded predominantly for the 10% ethanol mix, but total amount of ethanol consumed per session did not systematically change. In Experiment 5, the variable-ratio requirements for both ethanol and sucrose were simultaneously raised to VR 120; 7 of 8 rats increased ethanol-reinforced responding while decreasing sucrose-reinforced responding. These data suggest that, within this ethanol-induction procedure and within certain parameters, demand for ethanol-sucrose was relatively inelastic, and sucrose consumption was independent of ethanol-sucrose consumption. Demand for sucrose, on the other hand, was relatively elastic, and ethanol-sucrose readily substituted for it. The results are discussed in terms of applying a behavioral economic approach to relationships between drug and nondrug reinforcers.     

Relative sensitivity to reinforcer amount and delay in a self-control choice situation.

Rats were exposed to concurrent-chains schedules in which a single variable-interval schedule arranged entry into one of two terminal-link delay periods (fixed-interval schedules). The shorter delay ended with the delivery of a single food pellet; the longer day ended with a larger number of food pellets (two under some conditions and six under others). In Experiment 1, the terminal-link delays were selected so that under all conditions the ratio of delays would exactly equal the ratio of the number of pellets. But the absolute duration of the delays differed across conditions. In one condition, for example, rats chose between one pellet delayed 5 s and six pellets delayed 30 s; in another condition rats chose between one pellet delayed 10 s and six pellets delayed 60 s. The generalized matching law predicts indifference between the two alternatives, assuming that the sensitivity parameters for amount and delay of reinforcement are equal. The rats' choices were, in fact, close to indifference except when the choice was between one pellet delayed 5 s and six pellets delayed 30 s. That deviation from indifference suggests that the sensitivities to amount and delay differ from each other depending on the durations of the delays. In Experiment 2, rats chose between one pellet following a 5-s delay and six pellets following a delay that was systematically increased over sessions to find a point of indifference. Indifference was achieved when the delay to the six pellets was approximately 55 s. These results are consistent with the possibility that the relative sensitivities to amount and delay differ as a function of the delays.