Effects of reward magnitude frames on measures of delay discounting in a hypothetical money scenario

The current study analyzed the effects of three frames of reward magnitude—quantity, volume, and duration—on the rate at which college students discounted hypothetical, delayed monetary rewards. Hypothetical scenarios were presented using the fill-in-the-blank discounting questionnaire and participants made choices between immediate and delayed hypothetical monetary rewards. Scenarios framed the monetary choices as (a) quantity of dollar bills, (b) height (inches) of a stack of dollar bills, and (c) duration of time spent in a hypothetical cash machine to collect dollar bills. For each scenario, participants' subjective values were used to calculate the area under the curve (AuC). Framing resulted in a moderate effect size: The duration frame yielded significantly smaller AuC values compared to the quantity and volume frames. Thus, the framing of reward magnitude was a significant variable in controlling discounting rates for hypothetical, delayed monetary rewards. Subsequent investigations should be aware of the independent effects of the reward magnitude frames on delay discounting rates.     

Amount of reward has opposite effects on the discounting of delayed and probabilistic outcomes

Previous research has shown that the value of large future rewards is discounted less steeply than is the value of small future rewards. These experiments extended this line of research to probabilistic rewards. Two experiments replicated the standard findings for delayed rewards but demonstrated that amount has an opposite effect on the discounting of probabilistic rewards. That is, large probabilistic amounts were discounted at the same or higher rates than small amounts. Although amount had opposite effects on the discounting of delayed and probabilistic rewards, nevertheless, the same form of mathematical function accurately described discounting of both types of reward. The findings suggest that fundamentally similar, but not identical, processes are involved in decision making regarding delayed and probabilistic rewards. The implications of these findings for impulsivity and self-control are discussed.     

Modeling Myopic Decisions: Evidence for Hyperbolic Delay-Discounting within Subjects and Amounts

Hyperbolic and exponential discounting functions were compared as models of subjects′ present valuations of delayed rewards. Previous comparisons have been limited by relying on the assumption that discounting rate is independent of reward size; we avoided this limitation by making all comparisons within reward sizes. In Experiment 1, using real rewards in a simulated auction, and in Experiment 2, using hypothetical rewards, we offered subjects five monetary rewards at six delays each and asked them to indicate the smallest amount that they would accept immediately in exchange for those rewards. Both discounting functions were then fit to the six reported amounts for each reward using nonlinear regressions. In both experiments, although both functions fit the data very well, the hyperbolic function fit better for all of the delayed rewards. Furthermore, the hyperbolic function better described the data for 20 of 21 and 14 of 18 subjects in Experiments 1 and 2, respectively.     

Discounting of monetary and directly consumable rewards

We compared temporal and probability discounting of a nonconsumable reward (money) and three directly consumable rewards (candy, soda, and beer). When rewards were delayed, monetary rewards were discounted less steeply than directly consumable rewards, all three of which were discounted at equivalent rates. When rewards were probabilistic, however, there was no difference between the discounting of monetary and directly consumable rewards. It has been reported that substance abusers discount delayed drug rewards more steeply than delayed money, but this difference may reflect special characteristics of drugs or drug abusers, or it may reflect a general property of consumable rewards. The present findings suggest that abused substances (like beer) share the properties of other directly consumable rewards, whereas delayed monetary rewards are special because they are fungible, generalized (conditioned) reinforcers.     

Pigeons' discounting of probabilistic and delayed reinforcers

Pigeons' discounting of probabilistic and delayed food reinforcers was studied using adjusting-amount procedures. In the probability discounting conditions, pigeons chose between an adjusting number of food pellets contingent on a single key peck and a larger, fixed number of pellets contingent on completion of a variable-ratio schedule. In the delay discounting conditions, pigeons chose between an adjusting number of pellets delivered immediately and a larger, fixed number of pellets delivered after a delay. Probability discounting (i.e., subjective value as a function of the odds against reinforcement) was as well described by a hyperboloid function as delay discounting was (i.e., subjective value as a function of the time until reinforcement). As in humans, the exponents of the hyperboloid function when it was fitted to the probability discounting data were lower than the exponents of the hyperboloid function when it was fitted to the delay discounting data. The subjective values of probabilistic reinforcers were strongly correlated with predictions based on simply substituting the average delay to their receipt in each probabilistic reinforcement condition into the hyperboloid discounting function. However, the subjective values were systematically underestimated using this approach. Using the discounting function proposed by Mazur (1989), which takes into account the variability in the delay to the probabilistic reinforcers, the accuracy with which their subjective values could be predicted was increased. Taken together, the present findings are consistent with Rachlin's (Rachlin, 1990; Rachlin, Logue, Gibbon, & Frankel, 1986) hypothesis that choice involving repeated gambles may be interpreted in terms of the delays to the probabilistic reinforcers.     

DISCOUNTING OF DELAYED REWARDS:

Abstract— In this study, children, young adults, and older adults chose between immediate and delayed hypothetical monetary rewards The amount of the delayed reward was held constant while its delay was varied All three age groups showed delay discounting, that is, the amount of an immediate reward judged to be of equal value to the delayed reward decreased as a function of delay The rate of discounting was highest for children and lowest for older adults, predicting a life-span developmental trend toward increased selfcontrol Discounting of delayed rewards by all three age groups was well described by a single function with agesensitive parameters (all R²s>94) Thus, even though there are quantitative age differences in delay discounting, the existence of an age-invanant form of discount function suggests that the process of choosing between rewards of different amounts and delays is qualitatively similar across the life span     

DISCOUNTING OF DELAYED FOOD REWARDS IN PIGEONS AND RATS: IS THERE A MAGNITUDE EFFECT?

Temporal discounting refers to the decrease in the present, subjective value of a reward as the time to its receipt increases. Results from humans have shown that a hyperbola-like function describes the form of the discounting function when choices involve hypothetical monetary rewards. In addition, magnitude effects have been reported in which smaller reward amounts are discounted more steeply than larger amounts. The present research examines the cross-species generality of these findings using real rewards, namely food pellets, with both pigeons and rats. As with humans, an adjusting amount procedure was used to estimate the amount of immediate reward judged equal in value to a delayed reward. Different amounts of delayed food rewards (ranging from 5 to 32 pellets in pigeons and from 5 to 20 pellets in rats) were studied at delays varying from 1 s to 32 s. A simple hyperbola, similar to the hyperbola-like mathematical function that describes the discounting of hypothetical monetary rewards in humans, described the discounting of food rewards in both pigeons and rats. These results extend the generality of the mathematical model of discounting. Rates of discounting delayed food rewards were higher for pigeons than for rats. Unlike humans, however, neither pigeons nor rats showed a reliable magnitude effect: Rate of discounting did not vary systematically as a function of the amount of the delayed reward.     

Delay discounting as impaired valuation: Delayed rewards in an animal obesity model

Obesity is a major public health problem, which, like many forms of addiction, is associated with an elevated tendency to choose smaller immediate rather than larger delayed rewards, a response pattern often referred to as excessive delay discounting. Although some accounts of delay discounting conceptualize this process as impulsivity (placing the emphasis on overvaluing the smaller immediate reward), others have conceptualized delay discounting as an executive function (placing the emphasis on delayed rewards failing to retain their value). The present experiments used a popular animal model of obesity that has been shown to discount delayed rewards at elevated rates (i.e., obese Zucker rats) to test two predictions that conceptualize delay discounting as executive function. In the first experiment, acquisition of lever pressing with delayed rewards was compared in obese versus lean Zucker rats. Contrary to predictions based on delay discounting as executive function, obese Zucker rats learned to press the lever more quickly than controls. In the second experiment, progressive ratio breakpoints (a measure of reward efficacy) with delayed rewards were compared in obese versus lean Zucker rats. Contrary to the notion that obese rats fail to value delayed rewards, the obese Zucker rats' breakpoints were (at least) as high as those of the lean Zucker rats.     

The relation between temperament and rate of temporal discounting

The present study examines the relationship between several temperamental traits (sensation seeking, extraversion–introversion, and impulsivity) and rate of temporal discounting, that is the rate of decrease in the subjective value of a reward as the delay to its receipt increases. Participants made choices between hypothetical monetary rewards that could be obtained immediately or after a specified delay. Temporal discounting functions were calculated and differences in rate of discounting between different groups were evaluated. For all groups of participants, hyperbolic discounting functions described well the decreases in subjective value with delay (R² ranged from 0.700 to 0.985). The rate of discounting was equivalent in high and low sensation seekers. However, both extraverts and high impulsive individuals showed higher temporal discounting rates than introverts and low impulsive individuals. The relationship between temperament and temporal discounting may be related to differences in time perception and/or to differences in susceptibility to rewards in extraverts versus introverts and in high- versus low-impulsive individuals.     

Modeling the effect of reward amount on probability discounting

The present study with college students examined the effect of amount on the discounting of probabilistic monetary rewards. A hyperboloid function accurately described the discounting of hypothetical rewards ranging in amount from $20 to $10,000,000. The degree of discounting increased continuously with amount of probabilistic reward. This effect of amount was not due to changes in the rate parameter of the discounting function, but rather was due to increases in the exponent. These results stand in contrast to those observed with the discounting of delayed monetary rewards, in which the degree of discounting decreases with reward amount due to amount-dependent decreases in the rate parameter. Taken together, this pattern of results suggests that delay and probability discounting reflect different underlying mechanisms. That is, the fact that the exponent in the delay discounting function is independent of amount is consistent with a psychophysical scaling interpretation, whereas the finding that the exponent of the probability-discounting function is amount-dependent is inconsistent with such an interpretation. Instead, the present results are consistent with the idea that the probability-discounting function is itself the product of a value function and a weighting function. This idea was first suggested by Kahneman and Tversky (1979), although their prospect theory does not predict amount effects like those observed. The effect of amount on probability discounting was parsimoniously incorporated into our hyperboloid discounting function by assuming that the exponent was proportional to the amount raised to a power. The amount-dependent exponent of the probability-discounting function may be viewed as reflecting the effect of amount on the weighting of the probability with which the reward will be received.     

Are people really more patient than other animals? Evidence from human discounting of real liquid rewards

In previous studies, researchers have found that humans discount delayed rewards orders of magnitude less steeply than do other animals. Humans also discount smaller delayed reward amounts more steeply than larger amounts, whereas animals apparently do not. These differences between humans and animals might reflect differences in the types of rewards studied and/or the fact that animals actually had to wait for their rewards. In the present article, we report the results of three experiments in which people made choices involving liquid rewards delivered and consumed after actual delays, thereby bridging the gap between animal and human studies. Under these circumstances, humans, like animals, discounted the value of rewards delayed by seconds; however, unlike animals, they still showed an effect of reward amount. Human discounting was well described by the same hyperboloid function that has previously been shown to describe animal discounting of delayed food and water rewards, as well as human discounting of real and hypothetical monetary rewards.     

Delay-discounting probabilistic rewards: Rates decrease as amounts increase

The independence of delay-discounting rate and monetary reward size was tested by offering subjects (N = 621) a series of choices between immediate rewards and larger, delayed rewards. In contrast to previous studies, in which hypothetical rewards have typically been employed, subjects in the present study were entered into a lottery in which they had a chance of actually receiving one of their choices. The delayed rewards were grouped into small ($30–$35), medium ($55–$65), and large amounts ($70–$85). Using a novel parameter estimation procedure, we estimated discounting rates for all three reward sizes for each subject on the basis of his/her pattern of choices. The data indicated that the discounting rate is a decreasing function of the size of the delayed reward (p < .0001), whether hyperbolic or exponential discounting functions are assumed. In addition, a reliable gender difference was found (p = .005), with males discounting at higher rates than females, on average.     

Temporal discounting predicts student responsiveness to exchange delays in a classroom token system

Typical assessments of temporal discounting involve presenting choices between hypothetical monetary outcomes. Participants choose between smaller immediate rewards and larger delayed rewards to determine how the passage of time affects the subjective value of reinforcement. Few studies, however, have compared such discounting to actual manipulations of reward delay. The present study examined the predictive validity of a temporal discounting procedure developed for use with children. Forty-six sixth-grade students completed a brief discounting assessment and were then exposed to a classwide intervention that involved both immediate and delayed reinforcement in a multiple baseline design across classrooms. The parameters derived from two hyperbolic models of discounting correlated significantly with actual on-task behavior under conditions of immediate and delayed exchange. Implications of temporal discounting assessments for behavioral assessment and treatment are discussed.     

Positive mood effects on delay discounting

Delay discounting is the process by which the value of an expected reward decreases as the delay to obtaining that reward increases. Individuals with higher discounting rates tend to prefer smaller immediate rewards over larger delayed rewards. Previous research has indicated that personality can influence an individual's discounting rates, with higher levels of Extraversion predicting a preference for immediate gratification. The current study examined how this relationship would be influenced by situational mood inductions. While main effects were observed for both Extraversion and cognitive ability in the prediction of discounting rates, a significant interaction was also observed between Extraversion and positive affect. Extraverted individuals were more likely to prefer an immediate reward when first put in a positive mood. Extraverts thus appear particularly sensitive to impulsive, incentive-reward-driven behavior by temperament and by situational factors heightening positive affect.     

Pathological gamblers, with and without substance use disorders, discount delayed rewards at high rates

Pathological gambling is classified as a disorder of impulse control, yet little research has evaluated behavioral indices of impulsivity in gamblers. The rates at which rewards delayed in time are subjectively devalued may be a behavioral marker of impulsivity. This study evaluated delay discounting in 60 pathological gamblers and 26 control participants. Gamblers were divided into those with (n = 21) and without (n = 39) substance use disorders. A hypothetical $1,000 reward was delayed at intervals ranging from 6 hr to 25 years, and immediate rewards varied from $1 to $999. Pathological gamblers discounted delayed rewards at higher rates than control participants, and gamblers with substance use disorders discounted delayed rewards at higher rates than non-substance-abusing gamblers. These data provide further evidence that rapid discounting of delayed rewards may be a feature central to impulse control and addictive disorders, including pathological gambling.     

Gambling and Delay Discounting in Japanese Students

The present study examined the relationship between gambling behavior and delay discounting with Japanese residents. Japanese university students were selected into pathological gambler and non‐gambling control groups using a Japanese version of the South Oaks Gambling Screen. In a discounting task, participants chose individually between a large delayed reward and a smaller immediate reward with varied delays. The discounting rate (k‐value) and the area under the curve were significantly higher and smaller, respectively, for the gambler group than for the control group. These findings show that Japanese gamblers discount delayed rewards more steeply than non‐gambling controls, as has been found in U.S. residents.     

Subjective probability and delay.

Human subjects indicated their preference between a hypothetical $1,000 reward available with various probabilities or delays and a certain reward of variable amount available immediately. The function relating the amount of the certain-immediate reward subjectively equivalent to the delayed $1,000 reward had the same general shape (hyperbolic) as the function found by Mazur (1987) to describe pigeons' delay discounting. The function relating the certain-immediate amount of money subjectively equivalent to the probabilistic $1,000 reward was also hyperbolic, provided that the stated probability was transformed to odds against winning. In a second experiment, when human subjects chose between a delayed $1,000 reward and a probabilistic $1,000 reward, delay was proportional to the same odds-against transformation of the probability to which it was subjectively equivalent.     

The absence of numbers to express the amount may affect delay discounting with humans

Human delay discounting is usually studied with experimental protocols that use symbols to express delay and amount. In order to further understand discounting, we evaluated whether the absence of numbers to represent reward amounts affects discount rate in general, and whether the magnitude effect is generalized to nonsymbolic situations in particular. In Experiment 1, human participants were exposed to a delay‐discounting task in which rewards were presented using dots to represent monetary rewards (nonsymbolic); under this condition the magnitude effect did not occur. Nevertheless, the magnitude effect was observed when equivalent reward amounts were presented using numbers (symbolic). Moreover, in estimation tasks, magnitude increments produced underestimation of large amounts. In Experiment 2, participants were exposed only to the nonsymbolic discounting task and were required to estimate reward amounts in each trial. Consistent with Experiment 1, the absence of numbers representing reward amounts produced similar discount rates of small and large rewards. These results suggest that value of nonsymbolic rewards is a nonlinear function of amount and that value attribution depends on perceived difference between the immediate and the delayed nonsymbolic rewards.     

The rich get richer: Students’ discounting of hypothetical delayed rewards and real effortful extra credit

The present research compared choices among students with higher or lower grades for rewards that were devalued by imposing a delay to their receipt (Study 1) or by requiring more work for a larger reward (Study 2). In Study 1, students chose between hypothetical and noncontingent smaller immediate or larger delayed monetary rewards. In Study 2, students chose from among different amounts of real, response-contingent academic rewards (extra credit) that required different amounts of work. The results of both studies were similar: The highest scoring students discounted the value of the delayed money less than did their lower scoring counterparts, and the highest scoring students also chose to do and actually did more extra-credit work than lower scoring students did. Differences in the discounting of devalued rewards might represent a fundamental difference between the highest and lower scoring students.