Within-subject comparison of real and hypothetical money rewards in delay discounting

A within-subject design, using human participants, compared delay discounting functions for real and hypothetical money rewards. Both real and hypothetical rewards were studied across a range that included $10 to $250. For 5 of the 6 participants, no systematic difference in discount rate was observed in response to real and hypothetical choices, suggesting that hypothetical rewards may often serve as a valid proxy for real rewards in delay discounting research. By measuring discounting at an unprecedented range of real rewards, this study has also systematically replicated the robust finding in human delay discounting research that discount rates decrease with increasing magnitude of reward. A hyperbolic decay model described the data better than an exponential model.     

Tests of an indifference rule in variable‐delay and double‐reward choice procedures with humans

Four hundred and fifty participants were recruited from Amazon Mechanical Turk across 3 experiments to test the predictions of a hyperbolic discounting equation in accounting for human choices involving variable delays or multiple rewards (Mazur, 1984, 1986). In Experiment 1, participants made hypothetical choices between 2 monetary alternatives, 1 consisting of a fixed delay and another consisting of 2 delays of equal probability (i.e., a variable‐delay procedure). In Experiment 2, participants made hypothetical monetary choices between a single, immediate reward and 2 rewards, 1 immediate and 1 delayed (i.e., a double‐reward procedure). Experiment 3 also used a double‐reward procedure, but with 2 delayed rewards. Participants in all 3 experiments also completed a standard delay‐discounting task. Finally, 3 reward amounts were tested in each type of task ($100, $1000, and $5000). In the double‐reward conditions (Experiments 2 and 3), the results were in good qualitative and quantitative agreement with Mazur's model (1984, 1986). In contrast, when participants made choices involving variable delays (Experiment 1), there was relatively poor qualitative and quantitative agreement with this model. These results, along with our previous findings, suggest the structure of questions in hypothetical tasks with humans can be a strong determinant of the choice pattern.     

Examining children's ability to delay reward: Is the delay discounting task a suitable measure?

Discounting the value of delayed rewards has primarily been measured in children with the delay of gratification task and in adolescents and adults with the delay discounting task. In the present study, we assessed the suitability of the delay discounting task as a measure of temporal discounting in children. A sample of 7- to 9-year-olds (N = 98) completed a delay discounting task, a delay of gratification task, a sensation seeking measure, and IQ measures. In addition, teacher-based assessments of attention-deficit/hyperactivity disorder traits were measured. The results indicated that the majority of children produced meaningful data on the discounting task and discounted rewards hyperbolically. Children with an elevated risk of attention-deficit/hyperactivity disorder showed a trend towards discounting future rewards on the delay discounting task more steeply than did those at low risk. However, delay discounting was unrelated to either delay of gratification or sensation seeking. We interpret these results as providing some support for the use of delay discounting as a measure of intertemporal choice in children, although the results also suggest that delay discounting and delay of gratification tasks may tap different processes in this population.     

Introduction to the special issue on comparative cognition

Prior research has shown that nonhumans show an extreme preference for variable‐ over fixed‐delays to reinforcement. This well‐established preference for variability occurs because a reinforcer's strength or “value” decreases according to a curvilinear function as its delay increases. The purpose of the present experiments was to investigate whether this preference for variability occurs with human participants making hypothetical choices. In three experiments, participants recruited from Amazon Mechanical Turk made choices between variable and fixed monetary rewards. In a variable‐delay procedure, participants repeatedly chose between a reward delivered either immediately or after a delay (with equal probability) and a reward after a fixed delay (Experiments 1 and 2). In a double‐reward procedure, participants made choices between an alternative consisting of two rewards, one delivered immediately and one after a delay, and a second alternative consisting of a single reward delivered after a delay (Experiments 1 and 3). Finally, all participants completed a standard delay‐discounting task. Although we observed both curvilinear discounting and magnitude effects in the standard discounting task, we found no consistent evidence of a preference for variability—as predicted by two prominent models of curvilinear discounting (i.e., a simple hyperbola and a hyperboloid)—in our variable‐delay and double‐reward procedures. This failure to observe a preference for variability may be attributed to the hypothetical, rule‐governed nature of choices in the present study. In such contexts, participants may adopt relatively simple strategies for making more complex choices.     

Temporal discounting of monetary rewards in children and adolescents with ADHD and autism spectrum disorders

It has been difficult to differentiate attention‐deficit/hyperactivity disorder (ADHD) and autism spectrum disorder (ASD) in terms of some aspects of their cognitive profile. While both show deficits in executive functions, it has been suggested that they may differ in their response to monetary reward. For instance, children with ADHD prefer small immediate over large delayed rewards more than typically developing controls. One explanation for this is that they discount the value of rewards to a higher degree as they are moved into the future. The current study investigated whether children with ADHD can be differentiated from those with ASD in terms of reward discounting. Thirty‐nine children (8–16 y) with ADHD, 34 children with ASD and 46 typically developing controls performed a hypothetical monetary temporal discounting task. Participants were instructed to make repeated choices between small variable rewards (0, 5, 10, 20, 30€) delivered immediately and large rewards delivered after a variable delay. Children with ADHD but not ASD discounted future rewards at a higher rate than typically developing controls. These data confirm steeper discounting of future rewards in ADHD and add to a small but growing literature showing that the psychological profile of ADHD can be distinguished from that of ASD in terms of disrupted motivational processes.     

The absence of numbers to express the amount may affect delay discounting with humans

Human delay discounting is usually studied with experimental protocols that use symbols to express delay and amount. In order to further understand discounting, we evaluated whether the absence of numbers to represent reward amounts affects discount rate in general, and whether the magnitude effect is generalized to nonsymbolic situations in particular. In Experiment 1, human participants were exposed to a delay‐discounting task in which rewards were presented using dots to represent monetary rewards (nonsymbolic); under this condition the magnitude effect did not occur. Nevertheless, the magnitude effect was observed when equivalent reward amounts were presented using numbers (symbolic). Moreover, in estimation tasks, magnitude increments produced underestimation of large amounts. In Experiment 2, participants were exposed only to the nonsymbolic discounting task and were required to estimate reward amounts in each trial. Consistent with Experiment 1, the absence of numbers representing reward amounts produced similar discount rates of small and large rewards. These results suggest that value of nonsymbolic rewards is a nonlinear function of amount and that value attribution depends on perceived difference between the immediate and the delayed nonsymbolic rewards.     

Effects of reward magnitude frames on measures of delay discounting in a hypothetical money scenario

The current study analyzed the effects of three frames of reward magnitude—quantity, volume, and duration—on the rate at which college students discounted hypothetical, delayed monetary rewards. Hypothetical scenarios were presented using the fill-in-the-blank discounting questionnaire and participants made choices between immediate and delayed hypothetical monetary rewards. Scenarios framed the monetary choices as (a) quantity of dollar bills, (b) height (inches) of a stack of dollar bills, and (c) duration of time spent in a hypothetical cash machine to collect dollar bills. For each scenario, participants' subjective values were used to calculate the area under the curve (AuC). Framing resulted in a moderate effect size: The duration frame yielded significantly smaller AuC values compared to the quantity and volume frames. Thus, the framing of reward magnitude was a significant variable in controlling discounting rates for hypothetical, delayed monetary rewards. Subsequent investigations should be aware of the independent effects of the reward magnitude frames on delay discounting rates.     

Asymmetry of the group context effect on delay discounting

Binary choice delay discounting tasks require participants to indicate preference between smaller, immediate, and larger, delayed rewards. Previous research indicates that when the delayed reward is shared with others, the delayed outcome is preferred compared with when the outcomes are for the self only, resulting in lower rates of delay discounting. The present series of studies sought to replicate and extend this finding. Study 1 compared delay discounting on a standard task in which both immediate and delayed outcomes are for the self and a group context task where the delayed outcome was shared with one other person. Replicating previous results, group context resulted in lower rates of delay discounting, and this effect was independent of how the shared outcome was presented. Study 2 compared delay discounting on a standard task and a group context task where the immediate outcome was shared. In contrast to Study 1, group context resulted in higher rates of delay discounting, suggesting that preference in intertemporal choice tracks the shared outcome. Moreover, this effect was not independent of how the shared outcome was presented. This is the first study to reveal that group context, when applied to the immediate outcome, can result in higher rates of delay discounting.     

Physical and cognitive effort discounting of hypothetical monetary rewards

Effort discounting refers to the decrease in the subjective value of a reward as the effort required to obtain the reward increases. The main aims of this study were to ascertain whether the amount of the reward affects the steepness of the effort discounting process for hypothetical monetary rewards, to identify whether this steepness depends on the type of effort that is required, and to determine whether the steepness of different types of effort covary at the individual level. Two types of effort were studied under hypothetical choice situations: physical effort and cognitive effort. Both physical and cognitive effort discounting were well described by the hyperbolic model. Large rewards were discounted less steeply than small rewards for both types of effort. This finding agrees with the results of prior studies which have found that larger rewards have greater motivational power. In addition, the steepness of physical effort discounting was positively correlated with the steepness of cognitive effort discounting, which suggests that the effort discounting process is a trait‐like characteristic within an individual.     

Age‐related differences in delay discounting: Immediate reward,reward magnitude,and social influence

Delay discounting refers to the tendency of individuals to subjectively devalue rewards that are to be received in the future, with high rates of delay discounting being associated with a variety of maladaptive life outcomes (e.g., unhealthy dietary and exercise behaviors). The current study explored the psychological and social processes involved in adult age‐related differences in delay discounting of monetary rewards. Younger adults exhibited higher levels of delay discounting than older adults. This increased level of patience in older adults was found whether smaller‐sooner rewards were to be received immediately or in the future. However, there was an interaction with reward magnitude, whereby younger adults exhibited higher levels of delay discounting for smaller reward magnitudes but not larger reward magnitudes. Social influence on delay discounting was investigated by having participants complete three phases of the delay‐discounting task: an individual precollaboration phase, a collaboration phase in age‐group‐matched dyads, and an individual postcollaboration phase. A convergence effect was observed in that dyad members' postcollaboration choices were significantly more similar compared to their baseline choices during the precollaboration phase. Moreover, levels of convergence were comparable between younger and older adults, suggesting age invariance in social influence on delay discounting. The current results demonstrate a degree of malleability in delay discounting that extends into older adulthood, making interventions targeting the construct a promising avenue for future research.     

DISCOUNTING OF DELAYED REWARDS:

Abstract— In this study, children, young adults, and older adults chose between immediate and delayed hypothetical monetary rewards The amount of the delayed reward was held constant while its delay was varied All three age groups showed delay discounting, that is, the amount of an immediate reward judged to be of equal value to the delayed reward decreased as a function of delay The rate of discounting was highest for children and lowest for older adults, predicting a life-span developmental trend toward increased selfcontrol Discounting of delayed rewards by all three age groups was well described by a single function with agesensitive parameters (all R²s>94) Thus, even though there are quantitative age differences in delay discounting, the existence of an age-invanant form of discount function suggests that the process of choosing between rewards of different amounts and delays is qualitatively similar across the life span     

Temporal discounting predicts student responsiveness to exchange delays in a classroom token system

Typical assessments of temporal discounting involve presenting choices between hypothetical monetary outcomes. Participants choose between smaller immediate rewards and larger delayed rewards to determine how the passage of time affects the subjective value of reinforcement. Few studies, however, have compared such discounting to actual manipulations of reward delay. The present study examined the predictive validity of a temporal discounting procedure developed for use with children. Forty-six sixth-grade students completed a brief discounting assessment and were then exposed to a classwide intervention that involved both immediate and delayed reinforcement in a multiple baseline design across classrooms. The parameters derived from two hyperbolic models of discounting correlated significantly with actual on-task behavior under conditions of immediate and delayed exchange. Implications of temporal discounting assessments for behavioral assessment and treatment are discussed.     

Greater delay discounting among girls,but not boys,with ADHD correlates with cognitive control

Cognitive neuroscience models suggest both reward valuation and cognitive control contribute to reward-based decision-making. The current study examined the relationship between cognitive control and delay discounting (i.e., choosing smaller, immediate over larger, delayed rewards) in a large sample of boys and girls diagnosed with attention-deficit/hyperactivity disorder (ADHD; N = 95) and typically developing control children (TD; N = 59). Specifically, we examined performance on multiple measures of cognitive control (i.e., Go/No-Go task, Stop Signal task, and Spatial Span task) and delay discounting (i.e., Classic Delay Discounting and Real-Time Delay Discounting tasks), as well as the relationship between these measures. Results indicated that sex moderated the effects of group on task performance. Specifically, girls with ADHD, but not boys with the disorder, exhibited atypical delay discounting of real-time rewards. Results from correlational analyses indicated that delay discounting and cognitive control were not significantly correlated in the overall sample. Multiple regression analyses demonstrated that among girls with ADHD poorer spatial working memory and inhibitory control predicted greater real-time discounting. Collectively, findings provide support for distinct patterns of cognitive control and delay discounting among school-aged girls and boys with ADHD. Additionally, findings suggest that among girls with ADHD, those who exhibit relatively poor working memory and inhibitory control might be a particularly vulnerable subgroup with the greatest propensity to exhibit maladaptive decision-making.     

A Measure of Delay Discounting Within the Academic Domain

It is important to better understand the decision‐making processes involved in student procrastination, in order to develop interventions that reduce this common problem. Students may procrastinate because studying produces delayed reinforcers; however, no task measuring delay discounting of academic outcomes currently exists. In Experiment 1, we developed and piloted a measure of academic discounting modeled on titrating‐amount tasks successfully used in the discounting literature. Participants made hypothetical choices between working for money (the smaller, sooner reinforcer) and working on an assignment that was due at various times (the larger, later reinforcer). Participants showed systematic decreases in the subjective value of the assignment as a function of delay, and the hyperbolic and hyperboloid models described the shape of this decrease in value well. In general, larger delayed rewards are discounted less steeply than smaller delayed rewards (the magnitude effect). In Experiment 2, we observed the magnitude effect in academic discounting: Participants discounted a “not important” assignment more steeply than an “important” assignment. In the hyperboloid model, this change was captured by an increase in the s parameter. Results provide support for the validity of the academic discounting task. Copyright © 2018 John Wiley & Sons, Ltd.     

High temporal discounters overvalue immediate rewards rather than undervalue future rewards: An event-related brain potential study

Impulsivity is characterized in part by heightened sensitivity to immediate relative to future rewards. Although previous research has suggested that “high discounters” in intertemporal choice tasks tend to prefer immediate over future rewards because they devalue the latter, it remains possible that they instead overvalue immediate rewards. To investigate this question, we recorded the reward positivity, a component of the event-related brain potential (ERP) associated with reward processing, with participants engaged in a task in which they received both immediate and future rewards and nonrewards. The participants also completed a temporal discounting task without ERP recording. We found that immediate but not future rewards elicited the reward positivity. High discounters also produced larger reward positivities to immediate rewards than did low discounters, indicating that high discounters relatively overvalued immediate rewards. These findings suggest that high discounters may be more motivated than low discounters to work for monetary rewards, irrespective of the time of arrival of the incentives.     

Effects of anonymous peer observation on adolescents' preference for immediate rewards

Research suggests that the presence of peers influences adolescent risk‐taking by increasing the perceived reward value of risky decisions. While prior work has involved observation of participants by their friends, the current study examined whether observation by an anonymous peer could elicit similarly increased reward sensitivity. Late adolescent participants completed a delay discounting task either alone or under the belief that performance was being observed from a neighboring room by an unknown viewer of the same gender and age. Even in this limited social context, participants demonstrated a significantly increased preference for smaller, immediate rewards when they believed that they were being watched. This outcome challenges several intuitive accounts of the peer effect on adolescent risk‐taking, and indicates that the peer influence on reward sensitivity during late adolescence is not dependent on familiarity with the observer. The findings have both theoretical and practical implications for our understanding of social influences on adolescents' risky behavior.     

DISCOUNTING OF DELAYED FOOD REWARDS IN PIGEONS AND RATS: IS THERE A MAGNITUDE EFFECT?

Temporal discounting refers to the decrease in the present, subjective value of a reward as the time to its receipt increases. Results from humans have shown that a hyperbola-like function describes the form of the discounting function when choices involve hypothetical monetary rewards. In addition, magnitude effects have been reported in which smaller reward amounts are discounted more steeply than larger amounts. The present research examines the cross-species generality of these findings using real rewards, namely food pellets, with both pigeons and rats. As with humans, an adjusting amount procedure was used to estimate the amount of immediate reward judged equal in value to a delayed reward. Different amounts of delayed food rewards (ranging from 5 to 32 pellets in pigeons and from 5 to 20 pellets in rats) were studied at delays varying from 1 s to 32 s. A simple hyperbola, similar to the hyperbola-like mathematical function that describes the discounting of hypothetical monetary rewards in humans, described the discounting of food rewards in both pigeons and rats. These results extend the generality of the mathematical model of discounting. Rates of discounting delayed food rewards were higher for pigeons than for rats. Unlike humans, however, neither pigeons nor rats showed a reliable magnitude effect: Rate of discounting did not vary systematically as a function of the amount of the delayed reward.     

Gambling and Delay Discounting in Japanese Students

The present study examined the relationship between gambling behavior and delay discounting with Japanese residents. Japanese university students were selected into pathological gambler and non‐gambling control groups using a Japanese version of the South Oaks Gambling Screen. In a discounting task, participants chose individually between a large delayed reward and a smaller immediate reward with varied delays. The discounting rate (k‐value) and the area under the curve were significantly higher and smaller, respectively, for the gambler group than for the control group. These findings show that Japanese gamblers discount delayed rewards more steeply than non‐gambling controls, as has been found in U.S. residents.     

Delay discounting by pathological gamblers

Discounting of delayed rewards by pathological gamblers was compared to discounting of delayed rewards by matched control nongambling participants. All participants completed a hypothetical choice task in which they made repeated choices between dollars 1,000 available after a delay and an equal or lesser amount of money available immediately. The delay to the large amount of money was varied from 1 week to 10 years across conditions. Indifference points between immediate money and delayed money were identified at each delay condition by varying the amount of immediate money across choice trials. For the majority of participants, indifference points decreased monotonically across delays. Overall, gamblers discounted the delayed rewards more steeply than did control participants.     

Delay discounting as impaired valuation: Delayed rewards in an animal obesity model

Obesity is a major public health problem, which, like many forms of addiction, is associated with an elevated tendency to choose smaller immediate rather than larger delayed rewards, a response pattern often referred to as excessive delay discounting. Although some accounts of delay discounting conceptualize this process as impulsivity (placing the emphasis on overvaluing the smaller immediate reward), others have conceptualized delay discounting as an executive function (placing the emphasis on delayed rewards failing to retain their value). The present experiments used a popular animal model of obesity that has been shown to discount delayed rewards at elevated rates (i.e., obese Zucker rats) to test two predictions that conceptualize delay discounting as executive function. In the first experiment, acquisition of lever pressing with delayed rewards was compared in obese versus lean Zucker rats. Contrary to predictions based on delay discounting as executive function, obese Zucker rats learned to press the lever more quickly than controls. In the second experiment, progressive ratio breakpoints (a measure of reward efficacy) with delayed rewards were compared in obese versus lean Zucker rats. Contrary to the notion that obese rats fail to value delayed rewards, the obese Zucker rats' breakpoints were (at least) as high as those of the lean Zucker rats.