Delay, Probability, and Social Discounting in A Public Goods Game

A human social discount function measures the value to a person of a reward to another person at a given social distance. Just as delay discounting is a hyperbolic function of delay, and probability discounting is a hyperbolic function of odds-against, social discounting is a hyperbolic function of social distance. Experiment 1 obtained individual social, delay, and probability discount functions for a hypothetical $75 reward; participants also indicated how much of an initial $100 endowment they would contribute to a common investment in a public good. Steepness of discounting correlated, across participants, among all three discount dimensions. However, only social and probability discounting were correlated with the public-good contribution; high public-good contributors were more altruistic and also less risk averse than low contributors. Experiment 2 obtained social discount functions with hypothetical $75 rewards and delay discount functions with hypothetical $1,000 rewards, as well as public-good contributions. The results replicated those of Experiment 1; steepness of the two forms of discounting correlated with each other across participants but only social discounting correlated with the public-good contribution. Most participants in Experiment 2 predicted that the average contribution would be lower than their own contribution.     

Comparing rapid assessments of delay discounting with real and hypothetical rewards in children

Recent advances in assessment methodology have resulted in a highly efficient procedure for obtaining delay discounting rates for adults: a 5‐trial adjusting delay task (ADT‐5) examining intertemporal choice for hypothetical rewards. The low participant burden of this task makes it potentially useful for children, with whom delay discounting research is relatively limited. However, it is unknown whether results from this task match choice for real rewards. The present study assessed delay discounting for real and hypothetical monetary rewards using a modified ADT‐5 with 9 children admitted to a psychiatric day treatment program. Participants completed up to 3 tasks with each reward type in alternating order. No difference in discounting rate, via log(k), was observed between the first task of each reward type. This finding was replicated across subsequent tasks for the subset of participants (n = 6) who completed all 6 tasks. However, delay discounting of real and hypothetical rewards was not found to be statistically equivalent. These results suggest that a modified ADT‐5 using hypothetical rewards may be a viable option for assessing delay discounting in children with psychiatric diagnoses, but additional research is needed to explicitly examine whether hypothetical and real rewards are discounted equivalently in this population.     

Reformative self‐control and discounting of reward value by delay or effort1

Abstract: The relation between reformative self‐control and discounting of reward value by delay or effort was examined. Thirty‐two Japanese undergraduates were selected based on their scores on a standardized pencil and paper test of self‐control, the Redressive–Reformative Self‐Control Scale ( Sugiwaka, 1995 ). The subjects indicated their preference (i) between a hypothetical 100 000 yen reward available with various delays and a certain reward of variable amount available immediately; or (ii) between a hypothetical 100 000 yen reward available with various efforts and a certain reward of variable amount available without effort. The discounting of delayed reward value was described well by a hyperbolic function proposed by Mazur (1987 ). The slopes of the delayed discounting curves were steeper for subjects who scored low on the Reformative Self‐Control Scale, which is a measure of reformative self‐control and a subscale of the Redressive–Reformative Self‐Control Scale. The discounting by effort was also described well by the hyperbolic function. The slopes of the effortful discounting curves did not correlate to those of the delayed discounting curves. The slopes were not systematically different across the groups of subjects with different scores on the reformative self‐control scale.     

DISCOUNTING OF DELAYED FOOD REWARDS IN PIGEONS AND RATS: IS THERE A MAGNITUDE EFFECT?

Temporal discounting refers to the decrease in the present, subjective value of a reward as the time to its receipt increases. Results from humans have shown that a hyperbola-like function describes the form of the discounting function when choices involve hypothetical monetary rewards. In addition, magnitude effects have been reported in which smaller reward amounts are discounted more steeply than larger amounts. The present research examines the cross-species generality of these findings using real rewards, namely food pellets, with both pigeons and rats. As with humans, an adjusting amount procedure was used to estimate the amount of immediate reward judged equal in value to a delayed reward. Different amounts of delayed food rewards (ranging from 5 to 32 pellets in pigeons and from 5 to 20 pellets in rats) were studied at delays varying from 1 s to 32 s. A simple hyperbola, similar to the hyperbola-like mathematical function that describes the discounting of hypothetical monetary rewards in humans, described the discounting of food rewards in both pigeons and rats. These results extend the generality of the mathematical model of discounting. Rates of discounting delayed food rewards were higher for pigeons than for rats. Unlike humans, however, neither pigeons nor rats showed a reliable magnitude effect: Rate of discounting did not vary systematically as a function of the amount of the delayed reward.     

Effort discounting in human nucleus accumbens

A great deal of behavioral and economic research suggests that the value attached to a reward stands in inverse relation to the amount of effort required to obtain it, a principle known as effort discounting. In the present article, we present the first direct evidence for a neural analogue of effort discounting. We used fMRI to measure neural responses to monetary rewards in the human nucleus accumbens (NAcc), a structure previously demonstrated to encode reference-dependent reward information. The magnitude of accumbens activation was found to vary with both reward outcome and the degree of mental effort demanded to obtain individual rewards. For a fixed level of reward, the NAcc was less strongly activated following a high-demand for effort than following a low demand. The magnitude of this effect was noted to correlate with preceding activation in the dorsal anterior cingulate cortex, a region that has been proposed to monitor information-processing demands and to mediate in the subjective experience of effort.     

Within-subject comparison of real and hypothetical money rewards in delay discounting

A within-subject design, using human participants, compared delay discounting functions for real and hypothetical money rewards. Both real and hypothetical rewards were studied across a range that included $10 to $250. For 5 of the 6 participants, no systematic difference in discount rate was observed in response to real and hypothetical choices, suggesting that hypothetical rewards may often serve as a valid proxy for real rewards in delay discounting research. By measuring discounting at an unprecedented range of real rewards, this study has also systematically replicated the robust finding in human delay discounting research that discount rates decrease with increasing magnitude of reward. A hyperbolic decay model described the data better than an exponential model.     

Are people really more patient than other animals? Evidence from human discounting of real liquid rewards

In previous studies, researchers have found that humans discount delayed rewards orders of magnitude less steeply than do other animals. Humans also discount smaller delayed reward amounts more steeply than larger amounts, whereas animals apparently do not. These differences between humans and animals might reflect differences in the types of rewards studied and/or the fact that animals actually had to wait for their rewards. In the present article, we report the results of three experiments in which people made choices involving liquid rewards delivered and consumed after actual delays, thereby bridging the gap between animal and human studies. Under these circumstances, humans, like animals, discounted the value of rewards delayed by seconds; however, unlike animals, they still showed an effect of reward amount. Human discounting was well described by the same hyperboloid function that has previously been shown to describe animal discounting of delayed food and water rewards, as well as human discounting of real and hypothetical monetary rewards.     

Temporal discounting of monetary rewards in children and adolescents with ADHD and autism spectrum disorders

It has been difficult to differentiate attention‐deficit/hyperactivity disorder (ADHD) and autism spectrum disorder (ASD) in terms of some aspects of their cognitive profile. While both show deficits in executive functions, it has been suggested that they may differ in their response to monetary reward. For instance, children with ADHD prefer small immediate over large delayed rewards more than typically developing controls. One explanation for this is that they discount the value of rewards to a higher degree as they are moved into the future. The current study investigated whether children with ADHD can be differentiated from those with ASD in terms of reward discounting. Thirty‐nine children (8–16 y) with ADHD, 34 children with ASD and 46 typically developing controls performed a hypothetical monetary temporal discounting task. Participants were instructed to make repeated choices between small variable rewards (0, 5, 10, 20, 30€) delivered immediately and large rewards delivered after a variable delay. Children with ADHD but not ASD discounted future rewards at a higher rate than typically developing controls. These data confirm steeper discounting of future rewards in ADHD and add to a small but growing literature showing that the psychological profile of ADHD can be distinguished from that of ASD in terms of disrupted motivational processes.     

The absence of numbers to express the amount may affect delay discounting with humans

Human delay discounting is usually studied with experimental protocols that use symbols to express delay and amount. In order to further understand discounting, we evaluated whether the absence of numbers to represent reward amounts affects discount rate in general, and whether the magnitude effect is generalized to nonsymbolic situations in particular. In Experiment 1, human participants were exposed to a delay‐discounting task in which rewards were presented using dots to represent monetary rewards (nonsymbolic); under this condition the magnitude effect did not occur. Nevertheless, the magnitude effect was observed when equivalent reward amounts were presented using numbers (symbolic). Moreover, in estimation tasks, magnitude increments produced underestimation of large amounts. In Experiment 2, participants were exposed only to the nonsymbolic discounting task and were required to estimate reward amounts in each trial. Consistent with Experiment 1, the absence of numbers representing reward amounts produced similar discount rates of small and large rewards. These results suggest that value of nonsymbolic rewards is a nonlinear function of amount and that value attribution depends on perceived difference between the immediate and the delayed nonsymbolic rewards.     

Delay-discounting probabilistic rewards: Rates decrease as amounts increase

The independence of delay-discounting rate and monetary reward size was tested by offering subjects (N = 621) a series of choices between immediate rewards and larger, delayed rewards. In contrast to previous studies, in which hypothetical rewards have typically been employed, subjects in the present study were entered into a lottery in which they had a chance of actually receiving one of their choices. The delayed rewards were grouped into small ($30–$35), medium ($55–$65), and large amounts ($70–$85). Using a novel parameter estimation procedure, we estimated discounting rates for all three reward sizes for each subject on the basis of his/her pattern of choices. The data indicated that the discounting rate is a decreasing function of the size of the delayed reward (p < .0001), whether hyperbolic or exponential discounting functions are assumed. In addition, a reliable gender difference was found (p = .005), with males discounting at higher rates than females, on average.     

Modeling Myopic Decisions: Evidence for Hyperbolic Delay-Discounting within Subjects and Amounts

Hyperbolic and exponential discounting functions were compared as models of subjects′ present valuations of delayed rewards. Previous comparisons have been limited by relying on the assumption that discounting rate is independent of reward size; we avoided this limitation by making all comparisons within reward sizes. In Experiment 1, using real rewards in a simulated auction, and in Experiment 2, using hypothetical rewards, we offered subjects five monetary rewards at six delays each and asked them to indicate the smallest amount that they would accept immediately in exchange for those rewards. Both discounting functions were then fit to the six reported amounts for each reward using nonlinear regressions. In both experiments, although both functions fit the data very well, the hyperbolic function fit better for all of the delayed rewards. Furthermore, the hyperbolic function better described the data for 20 of 21 and 14 of 18 subjects in Experiments 1 and 2, respectively.     

Positive mood effects on delay discounting

Delay discounting is the process by which the value of an expected reward decreases as the delay to obtaining that reward increases. Individuals with higher discounting rates tend to prefer smaller immediate rewards over larger delayed rewards. Previous research has indicated that personality can influence an individual's discounting rates, with higher levels of Extraversion predicting a preference for immediate gratification. The current study examined how this relationship would be influenced by situational mood inductions. While main effects were observed for both Extraversion and cognitive ability in the prediction of discounting rates, a significant interaction was also observed between Extraversion and positive affect. Extraverted individuals were more likely to prefer an immediate reward when first put in a positive mood. Extraverts thus appear particularly sensitive to impulsive, incentive-reward-driven behavior by temperament and by situational factors heightening positive affect.     

Effects of reward magnitude frames on measures of delay discounting in a hypothetical money scenario

The current study analyzed the effects of three frames of reward magnitude—quantity, volume, and duration—on the rate at which college students discounted hypothetical, delayed monetary rewards. Hypothetical scenarios were presented using the fill-in-the-blank discounting questionnaire and participants made choices between immediate and delayed hypothetical monetary rewards. Scenarios framed the monetary choices as (a) quantity of dollar bills, (b) height (inches) of a stack of dollar bills, and (c) duration of time spent in a hypothetical cash machine to collect dollar bills. For each scenario, participants' subjective values were used to calculate the area under the curve (AuC). Framing resulted in a moderate effect size: The duration frame yielded significantly smaller AuC values compared to the quantity and volume frames. Thus, the framing of reward magnitude was a significant variable in controlling discounting rates for hypothetical, delayed monetary rewards. Subsequent investigations should be aware of the independent effects of the reward magnitude frames on delay discounting rates.     

DISCOUNTING OF DELAYED REWARDS:

Abstract— In this study, children, young adults, and older adults chose between immediate and delayed hypothetical monetary rewards The amount of the delayed reward was held constant while its delay was varied All three age groups showed delay discounting, that is, the amount of an immediate reward judged to be of equal value to the delayed reward decreased as a function of delay The rate of discounting was highest for children and lowest for older adults, predicting a life-span developmental trend toward increased selfcontrol Discounting of delayed rewards by all three age groups was well described by a single function with agesensitive parameters (all R²s>94) Thus, even though there are quantitative age differences in delay discounting, the existence of an age-invanant form of discount function suggests that the process of choosing between rewards of different amounts and delays is qualitatively similar across the life span     

Dissociation of reward and effort sensitivity in methcathinone‐induced Parkinsonism

Methcathinone‐induced Parkinsonism is a recently described extrapyramidal syndrome characterized by globus pallidus and substantia nigra lesions, which provides a unique model of basal ganglia dysfunction. We assessed motivated behaviour in this condition using a novel cost‐benefit decision‐making task, in which participants decided whether it was worth investing effort for reward. Patients showed a dissociation between reward and effort sensitivity, such that pallidonigral complex dysfunction caused them to become less sensitive to rewards, while normal sensitivity to effort costs was maintained.     

Age‐related differences in delay discounting: Immediate reward,reward magnitude,and social influence

Delay discounting refers to the tendency of individuals to subjectively devalue rewards that are to be received in the future, with high rates of delay discounting being associated with a variety of maladaptive life outcomes (e.g., unhealthy dietary and exercise behaviors). The current study explored the psychological and social processes involved in adult age‐related differences in delay discounting of monetary rewards. Younger adults exhibited higher levels of delay discounting than older adults. This increased level of patience in older adults was found whether smaller‐sooner rewards were to be received immediately or in the future. However, there was an interaction with reward magnitude, whereby younger adults exhibited higher levels of delay discounting for smaller reward magnitudes but not larger reward magnitudes. Social influence on delay discounting was investigated by having participants complete three phases of the delay‐discounting task: an individual precollaboration phase, a collaboration phase in age‐group‐matched dyads, and an individual postcollaboration phase. A convergence effect was observed in that dyad members' postcollaboration choices were significantly more similar compared to their baseline choices during the precollaboration phase. Moreover, levels of convergence were comparable between younger and older adults, suggesting age invariance in social influence on delay discounting. The current results demonstrate a degree of malleability in delay discounting that extends into older adulthood, making interventions targeting the construct a promising avenue for future research.     

Introduction to the special issue on comparative cognition

Prior research has shown that nonhumans show an extreme preference for variable‐ over fixed‐delays to reinforcement. This well‐established preference for variability occurs because a reinforcer's strength or “value” decreases according to a curvilinear function as its delay increases. The purpose of the present experiments was to investigate whether this preference for variability occurs with human participants making hypothetical choices. In three experiments, participants recruited from Amazon Mechanical Turk made choices between variable and fixed monetary rewards. In a variable‐delay procedure, participants repeatedly chose between a reward delivered either immediately or after a delay (with equal probability) and a reward after a fixed delay (Experiments 1 and 2). In a double‐reward procedure, participants made choices between an alternative consisting of two rewards, one delivered immediately and one after a delay, and a second alternative consisting of a single reward delivered after a delay (Experiments 1 and 3). Finally, all participants completed a standard delay‐discounting task. Although we observed both curvilinear discounting and magnitude effects in the standard discounting task, we found no consistent evidence of a preference for variability—as predicted by two prominent models of curvilinear discounting (i.e., a simple hyperbola and a hyperboloid)—in our variable‐delay and double‐reward procedures. This failure to observe a preference for variability may be attributed to the hypothetical, rule‐governed nature of choices in the present study. In such contexts, participants may adopt relatively simple strategies for making more complex choices.     

Temporal discounting predicts student responsiveness to exchange delays in a classroom token system

Typical assessments of temporal discounting involve presenting choices between hypothetical monetary outcomes. Participants choose between smaller immediate rewards and larger delayed rewards to determine how the passage of time affects the subjective value of reinforcement. Few studies, however, have compared such discounting to actual manipulations of reward delay. The present study examined the predictive validity of a temporal discounting procedure developed for use with children. Forty-six sixth-grade students completed a brief discounting assessment and were then exposed to a classwide intervention that involved both immediate and delayed reinforcement in a multiple baseline design across classrooms. The parameters derived from two hyperbolic models of discounting correlated significantly with actual on-task behavior under conditions of immediate and delayed exchange. Implications of temporal discounting assessments for behavioral assessment and treatment are discussed.     

The role of effort type and intensity in children's decisions about effort-based outcomes

Despite the importance of persistence in early learning, we know little about how children reason about outcomes that result from their efforts. Here we examined the role of effort type (i.e., physical vs. cognitive) and intensity (i.e., high vs. low effort) in shaping children's decision making about effort-based rewards. Five- to 7-year-olds (N = 133) were assigned to one of four conditions (High Physical Effort, Low Physical Effort, High Cognitive Effort, Low Cognitive Effort) and completed a series of tasks to construct a toy. Tasks varied in the type (physical/cognitive) and intensity (high/low) of effort required to complete them. After constructing their toy, children completed a series of tasks to probe how much they valued that toy. Across conditions, children preferred their toy and gave it a higher monetary value, relative to a stranger's. However, when choosing their toy came at a cost, children no longer preferred it. Only children who built their toy through either cognitive or low effort were willing to incur a cost for their toy. Older children, across conditions, were also more likely to incur a cost for their toy. These findings demonstrate that by age five, children are sensitive to variations in effort type and intensity, and these factors shape how they evaluate effort-based rewards.