Introduction to the special issue on comparative cognition

Prior research has shown that nonhumans show an extreme preference for variable‐ over fixed‐delays to reinforcement. This well‐established preference for variability occurs because a reinforcer's strength or “value” decreases according to a curvilinear function as its delay increases. The purpose of the present experiments was to investigate whether this preference for variability occurs with human participants making hypothetical choices. In three experiments, participants recruited from Amazon Mechanical Turk made choices between variable and fixed monetary rewards. In a variable‐delay procedure, participants repeatedly chose between a reward delivered either immediately or after a delay (with equal probability) and a reward after a fixed delay (Experiments 1 and 2). In a double‐reward procedure, participants made choices between an alternative consisting of two rewards, one delivered immediately and one after a delay, and a second alternative consisting of a single reward delivered after a delay (Experiments 1 and 3). Finally, all participants completed a standard delay‐discounting task. Although we observed both curvilinear discounting and magnitude effects in the standard discounting task, we found no consistent evidence of a preference for variability—as predicted by two prominent models of curvilinear discounting (i.e., a simple hyperbola and a hyperboloid)—in our variable‐delay and double‐reward procedures. This failure to observe a preference for variability may be attributed to the hypothetical, rule‐governed nature of choices in the present study. In such contexts, participants may adopt relatively simple strategies for making more complex choices.     

Effects of reward magnitude frames on measures of delay discounting in a hypothetical money scenario

The current study analyzed the effects of three frames of reward magnitude—quantity, volume, and duration—on the rate at which college students discounted hypothetical, delayed monetary rewards. Hypothetical scenarios were presented using the fill-in-the-blank discounting questionnaire and participants made choices between immediate and delayed hypothetical monetary rewards. Scenarios framed the monetary choices as (a) quantity of dollar bills, (b) height (inches) of a stack of dollar bills, and (c) duration of time spent in a hypothetical cash machine to collect dollar bills. For each scenario, participants' subjective values were used to calculate the area under the curve (AuC). Framing resulted in a moderate effect size: The duration frame yielded significantly smaller AuC values compared to the quantity and volume frames. Thus, the framing of reward magnitude was a significant variable in controlling discounting rates for hypothetical, delayed monetary rewards. Subsequent investigations should be aware of the independent effects of the reward magnitude frames on delay discounting rates.     

Within-subject comparison of real and hypothetical money rewards in delay discounting

A within-subject design, using human participants, compared delay discounting functions for real and hypothetical money rewards. Both real and hypothetical rewards were studied across a range that included $10 to $250. For 5 of the 6 participants, no systematic difference in discount rate was observed in response to real and hypothetical choices, suggesting that hypothetical rewards may often serve as a valid proxy for real rewards in delay discounting research. By measuring discounting at an unprecedented range of real rewards, this study has also systematically replicated the robust finding in human delay discounting research that discount rates decrease with increasing magnitude of reward. A hyperbolic decay model described the data better than an exponential model.     

Comparing rapid assessments of delay discounting with real and hypothetical rewards in children

Recent advances in assessment methodology have resulted in a highly efficient procedure for obtaining delay discounting rates for adults: a 5‐trial adjusting delay task (ADT‐5) examining intertemporal choice for hypothetical rewards. The low participant burden of this task makes it potentially useful for children, with whom delay discounting research is relatively limited. However, it is unknown whether results from this task match choice for real rewards. The present study assessed delay discounting for real and hypothetical monetary rewards using a modified ADT‐5 with 9 children admitted to a psychiatric day treatment program. Participants completed up to 3 tasks with each reward type in alternating order. No difference in discounting rate, via log(k), was observed between the first task of each reward type. This finding was replicated across subsequent tasks for the subset of participants (n = 6) who completed all 6 tasks. However, delay discounting of real and hypothetical rewards was not found to be statistically equivalent. These results suggest that a modified ADT‐5 using hypothetical rewards may be a viable option for assessing delay discounting in children with psychiatric diagnoses, but additional research is needed to explicitly examine whether hypothetical and real rewards are discounted equivalently in this population.     

Age‐related differences in delay discounting: Immediate reward,reward magnitude,and social influence

Delay discounting refers to the tendency of individuals to subjectively devalue rewards that are to be received in the future, with high rates of delay discounting being associated with a variety of maladaptive life outcomes (e.g., unhealthy dietary and exercise behaviors). The current study explored the psychological and social processes involved in adult age‐related differences in delay discounting of monetary rewards. Younger adults exhibited higher levels of delay discounting than older adults. This increased level of patience in older adults was found whether smaller‐sooner rewards were to be received immediately or in the future. However, there was an interaction with reward magnitude, whereby younger adults exhibited higher levels of delay discounting for smaller reward magnitudes but not larger reward magnitudes. Social influence on delay discounting was investigated by having participants complete three phases of the delay‐discounting task: an individual precollaboration phase, a collaboration phase in age‐group‐matched dyads, and an individual postcollaboration phase. A convergence effect was observed in that dyad members' postcollaboration choices were significantly more similar compared to their baseline choices during the precollaboration phase. Moreover, levels of convergence were comparable between younger and older adults, suggesting age invariance in social influence on delay discounting. The current results demonstrate a degree of malleability in delay discounting that extends into older adulthood, making interventions targeting the construct a promising avenue for future research.     

The absence of numbers to express the amount may affect delay discounting with humans

Human delay discounting is usually studied with experimental protocols that use symbols to express delay and amount. In order to further understand discounting, we evaluated whether the absence of numbers to represent reward amounts affects discount rate in general, and whether the magnitude effect is generalized to nonsymbolic situations in particular. In Experiment 1, human participants were exposed to a delay‐discounting task in which rewards were presented using dots to represent monetary rewards (nonsymbolic); under this condition the magnitude effect did not occur. Nevertheless, the magnitude effect was observed when equivalent reward amounts were presented using numbers (symbolic). Moreover, in estimation tasks, magnitude increments produced underestimation of large amounts. In Experiment 2, participants were exposed only to the nonsymbolic discounting task and were required to estimate reward amounts in each trial. Consistent with Experiment 1, the absence of numbers representing reward amounts produced similar discount rates of small and large rewards. These results suggest that value of nonsymbolic rewards is a nonlinear function of amount and that value attribution depends on perceived difference between the immediate and the delayed nonsymbolic rewards.     

Delay-discounting probabilistic rewards: Rates decrease as amounts increase

The independence of delay-discounting rate and monetary reward size was tested by offering subjects (N = 621) a series of choices between immediate rewards and larger, delayed rewards. In contrast to previous studies, in which hypothetical rewards have typically been employed, subjects in the present study were entered into a lottery in which they had a chance of actually receiving one of their choices. The delayed rewards were grouped into small ($30–$35), medium ($55–$65), and large amounts ($70–$85). Using a novel parameter estimation procedure, we estimated discounting rates for all three reward sizes for each subject on the basis of his/her pattern of choices. The data indicated that the discounting rate is a decreasing function of the size of the delayed reward (p < .0001), whether hyperbolic or exponential discounting functions are assumed. In addition, a reliable gender difference was found (p = .005), with males discounting at higher rates than females, on average.     

DISCOUNTING OF DELAYED FOOD REWARDS IN PIGEONS AND RATS: IS THERE A MAGNITUDE EFFECT?

Temporal discounting refers to the decrease in the present, subjective value of a reward as the time to its receipt increases. Results from humans have shown that a hyperbola-like function describes the form of the discounting function when choices involve hypothetical monetary rewards. In addition, magnitude effects have been reported in which smaller reward amounts are discounted more steeply than larger amounts. The present research examines the cross-species generality of these findings using real rewards, namely food pellets, with both pigeons and rats. As with humans, an adjusting amount procedure was used to estimate the amount of immediate reward judged equal in value to a delayed reward. Different amounts of delayed food rewards (ranging from 5 to 32 pellets in pigeons and from 5 to 20 pellets in rats) were studied at delays varying from 1 s to 32 s. A simple hyperbola, similar to the hyperbola-like mathematical function that describes the discounting of hypothetical monetary rewards in humans, described the discounting of food rewards in both pigeons and rats. These results extend the generality of the mathematical model of discounting. Rates of discounting delayed food rewards were higher for pigeons than for rats. Unlike humans, however, neither pigeons nor rats showed a reliable magnitude effect: Rate of discounting did not vary systematically as a function of the amount of the delayed reward.     

Delay, Probability, and Social Discounting in A Public Goods Game

A human social discount function measures the value to a person of a reward to another person at a given social distance. Just as delay discounting is a hyperbolic function of delay, and probability discounting is a hyperbolic function of odds-against, social discounting is a hyperbolic function of social distance. Experiment 1 obtained individual social, delay, and probability discount functions for a hypothetical $75 reward; participants also indicated how much of an initial $100 endowment they would contribute to a common investment in a public good. Steepness of discounting correlated, across participants, among all three discount dimensions. However, only social and probability discounting were correlated with the public-good contribution; high public-good contributors were more altruistic and also less risk averse than low contributors. Experiment 2 obtained social discount functions with hypothetical $75 rewards and delay discount functions with hypothetical $1,000 rewards, as well as public-good contributions. The results replicated those of Experiment 1; steepness of the two forms of discounting correlated with each other across participants but only social discounting correlated with the public-good contribution. Most participants in Experiment 2 predicted that the average contribution would be lower than their own contribution.     

Modeling Myopic Decisions: Evidence for Hyperbolic Delay-Discounting within Subjects and Amounts

Hyperbolic and exponential discounting functions were compared as models of subjects′ present valuations of delayed rewards. Previous comparisons have been limited by relying on the assumption that discounting rate is independent of reward size; we avoided this limitation by making all comparisons within reward sizes. In Experiment 1, using real rewards in a simulated auction, and in Experiment 2, using hypothetical rewards, we offered subjects five monetary rewards at six delays each and asked them to indicate the smallest amount that they would accept immediately in exchange for those rewards. Both discounting functions were then fit to the six reported amounts for each reward using nonlinear regressions. In both experiments, although both functions fit the data very well, the hyperbolic function fit better for all of the delayed rewards. Furthermore, the hyperbolic function better described the data for 20 of 21 and 14 of 18 subjects in Experiments 1 and 2, respectively.     

Temporal discounting of monetary rewards in children and adolescents with ADHD and autism spectrum disorders

It has been difficult to differentiate attention‐deficit/hyperactivity disorder (ADHD) and autism spectrum disorder (ASD) in terms of some aspects of their cognitive profile. While both show deficits in executive functions, it has been suggested that they may differ in their response to monetary reward. For instance, children with ADHD prefer small immediate over large delayed rewards more than typically developing controls. One explanation for this is that they discount the value of rewards to a higher degree as they are moved into the future. The current study investigated whether children with ADHD can be differentiated from those with ASD in terms of reward discounting. Thirty‐nine children (8–16 y) with ADHD, 34 children with ASD and 46 typically developing controls performed a hypothetical monetary temporal discounting task. Participants were instructed to make repeated choices between small variable rewards (0, 5, 10, 20, 30€) delivered immediately and large rewards delivered after a variable delay. Children with ADHD but not ASD discounted future rewards at a higher rate than typically developing controls. These data confirm steeper discounting of future rewards in ADHD and add to a small but growing literature showing that the psychological profile of ADHD can be distinguished from that of ASD in terms of disrupted motivational processes.     

DISCOUNTING OF DELAYED REWARDS:

Abstract— In this study, children, young adults, and older adults chose between immediate and delayed hypothetical monetary rewards The amount of the delayed reward was held constant while its delay was varied All three age groups showed delay discounting, that is, the amount of an immediate reward judged to be of equal value to the delayed reward decreased as a function of delay The rate of discounting was highest for children and lowest for older adults, predicting a life-span developmental trend toward increased selfcontrol Discounting of delayed rewards by all three age groups was well described by a single function with agesensitive parameters (all R²s>94) Thus, even though there are quantitative age differences in delay discounting, the existence of an age-invanant form of discount function suggests that the process of choosing between rewards of different amounts and delays is qualitatively similar across the life span     

The relation between temperament and rate of temporal discounting

The present study examines the relationship between several temperamental traits (sensation seeking, extraversion–introversion, and impulsivity) and rate of temporal discounting, that is the rate of decrease in the subjective value of a reward as the delay to its receipt increases. Participants made choices between hypothetical monetary rewards that could be obtained immediately or after a specified delay. Temporal discounting functions were calculated and differences in rate of discounting between different groups were evaluated. For all groups of participants, hyperbolic discounting functions described well the decreases in subjective value with delay (R² ranged from 0.700 to 0.985). The rate of discounting was equivalent in high and low sensation seekers. However, both extraverts and high impulsive individuals showed higher temporal discounting rates than introverts and low impulsive individuals. The relationship between temperament and temporal discounting may be related to differences in time perception and/or to differences in susceptibility to rewards in extraverts versus introverts and in high- versus low-impulsive individuals.     

Reformative self‐control and discounting of reward value by delay or effort1

Abstract: The relation between reformative self‐control and discounting of reward value by delay or effort was examined. Thirty‐two Japanese undergraduates were selected based on their scores on a standardized pencil and paper test of self‐control, the Redressive–Reformative Self‐Control Scale ( Sugiwaka, 1995 ). The subjects indicated their preference (i) between a hypothetical 100 000 yen reward available with various delays and a certain reward of variable amount available immediately; or (ii) between a hypothetical 100 000 yen reward available with various efforts and a certain reward of variable amount available without effort. The discounting of delayed reward value was described well by a hyperbolic function proposed by Mazur (1987 ). The slopes of the delayed discounting curves were steeper for subjects who scored low on the Reformative Self‐Control Scale, which is a measure of reformative self‐control and a subscale of the Redressive–Reformative Self‐Control Scale. The discounting by effort was also described well by the hyperbolic function. The slopes of the effortful discounting curves did not correlate to those of the delayed discounting curves. The slopes were not systematically different across the groups of subjects with different scores on the reformative self‐control scale.     

Temporal discounting predicts student responsiveness to exchange delays in a classroom token system

Typical assessments of temporal discounting involve presenting choices between hypothetical monetary outcomes. Participants choose between smaller immediate rewards and larger delayed rewards to determine how the passage of time affects the subjective value of reinforcement. Few studies, however, have compared such discounting to actual manipulations of reward delay. The present study examined the predictive validity of a temporal discounting procedure developed for use with children. Forty-six sixth-grade students completed a brief discounting assessment and were then exposed to a classwide intervention that involved both immediate and delayed reinforcement in a multiple baseline design across classrooms. The parameters derived from two hyperbolic models of discounting correlated significantly with actual on-task behavior under conditions of immediate and delayed exchange. Implications of temporal discounting assessments for behavioral assessment and treatment are discussed.     

Evidence for a magnitude effect in temporal discounting with pigeons

A magnitude effect in human intertemporal choice is well established-larger rewards or outcomes are discounted over time at a lower rate than are smaller rewards. However, many recent studies have failed to find a corresponding effect in nonhuman animals. Here we report a magnitude effect in temporal discounting for pigeons' choices involving a tradeoff between reward delay and amount. Pigeons chose between a small reward (1-s access to food) after a 2-s delay, and a large reward (4.5-s access to food) after a 28-s delay. Across conditions, the delays to the small and large rewards were increased or decreased, respectively. Temporal discounting functions obtained through a value-estimation procedure showed clear evidence of a magnitude effect: The value of the large reward decreased more slowly with increasing delay than the value of the small reward. We linked this result to a nonlinear relationship between choice and the delays associated with the small and large rewards. The nonlinearity was contrary to the generalized matching law but was predicted by the contextual choice model. Our results confirm the existence of a magnitude effect in nonhuman temporal discounting, showing that this adaptation is not unique to humans.     

The effect of temporal constraints on the value of money and other commodities

The value of hypothetical rewards of various delays and durations, consisting of money or other commodities, such as automobile use and vacations, was measured by the psychophysical up-down staircase method using an amount of unrestricted immediate money as the titrated variable. A model of temporal discounting based on implied constraints on anticipated consumption rate described the data. Further explicit constraints on consumption produced predictable deviations from the model. The concept that consumption is normally constrained together with time discounting may also explain the interaction between amount and delay of monetary reward in determining value and may provide the basis for a theory of addiction based on learning to increase consumption rate.     

Tradeoffs in choice between risk and delay depend on monetary amounts

In Experiments 1 and 2, 25 and 48 college students made binary choices between hypothetical money amounts. In Part A, choices were between small amounts available with certainty and larger amounts ($10 to $10,000) available with risk. Choices in Part B were between immediate small amounts and delayed larger amounts. As money amount grew, risk aversion and delay aversion both changed but in opposite ways: Risk aversion grew but delay aversion shrank. Part C of Experiment 1 pitted risky amounts against delayed amounts, and its results were consistent with those of Parts A and B. Equivalences of particular risks and delays depended on the particular monetary amounts to which they attached. In Experiment 3, 20 college students made binary choices between money amounts, knowing that they would actually receive some of the selections they made. In Part A, choices were between certain small amounts and risky larger amounts ($1 and $10). Choice problems in Part B were between immediate small amounts and delayed receipt of $1 or $10. The results were like those of Experiment 1, though weaker. These results argue against models of choice that posit an equivalence of risk and delay that is independent of monetary amount.     

Pathological gamblers, with and without substance use disorders, discount delayed rewards at high rates

Pathological gambling is classified as a disorder of impulse control, yet little research has evaluated behavioral indices of impulsivity in gamblers. The rates at which rewards delayed in time are subjectively devalued may be a behavioral marker of impulsivity. This study evaluated delay discounting in 60 pathological gamblers and 26 control participants. Gamblers were divided into those with (n = 21) and without (n = 39) substance use disorders. A hypothetical $1,000 reward was delayed at intervals ranging from 6 hr to 25 years, and immediate rewards varied from $1 to $999. Pathological gamblers discounted delayed rewards at higher rates than control participants, and gamblers with substance use disorders discounted delayed rewards at higher rates than non-substance-abusing gamblers. These data provide further evidence that rapid discounting of delayed rewards may be a feature central to impulse control and addictive disorders, including pathological gambling.     

Are people really more patient than other animals? Evidence from human discounting of real liquid rewards

In previous studies, researchers have found that humans discount delayed rewards orders of magnitude less steeply than do other animals. Humans also discount smaller delayed reward amounts more steeply than larger amounts, whereas animals apparently do not. These differences between humans and animals might reflect differences in the types of rewards studied and/or the fact that animals actually had to wait for their rewards. In the present article, we report the results of three experiments in which people made choices involving liquid rewards delivered and consumed after actual delays, thereby bridging the gap between animal and human studies. Under these circumstances, humans, like animals, discounted the value of rewards delayed by seconds; however, unlike animals, they still showed an effect of reward amount. Human discounting was well described by the same hyperboloid function that has previously been shown to describe animal discounting of delayed food and water rewards, as well as human discounting of real and hypothetical monetary rewards.