Evidence for a magnitude effect in temporal discounting with pigeons

A magnitude effect in human intertemporal choice is well established-larger rewards or outcomes are discounted over time at a lower rate than are smaller rewards. However, many recent studies have failed to find a corresponding effect in nonhuman animals. Here we report a magnitude effect in temporal discounting for pigeons' choices involving a tradeoff between reward delay and amount. Pigeons chose between a small reward (1-s access to food) after a 2-s delay, and a large reward (4.5-s access to food) after a 28-s delay. Across conditions, the delays to the small and large rewards were increased or decreased, respectively. Temporal discounting functions obtained through a value-estimation procedure showed clear evidence of a magnitude effect: The value of the large reward decreased more slowly with increasing delay than the value of the small reward. We linked this result to a nonlinear relationship between choice and the delays associated with the small and large rewards. The nonlinearity was contrary to the generalized matching law but was predicted by the contextual choice model. Our results confirm the existence of a magnitude effect in nonhuman temporal discounting, showing that this adaptation is not unique to humans.     

Introduction to the special issue on comparative cognition

Prior research has shown that nonhumans show an extreme preference for variable‐ over fixed‐delays to reinforcement. This well‐established preference for variability occurs because a reinforcer's strength or “value” decreases according to a curvilinear function as its delay increases. The purpose of the present experiments was to investigate whether this preference for variability occurs with human participants making hypothetical choices. In three experiments, participants recruited from Amazon Mechanical Turk made choices between variable and fixed monetary rewards. In a variable‐delay procedure, participants repeatedly chose between a reward delivered either immediately or after a delay (with equal probability) and a reward after a fixed delay (Experiments 1 and 2). In a double‐reward procedure, participants made choices between an alternative consisting of two rewards, one delivered immediately and one after a delay, and a second alternative consisting of a single reward delivered after a delay (Experiments 1 and 3). Finally, all participants completed a standard delay‐discounting task. Although we observed both curvilinear discounting and magnitude effects in the standard discounting task, we found no consistent evidence of a preference for variability—as predicted by two prominent models of curvilinear discounting (i.e., a simple hyperbola and a hyperboloid)—in our variable‐delay and double‐reward procedures. This failure to observe a preference for variability may be attributed to the hypothetical, rule‐governed nature of choices in the present study. In such contexts, participants may adopt relatively simple strategies for making more complex choices.     

DISCOUNTING OF DELAYED REWARDS:

Abstract— In this study, children, young adults, and older adults chose between immediate and delayed hypothetical monetary rewards The amount of the delayed reward was held constant while its delay was varied All three age groups showed delay discounting, that is, the amount of an immediate reward judged to be of equal value to the delayed reward decreased as a function of delay The rate of discounting was highest for children and lowest for older adults, predicting a life-span developmental trend toward increased selfcontrol Discounting of delayed rewards by all three age groups was well described by a single function with agesensitive parameters (all R²s>94) Thus, even though there are quantitative age differences in delay discounting, the existence of an age-invanant form of discount function suggests that the process of choosing between rewards of different amounts and delays is qualitatively similar across the life span     

A tribute to Howard Rachlin and his two-parameter discounting model: Reliable and flexible model fitting

Delay discounting reflects the rate at which a reward loses its subjective value as a function of delay to that reward. Many models have been proposed to measure delay discounting, and many comparisons have been made among these models. We highlight the two-parameter delay discounting model popularized by Howard Rachlin by demonstrating two key practical features of the Rachlin model. The first feature is flexibility; the Rachlin model fits empirical discounting data closely. Second, when compared with other available two-parameter discounting models, the Rachlin model has the advantage that unique best estimates for parameters are easy to obtain across a wide variety of potential discounting patterns. We focus this work on this second feature in the context of maximum likelihood, showing the relative ease with which the Rachlin model can be utilized compared with the extreme care that must be used with other models for discounting data, focusing on two illustrative cases that pass checks for data validity. Both of these features are demonstrated via a reanalysis of discounting data the authors have previously used for model selection purposes.     

Delay or probability discounting in a model of impulsive behavior: effect of alcohol

Little is known about the acute effects of drugs of abuse on impulsivity and self-control. In this study, impulsivity was assessed in humans using a computer task that measured delay and probability discounting. Discounting describes how much the value of a reward (or punisher) is decreased when its occurrence is either delayed or uncertain. Twenty-four healthy adult volunteers ingested a moderate dose of ethanol (0.5 or 0.8 g/kg ethanol: n = 12 at each dose) or placebo before completing the discounting task. In the task the participants were given a series of choices between a small, immediate, certain amount of money and $10 that was either delayed (0, 2, 30, 180, or 365 days) or probabilistic (i.e., certainty of receipt was 1.0, .9, .75, .5, or .25). The point at which each individual was indifferent between the smaller immediate or certain reward and the $10 delayed or probabilistic reward was identified using an adjusting-amount procedure. The results indicated that (a) delay and probability discounting were well described by a hyperbolic function; (b) delay and probability discounting were positively correlated within subjects; (c) delay and probability discounting were moderately correlated with personality measures of impulsivity; and (d) alcohol had no effect on discounting.     

The effect of temporal constraints on the value of money and other commodities

The value of hypothetical rewards of various delays and durations, consisting of money or other commodities, such as automobile use and vacations, was measured by the psychophysical up-down staircase method using an amount of unrestricted immediate money as the titrated variable. A model of temporal discounting based on implied constraints on anticipated consumption rate described the data. Further explicit constraints on consumption produced predictable deviations from the model. The concept that consumption is normally constrained together with time discounting may also explain the interaction between amount and delay of monetary reward in determining value and may provide the basis for a theory of addiction based on learning to increase consumption rate.     

Temporal Patterning in Probabilistic Choice

Human subjects making repeated choices between probabilistic and near-certain monetary rewards tended to be less risk-averse the shorter the inter-trial interval. Subjects were also less risk-averse when the choice-outcome sequences were clustered in threes than when each choice-outcome sequence was separated from its neighbors by equal intertrial intervals. These results further extend the analogy between delay discounting and probability discounting. Probability discounting, like delay discounting, may be described by hyperbolic function relating discounted value to expected delay to the next reward.     

Gambling and Delay Discounting in Japanese Students

The present study examined the relationship between gambling behavior and delay discounting with Japanese residents. Japanese university students were selected into pathological gambler and non‐gambling control groups using a Japanese version of the South Oaks Gambling Screen. In a discounting task, participants chose individually between a large delayed reward and a smaller immediate reward with varied delays. The discounting rate (k‐value) and the area under the curve were significantly higher and smaller, respectively, for the gambler group than for the control group. These findings show that Japanese gamblers discount delayed rewards more steeply than non‐gambling controls, as has been found in U.S. residents.     

Reformative self‐control and discounting of reward value by delay or effort1

Abstract: The relation between reformative self‐control and discounting of reward value by delay or effort was examined. Thirty‐two Japanese undergraduates were selected based on their scores on a standardized pencil and paper test of self‐control, the Redressive–Reformative Self‐Control Scale ( Sugiwaka, 1995 ). The subjects indicated their preference (i) between a hypothetical 100 000 yen reward available with various delays and a certain reward of variable amount available immediately; or (ii) between a hypothetical 100 000 yen reward available with various efforts and a certain reward of variable amount available without effort. The discounting of delayed reward value was described well by a hyperbolic function proposed by Mazur (1987 ). The slopes of the delayed discounting curves were steeper for subjects who scored low on the Reformative Self‐Control Scale, which is a measure of reformative self‐control and a subscale of the Redressive–Reformative Self‐Control Scale. The discounting by effort was also described well by the hyperbolic function. The slopes of the effortful discounting curves did not correlate to those of the delayed discounting curves. The slopes were not systematically different across the groups of subjects with different scores on the reformative self‐control scale.     

Intertemporal Similarity: Discounting as a Last Resort

Standard models of intertemporal choice assume that individuals discount future payoffs by integrating reward amounts and time delays to generate a discounted value. Alternative models propose that, rather than integrate across them, individuals compare within attributes (amounts and delays) to determine if differences in one attribute outweigh differences in another attribute. For instance, the similarity model 1) compares the two reward amounts to determine whether they are similar, 2) compares the similarity of the two time delays, and then 3) makes a decision based on these similarity judgments. Here, I tested discounting models against attribute‐based models that use similarity judgments to make choices. I collected intertemporal choices and similarity judgments for the reward amounts and time delays from participants in three experiments. All experiments tested the ability of discounting and similarity models to predict intertemporal choices. Model generalization analyses showed that the best predicting models started with similarity judgments and then, if similarity failed to make a prediction, resorted to discounting models. Similarity judgments also matched intertemporal choice data demonstrating both the magnitude and sign effects, thereby accounting for behavioral data that contradict many discounting models. These results highlight the possibility that attribute‐based models such as the similarity models provide alternatives to discounting that may offer insights into the process of making intertemporal choices. Copyright © 2015 John Wiley & Sons, Ltd.     

Delay, Probability, and Social Discounting in A Public Goods Game

A human social discount function measures the value to a person of a reward to another person at a given social distance. Just as delay discounting is a hyperbolic function of delay, and probability discounting is a hyperbolic function of odds-against, social discounting is a hyperbolic function of social distance. Experiment 1 obtained individual social, delay, and probability discount functions for a hypothetical $75 reward; participants also indicated how much of an initial $100 endowment they would contribute to a common investment in a public good. Steepness of discounting correlated, across participants, among all three discount dimensions. However, only social and probability discounting were correlated with the public-good contribution; high public-good contributors were more altruistic and also less risk averse than low contributors. Experiment 2 obtained social discount functions with hypothetical $75 rewards and delay discount functions with hypothetical $1,000 rewards, as well as public-good contributions. The results replicated those of Experiment 1; steepness of the two forms of discounting correlated with each other across participants but only social discounting correlated with the public-good contribution. Most participants in Experiment 2 predicted that the average contribution would be lower than their own contribution.     

Evaluating the effect of delay spacing on delay discounting: carry‐over effects on steepness and the form of the discounting function

Most delay discounting studies use tasks that arrange delay progressions in which the spacing between consecutive delays becomes progressively larger. To date, little research has examined delay discounting using other progressions. The present study assessed whether the form or steepness of discounting varied across different delay progressions. Human participants completed three discounting tasks with delay progressions that varied in the time between consecutive delays: a standard (increasing duration between delays), linear (equal duration between delays), and an inverse progression (decreasing duration between delays). Steepness of discounting was generally reduced, and remained so, following experience with the inverse progression. Effects of the delay progression on the best fitting equation were order‐dependent. Overall the hyperbola model provided better fits, but the exponential model performed better with data from the inverse progression. Regardless, differences in which model fit best were often small. The finding that the best fitting model was dependent, in some cases, on the delay progression suggests that a single quantitative model of discounting may not be applicable to describe discounting across all procedural contexts. Ultimately, changes in steepness of discounting following experience with the inverse progression appeared similar to anchoring effects, whose mechanism will require further study to delineate.     

The relation between temperament and rate of temporal discounting

The present study examines the relationship between several temperamental traits (sensation seeking, extraversion–introversion, and impulsivity) and rate of temporal discounting, that is the rate of decrease in the subjective value of a reward as the delay to its receipt increases. Participants made choices between hypothetical monetary rewards that could be obtained immediately or after a specified delay. Temporal discounting functions were calculated and differences in rate of discounting between different groups were evaluated. For all groups of participants, hyperbolic discounting functions described well the decreases in subjective value with delay (R² ranged from 0.700 to 0.985). The rate of discounting was equivalent in high and low sensation seekers. However, both extraverts and high impulsive individuals showed higher temporal discounting rates than introverts and low impulsive individuals. The relationship between temperament and temporal discounting may be related to differences in time perception and/or to differences in susceptibility to rewards in extraverts versus introverts and in high- versus low-impulsive individuals.     

The delay of gratification test for adults: Validating a behavioral measure of self-motivation in a sample of older people

Most previous delay of gratification tests were developed for children and are inappropriate for application in adults. The authors therefore developed the Delay of Gratification Test for Adults (DoG-A), which includes four types of reward that are meaningful to adults, namely snacks, real money, hypothetical money, and magazines. Four subscores and two composite scores can be calculated. This study is the first to evaluate the DoG-A and to investigate its association with external variables. A community sample of 147 cognitively healthy participants aged between 60 and 94 years completed a questionnaire and cognitive tests measuring delay discounting, self-regulation, motivational self-concept, personality, wellbeing, and cognitive function. The intercorrelations of the subscales were low to medium and the internal consistency of the composite scores was moderate (?? = .4), indicating relative domain independence of the four reward types. The nomological net established by investigating the relations of the DoG-A with other constructs proved to be fairly meaningful. The correlations of all subscales with the delay discounting rate were significant and moderate. The Snacks subscale showed the most consistent pattern of results in terms of moderate positive correlations with self-reported motivation regulation, optimism, dutifulness, and deliberation. The Snacks subscale also correlated with various measures of wellbeing. A regression analysis showed that DoG Snacks remained a significant predictor of wellbeing when self-reported self-regulation and other variables were controlled. These findings indicate that the DoG-A yields an interpretable behavioral measure of self-motivation and offers a developmentally adequate extension of the delay of gratification paradigm for use with adults.     

Age‐related differences in delay discounting: Immediate reward,reward magnitude,and social influence

Delay discounting refers to the tendency of individuals to subjectively devalue rewards that are to be received in the future, with high rates of delay discounting being associated with a variety of maladaptive life outcomes (e.g., unhealthy dietary and exercise behaviors). The current study explored the psychological and social processes involved in adult age‐related differences in delay discounting of monetary rewards. Younger adults exhibited higher levels of delay discounting than older adults. This increased level of patience in older adults was found whether smaller‐sooner rewards were to be received immediately or in the future. However, there was an interaction with reward magnitude, whereby younger adults exhibited higher levels of delay discounting for smaller reward magnitudes but not larger reward magnitudes. Social influence on delay discounting was investigated by having participants complete three phases of the delay‐discounting task: an individual precollaboration phase, a collaboration phase in age‐group‐matched dyads, and an individual postcollaboration phase. A convergence effect was observed in that dyad members' postcollaboration choices were significantly more similar compared to their baseline choices during the precollaboration phase. Moreover, levels of convergence were comparable between younger and older adults, suggesting age invariance in social influence on delay discounting. The current results demonstrate a degree of malleability in delay discounting that extends into older adulthood, making interventions targeting the construct a promising avenue for future research.     

Tests of an indifference rule in variable‐delay and double‐reward choice procedures with humans

Four hundred and fifty participants were recruited from Amazon Mechanical Turk across 3 experiments to test the predictions of a hyperbolic discounting equation in accounting for human choices involving variable delays or multiple rewards (Mazur, 1984, 1986). In Experiment 1, participants made hypothetical choices between 2 monetary alternatives, 1 consisting of a fixed delay and another consisting of 2 delays of equal probability (i.e., a variable‐delay procedure). In Experiment 2, participants made hypothetical monetary choices between a single, immediate reward and 2 rewards, 1 immediate and 1 delayed (i.e., a double‐reward procedure). Experiment 3 also used a double‐reward procedure, but with 2 delayed rewards. Participants in all 3 experiments also completed a standard delay‐discounting task. Finally, 3 reward amounts were tested in each type of task ($100, $1000, and $5000). In the double‐reward conditions (Experiments 2 and 3), the results were in good qualitative and quantitative agreement with Mazur's model (1984, 1986). In contrast, when participants made choices involving variable delays (Experiment 1), there was relatively poor qualitative and quantitative agreement with this model. These results, along with our previous findings, suggest the structure of questions in hypothetical tasks with humans can be a strong determinant of the choice pattern.     

Area under the curve as a measure of discounting

We describe a novel approach to the measurement of discounting based on calculating the area under the empirical discounting function. This approach avoids some of the problems associated with measures based on estimates of the parameters of theoretical discounting functions. The area measure may be easily calculated for both individual and group data collected using any of a variety of current delay and probability discounting procedures. The present approach is not intended as a substitute for theoretical discounting models. It is useful, however, to have a simple, univariate measure of discounting that is not tied to any specific theoretical framework.     

DISCOUNTING OF DELAYED FOOD REWARDS IN PIGEONS AND RATS: IS THERE A MAGNITUDE EFFECT?

Temporal discounting refers to the decrease in the present, subjective value of a reward as the time to its receipt increases. Results from humans have shown that a hyperbola-like function describes the form of the discounting function when choices involve hypothetical monetary rewards. In addition, magnitude effects have been reported in which smaller reward amounts are discounted more steeply than larger amounts. The present research examines the cross-species generality of these findings using real rewards, namely food pellets, with both pigeons and rats. As with humans, an adjusting amount procedure was used to estimate the amount of immediate reward judged equal in value to a delayed reward. Different amounts of delayed food rewards (ranging from 5 to 32 pellets in pigeons and from 5 to 20 pellets in rats) were studied at delays varying from 1 s to 32 s. A simple hyperbola, similar to the hyperbola-like mathematical function that describes the discounting of hypothetical monetary rewards in humans, described the discounting of food rewards in both pigeons and rats. These results extend the generality of the mathematical model of discounting. Rates of discounting delayed food rewards were higher for pigeons than for rats. Unlike humans, however, neither pigeons nor rats showed a reliable magnitude effect: Rate of discounting did not vary systematically as a function of the amount of the delayed reward.     

时间贴现的分段性

以延迟和相对延迟时间贴现的实验范式, 用选择法、匹配法确定价值主观相等点, 探讨时间贴现的分段性。三个实验和一个问卷调查发现, 时间贴现具有分段性。被试的时间贴现有三次显著变化, 表现为三个时段时间贴现心理状态的不同: 从现在到未来2周内规避损失、偏好风险、愿意短期等待, 从未来2周起直到未来10年采取非补偿性策略、需求与风险并重、愿意长期等待, 和从未来10年起直到未来50年规避风险、聊胜于无、不愿意等待。     

Temporal discounting when the choice is between two delayed rewards

The present experiments extend the temporal discounting paradigm from choice between an immediate and a delayed reward to choice between 2 delayed rewards: a smaller amount of money available sooner and a larger amount available later. Across different amounts and delays, the data were consistently well described by a hyperbola-like discounting function, and the degree of discounting decreased systematically as the delay to the sooner reward increased. Three theoretical models (the elimination-by-aspects, present-value comparison, and common-aspect attenuation hypotheses) were evaluated. The best account of the data was provided by the common-aspect attenuation hypothesis, according to which the common aspect of the choice alternatives (i.e., the time until the sooner reward is available) receives less weight in the decision-making process.