A mechanism for reducing delay discounting by altering temporal attention

Rewards that are not immediately available are discounted compared to rewards that are immediately available. The more a person discounts a delayed reward, the more likely that person is to have a range of behavioral problems, including clinical disorders. This latter observation has motivated the search for interventions that reduce discounting. One surprisingly simple method to reduce discounting is an "explicit-zero" reframing that states default or null outcomes. Reframing a classical discounting choice as "something now but nothing later" versus "nothing now but more later" decreases discount rates. However, it is not clear how this "explicit-zero" framing intervention works. The present studies delineate and test two possible mechanisms to explain the phenomenon. One mechanism proposes that the explicit-zero framing creates the impression of an improving sequence, thereby enhancing the present value of the delayed reward. A second possible mechanism posits an increase in attention allocation to temporally distant reward representations. In four experiments, we distinguish between these two hypothesized mechanisms and conclude that the temporal attention hypothesis is superior for explaining our results. We propose a model of temporal attention whereby framing affects intertemporal preferences by modifying present bias.     

Are people really more patient than other animals? Evidence from human discounting of real liquid rewards

In previous studies, researchers have found that humans discount delayed rewards orders of magnitude less steeply than do other animals. Humans also discount smaller delayed reward amounts more steeply than larger amounts, whereas animals apparently do not. These differences between humans and animals might reflect differences in the types of rewards studied and/or the fact that animals actually had to wait for their rewards. In the present article, we report the results of three experiments in which people made choices involving liquid rewards delivered and consumed after actual delays, thereby bridging the gap between animal and human studies. Under these circumstances, humans, like animals, discounted the value of rewards delayed by seconds; however, unlike animals, they still showed an effect of reward amount. Human discounting was well described by the same hyperboloid function that has previously been shown to describe animal discounting of delayed food and water rewards, as well as human discounting of real and hypothetical monetary rewards.     

Discounting of food and water in rats shows trait- and state-like characteristics

Delay discounting is the loss in value of an outcome as a function of its delay. The present study focused on examining a trait-like characteristic of delay discounting in a preclinical animal model. Specifically, we were interested in whether there was a positive relation between discounting of 2 different outcomes in rats. That is, would rats that discount delayed food steeply also discount delayed water steeply? In addition, we examined how session-to-session variability in discounting could be attributed to differences between subjects (trait variability) and to differences within subjects (state variability). Finally, we measured discounting from early- to mid-adulthood, allowing us to examine changes in discounting as a function of age. Overall, we found a moderate, positive correlation between discounting of food and discounting of water in rats, providing further evidence that the relative consistency with which individuals discount different outcomes is a trait-like characteristic. In addition, we found a high degree of within-subject variability in discounting, indicating strong state-like differences from session to session. Finally, overall, discounting decreased as a function of age; however, individual-subject data showed variability in how discounting changed across time. Overall, our results show that differences in delay discounting between individuals reflect variability in both trait- and state-like characteristics.     

Impulsive decision making and working memory

Decision making that favors short-term over long-term consequences of action, defined as impulsive or temporally myopic, may be related to individual differences in the executive functions of working memory (WM). In the first 2 experiments, participants made delay discounting (DD) judgments under different WM load conditions. In a 3rd experiment, participants high or low on standardized measures of imupulsiveness and dysexecutive function were asked to make DD judgments. A final experiment examined WM load effects on DD when monetary rewards were real rather than hypothetical. The results showed that higher WM load led to greater discounting of delayed monetary rewards. Further, a strong direct relation was found between measures of impulsiveness, dysexecutive function,and discounting of delayed rewards. Thus, limits on WM function, either intrinsic or extrinsic, are predictive of a more impulsive decision-making style.     

Temporal discounting predicts student responsiveness to exchange delays in a classroom token system

Typical assessments of temporal discounting involve presenting choices between hypothetical monetary outcomes. Participants choose between smaller immediate rewards and larger delayed rewards to determine how the passage of time affects the subjective value of reinforcement. Few studies, however, have compared such discounting to actual manipulations of reward delay. The present study examined the predictive validity of a temporal discounting procedure developed for use with children. Forty-six sixth-grade students completed a brief discounting assessment and were then exposed to a classwide intervention that involved both immediate and delayed reinforcement in a multiple baseline design across classrooms. The parameters derived from two hyperbolic models of discounting correlated significantly with actual on-task behavior under conditions of immediate and delayed exchange. Implications of temporal discounting assessments for behavioral assessment and treatment are discussed.     

Changes in intertemporal choices in deviant behaviors

Delay discounting is the process of devaluing results that happen in the future. We present a comprehensive literature review of changes on intertemporal choices in deviant behaviors, namely in (a) substance-related and addictive disorders, (b) disruptive, impulse-control, and conduct disorders, and (c) eating disorders. We also present studies focused on differences in demographic characteristics of the populations by gender, age, and education/social class. Delay discounting is presented as a process of studying intertemporal choices, resulting from decades of empirical research. Studies indicate that this process may provide explanation as to why individuals will sometimes choose a smaller reward, available sooner, instead of a larger reward available later. When studying populations with the above-mentioned problems, they tend to exhibit more pronounced discounting functions than control groups. The association between discounting and gender is not clear. The relationship between delay discounting and age is relatively clear, where older individuals discount less markedly than younger individuals. Studies suggest that shallower discounting gradients are associated with higher levels of intelligence and academic success. We emphasize the need for more empirical research on delay discounting, especially in regard to deviant behavior that may be associated with impulse-control disorders.     

Smokers discount their drug of abuse in the same way as other consumable rewards

Recent research shows that drug abusers discount delayed monetary rewards more than nonabusers do, and they discount delayed substances of abuse (e.g., drugs) more than delayed money. Furthermore, non-drug-abusers discount food and substances of abuse (e.g., alcohol), more than money. Here, we compare the delay and probability discounting of money with that of a directly consumable reward (chocolate) and with that of a substance of abuse (cigarettes), in a drug-using population (smokers). In line with previous research, we found in two experiments that delay discounting differentiated between smokers and nonsmokers, and between money and a nonabused directly consumable reward (chocolate). In addition, our results show that there appears to be no difference in the extent to which smokers discount their abused substance compared to another directly consumable reward. These findings support the contention that drugs and food are part of the same category of primary reinforcers, whereas money is discounted differently, as a conditioned reinforcer.     

Social discounting of pain

Impatience can be formalized as a delay discount rate, describing how the subjective value of reward decreases as it is delayed. By analogy, selfishness can be formalized as a social discount rate, representing how the subjective value of rewarding another person decreases with increasing social distance. Delay and social discount rates for reward are correlated across individuals. However no previous work has examined whether this relationship also holds for aversive outcomes. Neither has previous work described a functional form for social discounting of pain in humans. This is a pertinent question, since preferences over aversive outcomes formally diverge from those for reward. We addressed this issue in an experiment in which healthy adult participants (N = 67) chose the timing and intensity of hypothetical pain for themselves and others. In keeping with previous studies, participants showed a strong preference for immediate over delayed pain. Participants showed greater concern for pain in close others than for their own pain, though this hyperaltruism was steeply discounted with increasing social distance. Impatience for pain and social discounting of pain were weakly correlated across individuals. Our results extend a link between impatience and selfishness to the aversive domain.     

Discounting of food,sex, and money

Discounting is a useful framework for understanding choice involving a range of delayed and probabilistic outcomes (e.g., money, food, drugs), but relatively few studies have examined how people discount other commodities (e.g., entertainment, sex). Using a novel discounting task, where the length of a line represented the value of an outcome and was adjusted using a staircase procedure, we replicated previous findings showing that individuals discount delayed and probabilistic outcomes in a manner well described by a hyperbola-like function. In addition, we found strong positive correlations between discounting rates of delayed, but not probabilistic, outcomes. This suggests that discounting of delayed outcomes may be relatively predictable across outcome types but that discounting of probabilistic outcomes may depend more on specific contexts. The generality of delay discounting and potential context dependence of probability discounting may provide important information regarding factors contributing to choice behavior.     

Now for Me,Later for Us? Effects of Group Context on Temporal Discounting

Delayed rewards are less valuable than immediate rewards. This well‐established finding has focused almost entirely on individual outcomes. However, are delayed rewards similarly discounted if they are shared by a group? The current article reports on three experiments exploring the effect of group context on delay discounting. Results indicate that discount rates of individual and group rewards were highly correlated, but that respondents were more willing to wait (decreased discounting) for shared outcomes than for individual outcomes. An explanatory model is proposed suggesting that decreased discount rates in group contexts may be due to the way the effects of both delay and social discounting are combined. That is, in a group context, a person values both a future reward (discounted by delay) and a present reward to another person (discounted by the social distance between them). The results are explained by a combined discount function containing a delay factor and a factor representing the social distance between the decision maker and group members. Practical implications of the fact that shared consequences can increase individual self‐control are also discussed. Copyright © 2011 John Wiley & Sons, Ltd.     

Social discounting and delay discounting

Social discounting was measured as the amount of money a participant was willing to forgo to give a fixed amount (usually $75) to another person. In the first experiment, amount forgone was a hyperbolic function of the social distance between the giver and receiver. In the second experiment, degree of social discounting was an increasing function of reward magnitude whereas degree of delay discounting was a decreasing function of reward magnitude. In the third experiment, the shape of the function relating delayed rewards to equally valued immediate rewards for another person was predicted from individual delay and social discount functions. All in all, the studies show that the social discount function, like delay and probability discount functions, is hyperbolic in form. Copyright © 2007 John Wiley & Sons, Ltd.     

不确定性容忍度对跨期选择的影响及其情景依赖性

采用2(不确定性容忍度：高、低)×2(跨期日期：今天/14天、今天/180天)×2(延迟奖赏值：200元、1000元)混合实验设计,探讨不同任务特征下不确定性容忍度对跨期选择的影响。结果表明：跨期日期为180天时,不确定性容忍度主效应边缘显著;不确定性容忍度与延迟奖赏值交互作用显著：在200元时低容忍度个体对延迟奖赏的折扣程度大于高容忍度个体,在1000元时无此效应;跨期日期为14天时,不确定性容忍度的主效应及其与延迟奖赏值交互作用均不显著。这表明,不确定性容忍度对跨期选择存在影响,但这种影响受到跨期日期和延迟奖赏值的调节,具有情景依赖性。     

Intertemporal Similarity: Discounting as a Last Resort

Standard models of intertemporal choice assume that individuals discount future payoffs by integrating reward amounts and time delays to generate a discounted value. Alternative models propose that, rather than integrate across them, individuals compare within attributes (amounts and delays) to determine if differences in one attribute outweigh differences in another attribute. For instance, the similarity model 1) compares the two reward amounts to determine whether they are similar, 2) compares the similarity of the two time delays, and then 3) makes a decision based on these similarity judgments. Here, I tested discounting models against attribute‐based models that use similarity judgments to make choices. I collected intertemporal choices and similarity judgments for the reward amounts and time delays from participants in three experiments. All experiments tested the ability of discounting and similarity models to predict intertemporal choices. Model generalization analyses showed that the best predicting models started with similarity judgments and then, if similarity failed to make a prediction, resorted to discounting models. Similarity judgments also matched intertemporal choice data demonstrating both the magnitude and sign effects, thereby accounting for behavioral data that contradict many discounting models. These results highlight the possibility that attribute‐based models such as the similarity models provide alternatives to discounting that may offer insights into the process of making intertemporal choices. Copyright © 2015 John Wiley & Sons, Ltd.     

Impulsivity in rodents with a genetic predisposition for excessive alcohol consumption is associated with a lack of a prospective strategy

Increasing evidence supports the hypothesis that impulsive decision-making is a heritable risk factor for an alcohol use disorder (AUD). Clearly identifying a link between impulsivity and AUD risk, however, is complicated by the fact that both AUDs and impulsivity are heterogeneous constructs. Understanding the link between the two requires identifying the underlying cognitive factors that lead to impulsive choices. Rodent models have established that a family history of excessive drinking can lead to the expression of a transgenerational impulsive phenotype, suggesting heritable alterations in the decision-making process. In the present study, we explored the cognitive processes underlying impulsive choice in a validated, selectively bred rodent model of excessive drinking—the alcohol-preferring (“P”) rat. Impulsivity was measured via delay discounting (DD), and P rats exhibited an impulsive phenotype as compared to their outbred foundation strain—Wistar rats. Steeper discounting in P rats was associated with a lack of a prospective behavioral strategy, which was observed in Wistar rats and was directly related to DD. To further explore the underlying cognitive factors mediating these observations, a drift diffusion model of DD was constructed. These simulations supported the hypothesis that prospective memory of the delayed reward guided choice decisions, slowed discounting, and optimized the fit of the model to the experimental data. Collectively, these data suggest that a deficit in forming or maintaining a prospective behavioral plan is a critical intermediary to delaying reward, and by extension, may underlie the inability to delay reward in those with increased AUD risk.     

Choice patterns reveal qualitative individual differences among discounting of delayed gains,delayed losses,and probabilistic losses

A new probabilistic losses questionnaire as well as Kirby's delayed gains questionnaire and a previously developed delayed losses questionnaire were administered to a large online sample. Almost all participants showed the positive discounting choice pattern expected on the Kirby questionnaire, decreasing their choice of a delayed gain as time to its receipt increased. In contrast, approximately 15% of the participants showed negative discounting on the delayed losses questionnaire and/or the probabilistic losses questionnaire, decreasing their choice of an immediate loss as time to a delayed loss decreased and/or decreasing their choice of a certain loss as likelihood of the probabilistic loss increased. Mixture model analysis confirmed the existence of these negative discounting subgroups. The inconsistent findings observed in previous research involving delayed/probabilistic losses may be due to differences in the proportion of negative discounters who participated in previous studies. Further research is needed to determine how negative discounting of delayed and probabilistic losses manifests itself in everyday decisions. It should be noted that the presence of individuals who show atypical choice patterns when losses are involved may pose challenges for efforts to modify discounting in order to ameliorate behavioral problems, especially because many such problems concern choices that have negative consequences, often delayed and/or probabilistic.     

DISCOUNTING OF DELAYED REWARDS:

Abstract— In this study, children, young adults, and older adults chose between immediate and delayed hypothetical monetary rewards The amount of the delayed reward was held constant while its delay was varied All three age groups showed delay discounting, that is, the amount of an immediate reward judged to be of equal value to the delayed reward decreased as a function of delay The rate of discounting was highest for children and lowest for older adults, predicting a life-span developmental trend toward increased selfcontrol Discounting of delayed rewards by all three age groups was well described by a single function with agesensitive parameters (all R²s>94) Thus, even though there are quantitative age differences in delay discounting, the existence of an age-invanant form of discount function suggests that the process of choosing between rewards of different amounts and delays is qualitatively similar across the life span     

情绪对延迟折扣的影响：现状、机制与展望

延迟折扣研究领域日益重视情绪的影响作用。本文基于三类研究取向对情绪与延迟折扣关系研究进行了回顾。情绪效价和唤醒度均影响延迟折扣,但是研究结果并不一致;具体情绪类型不同,其对延迟折扣影响也存在差异。除此之外,本文就情绪信息理论、情绪动机维度理论和评估倾向理论如何解释延迟折扣进行了详细阐述。未来的研究需要进一步深入考察情绪影响延迟折扣的认知神经机制,从而为延迟折扣的负性情绪效应的干预提供可靠的科学依据。     

Gambling and Delay Discounting in Japanese Students

The present study examined the relationship between gambling behavior and delay discounting with Japanese residents. Japanese university students were selected into pathological gambler and non‐gambling control groups using a Japanese version of the South Oaks Gambling Screen. In a discounting task, participants chose individually between a large delayed reward and a smaller immediate reward with varied delays. The discounting rate (k‐value) and the area under the curve were significantly higher and smaller, respectively, for the gambler group than for the control group. These findings show that Japanese gamblers discount delayed rewards more steeply than non‐gambling controls, as has been found in U.S. residents.     

A discounting framework for choice with delayed and probabilistic rewards

When choosing between delayed or uncertain outcomes, individuals discount the value of such outcomes on the basis of the expected time to or the likelihood of their occurrence. In an integrative review of the expanding experimental literature on discounting, the authors show that although the same form of hyperbola-like function describes discounting of both delayed and probabilistic outcomes, a variety of recent findings are inconsistent with a single-process account. The authors also review studies that compare discounting in different populations and discuss the theoretical and practical implications of the findings. The present effort illustrates the value of studying choice involving both delayed and probabilistic outcomes within a general discounting framework that uses similar experimental procedures and a common analytical approach.     

Time discounting and time preference in animals: A critical review

Animals are an important model for studies of impulsivity and self-control. Many studies have made use of the intertemporal choice task, which pits small rewards available sooner against larger rewards available later (typically several seconds), repeated over many trials. Preference for the sooner reward is often taken to indicate impulsivity and/or a failure of self-control. This review shows that very little evidence supports this assumption; on the contrary, ostensible discounting behavior may reflect a boundedly rational but not necessarily impulsive reward-maximizing strategy. Specifically, animals may discount weakly, or even adopt a long-term rate-maximizing strategy, but fail to fully incorporate postreward delays into their choices. This failure may reflect learning biases. Consequently, tasks that measure animal discounting may greatly overestimate the true discounting and may be confounded by processes unrelated to time preferences. If so, animals may be much more patient than is widely believed; human and animal intertemporal choices may reflect unrelated mental operations; and the shared hyperbolic shape of the human and animal discount curves, which is used to justify cross-species comparisons, may be coincidental. The discussion concludes with a consideration of alternative ways to measure self-control in animals.