Impulsive choice and pre‐exposure to delays: iv. effects of delay‐ and immediacy‐exposure training relative to maturational changes in impulsivity

Impulsive choice describes preference for smaller, sooner rewards over larger, later rewards. Excessive delay discounting (i.e., rapid devaluation of delayed rewards) underlies some impulsive choices, and is observed in many maladaptive behaviors (e.g., substance abuse, gambling). Interventions designed to reduce delay discounting may provide therapeutic gains. One such intervention provides rats with extended training with delayed reinforcers. When compared to a group given extended training with immediate reinforcers, delay‐exposed rats make significantly fewer impulsive choices. To what extent is this difference due to delay‐exposure training shifting preference toward self‐control or immediacy‐exposure training (the putative control group) shifting preference toward impulsivity? The current study compared the effects of delay‐ and immediacy‐exposure training to a no‐training control group and evaluated within‐subject changes in impulsive choice across 51 male Wistar rats. Delay‐exposed rats made significantly fewer impulsive choices than immediacy‐exposed and control rats. Between‐group differences in impulsive choice were not observed in the latter two groups. While delay‐exposed rats showed large, significant pre‐ to posttraining reductions in impulsive choice, immediacy‐exposed and control rats showed small reductions in impulsive choice. These results suggest that extended training with delayed reinforcers reduces impulsive choice, and that extended training with immediate reinforcers does not increase impulsive choice.     

Delay discounting as impaired valuation: Delayed rewards in an animal obesity model

Obesity is a major public health problem, which, like many forms of addiction, is associated with an elevated tendency to choose smaller immediate rather than larger delayed rewards, a response pattern often referred to as excessive delay discounting. Although some accounts of delay discounting conceptualize this process as impulsivity (placing the emphasis on overvaluing the smaller immediate reward), others have conceptualized delay discounting as an executive function (placing the emphasis on delayed rewards failing to retain their value). The present experiments used a popular animal model of obesity that has been shown to discount delayed rewards at elevated rates (i.e., obese Zucker rats) to test two predictions that conceptualize delay discounting as executive function. In the first experiment, acquisition of lever pressing with delayed rewards was compared in obese versus lean Zucker rats. Contrary to predictions based on delay discounting as executive function, obese Zucker rats learned to press the lever more quickly than controls. In the second experiment, progressive ratio breakpoints (a measure of reward efficacy) with delayed rewards were compared in obese versus lean Zucker rats. Contrary to the notion that obese rats fail to value delayed rewards, the obese Zucker rats' breakpoints were (at least) as high as those of the lean Zucker rats.     

Introduction to the special issue on comparative cognition

Prior research has shown that nonhumans show an extreme preference for variable‐ over fixed‐delays to reinforcement. This well‐established preference for variability occurs because a reinforcer's strength or “value” decreases according to a curvilinear function as its delay increases. The purpose of the present experiments was to investigate whether this preference for variability occurs with human participants making hypothetical choices. In three experiments, participants recruited from Amazon Mechanical Turk made choices between variable and fixed monetary rewards. In a variable‐delay procedure, participants repeatedly chose between a reward delivered either immediately or after a delay (with equal probability) and a reward after a fixed delay (Experiments 1 and 2). In a double‐reward procedure, participants made choices between an alternative consisting of two rewards, one delivered immediately and one after a delay, and a second alternative consisting of a single reward delivered after a delay (Experiments 1 and 3). Finally, all participants completed a standard delay‐discounting task. Although we observed both curvilinear discounting and magnitude effects in the standard discounting task, we found no consistent evidence of a preference for variability—as predicted by two prominent models of curvilinear discounting (i.e., a simple hyperbola and a hyperboloid)—in our variable‐delay and double‐reward procedures. This failure to observe a preference for variability may be attributed to the hypothetical, rule‐governed nature of choices in the present study. In such contexts, participants may adopt relatively simple strategies for making more complex choices.     

Greater delay discounting among girls,but not boys,with ADHD correlates with cognitive control

Cognitive neuroscience models suggest both reward valuation and cognitive control contribute to reward-based decision-making. The current study examined the relationship between cognitive control and delay discounting (i.e., choosing smaller, immediate over larger, delayed rewards) in a large sample of boys and girls diagnosed with attention-deficit/hyperactivity disorder (ADHD; N = 95) and typically developing control children (TD; N = 59). Specifically, we examined performance on multiple measures of cognitive control (i.e., Go/No-Go task, Stop Signal task, and Spatial Span task) and delay discounting (i.e., Classic Delay Discounting and Real-Time Delay Discounting tasks), as well as the relationship between these measures. Results indicated that sex moderated the effects of group on task performance. Specifically, girls with ADHD, but not boys with the disorder, exhibited atypical delay discounting of real-time rewards. Results from correlational analyses indicated that delay discounting and cognitive control were not significantly correlated in the overall sample. Multiple regression analyses demonstrated that among girls with ADHD poorer spatial working memory and inhibitory control predicted greater real-time discounting. Collectively, findings provide support for distinct patterns of cognitive control and delay discounting among school-aged girls and boys with ADHD. Additionally, findings suggest that among girls with ADHD, those who exhibit relatively poor working memory and inhibitory control might be a particularly vulnerable subgroup with the greatest propensity to exhibit maladaptive decision-making.     

Now for Me,Later for Us? Effects of Group Context on Temporal Discounting

Delayed rewards are less valuable than immediate rewards. This well‐established finding has focused almost entirely on individual outcomes. However, are delayed rewards similarly discounted if they are shared by a group? The current article reports on three experiments exploring the effect of group context on delay discounting. Results indicate that discount rates of individual and group rewards were highly correlated, but that respondents were more willing to wait (decreased discounting) for shared outcomes than for individual outcomes. An explanatory model is proposed suggesting that decreased discount rates in group contexts may be due to the way the effects of both delay and social discounting are combined. That is, in a group context, a person values both a future reward (discounted by delay) and a present reward to another person (discounted by the social distance between them). The results are explained by a combined discount function containing a delay factor and a factor representing the social distance between the decision maker and group members. Practical implications of the fact that shared consequences can increase individual self‐control are also discussed. Copyright © 2011 John Wiley & Sons, Ltd.     

Positive mood effects on delay discounting

Delay discounting is the process by which the value of an expected reward decreases as the delay to obtaining that reward increases. Individuals with higher discounting rates tend to prefer smaller immediate rewards over larger delayed rewards. Previous research has indicated that personality can influence an individual's discounting rates, with higher levels of Extraversion predicting a preference for immediate gratification. The current study examined how this relationship would be influenced by situational mood inductions. While main effects were observed for both Extraversion and cognitive ability in the prediction of discounting rates, a significant interaction was also observed between Extraversion and positive affect. Extraverted individuals were more likely to prefer an immediate reward when first put in a positive mood. Extraverts thus appear particularly sensitive to impulsive, incentive-reward-driven behavior by temperament and by situational factors heightening positive affect.     

愤怒情绪对延迟折扣的影响：确定感和控制感的中介作用

本研究基于评估倾向理论, 通过3项实验考察了特定负性情绪(愤怒)对延迟折扣的影响, 并探究确定感和控制感评估倾向在这一关系中的作用。实验1考察愤怒情绪对延迟折扣的影响, 结果发现, 愤怒组被试的延迟满足倾向显著强于恐惧组和控制组。实验2采用实验因果链设计考察确定感和控制感评估倾向在愤怒情绪影响个体延迟折扣中的作用, 结果发现, 愤怒情绪可以有效增强个体的确定感和控制感(实验2a), 同时确定感和控制感能够增强个体的延迟满足倾向(实验2b)。实验3采用中介测量设计考察确定感和控制感评估倾向在愤怒情绪影响个体延迟折扣中的作用, 结果发现, 确定感和控制感评估倾向在愤怒情绪影响个体延迟折扣中起完全中介作用。本研究结果表明, 当个体进行跨期决策时, 体验到与确定感和控制感有关的偶然愤怒情绪会增强其延迟满足倾向。本研究对探究特定负性情绪对个体延迟折扣的影响具有一定的启示意义。     

Associations Between Delay Discounting and Risk‐Related Behaviors,Traits, Attitudes,and Outcomes

Delay discounting—preference for immediate, smaller rewards over distal, larger rewards—has been argued to be part of the “generality of deviance”, which describes the co‐occurrence of various forms of impulsive and risky behaviors among individuals. Some studies have linked laboratory‐measured delay discounting to behaviors, traits, attitudes, and outcomes associated with risk, but these associations have been inconsistent. Furthermore, many of these studies have been conducted with exclusively undergraduate samples, or in samples offering low statistical power. In a large community sample (n = 328) diverse in age and socioeconomic status, we examined associations between two measures of behavioral delay discounting (single‐shot and canonical k‐parameter estimation) and behavioral risk‐taking, personality traits associated with risk, domain‐specific risk attitudes, gambling and problem gambling, antisocial behavior, and criminal outcomes. In addition, we explored whether a novel response time latency measure of delay discounting explained variance in these risk‐related outcomes. Results indicated that behavioral delay discounting was consistently associated with all variables related to impulse control: high trait impulsivity, low trait self‐control, risk‐averse attitudes toward financial investment, risk‐prone attitudes toward gambling and health/safety risks, gambling and problem gambling, antisocial conduct, and criminal outcomes. Latency‐measured delay discounting was inconsistently associated with behavioral delay discounting and risk‐related measures. Together, results suggest that delay discounting is associated with poor impulse control consistent with a generality of deviance account. Copyright © 2016 John Wiley & Sons, Ltd.     

Temporal discounting predicts student responsiveness to exchange delays in a classroom token system

Typical assessments of temporal discounting involve presenting choices between hypothetical monetary outcomes. Participants choose between smaller immediate rewards and larger delayed rewards to determine how the passage of time affects the subjective value of reinforcement. Few studies, however, have compared such discounting to actual manipulations of reward delay. The present study examined the predictive validity of a temporal discounting procedure developed for use with children. Forty-six sixth-grade students completed a brief discounting assessment and were then exposed to a classwide intervention that involved both immediate and delayed reinforcement in a multiple baseline design across classrooms. The parameters derived from two hyperbolic models of discounting correlated significantly with actual on-task behavior under conditions of immediate and delayed exchange. Implications of temporal discounting assessments for behavioral assessment and treatment are discussed.     

The Effects of Social Status and Culture on Delay Discounting

People generally tend to discount future outcomes in favor of smaller but immediate gains (i.e., delay discounting). This study examines the hypothesis that culture and social status moderate this tendency, as well as the alternative hypothesis that social status and culture influence delay discounting independently of each other. American and Japanese adults were asked to choose receiving hypothetical monetary rewards either immediately or receiving rewards of different amounts with a delay of 1 year. The results replicated previous findings and supported the alternative hypothesis. Delay discounting was lower when subjective socioeconomic status (i.e., an individual’s perception of her or his social rank) was higher. Also, the Japanese were less likely to discount future rewards than the Americans. However, there was no interaction between social status and culture in influencing the rates of delay discounting.     

Thinking about others and the future: Neural correlates of perspective taking relate to preferences for delayed rewards

We infer the thoughts and feelings of others by taking their perspectives. Similar processes could be used to understand how we will be affected by future events, by allowing us to take the perspective of our future self. In this paper, we test this idea using a previously presented framework for guiding predictions. The framework proposes that a shared neural mechanism is involved in controlling egocentric bias, both while shifting our perspective away from self and towards others, and while shifting our perspective from immediate to future perspectives. To test this framework, 36 adults performed an intertemporal choice task. They were then scanned using 3T functional magnetic resonance imaging while completing a false-belief “localizer” task, which requires egocentric bias control. A positive correlation was observed between the right temporoparietal junction (rTPJ) response during the false-belief task, and preferences for delayed rewards in intertemporal choices. A subset of participants performed the intertemporal choice task again in the scanner, which revealed that the response of the same rTPJ cluster, individually localized during the false-belief task, was higher during delayed over immediate reward choices. In addition, functional connectivity between the rTPJ and ventromedial prefrontal cortex was found to differ between immediate and delayed choices. The current results indicate an overlap in processes of egocentric bias control and those that determine preferences in intertemporal choices, offering a social cognitive explanation for why rewards are devalued with delay in temporal discounting.     

Neural correlates of intertemporal choice in aggressive behavior

People often have to make decisions between immediate rewards and more long-term goals. Such intertemporal judgments are often investigated in the context of monetary choice or drug use, yet not in regard to aggressive behavior. We combined a novel intertemporal aggression paradigm with functional neuroimaging to examine the role of temporal delay in aggressive behavior and the neural correlates thereof. Sixty-one participants (aged 18–22 years; 37 females) exhibited substantial variability in the extent to which they selected immediate acts of lesser aggression versus delayed acts of greater aggression against a same-sex opponent. Choosing delayed-yet-more-severe aggression was increased by provocation and associated with greater self-control. Preferences for delayed aggression were associated with greater activity in the ventromedial prefrontal cortex (VMPFC) during such choices, and reduced functional connectivity between the VMPFC and brain regions implicated in motor impulsivity. Preferences for immediate aggression were associated with reduced functional connectivity between the VMPFC and the frontoparietal control network. Dispositionally aggressive participants exhibited reduced VMPFC activity, which partially explained and suppressed their preferences for delayed aggression. Blunted VMPFC activity may thus be a neural mechanism that promotes reactive aggression towards provocateurs among dispositionally aggressive individuals. These findings demonstrate the utility of an intertemporal framework for investigating aggression and provide further evidence for the similar underlying neurobiology between aggression and other rewarding behaviors.     

Examining children's ability to delay reward: Is the delay discounting task a suitable measure?

Discounting the value of delayed rewards has primarily been measured in children with the delay of gratification task and in adolescents and adults with the delay discounting task. In the present study, we assessed the suitability of the delay discounting task as a measure of temporal discounting in children. A sample of 7- to 9-year-olds (N = 98) completed a delay discounting task, a delay of gratification task, a sensation seeking measure, and IQ measures. In addition, teacher-based assessments of attention-deficit/hyperactivity disorder traits were measured. The results indicated that the majority of children produced meaningful data on the discounting task and discounted rewards hyperbolically. Children with an elevated risk of attention-deficit/hyperactivity disorder showed a trend towards discounting future rewards on the delay discounting task more steeply than did those at low risk. However, delay discounting was unrelated to either delay of gratification or sensation seeking. We interpret these results as providing some support for the use of delay discounting as a measure of intertemporal choice in children, although the results also suggest that delay discounting and delay of gratification tasks may tap different processes in this population.     

ALTERING THE MAGNITUDE OF DELAY DISCOUNTING BY PATHOLOGICAL GAMBLERS

The present study explored the delay discounting of future and past monetary rewards by pathological gamblers. Using a multiple baseline design, following repeated exposure to choices between smaller immediate and larger delayed consequences, participants completed a relational responding task that attempted to alter the psychological functions of irrelevant stimuli and to affect subsequent delay discounting. Results support previous literature on the discounting of delayed consequences by pathological gamblers, illustrate that the discounting of past rewards occurs in a similar fashion to the well‐documented literature on the discounting of future rewards, and that magnitude of discounting can be altered.     

Modeling the effect of reward amount on probability discounting

The present study with college students examined the effect of amount on the discounting of probabilistic monetary rewards. A hyperboloid function accurately described the discounting of hypothetical rewards ranging in amount from $20 to $10,000,000. The degree of discounting increased continuously with amount of probabilistic reward. This effect of amount was not due to changes in the rate parameter of the discounting function, but rather was due to increases in the exponent. These results stand in contrast to those observed with the discounting of delayed monetary rewards, in which the degree of discounting decreases with reward amount due to amount-dependent decreases in the rate parameter. Taken together, this pattern of results suggests that delay and probability discounting reflect different underlying mechanisms. That is, the fact that the exponent in the delay discounting function is independent of amount is consistent with a psychophysical scaling interpretation, whereas the finding that the exponent of the probability-discounting function is amount-dependent is inconsistent with such an interpretation. Instead, the present results are consistent with the idea that the probability-discounting function is itself the product of a value function and a weighting function. This idea was first suggested by Kahneman and Tversky (1979), although their prospect theory does not predict amount effects like those observed. The effect of amount on probability discounting was parsimoniously incorporated into our hyperboloid discounting function by assuming that the exponent was proportional to the amount raised to a power. The amount-dependent exponent of the probability-discounting function may be viewed as reflecting the effect of amount on the weighting of the probability with which the reward will be received.     

Four days later in Cincinnati: longitudinal tests of hyperbolic discounting

Hyperbolic discounting of delayed rewards has been proposed as an underlying cause of the failure to stick to plans to forego one's immediate desires, such as the plan to diet, wake up early, or quit taking heroin. We conducted two tests of inconsistent planning in which respondents made at least two choices between a smaller-sooner (SS) and larger-later (LL) amount of money, one several weeks before SS would be received, and one immediately before. Hyperbolic discounting predicts that there would be more choices of SS as it became more proximate-and, equivalently, that among those who change their mind, "impatient shifts" (LL-to-SS) will be more common than "patient shifts" (SS-to-LL). We find no evidence for this, however, and in our studies shifts in both directions were equally likely. We propose that some of the evidence cited on behalf of hyperbolic discounting can be attributed to qualitatively different psychological mechanisms.     

DISCOUNTING OF DELAYED REWARDS:

Abstract— In this study, children, young adults, and older adults chose between immediate and delayed hypothetical monetary rewards The amount of the delayed reward was held constant while its delay was varied All three age groups showed delay discounting, that is, the amount of an immediate reward judged to be of equal value to the delayed reward decreased as a function of delay The rate of discounting was highest for children and lowest for older adults, predicting a life-span developmental trend toward increased selfcontrol Discounting of delayed rewards by all three age groups was well described by a single function with agesensitive parameters (all R²s>94) Thus, even though there are quantitative age differences in delay discounting, the existence of an age-invanant form of discount function suggests that the process of choosing between rewards of different amounts and delays is qualitatively similar across the life span     

Delay discounting mediates the association between posterior insular cortex volume and social media addiction symptoms

Addiction-like symptoms in relation to excessive and compulsive social media use are common in the general population. Because they can lead to various adverse effects, there is a growing need to understand the brain systems and processes that are involved in potential social media addiction. We focus on the morphology of the posterior subdivision of the insular cortex (i.e., the insula), because it has been shown to be instrumental to supporting the maintenance of substance addictions and problematic behaviors. Assuming that social media addiction shares neural similarities with more established ones and consistent with evidence from the neuroeconomics domain, we further examine one possible reason for this association—namely that insular morphology influences one's delay discounting and that this delay discounting contributes to exaggerated preference for immediate social media rewards and consequent addiction-like symptoms. Based on voxel-based morphometry techniques applied to MRI scans of 32 social media users, we show that the gray matter volumes of the bilateral posterior insula are negatively associated with social media addiction symptoms. We further show that this association is mediated by delay discounting. This provides initial evidence that insular morphology can be associated with potential social media addiction, in part, through its contribution to poor foresight and impulsivity as captured by delay discounting.     

Delay discounting as emotional processing: An electrophysiological study

Both theoretical models and functional imaging studies implicate the involvement of emotions within the delay discounting process. However, defining this role has been difficult to establish with neuroimaging techniques given the automaticity of emotional responses. To address this, the current study examined electrophysiological correlates involved in the detection and evaluation of immediate and delayed monetary outcomes. Our results showed that modulation of both early and later ERP components previously associated with affective stimuli processing are sensitive to the signalling of delayed rewards. Together with behavioural reaction times that favoured immediacy, we demonstrated, for the first time, that time delays modify the incentive value of monetary rewards via mechanisms of emotional bias and selective visual attention. Furthermore, our data are consistent with the hypothesis that delayed and thus intangible rewards are perceived less saliently, and rely on emotion as a common currency within decision making. This study provides a new approach to delay discounting and highlights a potential novel route through which delay discounting may be investigated.     

Elevated outcome-anticipation and outcome-evaluation ERPs associated with a greater preference for larger-but-delayed rewards

Although waiting for a reward reduces or discounts its value, some people have a stronger tendency to wait for larger rewards and forgo smaller-but-immediate rewards. This ability to delay gratification is captured by individual differences in so-called intertemporal choices in which individuals are asked to choose between larger-but-delayed versus smaller-but-immediate rewards. The current study used event-related potentials (ERPs) to examine whether enhancement in two neurocognitive processes, outcome anticipation and outcome evaluation, modulate individual variability in intertemporal responses. After completing a behavioral intertemporal choice task, 34 participants performed an ERP gambling task. From this ERP task, we separately examined individual differences in outcome anticipation (stimulus-preceding negativity; SPN), early outcome valuation (feedback-related negativity; FRN), and late outcome evaluation (P3). We observed that both elevated outcome-anticipation (SPN) and late outcome-evaluation (P3) neural processes predicted a stronger preference toward larger-but-delayed rewards. No relationship was observed between intertemporal responses and early outcome evaluation (FRN), indicating that the relationship between outcome evaluation and intertemporal responses was specific to the late outcome-evaluation processing stream. Moreover, multiple regression analyses indicated that the SPN and P3 independently modulate individual differences in intertemporal responses, suggesting separate mechanisms underlie the relationship between these two neurocognitive processes and intertemporal responses. Accordingly, we identify two potential neurocognitive modulators of individual variability in intertemporal responses. We discuss the mechanisms underlying these modulators in terms of anticipation-related processing (SPN) and a saliency bias toward gain (compared to loss) outcomes (P3).