Impulsive decision making and working memory

Decision making that favors short-term over long-term consequences of action, defined as impulsive or temporally myopic, may be related to individual differences in the executive functions of working memory (WM). In the first 2 experiments, participants made delay discounting (DD) judgments under different WM load conditions. In a 3rd experiment, participants high or low on standardized measures of imupulsiveness and dysexecutive function were asked to make DD judgments. A final experiment examined WM load effects on DD when monetary rewards were real rather than hypothetical. The results showed that higher WM load led to greater discounting of delayed monetary rewards. Further, a strong direct relation was found between measures of impulsiveness, dysexecutive function,and discounting of delayed rewards. Thus, limits on WM function, either intrinsic or extrinsic, are predictive of a more impulsive decision-making style.     

Delay discounting as emotional processing: An electrophysiological study

Both theoretical models and functional imaging studies implicate the involvement of emotions within the delay discounting process. However, defining this role has been difficult to establish with neuroimaging techniques given the automaticity of emotional responses. To address this, the current study examined electrophysiological correlates involved in the detection and evaluation of immediate and delayed monetary outcomes. Our results showed that modulation of both early and later ERP components previously associated with affective stimuli processing are sensitive to the signalling of delayed rewards. Together with behavioural reaction times that favoured immediacy, we demonstrated, for the first time, that time delays modify the incentive value of monetary rewards via mechanisms of emotional bias and selective visual attention. Furthermore, our data are consistent with the hypothesis that delayed and thus intangible rewards are perceived less saliently, and rely on emotion as a common currency within decision making. This study provides a new approach to delay discounting and highlights a potential novel route through which delay discounting may be investigated.     

DISCOUNTING OF DELAYED REWARDS:

Abstract— In this study, children, young adults, and older adults chose between immediate and delayed hypothetical monetary rewards The amount of the delayed reward was held constant while its delay was varied All three age groups showed delay discounting, that is, the amount of an immediate reward judged to be of equal value to the delayed reward decreased as a function of delay The rate of discounting was highest for children and lowest for older adults, predicting a life-span developmental trend toward increased selfcontrol Discounting of delayed rewards by all three age groups was well described by a single function with agesensitive parameters (all R²s>94) Thus, even though there are quantitative age differences in delay discounting, the existence of an age-invanant form of discount function suggests that the process of choosing between rewards of different amounts and delays is qualitatively similar across the life span     

The relation between temperament and rate of temporal discounting

The present study examines the relationship between several temperamental traits (sensation seeking, extraversion–introversion, and impulsivity) and rate of temporal discounting, that is the rate of decrease in the subjective value of a reward as the delay to its receipt increases. Participants made choices between hypothetical monetary rewards that could be obtained immediately or after a specified delay. Temporal discounting functions were calculated and differences in rate of discounting between different groups were evaluated. For all groups of participants, hyperbolic discounting functions described well the decreases in subjective value with delay (R² ranged from 0.700 to 0.985). The rate of discounting was equivalent in high and low sensation seekers. However, both extraverts and high impulsive individuals showed higher temporal discounting rates than introverts and low impulsive individuals. The relationship between temperament and temporal discounting may be related to differences in time perception and/or to differences in susceptibility to rewards in extraverts versus introverts and in high- versus low-impulsive individuals.     

Money enhances memory consolidation--but only for boring material

Money’s ability to enhance memory has received increased attention in recent research. However, previous studies have not directly addressed the time-dependent nature of monetary effects on memory, which are suggested to exist by research in cognitive neuroscience, and the possible detrimental effects of monetary rewards on learning interesting material, as indicated by studies in motivational psychology. By utilizing a trivia question paradigm, the current study incorporated these perspectives and examined the effect of monetary rewards on immediate and delayed memory performance for answers to uninteresting and interesting questions. Results showed that monetary rewards promote memory performance only after a delay. In addition, the memory enhancement effect of monetary rewards was only observed for uninteresting questions. These results are consistent with both the hippocampus-dependent memory consolidation model of reward learning and previous findings documenting the ineffectiveness of monetary rewards on tasks that have intrinsic value.     

海洛因延迟强化物超快速折扣倾向的心理机制

以124名处于不同戒除时相的男性海洛因戒除者为被试, 采用金钱和海洛因延迟折扣任务(DDT), 并以基于线索暴露的渴求感测量为效度指标, 探讨了该类人群对海洛因延迟强化超快速折扣倾向及其心理机制。结果发现: (1) 相对于金钱延迟强化, 戒除者对海洛因延迟强化表现出显著的超快速折扣倾向, 且该倾向不随戒除期的延长而改变; (2) 戒除者对海洛因延迟强化的超快速折扣行为可能是其冲动性特质与海洛因相关线索共同作用的结果, 海洛因相对于金钱折扣率的增量部分可能反映了海洛因及其相关线索对该类人群主观渴求感的诱发效应。     

Waiting for more: the performance of domestic dogs (Canis familiaris) on exchange tasks

Five domestic dogs (Canis familiaris) were tested in a cooperative exchange task with an experimenter, as previously tested in non-human primates. In the first task, the dogs exchanged to maximise payoffs when presented with food items of differing quality. All consistently exchanged lower-value for higher-value rewards, as determined by their individual food preference, and exchanges corresponded significantly with the spontaneous preferences of three dogs. Next, all subjects demonstrated an ability to perform two and three exchanges in succession, to gain both qualitative and quantitatively increased rewards (group mean = 72 and 92% successful triple exchanges, respectively). Finally, the ability to delay gratification over increasing intervals was tested; the dogs kept one food item to exchange later for a larger item. As previously reported in non-human primates, there was considerable individual variation in the tolerance of delays, between 10 s and 10 min for the largest rewards. For those who reached longer time lags (>40 s), the dogs gave up the chance to exchange earlier than expected by each subject’s general waiting capacity; the dogs anticipated delay duration and made decisions according to the relative reward values offered. Compared to primates, dogs tolerated relatively long delays for smaller value rewards, suggesting that the socio-ecological history of domestic dogs facilitates their performance on decision-making and delay of gratification tasks.     

Applying self-determination theory to understand the motivational impact of cash rewards: New evidence from lab experiments

We investigated, based on self-determination theory (SDT), the impact of the functional meaning of monetary rewards on individuals' motivation and performance and further tested the role of the psychological needs as the underlying mechanism. In two experimental studies, we show that when presented in an autonomy-supportive way, rewards lead participants to experience greater intrinsic motivation, which leads them to perform better, than when monetary rewards are presented in a controlling way. This is mediated by greater psychological need satisfaction, indicating that through greater feelings of competence, autonomy, and relatedness, individuals experience greater intrinsic motivation for the task at hand. Our findings suggest that rewards can have a distinct effect on individuals' motivation and performance depending on whether they take on an autonomy-supportive or controlling meaning, thus providing empirical evidence for the theoretical and practical implications of SDT's concept of functional meaning of rewards. By highlighting the importance of this concept, this research contributes to our understanding of the effectiveness of such rewards in the workplace, suggesting that they can foster employee motivation and performance if organisations present them to employees in an autonomy-supportive way to convey an informational meaning and positively contribute to their psychological need stisfaction.     

Are people really more patient than other animals? Evidence from human discounting of real liquid rewards

In previous studies, researchers have found that humans discount delayed rewards orders of magnitude less steeply than do other animals. Humans also discount smaller delayed reward amounts more steeply than larger amounts, whereas animals apparently do not. These differences between humans and animals might reflect differences in the types of rewards studied and/or the fact that animals actually had to wait for their rewards. In the present article, we report the results of three experiments in which people made choices involving liquid rewards delivered and consumed after actual delays, thereby bridging the gap between animal and human studies. Under these circumstances, humans, like animals, discounted the value of rewards delayed by seconds; however, unlike animals, they still showed an effect of reward amount. Human discounting was well described by the same hyperboloid function that has previously been shown to describe animal discounting of delayed food and water rewards, as well as human discounting of real and hypothetical monetary rewards.     

Temporal Patterning in Probabilistic Choice

Human subjects making repeated choices between probabilistic and near-certain monetary rewards tended to be less risk-averse the shorter the inter-trial interval. Subjects were also less risk-averse when the choice-outcome sequences were clustered in threes than when each choice-outcome sequence was separated from its neighbors by equal intertrial intervals. These results further extend the analogy between delay discounting and probability discounting. Probability discounting, like delay discounting, may be described by hyperbolic function relating discounted value to expected delay to the next reward.     

Using logistic regression to estimate delay-discounting functions.

The monetary choice questionnaire (MCQ) and similar computer tasks ask preference questions in order to ascertain indifference, the perceived equivalence of immediate versus larger delayed rewards. Indifference data are then fitted with a hyperbolic function, summarizing the decline in perceived value with delay time. We present a fitting method that estimates the hyperbolic parameter k directly from survey responses. Binary preferences are modeled as a function of time (X2) and a transformed reward ratio (X1), yielding logistic regression coefficients beta 2 and beta 1. The hyperbolic parameter emerges as k = beta 2/beta 1, where the logistic predicted p = .5 (the definition of indifference). The MCQ was administered to 1,073 adolescents and was scored using both standard and logistic methods. The means for In(k) were similar (standard, -4.53; logistic, -4.51), and the results were highly correlated (rho = .973). Simulated MCQ data showed that k was unbiased, except where beta 1 > or = -1, indicating a vague survey response. Jackknife standard errors provided excellent coverage.     

海洛因戒除者的行为冲动性： 基于DDT和IGT任务反应模式的探讨

以61名男性海洛因戒除者和32名正常成年男性为被试,探讨了海洛因戒除者在延迟折扣任务和Iowa赌博任务两种决策条件下的冲动性反应模式及其关系。结果发现,海洛因戒除者的决策行为受其对即时强化的超敏感性或“即时收益优先”模式控制,其高冲动性特质既表现为对强化物长远价值的非敏感性,又表现为对强化物潜在风险的耐受性;该类人群上述两方面的特征虽有一定关联,但二者分别反应了其行为冲动性的两个相对独立的维度,且具有跨戒除时相的相对稳定性     

虚拟和真实金钱奖赏幅度对海洛因戒断者风险决策的影响

已有研究表明海洛因成瘾者风险决策能力受损, 但少有研究关注不同幅度金钱奖赏对戒断期海洛因成瘾者风险决策的影响以及这种影响是否会受到金钱奖赏类型的调节。因此, 本研究使用气球模拟风险任务(BART), 通过两个实验探究不同幅度虚拟和真实金钱奖赏对海洛因戒断者风险决策的影响。结果显示, 在虚拟奖赏情景下, 海洛因戒断者未爆破气球按键次数和爆破气球个数均显著大于正常组被试, 以及两组被试在25分奖赏条件下的未爆破气球按键次数和爆破气球个数均显著大于1分奖赏; 而在真实奖赏情景下, 海洛因戒断者未爆破气球按键次数和爆破气球个数均显著小于正常组被试, 以及两组被试在25分奖赏条件下的未爆破气球按键次数和爆破气球个数均显著小于1分奖赏。研究结果表明, 金钱奖赏类型和金钱奖赏幅度会影响被试的风险决策行为。在虚拟奖赏情景下, 两组被试的风险偏好水平随着奖赏幅度的增加显著升高, 但是戒断期海洛因成瘾者的风险偏好水平高于正常组被试; 而在真实奖赏情景下, 两组被试的风险偏好水平随着奖赏幅度的增加显著降低, 同时戒断期海洛因成瘾者的风险偏好水平低于正常组被试。     

Evidence for Implicit Risk: Delay Facilitates the Processing of Uncertainty

Humans and other animals discount the value of rewards over time. One explanation for this is that delayed rewards may be less certain than immediate rewards, what has been referred to as the implicit risk hypothesis. Although this explanation is widely accepted, little research has directly assessed the validity of the implicit risk hypothesis. In the current study, we present two experiments in which participants made decisions about rewards involving both delay and uncertainty. By manipulating the order in which information was presented, we were able to investigate whether delay information facilitates beliefs about uncertainty and vice versa. It was found that participants were more likely to prefer larger, delayed rewards when information about delay was presented before information about uncertainty than when the information was presented in the opposite order. Additionally, we describe a process model that implements the implicit risk hypothesis and show that it is consistent with the observed patterns of data. These results support the implicit risk hypothesis and suggest that information about delay facilitates the processing of information about uncertainty. Copyright © 2015 John Wiley & Sons, Ltd.     

Temporal discounting for monetary and close relationship outcomes

The present study extended research on intertemporal choice—in which individuals choose between outcomes that may be received immediately or after a delay—to close relationships. In Experiment 1, New Zealand university students aged 18 to 25 made decisions about hypothetical monetary and relationship outcomes, and in Experiment 2, about relationship outcomes which emphasized companionate or sexual aspects (Ns = 64). Both experiments found effects of delay and magnitude on temporal discounting rates, and domain independence for choices about close relationships, similar to previous studies with monetary outcomes. There were no significant gender differences. Overall, results suggest that people make intertemporal choices about relationships according to a similar process used to make decisions involving other types of outcomes.     

The absence of numbers to express the amount may affect delay discounting with humans

Human delay discounting is usually studied with experimental protocols that use symbols to express delay and amount. In order to further understand discounting, we evaluated whether the absence of numbers to represent reward amounts affects discount rate in general, and whether the magnitude effect is generalized to nonsymbolic situations in particular. In Experiment 1, human participants were exposed to a delay‐discounting task in which rewards were presented using dots to represent monetary rewards (nonsymbolic); under this condition the magnitude effect did not occur. Nevertheless, the magnitude effect was observed when equivalent reward amounts were presented using numbers (symbolic). Moreover, in estimation tasks, magnitude increments produced underestimation of large amounts. In Experiment 2, participants were exposed only to the nonsymbolic discounting task and were required to estimate reward amounts in each trial. Consistent with Experiment 1, the absence of numbers representing reward amounts produced similar discount rates of small and large rewards. These results suggest that value of nonsymbolic rewards is a nonlinear function of amount and that value attribution depends on perceived difference between the immediate and the delayed nonsymbolic rewards.     

Altering Impulsive Decision Making With an Acceptance-Based Procedure

Delay discounting is one facet of impulsive decision making and involves subjectively devaluing a delayed outcome. Steeply discounting delayed rewards is correlated with substance abuse and other problematic behaviors. To the extent that steep delay discounting underlies these clinical disorders, it would be advantageous to find psychosocial avenues for reducing delay discounting. Acceptance-based interventions may prove useful as they may help to decrease the distress that arises while waiting for a delayed outcome. The current study was conducted to determine if a 60–90 minute acceptance-based training would change delay discounting rates among 30 undergraduate university students in comparison to a waitlist control. Measures given at pre- and posttraining included a hypothetical monetary delay discounting task, the Acceptance and Action Questionnaire-II (AAQ-II), and the Distress Tolerance Scale. Those assigned to the treatment group decreased their discounting of delayed money, but not distress intolerance or psychological inflexibility when compared to the waitlist control group. After the waiting period, the control group received the intervention. Combining all participants’ pre- to posttreatment data, the acceptance-based treatment significantly decreased discounting of monetary rewards and increased distress tolerance. The difference in AAQ-II approached significance. Acceptance-based treatments may be a worthwhile option for decreasing delay discounting rates and, consequently, affecting the choices that underlie addiction and other problematic behaviors.     

Temporal discounting predicts student responsiveness to exchange delays in a classroom token system

Typical assessments of temporal discounting involve presenting choices between hypothetical monetary outcomes. Participants choose between smaller immediate rewards and larger delayed rewards to determine how the passage of time affects the subjective value of reinforcement. Few studies, however, have compared such discounting to actual manipulations of reward delay. The present study examined the predictive validity of a temporal discounting procedure developed for use with children. Forty-six sixth-grade students completed a brief discounting assessment and were then exposed to a classwide intervention that involved both immediate and delayed reinforcement in a multiple baseline design across classrooms. The parameters derived from two hyperbolic models of discounting correlated significantly with actual on-task behavior under conditions of immediate and delayed exchange. Implications of temporal discounting assessments for behavioral assessment and treatment are discussed.     

Gambling for Gatorade: risk-sensitive decision making for fluid rewards in humans

Determining how both humans and animals make decisions in risky situations is a central problem in economics, experimental psychology, behavioral economics, and neurobiology. Typically, humans are risk seeking for gains and risk averse for losses, while animals may display a variety of preferences under risk depending on, amongst other factors, internal state. Such differences in behavior may reflect major cognitive and cultural differences or they may reflect differences in the way risk sensitivity is probed in humans and animals. Notably, in most studies humans make one or a few choices amongst hypothetical or real monetary options, while animals make dozens of repeated choices amongst options offering primary rewards like food or drink. To address this issue, we probed risk-sensitive decision making in human participants using a paradigm modeled on animal studies, in which rewards were either small squirts of Gatorade or small amounts of real money. Possible outcomes and their probabilities were not made explicit in either case. We found that individual patterns of decision making were strikingly similar for both juice and for money, both in overall risk preferences and in trial-to-trial effects of reward outcome on choice. Comparison with decisions made by monkeys for juice in a similar task revealed highly similar gambling styles. These results unite known patterns of risk-sensitive decision making in human and nonhuman primates and suggest that factors such as the way a decision is framed or internal state may underlie observed variation in risk preferences between and within species.     

物质成瘾领域延迟折扣研究中的外部效度问题

物质成瘾者的跨期决策缺陷已被大量使用金钱延迟折扣任务的研究所证实。然而近年来, 来自金钱延迟折扣任务变式(成瘾物质延迟折扣任务、性延迟折扣任务和跨类别延迟折扣任务)的发现表明, 在物质成瘾领域的延迟折扣研究中单一使用金钱延迟折扣任务存在一定的局限性。首先, 物质成瘾者对金钱的延迟折扣水平可能并不能完全代表其对成瘾物质、性和其它自然奖赏的延迟折扣水平; 其次, 仅使用单一延迟折扣任务可能存在对物质成瘾者跨期决策过程的过度简化; 最后, 金钱延迟折扣任务较其变式对物质成瘾者的一些临床特征不够敏感。未来研究应进一步丰富、拓展物质成瘾领域的跨类别延迟折扣研究, 并对可能影响跨期决策的时间因素进行深入探索。