Tests of an indifference rule in variable‐delay and double‐reward choice procedures with humans

Four hundred and fifty participants were recruited from Amazon Mechanical Turk across 3 experiments to test the predictions of a hyperbolic discounting equation in accounting for human choices involving variable delays or multiple rewards (Mazur, 1984, 1986). In Experiment 1, participants made hypothetical choices between 2 monetary alternatives, 1 consisting of a fixed delay and another consisting of 2 delays of equal probability (i.e., a variable‐delay procedure). In Experiment 2, participants made hypothetical monetary choices between a single, immediate reward and 2 rewards, 1 immediate and 1 delayed (i.e., a double‐reward procedure). Experiment 3 also used a double‐reward procedure, but with 2 delayed rewards. Participants in all 3 experiments also completed a standard delay‐discounting task. Finally, 3 reward amounts were tested in each type of task ($100, $1000, and $5000). In the double‐reward conditions (Experiments 2 and 3), the results were in good qualitative and quantitative agreement with Mazur's model (1984, 1986). In contrast, when participants made choices involving variable delays (Experiment 1), there was relatively poor qualitative and quantitative agreement with this model. These results, along with our previous findings, suggest the structure of questions in hypothetical tasks with humans can be a strong determinant of the choice pattern.     

Pathological gamblers, with and without substance use disorders, discount delayed rewards at high rates

Pathological gambling is classified as a disorder of impulse control, yet little research has evaluated behavioral indices of impulsivity in gamblers. The rates at which rewards delayed in time are subjectively devalued may be a behavioral marker of impulsivity. This study evaluated delay discounting in 60 pathological gamblers and 26 control participants. Gamblers were divided into those with (n = 21) and without (n = 39) substance use disorders. A hypothetical $1,000 reward was delayed at intervals ranging from 6 hr to 25 years, and immediate rewards varied from $1 to $999. Pathological gamblers discounted delayed rewards at higher rates than control participants, and gamblers with substance use disorders discounted delayed rewards at higher rates than non-substance-abusing gamblers. These data provide further evidence that rapid discounting of delayed rewards may be a feature central to impulse control and addictive disorders, including pathological gambling.     

Foregoing the labor for the fruits: The effect of just world threat on the desire for immediate monetary rewards

Previous theorizing and research suggest that the need to believe in a just world develops when children begin to understand the benefits of foregoing their immediate gratifications for more desirable, long-term outcomes. Drawing on this previous work, we propose that an extant just world threat may induce a desire for smaller, immediate rewards at the expense of larger, delayed rewards. Participants were exposed to the suffering of an innocent or non-innocent victim and then, in a different context, completed a temporal discounting task that assessed, across six time delays, their preferences for smaller, immediate monetary rewards versus a constant, larger, delayed reward. Consistent with our reasoning, participants exposed to the suffering of an innocent versus non-innocent victim more steeply discounted the value of the delayed reward—that is, they were willing to accept smaller immediate rewards in place of the larger, delayed reward. The theoretical and practical implications of these results are discussed.     

Does goal relevant episodic future thinking amplify the effect on delay discounting?

Delay discounting (DD) is the preference for smaller immediate rewards over larger delayed rewards. Research shows episodic future thinking (EFT), or mentally simulating future experiences, reframes the choice between small immediate and larger delayed rewards, and can reduce DD. Only general EFT has been studied, whereby people reframe decisions in terms of non-goal related future events. Since future thinking is often goal-oriented and leads to greater activation of brain regions involved in prospection, goal-oriented EFT may be associated with greater reductions in DD than general goal-unrelated EFT. The present study (n = 104, M_age = 22.25, SD = 3.42; 50% Female) used a between-subjects 2 × 2 factorial design with type of episodic thinking (Goal, General) and temporal perspective (Episodic future versus recent thinking; EFT vs ERT) as between factors. Results showed a significant reduction in DD for EFT groups (p < 0.001, Cohen’s d effect size = 0.89), and goal-EFT was more effective than general-EFT on reducing DD (p = 0.03, d = 0.64).     

A cross-sectional and longitudinal analysis of reward-related brain activation: Effects of age,pubertal stage,and reward sensitivity

Neurobiological models suggest that adolescents are driven by an overactive ventral striatum (VS) response to rewards that may lead to an adolescent increase in risk-taking behavior. However, empirical studies showed mixed findings of adolescents’ brain response to rewards. In this study, we aimed to elucidate the relationship between reward-related brain activation and risky decision-making. In addition, we examined effects of age, puberty, and individuals’ reward sensitivity. We collected two datasets: Experiment 1 reports cross-sectional brain data from 75 participants (ages 10–25) who played a risky decision task. Experiment 2 presents a longitudinal extension in which a subset of these adolescents (n = 33) was measured again 2 years later. Results showed that (1) a reward-related network including VS and medial PFC was consistently activated over time, (2) the propensity to choose the risky option was related to increased reward-related activation in VS and medial PFC, and (3) longitudinal comparisons indicated that self-reported reward sensitivity was specifically related to VS activation over time. Together, these results advance our insights in the brain circuitry underlying reward processing across adolescence.     

Visual discrimination of delayed self-generated movement reveals the temporal limit of proprioceptive–visual intermodal integration

This study examined the intermodal integration of visual–proprioceptive feedback via a novel visual discrimination task of delayed self-generated movement. Participants performed a goal-oriented task in which visual feedback was available only via delayed videos displayed on two monitors—each with different delay durations. During task performance, delay duration was varied for one of the videos in the pair relative to a standard delay, which was held constant. Participants were required to identify and use the video with the lesser delay to perform the task. Visual discrimination of the lesser-delayed video was examined under four conditions in which the standard delay was increased for each condition. A temporal limit for proprioceptive–visual intermodal integration of 3–5 s was revealed by subjects’ inability to reliably discriminate video pairs.     

Delay-discounting probabilistic rewards: Rates decrease as amounts increase

The independence of delay-discounting rate and monetary reward size was tested by offering subjects (N = 621) a series of choices between immediate rewards and larger, delayed rewards. In contrast to previous studies, in which hypothetical rewards have typically been employed, subjects in the present study were entered into a lottery in which they had a chance of actually receiving one of their choices. The delayed rewards were grouped into small ($30–$35), medium ($55–$65), and large amounts ($70–$85). Using a novel parameter estimation procedure, we estimated discounting rates for all three reward sizes for each subject on the basis of his/her pattern of choices. The data indicated that the discounting rate is a decreasing function of the size of the delayed reward (p < .0001), whether hyperbolic or exponential discounting functions are assumed. In addition, a reliable gender difference was found (p = .005), with males discounting at higher rates than females, on average.     

Temporal discounting predicts student responsiveness to exchange delays in a classroom token system

Typical assessments of temporal discounting involve presenting choices between hypothetical monetary outcomes. Participants choose between smaller immediate rewards and larger delayed rewards to determine how the passage of time affects the subjective value of reinforcement. Few studies, however, have compared such discounting to actual manipulations of reward delay. The present study examined the predictive validity of a temporal discounting procedure developed for use with children. Forty-six sixth-grade students completed a brief discounting assessment and were then exposed to a classwide intervention that involved both immediate and delayed reinforcement in a multiple baseline design across classrooms. The parameters derived from two hyperbolic models of discounting correlated significantly with actual on-task behavior under conditions of immediate and delayed exchange. Implications of temporal discounting assessments for behavioral assessment and treatment are discussed.     

Neural activity in relation to temporal distance: Differences in past and future temporal discounting

This study investigated the differences between past and future temporal discounting in terms of neural activity in relation to temporal distance. Results show that brain regions are engaged differently in past and future temporal discounting. This is likely because past temporal discounting requires memory reconstruction, whereas future temporal discounting requires the processing of uncertainty about the future. In past temporal discounting, neural activity differed only when preferences were made between rewards received one hour prior and rewards received further in the past. The peak amplitudes of P2 and P3 varied as the temporal distance increased from 2 weeks to 50 years. In future temporal discounting, neural activity differed only when preferences were evaluated between two delayed rewards. The delay conditions (6 months:5 years) and (6 months:50 years) had a significant influence on P2 and N2. Findings indicate the existence of different decision-making systems operating in past and future temporal discounting.     

The development of prudence in the face of varying future rewards

The choice to delay gratification, opting for a greater reward later instead of a smaller reward now, has been used as a measure of preschoolers' ability to make future-oriented decisions. The present studies investigated to what extent these choice tasks reflect children's ability to make choices in favour of their future self. In Experiment 1, preschoolers were presented with choices between a smaller immediate reward of one sticker and larger delayed rewards varying in amount from two to five stickers. Whereas 3-year-olds showed no increased tendency to choose the delayed option as quantity increased from two to five, 4-year-olds' future-oriented choices reflected the value of the delayed reward. In Experiment 2, preschoolers chose between immediate and delayed rewards that were equal in amount and varied between one and four stickers. Three-year-olds reliably chose the immediate reward and showed no differentiation among rewards, whereas 4-year-olds chose in a manner that suggested they were trying to satisfy both immediate and future desires. Together these results support the notion that future-oriented prudence reflects growth in concern for the future self.     

The Effect of Symbolic Distancing on Delay Tolerance across the Preschool Period

ABSTRACT

We aimed to longitudinally examine how symbolic distancing affects preschool children’s delay tolerance in a delay choice task. We presented children with choices between a smaller immediate reward and a larger delayed reward in conditions with either symbolic stimuli or edible rewards. Overall, symbolic distancing modulated children’s delay tolerance. In particular, whereas in the first phase (T1: 3- and 4-year-olds) children presented with edible rewards chose the larger option more often than children presented with symbolic stimuli, in the second phase (T2: 5- and 6-year-olds), there was no significant difference between children presented with symbolic stimuli and those presented with edible rewards. These results are discussed by examining how children’s delay tolerance changes during the development and comparing children to adult humans in a similar task.     

Impaired retention is responsible for temporal order memory deficits in mild cognitive impairment

Temporal order memory, or remembering the order of events, is critical for everyday functioning and is difficult for patients with mild cognitive impairment (MCI). It is currently unclear whether these patients have difficulty acquiring and/or retaining such information and whether deficits in these patients are in excess of “normal” age-related declines. Therefore, the current study examined age and disease-related changes in temporal order memory as well as whether memory load played a role in such changes. Young controls (n = 25), older controls (n = 34), and MCI patients (n = 32) completed an experimental task that required the reconstruction of sequences that were 3, 4, or 5 items in length both immediately after presentation (i.e., immediate recall) and again after a 10-min delay (i.e., delayed recall). During the immediate recall phase, there was an effect of age largely due to reduced performance at the two longest span lengths. Older controls and MCI patients only differed during the five span (controls > MCI). During the delayed recall, however, there were significant effects of both age and MCI regardless of span length. In MCI patients, immediate recall was significantly correlated with measures of executive functioning, whereas delayed recall performance was only related to other memory tests. These findings suggest that MCI patients experience initial temporal order memory deficits at the point when information begins to exceed working memory capacity and become dependent on medial temporal lobe functioning. Longer-term deficits are due to an inability to retain information, consistent with the characteristic medial temporal lobe dysfunction in MCI.     

Anxiety and intertemporal decision making: The effect of the behavioral inhibition system and the moderation effects of trait anxiety on both state anxiety and socioeconomic status

Based on Gray's theory, which links the behavioral inhibition motivation system (BIS) to the personality trait of “anxiety”, the present study examined whether anxiety (trait vs. state), BIS sensitivity, and family socioeconomic status in childhood (SES) had an interactive or independent impact on intertemporal decision-making processes. The study also investigated whether participants with high trait anxiety had a significantly different choice preference on the immediate but smaller (SS) rewards over the larger but delayed (LL) rewards. Participants (N = 108) were randomly assigned to either the anxiety or the control condition. Results showed that people with a higher BIS score tended to choose less SS rewards. Trait anxiety was found to moderate both state anxiety and childhood SES to influence intertemporal decision processes. We further found high or low trait anxiety significantly influenced people's choice preference. Speculations on the psychological meanings of the findings were discussed from the perspective of biased risk perception. Limitations and implications were also discussed.     

Psychosocial correlates of frequent indoor tanning among adolescent boys

The aim of the current study was to assess psychosocial correlates (i.e., perceived weight, weight control strategies, substance use, and victimization) of frequent indoor tanning in adolescent boys—a group at high risk for developing skin cancer. Participants (N = 7,907) were drawn from a nationally representative sample of adolescent boys attending high school in the United States. Binary logistic regression revealed that extreme weight control strategies, particularly steroid use (odds ratio = 3.67) and compensatory vomiting (odds ratio = 2.34), along with substance use and victimization, were significantly related to frequent indoor tanning. These results highlight the role of appearance-changing, and health-risk behaviors in the context of frequent indoor tanning. Skin cancer prevention interventions may benefit from adopting approaches that integrate the treatment of body dissatisfaction and subsequent maladaptive behaviors.     

Personality correlates of risky health outcomes: Findings from a large Internet study

Numerous studies have documented the effects of personality on health outcomes. However, which traits are most relevant to health, and the precise magnitude of their effects, is inconsistent across studies. The present study used a large sample (N = 460,172) to replicate and extend the relations between the Big Five and three health-related outcomes: self-reported health, body mass index, and substance use. Low Conscientiousness predicted all outcomes, indicating that individuals who are less responsible and less self-controlled tend to report poorer health, be more overweight, and engage in more substance use. Individuals who were more emotionally unstable (high Neuroticism) reported poorer health, and individuals prone to seek out social experiences and rewards (high Extraversion) engaged in more frequent substance use.     

The absence of numbers to express the amount may affect delay discounting with humans

Human delay discounting is usually studied with experimental protocols that use symbols to express delay and amount. In order to further understand discounting, we evaluated whether the absence of numbers to represent reward amounts affects discount rate in general, and whether the magnitude effect is generalized to nonsymbolic situations in particular. In Experiment 1, human participants were exposed to a delay‐discounting task in which rewards were presented using dots to represent monetary rewards (nonsymbolic); under this condition the magnitude effect did not occur. Nevertheless, the magnitude effect was observed when equivalent reward amounts were presented using numbers (symbolic). Moreover, in estimation tasks, magnitude increments produced underestimation of large amounts. In Experiment 2, participants were exposed only to the nonsymbolic discounting task and were required to estimate reward amounts in each trial. Consistent with Experiment 1, the absence of numbers representing reward amounts produced similar discount rates of small and large rewards. These results suggest that value of nonsymbolic rewards is a nonlinear function of amount and that value attribution depends on perceived difference between the immediate and the delayed nonsymbolic rewards.     

DISCOUNTING OF DELAYED REWARDS:

Abstract— In this study, children, young adults, and older adults chose between immediate and delayed hypothetical monetary rewards The amount of the delayed reward was held constant while its delay was varied All three age groups showed delay discounting, that is, the amount of an immediate reward judged to be of equal value to the delayed reward decreased as a function of delay The rate of discounting was highest for children and lowest for older adults, predicting a life-span developmental trend toward increased selfcontrol Discounting of delayed rewards by all three age groups was well described by a single function with agesensitive parameters (all R²s>94) Thus, even though there are quantitative age differences in delay discounting, the existence of an age-invanant form of discount function suggests that the process of choosing between rewards of different amounts and delays is qualitatively similar across the life span     

High temporal discounters overvalue immediate rewards rather than undervalue future rewards: An event-related brain potential study

Impulsivity is characterized in part by heightened sensitivity to immediate relative to future rewards. Although previous research has suggested that “high discounters” in intertemporal choice tasks tend to prefer immediate over future rewards because they devalue the latter, it remains possible that they instead overvalue immediate rewards. To investigate this question, we recorded the reward positivity, a component of the event-related brain potential (ERP) associated with reward processing, with participants engaged in a task in which they received both immediate and future rewards and nonrewards. The participants also completed a temporal discounting task without ERP recording. We found that immediate but not future rewards elicited the reward positivity. High discounters also produced larger reward positivities to immediate rewards than did low discounters, indicating that high discounters relatively overvalued immediate rewards. These findings suggest that high discounters may be more motivated than low discounters to work for monetary rewards, irrespective of the time of arrival of the incentives.     

Observing response acquisition: preference for unpredictable appetitive rewards obtained under conditions predicted by DMOD

In five E-maze experiments, rats were given a choice between receiving reward and nonreward in a situation where stimuli were correlated with reward outcome (predictable situation) versus one where the stimuli were uncorrelated with reward outcome (unpredictable situation). Preference for the unpredictable situation occurred under the following conditions: (a) small (one 37-mg pellet), immediate rewards; (b) small, delayed (15 s) rewards, if the cues correlated with reward outcome were absent during the delay interval; (c) large (15 pellets), immediate rewards if a difficult discrimination was required; and (d) if the stimulus predicting nonreward was present at the choice point. Preference for the predictable situation was strongest if reinforcement was delayed and large or the stimulus predicting reward was present at the choice point. A weaker preference for the predictable situation occurred if reinforcement was immediate and large and a simple discrimination was required or if reinforcement was large and delayed and the cues that correlated with reward outcome were absent during the delay interval. The results support the predictions of DMOD (Daly modification of the Rescorla-Wagner model), a mathematical model of appetitive learning (Daly & Daly, 1982).