Tests of an indifference rule in variable‐delay and double‐reward choice procedures with humans

Four hundred and fifty participants were recruited from Amazon Mechanical Turk across 3 experiments to test the predictions of a hyperbolic discounting equation in accounting for human choices involving variable delays or multiple rewards (Mazur, 1984, 1986). In Experiment 1, participants made hypothetical choices between 2 monetary alternatives, 1 consisting of a fixed delay and another consisting of 2 delays of equal probability (i.e., a variable‐delay procedure). In Experiment 2, participants made hypothetical monetary choices between a single, immediate reward and 2 rewards, 1 immediate and 1 delayed (i.e., a double‐reward procedure). Experiment 3 also used a double‐reward procedure, but with 2 delayed rewards. Participants in all 3 experiments also completed a standard delay‐discounting task. Finally, 3 reward amounts were tested in each type of task ($100, $1000, and $5000). In the double‐reward conditions (Experiments 2 and 3), the results were in good qualitative and quantitative agreement with Mazur's model (1984, 1986). In contrast, when participants made choices involving variable delays (Experiment 1), there was relatively poor qualitative and quantitative agreement with this model. These results, along with our previous findings, suggest the structure of questions in hypothetical tasks with humans can be a strong determinant of the choice pattern.     

Introduction to the special issue on comparative cognition

Prior research has shown that nonhumans show an extreme preference for variable‐ over fixed‐delays to reinforcement. This well‐established preference for variability occurs because a reinforcer's strength or “value” decreases according to a curvilinear function as its delay increases. The purpose of the present experiments was to investigate whether this preference for variability occurs with human participants making hypothetical choices. In three experiments, participants recruited from Amazon Mechanical Turk made choices between variable and fixed monetary rewards. In a variable‐delay procedure, participants repeatedly chose between a reward delivered either immediately or after a delay (with equal probability) and a reward after a fixed delay (Experiments 1 and 2). In a double‐reward procedure, participants made choices between an alternative consisting of two rewards, one delivered immediately and one after a delay, and a second alternative consisting of a single reward delivered after a delay (Experiments 1 and 3). Finally, all participants completed a standard delay‐discounting task. Although we observed both curvilinear discounting and magnitude effects in the standard discounting task, we found no consistent evidence of a preference for variability—as predicted by two prominent models of curvilinear discounting (i.e., a simple hyperbola and a hyperboloid)—in our variable‐delay and double‐reward procedures. This failure to observe a preference for variability may be attributed to the hypothetical, rule‐governed nature of choices in the present study. In such contexts, participants may adopt relatively simple strategies for making more complex choices.     

A second type of magnitude effect: Reinforcer magnitude differentiates delay discounting between substance users and controls

Basic research on delay discounting, examining preference for smaller–sooner or larger–later reinforcers, has demonstrated a variety of findings of considerable generality. One of these, the magnitude effect, is the observation that individuals tend to exhibit greater preference for the immediate with smaller magnitude reinforcers. Delay discounting has also proved to be a useful marker of addiction, as demonstrated by the highly replicated finding of greater discounting rates in substance users compared to controls. However, some research on delay discounting rates in substance users, particularly research examining discounting of small‐magnitude reinforcers, has not found significant differences compared to controls. Here, we hypothesize that the magnitude effect could produce ceiling effects at small magnitudes, thus obscuring differences in delay discounting between groups. We examined differences in discounting between high‐risk substance users and controls over a broad range of magnitudes of monetary amounts ($0.10, $1.00, $10.00, $100.00, and $1000.00) in 116 Amazon Mechanical Turk workers. We found no significant differences in discounting rates between users and controls at the smallest reinforcer magnitudes ($0.10 and $1.00) and further found that differences became more pronounced as magnitudes increased. These results provide an understanding of a second form of the magnitude effect: That is, differences in discounting between populations can become more evident as a function of reinforcer magnitude.     

Age‐related differences in delay discounting: Immediate reward,reward magnitude,and social influence

Delay discounting refers to the tendency of individuals to subjectively devalue rewards that are to be received in the future, with high rates of delay discounting being associated with a variety of maladaptive life outcomes (e.g., unhealthy dietary and exercise behaviors). The current study explored the psychological and social processes involved in adult age‐related differences in delay discounting of monetary rewards. Younger adults exhibited higher levels of delay discounting than older adults. This increased level of patience in older adults was found whether smaller‐sooner rewards were to be received immediately or in the future. However, there was an interaction with reward magnitude, whereby younger adults exhibited higher levels of delay discounting for smaller reward magnitudes but not larger reward magnitudes. Social influence on delay discounting was investigated by having participants complete three phases of the delay‐discounting task: an individual precollaboration phase, a collaboration phase in age‐group‐matched dyads, and an individual postcollaboration phase. A convergence effect was observed in that dyad members' postcollaboration choices were significantly more similar compared to their baseline choices during the precollaboration phase. Moreover, levels of convergence were comparable between younger and older adults, suggesting age invariance in social influence on delay discounting. The current results demonstrate a degree of malleability in delay discounting that extends into older adulthood, making interventions targeting the construct a promising avenue for future research.     

The absence of numbers to express the amount may affect delay discounting with humans

Human delay discounting is usually studied with experimental protocols that use symbols to express delay and amount. In order to further understand discounting, we evaluated whether the absence of numbers to represent reward amounts affects discount rate in general, and whether the magnitude effect is generalized to nonsymbolic situations in particular. In Experiment 1, human participants were exposed to a delay‐discounting task in which rewards were presented using dots to represent monetary rewards (nonsymbolic); under this condition the magnitude effect did not occur. Nevertheless, the magnitude effect was observed when equivalent reward amounts were presented using numbers (symbolic). Moreover, in estimation tasks, magnitude increments produced underestimation of large amounts. In Experiment 2, participants were exposed only to the nonsymbolic discounting task and were required to estimate reward amounts in each trial. Consistent with Experiment 1, the absence of numbers representing reward amounts produced similar discount rates of small and large rewards. These results suggest that value of nonsymbolic rewards is a nonlinear function of amount and that value attribution depends on perceived difference between the immediate and the delayed nonsymbolic rewards.     

Sex differences in the effects of disinhibition,perceived peer drinking,and delay discounting on drinking among Japanese college students

Disinhibition, perceived peer drinking, and delay discounting are considered significant predictors of drinking in young adults. This study examined whether perceived peer drinking and delay discounting mediate the association between disinhibition and drinking for young men and women. In this study, 258 Japanese college students (109 men and 149 women, mean age 19.17 (SD = 1.20) years old) completed a self-administered questionnaire that included four measures—the disinhibition subscale of the Sensation Seeking Scale for Japanese Adolescents, the proportion of friends who drink as an index of perceived peer drinking behaviors, the Monetary Choice Questionnaire, and participants’ own drinking behavior. In the multiple mediator models analyzed using structural equation modeling, for both sexes, perceived peer drinking had the largest direct effect on participants’ drinking, followed by disinhibition and delay discounting. However, the results of mediation analyses indicated that perceived peer drinking mediated the association between disinhibition and drinking for only women. The results of this study imply that it is important to consider sex differences in the association between personality traits and peer influence to develop programs aiming to reduce drinking among young adults in Japan.     

The Gist of Delay of Gratification: Understanding and Predicting Problem Behaviors

Delay of gratification captures elements of temptation and self‐denial that characterize real‐life problems with money and other problem behaviors such as unhealthy risk taking. According to fuzzy‐trace theory, decision makers mentally represent social values such as delay of gratification in a coarse but meaningful form of memory called “gist.” Applying this theory, we developed a gist measure of delay of gratification that does not involve quantitative trade‐offs (as delay discounting does) and hypothesize that this construct explains unique variance beyond sensation seeking and inhibition in accounting for problem behaviors. Across four studies, we examine this Delay‐of‐gratification Gist Scale by using principal components analyses and evaluating convergent and divergent validity with other potentially related scales such as Future Orientation, Propensity to Plan, Time Perspectives Inventory, Spendthrift‐Tightwad, Sensation Seeking, Cognitive Reflection, Barratt Impulsiveness, and the Monetary Choice Questionnaire (delay discounting). The new 12‐item measure captured a single dimension of delay of gratification, correlated as predicted with other scales, but accounted for unique variance in predicting such outcomes as overdrawing bank accounts, substance abuse, and overall subjective well‐being. Results support a theoretical distinction between reward‐related approach motivation, including sensation seeking, and inhibitory faculties, including cognitive reflection. However, individuals' agreement with the qualitative gist of delay of gratification, as expressed in many cultural traditions, could not be reduced to such dualist distinctions nor to quantitative conceptions of delay discounting, shedding light on mechanisms of self‐control and risk taking. Copyright © 2016 John Wiley & Sons, Ltd.     

Syntax for calculation of discounting indices from the monetary choice questionnaire and probability discounting questionnaire

The 27‐item Monetary Choice Questionnaire (MCQ; Kirby, Petry, & Bickel, 1999) and 30‐item Probability Discounting Questionnaire (PDQ; Madden, Petry, & Johnson, 2009) are widely used, validated measures of preferences for immediate versus delayed rewards and guaranteed versus risky rewards, respectively. The MCQ measures delayed discounting by asking individuals to choose between rewards available immediately and larger rewards available after a delay. The PDQ measures probability discounting by asking individuals to choose between guaranteed rewards and a chance at winning larger rewards. Numerous studies have implicated these measures in addiction and other health behaviors. Unlike typical self‐report measures, the MCQ and PDQ generate inferred hyperbolic temporal and probability discounting functions by comparing choice preferences to arrays of functions to which the individual items are preconfigured. This article provides R and SPSS syntax for processing the MCQ and PDQ. Specifically, for the MCQ, the syntax generates k values, consistency of the inferred k, and immediate choice ratios; for the PDQ, the syntax generates h indices, consistency of the inferred h, and risky choice ratios. The syntax is intended to increase the accessibility of these measures, expedite the data processing, and reduce risk for error.     

Reformative self‐control and discounting of reward value by delay or effort1

Abstract: The relation between reformative self‐control and discounting of reward value by delay or effort was examined. Thirty‐two Japanese undergraduates were selected based on their scores on a standardized pencil and paper test of self‐control, the Redressive–Reformative Self‐Control Scale ( Sugiwaka, 1995 ). The subjects indicated their preference (i) between a hypothetical 100 000 yen reward available with various delays and a certain reward of variable amount available immediately; or (ii) between a hypothetical 100 000 yen reward available with various efforts and a certain reward of variable amount available without effort. The discounting of delayed reward value was described well by a hyperbolic function proposed by Mazur (1987 ). The slopes of the delayed discounting curves were steeper for subjects who scored low on the Reformative Self‐Control Scale, which is a measure of reformative self‐control and a subscale of the Redressive–Reformative Self‐Control Scale. The discounting by effort was also described well by the hyperbolic function. The slopes of the effortful discounting curves did not correlate to those of the delayed discounting curves. The slopes were not systematically different across the groups of subjects with different scores on the reformative self‐control scale.     

Comparing rapid assessments of delay discounting with real and hypothetical rewards in children

Recent advances in assessment methodology have resulted in a highly efficient procedure for obtaining delay discounting rates for adults: a 5‐trial adjusting delay task (ADT‐5) examining intertemporal choice for hypothetical rewards. The low participant burden of this task makes it potentially useful for children, with whom delay discounting research is relatively limited. However, it is unknown whether results from this task match choice for real rewards. The present study assessed delay discounting for real and hypothetical monetary rewards using a modified ADT‐5 with 9 children admitted to a psychiatric day treatment program. Participants completed up to 3 tasks with each reward type in alternating order. No difference in discounting rate, via log(k), was observed between the first task of each reward type. This finding was replicated across subsequent tasks for the subset of participants (n = 6) who completed all 6 tasks. However, delay discounting of real and hypothetical rewards was not found to be statistically equivalent. These results suggest that a modified ADT‐5 using hypothetical rewards may be a viable option for assessing delay discounting in children with psychiatric diagnoses, but additional research is needed to explicitly examine whether hypothetical and real rewards are discounted equivalently in this population.     

Delay, Probability, and Social Discounting in A Public Goods Game

A human social discount function measures the value to a person of a reward to another person at a given social distance. Just as delay discounting is a hyperbolic function of delay, and probability discounting is a hyperbolic function of odds-against, social discounting is a hyperbolic function of social distance. Experiment 1 obtained individual social, delay, and probability discount functions for a hypothetical $75 reward; participants also indicated how much of an initial $100 endowment they would contribute to a common investment in a public good. Steepness of discounting correlated, across participants, among all three discount dimensions. However, only social and probability discounting were correlated with the public-good contribution; high public-good contributors were more altruistic and also less risk averse than low contributors. Experiment 2 obtained social discount functions with hypothetical $75 rewards and delay discount functions with hypothetical $1,000 rewards, as well as public-good contributions. The results replicated those of Experiment 1; steepness of the two forms of discounting correlated with each other across participants but only social discounting correlated with the public-good contribution. Most participants in Experiment 2 predicted that the average contribution would be lower than their own contribution.     

Impact of Worry on Career Thoughts,Career Decision State,and Cognitive Information Processing Skills

Sixty-nine Amazon Mechanical Turk workers completed the Penn State Worry Questionnaire (Berle et al., 2011), the Career Thoughts Inventory (Sampson et al., 1996a), and the Career State Inventory (Leierer et al., 2017). Worry was significantly correlated with negative career thinking and its dimensions of decision-making confusion and commitment anxiety, with readiness and its dimensions of clarity and certainty, and with the self-assessed cognitive information processing skills of self-knowledge, options knowledge, decision-making, and executive processing. Worry was also found to predict the degree of readiness for career decision-making, negative career thinking, and cognitive information processing requisite skills.     

Does a Judicial Warning Improve Defendant‐Culprit Matching?

During a trial, jurors may be asked to compare the defendant with video of the culprit. Yet matching unfamiliar people in this manner can be difficult and error‐prone. Judges may warn jurors about the dangers of identification from video images, but the effect of warnings is unknown. Here we report two studies that assessed the effect of warning instructions on defendant‐culprit matching. In Experiment 1, college students read either control, warning, or illustrated warning instructions before deciding if a defendant seen in one video matched the culprit in another video. Experiment 2 compared control and warning instructions in a sample of Amazon Mechanical Turk workers. Matching accuracy in both experiments was poor, and warnings did not consistently improve performance or make participants more cautious. These results do not support the supposition that warning instructions help jurors compare the defendant to images of the culprit.Copyright © 2016 John Wiley & Sons, Ltd.     

Impulsive choice and pre‐exposure to delays: iv. effects of delay‐ and immediacy‐exposure training relative to maturational changes in impulsivity

Impulsive choice describes preference for smaller, sooner rewards over larger, later rewards. Excessive delay discounting (i.e., rapid devaluation of delayed rewards) underlies some impulsive choices, and is observed in many maladaptive behaviors (e.g., substance abuse, gambling). Interventions designed to reduce delay discounting may provide therapeutic gains. One such intervention provides rats with extended training with delayed reinforcers. When compared to a group given extended training with immediate reinforcers, delay‐exposed rats make significantly fewer impulsive choices. To what extent is this difference due to delay‐exposure training shifting preference toward self‐control or immediacy‐exposure training (the putative control group) shifting preference toward impulsivity? The current study compared the effects of delay‐ and immediacy‐exposure training to a no‐training control group and evaluated within‐subject changes in impulsive choice across 51 male Wistar rats. Delay‐exposed rats made significantly fewer impulsive choices than immediacy‐exposed and control rats. Between‐group differences in impulsive choice were not observed in the latter two groups. While delay‐exposed rats showed large, significant pre‐ to posttraining reductions in impulsive choice, immediacy‐exposed and control rats showed small reductions in impulsive choice. These results suggest that extended training with delayed reinforcers reduces impulsive choice, and that extended training with immediate reinforcers does not increase impulsive choice.     

Measuring delay discounting in a crowdsourced sample: An exploratory study

Delay discounting is a measure of preferences for smaller immediate rewards over larger delayed rewards. Discounting has been assessed in many ways; these methods have variably and inconsistently involved measures of different lengths (single vs. multiple items), forced‐choice methods, self‐report methods, online and laboratory assessments, monetary and non‐monetary compensation. The majority of these studies have been conducted in laboratory settings. However, over the past 20 years, behavioral data collection has increasingly shifted online. Usually, these experiments involve completing short tasks for small amounts of money, and are thus qualitatively different than experiments in the lab, which are typically more involved and in a strongly controlled environment. The present study aimed to determine how to best measure future discounting in a crowdsourced sample using three discounting measures (a single shot measure, the 27‐item Kirby Monetary Choice Questionnaire, and a one‐time Matching Task). We examined associations of these measures with theoretically related variables, and assessed influence of payment on responding. Results indicated that correlations between the discounting tasks and conceptually related measures were smaller than in prior laboratory experiments. Moreover, our results suggest providing monetary compensation may attenuate correlations between discounting measures and related variables. These findings suggest that incentivizing discounting measures changes the nature of measurement in these tasks.     

Rejection sensitivity,complaint‐related communication,and relational satisfaction: A mediation analysis

This study examines the links among rejection sensitivity (RS), communication about complaints, and relational satisfaction in intimate relationships. A total of 260 individuals completed an online survey through Amazon Mechanical Turk. RS was positively associated with complaint avoidance and negatively associated with positive politeness and negative politeness when voicing complaints. Furthermore, RS had indirect associations with relational satisfaction, partially mediated through complaint avoidance and positive politeness. The results of this study suggest that communicating complaints openly to one's partner, in concert with positive politeness (i.e., affirming the partner while voicing complaints), may help serve as a buffer against relational dissatisfaction associated with RS.     

The influence of evidence type and product involvement on message‐framing effects in advertising

• Extrapolating from prior research that describes the persuasive effects of gain‐ versus loss‐framed messages via the heuristic‐systematic model (HSM), the current study incorporated two advertising‐related factors – evidence type (informational vs. exemplar) and product involvement – and examined their influence on message‐framing effects in advertisements for commonplace consumer products. A significant interaction in Experiment 1 indicated that loss‐framed messages were persuasive in a higher‐involvement context only when coupled with informational evidence, which enhanced systematic processing among participants and thereby elicited the framing effect. No interaction effects occurred in the lower‐involvement context of Experiment 2, in which the hypothesized thought‐processing patterns did not evince. Consistent with recent theoretical advancements, these results indicate that message‐framing effects can be attenuated when both systematic and heuristic processing occur simultaneously. Practical implications are discussed.

Copyright © 2008 John Wiley & Sons, Ltd.     

Temporal discounting predicts student responsiveness to exchange delays in a classroom token system

Typical assessments of temporal discounting involve presenting choices between hypothetical monetary outcomes. Participants choose between smaller immediate rewards and larger delayed rewards to determine how the passage of time affects the subjective value of reinforcement. Few studies, however, have compared such discounting to actual manipulations of reward delay. The present study examined the predictive validity of a temporal discounting procedure developed for use with children. Forty-six sixth-grade students completed a brief discounting assessment and were then exposed to a classwide intervention that involved both immediate and delayed reinforcement in a multiple baseline design across classrooms. The parameters derived from two hyperbolic models of discounting correlated significantly with actual on-task behavior under conditions of immediate and delayed exchange. Implications of temporal discounting assessments for behavioral assessment and treatment are discussed.     

Impact of Experimentally Induced Positive and Anxious Mood on Alcohol Expectancy Strength in Internally Motivated Drinkers

The effects of musically‐induced positive and anxious mood on explicit alcohol‐related cognitions (alcohol expectancy strength) in 47 undergraduate students who consume alcohol either to enhance positive mood states (for enhancement motives) or to cope with anxiety (for anxiety‐related coping motives) were investigated. Pre‐ and post‐mood induction, participants completed the emotional reward and emotional relief subscales of the Alcohol Craving Questionnaire – Now. The hypothesis that anxiety‐related coping motivated drinkers in the anxious mood condition (but not those in the positive mood condition) would exhibit increases in strength of explicit emotional relief alcohol expectancies after the mood induction was supported. An additional, unanticipated finding was that enhancement‐motivated drinkers in the anxious condition also showed significant increases in strength of explicit emotional relief (but not emotional reward) alcohol expectancies. The hypothesis that enhancement‐motivated (but not anxiety‐related coping motivated) participants would exhibit increases in explicit emotional reward expectancies following exposure to the positive mood induction procedure was not supported. Taken together with past research findings, the current results highlight the importance of distinguishing between subtypes of negative affect (i.e., anxious and depressed affect) in exploring the affective antecedents of explicit alcohol outcome expectancies.     

Graph‐Framing Effects in Decision Making

This study manipulated the graphical representation of options by framing the physical characters in figures and found that preferences could be affected even when the words and numbers of the problem were constant. Based on attribute substitution theory and an equate‐to‐differentiate approach, we proposed a two‐process model of graph‐framing effects. In the first mental process, the graph‐editing process, the physical features (e.g., distance, size) represented in the graph are visually edited, and the perceived numerical difference between the options is judged based on its physical features. The second mental process, the preferential choice process, occurs by an equate‐to‐differentiate approach in which people seek to equate the difference between options on the dimension on which the difference is smaller, thus leaving the greater other‐dimensional difference to be the determinant of the final choice. Four experiments were tested for graph‐framing effects. Experiment 1 found a graph‐framing effect in coordinate graphs resting on the (de)compression of the scales employed in the figures. Experiment 2 revealed additional graph‐framing effects in other question scenarios and showed that preference changes were mediated by perceived numerical distances. Experiment 3 further confirmed the presence of graph‐framing effects in sector graphs similar to those found in coordinate ones. Experiment 4 suggested that such graph‐framing effects could be eliminated when logical processing (e.g., introducing a mathematical operation before a choice task) was encouraged. This paper discusses related research and a possible substrate basis for graph‐framing effects. Copyright © 2011 John Wiley & Sons, Ltd.