Modeling Myopic Decisions: Evidence for Hyperbolic Delay-Discounting within Subjects and Amounts

Hyperbolic and exponential discounting functions were compared as models of subjects′ present valuations of delayed rewards. Previous comparisons have been limited by relying on the assumption that discounting rate is independent of reward size; we avoided this limitation by making all comparisons within reward sizes. In Experiment 1, using real rewards in a simulated auction, and in Experiment 2, using hypothetical rewards, we offered subjects five monetary rewards at six delays each and asked them to indicate the smallest amount that they would accept immediately in exchange for those rewards. Both discounting functions were then fit to the six reported amounts for each reward using nonlinear regressions. In both experiments, although both functions fit the data very well, the hyperbolic function fit better for all of the delayed rewards. Furthermore, the hyperbolic function better described the data for 20 of 21 and 14 of 18 subjects in Experiments 1 and 2, respectively.     

Decision by sampling

We present a theory of decision by sampling (DbS) in which, in contrast with traditional models, there are no underlying psychoeconomic scales. Instead, we assume that an attribute's subjective value is constructed from a series of binary, ordinal comparisons to a sample of attribute values drawn from memory and is its rank within the sample. We assume that the sample reflects both the immediate distribution of attribute values from the current decision's context and also the background, real-world distribution of attribute values. DbS accounts for concave utility functions; losses looming larger than gains; hyperbolic temporal discounting; and the overestimation of small probabilities and the underestimation of large probabilities.     

Delay, Probability, and Social Discounting in A Public Goods Game

A human social discount function measures the value to a person of a reward to another person at a given social distance. Just as delay discounting is a hyperbolic function of delay, and probability discounting is a hyperbolic function of odds-against, social discounting is a hyperbolic function of social distance. Experiment 1 obtained individual social, delay, and probability discount functions for a hypothetical $75 reward; participants also indicated how much of an initial $100 endowment they would contribute to a common investment in a public good. Steepness of discounting correlated, across participants, among all three discount dimensions. However, only social and probability discounting were correlated with the public-good contribution; high public-good contributors were more altruistic and also less risk averse than low contributors. Experiment 2 obtained social discount functions with hypothetical $75 rewards and delay discount functions with hypothetical $1,000 rewards, as well as public-good contributions. The results replicated those of Experiment 1; steepness of the two forms of discounting correlated with each other across participants but only social discounting correlated with the public-good contribution. Most participants in Experiment 2 predicted that the average contribution would be lower than their own contribution.     

Delay-discounting probabilistic rewards: Rates decrease as amounts increase

The independence of delay-discounting rate and monetary reward size was tested by offering subjects (N = 621) a series of choices between immediate rewards and larger, delayed rewards. In contrast to previous studies, in which hypothetical rewards have typically been employed, subjects in the present study were entered into a lottery in which they had a chance of actually receiving one of their choices. The delayed rewards were grouped into small ($30–$35), medium ($55–$65), and large amounts ($70–$85). Using a novel parameter estimation procedure, we estimated discounting rates for all three reward sizes for each subject on the basis of his/her pattern of choices. The data indicated that the discounting rate is a decreasing function of the size of the delayed reward (p < .0001), whether hyperbolic or exponential discounting functions are assumed. In addition, a reliable gender difference was found (p = .005), with males discounting at higher rates than females, on average.     

Within-subject comparison of real and hypothetical money rewards in delay discounting

A within-subject design, using human participants, compared delay discounting functions for real and hypothetical money rewards. Both real and hypothetical rewards were studied across a range that included $10 to $250. For 5 of the 6 participants, no systematic difference in discount rate was observed in response to real and hypothetical choices, suggesting that hypothetical rewards may often serve as a valid proxy for real rewards in delay discounting research. By measuring discounting at an unprecedented range of real rewards, this study has also systematically replicated the robust finding in human delay discounting research that discount rates decrease with increasing magnitude of reward. A hyperbolic decay model described the data better than an exponential model.     

Deterrence, Opportunity, and Choice

Traditional studies of deterrence have focused on punishment with less regard for the rewards of both crime and noncrime. Influenced by work in economics and behavioral psychology, more recent studies have departed from tradition by incorporating rewards for crime. To this extent, they should be regarded as advances over the more traditional approaches. Notwithstanding these advances, variations in both the probability and magnitude of reward for noncrime have not been systematically included in these more recent theories of choice. In an attempt to determine whether opportunities for noncrime are either central or trivial to the criminal decision-making process, the present study fitted two alternative models to experimental data involving risk-taking: (a) the economic utility model employed by Piliavin, Gartner, Thornton, and Matsueda (1986) in their study of criminal choice; and (b) the satisfaction balance model developed by Gray and Tallman (1984). Results showed that while both models explained significant amounts of variation in the dependent variable, the Gray-Tallman model provided a substantially better fit of the data. Despite limitations inherent in experimental studies as, for example, limitations surrounding the issue of external validity, the findings strongly suggest that opportunities for noncrime are as important as rewards and costs for crime in the process by which criminal decisions are made.     

Syntax for calculation of discounting indices from the monetary choice questionnaire and probability discounting questionnaire

The 27‐item Monetary Choice Questionnaire (MCQ; Kirby, Petry, & Bickel, 1999) and 30‐item Probability Discounting Questionnaire (PDQ; Madden, Petry, & Johnson, 2009) are widely used, validated measures of preferences for immediate versus delayed rewards and guaranteed versus risky rewards, respectively. The MCQ measures delayed discounting by asking individuals to choose between rewards available immediately and larger rewards available after a delay. The PDQ measures probability discounting by asking individuals to choose between guaranteed rewards and a chance at winning larger rewards. Numerous studies have implicated these measures in addiction and other health behaviors. Unlike typical self‐report measures, the MCQ and PDQ generate inferred hyperbolic temporal and probability discounting functions by comparing choice preferences to arrays of functions to which the individual items are preconfigured. This article provides R and SPSS syntax for processing the MCQ and PDQ. Specifically, for the MCQ, the syntax generates k values, consistency of the inferred k, and immediate choice ratios; for the PDQ, the syntax generates h indices, consistency of the inferred h, and risky choice ratios. The syntax is intended to increase the accessibility of these measures, expedite the data processing, and reduce risk for error.     

Temporal discounting and preference reversals in choice between delayed outcomes

Subjects chose between pairs of hypothetical amounts of money available after different delays. When smaller, more immediate amounts were selected over larger, more delayed amounts, the addition of a constant delay to both outcomes resulted in reversals of preference, contrary to the standard discounted utility model of economics. The delays at which preference reversed were determined for three pairs of amounts ($20 vs. $50, $100 vs. $250, and $500 vs. $1,250). The relation between the delay to the larger amount and the delay to the smaller amount at preference reversal was well fit by both linear and quadratic functions. Intercepts increased with amount, strongly suggesting that rate of discounting decreases with amount. The presence of significant negative curvature in the data from the majority of individual subjects poses problems for exponential and hyperbolic models of temporal discounting in self-control, both of which predict a linear relation between the delays to the larger and smaller amounts.     

Bargaining ability,the utility of playing a game,and models of coalition formation

A utility function for playing a given position in a game is developed as a natural extension of the utility function which defines the rewards available in the game. This function is determined by a player's opinion of his bargaining ability. A characterization of such utilities is obtained which generalizes previous results that the Shapley value and Banzhaf-Coleman index are both cardinal utility functions which reflect different bargaining abilities. The approach taken here is related to models of coalition formation.     

Fairness and Discounts: The Subjective Value of a Bargain

In this work, we examined the surprising value consumers attach to getting a bargain. Past research has largely understood this phenomenon in terms of the impact discounts have on perceptions of fairness. However, the evidence for this explanation is inconclusive due to a number of viable alternatives as well as issues relating to construct and external validity. The experiments we report here provide clearer evidence for the basic assertion that discounts increase purchase satisfaction due to the nonfinancial rewards that are associated with perceptions of fairness. Furthermore, current notions of fairness in the promotion literature are extended by showing that social cues such as the relative size of the discount received by another customer and the loyalty status of that customer can also have an important impact on fairness and purchase satisfaction. We suggest an integration of transaction utility theory (Thaler, 1985) and equity theory (Bagozzi, 1975) to account for these findin     

Measurement Models for the Subjective Utility of Children1

Measurement models of subjective child utility were derived from theoretical typologies of expected consequences of children. Maximum likelihood estimates of the goodness-of-fit of each model to observed convariation among 18 indicators of subjective child utility were obtained, using data from 349 wives and 349 husbands. The best-fitting models included three distinct factors: personal rewards, personal costs, and normative rewards.     

Social discounting and delay discounting

Social discounting was measured as the amount of money a participant was willing to forgo to give a fixed amount (usually $75) to another person. In the first experiment, amount forgone was a hyperbolic function of the social distance between the giver and receiver. In the second experiment, degree of social discounting was an increasing function of reward magnitude whereas degree of delay discounting was a decreasing function of reward magnitude. In the third experiment, the shape of the function relating delayed rewards to equally valued immediate rewards for another person was predicted from individual delay and social discount functions. All in all, the studies show that the social discount function, like delay and probability discount functions, is hyperbolic in form. Copyright © 2007 John Wiley & Sons, Ltd.     

Using logistic regression to estimate delay-discounting functions.

The monetary choice questionnaire (MCQ) and similar computer tasks ask preference questions in order to ascertain indifference, the perceived equivalence of immediate versus larger delayed rewards. Indifference data are then fitted with a hyperbolic function, summarizing the decline in perceived value with delay time. We present a fitting method that estimates the hyperbolic parameter k directly from survey responses. Binary preferences are modeled as a function of time (X2) and a transformed reward ratio (X1), yielding logistic regression coefficients beta 2 and beta 1. The hyperbolic parameter emerges as k = beta 2/beta 1, where the logistic predicted p = .5 (the definition of indifference). The MCQ was administered to 1,073 adolescents and was scored using both standard and logistic methods. The means for In(k) were similar (standard, -4.53; logistic, -4.51), and the results were highly correlated (rho = .973). Simulated MCQ data showed that k was unbiased, except where beta 1 > or = -1, indicating a vague survey response. Jackknife standard errors provided excellent coverage.     

The relation between temperament and rate of temporal discounting

The present study examines the relationship between several temperamental traits (sensation seeking, extraversion–introversion, and impulsivity) and rate of temporal discounting, that is the rate of decrease in the subjective value of a reward as the delay to its receipt increases. Participants made choices between hypothetical monetary rewards that could be obtained immediately or after a specified delay. Temporal discounting functions were calculated and differences in rate of discounting between different groups were evaluated. For all groups of participants, hyperbolic discounting functions described well the decreases in subjective value with delay (R² ranged from 0.700 to 0.985). The rate of discounting was equivalent in high and low sensation seekers. However, both extraverts and high impulsive individuals showed higher temporal discounting rates than introverts and low impulsive individuals. The relationship between temperament and temporal discounting may be related to differences in time perception and/or to differences in susceptibility to rewards in extraverts versus introverts and in high- versus low-impulsive individuals.     

跨期选择的认知机制与神经基础

跨期选择是指个体对发生在不同时间的成本与收益进行权衡的决策过程。跨期选择的计算模型从经济学的角度用数学模型来建构时间折扣函数,而认知成分模型则从心理学的角度来研究跨期选择中的心理效应与认知成分。跨期选择的神经基础有三种不同的研究取向：双机制加工取向、单机制加工取向、自我控制取向。未来研究应该在跨期选择的认知机制、神经通路及运行机制、跨期选择的应用,以及从进化的角度对人与动物的跨期选择行为进行更深入的研究。