Opposing pupil responses to offered and anticipated reward values

Previous studies have shown that the pupils dilate more in anticipation of larger rewards. This finding raises the possibility of a more general association between reward amount and pupil size. We tested this idea by characterizing macaque pupil responses to offered rewards during evaluation and comparison in a binary choice task. To control attention, we made use of a design in which offers occurred in sequence. By looking at pupil responses after choice but before reward, we confirmed the previously observed positive association between pupil size and anticipated reward values. Surprisingly, however, we find that pupil size is negatively correlated with the value of offered gambles before choice, during both evaluation and comparison stages of the task. These results demonstrate a functional distinction between offered and anticipated rewards and present evidence against a narrow version of the simulation hypothesis; the idea that we represent offers by reactivating states associated with anticipating them. They also suggest that pupil size is correlated with relative, not absolute, values of offers, suggestive of an accept–reject model of comparison.     

Too good to be true? Psychological responses to uncommon options in risk–reward environments

Risks and rewards, or payoffs and probabilities, are inversely related in many choice environments. We investigated people's psychological responses to uncommon combinations of risk and reward that deviate from learned regularities (e.g., options that offer a high payoff with an unusually high probability) as they evaluated risky options. In two experiments (N = 183), participants first priced monetary gambles drawn from environments in which risks and rewards were negatively correlated, positively correlated, or uncorrelated. In later trials, they evaluated gambles with uncommon combinations of risk and reward—that is, options that deviated from the respective environment's risk–reward structure. Pricing, response times, and (in Experiment 2) pupil dilation were recorded. In both experiments, participants took more time when responding to uncommon compared to foreseeable options or when the same options were presented in an uncorrelated risk–reward environment. This result was most pronounced when the uncommon gambles offered higher expected values compared to the other gambles in the set. Moreover, these uncommon, high‐value options were associated with an increase in pupil size. These results suggest that people's evaluations of risky options are based not only on the options' payoffs and probabilities but also on the extent to which they fit the risk–reward structure of the environment.     

Positive mood effects on delay discounting

Delay discounting is the process by which the value of an expected reward decreases as the delay to obtaining that reward increases. Individuals with higher discounting rates tend to prefer smaller immediate rewards over larger delayed rewards. Previous research has indicated that personality can influence an individual's discounting rates, with higher levels of Extraversion predicting a preference for immediate gratification. The current study examined how this relationship would be influenced by situational mood inductions. While main effects were observed for both Extraversion and cognitive ability in the prediction of discounting rates, a significant interaction was also observed between Extraversion and positive affect. Extraverted individuals were more likely to prefer an immediate reward when first put in a positive mood. Extraverts thus appear particularly sensitive to impulsive, incentive-reward-driven behavior by temperament and by situational factors heightening positive affect.     

Observing response acquisition: preference for unpredictable appetitive rewards obtained under conditions predicted by DMOD

In five E-maze experiments, rats were given a choice between receiving reward and nonreward in a situation where stimuli were correlated with reward outcome (predictable situation) versus one where the stimuli were uncorrelated with reward outcome (unpredictable situation). Preference for the unpredictable situation occurred under the following conditions: (a) small (one 37-mg pellet), immediate rewards; (b) small, delayed (15 s) rewards, if the cues correlated with reward outcome were absent during the delay interval; (c) large (15 pellets), immediate rewards if a difficult discrimination was required; and (d) if the stimulus predicting nonreward was present at the choice point. Preference for the predictable situation was strongest if reinforcement was delayed and large or the stimulus predicting reward was present at the choice point. A weaker preference for the predictable situation occurred if reinforcement was immediate and large and a simple discrimination was required or if reinforcement was large and delayed and the cues that correlated with reward outcome were absent during the delay interval. The results support the predictions of DMOD (Daly modification of the Rescorla-Wagner model), a mathematical model of appetitive learning (Daly & Daly, 1982).     

Reversal learning as a function of changed reward location or changed drive

In two experiments, rats were trained with food in one location (e.g., black alley) and water in another location (white alley) under hunger or thirst. Subsequently, either the locations of the rewards were reversed, or the drive was changed (from hunger to thirst or thirst to hunger). Reversal of instrumental responses took considerably longer when drive was changed and rewards remained in the same locations than when reward locations were reversed. These results were interpreted as indicating that the animal's internal representations of the rewards received in each location transfer when drive is changed. These internal-reward representations interfere with reversal learning by eliciting the responses which were conditioned to them in Phase 1. Because the values of food and water reverse when drive is changed from hunger to thirst or vice versa, it was suggested that the reward representations surviving the drive shift are cognitive representations of the specific events received (food or water), independent of the value of the rewards under either hunger or thirst.     

Effects of material rewards on inkblot perception and organization

To explore further the potential relationship between material rewards and developmental regression, this research examined the effects of material rewards on perceptual organization as measured by Holtzman inkblot responses. Forty introductory psychology students (20 males and 20 females) were assigned to either a reward or nonreward group initially matched on sex and IQ. Reward subjects had lower scores on form definiteness, form appropriateness, integration, human, movement, color, and shading; faster response time; and higher scores on location and on pathognomic verbalization. Although reward/nonreward differences reached significance only for form definiteness, form appropriateness, shading, and response time, the differences on all 10 Holtzman Inkblot Technique variables that are sensitive to developmental change were in the predicted direction of a lower level of functioning under reward.     

Impulsivity and reward sensitivity within the pen model: A test of discriminant hypotheses

Impulsivity and reward sensitivity are often treated as interchangeable constructs. This conflation may be traced back to Gray’s interpretation of impulsivity as the trait level manifestation of the Behavioral Activation System (BAS), that mediates sensitivity to rewards. In this study (N = 696) we evaluated discriminant hypotheses regarding the relationships between BAS-mediated reward sensitivity, impulsivity and Eysenck’s PEN superfactors. We hypothesized that reward sensitivity would be mainly linked with Extraversion, and that impulsivity would be primarily connected with Psychoticism. Hypotheses were tested using structural equation modelling and equality constraints tests. Results mostly supported our expectations: reward sensitivity was more strongly related to Extraversion than to the other PEN superfactors, while impulsivity was more strongly related to Psychoticism and Neuroticism. Implications for BAS and impulsivity research are discussed.     

Reactivity of the Reward System in Artists During Acceptance and Rejection of Monetary Rewards

Humans possess an invaluable ability of self-expression that extends into visual, literary, musical, and many other fields of creation. More than any other profession, artists are in close contact with this subdomain of creativity. Probably one of the most intriguing aspects of creativity is its negative correlation with the availability of monetary reward. The aim of this study was to investigate the reactivity of the dopaminergic reward system in artists and nonartist controls using the desire-reason-dilemma (DRD) paradigm, which allows separate evaluation of reactivity to the acceptance and rejection of rewards. Using fMRI, blood-oxygen-level-dependent (BOLD) responses were measured in key regions of the reward system, namely the ventral striatum (VS), the ventral tegmental area (VTA), and the anterior ventral prefrontal cortex (AVPFC). In contrast to controls, artists presented significantly weaker VS activation in reward acceptance. Additionally, they showed stronger suppression of the VS by the AVPFC in reward rejection. No other differences in demographic or behavioral data were evidenced. These results support the existence of characteristic neural traits in artists, who display reduced reactions to monetary reward acceptance and increased reactions to monetary reward rejection.     

Individualistic attitudes toward attractive rewards in older people: An experimental study using ultimatum games

This study used an ultimatum game to test the hypothesis that older individuals make more selfish offers when bargaining for highly attractive rewards, regardless of the impacts of others' responses on reward size. Both older and younger individuals separately participated in the experiment and made offers as allocators. The effects of four factors (age, certainty of the allocators' own reward depending on the recipient's response, the recipient's response, and type of rewards to be shared) on participants' offers and expectations of recipients' replies were observed. Older participants demanded higher shares for themselves than younger participants, even under the low certainty condition in the highly attractive reward scenario. Particularly in this scenario, older participants increased their portions immediately after receiving rejections. Moreover, they consistently expected the recipients to accept their offers regardless of the proposed distribution amount or bargaining conditions. It was implied that the high attractiveness of the rewards made it difficult for older individuals to predict the recipient's view of their proposals and thus contributed to them making selfish proposals.     

The Relationship of Trait EI with Personality,IQ and Sex in a UK Sample of Employees

The relationships among trait emotional intelligence (EI), personality, IQ and sex were investigated in a sample of 585 employees (478 males, 107 females). Participants completed the Watson–Glaser Critical Thinking Appraisal, the Bar‐On Quotient Inventory (EQ‐i) and the Neuroticism–Extraversion–Openness Personality Inventory Revised. Bivariate correlations revealed significant associations between overall EQ‐i and Neuroticism (negative), Agreeableness, Extraversion, Openness and Conscientiousness (all positive). While there were no significant associations between overall EQ‐i and sex or IQ, significant correlations were observed when EI components were considered. Male participants scored significantly higher on Adaptability and females scored significantly higher on the Interpersonal facet. Moreover, IQ correlated with the Interpersonal composite in the male' sample. Results are discussed in the context of trait EI structure and its implications for interpretation of sex and IQ effects.     

Social comparison mediates chimpanzees’ responses to loss,not frustration

Why do chimpanzees react when their partner gets a better deal than them? Do they note the inequity or do their responses reflect frustration in response to unattainable rewards? To tease apart inequity and contrast, we tested chimpanzees in a series of conditions that created loss through individual contrast, through inequity, or by both. Chimpanzees were tested in four social and two individual conditions in which they received food rewards in return for exchanging tokens with an experimenter. In conditions designed to create individual contrast, after completing an exchange, the chimpanzees were given a relatively less-preferred reward than the one they were previously shown. The chimpanzees’ willingness to accept the less-preferred rewards was independent of previously offered foods in both the social and individual conditions. In conditions that created frustration through inequity, subjects were given a less-preferred reward than the one received by their partner, but not in relation to the reward they were previously offered. In a social context, females were more likely to refuse to participate when they received a less-preferred reward than their partner (disadvantageous inequity), than when they received a more-preferred reward (advantageous inequity). Specifically, the females’ refusals were typified by refusals to exchange tokens rather than refusals to accept food rewards. Males showed no difference in their responses to inequity or individual contrast. These results support previous evidence that some chimpanzees’ responses to inequity are mediated more strongly by what others receive than by frustration effects.     

Implicit rewards as reinforcers and extinguishers

Previous studies of implicit reinforcement with children have presented the implicit reward phase after baseline conditions. The present study replicated this design and compared these effects within a design where implicit rewards were presented after direct rewards to both targets and peers. Thirty-two fourth grade children copied the letters of the alphabet under varying reward conditions. Data indicated the presence of reinforcement effects when presented after baseline, and extinction effects when presented after direct reward conditions.     

Elevated outcome-anticipation and outcome-evaluation ERPs associated with a greater preference for larger-but-delayed rewards

Although waiting for a reward reduces or discounts its value, some people have a stronger tendency to wait for larger rewards and forgo smaller-but-immediate rewards. This ability to delay gratification is captured by individual differences in so-called intertemporal choices in which individuals are asked to choose between larger-but-delayed versus smaller-but-immediate rewards. The current study used event-related potentials (ERPs) to examine whether enhancement in two neurocognitive processes, outcome anticipation and outcome evaluation, modulate individual variability in intertemporal responses. After completing a behavioral intertemporal choice task, 34 participants performed an ERP gambling task. From this ERP task, we separately examined individual differences in outcome anticipation (stimulus-preceding negativity; SPN), early outcome valuation (feedback-related negativity; FRN), and late outcome evaluation (P3). We observed that both elevated outcome-anticipation (SPN) and late outcome-evaluation (P3) neural processes predicted a stronger preference toward larger-but-delayed rewards. No relationship was observed between intertemporal responses and early outcome evaluation (FRN), indicating that the relationship between outcome evaluation and intertemporal responses was specific to the late outcome-evaluation processing stream. Moreover, multiple regression analyses indicated that the SPN and P3 independently modulate individual differences in intertemporal responses, suggesting separate mechanisms underlie the relationship between these two neurocognitive processes and intertemporal responses. Accordingly, we identify two potential neurocognitive modulators of individual variability in intertemporal responses. We discuss the mechanisms underlying these modulators in terms of anticipation-related processing (SPN) and a saliency bias toward gain (compared to loss) outcomes (P3).     

The Effect of Symbolic Distancing on Delay Tolerance across the Preschool Period

ABSTRACT

We aimed to longitudinally examine how symbolic distancing affects preschool children’s delay tolerance in a delay choice task. We presented children with choices between a smaller immediate reward and a larger delayed reward in conditions with either symbolic stimuli or edible rewards. Overall, symbolic distancing modulated children’s delay tolerance. In particular, whereas in the first phase (T1: 3- and 4-year-olds) children presented with edible rewards chose the larger option more often than children presented with symbolic stimuli, in the second phase (T2: 5- and 6-year-olds), there was no significant difference between children presented with symbolic stimuli and those presented with edible rewards. These results are discussed by examining how children’s delay tolerance changes during the development and comparing children to adult humans in a similar task.     

基于价值的议程对学习时间分配影响的眼动研究

通过对比不同梯度下, 分值激发的议程与习惯性反应作用一致、不一致条件中, 优先选择项目和学习时间的差异, 考察基于价值的议程对学习时间分配的影响及其动态过程。结果发现：(1)等分值条件下, 汉语为母语被试存在从左到右的习惯性反应。(2)分值梯度对基于议程的学习时间分配的有效性具有调节作用。小分值梯度(1分、5分)激发的议程能够克服习惯性反应对学习时间分配的影响, 但不能使被试建立起优先学习高价值项目的议程; 大分值梯度(1分、10分)能够克服习惯性反应对学习时间分配影响, 且能够使被试建立起优先学习高价值项目的议程。(3)基于议程调节的学习时间分配在时程和阶段上具有动态性和情境特异性。     

特征和位置信息在价值驱动注意捕获中的作用

本研究采用训练−测试范式考察颜色和位置信息在价值驱动注意捕获中的作用。实验1考察是否存在基于具体位置的价值驱动的注意捕获效应。在训练阶段, 被试对8个位置中两个位置出现的红色目标反应伴随着高奖励反馈, 而对另外两个位置出现的红色目标反应伴随着低奖励反馈, 其它4个位置为中性位置, 没有目标出现。在测试阶段, 一半试次中红色刺激作为分心物出现。结果发现, 只有当分心刺激出现在高奖励位置和两个高奖励位置之间的中性位置时才能够捕获注意; 实验2考察颜色和位置信息在价值驱动注意捕获中的交互作用。在训练阶段, 将颜色特征和位置信息联合起来进行学习。在测试阶段, 和高、低奖励相联结的颜色刺激各在1/3试次中作为分心物出现。结果发现, 只有当高奖励颜色出现在高奖励位置或出现在高奖励位置之间的中性位置时才能够捕获注意。研究结果表明：(1)位置联结的价值驱动的注意捕获效应能够泛化到特定邻近位置上; (2)个体在训练阶段将颜色和位置的联合特征与奖励建立联结, 训练阶段建立的联结不能泛化到部分特征上。价值驱动注意捕获效应的泛化具有选择性。     

Effects of reward magnitude frames on measures of delay discounting in a hypothetical money scenario

The current study analyzed the effects of three frames of reward magnitude—quantity, volume, and duration—on the rate at which college students discounted hypothetical, delayed monetary rewards. Hypothetical scenarios were presented using the fill-in-the-blank discounting questionnaire and participants made choices between immediate and delayed hypothetical monetary rewards. Scenarios framed the monetary choices as (a) quantity of dollar bills, (b) height (inches) of a stack of dollar bills, and (c) duration of time spent in a hypothetical cash machine to collect dollar bills. For each scenario, participants' subjective values were used to calculate the area under the curve (AuC). Framing resulted in a moderate effect size: The duration frame yielded significantly smaller AuC values compared to the quantity and volume frames. Thus, the framing of reward magnitude was a significant variable in controlling discounting rates for hypothetical, delayed monetary rewards. Subsequent investigations should be aware of the independent effects of the reward magnitude frames on delay discounting rates.     

With age comes wisdom: decision making in younger and older adults

In two experiments, younger and older adults performed decision-making tasks in which reward values available were either independent of or dependent on the previous sequence of choices made. The choice-independent task involved learning and exploiting the options that gave the highest rewards on each trial. In this task, the stability of the expected reward for each option was not influenced by the previous choices participants made. The choice-dependent task involved learning how each choice influenced future rewards for two options and making the best decisions based on that knowledge. Younger adults performed better when rewards were independent of choice, whereas older adults performed better when rewards were dependent on choice. These findings suggest a fundamental difference in the way in which younger adults and older adults approach decision-making situations. We discuss the results in the context of prominent decision-making theories and offer possible explanations based on neurobiological and behavioral changes associated with aging.     

Beery VMI performance in autism spectrum disorder

Few studies have examined the visuomotor integration (VMI) abilities of individuals with autism spectrum disorder (ASD). An all-male sample consisting of 56 ASD participants (ages 3–23 years) and 36 typically developing (TD) participants (ages 4–26 years) completed the Beery-Buktenica Developmental Test of Visual-Motor Integration (Beery VMI) as part of a larger neuropsychological battery. Participants were also administered standardized measures of intellectual functioning and the Social Responsiveness Scale (SRS), which assesses autism and autism-like traits. The ASD group performed significantly lower on the Beery VMI and on all IQ measures compared to the TD group. VMI performance was significantly correlated with full scale IQ (FSIQ), performance IQ (PIQ), and verbal IQ (VIQ) in the TD group only. However, when FSIQ was taken into account, no significant Beery VMI differences between groups were observed. Only one TD participant scored 1.5 standard deviations (SDs) below the Beery VMI normative sample mean, in comparison to 21% of the ASD sample. As expected, the ASD group was rated as having significantly higher levels of social impairment on the SRS compared to the TD group across all major domains. However, level of functioning on the SRS was not associated with Berry VMI performance. These findings demonstrate that a substantial number of individuals with ASD experience difficulties compared to TD in performing VMI-related tasks, and that VMI is likely affected by general cognitive ability. The fact that lowered Beery VMI performance occurred only within a subset of individuals with ASD and did not correlate with SRS would indicate that visuomotor deficits are not a core feature of ASD, even though they present at a higher rate of impairment than observed in TD participants.     

Now for Me,Later for Us? Effects of Group Context on Temporal Discounting

Delayed rewards are less valuable than immediate rewards. This well‐established finding has focused almost entirely on individual outcomes. However, are delayed rewards similarly discounted if they are shared by a group? The current article reports on three experiments exploring the effect of group context on delay discounting. Results indicate that discount rates of individual and group rewards were highly correlated, but that respondents were more willing to wait (decreased discounting) for shared outcomes than for individual outcomes. An explanatory model is proposed suggesting that decreased discount rates in group contexts may be due to the way the effects of both delay and social discounting are combined. That is, in a group context, a person values both a future reward (discounted by delay) and a present reward to another person (discounted by the social distance between them). The results are explained by a combined discount function containing a delay factor and a factor representing the social distance between the decision maker and group members. Practical implications of the fact that shared consequences can increase individual self‐control are also discussed. Copyright © 2011 John Wiley & Sons, Ltd.