Monetary rewards influence retrieval orientations

Reward anticipation during learning is known to support memory formation, but its role in retrieval processes is so far unclear. Retrieval orientations, as a reflection of controlled retrieval processing, are one aspect of retrieval that might be modulated by reward. These processes can be measured using the event-related potentials (ERPs) elicited by retrieval cues from tasks with different retrieval requirements, such as via changes in the class of targeted memory information. To determine whether retrieval orientations of this kind are modulated by reward during learning, we investigated the effects of high and low reward expectancy on the ERP correlates of retrieval orientation in two separate experiments. The reward manipulation at study in Experiment 1 was associated with later memory performance, whereas in Experiment 2, reward was directly linked to accuracy in the study task. In both studies, the participants encoded mixed lists of pictures and words preceded by high- or low-reward cues. After 24?h, they performed a recognition memory exclusion task, with words as the test items. In addition to a previously reported material-specific effect of retrieval orientation, a frontally distributed, reward-associated retrieval orientation effect was found in both experiments. These findings suggest that reward motivation during learning leads to the adoption of a reward-associated retrieval orientation to support the retrieval of highly motivational information. Thus, ERP retrieval orientation effects not only reflect retrieval processes related to the sought-for materials, but also relate to the reward conditions with which items were combined during encoding.     

High temporal discounters overvalue immediate rewards rather than undervalue future rewards: An event-related brain potential study

Impulsivity is characterized in part by heightened sensitivity to immediate relative to future rewards. Although previous research has suggested that “high discounters” in intertemporal choice tasks tend to prefer immediate over future rewards because they devalue the latter, it remains possible that they instead overvalue immediate rewards. To investigate this question, we recorded the reward positivity, a component of the event-related brain potential (ERP) associated with reward processing, with participants engaged in a task in which they received both immediate and future rewards and nonrewards. The participants also completed a temporal discounting task without ERP recording. We found that immediate but not future rewards elicited the reward positivity. High discounters also produced larger reward positivities to immediate rewards than did low discounters, indicating that high discounters relatively overvalued immediate rewards. These findings suggest that high discounters may be more motivated than low discounters to work for monetary rewards, irrespective of the time of arrival of the incentives.     

Attentional deficits of learning-disabled children: Effects of rewards and practice

This study investigated the effects of rewards and practice on the attentional task performance of learning-disabled (LD) and normally achieving children. Contingent feedback and rewards resulted in faster but less accurate performance by the LD children. Despite the speed-accuracy trade-off, the LD children still responded more slowly than the controls. However, limited practice on the tasks resulted in significantly improved performance, such that the groups performed similarly. Poorer performance of LD children on their first encounter with laboratory measures of attention may be due to inefficient strategies rather than to actual deficits in ability to attend.This paper is based on the author's dissertation. I gratefully acknowledge the assistance of Nancy Ponzetti-Dyer, Susan Shapiro, and Duane Kemp in the data collection, and of Raymond Romanczyk and two anonymous reviewers for comments on a draft of this article.     

Comparing rapid assessments of delay discounting with real and hypothetical rewards in children

Recent advances in assessment methodology have resulted in a highly efficient procedure for obtaining delay discounting rates for adults: a 5‐trial adjusting delay task (ADT‐5) examining intertemporal choice for hypothetical rewards. The low participant burden of this task makes it potentially useful for children, with whom delay discounting research is relatively limited. However, it is unknown whether results from this task match choice for real rewards. The present study assessed delay discounting for real and hypothetical monetary rewards using a modified ADT‐5 with 9 children admitted to a psychiatric day treatment program. Participants completed up to 3 tasks with each reward type in alternating order. No difference in discounting rate, via log(k), was observed between the first task of each reward type. This finding was replicated across subsequent tasks for the subset of participants (n = 6) who completed all 6 tasks. However, delay discounting of real and hypothetical rewards was not found to be statistically equivalent. These results suggest that a modified ADT‐5 using hypothetical rewards may be a viable option for assessing delay discounting in children with psychiatric diagnoses, but additional research is needed to explicitly examine whether hypothetical and real rewards are discounted equivalently in this population.     

Integrating rewards and cognition in the frontal cortex

Research indicates that the dorsolateral prefrontal cortex (DLPFC) contributes to working memory and executive control, whereas the ventral frontal cortex (VFC) contributes to affective and motivational processing. Few studies have examined both the functional specificity and the integration of these regions. We did so using fMRI and a verbal working memory task in which visual cues indicated whether recall performance on an upcoming trial would be linked to a monetary reward. On the basis of prior findings obtained in delayed response tasks performed by nonhuman primates, we hypothesized that (1) VFC would show an increase only in response to a cue indicating potential for a monetary reward; (2) DLPFC would show sustained activity across a delay interval for all trials, though activity in rewarded trials would be enhanced; and (3) regions engaged in speech-based rehearsal would be relatively insensitive to monetary incentive. Our hypotheses about DLPFC and rehearsal-related regions were confirmed. In VFC regions, we failed to observe statistically significant effects of reward when the cue or delay epochs of the task were examined in isolation. However, an unexpected and significant deactivation was observed in VFC during the delay epoch; furthermore, a post hoc voxelwise analysis indicated a complex interaction between (1) the cue and delay epochs of the task and (2) the reward value of the trials. The pattern of activation and deactivation across trial types suggests that VFC is sensitive to reward cues, and that portions of DLPFC and VFC may work in opposition during the delay epoch of a working memory task in order to facilitate task performance.     

Capuchin monkeys (Cebus apella) let lesser rewards pass them by to get better rewards

Self-control is defined as foregoing an immediate reward to gain a larger delayed reward. Methods used to test self-control comparatively include inter-temporal choice tasks, delay of gratification tasks, and accumulation tasks. To date, capuchin monkeys have shown different levels of self-control across tasks. This study introduced a new task that could be used comparatively to measure self-control in an intuitive context that involved responses that required no explicit training. Capuchin monkeys (Cebus apella) were given a choice between two food items that were presented on a mechanized, revolving tray that moved those foods sequentially toward the monkeys. A monkey could grab the first item or wait for the second, but was only allowed one item. Most monkeys in the study waited for a more highly preferred food item or a larger amount of the same food item when those came later, and they inhibited the prepotent response to grab food by not reaching out to take less-preferred foods or smaller amounts of food that passed directly in front of them first. These data confirm that the mechanisms necessary for self-control are present in capuchin monkeys and indicate that the methodology can be useful for broader comparative assessments of self-control.     

How humans react to changing rewards during visual foraging

Much is known about the speed and accuracy of search in single-target search tasks, but less attention has been devoted to understanding search in multiple-target foraging tasks. These tasks raise and answer important questions about how individuals decide to terminate searches in cases in which the number of targets in each display is unknown. Even when asked to find every target, individuals quit before exhaustively searching a display. Because a failure to notice targets can have profound effects (e.g., missing a malignant tumor in an X-ray), it is important to develop strategies that could limit such errors. Here, we explored the impact of different reward patterns on these failures. In the Neutral condition, reward for finding a target was constant over time. In the Increasing condition, reward increased for each successive target in a display, penalizing early departure from a display. In the Decreasing condition, reward decreased for each successive target in a display. The experimental results demonstrate that observers will forage for longer (and find more targets) when the value of successive targets increases (and the opposite when value decreases). The data indicate that observers were learning to utilize knowledge of the reward pattern and to forage optimally over the course of the experiment. Simulation results further revealed that human behavior could be modeled with a variant of Charnov’s Marginal Value Theorem (MVT) (Charnov, 1976) that includes roles for reward and learning.     

The hybrid split ad technique and onsite rewards

With a ‘split ad’, information is presented as two distinct parts, such as when two short commercials for a given brand are separated by other television content. Two studies are presented in this paper which demonstrate the advantages of an emerging form of the split ad strategy, which is termed the ‘hybrid split ad’ technique. Using this approach, a message typically begins in a traditional medium and then concludes at a website. In Experiment 1, the hybrid split ad technique is shown to enhance attitudes towards an advertised product by increasing the perceived importance of favourable attributes provided at the website. Experiment 2 replicates this finding and also addresses an issue of managerial importance, namely, how to motivate consumers to pursue the second (web‐based) portion of the ad. Offering consumers an incentive at the website is useful in this regard, provided that the incentive is small enough not to undermine the positive effects of the hybrid split ad.     

Effects of anonymous peer observation on adolescents' preference for immediate rewards

Research suggests that the presence of peers influences adolescent risk‐taking by increasing the perceived reward value of risky decisions. While prior work has involved observation of participants by their friends, the current study examined whether observation by an anonymous peer could elicit similarly increased reward sensitivity. Late adolescent participants completed a delay discounting task either alone or under the belief that performance was being observed from a neighboring room by an unknown viewer of the same gender and age. Even in this limited social context, participants demonstrated a significantly increased preference for smaller, immediate rewards when they believed that they were being watched. This outcome challenges several intuitive accounts of the peer effect on adolescent risk‐taking, and indicates that the peer influence on reward sensitivity during late adolescence is not dependent on familiarity with the observer. The findings have both theoretical and practical implications for our understanding of social influences on adolescents' risky behavior.     

Preference for unpredictable food rewards occurs with high proportion of reinforced trials or alcohol if rewards are not delayed

Organisms typically prefer situations where reward and nonreward are predictable rather than unpredictable. Although many theories can account for this result (e.g., information theory and delay-reduction theory), a recently developed mathematical model (DMOD) also predicts that subjects prefer the unpredictable reward situation under conditions that substantially decrease aversiveness of unpredictable nonreward (Daly & Daly, 1982). Because a high proportion of reinforced trials (lenient schedule) and alcohol injections decrease aversive conditioning, these variables were tested with rats in five E-maze experiments. A choice to one side of the maze resulted in a stimulus uncorrelated with reward outcome (unpredictable situation). A choice to the other side resulted in stimuli correlated with reward and nonreward (predictable situation). The stimuli were not visible until after the choice was made. A lenient reinforcement schedule resulted in preference for the unpredictable reward situation if rewards were not delayed. Alcohol resulted in preference for the unpredictable reward situation if a medium five-pellet reward was given. A lenient reinforcement schedule combined with an alcohol injection resulted in faster acquisition of the preference for the unpredictable reward situation than did a lenient schedule combined with a saline control injection. These results pose a major challenge to most theories, yet were predicted by DMOD.     

Driver performance, rewards and motivation: A simulator study

It has been suggested that effort invested in a task may be moderated by the perception of the nature of reward offered, e.g., whether social or financial in nature. If levels of payment for empirical work meaningfully influence the effort invested in tasks by participants, the implications may be serious and wide-ranging for the reliability and validity of published data. The study reported in this paper, examines this thesis in a driving context. Thirty-six participants were allocated to either a No payment, Low payment or Medium payment condition in a driving simulator. They undertook both easy and difficult driving scenarios in which performance was measured. Subjective workload and performance results indicated that task difficulty was successfully manipulated with the study. However, in contrast to the previous research in non-driving contexts, participants not receiving rewards were found to perform more poorly and experience increased time pressure.     

Increases in rewards promote flexible behavior

Offering reward for performance can motivate people to perform a task better, but better preparation for one task usually means decreased flexibility to perform different tasks. In six experiments in which reward varied between low and high levels, we found that reward can encourage people to prepare more flexibly for different tasks, but only as it increased from the level on the previous trial. When the same high rewards were offered continuously trial after trial, people were more inclined to simply stick with doing what had worked previously. We demonstrated such enhancements in flexibility in task switching, a difficult visual search task, and an easier priming of pop-out search task, which shows that this effect generalizes from executive tasks to perceptual processes that require relatively little executive control. These findings suggest that relative, transient changes in reward can exert more potent effects on behavioral flexibility than can the absolute amount of reward, whether it consists of money or points in a social competition.     

Cruelty's rewards: the gratifications of perpetrators and spectators

Cruelty is the deliberate infliction of physical or psychological pain on other living creatures, sometimes indifferently, but often with delight. Though cruelty is an overwhelming presence in the world, there is no neurobiological or psychological explanation for its ubiquity and reward value. This target article attempts to provide such explanations by describing three stages in the development of cruelty. Stage 1 is the development of the predatory adaptation from the Palaeozoic to the ethology of predation in canids, felids, and primates. Stage 2, through palaeontological and anthropological evidence, traces the emergence of the hunting adaptation in the Pliocene, its development in early hominids, and its emotional loading in surviving forager societies. This adaptation provides an explanation for the powerful emotions - high arousal and strong affect - evoked by the pain-blood-death complex. Stage 3 is the emergence of cruelty about 1.5 million years ago as a hominid behavioural repertoire that promoted fitness through the maintenance of personal and social power. The resulting cultural elaborations of cruelty in war, in sacrificial rites, and as entertainment are examined to show the historical and cross-cultural stability of the uses of cruelty for punishment, amusement, and social control.Effective violence prevention must begin with perpetrators, not victims. If the upstream approaches to violence prevention advocated by the public-health model are to be effective, psychologists must be able to provide violence prevention workers with a fine-grained understanding of perpetrator gratifications. This is a distasteful task that will compel researchers to interact with torturers and abusers, and to acknowledge that their gratifications are rooted in a common human past. It is nonetheless an essential step in developing effective strategies for the primary prevention of violence.     

Effects of material rewards on inkblot perception and organization

To explore further the potential relationship between material rewards and developmental regression, this research examined the effects of material rewards on perceptual organization as measured by Holtzman inkblot responses. Forty introductory psychology students (20 males and 20 females) were assigned to either a reward or nonreward group initially matched on sex and IQ. Reward subjects had lower scores on form definiteness, form appropriateness, integration, human, movement, color, and shading; faster response time; and higher scores on location and on pathognomic verbalization. Although reward/nonreward differences reached significance only for form definiteness, form appropriateness, shading, and response time, the differences on all 10 Holtzman Inkblot Technique variables that are sensitive to developmental change were in the predicted direction of a lower level of functioning under reward.     

A learning rule that explains how rewards teach attention

Many theories propose that top-down attentional signals control processing in sensory cortices by modulating neural activity. But who controls the controller? Here we investigate how a biologically plausible neural reinforcement learning scheme can create higher order representations and top-down attentional signals. The learning scheme trains neural networks using two factors that gate Hebbian plasticity: (1) an attentional feedback signal from the response-selection stage to earlier processing levels; and (2) a globally available neuromodulator that encodes the reward prediction error. We demonstrate how the neural network learns to direct attention to one of two coloured stimuli that are arranged in a rank-order. Like monkeys trained on this task, the network develops units that are tuned to the rank-order of the colours and it generalizes this newly learned rule to previously unseen colour combinations. These results provide new insight into how individuals can learn to control attention as a function of reward contingency.     

A process analysis of the effects of performance-contingent rewards on intrinsic motivation

In this study, the effects of performance-contingent rewards on intrinsic motivation were examined in comparison to no-reward controls receiving identical performance feedback. A path analytic process analysis was conducted to examine the mediation of reward effects on subsequent task interest. It was hypothesized that competence valuation, or the personal importance of doing well, would be an important mediator of interest in situations where performance feedback was available. Rewards were predicted to affect interest by influencing an individual's valuation of competence, and by altering the competence valuation mediation process. In addition, achievement orientation was hypothesized to interact with reward in affecting importance and the mediation process. Prior to performing an interesting puzzle, high school students were offered a performance-contingent reward, and then indicated how personally important it was to do well. After doing three puzzles, all subjects received positive feedback regarding their performance. Multiple regression analyses indicated that importance was affected by the experimental variables, and had a positive causal impact on subsequent intrinsic motivation. It was found that the promise of performance-contingent reward positively affected importance for low achievers relative to high achievers, and that the mediation of subsequent intrinsic interest by importance differed according to reward by achievement combinations. Additionally, a direct effect revealed that performance-contingent rewards significantly enhanced interest, relative to no-reward controls receiving identical performance feedback.     

Physical and cognitive effort discounting of hypothetical monetary rewards

Effort discounting refers to the decrease in the subjective value of a reward as the effort required to obtain the reward increases. The main aims of this study were to ascertain whether the amount of the reward affects the steepness of the effort discounting process for hypothetical monetary rewards, to identify whether this steepness depends on the type of effort that is required, and to determine whether the steepness of different types of effort covary at the individual level. Two types of effort were studied under hypothetical choice situations: physical effort and cognitive effort. Both physical and cognitive effort discounting were well described by the hyperbolic model. Large rewards were discounted less steeply than small rewards for both types of effort. This finding agrees with the results of prior studies which have found that larger rewards have greater motivational power. In addition, the steepness of physical effort discounting was positively correlated with the steepness of cognitive effort discounting, which suggests that the effort discounting process is a trait‐like characteristic within an individual.     

Visual selective attention and the effects of monetary rewards

Outcomes of actions, in the form of rewards and punishments, are known to shape behavior. For example, an action followed by reward will be more readily elicited on subsequent encounters with the same stimuli and context -- a phenomenon known as the law of effect. These consequences of rewards (and punishments) are important because they reinforce adaptive behaviors at the expense of competing ones, thus increasing fitness of the organism in its environment. However, it is unknown whether similar influences regulate covert mental processes, such as visual selective attention. Visual selective attention allows privileged processing of task-relevant information, while inhibiting distracting contextual elements. Using variable monetary rewards as arbitrary feedback on performance, we tested whether acts of attentional selection, and in particular the resulting aftereffects, can be modulated by their consequences. Results show that the efficacy of visual selective attention can be sensibly adjusted by external feedback. Specifically, although lingering inhibition of distractors is robust after highly rewarded selections, it is eliminated after poorly rewarded selections. This powerful feature of visual selective attention provides attentive processes with both flexibility and self-regulation properties.     

What a feeling! Touching sexually laden stimuli makes women seek rewards

We argue that women's previously documented unresponsiveness to sexual primes when making economic decisions may be a consequence of the specific types of primes that have been used (i.e., visual primes). In three studies we show that presenting women with tactile sexual cues does influence their decisions about economic rewards. Similar to the effect found in men, the first study demonstrates that touching a pair of boxer shorts leads to a craving for monetary rewards in women. In the second study it is shown that touching a pair of boxers makes women less loss averse for both money and food. The third study explicitly focuses on the relative effectiveness of tactile versus visual sexual cues in altering women's economic decisions, and reveals that women's willingness-to-pay for economic rewards increases only when the sexual cue is tactile. We suggest that touching (vs. seeing) sexually laden stimuli prompts pre-programmed consummatory Pavlovian responses that promote approaching economic rewards.     

Pervasive negative effects of rewards on intrinsic motivation: The myth continues

A major concern in psychology and education is that rewards decrease intrinsic motivation to perform activities. Over the past 30 years, more than 100 experimental studies have been conducted on this topic. In 1994, Cameron and Pierce conducted a meta-analysis of this literature and concluded that negative effects of reward were limited and could be easily prevented in applied settings. A more recent meta-analysis of the literature by Deci, Koestner, and Ryan (1999) shows pervasive negative effects of reward. The purpose of the present article is to resolve differences in previous meta-analytic findings and to provide a meta-analysis of rewards and intrinsic motivation that permits tests of competing theoretical explanations. Our results suggest that in general, rewards are not harmful to motivation to perform a task. Rewards given for low-interest tasks enhance free-choice intrinsic motivation. On high-interest tasks, verbal rewards produce positive effects on free-choice motivation and self-reported task interest. Negative effects are found on high-interest tasks when the rewards are tangible, expected (offered beforehand), and loosely tied to level of performance. When rewards are linked to level of performance, measures of intrinsic motivation increase or do not differ from a nonrewarded control group. Overall, the pattern of results indicates that reward contingencies do not have pervasive negative effects on intrinsic motivation. Theoretical and practical implications of the findings are addressed.