Driver performance, rewards and motivation: A simulator study

It has been suggested that effort invested in a task may be moderated by the perception of the nature of reward offered, e.g., whether social or financial in nature. If levels of payment for empirical work meaningfully influence the effort invested in tasks by participants, the implications may be serious and wide-ranging for the reliability and validity of published data. The study reported in this paper, examines this thesis in a driving context. Thirty-six participants were allocated to either a No payment, Low payment or Medium payment condition in a driving simulator. They undertook both easy and difficult driving scenarios in which performance was measured. Subjective workload and performance results indicated that task difficulty was successfully manipulated with the study. However, in contrast to the previous research in non-driving contexts, participants not receiving rewards were found to perform more poorly and experience increased time pressure.     

Involvement of the rat anterior cingulate cortex in control of instrumental responses guided by reward expectancy

The anterior cingulate cortex (ACC) plays a critical role in stimulus-reinforcement learning and reward-guided selection of actions. Here we conducted a series of experiments to further elucidate the role of the ACC in instrumental behavior involving effort-based decision-making and instrumental learning guided by reward-predictive stimuli. In Experiment 1, rats were trained on a cost-benefit T-maze task in which they could either choose to climb a barrier to obtain a high reward (four pellets) in one arm or a low reward (two pellets) in the other with no barrier present. In line with previous studies, our data reveal that rats with quinolinic acid lesions of the ACC selected the response involving less work and smaller reward. Experiment 2 demonstrates that breaking points of instrumental performance under a progressive ratio schedule were similar in sham-lesioned and ACC-lesioned rats. Thus, lesions of the ACC did not interfere with the effort a rat is willing to expend to obtain a specific reward in this test. In a subsequent task, we examined effort-based decision-making in a lever-press task where rats had the choice between pressing a lever to receive preferred food pellets under a progressive ratio schedule, or free feeding on a less preferred food, i.e. lab chow. Results show that sham- and ACC-lesioned animals had similar breaking points and ingested comparable amounts of less-preferred food. Together, the results of Experiment 1 and 2 suggest that the ACC plays a role in evaluating how much effort to expend for reward; however, the ACC is not necessary in all situations requiring an assessment of costs and benefits. In Experiment 3 we investigated learning and reversal learning of instrumental responses guided by reward predictive stimuli. A reaction time (RT) task demanding conditioned lever release was used in which the upcoming reward magnitude (five vs. one food pellet) was signalled in advance by discriminative visual stimuli. Results revealed that rats with ACC lesions were able to discriminate reward magnitude-predictive stimuli and to adapt instrumental behavior to reversed stimulus-reward magnitude contingencies. Thus, in a simple discrimination task as used here, the ACC appears not to be required to discriminate reward magnitude-predictive stimuli and to use the learned significance of the stimuli to guide instrumental behavior.     

Does intrinsic reward motivate cognitive control? a naturalistic-fMRI study based on the synchronization theory of flow

Cognitive control is a framework for understanding the neuropsychological processes that underlie the successful completion of everyday tasks. Only recently has research in this area investigated motivational contributions to control allocation. An important gap in our understanding is the way in which intrinsic rewards associated with a task motivate the sustained allocation of control. To address this issue, we draw on flow theory, which predicts that a balance between task difficulty and individual ability results in the highest levels of intrinsic reward. In three behavioral and one functional magnetic resonance imaging studies, we used a naturalistic and open-source video game stimulus to show that changes in the balance between task difficulty and an individual’s ability to perform the task resulted in different levels of intrinsic reward, which is associated with different brain states. Specifically, psychophysiological interaction analyses show that high levels of intrinsic reward associated with a balance between task difficulty and individual ability are associated with increased functional connectivity between key structures within cognitive control and reward networks. By comparison, a mismatch between task difficulty and individual ability is associated with lower levels of intrinsic reward and corresponds to increased activity within the default mode network. These results suggest that intrinsic reward motivates cognitive control allocation.     

Cognitive labor shapes the desire for social and monetary compensation

When do people want something back for their mental labor? Based on equity theory, we propose that conscious experiences of success and effort—which emerge during cognitive work—shape people’s subsequent desire for social and monetary rewards. We examined this idea in a series of experiments, in which participants carried out a cognitive task, in which we manipulated task difficulty (easy vs. difficult) and performance feedback (high vs. low) within subjects. After each trial of this task, we probed people’s desire for compensation, in terms of social appreciation or money. Findings were in line with the entitlement hypothesis, which assumes that the experience of success can cause people to feel entitled to money. However, we found only indirect support for the effort compensation hypothesis, which assumes that the feeling of effort increases the subsequent desire for compensation, and no support for the intrinsic reward hypothesis, which assumes that people desire less social appreciation after already having experienced success. When considered together, our results suggest that labor-related feelings (of success and effort) shape people’s subsequent desire for money and social appreciation in several ways. These findings have potential implications for the effective use of performance feedback in work contexts.

     

Personality and performance on a missing-letter measure of perceptual defence

Fifty-two Ss were required to make complete words from 20 neutral and 20 unpleasant ‘target’ words whose alternate letters had been removed. The four personality scales from the EPQ and the Psychoticism scale from the unpublished PEN inventory were employed as independent variables in repeated-measures analyses of variance in which the dependent variable was the number of neutral or bad target words produced in the missing-letter task. A significant two-way interaction was obtained between PEN Psychoticism and performance on the task, such that Ss scoring low on the personality scale hit significantly more neutral targets than Ss scoring high on the scale. These results did not support previous studies on the relationship between personality and perceptual defence and were interpreted within the framework provided by Mednick, whereby schizophrenia is characterized by a flattening of associative hierarchies.     

Ambiguity and Communication Effects on Small Group Decision-Making Performance

The literature that has characterized the field of group studies has been controversial and confusing with regard to the effect of communicative and noncommunicative variables on group decision making. The research reported here seeks further understanding of the communication-performance relationship. It is postulated that two classes of variables (homogeneity and task) moderate the relationship between group communication and group performance. This is because the variables contribute to the overall ambiguity found in the decision-making situation. The ambiguity model is advanced in an effort to reconcile the contradictory findings, where they exist, and to propose new hypotheses regarding the communication-group performance relationship.     

Mood impact on cardiovascular reactivity when task difficulty is unclear

Research in the context of the mood-behavior-model (Gendolla in Rev Gen Psychol 4:348–408, 2000) has shown that moods can have an impact on effort mobilization due to congruency effects on demand appraisals. However, the mood research literature suggests that mood may also influence effort mobilization by its impact on appraisals of the instrumentality of success. In a single factor (mood valence: negative vs. neutral vs. positive) between-persons design, participants performed a memory task under conditions of unclear task difficulty. By successfully performing the task, participants could earn the chance to win a monetary reward. As predicted for tasks with unclear difficulty, effort mobilization—assessed as cardiovascular reactivity—increased from negative to positive mood. This effect was mediated by the subjective probability of winning the monetary reward for successful performance. These results demonstrate for the first time that mood can influence effort mobilization via the estimated instrumentality of success.     

Task difficulty, cardiovascular response, and the magnitude of goal valence

Sixty-four young women expected to perform an easy, moderately difficult, or extremely difficult memory task with the opportunity to earn a small incentive for good performance. Cardiovascular (heart rate, systolic and diastolic blood pressure) and subjective measures were taken immediately prior to task performance. Both systolic blood pressure (SBP) responses and ratings of goal attractiveness were nonmonotonically related to expected task difficulty, with the most pronounced SBP elevations and highest goal attractiveness in the moderately difficult task condition. Product-moment correlations among cardiovascular response measures revealed a strong positive association between systolic and diastolic pressure (but not heart rate) change in the easy condition, positive relationships among all measures in the moderately difficult condition, and no significant correlations in the extremely difficult condition. Subjective measures of arousal were not affected by the task difficulty manipulation. Principal findings are discussed in terms of a theoretical model proposed by Brehm (1979) that states that motivation varies as a nonmonotonic function of the difficulty of goal attainment. Intercorrelations among cardiovascular response variables are considered in terms of their possible indication of the mechanisms underlying blood pressure changes associated with variations in motivation.     

Expertise effects on decision-making in sport are constrained by requisite response behaviours – A meta-analysis

ObjectivesA quantitative review of the effects of requisite responses and methods of stimulus presentation for assessing decision-making expertise in sport was undertaken.DesignAn electronic literature search was conducted in the online databases: SPORTDiscus with Full Text and ISI Web Knowledge All Databases. Articles for analysis were selected according to prior defined criteria.MethodsWe considered 111 effect sizes in studies involving 882 expert and non-expert participants. Effect sizes were calculated for six common protocols for measures responses: verbalized knowledge, eye movement measures, decision time, response accuracy, movement accuracy, and movement time. Two moderator variables were also considered to assess effects of research protocols on the dependent variables: “the requisite response” and “stimulus presentation”. A random effect model was used to calculate effect sizes.ResultsAnalysis of moderator variables suggested that expertise effects were more apparent for “requisite responses” when participants were required to actually perform sporting actions and for “stimulus presentation” under in situ task constraints than for other conditions.ConclusionsFuture empirical work on expertise and decision-making needs to consider task representativeness in considering requisite responses of participants in simulating performance environment conditions. Use of representative task constraints with performers required to perform sport actions in in situ conditions appeared the most functional empirical protocols to enhance validity of data.     

编码后奖赏影响基于议程的学习：奖赏预期和结果的作用

基于ABR模型考察奖赏预期和奖赏结果对不同难度词对记忆与元记忆的影响。结果发现：(1)限时学习条件下,奖赏结果促进不同难度词对记忆成绩和学习判断,奖赏预期仅提高简单词对的记忆成绩。(2)自定步调学习条件下,定时学习判断时奖赏结果仅影响学习判断;奖赏预期促进高难度词对的学习时间分配,从而提高记忆成绩和学习判断。(3)在自定步调学习时,奖赏预期超越难度成为影响学习时间分配的因素。以上结果表明,个体会综合奖赏预期、奖赏结果和难度构建学习议程,足够大的奖赏预期会超越难度成为议程构建的主导因素。但奖赏预期和奖赏结果对记忆成绩、学习时间分配和学习判断的影响受学习条件调节。     

I'm worth more than you! Effects of reward interdependence on performance,cohesion, emotion and effort during team competition

ObjectivesTo examine the effects of reward structures on the performance of a motor task. To evaluate the effects of reward interdependence on performance, cohesion, emotion, and effort during intergroup (team) competition.DesignAn experimental design was used to compare the effects of reward interdependence (no, low, high) on performance of a strength and endurance task.MethodParticipants (N = 111) performed a 3-min handgrip task as a member of a team of four under three reward interdependence conditions (no; low, with an even split of prize money; high, with an uneven split of prize money) in head-to-head competitions against another team. Task performance was assessed using the cumulative force production total. Task-related cohesion, enjoyment, anxiety and effort were measured using self-report scales.ResultsPerformance was better with rewards than no reward, and better with high than low reward interdependence. Team cohesion was highest with low reward interdependence. Effort was greater with rewards than no reward. Anxiety and enjoyment did not vary among the reward conditions. Mediation analyses indicated that increased cohesion mediated improvements in performance from no reward to low reward interdependence conditions, and increased effort mediated improvements in performance from no reward to both low and high reward interdependence conditions.ConclusionPerformance of a simple physical task in team competition was facilitated by rewards, with optimal performance associated with unequal rewards (i.e., performance-related pay). The benefits of performing with rewards compared to no rewards were explained by increased cohesion and effort. Social interdependence theory can help explain performance of simple motor tasks during team-based competitions. The findings have implications for the pay structures adopted by sports teams.     

Investigating the influence of an effort–reward interaction on cognitive fatigue in individuals with multiple sclerosis

This study examined whether an alteration in the effort–reward relationship, a theoretical framework based on cognitive neuroscience, could explain cognitive fatigue. Forty persons with MS and 40 healthy age- and education-matched cognitively healthy controls (HC) participated in a computerized switching task with orthogonal high- and low-demand (effort) and reward manipulations. We used the Visual Analog Scale of Fatigue (VAS-F) to assess subjective state fatigue before and after each condition during the task. We used mixed-effects models to estimate the association and interaction between effort and reward and their relationship to subjective fatigue and task performance. We found the high-demand condition was associated with increased VAS-F scores (p < .001), longer response times (RT) (p < .001) and lower accuracy (p < .001). The high-reward condition was associated with faster RT (p = .006) and higher accuracy (p = .03). There was no interaction effect between effort and reward on VAS-F scores or performance. Participants with MS reported higher VAS-F scores (p = .02). Across all conditions, participants with MS were slower (p < .001) and slower as a function of condition demand compared with HC (p < .001). This behavioural study did not find evidence that an effort–reward interaction is associated with cognitive fatigue. However, our findings support the role of effort in subjective cognitive fatigue and both effort and reward on task performance. In future studies, more salient reward manipulations could be necessary to identify effort–reward interactions on subjective cognitive fatigue.     

Transfer of effort across behaviors

A series of experiments investigated the effects of required force and number of responses per reinforcer upon the subsequent performance of a second behavior. In the first experiment, a group of rats required to complete five round trips in an alley per food pellet subsequently bar-pressed for food at a greater rate than a group rewarded for each round trip or a control group that did not receive the alley experience. In the second experiment, a group required to apply a 70-g bar-press force subsequently shuttled for food at a greater rate than a group required merely to touch the lever or a control group that did not undergo the lever-press manipulation. The third experiment found that the force effect persisted across all five test sessions and was attributable to differences both in response speed and interresponse time. The fourth experiment found that both the necessary bar-press force and number of bar presses per reward affected subsequent shuttling in extinction. Two alternative interpretations of these results were compared: (a) the degree of accustomed effort per reinforcer becomes a generalized component of instrumental behavior or (b) high effort increases the habituation frustration-produced disruptive responses.     

Effect of failure/success feedback and the moderating influence of personality on reward motivation

While motivation to pursue goals is often assumed to be a trait-like characteristic, it is influenced by a variety of situational factors. In particular, recent experiences of success or failure, as well as cognitive responses to these outcomes, may shape subsequent willingness to expend effort for future rewards. To date, however, these effects have not been explicitly tested. In the present study, 131 healthy individuals received either failure or success feedback on a cognitive task. They were then instructed to either ruminate or distract themselves from their emotions. Finally, they completed the Effort Expenditure for Rewards Task, a laboratory measure of reward motivation. Results indicate that participants who received failure feedback relied more strongly on the reward magnitude when choosing whether to exert greater effort to obtain larger rewards, though this effect only held under conditions of significant uncertainty about whether the effort would be rewarded. Further, participants with high levels of trait inhibition were less responsive to reward value and probability when choosing whether to expend greater effort, results that echo past studies of effort-based decision-making in psychological disorders.     

Immediate attributional effects of success and failure in the field: Testing some laboratory hypotheses

Investigated how team success and failure are attributed to dispositional and situational factors as a function of immediate outcome of the group performance, past success of the team, and individual performance of team members within the group. 150 Little League baseball players' attributions for the team's outcome were taken separately with regard to team- and self-factors immediately after the conclusion of a game. The results reveal that success, independent of the margin of victory, is primarily assigned to effort and ability, while clear-loss is attributed to both effort and task difficulty. Conversely, bare-loss is seen to be mainly due to task difficulty and secondarily to low effort. The results are interpreted as supporting the notion of ego-centered causal judgments, but not necessarily the motive to enhance one's self, on the basis of the new proposition that effort has a different attributional meaning in the cases of success and failure; when losing effort is treated as an external factor, and when winning, effort tends to be interpreted as an internal factor. No differences with respect to attributions exist between individual players who perform poorly and those who excell within the team performance.     

Differential effects of task and reinforcement variables on the performance of three groups of behavior problem children

In a test of Quay's model of differential response tendencies in three basic dimensions of discordant behavior, 36 delinquent boys divided into three behavior groups — Conduct Disorder, Personality Disorder, Inadequate-Immature — del were compared on a verbal paired-associate task under four conditions of task structure: neutral and emotional content, simplicity and complexity; and two reward conditions: material and verbal. Predictions were that the Conduct Disorder and Inadequate-Immature group would perform optimally under conditions of simple emotional task structure and material reward as opposed to the Personality Disorder group, who would demonstrate optimal performance under verbal reinforcement and reflect an interaction effect for task complexity and emotionality. Results confirmed the basic hypothesis of differential responsiveness as a function of subject variables. Directions of the differences indicated that task variables also produced critical effects.     

奖赏和损失情境下男性海洛因戒断者的风险决策缺陷

摘 要 采用修改版的多伦多赌博任务考察决策情境对海洛因戒断者风险决策的影响。研究结果主要发现,海洛因戒断者在损失情境下的风险寻求决策比率与吸毒年限显著正相关,这种相关提示了风险决策背景下海洛因成瘾者持续使用毒品与其较低的损失敏感性之间的复杂交互作用。其次,海洛因戒断者在做出风险决策后收到消极反馈时的风险规避倾向可以负向预测其风险寻求决策比率,这可能进一步反映了海洛因戒断者风险感知的钝化或其对消极反馈信息的整合加工存在异常。     

Reward Processing and Decision-Making in Posttraumatic Stress Disorder

Theory suggests that, in those with posttraumatic stress disorder (PTSD), positive emotion is likely dampened due to reexperiencing of trauma-related stimuli. Prior research has extended positive emotion experiencing to reward processing research but has not yet examined how trauma cues affect reward processing (i.e., the anticipation of and satisfaction with reward) and decision-making in individuals with PTSD. We compared 24 individuals diagnosed with PTSD to 29 trauma-exposed controls in passive and decision-making phases of a wheel-of-fortune task, following both neutral and trauma inductions. Three types of spinners were used in the task: spinners that were obviously advantageous spinners, obviously disadvantageous spinners, and ambiguously advantageous spinners with outcomes averaging to a net gain. We hypothesized that the PTSD group would report lower reward expectation and lower outcome satisfaction and make less advantageous decisions, differences that would be exacerbated following a trauma prime. The PTSD group reported lower reward expectation than controls for the ambiguous spinners only, suggesting that the reduced anticipation of reward associated with PTSD may be specific to ambiguous stimuli. Reward expectation was not affected by the type of prime. Outcome satisfaction was not affected by PTSD or type of prime. Although only marginally significant, the PTSD group played the ambiguous spinners less often than controls, and played the obviously disadvantageous spinners significantly less often than controls, suggesting that those with PTSD are more aversive to loss. Our findings suggest that PTSD-related deficits are more robust for reward expectation than outcome satisfaction, and support future research examining the role of reward-related decision-making in PTSD.     

Context specificity of inhibitory control in dogs

Across three experiments, we explored whether a dog’s capacity for inhibitory control is stable or variable across decision-making contexts. In the social task, dogs were first exposed to the reputations of a stingy experimenter that never shared food and a generous experimenter who always shared food. In subsequent test trials, dogs were required to avoid approaching the stingy experimenter when this individual offered (but withheld) a higher-value reward than the generous experimenter did. In the A-not-B task, dogs were required to inhibit searching for food in a previously rewarded location after witnessing the food being moved from this location to a novel hiding place. In the cylinder task, dogs were required to resist approaching visible food directly (because it was behind a transparent barrier), in favor of a detour reaching response. Overall, dogs exhibited inhibitory control in all three tasks. However, individual scores were not correlated between tasks, suggesting that context has a large effect on dogs’ behavior. This result mirrors studies of humans, which have highlighted intra-individual variation in inhibitory control as a function of the decision-making context. Lastly, we observed a correlation between a subject’s age and performance on the cylinder task, corroborating previous observations of age-related decline in dogs’ executive function.     

Gorillas’ use of the escape response in object choice memory tests

The ability to monitor and control one’s own cognitive states, metacognition, is crucial for effective learning and problem solving. Although the literature on animal metacognition has grown considerably during last 15 years, there have been few studies examining whether great apes share such introspective abilities with humans. Here, we tested whether four gorillas could meet two criteria of animal metacognition, the increase in escape responses as a function of task difficulty and the chosen-forced performance advantage. During testing, the subjects participated in a series of object choice memory tests in which a preferable reward (two grapes) was placed under one of two or three blue cups. The apes were required to correctly select the baited blue cup in this primary test. Importantly, the subjects also had an escape response (a yellow cup), where they could obtain a secure but smaller reward (one grape) without taking the memory test. Although the gorillas received a relatively small number of trials and thus experienced little training, three gorillas significantly declined the memory tests more often in difficult trials (e.g., when the location of the preferred reward conflicted with side bias) than in easy trials (e.g., when there was no such conflict). Moreover, even when objective cues were eliminated that corresponded to task difficulty, one of the successful gorillas showed evidence suggestive of improved memory performance with the help of escape response by selectively avoiding trials in which he would be likely to err before the memory test actually proceeded. Together, these findings demonstrate that at least some gorillas may be able to make optimal choices on the basis of their own memory trace strength about the location of the preferred reward.