Food priming and short-term retention in the delayed alternation task

The delayed alternation task, with rats as subjects, was used to assess the effects of a priming food reward on subsequent retention of a reinforced target location in a T maze. Subjects received a pretrial feeding, followed by a forced-choice rewarded entry into one goal box of the maze (the “cuing” run). Following a delay interval (5–60 s), the subjects were allowed to choose either goal, with reward available only in the one not entered on the cuing run. Priming significantly reduced such alternation after 30- and 60-s delays (Experiment 1), whereas administering the reward following the cuing run had no effect on choice behavior (Experiment 2). In the third study, prefeeding had a decremental effect when the following cuing run was reinforced, but no decrement occurred when reinforcement was omitted on the cuing run. The results suggest that food reward enhances retention of spatial information, but priming reduces this effect.     

The effect of interpolated activity on a treble right-left alternation task

In a delayed treble alternation task the number of errors made by human subjects was found to increase when an irrelevant task was presented in the delay interval. The number of errors increased with the number of items presented in the delay interval, but neither the difficulty of the irrelevant task nor its similarity to the alternation task was found to affect the number of errors.     

Response rate correlates with indifference points in a delay‐discounting procedure

To study how effort affects reward value, we replicated Fortes, Vasconcelos and Machado's (2015) study using an adjusting‐delay task. Nine pigeons chose between a standard alternative that gave access to 4 s of food, after a 10 s delay, and an adjusting‐delay alternative that gave access to 12 s of food after a delay that changed dynamically with the pigeons' choices, decreasing when they preferred the standard alternative, and increasing when they preferred the adjusting alternative. The delay value at which preference stabilized defined the indifference point, a measure of reward value. To manipulate effort across phases, we varied the response rate required during the delay of the standard alternative. Results showed that a) the indifference point increased in the higher‐response‐rate phases, suggesting that reward value decreased with effort, and b) in the higher‐response‐rate phases, response rate in the standard alternative was linearly related to the indifference point. We advance several conceptions of how effort may change perceived delay or amount and thereby affect reward value.     

延迟满足：基于未来时间洞察力的自我调节

延迟满足是个体为获得更有价值的奖励结果,坚持目标行为而推迟即时性满足的倾向与行为。其产生机制在很大程度上基于未来取向的自我调节。未来时间洞察力对延迟满足的作用可由期望-价值理论、解释水平理论和自我调节周期模型等多种理论进行解释。除行为层面的机制,未来时间洞察力与延迟满足涉及腹侧额叶-纹状体环路等相似的脑机制。未来研究需深化和丰富延迟满足的理论机制,明确与时间洞察力各维度的复杂关系,探究与时间洞察力相同的生理神经机制,促进其应用于社会实践。     

Mindsets and pre-conscious open-mindedness to incidental information

Mindset theory (Gollwitzer, 1990) proposes that deliberative mindsets are marked by more open-minded processing of information, whereas implemental mindsets are characterized by more closed-minded processing. Accordingly, deliberative and implemental mindsets should differ in selective processing of incidental information when performing a central task. In three experiments, participants in deliberative and implemental mindsets performed a computer task while randomly presented incidental, unavoidable words. A subsequent recognition memory test assessed selective processing of these incidental words. Results revealed that deliberative mindsets led to superior recognition memory, suggesting increased open-mindedness to processing incidental information. Implications for mindset and goal theories are discussed.     

Integrating rewards and cognition in the frontal cortex

Research indicates that the dorsolateral prefrontal cortex (DLPFC) contributes to working memory and executive control, whereas the ventral frontal cortex (VFC) contributes to affective and motivational processing. Few studies have examined both the functional specificity and the integration of these regions. We did so using fMRI and a verbal working memory task in which visual cues indicated whether recall performance on an upcoming trial would be linked to a monetary reward. On the basis of prior findings obtained in delayed response tasks performed by nonhuman primates, we hypothesized that (1) VFC would show an increase only in response to a cue indicating potential for a monetary reward; (2) DLPFC would show sustained activity across a delay interval for all trials, though activity in rewarded trials would be enhanced; and (3) regions engaged in speech-based rehearsal would be relatively insensitive to monetary incentive. Our hypotheses about DLPFC and rehearsal-related regions were confirmed. In VFC regions, we failed to observe statistically significant effects of reward when the cue or delay epochs of the task were examined in isolation. However, an unexpected and significant deactivation was observed in VFC during the delay epoch; furthermore, a post hoc voxelwise analysis indicated a complex interaction between (1) the cue and delay epochs of the task and (2) the reward value of the trials. The pattern of activation and deactivation across trial types suggests that VFC is sensitive to reward cues, and that portions of DLPFC and VFC may work in opposition during the delay epoch of a working memory task in order to facilitate task performance.     

Conflict adaptation in time: Foreperiods as contextual cues for attentional adjustment

Interference evoked by distractor stimulus information, such as flankers in the Eriksen task, is reduced when the proportion of conflicting stimuli is increased. This modulation is sensitive to contextual cues such as stimulus location or color, suggesting attentional adjustment to conflict contingencies on the basis of context information. In the present study, we explored whether conflict adjustment is modulated by temporal variation of conflict likelihood. To this end, we associated low and high proportions of conflict stimuli with foreperiods of different lengths. Flanker interference was higher with foreperiods associated with low conflict proportions, suggesting that participants use the foreperiod as a contextual cue for attentional adjustment. We conjecture that participants initially adopt the strategy useful for conflict contingencies associated with short foreperiods, and then readjust during the trial, in the absence of any additional exogenous cue, when the imperative stimulus has not occurred during a certain time interval.     

Autonomic responsivity during visual search of hyperactive and reading-disabled children

Heart rate and skin conductance measures, recorded during a visual search task, were compared for hyperactive, reading-disabled, hyperactive reading-disabled, and control elementary school boys. As shown in past work, basal autonomic levels did not statistically differentiate groups. In all groups, heart rate levels increased with task complexity, but more so on reward than on nonreward trials. In the intertriai interval, heart rate decelerated consistently when subjects were anticipating stimuli associated with reward, but when reward was uncertain, heart rate accelerated slightly or stayed the same. Control subjects exhibited anticipatory heart rate deceleration more consistently than did clinical subjects, especially the solely hyperactive ones. Skin conductance levels first decreased, then rose as task complexity increased, but the groups did not differ on this measure. A conditioning model is outlined to explain directional changes in heart rate.     

Pavlovian reward learning elicits attentional capture by reward-associated stimuli

Feature–reward association elicits value-driven attentional capture (VDAC) regardless of the task relevance of associated features. What are the necessary conditions for feature–reward associations in VDAC? Recent studies claim that VDAC is based on Pavlovian conditioning. In this study, we manipulated the temporal relationships among feature, response, and reward in reward learning to elucidate the necessary components of VDAC. We presented reward-associated features in a variety of locations in a flanker task to form a color–reward association (training phase) and then tested VDAC in a subsequent visual search task (test phase). In Experiment 1, we showed reward-associated features in a task display requiring response selection and observed VDAC, consistent with most previous studies. In Experiment 2, features presented at a fixation display before a task display also induced VDAC. Moreover, in Experiment 3, we reduced the time interval between features and rewards so that features appeared after a task display and we obtained marginally significant VDAC. However, no VDAC was observed when features and rewards were simultaneously presented in a feedback display in Experiments 4 and 5, suggesting that a direct association between feature and reward is not sufficient for VDAC. These results are in favor of the idea that response selection does not mediate feature–reward association in VDAC. Moreover, the evidence suggests that the time interval of feature and reward is flexible with some restriction in the learning of feature–reward association. The present study supports the hypothesis that theories of Pavlovian conditioning can account for feature–reward association in VDAC.     

The role of exploration in win-shift and win-stay performance on a radial maze

Win-shift spatial memory tasks in a radial maze reinforce animals for avoiding previously visited rewarded arms; win-stay tasks reinforce them for returning to those arms. Win-shift tasks have generally been found much easier to perform, and this may be explained either in terms of foraging models which postulate avoidance of locations where food has been found, or in terms of the predominance of spontaneous alternation (exploration). Experiment 1 examined spontaneous alternation behavior in the radial maze as a function of whether the first visit to an arm had been rewarded or not, and showed that alternation was more probable after nonreward than after reward in both hungry and thirsty rats (a result which conflicts with the foraging account of the win-shift superiority). Experiment 2 replicated the finding that win-stay discrimination performance was inferior to win-shift. A manipulation (lengthening the delay between initial and test choices) which weakens spontaneous alternation, reduced, but did not reverse, the win-shift superiority. In Experiment 3, in order to eliminate the influence of spontaneous alternation, versions of the win-stay and win-shift tasks were devised in which, unlike the original task, all arms were familiar at the choice trial. Under those conditions win-stay was performed better than win-shift. It is concluded that spontaneous alternation plays a major role in many spatial memory tasks, and that the results can best be accounted for by combining principles of exploration and simple associative learning, without recourse to foraging models.     

Failure to exploit learned spatial value information during visual search

ABSTRACT

In recent years there has been rapid proliferation of studies demonstrating how reward learning guides visual search. However, most of these studies have focused on feature-based reward, and there has been scant evidence supporting the learning of space-based reward. We raise the possibility that the visual search apparatus is impenetrable to spatial value contingencies, even when such contingencies are learned and represented online in a separate knowledge domain. In three experiments, we interleaved a visual choice task with a visual search task in which one display quadrant produced greater monetary rewards than the remaining quadrants. We found that participants consistently exploited this spatial value contingency during the choice task but not during the search task – even when these tasks were interleaved within the same trials and when rewards were contingent on response speed. These results suggest that the expression of spatial value information is task specific and that the visual search apparatus could be impenetrable to spatial reward information. Such findings are consistent with an evolutionary framework in which the search apparatus has little to gain from spatial value information in most real world situations.     

Functional specialization within the striatum along both the dorsal/ventral and anterior/posterior axes during associative learning via reward and punishment

The goal of the present study was to elucidate the role of the human striatum in learning via reward and punishment during an associative learning task. Previous studies have identified the striatum as a critical component in the neural circuitry of reward-related learning. It remains unclear, however, under what task conditions, and to what extent, the striatum is modulated by punishment during an instrumental learning task. Using high-resolution functional magnetic resonance imaging (fMRI) during a reward- and punishment-based probabilistic associative learning task, we observed activity in the ventral putamen for stimuli learned via reward regardless of whether participants were correct or incorrect (i.e., outcome). In contrast, activity in the dorsal caudate was modulated by trials that received feedback--either correct reward or incorrect punishment trials. We also identified an anterior/posterior dissociation reflecting reward and punishment prediction error estimates. Additionally, differences in patterns of activity that correlated with the amount of training were identified along the anterior/posterior axis of the striatum. We suggest that unique subregions of the striatum--separated along both a dorsal/ventral and anterior/posterior axis--differentially participate in the learning of associations through reward and punishment.     

Non-spatial delayed alternation by the pigeon

Pigeons were trained on a non-spatial delayed alternation task in which the color not pecked on the previous trial was correct. When varying delays were interposed between trials, alternation accuracy decreased as a function of delay, but remained greater than chance with a 45-sec delay. Successful alternation on the longer delays was accomplished without behavioral mediation of the delay intervals. Also, during initial testing when a position cue was available in addition to the color cue after incorrect trials, alternation accuracy was greater after a preceding incorrect trial than after a correct trial. When the position cue was removed, no differences occurred as a function of the outcome of the preceding trial.     

Visual Search Remains Efficient When Visual Working Memory is Full

Many theories of attention have proposed that visual working memory plays an important role in visual search tasks. The present study examined the involvement of visual working memory in search using a dual-task paradigm in which participants performed a visual search task while maintaining no, two, or four objects in visual working memory. The presence of a working memory load added a constant delay to the visual search reaction times, irrespective of the number of items in the visual search array. That is, there was no change in the slope of the function relating reaction time to the number of items in the search array, indicating that the search process itself was not slowed by the memory load. Moreover, the search task did not substantially impair the maintenance of information in visual working memory. These results suggest that visual search requires minimal visual working memory resources, a conclusion that is inconsistent with theories that propose a close link between attention and working memory.     

Neuroeconomics,health psychology,and the interdisciplinary study of preventative health behavior

The goal of this article is to introduce readers to theories, tools, and evidence from the field of neuroeconomics and to describe how health psychology and neuroeconomics can be mutually informative in the study of preventative health behaviors. Preventative health behavior here refers to both individual actions that impact one's health (e.g., exercise) and broader behavioral patterns, such as those captured in personality constructs. Although neuroeconomic researchers have begun to incorporate health‐relevant behaviors into their studies, the full potential of this research to inform preventative health models is as yet unrealized. What is needed to “translate up” is the unification of rich theoretical content from health psychology with investigations by neuroeconomic researchers of the decision‐making process during health‐relevant choices. We identify choice as a central, shared feature across models of preventative health behavior that can serve as an inroad for neuroeconomics to contribute to existing models and highlight commonalities that might not otherwise be apparent. A central premise of our argument is that, because health decisions are nearly always multiply determined, a more precise and mechanistic understanding of how choices are made is an important but understudied topic in health psychology. A partnership between health psychologists and neuroeconomic researchers can yield valuable insights into how preventative health choice is made and to identify targets and methods for intervention.     

Reward modulates adaptations to conflict

Both cognitive conflict (e.g. Verguts & Notebaert, 2009) and reward signals (e.g. Waszak & Pholulamdeth, 2009) have been proposed to enhance task-relevant associations. Bringing these two notions together, we predicted that reward modulates conflict-based sequential adaptations in cognitive control. This was tested combining either a single flanker task (Experiment 1) or a task-switch paradigm (Experiment 2) with performance-related rewards. Both experiments confirmed that adaptations after conflict were modulated by reward. In the flanker task, this resulted in increased conflict adaptation after rewarded trials. In the task-switching experiment, reward increased the conflict-modulated switch cost. Interestingly, both adaptations to conflict disappeared after no-reward trials. Moreover, individual differences in participants' sensitivity to reward predicted these reward modulations of trial-to-trial adaptations. These findings shed new light on the exact role of cognitive conflict in shaping subsequent behavior.     

观点采择因素对3～4岁儿童延迟满足决策的影响

通过采用延迟满足决策任务,要求儿童分别为自己和他人做出决策,本研究考察了观点采择因素对儿童情感决策发展的影响。实验一选取3岁和4岁儿童各40名,结果发现3岁儿童和4岁儿童在为自己选和为他人选两种条件下的表现均无显著差异,都倾向于做出延迟选择。实验二选取3岁和4岁儿童各60名,在为他人的选择中进一步区分了不同的观点提示条件,并增加了观点采择测验任务。结果发现,4岁儿童的观点采择能力得到了初步的发展,在不同的观点提示条件下为他人选择时分别表现出了与为自己选择不同的决策趋势;3岁儿童尚未获得观点采择能力,在各种不同观点提示条件下为自己和为他人做选择时差异均不显著。本研究结果表明,观点采择能力对儿童情感决策的影响是发展性的。随着观点采择能力的发展,儿童逐渐能够确立正确的延迟动机,为他人做出有效的决策。     

视空工作记忆负载对真实场景搜索绩效的影响

采用视空工作记忆任务和真实场景搜索任务相结合的双任务范式, 结合眼动技术将搜索过程划分为起始阶段、扫描阶段和确认阶段, 探究视空工作记忆负载对真实场景搜索绩效的影响机制, 同时考查试次间搜索目标是否变化、目标模板的具体化程度以及搜索场景画面的视觉混乱度所起的调节作用。结果表明, 视空工作记忆负载会降低真实场景搜索的成绩, 在搜索过程中表现为视空负载条件下扫描阶段持续时间的延长、注视点数目的增加和空间负载条件下确认阶段持续时间的延长, 视空负载对搜索过程的影响与目标模板的具体化程度有关; 空间负载会降低真实场景搜索的效率, 且与搜索画面的视觉混乱度有关, 而客体负载则不会。由此可见, 视空工作记忆负载对真实场景搜索绩效的影响不同, 空间负载对搜索过程的影响比客体负载更长久, 二者均受到目标模板具体化程度的调节; 仅空间负载会降低真实场景的搜索效率, 且受到搜索场景画面视觉混乱度的调节。     

大学生在双趋冲突和趋避冲突中的折扣率差异

目的探讨大学生被试在双趋冲突和趋避冲突条件下的折扣率差异。方法让70名大学生完成两种条件下的延迟折扣任务（DDT）。结果趋避冲突条件下大学生被试的折扣率显著低于双趋冲突条件下的折扣率,在延迟奖赏为中幅度（50-60元）时折扣率最大。结论相对于双趋冲突,损益情况和延迟时间同时影响着被试在趋避冲突条件下的选择。     

Common attitudes about the effect of positive and negative mood on task related motivation]

Several theories on emotion and mood have stressed the close relationship between emotion and motivation. However, assumptions on mood contingent motivations have mainly been studied in the field of social behavior, and there are only few studies concerned with mood contingent task motivations, an area in which nit is possible to distinguish between two motivational sets, the deliberative and the implemented mind set. Assuming that positive mood is associated with a stronger task-oriented deliberative mind set, and that negative mood is associated with a stronger self-oriented deliberative mind set, and that implemented mind set should be intrinsically task-oriented during positive mood and instrumentally task-oriented during negative mood. The present paper is concerned with these assumptions from a subjective perspective: The respondents were asked about their lay perceptions of mood influences (positive, elated versus negative, sad mood) on task related motivations. In study I the respondents (N = 40) were asked about their deliberative mind sets during positive versus negative mood and about their general perceptions of mood influences on performance. In study II the respondents (N = 58) were requested to imagine situations which elicit positive, negative or neutral mood, and then to answer questions on deliberative and implemented mind sets during these states; they also hat to answer a general question about mood influences on task performance. Both quantitative and qualitative measures are used in these studies. The findings support the above general notions, and they additionally show that in the respondents' opinions negative mood effects are more variable than positive mood effects; further, that there are quite a few individual differences in assumed mood effects on task-related motivation.