How does reward compete with goal-directed and stimulus-driven shifts of attention?

In order to behave adaptively, attention can be directed in space either voluntarily (i.e. endogenously) according to strategic goals, or involuntarily (i.e. exogenously) through reflexive capture by salient or novel events. The emotional or motivational values of stimuli can also influence attentional orienting. However, little is known about how reward-related effects compete or interact with endogenous and exogenous attention mechanisms. Here we designed a visual search paradigm in which goal-driven and stimulus-driven shifts of attention were manipulated by classic spatial cueing procedures, while an irrelevant, but previously rewarded stimulus also appeared as a distractor and hence competed with both types of spatial attention during search. Our results demonstrated that stimuli previously associated with a high monetary reward received higher attentional priority in the subsequent visual search task, even though these stimuli and reward were no longer task-relevant, mitigating the attentional orienting induced by both endogenous and exogenous cues.     

Don’t let it distract you: how information about the availability of reward affects attentional selection

Previous research has shown that attentional selection is affected by reward contingencies: previously selected and rewarded stimuli continue to capture attention even if the reward contingencies are no longer in place. In the current study, we investigated whether attentional selection also is affected by stimuli that merely signal the magnitude of reward available on a given trial but, crucially, have never had instrumental value. In a series of experiments, we show that a stimulus signaling high reward availability captures attention even when that stimulus is and was never physically salient or part of the task set, and selecting it is harmful for obtaining reward. Our results suggest that irrelevant reward-signaling stimuli capture attention, because participants have learned about the relationship between the stimulus and reward. Importantly, we only observed learning after initial attentional prioritization of the reward signaling stimulus. We conclude that nonsalient, task-irrelevant but reward-signaling stimuli can affect attentional selection above and beyond top-down or bottom-up attentional control, however, only after such stimuli were initially prioritized for selection.     

Value-driven attentional and oculomotor capture during goal-directed, unconstrained viewing

Covert shifts of attention precede and direct overt eye movements to stimuli that are task relevant or physically salient. A growing body of evidence suggests that the learned value of perceptual stimuli strongly influences their attentional priority. For example, previously rewarded but otherwise irrelevant and inconspicuous stimuli capture covert attention involuntarily. It is unknown, however, whether stimuli also draw eye movements involuntarily as a consequence of their reward history. Here, we show that previously rewarded but currently task-irrelevant stimuli capture both attention and the eyes. Value-driven oculomotor capture was observed during unconstrained viewing, when neither eye movements nor fixations were required, and was strongly related to individual differences in visual working memory capacity. The appearance of a reward-associated stimulus came to evoke pupil dilation over the course of training, which provides physiological evidence that the stimuli that elicit value-driven capture come to serve as reward-predictive cues. These findings reveal a close coupling of value-driven attentional capture and eye movements that has broad implications for theories of attention and reward learning.     

特征和位置信息在价值驱动注意捕获中的作用

本研究采用训练−测试范式考察颜色和位置信息在价值驱动注意捕获中的作用。实验1考察是否存在基于具体位置的价值驱动的注意捕获效应。在训练阶段, 被试对8个位置中两个位置出现的红色目标反应伴随着高奖励反馈, 而对另外两个位置出现的红色目标反应伴随着低奖励反馈, 其它4个位置为中性位置, 没有目标出现。在测试阶段, 一半试次中红色刺激作为分心物出现。结果发现, 只有当分心刺激出现在高奖励位置和两个高奖励位置之间的中性位置时才能够捕获注意; 实验2考察颜色和位置信息在价值驱动注意捕获中的交互作用。在训练阶段, 将颜色特征和位置信息联合起来进行学习。在测试阶段, 和高、低奖励相联结的颜色刺激各在1/3试次中作为分心物出现。结果发现, 只有当高奖励颜色出现在高奖励位置或出现在高奖励位置之间的中性位置时才能够捕获注意。研究结果表明：(1)位置联结的价值驱动的注意捕获效应能够泛化到特定邻近位置上; (2)个体在训练阶段将颜色和位置的联合特征与奖励建立联结, 训练阶段建立的联结不能泛化到部分特征上。价值驱动注意捕获效应的泛化具有选择性。     

Reward history but not search history explains value-driven attentional capture

In past years, an extensive amount of research has focused on how past experiences guide future attention. Humans automatically attend to stimuli previously associated with reward and stimuli that have been experienced during visual search, even when it is disadvantageous in present situations. Recently, the relationship between “reward history” and “search history” has been discussed critically. We review results from research on value-driven attentional capture (VDAC) with a focus on these two experience-based attentional selection processes and their distinction. To clarify inconsistencies, we examined VDAC within a design that allows a direct comparison with other mechanisms of attentional selection. Eighty-four healthy adults were trained to incidentally associate colors with reward (10 cents, 2 cents) or with no reward. In a subsequent visual search task, distraction by reward-associated and unrewarded stimuli was contrasted. In the training phase, reward signals facilitated performance. When these value-signaling stimuli appeared as distractors in the test phase, they continuously shaped attentional selection, despite their task irrelevance. Our findings clearly cannot be attributed to a history of target search. We conclude that once an association is established, value signals guide attention automatically in new situations, which can be beneficial or not, depending on the congruency with current goals.     

Value-driven attentional capture is modulated by spatial context

When stimuli are associated with reward outcome, their visual features acquire high attentional priority such that stimuli possessing those features involuntarily capture attention. Whether a particular feature is predictive of reward, however, will vary with a number of contextual factors. One such factor is spatial location: for example, red berries are likely to be found in low-lying bushes, whereas yellow bananas are likely to be found on treetops. In the present study, I explore whether the attentional priority afforded to reward-associated features is modulated by such location-based contingencies. The results demonstrate that when a stimulus feature is associated with a reward outcome in one spatial location but not another, attentional capture by that feature is selective to when it appears in the rewarded location. This finding provides insight into how reward learning effectively modulates attention in an environment with complex stimulus–reward contingencies, thereby supporting efficient foraging.     

Valuable orientations capture attention

Visual attention has long been known to be drawn to stimuli that are physically salient or congruent with task-specific goals. Several recent studies have shown that attention is also captured by stimuli that are neither salient nor task relevant, but that are rendered in a colour that has previously been associated with reward. We investigated whether another feature dimension—orientation—can be associated with reward via learning and thereby elicit value-driven attentional capture. In a training phase, participants received a monetary reward for identifying the colour of Gabor patches exhibiting one of two target orientations. A subsequent test phase in which no reward was delivered required participants to search for Gabor patches exhibiting one of two spatial frequencies (orientation was now irrelevant to the task). Previously rewarded orientations robustly captured attention. We conclude that reward learning can imbue features other than colour—in this case, specific orientations—with persistent value.     

Cognitive control and counterproductive oculomotor capture by reward-related stimuli

Two experiments investigated the extent to which value-modulated oculomotor capture is subject to top-down control. In these experiments, participants were never required to look at the reward-related stimuli; indeed, doing so was directly counterproductive because it caused omission of the reward that would otherwise have been obtained. In Experiment 1, participants were explicitly informed of this omission contingency. Nevertheless, they still showed counterproductive oculomotor capture by reward-related stimuli, suggesting that this effect is relatively immune to cognitive control. Experiment 2 more directly tested whether this capture is controllable by comparing the performance of participants who either had or had not been explicitly informed of the omission contingency. There was no evidence that value-modulated oculomotor capture differed between the two conditions, providing further evidence that this effect proceeds independently of cognitive control. Taken together, the results of the present research provide strong evidence for the automaticity and cognitive impenetrability of value-modulated attentional capture.     

Counterintuitive effects of negative social feedback on attention

Which stimuli we pay attention to is strongly influenced by learning. Stimuli previously associated with reward outcomes, such as money and food, and stimuli previously associated with aversive outcomes, such as monetary loss and electric shock, automatically capture attention. Social reward (happy expressions) can bias attention towards associated stimuli, but the role of negative social feedback in biasing attentional selection remains unexplored. On the one hand, negative social feedback often serves to discourage particular behaviours. If attentional selection can be curbed much like any other behavioural preference, we might expect stimuli associated with negative social feedback to be more readily ignored. On the other hand, if negative social feedback influences attention in the same way that other aversive outcomes do, such feedback might ironically bias attention towards the stimuli it is intended to discourage selection of. In the present study, participants first completed a training phase in which colour targets were associated with negative social feedback. Then, in a subsequent test phase, these same colour stimuli served as task-irrelevant distractors during a visual search task. The results strongly support the latter interpretation in that stimuli previously associated with negative social feedback impaired search performance.     

场景在价值驱动注意捕获中的作用

本研究采用训练-测试范式考察场景信息在价值驱动注意捕获中的作用。实验1训练阶段将唯一性的场景信息与奖励建立联结,测试阶段发现只有当分心刺激出现在高奖励场景中才能捕获注意;实验2训练阶段将场景和颜色信息联合但分别独立预测奖励,结果发现高奖励颜色出现在任何场景中都能捕获注意。研究结果表明:(1)场景-价值联结能够引发注意捕获效应;(2)与场景相比,颜色特征在价值驱动的注意捕获中具有优势效应。     

积极情绪反馈对注意捕获影响的实验研究

目的：研究采用“学习-测试”范式,通过3个实验探讨积极社会情绪反馈对注意捕获的影响。方法：实验1,在学习阶段做出反应后,分别给予积极情绪和中性情绪反馈,探讨积极情绪和中性情绪捕获注意的情况;实验2,学习阶段做出反应后,没有任何情绪反馈;实验3,改变学习阶段积极情绪和中性情绪反馈图片出现的频率,探讨图片出现频率对注意捕获的影响。结果：（1）与中性情绪相比,积极情绪捕获了较多注意（实验1）;（2）无情绪反馈时,经过多次练习的刺激作为干扰刺激也捕获到了注意（实验2）;（3）积极情绪影响刺激注意优先性的过程还受到积极情绪图片出现频率的影响（实验3）。结论：积极情绪捕获注意的机制中,也有自上而下目标驱动的机制在起作用;情绪图片出现的频率也会影响社社会情绪对注意的捕获。     

Pavlovian reward learning underlies value driven attentional capture

Recent evidence shows that distractors that signal high compared to low reward availability elicit stronger attentional capture, even when this is detrimental for task-performance. This suggests that simply correlating stimuli with reward administration, rather than their instrumental relationship with obtaining reward, produces value-driven attentional capture. However, in previous studies, reward delivery was never response independent, as only correct responses were rewarded, nor was it completely task-irrelevant, as the distractor signaled the magnitude of reward that could be earned on that trial. In two experiments, we ensured that associative reward learning was completely response independent by letting participants perform a task at fixation, while high and low rewards were automatically administered following the presentation of task-irrelevant colored stimuli in the periphery (Experiment 1) or at fixation (Experiment 2). In a following non-reward test phase, using the additional singleton paradigm, the previously reward signaling stimuli were presented as distractors to assess truly task-irrelevant value driven attentional capture. The results showed that high compared to low reward-value associated distractors impaired performance, and thus captured attention more strongly. This suggests that genuine Pavlovian conditioning of stimulus-reward contingencies is sufficient to obtain value-driven attentional capture. Furthermore, value-driven attentional capture can occur following associative reward learning of temporally and spatially task-irrelevant distractors that signal the magnitude of available reward (Experiment 1), and is independent of training spatial shifts of attention towards the reward signaling stimuli (Experiment 2). This confirms and strengthens the idea that Pavlovian reward learning underlies value driven attentional capture.     

Stimulus-driven and goal-driven effects on Pavlovian associative reward learning

It has been shown that pure Pavlovian associative reward learning can elicit value-driven attentional capture. However, in previous studies, task-irrelevant and response-independent reward-signalling stimuli hardly competed for visual selective attention. Here we put Pavlovian reward learning to the test by manipulating the extent to which bottom-up (Experiment 1) and top-down (Experiment 2) processes were involved in this type of learning. In Experiment 1, the stimulus, the colour of which signalled the magnitude of the reward given, was presented simultaneously with another randomly coloured stimulus, so that it did not capture attention in a stimulus-driven manner. In Experiment 2, observers performed an attentionally demanding RSVP-task at the centre of the screen to largely tax goal-driven attentional resources, while a task-irrelevant and response-independent stimulus in the periphery signalled the magnitude of the reward given. Both experiments showed value-driven attentional capture in a non-reward test phase, indicating that the reward-signalling stimuli were imbued with value during the Pavlovian reward conditioning phases. This suggests that pure Pavlovian reward conditioning can occur even when (1) competition prevents attention being automatically allocated to the reward-signalling stimulus in a stimulus-driven manner, and (2) attention is occupied by a demanding task, leaving little goal-driven attentional resources available to strategically select the reward-signalling stimulus. The observed value-driven attentional capture effects appeared to be similar for observers who could and could not explicitly report the stimulus–reward contingencies. Altogether, this study provides insight in the conditions under which mere stimulus–reward contingencies in the environment can be learned to affect future behaviour.     

阈下抑郁个体对负性情绪刺激的注意解脱困难

本研究拟采用点探测范式及不同情绪内容的面孔刺激（高兴、中性、悲伤和愤怒）考察阈下抑郁个体的负性注意偏向及其内在机制。点探测任务中情绪面孔配对呈现（负性-中性、正性-中性）,配对面孔中的情绪线索位置与靶刺激的位置构成负性一致/不一致和正性一致/不一致条件,同时实验中加入“中性-中性”面孔线索作为一致和不一致条件的对比基线来考察注意偏向的内在机制。结果发现,阈下抑郁个体在负性不一致条件下的反应时显著长于负性一致条件,表明阈下抑郁个体具有对负性刺激的注意偏向;进一步比较发现,阈下抑郁个体在负性不一致条件下的反应时显著的长于“中性-中性”基线条件,而负性一致条件与基线之间差异不显著,表明阈下抑郁个体的负性注意偏向为对负性刺激的注意解脱困难。结果另发现,阈下抑郁个体未能像无抑郁对照组个体表现出对正性刺激的注意偏向。结果表明,处于阈下抑郁状态的个体表现出对负性刺激的注意偏向,具体为对负性刺激的注意解脱困难,其原因可能是由于阈下抑郁个体在注意控制和情绪调节功能上的紊乱。     

Testing reward-cue attentional salience: Attainment and dynamic changes

A great wealth of studies has investigated the capacity of motivationally relevant stimuli to bias attention, suggesting that reward predicting cues are prioritized even when reward is no longer delivered and when attending to such stimuli is detrimental to reward achievement. Despite multiple procedures have been adopted to unveil the mechanisms whereby reward cues gain attentional salience, some open questions remain. Indeed, mechanisms different from motivation can be responsible for the capture of attention triggered by the reward cue. In addition, we note that at present only a few studies have sought to address whether the cue attractiveness dynamically follows changes in the associated reward value. Investigating how and to what extent the salience of the reward cue is updated when motivation changes, could help shedding light on how reward-cues attain and maintain their capacity to attract attention, and therefore on apparent irrational attentive behaviors.     

On the value-dependence of value-driven attentional capture

Findings from an increasingly large number of studies have been used to argue that attentional capture can be dependent on the learned value of a stimulus, or value-driven. However, under certain circumstances attention can be biased to select stimuli that previously served as targets, independent of reward history. Value-driven attentional capture, as studied using the training phase-test phase design introduced by Anderson and colleagues, is widely presumed to reflect the combined influence of learned value and selection history. However, the degree to which attentional capture is at all dependent on value learning in this paradigm has recently been questioned. Support for value-dependence can be provided through one of two means: (1) greater attentional capture by prior targets following rewarded training than following unrewarded training, and (2) greater attentional capture by prior targets previously associated with high compared to low value. Using a variant of the original value-driven attentional capture paradigm, Sha and Jiang (Attention, Perception, and Psychophysics, 78, 403–414, 2016) failed to find evidence of either, and raised criticisms regarding the adequacy of evidence provided by prior studies using this particular paradigm. To address this disparity, here we provided a stringent test of the value-dependence hypothesis using the traditional value-driven attentional capture paradigm. With a sufficiently large sample size, value-dependence was observed based on both criteria, with no evidence of attentional capture without rewards during training. Our findings support the validity of the traditional value-driven attentional capture paradigm in measuring what its name purports to measure.     

Where is the chocolate? Rapid spatial orienting toward stimuli associated with primary rewards

Some stimuli can orient attentional resources and access awareness even if they appear outside the focus of voluntary attention. Stimuli with low-level perceptual salience and stimuli with an emotional content can modulate attention independently of voluntary processes. In Experiment 1, we used a spatial cuing task to investigate whether stimuli that are controlled for their perceptual salience can modulate the rapid orienting of attention based exclusively on their affective relevance. Affective relevance was manipulated through a Pavlovian conditioning paradigm in which an arbitrary and affectively neutral perceptual stimulus was associated with a primary reward (i.e., a chocolate odor). Results revealed that, after conditioning, attentional resources were rapidly oriented toward the stimulus that was previously associated with the reward. In Experiment 2, we used the very same conditioning procedure, but we devaluated the reward after conditioning for half of the participants through a sensory-specific satiation procedure. Strikingly, when the reward was devaluated, attention was no longer oriented toward reward-associated stimuli. Our findings therefore suggest that reward associations rapidly modulate visual processing independently of both voluntary processing and the perceptual salience of the stimulus. This supports the notion that stimuli associated with primary rewards modulate rapid attention orienting on the basis of the affective relevance of the stimulus.     

Attentional capture by emotional stimuli is modulated by semantic processing

The attentional blink paradigm was used to examine whether emotional stimuli always capture attention. The processing requirement for emotional stimuli in a rapid sequential visual presentation stream was manipulated to investigate the circumstances under which emotional distractors capture attention, as reflected in an enhanced attentional blink effect. Emotional distractors did not cause more interference than neutral distractors on target identification when perceptual or phonological processing of stimuli was required, showing that emotional processing is not as automatic as previously hypothesized. Only when semantic processing of stimuli was required did emotional distractors capture more attention than neutral distractors and increase attentional blink magnitude. Combining the results from 5 experiments, the authors conclude that semantic processing can modulate the attentional capture effect of emotional stimuli.     

无关工作记忆表征的负性情绪信息能否捕获视觉注意?一项眼动研究

研究通过分析视觉搜索任务的首次注视点和行为反应时, 探讨无关工作记忆表征的负性情绪信息对视觉注意选择的影响。实验1发现在反映早期注意选择的首次注视点百分率指标上, 不管工作记忆表征的情绪效价如何, 均出现了显著的注意捕获效应; 实验2发现当采用中性情绪靶子刺激时, 首次注视点百分率指标上仍表现出了稳健的注意捕获效应; 在首次注视点持续时间指标上, 实验1和实验2均发现记忆匹配条件的干扰刺激显著小于控制条件的干扰刺激, 表现出注意的快速脱离; 而在行为反应时指标上, 早期的注意捕获效应消失(实验1), 甚至被反转为注意抑制效应(实验2)。这些结果表明在早期注意选择阶段, 记忆驱动的注意捕获效应不受工作记忆表征情绪效价的影响, 但认知控制会在早期注意捕获之后促使注意快速脱离记忆匹配的干扰刺激, 其作用效果受靶子刺激情绪效价的调节。     

Biased processing of sad faces: An ERP marker candidate for depression susceptibility

Depression has been associated with task-relevant increased attention toward negative information, reduced attention toward positive information, or reduced inhibition of task-irrelevant negative information. This study employed behavioural and psychophysiological measures (event-related potentials; ERP) to examine whether groups with risk factors for depression (past depression, current dysphoria) would show attentional biases or inhibitory deficits related to viewing facial expressions. In oddball task blocks, young adult participants responded to an infrequently presented target emotion (e.g., sad) and inhibited responses to an infrequently presented distracter emotion (e.g., happy) in the context of frequently presented neutral stimuli. Previous depression was uniquely associated with greater P3 ERP amplitude following sad targets, reflecting a selective attention bias. Also, dysphoric individuals less effectively inhibited responses to sad distracters than non-dysphoric individuals according to behavioural data, but not psychophysiological data. Results suggest that depression risk may be most reliably characterised by increased attention toward others' depressive facial emotion.