Bringing color to emotion: The influence of color on attentional bias to briefly presented emotional images

Is color a critical feature in emotional content extraction and involuntary attentional orienting toward affective stimuli? Here we used briefly presented emotional distractors to investigate the extent to which color information can influence the time course of attentional bias in early visual cortex. While participants performed a demanding visual foreground task, complex unpleasant and neutral background images were displayed in color or grayscale format for a short period of 133 ms and were immediately masked. Such a short presentation poses a challenge for visual processing. In the visual detection task, participants attended to flickering squares that elicited the steady-state visual evoked potential (SSVEP), allowing us to analyze the temporal dynamics of the competition for processing resources in early visual cortex. Concurrently we measured the visual event-related potentials (ERPs) evoked by the unpleasant and neutral background scenes. The results showed (a) that the distraction effect was greater with color than with grayscale images and (b) that it lasted longer with colored unpleasant distractor images. Furthermore, classical and mass-univariate ERP analyses indicated that, when presented in color, emotional scenes elicited more pronounced early negativities (N1–EPN) relative to neutral scenes, than when the scenes were presented in grayscale. Consistent with neural data, unpleasant scenes were rated as being more emotionally negative and received slightly higher arousal values when they were shown in color than when they were presented in grayscale. Taken together, these findings provide evidence for the modulatory role of picture color on a cascade of coordinated perceptual processes: by facilitating the higher-level extraction of emotional content, color influences the duration of the attentional bias to briefly presented affective scenes in lower-tier visual areas.     

Why does a red snake in the grass capture your attention?

It has been suggested that affective stimuli automatically capture attention; this preferential processing is thought to be related to the evolutionary significance of affective stimuli. However, recent evidence suggests that perceptual salience alone might explain why some affective stimuli are more likely to influence attentional processes in certain contexts. In this study, we manipulated affective and perceptual salience to better understand how affective information is processed and how it impacts attentional processes in different contexts. We used stimuli that are both affectively and perceptually salient, while varying the task requirement to encourage the processing of perceptually salient (Experiment 1) or affectively salient (Experiment 2) information. This design made it possible to observe independent and interdependent relationships between perceptual and affective salience. The results showed that when the task encouraged the processing of perceptually salient information, affective salience did not influence task performance. In contrast, when the task encouraged the processing of affectively salient information, affectively salient information impaired task performance. The findings suggest that the affective nature of the stimuli does not always influence attentional processes.     

ERP correlates of attentional processing in spider fear: evidence of threat-specific hypervigilance

Attentional bias towards threat can be demonstrated by enhanced processing of threat-related targets and/or greater interference when threat-related distractors are present. These effects are argued to reflect processing within the orienting and executive control networks of the brain respectively. This study investigated behavioural (RT) and electrophysiological correlates of early selective attention and top-down attentional control among females with high (n?=?16) or low (n?=?16) spider fear (Mean age?=?22 years). Participants completed a novel flanker go/nogo task in which a central schematic flower or spider stimulus was flanked by either congruent or incongruent distractors. Participants responded to green stimuli (go trials) and withheld response to yellow stimuli (nogo trials). High fear participants demonstrated significantly shorter reaction times and greater P1 amplitude to spider targets, suggesting specific hypervigilance towards threat-relevant stimuli. In contrast to predictions, there was little evidence for behavioural interference effects or differences in N2 amplitude when distractor stimuli were threat-relevant.     

Processing emotional facial expressions: The role of anxiety and awareness

In this paper, the role of self-reported anxiety and degree of conscious awareness as determinants of the selective processing of affective facial expressions is investigated. In two experiments, an attentional bias toward fearful facial expressions was observed, although this bias was apparent only for those reporting high levels of trait anxiety and only when the emotional face was presented in the left visual field. This pattern was especially strong when the participants were unaware of the presence of the facial stimuli. In Experiment 3, a patient with right-hemisphere brain damage and visual extinction was presented with photographs of faces and fruits on unilateral and bilateral trials. On bilateral trials, it was found that faces produced less extinction than did fruits. Moreover, faces portraying a fearful or a happy expression tended to produce less extinction than did neutral expressions. This suggests that emotional facial expressions may be less dependent on attention to achieve awareness. The implications of these results for understanding the relations between attention, emotion, and anxiety are discussed.     

Attentional bias to angry faces using the dot-probe task? It depends when you look for it

A number of studies using the dot-probe task now report the existence of an attentional bias to angry faces in participants who rate highly on scales of anxiety; however, no equivalent bias has been observed in non-anxious populations, despite evidence to the contrary from studies using other tasks. One reason for this discrepancy may be that researchers using the dot-probe task have rarely investigated any effects which might emerge earlier than 500 ms following presentation of the threat-related faces. Accordingly, in the current study we presented pairs of face stimuli with emotional and neutral expressions and probed the allocation of attention to these stimuli for presentation times of 100 and 500 ms. Results showed that at 100 ms there was an attentional bias towards the location of the relatively threatening stimulus (the angry face in angry/neutral pairs and the neutral face in neutral/happy pairs) and this pattern reversed by 500 ms. Comparisons of reaction time (RT) scores with an appropriate baseline suggested that the early bias toward threatening faces may actually arise through inhibition of the relatively least threatening member of a face pair rather than through facilitation of, or vigilance towards, the more threatening stimulus. However the mechanisms governing the observed biases are interpreted, these data provide evidence that probing for the location of spatial attention at 500 ms is not necessarily indicative of the initial allocation of attention between competing emotional facial stimuli.     

Is there a mutual relationship between opposite attentional biases underlying anxiety?

Current models that account for attentional processes in anxiety have proposed that high-trait anxious individuals are characterized by a hypervigilant-avoidant pattern of attentional biases to threat. We adopted a laboratory conditioning procedure to induce concomitant hypervigilance and avoidance to threat, emphasizing a putative relationship between lower-level reactive and upper-level controlled attentional mechanisms as the core account of attentional processes involved in the development and maintenance of anxiety. Eighty high- and low-trait anxious participants underwent Pavlovian conditioning to a human face. Eye tracking was used to monitor attentional changes to the conditioned stimulus (CS+) face and the neutral stimulus (CS-) face, presented at 200, 500, and 800 ms durations. The high-anxious participants developed the expected attentional bias toward the CS+ at 200 ms presentation time and attentional avoidance at 500 and 800 ms durations. Hypervigilance to aversive stimuli at 200 ms and later avoidance to the same stimuli at 500 and 800 ms were associated with higher levels of galvanic skin conductance to the CS+. The low-anxious individuals developed the opposite attentional pattern with an initial tendency to orient attention away from the aversive stimuli in the 200 ms condition and to orient attention toward aversive stimuli in the remaining time. The differential modulation between hypervigilance and avoidance elicited in the two groups by the conditioning procedure suggests that vulnerability to anxiety is characterized by a latent relationship between diverse attentional mechanisms. Within this relationship, hypervigilance and avoidance to threat operate at different stages of information processing suggesting fuzzy boundaries between early reactive and later-strategic processing of threat.     

情绪信息与注意偏向

情绪信息对注意的调节是情绪研究的热点问题之一。过去的研究多集中于注意偏向,研究范式的多样化、被试群体特质的差异性,导致对注意偏向机制的诸多争论,形成了注意成分说、图式说、注意资源说和PDP模型。注意成分说认为,威胁相关的刺激损害了注意解除能力而引起偏向。图式说认为,图式或知识结构的激活引发注意偏向。注意资源说认为,过多注意资源的消耗引起情绪Stroop实验中的注意偏向。PDP模型认为,特殊人群过高的输入单元激活水平引起注意偏向。     

Interlateral asymmetry in the time course of the effect of a peripheral prime stimulus

Evidence exists that both right and left hemisphere attentional mechanisms are mobilized when attention is directed to the right visual hemifield and only right hemisphere attentional mechanisms are mobilized when attention is directed to the left visual hemifield. This arrangement might lead to a rightward bias of automatic attention. The hypothesis was investigated by testing male volunteers, wherein a "location discrimination" reaction time task (Experiments 1 and 3) and a "location and shape discrimination" reaction time task (Experiments 2 and 4) were used. Unilateral (Experiments 1 and 2) and unilateral or bilateral (Experiments 3 and 4) peripheral visual prime stimuli were used to control attention. Reaction time to a small visual target stimulus in the same location or in the horizontally opposite location was evaluated. Stimulus onset asynchronies (SOAs) were 34, 50, 67, 83 and 100 ms. An important prime stimulus attentional effect was observed as early as 50 ms in the four experiments. In Experiments 2, 3 and 4, this effect was larger when the prime stimulus occurred in the right hemifield than when it occurred in the left hemifield for SOA 100 ms. In Experiment 4, when the prime stimulus occurred simultaneously in both hemifields, reaction time was faster for the right hemifield and for SOA 100 ms. These results indicate that automatic attention tends to favor the right side of space, particularly when identification of the target stimulus shape is required.     

Attentional Bias for Threat: Evidence for Delayed Disengagement from Emotional Faces

The present paper reports three new experiments suggesting that the valence of a face cue can influence attentional effects in a cueing paradigm. Moreover, heightened trait anxiety resulted in increased attentional dwell-time on emotional facial stimuli, relative to neutral faces. Experiment 1 presented a cueing task, in which the cue was either an "angry", "happy", or "neutral" facial expression. Targets could appear either in the same location as the face (valid trials) or in a different location to the face (invalid trials). Participants did not show significant variations across the different cue types (angry, happy, neutral) in responding to a target on valid trials. However, the valence of the face did affect response times on invalid trials. Specifically, participants took longer to respond to a target when the face cue was "angry" or "happy" relative to neutral. In Experiment 2, the cue-target stimulus onset asynchrony (SOA) was increased and an overall inhibition of return (IOR) effect was found (i.e., slower responses on valid trials). However, the "angry" face cue eliminated the IOR effect for both high and low trait anxious groups. In Experiment 3, threat-related and jumbled facial stimuli reduced the magnitude of IOR for high, but not for low, trait-anxious participants.These results suggest that: (i) attentional bias in anxiety may reflect a difficulty in disengaging from threat-related and emotional stimuli, and (ii) threat-related and ambiguous cues can influence the magnitude of the IOR effect.     

Facilitation and interference of behavioral responses by task-irrelevant affect-laden stimuli

Emotional interference on behavior is commonly observed when task-irrelevant negative stimuli appear before behavioral targets. One explanation postulates that affect-laden stimuli readily capture attention, interfering with the processing of the upcoming target. Emotional stimuli might also preactivate motor programs incompatible with the demanded response. Using a cued go/no-go procedure we showed that task-irrelevant unpleasant stimuli cause interference or facilitation depending on their onset asynchrony relative to the target. We observed interference with short (200 ms) stimulus-target asynchronies and facilitation for longer ones (600 ms), both for key press (Experiment 1) and key release (Experiment 2) responses. The interference effect is compatible with an attentional explanation, but the behavioral facilitation is hard to accommodate within either attentional or motor accounts. This interference-facilitation pattern can be explained assuming that once the attentional effect subsides, emotional processing may enhance the perceptual processing of the stimuli, or lower the decision threshold, thereby facilitating the response selection process.     

Do threatening stimuli draw or hold visual attention in subclinical anxiety?

Biases in information processing undoubtedly play an important role in the maintenance of emotion and emotional disorders. In an attentional cueing paradigm, threat words and angry faces had no advantage over positive or neutral words (or faces) in attracting attention to their own location, even for people who were highly state-anxious. In contrast, the presence of threatening cues (words and faces) had a strong impact on the disengagement of attention. When a threat cue was presented and a target subsequently presented in another location, high state-anxious individuals took longer to detect the target relative to when either a positive or a neutral cue was presented. It is concluded that threat-related stimuli affect attentional dwell time and the disengage component of attention, leaving the question of whether threat stimuli affect the shift component of attention open to debate.     

The processing of affectively valenced stimuli: The role of surprise

Two experiments tested the hypothesis that the surprise mechanism activates a threat detection system that prioritises the processing of threat-related stimuli. In Experiment 1, participants responded to a dot that appeared during the presentation of two words. In the critical trial, one of the two words was either pleasant or unpleasant. In Experiment 2, depending on the condition, the participants had to decide whether at least one of two simultaneously presented pictures depicted either a pleasant or an unpleasant stimulus. In the critical trial, both a pleasant and an unpleasant picture appeared. In both experiments, the stimuli in the critical trial were presented either during routine behaviour or in the context of a surprising event. The results showed that during routine behaviour unpleasant stimuli received more attentive resources than pleasant stimuli only if the affective valence of the stimuli was action-relevant (Experiment 2). In contrast, in the context of surprise, unpleasant words engaged more attentive resources than pleasant words although they were action-irrelevant (Experiment 1). In addition, in the context of surprise, the decision time increase was more pronounced in the pleasant than in the unpleasant experimental group. This finding was interpreted as evidence that the threat detection system of the surprise mechanism initially searches for a threat-related stimulus.     

中英双语者情绪注意偏向中的双语优势效应

采用改进的点–探测范式,考察熟练双语者在情绪注意偏向中对情绪信息加工的优势效应及该效应产生的原因。采用2（熟练双语者和非熟练双语者）×3（靶刺激与消极词汇出现的位置一致、不一致和中性条件）×2（线索呈现时间为100 ms和400 ms）的混合实验设计,记录被试对靶子的按键反应时和错误率。结果发现：线索呈现100 ms和400 ms时,两组被试在注意定向分数上无显著差异;线索呈现100 ms时,两组被试的注意解除分数无显著差异;线索呈现400 ms时,熟练双语者的注意解除分数显著小于非熟练双语者。结果表明,在情绪注意偏向任务中,熟练双语者比非熟练双语者表现出了对情绪词汇信息更好的注意抑制控制能力,体现出对情绪信息加工的双语优势效应,产生这一优势效应的原因是熟练双语者在注意的晚期阶段比非熟练双语者具有更好的情绪信息注意解除能力。     

Time course of visual attention across perceptual levels and objects

Theories of shifts of visual attention based on attentional blink or dwell time do not directly address shifts of attention across different levels (global or local) involving multiple objects. Two experiments were conducted employing the attentional dwell time paradigm to investigate the shifts of visual attention between objects selected at same or different levels. Participants were instructed to identify two successive compound stimuli at a pre-specified level (global or local) presented at two different locations with variable SOA. The initial pair of locations in which the stimulus was presented was fixed in Experiment 1 but not in Experiment 2. Experiment 1 results showed very little impairment for second target identification when both the targets were at the global level. Attentional shift was better with both targets at the same level compared to different levels. Experiment 2 results showed that local followed by global target identification is difficult at short SOAs compared to other conditions. The results indicate that scope of attention affects the time course of visual attention. Global processing could be performed with very little capacity limitation simultaneously with distributed attention. The default mode of attention might be distributed and attention becomes focused for target identification. Different mechanisms may underlie shifts in focused attention between different locations and changes in attentional set required by changes in perceptual levels.     

Time course of attentional bias to emotional scenes in anxiety: Gaze direction and duration

Pictures of emotionally neutral, positive, and negative (threat‐ or harm‐related) scenes were presented for 3 seconds, paired with nonemotional control pictures. The eye fixations of high and low trait anxiety participants were monitored. Intensity of stimulus emotionality was varied, with two levels of perceptual salience for each picture (colour vs. greyscale). Regardless of perceptual salience, high anxiety was associated with preferential attention: (a) towards all types of emotional stimuli in initial orienting, as revealed by a higher probability of first fixation on the emotional picture than on the neutral picture of a pair; (b) towards positive and harm stimuli in a subsequent stage of early engagement, as shown by longer viewing times during the first 500 ms following onset of the pictures; and with (c) attention away from (i.e., avoidance) harm stimuli in a later phase, as indicated by shorter viewing times and lower frequency of fixation during the last 1000 ms of picture exposure. This suggests that the nature of the attentional bias varies as a function of the time course in the processing of emotional pictures.     

Electrophysiological evidence for greater attention to threat when cognitive control resources are depleted

In this study, we investigated the time course of attentional bias for threat-related (angry) facial expressions under conditions of high versus low cognitive (working memory) load. Event-related potential (ERP) and reaction time (RT) data were recorded while participants viewed pairs of faces (angry paired with neutral face) displayed for 500 ms and followed by a probe. Participants were required to respond to the probe while performing a concurrent task of holding in working memory a sequence of digits that were either in the same order (low memory load) or in a random mixed order (high memory load). The ERP results revealed that higher working memory load resulted in enhanced lateralized neural responses to threatening relative to neutral faces, consistent with greater initial orienting of attention to threatening faces (early N2pc: 180–252 ms) and enhanced maintenance of processing representations of threat (late N2pc, 252–320 ms; SPCN, 320–500 ms). The ERP indices showed significant positive relationships with each other, and also with the behavioral index of attentional bias to threat (reflected by faster RTs to probes replacing angry than neutral faces at 500 ms), although the latter index was not significantly influenced by memory load. Overall, the findings indicate that depletion of cognitive control resources, using a working memory manipulation, increases the capacity of task-irrelevant threat cues to capture and hold attention.     

Time course of attentional bias to emotional scenes in anxiety: Gaze direction and duration

Pictures of emotionally neutral, positive, and negative (threat- or harm-related) scenes were presented for 3 seconds, paired with nonemotional control pictures. The eye fixations of high and low trait anxiety participants were monitored. Intensity of stimulus emotionality was varied, with two levels of perceptual salience for each picture (colour vs. greyscale). Regardless of perceptual salience, high anxiety was associated with preferential attention: (a) towards all types of emotional stimuli in initial orienting, as revealed by a higher probability of first fixation on the emotional picture than on the neutral picture of a pair; (b) towards positive and harm stimuli in a subsequent stage of early engagement, as shown by longer viewing times during the first 500 ms following onset of the pictures; and with (c) attention away from (i.e., avoidance) harm stimuli in a later phase, as indicated by shorter viewing times and lower frequency of fixation during the last 1000 ms of picture exposure. This suggests that the nature of the attentional bias varies as a function of the time course in the processing of emotional pictures.     

Attentional capture by emotional faces is contingent on attentional control settings

Attentional capture by schematic emotional faces was investigated in two experiments using the flanker task devised by Eriksen and Eriksen (1974). In Experiment 1, participants were presented with a central target (a schematic face that was either positive or negative) flanked by two identical distractors, one on either side (schematic faces that were positive, negative, or neutral). The objective was to identify the central target as quickly as possible. The impact of the flankers depended on their emotional expression. Consistent with a threat advantage hypothesis (negative faces are processed faster and attract more processing resources), responses to positive faces were slower when these were flanked by (response incompatible) negative faces as compared with positive or neutral faces, whereas responses to negative faces were unaffected by the identity of the flankers. Experiment 2 was a standard flanker task with letter stimuli except that the task-neutral flankers were schematic faces that were either positive, negative, or emotionally neutral. In this case, in which faces and emotional expressions were to be ignored, performance seemed entirely unaffected by the faces. This result suggests that attentional capture by emotional faces is contingent on attentional control settings.     

Attentional capture by emotional faces is contingent on attentional control settings

Attentional capture by schematic emotional faces was investigated in two experiments using the flanker task devised by Eriksen and Eriksen (1974). In Experiment 1, participants were presented with a central target (a schematic face that was either positive or negative) flanked by two identical distractors, one on either side (schematic faces that were positive, negative, or neutral). The objective was to identify the central target as quickly as possible. The impact of the flankers depended on their emotional expression. Consistent with a threat advantage hypothesis (negative faces are processed faster and attract more processing resources), responses to positive faces were slower when these were flanked by (response incompatible) negative faces as compared with positive or neutral faces, whereas responses to negative faces were unaffected by the identity of the flankers. Experiment 2 was a standard flanker task with letter stimuli except that the task-neutral flankers were schematic faces that were either positive, negative, or emotionally neutral. In this case, in which faces and emotional expressions were to be ignored, performance seemed entirely unaffected by the faces. This result suggests that attentional capture by emotional faces is contingent on attentional control settings.     

The flexibility of emotional attention: Accessible social identities guide rapid attentional orienting

There is extensive evidence that emotional-especially threatening-stimuli rapidly capture attention. These findings are often explained in terms of a hard-wired and relatively inflexible fear module. We propose an alternative, more flexible mechanism, arguing that motivational relevance is the crucial factor driving rapid attentional orienting. To test our hypothesis, we endowed initially neutral face stimuli with relevance by randomly assigning them to a social in-group or out-group during a 1-min learning phase, and used these faces as cues in a dot probe task to measure rapid attentional orienting. Across three experiments, we observed attentional orienting toward faces assigned to the out-group. Initial rapid orienting (after 100ms, Experiments 1 and 2) was observed only for familiar faces for which group membership was explicitly encoded, suggesting that rapid orienting may be based on affectively charged memory traces. At a later time point (after 500ms, Experiment 3), attention was deployed toward unfamiliar faces sharing a physical attribute (background color) with the familiar out-group faces, suggesting a more time-consuming on-line appraisal of the stimulus. The amount of attentional bias to out-group faces was correlated with individual differences in the accessibility of group identification. Our findings demonstrate that attentional prioritization mechanisms can be flexibly tuned by a brief learning phase of social identity. This is consistent with the idea that attention mechanisms subserving the selection and prioritization of emotional aspects of the environment are not static and hard-wired, but may rapidly adapt to recent changes in motivational contingencies.