Anxiety and sensitivity to eye gaze in emotional faces

This paper reports three studies in which stronger orienting to perceived eye gaze direction was revealed when observers viewed faces showing fearful or angry, compared with happy or neutral, emotional expressions. Gaze-related spatial cueing effects to laterally presented fearful faces and centrally presented angry faces were also modulated by the anxiety level of participants, with high- but not low-state anxious individuals revealing enhanced shifts of attention. In contrast, both high- and low-state anxious individuals demonstrated enhanced orienting to averted gaze when viewing laterally presented angry faces. These results provide novel evidence for the rapid integration of facial expression and gaze direction information, and for the regulation of gaze-cued attention by both the emotion conveyed in the perceived face and the degree of anxiety experienced by the observer.     

“Avoiding or approaching eyes”? Introversion/extraversion affects the gaze-cueing effect

We investigated whether the extra-/introversion personality dimension can influence processing of others’ eye gaze direction and emotional facial expression during a target detection task. On the basis of previous evidence showing that self-reported trait anxiety can affect gaze-cueing with emotional faces, we also verified whether trait anxiety can modulate the influence of intro-/extraversion on behavioral performance. Fearful, happy, angry or neutral faces, with either direct or averted gaze, were presented before the target appeared in spatial locations congruent or incongruent with stimuli’s eye gaze direction. Results showed a significant influence of intra-/extraversion dimension on gaze-cueing effect for angry, happy, and neutral faces with averted gaze. Introverts did not show the gaze congruency effect when viewing angry expressions, but did so with happy and neutral faces; extraverts showed the opposite pattern. Importantly, the influence of intro-/extraversion on gaze-cueing was not mediated by trait anxiety. These findings demonstrated that personality differences can shape processing of interactions between relevant social signals.     

Dynamic emotional messages differentially affect 6-month-old infants’ attention to eyes and gaze cues

Infants often experience interactions in which caregivers use dynamic messages to convey their affective and communicative intent. These dynamic emotional messages may shape the development of emotion discrimination skills and shared attention by influencing infants’ attention to internal facial features and their responses to eye gaze cues. However, past research examining infants’ responses to emotional faces has predominantly focused on classic, stereotyped expressions (e.g., happy, sad, angry) that may not reflect the variability that infants experience in their daily interactions. The present study therefore examined forty-two 6-month-old infants’ attention to eyes vs. mouth and gaze cueing responses across multiple dynamic emotional messages that are common to infant-directed interactions. Overall, infants looked more to the eyes during messages with negative affect, but this increased attention to the eyes during these message conditions did not directly facilitate gaze cueing. Infants instead showed reliable gaze cueing only after messages with positive and neutral affect. We additionally observed gender differences in infants’ attention to internal face features and subsequent gaze cueing responses. Female infants spent more time looking at the eyes during the dynamic emotional messages and showed increased initial orienting and longer looking to gaze-cued objects following positive messages, whereas male infants showed these gaze cueing effects following neutral messages. These results suggest that variability in caregivers' communication can shape infants’ attention to and processing of emotion and gaze information.     

威胁相关面孔表情对眼睛注视方向知觉的影响

以往研究发现眼睛注视方向知觉受面孔表情的影响,愤怒面孔相较于恐惧面孔更倾向被判断为看着观察者。虽然研究者对此提出了不同的解释,但目前尚不清楚愤怒和恐惧表情在注视方向知觉中的这种差异影响到底来自于面孔的结构信息还是物理特征信息。本研究采用注视方向辨别任务,计算直视知觉范围（The Cone of Direct Gaze,CoDG）为因变量,分别以直立,倒置及模糊图片为实验材料,试图通过分离面孔结构信息和物理特征信息,对以上问题进行探讨。结果发现在保留面孔全部信息的情况下（实验1）愤怒面孔的CoDG大于恐惧面孔;在破坏结构信息加工,只保留特征信息加工的情况下（实验2））愤怒和恐惧表情在直视知觉范围上的差异消失了;在削弱物理特征信息加工,保留结构信息加工的情况下（实验3）二者在CoDG上的差异又复现。本研究结果说明不同威胁性面孔表情对眼睛注视知觉的影响主要来自于二者在与情绪意义相关的结构信息加工上的不同,而二者非低级的物理信息上的差异,支持信号共享假说和情绪评价假说对威胁性面孔表情与注视方向整合加工解释的理论基础。     

Emotional modulation of attention orienting by gaze varies with dynamic cue sequence

ABSTRACT

Recent gaze cueing studies using dynamic cue sequences have reported increased attention orienting by gaze with faces expressing fear, surprise or anger. Here, we investigated whether the type of dynamic cue sequence used impacted the magnitude of this effect. When the emotion was expressed before or concurrently with gaze shift, no modulation of gaze-oriented attention by emotion was seen. In contrast, when the face cue averted gaze before expressing an emotion (as if reacting to the object after first localizing it), the gaze orienting effect was clearly increased for fearful, surprised and angry faces compared to neutral faces. Thus, the type of dynamic sequence used, and in particular the order in which the gaze shift and the facial expression are presented, modulate gaze-oriented attention, with maximal modulation seen when the expression of emotion follows gaze shift.     

Both fearful and happy expressions interact with gaze direction by 200 ms SOA to speed attention orienting

Attention orienting towards a gazed-at location is fundamental to social attention. Whether gaze cues can interact with emotional expressions other than those signalling environmental threat to modulate this gaze cueing, and whether this integration changes over time, remains unclear. With four experiments we demonstrate that, when perceived motion inherent to dynamic displays is controlled for, gaze cueing is enhanced by both fearful and happy faces compared to neutral faces. This enhancement is seen with stimulus-onset asynchronies ranging from 200–700?ms. Thus, gaze cueing can be reliably modulated by positive expressions, albeit to a smaller degree than fearful ones, and this gaze–emotion integration impacts behaviour as early as 200?ms post-cue onset.     

Angry faces are tracked more easily than neutral faces during multiple identity tracking

We investigated whether and how emotional facial expressions affect sustained attention in face tracking. In a multiple-identity and object tracking paradigm, participants tracked multiple target faces that continuously moved around together with several distractor faces, and subsequently reported where each target face had moved to. The emotional expression (angry, happy, and neutral) of the target and distractor faces was manipulated. Tracking performance was better when the target faces were angry rather than neutral, whereas angry distractor faces did not affect tracking. The effect persisted when the angry faces were presented upside-down and when surface features of the faces were irrelevant to the ongoing task. There was only suggestive and weak evidence for a facilitatory effect of happy targets and a distraction effect of happy distractors in comparison to neutral faces. The results show that angry expressions on the target faces can facilitate sustained attention on the targets via increased vigilance, yet this effect likely depends on both emotional information and visual features of the angry faces.     

奖赏预期对面孔情绪加工的影响：一项事件相关电位研究

采用事件相关电位(ERPs)技术考察了奖赏预期对人类面孔情绪识别的影响。实验采用线索-目标范式, 分别记录了被试在奖赏预期条件下以及无奖赏预期条件下对正性、中性和负性面孔进行情绪辨别任务的ERP数据。行为结果显示, 被试在奖赏预期条件下的反应时快于无奖赏预期条件下的反应时, 对情绪面孔的反应时快于对中性面孔的反应时。ERPs数据显示, 奖赏线索比无奖赏线索诱发了更正的P1、P2和P300成分。目标刺激诱发的P1、N170波幅以及N300均受到奖赏预期的调节, 在奖赏预期条件下目标诱发了更正的ERPs。P1、N170、VPP等成分没有受到面孔情绪的影响, 而额中央位置的N300波幅显示情绪(正性与负性)面孔与中性面孔加工的差异。重要的是, N300波幅出现奖赏预期与情绪的交互作用, 正、负情绪加工效应以及负性偏向效应受奖赏预期的差异性影响。正性情绪加工效应不受奖赏预期的影响, 而负性情绪加工效应和负性偏向效应在奖赏预期条件下显著大于无奖赏预期条件下。这些结果说明, 奖赏预期能够调节对面孔情绪的加工, 且不同加工进程中奖赏对情绪加工的调节作用不同。动机性信息调节注意资源的分配, 促进了个体在加工面孔情绪时的负性偏向。     

Modulation of reflexive orienting to gaze direction by facial expressions

Facial expression and gaze perception are thought to share brain mechanisms but behavioural interactions, especially from gaze-cueing paradigms, are inconsistent. We conducted a series of gaze-cueing studies using dynamic facial cues to examine orienting across different emotional expression and task conditions, including face inversion. Across experiments, at a short stimulus–onset asynchrony (SOA) we observed both an expression effect (i.e., faster responses when the face was emotional versus neutral) and a cue validity effect (i.e., faster responses when the target was gazed-at), but no interaction between validity and emotion. Results from face inversion suggest that the emotion effect may have been due to both facial expression and stimulus motion. At longer SOAs, validity and emotion interacted such that cueing by emotional faces, fearful faces in particular, was enhanced relative to neutral faces. These results converge with a growing body of evidence that suggests that gaze and expression are initially processed independently and interact at later stages to direct attentional orienting.     

Identification of angry faces in the attentional blink

According to cognitive and neural theories of emotion, attentional processing of innate threat stimuli, such as angry facial expressions, is prioritised over neutral stimuli. To test this hypothesis, the present study used a modified version of the rapid serial visual presentation (RSVP) paradigm to investigate the effect of emotional face stimuli on the attentional blink (AB). The target stimuli were schematic faces which depicted threatening (angry), positive or neutral facial expressions. Results showed that performance accuracy was enhanced (i.e., the AB was reduced) on trials in which the second target was an angry face, rather than a neutral face. Results extend previous research by demonstrating that angry faces reduce the AB, and that this effect is found for schematic facial expressions. These findings further support the proposal that, when there is competition for attentional resources, threat stimuli are given higher priority in processing compared with non-threatening stimuli.     

Detection of emotional faces is modulated by the direction of eye gaze

Emotionally expressive faces have shown enhanced detectability over neutral faces, but little is known about the effect of eye gaze on detecting the presence of emotional faces. Emotional expressions and gaze direction are both cues to the intentions of another person, and gaze direction has been shown to affect recognition accuracy and perceived intensity of emotional faces. The current study showed that fearful faces were detected more frequently with an averted gaze than with a direct gaze in an attentional blink task, whereas angry and happy faces were detected more frequently with a direct gaze than with an averted gaze. The results are in line with the shared signal hypothesis and appraisal theory and suggest that selection for awareness was based on a rapid evaluation of the intentions of another person as conveyed by their facial expression and gaze direction.     

注视方向和面部表情对注意朝向的影响

摘 要 本文以三种表情面孔为材料,运用事件相关电位（ERP）方法探讨表情线索在注意朝向中与注视转移发生的交互及两者如何共同影响观察者的反应。结果发现：（1）线索效应在三种表情面孔的两种SOA中都出现了;（2）SOA较长时,注视线索效应量间的显著差异出现在中性和恐惧面孔、高兴和恐惧面孔间;（3）面部表情的效应出现在了表情线索诱发的P1成分上;（4）目标诱发的P1和N1说明了注视线索效应的存在及与表情间的交互。结论：表情线索先对观察者的朝向反应产生影响,随后是注视线索及其与表情线索发生的交互。     

Gaze cueing elicited by emotional faces is influenced by affective context

When we observe someone shift their gaze to a peripheral event or object, a corresponding shift in our own attention often follows. This social orienting response, joint attention, has been studied in the laboratory using the gaze cueing paradigm. Here, we investigate the combined influence of the emotional content displayed in two critical components of a joint attention episode: The facial expression of the cue face, and the affective nature of the to-be-localized target object. Hence, we presented participants with happy and disgusted faces as cueing stimuli, and neutral (Experiment 1), pleasant and unpleasant (Experiment 2) pictures as target stimuli. The findings demonstrate an effect of ‘emotional context’ confined to participants viewing pleasant pictures. Specifically, gaze cueing was boosted when the emotion of the gazing face (i.e., happy) matched that of the targets (pleasant). Demonstrating modulation by emotional context highlights the vital flexibility that a successful joint attention system requires in order to assist our navigation of the social world.     

Does facial expression affect attention orienting by gaze direction cues?

In 6 experiments, the authors investigated whether attention orienting by gaze direction is modulated by the emotional expression (neutral, happy, angry, or fearful) on the face. The results showed a clear spatial cuing effect by gaze direction but no effect by facial expression. In addition, it was shown that the cuing effect was stronger with schematic faces than with real faces, that gaze cuing could be achieved at very short stimulus onset asynchronies (14 ms), and that there was no evidence for a difference in the strength of cuing triggered by static gaze cues and by cues involving apparent motion of the pupils. In sum, the results suggest that in normal, healthy adults, eye direction processing for attention shifts is independent of facial expression analysis.     

Gaze direction and facial expressions exert combined but different effects on attentional resources

Gaze direction and facial expressions are critical components of face processing and have been shown to influence attention deployment. We investigated whether gaze direction (direct vs. averted) combined with a neutral or angry expression modulates the deployment of attentional resources over time. In a Rapid Serial Visual Presentation (RSVP) paradigm participants had to decide the gender of a neutral or an angry target face with direct or averted gaze (T1) and then to judge the orientation of a target picture of a landscape (T2), following the face at different time intervals. Results showed no attentional blink effect (i.e., no deterioration in T2 accuracy) when T1 was an angry face with direct gaze, whereas it was present for angry faces with averted gaze or neutral faces with either averted or direct gaze. These findings are consistent with appraisal theories and are discussed against the background of automatic processing of threat stimuli.     

Gaze direction and facial expressions exert combined but different effects on attentional resources

Gaze direction and facial expressions are critical components of face processing and have been shown to influence attention deployment. We investigated whether gaze direction (direct vs. averted) combined with a neutral or angry expression modulates the deployment of attentional resources over time. In a Rapid Serial Visual Presentation (RSVP) paradigm participants had to decide the gender of a neutral or an angry target face with direct or averted gaze (T1) and then to judge the orientation of a target picture of a landscape (T2), following the face at different time intervals. Results showed no attentional blink effect (i.e., no deterioration in T2 accuracy) when T1 was an angry face with direct gaze, whereas it was present for angry faces with averted gaze or neutral faces with either averted or direct gaze. These findings are consistent with appraisal theories and are discussed against the background of automatic processing of threat stimuli.     

More than mere mimicry? The influence of emotion on rapid facial reactions to faces

Within a second of seeing an emotional facial expression, people typically match that expression. These rapid facial reactions (RFRs), often termed mimicry, are implicated in emotional contagion, social perception, and embodied affect, yet ambiguity remains regarding the mechanism(s) involved. Two studies evaluated whether RFRs to faces are solely nonaffective motor responses or whether emotional processes are involved. Brow (corrugator, related to anger) and forehead (frontalis, related to fear) activity were recorded using facial electromyography (EMG) while undergraduates in two conditions (fear induction vs. neutral) viewed fear, anger, and neutral facial expressions. As predicted, fear induction increased fear expressions to angry faces within 1000 ms of exposure, demonstrating an emotional component of RFRs. This did not merely reflect increased fear from the induction, because responses to neutral faces were unaffected. Considering RFRs to be merely nonaffective automatic reactions is inaccurate. RFRs are not purely motor mimicry; emotion influences early facial responses to faces. The relevance of these data to emotional contagion, autism, and the mirror system-based perspectives on imitation is discussed.     

Visual search of emotional faces: The role of affective content and featural distinctiveness

We investigated the source of the visual search advantage of some emotional facial expressions. An emotional face target (happy, surprised, disgusted, fearful, angry, or sad) was presented in an array of neutral faces. A faster detection was found for happy targets, with angry and, especially, sad targets being detected more poorly. Physical image properties (e.g., luminance) were ruled out as a potential source of these differences in visual search. In contrast, the search advantage is partly due to the facilitated processing of affective content, as shown by an emotion identification task. Happy expressions were identified faster than the other expressions and were less likely to be confounded with neutral faces, whereas misjudgements occurred more often for angry and sad expressions. Nevertheless, the distinctiveness of some local features (e.g., teeth) that are consistently associated with emotional expressions plays the strongest role in the search advantage pattern. When the contribution of these features to visual search was factored out statistically, the advantage disappeared.     

The combined effect of gaze direction and facial expression on cueing spatial attention

Empirical evidence shows an effect of gaze direction on cueing spatial attention, regardless of the emotional expression shown by a face, whereas a combined effect of gaze direction and facial expression has been observed on individuals' evaluative judgments. In 2 experiments, the authors investigated whether gaze direction and facial expression affect spatial attention depending upon the presence of an evaluative goal. Disgusted, fearful, happy, or neutral faces gazing left or right were followed by positive or negative target words presented either at the spatial location looked at by the face or at the opposite spatial location. Participants responded to target words based on affective valence (i.e., positive/negative) in Experiment 1 and on letter case (lowercase/uppercase) in Experiment 2. Results showed that participants responded much faster to targets presented at the spatial location looked at by disgusted or fearful faces but only in Experiment 1, when an evaluative task was used. The present findings clearly show that negative facial expressions enhance the attentional shifts due to eye-gaze direction, provided that there was an explicit evaluative goal present.     

An electromyographic investigation of the impact of task relevance on facial mimicry

When viewing a face expressing emotion, the viewer's face mimics the same emotion. It is unknown whether such facial mimicry takes place when the viewed emotion is a task irrelevant property of the face. The present experiment addressed this question by asking participants to judge either the emotional expression or the colour of a series of happy and angry faces that were either blue or yellow. Electromyographical recordings showed that when emotion was ignored, there was a tendency for facial muscle activity to be suppressed. Nonetheless, participants’ facial expressions mimicked target expressions, with the zygomaticus cheek muscle being more active when viewing a smiling face and the corrugator brow muscle more active when viewing an angry face. These data support the automatic encoding of irrelevant emotional information, as well as suppression of emotional information by selective attention.