The face of fear: Effects of eye gaze and emotion on visual attention

We investigated whether a fearful expression enhances the effect of another's gaze in directing the attention of an observer. Participants viewed photographs of faces whose gaze was directed ahead, to the left or to the right. Target letters then appeared unpredictably to the left or right. As expected, targets in the location indicated by gaze were detected more rapidly. In nonanxious volunteers the effects of fearful gaze did not differ from neutral gaze, but fearful expression had a more powerful influence in a selected high anxious group. Attention is thus more likely to be guided by the direction of fearful than neutral gaze, but only in anxiety-prone individuals.     

Anxiety and sensitivity to gaze direction in emotionally expressive faces

This study investigated the role of neutral, happy, fearful, and angry facial expressions in enhancing orienting to the direction of eye gaze. Photographs of faces with either direct or averted gaze were presented. A target letter (T or L) appeared unpredictably to the left or the right of the face, either 300 ms or 700 ms after gaze direction changed. Response times were faster in congruent conditions (i.e., when the eyes gazed toward the target) relative to incongruent conditions (when the eyes gazed away from the target letter). Facial expression did influence reaction times, but these effects were qualified by individual differences in self-reported anxiety. High trait-anxious participants showed an enhanced orienting to the eye gaze of faces with fearful expressions relative to all other expressions. In contrast, when the eyes stared straight ahead, trait anxiety was associated with slower responding when the facial expressions depicted anger. Thus, in anxiety-prone people attention is more likely to be held by an expression of anger, whereas attention is guided more potently by fearful facial expressions.     

Emotionally meaningful targets enhance orienting triggered by a fearful gazing face

Studies investigating the effect of emotional expression on spatial orienting to a gazed-at location have produced mixed results. The present study investigated the role of affective context in the integration of emotion processing and gaze-triggered orienting. In three experiments, a face gazed non-predictively to the left or right, and then its expression became fearful or happy. Participants identified (Experiments 1 and 2) or detected (Experiment 3) a peripheral target presented 225 or 525 ms after the gaze cue onset. In Experiments 1 and 3 the targets were either threatening (a snarling dog) or non-threatening (a smiling baby); in Experiment 2 the targets were neutral. With emotionally valenced targets, the gaze-cuing effect was larger when the face was fearful compared to happy—but only with the longer cue–target interval. With neutral targets, there was no interaction between gaze and expression. Our results indicate that a meaningful context optimises attentional integration of gaze and expression information.     

The combined effect of gaze direction and facial expression on cueing spatial attention

Empirical evidence shows an effect of gaze direction on cueing spatial attention, regardless of the emotional expression shown by a face, whereas a combined effect of gaze direction and facial expression has been observed on individuals' evaluative judgments. In 2 experiments, the authors investigated whether gaze direction and facial expression affect spatial attention depending upon the presence of an evaluative goal. Disgusted, fearful, happy, or neutral faces gazing left or right were followed by positive or negative target words presented either at the spatial location looked at by the face or at the opposite spatial location. Participants responded to target words based on affective valence (i.e., positive/negative) in Experiment 1 and on letter case (lowercase/uppercase) in Experiment 2. Results showed that participants responded much faster to targets presented at the spatial location looked at by disgusted or fearful faces but only in Experiment 1, when an evaluative task was used. The present findings clearly show that negative facial expressions enhance the attentional shifts due to eye-gaze direction, provided that there was an explicit evaluative goal present.     

Emotionally meaningful targets enhance orienting triggered by a fearful gazing face

Studies investigating the effect of emotional expression on spatial orienting to a gazed-at location have produced mixed results. The present study investigated the role of affective context in the integration of emotion processing and gaze-triggered orienting. In three experiments, a face gazed nonpredictively to the left or right, and then its expression became fearful or happy. Participants identified (Experiments 1 and 2) or detected (Experiment 3) a peripheral target presented 225 or 525 ms after the gaze cue onset. In Experiments 1 and 3 the targets were either threatening (a snarling dog) or nonthreatening (a smiling baby); in Experiment 2 the targets were neutral. With emotionally-valenced targets, the gaze-cuing effect was larger when the face was fearful compared to happy--but only with the longer cue-target interval. With neutral targets, there was no interaction between gaze and expression. Our results indicate that a meaningful context optimizes attentional integration of gaze and expression information.     

The development of emotional face and eye gaze processing

Recent research has demonstrated that infants' attention towards novel objects is affected by an adult's emotional expression and eye gaze toward the object. The current event-related potential (ERP) study investigated how infants at 3, 6, and 9 months of age process fearful compared to neutral faces looking toward objects or averting gaze away from objects. Furthermore, we examined how the processing of novel objects is affected by gaze direction and emotional expression. We hypothesized that an adult's fearful expression should be particularly salient when it is directed toward a referent in the environment. Furthermore, responses to objects should be increased if the face previously expressed fear toward the object. Three-month-olds did not show differential neural responses to fearful vs. neutral faces regardless of gaze direction. Six-month-olds showed an enhanced negative central (Nc) component for fearful relative to neutral faces looking toward objects, but not when eye gaze was averted away from the objects. Furthermore, 6-month-olds showed an enhanced Nc for objects that had been gaze-cued by a fearful compared to a neutral face. Nine-month-olds showed an enhanced Nc for fearful relative to neutral faces in both eye gaze conditions and showed an enhanced Nc for objects that had been gaze-cued by a neutral face. The findings are discussed in the context of social cognitive and brain development.     

注视方向和面部表情对注意朝向的影响

摘 要 本文以三种表情面孔为材料,运用事件相关电位（ERP）方法探讨表情线索在注意朝向中与注视转移发生的交互及两者如何共同影响观察者的反应。结果发现：（1）线索效应在三种表情面孔的两种SOA中都出现了;（2）SOA较长时,注视线索效应量间的显著差异出现在中性和恐惧面孔、高兴和恐惧面孔间;（3）面部表情的效应出现在了表情线索诱发的P1成分上;（4）目标诱发的P1和N1说明了注视线索效应的存在及与表情间的交互。结论：表情线索先对观察者的朝向反应产生影响,随后是注视线索及其与表情线索发生的交互。     

Emotional expression affects the accuracy of gaze perception

Emotional facial expressions are powerful social cues. Here we investigated how emotional expression affects the interpretation of eye gaze direction. Fifty-two observers judged where faces were looking by moving a slider on a measuring bar to the respective position. The faces displayed either an angry, happy, fearful or a neutral expression and were looking either straight at the observer, or were rotated 2°, 4°, 6° or 8° to the left and right. We found that happy faces were interpreted as directed closer to the observer, while fearful and angry faces were interpreted as directed further away. Judgments were most accurate for neutral faces, followed by happy, angry and fearful faces. These findings are discussed on the background of the “self-referential positivity bias”, suggesting that happy faces are preferably interpreted as directed towards the self while negative emotions are interpreted as directed further away.     

The effectiveness of a gaze cue depends on the facial expression of emotion: Evidence from simultaneous competing cues

The gaze of a fearful face should be a particularly effective cue to attention; it allows one to rapidly allocate attention to potential threats. Prior data from investigations of this issue have been mixed. We report a novel method in which the gazes of two faces simultaneously cued different directions. Across trials, the emotion expressed by each face varied between happy, neutral, and fearful. Results showed that attention followed a fearful gaze when it competed with a neutral gaze but did not consistently follow a happy gaze when it competed with a neutral gaze. These results suggest that fear moderates the effectiveness of gaze cuing, and we present a parsimonious account that reconciles previously inconsistent data. We also found that presenting a fearful and a happy face simultaneously eliminates this effect, suggesting that emotional expressions interact in ways that may be important for understanding how emotional stimuli influence attention in more complex environments.     

The Mediating Effects of Facial Expression on Spatial Interference Between Gaze Direction and Gaze Location

Gaze direction is an important social cue that interacts with facial expression. Cañadas and Lupiáñez (2012) reported a reverse-congruency effect such that identification of gaze direction was faster when a face was presented to the left but with the eyes directed to the right, or vice versa. In two experiments, this effect is replicated and then extended to explore the relationship between this effect and facial expression. Results show that the reverse-congruency effect is replicable with speeded gaze-direction identification, and that the effect is mediated by facial expression. The reverse-congruency effect is similar for happy and angry faces, but was not found for fearful faces. Findings are discussed in relation to the similarity of processing of incongruent gaze direction and the processing of direct gaze.     

Amygdala activation during masked presentation of emotional faces predicts conscious detection of threat-related faces

It has been argued that critical functions of the human amygdala are to modulate the moment-to-moment vigilance level and to enhance the processing and the consolidation of memories of emotionally arousing material. In this functional magnetic resonance study, pictures of human faces bearing fearful, angry, and happy expressions were presented to nine healthy volunteers using a backward masking procedure based on neutral facial expression. Activation of the left and right amygdala in response to the masked fearful faces (compared to neutral faces) was significantly correlated with the number of fearful faces detected. In addition, right but not left amygdala activation in response to the masked angry faces was significantly related to the number of angry faces detected. The present findings underscore the role of the amygdala in the detection and consolidation of memory for marginally perceptible threatening facial expression.     

Anxiety meets fear in perception of dynamic expressive gaze

This study investigated in 2 experiments whether reflexive cuing of attention that occurs after perception of a gaze cue is greater for fearful than for happy faces in normal participants, as hypothesized from a social neuroscience perspective. To increase neuroecological validity, dynamic stimulus presentation was used to display faces that simultaneously morphed from a neutral expression into a happy or fearful one and shifted eye gaze from the center to the periphery. Shifts of attention resulting from a natural fearful gaze were expected to be related to participants' anxiety traits, in agreement with the often found increased selective attention to threat in anxious participants. Both hypotheses were confirmed: Fearful faces induced stronger gaze cuing than happy faces, and the strength of this cuing effect was correlated to participants' anxiety levels. These results suggest a neural network, which integrates the processing of gaze, expression, and emotional states to adaptively prime vigilance under threatening circumstances.     

Detection of emotional faces is modulated by the direction of eye gaze

Emotionally expressive faces have shown enhanced detectability over neutral faces, but little is known about the effect of eye gaze on detecting the presence of emotional faces. Emotional expressions and gaze direction are both cues to the intentions of another person, and gaze direction has been shown to affect recognition accuracy and perceived intensity of emotional faces. The current study showed that fearful faces were detected more frequently with an averted gaze than with a direct gaze in an attentional blink task, whereas angry and happy faces were detected more frequently with a direct gaze than with an averted gaze. The results are in line with the shared signal hypothesis and appraisal theory and suggest that selection for awareness was based on a rapid evaluation of the intentions of another person as conveyed by their facial expression and gaze direction.     

The world smiles at me: self-referential positivity bias when interpreting direction of attention

Recent research suggests that eye-gaze direction modulates perceived emotional expression. Here we explore the extent to which emotion affects interpretation of attention direction. We captured three-dimensional face models of 8 actors expressing happy, fearful, angry and neutral emotions. From these 3D models 9 views were extracted (0°, 2°, 4°, 6°, 8° to the left and right). These stimuli were randomly presented for 150 ms. Using a forced-choice paradigm 28 participants judged for each face whether or not it was attending to them. Two conditions were tested: either the whole face was visible, or the eyes were covered. In both conditions happy faces elicited most "attending-to-me" answers. Thus, emotional expression has a more general effect than an influence on gaze direction: emotion affects interpretation of attention direction. We interpret these results as a self-referential positivity bias, suggesting a general preference to associate a happy face with the self.     

Anxiety and sensitivity to eye gaze in emotional faces

This paper reports three studies in which stronger orienting to perceived eye gaze direction was revealed when observers viewed faces showing fearful or angry, compared with happy or neutral, emotional expressions. Gaze-related spatial cueing effects to laterally presented fearful faces and centrally presented angry faces were also modulated by the anxiety level of participants, with high- but not low-state anxious individuals revealing enhanced shifts of attention. In contrast, both high- and low-state anxious individuals demonstrated enhanced orienting to averted gaze when viewing laterally presented angry faces. These results provide novel evidence for the rapid integration of facial expression and gaze direction information, and for the regulation of gaze-cued attention by both the emotion conveyed in the perceived face and the degree of anxiety experienced by the observer.     

Does facial expression affect attention orienting by gaze direction cues?

In 6 experiments, the authors investigated whether attention orienting by gaze direction is modulated by the emotional expression (neutral, happy, angry, or fearful) on the face. The results showed a clear spatial cuing effect by gaze direction but no effect by facial expression. In addition, it was shown that the cuing effect was stronger with schematic faces than with real faces, that gaze cuing could be achieved at very short stimulus onset asynchronies (14 ms), and that there was no evidence for a difference in the strength of cuing triggered by static gaze cues and by cues involving apparent motion of the pupils. In sum, the results suggest that in normal, healthy adults, eye direction processing for attention shifts is independent of facial expression analysis.     

Emotional expression modulates perceived gaze direction

Gaze perception is an important social skill, as it portrays information about what another person is attending to. Gaze direction has been shown to affect interpretation of emotional expression. Here the authors investigate whether the emotional facial expression has a reciprocal influence on interpretation of gaze direction. In a forced-choice yes-no task, participants were asked to judge whether three faces expressing different emotions (anger, fear, happiness, and neutral) in different viewing angles were looking at them or not. Happy faces were more likely to be judged as looking at the observer than were angry, fearful, or neutral faces. Angry faces were more often judged as looking at the observer than were fearful and neutral expressions. These findings are discussed on the background of approach and avoidance orientation of emotions and of the self-referential positivity bias.     

The world smiles at me: Self-referential positivity bias when interpreting direction of attention

Recent research suggests that eye-gaze direction modulates perceived emotional expression. Here we explore the extent to which emotion affects interpretation of attention direction. We captured three-dimensional face models of 8 actors expressing happy, fearful, angry and neutral emotions. From these 3D models 9 views were extracted (0°, 2°, 4°, 6°, 8° to the left and right). These stimuli were randomly presented for 150 ms. Using a forced-choice paradigm 28 participants judged for each face whether or not it was attending to them. Two conditions were tested: either the whole face was visible, or the eyes were covered. In both conditions happy faces elicited most “attending-to-me” answers. Thus, emotional expression has a more general effect than an influence on gaze direction: emotion affects interpretation of attention direction. We interpret these results as a self-referential positivity bias, suggesting a general preference to associate a happy face with the self.     

Visual representation of eye gaze is coded by a nonopponent multichannel system

To date, there is no functional account of the visual perception of gaze in humans. Previous work has demonstrated that left gaze and right gaze are represented by separate mechanisms. However, these data are consistent with either a multichannel system comprising separate channels for distinct gaze directions (e.g., left, direct, and right) or an opponent-coding system in which all gaze directions are coded by just 2 pools of cells, one coding left gaze and the other right, with direct gaze represented as a neutral point reflecting equal activation of both left and right pools. In 2 experiments, the authors used adaptation procedures to investigate which of these models provides the optimal account. Both experiments supported multichannel coding. Previous research has shown that facial identity is coded by an opponent-coding system; hence, these results also demonstrate that gaze is coded by a different representational system to facial identity.     

Increased gaze following for fearful faces. It depends on what you’re looking for!

An oculomotor visual search task was used to investigate how participants follow the gaze of a non-predictive and task irrelevant distractor gaze, and the way in which this gaze following is influenced by the emotional expression (fearful vs. happy) as well as participants' goal. Previous research has suggested that fearful emotions should result in stronger cueing effects than happy faces. Our results demonstrated that the degree to which the emotional expression influenced this gaze following varied as a function of the search target. When searching for a threatening target, participants were more likely to look in the direction of eye gaze on a fearful compared to a happy face. However, when searching for a pleasant target, this stronger cueing effect for fearful faces disappeared. Therefore, gaze following is influenced by contextual factors such as the emotional expression, as well as the participant's goal.