Emotionally meaningful targets enhance orienting triggered by a fearful gazing face

Studies investigating the effect of emotional expression on spatial orienting to a gazed-at location have produced mixed results. The present study investigated the role of affective context in the integration of emotion processing and gaze-triggered orienting. In three experiments, a face gazed non-predictively to the left or right, and then its expression became fearful or happy. Participants identified (Experiments 1 and 2) or detected (Experiment 3) a peripheral target presented 225 or 525 ms after the gaze cue onset. In Experiments 1 and 3 the targets were either threatening (a snarling dog) or non-threatening (a smiling baby); in Experiment 2 the targets were neutral. With emotionally valenced targets, the gaze-cuing effect was larger when the face was fearful compared to happy—but only with the longer cue–target interval. With neutral targets, there was no interaction between gaze and expression. Our results indicate that a meaningful context optimises attentional integration of gaze and expression information.     

The combined effect of gaze direction and facial expression on cueing spatial attention

Empirical evidence shows an effect of gaze direction on cueing spatial attention, regardless of the emotional expression shown by a face, whereas a combined effect of gaze direction and facial expression has been observed on individuals' evaluative judgments. In 2 experiments, the authors investigated whether gaze direction and facial expression affect spatial attention depending upon the presence of an evaluative goal. Disgusted, fearful, happy, or neutral faces gazing left or right were followed by positive or negative target words presented either at the spatial location looked at by the face or at the opposite spatial location. Participants responded to target words based on affective valence (i.e., positive/negative) in Experiment 1 and on letter case (lowercase/uppercase) in Experiment 2. Results showed that participants responded much faster to targets presented at the spatial location looked at by disgusted or fearful faces but only in Experiment 1, when an evaluative task was used. The present findings clearly show that negative facial expressions enhance the attentional shifts due to eye-gaze direction, provided that there was an explicit evaluative goal present.     

注视方向和面部表情对注意朝向的影响

摘 要 本文以三种表情面孔为材料,运用事件相关电位（ERP）方法探讨表情线索在注意朝向中与注视转移发生的交互及两者如何共同影响观察者的反应。结果发现：（1）线索效应在三种表情面孔的两种SOA中都出现了;（2）SOA较长时,注视线索效应量间的显著差异出现在中性和恐惧面孔、高兴和恐惧面孔间;（3）面部表情的效应出现在了表情线索诱发的P1成分上;（4）目标诱发的P1和N1说明了注视线索效应的存在及与表情间的交互。结论：表情线索先对观察者的朝向反应产生影响,随后是注视线索及其与表情线索发生的交互。     

Gaze cueing elicited by emotional faces is influenced by affective context

When we observe someone shift their gaze to a peripheral event or object, a corresponding shift in our own attention often follows. This social orienting response, joint attention, has been studied in the laboratory using the gaze cueing paradigm. Here, we investigate the combined influence of the emotional content displayed in two critical components of a joint attention episode: The facial expression of the cue face, and the affective nature of the to-be-localized target object. Hence, we presented participants with happy and disgusted faces as cueing stimuli, and neutral (Experiment 1), pleasant and unpleasant (Experiment 2) pictures as target stimuli. The findings demonstrate an effect of ‘emotional context’ confined to participants viewing pleasant pictures. Specifically, gaze cueing was boosted when the emotion of the gazing face (i.e., happy) matched that of the targets (pleasant). Demonstrating modulation by emotional context highlights the vital flexibility that a successful joint attention system requires in order to assist our navigation of the social world.     

Anxiety and sensitivity to eye gaze in emotional faces

This paper reports three studies in which stronger orienting to perceived eye gaze direction was revealed when observers viewed faces showing fearful or angry, compared with happy or neutral, emotional expressions. Gaze-related spatial cueing effects to laterally presented fearful faces and centrally presented angry faces were also modulated by the anxiety level of participants, with high- but not low-state anxious individuals revealing enhanced shifts of attention. In contrast, both high- and low-state anxious individuals demonstrated enhanced orienting to averted gaze when viewing laterally presented angry faces. These results provide novel evidence for the rapid integration of facial expression and gaze direction information, and for the regulation of gaze-cued attention by both the emotion conveyed in the perceived face and the degree of anxiety experienced by the observer.     

Masked fearful faces modulate the orienting of covert spatial attention

Dot probe studies indicate that masked fearful faces modulate spatial attention. However, without a baseline to compare congruent and incongruent reaction times, it is unclear which aspect(s) of attention (orienting or disengagement) is affected. Additionally, backward masking studies commonly use a neutral face as the mask stimulus. This method results in greater perceptual inconsistencies for fearful as opposed to neutral faces. Therefore, it is currently unclear whether the effects of backward masked fearful faces are due to the fearful nature of the face or perceptual inconsistencies. Equally unclear, is whether this spatial attention effect is due to orienting or disengagement. Two modified dot probe experiments with neutral (closed mouth in Experiment 1) and smiling (open mouth in Experiment 2) masks were used to determine the role of perceptual inconsistencies in mediating the spatial attention effects elicited by masked fearful faces. The results indicate that masked fearful faces modulate the orienting of spatial attention, and it appears that this effect is due to the fearful nature of the face rather than perceptual inconsistencies between the initial faces and masks.     

The development of emotional face and eye gaze processing

Recent research has demonstrated that infants' attention towards novel objects is affected by an adult's emotional expression and eye gaze toward the object. The current event-related potential (ERP) study investigated how infants at 3, 6, and 9 months of age process fearful compared to neutral faces looking toward objects or averting gaze away from objects. Furthermore, we examined how the processing of novel objects is affected by gaze direction and emotional expression. We hypothesized that an adult's fearful expression should be particularly salient when it is directed toward a referent in the environment. Furthermore, responses to objects should be increased if the face previously expressed fear toward the object. Three-month-olds did not show differential neural responses to fearful vs. neutral faces regardless of gaze direction. Six-month-olds showed an enhanced negative central (Nc) component for fearful relative to neutral faces looking toward objects, but not when eye gaze was averted away from the objects. Furthermore, 6-month-olds showed an enhanced Nc for objects that had been gaze-cued by a fearful compared to a neutral face. Nine-month-olds showed an enhanced Nc for fearful relative to neutral faces in both eye gaze conditions and showed an enhanced Nc for objects that had been gaze-cued by a neutral face. The findings are discussed in the context of social cognitive and brain development.     

Emotional modulation of attention orienting by gaze varies with dynamic cue sequence

ABSTRACT

Recent gaze cueing studies using dynamic cue sequences have reported increased attention orienting by gaze with faces expressing fear, surprise or anger. Here, we investigated whether the type of dynamic cue sequence used impacted the magnitude of this effect. When the emotion was expressed before or concurrently with gaze shift, no modulation of gaze-oriented attention by emotion was seen. In contrast, when the face cue averted gaze before expressing an emotion (as if reacting to the object after first localizing it), the gaze orienting effect was clearly increased for fearful, surprised and angry faces compared to neutral faces. Thus, the type of dynamic sequence used, and in particular the order in which the gaze shift and the facial expression are presented, modulate gaze-oriented attention, with maximal modulation seen when the expression of emotion follows gaze shift.     

Modulation of reflexive orienting to gaze direction by facial expressions

Facial expression and gaze perception are thought to share brain mechanisms but behavioural interactions, especially from gaze-cueing paradigms, are inconsistent. We conducted a series of gaze-cueing studies using dynamic facial cues to examine orienting across different emotional expression and task conditions, including face inversion. Across experiments, at a short stimulus–onset asynchrony (SOA) we observed both an expression effect (i.e., faster responses when the face was emotional versus neutral) and a cue validity effect (i.e., faster responses when the target was gazed-at), but no interaction between validity and emotion. Results from face inversion suggest that the emotion effect may have been due to both facial expression and stimulus motion. At longer SOAs, validity and emotion interacted such that cueing by emotional faces, fearful faces in particular, was enhanced relative to neutral faces. These results converge with a growing body of evidence that suggests that gaze and expression are initially processed independently and interact at later stages to direct attentional orienting.     

Does facial expression affect attention orienting by gaze direction cues?

In 6 experiments, the authors investigated whether attention orienting by gaze direction is modulated by the emotional expression (neutral, happy, angry, or fearful) on the face. The results showed a clear spatial cuing effect by gaze direction but no effect by facial expression. In addition, it was shown that the cuing effect was stronger with schematic faces than with real faces, that gaze cuing could be achieved at very short stimulus onset asynchronies (14 ms), and that there was no evidence for a difference in the strength of cuing triggered by static gaze cues and by cues involving apparent motion of the pupils. In sum, the results suggest that in normal, healthy adults, eye direction processing for attention shifts is independent of facial expression analysis.     

Anxiety and sensitivity to gaze direction in emotionally expressive faces

This study investigated the role of neutral, happy, fearful, and angry facial expressions in enhancing orienting to the direction of eye gaze. Photographs of faces with either direct or averted gaze were presented. A target letter (T or L) appeared unpredictably to the left or the right of the face, either 300 ms or 700 ms after gaze direction changed. Response times were faster in congruent conditions (i.e., when the eyes gazed toward the target) relative to incongruent conditions (when the eyes gazed away from the target letter). Facial expression did influence reaction times, but these effects were qualified by individual differences in self-reported anxiety. High trait-anxious participants showed an enhanced orienting to the eye gaze of faces with fearful expressions relative to all other expressions. In contrast, when the eyes stared straight ahead, trait anxiety was associated with slower responding when the facial expressions depicted anger. Thus, in anxiety-prone people attention is more likely to be held by an expression of anger, whereas attention is guided more potently by fearful facial expressions.     

Spatial interference between gaze direction and gaze location: a study on the eye contact effect

Perceived gaze in faces is an important social cue that influences spatial orienting of attention. In three experiments, we examined whether the social relevance of gaze direction modulated spatial interference in response selection, using three different stimuli: faces, isolated eyes, and symbolic eyes (Experiments 1, 2, and 3, respectively). Each experiment employed a variant of the spatial Stroop paradigm in which face location and gaze direction were put into conflict. Results showed a reverse congruency effect between face location to the right or left of fixation and gaze direction only for stimuli with a social meaning to participants (Experiments 1 and 2). The opposite was observed for the nonsocial stimuli used in Experiment 3. Results are explained as facilitation in response to eye contact.     

Spatial interference between gaze direction and gaze location: A study on the eye contact effect

Perceived gaze in faces is an important social cue that influences spatial orienting of attention. In three experiments, we examined whether the social relevance of gaze direction modulated spatial interference in response selection, using three different stimuli: faces, isolated eyes, and symbolic eyes (Experiments 1, 2, and 3, respectively). Each experiment employed a variant of the spatial Stroop paradigm in which face location and gaze direction were put into conflict. Results showed a reverse congruency effect between face location to the right or left of fixation and gaze direction only for stimuli with a social meaning to participants (Experiments 1 and 2). The opposite was observed for the nonsocial stimuli used in Experiment 3. Results are explained as facilitation in response to eye contact.     

The face of fear: Effects of eye gaze and emotion on visual attention

We investigated whether a fearful expression enhances the effect of another's gaze in directing the attention of an observer. Participants viewed photographs of faces whose gaze was directed ahead, to the left or to the right. Target letters then appeared unpredictably to the left or right. As expected, targets in the location indicated by gaze were detected more rapidly. In nonanxious volunteers the effects of fearful gaze did not differ from neutral gaze, but fearful expression had a more powerful influence in a selected high anxious group. Attention is thus more likely to be guided by the direction of fearful than neutral gaze, but only in anxiety-prone individuals.     

The face of fear: Effects of eye gaze and emotion on visual attention

We investigated whether a fearful expression enhances the effect of another's gaze in directing the attention of an observer. Participants viewed photographs of faces whose gaze was directed ahead, to the left or to the right. Target letters then appeared unpredictably to the left or right. As expected, targets in the location indicated by gaze were detected more rapidly. In nonanxious volunteers the effects of fearful gaze did not differ from neutral gaze, but fearful expression had a more powerful influence in a selected high anxious group. Attention is thus more likely to be guided by the direction of fearful than neutral gaze, but only in anxiety-prone individuals.     

Both fearful and happy expressions interact with gaze direction by 200 ms SOA to speed attention orienting

Attention orienting towards a gazed-at location is fundamental to social attention. Whether gaze cues can interact with emotional expressions other than those signalling environmental threat to modulate this gaze cueing, and whether this integration changes over time, remains unclear. With four experiments we demonstrate that, when perceived motion inherent to dynamic displays is controlled for, gaze cueing is enhanced by both fearful and happy faces compared to neutral faces. This enhancement is seen with stimulus-onset asynchronies ranging from 200–700?ms. Thus, gaze cueing can be reliably modulated by positive expressions, albeit to a smaller degree than fearful ones, and this gaze–emotion integration impacts behaviour as early as 200?ms post-cue onset.     

The neural fate of individual item representations in visual working memory

Previous research has demonstrated an interaction between eye gaze and selected facial emotional expressions, whereby the perception of anger and happiness is impaired when the eyes are horizontally averted within a face, but the perception of fear and sadness is enhanced under the same conditions. The current study reexamined these claims over six experiments. In the first three experiments, the categorization of happy and sad expressions (Experiments 1 and 2) and angry and fearful expressions (Experiment 3) was impaired when eye gaze was averted, in comparison to direct gaze conditions. Experiment 4 replicated these findings in a rating task, which combined all four expressions within the same design. Experiments 5 and 6 then showed that previous findings, that the perception of selected expressions is enhanced under averted gaze, are stimulus and task-bound. The results are discussed in relation to research on facial expression processing and visual attention.     

Task-irrelevant direct gaze facilitates visual search for deviant facial expression

The detection of emotional expression is important particularly when the expression is directed towards the viewer. Therefore, we conjectured that the efficiency in visual search for deviant emotional expression is modulated by gaze direction, which is one of the primary clues for encoding the focus of social attention. To examine this hypothesis, two visual search tasks were conducted. In Emotional Face Search, the participants were required to detect an emotional expression amongst distractor faces with neutral expression; in Neutral Face Search they were required to detect a neutral target among emotional distractors. The results revealed that target detection was accelerated when the target face had direct gaze compared to averted gaze for fearful, angry, and neutral targets, but no effect of distractor gaze direction was observed. An additional experiment including multiple display sizes has shown a shallower search slope in search for a target face with direct gaze than that with averted gaze, indicating that the advantage of a target face with direct gaze is attributable to efficient orientation of attention towards target faces. These results indicate that direct gaze facilitates detection of target face in visual scenery even when gaze discrimination is not the primary task at hand.     

Beware the eyes behind the mask: The capture and hold of selective attention by backward masked fearful eyes

Fearful facial expressions are important social indicators of environmental threat. Among the various features of a fearful face, the eyes appear to be particularly important for recognizing and responding to these social cues. One way in which fearful faces facilitate observers’ behavior is by automatically capturing attention. This is true for both consciously and nonconsciously processed fearful faces. Recent research suggests that consciously processed fearful eyes alone are sufficient to capture observers’ attention. However, it is unknown as to whether or not nonconsciously processed, backward masked, fearful eyes are sufficient to facilitate spatial attention. To test this possibility, two dot-probe experiments with masked fearful eye stimuli were performed. In Experiment 1, we found that, relative to scrambled eyes, masked fearful eyes facilitate attentional orienting and delay attentional disengagement. In Experiment 2, we replicated this effect when comparing backward masked fearful to neutral eyes. Thus, the data suggest that nonconscious fearful eyes facilitate spatial attention through facilitated orienting and delayed disengagement.     

Gaze and arrow cueing of attention reveals individual differences along the autism spectrum as a function of target context

Observing averted gaze results in a reflexive shift of attention to the gazed‐at location. In two experiments, participants scoring high and low on the Autism‐Spectrum Quotient questionnaire (AQ; Baron‐Cohen, Wheelwright, Skinner, Martin, & Clubley, 2001 ) observed arrow and gaze cues to investigate cueing effect magnitude as a function of the context in which peripheral targets could appear. While identical cueing effects were found with gaze and arrow cues, the more striking results concerned target stimuli. In Experiment 1, targets could appear on a peripheral face, or on scrambled face parts. Overall, greater cueing effects were found when the target appeared on a face. However, this face bias was only observed in participants with low AQ scores, whereas high AQ scorers oriented more to scrambled features. Experiment 2 found equal cueing to targets appearing on tools, as compared with tool parts. However, individual differences were again observed, where low AQ scorers showed larger cueing towards tools, while high scorers oriented more to scrambled parts, as in Experiment 1. These results support the idea that low AQ individuals orient strongly to objects attended by others. However, since the same results were found for arrow cues, this effect may generalize to all central cues to attention. High AQ scorers possessing many more autistic‐like traits tended to orient more to scrambled shapes, perhaps reflecting a bias for orienting to local details.