Increased gaze following for fearful faces. It depends on what you’re looking for!

An oculomotor visual search task was used to investigate how participants follow the gaze of a non-predictive and task irrelevant distractor gaze, and the way in which this gaze following is influenced by the emotional expression (fearful vs. happy) as well as participants' goal. Previous research has suggested that fearful emotions should result in stronger cueing effects than happy faces. Our results demonstrated that the degree to which the emotional expression influenced this gaze following varied as a function of the search target. When searching for a threatening target, participants were more likely to look in the direction of eye gaze on a fearful compared to a happy face. However, when searching for a pleasant target, this stronger cueing effect for fearful faces disappeared. Therefore, gaze following is influenced by contextual factors such as the emotional expression, as well as the participant's goal.     

Gaze and arrow cueing of attention reveals individual differences along the autism spectrum as a function of target context

Observing averted gaze results in a reflexive shift of attention to the gazed‐at location. In two experiments, participants scoring high and low on the Autism‐Spectrum Quotient questionnaire (AQ; Baron‐Cohen, Wheelwright, Skinner, Martin, & Clubley, 2001 ) observed arrow and gaze cues to investigate cueing effect magnitude as a function of the context in which peripheral targets could appear. While identical cueing effects were found with gaze and arrow cues, the more striking results concerned target stimuli. In Experiment 1, targets could appear on a peripheral face, or on scrambled face parts. Overall, greater cueing effects were found when the target appeared on a face. However, this face bias was only observed in participants with low AQ scores, whereas high AQ scorers oriented more to scrambled features. Experiment 2 found equal cueing to targets appearing on tools, as compared with tool parts. However, individual differences were again observed, where low AQ scorers showed larger cueing towards tools, while high scorers oriented more to scrambled parts, as in Experiment 1. These results support the idea that low AQ individuals orient strongly to objects attended by others. However, since the same results were found for arrow cues, this effect may generalize to all central cues to attention. High AQ scorers possessing many more autistic‐like traits tended to orient more to scrambled shapes, perhaps reflecting a bias for orienting to local details.     

Attentional shift by eye gaze requires joint attention: Eye gaze cues are unique to shift attention1

Researchers have demonstrated that attentional shift triggered by gaze direction is reflexive. However, here we show that attentional shift by gaze direction was not always reflexive, but could be modulated by another's perspective. In Experiment 1, a schematic face's line of sight to a peripheral target was obstructed by a vertical barrier located between the face and the target under two conditions. However, the line of sight of the face was clear under another two conditions, in which the barrier was located behind the line of sight by utilizing a depth cue. The gaze cue shifted attention only when the line of sight was not blocked (i.e. joint attention was attained). The arrow cue did not shift attention regardless of the obstruction conditions in Experiment 2. These results suggest that attentional shift by gaze cues, but not arrow cues, involve a higher social cognitive process such as interpretation of the gaze.     

The combined effect of gaze direction and facial expression on cueing spatial attention

Empirical evidence shows an effect of gaze direction on cueing spatial attention, regardless of the emotional expression shown by a face, whereas a combined effect of gaze direction and facial expression has been observed on individuals' evaluative judgments. In 2 experiments, the authors investigated whether gaze direction and facial expression affect spatial attention depending upon the presence of an evaluative goal. Disgusted, fearful, happy, or neutral faces gazing left or right were followed by positive or negative target words presented either at the spatial location looked at by the face or at the opposite spatial location. Participants responded to target words based on affective valence (i.e., positive/negative) in Experiment 1 and on letter case (lowercase/uppercase) in Experiment 2. Results showed that participants responded much faster to targets presented at the spatial location looked at by disgusted or fearful faces but only in Experiment 1, when an evaluative task was used. The present findings clearly show that negative facial expressions enhance the attentional shifts due to eye-gaze direction, provided that there was an explicit evaluative goal present.     

Emotionally meaningful targets enhance orienting triggered by a fearful gazing face

Studies investigating the effect of emotional expression on spatial orienting to a gazed-at location have produced mixed results. The present study investigated the role of affective context in the integration of emotion processing and gaze-triggered orienting. In three experiments, a face gazed non-predictively to the left or right, and then its expression became fearful or happy. Participants identified (Experiments 1 and 2) or detected (Experiment 3) a peripheral target presented 225 or 525 ms after the gaze cue onset. In Experiments 1 and 3 the targets were either threatening (a snarling dog) or non-threatening (a smiling baby); in Experiment 2 the targets were neutral. With emotionally valenced targets, the gaze-cuing effect was larger when the face was fearful compared to happy—but only with the longer cue–target interval. With neutral targets, there was no interaction between gaze and expression. Our results indicate that a meaningful context optimises attentional integration of gaze and expression information.     

视觉搜索中的情绪干扰项预习效应

干扰项预习效应是视觉搜索的试次间效应, 反映了过去不成功的搜索经验对注意的抑制。本研究中, 被试对情绪材料进行视觉搜索时, 同一个画面中的刺激的情绪效价可能一致, 也可能存在一个效价与众不同的靶子。实验任务是要求被试找到该靶子, 并对它的非情绪特征进行辨别反应。本研究包括3个实验, 分别采用情绪面孔的照片、情绪性动物图片、情绪性动物示意图, 均发现了情绪干扰项预习效应。也就是说, 当先呈现无靶子的试次再呈现有靶子的试次, 且有靶子的试次中干扰项的效价与之前无靶子试次中的刺激的效价一致时, 被试的反应要比靶子的效价与之前无靶子试次中刺激效价一致时更快。这些结果表明, 选择性注意系统可以利用以往的情绪信息引导注意的分配, 使当前注意偏离那些曾经搜索过但没有找到靶子的情绪特征, 而且这些情绪信息可能是由人脸表达的, 也可能是由于人以外的因素表达的。这些结果体现了情绪与认知的交互作用, 尤其是个体对情绪的已有经验对视觉选择注意的引导作用。     

Attentional Bias for Threat: Evidence for Delayed Disengagement from Emotional Faces

The present paper reports three new experiments suggesting that the valence of a face cue can influence attentional effects in a cueing paradigm. Moreover, heightened trait anxiety resulted in increased attentional dwell-time on emotional facial stimuli, relative to neutral faces. Experiment 1 presented a cueing task, in which the cue was either an "angry", "happy", or "neutral" facial expression. Targets could appear either in the same location as the face (valid trials) or in a different location to the face (invalid trials). Participants did not show significant variations across the different cue types (angry, happy, neutral) in responding to a target on valid trials. However, the valence of the face did affect response times on invalid trials. Specifically, participants took longer to respond to a target when the face cue was "angry" or "happy" relative to neutral. In Experiment 2, the cue-target stimulus onset asynchrony (SOA) was increased and an overall inhibition of return (IOR) effect was found (i.e., slower responses on valid trials). However, the "angry" face cue eliminated the IOR effect for both high and low trait anxious groups. In Experiment 3, threat-related and jumbled facial stimuli reduced the magnitude of IOR for high, but not for low, trait-anxious participants.These results suggest that: (i) attentional bias in anxiety may reflect a difficulty in disengaging from threat-related and emotional stimuli, and (ii) threat-related and ambiguous cues can influence the magnitude of the IOR effect.     

A direct link between gaze perception and social attention

How information is exchanged between the cognitive mechanisms responsible for gaze perception and social attention is unclear. These systems could be independent; the "gaze cueing" effect could emerge from the activation of a general-purpose attentional mechanism that is ignorant of the social nature of the gaze cue. Alternatively, orienting to social gaze direction might be directly determined by the operation of cognitive mechanisms specifically dedicated to gaze perception. This second notion is the dominant assumption in the literature, but there is little direct support for this account. Here, we systematically manipulated observers' perception of gaze direction by implementing a gaze adaptation paradigm. Gaze cueing was reduced only in conditions where perception of specific averted gaze stimuli was impaired (Experiment 1). Adaptation to a pointing stimulus failed to impact gaze cueing (Experiment 2). Overall, these data suggest a direct link between the specific operation of gaze perception mechanisms and the consequential orienting of attention.     

Facial expressions modulate the gaze orienting effect on sound localization judgement

Recent studies have shown that cueing eye gaze can affect the processing of visual information, and this phenomenon is called the gaze-orienting effect (visual-GOE). Emerging evidence has shown that the cueing eye gaze also affects the processing of auditory information (auditory-GOE). However, it is unclear whether the auditory-GOE is modulated by emotion. We conducted three behavioural experiments to investigate whether cueing eye gaze influenced the orientation judgement to a sound, and whether the effect was modulated by facial expressions. The current study set four facial expressions (angry, fearful, happy, and neutral), manipulated the display type of facial expressions, and changed the sequence of gaze and emotional expressions. Participants were required to judge the sound orientation after facial expressions and gaze cues. The results showed that the orientation judgement of sound was influenced by gaze direction in all three experiments, and the orientation judgement of sound was faster when the face was oriented to the target location (congruent trials) than when the face was oriented away from the target location (incongruent trials). The modulation of emotion on auditory-GOE was observed only when gaze shifted followed by facial expression (Exp3); the auditory-GOE was significantly greater for angry faces than for neutral faces. These findings indicate that auditory-GOE as a social phenomenon exists widely, and the effect was modulated by facial expression. Gaze shift before the presentation of emotion was the key influencing factor for the emotional modulation in an auditory target gaze-orienting task. Our findings suggest that the integration of facial expressions and eye gaze was context-dependent.     

Fearful faces drive gaze‐cueing and threat bias effects in children on the lookout for danger

Most developmental studies of face emotion processing show faces in isolation, in the absence of any broader context. Here we investigate two types of interactions between expression and threat contexts. First, in adults, following of another person's direction of social attention is increased when that person shows fear and the context requires vigilance for danger. We investigate whether this also occurs in children. Using a Posner‐style eye‐gaze cueing paradigm, we tested whether children would show greater gaze‐cueing from fearful than happy expressions when the task was to be vigilant for possible dangerous animals. Testing across the 8–12‐year‐old age range, we found this fear priority effect was absent in the youngest children but developed to reach adult levels in the oldest children. However, even the oldest children were unable to sustain fear‐prioritization when the onset of the target was delayed. Second, we addressed the development of ‘threat bias’ – namely faster identification of dangerous animals than safe animals – in the social context provided by expressive faces. In our non‐anxious samples (i.e. with typical‐population levels of anxiety), adults showed a threat bias regardless of the expression or looking direction of the just‐seen cue face whereas 8–12‐year‐olds only showed a threat bias when the just‐seen cue face displayed fear. Overall, the results argue that some, but not all, aspects of expression–context interactions are mature by 12 years of age.     

The effectiveness of a gaze cue depends on the facial expression of emotion: Evidence from simultaneous competing cues

The gaze of a fearful face should be a particularly effective cue to attention; it allows one to rapidly allocate attention to potential threats. Prior data from investigations of this issue have been mixed. We report a novel method in which the gazes of two faces simultaneously cued different directions. Across trials, the emotion expressed by each face varied between happy, neutral, and fearful. Results showed that attention followed a fearful gaze when it competed with a neutral gaze but did not consistently follow a happy gaze when it competed with a neutral gaze. These results suggest that fear moderates the effectiveness of gaze cuing, and we present a parsimonious account that reconciles previously inconsistent data. We also found that presenting a fearful and a happy face simultaneously eliminates this effect, suggesting that emotional expressions interact in ways that may be important for understanding how emotional stimuli influence attention in more complex environments.     

Interactions between cognition and emotion during response inhibition

Cognition and emotion interact to determine ongoing behaviors. In this study, we investigated the interaction between cognition and emotion during response inhibition using the stop-signal task. In Experiment 1, low-threat stop-signals comprising fearful and happy face pictures were employed. We found that both fearful and happy faces improved response inhibition relative to neutral ones. In Experiment 2, we employed high-threat emotional stimuli as stop signals, namely stimuli previously paired with mild shock. In this case, inhibitory performance was impaired relative to a neutral condition. We interpret these findings in terms of the impact of emotional stimuli on early sensory/attentional processing, which resulted in improved performance (Experiment 1), and in terms of their impact at more central stages, which impaired performance (Experiment 2). Taken together, our findings demonstrate that emotion can either enhance or impair cognitive performance depending on the emotional potency of the stimuli involved.     

Dynamic emotional messages differentially affect 6-month-old infants’ attention to eyes and gaze cues

Infants often experience interactions in which caregivers use dynamic messages to convey their affective and communicative intent. These dynamic emotional messages may shape the development of emotion discrimination skills and shared attention by influencing infants’ attention to internal facial features and their responses to eye gaze cues. However, past research examining infants’ responses to emotional faces has predominantly focused on classic, stereotyped expressions (e.g., happy, sad, angry) that may not reflect the variability that infants experience in their daily interactions. The present study therefore examined forty-two 6-month-old infants’ attention to eyes vs. mouth and gaze cueing responses across multiple dynamic emotional messages that are common to infant-directed interactions. Overall, infants looked more to the eyes during messages with negative affect, but this increased attention to the eyes during these message conditions did not directly facilitate gaze cueing. Infants instead showed reliable gaze cueing only after messages with positive and neutral affect. We additionally observed gender differences in infants’ attention to internal face features and subsequent gaze cueing responses. Female infants spent more time looking at the eyes during the dynamic emotional messages and showed increased initial orienting and longer looking to gaze-cued objects following positive messages, whereas male infants showed these gaze cueing effects following neutral messages. These results suggest that variability in caregivers' communication can shape infants’ attention to and processing of emotion and gaze information.     

Is chimpanzee (Pan troglodytes) spatial attention reflexively triggered by gaze cue?

Humans show a reflexive shift in spatial attention triggered by gaze cues. Chimpanzees (Pan troglodytes) have an excellent ability to follow another's gaze, but they exhibit a limited capacity to engage in triadic interactions based on joint attention, suggesting the possibility of contributions of the different mechanisms underlying joint attention between humans and chimpanzees. The present study thus examined how the chimpanzee's visual spatial attention is triggered by gaze cues. Two chimpanzees showed no clear signs of attention shift triggered by various kinds of nonfacial and facial stimuli with averted gaze under the letter-discrimination tasks but showed significant cueing effects when the head-turning cue was presented in a quasi-dynamic manner. These cueing effects were, however, affected by the predictability of the gaze cue: Highly predictive gaze cues caused stronger cueing effects than less predictive cues. Thus, these results suggest that the shift in spatial attention caused by gaze cues does occur in chimpanzees, but, in contrast to humans, vulnerability against the cue predictability suggests that the voluntary mechanism contributes more dominantly than the reflexive mechanism to this attention shift.     

Both fearful and happy expressions interact with gaze direction by 200 ms SOA to speed attention orienting

Attention orienting towards a gazed-at location is fundamental to social attention. Whether gaze cues can interact with emotional expressions other than those signalling environmental threat to modulate this gaze cueing, and whether this integration changes over time, remains unclear. With four experiments we demonstrate that, when perceived motion inherent to dynamic displays is controlled for, gaze cueing is enhanced by both fearful and happy faces compared to neutral faces. This enhancement is seen with stimulus-onset asynchronies ranging from 200–700?ms. Thus, gaze cueing can be reliably modulated by positive expressions, albeit to a smaller degree than fearful ones, and this gaze–emotion integration impacts behaviour as early as 200?ms post-cue onset.     

Eye movement assessment of selective attentional capture by emotional pictures

The eye-tracking method was used to assess attentional orienting to and engagement on emotional visual scenes. In Experiment 1, unpleasant, neutral, or pleasant target pictures were presented simultaneously with neutral control pictures in peripheral vision under instruction to compare pleasantness of the pictures. The probability of first fixating an emotional picture, and the frequency of subsequent fixations, were greater than those for neutral pictures. In Experiment 2, participants were instructed to avoid looking at the emotional pictures, but these were still more likely to be fixated first and gazed longer during the first-pass viewing than neutral pictures. Low-level visual features cannot explain the results. It is concluded that overt visual attention is captured by both unpleasant and pleasant emotional content.     

Gaze cuing and affective judgments of objects: I like what you look at

When we see another person look somewhere, we automatically attend to the same location in space. Thisjoint attention emerges early in life and has a great impact on social interactions in development and in everyday adult life. The direction of another’s gaze indicates what object is of current interest, which may be the target for a subsequent action. In this study, we found that objects that are looked at by other people are liked more than objects that do not receive the attention of other people (Experiment 1). This suggests that observing averted gaze can have an impact on the affective appraisals of objects in the environment. This liking effect was absent when an arrow was used to cue attention (Experiment 2). This underlines the importance of other people’s interactions with objects for generating our own impressions of such stimuli in the world.     

Gaze Perception Triggers Reflexive Visuospatial Orienting

This paper seeks to bring together two previously separate research traditions: research on spatial orienting within the visual cueing paradigm and research into social cognition, addressing our tendency to attend in the direction that another person looks. Cueing methodologies from mainstream attention research were adapted to test the automaticity of orienting in the direction of seen gaze. Three studies manipulated the direction of gaze in a computerized face, which appeared centrally in a frontal view during a peripheral letter-discrimination task. Experiments 1 and 2 found faster discrimination of peripheral target letters on the side the computerized face gazed towards, even though the seen gaze did not predict target side, and despite participants being asked to ignore the face. This suggests reflexive covert and/or overt orienting in the direction of seen gaze, arising even when the observer has no motivation to orient in this way. Experiment 3 found faster letter discrimination on the side the computerized face gazed towards even when participants knew that target letters were four times as likely on the opposite side. This suggests that orienting can arise in the direction of seen gaze even when counter to intentions. The experiments illustrate that methods from mainstream attention research can be usefully applied to social cognition, and that studies of spatial attention may profit from considering its social function.     

Emotional modulation of attention orienting by gaze varies with dynamic cue sequence

ABSTRACT

Recent gaze cueing studies using dynamic cue sequences have reported increased attention orienting by gaze with faces expressing fear, surprise or anger. Here, we investigated whether the type of dynamic cue sequence used impacted the magnitude of this effect. When the emotion was expressed before or concurrently with gaze shift, no modulation of gaze-oriented attention by emotion was seen. In contrast, when the face cue averted gaze before expressing an emotion (as if reacting to the object after first localizing it), the gaze orienting effect was clearly increased for fearful, surprised and angry faces compared to neutral faces. Thus, the type of dynamic sequence used, and in particular the order in which the gaze shift and the facial expression are presented, modulate gaze-oriented attention, with maximal modulation seen when the expression of emotion follows gaze shift.     

Emotionally meaningful targets enhance orienting triggered by a fearful gazing face

Studies investigating the effect of emotional expression on spatial orienting to a gazed-at location have produced mixed results. The present study investigated the role of affective context in the integration of emotion processing and gaze-triggered orienting. In three experiments, a face gazed nonpredictively to the left or right, and then its expression became fearful or happy. Participants identified (Experiments 1 and 2) or detected (Experiment 3) a peripheral target presented 225 or 525 ms after the gaze cue onset. In Experiments 1 and 3 the targets were either threatening (a snarling dog) or nonthreatening (a smiling baby); in Experiment 2 the targets were neutral. With emotionally-valenced targets, the gaze-cuing effect was larger when the face was fearful compared to happy--but only with the longer cue-target interval. With neutral targets, there was no interaction between gaze and expression. Our results indicate that a meaningful context optimizes attentional integration of gaze and expression information.