Task-irrelevant direct gaze facilitates visual search for deviant facial expression

The detection of emotional expression is important particularly when the expression is directed towards the viewer. Therefore, we conjectured that the efficiency in visual search for deviant emotional expression is modulated by gaze direction, which is one of the primary clues for encoding the focus of social attention. To examine this hypothesis, two visual search tasks were conducted. In Emotional Face Search, the participants were required to detect an emotional expression amongst distractor faces with neutral expression; in Neutral Face Search they were required to detect a neutral target among emotional distractors. The results revealed that target detection was accelerated when the target face had direct gaze compared to averted gaze for fearful, angry, and neutral targets, but no effect of distractor gaze direction was observed. An additional experiment including multiple display sizes has shown a shallower search slope in search for a target face with direct gaze than that with averted gaze, indicating that the advantage of a target face with direct gaze is attributable to efficient orientation of attention towards target faces. These results indicate that direct gaze facilitates detection of target face in visual scenery even when gaze discrimination is not the primary task at hand.     

Look at them and they will notice you: Distractor-independent attentional capture by direct gaze in change blindness

Humans have shown a detection advantage of direct vs. averted gaze stimuli in visual search tasks. However, instead of attentional capture by direct gaze, the detection advantage in visual search may depend on attention-grabbing potential of the distractor stimuli to which the target needs to be compared. We investigated attentional capture by direct gaze using the change blindness paradigm, in which successful detection does not require comparison between the target and the distractor items. Participants detected a masked gaze direction change in one of four simultaneously presented schematic faces. The distractor gaze directions were systematically varied across three experiments. Changes resulting in direct gaze were detected more efficiently than those resulting in averted gaze, independently of distractor gaze directions. This finding suggests that the detection advantage is specifically due to attentional capture by direct gaze, not properties of distractor items.     

Gaze direction and facial expressions exert combined but different effects on attentional resources

Gaze direction and facial expressions are critical components of face processing and have been shown to influence attention deployment. We investigated whether gaze direction (direct vs. averted) combined with a neutral or angry expression modulates the deployment of attentional resources over time. In a Rapid Serial Visual Presentation (RSVP) paradigm participants had to decide the gender of a neutral or an angry target face with direct or averted gaze (T1) and then to judge the orientation of a target picture of a landscape (T2), following the face at different time intervals. Results showed no attentional blink effect (i.e., no deterioration in T2 accuracy) when T1 was an angry face with direct gaze, whereas it was present for angry faces with averted gaze or neutral faces with either averted or direct gaze. These findings are consistent with appraisal theories and are discussed against the background of automatic processing of threat stimuli.     

Gaze direction and facial expressions exert combined but different effects on attentional resources

Gaze direction and facial expressions are critical components of face processing and have been shown to influence attention deployment. We investigated whether gaze direction (direct vs. averted) combined with a neutral or angry expression modulates the deployment of attentional resources over time. In a Rapid Serial Visual Presentation (RSVP) paradigm participants had to decide the gender of a neutral or an angry target face with direct or averted gaze (T1) and then to judge the orientation of a target picture of a landscape (T2), following the face at different time intervals. Results showed no attentional blink effect (i.e., no deterioration in T2 accuracy) when T1 was an angry face with direct gaze, whereas it was present for angry faces with averted gaze or neutral faces with either averted or direct gaze. These findings are consistent with appraisal theories and are discussed against the background of automatic processing of threat stimuli.     

Effects of perceived mutual gaze and gender on face processing and recognition memory

Perceived gaze contact in seen faces may convey important social signals. We examined whether gaze perception affects face processing during two tasks: Online gender judgement, and later incidental recognition memory. Individual faces were presented with eyes directed either straight towards the viewer or away, while these faces were seen in either frontal or three-quarters view. Participants were slower to make gender judgements for faces with direct versus averted eye gaze, but this effect was particularly pronounced for faces with opposite gender to the observer, and seen in three-quarters view. During subsequent surprise recognition-memory testing, recognition was better for faces previously seen with direct than averted gaze, again especially for the opposite gender to the observer. The effect of direct gaze was stronger in both tasks when the head was seen in three-quarters rather than in frontal view, consistent with the greater salience of perceived eye contact for deviated faces. However, in the memory test, face recognition was also relatively enhanced for faces of opposite gender in front views when their gaze was averted rather than direct. Together, these results indicate that perceived eye contact can interact with facial processing during gender judgements and recognition memory, even when gaze direction is task-irrelevant, and particularly for faces of opposite gender to the observer (an influence which controls for stimulus factors when considering observers of both genders). These findings appear consistent with recent neuroimaging evidence that social facial cues can modulate visual processing in cortical regions involved in face processing and memory, presumably via interconnections with brain systems specialized for gaze perception and social monitoring.     

视觉搜索任务中直视探测优势的眼动研究

已有研究发现在视觉搜索任务中对直视的探测比斜视更快且更准确, 该现象被命名为“人群中的凝视效应”。大多数研究者将该效应的产生归因于直视会捕获更多的注意。然而, 直视条件下对搜索项的匹配加工更容易也有可能导致对直视的探测比斜视快。此外,已有研究还发现头的朝向会影响对注视方向的探测, 但对于其产生原因缺乏实验验证。本研究采用视觉搜索范式, 运用眼动技术, 把注视探测的视觉搜索过程分为准备阶段、搜索阶段和反应阶段, 对这两个问题进行了探讨。结果显示：对直视的探测优势主要表现在搜索阶段和反应阶段; 在搜索阶段直视的探测优势获益于搜索路径的变短和分心项数量的变少以及分心项平均注视时间的变短; 头的朝向仅在搜索阶段对注视探测产生影响。该结果表明, 在直视探测中对搜索项的匹配加工比在斜视探测中更容易也是导致“人群中的凝视效应”的原因之一; 头的朝向仅仅影响了对注视方向的搜索并没有影响对其的确认加工。     

Direct gaze captures visuospatial attention

This study investigated whether the direct gaze of others influences attentional disengagement from faces in an experimental situation. Participants were required to fixate on a centrally presented face with varying gaze directions and to detect the appearance of a peripheral target as quickly as possible. Results revealed that target detection was delayed when the preceding face was directly gazing at the subject (direct gaze), as compared with an averted gaze (averted gaze) or with closed eyes (closed eyes). This effect disappeared when a temporal gap was inserted between the offset of the centrally presented face and the onset of a peripheral target, suggesting that attentional disengagement contributed to the delayed response in the direct gaze condition. The response delay to direct gaze was not found when the contrast polarity of eyes in the facial stimuli was reversed, reinforcing the importance of gaze perception in delayed disengagement from direct gaze.     

The effects of the presence of a face and direct eye gaze on voice identity learning

We rarely become familiar with the voice of another person in isolation but usually also have access to visual identity information, thus learning to recognize their voice and face in parallel. There are conflicting findings as to whether learning to recognize voices in audiovisual vs audio-only settings is advantageous or detrimental to learning. One prominent finding shows that the presence of a face overshadows the voice, hindering voice identity learning by capturing listeners' attention (Face Overshadowing Effect; FOE). In the current study, we tested the proposal that the effect of audiovisual training on voice identity learning is driven by attentional processes. Participants learned to recognize voices through either audio-only training (Audio-Only) or through three versions of audiovisual training, where a face was presented alongside the voices. During audiovisual training, the faces were either looking at the camera (Direct Gaze), were looking to the side (Averted Gaze) or had closed eyes (No Gaze). We found a graded effect of gaze on voice identity learning: Voice identity recognition was most accurate after audio-only training and least accurate after audiovisual training including direct gaze, constituting a FOE. While effect sizes were overall small, the magnitude of FOE was halved for the Averted and No Gaze conditions. With direct gaze being associated with increased attention capture compared to averted or no gaze, the current findings suggest that incidental attention capture at least partially underpins the FOE. We discuss these findings in light of visual dominance effects and the relative informativeness of faces vs voices for identity perception.     

Direct gaze modulates face recognition in young infants

From birth, infants prefer to look at faces that engage them in direct eye contact. In adults, direct gaze is known to modulate the processing of faces, including the recognition of individuals. In the present study, we investigate whether direction of gaze has any effect on face recognition in four-month-old infants. Four-month infants were shown faces with both direct and averted gaze, and subsequently given a preference test involving the same face and a novel one. A novelty preference during test was only found following initial exposure to a face with direct gaze. Further, face recognition was also generally enhanced for faces with both direct and with averted gaze when the infants started the task with the direct gaze condition. Together, these results indicate that the direction of the gaze modulates face recognition in early infancy.     

Real Men Don't Look Down: Direction of Gaze Affects Sex Decisions on Faces

Classifying a face as male or female was shown to be reliably affected by the direction in which the face was looking—a variable apparently unrelated to reported features of the face that show sexual dimorphism. Decisions were slower when gaze was averted downwards. Furthermore, masculinity ratings were lower for men's faces looking down than for the same faces looking ahead. One high-level (configurational) face feature that varies with the sex of the face and with direction of gaze was identified. The vertical upper-lid-to-brow distance is smaller in men than in women and becomes less salient when eyes are averted down. This display feature may have evolved to signal gender quickly and reliably, especially in alert male faces.     

Face detection in 2‐ to 6‐month‐old infants is influenced by gaze direction and species

Humans detect faces efficiently from a young age. Face detection is critical for infants to identify and learn from relevant social stimuli in their environments. Faces with eye contact are an especially salient stimulus, and attention to the eyes in infancy is linked to the emergence of later sociality. Despite the importance of both of these early social skills—attending to faces and attending to the eyes—surprisingly little is known about how they interact. We used eye tracking to explore whether eye contact influences infants' face detection. Longitudinally, we examined 2‐, 4‐, and 6‐month‐olds' (N = 65) visual scanning of complex image arrays with human and animal faces varying in eye contact and head orientation. Across all ages, infants displayed superior detection of faces with eye contact; however, this effect varied as a function of species and head orientation. Infants were more attentive to human than animal faces and were more sensitive to eye and head orientation for human faces compared to animal faces. Unexpectedly, human faces with both averted heads and eyes received the most attention. This pattern may reflect the early emergence of gaze following—the ability to look where another individual looks—which begins to develop around this age. Infants may be especially interested in averted gaze faces, providing early scaffolding for joint attention. This study represents the first investigation to document infants' attention patterns to faces systematically varying in their attentional states. Together, these findings suggest that infants develop early, specialized functional conspecific face detection.     

Where a person with a squint is actually looking: Gaze-cued orienting in crossed eyes

In this study, we investigated gaze-cued attention orienting when the perceived eyes are not looking in the same direction. This condition occurs in strabismus (squint). Participants were asked to detect laterally presented reaction signals preceded by schematic faces in which the direction (left, straight, or right) of the left and right eye was independently manipulated. Consistent with earlier studies, the results showed a reliable cuing effect by two eyes with parallel gaze direction. Gaze-cued orienting was also shown in a situation when one eye was averted and the other eye was looking straight ahead. The gaze cuing was not significantly stronger in the former than in the latter situation. When both eyes were either nasally or temporally averted, no shifts of visual attention were observed. The results suggest that, if both eyes are visible, the direction of both eyes is computed and integrated for the gaze-cued orienting.     

Talking heads or talking eyes? Effects of head orientation and sudden onset gaze cues on attention capture

The direction of gaze towards or away from an observer has immediate effects on attentional processing in the observer. Previous research indicates that faces with direct gaze are processed more efficiently than faces with averted gaze. We recently reported additional processing advantages for faces that suddenly adopt direct gaze (abruptly shift from averted to direct gaze) relative to static direct gaze (always in direct gaze), sudden averted gaze (abruptly shift from direct to averted gaze), and static averted gaze (always in averted gaze). Because changes in gaze orientation in previous study co-occurred with changes in head orientation, it was not clear if the effect is contingent on face or eye processing, or whether it requires both the eyes and the face to provide consistent information. The present study delineates the impact of head orientation, sudden onset motion cues, and gaze cues. Participants completed a target-detection task in which head position remained in a static averted or direct orientation while sudden onset motion and eye gaze cues were manipulated within each trial. The results indicate a sudden direct gaze advantage that resulted from the additive role of motion and gaze cues. Interestingly, the orientation of the face towards or away from the observer did not influence the sudden direct gaze effect, suggesting that eye gaze cues, not face orientation cues, are critical for the sudden direct gaze effect.     

I just love the attention: implicit preference for direct eye contact

Seven studies used the Implicit Association Test to measure preference for gaze direction. For faces with neutral expressions, people clearly preferred eyes looking towards them compared to eyes gazing to the right or left (Experiment 1). This preference remained for faces shown turned to the side (Experiment 2) and upside-down (Experiment 3). Even angry faces were preferred with direct compared to averted gaze (Experiments 4 and 5). Furthermore, preference for eye contact did not correlate to performance on the Reading the Mind in the Eyes Test (RMET) or the Autism Quotient (AQ); note performance on the RMET and the AQ was only weakly correlated although both are claimed to measure social cognition. When the faces were replaced by coloured shapes (Experiment 6) or arrows (Experiment 7) people showed a weaker preference for the category label “looking at you” versus “looking to the side”. Overall, people revealed a robust preference for direct rather than averted gaze which generalized across face pose and expression. Together with a weaker preference for arrows pointing towards them, this is consistent with people having an implicit preference for self-directed attention.     

The effect of facial expression and gaze direction on memory for unfamiliar faces

We report data from an experiment that investigated the influence of gaze direction and facial expression on face memory. Participants were shown a set of unfamiliar faces with either happy or angry facial expressions, which were either gazing straight ahead or had their gaze averted to one side. Memory for faces that were initially shown with angry expressions was found to be poorer when these faces had averted as opposed to direct gaze, whereas memory for individuals shown with happy faces was unaffected by gaze direction. We suggest that memory for another individual's face partly depends on an evaluation of the behavioural intention of that individual.     

The effect of facial expression and gaze direction on memory for unfamiliar faces

We report data from an experiment that investigated the influence of gaze direction and facial expression on face memory. Participants were shown a set of unfamiliar faces with either happy or angry facial expressions, which were either gazing straight ahead or had their gaze averted to one side. Memory for faces that were initially shown with angry expressions was found to be poorer when these faces had averted as opposed to direct gaze, whereas memory for individuals shown with happy faces was unaffected by gaze direction. We suggest that memory for another individual's face partly depends on an evaluation of the behavioural intention of that individual.     

A study of impaired judgment of eye-gaze direction and related face-processing deficits in autism spectrum disorders

The purpose of this study was to examine whether individuals with autism spectrum disorders (ASD) use the same cognitive strategies as typically developing individuals when processing eye-gaze direction. Subjects viewed pictures of whole faces, the eye region alone, and pairs of arrows presented for 40, 70, or 100 ms, and responded according to the direction the eyes were looking or the arrows pointing (left, right, or straight ahead). Experiment 1 demonstrated that typically developing adults (n = 41) were more accurate and showed shorter reaction times when judging direction of averted eye gaze in the context of the whole face than when only the eyes were visible (eye-region-alone condition). Furthermore, in the eye-region-alone condition participants were more accurate and faster at judging direct eye gaze than averted eye gaze. The same task was used in experiment 2 to compare the performance of a group of individuals with ASD (n = 24) with that of a group of IQ-matched typically developing individuals (n = 26). The performance of the control participants was identical to that observed in experiment 1. Individuals with ASD were able to judge eye-gaze direction accurately at short exposure duration; however, they failed to show the typical advantage for judging averted gaze in whole faces and the increased sensitivity to direct gaze in the eye-region-alone condition. The findings are discussed in terms of impairments to discrete gaze-processing and face-processing mechanisms, and the connectivity between these mechanisms.     

Orienting of attention via observed eye gaze is head-centred

Observing averted eye gaze results in the automatic allocation of attention to the gazed-at location. The role of the orientation of the face that produces the gaze cue was investigated. The eyes in the face could look left or right in a head-centred frame, but the face itself could be oriented 90 degrees clockwise or anticlockwise such that the eyes were gazing up or down. Significant cueing effects to targets presented to the left or right of the screen were found in these head orientation conditions. This suggests that attention was directed to the side to which the eyes would have been looking towards, had the face been presented upright. This finding provides evidence that head orientation can affect gaze following, even when the head orientation alone is not a social cue. It also shows that the mechanism responsible for the allocation of attention following a gaze cue can be influenced by intrinsic object-based (i.e. head-centred) properties of the task-irrelevant cue.     

Anxiety and sensitivity to gaze direction in emotionally expressive faces

This study investigated the role of neutral, happy, fearful, and angry facial expressions in enhancing orienting to the direction of eye gaze. Photographs of faces with either direct or averted gaze were presented. A target letter (T or L) appeared unpredictably to the left or the right of the face, either 300 ms or 700 ms after gaze direction changed. Response times were faster in congruent conditions (i.e., when the eyes gazed toward the target) relative to incongruent conditions (when the eyes gazed away from the target letter). Facial expression did influence reaction times, but these effects were qualified by individual differences in self-reported anxiety. High trait-anxious participants showed an enhanced orienting to the eye gaze of faces with fearful expressions relative to all other expressions. In contrast, when the eyes stared straight ahead, trait anxiety was associated with slower responding when the facial expressions depicted anger. Thus, in anxiety-prone people attention is more likely to be held by an expression of anger, whereas attention is guided more potently by fearful facial expressions.     

Gaze cueing as a function of perceived gaze direction

Previous studies have found that attention is automatically oriented in the direction of other people's gaze. This study directly investigated whether the perceiving gaze direction modulates the orienting of observers' attention. Gaze perception was manipulated by changing the face context (head orientation) of the gaze cue: the perceived gaze angle was increased (or decreased) when the head and gaze are congruent (or incongruent), while the local‐feature information of the eye region was preserved for all stimuli. The results showed that gaze‐cueing effects were enhanced when the perceived gaze direction was averted more toward left or right, and reduced when the perceived gaze direction was closer to direct gaze. The results suggest that gaze‐cueing effects are based on mechanisms specialized for gaze perception, and the magnitude of gaze‐cueing effects was probably a function of the perceived gaze direction.