Real Men Don't Look Down: Direction of Gaze Affects Sex Decisions on Faces

Classifying a face as male or female was shown to be reliably affected by the direction in which the face was looking—a variable apparently unrelated to reported features of the face that show sexual dimorphism. Decisions were slower when gaze was averted downwards. Furthermore, masculinity ratings were lower for men's faces looking down than for the same faces looking ahead. One high-level (configurational) face feature that varies with the sex of the face and with direction of gaze was identified. The vertical upper-lid-to-brow distance is smaller in men than in women and becomes less salient when eyes are averted down. This display feature may have evolved to signal gender quickly and reliably, especially in alert male faces.     

Effects of perceived mutual gaze and gender on face processing and recognition memory

Perceived gaze contact in seen faces may convey important social signals. We examined whether gaze perception affects face processing during two tasks: Online gender judgement, and later incidental recognition memory. Individual faces were presented with eyes directed either straight towards the viewer or away, while these faces were seen in either frontal or three-quarters view. Participants were slower to make gender judgements for faces with direct versus averted eye gaze, but this effect was particularly pronounced for faces with opposite gender to the observer, and seen in three-quarters view. During subsequent surprise recognition-memory testing, recognition was better for faces previously seen with direct than averted gaze, again especially for the opposite gender to the observer. The effect of direct gaze was stronger in both tasks when the head was seen in three-quarters rather than in frontal view, consistent with the greater salience of perceived eye contact for deviated faces. However, in the memory test, face recognition was also relatively enhanced for faces of opposite gender in front views when their gaze was averted rather than direct. Together, these results indicate that perceived eye contact can interact with facial processing during gender judgements and recognition memory, even when gaze direction is task-irrelevant, and particularly for faces of opposite gender to the observer (an influence which controls for stimulus factors when considering observers of both genders). These findings appear consistent with recent neuroimaging evidence that social facial cues can modulate visual processing in cortical regions involved in face processing and memory, presumably via interconnections with brain systems specialized for gaze perception and social monitoring.     

Talking heads or talking eyes? Effects of head orientation and sudden onset gaze cues on attention capture

The direction of gaze towards or away from an observer has immediate effects on attentional processing in the observer. Previous research indicates that faces with direct gaze are processed more efficiently than faces with averted gaze. We recently reported additional processing advantages for faces that suddenly adopt direct gaze (abruptly shift from averted to direct gaze) relative to static direct gaze (always in direct gaze), sudden averted gaze (abruptly shift from direct to averted gaze), and static averted gaze (always in averted gaze). Because changes in gaze orientation in previous study co-occurred with changes in head orientation, it was not clear if the effect is contingent on face or eye processing, or whether it requires both the eyes and the face to provide consistent information. The present study delineates the impact of head orientation, sudden onset motion cues, and gaze cues. Participants completed a target-detection task in which head position remained in a static averted or direct orientation while sudden onset motion and eye gaze cues were manipulated within each trial. The results indicate a sudden direct gaze advantage that resulted from the additive role of motion and gaze cues. Interestingly, the orientation of the face towards or away from the observer did not influence the sudden direct gaze effect, suggesting that eye gaze cues, not face orientation cues, are critical for the sudden direct gaze effect.     

Orienting to eye gaze and face processing

The author conducted 7 experiments to examine possible interactions between orienting to eye gaze and specific forms of face processing. Participants classified a letter following either an upright or inverted face with averted, uninformative eye gaze. Eye gaze orienting effects were recorded for upright and inverted faces, irrespective of whether the faces were simple, schematic faces or more realistic faces. In contrast, inversion affected orienting to targets appearing along the vertical axis. Switching the contrast between the iris and sclera reversed orienting to eye gaze. Lifting the eyelid to expose more of the iris-sclera contrast led to a potentiation of orienting to eye gaze. Raising the eyebrow alone without the eyelid did not affect orienting. The findings suggest that local perceptual information is critical for orienting to eye gaze and that the effect can occur with a degree of independence from certain types of face processing.     

Factors influencing newborns' preference for faces with eye contact

We investigated newborns' sensitivity to the direction of gaze of another's face by using a preferential looking technique. This study extends earlier work on a preference for faces with direct gaze in newborns. In Experiment 1, we replicate the basic finding of Farroni and colleagues that newborns prefer to look at faces with direct gaze. In Experiments 2 and 3, we establish that a preference for faces with direct gaze in newborns is present only within the context of an upright face and a straight head, suggesting that relatively primitive configuration-sensitive mechanisms may be operating. Overall, these results further the view that relatively simple perceptual biases in newborns may be an essential foundation for later social-cognitive development.     

Fast face detection using a unified architecture for unconstrained and infrared face images

Human face detection along with its localization is a difficult task when the face is presented in the cluttered scene in an unconstrained scenario that might be with arbitrary pose variations, occlusions, random backgrounds and infrared (IR) environment. This paper proposes a novel face detection method which can address some of these issues and challenges quite successfully during face detection in unconstrained as well as infrared environments. It makes use of Fast Successive Mean Quantization Transform (FastSMQT) features for image enhancement and feature representation to deal with illumination and sensor insensitiveness. A split up Sparse Network of Winnows (SNoW) with Winnow updating rule is then exploited to speed up the original SNoW classifier. Finally, the features and classifiers are combined together with skin detection algorithm for face detection in crowd image and head orientation correction of near infrared faces. The proposed face detector is robust in handling pose, occlusion, illumination, blur and low image resolution. The experiment is performed on six challenging and publicly available databases, viz. BIOID, LFW, FDDB, UFI, WIDER FACE and IIT Delhi near infrared. The experimental results depict that the proposed method outperforms traditional as well as some advanced methods in detecting unconstrained and infrared faces under challenging situations.     

Representation of facial expressions of emotion

Inversion interferes with the encoding of configural and holistic information more than it does with the encoding of explicitly represented and isolated parts. Accordingly, if facial expressions are explicitly represented in the face representation, their recognition should not be greatly affected by face orientation. In the present experiment, response times to detect a difference in hair color in line-drawn faces were unaffected by face orientation, but response times to detect the presence of brows and mouth were longer with inverted than with upright faces, independent of the emergent expression (neutral, happy, sad, and angry). Expressions are not explicitly represented; rather, they and the face configuration are represented as undecomposed wholes.     

Stare in the crowd: frontal face guides overt attention independently of its gaze direction

Whether or not a stare in the midst of many faces can guide visual attention is a controversial issue. Two experiments are reported that investigate the hypothesis that visual attention is guided toward a frontal face in the search for a stare among faces with varied head angles. The participants were required to search for a face with a direct gaze in a context where the target could be at any of various head angles and the target's head angle was unpredictable in one trial. The search performance was better for a frontal-face target than for deviated-face targets. Furthermore, eye-movement analyses revealed that a frontal-face stimulus tended to be initially fixated prior to deviated-face stimuli, and many of the initially fixated frontal-face stimuli had an averted gaze. The findings suggest that a frontal face guides overt attention independently of its gaze direction in the search for a stare in a crowd. The validity of prioritising a frontal face in order to find a direct gaze among faces and the characteristics of a human-face detection system are discussed.     

The meaningfulness and meaning of schematic faces

A pool of 128 schematic faces was generated by varying brow, mouth, nose, eye height, and eye shape. Ratings of meaningfulness (how easy it was to find an adjective describing the face) and meaning (the adjective given to the face) were mainly a function of brow and mouth. When brow and mouth were horizontal, faces were least meaningful and neutral in expression; if either brow or mouth moved from the horizontal, faces increased in meaningfulness, meaning being dependent on the moving feature; when both brow and mouth moved from the horizontal, faces were most meaningful, and their expression was a function of the combination of brow and mouth.     

Straight gaze facilitates face processing but does not cause involuntary attentional capture

This study aimed to investigate the conditions under which eyes with a straight gaze capture attention more than eyes with an averted gaze, a phenomenon called the stare-in-the-crowd effect. In Experiment 1, we measured attentional capture by distractor faces with either straight or averted gaze that were shown among faces with closed eyes. Gaze direction of the distractor face was irrelevant because participants searched for a tilted face and indicated its gender. The presence of the distractor face with open eyes resulted in slower reaction times, but gaze direction had no effect, suggesting that straight gaze does not result in more involuntary attentional capture than averted gaze. In three further experiments with the same stimuli, the gaze direction of the target, and not the distractor, was varied. Better performance with straight than averted gaze of the target face was observed when the gaze direction or gender of the target face had to be discriminated. However, no difference between straight and averted was observed when only the presence of a face with open eyes had to be detected. Thus, the stare-in-the crowd effect is only observed when eye gaze is selected as part of the target and only when features of the face have to be discriminated. Our findings suggest that preference for straight gaze bears on target-related processes rather than on attentional capture per se.     

Preferred gaze direction and the vergence system at rest]

In two experiments the effects of binocular vergence, head tilt, and prolonged gaze inclination on the preferred vertical gaze direction were studied. Concurrently, dark vergence was measured to test a hypothesis on the effect that binocular vergence has on the preferred vertical direction of gaze. The previously reported influence of observation distance on the preferred gaze inclination was replicated. When the head was tilted backward, the preferred gaze inclination was lower and the effect of observation distance was reduced; when the head was tilted forward, the preferred gaze inclination was higher and the effect of observation distance was increased. After prolonged upward or downward gaze inclination the preferred vertical gaze direction was shifted up or down, respectively, while the effect of observation distance remained constant. Overall the change of the preferred vertical direction of gaze upon binocular fixation of near stimuli was accompanied by a reduced discrepancy between convergence and the resting state of the vergence system; additional implications of the hypothesis on the relation between individual resting vergence and the effect of observation distance on the preferred inclination of gaze could not be substantiated.     

Spatial interference between gaze direction and gaze location: a study on the eye contact effect

Perceived gaze in faces is an important social cue that influences spatial orienting of attention. In three experiments, we examined whether the social relevance of gaze direction modulated spatial interference in response selection, using three different stimuli: faces, isolated eyes, and symbolic eyes (Experiments 1, 2, and 3, respectively). Each experiment employed a variant of the spatial Stroop paradigm in which face location and gaze direction were put into conflict. Results showed a reverse congruency effect between face location to the right or left of fixation and gaze direction only for stimuli with a social meaning to participants (Experiments 1 and 2). The opposite was observed for the nonsocial stimuli used in Experiment 3. Results are explained as facilitation in response to eye contact.     

Spatial interference between gaze direction and gaze location: A study on the eye contact effect

Perceived gaze in faces is an important social cue that influences spatial orienting of attention. In three experiments, we examined whether the social relevance of gaze direction modulated spatial interference in response selection, using three different stimuli: faces, isolated eyes, and symbolic eyes (Experiments 1, 2, and 3, respectively). Each experiment employed a variant of the spatial Stroop paradigm in which face location and gaze direction were put into conflict. Results showed a reverse congruency effect between face location to the right or left of fixation and gaze direction only for stimuli with a social meaning to participants (Experiments 1 and 2). The opposite was observed for the nonsocial stimuli used in Experiment 3. Results are explained as facilitation in response to eye contact.     

Face detection in 2‐ to 6‐month‐old infants is influenced by gaze direction and species

Humans detect faces efficiently from a young age. Face detection is critical for infants to identify and learn from relevant social stimuli in their environments. Faces with eye contact are an especially salient stimulus, and attention to the eyes in infancy is linked to the emergence of later sociality. Despite the importance of both of these early social skills—attending to faces and attending to the eyes—surprisingly little is known about how they interact. We used eye tracking to explore whether eye contact influences infants' face detection. Longitudinally, we examined 2‐, 4‐, and 6‐month‐olds' (N = 65) visual scanning of complex image arrays with human and animal faces varying in eye contact and head orientation. Across all ages, infants displayed superior detection of faces with eye contact; however, this effect varied as a function of species and head orientation. Infants were more attentive to human than animal faces and were more sensitive to eye and head orientation for human faces compared to animal faces. Unexpectedly, human faces with both averted heads and eyes received the most attention. This pattern may reflect the early emergence of gaze following—the ability to look where another individual looks—which begins to develop around this age. Infants may be especially interested in averted gaze faces, providing early scaffolding for joint attention. This study represents the first investigation to document infants' attention patterns to faces systematically varying in their attentional states. Together, these findings suggest that infants develop early, specialized functional conspecific face detection.     

Gaze direction and facial expressions exert combined but different effects on attentional resources

Gaze direction and facial expressions are critical components of face processing and have been shown to influence attention deployment. We investigated whether gaze direction (direct vs. averted) combined with a neutral or angry expression modulates the deployment of attentional resources over time. In a Rapid Serial Visual Presentation (RSVP) paradigm participants had to decide the gender of a neutral or an angry target face with direct or averted gaze (T1) and then to judge the orientation of a target picture of a landscape (T2), following the face at different time intervals. Results showed no attentional blink effect (i.e., no deterioration in T2 accuracy) when T1 was an angry face with direct gaze, whereas it was present for angry faces with averted gaze or neutral faces with either averted or direct gaze. These findings are consistent with appraisal theories and are discussed against the background of automatic processing of threat stimuli.     

Gaze direction and facial expressions exert combined but different effects on attentional resources

Gaze direction and facial expressions are critical components of face processing and have been shown to influence attention deployment. We investigated whether gaze direction (direct vs. averted) combined with a neutral or angry expression modulates the deployment of attentional resources over time. In a Rapid Serial Visual Presentation (RSVP) paradigm participants had to decide the gender of a neutral or an angry target face with direct or averted gaze (T1) and then to judge the orientation of a target picture of a landscape (T2), following the face at different time intervals. Results showed no attentional blink effect (i.e., no deterioration in T2 accuracy) when T1 was an angry face with direct gaze, whereas it was present for angry faces with averted gaze or neutral faces with either averted or direct gaze. These findings are consistent with appraisal theories and are discussed against the background of automatic processing of threat stimuli.     

Attentional capture by change in direct gaze

In three experiments, we examined whether change in direct gaze was better at capturing visuospatial attention than non-direct gaze change. Also, change in direct gaze can be categorised into two types: 'look toward', which means gaze changing to look toward observers, and 'look away', which means gaze changing to look away from observers. Thus, we also investigated which type of change in direct gaze was more effective in capturing visuospatial attention. Each experiment employed a change-detection task, and we compared detection accuracy between 'look away', 'look toward', and non-direct gaze-change conditions. In experiment 1, we found detection advantage for change in direct gaze relative to non-direct gaze change, and for 'look toward' compared with 'look away'. In experiment 2, we conducted control experiments to exclude possibilities of simple motion detection and geometrical factors of eyes, and confirm detection advantage in experiment 1 only occurred when the stimuli were processed as faces and gazes. In experiment 3, we manipulated the head deviation, but the results in experiment 1 persisted despite changes in head orientation. The findings establish that individuals are sensitive to change in direct relative to non-direct gaze change, and 'look toward' compared with 'look away'.     

面孔知觉中特征、结构和整体加工策略的眼动研究

考察面孔知觉中特征加工、结构加工和整体加工三种不同加工方式对应的眼动模式。实验1中, 将以特征信息为主的错乱面孔和以结构信息为主的模糊面孔作为线索刺激, 引发对测试面孔的特征加工和结构加工, 眼动分析表明：特征加工表现为对面孔各特征内更长的凝视时间, 结构加工表现为对面孔各特征间高频的眼跳。实验2采用相同的研究范式, 将完整面孔、轻度错乱面孔和低水平模糊面孔作为线索刺激, 引发对测试面孔除特征加工和结构加工外的另一种加工方式-- 整体加工, 表现为注视点更多地落在测试面孔中央区的鼻子部位以扩大注视范围, 进而把握整张面孔信息。本研究揭示了三种不同面孔加工方式眼动模式的差异。     

Eye remember you: the effects of gaze direction on face recognition in children and adults

Children and adults were tested on a forced‐choice face recognition task in which the direction of eye gaze was manipulated over the course of the initial presentation and subsequent test phase of the experiment. To establish the effects of gaze direction on the encoding process, participants were presented with to‐be‐studied faces displaying either direct or deviated gaze (i.e. encoding manipulation). At test, all the faces depicted persons with their eyes closed. To investigate the effects of gaze direction on the efficiency of the retrieval process, a second condition (i.e. retrieval manipulation) was run in which target faces were presented initially with eyes closed and tested with either direct or deviated gaze. The results revealed the encoding advantages enjoyed by faces with direct gaze was present for both children and adults. Faces with direct gaze were also recognized better than faces with deviated gaze at retrieval, although this effect was most pronounced for adults. Finally, the advantage for direct gaze over deviated gaze at encoding was greater than the advantage for direct gaze over deviated gaze at retrieval. We consider the theoretical implications of these findings.     

I just love the attention: implicit preference for direct eye contact

Seven studies used the Implicit Association Test to measure preference for gaze direction. For faces with neutral expressions, people clearly preferred eyes looking towards them compared to eyes gazing to the right or left (Experiment 1). This preference remained for faces shown turned to the side (Experiment 2) and upside-down (Experiment 3). Even angry faces were preferred with direct compared to averted gaze (Experiments 4 and 5). Furthermore, preference for eye contact did not correlate to performance on the Reading the Mind in the Eyes Test (RMET) or the Autism Quotient (AQ); note performance on the RMET and the AQ was only weakly correlated although both are claimed to measure social cognition. When the faces were replaced by coloured shapes (Experiment 6) or arrows (Experiment 7) people showed a weaker preference for the category label “looking at you” versus “looking to the side”. Overall, people revealed a robust preference for direct rather than averted gaze which generalized across face pose and expression. Together with a weaker preference for arrows pointing towards them, this is consistent with people having an implicit preference for self-directed attention.