The influence of head contour and nose angle on the perception of eye-gaze direction

We report seven experiments that investigate the influence that head orientation exerts on the perception of eye-gaze direction. In each of these experiments, participants were asked to decide whether the eyes in a brief and masked presentation were looking directly at them or were averted. In each case, the eyes could be presented alone, or in the context of congruent or incongruent stimuli In Experiment 1A, the congruent and incongruent stimuli were provided by the orientation of face features and head outline. Discrimination of gaze direction was found to be better when face and gaze were congruent than in both of the other conditions, an effect that was not eliminated by inversion of the stimuli (Experiment 1B). In Experiment 2A, the internal face features were removed, but the outline of the head profile was found to produce an identical pattern of effects on gaze discrimination, effects that were again insensitive to inversion (Experiment 2B) and which persisted when lateral displacement of the eyes was controlled (Experiment 2C). Finally, in Experiment 3A, nose angle was also found to influence participants' ability to discriminate direct gaze from averted gaze, but here the effect was eliminated by inversion of the stimuli (Experiment 3B). We concluded that an image-based mechanism is responsible for the influence of head profile on gaze perception, whereas the analysis of nose angle involves the configural processing of face features.     

Preference for human direct gaze in infant chimpanzees (Pan troglodytes)

We studied gaze perception in three infant chimpanzees (Pan troglodytes), aged 10-32 weeks, using a two-choice preferential-looking paradigm. The infants were presented with two photographs of a human face: (a) with the eyes open or closed, and (b) with a direct or an averted gaze. We found that the chimpanzees preferred looking at the direct-gaze face. However, in the context of scrambled faces, the infants showed no difference in gaze discrimination between direct and averted gazes. These findings suggest that gaze perception by chimpanzees may be influenced by the surrounding facial context. The relationship between gaze perception, face processing, and the adaptive significance of gaze perception are discussed from an evolutionary perspective.     

The development of emotional face and eye gaze processing

Recent research has demonstrated that infants' attention towards novel objects is affected by an adult's emotional expression and eye gaze toward the object. The current event-related potential (ERP) study investigated how infants at 3, 6, and 9 months of age process fearful compared to neutral faces looking toward objects or averting gaze away from objects. Furthermore, we examined how the processing of novel objects is affected by gaze direction and emotional expression. We hypothesized that an adult's fearful expression should be particularly salient when it is directed toward a referent in the environment. Furthermore, responses to objects should be increased if the face previously expressed fear toward the object. Three-month-olds did not show differential neural responses to fearful vs. neutral faces regardless of gaze direction. Six-month-olds showed an enhanced negative central (Nc) component for fearful relative to neutral faces looking toward objects, but not when eye gaze was averted away from the objects. Furthermore, 6-month-olds showed an enhanced Nc for objects that had been gaze-cued by a fearful compared to a neutral face. Nine-month-olds showed an enhanced Nc for fearful relative to neutral faces in both eye gaze conditions and showed an enhanced Nc for objects that had been gaze-cued by a neutral face. The findings are discussed in the context of social cognitive and brain development.     

Task-irrelevant direct gaze facilitates visual search for deviant facial expression

The detection of emotional expression is important particularly when the expression is directed towards the viewer. Therefore, we conjectured that the efficiency in visual search for deviant emotional expression is modulated by gaze direction, which is one of the primary clues for encoding the focus of social attention. To examine this hypothesis, two visual search tasks were conducted. In Emotional Face Search, the participants were required to detect an emotional expression amongst distractor faces with neutral expression; in Neutral Face Search they were required to detect a neutral target among emotional distractors. The results revealed that target detection was accelerated when the target face had direct gaze compared to averted gaze for fearful, angry, and neutral targets, but no effect of distractor gaze direction was observed. An additional experiment including multiple display sizes has shown a shallower search slope in search for a target face with direct gaze than that with averted gaze, indicating that the advantage of a target face with direct gaze is attributable to efficient orientation of attention towards target faces. These results indicate that direct gaze facilitates detection of target face in visual scenery even when gaze discrimination is not the primary task at hand.     

Straight gaze facilitates face processing but does not cause involuntary attentional capture

This study aimed to investigate the conditions under which eyes with a straight gaze capture attention more than eyes with an averted gaze, a phenomenon called the stare-in-the-crowd effect. In Experiment 1, we measured attentional capture by distractor faces with either straight or averted gaze that were shown among faces with closed eyes. Gaze direction of the distractor face was irrelevant because participants searched for a tilted face and indicated its gender. The presence of the distractor face with open eyes resulted in slower reaction times, but gaze direction had no effect, suggesting that straight gaze does not result in more involuntary attentional capture than averted gaze. In three further experiments with the same stimuli, the gaze direction of the target, and not the distractor, was varied. Better performance with straight than averted gaze of the target face was observed when the gaze direction or gender of the target face had to be discriminated. However, no difference between straight and averted was observed when only the presence of a face with open eyes had to be detected. Thus, the stare-in-the crowd effect is only observed when eye gaze is selected as part of the target and only when features of the face have to be discriminated. Our findings suggest that preference for straight gaze bears on target-related processes rather than on attentional capture per se.     

The interaction between gaze direction and facial expressions in newborns

The ability to decode facial expressions is an important component of social interaction and functioning. This ability is even more fundamental early in life, prior to the development of verbal communication. However, it is still unclear whether newborns can detect, discriminate and process facial expressions, and, if so, what the mechanisms underlying this ability are. In this study, we extend the investigation of perceived emotional expression by manipulating gaze direction with different facial expressions. Specifically, newborns were presented with faces displaying neutral, fearful, or happy facial expressions accompanied with direct or averted gaze, and tested in a visual preference paradigm. Four experiments were conducted in which different combinations of expression and gaze were used. However, only in the fourth experiment did newborns show a visual preference for a specific emotional display; they looked significantly longer at a happy face than a neutral one only when both were accompanied with direct gaze. These results provide support for the advantage of happy facial expressions in the development of a face processing system and suggest that this preference reflects experience acquired during the first few days after birth.     

Direct gaze modulates face recognition in young infants

From birth, infants prefer to look at faces that engage them in direct eye contact. In adults, direct gaze is known to modulate the processing of faces, including the recognition of individuals. In the present study, we investigate whether direction of gaze has any effect on face recognition in four-month-old infants. Four-month infants were shown faces with both direct and averted gaze, and subsequently given a preference test involving the same face and a novel one. A novelty preference during test was only found following initial exposure to a face with direct gaze. Further, face recognition was also generally enhanced for faces with both direct and with averted gaze when the infants started the task with the direct gaze condition. Together, these results indicate that the direction of the gaze modulates face recognition in early infancy.     

Infant shifting attention from an adult’s face to an adult’s hand: a precursor of joint attention

Two experiments were designed to investigate shifting attention from an adult’s face to an adult’s hand by 3- and 4-month-olds. In Experiment 1, 24 infants were presented with five types of hand gestures by their mothers and a stranger. Experiment 2 was given to 22 infants with the same procedures, except for the addition of a head inclining while pointing to objects. The results were: (1) after encountering an averted head repeatedly, the infants shifted their attention from the adult’s face to the moving hand and objects; they oriented to what the adult was attending to. (2) The moving head improved the rate of infants turning their heads to the same direction as the adult. The conclusion was averted head and eyes play a major role in infants’ orienting to an adult’s hand. A hand was a shared visual target during the adult’s object performance, indicating that infants’ orientation to the adults’ hand is a precursor stage of joint visual attention.     

Effects of perceived mutual gaze and gender on face processing and recognition memory

Perceived gaze contact in seen faces may convey important social signals. We examined whether gaze perception affects face processing during two tasks: Online gender judgement, and later incidental recognition memory. Individual faces were presented with eyes directed either straight towards the viewer or away, while these faces were seen in either frontal or three-quarters view. Participants were slower to make gender judgements for faces with direct versus averted eye gaze, but this effect was particularly pronounced for faces with opposite gender to the observer, and seen in three-quarters view. During subsequent surprise recognition-memory testing, recognition was better for faces previously seen with direct than averted gaze, again especially for the opposite gender to the observer. The effect of direct gaze was stronger in both tasks when the head was seen in three-quarters rather than in frontal view, consistent with the greater salience of perceived eye contact for deviated faces. However, in the memory test, face recognition was also relatively enhanced for faces of opposite gender in front views when their gaze was averted rather than direct. Together, these results indicate that perceived eye contact can interact with facial processing during gender judgements and recognition memory, even when gaze direction is task-irrelevant, and particularly for faces of opposite gender to the observer (an influence which controls for stimulus factors when considering observers of both genders). These findings appear consistent with recent neuroimaging evidence that social facial cues can modulate visual processing in cortical regions involved in face processing and memory, presumably via interconnections with brain systems specialized for gaze perception and social monitoring.     

The shared signal hypothesis: Effects of emotion‐gaze congruency in infant and adult visual preferences

In this study, 4‐month‐old infants’ and adults’ spontaneous preferences for emotional and neutral displays with direct and averted gaze are investigated using visual preference paradigms. Specifically, by presenting two approach‐oriented emotions (happiness and anger) and two avoidance‐oriented emotions (fear and sadness), we asked whether the pattern of emotion–gaze interaction suggested by the shared signal hypothesis (SSH) would also be found with this paradigm. Both age groups demonstrated an ability to discern the approach‐ and avoidance‐oriented emotions, matching them with direct and averted gaze, respectively. Nonetheless, infants showed a greater sensitivity for the congruent emotion‐gaze combination in the approach‐oriented emotions, while adults were equally sensitive to the gaze‐expression congruence for both the approach‐ and avoidance‐oriented emotions. In a follow‐up experiment, infants showed no preference for direct or averted gaze in the context of neutral faces. We conclude that the SSH may have validity from infancy, gradually extending from approach‐oriented emotions to avoidance‐oriented emotions over the course of development.     

Adult's Eyes Trigger Shifts of Visual Attention in Human Infants

Two experiments examined whether infants shift their visual attention in the direction toward which an adult's eyes turn. A computerized modification of previous joint-attention paradigms revealed that infants as young as 3 months attend in the same direction as the eyes of a digitized adult face. This attention shift was indicated by the latency and direction of their orienting to peripheral probes presented after the face was extinguished. A second experiment found a similar influence of direction of perceived gaze, but also that less peripheral orienting occurred if the central face remained visible during presentation of the probe. This may explain why attention shifts triggered by gaze perception have been difficult to observe in infants using previous naturalistic procedures. Our new method reveals both that direction of perceived gaze can be discriminated by young infants and that this perception triggers corresponding shifts of their own attention.     

A study of impaired judgment of eye-gaze direction and related face-processing deficits in autism spectrum disorders

The purpose of this study was to examine whether individuals with autism spectrum disorders (ASD) use the same cognitive strategies as typically developing individuals when processing eye-gaze direction. Subjects viewed pictures of whole faces, the eye region alone, and pairs of arrows presented for 40, 70, or 100 ms, and responded according to the direction the eyes were looking or the arrows pointing (left, right, or straight ahead). Experiment 1 demonstrated that typically developing adults (n = 41) were more accurate and showed shorter reaction times when judging direction of averted eye gaze in the context of the whole face than when only the eyes were visible (eye-region-alone condition). Furthermore, in the eye-region-alone condition participants were more accurate and faster at judging direct eye gaze than averted eye gaze. The same task was used in experiment 2 to compare the performance of a group of individuals with ASD (n = 24) with that of a group of IQ-matched typically developing individuals (n = 26). The performance of the control participants was identical to that observed in experiment 1. Individuals with ASD were able to judge eye-gaze direction accurately at short exposure duration; however, they failed to show the typical advantage for judging averted gaze in whole faces and the increased sensitivity to direct gaze in the eye-region-alone condition. The findings are discussed in terms of impairments to discrete gaze-processing and face-processing mechanisms, and the connectivity between these mechanisms.     

Face detection in 2‐ to 6‐month‐old infants is influenced by gaze direction and species

Humans detect faces efficiently from a young age. Face detection is critical for infants to identify and learn from relevant social stimuli in their environments. Faces with eye contact are an especially salient stimulus, and attention to the eyes in infancy is linked to the emergence of later sociality. Despite the importance of both of these early social skills—attending to faces and attending to the eyes—surprisingly little is known about how they interact. We used eye tracking to explore whether eye contact influences infants' face detection. Longitudinally, we examined 2‐, 4‐, and 6‐month‐olds' (N = 65) visual scanning of complex image arrays with human and animal faces varying in eye contact and head orientation. Across all ages, infants displayed superior detection of faces with eye contact; however, this effect varied as a function of species and head orientation. Infants were more attentive to human than animal faces and were more sensitive to eye and head orientation for human faces compared to animal faces. Unexpectedly, human faces with both averted heads and eyes received the most attention. This pattern may reflect the early emergence of gaze following—the ability to look where another individual looks—which begins to develop around this age. Infants may be especially interested in averted gaze faces, providing early scaffolding for joint attention. This study represents the first investigation to document infants' attention patterns to faces systematically varying in their attentional states. Together, these findings suggest that infants develop early, specialized functional conspecific face detection.     

Infants perceiving and acting on the eyes: tests of an evolutionary hypothesis

It has been hypothesized that an evolutionarily ancient mechanism underlies the ability of human infants to detect and act upon the direction of eye gaze of another human face. However, the evidence from behavioral studies with infants is also consistent with a more domain-general system responsive to the lateral motion of stimuli regardless of whether or not eyes are involved. To address this issue three experiments with 4-month-old infants are reported that utilize a standard face-cueing paradigm. In the first experiment an inverted face was used to investigate whether the motion of the pupils elicits the cueing effect regardless of the surrounding face context. In the second experiment pupil motion and eye gaze direction were opposed, allowing us to assess their relative importance. In a third experiment, a more complex gaze shift sequence allowed us to analyse the importance of beginning with a period of mutual gaze. Overall, the results were consistent with the importance of the perceived direction of motion of pupils. However, to be effective in cueing spatial locations this motion needs to be preceded by a period of direct mutual gaze (eye contact). We suggest that evolution results in information-processing biases that shape and constrain the outcome of individual development to eventually result in adult adaptive specializations.     

Understanding the referential nature of looking: infants' preference for object-directed gaze

In four experiments, we investigated whether 9-month-old infants are sensitive to the relationship between gaze direction and object location and whether this sensitivity depends on the presence of communicative cues like eye contact. Infants observed a face, which repeatedly shifted its eyes either toward, or away from, unpredictably appearing objects. We found that they looked longer at the face when the gaze shifts were congruent with the location of the object. A second experiment ruled out that this effect was simply due to spatial congruency, while a third and a fourth experiment revealed that a preceding period of eye contact is required to elicit the gaze-object congruency effect. These results indicate that infants at this age can encode eye direction in referential terms in the presence of communication cues and are biased to attend to scenes with object-directed gaze.     

Is anyone looking at me? Direct gaze detection in children with and without autism

Atypical processing of eye contact is one of the significant characteristics of individuals with autism, but the mechanism underlying atypical direct gaze processing is still unclear. This study used a visual search paradigm to examine whether the facial context would affect direct gaze detection in children with autism. Participants were asked to detect target gazes presented among distracters with different gaze directions. The target gazes were either direct gaze or averted gaze, which were either presented alone (Experiment 1) or within facial context (Experiment 2). As with the typically developing children, the children with autism, were faster and more efficient to detect direct gaze than averted gaze, whether or not the eyes were presented alone or within faces. In addition, face inversion distorted efficient direct gaze detection in typically developing children, but not in children with autism. These results suggest that children with autism use featural information to detect direct gaze, whereas typically developing children use configural information to detect direct gaze.     

Where a person with a squint is actually looking: Gaze-cued orienting in crossed eyes

In this study, we investigated gaze-cued attention orienting when the perceived eyes are not looking in the same direction. This condition occurs in strabismus (squint). Participants were asked to detect laterally presented reaction signals preceded by schematic faces in which the direction (left, straight, or right) of the left and right eye was independently manipulated. Consistent with earlier studies, the results showed a reliable cuing effect by two eyes with parallel gaze direction. Gaze-cued orienting was also shown in a situation when one eye was averted and the other eye was looking straight ahead. The gaze cuing was not significantly stronger in the former than in the latter situation. When both eyes were either nasally or temporally averted, no shifts of visual attention were observed. The results suggest that, if both eyes are visible, the direction of both eyes is computed and integrated for the gaze-cued orienting.     

Early and late cortical responses to directly gazing faces are task dependent

Gender categorisation of human faces is facilitated when gaze is directed toward the observer (i.e., a direct gaze), compared with situations where gaze is averted or the eyes are closed (Macrae, Hood, Milne, Rowe, & Mason, Psychological Science, 13(5), 460–464, 2002). However, the temporal dynamics underlying this phenomenon remain to some extent unknown. Here, we used electroencephalography (EEG) to assess the neural correlates of this effect, focusing on the event-related potential (ERP) components known to be sensitive to gaze perception (i.e., P1, N170, and P3b). We first replicated the seminal findings of Macrae et al. (2002, Experiment 1) regarding facilitated gender discrimination, and subsequently measured the underlying neural responses. Our data revealed an early preferential processing of direct gaze as compared with averted gaze and closed eyes at the P1, which reverberated at the P3b (Experiment 2). Critically, using the same material, we failed to reproduce these effects when gender categorisation was not required (Experiment 3). Taken together, our data confirm that direct gaze enhances the early P1, as well as later cortical responses to face processing, although the effect appears to be task dependent.     

Dynamic emotional messages differentially affect 6-month-old infants’ attention to eyes and gaze cues

Infants often experience interactions in which caregivers use dynamic messages to convey their affective and communicative intent. These dynamic emotional messages may shape the development of emotion discrimination skills and shared attention by influencing infants’ attention to internal facial features and their responses to eye gaze cues. However, past research examining infants’ responses to emotional faces has predominantly focused on classic, stereotyped expressions (e.g., happy, sad, angry) that may not reflect the variability that infants experience in their daily interactions. The present study therefore examined forty-two 6-month-old infants’ attention to eyes vs. mouth and gaze cueing responses across multiple dynamic emotional messages that are common to infant-directed interactions. Overall, infants looked more to the eyes during messages with negative affect, but this increased attention to the eyes during these message conditions did not directly facilitate gaze cueing. Infants instead showed reliable gaze cueing only after messages with positive and neutral affect. We additionally observed gender differences in infants’ attention to internal face features and subsequent gaze cueing responses. Female infants spent more time looking at the eyes during the dynamic emotional messages and showed increased initial orienting and longer looking to gaze-cued objects following positive messages, whereas male infants showed these gaze cueing effects following neutral messages. These results suggest that variability in caregivers' communication can shape infants’ attention to and processing of emotion and gaze information.     

Real Men Don't Look Down: Direction of Gaze Affects Sex Decisions on Faces

Classifying a face as male or female was shown to be reliably affected by the direction in which the face was looking—a variable apparently unrelated to reported features of the face that show sexual dimorphism. Decisions were slower when gaze was averted downwards. Furthermore, masculinity ratings were lower for men's faces looking down than for the same faces looking ahead. One high-level (configurational) face feature that varies with the sex of the face and with direction of gaze was identified. The vertical upper-lid-to-brow distance is smaller in men than in women and becomes less salient when eyes are averted down. This display feature may have evolved to signal gender quickly and reliably, especially in alert male faces.