Effects of head orientation on gaze perception: how positive congruency effects can be reversed

Several past studies have considered how perceived head orientation may be combined with perceived gaze direction in judging where someone else is attending. In three experiments we tested the impact of different sources of information by examining the role of head orientation in gaze-direction judgements when presenting: (a) the whole face; (b) the face with the nose masked; (c) just the eye region, removing all other head-orientation cues apart from some visible part of the nose; or (d) just the eyes, with all parts of the nose masked and no head orientation cues present other than those within the eyes themselves. We also varied time pressure on gaze direction judgements. The results showed that gaze judgements were not solely driven by the eye region. Gaze perception can also be affected by parts of the head and face, but in a manner that depends on the time constraints for gaze direction judgements. While “positive” congruency effects were found with time pressure (i.e., faster left/right judgements of seen gaze when the seen head deviated towards the same side as that gaze), the opposite applied without time pressure.     

The positive and negative of human expertise in gaze perception

Judging where others look is crucial for many social and cognitive functions. Past accounts of gaze perception emphasize geometrical cues from the seen eye. Human eyes have a unique morphology, with a large white surround (sclera) to the dark iris that may have evolved to enhance gaze processing. Here we show that the contrast polarity of seen eyes has a powerful influence on gaze perception. Adult observers are highly inaccurate in judging gaze direction for images of human eyes with negative contrast polarity (regardless of whether the surrounding face is positive or negative), even though negative images of eyes preserve the geometric properties of positives that are judged accurately. The detrimental effect of negative contrast polarity is much larger for gaze perception than for other directional judgements (e.g. judging which way a head is turned). These results suggest an 'expert' system for gaze perception, which always treats the darker region of a seen eye as the part that does the looking.     

Effects of perceived mutual gaze and gender on face processing and recognition memory

Perceived gaze contact in seen faces may convey important social signals. We examined whether gaze perception affects face processing during two tasks: Online gender judgement, and later incidental recognition memory. Individual faces were presented with eyes directed either straight towards the viewer or away, while these faces were seen in either frontal or three-quarters view. Participants were slower to make gender judgements for faces with direct versus averted eye gaze, but this effect was particularly pronounced for faces with opposite gender to the observer, and seen in three-quarters view. During subsequent surprise recognition-memory testing, recognition was better for faces previously seen with direct than averted gaze, again especially for the opposite gender to the observer. The effect of direct gaze was stronger in both tasks when the head was seen in three-quarters rather than in frontal view, consistent with the greater salience of perceived eye contact for deviated faces. However, in the memory test, face recognition was also relatively enhanced for faces of opposite gender in front views when their gaze was averted rather than direct. Together, these results indicate that perceived eye contact can interact with facial processing during gender judgements and recognition memory, even when gaze direction is task-irrelevant, and particularly for faces of opposite gender to the observer (an influence which controls for stimulus factors when considering observers of both genders). These findings appear consistent with recent neuroimaging evidence that social facial cues can modulate visual processing in cortical regions involved in face processing and memory, presumably via interconnections with brain systems specialized for gaze perception and social monitoring.     

Talking heads or talking eyes? Effects of head orientation and sudden onset gaze cues on attention capture

The direction of gaze towards or away from an observer has immediate effects on attentional processing in the observer. Previous research indicates that faces with direct gaze are processed more efficiently than faces with averted gaze. We recently reported additional processing advantages for faces that suddenly adopt direct gaze (abruptly shift from averted to direct gaze) relative to static direct gaze (always in direct gaze), sudden averted gaze (abruptly shift from direct to averted gaze), and static averted gaze (always in averted gaze). Because changes in gaze orientation in previous study co-occurred with changes in head orientation, it was not clear if the effect is contingent on face or eye processing, or whether it requires both the eyes and the face to provide consistent information. The present study delineates the impact of head orientation, sudden onset motion cues, and gaze cues. Participants completed a target-detection task in which head position remained in a static averted or direct orientation while sudden onset motion and eye gaze cues were manipulated within each trial. The results indicate a sudden direct gaze advantage that resulted from the additive role of motion and gaze cues. Interestingly, the orientation of the face towards or away from the observer did not influence the sudden direct gaze effect, suggesting that eye gaze cues, not face orientation cues, are critical for the sudden direct gaze effect.     

The influence of head contour and nose angle on the perception of eye-gaze direction

We report seven experiments that investigate the influence that head orientation exerts on the perception of eye-gaze direction. In each of these experiments, participants were asked to decide whether the eyes in a brief and masked presentation were looking directly at them or were averted. In each case, the eyes could be presented alone, or in the context of congruent or incongruent stimuli In Experiment 1A, the congruent and incongruent stimuli were provided by the orientation of face features and head outline. Discrimination of gaze direction was found to be better when face and gaze were congruent than in both of the other conditions, an effect that was not eliminated by inversion of the stimuli (Experiment 1B). In Experiment 2A, the internal face features were removed, but the outline of the head profile was found to produce an identical pattern of effects on gaze discrimination, effects that were again insensitive to inversion (Experiment 2B) and which persisted when lateral displacement of the eyes was controlled (Experiment 2C). Finally, in Experiment 3A, nose angle was also found to influence participants' ability to discriminate direct gaze from averted gaze, but here the effect was eliminated by inversion of the stimuli (Experiment 3B). We concluded that an image-based mechanism is responsible for the influence of head profile on gaze perception, whereas the analysis of nose angle involves the configural processing of face features.     

Gaze cueing as a function of perceived gaze direction

Previous studies have found that attention is automatically oriented in the direction of other people's gaze. This study directly investigated whether the perceiving gaze direction modulates the orienting of observers' attention. Gaze perception was manipulated by changing the face context (head orientation) of the gaze cue: the perceived gaze angle was increased (or decreased) when the head and gaze are congruent (or incongruent), while the local‐feature information of the eye region was preserved for all stimuli. The results showed that gaze‐cueing effects were enhanced when the perceived gaze direction was averted more toward left or right, and reduced when the perceived gaze direction was closer to direct gaze. The results suggest that gaze‐cueing effects are based on mechanisms specialized for gaze perception, and the magnitude of gaze‐cueing effects was probably a function of the perceived gaze direction.     

Effects of peripheral eccentricity and head orientation on gaze discrimination

Visual search tasks support a special role for direct gaze in human cognition, while classic gaze judgement tasks suggest the congruency between head orientation and gaze direction plays a central role in gaze perception. Moreover, whether gaze direction can be accurately discriminated in the periphery using covert attention is unknown. In the present study, individual faces in frontal and in deviated head orientations with a direct or an averted gaze were flashed for 150 ms across the visual field; participants focused on a centred fixation while judging the gaze direction. Gaze discrimination speed and accuracy varied with head orientation and eccentricity. The limit of accurate gaze discrimination was less than ±6° eccentricity. Response times suggested a processing facilitation for direct gaze in fovea, irrespective of head orientation, however, by ±3° eccentricity, head orientation started biasing gaze judgements, and this bias increased with eccentricity. Results also suggested a special processing of frontal heads with direct gaze in central vision, rather than a general congruency effect between eye and head cues. Thus, while both head and eye cues contribute to gaze discrimination, their role differs with eccentricity.     

Learning and limits of use of eye gaze by capuchin monkeys (Cebus apella) in an object-choice task

The ability of 3 capuchin monkeys (Cebus apella) to use experimenter-given cues to solve an object-choice task was assessed. The monkeys learned to use explicit gestural and postural cues and then progressed to using eye-gaze-only cues to solve the task, that is, to choose the baited 1 of 2 objects and thus obtain a food reward. Increasing cue-stimulus distance and introducing movement of the eyes impeded the establishment of effective eye-gaze reading. One monkey showed positive but imperfect transfer of use of eye gaze when a novel experimenter presented the cue. When head and eye orientation cues were presented simultaneously and in conflict, the monkeys showed greater responsiveness to head orientation cues. The results show that capuchin monkeys can learn to use eye gaze as a discriminative cue, but there was no-evidence for any underlying awareness of eye gaze as a cue to direction of attention.     

Configural processing in the perception of eye-gaze direction

Traditional accounts of gaze perception emphasise the geometric or configural cues present in the eye; the position of the iris in relation to the corner of the eye, for example. This kind of geometric account has been supported, in part, by findings that gaze judgments are impaired in faces rotated through 180 degrees, a manipulation known to disrupt the processing of relations between facial elements. However, studies involving this manipulation have confounded inversion of the face context with inversion of the eye region. The effects of inversion might therefore have been caused by a disruption of the computation of gaze direction from the eye region itself and/or a disruption of the influence that face context might exert on gaze processing. In the experiment reported here we independently manipulated eye orientation and the orientation of the face context, and measured participants' sensitivity to gaze direction. Performance was severely affected by inversion of the eyes, regardless of the orientation of the face, whereas face inversion had no significant effect on gaze sensitivity. Previous reports of a face-inversion effect on gaze perception can therefore be attributed to inversion of the eye region itself which, we suggest, disrupts some form of configural or relational processing that is normally involved in the computation of eye-gaze direction.     

The mutual influence of gaze and head orientation in the analysis of social attention direction

Three experiments are reported that investigate the hypothesis that head orientation and gaze direction interact in the processing of another individual's direction of social attention. A Stroop-type interference paradigm was adopted, in which gaze and head cues were placed into conflict. In separate blocks of trials, participants were asked to make speeded keypress responses contingent on either the direction of gaze, or the orientation of the head displayed in a digitized photograph of a male face. In Experiments 1 and 2, head and gaze cues showed symmetrical interference effects. Compared with congruent arrangements, incongruent head cues slowed responses to gaze cues, and incongruent gaze cues slowed responses to head cues, suggesting that head and gaze are mutually influential in the analysis of social attention direction. This mutuality was also evident in a cross-modal version of the task (Experiment 3) where participants responded to spoken directional words whilst ignoring the head/gaze images. It is argued that these interference effects arise from the independent influences of gaze and head orientation on decisions concerning social attention direction.     

Do the eyes have it? Cues to the direction of social attention

The face communicates an impressive amount of visual information. We use it to identify its owner, how they are feeling and to help us understand what they are saying. Models of face processing have considered how we extract such meaning from the face but have ignored another important signal - eye gaze. In this article we begin by reviewing evidence from recent neurophysiological studies that suggests that the eyes constitute a special stimulus in at least two senses. First, the structure of the eyes is such that it provides us with a particularly powerful signal to the direction of another person's gaze, and second, we may have evolved neural mechanisms devoted to gaze processing. As a result, gaze direction is analysed rapidly and automatically, and is able to trigger reflexive shifts of an observer's visual attention. However, understanding where another individual is directing their attention involves more than simply analysing their gaze direction. We go on to describe research with adult participants, children and non-human primates that suggests that other cues such as head orientation and pointing gestures make significant contributions to the computation of another's direction of attention.     

面孔-人格知觉中眼部线索及其效应

人们常常会基于他人面孔特征对其人格做出相应推论。在影响面孔-人格知觉的五官特征中, 眼部特征最具复杂性。总体上, 眼部线索可分为可变和不可变两大类。可变线索包括注视方向、眼睑开放程度与眼部区域的表情等; 不可变线索包括眼睛大小、巩膜着色程度、虹膜颜色以及巩膜暴露指数等。从以上线索效应的潜在作用机制来看, 可以将眼部线索分为三大类, 即受病理因素影响的眼部线索、与特定群体相关的眼部线索和受主观意识或生理因素调控的眼部线索。此外, 也进一步指出了未来研究还需加以考虑的其他眼部特征效应, 以及待拓展深入的研究视角。     

面孔部件在群体注意方向判断中的作用

探讨面孔部件(眼睛和鼻子)在个体和群体注意方向判断中的作用。实验1使用不同数量面孔的图片,要求报告群体或个体的注意方向。结果发现,多面孔条件下对群体注意方向估计的准确性高于单面孔条件。实验2采用眼动技术,探讨眼睛和鼻子在判断其注意方向时注视的空间与时间分布特征。结果发现,基于单张面孔判断时,对鼻子的总注视时间长于眼睛;基于多张面孔判断时,对眼睛和鼻子的总注视时间没有差异。整个研究表明,知觉个体注意主要依赖鼻子,知觉群体注意依赖眼睛和鼻子。     

Are you looking at me? Measuring the cone of gaze

The processing of gaze cues plays an important role in social interactions, and mutual gaze in particular is relevant for natural as well as video-mediated communications. Mutual gaze occurs when an observer looks at or in the direction of the eyes of another person. The authors chose the metaphor of a cone of gaze to characterize this range of gaze directions that constitutes "looking at" another person. In 4 experiments using either a real person or a virtual head, the authors investigated the influences of observer distance, head orientation, visibility of the eyes, and the presence of a 2nd head on the perceived direction and width of the gaze cone. The direction of the gaze cone was largely affected by all experimental manipulations, whereas its angular width remained comparatively stable.     

自闭症谱系障碍儿童在多重线索下习得词语的眼动研究

本文利用眼动追踪技术在基线、一致和矛盾3种实验条件下考察感知觉线索和社会性线索在自闭症谱系障碍儿童词语习得中的相对作用。行为数据结果表明, 此类儿童在矛盾条件下选择枯燥物体作为新异词语的所指对象, 这说明社会性线索较之于感知觉线索具有优势作用; 而他们在基线和一致条件下选择有趣物体作为新异词语的所指对象, 且一致条件的词语习得成绩优于基线条件, 这说明社会性线索较之于感知觉线索具有促进作用。眼动数据结果表明, 此类儿童在脸部注视模式和视线追随行为上与普通儿童存在差异。这说明, 虽然社会性线索在此类儿童与普通儿童的词语习得中具有相同的相对作用, 但他们获取社会性信息的方式与普通儿童存在差异。     

Eastern observers cannot inhibit their gaze to eye and nose regions in face perception

It has been found that Western observers cannot inhibit their gaze to the eye region, even if they are told to avoid doing so when they observe face stimuli because of the importance of the eye region. However, studies indicate that the nose region is more important for face processing among Eastern observers. We used the “don’t look” paradigm with Eastern observers, in which participants were told to avoid fixating on a specific region (eye, nose, and mouth). The results extend previous findings as both the eye and nose regions attracted their gaze. Interestingly, the fixation behaviors differed for the eyes and nose in terms of the time-dependent view, in which reflexive saccades to the eye with a persistent fixation to the nose were observed. The nose regions could have stronger attractiveness than previously thought.     

Face in profile view reduces perceived facial expression intensity: An eye-tracking study

Recent studies measuring the facial expressions of emotion have focused primarily on the perception of frontal face images. As we frequently encounter expressive faces from different viewing angles, having a mechanism which allows invariant expression perception would be advantageous to our social interactions. Although a couple of studies have indicated comparable expression categorization accuracy across viewpoints, it is unknown how perceived expression intensity and associated gaze behaviour change across viewing angles. Differences could arise because diagnostic cues from local facial features for decoding expressions could vary with viewpoints. Here we manipulated orientation of faces (frontal, mid-profile, and profile view) displaying six common facial expressions of emotion, and measured participants' expression categorization accuracy, perceived expression intensity and associated gaze patterns. In comparison with frontal faces, profile faces slightly reduced identification rates for disgust and sad expressions, but significantly decreased perceived intensity for all tested expressions. Although quantitatively viewpoint had expression-specific influence on the proportion of fixations directed at local facial features, the qualitative gaze distribution within facial features (e.g., the eyes tended to attract the highest proportion of fixations, followed by the nose and then the mouth region) was independent of viewpoint and expression type. Our results suggest that the viewpoint-invariant facial expression processing is categorical perception, which could be linked to a viewpoint-invariant holistic gaze strategy for extracting expressive facial cues.     

Gaze as depicted in Vermeer's Girl with a Pearl Earring

Ten observers viewed Vermeer's painting Girl With a Pearl Earring and estimated her direction of gaze when her eyes were exposed together and separately. The observers also viewed the painting when her eyes were digitally replaced by those of a real person. The authors found that Vermeer painted the girl's eyes with a precision that was near the limits of visual acuity. Also, Vermeer included 3 gaze illusions, none of which researchers have documented as known in Vermeer's time: (a) when a model whose head is turned to one side gazes at an observer, there is an illusion that she is looking to the side of the observer away from the direction of her head turn; (b) when a model's eyes are viewed separately, they appear to gaze outward relative to each other; and (c) when both of a model's eyes are viewed, the perceived direction of gaze follows that of the nearer eye.     

Take a look at the bright side: effects of contrast polarity on gaze direction judgments

Observers are inaccurate when judging the gaze direction of eyes shown in negative rather than positive polarity. On the basis of this polarity effect, it has been proposed that gaze is perceived as directed from the dark part of the eye. Our experiment investigated whether direction judgments simply follow this heuristic, as has been suggested. Participants judged the gaze direction of eyes shown at different eccentricities in positive or negative polarity. The error pattern revealed that most errors were incorrect "straight" judgments, suggesting that judgments do not merely follow the heuristic "the dark part does the looking." We suggest that gaze judgments are based on the outcome of a competition between gaze direction signals: Whereas luminance cues may indicate that gaze is directed from the dark part of the eye, geometric cues may indicate the opposite. This interpretation is supported by reduced overall error rates, and fewer incorrect "straight" responses, for more extreme gaze directions.     

Look away! Eyes and arrows engage oculomotor responses automatically

The present study investigates how people’s voluntary saccades are influenced by where another person is looking, even when this is counterpredictive of the intended saccade direction. The color of a fixation point instructed participants to make saccades either to the left or right. These saccade directions were either congruent or incongruent with the eye gaze of a centrally presented schematic face. Participants were asked to ignore the eyes, which were congruent only 20% of the time. At short gaze—fixation-cue stimulus onset asynchronies (SOAs; 0 and 100 msec), participants made more directional errors on incongruent than on congruent trials. At a longer SOA (900 msec), the pattern tended to reverse. We demonstrate that a perceived eye gaze results in an automatic saccade following the gaze and that the gaze cue cannot be ignored, even when attending to it is detrimental to the task. Similar results were found for centrally presented arrow cues, suggesting that this interference is not unique to gazes.