Look into my eyes: gaze direction and person memory

The current research considered the effects of gaze direction on a fundamental aspect of social cogition: person memory. It was anticipated that a person's direction of gaze (i.e., direct or averted) would impact his or her subsequent memorability, such that recognition would be enhanced for targets previously displaying direct gaze. In Experiment 1, participants were presented with faces displaying either direct or averted gaze in a person-classification (i.e., conceptual) task. Then, in a surprise memory test, they were required to report whether a presented face had been seen before. As expected, a recognition advantage was observed for targets displaying direct gaze during the initial classification task. This finding was replicated and extended in a second experiment in which participants initially reported the spatial location (i.e., perceptual task) of each face. We consider the implications of these findings for basic aspects of social-cognitive functioning and person perception.     

Objects capture perceived gaze direction

The interpretation of another person's eye gaze is a key element of social cognition. Previous research has established that this ability develops early in life and is influenced by the person's head orientation, as well as local features of the person's eyes. Here we show that the presence of objects in the attended space also has an impact on gaze interpretation. Eleven normal adults identified the fixation points of photographed faces with a mouse cursor. Their responses were systematically biased toward the locations of nearby objects. This capture of perceived gaze direction probably reflects the attribution of intentionality and has methodological implications for research on gaze perception.     

Subliminal gaze cues increase preference levels for items in the gaze direction

Another individual’s gaze automatically shifts an observer’s attention to a location. This reflexive response occurs even when the gaze is presented subliminally over a short period. Another’s gaze also increases the preference level for items in the gaze direction; however, it was previously unclear if this effect occurs when the gaze is presented subliminally. This study showed that the preference levels for nonsense figures looked at by a subliminal gaze were significantly greater than those for items that were subliminally looked away from (Task 1). Targets that were looked at by a subliminal gaze were detected faster (Task 2); however, the participants were unable to detect the gaze direction (Task 3). These results indicate that another individual’s gaze automatically increases the preference levels for items in the gaze direction without conscious awareness.     

Luminance-induced shift in the apparent direction of gaze

Changing the luminance of one side of the sclera induces an apparent shift of the perceived direction of gaze toward the darker side of the sclera. This luminance-induced gaze shift was measured in photographic and schematic images of eyes. The effect was substantial: a moderate darkening of one side of the sclera induced an apparent shift of 8 to 10 deg of gaze; the maximum darkening induced a shift of 15 deg of gaze or more. The effect of scleral darkening was also compared to the gaze shift induced by an actual shift of the iris. The effects of the two cues were measured independently and in combination. When pitted against each other, their effects could be nulled, demonstrating that they act on a common level. Predictions of the relative strengths of the luminance and iris shift cues were developed for two simple luminance-based mechanisms: flux ratio and luminance centroid. The data showed the luminance cue was less effective than the models predicted in determining gaze direction. As an alternative source for the gaze shift, irradiation effects on apparent size could create a perceived shift in the iris position but a direct measure of the irradiation shift showed that this was far too small. The results suggest that at least one important mechanism for gaze judgment is based on low-level analysis of the luminance configuration within the eye.     

The effect of gaze on gaze direction while looking at art

In highly controlled cuing experiments, conspecific gaze direction has powerful effects on an observer’s attention. We explored the generality of this effect by using paintings in which the gaze direction of a key character had been carefully manipulated. Our observers looked at these paintings in one of three instructional states (neutral, social, or spatial) while we monitored their eye movements. Overt orienting was much less influenced by the critical gaze direction than what the cuing literature might suggest: An analysis of the direction of saccades following the first fixation of the critical gaze showed that observers were weakly biased to orient in the direction of the gaze. Over longer periods of viewing, however, this effect disappeared for all but the social condition. This restriction of gaze as an attentional cue to a social context is consistent with the idea that the evolution of gaze direction detection is rooted in social communication. The picture stimuli from this experiment can be downloaded from the Psychonomic Society’s Archive of Norms, Stimuli, and Data, www.psychonomic.org/archive.     

Emotional expression modulates perceived gaze direction

Gaze perception is an important social skill, as it portrays information about what another person is attending to. Gaze direction has been shown to affect interpretation of emotional expression. Here the authors investigate whether the emotional facial expression has a reciprocal influence on interpretation of gaze direction. In a forced-choice yes-no task, participants were asked to judge whether three faces expressing different emotions (anger, fear, happiness, and neutral) in different viewing angles were looking at them or not. Happy faces were more likely to be judged as looking at the observer than were angry, fearful, or neutral faces. Angry faces were more often judged as looking at the observer than were fearful and neutral expressions. These findings are discussed on the background of approach and avoidance orientation of emotions and of the self-referential positivity bias.     

Spatial interference between gaze direction and gaze location: A study on the eye contact effect

Perceived gaze in faces is an important social cue that influences spatial orienting of attention. In three experiments, we examined whether the social relevance of gaze direction modulated spatial interference in response selection, using three different stimuli: faces, isolated eyes, and symbolic eyes (Experiments 1, 2, and 3, respectively). Each experiment employed a variant of the spatial Stroop paradigm in which face location and gaze direction were put into conflict. Results showed a reverse congruency effect between face location to the right or left of fixation and gaze direction only for stimuli with a social meaning to participants (Experiments 1 and 2). The opposite was observed for the nonsocial stimuli used in Experiment 3. Results are explained as facilitation in response to eye contact.     

Exploiting human sensitivity to gaze for tracking the eyes

Given the prevalence, quality, and low cost of web cameras, along with the remarkable human sensitivity to gaze, we examined the accuracy of eye tracking using only a web camera. Participants were shown webcamera recordings of a person’s eyes moving 1°, 2°, or 3° of visual angle in one of eight radial directions (north, northeast, east, southeast, etc.), or no eye movement occurred at all. Observers judged whether an eye movement was made and, if so, its direction. Our findings demonstrate that for all saccades of any size or direction, observers can detect and discriminate eye movements significantly better than chance. Critically, the larger the saccade, the better the judgments, so that for eye movements of 3°, people can tell whether an eye movement occurred, and where it was going, at about 90% or better. This simple methodology of using a web camera and looking for eye movements offers researchers a simple, reliable, and cost-effective research tool that can be applied effectively both in studies where it is important that participants maintain central fixation (e.g., covert attention investigations) and in those where they are free or required to move their eyes (e.g., visual search).     

Preferred gaze direction and the vergence system at rest]

In two experiments the effects of binocular vergence, head tilt, and prolonged gaze inclination on the preferred vertical gaze direction were studied. Concurrently, dark vergence was measured to test a hypothesis on the effect that binocular vergence has on the preferred vertical direction of gaze. The previously reported influence of observation distance on the preferred gaze inclination was replicated. When the head was tilted backward, the preferred gaze inclination was lower and the effect of observation distance was reduced; when the head was tilted forward, the preferred gaze inclination was higher and the effect of observation distance was increased. After prolonged upward or downward gaze inclination the preferred vertical gaze direction was shifted up or down, respectively, while the effect of observation distance remained constant. Overall the change of the preferred vertical direction of gaze upon binocular fixation of near stimuli was accompanied by a reduced discrepancy between convergence and the resting state of the vergence system; additional implications of the hypothesis on the relation between individual resting vergence and the effect of observation distance on the preferred inclination of gaze could not be substantiated.     

Spatial interference between gaze direction and gaze location: a study on the eye contact effect

Perceived gaze in faces is an important social cue that influences spatial orienting of attention. In three experiments, we examined whether the social relevance of gaze direction modulated spatial interference in response selection, using three different stimuli: faces, isolated eyes, and symbolic eyes (Experiments 1, 2, and 3, respectively). Each experiment employed a variant of the spatial Stroop paradigm in which face location and gaze direction were put into conflict. Results showed a reverse congruency effect between face location to the right or left of fixation and gaze direction only for stimuli with a social meaning to participants (Experiments 1 and 2). The opposite was observed for the nonsocial stimuli used in Experiment 3. Results are explained as facilitation in response to eye contact.     

Perceived gaze direction and the processing of facial displays of emotion

There is good reason to believe that gaze direction and facial displays of emotion share an information value as signals of approach or avoidance. The combination of these cues in the analysis of social communication, however, has been a virtually neglected area of inquiry. Two studies were conducted to test the prediction that direct gaze would facilitate the processing of facially communicated approach-oriented emotions (e.g., anger and joy), whereas averted gaze would facilitate the processing of facially communicated avoidance-oriented emotions (e.g., fear and sadness). The results of both studies confirmed the central hypothesis and suggest that gaze direction and facial expression are combined in the processing of emotionally relevant facial information.     

Influence of emotional expression on the processing of gaze direction

Research demonstrates an influence of gaze direction in emotion recognition. Here we examined whether facial affect similarly influences recognition of gaze direction. Across two studies we found that averted relative to direct gaze was processed more quickly and accurately when coupled with fear, and direct relative to averted gaze with anger. Also evident was that slower overall gaze processing was associated with increased interaction effects between emotion and gaze. Examining individual differences, therefore, enabled us to extend previous research examining speed of processing as a moderator of the interaction effect, while holding constant task demands and stimulus features. Unexpectedly, a main effect emerged such that averted relative to direct gaze was found to be processed more quickly and accurately overall. This effect was not moderated by processing speed and is discussed as a potential stimulus-driven effect that may help explain discrepant findings in the literature.

Perception of gaze direction based on luminance ratio

Changing the luminance of one side of the sclera induces an apparent shift of the perceived direction of gaze toward the darker side of the sclera (Ando, 2002 Perception 31 657-674). However, when both the sclera and the skin surrounding it were darkened simultaneously as if by a cast shadow, the apparent direction of gaze shifted less than when only the sclera was darkened. The results suggest that one mechanism for gaze judgment is based on a simple analysis of the local luminance ratio between the eye and the surrounding region.     

The functional arrangement of objects biases gaze direction

Psychonomic Bulletin & Review - A growing number of studies suggest that semantic knowledge can influence the control of gaze in scenes. For example, observers are more likely to look toward...     

Effects of facial expression and gaze direction on approach-avoidance behaviour

Humans must coordinate approach-avoidance behaviours with the social cues that elicit them, such as facial expressions and gaze direction. We hypothesised that when someone is observed looking in a particular direction with a happy expression, the observer would tend to approach that direction, but that when someone is observed looking in a particular direction with a fearful expression, the observer would tend to avoid that direction. Twenty-eight participants viewed stimulus faces with averted gazes and happy or fearful expressions on a computer screen. Participants were asked to grasp (approach) or withdraw from (avoid) a left- or right-hand button depending on the stimulus face's expression. The results were consistent with our hypotheses about avoidance responses, but not with respect to approach responses. Links between social cues and adaptive behaviour are discussed.     

Pointing with the eyes: the role of gaze in communicating danger

Facial expression and direction of gaze are two important sources of social information, and what message each conveys may ultimately depend on how the respective information interacts in the eye of the perceiver. Direct gaze signals an interaction with the observer but averted gaze amounts to "pointing with the eyes", and in combination with a fearful facial expression may signal the presence of environmental danger. We used fMRI to examine how gaze direction influences brain processing of facial expression of fear. The combination of fearful faces and averted gazes activated areas related to gaze shifting (STS, IPS) and fear-processing (amygdala, hypothalamus, pallidum). Additional modulation of activation was observed in motion detection areas, in premotor areas and in the somatosensory cortex, bilaterally. Our results indicate that the direction of gaze prompts a process whereby the brain combines the meaning of the facial expression with the information provided by gaze direction, and in the process computes the behavioral implications for the observer.     

Gaze cueing as a function of perceived gaze direction

Previous studies have found that attention is automatically oriented in the direction of other people's gaze. This study directly investigated whether the perceiving gaze direction modulates the orienting of observers' attention. Gaze perception was manipulated by changing the face context (head orientation) of the gaze cue: the perceived gaze angle was increased (or decreased) when the head and gaze are congruent (or incongruent), while the local‐feature information of the eye region was preserved for all stimuli. The results showed that gaze‐cueing effects were enhanced when the perceived gaze direction was averted more toward left or right, and reduced when the perceived gaze direction was closer to direct gaze. The results suggest that gaze‐cueing effects are based on mechanisms specialized for gaze perception, and the magnitude of gaze‐cueing effects was probably a function of the perceived gaze direction.     

Integrating gaze direction and expression in preferences for attractive faces

Few studies have investigated how physical and social facial cues are integrated in the formation of face preferences. Here we show that expression differentially qualifies the strength of attractiveness preferences for faces with direct and averted gaze. For judgments of faces with direct gaze, attractiveness preferences were stronger for smiling faces than for faces with neutral expressions. By contrast, for judgments of faces with averted gaze, attractiveness preferences were stronger for faces with neutral expressions than for smiling faces. Because expressions can differ in meaning depending on whether they are directed toward or away from oneself, it is only by integrating gaze direction, facial expression, and physical attractiveness that one can unambiguously identify the most attractive individuals who are likely to reciprocate one's own social interest.     

The interaction between gaze direction and facial expressions in newborns

The ability to decode facial expressions is an important component of social interaction and functioning. This ability is even more fundamental early in life, prior to the development of verbal communication. However, it is still unclear whether newborns can detect, discriminate and process facial expressions, and, if so, what the mechanisms underlying this ability are. In this study, we extend the investigation of perceived emotional expression by manipulating gaze direction with different facial expressions. Specifically, newborns were presented with faces displaying neutral, fearful, or happy facial expressions accompanied with direct or averted gaze, and tested in a visual preference paradigm. Four experiments were conducted in which different combinations of expression and gaze were used. However, only in the fourth experiment did newborns show a visual preference for a specific emotional display; they looked significantly longer at a happy face than a neutral one only when both were accompanied with direct gaze. These results provide support for the advantage of happy facial expressions in the development of a face processing system and suggest that this preference reflects experience acquired during the first few days after birth.