The impact of eye contact on the sense of agency

Recent research suggests that eye contact can lead to enhanced self-awareness. A related phenomenon, the sense of agency deals with the notion of the self as the origin of our actions. Possible links between eye contact and agency have been so far neglected. Here, we investigated whether an implicit sense of agency could be modulated by eye gaze. We asked participants to respond (button press) to a face stimulus: looking or not at the participant (experiment 1); or displaying distinct eye gaze before or after a mask (experiment 2). After each trial, participants estimated the time between their key press and the ensuing effects. We found enhanced intentional binding for conditions that involved direct compared to averted gaze. This study supports the idea that eye contact is an important cue that affects complex cognitive processes and suggests that modulating self-processing can impact the sense of agency.     

Configural processing in the perception of eye-gaze direction

Traditional accounts of gaze perception emphasise the geometric or configural cues present in the eye; the position of the iris in relation to the corner of the eye, for example. This kind of geometric account has been supported, in part, by findings that gaze judgments are impaired in faces rotated through 180 degrees, a manipulation known to disrupt the processing of relations between facial elements. However, studies involving this manipulation have confounded inversion of the face context with inversion of the eye region. The effects of inversion might therefore have been caused by a disruption of the computation of gaze direction from the eye region itself and/or a disruption of the influence that face context might exert on gaze processing. In the experiment reported here we independently manipulated eye orientation and the orientation of the face context, and measured participants' sensitivity to gaze direction. Performance was severely affected by inversion of the eyes, regardless of the orientation of the face, whereas face inversion had no significant effect on gaze sensitivity. Previous reports of a face-inversion effect on gaze perception can therefore be attributed to inversion of the eye region itself which, we suggest, disrupts some form of configural or relational processing that is normally involved in the computation of eye-gaze direction.     

Effects of direct and averted gaze on the subsequent saccadic response

The saccadic latency to visual targets is susceptible to the properties of the currently fixated objects. For example, the disappearance of a fixation stimulus prior to presentation of a peripheral target shortens saccadic latencies (the gap effect). In the present study, we investigated the influences of a social signal from a facial fixation stimulus (i.e., gaze direction) on subsequent saccadic responses in the gap paradigm. In Experiment 1, a cartoon face with a direct or averted gaze was used as a fixation stimulus. The pupils of the face were unchanged (overlap), disappeared (gap), or were translated vertically to make or break eye contact (gaze shift). Participants were required to make a saccade toward a target to the left or the right of the fixation stimulus as quickly as possible. The results showed that the gaze direction influenced saccadic latencies only in the gaze shift condition, but not in the gap or overlap condition; the direct-to-averted gaze shift (i.e., breaking eye contact) yielded shorter saccadic latencies than did the averted-to-direct gaze shift (i.e., making eye contact). Further experiments revealed that this effect was eye contact specific (Exp. 2) and that the appearance of an eye gaze immediately before the saccade initiation also influenced the saccadic latency, depending on the gaze direction (Exp. 3). These results suggest that the latency of target-elicited saccades can be modulated not only by physical changes of the fixation stimulus, as has been seen in the conventional gap effect, but also by a social signal from the attended fixation stimulus.     

Eye-contact perception in schizophrenia: relationship with symptoms and socioemotional functioning

Accurately perceiving self-referential social signals, particularly eye contact, is critical to social adaptation. Schizophrenia is often accompanied by deficits in social cognition, but it is unclear whether this includes gaze discrimination deficits. This study investigated whether eye-contact perception is preserved or impaired and if it is related to symptoms and broader socioemotional functioning in schizophrenia. Twenty-six participants with schizophrenia (SCZ) and 23 healthy controls (HC) made eye-contact judgments for faces in varying gaze direction (from averted to direct in ten 10% increments), head orientation (forward, 30° averted), and emotion (neutral, fearful). Psychophysical analyses for forward faces showed that SCZ began endorsing eye contact with weaker eye-contact signal and their eye-contact perception was less of a dichotomous function, as compared with HC. SCZ were more likely than HC to endorse eye contact when gaze was ambiguous, and this overperception of eye contact was modulated by head orientation and emotion. Overperception of eye contact was associated with more severe negative symptoms. Decreased categorical gaze perception explained variance of socioemotional deficits in schizophrenia after taking basic neurocognition into consideration, suggesting the relationship was not solely due to a general deficit problem. These results were discussed in relation to the nature of categorical gaze perception and its significance to clinical and functional presentations of schizophrenia.     

Effects of perceived mutual gaze and gender on face processing and recognition memory

Perceived gaze contact in seen faces may convey important social signals. We examined whether gaze perception affects face processing during two tasks: Online gender judgement, and later incidental recognition memory. Individual faces were presented with eyes directed either straight towards the viewer or away, while these faces were seen in either frontal or three-quarters view. Participants were slower to make gender judgements for faces with direct versus averted eye gaze, but this effect was particularly pronounced for faces with opposite gender to the observer, and seen in three-quarters view. During subsequent surprise recognition-memory testing, recognition was better for faces previously seen with direct than averted gaze, again especially for the opposite gender to the observer. The effect of direct gaze was stronger in both tasks when the head was seen in three-quarters rather than in frontal view, consistent with the greater salience of perceived eye contact for deviated faces. However, in the memory test, face recognition was also relatively enhanced for faces of opposite gender in front views when their gaze was averted rather than direct. Together, these results indicate that perceived eye contact can interact with facial processing during gender judgements and recognition memory, even when gaze direction is task-irrelevant, and particularly for faces of opposite gender to the observer (an influence which controls for stimulus factors when considering observers of both genders). These findings appear consistent with recent neuroimaging evidence that social facial cues can modulate visual processing in cortical regions involved in face processing and memory, presumably via interconnections with brain systems specialized for gaze perception and social monitoring.     

Genuine eye contact elicits self-referential processing

The effect of eye contact on self-awareness was investigated with implicit measures based on the use of first-person singular pronouns in sentences. The measures were proposed to tap into self-referential processing, that is, information processing associated with self-awareness. In addition, participants filled in a questionnaire measuring explicit self-awareness. In Experiment 1, the stimulus was a video clip showing another person and, in Experiment 2, the stimulus was a live person. In both experiments, participants were divided into two groups and presented with the stimulus person either making eye contact or gazing downward, depending on the group assignment. During the task, the gaze stimulus was presented before each trial of the pronoun-selection task. Eye contact was found to increase the use of first-person pronouns, but only when participants were facing a real person, not when they were looking at a video of a person. No difference in self-reported self-awareness was found between the two gaze direction groups in either experiment. The results indicate that eye contact elicits self-referential processing, but the effect may be stronger, or possibly limited to, live interaction.     

Effects of gaze‐aversion on visual‐spatial imagination

Research suggests that averting gaze from an interlocutor can improve both children's and adults' performance in a range of cognitive tasks. With the present experiments, we investigated the effect of gaze aversion on adults' visual‐spatial imagination, using a methodology adapted from Kerr (1987). Participants mentally kept track of a pathway through an imaginary matrix, while either maintaining eye‐contact with the experimenter, closing their eyes, gazing at a static or a dynamic visual stimulus (in Experiment 1), or fixating an upright or inverted image of the experimenter's face (in Experiment 2). The results show that whereas maintaining eye‐contact with another person disrupts accurate imagination of this pathway, averting gaze or looking at other visual stimuli does not. We conclude that gaze aversion benefits cognitive performance, not just by disengaging visual attention from irrelevant visual information, but also by interrupting social interaction processes involved in face‐to‐face communication.     

Infants perceiving and acting on the eyes: tests of an evolutionary hypothesis

It has been hypothesized that an evolutionarily ancient mechanism underlies the ability of human infants to detect and act upon the direction of eye gaze of another human face. However, the evidence from behavioral studies with infants is also consistent with a more domain-general system responsive to the lateral motion of stimuli regardless of whether or not eyes are involved. To address this issue three experiments with 4-month-old infants are reported that utilize a standard face-cueing paradigm. In the first experiment an inverted face was used to investigate whether the motion of the pupils elicits the cueing effect regardless of the surrounding face context. In the second experiment pupil motion and eye gaze direction were opposed, allowing us to assess their relative importance. In a third experiment, a more complex gaze shift sequence allowed us to analyse the importance of beginning with a period of mutual gaze. Overall, the results were consistent with the importance of the perceived direction of motion of pupils. However, to be effective in cueing spatial locations this motion needs to be preceded by a period of direct mutual gaze (eye contact). We suggest that evolution results in information-processing biases that shape and constrain the outcome of individual development to eventually result in adult adaptive specializations.     

Mentalizing eye contact with a face on a video: Gaze direction does not influence autonomic arousal

Recent research has revealed enhanced autonomic and subjective responses to eye contact only when perceiving another live person. However, these enhanced responses to eye contact are abolished if the viewer believes that the other person is not able to look back at the viewer. We purported to investigate whether this “genuine” eye contact effect can be reproduced with pre‐recorded videos of stimulus persons. Autonomic responses, gaze behavior, and subjective self‐assessments were measured while participants viewed pre‐recorded video persons with direct or averted gaze, imagined that the video person was real, and mentalized that the person could see them or not. Pre‐recorded videos did not evoke similar physiological or subjective eye contact effect as previously observed with live persons, not even when the participants were mentalizing being seen by the person. Gaze tracking results showed, however, increased attention allocation to faces with direct gaze compared to averted gaze directions. The results suggest that elicitation of the physiological arousal in response to genuine eye contact seems to require spontaneous experience of seeing and of being seen by another individual.     

Facial attractiveness biases the perception of eye contact

Attractive faces are appealing: We like to look at them, and we like to be looked at by them. We presented attractive and unattractive smiling and neutral faces containing identical eye regions with different gaze directions. Participants judged whether or not a face looked directly at them. Overall, attractive faces increased participants' tendency to perceive eye contact, consistent with a self-referential positivity bias. However, attractiveness effects were modulated by facial expression and gender: For female faces, observers more likely perceived eye contact in attractive than unattractive faces, independent of expression. For male faces, attractiveness effects were limited to neutral expressions and were absent in smiling faces. A signal detection analysis elucidated a systematic pattern in which (a) smiling faces, but not highly attractive faces, reduced sensitivity in gaze perception overall, and (b) attractiveness had a more consistent impact on bias than sensitivity measures. We conclude that combined influences of attractiveness, expression, and gender determine the formation of an overall impression when deciding which individual's interest in oneself may be beneficial and should be reciprocated.     

The positive and negative of human expertise in gaze perception

Judging where others look is crucial for many social and cognitive functions. Past accounts of gaze perception emphasize geometrical cues from the seen eye. Human eyes have a unique morphology, with a large white surround (sclera) to the dark iris that may have evolved to enhance gaze processing. Here we show that the contrast polarity of seen eyes has a powerful influence on gaze perception. Adult observers are highly inaccurate in judging gaze direction for images of human eyes with negative contrast polarity (regardless of whether the surrounding face is positive or negative), even though negative images of eyes preserve the geometric properties of positives that are judged accurately. The detrimental effect of negative contrast polarity is much larger for gaze perception than for other directional judgements (e.g. judging which way a head is turned). These results suggest an 'expert' system for gaze perception, which always treats the darker region of a seen eye as the part that does the looking.     

威胁相关面孔表情对眼睛注视方向知觉的影响

以往研究发现眼睛注视方向知觉受面孔表情的影响,愤怒面孔相较于恐惧面孔更倾向被判断为看着观察者。虽然研究者对此提出了不同的解释,但目前尚不清楚愤怒和恐惧表情在注视方向知觉中的这种差异影响到底来自于面孔的结构信息还是物理特征信息。本研究采用注视方向辨别任务,计算直视知觉范围（The Cone of Direct Gaze,CoDG）为因变量,分别以直立,倒置及模糊图片为实验材料,试图通过分离面孔结构信息和物理特征信息,对以上问题进行探讨。结果发现在保留面孔全部信息的情况下（实验1）愤怒面孔的CoDG大于恐惧面孔;在破坏结构信息加工,只保留特征信息加工的情况下（实验2））愤怒和恐惧表情在直视知觉范围上的差异消失了;在削弱物理特征信息加工,保留结构信息加工的情况下（实验3）二者在CoDG上的差异又复现。本研究结果说明不同威胁性面孔表情对眼睛注视知觉的影响主要来自于二者在与情绪意义相关的结构信息加工上的不同,而二者非低级的物理信息上的差异,支持信号共享假说和情绪评价假说对威胁性面孔表情与注视方向整合加工解释的理论基础。     

Understanding the referential nature of looking: infants' preference for object-directed gaze

In four experiments, we investigated whether 9-month-old infants are sensitive to the relationship between gaze direction and object location and whether this sensitivity depends on the presence of communicative cues like eye contact. Infants observed a face, which repeatedly shifted its eyes either toward, or away from, unpredictably appearing objects. We found that they looked longer at the face when the gaze shifts were congruent with the location of the object. A second experiment ruled out that this effect was simply due to spatial congruency, while a third and a fourth experiment revealed that a preceding period of eye contact is required to elicit the gaze-object congruency effect. These results indicate that infants at this age can encode eye direction in referential terms in the presence of communication cues and are biased to attend to scenes with object-directed gaze.     

Gaze cueing as a function of perceived gaze direction

Previous studies have found that attention is automatically oriented in the direction of other people's gaze. This study directly investigated whether the perceiving gaze direction modulates the orienting of observers' attention. Gaze perception was manipulated by changing the face context (head orientation) of the gaze cue: the perceived gaze angle was increased (or decreased) when the head and gaze are congruent (or incongruent), while the local‐feature information of the eye region was preserved for all stimuli. The results showed that gaze‐cueing effects were enhanced when the perceived gaze direction was averted more toward left or right, and reduced when the perceived gaze direction was closer to direct gaze. The results suggest that gaze‐cueing effects are based on mechanisms specialized for gaze perception, and the magnitude of gaze‐cueing effects was probably a function of the perceived gaze direction.     

Facial attractiveness biases the perception of eye contact

Attractive faces are appealing: We like to look at them, and we like to be looked at by them. We presented attractive and unattractive smiling and neutral faces containing identical eye regions with different gaze directions. Participants judged whether or not a face looked directly at them. Overall, attractive faces increased participants' tendency to perceive eye contact, consistent with a self-referential positivity bias. However, attractiveness effects were modulated by facial expression and gender: For female faces, observers more likely perceived eye contact in attractive than unattractive faces, independent of expression. For male faces, attractiveness effects were limited to neutral expressions and were absent in smiling faces. A signal detection analysis elucidated a systematic pattern in which (a) smiling faces, but not highly attractive faces, reduced sensitivity in gaze perception overall, and (b) attractiveness had a more consistent impact on bias than sensitivity measures. We conclude that combined influences of attractiveness, expression, and gender determine the formation of an overall impression when deciding which individual's interest in oneself may be beneficial and should be reciprocated.     

眼睛注视的知觉及其线索效应

对眼睛注视知觉、眼睛注视线索效应及其影响因素等相关研究进行了总结和分析。结果发现:(1)婴儿从一出生就对眼睛注视线索表现出强烈的敏感性,眼睛注视知觉对语言和社会等能力的发展有很大影响;(2)颞上沟是加工眼睛注视线索的特异神经结构,它与实时监控情绪和情感的杏仁核存在神经联结,成为社会认知神经系统的重要组成部分;(3)对眼睛注视线索的早期加工显示出特异的脑电活动模式;(4)眼睛注视线索效应与外周线索的反射式效应相类似,但持续时间较长;(5)眼睛注视线索效应不仅受面部结构信息的影响,也受自上而下加工等高水平认知因素的调节,并显示出明显的个体差异。对眼睛注视线索效应的进一步研究应涉及人格判断、喜好评价和心理理论等高级社会认知活动。     

Looking the other way: The role of gaze direction in the cross-race memory effect

One of the most replicable findings reported in the social psychological literature is the cross-race memory effect. We argue this effect derives from higher-order interactions among social cues that determine the perceived relevance of a face to an observer. The current research tested this hypothesis by examining the combined influences of eye gaze direction and race on face memory. The physical subtlety of eye gaze belies its powerful influence on social perception, and in this case helps specify the relevance of same- versus other-race faces. We found that only in faces making direct eye contact—not those displaying averted eye gaze—was the cross-race memory effect evident. Likewise, only in same-race faces did direct relative to averted-gaze enhance face memory. These findings have implications for our general understanding of the combinatorial nature of social perception and help clarify the underlying cause of the cross-race memory effect.     

Why does gaze enhance mimicry? Placing gaze-mimicry effects in relation to other gaze phenomena

Eye gaze is a powerful signal, which exerts a mixture of arousal, attentional, and social effects on the observer. We recently found a behavioural interaction between eye contact and mimicry where direct gaze rapidly enhanced mimicry of hand movements ). Here, we report two detailed investigations of this effect. In Experiment 1, we compared the effects of “direct gaze”, “averted gaze”, and “gaze to the acting hand” on mimicry and manipulated the sequence of gaze events within a trial. Only direct gaze immediately before the hand action enhanced mimicry. In Experiment 2, we examined the enhancement of mimicry when direct gaze is followed by a “blink” or by “shut eyes”, or by “occluded eyes”. Enhanced mimicry relative to baseline was seen only in the blink condition. Together, these results suggest that ongoing social engagement is necessary for enhanced mimicry. These findings allow us to place the gaze-enhancement effect in the context of other reported gaze phenomena. We suggest that this effect is similar to previously reported audience effects, but is less similar to ostensive cueing effects. This has important implications for our theories of the relationships between social cues and imitation.     

Do the upright eyes have it?

Eye contact is crucial for social communication. A perceived direct gaze facilitates detection, whereas face inversion diminishes this facilitative effect (Senju, Hasegawa, & Tojo, 2005). In the present study, we adopted a visual search paradigm to investigate why a direct gaze facilitates detection in an upright face, but not in an upside-down face. Upright eyes were found to facilitate detection even when other parts of the face were inverted or absent, whereas inverted eyes had no effect on search performance. A critical role for the morphological information of upright eyes, which can be distorted by “eye inversion,” in direct gaze processing is suggested.     

Gaze behavior and affect at 6 months: predicting clinical outcomes and language development in typically developing infants and infants at risk for autism

This paper presents follow‐up longitudinal data to research that previously suggested the possibility of abnormal gaze behavior marked by decreased eye contact in a subgroup of 6‐month‐old infants at risk for autism ( Merin, Young, Ozonoff & Rogers, 2007 ). Using eye‐tracking data and behavioral data recorded during a live mother–infant interaction involving the still‐face procedure, the predictive utility of gaze behavior and affective behaviors at 6 months was examined using diagnostic outcome data obtained longitudinally over the following 18 months. Results revealed that none of the infants previously identified as showing lower rates of eye contact had any signs of autism at outcome. In contrast, three infants who were diagnosed with autism demonstrated consistent gaze to the eye region and typical affective responses at 6 months. Individual differences in face scanning and affective responsivity during the live interaction were not related to any continuous measures of symptom frequency or symptom severity. In contrast, results of growth curve models for language development revealed significant relationships between face scanning and expressive language. Greater amounts of fixation to the mother's mouth during live interaction predicted higher levels of expressive language at outcome and greater rates of growth. These findings suggest that although gaze behavior at 6 months may not provide early markers for autism as initially conceived, gaze to the mouth in particular may be useful in predicting individual differences in language development.