The effects of the presence of a face and direct eye gaze on voice identity learning

We rarely become familiar with the voice of another person in isolation but usually also have access to visual identity information, thus learning to recognize their voice and face in parallel. There are conflicting findings as to whether learning to recognize voices in audiovisual vs audio-only settings is advantageous or detrimental to learning. One prominent finding shows that the presence of a face overshadows the voice, hindering voice identity learning by capturing listeners' attention (Face Overshadowing Effect; FOE). In the current study, we tested the proposal that the effect of audiovisual training on voice identity learning is driven by attentional processes. Participants learned to recognize voices through either audio-only training (Audio-Only) or through three versions of audiovisual training, where a face was presented alongside the voices. During audiovisual training, the faces were either looking at the camera (Direct Gaze), were looking to the side (Averted Gaze) or had closed eyes (No Gaze). We found a graded effect of gaze on voice identity learning: Voice identity recognition was most accurate after audio-only training and least accurate after audiovisual training including direct gaze, constituting a FOE. While effect sizes were overall small, the magnitude of FOE was halved for the Averted and No Gaze conditions. With direct gaze being associated with increased attention capture compared to averted or no gaze, the current findings suggest that incidental attention capture at least partially underpins the FOE. We discuss these findings in light of visual dominance effects and the relative informativeness of faces vs voices for identity perception.     

Task-irrelevant direct gaze facilitates visual search for deviant facial expression

The detection of emotional expression is important particularly when the expression is directed towards the viewer. Therefore, we conjectured that the efficiency in visual search for deviant emotional expression is modulated by gaze direction, which is one of the primary clues for encoding the focus of social attention. To examine this hypothesis, two visual search tasks were conducted. In Emotional Face Search, the participants were required to detect an emotional expression amongst distractor faces with neutral expression; in Neutral Face Search they were required to detect a neutral target among emotional distractors. The results revealed that target detection was accelerated when the target face had direct gaze compared to averted gaze for fearful, angry, and neutral targets, but no effect of distractor gaze direction was observed. An additional experiment including multiple display sizes has shown a shallower search slope in search for a target face with direct gaze than that with averted gaze, indicating that the advantage of a target face with direct gaze is attributable to efficient orientation of attention towards target faces. These results indicate that direct gaze facilitates detection of target face in visual scenery even when gaze discrimination is not the primary task at hand.     

威胁相关面孔表情对眼睛注视方向知觉的影响

以往研究发现眼睛注视方向知觉受面孔表情的影响,愤怒面孔相较于恐惧面孔更倾向被判断为看着观察者。虽然研究者对此提出了不同的解释,但目前尚不清楚愤怒和恐惧表情在注视方向知觉中的这种差异影响到底来自于面孔的结构信息还是物理特征信息。本研究采用注视方向辨别任务,计算直视知觉范围（The Cone of Direct Gaze,CoDG）为因变量,分别以直立,倒置及模糊图片为实验材料,试图通过分离面孔结构信息和物理特征信息,对以上问题进行探讨。结果发现在保留面孔全部信息的情况下（实验1）愤怒面孔的CoDG大于恐惧面孔;在破坏结构信息加工,只保留特征信息加工的情况下（实验2））愤怒和恐惧表情在直视知觉范围上的差异消失了;在削弱物理特征信息加工,保留结构信息加工的情况下（实验3）二者在CoDG上的差异又复现。本研究结果说明不同威胁性面孔表情对眼睛注视知觉的影响主要来自于二者在与情绪意义相关的结构信息加工上的不同,而二者非低级的物理信息上的差异,支持信号共享假说和情绪评价假说对威胁性面孔表情与注视方向整合加工解释的理论基础。     

Pointing with the eyes: the role of gaze in communicating danger

Facial expression and direction of gaze are two important sources of social information, and what message each conveys may ultimately depend on how the respective information interacts in the eye of the perceiver. Direct gaze signals an interaction with the observer but averted gaze amounts to "pointing with the eyes", and in combination with a fearful facial expression may signal the presence of environmental danger. We used fMRI to examine how gaze direction influences brain processing of facial expression of fear. The combination of fearful faces and averted gazes activated areas related to gaze shifting (STS, IPS) and fear-processing (amygdala, hypothalamus, pallidum). Additional modulation of activation was observed in motion detection areas, in premotor areas and in the somatosensory cortex, bilaterally. Our results indicate that the direction of gaze prompts a process whereby the brain combines the meaning of the facial expression with the information provided by gaze direction, and in the process computes the behavioral implications for the observer.     

Gaze direction and facial expressions exert combined but different effects on attentional resources

Gaze direction and facial expressions are critical components of face processing and have been shown to influence attention deployment. We investigated whether gaze direction (direct vs. averted) combined with a neutral or angry expression modulates the deployment of attentional resources over time. In a Rapid Serial Visual Presentation (RSVP) paradigm participants had to decide the gender of a neutral or an angry target face with direct or averted gaze (T1) and then to judge the orientation of a target picture of a landscape (T2), following the face at different time intervals. Results showed no attentional blink effect (i.e., no deterioration in T2 accuracy) when T1 was an angry face with direct gaze, whereas it was present for angry faces with averted gaze or neutral faces with either averted or direct gaze. These findings are consistent with appraisal theories and are discussed against the background of automatic processing of threat stimuli.     

Effects of peripheral eccentricity and head orientation on gaze discrimination

Visual search tasks support a special role for direct gaze in human cognition, while classic gaze judgement tasks suggest the congruency between head orientation and gaze direction plays a central role in gaze perception. Moreover, whether gaze direction can be accurately discriminated in the periphery using covert attention is unknown. In the present study, individual faces in frontal and in deviated head orientations with a direct or an averted gaze were flashed for 150 ms across the visual field; participants focused on a centred fixation while judging the gaze direction. Gaze discrimination speed and accuracy varied with head orientation and eccentricity. The limit of accurate gaze discrimination was less than ±6° eccentricity. Response times suggested a processing facilitation for direct gaze in fovea, irrespective of head orientation, however, by ±3° eccentricity, head orientation started biasing gaze judgements, and this bias increased with eccentricity. Results also suggested a special processing of frontal heads with direct gaze in central vision, rather than a general congruency effect between eye and head cues. Thus, while both head and eye cues contribute to gaze discrimination, their role differs with eccentricity.     

Gaze avoidance in social phobia: Objective measure and correlates

Gaze aversion could be a central component of the physiopathology of social phobia. The emotions of the people interacting with a person with social phobia seem to model this gaze aversion. Our research consists of testing gaze aversion in subjects with social phobia compared to control subjects in different emotional faces of men and women using an eye tracker. Twenty-six subjects with DSM-IV social phobia were recruited. Twenty-four healthy subjects aged and sex-matched constituted the control group. We looked at the number of fixations and the dwell time in the eyes area on the pictures. The main findings of this research are: confirming a significantly lower amount of fixations and dwell time in patients with social phobia as a general mean and for the 6 basic emotions independently from gender; observing a significant correlation between the severity of the phobia and the degree of gaze avoidance. However, no difference in gaze avoidance according to subject/picture gender matching was observed. These findings confirm and extend some previous results, and suggest that eye avoidance is a robust marker of persons with social phobia, which could be used as a behavioral phenotype for brain imagery studies on this disorder.     

Carryover effect of joint attention to repeated events in chimpanzees and young children

Gaze following is a fundamental component of triadic social interaction which includes events and an object shared with other individuals and is found in both human and nonhuman primates. Most previous work has focused only on the immediate reaction after following another’s gaze. In contrast, this study investigated whether gaze following is retained after the observation of the other’s gaze shift, whether this retainment differs between species and age groups, and whether the retainment depends on the nature of the preceding events. In the social condition, subjects (1- and 2-year-old human children and chimpanzees) witnessed an experimenter who looked and pointed in the direction of a target lamp. In the physical condition, the target lamp blinked but the experimenter did not provide any cues. After a brief delay, we presented the same stimulus again without any cues. All subjects looked again to the target location after experiencing the social condition and thus showed a carryover effect. However, only 2-year-olds showed a carryover effect in the physical condition; 1-year-olds and chimpanzees did not. Additionally, only human children showed spontaneous interactive actions such as pointing. Our results suggest that the difference between the two age groups and chimpanzees is conceptual and not only quantitative.     

Modification of prenatal auditory experience alters postnatal auditory preferences of bobwhite quail chicks.

This study assessed the effects of altered prenatal auditory experience on bobwhite quail chicks' (Colinus virginianus) species-specific preference for the bobwhite maternal call. Results revealed that when the repetition rate of the embryonic vocalizations normally present in the prenatal environment was altered, the species-typical auditory preference of hatchlings for the maternal call was also altered. Specifically, embryos exposed to embryonic vocalizations with a faster repetition rate than normal subsequently preferred a bobwhite maternal call with a faster repetition rate over one with its normal repetition rate. Bobwhite embryos thus appear able to abstract features of their prenatal auditory environment to other auditory events in the postnatal period. This demonstration of prenatal perceptual learning is in keeping with other recent studies from behavioural embryology, which have also demonstrated that prenatal perceptual experience can influence later responses to species-typical stimulation.     

The effect of facial expression and gaze direction on memory for unfamiliar faces

We report data from an experiment that investigated the influence of gaze direction and facial expression on face memory. Participants were shown a set of unfamiliar faces with either happy or angry facial expressions, which were either gazing straight ahead or had their gaze averted to one side. Memory for faces that were initially shown with angry expressions was found to be poorer when these faces had averted as opposed to direct gaze, whereas memory for individuals shown with happy faces was unaffected by gaze direction. We suggest that memory for another individual's face partly depends on an evaluation of the behavioural intention of that individual.     

Modification of prenatal auditory experience alters postnatal auditory preferences of bobwhite quail chicks

This study assessed the effects of altered prenatal auditory experience on bobwhite quail chicks' (Colinus virginianus) species-specific preference for the bobwhite maternal call. Results revealed that when the repetition rate of the embryonic vocalizations normally present in the prenatal environment was altered, the species-typical auditory preference of hatchlings for the maternal call was also altered. Specifically, embryos exposed to embryonic vocalizations with a faster repetition rate than normal subsequently preferred a bobwhite maternal call with a faster repetition rate over one with its normal repetition rate. Bobwhite embryos thus appear able to abstract features of their prenatal auditory environment to other auditory events in the postnatal period. This demonstration of prenatal perceptual learning is in keeping with other recent studies from behavioural embryology, which have also demonstrated that prenatal perceptual experience can influence later responses to species-typical stimulation.     

An infant chimpanzee (Pan troglodytes) follows human gaze

The ability of non-human primates to follow the gaze of other individuals has recently received much attention in comparative cognition. The aim of the present study was to investigate the emergence of this ability in a chimpanzee infant. The infant was trained to look at one of two objects, which an experimenter indicated by one of four different cue conditions: (1) tapping on the target object with a finger; (2) pointing to the target object with a finger; (3) gazing at the target object with head orientation; or (4) glancing at the target object without head orientation. The subject was given food rewards independently of its responses under the first three conditions, so that its responses to the objects were not influenced by the rewards. The glancing condition was tested occasionally, without any reinforcement. By the age of 13 months, the subject showed reliable following responses to the object that was indicated by the various cues, including glancing alone. Furthermore, additional tests clearly showed that the subject's performance was controlled by the "social" properties of the experimenter-given cues but not by the non-social, local-enhancing peripheral properties. Electronic Publication     

Gaze following among toddlers

Children's cooperative activities with their peers become markedly coordinated during the 3rd year of life. During these activities, the child needs to follow his/her peers’ gaze to objects, and look at the same objects to initiate coordinated action. Since 3-year-olds’ ability to follow their peers’ gaze has not been studied, we experimentally investigated this in our study. In the experimental trials, an experimenter induced a child (looker) to look at a doll on display, and observed the reaction of another child (follower) who was in front of the looker (and not looking at the doll). In the control trials, the experimenter displayed the doll in an identical manner when the follower was alone. The followers followed the gaze of the lookers, looking at the doll in approximately 90% of the experimental trials, compared with 20% of the control trials. These results indicate that 3-year-olds can follow their peers’ gaze.     

Observing shared attention modulates gaze following

Humans’ tendency to follow others’ gaze is considered to be rather resistant to top-down influences. However, recent evidence indicates that gaze following depends on prior eye contact with the observed agent. Does observing two people engaging in eye contact also modulate gaze following? Participants observed two faces looking at each other or away from each other before jointly shifting gaze to one of two locations. Targets appeared either at the cued location or at the non-cued location. In three experiments gaze cueing effects (faster responses to objects appearing at the cued location) were found only when the two faces had looked at each other before shifting gaze. In contrast, no effects of gaze following were observed when the two faces had looked away from each other. Thus, the attentional relation between observed people modulates whether their gaze is followed.     

Not afraid to trust you: Trustworthiness moderates gaze cueing but not in highly anxious participants

Gaze cueing (i.e., the shifting of person B's attention by following person A's gaze) is closely linked with human interaction and learning. To make the most of this connection, researchers need to investigate possible moderators enhancing or reducing the extent of this attentional shifting. In this study we used a gaze cueing paradigm to demonstrate that the perceived trustworthiness of a cueing person constitutes such a moderator for female participants. Our results show a significant interaction between perceived trustworthiness and the response time trade-off between valid and invalid gaze cues [gaze cueing effect (GCE)], as manifested in greater following of a person's gaze if this person was trustworthy as opposed to the following of an untrustworthy person's gaze. An additional exploratory analysis showed potentially moderating influences of trait-anxiety on this interaction (p = .057). The affective background of the experiment (i.e., using positive or negative target stimuli) had no influence.     

Sex differences for the recognition of direct versus averted gaze faces

Gaze direction plays a central role in face recognition. Previous research suggests that faces with direct gaze are better remembered than faces with averted gaze. We compared recognition of faces with direct versus averted gaze in male versus female participants. A total of 52 adults (23 females, 29 males) and 46 children (25 females, 21 males) completed a computerised task that assessed their recognition of faces with direct gaze and faces with averted gaze. Adult male participants showed superior recognition of faces with direct gaze compared to faces with averted gaze. There was no difference between recognition of direct and averted gaze faces for the adult female participants. Children did not demonstrate this sex difference; rather, both male and female youth participants showed better recognition of faces with direct gaze compared to averted gaze. A large body of previous research has revealed superior recognition of faces with direct, compared to averted gaze. However, relatively few studies have examined sex differences. Our findings suggest that gaze direction has differential effects on face recognition for adult males and females, but not for children. These findings have implications for previous explanations of better recognition for direct versus averted gaze.     

Emotional expression modulates perceived gaze direction

Gaze perception is an important social skill, as it portrays information about what another person is attending to. Gaze direction has been shown to affect interpretation of emotional expression. Here the authors investigate whether the emotional facial expression has a reciprocal influence on interpretation of gaze direction. In a forced-choice yes-no task, participants were asked to judge whether three faces expressing different emotions (anger, fear, happiness, and neutral) in different viewing angles were looking at them or not. Happy faces were more likely to be judged as looking at the observer than were angry, fearful, or neutral faces. Angry faces were more often judged as looking at the observer than were fearful and neutral expressions. These findings are discussed on the background of approach and avoidance orientation of emotions and of the self-referential positivity bias.     

Face detection in 2‐ to 6‐month‐old infants is influenced by gaze direction and species

Humans detect faces efficiently from a young age. Face detection is critical for infants to identify and learn from relevant social stimuli in their environments. Faces with eye contact are an especially salient stimulus, and attention to the eyes in infancy is linked to the emergence of later sociality. Despite the importance of both of these early social skills—attending to faces and attending to the eyes—surprisingly little is known about how they interact. We used eye tracking to explore whether eye contact influences infants' face detection. Longitudinally, we examined 2‐, 4‐, and 6‐month‐olds' (N = 65) visual scanning of complex image arrays with human and animal faces varying in eye contact and head orientation. Across all ages, infants displayed superior detection of faces with eye contact; however, this effect varied as a function of species and head orientation. Infants were more attentive to human than animal faces and were more sensitive to eye and head orientation for human faces compared to animal faces. Unexpectedly, human faces with both averted heads and eyes received the most attention. This pattern may reflect the early emergence of gaze following—the ability to look where another individual looks—which begins to develop around this age. Infants may be especially interested in averted gaze faces, providing early scaffolding for joint attention. This study represents the first investigation to document infants' attention patterns to faces systematically varying in their attentional states. Together, these findings suggest that infants develop early, specialized functional conspecific face detection.     

Physical self-similarity enhances the gaze-cueing effect

Important social information can be gathered from the direction of another person's gaze, such as their intentions and aspects of the environment that are relevant to those intentions. Previous work has examined the effect of gaze on attention through the gaze-cueing effect: an enhancement of performance in detecting targets that appear where another person is looking. The present study investigated whether the physical self-similarity of a face could increase its impact on attention. Self-similarity was manipulated by morphing participants' faces with those of strangers. The effect of gaze direction on target detection was strongest for faces morphed with the participant's face. The results support previous work suggesting that self-similar faces are processed differently from dissimilar faces. The data also demonstrate that a face's similarity to one's own face influences the degree to which that face guides our attention in the environment.     

Spatial interference between gaze direction and gaze location: A study on the eye contact effect

Perceived gaze in faces is an important social cue that influences spatial orienting of attention. In three experiments, we examined whether the social relevance of gaze direction modulated spatial interference in response selection, using three different stimuli: faces, isolated eyes, and symbolic eyes (Experiments 1, 2, and 3, respectively). Each experiment employed a variant of the spatial Stroop paradigm in which face location and gaze direction were put into conflict. Results showed a reverse congruency effect between face location to the right or left of fixation and gaze direction only for stimuli with a social meaning to participants (Experiments 1 and 2). The opposite was observed for the nonsocial stimuli used in Experiment 3. Results are explained as facilitation in response to eye contact.