The effect of gaze on gaze direction while looking at art

In highly controlled cuing experiments, conspecific gaze direction has powerful effects on an observer’s attention. We explored the generality of this effect by using paintings in which the gaze direction of a key character had been carefully manipulated. Our observers looked at these paintings in one of three instructional states (neutral, social, or spatial) while we monitored their eye movements. Overt orienting was much less influenced by the critical gaze direction than what the cuing literature might suggest: An analysis of the direction of saccades following the first fixation of the critical gaze showed that observers were weakly biased to orient in the direction of the gaze. Over longer periods of viewing, however, this effect disappeared for all but the social condition. This restriction of gaze as an attentional cue to a social context is consistent with the idea that the evolution of gaze direction detection is rooted in social communication. The picture stimuli from this experiment can be downloaded from the Psychonomic Society’s Archive of Norms, Stimuli, and Data, www.psychonomic.org/archive.     

The interaction between gaze direction and facial expressions in newborns

The ability to decode facial expressions is an important component of social interaction and functioning. This ability is even more fundamental early in life, prior to the development of verbal communication. However, it is still unclear whether newborns can detect, discriminate and process facial expressions, and, if so, what the mechanisms underlying this ability are. In this study, we extend the investigation of perceived emotional expression by manipulating gaze direction with different facial expressions. Specifically, newborns were presented with faces displaying neutral, fearful, or happy facial expressions accompanied with direct or averted gaze, and tested in a visual preference paradigm. Four experiments were conducted in which different combinations of expression and gaze were used. However, only in the fourth experiment did newborns show a visual preference for a specific emotional display; they looked significantly longer at a happy face than a neutral one only when both were accompanied with direct gaze. These results provide support for the advantage of happy facial expressions in the development of a face processing system and suggest that this preference reflects experience acquired during the first few days after birth.     

Perceiving crowd attention: Gaze following in human crowds with conflicting cues

People automatically redirect their visual attention by following others’ gaze orientation, a phenomenon called “gaze following.” This is an evolutionarily generated socio-cognitive process that provides people with information about their environments. Often, however, people in crowds can have rather different gaze orientations. This study investigated how gaze following occurs in situations with many conflicting gazes. In two experiments, we modified the gaze cueing paradigm to use a crowd rather than a single individual. Specifically, participants were presented with a group of human avatars with differing gaze orientations, and the target appeared randomly on the left or right side of a display. We found that (a) when a marked difference existed in the number of avatars with divergent gaze orientations, participants automatically followed the majority’s gaze orientation, and (b) the strongest gaze cue effect occurred when all gazes shared the same orientation, with the response superiority of the majority’s oriented location monotonically diminishing with the number of gazes with divergent orientations. These findings suggested that the majority rule plays a role in gaze following behavior when individuals are confronted with conflicting multigaze scenes, and that an increasing subgroup size appears to enlarge the strength of the gaze cueing effect.     

The eye gaze direction of an observed person can bias perception,memory, and attention in adolescents with and without autism spectrum disorder

The reported experiments aimed to investigate whether a person and his or her gaze direction presented in the context of a naturalistic scene cause perception, memory, and attention to be biased in typically developing adolescents and high-functioning adolescents with autism spectrum disorder (ASD). A novel computerized image manipulation program presented a series of photographic scenes, each containing a person. The program enabled participants to laterally maneuver the scenes behind a static window, the borders of which partially occluded the scenes. The gaze direction of the person in the scenes spontaneously cued attention of both groups in the direction of gaze, affecting judgments of preference (Experiment 1a) and causing memory biases (Experiment 1b). Experiment 2 showed that the gaze direction of a person cues visual search accurately to the exact location of gaze in both groups. These findings suggest that biases in preference, memory, and attention are caused by another person’s gaze direction when viewed in a complex scene in adolescents with and without ASD     

Gaze cueing as a function of perceived gaze direction

Previous studies have found that attention is automatically oriented in the direction of other people's gaze. This study directly investigated whether the perceiving gaze direction modulates the orienting of observers' attention. Gaze perception was manipulated by changing the face context (head orientation) of the gaze cue: the perceived gaze angle was increased (or decreased) when the head and gaze are congruent (or incongruent), while the local‐feature information of the eye region was preserved for all stimuli. The results showed that gaze‐cueing effects were enhanced when the perceived gaze direction was averted more toward left or right, and reduced when the perceived gaze direction was closer to direct gaze. The results suggest that gaze‐cueing effects are based on mechanisms specialized for gaze perception, and the magnitude of gaze‐cueing effects was probably a function of the perceived gaze direction.     

Crossmodal spatial attention shift produced by centrally presented gaze cues1

Abstract: Despite previous failures to identify visual‐upon‐auditory spatial‐cuing effects, recent studies have demonstrated that the abrupt onset of a lateralized visual stimulus triggers a shift of spatial attention in response to auditory judgment. Nevertheless, whether a centrally presented visual stimulus orients auditory attention remained unclear. The present study investigated whether centrally presented gaze cues trigger a reflexive shift of attention in response to auditory judgment. Participants fixated on a schematic face in which the eyes looked left or right (the cue). A target sound was then presented to the left or right of the cue. Participants judged the direction of the target as quickly as possible. Even though participants were told that the gaze direction did not predict the direction of the target, the response time was significantly faster when the gaze was in the target direction than when it was in the non‐target direction. These findings provide initial evidence for visual‐upon‐auditory spatial‐cuing effects produced by centrally presented cues, suggesting that a reflexive crossmodal shift of attention does occur with a centrally presented visual stimulus.     

The combined effect of gaze direction and facial expression on cueing spatial attention

Empirical evidence shows an effect of gaze direction on cueing spatial attention, regardless of the emotional expression shown by a face, whereas a combined effect of gaze direction and facial expression has been observed on individuals' evaluative judgments. In 2 experiments, the authors investigated whether gaze direction and facial expression affect spatial attention depending upon the presence of an evaluative goal. Disgusted, fearful, happy, or neutral faces gazing left or right were followed by positive or negative target words presented either at the spatial location looked at by the face or at the opposite spatial location. Participants responded to target words based on affective valence (i.e., positive/negative) in Experiment 1 and on letter case (lowercase/uppercase) in Experiment 2. Results showed that participants responded much faster to targets presented at the spatial location looked at by disgusted or fearful faces but only in Experiment 1, when an evaluative task was used. The present findings clearly show that negative facial expressions enhance the attentional shifts due to eye-gaze direction, provided that there was an explicit evaluative goal present.     

Direct gaze modulates face recognition in young infants

From birth, infants prefer to look at faces that engage them in direct eye contact. In adults, direct gaze is known to modulate the processing of faces, including the recognition of individuals. In the present study, we investigate whether direction of gaze has any effect on face recognition in four-month-old infants. Four-month infants were shown faces with both direct and averted gaze, and subsequently given a preference test involving the same face and a novel one. A novelty preference during test was only found following initial exposure to a face with direct gaze. Further, face recognition was also generally enhanced for faces with both direct and with averted gaze when the infants started the task with the direct gaze condition. Together, these results indicate that the direction of the gaze modulates face recognition in early infancy.     

Stimulus exposure and gaze bias: A further test of the gaze cascade model

We tested predictions derived from the gaze cascade model of preference decision making (Shimojo, Simion, Shimojo, & Scheier, 2003; Simion & Shimojo, 2006, 2007). In each trial, participants’ eye movements were monitored while they performed an eight-alternative decision task in which four of the items in the array were preexposed prior to the trial. Replicating previous findings, we found a gaze bias toward the chosen item prior to the response. However, contrary to the prediction of the gaze cascade model, preexposure of stimuli decreased, rather than increased, the magnitude of the gaze bias in preference decisions. Furthermore, unlike the prediction of the model, preexposure did not affect the likelihood of an item being chosen, and the pattern of looking behavior in preference decisions and on a nonpreference control task was remarkably similar. Implications of the present findings in multistage models of decision making are discussed.     

Anticipating intentional actions: The effect of eye gaze direction on the judgment of head rotation

Using a representational momentum paradigm, this study investigated the hypothesis that judgments of how far another agent’s head has rotated are influenced by the perceived gaze direction of the head. Participants observed a video-clip of a face rotating 60° towards them starting from the left or right profile view. The gaze direction of the face was either congruent with, ahead of, or lagging behind the angle of rotation. Following this, two static faces, at varying angles of rotation with respect to the end-point angle of the face in the video-clip, were presented simultaneously. The task of the participants was to decide which of the two heads was at an angle best resembling the angle of the end-point of the moving face. The critical test condition consisted of one test face oriented at 10° before, and the other at 10° after the end-point. The ‘lagging behind’ gaze condition elicited a significant underestimation of the rotation compared to the ‘congruent’ and ‘ahead’ gaze conditions. Participants did not exhibit similar biases when judging the rotation of several non-face control stimuli with visual features that mimicked different aspects of gaze direction. The findings suggest that when the gaze direction of a perceived agent is incongruent with the direction of the agent’s head motion observers automatically utilise this discrepancy to adjust their inferences about the agent’s intended heading direction.     

Predictive gaze cues affect face evaluations: The effect of facial emotion

When we see someone change their direction of gaze, we spontaneously follow their eyes because we expect people to look at interesting objects. Bayliss and Tipper (2006) examined the consequences of observing this expectancy being either confirmed or violated by faces producing reliable or unreliable gaze cues. Participants viewed different faces that would consistently look at the target, or consistently look away from the target: The faces that consistently looked towards targets were subsequently chosen as being more trustworthy than the faces that consistently looked away from targets. The current work demonstrates that these gaze contingency effects are only detected when faces create a positive social context by smiling, but not in the negative context when all the faces held angry or neutral expressions. These data suggest that implicit processing of the reward contingencies associated with gaze cues relies on a positive emotional expression to maintain expectations of a favourable outcome of joint attention episodes.     

The effect of facial expression and gaze direction on memory for unfamiliar faces

We report data from an experiment that investigated the influence of gaze direction and facial expression on face memory. Participants were shown a set of unfamiliar faces with either happy or angry facial expressions, which were either gazing straight ahead or had their gaze averted to one side. Memory for faces that were initially shown with angry expressions was found to be poorer when these faces had averted as opposed to direct gaze, whereas memory for individuals shown with happy faces was unaffected by gaze direction. We suggest that memory for another individual's face partly depends on an evaluation of the behavioural intention of that individual.     

The whereabouts of visual attention: Involuntary attentional bias toward the default gaze direction

This study proposed and verified a new hypothesis on the relationship between gaze direction and visual attention: attentional bias by default gaze direction based on eye-head coordination. We conducted a target identification task in which visual stimuli appeared briefly to the left and right of a fixation cross. In Experiment 1, the direction of the participant’s head (aligned with the body) was manipulated to the left, front, or right relative to a central fixation point. In Experiment 2, head direction was manipulated to the left, front, or right relative to the body direction. This manipulation was based on results showing that bias of eye position distribution was highly correlated with head direction. In both experiments, accuracy was greater when the target appeared at a position where the eyes would potentially be directed. Consequently, eye–head coordination influences visual attention. That is, attention can be automatically biased toward the location where the eyes tend to be directed.     

The eyes have it! Reflexive orienting is triggered by nonpredictive gaze

Normal subjects were presented with a simple line drawing of a face looking left, right, or straight ahead. A target letter F or T then appeared to the left or the right of the face. All subjects participated in target detection, localization, and identification response conditions. Although subjects were told that the line drawing’s gaze direction (the cue) did not predict where the target would occur, response time in all three conditions was reliably faster when gaze was toward versus away from the target. This study provides evidence for covert, reflexive orienting to peripheral locations in response to uninformative gaze shifts presented at fixation. The implications for theories of social attention and visual orienting are discussed, and the brain mechanisms that may underlie this phenomenon are considered.     

Learning under your gaze: the mediating role of affective arousal between perceived direct gaze and memory performance

Previous studies have shown that cognitive performance can be affected by the presence of an observer and self-directed gaze. We investigated whether the effect of gaze direction (direct vs. downcast) on verbal memory is mediated by autonomic arousal. Male participants responded with enhanced affective arousal to both male and female storytellers’ direct gaze which, according to a path analysis, was negatively associated with the performance. On the other hand, parallel to this arousal-mediated effect, males’ performance was affected by another process impacting the performance positively and suggested to be related to effort allocation on the task. The effect of this process was observed only when the storyteller was a male. The participants remembered more details from a story told by a male with a direct vs. downcast gaze. The effect of gaze direction on performance was the opposite for female storytellers, which was explained by the arousal-mediated process. Surprisingly, these results were restricted to male participants only and no effects of gaze were observed among female participants. We also investigated whether the participants’ belief of being seen or not (through an electronic window) by the storyteller influenced the memory and arousal, but this manipulation had no effect on the results.     

Don’t make me angry,you wouldn’t like me when I’m angry: Volitional choices to act or inhibit are modulated by subliminal perception of emotional faces

Volitional action and self-control—feelings of acting according to one’s own intentions and in being control of one’s own actions—are fundamental aspects of human conscious experience. However, it is unknown whether high-level cognitive control mechanisms are affected by socially salient but nonconscious emotional cues. In this study, we manipulated free choice decisions to act or withhold an action by subliminally presenting emotional faces: In a novel version of the Go/NoGo paradigm, participants made speeded button-press responses to Go targets, withheld responses to NoGo targets, and made spontaneous, free choices to execute or withhold the response for Choice targets. Before each target, we presented emotional faces, backwards masked to render them nonconscious. In Intentional trials, subliminal angry faces made participants more likely to voluntarily withhold the action, whereas fearful and happy faces had no effects. In a second experiment, the faces were made supraliminal, which eliminated the effects of angry faces on volitional choices. A third experiment measured neural correlates of the effects of subliminal angry faces on intentional choice using EEG. After replicating the behavioural results found in Experiment 1, we identified a frontal-midline theta component—associated with cognitive control processes—which is present for volitional decisions, and is modulated by subliminal angry faces. This suggests a mechanism whereby subliminally presented “threat” stimuli affect conscious control processes. In summary, nonconscious perception of angry faces increases choices to inhibit, and subliminal influences on volitional action are deep seated and ecologically embedded.     

Straight gaze facilitates face processing but does not cause involuntary attentional capture

This study aimed to investigate the conditions under which eyes with a straight gaze capture attention more than eyes with an averted gaze, a phenomenon called the stare-in-the-crowd effect. In Experiment 1, we measured attentional capture by distractor faces with either straight or averted gaze that were shown among faces with closed eyes. Gaze direction of the distractor face was irrelevant because participants searched for a tilted face and indicated its gender. The presence of the distractor face with open eyes resulted in slower reaction times, but gaze direction had no effect, suggesting that straight gaze does not result in more involuntary attentional capture than averted gaze. In three further experiments with the same stimuli, the gaze direction of the target, and not the distractor, was varied. Better performance with straight than averted gaze of the target face was observed when the gaze direction or gender of the target face had to be discriminated. However, no difference between straight and averted was observed when only the presence of a face with open eyes had to be detected. Thus, the stare-in-the crowd effect is only observed when eye gaze is selected as part of the target and only when features of the face have to be discriminated. Our findings suggest that preference for straight gaze bears on target-related processes rather than on attentional capture per se.     

Affective evaluations of objects are influenced by observed gaze direction and emotional expression

Gaze direction signals another person's focus of interest. Facial expressions convey information about their mental state. Appropriate responses to these signals should reflect their combined influence, yet current evidence suggests that gaze-cueing effects for objects near an observed face are not modulated by its emotional expression. Here, we extend the investigation of perceived gaze direction and emotional expression by considering their combined influence on affective judgments. While traditional response-time measures revealed equal gaze-cueing effects for happy and disgust faces, affective evaluations critically depended on the combined product of gaze and emotion. Target objects looked at with a happy expression were liked more than objects looked at with a disgust expression. Objects not looked at were rated equally for both expressions. Our results demonstrate that facial expression does modulate the way that observers utilize gaze cues: Objects attended by others are evaluated according to the valence of their facial expression.     

Human ostensive signals do not enhance gaze following in chimpanzees,but do enhance object-oriented attention

The previous studies have shown that human infants and domestic dogs follow the gaze of a human agent only when the agent has addressed them ostensively—e.g., by making eye contact, or calling their name. This evidence is interpreted as showing that they expect ostensive signals to precede referential information. The present study tested chimpanzees, one of the closest relatives to humans, in a series of eye-tracking experiments using an experimental design adapted from these previous studies. In the ostension conditions, a human actor made eye contact, called the participant’s name, and then looked at one of two objects. In the control conditions, a salient cue, which differed in each experiment (a colorful object, the actor’s nodding, or an eating action), attracted participants’ attention to the actor’s face, and then the actor looked at the object. Overall, chimpanzees followed the actor’s gaze to the cued object in both ostension and control conditions, and the ostensive signals did not enhance gaze following more than the control attention-getters. However, the ostensive signals enhanced subsequent attention to both target and distractor objects (but not to the actor’s face) more strongly than the control attention-getters—especially in the chimpanzees who had a close relationship with human caregivers. We interpret this as showing that chimpanzees have a simple form of communicative expectations on the basis of ostensive signals, but unlike human infants and dogs, they do not subsequently use the experimenter’s gaze to infer the intended referent. These results may reflect a limitation of non-domesticated species for interpreting humans’ ostensive signals in inter-species communication.