Watching Eyes effects: When others meet the self

The perception of direct gaze—that is, of another individual’s gaze directed at the observer—is known to influence a wide range of cognitive processes and behaviors. We present a new theoretical proposal to provide a unified account of these effects. We argue that direct gaze first captures the beholder’s attention and then triggers self-referential processing, i.e., a heightened processing of stimuli in relation with the self. Self-referential processing modulates incoming information processing and leads to the Watching Eyes effects, which we classify into four main categories: the enhancement of self-awareness, memory effects, the activation of pro-social behavior, and positive appraisals of others. We advance that the belief to be the object of another’s attention is embedded in direct gaze perception and gives direct gaze its self-referential power. Finally, we stress that the Watching Eyes effects reflect a positive impact on human cognition; therefore, they may have a therapeutic potential, which future research should delineate.     

视频教学中教师的眼神注视能否促进学习?

教师的眼神注视是在视频学习中重要但易被忽视的元素。以往理论存在两种对立的观点：其中准社会交往理论和社会代理理论支持教师的眼神注视促进学习; 而基于多媒体学习认知理论与认知负荷理论认为教师的眼神注视会阻碍学习效果。通过汇总以往实证研究得出如下结论：首先, 教师的眼神注视对学习效果具有小的促进效应, 即教师的眼神注视能够促进学习者的保持成绩(d_保持 = 0.41)和迁移成绩(d_迁移 = 0.39); 其次, 在主观体验上, 教师的眼神注视对准社会交往也具有小的促进效应(d_{准社会交往} = 0.35), 而教师的眼神注视对认知负荷影响十分微弱(d_认知负荷 = -0.02); 最后, 在对学习材料的注意加工上, 教师的眼神注视总体上影响比较微弱(d_注视时间 = 0.06, d_{首次注视时间} = -0.15)。未来研究需要对不同注视类型、先前知识经验、学习材料性质以及认知神经方法进一步探究。     

Gaze step distributions reflect fixations and saccades: a comment on

In three experimental tasks Stephen and Mirman (2010) measured gaze steps, the distance in pixels between gaze positions on successive samples from an eyetracker. They argued that the distribution of gaze steps is best fit by the lognormal distribution, and based on this analysis they concluded that interactive cognitive processes underlie eye movement control in these tasks. The present comment argues that the gaze step distribution is predictable based on the fact that the eyes alternate between a fixation state in which gaze is steady and a saccade state in which gaze position changes rapidly. By fitting a simple mixture model to Stephen and Mirman's gaze step data we reveal a fixation distribution and a saccade distribution. This mixture model captures the shape of the gaze step distribution in detail, unlike the lognormal model, and provides a better quantitative fit to the data. We conclude that the gaze step distribution does not directly suggest processing interaction, and we emphasize some important limits on the utility of fitting theoretical distributions to data.     

Linking patterns of infant eye movements to a neural network model of the ventral stream using representational similarity analysis

Little is known about the development of higher-level areas of visual cortex during infancy, and even less is known about how the development of visually guided behavior is related to the different levels of the cortical processing hierarchy. As a first step toward filling these gaps, we used representational similarity analysis (RSA) to assess links between gaze patterns and a neural network model that captures key properties of the ventral visual processing stream. We recorded the eye movements of 4- to 12-month-old infants (N = 54) as they viewed photographs of scenes. For each infant, we calculated the similarity of the gaze patterns for each pair of photographs. We also analyzed the images using a convolutional neural network model in which the successive layers correspond approximately to the sequence of areas along the ventral stream. For each layer of the network, we calculated the similarity of the activation patterns for each pair of photographs, which was then compared with the infant gaze data. We found that the network layers corresponding to lower-level areas of visual cortex accounted for gaze patterns better in younger infants than in older infants, whereas the network layers corresponding to higher-level areas of visual cortex accounted for gaze patterns better in older infants than in younger infants. Thus, between 4 and 12 months, gaze becomes increasingly controlled by more abstract, higher-level representations. These results also demonstrate the feasibility of using RSA to link infant gaze behavior to neural network models. A video abstract of this article can be viewed at https://youtu.be/K5mF2Rw98Is     

Gaze behavior in audiovisual speech perception: the influence of ocular fixations on the McGurk effect

We conducted three experiments in order to examine the influence of gaze behavior and fixation on audiovisual speech perception in a task that required subjects to report the speech sound they perceived during the presentation of congruent and incongruent (McGurk) audiovisual stimuli. Experiment 1 showed that the subjects' natural gaze behavior rarely involved gaze fixations beyond the oral and ocular regions of the talker's face and that these gaze fixations did not predict the likelihood of perceiving the McGurk effect. Experiments 2 and 3 showed that manipulation of the subjects' gaze fixations within the talker's face did not influence audiovisual speech perception substantially and that it was not until the gaze was displaced beyond 10 degrees - 20 degrees from the talker's mouth that the McGurk effect was significantly lessened. Nevertheless, the effect persisted under such eccentric viewing conditions and became negligible only when the subject's gaze was directed 60 degrees eccentrically. These findings demonstrate that the analysis of high spatial frequency information afforded by direct oral foveation is not necessary for the successful processing of visual speech information.     

Enhanced gaze‐following behavior in Deaf infants of Deaf parents

Gaze following plays a role in parent–infant communication and is a key mechanism by which infants acquire information about the world from social input. Gaze following in Deaf infants has been understudied. Twelve Deaf infants of Deaf parents (DoD) who had native exposure to American Sign Language (ASL) were gender‐matched and age‐matched (±7 days) to 60 spoken‐language hearing control infants. Results showed that the DoD infants had significantly higher gaze‐following scores than the hearing infants. We hypothesize that in the absence of auditory input, and with support from ASL‐fluent Deaf parents, infants become attuned to visual‐communicative signals from other people, which engenders increased gaze following. These findings underscore the need to revise the ‘deficit model’ of deafness. Deaf infants immersed in natural sign language from birth are better at understanding the signals and identifying the referential meaning of adults’ gaze behavior compared to hearing infants not exposed to sign language. Broader implications for theories of social‐cognitive development are discussed. A video abstract of this article can be viewed at https://youtu.be/QXCDK_CUmAI     

The owl and the pussycat: Gaze cues and visuospatial orienting

Recent research has shown that nonpredictive gaze cues trigger reflexive shifts in attention toward the looked-at location. But just how generalizable is this spatial cuing effect? In particular, are people especially tuned to gaze cues provided by conspecifics, or can comparable shifts in visual attention be triggered by other cue providers and directional cues? To investigate these issues, we used a standard cuing paradigm to compare the attentional orienting produced by different cue providers (i.e., animate vs. inanimate) and directional cues (i.e., eyes vs. arrows). The results of three experiments revealed that attentional orienting was insensitive to both the identity of the cue provider and the nature of the triggering cue. However, compared with arrows, gaze cues prompted a general enhancement in the efficiency of processing operations. We consider the implications of these findings for accounts of reflexive visual orienting.     

Positive Gaze Preferences in Older Adults: Assessing the Role of Cognitive Effort with Pupil Dilation

ABSTRACT

Older adults display positive preferences in their gaze, consistent with their prioritization of emotion regulation goals. While some research has argued that substantial amounts of cognitive effort are necessary for these information-processing preferences to occur, other work suggests that these attentional patterns unfold with minimal cognitive exertion. The current study used an implicit regulatory context (i.e., viewing facial stimuli of varying emotions) to assess how much cognitive effort was required for positive attentional preferences to occur. Effortful cognitive processing was assessed with a direct measure of change in pupil dilation. Results indicated that minimal cognitive effort was expended when older adults engaged in positive gaze preferences. This finding suggests that gaze acts as a rather effortless and economical regulatory tool for individuals to shape their affective experience.     

眼睛注视的知觉及其线索效应

对眼睛注视知觉、眼睛注视线索效应及其影响因素等相关研究进行了总结和分析。结果发现:(1)婴儿从一出生就对眼睛注视线索表现出强烈的敏感性,眼睛注视知觉对语言和社会等能力的发展有很大影响;(2)颞上沟是加工眼睛注视线索的特异神经结构,它与实时监控情绪和情感的杏仁核存在神经联结,成为社会认知神经系统的重要组成部分;(3)对眼睛注视线索的早期加工显示出特异的脑电活动模式;(4)眼睛注视线索效应与外周线索的反射式效应相类似,但持续时间较长;(5)眼睛注视线索效应不仅受面部结构信息的影响,也受自上而下加工等高水平认知因素的调节,并显示出明显的个体差异。对眼睛注视线索效应的进一步研究应涉及人格判断、喜好评价和心理理论等高级社会认知活动。     

Memory and attention for social threat: anxious hypercoding-avoidance and submissive gaze aversion

Rivalry for dominance is a recurrent challenge in human social interaction. During these social dominance interactions, some people rapidly break eye contact, whereas others merely try to avoid such eye-to-eye confrontations. The first is an example of submissive gaze aversion, whereas the second reflects anxious gaze avoidance. We tested these distinct forms of gaze behavior within a social-memory setting and show that anxious individuals vigilantly attend to, superiorly remember, and subsequently avoid social threats (i.e., angry faces). Furthermore, submissive individuals, as indexed by high trait anxiety and low trait anger, exhibit rapid gaze aversion from facial anger. Mechanisms of hypervigilance-avoidance thus seem to underlie natural gaze behavior and enhanced memory for threat in anxiety. Accordingly, we propose the term hypercoding-avoidance, which describes how anxious individuals habitually scan their immediate social environment for threat, remember its location, and subsequently avoid it. Moreover, this is the first experimental evidence showing that submissive gaze aversion is distinct from anxious gaze avoidance.     

Perceiving crowd attention: Gaze following in human crowds with conflicting cues

People automatically redirect their visual attention by following others’ gaze orientation, a phenomenon called “gaze following.” This is an evolutionarily generated socio-cognitive process that provides people with information about their environments. Often, however, people in crowds can have rather different gaze orientations. This study investigated how gaze following occurs in situations with many conflicting gazes. In two experiments, we modified the gaze cueing paradigm to use a crowd rather than a single individual. Specifically, participants were presented with a group of human avatars with differing gaze orientations, and the target appeared randomly on the left or right side of a display. We found that (a) when a marked difference existed in the number of avatars with divergent gaze orientations, participants automatically followed the majority’s gaze orientation, and (b) the strongest gaze cue effect occurred when all gazes shared the same orientation, with the response superiority of the majority’s oriented location monotonically diminishing with the number of gazes with divergent orientations. These findings suggested that the majority rule plays a role in gaze following behavior when individuals are confronted with conflicting multigaze scenes, and that an increasing subgroup size appears to enlarge the strength of the gaze cueing effect.     

The curious case of spillover: Does it tell us much about saccade timing in reading?

In completing daily activities, the eyes make a series of saccades by gazing at stimuli in succession. The duration of gaze on each stimulus has been used to infer how the initiation of a saccade is timed relative to the underlying mental processing. In reading, gaze dwells longer on a word that occurs infrequently in English text (low frequency) than on a more frequent word (high frequency), but also on the following word, which is referred to as spillover. Accounts of spillover attribute it to mechanisms of lexical access. A low-frequency word n is assumed to delay the onset of cognitive processing of word n+1 more than it delays the saccade to n+1, leaving more processing to be done on n+1 once it is fixated. We tested this assumption by having participants perform a series of speeded lexical decisions on a linear array of letter strings spaced 5° apart, using low- and high-frequency words to vary the lexical difficulty. Lexical decision adds a response selection stage that is absent in reading, which should eliminate differential effects on saccades and cognitive processing. Nonetheless, we found the typical pattern of lengthened gaze duration and spillover for low-frequency words, with effects that were consistent in magnitude with those seen in studies of reading. These data challenge existing accounts of spillover and argue against the idea that reading has a unique interaction with oculomotor control. Instead, the similarity of our gaze patterns to those of reading suggests a common pattern of saccade initiation across tasks.     

Forward inference in risky choice: Mapping gaze and decision processes

The study of cognitive processes is built on a close mapping between three components: overt gaze behavior, overt choice, and covert processes. To validate this overt–covert mapping in the domain of decision‐making, we collected eye‐movement data during decisions between risky gamble problems. Applying a forward inference paradigm, participants were instructed to use specific decision strategies to solve those gamble problems (maximizing expected values or applying different choice heuristics) during which gaze behavior was recorded. We revealed differences between overt behavior, as indicated by eye movements, and covert decision processes, instructed by the experimenter. However, our results show that the overt–covert mapping is for some eye‐movement measures not as close as expected by current decision theory, and hence question reverse inference as being prone to fallacies due to a violation of its prerequisite, that is, a close overt–covert mapping. We propose a framework to rehabilitate reverse inference.     

Gaze behavior in analytical and holistic face processing

We conducted two experiments examining children's and adults' gaze behavior when processing faces analytically (focusing on a single feature) or holistically (comparing the overall similarity of the faces). Children 6-8 and 9-10 years of age and adults were instructed to assign schematically drawn faces in Experiment 1 and photos of real faces in Experiment 2 to two categories. The categories were constructed so as to allow either an analytical or holistic categorization of the faces. During all trials, gaze behavior was recorded from stimulus onset until reaction. The location and duration of the fixations used were analyzed. Whereas the holistic processors fixated the whole area of the eyes and nose most and longest independently of age, analytical processors showed a more feature-specific gaze behavior, focusing their fixations upon the particular feature used for subsequent processing. Thus, differences in analytical and holistic face processing can be detected early in gaze behavior-that is, at the visual encoding stage.     

Eye contact elicits bodily self-awareness in human adults

Eye contact is a typical human behaviour known to impact concurrent or subsequent cognitive processing. In particular, it has been suggested that eye contact induces self-awareness, though this has never been formally proven. Here, we show that the perception of a face with a direct gaze (that establishes eye contact), as compared to either a face with averted gaze or a mere fixation cross, led adult participants to rate more accurately the intensity of their physiological reactions induced by emotional pictures. Our data support the view that bodily self-awareness becomes more acute when one is subjected to another’s gaze. Importantly, this effect was not related to a particular arousal state induced by eye contact perception. Rejecting the arousal hypothesis, we suggest that eye contact elicits a self-awareness process by enhancing self-focused attention in humans. We further discuss the implications of this proposal.     

Processing head fakes in basketball: Are there ironic effects of instructions on the head-fake effect in basketball?

Instructions in sports are used to improve athletes’ performance. However, instructions can also impair performance if they direct athletes’ attention to a to-be-avoided behavior which paradoxically provokes exactly that behavior (ironic effect). The present study investigates the impact of different instructions on the head-fake effect in basketball. Specifically, we asked here if deliberate attempts to ignore the deceptive cues gaze direction and head orientation increase the impact of that information and thus, paradoxically increase the head-fake effect. We found that the detrimental impact of spatially incongruent gaze direction and head orientation was essentially independent of whether participants were, or were not, instructed to deliberately ignore the task-irrelevant information. Hence, deceptive actions exert their impact independent of the perceivers’ attempts to ignore deceptive cues. We thus conclude that the deceptive cues gaze direction and head orientation are per se hyper-accessible or over-salient and its processing cannot be controlled with any amount of mental capacity (and even not with the non-ironic instruction). However, as both ignore instructions produce general processing costs (i.e., slower reactions) coaches should solely instruct athletes’ to focus attention on the processing of the pass direction.     

The look of love: gaze shifts and person perception

Gaze direction is a vital communicative channel through which people transmit information to each other. By signaling the locus of social attention, gaze cues convey information about the relative importance of objects, including other people, in the environment. For the most part, this information is communicated via patterns of gaze direction, with gaze shifts signaling changes in the objects of attention. Noting the relevance of gaze cues in social cognition, we speculated that gaze shifts may modulate people's evaluations of others. We investigated this possibility by asking participants to judge the likability (Experiment 1) and physical attractiveness (Experiment 2) of targets displaying gaze shifts indicative of attentional engagement or disengagement with the participants. As expected, person evaluation was moderated by the direction of gaze shifts, but only when the judgment under consideration was relevant to participants. We consider how and when gaze shifts may modulate person perception and its associated behavioral products.     

Interrupting the cascade: orienting contributes to decision making even in the absence of visual stimulation

Most systematic studies of human decision making approach the subject from a cost analysis point of view and assume that people make the highest utility choice. Very few articles investigate subjective decision making, such as that involving preference, although such decisions are very important for our daily functioning. We have argued (Shimojo, Simion, Shimojo, & Scheier, 2003) that an orienting bias effectively leads to the preference decision by means of a positive feedback loop involving mere exposure and preferential looking. The illustration of this process is a continually increasing gaze bias toward the eventual choice, which we call the gaze cascade effect. In the present study, we interrupt the natural process of preference selection, but we show that gaze behavior does not change even when the stimuli are removed from observers' visual field. This demonstrates that once started, the involvement of orienting in decision making cannot be stopped and that orienting acts independently of the presence of visual stimuli. We also show that the cascade effect is intrinsically linked to the decision itself and is not triggered simply by a tendency to look at preferred targets.     

What are you looking at? Infants’ neural processing of an adult's object‐directed eye gaze

Previous research suggests that by 4 months of age infants use the eye gaze of adults to guide their attention and facilitate processing of environmental information. Here we address the question of how infants process the relation between another person and an external object. We applied an ERP paradigm to investigate the neural processes underlying the perception of the direction of an adult's eye gaze in 4-month-old infants. Infants showed differential processing of an adult's eye gaze, which was directed at a simultaneously presented object compared to non-object-directed eye gaze. This distinction was evident in two ERP components: The Negative component, reflecting attentional processes, and the positive slow wave, which is involved in memory encoding. The implications of these findings for the development of joint attention and related social cognitive functions are discussed.     

Development of gaze aversion as disengagement from visual information

Older children, but not younger children, were found to look away more from the face of an interlocutor when answering difficult as opposed to easy questions. Similar results were found in earlier work with adults, who often avert their gaze during cognitively difficult tasks (A. M. Glenberg, J. L. Schroeder, & D. A. Robertson, 1998). Twenty-five 8-year-olds and 26 5-year-olds answered verbal reasoning and arithmetic questions of varying difficulty. The older children increased gaze aversion from the face of the adult questioner in response to both difficult verbal reasoning questions and difficult arithmetic questions. In contrast, younger children (5-year-olds) responded less consistently to cognitive difficulty. It is concluded that adultlike patterns of gaze aversion in response to cognitive difficulty are certainly acquired by 8 years of age. The implications of appropriate gaze aversion for children's management of cognitive processing resources are considered.