Automatic attentional orienting to other people’s gaze in schizophrenia

Explicit tests of social cognition have revealed pervasive deficits in schizophrenia. Less is known of automatic social cognition in schizophrenia. We used a spatial orienting task to investigate automatic shifts of attention cued by another person’s eye gaze in 29 patients and 28 controls. Central photographic images of a face with eyes shifted left or right, or looking straight ahead, preceded targets that appeared left or right of the cue. To examine automatic effects, cue direction was non-predictive of target location. Cue–target intervals were 100, 300, and 800?ms. In non-social control trials, arrows replaced eye-gaze cues. Both groups showed automatic attentional orienting indexed by faster reaction times (RTs) when arrows were congruent with target location across all cue–target intervals. Similar congruency effects were seen for eye-shift cues at 300 and 800?ms intervals, but patients showed significantly larger congruency effects at 800?ms, which were driven by delayed responses to incongruent target locations. At short 100-ms cue–target intervals, neither group showed faster RTs for congruent than for incongruent eye-shift cues, but patients were significantly slower to detect targets after direct-gaze cues. These findings conflict with previous studies using schematic line drawings of eye-shifts that have found automatic attentional orienting to be reduced in schizophrenia. Instead, our data indicate that patients display abnormalities in responding to gaze direction at various stages of gaze processing—reflected by a stronger preferential capture of attention by another person’s direct eye contact at initial stages of gaze processing and difficulties disengaging from a gazed-at location once shared attention is established.     

What are you looking at? Infants’ neural processing of an adult's object‐directed eye gaze

Previous research suggests that by 4 months of age infants use the eye gaze of adults to guide their attention and facilitate processing of environmental information. Here we address the question of how infants process the relation between another person and an external object. We applied an ERP paradigm to investigate the neural processes underlying the perception of the direction of an adult's eye gaze in 4-month-old infants. Infants showed differential processing of an adult's eye gaze, which was directed at a simultaneously presented object compared to non-object-directed eye gaze. This distinction was evident in two ERP components: The Negative component, reflecting attentional processes, and the positive slow wave, which is involved in memory encoding. The implications of these findings for the development of joint attention and related social cognitive functions are discussed.     

Visual attention and action: How cueing,direct mapping,and social interactions drive orienting

Despite considerable interest in both action perception and social attention over the last 2 decades, there has been surprisingly little investigation concerning how the manual actions of other humans orient visual attention. The present review draws together studies that have measured the orienting of attention, following observation of another’s goal-directed action. Our review proposes that, in line with the literature on eye gaze, action is a particularly strong orienting cue for the visual system. However, we additionally suggest that action may orient visual attention using mechanisms, which gaze direction does not (i.e., neural direct mapping and corepresentation). Finally, we review the implications of these gaze-independent mechanisms for the study of attention to action. We suggest that our understanding of attention to action may benefit from being studied in the context of joint action paradigms, where the role of higher level action goals and social factors can be investigated.     

注视方向的知觉对注视追随行为的影响

他人的注视线索可诱导观察者将注意自动地转移到该线索所指示的方向上去(注视追随), 但仍不清楚注视方向的知觉在注视追随中起到何种作用。本研究结合注视适应和注视线索提示范式发现：知觉到的注视线索角度越大, 其线索提示效应越强; 知觉适应后被试判断注视方向的准确性下降, 注视线索引起的注意转移量显著减少。可见, 对注视方向的知觉能直接影响注视追随行为, 而注视方向抽取受到刺激显著性(注视角度)和知觉适应等因素的调节。这提示：在意识状态下, 注视知觉与注视追随存在直接联系, 即可能存在从注视知觉系统到注意转移系统的皮层加工通路; 注视追随并非纯粹的反射式加工, 它受自上而下知觉经验的调节。     

Eye contact elicits bodily self-awareness in human adults

Eye contact is a typical human behaviour known to impact concurrent or subsequent cognitive processing. In particular, it has been suggested that eye contact induces self-awareness, though this has never been formally proven. Here, we show that the perception of a face with a direct gaze (that establishes eye contact), as compared to either a face with averted gaze or a mere fixation cross, led adult participants to rate more accurately the intensity of their physiological reactions induced by emotional pictures. Our data support the view that bodily self-awareness becomes more acute when one is subjected to another’s gaze. Importantly, this effect was not related to a particular arousal state induced by eye contact perception. Rejecting the arousal hypothesis, we suggest that eye contact elicits a self-awareness process by enhancing self-focused attention in humans. We further discuss the implications of this proposal.     

注视者及观察者因素对注视知觉的影响

注视知觉既包括识别他人对周围环境的注视位置, 也包括对他人是否在注视自己(即直视)的感知。诸多研究表明, 注视知觉过程受来自目光发出者与感知者多种因素的影响。从眼神沟通中不同角色角度出发, 将这些影响因素分为注视者因素和观察者因素。具体而言, 注视者因素主要探讨了眼部及头部物理特征及面孔情绪与吸引力对注视知觉的影响。而观察者因素则探讨了个体的心理或精神障碍、个体当前状态特征及观察者的性别、种族及文化差异对注视知觉的影响。未来研究可以从创新实验设计与任务出发, 探讨注视者刺激的实验材料与观察者特征的临床应用及跨文化差异等方面的问题。     

Gaze cueing as a function of perceived gaze direction

Previous studies have found that attention is automatically oriented in the direction of other people's gaze. This study directly investigated whether the perceiving gaze direction modulates the orienting of observers' attention. Gaze perception was manipulated by changing the face context (head orientation) of the gaze cue: the perceived gaze angle was increased (or decreased) when the head and gaze are congruent (or incongruent), while the local‐feature information of the eye region was preserved for all stimuli. The results showed that gaze‐cueing effects were enhanced when the perceived gaze direction was averted more toward left or right, and reduced when the perceived gaze direction was closer to direct gaze. The results suggest that gaze‐cueing effects are based on mechanisms specialized for gaze perception, and the magnitude of gaze‐cueing effects was probably a function of the perceived gaze direction.     

"You talkin' to me?" Self-relevant auditory signals influence perception of gaze direction

In humans, direct gaze typically signals a deliberate attempt to communicate with an observer. An auditory signal with similar signal value is calling someone's name. We investigated whether the presence of this personally relevant signal in the auditory modality would influence perception of another individual's gaze. Participants viewed neutral faces displaying different gaze deviations while hearing someone call their own name or the name of another person. Results were consistent with our predictions, as participants judged faces with a wider range of gaze deviations as looking directly at them when they simultaneously heard their own name. The influence of this personally relevant signal was present only at ambiguous gaze deviations; thus, an overall response bias to categorize gaze as direct when hearing one's own name cannot account for the results. This study provides the first evidence that communicative intent signaled via the auditory modality influences the perception of another individual's gaze.     

The cost of being watched: Stroop interference increases under concomitant eye contact

Current models in social neuroscience advance that eye contact may automatically recruit cognitive resources. Here, we directly tested this hypothesis by evaluating the distracting strength of eye contact on concurrent visual processing in the well-known Stroop’s paradigm. As expected, participants showed stronger Stroop interference under concomitant eye contact as compared to closed eyes. Two control experiments allowed ruling out low-level account of this effect as well as non-specific effect of the presence of open eyes. This suggests that refraining from processing eye contact is actually as difficult as refraining from word reading in the Stroop task. Crucially, the eye contact effect was obtained while gaze was not under the direct focus of attention and the participants were faced with another powerful distracter (the incongruent word) in the task at hand. Thus, there is a cost of being watched even in circumstances where the processing of direct gaze is strongly disfavored. The present results emphasize the crucial status of eye contact in human cognition.     

眼睛注视线索提示效应: 内源性注意还是外源性注意?

采用改进的Posner视-空间线索提示范式, 对眼睛注视线索提示效应(eyes gaze cueing effect)的加工机制进行了探讨。实验一考察注视提示线索对空间Stroop效应的影响; 实验二考察注视提示线索对特征抽取和特征整合的影响。实验结果显示: 注视线索提示有效时的空间Stroop效应显著大于提示无效的情景; 在单一特征搜索与特征联合搜索任务中, 注视线索提示效应无差别。这说明, 注视线索通过在头脑里形成空间方位表征诱导注意转移; 注视线索通过影响特征抽取、而非特征整合阶段, 对客体加工产生易化。本研究支持注视线索提示效应属于内源性注意的观点。     

面孔参照或观察者参照：性别二态线索、面孔吸引力与表情对正视面孔偏好的影响

本研究探讨了性别二态线索、面孔吸引力和表情对正视面孔偏好的影响。实验1基于面孔参照,被试普遍偏好正视面孔;相对男性化/厌恶和生气/低吸引力的面孔,被试更偏好女性化/高兴和中性/高吸引力的正视面孔;实验2基于观察者参照,总体并未表现出正视偏好;对低吸引力/中性表情/男性化面孔更偏好斜视面孔。     

解读成语中的他人心理与互动心理：来自眼动和ERP的证据

为了探查理解单个他人心理与解读互动心理的差异机制, 在实验一和实验二中分别采用眼动和事件相关电位技术来测评个体解读中文四字成语中的单个他人心理和互动心理的加工过程。眼动实验发现, 单人成语第二个字的总阅读时间显著长于物理成语; 随后, 互动成语前三字的凝视时间显著长于单人和物理成语。脑电实验发现, 在成语呈现后500~700ms, 解读单人和互动成语诱发的额区晚期正成分(LPC)平均波幅显著大于解读物理成语; 之后在700~800ms, 解读互动成语诱发的额中区LPC平均波幅显著大于解读单人和物理成语。眼动注视模式和脑电证据共同印证了理解单个他人的心理与理解多人的互动心理存在时间和强度上的差异。相对于物理表征和单人心理的加工, 理解更为复杂的互动心理需要更长的加工时间和更强的神经活动。     

A direct link between gaze perception and social attention

How information is exchanged between the cognitive mechanisms responsible for gaze perception and social attention is unclear. These systems could be independent; the "gaze cueing" effect could emerge from the activation of a general-purpose attentional mechanism that is ignorant of the social nature of the gaze cue. Alternatively, orienting to social gaze direction might be directly determined by the operation of cognitive mechanisms specifically dedicated to gaze perception. This second notion is the dominant assumption in the literature, but there is little direct support for this account. Here, we systematically manipulated observers' perception of gaze direction by implementing a gaze adaptation paradigm. Gaze cueing was reduced only in conditions where perception of specific averted gaze stimuli was impaired (Experiment 1). Adaptation to a pointing stimulus failed to impact gaze cueing (Experiment 2). Overall, these data suggest a direct link between the specific operation of gaze perception mechanisms and the consequential orienting of attention.     

Do the eyes have it? Cues to the direction of social attention

The face communicates an impressive amount of visual information. We use it to identify its owner, how they are feeling and to help us understand what they are saying. Models of face processing have considered how we extract such meaning from the face but have ignored another important signal - eye gaze. In this article we begin by reviewing evidence from recent neurophysiological studies that suggests that the eyes constitute a special stimulus in at least two senses. First, the structure of the eyes is such that it provides us with a particularly powerful signal to the direction of another person's gaze, and second, we may have evolved neural mechanisms devoted to gaze processing. As a result, gaze direction is analysed rapidly and automatically, and is able to trigger reflexive shifts of an observer's visual attention. However, understanding where another individual is directing their attention involves more than simply analysing their gaze direction. We go on to describe research with adult participants, children and non-human primates that suggests that other cues such as head orientation and pointing gestures make significant contributions to the computation of another's direction of attention.     

Dynamic emotional messages differentially affect 6-month-old infants’ attention to eyes and gaze cues

Infants often experience interactions in which caregivers use dynamic messages to convey their affective and communicative intent. These dynamic emotional messages may shape the development of emotion discrimination skills and shared attention by influencing infants’ attention to internal facial features and their responses to eye gaze cues. However, past research examining infants’ responses to emotional faces has predominantly focused on classic, stereotyped expressions (e.g., happy, sad, angry) that may not reflect the variability that infants experience in their daily interactions. The present study therefore examined forty-two 6-month-old infants’ attention to eyes vs. mouth and gaze cueing responses across multiple dynamic emotional messages that are common to infant-directed interactions. Overall, infants looked more to the eyes during messages with negative affect, but this increased attention to the eyes during these message conditions did not directly facilitate gaze cueing. Infants instead showed reliable gaze cueing only after messages with positive and neutral affect. We additionally observed gender differences in infants’ attention to internal face features and subsequent gaze cueing responses. Female infants spent more time looking at the eyes during the dynamic emotional messages and showed increased initial orienting and longer looking to gaze-cued objects following positive messages, whereas male infants showed these gaze cueing effects following neutral messages. These results suggest that variability in caregivers' communication can shape infants’ attention to and processing of emotion and gaze information.     

The effects of the presence of a face and direct eye gaze on voice identity learning

We rarely become familiar with the voice of another person in isolation but usually also have access to visual identity information, thus learning to recognize their voice and face in parallel. There are conflicting findings as to whether learning to recognize voices in audiovisual vs audio-only settings is advantageous or detrimental to learning. One prominent finding shows that the presence of a face overshadows the voice, hindering voice identity learning by capturing listeners' attention (Face Overshadowing Effect; FOE). In the current study, we tested the proposal that the effect of audiovisual training on voice identity learning is driven by attentional processes. Participants learned to recognize voices through either audio-only training (Audio-Only) or through three versions of audiovisual training, where a face was presented alongside the voices. During audiovisual training, the faces were either looking at the camera (Direct Gaze), were looking to the side (Averted Gaze) or had closed eyes (No Gaze). We found a graded effect of gaze on voice identity learning: Voice identity recognition was most accurate after audio-only training and least accurate after audiovisual training including direct gaze, constituting a FOE. While effect sizes were overall small, the magnitude of FOE was halved for the Averted and No Gaze conditions. With direct gaze being associated with increased attention capture compared to averted or no gaze, the current findings suggest that incidental attention capture at least partially underpins the FOE. We discuss these findings in light of visual dominance effects and the relative informativeness of faces vs voices for identity perception.     

Processing head fakes in basketball: Are there ironic effects of instructions on the head-fake effect in basketball?

Instructions in sports are used to improve athletes’ performance. However, instructions can also impair performance if they direct athletes’ attention to a to-be-avoided behavior which paradoxically provokes exactly that behavior (ironic effect). The present study investigates the impact of different instructions on the head-fake effect in basketball. Specifically, we asked here if deliberate attempts to ignore the deceptive cues gaze direction and head orientation increase the impact of that information and thus, paradoxically increase the head-fake effect. We found that the detrimental impact of spatially incongruent gaze direction and head orientation was essentially independent of whether participants were, or were not, instructed to deliberately ignore the task-irrelevant information. Hence, deceptive actions exert their impact independent of the perceivers’ attempts to ignore deceptive cues. We thus conclude that the deceptive cues gaze direction and head orientation are per se hyper-accessible or over-salient and its processing cannot be controlled with any amount of mental capacity (and even not with the non-ironic instruction). However, as both ignore instructions produce general processing costs (i.e., slower reactions) coaches should solely instruct athletes’ to focus attention on the processing of the pass direction.     

Preference for human direct gaze in infant chimpanzees (Pan troglodytes)

We studied gaze perception in three infant chimpanzees (Pan troglodytes), aged 10-32 weeks, using a two-choice preferential-looking paradigm. The infants were presented with two photographs of a human face: (a) with the eyes open or closed, and (b) with a direct or an averted gaze. We found that the chimpanzees preferred looking at the direct-gaze face. However, in the context of scrambled faces, the infants showed no difference in gaze discrimination between direct and averted gazes. These findings suggest that gaze perception by chimpanzees may be influenced by the surrounding facial context. The relationship between gaze perception, face processing, and the adaptive significance of gaze perception are discussed from an evolutionary perspective.     

ERPs reveal similar effects of social gaze orienting and voluntary attention, and distinguish each from reflexive attention

Spatial attention can be reflexively captured by a physically salient stimulus, effortfully directed toward a relevant location, or involuntarily oriented in the direction of another person's gaze (i.e., social gaze orienting). Here, we used event-related potentials to compare the effects of these three types of orienting on multiple stages of subsequent target processing. Although gaze orienting has been associated more strongly with reflexive capture than with voluntary attention, the present data provide new evidence that the neural effects of social gaze orienting are markedly different from the effects of reflexive attentional capture by physically salient stimuli. Specifically, despite their similar behavioral effects, social gaze orienting and reflexive capture produce different effects on both early sensory processing (~120 ms; P1/N1 components) and later, higher-order processing (~300 ms; P3 component). In contrast, the effects of social gaze orienting were highly similar to those of voluntary orienting at these stages of target processing.     

Social Beliefs and Visual Attention: How the Social Relevance of a Cue Influences Spatial Orienting

We are highly tuned to each other's visual attention. Perceiving the eye or hand movements of another person can influence the timing of a saccade or the reach of our own. However, the explanation for such spatial orienting in interpersonal contexts remains disputed. Is it due to the social appearance of the cue—a hand or an eye—or due to its social relevance—a cue that is connected to another person with attentional and intentional states? We developed an interpersonal version of the Posner spatial cueing paradigm. Participants saw a cue and detected a target at the same or a different location, while interacting with an unseen partner. Participants were led to believe that the cue was either connected to the gaze location of their partner or was generated randomly by a computer (Experiment 1), and that their partner had higher or lower social rank while engaged in the same or a different task (Experiment 2). We found that spatial cue‐target compatibility effects were greater when the cue related to a partner's gaze. This effect was amplified by the partner's social rank, but only when participants believed their partner was engaged in the same task. Taken together, this is strong evidence in support of the idea that spatial orienting is interpersonally attuned to the social relevance of the cue—whether the cue is connected to another person, who this person is, and what this person is doing—and does not exclusively rely on the social appearance of the cue. Visual attention is not only guided by the physical salience of one's environment but also by the mental representation of its social relevance.