Attention misplaced: the role of diagnostic features in the face-inversion effect

Inversion disproportionately impairs recognition of face stimuli compared to nonface stimuli arguably due to the holistic manner in which faces are processed. A qualification is put forward in which the first point fixated on is different for upright and inverted faces and this carries some of the face-inversion effect. Three experiments explored this possibility by using fixation crosses to guide attention to the eye or mouth region of the to-be-presented faces in different orientations. Recognition was better when the fixation cross appeared at the eye region than at the mouth region. The face-inversion effect was smaller when the eyes were cued than when the mouth was cued or when there was no cueing. The results suggest that the first facial feature attended to is important for accurate face recognition and this may carry some of the effects of inversion.     

Facial perception of conspecifics: chimpanzees (Pan troglodytes) preferentially attend to proper orientation and open eyes

This paper reports on the use of an eye-tracking technique to examine how chimpanzees look at facial photographs of conspecifics. Six chimpanzees viewed a sequence of pictures presented on a monitor while their eye movements were measured by an eye tracker. The pictures presented conspecific faces with open or closed eyes in an upright or inverted orientation in a frame. The results demonstrated that chimpanzees looked at the eyes, nose, and mouth more frequently than would be expected on the basis of random scanning of faces. More specifically, they looked at the eyes longer than they looked at the nose and mouth when photographs of upright faces with open eyes were presented, suggesting that particular attention to the eyes represents a spontaneous face-scanning strategy shared among monkeys, apes, and humans. In contrast to the results obtained for upright faces with open eyes, the viewing times for the eyes, nose, and mouth of inverted faces with open eyes did not differ from one another. The viewing times for the eyes, nose, and mouth of faces with closed eyes did not differ when faces with closed eyes were presented in either an upright or inverted orientation. These results suggest the possibility that open eyes play an important role in the configural processing of faces and that chimpanzees perceive and process open and closed eyes differently.     

Removing the own-race bias in face recognition by attentional shift using fixation crosses to diagnostic features: An eye-tracking study

Hills and Lewis (2011) have demonstrated that the own-race bias in face recognition can be reduced or even removed by guiding participants' attention and potentially eye movements to the most diagnostic visual features. Using the same old/new recognition paradigm as Hills and Lewis, we recorded Black and White participants' eye movements whilst viewing Black and White faces following fixation crosses that preceded the bridge of the nose (between the eyes) or the tip of the nose. White faces were more accurately recognized when following high fixation crosses (that preceded the bridge of the nose) than when following low fixation crosses. The converse was true for Black faces. These effects were independent of participant race. The fixation crosses attracted the first fixation but had less effect on other eye-tracking measures. Furthermore, the location of the first fixation was predictive of recognition accuracy. These results are consistent with an attentional allocation model of the own-race bias in face recognition and highlight the importance of the first fixation for face perception (cf. Hsiao & Cottrell, 2008).     

Configural features in the context of upright and inverted faces

When faces are turned upside down, recognition is known to be severely disrupted. This effect is thought to be due to disruption of configural processing. Recently, Leder and Bruce (2000, Quarterly Journal of Experimental Psychology A 53 513-536) argued that configural information in face processing consists at least partly of locally processed relations between facial elements. In three experiments we investigated whether a local relational feature (the interocular distance) is processed differently in upside-down versus upright faces. In experiment 1 participants decided in which of two sequentially presented photographic faces the interocular distance was larger. The decision was more difficult in upside-down presentation. Three different conditions were used in experiment 2 to investigate whether this deficit depends upon parts of the face beyond the eyes themselves; displays showed the eye region alone, the eyes and nose, or the eyes and nose and mouth. The availability of additional features did not interact with the inversion effect which was observed strongly even when the eyes were shown in isolation. In experiment 3 all eyes were turned upside down in the inverted face condition as in the Thatcher illusion (Thompson, 1980 Perception 9 483-484). In this case no inversion effect was found. These results are in accordance with an explanation of the face-inversion effect in which the disruption of configural facial information plays the critical role in memory for faces, and in which configural information corresponds to spatial information that is processed in a way which is sensitive to local properties of the facial features involved.     

Do they ‘look’ different(ly)? Dynamic face recognition in Malaysians: Chinese,Malays and Indians compared

Previous cross-cultural eye-tracking studies examining face recognition discovered differences in the eye movement strategies that observers employ when perceiving faces. However, it is unclear (1) the degree to which this effect is fundamentally related to culture and (2) to what extent facial physiognomy can account for the differences in looking strategies when scanning own- and other-race faces. In the current study, Malay, Chinese and Indian young adults who live in the same multiracial country performed a modified yes/no recognition task. Participants' recognition accuracy and eye movements were recorded while viewing muted face videos of own- and other-race individuals. Behavioural results revealed a clear own-race advantage in recognition memory, and eye-tracking results showed that the three ethnic race groups adopted dissimilar fixation patterns when perceiving faces. Chinese participants preferentially attended more to the eyes than Indian participants did, while Indian participants made more and longer fixations on the nose than Malay participants did. In addition, we detected statistically significant, though subtle, differences in fixation patterns between the faces of the three races. These findings suggest that the racial differences in face-scanning patterns may be attributed both to culture and to variations in facial physiognomy between races.     

眼睛区域构型信息与特征信息的跨维共变增益效应及其加工特异性

面孔知觉可能在区域尺度上发生多维信息整合, 但迄今无特异性实验证据。本研究在两个实验中操纵面孔眼睛区域或嘴巴区域的单维构型或特征信息, 测量人们觉察单维变化或跨维共变的敏感度, 以此检测面孔区域尺度上的多维信息整合有何现象与规律, 进而揭示面孔知觉的多维信息整合机制。实验获得3个发现：(1)正立面孔眼睛区域的信息变化觉察呈现出“跨维共变增益效应”, 跨维信息共变觉察的敏感度显著高于任意一种单维信息变化觉察的敏感度; (2)“跨维共变增益效应”只在正立面孔的眼睛区域出现, 在倒置面孔的眼睛区域、正立面孔的嘴巴区域或倒置面孔的嘴巴区域都没有出现, 因此具有面孔区域特异性和面孔朝向特异性; (3)就单维信息变化觉察而言, 眼睛区域的敏感度不会受到面孔倒置的损伤, 但是嘴巴区域的敏感度会受到面孔倒置的显著损伤。综合可知, 面孔知觉确实会发生区域尺度上的信息整合, 它不是普遍性的信息量效应, 而是特异性的眼睛效应(只发生在正立面孔的眼睛区域)。这是面孔整体加工(face holistic processing)在单维信息分辨和多维信息整合之间建立联系的必经环节。这提示我们对全脸多维信息知觉整合的理解需要从传统的面孔整体加工假设升级到以眼睛为中心的层级化多维信息整合算法(a hierarchical algorithm for multi-dimensional information integration)。     

A feature-inversion effect: can an isolated feature show behavior like the face-inversion effect?

The face-inversion effect (FIE) is explained by the configural-processing hypothesis. It proposes that inversion disrupts configural information processing (spatial links among facial features) and leaves the processing of featural information (eyes, nose, and mouth) comparatively intact. According to this hypothesis, an inverted isolated facial feature cannot show a feature-inversion effect--that is, behavior similar to the FIE--since all the spatial links between it and the other features in a face are eliminated; that is, the configural information is removed. The findings of the present study, which show that isolated eyes do exhibit the feature-inversion effect, support the extended configural-processing hypothesis. This proposes that inversion also impairs processing of the configural information within the eyes themselves. Removal of the brows in whole faces tended to interfere with processing of the configural information in the upright position but to facilitate processing in the inverted position.     

Aberrant first fixations when looking at inverted faces in various poses: The result of the centre‐of‐gravity effect?

Face recognition is essential in everyday human life, and all faces are encountered in different poses. However, when a face is inverted, difficulties arise for recognition and eye movements may (Barton, Radcliffe, Cherkasova, Edleman, & Intriligator, 2006) or may not be disrupted (Williams & Henderson, 2007). The present study explored the effects of orientation and pose on recognition and eye movements during a standard old/new recognition task in order to resolve whether inversion disrupts eye movements. Eye‐tracking data looked at the first fixations, the number of fixations, and the duration of fixations over a face. A standard inversion effect was observed, but the three‐quarter view advantage was not observed. Eye‐movement data revealed that the eyes were the most sampled feature (in terms of first fixation, number of fixations, and duration of fixation) for all upright faces, however, other features were sampled first for inverted faces. These results are consistent with Barton et al.'s (2006) but not Williams and Henderson's (2007) findings: possible explanations for this are discussed with the caveat that the same images were used from learning to test.     

哭泣表情面孔的注意偏向:眼动的证据

研究采用双选择Oddball范式和线索-靶子范式,并结合眼动技术,以微笑、哭泣和中性表情面孔为刺激材料,综合考察哭泣表情面孔在识别和解离过程中的注意偏向。研究发现:在识别阶段,哭泣表情面孔的识别正确率和反应速度都显著优于微笑表情面孔,进一步的兴趣区注视偏向分析发现,哭泣和微笑表情面孔的注视模式既具有一致的规律,又存在细微的差异;在解离阶段,返回抑制受线索表情类型的影响,在有效线索条件下,哭泣表情线索呈现后个体对目标刺激的平均注视时间和眼跳潜伏期都显著短于其它表情线索。表明哭泣表情面孔在识别和解离过程中具有不同的注意偏向表现,在识别阶段表现为反应输出优势和注视模式上的一致性与差异性;在解离阶段表现为有效线索条件下,对目标刺激定位和视觉加工的促进作用。     

Attending to faces: change detection,familiarization, and inversion effects

We tested detection of changes to eye position, eye color (brightness), mouth position, and mouth color in frontal views of faces. Two faces were presented sequentially for 555 ms each, with a blank screen of 120 ms separating the two. Faces were presented either both upright or both inverted. Measures of detection (d') were calculated for several different degrees of change for each of the four dimensions of change. We first compared results to an earlier experiment that used an oddity design, in which subjects indicated which of three simultaneously viewed and otherwise identical faces had been altered on one of these four dimensions. Subjects in both of these experiments were partially cued, in that they knew the four possible types of changes that could occur on a given trial. The change-detection results correlated well with the oddity data. They confirmed that face inversion had little effect upon detection of changes in eye color, a moderate effect upon detection of eye-position or mouth-color changes, and caused a drastic reduction in the detection of mouth-position changes. An experiment in which uncued and fully cued subjects were compared showed that cueing significantly improved detection of feature color changes, but there was little difference between upright and inverted faces. Full cueing eliminated all effects of inversion. Compared to partial cueing, changes in mouth color were poorly detected by uncued subjects. Last, a change in the frequency of the base (unaltered) face in an experiment from 75% to 40% showed that increased short-term familiarity decreased the detection of eye changes and increased the detection of mouth changes, regardless of face orientation and the type of change made (color or position). We conclude that uncued subjects encode the spatial relations of features more than the colors of features, that mouth color in particular is not considered a relevant dimension for encoding, and that familiarization redistributes attention from more to less salient facial regions. Inversion effects are not simply an exaggeration of the salience effects revealed by withdrawing cueing, but represent an interaction of spatial encoding with salience, in that the greatest inversion effects occur for spatial shifts in less salient facial regions, and can be eliminated through the use of focused attention.     

How the Thatcher illusion reveals evolutionary differences in the face processing of primates

Face recognition in humans is a complex cognitive skill that requires sensitivity to unique configurations of eyes, mouth, and other facial features. The Thatcher illusion has been used to demonstrate the importance of orientation when processing configural information within faces. Transforming an upright face so that the eyes and mouth are inverted renders the face grotesque; however, when this “Thatcherized” face is inverted, the effect disappears. Due to the use of primate models in social cognition research, it is important to determine the extent to which specialized cognitive functions like face processing occur across species. To date, the Thatcher illusion has been explored in only a few species with mixed results. Here, we used computerized tasks to examine whether nonhuman primates perceive the Thatcher illusion. Chimpanzees and rhesus monkeys were required to discriminate between Thatcherized and unaltered faces presented upright and inverted. Our results confirm that chimpanzees perceived the Thatcher illusion, but rhesus monkeys did not, suggesting species differences in the importance of configural information in face processing. Three further experiments were conducted to understand why our results differed from previously published accounts of the Thatcher illusion in rhesus monkeys.     

The ups and downs of face perception: evidence for holistic encoding of upright and inverted faces

A visual-search task was used to investigate the influence of facial organisation on discrimination of an internal facial feature. Participants searched for a downturned mouth in arrays of one to six faces that differed only in the target feature, with distractor faces containing an upturned mouth. Feature search was tested in four different face contexts: upright unaltered faces, inverted unaltered faces, upright faces in which the internal features were scrambled, or inverted scrambled faces. Normal face organisation facilitated feature search in upright faces, but slowed it in inverted faces. These findings demonstrate an interdependence of features and their configuration in the perceptual analysis of both upright and inverted faces.     

Inhibition of object identity in inhibition of return: Implications for encoding and retrieving inhibitory processes

Inhibition of return (IOR) effects, in which participants detect a target in a cued box more slowly than one in an uncued box, suggest that behavior is aided by inhibition of recently attended irrelevant locations. To investigate the controversial question of whether inhibition can be applied to object identity in these tasks, in the present research we presented faces upright or inverted during cue and/or target sequences. IOR was greater when both cue and target faces were upright than when cue and/or target faces were inverted. Because the only difference between the conditions was the ease of facial recognition, this result indicates that inhibition was applied to object identity. Interestingly, inhibition of object identity affected IOR both whenencoding a cue face andretrieving information about a target face. Accordingly, we propose that episodic retrieval of inhibition associated with object identity may mediate behavior in cuing tasks.     

5~6岁幼儿对不同文化背景卡通面孔再认的眼动研究

采用不同文化背景卡通面孔为刺激材料,探究中国幼儿对中国风、日本风与欧美风女性卡通面孔再认的差异及其眼动机制。结果显示：（1）卡通面孔再认正确率差异显著,日本风面孔具有记忆优势;女童对三种面孔再认正确率均显著高于男童;（2）卡通面孔特质中的夸张性对卡通面孔再认正确率的预测显著;（3）文化背景与性别因素显著影响平均注视时间、注视点个数、眼跳次数和幅度及瞳孔大小等总体眼动指标;（4）兴趣区数据显示：对日本风面孔的总注视时间和注视点个数最高;卡通面孔再认主要依赖于眼部、其次为鼻子;文化背景与兴趣区存在交互作用,在注视时间、注视点个数与首注视点指标上,提示幼儿更关注日本风的眼睛区域与欧美风的鼻子区域。综上,幼儿对不同文化背景卡通面孔的记忆和眼动加工存在差异,日本风卡通面孔的记忆优势可能基于其夸张性高的面孔特质,尤其在眼睛部位;行为学与眼动指标均提示女童对卡通面孔的再认具有优势。     

Effects of motion and audio-visual redundancy on upright and inverted face and feature preferences in 4-13-month old pre- and full-term NICU graduates

NICU infants are reported to have diminished social orientation and increased risk of socio-communicative disorders. In this eye tracking study, we used a preference for upright compared to inverted faces as a gauge of social interest in high medical risk full- and pre-term NICU infants. We examined the effects of facial motion and audio-visual redundancy on face and eye/mouth preferences across the first year. Upright and inverted baby faces were simultaneously presented in a paired-preference paradigm with motion and synchronized vocalization varied. NICU risk factors including birth weight, sex, and degree of CNS injury were examined. Overall, infants preferred the more socially salient upright faces, making this the first report, to our knowledge, of an upright compared to inverted face preference among high medical risk NICU infants. Infants with abnormalities on cranial ultrasound displayed lower social interest, i.e. less of a preferential interest in upright faces, when viewing static faces. However, motion selectively increased their upright face looking time to a level equal that of infants in other CNS injury groups. We also observed an age-related sex effect suggesting higher risk in NICU males. Females increased their attention to the mouth in upright faces across the first year, especially between 7–10 months, but males did not. Although vocalization increased diffuse attention toward the screen, contrary to our predictions, there was no evidence that the audio-visual redundancy embodied in a vocalizing face focused additional attention on upright faces or mouths. This unexpected result may suggest a vulnerability in response to talking faces among NICU infants that could potentially affect later verbal and socio-communicative development.     

A smile biases the recognition of eye expressions: Configural projection from a salient mouth

A smile is visually highly salient and grabs attention automatically. We investigated how extrafoveally seen smiles influence the viewers' perception of non-happy eyes in a face. A smiling mouth appeared in composite faces with incongruent non-happy (fearful, neutral, etc.) eyes, thus producing blended expressions, or it appeared in intact faces with genuine expressions. Attention to the eye region was spatially cued while foveal vision of the mouth was blocked by gaze-contingent masking. Participants judged whether the eyes were happy or not. Results indicated that the smile biased the evaluation of the eye expression: The same non-happy eyes were more likely to be judged as happy and categorized more slowly as not happy in a face with a smiling mouth than in a face with a non-smiling mouth or with no mouth. This bias occurred when the mouth and the eyes appeared simultaneously and aligned, but also to some extent when they were misaligned and when the mouth appeared after the eyes. We conclude that the highly salient smile projects to other facial regions, thus influencing the perception of the eye expression. Projection serves spatial and temporal integration of face parts and changes.     

Recognition of emotion from inverted schematic drawings of faces

The present study investigated whether facial expressions of emotion are recognized holistically, i.e., all at once as an entire unit, as faces are or featurally as other nonface stimuli. Evidence for holistic processing of faces comes from a reliable decrement in recognition performance when faces are presented inverted rather than upright. If emotion is recognized holistically, then recognition of facial expressions of emotion should be impaired by inversion. To test this, participants were shown schematic drawings of faces showing one of six emotions (surprise, sadness, anger, happiness, disgust, and fear) in either an upright or inverted orientation and were asked to indicate the emotion depicted. Participants were more accurate in the upright than in the inverted orientation, providing evidence in support of holistic recognition of facial emotion. Because recognition of facial expressions of emotion is important in social relationships, this research may have implications for treatment of some social disorders.     

A unique look at face processing: the impact of masked faces on the processing of facial features

This experiment utilized a masked priming paradigm to explore the early processes involved in face recognition. The first experiment investigated implicit processing of the eyes and mouth in an upright face, using prime durations of 33 and 50 ms. The results demonstrate implicit processing of both the eyes and mouth, and support the configural processing theory of face processing. The second experiment used the same method with inverted faces and the third experiment was a combination of Experiments 1 and 2. The fourth experiment utilized misaligned faces as the primes. Based on the pattern of results from these experiments, we suggest that, when a face is inverted, the eyes and mouth are initially processed individually and are not linked until a later stage of processing. An upright face is proposed to be processed by analysis of its configuration, whereas an inverted face is initially processed using first-order relational information, and then converted to an upright representation and transferred to face specific regions for configural analysis.     

An investigation of basic facial expression recognition in autism spectrum disorders

This study was designed to test three competing hypotheses (impaired configural processing; impaired Theory of Mind; atypical amygdala functioning) to explain the basic facial expression recognition profile of adults with autism spectrum disorders (ASD). In Experiment 1 the Ekman and Friesen (1976) series were presented upright and inverted. Individuals with ASD were significantly less accurate than controls at recognising upright facial expressions of fear, sadness and disgust and their pattern of errors suggested some configural processing difficulties. Impaired recognition of inverted facial expressions suggested some additional difficulties processing the facial features. Unexpectedly, the clinical group misidentified fear as anger. In Experiment 2 feature processing of facial expressions was investigated by presenting stimuli in a piecemeal fashion, starting with either just the eyes or the mouth. Individuals with ASD were impaired at recognising fear from the eyes and disgust from the mouth; they also confused fearful eyes as being angry. The findings are discussed in terms of the three competing hypotheses tested.     

Is there more in a happy face than just a big smile?

Happy faces involve appearance changes in the mouth (the smile) and eye region (e.g., narrowing of the eye opening). The present experiments investigated whether the recognition of happy faces is achieved on the basis of the smile alone or whether information in the eye region is also used. A go/no-go task was used in which participants responded to happy faces and withhold a response to nonhappy distractors. The presence/absence of the expressive cues in the eyes did not affect recognition accuracy but reaction times were slightly longer for smiles without expressive cues in the eyes. This delay was not obtained when the top and the bottom halves of the faces were misaligned, or when the distractor was changed from a top-dominant to a bottom-dominant facial expression (i.e., from anger to disgust). Together, these results suggest that the eyes may have a modest effect on speeded recognition of happy faces although the presence of this effect may depend on task context.