First fixations in face processing: The more diagnostic they are the smaller the face-inversion effect

Hills, Ross, and Lewis (2011) introduced the concept that the face-inversion effect may, in part, be carried by the first feature attended to, since the first feature fixated upon is different for upright and inverted faces. An eye-tracking study that directly assesses this hypothesis by using fixation crosses to guide attention to the eye or mouth region of the to-be-presented upright and inverted faces was devised. Recognition was better when the fixation cross appeared at the eye region than at the mouth region. The face-inversion effect was smaller when the eyes were cued than when the mouth was cued or when there was no cueing. The eye-tracking measures confirmed that the fixation crosses attracted the first fixation but did not affect other measures of eye-movements. Furthermore, the location of the first fixation predicted recognition accuracy: when the first fixation was to the eyes, recognition accuracy was higher than when the first fixation was to the mouth, irrespective of facial orientation. The results suggest that the first facial feature attended to is more predictive of recognition accuracy than the face orientation in which they are presented.     

哭泣表情面孔的注意偏向:眼动的证据

研究采用双选择Oddball范式和线索-靶子范式,并结合眼动技术,以微笑、哭泣和中性表情面孔为刺激材料,综合考察哭泣表情面孔在识别和解离过程中的注意偏向。研究发现:在识别阶段,哭泣表情面孔的识别正确率和反应速度都显著优于微笑表情面孔,进一步的兴趣区注视偏向分析发现,哭泣和微笑表情面孔的注视模式既具有一致的规律,又存在细微的差异;在解离阶段,返回抑制受线索表情类型的影响,在有效线索条件下,哭泣表情线索呈现后个体对目标刺激的平均注视时间和眼跳潜伏期都显著短于其它表情线索。表明哭泣表情面孔在识别和解离过程中具有不同的注意偏向表现,在识别阶段表现为反应输出优势和注视模式上的一致性与差异性;在解离阶段表现为有效线索条件下,对目标刺激定位和视觉加工的促进作用。     

A smile biases the recognition of eye expressions: Configural projection from a salient mouth

A smile is visually highly salient and grabs attention automatically. We investigated how extrafoveally seen smiles influence the viewers' perception of non-happy eyes in a face. A smiling mouth appeared in composite faces with incongruent non-happy (fearful, neutral, etc.) eyes, thus producing blended expressions, or it appeared in intact faces with genuine expressions. Attention to the eye region was spatially cued while foveal vision of the mouth was blocked by gaze-contingent masking. Participants judged whether the eyes were happy or not. Results indicated that the smile biased the evaluation of the eye expression: The same non-happy eyes were more likely to be judged as happy and categorized more slowly as not happy in a face with a smiling mouth than in a face with a non-smiling mouth or with no mouth. This bias occurred when the mouth and the eyes appeared simultaneously and aligned, but also to some extent when they were misaligned and when the mouth appeared after the eyes. We conclude that the highly salient smile projects to other facial regions, thus influencing the perception of the eye expression. Projection serves spatial and temporal integration of face parts and changes.     

Configural features in the context of upright and inverted faces

When faces are turned upside down, recognition is known to be severely disrupted. This effect is thought to be due to disruption of configural processing. Recently, Leder and Bruce (2000, Quarterly Journal of Experimental Psychology A 53 513-536) argued that configural information in face processing consists at least partly of locally processed relations between facial elements. In three experiments we investigated whether a local relational feature (the interocular distance) is processed differently in upside-down versus upright faces. In experiment 1 participants decided in which of two sequentially presented photographic faces the interocular distance was larger. The decision was more difficult in upside-down presentation. Three different conditions were used in experiment 2 to investigate whether this deficit depends upon parts of the face beyond the eyes themselves; displays showed the eye region alone, the eyes and nose, or the eyes and nose and mouth. The availability of additional features did not interact with the inversion effect which was observed strongly even when the eyes were shown in isolation. In experiment 3 all eyes were turned upside down in the inverted face condition as in the Thatcher illusion (Thompson, 1980 Perception 9 483-484). In this case no inversion effect was found. These results are in accordance with an explanation of the face-inversion effect in which the disruption of configural facial information plays the critical role in memory for faces, and in which configural information corresponds to spatial information that is processed in a way which is sensitive to local properties of the facial features involved.     

Removing the own-race bias in face recognition by attentional shift using fixation crosses to diagnostic features: An eye-tracking study

Hills and Lewis (2011) have demonstrated that the own-race bias in face recognition can be reduced or even removed by guiding participants' attention and potentially eye movements to the most diagnostic visual features. Using the same old/new recognition paradigm as Hills and Lewis, we recorded Black and White participants' eye movements whilst viewing Black and White faces following fixation crosses that preceded the bridge of the nose (between the eyes) or the tip of the nose. White faces were more accurately recognized when following high fixation crosses (that preceded the bridge of the nose) than when following low fixation crosses. The converse was true for Black faces. These effects were independent of participant race. The fixation crosses attracted the first fixation but had less effect on other eye-tracking measures. Furthermore, the location of the first fixation was predictive of recognition accuracy. These results are consistent with an attentional allocation model of the own-race bias in face recognition and highlight the importance of the first fixation for face perception (cf. Hsiao & Cottrell, 2008).     

Losing face: impaired discrimination of featural and configural information in the mouth region of an inverted face

Given that all faces share the same set of features—two eyes, a nose, and a mouth—that are arranged in similar configuration, recognition of a specific face must depend on our ability to discern subtle differences in its featural and configural properties. An enduring question in the face-processing literature is whether featural or configural information plays a larger role in the recognition process. To address this question, the face dimensions task was designed, in which the featural and configural properties in the upper (eye) and lower (mouth) regions of a face were parametrically and independently manipulated. In a same–different task, two faces were sequentially presented and tested in their upright or in their inverted orientation. Inversion disrupted the perception of featural size (Exp. 1), featural shape (Exp. 2), and configural changes in the mouth region, but it had relatively little effect on the discrimination of featural size and shape and configural differences in the eye region. Inversion had little effect on the perception of information in the top and bottom halves of houses (Exp. 3), suggesting that the lower-half impairment was specific to faces. Spatial cueing to the mouth region eliminated the inversion effect (Exp. 4), suggesting that participants have a bias to attend to the eye region of an inverted face. The collective findings from these experiments suggest that inversion does not differentially impair featural or configural face perceptions, but rather impairs the perception of information in the mouth region of the face.     

Aberrant first fixations when looking at inverted faces in various poses: The result of the centre‐of‐gravity effect?

Face recognition is essential in everyday human life, and all faces are encountered in different poses. However, when a face is inverted, difficulties arise for recognition and eye movements may (Barton, Radcliffe, Cherkasova, Edleman, & Intriligator, 2006) or may not be disrupted (Williams & Henderson, 2007). The present study explored the effects of orientation and pose on recognition and eye movements during a standard old/new recognition task in order to resolve whether inversion disrupts eye movements. Eye‐tracking data looked at the first fixations, the number of fixations, and the duration of fixations over a face. A standard inversion effect was observed, but the three‐quarter view advantage was not observed. Eye‐movement data revealed that the eyes were the most sampled feature (in terms of first fixation, number of fixations, and duration of fixation) for all upright faces, however, other features were sampled first for inverted faces. These results are consistent with Barton et al.'s (2006) but not Williams and Henderson's (2007) findings: possible explanations for this are discussed with the caveat that the same images were used from learning to test.     

When inverted faces are recognized: The role of configural information in face recognition

The identification of upright faces seems to involve a special sensitivity to "configural" information, the processing of which is less effective when the face is inverted. However the precise meaning of "configural" remains unclear. Five experiments are presented, which showed that the disruption of the processing of relational, rather than holistic, information largely determines the occurrence as well as the size of the face-inversion effect. In Experiment 1, faces could be identified either by unique combinations of local information (e.g. a specific eye colour plus hair colour) or by unique relational information (e.g. nose-mouth distance). The former showed no inversion effect, whereas the latter did. A combination of local and relational information (Experiment 2) again produced an inversion effect, although this effect was smaller than that found when only relational information was used. The results were replicated in Experiment 3 when differences in the brightness of local features were used instead of specific colour combinations. Experiment 4 used different retrieval conditions to distinguish relational from holistic processing, and demonstrated again that spatial relations between single features appeared to provide crucial information for face recognition. In Experiment 5, the importance of relational information was confirmed using faces that also varied in the shapes of local features.     

Face processing and familiarity: Evidence from eye‐movement data

How is information extracted from familiar and unfamiliar faces? Three experiments, in which eye‐movement measures were used, examined whether there was differential sampling of the internal face region according to familiarity. Experiment 1 used a face familiarity task and found that whilst the majority of fixations fell within the internal region, there were no differences in the sampling of this region according to familiarity. Experiment 2 replicated these findings, using a standard recognition memory paradigm. The third experiment employed a matching task, and once again found that the majority of fixations fell within the internal region. Additionally, this experiment found that there was more sampling of the internal region when faces were familiar compared with when they were unfamiliar. The use of eye fixation measures affirms the importance of internal facial features in the recognition of familiar faces compared with unfamiliar faces, but only when viewers compare pairs of faces.     

Facial expression recognition in peripheral versus central vision: role of the eyes and the mouth

This study investigated facial expression recognition in peripheral relative to central vision, and the factors accounting for the recognition advantage of some expressions in the visual periphery. Whole faces or only the eyes or the mouth regions were presented for 150 ms, either at fixation or extrafoveally (2.5° or 6°), followed by a backward mask and a probe word. Results indicated that (a) all the basic expressions were recognized above chance level, although performance in peripheral vision was less impaired for happy than for non-happy expressions, (b) the happy face advantage remained when only the mouth region was presented, and (c) the smiling mouth was the most visually salient and most distinctive facial feature of all expressions. This suggests that the saliency and the diagnostic value of the smile account for the advantage in happy face recognition in peripheral vision. Because of saliency, the smiling mouth accrues sensory gain and becomes resistant to visual degradation due to stimulus eccentricity, thus remaining accessible extrafoveally. Because of diagnostic value, the smile provides a distinctive single cue of facial happiness, thus bypassing integration of face parts and reducing susceptibility to breakdown of configural processing in peripheral vision.     

Development of Recognition of Face Parts from Unfamiliar Faces

The present study examined developmental changes in the ability to recognize face parts. In Experiment 1, participants were familiarized with whole faces and given a recognition test with old and new eyes, noses, mouths, inner faces, outer faces, or whole faces. Adults were above chance in their recognition of the eye and mouth regions. However, children did not naturally encode and recognize face parts independently of the entire face. In addition, all age groups showed comparable inner and outer face recognition, except for 8‐ to 9‐year‐olds who showed a recognition advantage for outer faces. In Experiment 2, when participants were familiarized with eyes, noses, or mouths and tested with eyes, noses, or mouths, respectively, all ages showed above‐chance recognition of eyes and mouths. Thirteen‐ to 14‐year‐olds were adult‐like in their recognition of the eye region, but mouth recognition continued to develop beyond 14 years of age. Nose recognition was above chance among 13‐ to 14‐year‐olds, but recognition scores remained low even in adulthood. The present findings reveal unique developmental trajectories in the use of isolated facial regions in face recognition and suggest that featural cues (as a class) have a different ontogenetic course relative to holistic and configural cues. Copyright © 2012 John Wiley & Sons, Ltd.     

5~6岁幼儿对不同文化背景卡通面孔再认的眼动研究

采用不同文化背景卡通面孔为刺激材料,探究中国幼儿对中国风、日本风与欧美风女性卡通面孔再认的差异及其眼动机制。结果显示：（1）卡通面孔再认正确率差异显著,日本风面孔具有记忆优势;女童对三种面孔再认正确率均显著高于男童;（2）卡通面孔特质中的夸张性对卡通面孔再认正确率的预测显著;（3）文化背景与性别因素显著影响平均注视时间、注视点个数、眼跳次数和幅度及瞳孔大小等总体眼动指标;（4）兴趣区数据显示：对日本风面孔的总注视时间和注视点个数最高;卡通面孔再认主要依赖于眼部、其次为鼻子;文化背景与兴趣区存在交互作用,在注视时间、注视点个数与首注视点指标上,提示幼儿更关注日本风的眼睛区域与欧美风的鼻子区域。综上,幼儿对不同文化背景卡通面孔的记忆和眼动加工存在差异,日本风卡通面孔的记忆优势可能基于其夸张性高的面孔特质,尤其在眼睛部位;行为学与眼动指标均提示女童对卡通面孔的再认具有优势。     

Configural processing in the perception of eye-gaze direction

Traditional accounts of gaze perception emphasise the geometric or configural cues present in the eye; the position of the iris in relation to the corner of the eye, for example. This kind of geometric account has been supported, in part, by findings that gaze judgments are impaired in faces rotated through 180 degrees, a manipulation known to disrupt the processing of relations between facial elements. However, studies involving this manipulation have confounded inversion of the face context with inversion of the eye region. The effects of inversion might therefore have been caused by a disruption of the computation of gaze direction from the eye region itself and/or a disruption of the influence that face context might exert on gaze processing. In the experiment reported here we independently manipulated eye orientation and the orientation of the face context, and measured participants' sensitivity to gaze direction. Performance was severely affected by inversion of the eyes, regardless of the orientation of the face, whereas face inversion had no significant effect on gaze sensitivity. Previous reports of a face-inversion effect on gaze perception can therefore be attributed to inversion of the eye region itself which, we suggest, disrupts some form of configural or relational processing that is normally involved in the computation of eye-gaze direction.     

How dogs scan familiar and inverted faces: an eye movement study

Faces play an important role in communication and identity recognition in social animals. Domestic dogs often respond to human facial cues, but their face processing is weakly understood. In this study, facial inversion effect (deficits in face processing when the image is turned upside down) and responses to personal familiarity were tested using eye movement tracking. A total of 23 pet dogs and eight kennel dogs were compared to establish the effects of life experiences on their scanning behavior. All dogs preferred conspecific faces and showed great interest in the eye area, suggesting that they perceived images representing faces. Dogs fixated at the upright faces as long as the inverted faces, but the eye area of upright faces gathered longer total duration and greater relative fixation duration than the eye area of inverted stimuli, regardless of the species (dog or human) shown in the image. Personally, familiar faces and eyes attracted more fixations than the strange ones, suggesting that dogs are likely to recognize conspecific and human faces in photographs. The results imply that face scanning in dogs is guided not only by the physical properties of images, but also by semantic factors. In conclusion, in a free-viewing task, dogs seem to target their fixations at naturally salient and familiar items. Facial images were generally more attractive for pet dogs than kennel dogs, but living environment did not affect conspecific preference or inversion and familiarity responses, suggesting that the basic mechanisms of face processing in dogs could be hardwired or might develop under limited exposure.     

Face processing is enhanced in the left and upper visual hemi-fields

We tested whether two known hemi-field asymmetries would affect visual search with face stimuli. Holistic processing of spatial configurations is better in the left hemi-field, reflecting a right hemisphere specialization, and object recognition is better in the upper visual field, reflecting stronger projections into the ventral stream. Faces tap into holistic processing and object recognition at the same time, which predicts better performance in the left and upper hemi-field, respectively. In the first experiment, participants had to detect a face with a gaze direction different from the remaining faces. Participants were faster to respond when targets were presented in the left and upper hemi-field. The same pattern of results was observed when only the eye region was presented. In the second experiment, we turned the faces upside-down, which eliminated the typical spatial configuration of faces. The left hemi-field advantage disappeared, showing that it is related to holistic processing of faces, whereas the upper hemi-field advantage related to object recognition persisted. Finally, we made the search task easier by asking observers to search for a face with open among closed eyes or vice versa. The easy search task eliminated the need for complex object recognition and, accordingly, the advantage of the upper visual field disappeared. Similarly, the left hemi-field advantage was attenuated. In sum, our findings show that both horizontal and vertical asymmetries affect the search for faces and can be selectively suppressed by changing characteristics of the stimuli.     

眼睛区域构型信息与特征信息的跨维共变增益效应及其加工特异性

面孔知觉可能在区域尺度上发生多维信息整合, 但迄今无特异性实验证据。本研究在两个实验中操纵面孔眼睛区域或嘴巴区域的单维构型或特征信息, 测量人们觉察单维变化或跨维共变的敏感度, 以此检测面孔区域尺度上的多维信息整合有何现象与规律, 进而揭示面孔知觉的多维信息整合机制。实验获得3个发现：(1)正立面孔眼睛区域的信息变化觉察呈现出“跨维共变增益效应”, 跨维信息共变觉察的敏感度显著高于任意一种单维信息变化觉察的敏感度; (2)“跨维共变增益效应”只在正立面孔的眼睛区域出现, 在倒置面孔的眼睛区域、正立面孔的嘴巴区域或倒置面孔的嘴巴区域都没有出现, 因此具有面孔区域特异性和面孔朝向特异性; (3)就单维信息变化觉察而言, 眼睛区域的敏感度不会受到面孔倒置的损伤, 但是嘴巴区域的敏感度会受到面孔倒置的显著损伤。综合可知, 面孔知觉确实会发生区域尺度上的信息整合, 它不是普遍性的信息量效应, 而是特异性的眼睛效应(只发生在正立面孔的眼睛区域)。这是面孔整体加工(face holistic processing)在单维信息分辨和多维信息整合之间建立联系的必经环节。这提示我们对全脸多维信息知觉整合的理解需要从传统的面孔整体加工假设升级到以眼睛为中心的层级化多维信息整合算法(a hierarchical algorithm for multi-dimensional information integration)。     

The Thatcher illusion: rotating the viewer instead of the picture

Faces are difficult to recognise when presented upside down. This effect of face inversion was effectively demonstrated with the 'Thatcher illusion' by Thompson (1980 Perception 9 483-484). It has been tacitly assumed that this effect is due to inversion relative to retinal coordinates. Here we tested whether it is due to egocentric (i.e. retinal) inversion or whether the orientation of the body with respect to gravity also influences the face-inversion effect. A 3-D human turntable was used to test subjects in 5 different body-tilt (roll) orientations: 0 degree, 45 degrees, 90 degrees, 135 degrees, and 180 degrees. The stimuli consisted of 4 'normal' and 4 'thatcherised' faces and were presented in 8 different orientations in the picture plane. The subjects had to decide in a yes-no task whether the faces were 'normal' or 'thatcherised'. Analysis of the d' values revealed a significant effect of stimulus orientation and body tilt. The significant effect of body tilt was due to a drop in d' values in the 135 degrees orientation. This result is compared to findings of studies on the subjective visual vertical, where larger errors occurred in body-tilt orientations between 90 degrees and 180 degrees. The present findings suggest that the face-inversion effect relies mainly on retinal coordinates, but that in head-down body-tilt orientations around 135 degrees the gravitational reference frame has a major influence on the perception of faces.     

刷微博，让焦虑的人更焦虑——特质焦虑对青少年注意情绪刺激的影响

采用自由观看眼动追踪范式,考察特质焦虑青少年在观看情绪面孔图片过程中的眼动轨迹。结果发现,高特质焦虑组对愤怒和恐惧面孔的首次注视到达时间（TFF）较快,首次注视持续时间（TFD）较短;低特质焦虑组对愤怒和恐惧面孔的TFF虽然稍早于平静面孔,但差异不显著。在刺激呈现1000ms之后,高特质焦虑组对愤怒和恐惧面孔的注视次数（FC）较多,平均注视持续时间（AFD）较短。低特质焦虑组对愤怒和恐惧面孔的FC较少,AFD较长;这就表明,高特质焦虑青少年在认知加工早期对威胁性刺激注意定向加速,没有注意解除困难,呈现“浅尝辄止”现象。而在认知加工晚期,他们则对威胁性刺激存在“反刍”现象。     

The revealing glance: Eye gaze behavior to concealed information

We explored the usefulness of eye fixation durations as a dependent measure in a concealed knowledge test, drawing on Ryan, Hannula, and Cohen (2007), who found eye fixations on a familiar face to be longer than fixations on an unknown face. However, in their study, participants always had to select the known face out of three faces; thus, recognition and response intention could not be differentiated. In the experimental phase of our experiment, participants saw six faces per trial and had to select one of them. We had three conditions: In the first, one of the six faces was a known face, and the participants had to conceal that knowledge and select another face (concealed display); in another, one of the six faces was a known face, and the participants had to select that face (revealed display); or finally, all six faces were unknown, and participants had to select any of the six faces (neutral display). Using fixation durations as the dependent measure, we found a pure and early recognition effect; that is, fixations on the concealed faces (known but not selected) were longer than fixations on the nonselected unknown target faces in the neutral display. In addition, we found a response intention effect; that is, fixation durations on the selected known faces were longer than those on concealed faces (known but not selected).     

Face value: testing the utility of contextual face cues for face recognition

The presence of multiple faces during a crime may provide a naturally-occurring contextual cue to support eyewitness recognition for those faces later. Across two experiments, we sought to investigate mechanisms underlying previously-reported cued recognition effects, and to determine whether such effects extended to encoding conditions involving more than two faces. Participants studied sets of individual faces, pairs of faces, or groups of four faces. At test, participants in the single-face condition were tested only on those individual faces without cues. Participants in the two and four-face conditions were tested using no cues, correct cues (a face previously studied with the target test face), or incorrect cues (a never-before-seen face). In Experiment 2, associative encoding was promoted by a rating task. Neither hit rates nor false-alarm rates were significantly affected by cue type or face encoding condition in Experiment 1, but cuing of any kind (correct or incorrect) in Experiment 2 appeared to provide a protective buffer to reduce false-alarm rates through a less liberal response bias. Results provide some evidence that cued recognition techniques could be useful to reduce false recognition, but only when associative encoding is strong.