Do they ‘look’ different(ly)? Dynamic face recognition in Malaysians: Chinese,Malays and Indians compared

Previous cross-cultural eye-tracking studies examining face recognition discovered differences in the eye movement strategies that observers employ when perceiving faces. However, it is unclear (1) the degree to which this effect is fundamentally related to culture and (2) to what extent facial physiognomy can account for the differences in looking strategies when scanning own- and other-race faces. In the current study, Malay, Chinese and Indian young adults who live in the same multiracial country performed a modified yes/no recognition task. Participants' recognition accuracy and eye movements were recorded while viewing muted face videos of own- and other-race individuals. Behavioural results revealed a clear own-race advantage in recognition memory, and eye-tracking results showed that the three ethnic race groups adopted dissimilar fixation patterns when perceiving faces. Chinese participants preferentially attended more to the eyes than Indian participants did, while Indian participants made more and longer fixations on the nose than Malay participants did. In addition, we detected statistically significant, though subtle, differences in fixation patterns between the faces of the three races. These findings suggest that the racial differences in face-scanning patterns may be attributed both to culture and to variations in facial physiognomy between races.     

面孔部件在群体注意方向判断中的作用

探讨面孔部件(眼睛和鼻子)在个体和群体注意方向判断中的作用。实验1使用不同数量面孔的图片,要求报告群体或个体的注意方向。结果发现,多面孔条件下对群体注意方向估计的准确性高于单面孔条件。实验2采用眼动技术,探讨眼睛和鼻子在判断其注意方向时注视的空间与时间分布特征。结果发现,基于单张面孔判断时,对鼻子的总注视时间长于眼睛;基于多张面孔判断时,对眼睛和鼻子的总注视时间没有差异。整个研究表明,知觉个体注意主要依赖鼻子,知觉群体注意依赖眼睛和鼻子。     

面孔可爱度和客观熟悉度对婴儿面孔注意偏向效应的影响

近年来, 研究发现, 与成人面孔和其他社会性刺激相比, 成人对婴儿面孔表现出更多的注意偏向。本研究利用点探测范式, 结合眼动技术, 探讨了面孔可爱度和熟悉度对婴儿面孔注意偏向效应的影响。行为结果表明, 成人对高可爱度的婴儿面孔的反应时注意偏向更强; 眼动结果发现, 高可爱度的婴儿面孔的首注视时间偏向和总注视时间偏向更强, 表现为注意维持模式, 并且, 这一效应只出现在低熟悉度条件下; 而在可爱度评分上, 高熟悉度的婴儿面孔的可爱度评分显著高于低熟悉度的婴儿面孔。结果表明, 在低熟悉度条件下, 可爱度才会影响成人对婴儿面孔注意偏向效应; 在偏好行为上, 对婴儿面孔的主观评定和观看行为上可能存在分离的情况。     

5~6岁幼儿对不同文化背景卡通面孔再认的眼动研究

采用不同文化背景卡通面孔为刺激材料,探究中国幼儿对中国风、日本风与欧美风女性卡通面孔再认的差异及其眼动机制。结果显示：（1）卡通面孔再认正确率差异显著,日本风面孔具有记忆优势;女童对三种面孔再认正确率均显著高于男童;（2）卡通面孔特质中的夸张性对卡通面孔再认正确率的预测显著;（3）文化背景与性别因素显著影响平均注视时间、注视点个数、眼跳次数和幅度及瞳孔大小等总体眼动指标;（4）兴趣区数据显示：对日本风面孔的总注视时间和注视点个数最高;卡通面孔再认主要依赖于眼部、其次为鼻子;文化背景与兴趣区存在交互作用,在注视时间、注视点个数与首注视点指标上,提示幼儿更关注日本风的眼睛区域与欧美风的鼻子区域。综上,幼儿对不同文化背景卡通面孔的记忆和眼动加工存在差异,日本风卡通面孔的记忆优势可能基于其夸张性高的面孔特质,尤其在眼睛部位;行为学与眼动指标均提示女童对卡通面孔的再认具有优势。     

Eye movements are functional during face learning

In a free viewing learning condition, participants were allowed to move their eyes naturally as they learned a set of new faces. In a restricted viewing learning condition, participants remained fixated in a single central location as they learned the new faces. Recognition of the learned faces was then tested following the two learning conditions. Eye movements were recorded during the free viewing learning condition, as well as during recognition. The recognition results showed a clear deficit following the restricted viewing condition, compared with the free viewing condition, demonstrating that eye movements play a functional role during human face learning. Furthermore, the features selected for fixation during recognition were similar following free viewing and restricted viewing learning, suggesting that the eye movements generated during recognition are not simply a recapitulation of those produced during learning.     

Removing the own-race bias in face recognition by attentional shift using fixation crosses to diagnostic features: An eye-tracking study

Hills and Lewis (2011) have demonstrated that the own-race bias in face recognition can be reduced or even removed by guiding participants' attention and potentially eye movements to the most diagnostic visual features. Using the same old/new recognition paradigm as Hills and Lewis, we recorded Black and White participants' eye movements whilst viewing Black and White faces following fixation crosses that preceded the bridge of the nose (between the eyes) or the tip of the nose. White faces were more accurately recognized when following high fixation crosses (that preceded the bridge of the nose) than when following low fixation crosses. The converse was true for Black faces. These effects were independent of participant race. The fixation crosses attracted the first fixation but had less effect on other eye-tracking measures. Furthermore, the location of the first fixation was predictive of recognition accuracy. These results are consistent with an attentional allocation model of the own-race bias in face recognition and highlight the importance of the first fixation for face perception (cf. Hsiao & Cottrell, 2008).     

Straight gaze facilitates face processing but does not cause involuntary attentional capture

This study aimed to investigate the conditions under which eyes with a straight gaze capture attention more than eyes with an averted gaze, a phenomenon called the stare-in-the-crowd effect. In Experiment 1, we measured attentional capture by distractor faces with either straight or averted gaze that were shown among faces with closed eyes. Gaze direction of the distractor face was irrelevant because participants searched for a tilted face and indicated its gender. The presence of the distractor face with open eyes resulted in slower reaction times, but gaze direction had no effect, suggesting that straight gaze does not result in more involuntary attentional capture than averted gaze. In three further experiments with the same stimuli, the gaze direction of the target, and not the distractor, was varied. Better performance with straight than averted gaze of the target face was observed when the gaze direction or gender of the target face had to be discriminated. However, no difference between straight and averted was observed when only the presence of a face with open eyes had to be detected. Thus, the stare-in-the crowd effect is only observed when eye gaze is selected as part of the target and only when features of the face have to be discriminated. Our findings suggest that preference for straight gaze bears on target-related processes rather than on attentional capture per se.     

Similarity and difference in the processing of same- and other-race faces as revealed by eye tracking in 4- to 9-month-olds

Fixation duration for same-race (i.e., Asian) and other-race (i.e., Caucasian) female faces by Asian infant participants between 4 and 9 months of age was investigated with an eye-tracking procedure. The age range tested corresponded with prior reports of processing differences between same- and other-race faces observed in behavioral looking time studies, with preference for same-race faces apparent at 3 months of age and recognition memory differences in favor of same-race faces emerging between 3 and 9 months of age. The eye-tracking results revealed both similarity and difference in infants’ processing of own- and other-race faces. There was no overall fixation time difference between same race and other race for the whole face stimuli. In addition, although fixation time was greater for the upper half of the face than for the lower half of the face and trended higher on the right side of the face than on the left side of the face, face race did not impact these effects. However, over the age range tested, there was a gradual decrement in fixation time on the internal features of other-race faces and a maintenance of fixation time on the internal features of same-race faces. Moreover, the decrement in fixation time for the internal features of other-race faces was most prominent on the nose. The findings suggest that (a) same-race preferences may be more readily evidenced in paired comparison testing formats, (b) the behavioral decline in recognition memory for other-race faces corresponds in timing with a decline in fixation on the internal features of other-race faces, and (c) the center of the face (i.e., the nose) is a differential region for processing same- versus other-race faces by Asian infants.     

Sex differences in unfamiliar face identification: evidence from matching tasks

Research on sex differences in face recognition has reported mixed results, on balance suggesting an advantage for female observers. However, it is not clear whether this advantage is specific to face processing or reflects a more general superiority effect in episodic memory. The current study therefore examined sex differences with a face-matching task that eliminates memory demands. Across two experiments, female but not male observers showed an own-sex advantage on match trials, in which two pictures have to be identified as the same person. This advantage was present for whole faces and when only the internal or external facial features were shown. Female observers were also more accurate in these three conditions on mismatch encounters, in which two photographs have to be identified as different people, but this reflects a more general effect that is present for male and female faces. These findings converge with claims of a female advantage in face recognition and demonstrate that this effect persists when memory demands are eliminated.     

Some effects of alcohol and eye movements on cross-race face learning

This study examines the impact of acute alcohol intoxication on visual scanning in cross-race face learning. The eye movements of a group of white British participants were recorded as they encoded a series of own-and different-race faces, under alcohol and placebo conditions. Intoxication reduced the rate and extent of visual scanning during face encoding, reorienting the focus of foveal attention away from the eyes and towards the nose. Differences in encoding eye movements also varied between own-and different-race face conditions as a function of alcohol. Fixations to both face types were less frequent and more lingering following intoxication, but in the placebo condition this was only the case for different-race faces. While reducing visual scanning, however, alcohol had no adverse effect on memory, only encoding restrictions associated with sober different-race face processing led to poorer recognition. These results support perceptual expertise accounts of own-race face processing, but suggest the adverse effects of alcohol on face learning published previously are not caused by foveal encoding restrictions. The implications of these findings for alcohol myopia theory are discussed.     

Spatio-temporal dynamics of face recognition in a flash: it’s in the eyes

We adapted the Bubbles procedure [Vis. Res. 41 (2001) 2261] to examine the effective use of information during the first 282 ms of face identification. Ten participants each viewed a total of 5100 faces sub‐sampled in space–time. We obtained a clear pattern of effective use of information: the eye on the left side of the image became diagnostic between 47 and 94 ms after the onset of the stimulus; after 94 ms, both eyes were used effectively. This preference for the eyes increased with practice, and was not solely due to the informativeness of the eyes for the task at hand. The bias for the eye on the left side of the image is explained in terms of hemispheric specialization. Although there were individual differences, most participants exhibited this pattern of effective use of information. An intriguing finding is that most participants displayed a clear sinusoidal modulation of effective use of attention through time with a frequency of about 10.6 Hz.     

Attention to internal face features in unfamiliar face matching

Accurate matching of unfamiliar faces is vital in security and forensic applications, yet previous research has suggested that humans often perform poorly when matching unfamiliar faces. Hairstyle and facial hair can strongly influence unfamiliar face matching but are potentially unreliable cues. This study investigated whether increased attention to the more stable internal face features of eyes, nose, and mouth was associated with more accurate face‐matching performance. Forty‐three first‐year psychology students decided whether two simultaneously presented faces were of the same person or not. The faces were displayed for either 2 or 6 seconds, and had either similar or dissimilar hairstyles. The level of attention to internal features was measured by the proportion of fixation time spent on the internal face features and the sensitivity of discrimination to changes in external feature similarity. Increased attention to internal features was associated with increased discrimination in the 2‐second display‐time condition, but no significant relationship was found in the 6‐second condition. Individual differences in eye‐movements were highly stable across the experimental conditions.     

Gaze control and recollective experience in face recognition

In two experiments, we examined the relation between gaze control and recollective experience in the context of face recognition. In Experiment 1, participants studied a series of faces, while their eye movements were eliminated either during study or test, or both. Subsequently, they made remember/know judgements for each recognized test face. The preclusion of eye movements impaired explicit recollection without affecting familiarity-based recognition. In Experiment 2, participants examined unfamiliar faces under two study conditions (similarity vs. difference judgements), while their eye movements were registered. Similarity vs. difference judgements produced the opposite effects on remember/know responses, with no systematic effects on eye movements. However, face recollection was related to eye movements, so that remember responses were associated with more frequent refixations than know responses. These findings suggest that saccadic eye movements mediate the nature of recollective experience, and that explicit recollection reflects a greater consistency between study and test fixations than familiarity-based face recognition.     

Processing style and person recognition: Exploring the face inversion effect

It has frequently been reported that recognition performance is impaired when faces are presented in an inverted rather than upright orientation, a phenomenon termed the face inversion effect (FIE). Extending previous work on this topic, the current investigation explored whether individual differences in global precedence—the propensity to process nonfacial stimuli in a configural manner—impacts memory for faces. Based on performance on the Navon letter-classification task, two experimental groups were created that differed in relative global precedence (i.e., strong global precedence [SGP] and weak global precedence [WGP]). In a subsequent face-recognition task, results revealed that while both groups demonstrated a reliable FIE, this effect was attenuated among participants displaying WGP. These findings suggest that individual differences in general processing style modulate face recognition.     

Gaze behavior in face comparison: The roles of sex, task, and symmetry

Knowing where people look on a face provides an objective insight into the information entering the visual system and into cognitive processes involved in face perception. In the present study, we recorded eye movements of human participants while they compared two faces presented simultaneously. Observers’ viewing behavior and performance was examined in two tasks of parametrically varying difficulty, using two types of face stimuli (sex morphs and identity morphs). The frequency, duration, and temporal sequence of fixations on previously defined areas of interest in the faces were analyzed. As was expected, viewing behavior and performance varied with difficulty. Interestingly, observers compared predominantly the inner halves of the face stimuli—a result inconsistent with the general left-hemiface bias reported for single faces. Furthermore, fixation patterns and performance differed between tasks, independently of stimulus type. Moreover, we found differences in male and female participants’ viewing behaviors, but only when the sex of the face stimuli was task relevant.     

Emotional face prediction in rejection sensitive individuals: Evidence from event-related potentials

Human beings live in an uncertain world, but they continuously generate top-down predictions about emotional face information of other people around them. Although the prediction processing has repeatedly been investigated in the literature of prediction, little is known about the impact of rejection sensitive (RS) on individuals’ emotional face prediction. To this end, high and low RS participants were asked to perform an identification task of emotional faces in which target faces were shown in either an angry or happy expression while their brain responses were recorded using an event-related potential (ERP) technique. The behavioral results suggested an effect of emotional face prediction. For the P100 component, low RS participants showed longer P100 peak latencies in the left than right hemisphere when they viewed predictable emotional faces. In addition, low RS participants showed larger N170 mean amplitudes for angry compared to happy faces when they perceived unpredictable faces, but not when these faces were predictable. This presumably reflected a sensibility to angry faces in the unpredictable trails. Interestingly, high RS participants did not demonstrate such a N170 difference, suggesting that high RS participants showed a reduced sensitivity to unpredictable angry faces. Furthermore, angry faces triggered increased LPP mean amplitudes compared to happy faces, which was consistent with the results of other ERP studies examining the processing of emotional faces. Finally, we observed significant negative correlations between behavioral and ERP prediction effect, indicating one consistency between the behavioral and electrophysiological data.     

Cultural influences on face scanning are consistent across infancy and adulthood

The emergence of cultural differences in face scanning is thought to be shaped by social experience. However, previous studies mainly investigated eye movements of adults and little is known about early development. The current study recorded eye movements of British and Japanese infants (aged 10 and 16 months) and adults, who were presented with static and dynamic faces on screen. Cultural differences were observed across all age groups, with British participants exhibiting more mouth scanning, and Japanese individuals showing increased central face (nose) scanning for dynamic stimuli. Age-related influences independent of culture were also revealed, with a shift from eye to mouth scanning between 10 and 16 months, while adults distributed their gaze more flexibly. Against our prediction, no age-related increases in cultural differences were observed, suggesting the possibility that cultural differences are largely manifest by 10 months of age. Overall, the findings suggest that individuals adopt visual strategies in line with their cultural background from early in infancy, pointing to the development of a highly adaptive face processing system that is shaped by early sociocultural experience.     

Holistic face processing can be independent of gaze behaviour: Evidence from the composite face illusion

People tend to perceive identical top halves (i.e. above the nose) of two face stimuli as being different when they are aligned with distinct bottom halves. This composite face illusion is generally considered as the most compelling evidence that facial features are integrated into a holistic representation. Here, we recorded eye‐movements during the composite face illusion in a delayed matching task of top halves of faces. Behavioural results showed a strong composite face effect, participants making more mistakes and taking longer time to match two identical top halves of faces when they were aligned (vs. misaligned) with different bottom halves. Importantly, fixation sites and eye‐movements were virtually identical when the top and bottom parts were aligned (composite illusion) or misaligned (no illusion), indicating that holistic face processing can be independent of gaze behaviour. These findings reinforce the view that holistic representations of individual faces can be extracted early on from information at a relatively coarse scale, independently of overt attention.     

Eastern observers cannot inhibit their gaze to eye and nose regions in face perception

It has been found that Western observers cannot inhibit their gaze to the eye region, even if they are told to avoid doing so when they observe face stimuli because of the importance of the eye region. However, studies indicate that the nose region is more important for face processing among Eastern observers. We used the “don’t look” paradigm with Eastern observers, in which participants were told to avoid fixating on a specific region (eye, nose, and mouth). The results extend previous findings as both the eye and nose regions attracted their gaze. Interestingly, the fixation behaviors differed for the eyes and nose in terms of the time-dependent view, in which reflexive saccades to the eye with a persistent fixation to the nose were observed. The nose regions could have stronger attractiveness than previously thought.