The “parts and wholes” of face recognition: A review of the literature

It has been claimed that faces are recognized as a “whole” rather than by the recognition of individual parts. In a paper published in the Quarterly Journal of Experimental Psychology in 1993, Martha Farah and I attempted to operationalize the holistic claim using the part/whole task. In this task, participants studied a face and then their memory presented in isolation and in the whole face. Consistent with the holistic view, recognition of the part was superior when tested in the whole-face condition compared to when it was tested in isolation. The “whole face” or holistic advantage was not found for faces that were inverted, or scrambled, nor for non-face objects, suggesting that holistic encoding was specific to normal, intact faces. In this paper, we reflect on the part/whole paradigm and how it has contributed to our understanding of what it means to recognize a face as a “whole” stimulus. We describe the value of part/whole task for developing theories of holistic and non-holistic recognition of faces and objects. We discuss the research that has probed the neural substrates of holistic processing in healthy adults and people with prosopagnosia and autism. Finally, we examine how experience shapes holistic face recognition in children and recognition of own- and other-race faces in adults. The goal of this article is to summarize the research on the part/whole task and speculate on how it has informed our understanding of holistic face processing.     

In defence of high-speed memory scanning

This paper reviews some of the evidence that bears on the existence of a mental high-speed serial exhaustive scanning process (SES) used by humans to interrogate the active memory of a set of items to determine whether it contains a test item. First proposed in the 1960s, based on patterns of reaction times (RTs), numerous later studies supported, elaborated, extended, and limited the generality of SES, while critics claimed that SES never occurred, that predictions from SES were violated, and that other mechanisms produced the RT patterns that led to the idea. I show that some of these claims result from ignoring variations in experimental procedure that produce superficially similar but quantitatively different RT patterns and that, for the original procedures, the most frequently repeated claims that predictions are violated are false. I also discuss evidence against the generality of competing theories of active-memory interrogation, especially those that depend on discrimination of directly accessible “memory-strength”. Some of this evidence has been available since the 1960s but has been ignored by some proponents of alternative theories. Other evidence presented herein is derived from results of one relevant experiment described for the first time, results of another described in more detail than heretofore, and new analyses of old data. Knowledge of brain function acquired during the past half century has increased the plausibility of SES. The conclusion: SES is alive and well, but many associated puzzles merit further investigation, suggestions for which are offered.     

Correlations between psychometric schizotypy,scan path length,fixations on the eyes and face recognition

Psychometric schizotypy in the general population correlates negatively with face recognition accuracy, potentially due to deficits in inhibition, social withdrawal, or eye-movement abnormalities. We report an eye-tracking face recognition study in which participants were required to match one of two faces (target and distractor) to a cue face presented immediately before. All faces could be presented with or without paraphernalia (e.g., hats, glasses, facial hair). Results showed that paraphernalia distracted participants, and that the most distracting condition was when the cue and the distractor face had paraphernalia but the target face did not, while there was no correlation between distractibility and participants’ scores on the Schizotypal Personality Questionnaire (SPQ). Schizotypy was negatively correlated with proportion of time fixating on the eyes and positively correlated with not fixating on a feature. It was negatively correlated with scan path length and this variable correlated with face recognition accuracy. These results are interpreted as schizotypal traits being associated with a restricted scan path leading to face recognition deficits.     

Distorting Face Representations in Newborn Brains

What role does experience play in the development of face recognition? A growing body of evidence indicates that newborn brains need slowly changing visual experiences to develop accurate visual recognition abilities. All of the work supporting this “slowness constraint” on visual development comes from studies testing basic-level object recognition. Here, we present the results of controlled-rearing experiments that provide evidence for a slowness constraint on the development of face recognition, a prototypical subordinate-level object recognition task. We found that (1) newborn chicks can rapidly develop view-invariant face recognition and (2) the development of this ability relies on experience with slowly moving faces. When chicks were reared with quickly moving faces, they built distorted face representations that largely lacked invariance to viewpoint changes, effectively “breaking” their face recognition abilities. These results provide causal evidence that slowly changing visual experiences play a critical role in the development of face recognition, akin to basic-level object recognition. Thus, face recognition is not a hardwired property of vision but is learned rapidly as the visual system adapts to the temporal structure of the animal's visual environment.     

Changes in infant visual attention when observing repeated actions

Infants’ early visual preferences for faces, and their observational learning abilities, are well-established in the literature. The current study examines how infants’ attention changes as they become increasingly familiar with a person and the actions that person is demonstrating. The looking patterns of 12- (n = 61) and 16-month-old infants (n = 29) were tracked while they watched videos of an adult presenting novel actions with four different objects three times. A face-to-action ratio in visual attention was calculated for each repetition and summarized as a mean across all videos. The face-to-action ratio increased with each action repetition, indicating that there was an increase in attention to the face relative to the action each additional time the action was demonstrated. Infant’s prior familiarity with the object used was related to face-to-action ratio in 12-month-olds and initial looking behavior was related to face-to-action ratio in the whole sample. Prior familiarity with the presenter, and infant gender and age, were not related to face-to-action ratio. This study has theoretical implications for face preference and action observations in dynamic contexts.     

Fast face detection using a unified architecture for unconstrained and infrared face images

Human face detection along with its localization is a difficult task when the face is presented in the cluttered scene in an unconstrained scenario that might be with arbitrary pose variations, occlusions, random backgrounds and infrared (IR) environment. This paper proposes a novel face detection method which can address some of these issues and challenges quite successfully during face detection in unconstrained as well as infrared environments. It makes use of Fast Successive Mean Quantization Transform (FastSMQT) features for image enhancement and feature representation to deal with illumination and sensor insensitiveness. A split up Sparse Network of Winnows (SNoW) with Winnow updating rule is then exploited to speed up the original SNoW classifier. Finally, the features and classifiers are combined together with skin detection algorithm for face detection in crowd image and head orientation correction of near infrared faces. The proposed face detector is robust in handling pose, occlusion, illumination, blur and low image resolution. The experiment is performed on six challenging and publicly available databases, viz. BIOID, LFW, FDDB, UFI, WIDER FACE and IIT Delhi near infrared. The experimental results depict that the proposed method outperforms traditional as well as some advanced methods in detecting unconstrained and infrared faces under challenging situations.     

快慢读者利用语境信息的差异：加工深度的作用

通过主题扫描和阅读理解两种加工深度不同的任务,考察快慢读者预测性效应差异的来源及加工深度在其中发挥的作用。被试在两种任务情境下阅读分别包含高低预测性目标词的96个句子框架,记录其眼动轨迹。结果显示：预测性效应仅在阅读理解任务中出现,快速读者在早期眼动指标上就表现出了预测性效应,慢速读者在晚期眼动指标上才表现出预测性效应。结果表明：加工深度调节快慢读者预测性效应的大小;在自然阅读情境下快慢读者的预测性效应表现符合预测编码框架假设。     

Body weight, not facial width-to-height ratio, predicts aggression in pro hockey players

Studies indicate that facial characteristics may predict behavior, but it is unclear if this will hold within highly selective populations. One relevant characteristic is the face’s width-to-height ratio (FWHR), a sexually dimorphic trait that has been shown to predict aggression. That FWHR may predict aggression within highly selective populations was suggested by Carré and McCormick’s (2008) finding that professional hockey players with greater FWHRs accrued more penalties. We attempted to replicate this result using all NHL players. We also explored fighting penalties as another aggression measure and height and weight as additional aggression predictors. We found that body weight predicted substantial variance in aggression but FWHR did not. Thus, in highly selective populations, inferences based on faces may be inaccurate.