Two routes to face perception: evidence from psychophysics and computational modeling

The aim of this study was to separately analyze the role of featural and configural face representations. Stimuli containing only featural information were created by cutting the faces into their parts and scrambling them. Stimuli only containing configural information were created by blurring the faces. Employing an old-new recognition task, the aim of Experiments 1 and 2 was to investigate whether unfamiliar faces (Exp. 1) or familiar faces (Exp. 2) can be recognized if only featural or configural information is provided. Both scrambled and blurred faces could be recognized above chance level. A further aim of Experiments 1 and 2 was to investigate whether our method of creating configural and featural stimuli is valid. Pre-activation of one form of representation did not facilitate recognition of the other, neither for unfamiliar faces (Exp. 1) nor for familiar faces (Exp. 2). This indicates a high internal validity of our method for creating configural and featural face stimuli. Experiment 3 examined whether features placed in their correct categorical relational position but with distorted metrical distances facilitated recognition of unfamiliar faces. These faces were recognized no better than the scrambled faces in Experiment 1, providing further evidence that facial features are stored independently of configural information. From these results we conclude that both featural and configural information are important to recognize a face and argue for a dual-mode hypothesis of face processing. Using the psychophysical results as motivation, we propose a computational framework that implements featural and configural processing routes using an appearance-based representation based on local features and their spatial relations. In three computational experiments (Experiments 4–6) using the same sets of stimuli, we show how this framework is able to model the psychophysical data.     

Perception of novel faces: the parts have it!

It has been suggested that, as a result of expertise, configural information plays a predominant role in face processing. We investigated this idea using novel and learned faces. In experiment 1, sixteen participants matched two subsequently presented blurred or scrambled faces, which could be either upright or inverted, in a sequential same -different matching task. By means of blurring, featural information is hampered, whilst scrambling disrupts configural information. Each face was unfamiliar to the participants and was presented for 1000 ms. An ANOVA on the d' values revealed a significant advantage for scrambled faces. In experiment 2, fourteen participants were tested with the same design, except that the second face was always intact. Again, the ANOVA on the d' values revealed a significant advantage for scrambled faces. In experiment 3 half of the faces were learned in a familiarisation block prior to the experiment. The ANOVA of these d' values revealed a significant interaction of familiarity and condition, showing that blurred stimuli were better recognised when the faces were familiar. These results suggest that recognition of novel faces, compared to learned faces, relies relatively more on the processing of featural information. In the course of familiarisation the importance of configural information increases.     

Processes underlying the cross-race effect: an investigation of holistic, featural, and relational processing of own-race versus other-race faces

Adults are often better at recognising own-race than other-race faces. Unlike previous studies that reported an own-race advantage after administering a single test of either holistic processing or of featural and relational processing, we used a cross-over design and multiple tasks to assess differential processing of faces from a familiar race versus a less familiar race. Caucasian and Chinese adults performed four tasks, each with Caucasian and Chinese faces. Two tasks measured holistic processing: the composite face task and the part/whole task. Both tasks indicated holistic processing of own-race and other-race faces that did not differ in degree. Two tasks measured featural and relational processing: the Jane/Ling task, in which same/ different judgments were made about face pairs that differed in features of their spacing, and the scrambled/blurred task, in which test faces were scrambled (isolates memory for components) or blurred (isolates memory for relations). Both tasks provided evidence of an own-race advantage in both featural and relational processing. We conclude that even when adults process other-race faces holistically, other manifestations of an own-race advantage remain.     

Is there a linear or a nonlinear relationship between rotation and configural processing of faces?

Research suggests that inverted faces are harder to recognise than upright faces because of a disruption in processing their configural properties. Reasons for this difficulty were explored by investigating people's ability to identify faces at intermediate angles of rotation. Participants were asked to discriminate blurred famous and unfamiliar faces presented at nine angles. Blurred faces were used to minimise featural processing strategies, and to assess the effects of rotation that are specific to configural processing. The results indicate a linear relationship between angle of rotation and recognition accuracy. It appears that configural processing becomes gradually more disrupted the further a face is oriented away from the upright. The implications of these findings for competing explanations of the face-inversion effect are discussed.     

Categorical perception effects for facial identity in robustly represented familiar and self-faces: the role of configural and featural information

Categorical perception of robustly represented faces (self, friend) and unfamiliar faces is investigated, and the relative roles of configural and featural information are examined. Participants performed identification and discrimination tasks on morph series containing the self-face and a friend's face (self-Friend 1), two friends' faces (Friend 2-Friend 3), and two unfamiliar faces (Unfamiliar 1-Unfamiliar 2), presented in upright and inverted orientations. For upright faces, categorical perception effects were observed for both familiar morph series but not for the unfamiliar morph series, suggesting that robust representation is a requirement for categorical perception in facial identity. For inverted faces, categorical perception was observed for the self-Friend 1 morph series only. This suggests that categorical perception is tied to configural processing for familiar non-self-faces, but can be observed for self-faces during featural processing-consistent with evidence that self-face representations contain strong configural and featural components. Finally, categorical perception is not enhanced by the presence of the self-face relative to other familiar faces when upright, but shows a trend of being enhanced for self-faces when inverted, adding to the debate on the ways in which robustly represented faces can elicit categorical perception.     

Emotion recognition: The role of featural and configural face information

Several studies investigated the role of featural and configural information when processing facial identity. A lot less is known about their contribution to emotion recognition. In this study, we addressed this issue by inducing either a featural or a configural processing strategy (Experiment 1) and by investigating the attentional strategies in response to emotional expressions (Experiment 2). In Experiment 1, participants identified emotional expressions in faces that were presented in three different versions (intact, blurred, and scrambled) and in two orientations (upright and inverted). Blurred faces contain mainly configural information, and scrambled faces contain mainly featural information. Inversion is known to selectively hinder configural processing. Analyses of the discriminability measure (A′) and response times (RTs) revealed that configural processing plays a more prominent role in expression recognition than featural processing, but their relative contribution varies depending on the emotion. In Experiment 2, we qualified these differences between emotions by investigating the relative importance of specific features by means of eye movements. Participants had to match intact expressions with the emotional cues that preceded the stimulus. The analysis of eye movements confirmed that the recognition of different emotions rely on different types of information. While the mouth is important for the detection of happiness and fear, the eyes are more relevant for anger, fear, and sadness.     

面孔知觉中特征、结构和整体加工策略的眼动研究

考察面孔知觉中特征加工、结构加工和整体加工三种不同加工方式对应的眼动模式。实验1中, 将以特征信息为主的错乱面孔和以结构信息为主的模糊面孔作为线索刺激, 引发对测试面孔的特征加工和结构加工, 眼动分析表明：特征加工表现为对面孔各特征内更长的凝视时间, 结构加工表现为对面孔各特征间高频的眼跳。实验2采用相同的研究范式, 将完整面孔、轻度错乱面孔和低水平模糊面孔作为线索刺激, 引发对测试面孔除特征加工和结构加工外的另一种加工方式-- 整体加工, 表现为注视点更多地落在测试面孔中央区的鼻子部位以扩大注视范围, 进而把握整张面孔信息。本研究揭示了三种不同面孔加工方式眼动模式的差异。     

Face imagery is based on featural representations

The effect of imagery on featural and configural face processing was investigated using blurred and scrambled faces. By means of blurring, featural information is reduced; by scrambling a face into its constituent parts configural information is lost. Twenty-four participants learned ten faces together with the sound of a name. In following matching-to-sample tasks participants had to decide whether an auditory presented name belonged to a visually presented scrambled or blurred face in two experimental conditions. In the imagery condition, the name was presented prior to the visual stimulus and participants were required to imagine the corresponding face as clearly and vividly as possible. In the perception condition name and test face were presented simultaneously, thus no facilitation via mental imagery was possible. Analyses of the hit values showed that in the imagery condition scrambled faces were recognized significantly better than blurred faces whereas there was no such effect for the perception condition. The results suggest that mental imagery activates featural representations more than configural representations.     

Self-face recognition is characterized by “bilateral gain” and by faster,more accurate performance which persists when faces are inverted

We examine interhemispheric cooperation in the recognition of personally known faces whose long-term familiarity ensures frequent co-activation of face-sensitive areas in the right and left brain. Images of self, friend, and stranger faces were presented for 150 ms in upright and inverted orientations both unilaterally, in the right or left visual field, and bilaterally. Consistent with previous research, we find a bilateral advantage for familiar but not for unfamiliar faces, and we demonstrate that this gain occurs for inverted as well as upright faces. We show that friend faces are recognized more quickly than unfamiliar faces in upright but not in inverted orientations, suggesting that configural processing underlies this particular advantage. Novel to this study is the finding that people are faster and more accurate at recognizing their own face over both stranger and friend faces and that these advantages occur for both upright and inverted faces. These findings are consistent with evidence for a bilateral representation of self-faces.     

An own-race advantage for components as well as configurations in face recognition

The own-race advantage in face recognition has been hypothesized as being due to a superiority in the processing of configural information for own-race faces. Here we examined the contributions of both configural and component processing to the own-race advantage. We recruited 48 Caucasian participants in Australia and 48 Chinese participants in Hong Kong, and had them study Caucasian and Chinese faces. After study, they were shown old faces (along with distractors) that were either blurred (isolating configural processing), in which high spatial frequencies were removed from the intact faces, or scrambled (isolating component processing), in which the locations of all face components were rearranged. Participants performed better on the memory test for own-race faces in both the blurred (configural) and scrambled (component) conditions, showing an own-race advantage for both configural and component processing. These results suggest that the own-race advantage in face recognition is due to a general facilitation in different forms of face processing.     

Unfamiliar faces are not faces: Evidence from a matching task

It is difficult to match two images of the same unfamiliar face, even under good conditions. Here, we show that there are large individual differences on unfamiliar face matching. Initially, we tried to predict these using tests of visual short-term memory, cognitive style, and perceptual speed. Moderate correlations were produced by various components of these tests. In three other experiments, we found very strong correlations between face matching and inverted face matching on the same test. Finally, we examined potential associations between familiar and unfamiliar face processing. Strong correlations were found between familiar and unfamiliar face processing, but only when the familiar faces were inverted. We conclude that unfamiliar faces are processed for identity in a qualitatively different way than are familiar faces.     

Developmental changes in the recognition of faces and facial features

The view that, as children get older, there is a decline in the use of feature‐based forms of face processing to more configurational forms of processing was examined by asking 6‐year‐old and 9‐year‐old children to judge which of two photographs matches an identical probe photograph. The probe and test stimuli were either photographs of whole faces or photographs of isolated facial features. Within this standard method, the stimuli also systematically varied in terms of the familiarity of the faces shown and in the orientation of presentation, both factors that have been interpreted as effecting configurational encoding. A number of age‐related effects are observed: (a) older children are better at recognizing whole faces than younger children, (b) older children exhibit a clear face inversion effect with whole faces while the younger children are equally adept at identifying upright and inverted whole faces, and (c) analysis of the recognition rates associated with the individual features reveals that younger children are better than older children when asked to recognize eye regions. It is argued that the data support the view that as children get older there is a change in the forms of piecemeal encoding employed and an increase in configurational processing. Copyright © 2000 John Wiley & Sons, Ltd.     

The other-race effect: Holistic coding differences and beyond

We evaluate claims that the other-race effect in face memory reflects stronger holistic coding of own-race than other-race faces. Considering evidence from a range of paradigms, including the inversion effect, part–whole effect, composite effect, and the scrambled/blurred task, we find considerable inconsistency, both between paradigms and between participant ethnicities. At the same time, however, studies that isolate configural and component feature processing consistently show better featural, as well as better configural, processing of own-race faces, for both Caucasian and Asian participants. These results raise the possibility that the key feature of own-race face processing is not stronger holistic processing per se, but rather more effective processing of all types of face information (featural as well as holistic).     

When feature information comes first! Early processing of inverted faces

We investigated the early stages of face recognition and the role of featural and holistic face information. We exploited the fact that, on inversion, the alienating disorientation of the eyes and mouth in thatcherised faces is hardly detectable. This effect allows featural and holistic information to be dissociated and was used to test specific face-processing hypotheses. In inverted thatcherised faces, the cardinal features are already correctly oriented, whereas in undistorted faces, the whole Gestalt is coherent but all information is disoriented. Experiment 1 and experiment 3 revealed that, for inverted faces, featural information processing precedes holistic information. Moreover, the processing of contextual information is necessary to process local featural information within a short presentation time (26 ms). Furthermore, for upright faces, holistic information seems to be available faster than for inverted faces (experiment 2). These differences in processing inverted and upright faces presumably cause the differential importance of featural and holistic information for inverted and upright faces.     

The Ability of Face Viewpoint Transformation Remains Immature at Age of 12: Evidence from Recognition of Faces with Different Familiarity in Children

Children are immature in face recognition, particularly in face configural decoding. This study examines the developmental difference of face recognition in another mechanism: viewpoint transformation processing. Adults and sixth‐grade children were instructed to match a series of one‐tone black face silhouettes to their corresponding front‐view faces. This task involves sophisticated calculation in pictorial information, precise viewpoint transformation, and most probably a 3‐D face representation. The results showed that although the performances were well above chance level in the recognition of familiar faces, for children, they were at chance level in the recognition of unfamiliar faces. The results indicate that children, at least to the age of about 12 years, are still immature in the processing of face viewpoint transformation compared to adults.     

Effects of geometric distortions on face-recognition performance

The importance of 'configural' processing for face recognition is now well established, but it remains unclear precisely what it entails. Through four experiments we attempted to clarify the nature of configural processing by investigating the effects of various affine transformations on the recognition of familiar faces. Experiment 1 showed that recognition was markedly impaired by inversion of faces, somewhat impaired by shearing or horizontally stretching them, but unaffected by vertical stretching of faces to twice their normal height. In experiment 2 we investigated vertical and horizontal stretching in more detail, and found no effects of either transformation. Two further experiments were performed to determine whether participants were recognising stretched faces by using configural information. Experiment 3 showed that nonglobal vertical stretching of faces (stretching either the top or the bottom half while leaving the remainder undistorted) impaired recognition, implying that configural information from the stretched part of the face was influencing the process of recognition--ie that configural processing involves global facial properties. In experiment 4 we examined the effects of Gaussian blurring on recognition of undistorted and vertically stretched faces. Faces remained recognisable even when they were both stretched and blurred, implying that participants were basing their judgments on configural information from these stimuli, rather than resorting to some strategy based on local featural details. The tolerance of spatial distortions in human face recognition suggests that the configural information used as a basis for face recognition is unlikely to involve information about the absolute position of facial features relative to each other, at least not in any simple way.     

Recognizing familiar and unfamiliar faces

These experiments addressed why, in episodic-memory tests, familiar faces are recognized better than unfamiliar faces. Memory for faces of well-known public figures and unfamiliar persons was tested, not only with old/new recognition tests, in which initially viewed faces were discriminated from dis tractors, but also with tests of memory for specific information. These included: detail recall, in which a masked feature had to be described; orientation recognition, in which discrimination between originally seen faces and mirror-image reversals was required; and recognition and recall of labels for the public figures. Experiments 1 and 2 showed that memory for orientation and featural details was not robustly related either to facial familiarity or to old/new recognition rates. Experiment 3 showed that memory for labels was not the exclusive determinant of the famous-face advantage in recognition, since famous faces were highly recognizable even they were not labelable or when labels were forgotten. These results suggest that the familiarity effect, and face recognition in general, may reflect a nonverbal memory representation that is relatively abstract.     

Effects of geometric distortions,Gaussian blur,and contrast negation on recognition of familiar faces

It is assumed that “configural processing” is important for recognizing people whom we know. Studies have shown better discrimination of relational changes between facial features when faces are presented upright than upside down and when presented as photographic negatives. However, studies have also demonstrated tolerance for complex changes to facial configuration of familiar faces when images are geometrically distorted. In two experiments, we explored effects of linear stretching, Gaussian blur, and contrast negation on recognition of familiar or unfamiliar faces (Experiment 1) and familiar or unfamiliar company brand logos (Experiment 2). Only contrast negation severely impaired recognition of familiar faces but not unfamiliar faces or company brand logos. Effects of contrast negation were additional to linear stretching, whereas linear stretching independently had no impact on recognition. These findings highlight an important deficit in the recognition of familiar faces caused by contrast negation.     

Repetition priming of face gender judgments: An instance based explanation

Earlier studies of repetition priming using faces have been interpreted as indicating that such effects are confined to the processing of known faces. The experiment reported here employed eight rather than the more usual two presentation trials and required subjects to make gender decisions (is it a male or is it a female face?) to both familiar and unfamiliar faces. This allowed the currently favored recognition unit theories of face processing to be compared with the Logan (1988) instance model. Equivalent repetition priming effects were observed for both familiar and unfamiliar faces and were well fitted by power functions. It is argued that the findings are consistent with the strong predictions made by Logan's model and pose problems for recognition unit based theories.     

Repetition priming and recognition of dynamic and static chimeras

Chimeric faces, produced by combining the top half of a familiar face with the bottom half of a different familiar face, are difficult to recognise explicitly. However, given that they contain potentially useful configurational and featural information for face recognition, they might nevertheless produce some activation of representations of their constituent faces. Repetition priming with dynamic and static facial chimeras was used to test this possibility. Whereas half-faces produced significant repetition priming of their familiar counterparts, both types of chimera did not. When analyses were restricted to faces that were recognised during the prime phase, repetition priming was both significant, and equivalent, for chimeras and half-faces. The results suggest that the constituents of a facial chimera must be parsed, and recognised, in order for them to cause repetition priming for their familiar counterparts. Facial motion does not help with the parsing of a facial chimera.