Two routes to face perception: evidence from psychophysics and computational modeling

The aim of this study was to separately analyze the role of featural and configural face representations. Stimuli containing only featural information were created by cutting the faces into their parts and scrambling them. Stimuli only containing configural information were created by blurring the faces. Employing an old-new recognition task, the aim of Experiments 1 and 2 was to investigate whether unfamiliar faces (Exp. 1) or familiar faces (Exp. 2) can be recognized if only featural or configural information is provided. Both scrambled and blurred faces could be recognized above chance level. A further aim of Experiments 1 and 2 was to investigate whether our method of creating configural and featural stimuli is valid. Pre-activation of one form of representation did not facilitate recognition of the other, neither for unfamiliar faces (Exp. 1) nor for familiar faces (Exp. 2). This indicates a high internal validity of our method for creating configural and featural face stimuli. Experiment 3 examined whether features placed in their correct categorical relational position but with distorted metrical distances facilitated recognition of unfamiliar faces. These faces were recognized no better than the scrambled faces in Experiment 1, providing further evidence that facial features are stored independently of configural information. From these results we conclude that both featural and configural information are important to recognize a face and argue for a dual-mode hypothesis of face processing. Using the psychophysical results as motivation, we propose a computational framework that implements featural and configural processing routes using an appearance-based representation based on local features and their spatial relations. In three computational experiments (Experiments 4–6) using the same sets of stimuli, we show how this framework is able to model the psychophysical data.     

An own-race advantage for components as well as configurations in face recognition

The own-race advantage in face recognition has been hypothesized as being due to a superiority in the processing of configural information for own-race faces. Here we examined the contributions of both configural and component processing to the own-race advantage. We recruited 48 Caucasian participants in Australia and 48 Chinese participants in Hong Kong, and had them study Caucasian and Chinese faces. After study, they were shown old faces (along with distractors) that were either blurred (isolating configural processing), in which high spatial frequencies were removed from the intact faces, or scrambled (isolating component processing), in which the locations of all face components were rearranged. Participants performed better on the memory test for own-race faces in both the blurred (configural) and scrambled (component) conditions, showing an own-race advantage for both configural and component processing. These results suggest that the own-race advantage in face recognition is due to a general facilitation in different forms of face processing.     

Perception of novel faces: the parts have it!

It has been suggested that, as a result of expertise, configural information plays a predominant role in face processing. We investigated this idea using novel and learned faces. In experiment 1, sixteen participants matched two subsequently presented blurred or scrambled faces, which could be either upright or inverted, in a sequential same -different matching task. By means of blurring, featural information is hampered, whilst scrambling disrupts configural information. Each face was unfamiliar to the participants and was presented for 1000 ms. An ANOVA on the d' values revealed a significant advantage for scrambled faces. In experiment 2, fourteen participants were tested with the same design, except that the second face was always intact. Again, the ANOVA on the d' values revealed a significant advantage for scrambled faces. In experiment 3 half of the faces were learned in a familiarisation block prior to the experiment. The ANOVA of these d' values revealed a significant interaction of familiarity and condition, showing that blurred stimuli were better recognised when the faces were familiar. These results suggest that recognition of novel faces, compared to learned faces, relies relatively more on the processing of featural information. In the course of familiarisation the importance of configural information increases.     

Effects of geometric distortions on face-recognition performance

The importance of 'configural' processing for face recognition is now well established, but it remains unclear precisely what it entails. Through four experiments we attempted to clarify the nature of configural processing by investigating the effects of various affine transformations on the recognition of familiar faces. Experiment 1 showed that recognition was markedly impaired by inversion of faces, somewhat impaired by shearing or horizontally stretching them, but unaffected by vertical stretching of faces to twice their normal height. In experiment 2 we investigated vertical and horizontal stretching in more detail, and found no effects of either transformation. Two further experiments were performed to determine whether participants were recognising stretched faces by using configural information. Experiment 3 showed that nonglobal vertical stretching of faces (stretching either the top or the bottom half while leaving the remainder undistorted) impaired recognition, implying that configural information from the stretched part of the face was influencing the process of recognition--ie that configural processing involves global facial properties. In experiment 4 we examined the effects of Gaussian blurring on recognition of undistorted and vertically stretched faces. Faces remained recognisable even when they were both stretched and blurred, implying that participants were basing their judgments on configural information from these stimuli, rather than resorting to some strategy based on local featural details. The tolerance of spatial distortions in human face recognition suggests that the configural information used as a basis for face recognition is unlikely to involve information about the absolute position of facial features relative to each other, at least not in any simple way.     

Internal feature saliency as a marker of familiarity and configural processing

Two experiments that explore the internal feature advantage (IFA) in familiar face processing are reported. The IFA involves more efficient processing of internal features for familiar faces over unfamiliar ones. Experiment 1 examined the possibility of a configural basis for this effect through use of a matching task for familiar and unfamiliar faces presented both upright and upside-down. Results revealed the predicted IFA for familiar faces when stimuli were upright, but this was removed when stimuli were inverted. Experiment 2 examined the degree of training required before the IFA was demonstrated. Latency results revealed that whilst 90–180 s of exposure was sufficient to generate an IFA of intermediate magnitude, 180–270 s of exposure was required before the IFA was equivalent to that demonstrated for a familiar face. Taken together, these results offer three conclusions: First, the IFA is reaffirmed as an objective indicator of familiarity; second, the IFA is seen to rest on configural processing; and finally, the development of the IFA with familiarity indicates a development of configural processing with familiarity. As such, insight is gained as to the type of processing changes that occur as familiarity is gradually acquired.     

Expert face coding: Configural and component coding of own-race and other-race faces

Configural and holistic coding are hallmarks of face perception. Although recent studies have shown that own-race faces are coded more holistically than other-race faces, the evidence for better configural coding of own-race faces is equivocal. We directly measured configural and component coding of own- and other-race male faces in Caucasian and Chinese participants. We manipulated individual features (components) or their spatial relations (configurations) using a novel morphing method to vary difficulty parametrically and tested sensitivity to these changes in a sequential matching task. Both configural and component coding were better for upright own-race than for upright other-race faces. Inversion impaired detection of configural changes more than it did detection of component changes, but also impaired performance more for easier discriminations,independent of type of change. These results challenge explanations of face expertise that rely solely on configural and holistic processing, and also call into question the widespread interpretation of large inversion decrements as diagnostic of configural coding.     

An inner face advantage in children's recognition of familiar peers

Children’s recognition of familiar own-age peers was investigated. Chinese children (4-, 8-, and 14-year-olds) were asked to identify their classmates from photographs showing the entire face, the internal facial features only, the external facial features only, or the eyes, nose, or mouth only. Participants from all age groups were familiar with the faces used as stimuli for 1 academic year. The results showed that children from all age groups demonstrated an advantage for recognition of the internal facial features relative to their recognition of the external facial features. Thus, previous observations of a shift in reliance from external to internal facial features can be attributed to experience with faces rather than to age-related changes in face processing.     

7-11-year-old children show an advantage for matching and recognizing the internal features of familiar faces: Evidence against a developmental shift

Adults are better at recognizing familiar faces from the internal facial features (eyes, nose, mouth) than from the external facial features (hair, face outline). However, previous research suggests that this “internal advantage” does not appear until relatively late in childhood, and some studies suggest that children rely on external features to recognize all faces, whether familiar or not. We use a matching task to examine face processing in 7-8- and 10-11-year-old children. We use a design in which all face stimuli can be used as familiar items (for participants who are classmates) and unfamiliar items (for participants from a different school). Using this design, we find an internal feature advantage for matching familiar faces, for both groups of children. The same children were then shown the external and internal features of their classmates and were asked to name or otherwise identify them. Again, both age groups identified more of their classmates correctly from the internal than the external features. This is the first time an internal advantage has been reported in this age group. Results suggest that children as young as 7 process faces in the same way as do adults, and that once procedural difficulties are overcome, the standard effects of familiarity are observed.     

Recognizing people from the inner or outer parts of their faces: Developmental data concerning ‘unfamiliar’ faces

Existing data demonstrate a developmental trend in the way in which highly familiar faces are recognized, such that young children rely more on the outer facial features (the hairline, chin and ears) than the inner facial features (the eyes, nose and mouth) and adults demonstrate the reverse pattern. However, little is known about the developmental pattern of importance of inner and outer facial features for recognizing people who are not highly familiar. Here we report a study which attempts to describe this pattern. Using a two‐alternative forced‐choice procedure, we presented 5‐, 7‐, and 9‐year‐olds and adults (N = 22 in each group) with the task of recognizing an experimentally familiarized face (initially seen in a short video) from a still picture of either the whole face, just the inner, or just the outer parts. The results showed that, for all ages, recognition was faster (and in most cases, more accurate) for outer features alone than for inner features alone (and was fastest for whole faces). These data demonstrate the importance of outer facial features for the recognition of relatively unfamiliar faces. Taken together with previous findings, they enhance our picture of the effects of age and experience with individual faces on recognition and configural processing.     

Effects of geometric distortions,Gaussian blur,and contrast negation on recognition of familiar faces

It is assumed that “configural processing” is important for recognizing people whom we know. Studies have shown better discrimination of relational changes between facial features when faces are presented upright than upside down and when presented as photographic negatives. However, studies have also demonstrated tolerance for complex changes to facial configuration of familiar faces when images are geometrically distorted. In two experiments, we explored effects of linear stretching, Gaussian blur, and contrast negation on recognition of familiar or unfamiliar faces (Experiment 1) and familiar or unfamiliar company brand logos (Experiment 2). Only contrast negation severely impaired recognition of familiar faces but not unfamiliar faces or company brand logos. Effects of contrast negation were additional to linear stretching, whereas linear stretching independently had no impact on recognition. These findings highlight an important deficit in the recognition of familiar faces caused by contrast negation.     

Perceptual specialization and configural face processing in infancy

Adults’ face processing expertise includes sensitivity to second-order configural information (spatial relations among features such as distance between eyes). Prior research indicates that infants process this information in female faces. In the current experiments, 9-month-olds discriminated spacing changes in upright human male and monkey faces but not in inverted faces. However, they failed to process matching changes in upright house stimuli. A similar pattern of performance was exhibited by 5-month-olds. Thus, 5- and 9-month-olds exhibited specialization by processing configural information in upright primate faces but not in houses or inverted faces. This finding suggests that, even early in life, infants treat faces in a special manner by responding to changes in configural information more readily in faces than in non-face stimuli. However, previously reported differences in infants’ processing of human versus monkey faces at 9 months of age (but not at younger ages), which have been associated with perceptual narrowing, were not evident in the current study. Thus, perceptual narrowing is not absolute in the sense of loss of the ability to process information from other species’ faces at older ages.     

面孔知觉中特征、结构和整体加工策略的眼动研究

考察面孔知觉中特征加工、结构加工和整体加工三种不同加工方式对应的眼动模式。实验1中, 将以特征信息为主的错乱面孔和以结构信息为主的模糊面孔作为线索刺激, 引发对测试面孔的特征加工和结构加工, 眼动分析表明：特征加工表现为对面孔各特征内更长的凝视时间, 结构加工表现为对面孔各特征间高频的眼跳。实验2采用相同的研究范式, 将完整面孔、轻度错乱面孔和低水平模糊面孔作为线索刺激, 引发对测试面孔除特征加工和结构加工外的另一种加工方式-- 整体加工, 表现为注视点更多地落在测试面孔中央区的鼻子部位以扩大注视范围, 进而把握整张面孔信息。本研究揭示了三种不同面孔加工方式眼动模式的差异。     

Emotion recognition: The role of featural and configural face information

Several studies investigated the role of featural and configural information when processing facial identity. A lot less is known about their contribution to emotion recognition. In this study, we addressed this issue by inducing either a featural or a configural processing strategy (Experiment 1) and by investigating the attentional strategies in response to emotional expressions (Experiment 2). In Experiment 1, participants identified emotional expressions in faces that were presented in three different versions (intact, blurred, and scrambled) and in two orientations (upright and inverted). Blurred faces contain mainly configural information, and scrambled faces contain mainly featural information. Inversion is known to selectively hinder configural processing. Analyses of the discriminability measure (A′) and response times (RTs) revealed that configural processing plays a more prominent role in expression recognition than featural processing, but their relative contribution varies depending on the emotion. In Experiment 2, we qualified these differences between emotions by investigating the relative importance of specific features by means of eye movements. Participants had to match intact expressions with the emotional cues that preceded the stimulus. The analysis of eye movements confirmed that the recognition of different emotions rely on different types of information. While the mouth is important for the detection of happiness and fear, the eyes are more relevant for anger, fear, and sadness.     

The Ability of Face Viewpoint Transformation Remains Immature at Age of 12: Evidence from Recognition of Faces with Different Familiarity in Children

Children are immature in face recognition, particularly in face configural decoding. This study examines the developmental difference of face recognition in another mechanism: viewpoint transformation processing. Adults and sixth‐grade children were instructed to match a series of one‐tone black face silhouettes to their corresponding front‐view faces. This task involves sophisticated calculation in pictorial information, precise viewpoint transformation, and most probably a 3‐D face representation. The results showed that although the performances were well above chance level in the recognition of familiar faces, for children, they were at chance level in the recognition of unfamiliar faces. The results indicate that children, at least to the age of about 12 years, are still immature in the processing of face viewpoint transformation compared to adults.     

Understanding the role of configural processing in face emotion recognition in Parkinson’s disease

This investigation examined whether impairment in configural processing could explain deficits in face emotion recognition in people with Parkinson’s disease (PD). Stimuli from the Radboud Faces Database were used to compare recognition of four negative emotion expressions by older adults with PD (n = 16) and matched controls (n = 17). Participants were tasked with categorizing emotional expressions from upright and inverted whole faces and facial composites; it is difficult to derive configural information from these two types of stimuli so featural processing should play a larger than usual role in accurate recognition of emotional expressions. We found that the PD group were impaired relative to controls in recognizing anger, disgust and fearful expressions in upright faces. Then, consistent with a configural processing deficit, participants with PD showed no composite effect when attempting to identify facial expressions of anger, disgust and fear. A face inversion effect, however, was observed in the performance of all participants in both the whole faces and facial composites tasks. These findings can be explained in terms of a configural processing deficit if it is assumed that the disruption caused by facial composites was specific to configural processing, whereas inversion reduced performance by making it difficult to derive both featural and configural information from faces.     

Development of Recognition of Face Parts from Unfamiliar Faces

The present study examined developmental changes in the ability to recognize face parts. In Experiment 1, participants were familiarized with whole faces and given a recognition test with old and new eyes, noses, mouths, inner faces, outer faces, or whole faces. Adults were above chance in their recognition of the eye and mouth regions. However, children did not naturally encode and recognize face parts independently of the entire face. In addition, all age groups showed comparable inner and outer face recognition, except for 8‐ to 9‐year‐olds who showed a recognition advantage for outer faces. In Experiment 2, when participants were familiarized with eyes, noses, or mouths and tested with eyes, noses, or mouths, respectively, all ages showed above‐chance recognition of eyes and mouths. Thirteen‐ to 14‐year‐olds were adult‐like in their recognition of the eye region, but mouth recognition continued to develop beyond 14 years of age. Nose recognition was above chance among 13‐ to 14‐year‐olds, but recognition scores remained low even in adulthood. The present findings reveal unique developmental trajectories in the use of isolated facial regions in face recognition and suggest that featural cues (as a class) have a different ontogenetic course relative to holistic and configural cues. Copyright © 2012 John Wiley & Sons, Ltd.     

Older adults' configural processing of faces: role of second-order information

Problems with face recognition are frequent in older adults. However, the mechanisms involved have only been partially discovered. In particular, it is unknown to what extent these problems may be related to changes in configural face processing. Here, we investigated the face inversion effect (FIE) together with the ability to detect modifications in the vertical or horizontal second-order relations between facial features. We used a same/different unfamiliar face discrimination task with 33 young and 33 older adults. The results showed dissociations in the performances of older versus younger adults. There was a lack of inversion effect during the recognition of original faces by older adults. However, for modified faces, older adults showed a pattern of performance similar to that of young participants, with preserved FIE for vertically modified faces and no detectable FIE for horizontally modified faces. Most importantly, the detection of vertical modifications was preserved in older relative to young adults whereas the detection of horizontal modifications was markedly diminished. We conclude that age has dissociable effects on configural face-encoding processes, with a relative preservation of vertical compared to horizontal second-order relations processing. These results help to understand some divergent results in the literature and may explain the spared familiar face identification abilities in the daily lives of older adults.     

Other-race categorisation advantage in a binary- vs. ternary-response race categorisation task*

When categorising a face based on race, people respond faster to other-race faces than own-race faces [Other-Race Categorisation Advantage (ORCA)]. Five experiments were conducted to examine the ORCA in Chinese participants in race categorisation tasks. Participants classified a face either as Chinese vs. non-Chinese (binary response) or as Caucasian, Indian, or Chinese (ternary response). Experiments 1A and 1B replicated the ORCA with Chinese vs. Caucasian and Chinese vs. Indian faces, respectively, in a binary-response task. Experiments 2A/2B and 3 presented faces of all three races in the ternary- and binary-response tasks. Task type was manipulated between and within participants in Experiments 2A/2B and 3, respectively. The typical ORCA occurred in the binary-response task, but did not consistently so in the ternary-response task. These results indicate that neither the race-feature hypothesis [Levin, D. T. 1996. Classifying faces by race: The structure of face categories. Journal of Experimental Psychology: Learning, Memory, and Cognition, 22(6), 1364–1382] nor the differential processing hypothesis [Zhao, L., & Bentin, S. 2011. The role of features and configural processing in face-race classification. Vision Research, 51(23-24), 2462–2470] could fully account for the ORCA observed in the ternary-response task.     

Multiple perceptual strategies used by macaque monkeys for face recognition

Successful integration of individuals in macaque societies suggests that monkeys use fast and efficient perceptual mechanisms to discriminate between conspecifics. Humans and great apes use primarily holistic and configural, but also feature-based, processing for face recognition. The relative contribution of these processes to face recognition in monkeys is not known. We measured face recognition in three monkeys performing a visual paired comparison task. Monkey and humans faces were (1) axially rotated, (2) inverted, (3) high-pass filtered, and (4) low-pass filtered to isolate different face processing strategies. The amount of time spent looking at the eyes, mouth, and other facial features was compared across monkey and human faces for each type of stimulus manipulation. For all monkeys, face recognition, expressed as novelty preference, was intact for monkey faces that were axially rotated or spatially filtered and was supported in general by preferential looking at the eyes, but was impaired for inverted faces in two of the three monkeys. Axially rotated, upright human faces with a full range of spatial frequencies were also recognized, however, the distribution of time spent exploring each facial feature was significantly different compared to monkey faces. No novelty preference, and hence no inferred recognition, was observed for inverted or low-pass filtered human faces. High-pass filtered human faces were recognized, however, the looking pattern on facial features deviated from the pattern observed for monkey faces. Taken together these results indicate large differences in recognition success and in perceptual strategies used by monkeys to recognize humans versus conspecifics. Monkeys use both second-order configural and feature-based processing to recognize the faces of conspecifics, but they use primarily feature-based strategies to recognize human faces.     

Losing face: impaired discrimination of featural and configural information in the mouth region of an inverted face

Given that all faces share the same set of features—two eyes, a nose, and a mouth—that are arranged in similar configuration, recognition of a specific face must depend on our ability to discern subtle differences in its featural and configural properties. An enduring question in the face-processing literature is whether featural or configural information plays a larger role in the recognition process. To address this question, the face dimensions task was designed, in which the featural and configural properties in the upper (eye) and lower (mouth) regions of a face were parametrically and independently manipulated. In a same–different task, two faces were sequentially presented and tested in their upright or in their inverted orientation. Inversion disrupted the perception of featural size (Exp. 1), featural shape (Exp. 2), and configural changes in the mouth region, but it had relatively little effect on the discrimination of featural size and shape and configural differences in the eye region. Inversion had little effect on the perception of information in the top and bottom halves of houses (Exp. 3), suggesting that the lower-half impairment was specific to faces. Spatial cueing to the mouth region eliminated the inversion effect (Exp. 4), suggesting that participants have a bias to attend to the eye region of an inverted face. The collective findings from these experiments suggest that inversion does not differentially impair featural or configural face perceptions, but rather impairs the perception of information in the mouth region of the face.