Two routes to face perception: evidence from psychophysics and computational modeling

The aim of this study was to separately analyze the role of featural and configural face representations. Stimuli containing only featural information were created by cutting the faces into their parts and scrambling them. Stimuli only containing configural information were created by blurring the faces. Employing an old-new recognition task, the aim of Experiments 1 and 2 was to investigate whether unfamiliar faces (Exp. 1) or familiar faces (Exp. 2) can be recognized if only featural or configural information is provided. Both scrambled and blurred faces could be recognized above chance level. A further aim of Experiments 1 and 2 was to investigate whether our method of creating configural and featural stimuli is valid. Pre-activation of one form of representation did not facilitate recognition of the other, neither for unfamiliar faces (Exp. 1) nor for familiar faces (Exp. 2). This indicates a high internal validity of our method for creating configural and featural face stimuli. Experiment 3 examined whether features placed in their correct categorical relational position but with distorted metrical distances facilitated recognition of unfamiliar faces. These faces were recognized no better than the scrambled faces in Experiment 1, providing further evidence that facial features are stored independently of configural information. From these results we conclude that both featural and configural information are important to recognize a face and argue for a dual-mode hypothesis of face processing. Using the psychophysical results as motivation, we propose a computational framework that implements featural and configural processing routes using an appearance-based representation based on local features and their spatial relations. In three computational experiments (Experiments 4–6) using the same sets of stimuli, we show how this framework is able to model the psychophysical data.     

Sources of information for discriminating dynamic human actions

Despite the importance of action identification and discrimination in action perception and social cognition more broadly, little research has investigated how these processes are achieved. To this end, we sought to identify the extent to which adults capitalize on featural versus configural sources of information when discriminating small-scale human actions such as grasp and place. Results across two experiments indicate adults are sensitive to both sources of information in action discrimination, but selectively attend to featural over configural action information. The findings also parallel what is known regarding face processing: processing of configural information is especially disrupted by inversion, whereas processing of featural information is specifically affected by low-pass filtering.     

眼睛区域构型信息与特征信息的跨维共变增益效应及其加工特异性

面孔知觉可能在区域尺度上发生多维信息整合, 但迄今无特异性实验证据。本研究在两个实验中操纵面孔眼睛区域或嘴巴区域的单维构型或特征信息, 测量人们觉察单维变化或跨维共变的敏感度, 以此检测面孔区域尺度上的多维信息整合有何现象与规律, 进而揭示面孔知觉的多维信息整合机制。实验获得3个发现：(1)正立面孔眼睛区域的信息变化觉察呈现出“跨维共变增益效应”, 跨维信息共变觉察的敏感度显著高于任意一种单维信息变化觉察的敏感度; (2)“跨维共变增益效应”只在正立面孔的眼睛区域出现, 在倒置面孔的眼睛区域、正立面孔的嘴巴区域或倒置面孔的嘴巴区域都没有出现, 因此具有面孔区域特异性和面孔朝向特异性; (3)就单维信息变化觉察而言, 眼睛区域的敏感度不会受到面孔倒置的损伤, 但是嘴巴区域的敏感度会受到面孔倒置的显著损伤。综合可知, 面孔知觉确实会发生区域尺度上的信息整合, 它不是普遍性的信息量效应, 而是特异性的眼睛效应(只发生在正立面孔的眼睛区域)。这是面孔整体加工(face holistic processing)在单维信息分辨和多维信息整合之间建立联系的必经环节。这提示我们对全脸多维信息知觉整合的理解需要从传统的面孔整体加工假设升级到以眼睛为中心的层级化多维信息整合算法(a hierarchical algorithm for multi-dimensional information integration)。     

Hemispheric asymmetry in discriminating faces differing for featural or configural (second-order relations) aspects

The human capacity to discriminate among different faces relies on distinct parallel subprocesses, based either on the analysis of configural aspects or on the sequential analysis of the single elements of a face. A particular type of configural processing consists of considering whether two faces differ in terms of internal spacing among their features, referred to as second-order relations processing. Findings from electrophysiological, neuroimaging, and lesion studies suggest that, overall, configural processes rely more on the right hemisphere, whereas analysis of single features would involve more the left. However, results are not always consistent, and behavioral evidence for a right-hemisphere specialization in second-order relations processing is lacking. Here, we used divided visual field presentation to investigate the possible different contributions of the two hemispheres to face discrimination based on relational versus featural processing. Our data indicate a right-hemispheric specialization in relational processing of upright (but not inverted) faces. Furthermore, we provide evidence regarding the involvement of both the right and left hemispheres in the processing of faces differing for inner features, suggesting that both analytical and configural modes of processing are at play.     

A feature-inversion effect: can an isolated feature show behavior like the face-inversion effect?

The face-inversion effect (FIE) is explained by the configural-processing hypothesis. It proposes that inversion disrupts configural information processing (spatial links among facial features) and leaves the processing of featural information (eyes, nose, and mouth) comparatively intact. According to this hypothesis, an inverted isolated facial feature cannot show a feature-inversion effect--that is, behavior similar to the FIE--since all the spatial links between it and the other features in a face are eliminated; that is, the configural information is removed. The findings of the present study, which show that isolated eyes do exhibit the feature-inversion effect, support the extended configural-processing hypothesis. This proposes that inversion also impairs processing of the configural information within the eyes themselves. Removal of the brows in whole faces tended to interfere with processing of the configural information in the upright position but to facilitate processing in the inverted position.     

Configural information is processed differently in human action

Recent evidence indicates that observers' sensitivity to configural information in dynamic human action is disrupted when action is inverted, whereas sensitivity to featural action information is not. The current research involved two experiments that expand upon this basic finding. Experiment 1 revealed that featural and configural action information are processed similarly in static representations of action as in dynamic action. Experiment 2 indicated that configural processing is uniquely sensitive to orientation only in human action as compared to a similar control stimulus. These findings further support the idea that the perception of action recruits specialized orientation-specific configural processing, and parallel similar findings in face perception and visual expertise.     

Emotion recognition: The role of featural and configural face information

Several studies investigated the role of featural and configural information when processing facial identity. A lot less is known about their contribution to emotion recognition. In this study, we addressed this issue by inducing either a featural or a configural processing strategy (Experiment 1) and by investigating the attentional strategies in response to emotional expressions (Experiment 2). In Experiment 1, participants identified emotional expressions in faces that were presented in three different versions (intact, blurred, and scrambled) and in two orientations (upright and inverted). Blurred faces contain mainly configural information, and scrambled faces contain mainly featural information. Inversion is known to selectively hinder configural processing. Analyses of the discriminability measure (A′) and response times (RTs) revealed that configural processing plays a more prominent role in expression recognition than featural processing, but their relative contribution varies depending on the emotion. In Experiment 2, we qualified these differences between emotions by investigating the relative importance of specific features by means of eye movements. Participants had to match intact expressions with the emotional cues that preceded the stimulus. The analysis of eye movements confirmed that the recognition of different emotions rely on different types of information. While the mouth is important for the detection of happiness and fear, the eyes are more relevant for anger, fear, and sadness.     

Faces elicit different scanning patterns depending on task demands

Eye movements were recorded while participants discriminated upright and inverted faces that differed with respect to either configural or featural information. Two hypotheses were examined: (1) whether featural and configural information processing elicit different scanning patterns; (2) whether fixations on a specific region of the face dominate scanning patterns. Results from two experiments were compared to examine whether participants’ prior knowledge of the kind of information that would be relevant for the task (i.e., configural vs featural) influences eye movements. In Experiment 1, featural and configural discrimination trials were presented in random order such that participants were unaware of the information that would be relevant on any given trial. In Experiment 2, featural and configural discrimination trials were blocked and participants were informed of the nature of the discriminations. The results of both experiments suggest that faces elicit different scanning patterns depending on task demands. When participants were unaware of the nature of the information relevant for the task at hand, face processing was dominated by attention to the eyes. When participants were aware that relational information was relevant, scanning was dominated by fixations to the center of the face. We conclude that faces elicit scanning strategies that are driven by task demands.     

Face imagery is based on featural representations

The effect of imagery on featural and configural face processing was investigated using blurred and scrambled faces. By means of blurring, featural information is reduced; by scrambling a face into its constituent parts configural information is lost. Twenty-four participants learned ten faces together with the sound of a name. In following matching-to-sample tasks participants had to decide whether an auditory presented name belonged to a visually presented scrambled or blurred face in two experimental conditions. In the imagery condition, the name was presented prior to the visual stimulus and participants were required to imagine the corresponding face as clearly and vividly as possible. In the perception condition name and test face were presented simultaneously, thus no facilitation via mental imagery was possible. Analyses of the hit values showed that in the imagery condition scrambled faces were recognized significantly better than blurred faces whereas there was no such effect for the perception condition. The results suggest that mental imagery activates featural representations more than configural representations.     

Perception of novel faces: the parts have it!

It has been suggested that, as a result of expertise, configural information plays a predominant role in face processing. We investigated this idea using novel and learned faces. In experiment 1, sixteen participants matched two subsequently presented blurred or scrambled faces, which could be either upright or inverted, in a sequential same -different matching task. By means of blurring, featural information is hampered, whilst scrambling disrupts configural information. Each face was unfamiliar to the participants and was presented for 1000 ms. An ANOVA on the d' values revealed a significant advantage for scrambled faces. In experiment 2, fourteen participants were tested with the same design, except that the second face was always intact. Again, the ANOVA on the d' values revealed a significant advantage for scrambled faces. In experiment 3 half of the faces were learned in a familiarisation block prior to the experiment. The ANOVA of these d' values revealed a significant interaction of familiarity and condition, showing that blurred stimuli were better recognised when the faces were familiar. These results suggest that recognition of novel faces, compared to learned faces, relies relatively more on the processing of featural information. In the course of familiarisation the importance of configural information increases.     

Understanding the role of configural processing in face emotion recognition in Parkinson’s disease

This investigation examined whether impairment in configural processing could explain deficits in face emotion recognition in people with Parkinson’s disease (PD). Stimuli from the Radboud Faces Database were used to compare recognition of four negative emotion expressions by older adults with PD (n = 16) and matched controls (n = 17). Participants were tasked with categorizing emotional expressions from upright and inverted whole faces and facial composites; it is difficult to derive configural information from these two types of stimuli so featural processing should play a larger than usual role in accurate recognition of emotional expressions. We found that the PD group were impaired relative to controls in recognizing anger, disgust and fearful expressions in upright faces. Then, consistent with a configural processing deficit, participants with PD showed no composite effect when attempting to identify facial expressions of anger, disgust and fear. A face inversion effect, however, was observed in the performance of all participants in both the whole faces and facial composites tasks. These findings can be explained in terms of a configural processing deficit if it is assumed that the disruption caused by facial composites was specific to configural processing, whereas inversion reduced performance by making it difficult to derive both featural and configural information from faces.     

面孔知觉中特征、结构和整体加工策略的眼动研究

考察面孔知觉中特征加工、结构加工和整体加工三种不同加工方式对应的眼动模式。实验1中, 将以特征信息为主的错乱面孔和以结构信息为主的模糊面孔作为线索刺激, 引发对测试面孔的特征加工和结构加工, 眼动分析表明：特征加工表现为对面孔各特征内更长的凝视时间, 结构加工表现为对面孔各特征间高频的眼跳。实验2采用相同的研究范式, 将完整面孔、轻度错乱面孔和低水平模糊面孔作为线索刺激, 引发对测试面孔除特征加工和结构加工外的另一种加工方式-- 整体加工, 表现为注视点更多地落在测试面孔中央区的鼻子部位以扩大注视范围, 进而把握整张面孔信息。本研究揭示了三种不同面孔加工方式眼动模式的差异。     

Developmental changes in the discrimination of dynamic human actions in infancy

Recent evidence suggests that adults selectively attend to features of action, such as how a hand contacts an object, and less to configural properties of action, such as spatial trajectory, when observing human actions. The current research investigated whether this bias develops in infancy. We utilized a habituation paradigm to assess 4-month-old and 10-month-old infants' discrimination of action based on featural, configural, and temporal sources of action information. Younger infants were able to discriminate changes to all three sources of information, but older infants were only able to reliably discriminate changes to featural information. These results highlight a previously unknown aspect of early action processing, and suggest that action perception may undergo a developmental process akin to perceptual narrowing.     

Categorical perception effects for facial identity in robustly represented familiar and self-faces: the role of configural and featural information

Categorical perception of robustly represented faces (self, friend) and unfamiliar faces is investigated, and the relative roles of configural and featural information are examined. Participants performed identification and discrimination tasks on morph series containing the self-face and a friend's face (self-Friend 1), two friends' faces (Friend 2-Friend 3), and two unfamiliar faces (Unfamiliar 1-Unfamiliar 2), presented in upright and inverted orientations. For upright faces, categorical perception effects were observed for both familiar morph series but not for the unfamiliar morph series, suggesting that robust representation is a requirement for categorical perception in facial identity. For inverted faces, categorical perception was observed for the self-Friend 1 morph series only. This suggests that categorical perception is tied to configural processing for familiar non-self-faces, but can be observed for self-faces during featural processing-consistent with evidence that self-face representations contain strong configural and featural components. Finally, categorical perception is not enhanced by the presence of the self-face relative to other familiar faces when upright, but shows a trend of being enhanced for self-faces when inverted, adding to the debate on the ways in which robustly represented faces can elicit categorical perception.     

The respective role of low and high spatial frequencies in supporting configural and featural processing of faces

One distinctive feature of processing faces, as compared to other categories, is thought to be the large dependence on configural cues such as the metric relations among features. To test the role of low spatial frequencies (LSFs) and high spatial frequencies (HSFs) in configural and featural processing, subjects were presented with triplets of faces that were filtered to preserve either LSFs (below 8 cycles per face width), HSFs (above 32 cycles per face width), or the full frequency spectrum. They were asked to match one of two probe faces to a target face. The distractor probe face differed from the target either configurally, featurally, or both featurally and configurally. When the difference was at the configural level, performance was better with LSF faces than with HSF faces. In contrast, with a featural difference, a strong performance advantage was found for HSF faces as compared to LSF faces. These results support the dominant role that LSFs play in the configural processing of faces, whereas featural processing is largely dependent on HSFs.     

Features are also important: contributions of featural and configural processing to face recognition

It has been suggested that face recognition is primarily based on configural information, with featural information playing little or no role. We investigated this idea by comparing the prototype effect for face prototypes that emphasized either featural or configural processing. In Experiment 1, participants showed a tendency to commit false alarms in response to nonstudied prototypes, and this tendency was equivalent for featural and configural prototypes. Experiment 2 replicated this finding, and provided support for the assumption that the two types of prototypes differed in terms of featural and configural processing: Face inversion eliminated the prototype effect for configural prototypes but not for featural prototypes. These results suggest that both featural and configural processing make important contributions to face recognition, and that their effects are dissociable.     

The other-race effect: Holistic coding differences and beyond

We evaluate claims that the other-race effect in face memory reflects stronger holistic coding of own-race than other-race faces. Considering evidence from a range of paradigms, including the inversion effect, part–whole effect, composite effect, and the scrambled/blurred task, we find considerable inconsistency, both between paradigms and between participant ethnicities. At the same time, however, studies that isolate configural and component feature processing consistently show better featural, as well as better configural, processing of own-race faces, for both Caucasian and Asian participants. These results raise the possibility that the key feature of own-race face processing is not stronger holistic processing per se, but rather more effective processing of all types of face information (featural as well as holistic).     

Configural face processing develops more slowly than featural face processing

Expertise in face processing takes many years to develop. To determine the contribution of different face-processing skills to this slow development, we altered a single face so as to create sets of faces designed to measure featural, configural, and contour processing. Within each set, faces differed only in the shape of the eyes and mouth (featural set), only in the spacing of the eyes and mouth (spacing set), or only in the shape of the external contour (contour set). We presented adults, and children aged 6, 8, and 10 years, with pairs of upright and inverted faces and instructed them to indicate whether the two faces were the same or different. Adults showed a larger inversion effect for the spacing set than for the featural and external contour sets, confirming that the spacing set taps configural processing. On the spacing set, all groups of children made more errors than adults. In contrast, on the external contour and featural sets, children at all ages were almost as accurate as adults, with no significant difference beginning at age 6 on the external contour set and beginning at age 10 on the featural set. Overall, the results indicate that adult expertise in configural processing is especially slow to develop.     

Effects of geometric distortions on face-recognition performance

The importance of 'configural' processing for face recognition is now well established, but it remains unclear precisely what it entails. Through four experiments we attempted to clarify the nature of configural processing by investigating the effects of various affine transformations on the recognition of familiar faces. Experiment 1 showed that recognition was markedly impaired by inversion of faces, somewhat impaired by shearing or horizontally stretching them, but unaffected by vertical stretching of faces to twice their normal height. In experiment 2 we investigated vertical and horizontal stretching in more detail, and found no effects of either transformation. Two further experiments were performed to determine whether participants were recognising stretched faces by using configural information. Experiment 3 showed that nonglobal vertical stretching of faces (stretching either the top or the bottom half while leaving the remainder undistorted) impaired recognition, implying that configural information from the stretched part of the face was influencing the process of recognition--ie that configural processing involves global facial properties. In experiment 4 we examined the effects of Gaussian blurring on recognition of undistorted and vertically stretched faces. Faces remained recognisable even when they were both stretched and blurred, implying that participants were basing their judgments on configural information from these stimuli, rather than resorting to some strategy based on local featural details. The tolerance of spatial distortions in human face recognition suggests that the configural information used as a basis for face recognition is unlikely to involve information about the absolute position of facial features relative to each other, at least not in any simple way.     

Losing face: impaired discrimination of featural and configural information in the mouth region of an inverted face

Given that all faces share the same set of features—two eyes, a nose, and a mouth—that are arranged in similar configuration, recognition of a specific face must depend on our ability to discern subtle differences in its featural and configural properties. An enduring question in the face-processing literature is whether featural or configural information plays a larger role in the recognition process. To address this question, the face dimensions task was designed, in which the featural and configural properties in the upper (eye) and lower (mouth) regions of a face were parametrically and independently manipulated. In a same–different task, two faces were sequentially presented and tested in their upright or in their inverted orientation. Inversion disrupted the perception of featural size (Exp. 1), featural shape (Exp. 2), and configural changes in the mouth region, but it had relatively little effect on the discrimination of featural size and shape and configural differences in the eye region. Inversion had little effect on the perception of information in the top and bottom halves of houses (Exp. 3), suggesting that the lower-half impairment was specific to faces. Spatial cueing to the mouth region eliminated the inversion effect (Exp. 4), suggesting that participants have a bias to attend to the eye region of an inverted face. The collective findings from these experiments suggest that inversion does not differentially impair featural or configural face perceptions, but rather impairs the perception of information in the mouth region of the face.