Remembering parts and wholes: Configural processing in face recollection

In two experiments, we examined the role of configural processing on states of awareness in face recognition. Configural processing was manipulated by presenting upright and inverted faces during study and test. After studying facial photographs of humans (Experiment 1) and horses (Experiment 2), participants provided a remember/know judgement for each recognised test face. In both experiments, disrupted configural processing had selective effects on states of awareness, so that inversion reduced remember, but not know, responses. Experiment 2 revealed disproportionate inversion effects in that the difference in remember responses between upright and inverted items was significant for human faces but not horses. These findings suggest that configural processing facilitates explicit recollection by providing a distinctive combination of nonsalient event attributes.     

面孔倒置效应的研究与理论述评

面孔倒置效应是指, 个体对倒置面孔的再认成绩显著低于对正立面孔的再认成绩, 而且, 与普通物体的倒置效应相比, 面孔的倒置效应更大。研究者们针对面孔倒置效应提出了多种理论假说, 两种主要的理论解释是：第一, 倒置面孔破坏了面孔的结构特征, 影响了面孔的整体加工, 所以, 个体对倒置面孔的再认成绩较差; 第二, 眼睛在面孔加工中起重要作用, 尤其在倒置面孔中的作用更明显, 使得倒置面孔N170波幅较高。ERP和fMRI研究提示, 未来研究需要进一步明确眼睛、注意等在面孔倒置效应中的作用。     

A feature-inversion effect: can an isolated feature show behavior like the face-inversion effect?

The face-inversion effect (FIE) is explained by the configural-processing hypothesis. It proposes that inversion disrupts configural information processing (spatial links among facial features) and leaves the processing of featural information (eyes, nose, and mouth) comparatively intact. According to this hypothesis, an inverted isolated facial feature cannot show a feature-inversion effect--that is, behavior similar to the FIE--since all the spatial links between it and the other features in a face are eliminated; that is, the configural information is removed. The findings of the present study, which show that isolated eyes do exhibit the feature-inversion effect, support the extended configural-processing hypothesis. This proposes that inversion also impairs processing of the configural information within the eyes themselves. Removal of the brows in whole faces tended to interfere with processing of the configural information in the upright position but to facilitate processing in the inverted position.     

The influence of ingroup/outgroup categorization on same- and other-race face processing: The moderating role of inter- versus intra-racial context

We investigated the impact of ingroup/outgroup categorization on the encoding of same-race and other-race faces presented in inter-racial and intra-racial contexts (Experiments 1 and 2, respectively). White participants performed a same/different matching task on pairs of upright and inverted faces that were either same-race (White) or other-race (Black), and labeled as being from the same university or a different university. In Experiment 1, the same- and other-race faces were intermixed. For other-race faces, participants demonstrated greater configural processing following same- than other-university labeling. Same-race faces showed strong configural coding irrespective of the university labeling. In Experiment 2, faces were blocked by race. Participants demonstrated greater configural processing of same- than other-university faces, but now for both same- and other-race faces. These results demonstrate that other-race face processing is sensitive to non-racial ingroup/outgroup status regardless of racial context, but that the sensitivity of same-race face processing to the same cues depends on the racial context in which targets are encountered.     

Abnormalities in visual processing amongst students with body image concerns

Individuals with body dysmorphic disorder (BDD) appear to possess abnormalities in the way they observe and discriminate visual information. A pre-occupation with perceived defects in appearance has been attributed to a local visual processing bias. We studied the nature of visual bias in individuals who may be at risk of developing BDD – those with high body image concerns (BICs) – by using inverted stimulus discrimination. Inversion disrupts global, configural information in favor of local, feature-based processing. 40 individuals with high BIC and 40 low BIC controls performed a discrimination task with upright and inverted faces, bodies, and scenes. Individuals with high BIC discriminated inverted faces and bodies faster than controls, and were also more accurate when discriminating inverted bodies and scenes. This reduction in inversion effect for high BIC individuals may be due to a stimulus-general local, detail-focused processing bias, which may be associated with maladaptive fixation on small features in their appearance.     

Impaired face recognition does not preclude intact whole face perception

We studied intact and impaired processes in a prosopagnosic patient (RP). In Experiment 1, RP showed an inversion superiority effect with both faces and objects, with better performance when stimuli were presented upside down than in normal upright orientation. In Experiment 2, we studied the effect of face configuration directly by comparing matching performance with normal vs. scrambled faces. RP was worse with normal than with scrambled faces, whereas normal controls showed an advantage of a good face context. In Experiment 3, RP showed interference from external face features on the evaluation of internal face features. These results indicate, first, that although RP is impaired in face recognition and face matching, he does still encode the whole face rather than relying completely on parts-based procedures. Second, RP has a deficit at the level of the configural processes involved in finding subtle differences between individual faces, as his performance is worse when presented with a normal face configuration than with scrambled or inverted faces.     

Categorical perception of face identity in noise isolates configural processing.

Neuropsychological evidence suggests that face recognition based on configural (holistic) information can occur in isolation from recognition based on local feature cues. The present study shows that configural processing can be isolated experimentally in normal subjects. A phenomenon is reported that exists only for upright whole faces, namely categorical perception (CP) of face identity in noise. Three discrimination tasks (ABX, better likeness, and similarity ratings) were used to test for perceptual distortion across the category boundary predicted from binary classification of face morphs. Noise was added such that any single local region provided unreliable cues to identity. Under these conditions, CP was found for upright faces but not for inverted faces or single features, even with more than 10,000 trials. The CP-in-noise signature phenomenon was then used to show that configural processing survives image plane rotations of 45 degrees-90 degrees.     

The face inversion effect—Parts and wholes: Individual features and their configuration

The face inversion effect (FIE) is a reduction in recognition performance for inverted faces (compared to upright faces) that is greater than that typically observed with other stimulus types (e.g., houses). The work of Diamond and Carey, suggests that a special type of configural information, “second-order relational information” is critical in generating this inversion effect. However, Tanaka and Farah concluded that greater reliance on second-order relational information did not directly result in greater sensitivity to inversion, and they suggested that the FIE is not entirely due to a reliance on this type of configural information. A more recent review by McKone and Yovel provides a meta-analysis that makes a similar point. In this paper, we investigated the contributions made by configural and featural information to the FIE. Experiments 1a and1b investigated the link between configural information and the FIE. Remarkably, Experiment 1b showed that disruption of all configural information of the type considered in Diamond and Carey's analysis (both first and second order) was effective in reducing recognition performance, but did not significantly impact on the FIE. Experiments 2 and 3 revealed that face processing is affected by the orientation of individual features and that this plays a major role in producing the FIE. The FIE was only completely eliminated when we disrupted the single feature orientation information in addition to the configural information, by using a new type of transformation similar to Thatcherizing our sets of scrambled faces. We conclude by noting that our results for scrambled faces are consistent with an account that has recognition performance entirely determined by the proportion of upright facial features within a stimulus, and that any ability to make use of the spatial configuration of these features seems to benefit upright and inverted normal faces alike.     

Configural and component processing in simultaneous and sequential lineup procedures

Configural processing supports accurate face recognition, yet it has never been examined within the context of criminal identification lineups. We tested, using the inversion paradigm, the role of configural processing in lineups. Recent research has found that face discrimination accuracy in lineups is better in a simultaneous compared to a sequential lineup procedure. Therefore, we compared configural processing in simultaneous and sequential lineups to examine whether there are differences. We had participants view a crime video, and then they attempted to identify the perpetrator from a simultaneous or sequential lineup. The test faces were presented either upright or inverted, as previous research has shown that inverting test faces disrupts configural processing. The size of the inversion effect for faces was the same across lineup procedures, indicating that configural processing underlies face recognition in both procedures. Discrimination accuracy was comparable across lineup procedures in both the upright and inversion condition. Theoretical implications of the results are discussed.     

Perceptual integrality of componential and configural information in faces

The relative contribution of componential and configural information to face perception is controversial. We addressed this issue in the present study by examining how componential information and configural information interact during face processing, using Garner’s (1974) speeded classification paradigm. When classifying upright faces varying in components (eyes, nose, and mouth) and configural information (intereyes and nose-mouth spacing), observers could not selectively attend to components without being influenced by irrelevant variation in configural information, and vice versa, indicating that componential information and configural information are integral in upright face processing. Performance with inverted faces showed selective attention to components but not to configural information, implying dominance of componential information in processing inverted faces. When faces varied only in components, selective attention to different components was observed in upright and inverted faces, indicating that facial components are perceptually separable. These results provide strong evidence that integrality of componential and configural information, rather than the relative dominance of either, is the hallmark of upright face perception.     

Face inversion disproportionately impairs the perception of vertical but not horizontal relations between features

Upside-down inversion disrupts the processing of spatial relations between the features of a face, while largely preserving local feature analysis. However, recent studies on face inversion failed to observe a clear dissociation between relational and featural processing. To resolve these discrepancies and clarify how inversion affects face perception, the authors monitored inversion effects separately for vertical and horizontal distances between features. Inversion dramatically declined performance in the vertical-relational condition, but it impaired featural and horizontal-relational performance only moderately. Identical observations were made whether upright and inverted trials were blocked or randomly interleaved. The largest performance decrement was found for vertical relations even when faces were rotated by 90 degrees. Evidence that inversion dramatically disrupts the ability to extract vertical but not horizontal feature relations supports the view that inversion qualitatively changes face perception by rendering some of the processes activated by upright faces largely ineffective.     

Configural face encoding and spatial frequency information

Configural relations and a critical band of spatial frequencies (SFs) in the middle range are particularly important for face recognition. We report the results of four experiments in which the relationship between these two types of information was examined. In Experiments 1, 2A, and 2B, the face inversion effect (FIE) was used to probe configural face encoding. Recognition of upright and inverted faces and nonface objects was measured in four conditions: a no-filter condition and three SF conditions (low, medium, and high frequency). We found significant FIEs of comparable magnitudes for all frequency conditions. In Experiment 3, discrimination of faces on the basis of either configural or featural modifications was measured under the same four conditions. Although the ability to discriminate configural modifications was superior in the medium-frequency condition, so was the ability to discriminate featural modifications. We conclude that the band of SF that is critical for face recognition does not contribute preferentially to configural encoding.     

Picture-plane inversion leads to qualitative changes of face perception

Presenting a face stimulus upside-down generally causes a larger deficit in perceiving metric distances between facial features ("configuration") than local properties of these features. This effect supports a qualitative account of face inversion: the same transformation affects the processing of different kinds of information differently. However, this view has been recently challenged by studies reporting equal inversion costs of performance for discriminating featural and configural manipulations on faces. In this paper I argue that these studies did not replicate previous results due to methodological factors rather than largely irrelevant parameters such as having equal performance for configural and featural conditions at upright orientation, or randomizing trials across conditions. I also argue that identifying similar diagnostic features (eyes and eyebrows) for discriminating individual faces at upright and inverted orientations by means of response classification methods does not dismiss at all the qualitative view of face inversion. Considering these elements as well as both behavioral and neuropsychological evidence, I propose that the generally larger effect of inversion for processing configural than featural cues is a mere consequence of the disruption of holistic face perception. That is, configural relations necessarily involve two or more distant features on the face, such that their perception is most dependent on the ability to perceive simultaneously multiple features of a face as a whole.     

Face detection in normal and prosopagnosic individuals

Face detection, the process of finding a face in a visual scene, is a critical step in face processing, yet it has received relatively little attention compared with other face processes. The present study addresses this crucial first stage by investigating the effect of inversion on face detection and by examining how individuals with developmental prosopagnosia perform on face detection tasks. Fourteen control participants and fourteen individuals with developmental prosopagnosia (DPs) were tested with two face detection tasks: (1) Face versus Non‐Face, where arrays of small images were presented, one of which could contain a face and (2) Face versus Face Parts, where a two‐tone face could be embedded in a larger array of similar two‐tone face parts. On each trial, participants made a speeded response if a face was present in the visual display. On almost all measures both normal and prosopagnosic individuals showed strong inversion effects with significantly worse performance with inverted faces. This shows that the simple task of detection can show inversion effects comparable to those seen for other face tasks, including recognition. Finally, while there were prosopagnosics who were well within the normal range for detection, there were significant group differences, particularly for the case of the Face versus Face Parts, where prosopagnosics were worse than controls on upright but not on inverted face detection.     

Face inversion and contrast-reversal effects across development: in contrast to the expertise theory

To determine the role of configural changes on the development of face encoding and memory, we investigated face recognition in an n-back repetition task with upright, inverted and contrast-reversed unfamiliar faces in adults and children (8-16 years). Repetitions occurred immediately (0-lag) or after one intervening face (1-lag). Face recognition continued to develop beyond 14-16 years, as shown with hit rates, d' scores and reaction times that all improved with age. Inversion and contrast-reversal effects were found in all subjects but were not more pronounced with increasing age, suggesting no increased reliance on configural processing and thus arguing against the expertise theory of Diamond and Carey (1986). Recognition improved with age in upright but also in inverted and contrast-reversed faces, suggesting a quantitative rather than a qualitative developmental change in face processing. For all age groups, performances decreased and reaction times increased from 0- to 1-lag conditions similarly, suggesting a similar memory component involved in adults' and children's processing. These data suggest gradual quantitative improvements in face processing with age, mainly due to increasing working memory processing capacity.     

The influence of divided attention on holistic face perception.

There is evidence that upright, but not inverted, faces are encoded holistically. The holistic coding of faces was examined in four experiments by manipulating the attention allocated to target faces. In Experiment 1, participants in a divided attention condition were asked to match two upright flanker faces while encoding a centrally presented upright target face. Although holistic coding was evident in the full attention conditions, dividing attention disrupted holistic coding of target faces. In Experiment 2, we found that while matching upright flanker faces disrupted holistic coding, matching inverted flanker faces did not. Experiment 3 demonstrated that the differential effects of flanker orientation were not due to participants taking longer to match upright, than inverted, flanker faces. In Experiment 4, we found that matching fractured faces had an intermediate effect to that of matching upright and inverted flankers, on the holistic coding of the target faces. The findings emphasize the differences in processing of upright, fractured and inverted faces and suggest that there are limitations in the number of faces that can be holistically coded in a brief time.     

Perceptual specialization and configural face processing in infancy

Adults’ face processing expertise includes sensitivity to second-order configural information (spatial relations among features such as distance between eyes). Prior research indicates that infants process this information in female faces. In the current experiments, 9-month-olds discriminated spacing changes in upright human male and monkey faces but not in inverted faces. However, they failed to process matching changes in upright house stimuli. A similar pattern of performance was exhibited by 5-month-olds. Thus, 5- and 9-month-olds exhibited specialization by processing configural information in upright primate faces but not in houses or inverted faces. This finding suggests that, even early in life, infants treat faces in a special manner by responding to changes in configural information more readily in faces than in non-face stimuli. However, previously reported differences in infants’ processing of human versus monkey faces at 9 months of age (but not at younger ages), which have been associated with perceptual narrowing, were not evident in the current study. Thus, perceptual narrowing is not absolute in the sense of loss of the ability to process information from other species’ faces at older ages.     

眼睛区域构型信息与特征信息的跨维共变增益效应及其加工特异性

面孔知觉可能在区域尺度上发生多维信息整合, 但迄今无特异性实验证据。本研究在两个实验中操纵面孔眼睛区域或嘴巴区域的单维构型或特征信息, 测量人们觉察单维变化或跨维共变的敏感度, 以此检测面孔区域尺度上的多维信息整合有何现象与规律, 进而揭示面孔知觉的多维信息整合机制。实验获得3个发现：(1)正立面孔眼睛区域的信息变化觉察呈现出“跨维共变增益效应”, 跨维信息共变觉察的敏感度显著高于任意一种单维信息变化觉察的敏感度; (2)“跨维共变增益效应”只在正立面孔的眼睛区域出现, 在倒置面孔的眼睛区域、正立面孔的嘴巴区域或倒置面孔的嘴巴区域都没有出现, 因此具有面孔区域特异性和面孔朝向特异性; (3)就单维信息变化觉察而言, 眼睛区域的敏感度不会受到面孔倒置的损伤, 但是嘴巴区域的敏感度会受到面孔倒置的显著损伤。综合可知, 面孔知觉确实会发生区域尺度上的信息整合, 它不是普遍性的信息量效应, 而是特异性的眼睛效应(只发生在正立面孔的眼睛区域)。这是面孔整体加工(face holistic processing)在单维信息分辨和多维信息整合之间建立联系的必经环节。这提示我们对全脸多维信息知觉整合的理解需要从传统的面孔整体加工假设升级到以眼睛为中心的层级化多维信息整合算法(a hierarchical algorithm for multi-dimensional information integration)。     

Multiple perceptual strategies used by macaque monkeys for face recognition

Successful integration of individuals in macaque societies suggests that monkeys use fast and efficient perceptual mechanisms to discriminate between conspecifics. Humans and great apes use primarily holistic and configural, but also feature-based, processing for face recognition. The relative contribution of these processes to face recognition in monkeys is not known. We measured face recognition in three monkeys performing a visual paired comparison task. Monkey and humans faces were (1) axially rotated, (2) inverted, (3) high-pass filtered, and (4) low-pass filtered to isolate different face processing strategies. The amount of time spent looking at the eyes, mouth, and other facial features was compared across monkey and human faces for each type of stimulus manipulation. For all monkeys, face recognition, expressed as novelty preference, was intact for monkey faces that were axially rotated or spatially filtered and was supported in general by preferential looking at the eyes, but was impaired for inverted faces in two of the three monkeys. Axially rotated, upright human faces with a full range of spatial frequencies were also recognized, however, the distribution of time spent exploring each facial feature was significantly different compared to monkey faces. No novelty preference, and hence no inferred recognition, was observed for inverted or low-pass filtered human faces. High-pass filtered human faces were recognized, however, the looking pattern on facial features deviated from the pattern observed for monkey faces. Taken together these results indicate large differences in recognition success and in perceptual strategies used by monkeys to recognize humans versus conspecifics. Monkeys use both second-order configural and feature-based processing to recognize the faces of conspecifics, but they use primarily feature-based strategies to recognize human faces.     

Face processing in adolescents with autistic disorder: the inversion and composite effects

Two experiments with upright and inverted face and object images were carried out to investigate whether face processing in autism is more feature-based than in individuals with typical development. Participants were 17 high-ability adolescents with autistic disorder (16-24 years), 24 typically developing children (9-10 years) and 16 adults (18-33 years). In Experiment 1, a normal inversion effect was found for the adolescents with autism in a standard face recognition paradigm with reduced memory demands, except for a subgroup with low social intelligence who were not better in recognizing upright relative to inverted photographs of faces. In Experiment 2, the group with autism did not show the composite effect like the adult group did: they recognized face halves as well in aligned composite faces as in non-aligned composite faces. The results on the inversion task suggest that most adolescents with autism form a normal configuration-based face representation, but the absence of the composite effect indicates that they are less prone to use the contextual information of the face in a visual-search task.