Converging evidence of configural processing of faces in high-functioning adults with autism spectrum disorders

There is conflicting evidence about whether individuals with autism spectrum disorder (ASD) demonstrate configural processing of faces. We examined two types of configural processing of unfamiliar faces in high-functioning adults with ASD: Holistic processing (processing a face as a gestalt percept) and processing of second-order relations (the spatial relations among facial features, e.g., distance between two eyes). Compared to age- and IQ-matched typical adults, 17 adults with ASD demonstrated normal holistic processing (as demonstrated by the composite face effect), normal sensitivity to second-order relations in upright faces, and the expected disruption of sensitivity to second-order relations in inverted faces. They were also normal in using the internal features and shape of the external contour to make same/different judgements about facial identity. The results provide converging evidence of configural processing of unfamiliar faces in high-functioning adults with ASD, and bring into question the generalizability of previous reports of abnormal face processing in individuals with ASD.     

The many faces of configural processing

Adults' expertise in recognizing faces has been attributed to configural processing. We distinguish three types of configural processing: detecting the first-order relations that define faces (i.e. two eyes above a nose and mouth), holistic processing (glueing the features together into a gestalt), and processing second-order relations (i.e. the spacing among features). We provide evidence for their separability based on behavioral marker tasks, their sensitivity to experimental manipulations, and their patterns of development. We note that inversion affects each type of configural processing, not just sensitivity to second-order relations, and we review evidence on whether configural processing is unique to faces.     

Three studies on configural face processing by chimpanzees

Previous studies have demonstrated the sensitivity of chimpanzees to facial configurations. Three studies further these findings by showing this sensitivity to be specific to second-order relational properties. In humans, this type of configural processing requires prolonged experience and enables subordinate-level discriminations of many individuals. Chimpanzees showed evidence of a composite-like effect for conspecific but not human faces despite extensive experience with humans. Chimpanzee face recognition was impaired only when manipulations targeted second-order properties. Finally, face processing was impaired when individual features were blurred through pixelation. Results confirm that chimpanzee face discrimination, like humans, depends on the integrity of second-order relational properties.     

Perceptual specialization and configural face processing in infancy

Adults’ face processing expertise includes sensitivity to second-order configural information (spatial relations among features such as distance between eyes). Prior research indicates that infants process this information in female faces. In the current experiments, 9-month-olds discriminated spacing changes in upright human male and monkey faces but not in inverted faces. However, they failed to process matching changes in upright house stimuli. A similar pattern of performance was exhibited by 5-month-olds. Thus, 5- and 9-month-olds exhibited specialization by processing configural information in upright primate faces but not in houses or inverted faces. This finding suggests that, even early in life, infants treat faces in a special manner by responding to changes in configural information more readily in faces than in non-face stimuli. However, previously reported differences in infants’ processing of human versus monkey faces at 9 months of age (but not at younger ages), which have been associated with perceptual narrowing, were not evident in the current study. Thus, perceptual narrowing is not absolute in the sense of loss of the ability to process information from other species’ faces at older ages.     

The face inversion effect—Parts and wholes: Individual features and their configuration

The face inversion effect (FIE) is a reduction in recognition performance for inverted faces (compared to upright faces) that is greater than that typically observed with other stimulus types (e.g., houses). The work of Diamond and Carey, suggests that a special type of configural information, “second-order relational information” is critical in generating this inversion effect. However, Tanaka and Farah concluded that greater reliance on second-order relational information did not directly result in greater sensitivity to inversion, and they suggested that the FIE is not entirely due to a reliance on this type of configural information. A more recent review by McKone and Yovel provides a meta-analysis that makes a similar point. In this paper, we investigated the contributions made by configural and featural information to the FIE. Experiments 1a and1b investigated the link between configural information and the FIE. Remarkably, Experiment 1b showed that disruption of all configural information of the type considered in Diamond and Carey's analysis (both first and second order) was effective in reducing recognition performance, but did not significantly impact on the FIE. Experiments 2 and 3 revealed that face processing is affected by the orientation of individual features and that this plays a major role in producing the FIE. The FIE was only completely eliminated when we disrupted the single feature orientation information in addition to the configural information, by using a new type of transformation similar to Thatcherizing our sets of scrambled faces. We conclude by noting that our results for scrambled faces are consistent with an account that has recognition performance entirely determined by the proportion of upright facial features within a stimulus, and that any ability to make use of the spatial configuration of these features seems to benefit upright and inverted normal faces alike.     

Two routes to face perception: evidence from psychophysics and computational modeling

The aim of this study was to separately analyze the role of featural and configural face representations. Stimuli containing only featural information were created by cutting the faces into their parts and scrambling them. Stimuli only containing configural information were created by blurring the faces. Employing an old-new recognition task, the aim of Experiments 1 and 2 was to investigate whether unfamiliar faces (Exp. 1) or familiar faces (Exp. 2) can be recognized if only featural or configural information is provided. Both scrambled and blurred faces could be recognized above chance level. A further aim of Experiments 1 and 2 was to investigate whether our method of creating configural and featural stimuli is valid. Pre-activation of one form of representation did not facilitate recognition of the other, neither for unfamiliar faces (Exp. 1) nor for familiar faces (Exp. 2). This indicates a high internal validity of our method for creating configural and featural face stimuli. Experiment 3 examined whether features placed in their correct categorical relational position but with distorted metrical distances facilitated recognition of unfamiliar faces. These faces were recognized no better than the scrambled faces in Experiment 1, providing further evidence that facial features are stored independently of configural information. From these results we conclude that both featural and configural information are important to recognize a face and argue for a dual-mode hypothesis of face processing. Using the psychophysical results as motivation, we propose a computational framework that implements featural and configural processing routes using an appearance-based representation based on local features and their spatial relations. In three computational experiments (Experiments 4–6) using the same sets of stimuli, we show how this framework is able to model the psychophysical data.     

The development of expert face processing: are infants sensitive to normal differences in second-order relational information?

Sensitivity to second-order relational information (i.e., spatial relations among features such as the distance between eyes) is a vital part of achieving expertise with face processing. Prior research is unclear on whether infants are sensitive to second-order differences seen in typical human populations. In the current experiments, we examined whether infants are sensitive to changes in the space between the eyes and between the nose and the mouth that are within the normal range of variability in Caucasian female faces. In Experiment 1, 7-month-olds detected these changes in second-order relational information. Experiment 2 extended this finding to 5-month-olds and also found that infants detect second-order relations in upright faces but not in inverted faces, thereby exhibiting an inversion effect that has been considered to be a hallmark of second-order relational processing during adulthood. These results suggest that infants as young as 5 months are sensitive to second-order relational changes that are within the normal range of human variability. They also indicate that at least rudimentary aspects of face processing expertise are available early in life.     

When inverted faces are recognized: The role of configural information in face recognition

The identification of upright faces seems to involve a special sensitivity to "configural" information, the processing of which is less effective when the face is inverted. However the precise meaning of "configural" remains unclear. Five experiments are presented, which showed that the disruption of the processing of relational, rather than holistic, information largely determines the occurrence as well as the size of the face-inversion effect. In Experiment 1, faces could be identified either by unique combinations of local information (e.g. a specific eye colour plus hair colour) or by unique relational information (e.g. nose-mouth distance). The former showed no inversion effect, whereas the latter did. A combination of local and relational information (Experiment 2) again produced an inversion effect, although this effect was smaller than that found when only relational information was used. The results were replicated in Experiment 3 when differences in the brightness of local features were used instead of specific colour combinations. Experiment 4 used different retrieval conditions to distinguish relational from holistic processing, and demonstrated again that spatial relations between single features appeared to provide crucial information for face recognition. In Experiment 5, the importance of relational information was confirmed using faces that also varied in the shapes of local features.     

Categorical perception of face identity in noise isolates configural processing.

Neuropsychological evidence suggests that face recognition based on configural (holistic) information can occur in isolation from recognition based on local feature cues. The present study shows that configural processing can be isolated experimentally in normal subjects. A phenomenon is reported that exists only for upright whole faces, namely categorical perception (CP) of face identity in noise. Three discrimination tasks (ABX, better likeness, and similarity ratings) were used to test for perceptual distortion across the category boundary predicted from binary classification of face morphs. Noise was added such that any single local region provided unreliable cues to identity. Under these conditions, CP was found for upright faces but not for inverted faces or single features, even with more than 10,000 trials. The CP-in-noise signature phenomenon was then used to show that configural processing survives image plane rotations of 45 degrees-90 degrees.     

The respective role of low and high spatial frequencies in supporting configural and featural processing of faces

One distinctive feature of processing faces, as compared to other categories, is thought to be the large dependence on configural cues such as the metric relations among features. To test the role of low spatial frequencies (LSFs) and high spatial frequencies (HSFs) in configural and featural processing, subjects were presented with triplets of faces that were filtered to preserve either LSFs (below 8 cycles per face width), HSFs (above 32 cycles per face width), or the full frequency spectrum. They were asked to match one of two probe faces to a target face. The distractor probe face differed from the target either configurally, featurally, or both featurally and configurally. When the difference was at the configural level, performance was better with LSF faces than with HSF faces. In contrast, with a featural difference, a strong performance advantage was found for HSF faces as compared to LSF faces. These results support the dominant role that LSFs play in the configural processing of faces, whereas featural processing is largely dependent on HSFs.     

Older adults' configural processing of faces: role of second-order information

Problems with face recognition are frequent in older adults. However, the mechanisms involved have only been partially discovered. In particular, it is unknown to what extent these problems may be related to changes in configural face processing. Here, we investigated the face inversion effect (FIE) together with the ability to detect modifications in the vertical or horizontal second-order relations between facial features. We used a same/different unfamiliar face discrimination task with 33 young and 33 older adults. The results showed dissociations in the performances of older versus younger adults. There was a lack of inversion effect during the recognition of original faces by older adults. However, for modified faces, older adults showed a pattern of performance similar to that of young participants, with preserved FIE for vertically modified faces and no detectable FIE for horizontally modified faces. Most importantly, the detection of vertical modifications was preserved in older relative to young adults whereas the detection of horizontal modifications was markedly diminished. We conclude that age has dissociable effects on configural face-encoding processes, with a relative preservation of vertical compared to horizontal second-order relations processing. These results help to understand some divergent results in the literature and may explain the spared familiar face identification abilities in the daily lives of older adults.     

Expert face coding: Configural and component coding of own-race and other-race faces

Configural and holistic coding are hallmarks of face perception. Although recent studies have shown that own-race faces are coded more holistically than other-race faces, the evidence for better configural coding of own-race faces is equivocal. We directly measured configural and component coding of own- and other-race male faces in Caucasian and Chinese participants. We manipulated individual features (components) or their spatial relations (configurations) using a novel morphing method to vary difficulty parametrically and tested sensitivity to these changes in a sequential matching task. Both configural and component coding were better for upright own-race than for upright other-race faces. Inversion impaired detection of configural changes more than it did detection of component changes, but also impaired performance more for easier discriminations,independent of type of change. These results challenge explanations of face expertise that rely solely on configural and holistic processing, and also call into question the widespread interpretation of large inversion decrements as diagnostic of configural coding.     

The effect of congenital deafness on cerebral asymmetry in the perception of emotional and non-emotional faces.

Functional hemispheric specialization in recognizing faces expressing emotions was investigated in 18 normal hearing and 18 congenitally deaf children aged 13-14 years. Three kinds of faces were presented: happy, to express positive emotions, sad, to express negative emotions, and neutral. The subjects' task was to recognize the test face exposed for 20 msec in the left or right visual field. The subjects answered by pointing at the exposed stimulus on the response card that contained three different faces. The errors committed in expositions of faces in the left and right visual field were analyzed. In the control group the right hemisphere dominated in case of sad and neutral faces. There were no significant differences in recognition of happy faces. The differentiated hemispheric organization pattern in normal hearing persons supports the hypothesis of different processing of positive and negative emotions expressed by faces. The observed hemispheric asymmetry was a result of two factors: (1) processing of faces as complex patterns requiring visuo-spatial analysis, and (2) processing of emotions contained in them. Functional hemispheric asymmetry was not observed in the group of deaf children for any kind of emotion expressed in the presented faces. The results suggest that lack of auditory experience influences the organization of functional hemispheric specialization. It can be supposed that in deaf children, the analysis of information contained in emotional faces takes place in both hemispheres.     

Featural and configural face processing in adults and infants: a behavioral and electrophysiological investigation

We sought to elucidate the behavioral and electrophysiological correlates of face processing, in adults and infants, by manipulating either the featural or configural information within the face. Two different experiments are reported. In these experiments, event-related potentials (ERPs) were recorded from the scalp while adult, 8-month-old, and 4-month-old participants completed configural-change and featural-change face tasks. The infants also completed a behavioral visual paired-comparison task with featural and configural face changes. ERP results reveal hemispheric differences in processing featural but not configural changes for the N170 in adults. Furthermore, featural and configural changes are processed differently within the right and left hemispheres. The right hemisphere N170 is significantly greater for configural compared to featural changes. The left hemisphere N170, however, exhibits the opposite effect. Infant data suggest that similar to adults, 8-month-old, but not 4-month-old participants, exhibit similar hemispheric differences between featural and configural changes for the P400 component. Behavioral results suggest increased sensitivity to both featural and configural face changes in 8-month-olds compared to 4-month-olds.     

Lateralised processing of the internal and the external facial features of personally familiar and unfamiliar faces: a visual half-field study

In this visual half field (VHF) experiment, we investigated possible differences between the left and the right hemisphere in the processing of the internal and external features of familiar and unfamiliar faces. Previous studies using famous and unknown faces had indicated that both hemispheres use the same qualitative mode of processing with the internal features being more important for the perception of familiar faces. In this experiment, personally familiar faces rather than famous faces are used. There are several, mainly methodological, reasons why personally familiar faces are more appropriate stimuli to investigate face processing. The results of the present study showed that no overall visual field effect occurred, but more importantly, that face processing in the left hemisphere differed qualitatively from that in the right hemisphere. The theoretical repercussions of these findings are discussed.     

Perceptual biases in processing facial identity and emotion

Normal observers demonstrate a bias to process the left sides of faces during perceptual judgments about identity or emotion. This effect suggests a right cerebral hemisphere processing bias. To test the role of the right hemisphere and the involvement of configural processing underlying this effect, young and older control observers and patients with right hemisphere damage completed two chimeric faces tasks (emotion judgment and face identity matching) with both upright and inverted faces. For control observers, the emotion judgment task elicited a strong left-sided perceptual bias that was reduced in young controls and eliminated in older controls by face inversion. Right hemisphere damage reversed the bias, suggesting the right hemisphere was dominant for this task, but that the left hemisphere could be flexibly recruited when right hemisphere mechanisms are not available or dominant. In contrast, face identity judgments were associated most clearly with a vertical bias favouring the uppermost stimuli that was eliminated by face inversion and right hemisphere lesions. The results suggest these tasks involve different neurocognitive mechanisms. The role of the right hemisphere and ventral cortical stream involvement with configural processes in face processing is discussed.     

Configural features in the context of upright and inverted faces

When faces are turned upside down, recognition is known to be severely disrupted. This effect is thought to be due to disruption of configural processing. Recently, Leder and Bruce (2000, Quarterly Journal of Experimental Psychology A 53 513-536) argued that configural information in face processing consists at least partly of locally processed relations between facial elements. In three experiments we investigated whether a local relational feature (the interocular distance) is processed differently in upside-down versus upright faces. In experiment 1 participants decided in which of two sequentially presented photographic faces the interocular distance was larger. The decision was more difficult in upside-down presentation. Three different conditions were used in experiment 2 to investigate whether this deficit depends upon parts of the face beyond the eyes themselves; displays showed the eye region alone, the eyes and nose, or the eyes and nose and mouth. The availability of additional features did not interact with the inversion effect which was observed strongly even when the eyes were shown in isolation. In experiment 3 all eyes were turned upside down in the inverted face condition as in the Thatcher illusion (Thompson, 1980 Perception 9 483-484). In this case no inversion effect was found. These results are in accordance with an explanation of the face-inversion effect in which the disruption of configural facial information plays the critical role in memory for faces, and in which configural information corresponds to spatial information that is processed in a way which is sensitive to local properties of the facial features involved.     

The effect of categorisation on sensitivity to second-order relations in novel objects

Adults appear to be more sensitive to configural information, including second-order relations (the spacing of features), in faces than in other objects. Superior processing of second-order relations in faces may arise from our experience of identifying faces at the individual level of categorisation (eg Bob versus John) but other objects at the basic level of categorisation (eg table versus chair; Gauthier and Tarr, 1997 Vision Research 37 1673- 1682). We simulated this learning difference with novel stimuli (comprised of blobs) by having two groups view the same stimuli but learn to identify the objects only at the basic level (based on the number of constituent blobs) or at both the basic level and individual level (based on the spacing, or second-order relations, of the blobs) of categorisation. Results from two experiments showed that, after training, observers in the individual-level training group were more sensitive to the second-order relations in novel exemplars of the learned category than observers in the basic-level training group. This is the first demonstration of specific improvement in sensitivity to second-order relations after training with non-face stimuli. The findings are consistent with the hypothesis that adults are more sensitive to second-order relations in faces than in other objects, at least in part, because they have more experience identifying faces at the individual level of categorisation.     

Processes underlying the cross-race effect: an investigation of holistic, featural, and relational processing of own-race versus other-race faces

Adults are often better at recognising own-race than other-race faces. Unlike previous studies that reported an own-race advantage after administering a single test of either holistic processing or of featural and relational processing, we used a cross-over design and multiple tasks to assess differential processing of faces from a familiar race versus a less familiar race. Caucasian and Chinese adults performed four tasks, each with Caucasian and Chinese faces. Two tasks measured holistic processing: the composite face task and the part/whole task. Both tasks indicated holistic processing of own-race and other-race faces that did not differ in degree. Two tasks measured featural and relational processing: the Jane/Ling task, in which same/ different judgments were made about face pairs that differed in features of their spacing, and the scrambled/blurred task, in which test faces were scrambled (isolates memory for components) or blurred (isolates memory for relations). Both tasks provided evidence of an own-race advantage in both featural and relational processing. We conclude that even when adults process other-race faces holistically, other manifestations of an own-race advantage remain.     

Picture-plane inversion leads to qualitative changes of face perception

Presenting a face stimulus upside-down generally causes a larger deficit in perceiving metric distances between facial features ("configuration") than local properties of these features. This effect supports a qualitative account of face inversion: the same transformation affects the processing of different kinds of information differently. However, this view has been recently challenged by studies reporting equal inversion costs of performance for discriminating featural and configural manipulations on faces. In this paper I argue that these studies did not replicate previous results due to methodological factors rather than largely irrelevant parameters such as having equal performance for configural and featural conditions at upright orientation, or randomizing trials across conditions. I also argue that identifying similar diagnostic features (eyes and eyebrows) for discriminating individual faces at upright and inverted orientations by means of response classification methods does not dismiss at all the qualitative view of face inversion. Considering these elements as well as both behavioral and neuropsychological evidence, I propose that the generally larger effect of inversion for processing configural than featural cues is a mere consequence of the disruption of holistic face perception. That is, configural relations necessarily involve two or more distant features on the face, such that their perception is most dependent on the ability to perceive simultaneously multiple features of a face as a whole.