Chinese characters elicit face-like N170 inversion effects

Recognition of both faces and Chinese characters is commonly believed to rely on configural information. While faces typically exhibit behavioral and N170 inversion effects that differ from non-face stimuli (Rossion, Joyce, Cottrell, & Tarr, 2003), the current study examined whether a similar reliance on configural processing may result in similar inversion effects for faces and Chinese characters. Participants were engaged in an orientation judgment task (Experiment 1) and a one-back identity matching task (Experiment 2). Across two experiments, the N170 was delayed and enhanced in magnitude for upside-down faces and compound Chinese characters, compared to upright stimuli. The inversion effects for these two stimulus categories were bilateral for latency and right-lateralized for amplitudes. For simple Chinese characters, only the latency inversion effects were significant. Moreover, the size of the right-hemisphere inversion effects in N170 amplitude was larger for faces than Chinese characters. These findings show the N170 inversion effects from non-face stimuli closely parallel effects seen with faces. Face-like N170 inversion effects elicited by Chinese compound characters were attributed to the difficulty of part-whole integration as well as the disrupted regularity in relational information due to inversion. Hemispheric difference in Chinese character processing is also discussed.     

面孔识别特异性本质的ERP研究

本研究记录了16名被试在完成有整体结构变化和局部特征变化的面孔/房屋图片的一致性判断时的脑内时程变化,以期对面孔识别的特异性本质进行探讨。结果显示,N170波幅和潜伏期的刺激类型主效应显著;面孔/房屋所诱发的N170成分在波幅和潜伏期上均不存在加工方式上的显著差异。晚期成分(300～700ms)上也得到类似的结果。这表明:面孔与房屋(非面孔)的加工在早期和晚期成分上都有差异性,体现出面孔的加工在早期视觉刺激的加工和晚期识别的加工上都具有特异性;晚期识别加工的脑电结果不支持"面孔识别是整体的,结构的,而非面孔客体的识别是局部的,基于特征的"加工观点。     

The role of the head in configural body processing: Behavioural and electrophysiological evidence from the inversion and scrambling effect

The present study aimed to further explore the role of the head for configural body processing by comparing complete bodies with headless bodies and faceless heads (Experiment 1). A second aim was to further explore the role of the eye region in configural face processing (Experiment 2). Due to that, we conducted a second experiment with complete faces, eyeless faces, and eyes. In addition, we used two effects to manipulate configural processing: the effect of stimulus inversion and scrambling. The current data clearly show an inversion effect for intact bodies presented with head and faces including the eye region. Thus, the head and the eye region seem to be central for configural processes that are manipulated by the effect of stimulus inversion. Furthermore, the behavioural and electrophysiological body inversion effect depends on the intact configuration of bodies and is associated with the N170 as the face inversion effect depends on the intact face configuration. Hence, configural body processing depends not only on the presence of the head but rather on a complete representation of human bodies that includes the body and the head. Furthermore, configural face processing relies on intact and complete face representations that include faces and eyes.     

Behavioral and ERP measures of holistic face processing in a composite task

Holistic processing of faces is characterized by encoding of the face as a single stimulus. This study employed a composite face task to examine whether holistic processing varies when attention is restricted to the top as compared to the bottom half of the face, and whether evidence of holistic processing would be observed in event-related potentials. Analyses of behavioral data showed that spatial misalignment of the face halves disrupted holistic processing and enhanced detection of repeated attended halves. Effects of misalignment on the N170, VPP and N250 ERP components resembled effects of face inversion. Attention to the top half of the face was associated with faster P1, N170, VPP, and P2 latencies than attending to the bottom, suggesting automatic processing of the eye region. Further, N170 latency effects suggested that structural encoding of the face is facilitated during holistic processing. N250 latency effects reflected task difficulty. Finally, an overall right hemispheric asymmetry was most pronounced when holistic face processing was greatest. Results are discussed in light of recent proposals that holistic face processing is a subtype of configural face processing.     

Domain specificity versus expertise: factors influencing distinct processing of faces

To explore face specificity in visual processing, we compared the role of task-associated strategies and expertise on the N170 event-related potential (ERP) component elicited by human faces with the ERPs elicited by cars, birds, items of furniture, and ape faces. In Experiment 1, participants performed a car monitoring task and an animacy decision task. In Experiment 2, participants monitored human faces while faces of apes were the distracters. Faces elicited an equally conspicuous N170, significantly larger than the ERPs elicited by non-face categories regardless of whether they were ignored or had an equal status with other categories (Experiment 1), or were the targets (in Experiment 2). In contrast, the negative component elicited by cars during the same time range was larger if they were targets than if they were not. Furthermore, unlike the posterior-temporal distribution of the N170, the negative component elicited by cars and its modulation by task were more conspicuous at occipital sites. Faces of apes elicited an N170 that was similar in amplitude to that elicited by the human face targets, albeit peaking 10 ms later. As our participants were not ape experts, this pattern indicates that the N170 is face-specific, but not specie-specific, i.e. it is elicited by particular face features regardless of expertise. Overall, these results demonstrate the domain specificity of the visual mechanism implicated in processing faces, a mechanism which is not influenced by either task or expertise. The processing of other objects is probably accomplished by a more general visual processor, which is sensitive to strategic manipulations and attention.     

Perceptual specialization and configural face processing in infancy

Adults’ face processing expertise includes sensitivity to second-order configural information (spatial relations among features such as distance between eyes). Prior research indicates that infants process this information in female faces. In the current experiments, 9-month-olds discriminated spacing changes in upright human male and monkey faces but not in inverted faces. However, they failed to process matching changes in upright house stimuli. A similar pattern of performance was exhibited by 5-month-olds. Thus, 5- and 9-month-olds exhibited specialization by processing configural information in upright primate faces but not in houses or inverted faces. This finding suggests that, even early in life, infants treat faces in a special manner by responding to changes in configural information more readily in faces than in non-face stimuli. However, previously reported differences in infants’ processing of human versus monkey faces at 9 months of age (but not at younger ages), which have been associated with perceptual narrowing, were not evident in the current study. Thus, perceptual narrowing is not absolute in the sense of loss of the ability to process information from other species’ faces at older ages.     

The effect of inversion on the encoding of normal and “thatcherized” faces

In the “Thatcher illusion” a face, in which the eyes and mouth are inverted relative to the rest of the face, looks grotesque when shown upright but not when inverted. In four experiments we investigated the contribution of local and global processing to this illusion in normal observers. We examined inversion effects (i.e., better performance for upright than for inverted faces) in a task requiring discrimination of whether faces were or were not “thatcherized”. Observers made same/different judgements to isolated face parts (Experiments 1-2) and to whole faces (Experiments 3-4). Face pairs had the same or different identity, allowing for different process- ing strategies using feature-based or configural information, respectively. In Experiment 1, feature-based matching of same-person face parts yielded only a small inversion effect for normal face parts. However, when feature-based matching was prevented by using the face parts of different people on all trials (Experiment 2) an inversion effect occurred for normal but not for thatcherized parts. In Experiments 3 and 4, inversion effects occurred with normal but not with thatcherized whole faces, on both same- and different-person matching tasks. This suggests that a common configural strategy was used with whole (normal) faces. Face context facilitated attention to misoriented parts in same-person but not in different-person matching. The results indicate that (1) face inversion disrupts local configural processing, but not the processing of image features, and (2) thatcherization disrupts local configural processing in upright faces.     

Effects of geometric distortions on face-recognition performance

The importance of 'configural' processing for face recognition is now well established, but it remains unclear precisely what it entails. Through four experiments we attempted to clarify the nature of configural processing by investigating the effects of various affine transformations on the recognition of familiar faces. Experiment 1 showed that recognition was markedly impaired by inversion of faces, somewhat impaired by shearing or horizontally stretching them, but unaffected by vertical stretching of faces to twice their normal height. In experiment 2 we investigated vertical and horizontal stretching in more detail, and found no effects of either transformation. Two further experiments were performed to determine whether participants were recognising stretched faces by using configural information. Experiment 3 showed that nonglobal vertical stretching of faces (stretching either the top or the bottom half while leaving the remainder undistorted) impaired recognition, implying that configural information from the stretched part of the face was influencing the process of recognition--ie that configural processing involves global facial properties. In experiment 4 we examined the effects of Gaussian blurring on recognition of undistorted and vertically stretched faces. Faces remained recognisable even when they were both stretched and blurred, implying that participants were basing their judgments on configural information from these stimuli, rather than resorting to some strategy based on local featural details. The tolerance of spatial distortions in human face recognition suggests that the configural information used as a basis for face recognition is unlikely to involve information about the absolute position of facial features relative to each other, at least not in any simple way.     

Deficits in early-stage face perception in excessive internet users

Excessive Internet use is associated with a limited ability to communicate effectively socially, which depends largely on the capacity for perception of the human face. We used a passive visual detection paradigm to compare the early stages of the processing of face-related information in young excessive Internet users (EIUs) and healthy normal subjects by analyzing event-related potentials (ERPs) elicited by faces and by nonface stimuli (tables), each presented in the upright and inverted position. The P1 and N170 components of the spectrum of ERPs elicited at occipital-temporal sites by the viewing of faces were larger and peaked sooner than the same ERP components elicited by tables, and inverted faces significantly enhanced and delayed the N170 component. EIUs had a generally smaller P1 component than did normal subjects, whether elicited by faces or by tables, and the N170 effect, or difference in amplitude of the N170 component for faces versus tables, was significantly smaller in the EIUs than in normal subjects. However, the N170 inversion effect, or difference in amplitude of the N170 component elicited by upright versus inverted faces, was similar in the EIUs and normal subjects. These data indicate that EIUs have deficits in the early stage of face-perception processing but may have intact holistic/configural processing of faces. Whether some deeper processes of face perception, such as face memory and face identification, are affected in EIUs needs to be investigated further with more specific procedures.     

The Inversion Effect for Chinese Characters is Modulated by Radical Organization

In studies of visual object recognition, strong inversion effects accompany the acquisition of expertise and imply the involvement of configural processing. Chinese literacy results in sensitivity to the orthography of Chinese characters. While there is some evidence that this orthographic sensitivity results in an inversion effect, and thus involves configural processing, that processing might depend on exact orthographic properties. Chinese character recognition is believed to involve a hierarchical process, involving at least two lower levels of representation: strokes and radicals. Radicals are grouped into characters according to certain types of structure, i.e. left–right structure, top–bottom structure, or simple characters with only one radical by itself. These types of radical structures vary in both familiarity, and in hierarchical level (compound versus simple characters). In this study, we investigate whether the hierarchical-level or familiarity of radical-structure has an impact on the magnitude of the inversion effect. Participants were asked to do a matching task on pairs of either upright or inverted characters with all the types of structure. Inversion effects were measured based on both reaction time and response sensitivity. While an inversion effect was observed in all 3 conditions, the magnitude of the inversion effect varied with radical structure, being significantly larger for the most familiar type of structure: characters consisting of 2 radicals organized from left to right. These findings indicate that character recognition involves extraction of configural structure as well as radical processing which play different roles in the processing of compound characters and simple characters.     

Face‐specific configural processing of relational information

Face processing relies on configural processing, which is thought to be particularly disrupted by inversion. We compared inversion effects in recognition experiments for three types of stimuli, using faces (Experiment 1) and houses (Experiment 2). Stimuli varied by their colour only (colour), by the spatial relations between components (relational), or by the components themselves (eyes, mouths, doors). For faces, relational versions revealed strong inversion effects, component versions moderate, and colour versions no inversion effect. Recognition of houses revealed no inversion effects at all. We suggest that the inversion effects observed for faces in the component condition are due to relational changes, which must accompany any change in components. This proposal may account for the rather inconsistent effects of inversion reported in the literature. Furthermore, we suggest configural processing seems to be somehow face‐specific.     

Two routes to face perception: evidence from psychophysics and computational modeling

The aim of this study was to separately analyze the role of featural and configural face representations. Stimuli containing only featural information were created by cutting the faces into their parts and scrambling them. Stimuli only containing configural information were created by blurring the faces. Employing an old-new recognition task, the aim of Experiments 1 and 2 was to investigate whether unfamiliar faces (Exp. 1) or familiar faces (Exp. 2) can be recognized if only featural or configural information is provided. Both scrambled and blurred faces could be recognized above chance level. A further aim of Experiments 1 and 2 was to investigate whether our method of creating configural and featural stimuli is valid. Pre-activation of one form of representation did not facilitate recognition of the other, neither for unfamiliar faces (Exp. 1) nor for familiar faces (Exp. 2). This indicates a high internal validity of our method for creating configural and featural face stimuli. Experiment 3 examined whether features placed in their correct categorical relational position but with distorted metrical distances facilitated recognition of unfamiliar faces. These faces were recognized no better than the scrambled faces in Experiment 1, providing further evidence that facial features are stored independently of configural information. From these results we conclude that both featural and configural information are important to recognize a face and argue for a dual-mode hypothesis of face processing. Using the psychophysical results as motivation, we propose a computational framework that implements featural and configural processing routes using an appearance-based representation based on local features and their spatial relations. In three computational experiments (Experiments 4–6) using the same sets of stimuli, we show how this framework is able to model the psychophysical data.     

Combined effects of inversion and feature removal on N170 responses elicited by faces and car fronts

The face-sensitive N170 is typically enhanced for inverted compared to upright faces. Itier, Alain, Sedore, and McIntosh (2007) recently suggested that this N170 inversion effect is mainly driven by the eye region which becomes salient when the face configuration is disrupted. Here we tested whether similar effects could be observed with non-face objects that are structurally similar to faces in terms of possessing a homogeneous within-class first-order feature configuration. We presented upright and inverted pictures of intact car fronts, car fronts without lights, and isolated lights, in addition to analogous face conditions. Upright cars elicited substantial N170 responses of similar amplitude to those evoked by upright faces. In strong contrast to face conditions however, the car-elicited N170 was mainly driven by the global shape rather than the presence or absence of lights, and was dramatically reduced for isolated lights. Overall, our data confirm a differential influence of the eye region in upright and inverted faces. Results for car fronts do not suggest similar interactive encoding of eye-like features and configuration for non-face objects, even when these objects possess a similar feature configuration as faces.     

面孔加工的结构编码阶段异族效应的加工方式： ERPs研究

实验采用事件相关电位（ERPs）技术,以大学生为被试,运用非洲、欧洲、亚洲三个不同种族的面孔照片,探究异族效应与加工方式的关系。行为实验结果显示,被试对非洲面孔的反应时快于欧洲面孔,且两者均快于亚洲面孔。ERP研究结果显示,亚洲面孔的N170波幅显著小于非洲和欧洲面孔的波幅,后两者的N170波幅没有差异,而且亚洲面孔的倒置效应最大。研究结果说明相对于异族面孔,本族面孔更多地使用构型编码的加工方式,且N170成分表现出右半球优势。     

Remembering parts and wholes: Configural processing in face recollection

In two experiments, we examined the role of configural processing on states of awareness in face recognition. Configural processing was manipulated by presenting upright and inverted faces during study and test. After studying facial photographs of humans (Experiment 1) and horses (Experiment 2), participants provided a remember/know judgement for each recognised test face. In both experiments, disrupted configural processing had selective effects on states of awareness, so that inversion reduced remember, but not know, responses. Experiment 2 revealed disproportionate inversion effects in that the difference in remember responses between upright and inverted items was significant for human faces but not horses. These findings suggest that configural processing facilitates explicit recollection by providing a distinctive combination of nonsalient event attributes.     

Activation of face expertise and the inversion effect

We used a contextual priming paradigm to examine top-down influences on the face-inversion effect. Adult participants were primed with either faces or Chinese characters and then tested on ambiguous figures that could be perceived as either faces or Chinese characters, dependent on the priming condition. The ambiguous figures differed from one another in their configural information, which is crucial for processing faces but not Chinese characters. The inversion effect was observed in the face-priming condition, but not in the character-priming condition. The present results provide the first direct evidence that top-down activation of the face-processing expertise system plays a crucial role in the face-inversion effect.     

Interfering with memory for faces: The cost of doing two things at once

We inferred the processes critical for episodic retrieval of faces by measuring susceptibility to memory interference from different distracting tasks. Experiment 1 examined recognition of studied faces under full attention (FA) or each of two divided attention (DA) conditions requiring concurrent decisions to auditorily presented letters. Memory was disrupted in both DA relative to FA conditions, a result contrary to a material-specific account of interference effects. Experiment 2 investigated whether the magnitude of interference depended on competition between concurrent tasks for common processing resources. Studied faces were presented either upright (configurally processed) or inverted (featurally processed). Recognition was completed under FA, or DA with one of two face-based distracting tasks requiring either featural or configural processing. We found an interaction: memory for upright faces was lower under DA when the distracting task required configural than featural processing, while the reverse was true for memory of inverted faces. Across experiments, the magnitude of memory interference was similar (a 19% or 20% decline from FA) regardless of whether the materials in the distracting task overlapped with the to-be-remembered information. Importantly, interference was significantly larger (42%) when the processing demands of the distracting and target retrieval task overlapped, suggesting a processing-specific account of memory interference.     

Featural and configural face processing in adults and infants: a behavioral and electrophysiological investigation

We sought to elucidate the behavioral and electrophysiological correlates of face processing, in adults and infants, by manipulating either the featural or configural information within the face. Two different experiments are reported. In these experiments, event-related potentials (ERPs) were recorded from the scalp while adult, 8-month-old, and 4-month-old participants completed configural-change and featural-change face tasks. The infants also completed a behavioral visual paired-comparison task with featural and configural face changes. ERP results reveal hemispheric differences in processing featural but not configural changes for the N170 in adults. Furthermore, featural and configural changes are processed differently within the right and left hemispheres. The right hemisphere N170 is significantly greater for configural compared to featural changes. The left hemisphere N170, however, exhibits the opposite effect. Infant data suggest that similar to adults, 8-month-old, but not 4-month-old participants, exhibit similar hemispheric differences between featural and configural changes for the P400 component. Behavioral results suggest increased sensitivity to both featural and configural face changes in 8-month-olds compared to 4-month-olds.     

Why does picture-plane inversion sometimes dissociate perception of features and spacing in faces, and sometimes not? Toward a new theory of holistic processing

Classically, it has been presumed that picture-plane inversion primarily reduces sensitivity to spacing/configural information in faces (distance between location of the major features) and has little effect on sensitivity to local feature information (e.g., eye shape or color). Here, we review 22 published studies relevant to this claim. Data show that the feature inversion effect varied substantially across studies as a function of the following factors: whether the feature change was shape only or included color/brightness, the number of faces in the stimulus set, and whether the feature was in facial context. For shape-only changes in facial context, feature inversion effects were as large as typical spacing inversion effects. Small feature inversion effects occurred only when a task could be efficiently solved by visual-processing areas outside whole-face coding. The results argue that holistic/configural processing for upright faces integrates exact feature shape and spacing between blobs. We describe two plausible approaches to this process.     

When inverted faces are recognized: The role of configural information in face recognition

The identification of upright faces seems to involve a special sensitivity to "configural" information, the processing of which is less effective when the face is inverted. However the precise meaning of "configural" remains unclear. Five experiments are presented, which showed that the disruption of the processing of relational, rather than holistic, information largely determines the occurrence as well as the size of the face-inversion effect. In Experiment 1, faces could be identified either by unique combinations of local information (e.g. a specific eye colour plus hair colour) or by unique relational information (e.g. nose-mouth distance). The former showed no inversion effect, whereas the latter did. A combination of local and relational information (Experiment 2) again produced an inversion effect, although this effect was smaller than that found when only relational information was used. The results were replicated in Experiment 3 when differences in the brightness of local features were used instead of specific colour combinations. Experiment 4 used different retrieval conditions to distinguish relational from holistic processing, and demonstrated again that spatial relations between single features appeared to provide crucial information for face recognition. In Experiment 5, the importance of relational information was confirmed using faces that also varied in the shapes of local features.