The role of the head in configural body processing: Behavioural and electrophysiological evidence from the inversion and scrambling effect

The present study aimed to further explore the role of the head for configural body processing by comparing complete bodies with headless bodies and faceless heads (Experiment 1). A second aim was to further explore the role of the eye region in configural face processing (Experiment 2). Due to that, we conducted a second experiment with complete faces, eyeless faces, and eyes. In addition, we used two effects to manipulate configural processing: the effect of stimulus inversion and scrambling. The current data clearly show an inversion effect for intact bodies presented with head and faces including the eye region. Thus, the head and the eye region seem to be central for configural processes that are manipulated by the effect of stimulus inversion. Furthermore, the behavioural and electrophysiological body inversion effect depends on the intact configuration of bodies and is associated with the N170 as the face inversion effect depends on the intact face configuration. Hence, configural body processing depends not only on the presence of the head but rather on a complete representation of human bodies that includes the body and the head. Furthermore, configural face processing relies on intact and complete face representations that include faces and eyes.     

Behavioral and ERP measures of holistic face processing in a composite task

Holistic processing of faces is characterized by encoding of the face as a single stimulus. This study employed a composite face task to examine whether holistic processing varies when attention is restricted to the top as compared to the bottom half of the face, and whether evidence of holistic processing would be observed in event-related potentials. Analyses of behavioral data showed that spatial misalignment of the face halves disrupted holistic processing and enhanced detection of repeated attended halves. Effects of misalignment on the N170, VPP and N250 ERP components resembled effects of face inversion. Attention to the top half of the face was associated with faster P1, N170, VPP, and P2 latencies than attending to the bottom, suggesting automatic processing of the eye region. Further, N170 latency effects suggested that structural encoding of the face is facilitated during holistic processing. N250 latency effects reflected task difficulty. Finally, an overall right hemispheric asymmetry was most pronounced when holistic face processing was greatest. Results are discussed in light of recent proposals that holistic face processing is a subtype of configural face processing.     

Turning configural processing upside down: part and whole body postures

Like faces, body postures are susceptible to an inversion effect in untrained viewers. The inversion effect may be indicative of configural processing, but what kind of configural processing is used for the recognition of body postures must be specified. The information available in the body stimulus was manipulated. The presence and magnitude of inversion effects were compared for body parts, scrambled bodies, and body halves relative to whole bodies and to corresponding conditions for faces and houses. Results suggest that configural body posture recognition relies on the structural hierarchy of body parts, not the parts themselves or a complete template match. Configural recognition of body postures based on information about the structural hierarchy of parts defines an important point on the configural processing continuum, between recognition based on first-order spatial relations and recognition based on holistic undifferentiated template matching.     

The composite face illusion: A whole window into our understanding of holistic face perception

Two identical top halves of a face are perceived as being different when their bottom halves belong to different faces, showing that the parts of a face cannot be perceived independently from the whole face. When this visual illusion is inserted in a matching task, observers make more mistakes and/or are slower at matching identical top face halves aligned with different bottom halves than when the bottom halves are spatially offset: The composite face effect. This composite face paradigm has been used in more than 60 studies that have provided information about the specificity and nature of perceptual integration between facial parts (“holistic face perception”), the impairment of this process in acquired prosopagnosia, its developmental course, temporal dynamics, and neural basis. Following a review of the main contributions made with the paradigm, I explain its rationale and strengths, and discuss its methodological parameters, making a number of proposals for its optimal use and refinement in order to improve our understanding of holistic face perception. Finally, I explain how this standard composite face paradigm is fundamentally different than the application to facial parts of a congruency/interference paradigm that has a long tradition in experimental psychology since Stroop (1935), and which was originally developed to measure attentional and response interference between different representations rather than perceptual integration. Moreover, a version of this congruency/interference paradigm used extensively over the past years with composite faces lacks a baseline measure and has decisional, attentional, and stimulus confounds, making the findings of these studies impossible to interpret in terms of holistic perception. I conclude by encouraging researchers in this field to concentrate fully on the standard composite face paradigm, gaze contingency, and other behavioural measures that can help us take one of the most important challenges of visual perception research: Understanding the neural mechanisms of holistic face perception.     

Holistic face processing can be independent of gaze behaviour: Evidence from the composite face illusion

People tend to perceive identical top halves (i.e. above the nose) of two face stimuli as being different when they are aligned with distinct bottom halves. This composite face illusion is generally considered as the most compelling evidence that facial features are integrated into a holistic representation. Here, we recorded eye‐movements during the composite face illusion in a delayed matching task of top halves of faces. Behavioural results showed a strong composite face effect, participants making more mistakes and taking longer time to match two identical top halves of faces when they were aligned (vs. misaligned) with different bottom halves. Importantly, fixation sites and eye‐movements were virtually identical when the top and bottom parts were aligned (composite illusion) or misaligned (no illusion), indicating that holistic face processing can be independent of gaze behaviour. These findings reinforce the view that holistic representations of individual faces can be extracted early on from information at a relatively coarse scale, independently of overt attention.     

Priming global and local processing of composite faces: revisiting the processing-bias effect on face perception

We used the composite-face illusion and Navon stimuli to determine the consequences of priming local or global processing on subsequent face recognition. The composite-face illusion reflects the difficulty of ignoring the task-irrelevant half-face while attending the task-relevant half if the half-faces in the composite are aligned. On each trial, participants first matched two Navon stimuli, attending to either the global or the local level, and then matched the upper halves of two composite faces presented sequentially. Global processing of Navon stimuli increased the sensitivity to incongruence between the upper and the lower halves of the composite face, relative to a baseline in which the composite faces were not primed. Local processing of Navon stimuli did not influence the sensitivity to incongruence. Although incongruence induced a bias toward different responses, this bias was not modulated by priming. We conclude that global processing of Navon stimuli augments holistic processing of the face.     

Disrupting perceptual grouping of face parts impairs holistic face processing

Face perception is widely believed to involve integration of facial features into a holistic perceptual unit, but the mechanisms underlying this integration are relatively unknown. We examined whether perceptual grouping cues influence a classic marker of holistic face perception, the “composite-face effect.” Participants made same–different judgments about a cued part of sequentially presented chimeric faces, and holistic processing was indexed as the degree to which the task-irrelevant face halves impacted performance. Grouping was encouraged or discouraged by adjusting the backgrounds behind the face halves: Although the face halves were always aligned, their respective backgrounds could be misaligned and of different colors. Holistic processing of face, but not of nonface, stimuli was significantly reduced when the backgrounds were misaligned and of different colors, cues that discouraged grouping of the face halves into a cohesive unit (Exp. 1). This effect was sensitive to stimulus orientation at short (200 ms) but not at long (2,500 ms) encoding durations, consistent with the previously documented temporal properties of the holistic processing of upright and inverted faces (Exps. 2 and 3). These results suggest that grouping mechanisms, typically involved in the perception of objecthood more generally, might contribute in important ways to the holistic perception of faces.     

Holistic face perception: Mind the gap!

The most widely used measurement of holistic face perception, the composite face effect (CFE), is challenged by two apparently contradictory goals: having a defined face part (i.e., the top half), and yet perceiving the face as an integrated unit (i.e., holistically). Here, we investigated the impact of a small gap between top and bottom face halves in the standard composite face paradigm, requiring matching of sequentially presented top face halves. In Experiment 1, the CFE was larger for no-gap than gap stimuli overall, but not for participants who were presented with gap stimuli first, suggesting that the area of the top face half was unknown without a gap. This was confirmed in Experiment 2, in which these two stimulus sets were mixed up: the gap stimuli thus provided information about the area of a top face half and the magnitude of the CFE did not differ between stimulus sets. These observations indicate that the CFE might be artificially inflated in the absence of a stimulus cue that objectively defines a border between the face halves. Finally, in Experiment 3, observers were asked to determine which of two simultaneously presented faces was the composite face. Perceptual judgements for no-gap stimuli approached ceiling; however, with a gap, participants were almost unable to distinguish the composite face from a veridical face. This effect was not only due to low-level segmentation cues at the border of no-gap face halves, because stimulus inversion decreased performance in both conditions. This result indicates that the two halves of different faces may be integrated more naturally with a small gap that eliminates an enhanced contrast border. Collectively, these observations suggest that a small gap between face halves provides an objective definition of the face half to match and is beneficial for valid measurement of the behavioural CFE.     

The effect of face orientation on holistic processing

Holistic processing, a hallmark of face processing, can be measured by the composite face effect: adults have difficulty recognising the top half of a face when it is aligned with a new bottom half, unless holistic processing is disrupted by misaligning the two halves. Like the recognition of facial identity, holistic processing is impaired when faces are inverted. To obtain a more refined measure of the influence of orientation on holistic face processing, we administered the composite face task to adults at each of seven orientations. In both experiment 1 (in which orientations were randomly intermixed) and experiment 2 (in which orientations were blocked), the composite face effect decreased linearly with rotation. We conclude that holistic processing is tuned to upright faces, diminishes as faces deviate from upright, and becomes insignificant once faces reach a sideways orientation. We propose a hierarchical model of face perception in which linear decreases in holistic processing underlie qualitative shifts in other aspects of face perception.     

The perception of (naked only) bodies and faceless heads relies on holistic processing: Evidence from the inversion effect

Faces and bodies are more difficult to perceive when presented inverted than when presented upright (i.e., stimulus inversion effect), an effect that has been attributed to the disruption of holistic processing. The features that can trigger holistic processing in faces and bodies, however, still remain elusive. In this study, using a sequential matching task, we tested whether stimulus inversion affects various categories of visual stimuli: faces, faceless heads, faceless heads in body context, headless bodies naked, whole bodies naked, headless bodies clothed, and whole bodies clothed. Both accuracy and inversion efficiency score results show inversion effects for all categories but for clothed bodies (with and without heads). In addition, the magnitude of the inversion effect for face, naked body, and faceless heads was similar. Our findings demonstrate that the perception of faces, faceless heads, and naked bodies relies on holistic processing. Clothed bodies (with and without heads), on the other side, may trigger clothes-sensitive rather than body-sensitive perceptual mechanisms.     

面孔加工的结构编码阶段异族效应的加工方式： ERPs研究

实验采用事件相关电位（ERPs）技术,以大学生为被试,运用非洲、欧洲、亚洲三个不同种族的面孔照片,探究异族效应与加工方式的关系。行为实验结果显示,被试对非洲面孔的反应时快于欧洲面孔,且两者均快于亚洲面孔。ERP研究结果显示,亚洲面孔的N170波幅显著小于非洲和欧洲面孔的波幅,后两者的N170波幅没有差异,而且亚洲面孔的倒置效应最大。研究结果说明相对于异族面孔,本族面孔更多地使用构型编码的加工方式,且N170成分表现出右半球优势。     

The other-race effect: Holistic coding differences and beyond

We evaluate claims that the other-race effect in face memory reflects stronger holistic coding of own-race than other-race faces. Considering evidence from a range of paradigms, including the inversion effect, part–whole effect, composite effect, and the scrambled/blurred task, we find considerable inconsistency, both between paradigms and between participant ethnicities. At the same time, however, studies that isolate configural and component feature processing consistently show better featural, as well as better configural, processing of own-race faces, for both Caucasian and Asian participants. These results raise the possibility that the key feature of own-race face processing is not stronger holistic processing per se, but rather more effective processing of all types of face information (featural as well as holistic).     

Configural coding of facial expressions: The impact of inversion and photographic negative

In previous research we used the composite paradigm (Young, Hellawell, & Hay, ) to demonstrate that configural cues are important for interpreting facial expressions. However, different configural cues in face perception have been identified, including holistic processing (i.e., perception of facial features as a single gestalt) and second‐order spatial relations (i.e., the spatial relationship between individual features). Previous research has suggested that the composite effect for facial identity operates at the level of holistic encoding. Here we show that the composite effect for facial expression has a similar perceptual basis by using different graphic manipulations (stimulus inversion and photographic negative) in conjunction with the composite paradigm. In relation to Bruce and Young's () functional model of face recognition, a suitable level for the composite effect is a stage of front‐end processing referred to as structural encoding, that is common to both facial identity and facial expression perception.     

Left-right holistic integration of human bodies

Holistic integration of faces has been widely studied. More recently, investigations have explored whether similar processing is used for human bodies. Here we show that holistic processing, as measured by the composite task, does occur for bodies but is stronger for left and right halves than for top and bottom halves. We also found composite effects for left-right halves of inverted bodies. Standard composite effects were found for top halves of faces, tested as a control. We argue that our results suggest that holistic processing of faces and bodies might not exclusively occur for identification, but instead may also have evolved to aid communication and/or decisions about mate choice (through judging symmetry).     

Visual expertise does not predict the composite effect across species: A comparison between spider (Ateles geoffroyi) and rhesus (Macaca mulatta) monkeys

Humans are subject to the composite illusion: two identical top halves of a face are perceived as “different” when they are presented with different bottom halves. This observation suggests that when building a mental representation of a face, the underlying system perceives the whole face, and has difficulty decomposing facial features. We adapted a behavioural task that measures the composite illusion to examine the perception of faces in two nonhuman species. Specifically we had spider (Ateles geoffroyi) and rhesus monkeys (Macaca mulatta) perform a two-forced choice, match-to-sample task where only the top half of sample was relevant to the task. The results of Experiment 1 show that spider monkeys (N = 2) process the faces of familiar species (conspecifics and humans, but not chimpanzees, sheep, or sticks), holistically. The second experiment tested rhesus monkeys (N = 7) with the faces of humans, chimpanzees, gorillas, sheep, and sticks. Contrary to prediction, there was no evidence of a composite effect in the human (or familiar primate) condition. Instead, we present evidence of a composite illusion in the chimpanzee condition (an unfamiliar primate). Together, these experiments show that visual expertise does not predict the composite effect across the primate order.     

Left–right holistic integration of human bodies

Holistic integration of faces has been widely studied. More recently, investigations have explored whether similar processing is used for human bodies. Here we show that holistic processing, as measured by the composite task, does occur for bodies but is stronger for left and right halves than for top and bottom halves. We also found composite effects for left–right halves of inverted bodies. Standard composite effects were found for top halves of faces, tested as a control. We argue that our results suggest that holistic processing of faces and bodies might not exclusively occur for identification, but instead may also have evolved to aid communication and/or decisions about mate choice (through judging symmetry).     

Faces are "spatial"--holistic face perception is supported by low spatial frequencies

Faces are perceived holistically, a phenomenon best illustrated when the processing of a face feature is affected by the other features. Here, the authors tested the hypothesis that the holistic perception of a face mainly relies on its low spatial frequencies. Holistic face perception was tested in two classical paradigms: the whole-part advantage (Experiment 1) and the composite face effect (Experiments 2-4). Holistic effects were equally large or larger for low-pass filtered faces as compared to full-spectrum faces and significantly larger than for high-pass filtered faces. The disproportionate composite effect found for low-pass filtered faces was not observed when holistic perception was disrupted by inversion (Experiment 3). Experiment 4 showed that the composite face effect was enhanced only for low spatial frequencies, but not for intermediate spatial frequencies known be critical for face recognition. These findings indicate that holistic face perception is largely supported by low spatial frequencies. They also suggest that holistic processing precedes the analysis of local features during face perception.     

Discrimination of faces and houses by rhesus monkeys: the role of stimulus expertise and rotation angle

The face inversion effect, or impaired recognition of upside down compared to upright faces, is used as a marker for the configural processing of faces in primates. The inversion effect in humans and chimpanzees is strongest for categories of stimuli for which subjects have considerable expertise, primarily conspecifics’ faces. Moreover, discrimination performance decreases linearly as faces are incrementally rotated from upright to inverted. This suggests that rotated faces must be transformed, or normalized back into their most typical viewpoint before configural processing can ensue, and the greater the required normalization, the greater the likelihood of errors resulting. Previous studies in our lab have demonstrated a general face inversion effect in rhesus monkeys that was not influenced by expertise. Therefore, the present study examined the influence of rotation angle on the visual perception of face and nonface stimuli that varied in their level of expertise to further delineate the processes underlying the inversion effect in rhesus monkeys. Five subjects discriminated images in five orientation angles. Results showed significant linear impairments for all stimulus categories, including houses. However, compared to the upright images, only rhesus faces resulted in worse performance at rotation angles greater than 45°, suggesting stronger configural processing for stimuli for which subjects had the greatest expertise.     

The role of holistic processing in judgments of facial attractiveness

Previous work has demonstrated that facial identity recognition, expression recognition, gender categorisation, and race categorisation rely on a holistic representation. Here we examine whether a holistic representation is also used for judgments of facial attractiveness. Like past studies, we used the composite paradigm to assess holistic processing (Young et al 1987, Perception 16 747-759). Experiment 1 showed that top halves of upright faces are judged to be more attractive when aligned with an attractive bottom half than when aligned with an unattractive bottom half. To assess whether this effect resulted from holistic processing or more general effects, we examined the impact of the attractive and unattractive bottom halves when upright halves were misaligned and when aligned and misaligned halves were presented upside-down. The bottom halves had no effect in either condition. These results demonstrate that the perceptual processes underlying upright facial-attractiveness judgments represent the face holistically. Our findings with attractiveness judgments and previous demonstrations involving other aspects of face processing suggest that a common holistic representation is used for most types of face processing.