Left–right holistic integration of human bodies

Holistic integration of faces has been widely studied. More recently, investigations have explored whether similar processing is used for human bodies. Here we show that holistic processing, as measured by the composite task, does occur for bodies but is stronger for left and right halves than for top and bottom halves. We also found composite effects for left–right halves of inverted bodies. Standard composite effects were found for top halves of faces, tested as a control. We argue that our results suggest that holistic processing of faces and bodies might not exclusively occur for identification, but instead may also have evolved to aid communication and/or decisions about mate choice (through judging symmetry).     

Dissociation between the behavioural and electrophysiological effects of the face and body composite illusions

Several studies have reported similarities between perceptual processes underlying face and body perception, particularly emphasizing the importance of configural processes. Differences between the perception of faces and the perception of bodies were observed by means of a manipulation targeting a specific subtype of configural processing: the composite illusion. The composite face illusion describes the fact that two identical top halves of a face are perceived as being different if they are presented with different bottom parts. This effect disappears, if both halves are laterally shifted. Crucially, the effect of misalignment is not observed for bodies. This study aimed to further explore differences in the time course of face and body perception by using the composite effect. The present results replicated behavioural effects illustrating that misalignment affects the perception of faces but not bodies. Thus, face but not body perception relies on holistic processing. However, differences in the time course of the processing of both stimulus categories emerged at the N170 and P200. The pattern of the behavioural data seemed to be related to the P200. Thus, the present data indicate that holistic processes associated with the effect of misalignment might occur 200 ms after stimulus onset.     

The effect of face orientation on holistic processing

Holistic processing, a hallmark of face processing, can be measured by the composite face effect: adults have difficulty recognising the top half of a face when it is aligned with a new bottom half, unless holistic processing is disrupted by misaligning the two halves. Like the recognition of facial identity, holistic processing is impaired when faces are inverted. To obtain a more refined measure of the influence of orientation on holistic face processing, we administered the composite face task to adults at each of seven orientations. In both experiment 1 (in which orientations were randomly intermixed) and experiment 2 (in which orientations were blocked), the composite face effect decreased linearly with rotation. We conclude that holistic processing is tuned to upright faces, diminishes as faces deviate from upright, and becomes insignificant once faces reach a sideways orientation. We propose a hierarchical model of face perception in which linear decreases in holistic processing underlie qualitative shifts in other aspects of face perception.     

Holistic face processing can be independent of gaze behaviour: Evidence from the composite face illusion

People tend to perceive identical top halves (i.e. above the nose) of two face stimuli as being different when they are aligned with distinct bottom halves. This composite face illusion is generally considered as the most compelling evidence that facial features are integrated into a holistic representation. Here, we recorded eye‐movements during the composite face illusion in a delayed matching task of top halves of faces. Behavioural results showed a strong composite face effect, participants making more mistakes and taking longer time to match two identical top halves of faces when they were aligned (vs. misaligned) with different bottom halves. Importantly, fixation sites and eye‐movements were virtually identical when the top and bottom parts were aligned (composite illusion) or misaligned (no illusion), indicating that holistic face processing can be independent of gaze behaviour. These findings reinforce the view that holistic representations of individual faces can be extracted early on from information at a relatively coarse scale, independently of overt attention.     

Impairment in holistic face processing following early visual deprivation

Unlike most objects, faces are processed holistically: They are processed as a whole rather than as a collection of independent features. We examined the role of early visual experience in the development of this type of processing of faces by using the composite-face task, a measure of holistic processing, to test patients deprived of visual experience during infancy. Visually normal control subjects showed the expected composite-face effect: They had difficulty perceiving that the top halves of two faces were the same when the top halves were aligned with different bottom halves. Performance improved when holistic processing was disrupted by misaligning the top and bottom halves. Deprived patients, in contrast, showed no evidence of holistic processing, and in fact performed significantly better than control subjects when top and bottom halves were aligned. These findings suggest that early visual experience is necessary to set up or maintain the neural substrate that leads to holistic processing of faces.     

Does response interference contribute to face composite effects?

Holistic processing of faces can be measured as a failure of selective attention to one face-half under instructions to ignore the other face-half in a naming or same/different matching task. But is interference from the irrelevant half due to response interference rather than to holistic processing? Here, participants learned to name two faces “Fred” and two “Bob.” At test, composites were created from top and bottom halves of different learned faces or of a novel face, and composites were either aligned or misaligned. Naming was slower when the irrelevant half was from a different face as opposed to the same face, regardless of whether it was associated with the same name, a different name, or no name, suggesting holistic processing. Interference was eliminated when composite halves were misaligned. These results suggest that, unlike Stroop effects, composite effects are not due to response interference.     

The role of holistic processing in judgments of facial attractiveness

Previous work has demonstrated that facial identity recognition, expression recognition, gender categorisation, and race categorisation rely on a holistic representation. Here we examine whether a holistic representation is also used for judgments of facial attractiveness. Like past studies, we used the composite paradigm to assess holistic processing (Young et al 1987, Perception 16 747-759). Experiment 1 showed that top halves of upright faces are judged to be more attractive when aligned with an attractive bottom half than when aligned with an unattractive bottom half. To assess whether this effect resulted from holistic processing or more general effects, we examined the impact of the attractive and unattractive bottom halves when upright halves were misaligned and when aligned and misaligned halves were presented upside-down. The bottom halves had no effect in either condition. These results demonstrate that the perceptual processes underlying upright facial-attractiveness judgments represent the face holistically. Our findings with attractiveness judgments and previous demonstrations involving other aspects of face processing suggest that a common holistic representation is used for most types of face processing.     

Why does selective attention to parts fail in face processing?

One hallmark of holistic face processing is an inability to selectively attend to 1 face part while ignoring information in another part. In 3 sequential matching experiments, the authors tested perceptual and decisional accounts of holistic processing by measuring congruency effects between cued and uncued composite face halves shown in spatially aligned or disjointed configurations. The authors found congruency effects when the top and bottom halves of the study face were spatially aligned, misaligned (Experiment 1), or adjacent to one another (Experiment 2). However, at test, congruency effects were reduced by misalignment and abolished for adjacent configurations. This suggests that manipulations at test are more influential than manipulations at study, consistent with a decisional account of holistic processing. When encoding demands for study and test faces were equated (Experiment 3), the authors observed effects of study configuration suggesting that, consistent with a perceptual explanation, encoding does influence the magnitude of holistic processing. Together, these results cannot be accounted for by current perceptual or decisional accounts of holistic processing and suggest the existence of an attention-dependent mechanism that can integrate spatially separated face parts.     

Behavioral and ERP measures of holistic face processing in a composite task

Holistic processing of faces is characterized by encoding of the face as a single stimulus. This study employed a composite face task to examine whether holistic processing varies when attention is restricted to the top as compared to the bottom half of the face, and whether evidence of holistic processing would be observed in event-related potentials. Analyses of behavioral data showed that spatial misalignment of the face halves disrupted holistic processing and enhanced detection of repeated attended halves. Effects of misalignment on the N170, VPP and N250 ERP components resembled effects of face inversion. Attention to the top half of the face was associated with faster P1, N170, VPP, and P2 latencies than attending to the bottom, suggesting automatic processing of the eye region. Further, N170 latency effects suggested that structural encoding of the face is facilitated during holistic processing. N250 latency effects reflected task difficulty. Finally, an overall right hemispheric asymmetry was most pronounced when holistic face processing was greatest. Results are discussed in light of recent proposals that holistic face processing is a subtype of configural face processing.     

Mixed emotions: Holistic and analytic perception of facial expressions

In the face literature, it is debated whether the identification of facial expressions requires holistic (i.e., whole face) or analytic (i.e., parts-based) information. In this study, happy and angry composite expressions were created in which the top and bottom face halves formed either an incongruent (e.g., angry top + happy bottom) or congruent composite expression (e.g., happy top + happy bottom). Participants reported the expression in the target top or bottom half of the face. In Experiment 1, the target half in the incongruent condition was identified less accurately and more slowly relative to the baseline isolated expression or neutral face conditions. In contrast, no differences were found between congruent and the baseline conditions. In Experiment 2, the effects of exposure duration were tested by presenting faces for 20, 60, 100 and 120 ms. Interference effects for the incongruent faces appeared at the earliest 20 ms interval and persisted for the 60, 100 and 120 ms intervals. In contrast, no differences were found between the congruent and baseline face conditions at any exposure interval. In Experiment 3, it was found that spatial alignment impaired the recognition of incongruent expressions, but had no effect on congruent expressions. These results are discussed in terms of holistic and analytic processing of facial expressions.     

Mixed emotions: holistic and analytic perception of facial expressions

In the face literature, it is debated whether the identification of facial expressions requires holistic (i.e., whole face) or analytic (i.e., parts-based) information. In this study, happy and angry composite expressions were created in which the top and bottom face halves formed either an incongruent (e.g., angry top + happy bottom) or congruent composite expression (e.g., happy top + happy bottom). Participants reported the expression in the target top or bottom half of the face. In Experiment 1, the target half in the incongruent condition was identified less accurately and more slowly relative to the baseline isolated expression or neutral face conditions. In contrast, no differences were found between congruent and the baseline conditions. In Experiment 2, the effects of exposure duration were tested by presenting faces for 20, 60, 100 and 120 ms. Interference effects for the incongruent faces appeared at the earliest 20 ms interval and persisted for the 60, 100 and 120 ms intervals. In contrast, no differences were found between the congruent and baseline face conditions at any exposure interval. In Experiment 3, it was found that spatial alignment impaired the recognition of incongruent expressions, but had no effect on congruent expressions. These results are discussed in terms of holistic and analytic processing of facial expressions.     

Evidence for holistic processing of faces viewed as photographic negatives

Inversion and photographic negation both impair face recognition. Inversion seems to disrupt processing of the spatial relationship between facial features ('relational' processing) which normally occurs with upright faces and which facilitates their recognition. It remains unclear why negation affects recognition. To find out if negation impairs relational processing, we investigated whether negative faces are subject to the 'chimeric-face effect'. Recognition of the top half of a composite face (constructed from top and bottom halves of different faces) is difficult when the face is upright, but not when it is inverted. To perform this task successfully, the bottom half of the face has to be disregarded, but the relational processing which normally occurs with upright faces makes this difficult. Inversion reduces relational processing and thus facilitates performance on this particular task. In our experiments, subjects saw pairs of chimeric faces and had to decide whether or not the top halves were identical. On half the trials the two chimeras had identical tops; on the remaining trials the top halves were different. (The bottom halves were always different.) All permutations of orientation (upright or inverted) and luminance (normal or negative) were used. In experiment 1, each pair of 'identical' top halves were the same in all respects. Experiment 2 used differently oriented views of the same person, to preclude matches being based on incidental features of the images rather than the faces displayed within them. In both experiments, similar chimeric-face effects were obtained with both positive and negative faces, implying that negative faces evoke some form of relational processing. It is argued that there may be more than one kind of relational processing involved in face recognition: the 'chimeric-face effect' may reflect an initial 'holistic' processing which binds facial features into a 'Gestalt', rather than being a demonstration of the configurational processing involved in individual recognition.     

The composite face illusion: A whole window into our understanding of holistic face perception

Two identical top halves of a face are perceived as being different when their bottom halves belong to different faces, showing that the parts of a face cannot be perceived independently from the whole face. When this visual illusion is inserted in a matching task, observers make more mistakes and/or are slower at matching identical top face halves aligned with different bottom halves than when the bottom halves are spatially offset: The composite face effect. This composite face paradigm has been used in more than 60 studies that have provided information about the specificity and nature of perceptual integration between facial parts (“holistic face perception”), the impairment of this process in acquired prosopagnosia, its developmental course, temporal dynamics, and neural basis. Following a review of the main contributions made with the paradigm, I explain its rationale and strengths, and discuss its methodological parameters, making a number of proposals for its optimal use and refinement in order to improve our understanding of holistic face perception. Finally, I explain how this standard composite face paradigm is fundamentally different than the application to facial parts of a congruency/interference paradigm that has a long tradition in experimental psychology since Stroop (1935), and which was originally developed to measure attentional and response interference between different representations rather than perceptual integration. Moreover, a version of this congruency/interference paradigm used extensively over the past years with composite faces lacks a baseline measure and has decisional, attentional, and stimulus confounds, making the findings of these studies impossible to interpret in terms of holistic perception. I conclude by encouraging researchers in this field to concentrate fully on the standard composite face paradigm, gaze contingency, and other behavioural measures that can help us take one of the most important challenges of visual perception research: Understanding the neural mechanisms of holistic face perception.     

The composite face effect in six-year-old children: Evidence of adult-like holistic face processing

Holistic processing (i.e., gluing facial features together into a gestalt) is a hallmark of adults’ expert face recognition. Children make more errors than adults on a variety of face processing tasks even during adolescence. To determine whether this slow development can be attributed to immature holistic processing of unfamiliar faces, we tested 6-year-old children (n=24) with a classic measure of adults’ holistic processing, the composite face effect: They made same/different judgements about the top halves of face pairs when each top half was combined with a different bottom half, with which it was aligned (so that holistic processing creates the impression of a different face) or misaligned (a manipulation that disrupts holistic processing). Six-year-olds showed an adult-like composite face effect: Like adults, they made 26% more errors on aligned trials than on misaligned trials. These results suggest that the improvements after age 6 in the recognition of the facial identity are not caused by the onset or increasing strength of holistic face processing.     

Does temporal integration of face parts reflect holistic processing?

We examined whether temporal integration of face parts reflects holistic processing or response interference. Participants learned to name two faces “Fred” and two “Bob.” At test, the top and bottom halves of different faces formed composites and were presented briefly separated in time. Replicating prior findings (Singer & Sheinberg, Vision Research, 46, 1838–1847, 2006), naming of the target half for aligned composites was slowed when the irrelevant half was from a face with a different name rather than from the original face. However, no interference was observed when the irrelevant half had a name identical to the name of the target half but came from a different learned face, arguing against a true holistic effect. Instead, response interference was obtained when the target half briefly preceded the irrelevant half. Experiment 2 confirmed a double dissociation of holistic processing versus response interference for intact faces versus temporally separated face halves, suggesting that simultaneous presentation of facial information is critical for holistic processing.     

Faces are "spatial"--holistic face perception is supported by low spatial frequencies

Faces are perceived holistically, a phenomenon best illustrated when the processing of a face feature is affected by the other features. Here, the authors tested the hypothesis that the holistic perception of a face mainly relies on its low spatial frequencies. Holistic face perception was tested in two classical paradigms: the whole-part advantage (Experiment 1) and the composite face effect (Experiments 2-4). Holistic effects were equally large or larger for low-pass filtered faces as compared to full-spectrum faces and significantly larger than for high-pass filtered faces. The disproportionate composite effect found for low-pass filtered faces was not observed when holistic perception was disrupted by inversion (Experiment 3). Experiment 4 showed that the composite face effect was enhanced only for low spatial frequencies, but not for intermediate spatial frequencies known be critical for face recognition. These findings indicate that holistic face perception is largely supported by low spatial frequencies. They also suggest that holistic processing precedes the analysis of local features during face perception.     

The role of holistic face processing in acquired prosopagnosia: evidence from the composite face effect

Faces are processed more holistically than other objects, and it has been suggested that the loss of holistic face processing causes acquired prosopagnosia. Support for this hypothesis comes from several cases who failed to show holistic face effects as well as the absence of reports of prosopagnosics with unequivocally normal holistic face perception. The current study examines the relationship between holistic face processing and prosopagnosia by testing seven acquired prosopagnosics with the face composite task, a classic measure of holistic face processing. To enhance the robustness of the findings, each prosopagnosic was tested with two versions of the composite task showing upright faces. We also tested an inverted condition to exclude the possibility that more general factors account for composite effects for upright faces. Four of the seven acquired prosopagnosic participants showed consistent upright face composite effects with minimal inverted face composite effects. We conclude that severe face processing deficits can co-occur with intact holistic face processing and that factors other than a loss of holistic processing contribute to the perceptual and recognition deficits in acquired prosopagnosia.     

Priming global and local processing of composite faces: revisiting the processing-bias effect on face perception

We used the composite-face illusion and Navon stimuli to determine the consequences of priming local or global processing on subsequent face recognition. The composite-face illusion reflects the difficulty of ignoring the task-irrelevant half-face while attending the task-relevant half if the half-faces in the composite are aligned. On each trial, participants first matched two Navon stimuli, attending to either the global or the local level, and then matched the upper halves of two composite faces presented sequentially. Global processing of Navon stimuli increased the sensitivity to incongruence between the upper and the lower halves of the composite face, relative to a baseline in which the composite faces were not primed. Local processing of Navon stimuli did not influence the sensitivity to incongruence. Although incongruence induced a bias toward different responses, this bias was not modulated by priming. We conclude that global processing of Navon stimuli augments holistic processing of the face.     

Holistic face perception: Mind the gap!

The most widely used measurement of holistic face perception, the composite face effect (CFE), is challenged by two apparently contradictory goals: having a defined face part (i.e., the top half), and yet perceiving the face as an integrated unit (i.e., holistically). Here, we investigated the impact of a small gap between top and bottom face halves in the standard composite face paradigm, requiring matching of sequentially presented top face halves. In Experiment 1, the CFE was larger for no-gap than gap stimuli overall, but not for participants who were presented with gap stimuli first, suggesting that the area of the top face half was unknown without a gap. This was confirmed in Experiment 2, in which these two stimulus sets were mixed up: the gap stimuli thus provided information about the area of a top face half and the magnitude of the CFE did not differ between stimulus sets. These observations indicate that the CFE might be artificially inflated in the absence of a stimulus cue that objectively defines a border between the face halves. Finally, in Experiment 3, observers were asked to determine which of two simultaneously presented faces was the composite face. Perceptual judgements for no-gap stimuli approached ceiling; however, with a gap, participants were almost unable to distinguish the composite face from a veridical face. This effect was not only due to low-level segmentation cues at the border of no-gap face halves, because stimulus inversion decreased performance in both conditions. This result indicates that the two halves of different faces may be integrated more naturally with a small gap that eliminates an enhanced contrast border. Collectively, these observations suggest that a small gap between face halves provides an objective definition of the face half to match and is beneficial for valid measurement of the behavioural CFE.