The influence of divided attention on holistic face perception.

There is evidence that upright, but not inverted, faces are encoded holistically. The holistic coding of faces was examined in four experiments by manipulating the attention allocated to target faces. In Experiment 1, participants in a divided attention condition were asked to match two upright flanker faces while encoding a centrally presented upright target face. Although holistic coding was evident in the full attention conditions, dividing attention disrupted holistic coding of target faces. In Experiment 2, we found that while matching upright flanker faces disrupted holistic coding, matching inverted flanker faces did not. Experiment 3 demonstrated that the differential effects of flanker orientation were not due to participants taking longer to match upright, than inverted, flanker faces. In Experiment 4, we found that matching fractured faces had an intermediate effect to that of matching upright and inverted flankers, on the holistic coding of the target faces. The findings emphasize the differences in processing of upright, fractured and inverted faces and suggest that there are limitations in the number of faces that can be holistically coded in a brief time.     

Race categorization modulates holistic face encoding

Recent studies have shown that same-race (SR) faces are processed more holistically than other-race (OR) faces, a difference that may underlie the greater difficulty at recognizing OR than SR faces (the "other-race effect"). This article provides original evidence suggesting that the holistic processing of faces may be sensitive to the observers' racial categorization of the face. In Experiment 1, Caucasian participants performed a face-composite task with Caucasian faces, Asian faces, and racially ambiguous morphed face stimuli. Identical morphed face stimuli were processed more holistically when categorized as SR than as OR faces. Experiment 2 further suggests that this finding was not underlain by strategic or training effects. Overall, these results support the view that one's categorization of a face as belonging to the same or another race plays a critical role in the holistic processing of this face.     

The composite face illusion: A whole window into our understanding of holistic face perception

Two identical top halves of a face are perceived as being different when their bottom halves belong to different faces, showing that the parts of a face cannot be perceived independently from the whole face. When this visual illusion is inserted in a matching task, observers make more mistakes and/or are slower at matching identical top face halves aligned with different bottom halves than when the bottom halves are spatially offset: The composite face effect. This composite face paradigm has been used in more than 60 studies that have provided information about the specificity and nature of perceptual integration between facial parts (“holistic face perception”), the impairment of this process in acquired prosopagnosia, its developmental course, temporal dynamics, and neural basis. Following a review of the main contributions made with the paradigm, I explain its rationale and strengths, and discuss its methodological parameters, making a number of proposals for its optimal use and refinement in order to improve our understanding of holistic face perception. Finally, I explain how this standard composite face paradigm is fundamentally different than the application to facial parts of a congruency/interference paradigm that has a long tradition in experimental psychology since Stroop (1935), and which was originally developed to measure attentional and response interference between different representations rather than perceptual integration. Moreover, a version of this congruency/interference paradigm used extensively over the past years with composite faces lacks a baseline measure and has decisional, attentional, and stimulus confounds, making the findings of these studies impossible to interpret in terms of holistic perception. I conclude by encouraging researchers in this field to concentrate fully on the standard composite face paradigm, gaze contingency, and other behavioural measures that can help us take one of the most important challenges of visual perception research: Understanding the neural mechanisms of holistic face perception.     

Impaired holistic and analytic face processing in congenital prosopagnosia: Evidence from the eye-contingent mask/window paradigm

There is abundant evidence that face recognition, in comparison to the recognition of other objects, is based on holistic processing rather than analytic processing. One line of research that provides evidence for this hypothesis is based on the study of people who experience pronounced difficulties in visually identifying conspecifics on the basis of their face. Earlier, we developed a behavioural paradigm to directly test analytic vs. holistic face processing. In comparison to a to be remembered reference face stimulus, one of two test stimuli was either presented in full view, with an eye-contingently moving window (only showing the fixated face feature, and therefore only affording analytic processing), or with an eye-contingently moving mask or scotoma (masking the fixated face feature, but still allowing holistic processing). In the present study we use this paradigm (that we used earlier in acquired prosopagnosia) to study face perception in congenital prosopagnosia (people having difficulties recognizing faces from birth on, without demonstrable brain damage). We observe both holistic and analytic face processing deficits in people with congenital prosopagnosia. Implications for a better understanding, both of congenital prosopagnosia and of normal face perception, are discussed.     

Inferring social attributes from different face regions: Evidence for holistic processing

Two experiments investigated the role that different face regions play in a variety of social judgements that are commonly made from facial appearance (sex, age, distinctiveness, attractiveness, approachability, trustworthiness, and intelligence). These judgements lie along a continuum from those with a clear physical basis and high consequent accuracy (sex, age) to judgements that can achieve a degree of consensus between observers despite having little known validity (intelligence, trustworthiness). Results from Experiment 1 indicated that the face's internal features (eyes, nose, and mouth) provide information that is more useful for social inferences than the external features (hair, face shape, ears, and chin), especially when judging traits such as approachability and trustworthiness. Experiment 2 investigated how judgement agreement was affected when the upper head, eye, nose, or mouth regions were presented in isolation or when these regions were obscured. A different pattern of results emerged for different characteristics, indicating that different types of facial information are used in the various judgements. Moreover, the informativeness of a particular region/feature depends on whether it is presented alone or in the context of the whole face. These findings provide evidence for the importance of holistic processing in making social attributions from facial appearance.     

Electrophysiological correlates of the composite face illusion: Disentangling perceptual and decisional components of holistic face processing in the human brain

When the bottom halves of two faces differ, people’s behavioral judgment of the identical top halves of those faces is impaired: they report that the top halves are different, and/or take more time than usual to provide a response. This behavioral measure is known as the composite face effect (CFE) and has traditionally been taken as evidence that faces are perceived holistically. Recently, however, it has been claimed that this effect is driven almost entirely by decisional, rather than perceptual, factors ( Richler, Gauthier, Wenger, & Palmeri, 2008). To disentangle the contribution of perceptual and decisional brain processes, we aimed to obtain an event-related potential (ERP) measure of the CFE at a stage of face encoding ( Jacques & Rossion, 2009) in the absence of a behavioral CFE effect. Sixteen participants performed a go/no-go task in an oddball paradigm, lifting a finger of their right or left hand when the top half of a face changed identity. This change of identity of the top of the face was associated with an increased ERP signal on occipito-temporal electrode sites at the N170 face-sensitive component (∼160 ms), the later decisional P3b component, and the lateralized readiness potential (LRP) starting at ∼350 ms. The N170 effect was observed equally early when only the unattended bottom part of the face changed, indicating that an identity change was perceived across the whole face in this condition. Importantly, there was no behavioral response bias for the bottom change trials, and no evidence of decisional biases from electrophysiological data (no P3b and LRP deflection in no-go trials). These data show that an early CFE can be measured in ERPs in the absence of any decisional response bias, indicating that the CFE reflects primarily the visual perception of the whole face.     

The influence of emotion on face processing

According to the broaden-and-build theory, positive emotions broaden one's thought-action repertoire, which may manifest as a widened attentional scope in cognitive processing. The present study directly tests this hypothesis by examining the influences of induced emotions (positive, neutral and negative) on holistic processing of face (Experiment 1) and face discrimination (Experiment 2). In both experiments, emotions induced with images from the International Affective Picture System significantly interacted with face processing. That is, positive emotions engendered greater holistic face encoding in a composite-face task in Experiment 1 and more accurate face discrimination in Experiment 2, relative to the neutral condition. In contrast, negative emotions impaired holistic face encoding in the composite-face task and reduced face discrimination accuracy. Taken together, these results provide further support for the attentional broadening effect of positive affect by demonstrating that induced positive emotions facilitate holistic/configural processing.     

Task effects, performance levels, features, configurations, and holistic face processing: A reply to Rossion

A recent article in Acta Psychologica (“Picture-plane inversion leads to qualitative changes of face perception” by Rossion [Rossion, B. (2008). Picture-plane inversion leads to qualitative changes of face perception. Acta Psychologica (Amst), 128(2), 274-289]) criticized several aspects of an earlier paper of ours [Riesenhuber, M., Jarudi, I., Gilad, S., & Sinha, P. (2004). Face processing in humans is compatible with a simple shape-based model of vision. Proceedings of the Royal Society of London B (Supplements), 271, S448-S450]. We here address Rossion’s criticisms and correct some misunderstandings. To frame the discussion, we first review our previously presented computational model of face recognition in cortex [Jiang, X., Rosen, E., Zeffiro, T., Vanmeter, J., Blanz, V., & Riesenhuber, M. (2006). Evaluation of a shape-based model of human face discrimination using FMRI and behavioral techniques. Neuron, 50(1), 159-172] that provides a concrete biologically plausible computational substrate for holistic coding, namely a neural representation learned for upright faces, in the spirit of the original simple-to-complex hierarchical model of vision by Hubel and Wiesel. We show that Rossion’s and others’ data support the model, and that there is actually a convergence of views on the mechanisms underlying face recognition, in particular regarding holistic processing.     

The electrophysiological correlates of integrated face and body-part perception

Previous studies have suggested that the human visual system processes faces and bodies holistically—that is, the different body parts are integrated into a unified representation. However, the time course of this integrative process is less known. In the present study, we investigated this issue by recording event-related potentials evoked by a face and two hands presented simultaneously and in different configurations. When the hands were rotated to obtain a biologically implausible configuration, a reduction of the P2 amplitude was observed relative to the condition in which the face and hands were retained in their veridical configuration and were supplemented with visual cues to highlight further the overall body posture. Our results show that the P2 component is sensitive to manipulations affecting the configuration of face and hand stimuli and suggest that the P2 reflects the operation of perceptual mechanisms responsible for the integrated processing of visually presented body parts.     

Early maturity of face recognition: No childhood development of holistic processing, novel face encoding, or face-space

Historically, it was believed the perceptual mechanisms involved in individuating faces developed only very slowly over the course of childhood, and that adult levels of expertise were not reached until well into adolescence. Over the last 10 years, there has been some erosion of this view by demonstrations that all adult-like behavioural properties are qualitatively present in young children and infants. Determining the age of maturity, however, requires quantitative comparison across age groups, a task made difficult by the need to disentangle development in face perception from development in all the other cognitive factors that affect task performance. Here, we argue that full quantitative maturity is reached early, by 5-7 years at the latest and possibly earlier. This is based on a comprehensive literature review of results in the 5-years-to-adult age range, with particular focus on the results of the few previous studies that are methodologically suitable for quantitative comparison of face effects across age, plus three new experiments testing development of holistic/configural processing (faces versus objects, disproportionate inversion effect), ability to encode novel faces (assessed via implicit memory) and face-space (own-age bias).     

Hemisphere-dependent holistic processing of familiar faces

In two behavioral experiments involving lateralized stimulus presentation, we tested whether one of the most commonly used measures of holistic face processing—the composite face effect—would be more pronounced for stimuli presented to the right as compared to the left hemisphere. In experiment 1, we investigated the composite face effect in a verbal identification task, similar to its original report (Young, Hellawell, & Hay, 1987). Aligning top and bottom halves of composite face stimuli led to performance decreases irrespective of hemifield, indicating holistic processing of comparable magnitude for inputs provided separately to either hemisphere. However, when matching of the same top parts was required in experiment 2, an alignment-dependent performance decrease was found for stimuli presented in the left, but not right visual field. These observations suggest that the right hemisphere dominates in early stages of holistic processing, as indexed by the composite face effect, but that later processes such as face identification and naming are based on unified representations that are independent of input lateralization. Moreover, the composite face effect may not rely on the exact same representation(s) when measured in matching and identification tasks.     

Sex-contingent face aftereffects depend on perceptual category rather than structural encoding

Many studies have used visual adaptation to investigate how recent experience with faces influences perception. While faces similar to those seen during adaptation phases are typically perceived as more 'normal' after adaptation, it is possible to induce aftereffects in one direction for one category (e.g. female) and simultaneously induce aftereffects in the opposite direction for another category (e.g. male). Such aftereffects could reflect 'category-contingent' adaptation of neurons selective for perceptual category (e.g. male or female) or 'structure-contingent' adaptation of lower-level neurons coding the physical characteristics of different face patterns. We compared these explanations by testing for simultaneous opposite after effects following adaptation to (a) two groups of faces from distinct sex categories (male and female) or (b) two groups of faces from the same sex category (female and hyper-female) where the structural differences between the female and hyper-female groups were mathematically identical to those between male and female groups. We were able to induce opposite aftereffects following adaptation between sex categories but not after adaptation within a sex category. These findings indicate the involvement of neurons coding perceptual category in sex-contingent face aftereffects and cannot be explained by neurons coding only the physical aspects of face patterns.     

Normal face-based judgements of social characteristics despite severely impaired holistic face processing

Initial evidence indicates that face-based judgements of socially relevant characteristics such as people's trustworthiness or attractiveness are linked to the configural/holistic processing of facial cues. What remains a matter of debate, however, is whether such processing is actually necessary for normal social judgements to occur and whether it resembles the type of integrative processing as required for facial identification. To address these issues, we asked a well-characterized case of acquired prosopagnosia (PS) with a marked deficit in holistic processing for face identity to rate a series of faces on several dimensions of social relevance. PS provided ratings within the normal range for most of the social characteristics probed (i.e., aggression, attractiveness, confidence, intelligence, sociability, trustworthiness). Her evaluations deviated from those of healthy controls only when facial dominance was concerned. Taken together, these data demonstrate that the inability to integrate facial information during face individuation does not necessarily translate into a generalized deficit to evaluate faces on social dimensions.     

The evidence rejects the expertise hypothesis: reply to Gauthier & Bukach

In Robbins, R. & McKone, E. (2006). No face-like processing for object-of-expertise in three behavioural tasks. Cognition this issue, we showed face-like holistic/configural processing does not occur for objects-of-expertise on standard paradigms including inversion, part-whole, part-in-configurally-transformed-whole, and the standard composite task. In this reply to the discussion by Gauthier, I., & Bukach, C. (2006). Should we reject the expertise hypothesis? Cognition, this issue, we focus on several issues: the fact that they do not dispute our review of previous data; the strength of null effects obtained from multiple studies and paradigms; the evidence for domain-specificity of the neural substrate supporting face processing; the difference between the expertise hypothesis (as a theory about the origin of face processing) and studies of how experience affects object processing in general; and the problems with G&B's proposed alteration to the standard composite paradigm. We argue that overwhelming evidence suggests the expertise hypothesis should be put to rest so that researchers can focus on what the origin of "special" processing for faces actually is, and investigate the many interesting changes to object recognition that do occur with experience.     

A holistic account of the own-race effect in face recognition: evidence from a cross-cultural study

A robust finding in the cross-cultural research is that people's memories for faces of their own race are superior to their memories for other-race faces. However, the mechanisms underlying the own-race effect have not been well defined. In this study, a holistic explanation was examined in which Caucasian and Asian participants were asked to recognize features of Caucasian and Asian faces presented in isolation and in the whole face. The main finding was that Caucasian participants recognized own-race faces more holistically than Asian faces whereas Asian participants demonstrated holistic recognition for both own-race and other-race faces. The differences in holistic recognition between Caucasian and Asian participants mirrored differences in their relative experience with own-race and other-race faces. These results suggest that the own-race effect may arise from the holistic recognition of faces from a highly familiar racial group.     

Holistic face encoding is modulated by perceived face race: Evidence from perceptual adaptation

Human expertise at processing faces relies on how facial features are encoded: as a whole template rather than as a sum of independent features. This holistic encoding is less prominent for other-race faces, possibly accounting for the difficulty one encounters in recognizing these faces (the ‘other-race effect’). Here, we tested the hypothesis that the magnitude of holistic face encoding can be modulated by racial categorization of the face. Caucasian participants performed a face-composite task with ‘racially-ambiguous’ face-stimuli (cross-race morphed faces, equally categorized as Asian or Caucasian faces in an independent task). The perceived race of the ambiguous faces was manipulated using adaptation. Experiment 1 showed that identical morphed face-stimuli were processed more holistically when perceived as ‘same-race’ than as ‘other-race’, i.e., following adaptation to ‘other-race’ versus ‘same-race’, respectively. Experiment 2 ascertained that the determining factor in the observed holistic processing modulation was the race of the racially-ambiguous face as perceived, rather than expected, by the participants, which supports the idea that the holistic processing of the face-stimuli was modulated by their race-categorization at the perceptual level.     

A unique look at face processing: the impact of masked faces on the processing of facial features

This experiment utilized a masked priming paradigm to explore the early processes involved in face recognition. The first experiment investigated implicit processing of the eyes and mouth in an upright face, using prime durations of 33 and 50 ms. The results demonstrate implicit processing of both the eyes and mouth, and support the configural processing theory of face processing. The second experiment used the same method with inverted faces and the third experiment was a combination of Experiments 1 and 2. The fourth experiment utilized misaligned faces as the primes. Based on the pattern of results from these experiments, we suggest that, when a face is inverted, the eyes and mouth are initially processed individually and are not linked until a later stage of processing. An upright face is proposed to be processed by analysis of its configuration, whereas an inverted face is initially processed using first-order relational information, and then converted to an upright representation and transferred to face specific regions for configural analysis.     

When intuition fails to align with data: A reply to Rossion (2013)

Holistic processing, a hallmark of face perception, is often measured in the so-called composite paradigm, in which participants are asked to match part of a stimulus while ignoring another part. In prior work, we recommended against the use of one version of the composite task we call the partial design, on the basis of confounds with response biases. Rossion wrote a lengthy piece that reviews the work that he has published using this design, raising a large number of criticisms, both about an alternative measure of holistic processing that we have used and advocated (which we call the complete design) and about our work in general. In this reply, we have limited our discussion to those issues that would be relevant to a researcher looking to decide which version of this composite paradigm to use, as we doubt a comprehensive reply would be of significant interest outside a very small circle.     

Focus of attention and automaticity in handwriting

This study investigated the nature of automaticity in everyday tasks by testing handwriting performance under single and dual-task conditions. Item familiarity and hand dominance were also manipulated to understand both cognitive and motor components of the task. In line with previous literature, performance was superior in an extraneous focus of attention condition compared to two different skill focus conditions. This effect was found only when writing with the dominant hand. In addition, performance was superior for high familiarity compared to low familiarity items. These findings indicate that motor and cognitive familiarity are related to the degree of automaticity of motor skills and can be manipulated to produce different performance outcomes. The findings also imply that the progression of skill acquisition from novel to novice to expert levels can be traced using different dual-task conditions. The separation of motor and cognitive familiarity is a new approach in the handwriting domain, and provides insight into the nature of attentional demands during performance.     

The role of TPH2 variant rs4570625 in shaping infant attention to social signals

TPH2, the rate-limiting enzyme in the synthesis of serotonin, has been connected to several psychiatric outcomes. Its allelic variant, rs4570625, has been found to relate to individual differences in cognitive and emotion regulation during infancy with T-carriers of rs4570625 showing a relatively heightened attention bias for fearful faces. A significant gene-environment interaction was also reported with the T-carriers of mothers with depressive symptoms showing the highest fear bias.We investigated these associations in a sample of 8-month old infants (N = 330), whose mothers were prescreened for low/high levels of prenatal depressive and/or anxiety symptoms. Attention disengagement from emotional faces (neutral, happy, fearful, and phase-scrambled control faces) to distractors was assessed with eye tracking and an overlap paradigm. Maternal depressive symptoms were assessed at several time points during pregnancy and postpartum. The mean levels of symptoms at six months postpartum and the trajectories of symptoms from early pregnancy until six months postpartum were used in the analyses (N = 274).No main effect of the rs4570625 genotype on attention disengagement was found. The difference in fear bias between the genotypes was significant but in an opposite direction compared to a previous study. The results regarding the interaction of the genotype and maternal depression were not in accordance with the previous studies.These results show inconsistencies in the effects of the rs4570625 genotype on attention biases in separate samples of infants from the same population with only slight differences in age.