Holistic face processing can be independent of gaze behaviour: Evidence from the composite face illusion

People tend to perceive identical top halves (i.e. above the nose) of two face stimuli as being different when they are aligned with distinct bottom halves. This composite face illusion is generally considered as the most compelling evidence that facial features are integrated into a holistic representation. Here, we recorded eye‐movements during the composite face illusion in a delayed matching task of top halves of faces. Behavioural results showed a strong composite face effect, participants making more mistakes and taking longer time to match two identical top halves of faces when they were aligned (vs. misaligned) with different bottom halves. Importantly, fixation sites and eye‐movements were virtually identical when the top and bottom parts were aligned (composite illusion) or misaligned (no illusion), indicating that holistic face processing can be independent of gaze behaviour. These findings reinforce the view that holistic representations of individual faces can be extracted early on from information at a relatively coarse scale, independently of overt attention.     

The relative importance of external and internal features of facial composites

Three experiments are reported that compare the quality of external with internal regions within a set of facial composites using two matching‐type tasks. Composites are constructed with the aim of triggering recognition from people familiar with the targets, and past research suggests internal face features dominate representations of familiar faces in memory. However the experiments reported here show that the internal regions of composites are very poorly matched against the faces they purport to represent, while external feature regions alone were matched almost as well as complete composites. In Experiments 1 and 2 the composites used were constructed by participant‐witnesses who were unfamiliar with the targets and therefore were predicted to demonstrate a bias towards the external parts of a face. In Experiment 3 we compared witnesses who were familiar or unfamiliar with the target items, but for both groups the external features were much better reproduced in the composites, suggesting it is the process of composite construction itself which is responsible for the poverty of the internal features. Practical implications of these results are discussed.     

面孔再认能力性别差异的实验研究

采用“学习—再认”范式,以有或无外部特征的不同性别面孔照片为材料,研究面孔记忆的性别差异,结果表明：（1）有外部特征时,女性被试对不同性别面孔的记忆成绩均好于男性被试;无外部特征时,女性被试与男性被试的记忆成绩不存在性别差异;（2）比起男性照片,女性可记忆更多的女性照片,表明女性在面孔记忆中存在自我性别偏见;男性也是可记忆更多的女性照片,存在反向的性别偏向;（3）无论被试性别和照片性别,均是有外部特征的面孔照片的记忆效果更好;有外部特征的情况下,女性的自我性别偏见更明显。     

Recovering faces from memory: the distracting influence of external facial features

Recognition memory for unfamiliar faces is facilitated when contextual cues (e.g., head pose, background environment, hair and clothing) are consistent between study and test. By contrast, inconsistencies in external features, especially hair, promote errors in unfamiliar face-matching tasks. For the construction of facial composites, as carried out by witnesses and victims of crime, the role of external features (hair, ears, and neck) is less clear, although research does suggest their involvement. Here, over three experiments, we investigate the impact of external features for recovering facial memories using a modern, recognition-based composite system, EvoFIT. Participant-constructors inspected an unfamiliar target face and, one day later, repeatedly selected items from arrays of whole faces, with "breeding," to "evolve" a composite with EvoFIT; further participants (evaluators) named the resulting composites. In Experiment 1, the important internal-features (eyes, brows, nose, and mouth) were constructed more identifiably when the visual presence of external features was decreased by Gaussian blur during construction: higher blur yielded more identifiable internal-features. In Experiment 2, increasing the visible extent of external features (to match the target's) in the presented face-arrays also improved internal-features quality, although less so than when external features were masked throughout construction. Experiment 3 demonstrated that masking external-features promoted substantially more identifiable images than using the previous method of blurring external-features. Overall, the research indicates that external features are a distractive rather than a beneficial cue for face construction; the results also provide a much better method to construct composites, one that should dramatically increase identification of offenders.     

Understanding the role of configural processing in face emotion recognition in Parkinson’s disease

This investigation examined whether impairment in configural processing could explain deficits in face emotion recognition in people with Parkinson’s disease (PD). Stimuli from the Radboud Faces Database were used to compare recognition of four negative emotion expressions by older adults with PD (n = 16) and matched controls (n = 17). Participants were tasked with categorizing emotional expressions from upright and inverted whole faces and facial composites; it is difficult to derive configural information from these two types of stimuli so featural processing should play a larger than usual role in accurate recognition of emotional expressions. We found that the PD group were impaired relative to controls in recognizing anger, disgust and fearful expressions in upright faces. Then, consistent with a configural processing deficit, participants with PD showed no composite effect when attempting to identify facial expressions of anger, disgust and fear. A face inversion effect, however, was observed in the performance of all participants in both the whole faces and facial composites tasks. These findings can be explained in terms of a configural processing deficit if it is assumed that the disruption caused by facial composites was specific to configural processing, whereas inversion reduced performance by making it difficult to derive both featural and configural information from faces.     

Faces are "spatial"--holistic face perception is supported by low spatial frequencies

Faces are perceived holistically, a phenomenon best illustrated when the processing of a face feature is affected by the other features. Here, the authors tested the hypothesis that the holistic perception of a face mainly relies on its low spatial frequencies. Holistic face perception was tested in two classical paradigms: the whole-part advantage (Experiment 1) and the composite face effect (Experiments 2-4). Holistic effects were equally large or larger for low-pass filtered faces as compared to full-spectrum faces and significantly larger than for high-pass filtered faces. The disproportionate composite effect found for low-pass filtered faces was not observed when holistic perception was disrupted by inversion (Experiment 3). Experiment 4 showed that the composite face effect was enhanced only for low spatial frequencies, but not for intermediate spatial frequencies known be critical for face recognition. These findings indicate that holistic face perception is largely supported by low spatial frequencies. They also suggest that holistic processing precedes the analysis of local features during face perception.     

Passport Checks: Interactions Between Matching Faces and Biographical Details

Matching unfamiliar faces is known to be a difficult task. However, most research has tested viewers' ability to match pairs of faces presented in isolation. In real settings, professionals are commonly required to examine photo ID that contains other biographical information too. In three experiments, we present faces embedded in passport frames and ask viewers to make face matching decisions and to check biographical information. We find that the inclusion of a passport frame reduces viewers' ability to detect a face mismatch. Furthermore, the nature of the face match influences biographical data checking—true matches lead to fewer detections of invalid data. In general, viewers were poor at spotting errors in biographical information. This pattern suggests that detection of fraudulent photo ID is even harder than current experimental studies suggest. Possible mechanisms for these effects are discussed. Copyright © 2016 John Wiley & Sons, Ltd.     

Sensitivity to First‐Order Relations of Facial Elements in Infant Rhesus Macaques

Faces are visually attractive to both human and nonhuman primates. Human neonates are thought to have a broad template for faces at birth and prefer face‐like to non‐face‐like stimuli. To better compare developmental trajectories of face processing phylogenetically, here, we investigated preferences for face‐like stimuli in infant rhesus macaques using photographs of real faces. We presented infant macaques aged 15–25 days with human, macaque and abstract faces with both normal and linear arrangements of facial features and measured infants' gaze durations, number of fixations and latency to look to each face using eye‐tracking technology. There was an overall preference for normal over linear facial arrangements for abstract and monkey faces but not human faces. Moreover, infant macaques looked less at monkey faces than at abstract or human faces. These results suggest that species and facial configurations affect face processing in infant macaques, and we discuss potential explanations for these findings. Further, carefully controlled studies are required to ascertain whether infant macaques' face template can be considered as broad as human infants' face template. Copyright © 2013 John Wiley & Sons, Ltd.     

Face inversion disproportionately impairs the perception of vertical but not horizontal relations between features

Upside-down inversion disrupts the processing of spatial relations between the features of a face, while largely preserving local feature analysis. However, recent studies on face inversion failed to observe a clear dissociation between relational and featural processing. To resolve these discrepancies and clarify how inversion affects face perception, the authors monitored inversion effects separately for vertical and horizontal distances between features. Inversion dramatically declined performance in the vertical-relational condition, but it impaired featural and horizontal-relational performance only moderately. Identical observations were made whether upright and inverted trials were blocked or randomly interleaved. The largest performance decrement was found for vertical relations even when faces were rotated by 90 degrees. Evidence that inversion dramatically disrupts the ability to extract vertical but not horizontal feature relations supports the view that inversion qualitatively changes face perception by rendering some of the processes activated by upright faces largely ineffective.     

Face inversion disrupts the perception of vertical relations between features in the right human occipito‐temporal cortex

The impact of inversion on the extraction of relational and featural face information was investigated in two fMRI experiments. Unlike previous studies, the contribution of horizontal and vertical spatial relations were considered separately since they have been shown to be differentially vulnerable to face inversion (Goffaux & Rossion, 2007). Hence, inversion largely affects the perception of vertical relations (e.g. eye or mouth height) while the processing of features (e.g. eye shape and surface) and of horizontal relations (e.g. inter‐ocular distance) is affected to a far lesser extent. Participants viewed pairs of faces that differed either at the level of one local feature (i.e. the eyes) or of the spatial relations of this feature with adjacent features. Changes of spatial relations were divided into two conditions, depending on the vertical or horizontal axis of the modifications. These stimulus conditions were presented in separate blocks in the first (block) experiment while they were presented in a random order in the second event‐related (ER) experiment. Face‐preferring voxels located in the right‐lateralized middle fusiform gyrus (rMFG) largely decreased their activity with inversion. Inversion‐related decreases were more moderate in left‐lateralized middle fusiform gyrus (lMFG). ER experiment revealed that inversion affected rMFG and lMFG activity in distinct stimulus conditions. Whereas inversion affected lMFG processing only in featural condition, inversion selectively affected the processing of vertical relations in rMFG. Correlation analyses further indicated that the inversion effect (IE) observed in rMFG and right inferior occipital gyrus (rIOG) reliably predicted the large behavioural IE observed for the processing of vertical relations. In contrast, lMFG IE correlated with the weak behavioural IE observed for the processing of horizontal relations. Our findings suggest that face configuration is mostly encoded in rMFG, whereas more local aspects of face information, such as features and horizontal spatial relations drive lMFG processing. These findings corroborate the view that the vulnerability of face perception to inversion stems mainly from the disrupted processing of vertical face relations in the right‐lateralized network of face‐preferring regions (rMFG, rIOG).     

Configural processing and face viewpoint

Configural/holistic processing, a key property of face recognition, has previously been examined only for front views of faces. Here, 6 experiments tested front (0 degrees ), three-quarter (45 degrees ), and profile views (90 degrees ), using composite and peripheral inversion tasks. Results showed an overall disadvantage in identifying profiles. This arose entirely from part-based processing: View effects were as strong for disrupted-configuration faces (inverted, misaligned, scrambled) as for normal-configuration faces. In contrast, configural processing (aligned-misaligned difference, upright-inverted difference) was equally strong for all views under both clear and degraded viewing conditions. Findings argue that, although part-based processing is weakened by lower natural frequency of the profile view and/or occlusion of key face features, neither of these variables influences configural processing. This suggests that the functional role of configural processing is to allow reliable face identification despite substantial variance in local information across different natural images. Results also show that only image-plane rotation of faces (upright through inverted) affects configural processing; the contrast with depth rotation has potential implications for understanding the origin of configural processing in terms of innate versus experience-based expertise contributions.     

THE INFLUENCE OF SEX OF SUBJECT AND PHOTO IN THE HEMISPHERIC SPECIALIZATION OF FACIAL RECOGNITION

This study was conducted to assess the effects of sex of subject, sex of photo, and hemispheric specialization on the ability of male (n = 21) and female (n = 21) subjects to recognize previously seen black and white male and female faces. Results indicated better performance with female faces and a significant interaction for sex of photo and laterality. Overall performance was best for female photos and worst for male photos in the LVF. A greater number of false alarms occurred in the LVF with male photos. The differential processing of distinctive cues of male and female faces by the LVF and RVF was discussed.     

Repetition priming for familiar and unfamiliar faces in a sex-judgment task: evidence for a common route for the processing of sex and identity

Repetition priming for faces was examined in a sex-judgment task given at test. Priming was found for edited, hair-removed photos of unfamiliar and familiar faces after a single presentation at study. Priming was also observed for the edited photos when study and test faces were different exemplars. Priming was not observed, however, when sex judgments were made at test to photos of complete, hair-included faces. These findings were interpreted by assuming that, for edited faces, internal features are attended, thereby activating face-recognition units that support performance. With complete faces, however, participants provided speeded judgments based primarily on the hairstyle. It is suggested that, for both familiar and unfamiliar faces, a common locus exists for the processing of the identity of a face and its sex. A single face-recognition model for the processing of familiar and unfamiliar faces is advocated.     

Beyond U-Shaped Development in Infants' Processing of Faces: An Information-Processing Account

The development of the "inversion" effect in face processing was examined in infants 3 to 6 months of age by testing their integration of the internal and external features of upright and inverted faces using a variation of the "switch" visual habituation paradigm. When combined with previous findings showing that 7-month-olds use integrative processing of an upright face, but featural processing of an inverted face (Cohen & Cashon, 2001a), the present findings suggest that from 3 to 7 months, infants' ability to integrate facial features follows an N-shaped developmental pattern for upright faces and an inverted U-shaped pattern for inverted faces. We discuss these results in terms of a set of domain-general information-processing principles.     

Gaze behavior in analytical and holistic face processing

We conducted two experiments examining children's and adults' gaze behavior when processing faces analytically (focusing on a single feature) or holistically (comparing the overall similarity of the faces). Children 6-8 and 9-10 years of age and adults were instructed to assign schematically drawn faces in Experiment 1 and photos of real faces in Experiment 2 to two categories. The categories were constructed so as to allow either an analytical or holistic categorization of the faces. During all trials, gaze behavior was recorded from stimulus onset until reaction. The location and duration of the fixations used were analyzed. Whereas the holistic processors fixated the whole area of the eyes and nose most and longest independently of age, analytical processors showed a more feature-specific gaze behavior, focusing their fixations upon the particular feature used for subsequent processing. Thus, differences in analytical and holistic face processing can be detected early in gaze behavior-that is, at the visual encoding stage.     

Attractiveness of own-race, other-race, and mixed-race faces

Averaged face composites, which represent the central tendency of a familiar population of faces, are attractive. If this prototypicality contributes to their appeal, then averaged composites should be more attractive when their component faces come from a familiar, own-race population than when they come from a less familiar, other-race population. We compared the attractiveness of own-race composites, other-race composites, and mixed-race composites (where the component faces were from both races). In experiment 1, Caucasian participants rated own-race composites as more attractive than other-race composites, but only for male faces. However, mixed-race (Caucasian/Japanese) composites were significantly more attractive than own-race composites, particularly for the opposite sex. In experiment 2, Caucasian and Japanese participants living in Australia and Japan, respectively, selected the most attractive face from a continuum with exaggerated Caucasian characteristics at one end and exaggerated Japanese characteristics at the other, with intervening images including a Caucasian averaged composite, a mixed-race averaged composite, and a Japanese averaged composite. The most attractive face was, again, a mixed-race composite, for both Caucasian and Japanese participants. In experiment 3, Caucasian participants rated individual Eurasian faces as significantly more attractive than either Caucasian or Asian faces. Similar results were obtained with composites. Eurasian faces and composites were also rated as healthier than Caucasian or Asian faces and composites, respectively. These results suggest that signs of health may be more important than prototypicality in making average faces attractive.     

Face processing in adolescents with autistic disorder: the inversion and composite effects

Two experiments with upright and inverted face and object images were carried out to investigate whether face processing in autism is more feature-based than in individuals with typical development. Participants were 17 high-ability adolescents with autistic disorder (16-24 years), 24 typically developing children (9-10 years) and 16 adults (18-33 years). In Experiment 1, a normal inversion effect was found for the adolescents with autism in a standard face recognition paradigm with reduced memory demands, except for a subgroup with low social intelligence who were not better in recognizing upright relative to inverted photographs of faces. In Experiment 2, the group with autism did not show the composite effect like the adult group did: they recognized face halves as well in aligned composite faces as in non-aligned composite faces. The results on the inversion task suggest that most adolescents with autism form a normal configuration-based face representation, but the absence of the composite effect indicates that they are less prone to use the contextual information of the face in a visual-search task.     

Does response interference contribute to face composite effects?

Holistic processing of faces can be measured as a failure of selective attention to one face-half under instructions to ignore the other face-half in a naming or same/different matching task. But is interference from the irrelevant half due to response interference rather than to holistic processing? Here, participants learned to name two faces “Fred” and two “Bob.” At test, composites were created from top and bottom halves of different learned faces or of a novel face, and composites were either aligned or misaligned. Naming was slower when the irrelevant half was from a different face as opposed to the same face, regardless of whether it was associated with the same name, a different name, or no name, suggesting holistic processing. Interference was eliminated when composite halves were misaligned. These results suggest that, unlike Stroop effects, composite effects are not due to response interference.     

The eyes or the mouth? Feature salience and unfamiliar face processing in Williams syndrome and autism

Using traditional face perception paradigms the current study explores unfamiliar face processing in two neurodevelopmental disorders. Previous research indicates that autism and Williams syndrome (WS) are both associated with atypical face processing strategies. The current research involves these groups in an exploration of feature salience for processing the eye and mouth regions of unfamiliar faces. The tasks specifically probe unfamiliar face matching by using (a) upper or lower face features, (b) the Thatcher illusion, and (c) featural and configural face modifications to the eye and mouth regions. Across tasks, individuals with WS mirror the typical pattern of performance, with greater accuracy for matching faces using the upper than using the lower features, susceptibility to the Thatcher illusion, and greater detection of eye than mouth modifications. Participants with autism show a generalized performance decrement alongside atypicalities, deficits for utilizing the eye region, and configural face cues to match unfamiliar faces. The results are discussed in terms of feature salience, structural encoding, and the phenotypes typically associated with these neurodevelopmental disorders.     

Holistic face processing among school children,younger and older adults

While previous studies have mostly examined holistic face processing in childhood and young adulthood, the present study investigated developmental changes of holistic face processing under a lifespan perspective, including older adulthood. Children 5–7 and 9–10 years of age, as well as young and older adults were instructed to assign faces into two categories. The categories were constructed to allow either a holistic categorization according to the overall face similarities or an analytical categorization by focusing on single facial features. The results show an increase in holistic face processing from childhood to young adulthood and a decrease towards older adulthood. Features used for categorization changed from internal to external features with age. Thus, crucial changes of face processing occur beyond young adulthood.