Effects of spatial frequency content on classification of face gender and expression

The role of different spatial frequency bands on face gender and expression categorization was studied in three experiments. Accuracy and reaction time were measured for unfiltered, low-pass (cut-off frequency of 1 cycle/deg) and high-pass (cutoff frequency of 3 cycles/deg) filtered faces. Filtered and unfiltered faces were equated in root-mean-squared contrast. For low-pass filtered faces reaction times were higher than unfiltered and high-pass filtered faces in both categorization tasks. In the expression task, these results were obtained with expressive faces presented in isolation (Experiment 1) and also with neutral-expressive dynamic sequences where each expressive face was preceded by a briefly presented neutral version of the same face (Experiment 2). For high-pass filtered faces different effects were observed on gender and expression categorization. While both speed and accuracy of gender categorization were reduced comparing to unfiltered faces, the efficiency of expression classification remained similar. Finally, we found no differences between expressive and non expressive faces in the effects of spatial frequency filtering on gender categorization (Experiment 3). These results show a common role of information from the high spatial frequency band in the categorization of face gender and expression.     

Face in profile view reduces perceived facial expression intensity: An eye-tracking study

Recent studies measuring the facial expressions of emotion have focused primarily on the perception of frontal face images. As we frequently encounter expressive faces from different viewing angles, having a mechanism which allows invariant expression perception would be advantageous to our social interactions. Although a couple of studies have indicated comparable expression categorization accuracy across viewpoints, it is unknown how perceived expression intensity and associated gaze behaviour change across viewing angles. Differences could arise because diagnostic cues from local facial features for decoding expressions could vary with viewpoints. Here we manipulated orientation of faces (frontal, mid-profile, and profile view) displaying six common facial expressions of emotion, and measured participants' expression categorization accuracy, perceived expression intensity and associated gaze patterns. In comparison with frontal faces, profile faces slightly reduced identification rates for disgust and sad expressions, but significantly decreased perceived intensity for all tested expressions. Although quantitatively viewpoint had expression-specific influence on the proportion of fixations directed at local facial features, the qualitative gaze distribution within facial features (e.g., the eyes tended to attract the highest proportion of fixations, followed by the nose and then the mouth region) was independent of viewpoint and expression type. Our results suggest that the viewpoint-invariant facial expression processing is categorical perception, which could be linked to a viewpoint-invariant holistic gaze strategy for extracting expressive facial cues.     

Janet Taylor Spence: Innovator in the Study of Gender

Janet Spence’s contributions moved gender researchers beyond a simple understanding of psychological gender in terms of individual differences in masculinity and femininity. In early work, she constructed the Personal Attributes Questionnaire, or PAQ, consisting of a masculine and a feminine scale, which she interpreted as assessing the core of psychological masculinity and femininity. Spence subsequently recognized that the masculine, or instrumental, scale reliably predicts only self-assertive, dominant behaviors and that the feminine, or expressive, scale reliably predicts only other-oriented, relational behaviors. Moreover, as her work developed, Spence came to understand this self-ascribed instrumentality and expressiveness, not as gender identity, but as two of the several types of psychological attributes that may become associated with individuals’ self-categorization as male or female. She then defined gender identity as the basic, existential sense of being male or female, which generally corresponds to one’s biological sex. Building on her ideas, we argue that gender identity instead encompasses both the sex categorization of oneself, usually as male or female, and self-assessments on gender-stereotypic instrumental and expressive attributes. These two levels of gender identity are linked by people’s self-stereotyping to the extent that they value their group membership as male or female.     

ERP evidence for task modulations on face perceptual processing at different spatial scales

Does the perceptual processing of faces flexibly adapt to the requirements of the categorization task at hand, or does it operate independently of this cognitive context? Behavioral studies have shown that the fine and coarse spatial scales of a face are differentially processed depending on the categorization task performed, thus suggesting that the latter can influence stimulus perception. Here, we investigated the time course of these task influences on perceptual processing by examining the visual N170 face‐sensitive Event‐Related Potential (ERP), while observers categorized faces for their gender and familiarity. Stimuli were full spectrum, or filtered versions that preserved either coarse or fine scale information of the faces. Behavioral results replicated previous findings of a differential processing of coarse and fine spatial scales across tasks. In addition, the N170 amplitude was larger in the Gender task as compared to the Familiarity task for LSF faces exclusively, thus showing that task demands differentially modulated the spatial scale processing on faces. These results suggest that the diagnosticity of scale‐specific cues in categorization tasks can modulate face processing.     

Show me the features! Understanding recognition from the use of visual information

We propose an approach that allows a rigorous understanding of the visual categorization and recognition process without asking direct questions about unobservable memory representations. Our approach builds on the selective use of visual information in recognition and a new method (Bubbles) to depict and measure what this information is. We examine three face–recognition tasks (identity, gender, expressive or not) and establish the componential and holistic information responsible for recognition performance. On the basis of this information, we derive task–specific gradients of probability for the allocation of attention to the different regions of the face.     

Attention to low- and high-spatial frequencies in categorizing facial identities, emotions and gender in children with autism

This study was aimed at investigating face categorization strategies in children with autistic spectrum disorders (ASD). Performance of 17 children with ASD was compared to that of 17 control children in a face-matching task, including hybrid faces (composed of two overlapping faces of different spatial bandwidths) and either low- or high-pass filtered faces. Participants were asked to match faces on the basis of identity, emotion or gender. Results revealed that children with ASD used the same strategies as controls when matching faces by gender. By contrast, in the identity and the emotion conditions, children with ASD showed a high-pass bias (i.e., preference for local information), contrary to controls. Consistent with previous studies on autism, these findings suggest that children with ASD do use atypical (local-oriented) strategies to process faces.     

Receptive fields for flexible face categorizations

Abstract-Examining the receptive fields of brain signals can elucidate how information impinging on the former modulates the latter. We applied this time-honored approach in early vision to the higher-level brain processes underlying face categorizations. Electroencephalograms in response to face-information samples were recorded while observers resolved two different categorizations (gender, expressive or not). Using a method with low bias and low variance, we compared, in a common space of information states, the information determining behavior (accuracy and reaction time) with the information that modulates emergent brain signals associated with early face encoding and later category decision. Our results provide a time line for face processing in which selective attention to diagnostic information for categorizing stimuli (the eyes and their second-order relationships in gender categorization; the mouth in expressive-or-not categorization) correlates with late electrophysiological (P300) activity, whereas early face-sensitive occipito-temporal (N170) activity is mainly driven by the contralateral eye, irrespective of the categorization task.     

Categorical and coordinate relations in faces, or Fechner's law and face space instead?

E. E. Cooper and T. J. Wojan (2000) applied the categorical-coordinate relations distinction to faces on the basis of a finding that two-eyes-up versus one-eye-up distortions had opposite effects in between-class (face normality) and within-class (face identity) tasks. However, Cooper and Wojan failed to match amount of metric change between their 2 deviation types and tested only 1 deviation level. In the present study, eyeheight was shifted (e.g., both eyes up or both eyes down vs. one eye up and one eye down) parametrically (11 levels) and normality and identity ratings obtained. There was no evidence of categorical changes in perception where these would have been predicted by Cooper and Wojan's theory. In all cases, the relationship between physical and perceived distortion followed Fechner's law. Differences across distortion types in Fechner threshold (the minimum deviation altering perceived normality or identity) are explained in terms of the variability associated with different dimensions in face space.     

Same-gender distractors are not so easy to reject: ERP evidence of gender categorization

Social categorization appears to be an automatic process that occurs during person perception. Understanding social categorization better is important because mere categorization can lead to stereotype activation and, in turn, to discrimination. In the present study we used a novel approach to examine event-related potentials (ERPs) of gender categorization in the “Who said what?” memory paradigm, thus allowing for a more in-depth understanding of the specific mechanisms underlying identity versus categorization processing. After observing video clips showing a “discussion” among female and male targets, participants were shown individual statements, each accompanied by one of the discussants’ faces. While we measured ERPs, participants had to decide whether or not a given statement had previously been made by the person with the accompanying face. In same-person trials, statements were paired with the correct person, whereas in the distractor trials, either a same-gender or a different-gender distractor was shown. As expected, participants were able to reject different-gender distractors faster than same-gender distractors, and they were more likely to falsely choose yes for a same-gender than for a different-gender distractor. Both findings indicate gender-based categorization. ERPs, analyzed in a 300- to 400-ms time window at occipito-temporal channels, indicated more negative amplitudes for yes responses both for the same person and for same-gender distractors, relative to different-gender distractors. Overall, these results show gender-based categorization even when the task was to assess the identifying information in a gender-neutral context. These findings are interpreted as showing that gender categorization occurs automatically during person perception, but later than race- or age-based categorization.     

Perceiving age and gender in unfamiliar faces: an fMRI study on face categorization

Efficient processing of unfamiliar faces typically involves their categorization (e.g., into old vs. young or male vs. female). However, age and gender categorization may pose different perceptual demands. In the present study, we employed functional magnetic resonance imaging (fMRI) to compare the activity evoked during age vs. gender categorization of unfamiliar faces. In different blocks, participants performed age and gender classifications for old or young unfamiliar faces (50% female respectively). Both tasks elicited activations in the bilateral fusiform gyri (fusiform face area, FFA) and bilateral inferior occipital gyri (occipital face area, OFA). Importantly, the same stimuli elicited enhanced activation during gender as compared to age categorization. This enhancement was significant in the right FFA and the left OFA, and may be related to increased configural processing. Our findings replicate and extend recent work, and shows that the activation of core components of the face processing network is strongly dependent on task demands.     

The biasing of figure-ground assignment by shading cues for objects and faces in prosopagnosia

Prosopagnosia is defined by impaired recognition of the identity of specific faces. Whether the perception of faces at the categorical level (recognizing that a face is a face) is also impaired to a lesser degree is unclear. We examined whether prosopagnosia is associated with impaired detection of facial contours in a bistable display, by testing a series of five prosopagnosic patients on a variation of Rubin's vase illusion, in which shading was introduced to bias perception towards either the face or the vase. We also included a control bistable display in which a disc or an aperture were the two possible percepts. With the control disc/aperture test, prosopagnosic patients did not generate a normal sigmoid function, but a U-shaped function, indicating that they perceived the shading but had difficulty in using the shading to make the appropriate figure-ground assignment. While controls still generated a sigmoid function for the vase/face test, prosopagnosic patients showed a severe impairment in using shading to make consistent perceptual assignments. We conclude that prosopagnosic patients have difficulty in using shading to segment figures from background correctly, particularly with complex stimuli like faces. This suggests that a subtler defect in face categorization accompanies their severe defect in face identification, consistent with predictions of computational models and recent data from functional imaging.     

When a face type is perceived as threatening: Using general recognition theory to understand biased categorization of Afrocentric faces

Prior research indicates that stereotypical Black faces (e.g., wide nose, full lips: Afrocentric) are often associated with crime and violence. The current study investigated whether stereotypical faces may bias the interpretation of facial expression to seem threatening. Stimuli were prerated by face type (stereotypical, nonstereotypical) and expression (neutral, threatening). Later in a forced-choice task, different participants categorized face stimuli as stereotypical or not and threatening or not. Regardless of prerated expression, stereotypical faces were judged as more threatening than were nonstereotypical faces. These findings were supported using computational models based on general recognition theory (GRT), indicating that decision boundaries were more biased toward the threatening response for stereotypical faces than for nonstereotypical faces. GRT analysis also indicated that perception of face stereotypicality and emotional expression are dependent, both across categories and within individual categories. Higher perceived stereotypicality predicts higher perception of threat, and, conversely, higher ratings of threat predict higher perception of stereotypicality. Implications for racial face-type bias influencing perception and decision-making in a variety of social and professional contexts are discussed.     

The flip side of the other‐race coin: They all look different to me

Poorer recognition of other‐race faces than own‐races faces has been attributed to a problem of discrimination (i.e., telling faces apart). The conclusion that ‘they all look the same to me' is based on studies measuring the perception/memory of highly controlled stimuli, typically involving only one or two images of each identity. We hypothesized that such studies underestimate the challenge involved in recognizing other‐race faces because in the real world, an individual's appearance varies in a number of ways (e.g., lighting, expression, hairstyle), reducing the utility of relying on pictorial cues to identity. In two experiments, Caucasian and East Asian participants completed a perceptual sorting task in which they were asked to sort 40 photographs of two unfamiliar identities into piles such that each pile contained all photographs of a single identity. Participants perceived more identities when sorting other‐race faces than own‐race faces, both when sorting celebrity (Experiment 1) and non‐celebrity (Experiment 2) faces, suggesting that in the real world, ‘they all look different to me'. We discuss these results in the light of models in which each identity is represented as a region in a multidimensional face space; we argue that this region is smaller for other‐race than own‐race faces.     

Usage of spatial scales for the categorization of faces, objects, and scenes

The role of spatial scales (or spatial frequencies) in the processing of faces, objects, and scenes has recently seen a surge of research activity. In this review, we will critically examine two main theories of scale usage. The fixed theory proposes that spatial scales are used in a fixed, perceptually determined order (coarse to fine). The flexible theory suggests instead that usage of spatial scales is flexible, depending on the requirements of visual information for the categorization task at hand. The implications of the theories are examined for face, object, and scene categorization, attention, perception, and representation.     

Configural coding of facial expressions: The impact of inversion and photographic negative

In previous research we used the composite paradigm (Young, Hellawell, & Hay, ) to demonstrate that configural cues are important for interpreting facial expressions. However, different configural cues in face perception have been identified, including holistic processing (i.e., perception of facial features as a single gestalt) and second‐order spatial relations (i.e., the spatial relationship between individual features). Previous research has suggested that the composite effect for facial identity operates at the level of holistic encoding. Here we show that the composite effect for facial expression has a similar perceptual basis by using different graphic manipulations (stimulus inversion and photographic negative) in conjunction with the composite paradigm. In relation to Bruce and Young's () functional model of face recognition, a suitable level for the composite effect is a stage of front‐end processing referred to as structural encoding, that is common to both facial identity and facial expression perception.     

Holistic processing underlies gender judgments of faces

In three experiments, we investigated whether holistic processing underlies gender judgments about faces. Chinese participants were asked to make gender judgments for inverted, scrambled, or composite faces. Results showed that judgments were dramatically impaired by these manipulations (as compared with performance for normal upright faces), demonstrating three hallmark effects of holistic face processing that have been observed in perception of face identity. Whether the test faces were Chinese or Caucasian showed no effect on holistic processing of gender perception, in contrast to studies of identity analysis. These results suggest that holistic processing is a general mechanism for different aspects of face perception and are consistent with the idea that physiognomic properties that determine the gender of a face are universal, rather than race specific.     

Audiovisual identity perception from naturally-varying stimuli is driven by visual information

Identity perception often takes place in multimodal settings, where perceivers have access to both visual (face) and auditory (voice) information. Despite this, identity perception is usually studied in unimodal contexts, where face and voice identity perception are modelled independently from one another. In this study, we asked whether and how much auditory and visual information contribute to audiovisual identity perception from naturally-varying stimuli. In a between-subjects design, participants completed an identity sorting task with either dynamic video-only, audio-only or dynamic audiovisual stimuli. In this task, participants were asked to sort multiple, naturally-varying stimuli from three different people by perceived identity. We found that identity perception was more accurate for video-only and audiovisual stimuli compared with audio-only stimuli. Interestingly, there was no difference in accuracy between video-only and audiovisual stimuli. Auditory information nonetheless played a role alongside visual information as audiovisual identity judgements per stimulus could be predicted from both auditory and visual identity judgements, respectively. While the relationship was stronger for visual information and audiovisual information, auditory information still uniquely explained a significant portion of the variance in audiovisual identity judgements. Our findings thus align with previous theoretical and empirical work that proposes that, compared with faces, voices are an important but relatively less salient and a weaker cue to identity perception. We expand on this work to show that, at least in the context of this study, having access to voices in addition to faces does not result in better identity perception accuracy.     

Negational categorization and intergroup behavior

Individuals define themselves, at times, as who they are (e.g., a psychologist) and, at other times, as who they are not (e.g., not an economist). Drawing on social identity, optimal distinctiveness, and balance theories, four studies examined the nature of negational identity relative to affirmational identity. One study explored the conditions that increase negational identification and found that activating the need for distinctiveness increased the accessibility of negational identities. Three additional studies revealed that negational categorization increased outgroup derogation relative to affirmational categorization and the authors argue that this effect is at least partially due to a focus on contrasting the self from the outgroup under negational categorization. Consistent with this argument, outgroup derogation following negational categorization was mitigated when connections to similar others were highlighted. By distinguishing negational identity from affirmational identity, a more complete picture of collective identity and intergroup behavior can start to emerge.     

Perception and imagery of faces generate similar gender aftereffects

Visual adaptation is known to bias perception away from the properties of the adapting stimuli, toward opposite properties, resulting in perceptual aftereffects. For example, prolonged exposure to a face has been shown to produce an identity aftereffect, biasing perception of a subsequent face toward the opposite identity. Such repulsive aftereffects have been observed for both visually perceived and visually imagined faces, suggesting that both perception and imagery yield typical aftereffects. However, recent studies have reported opposite patterns of aftereffects for perception and imagery of face gender. In these studies, visually perceived faces produced typical effects in which perception of androgynous faces was biased away from the gender of the adaptor, whereas imagery of the same stimuli produced atypical aftereffects, biasing the perceived gender of androgynous faces toward the gender of the adaptor. These findings are highly unusual and warrant further research. The present study aimed to gather new evidence on the direction of gender aftereffects following perception and imagery of faces. Experiment 1 had participants view and imagine female and male faces of famous and non-famous individuals. To determine the effect of concomitant visual stimulation on imagery and adaptation, participants visualized faces both in the presence and in the absence of a visual input. In Experiment 2, participants were adapted to perceived and imagined faces of famous and non-famous actors matched on gender typicality. This manipulation allowed us to determine the effect of face familiarity on the magnitude of gender aftereffects. Contrary to evidence from previous studies, our results demonstrated that both perception and imagery produced typical aftereffects, biasing the perceived gender of androgynous faces in the opposite direction to the gender of the adaptor. Famous faces yielded largest adaptation effects across tasks. Experiment 2 confirmed that these effects depended on familiarity rather than on sexual dimorphism. In both experiments, this effect was greater for perception than imagery. Additionally, imagery of famous faces produced strongest aftereffects when it was performed in the absence of visual stimulation. The implications of these findings are discussed.