Categorising intersectional targets: An “either/and” approach to race- and gender-emotion congruity

Research on the interaction of emotional expressions with social category cues in face processing has focused on whether specific emotions are associated with single-category identities, thus overlooking the influence of intersectional identities. Instead, we examined how quickly people categorise intersectional targets by their race, gender, or emotional expression. In Experiment 1, participants categorised Black and White faces displaying angry, happy, or neutral expressions by either race or gender. Emotion influenced responses to men versus women only when gender was made salient by the task. Similarly, emotion influenced responses to Black versus White targets only when participants categorised by race. In Experiment 2, participants categorised faces by emotion so that neither category was more salient. As predicted, responses to Black women differed from those to both Black men and White women. Thus, examining race and gender separately is insufficient to understanding how emotion and social category cues are processed.     

The processing of invariant and variant face cues in the Garner Paradigm

Faces provide a complex source of information via invariant (e.g., race, sex and age) and variant (e.g., emotional expressions) cues. At present, it is not clear whether these different cues are processed separately or whether they interact. Using the Garner Paradigm, Experiment 1 confirmed that race, sex, and age cues affected the categorization of faces according to emotional expression whereas emotional expression had no effect on the categorization of faces by sex, age, or race. Experiment 2 used inverted faces and replicated this pattern of asymmetrical interference for race and age cues, but not for sex cues for which no interference on emotional expression categorization was observed. Experiment 3 confirmed this finding with a more stringently matched set of facial stimuli. Overall, this study shows that invariant cues interfere with the processing of emotional expressions. It indicates that the processing of invariant cues, but not of emotional expressions, is obligatory and that it precedes that of emotional expressions.     

A perceptual interference account of acquisition difficulties for non-native phonemes

This article presents an account of how early language experience can impede the acquisition of non-native phonemes during adulthood. The hypothesis is that early language experience alters relatively low-level perceptual processing, and that these changes interfere with the formation and adaptability of higher-level linguistic representations. Supporting data are presented from an experiment that tested the perception of English /r/ and /l/ by Japanese, German, and American adults. The underlying perceptual spaces for these phonemes were mapped using multidimensional scaling and compared to native-language categorization judgments. The results demonstrate that Japanese adults are most sensitive to an acoustic cue, F2, that is irrelevant to the English /r/-/l/ categorization. German adults, in contrast, have relatively high sensitivity to more critical acoustic cues. The results show how language-specific perceptual processing can alter the relative salience of within- and between-category acoustic variation, and thereby interfere with second language acquisition.     

The development of race‐based perceptual categorization: skin color dominates early category judgments

Prior research on the development of race‐based categorization has concluded that children understand the perceptual basis of race categories from as early as age 4 (e.g. Aboud, 1988). However, such work has rarely separated the influence of skin color from other physiognomic features considered by adults to be diagnostic of race categories. In two studies focusing on Black–White race categorization judgments in children between the ages of 4 and 9, as well as in adults, we find that categorization decisions in early childhood are determined almost entirely by attention to skin color, with attention to other physiognomic features exerting only a small influence on judgments as late as middle childhood. We further find that when skin color cues are largely eliminated from the stimuli, adults readily shift almost entirely to focus on other physiognomic features. However, 6‐ and 8‐year‐old children show only a limited ability to shift attention to facial physiognomy and so perform poorly on the task. These results demonstrate that attention to ‘race’ in younger children is better conceptualized as attention to skin color, inviting a reinterpretation of past work focusing on children's race‐related cognition.     

Emergent Research in Social Vision: An Integrated Approach to the Determinants and Consequences of Social Categorization

Social categorization research has historically focused either on understanding how observers utilize visual cues in the face and body to make judgments of others or on understanding the downstream consequences that occur following social categorizations, but rarely both. Recently, however, research has evidenced a marked shift toward an integrated approach. Here, we provide a snapshot of social vision's contributions to the study of social categorization with a goal of illuminating the new and exciting directions afforded by an integrative approach. From this perspective, social categorizations are characterized not only as being informed by visual cues but also as being malleable, probabilistic, and contextualized. Moreover, the process of categorization itself can affect evaluative outcomes directly, independent of categorization. By exploring empirical evidence for this integrated approach to the determinants and consequences of social categorization, we show how the emerging field of social vision has revealed new insights into the nature of social categorization and by extension its implications for evaluations.     

Judging trustworthiness from faces: Emotion cues modulate trustworthiness judgments in young children

By adulthood, people judge trustworthiness from appearances rapidly and reliably. However, we know little about these judgments in children. This novel study investigates the developmental trajectory of explicit trust judgments from faces, and the contribution made by emotion cues across age groups. Five‐, 7‐, 10‐year‐olds, and adults rated the trustworthiness of trustworthy and untrustworthy faces with neutral expressions. The same participants also rated faces displaying overt happy and angry expressions, allowing us to investigate whether emotion cues modulate trustworthiness judgments similarly in children and adults. Results revealed that the ability to evaluate the trustworthiness of faces emerges in childhood, but may not be adult like until 10 years of age. Moreover, we show that emotion cues modulate trust judgments in young children, as well as adults. Anger cues diminished the appearance of trustworthiness for participants from 5 years of age and happy cues increased it, although this effect did not consistently emerge until later in childhood, that is, 10 years of age. These associations also extended to more subtle emotion cues present in neutral faces. Our results indicate that young children are sensitive to facial trustworthiness, and suggest that similar expression cues modulate these judgments in children and adults.     

Look Black in anger: The role of implicit prejudice in the categorization and perceived emotional intensity of racially ambiguous faces

Research has demonstrated that individuals high in implicit prejudice are more likely to classify a racially ambiguous angry face as Black compared to individuals low in implicit prejudice [Hugenberg, K., & Bodenhausen, G. V. (2004). Ambiguity in social categorization. Psychological Science, 15, 342-345]. The current study sought to replicate and extend this finding by examining whether the same expression of anger on a racially ambiguous face is perceived to be differentially intense when the face is judged to be Black or White. White participants viewed racially ambiguous, White, and Black faces displaying angry, neutral, or happy emotions. Participants’ task was to identify the race, emotion, and intensity of emotion display. The results revealed that participants high in implicit prejudice reported significantly more of the racially ambiguous angry faces as Black compared to participants low in implicit prejudice. Further, participants high in implicit prejudice reported the intensity of the racially ambiguous angry emotion as greater when the same face had been categorized as Black compared to White. The results suggest that implicit prejudice is not only associated with the racial categorization of an ambiguous face but also the perceived intensity of the emotion displayed.     

Continuous dynamics in the real-time perception of race

Although the outcomes of race categorization have been studied in detail, the temporal dynamics of real-time processing of race remain elusive. We measured participants’ hand movements en route to one of two race-category alternatives by recording the streaming x, y coordinates of the computer mouse. Study 1 showed that, when categorizing White and Black computer-generated faces that featurally overlapped with the opposite race, mouse trajectories showed a continuous spatial attraction toward the opposite category. Moreover, these race-atypical White and Black targets induced spatial attraction effects that had different temporal signatures. Study 2 showed that, when categorizing real faces that varied along a continuum of racial ambiguity, graded increases in ambiguity led to corresponding increases in trajectories’ attraction to the opposite category and trajectories’ movement complexity. These studies provide evidence for temporally dynamic competition across perceptions of race, where simultaneously and partially-active race categories continuously evolve into single categorical outcomes over time. Moreover, the findings show how different social category cues may exert different dynamic patterns of influence over the real-time processing that culminates in categorizations of others.     

社会分类的概念、线索及影响机制

作为社会认知的基本过程和重要途径,社会分类对预测刻板印象和群际感知、减少多元文化群体中的关系冲突、促进推理与决策以及指导社会关系推断等都有重要作用。人们进行社会分类的线索可以概括为明显线索和模糊线索、自然线索和社会线索以及静态线索和动态线索。社会分类会受到分类对象、情境和感知者等的作用,同时对人们认知、情绪、情感和行为等产生一系列影响。未来可以基于跨文化和发展视角探讨社会分类的线索偏向、潜在机制及立足本土文化检验社会分类的影响及干预策略。     

Perceptual Fluency and Judgments of Vocal Aesthetics and Stereotypicality

Research has shown that processing dynamics on the perceiver's end determine aesthetic pleasure. Specifically, typical objects, which are processed more fluently, are perceived as more attractive. We extend this notion of perceptual fluency to judgments of vocal aesthetics. Vocal attractiveness has traditionally been examined with respect to sexual dimorphism and the apparent size of a talker, as reconstructed from the acoustic signal, despite evidence that gender‐specific speech patterns are learned social behaviors. In this study, we report on a series of three experiments using 60 voices (30 females) to compare the relationship between judgments of vocal attractiveness, stereotypicality, and gender categorization fluency. Our results indicate that attractiveness and stereotypicality are highly correlated for female and male voices. Stereotypicality and categorization fluency were also correlated for male voices, but not female voices. Crucially, stereotypicality and categorization fluency interacted to predict attractiveness, suggesting the role of perceptual fluency is present, but nuanced, in judgments of human voices.     

Individual Differences in Categorization Gradience As Predicted by Online Processing of Phonetic Cues During Spoken Word Recognition: Evidence From Eye Movements

Recent studies have documented substantial variability among typical listeners in how gradiently they categorize speech sounds, and this variability in categorization gradience may link to how listeners weight different cues in the incoming signal. The present study tested the relationship between categorization gradience and cue weighting across two sets of English contrasts, each varying orthogonally in two acoustic dimensions. Participants performed a four-alternative forced-choice identification task in a visual world paradigm while their eye movements were monitored. We found that (a) greater categorization gradience derived from behavioral identification responses corresponds to larger secondary cue weights derived from eye movements; (b) the relationship between categorization gradience and secondary cue weighting is observed across cues and contrasts, suggesting that categorization gradience may be a consistent within-individual property in speech perception; and (c) listeners who showed greater categorization gradience tend to adopt a buffered processing strategy, especially when cues arrive asynchronously in time.     

Face aftereffects suggest interdependent processing of expression and sex and of expression and race

Bruce and Young (1986) proposed that functionally different aspects of faces (e.g., sex, identity, and expression) are processed independently. Although interdependent processing of identity and expression and of identity and sex have been demonstrated previously, evidence for interdependent processing of sex and expression is equivocal. Using a visual adaptation paradigm, we show that expression aftereffects can be simultaneously induced in different directions along anger–fear continua for male and female faces (Experiment 1) and for East Asian and Black African faces (Experiment 2). These findings for sex- and race-contingent expression aftereffects suggest that processing of expression is interdependent with processing of sex and race and are therefore problematic for models of face perception that have emphasized independent processing of functionally different aspects of faces. By contrast, our findings are consistent with models of face processing that propose that invariant physical aspects of faces and changeable social cues can be processed interdependently.     

He throws like a girl (but only when he's sad): emotion affects sex-decoding of biological motion displays

Gender stereotypes have been implicated in sex-typed perceptions of facial emotion. Such interpretations were recently called into question because facial cues of emotion are confounded with sexually dimorphic facial cues. Here we examine the role of visual cues and gender stereotypes in perceptions of biological motion displays, thus overcoming the morphological confounding inherent in facial displays. In four studies, participants’ judgments revealed gender stereotyping. Observers accurately perceived emotion from biological motion displays (Study 1), and this affected sex categorizations. Angry displays were overwhelmingly judged to be men; sad displays were judged to be women (Studies 2–4). Moreover, this pattern remained strong when stimuli were equated for velocity (Study 3). We argue that these results were obtained because perceivers applied gender stereotypes of emotion to infer sex category (Study 4). Implications for both vision sciences and social psychology are discussed.     

Monolingual but not bilingual infants demonstrate racial bias in social cue use

Bilingualism exerts early and pervasive effects on cognition, observable in infancy. Thus far, investigations of infant bilingual cognition have focused on sensitivity to visual memory, executive function, and linguistic sensitivity. Much less research has focused on how bilingualism impacts processing of social cues. The present study sought to investigate whether bilingualism modulates the expression of one aspect of social processing: early racial bias. Using a gaze‐following paradigm, we investigated whether 18‐ to 20‐month‐old monolingual and bilingual infants favored their own race. Results demonstrated that monolingual infants favored their own race in following a model whose direction of gaze signaled an event. In contrast, bilingual infants demonstrated race‐neutral gaze‐following patterns, relying more heavily on the reliability of the behavior of the model over race. Findings suggest that bilingualism may have protective effects against the early emergence of racial bias.     

Social Categorization and Stereotyping In vivo: The VUCA Challenge

A substantial literature has examined the nature of social categorization, a fundamental process having important implications for a wide variety of social phenomena. The great majority of this research has focused on the role of particular, clearly identified social categories (e.g. race, nationality, etc.) while ignoring or holding constant other identity dimensions. This approach has afforded considerable leverage for understanding how salient social identities influence perception, judgment, and behavior. However, it leaves unaddressed many questions about how particular social identities become salient and how (and whether) identities might be inferred when category membership is ambiguous or unknown. Everyday social perception often occurs under conditions of volatility (dynamic contexts), uncertainty (missing information), complexity (multiple bases for categorization), and ambiguity (unclear meaning of available cues). As a consequence, research must address how these factors might qualify basic processes of social categorization. Available evidence is reviewed, and directions for future research are discussed.     

Garner interference reveals dependencies between emotional expression and gaze in face perception

The relationship between facial expression and gaze processing was investigated with the Garner selective attention paradigm. In Experiment 1, participants performed expression judgments without interference from gaze, but expression interfered with gaze judgments. Experiment 2 replicated these results across different emotions. In both experiments, expression judgments occurred faster than gaze judgments, suggesting that expression was processed before gaze could interfere. In Experiments 3 and 4, the difficulty of the emotion discrimination was increased in two different ways. In both cases, gaze interfered with emotion judgments and vice versa. Furthermore, increasing the difficulty of the emotion discrimination resulted in gaze and expression interactions. Results indicate that expression and gaze interactions are modulated by discriminability. Whereas expression generally interferes with gaze judgments, gaze direction modulates expression processing only when facial emotion is difficult to discriminate.     

Body posture and gender impact neural processing of power-related words

Judging others’ power facilitates successful social interaction. Both gender and body posture have been shown to influence judgments of another’s power. However, little is known about how these two cues interact when they conflict or how they influence early processing. The present study investigated this question during very early processing of power-related words using event-related potentials (ERPs). Participants viewed images of women and men in dominant and submissive postures that were quickly followed by dominant or submissive words. Gender and posture both modulated neural responses in the N2 latency range to dominant words, but for submissive words they had little impact. Thus, in the context of dual-processing theories of person perception, information extracted from both behavior (i.e., posture) and from category membership (i.e., gender) are recruited side-by-side to impact word processing.     

眼睛注视的知觉及其线索效应

对眼睛注视知觉、眼睛注视线索效应及其影响因素等相关研究进行了总结和分析。结果发现:(1)婴儿从一出生就对眼睛注视线索表现出强烈的敏感性,眼睛注视知觉对语言和社会等能力的发展有很大影响;(2)颞上沟是加工眼睛注视线索的特异神经结构,它与实时监控情绪和情感的杏仁核存在神经联结,成为社会认知神经系统的重要组成部分;(3)对眼睛注视线索的早期加工显示出特异的脑电活动模式;(4)眼睛注视线索效应与外周线索的反射式效应相类似,但持续时间较长;(5)眼睛注视线索效应不仅受面部结构信息的影响,也受自上而下加工等高水平认知因素的调节,并显示出明显的个体差异。对眼睛注视线索效应的进一步研究应涉及人格判断、喜好评价和心理理论等高级社会认知活动。     

Facial age cues and emotional expression interact asymmetrically: age cues moderate emotion categorisation

Facial attributes such as race, sex, and age can interact with emotional expressions; however, only a couple of studies have investigated the nature of the interaction between facial age cues and emotional expressions and these have produced inconsistent results. Additionally, these studies have not addressed the mechanism/s driving the influence of facial age cues on emotional expression or vice versa. In the current study, participants categorised young and older adult faces expressing happiness and anger (Experiment 1) or sadness (Experiment 2) by their age and their emotional expression. Age cues moderated categorisation of happiness vs. anger and sadness in the absence of an influence of emotional expression on age categorisation times. This asymmetrical interaction suggests that facial age cues are obligatorily processed prior to emotional expressions. Finding a categorisation advantage for happiness expressed on young faces relative to both anger and sadness which are negative in valence but different in their congruence with old age stereotypes or structural overlap with age cues suggests that the observed influence of facial age cues on emotion perception is due to the congruence between relatively positive evaluations of young faces and happy expressions.     

When two become one: Temporally dynamic integration of the face and voice

In everyday interactions with others, people have to deal with the sight of a face and sound of a voice at the same time. How the perceptual system brings this information together over hundreds of milliseconds to perceive others remains unclear. In 2 studies, we investigated how facial and vocal cues are integrated during real-time social categorization by recording participants' hand movements (via the streaming x, y coordinates of the computer mouse) en route to “male” and “female” responses on the screen. Participants were presented with male and female faces that were accompanied by a same-sex voice morphed to be either sex-typical (e.g., masculinized male voice) or sex-atypical (i.e., feminized male voice). Before settling into ultimate sex categorizations of the face, the simultaneous processing of a sex-atypical voice led the hand to be continuously attracted to the opposite sex-category response across construal. This is evidence that ongoing results from voice perception continuously influence face perception across processing. Thus, social categorization involves dynamic updates of gradual integration of the face and voice.