Inferring social attributes from different face regions: Evidence for holistic processing

Two experiments investigated the role that different face regions play in a variety of social judgements that are commonly made from facial appearance (sex, age, distinctiveness, attractiveness, approachability, trustworthiness, and intelligence). These judgements lie along a continuum from those with a clear physical basis and high consequent accuracy (sex, age) to judgements that can achieve a degree of consensus between observers despite having little known validity (intelligence, trustworthiness). Results from Experiment 1 indicated that the face's internal features (eyes, nose, and mouth) provide information that is more useful for social inferences than the external features (hair, face shape, ears, and chin), especially when judging traits such as approachability and trustworthiness. Experiment 2 investigated how judgement agreement was affected when the upper head, eye, nose, or mouth regions were presented in isolation or when these regions were obscured. A different pattern of results emerged for different characteristics, indicating that different types of facial information are used in the various judgements. Moreover, the informativeness of a particular region/feature depends on whether it is presented alone or in the context of the whole face. These findings provide evidence for the importance of holistic processing in making social attributions from facial appearance.     

Inferring social attributes from different face regions: evidence for holistic processing

Two experiments investigated the role that different face regions play in a variety of social judgements that are commonly made from facial appearance (sex, age, distinctiveness, attractiveness, approachability, trustworthiness, and intelligence). These judgements lie along a continuum from those with a clear physical basis and high consequent accuracy (sex, age) to judgements that can achieve a degree of consensus between observers despite having little known validity (intelligence, trustworthiness). Results from Experiment 1 indicated that the face's internal features (eyes, nose, and mouth) provide information that is more useful for social inferences than the external features (hair, face shape, ears, and chin), especially when judging traits such as approachability and trustworthiness. Experiment 2 investigated how judgement agreement was affected when the upper head, eye, nose, or mouth regions were presented in isolation or when these regions were obscured. A different pattern of results emerged for different characteristics, indicating that different types of facial information are used in the various judgements. Moreover, the informativeness of a particular region/feature depends on whether it is presented alone or in the context of the whole face. These findings provide evidence for the importance of holistic processing in making social attributions from facial appearance.     

面孔吸引力的整体表征及其动态性增强

面孔作为一种高级的视觉刺激,在人际交往中有着无可替代的作用。其中,面孔吸引力更是影响着日常生活的重要社交决策,如择偶、交友、求职、社会交换等。长久以来,研究者们从面孔特征、社会信息和观察者因素等角度不断探索着人们对静态面孔吸引力的感知,且多从进化角度加以解释。但是,人们如何表征面孔吸引力以及其动态性增强机制仍未可知。本项目通过两个研究,分别从面孔吸引力的整体表征,以及面孔动态性通过影响整体加工、影响对整体信息和特征信息的注意、以及影响社会信息来增强吸引力,从这两个角度尝试回答这一问题。在研究1中,本项目从整体加工的角度探索了面孔吸引力的认知表征。研究1.1通过评分任务和适应范式探索高空间频率（更多局部特征）和低空间频率（更多整体特征）对面孔吸引力的影响,旨在从空间频率探讨面孔吸引力的整体表征。研究1.2通过操纵面孔对称性和面孔常态性探索面孔常态性在面孔对称性和面孔吸引力间的中介作用,探讨面孔吸引力的常态构型表征。研究1.3引入“三庭五眼”这一中国传统面孔审美理论,通过评分任务和适应范式研究“三庭五眼” 构型是否符合中国人对高吸引力中国面孔的表征,以此探讨面孔吸引力的整体表征。研究1.4通过评分任务和适应范式考察局部面孔遮挡是否促进整体面孔吸引力,以及这种促进作用是否由于人们通过局部特征“脑补”出了完整面孔。研究2从整体加工、注意和生命力的角度探讨面孔吸引力的动态性增强机制。研究2.1使用合成效应范式测量动态面孔吸引力的整体加工,探索动静态面孔的吸引力差异是否源于其整体加工程度的不同。研究2.2使用注意分散范式,并结合眼动技术,探讨人们对动静态面孔的注视模式是否存在差异,这种差异是否能解释动态面孔吸引力的增强。研究2.3结合问卷法、实验法和结构方程模型,考察了生命力这一社会因素对动静态面孔吸引力的影响。本项目探讨了面孔吸引力的认知表征以及其动态性增强机制,有助于我们进一步理解人们对面孔吸引力的认知加工以及人类欣赏美这一高级智能。同时,本项目的结果对于日常人际交往和面孔吸引力相关算法的优化等方面也有潜在的应用价值。     

Exploring the perception of social characteristics in faces using the isolation effect

The age, sex, and distinctiveness of faces can be judged from objective and partially independent facial features. In contrast, the physical basis of other social judgements, such as attractiveness, intelligence, and trustworthiness is not as yet entirely understood, despite the consistency of these judgements from faces. The present set of experiments investigated the perception of social characteristics in faces, using an adaptation of the von Restorff/isolation paradigm to determine which social characteristics are spontaneously encoded from the face. The isolation effect involves enhanced memory for perceptually salient items in a list (items that are isolated in the sense that they are in numeric minority) and our results suggested that its locus is at the encoding stage of the recognition memory experiment. Isolation in the present experiments was achieved by manipulating the number of faces included in the sets on the basis of certain characteristics. Because the manipulation of the characteristics of faces in a set to be learnt was not mentioned in most of the experiments, any resulting memory increment for the isolated items could be taken as an index of spontaneous processing of the manipulated social characteristic. Age and sex were found to be spontaneously encoded from faces. Results for other characteristics were mixed, ranging from distinctiveness and attractiveness, for which there was some indication of spontaneous processing, to intelligence and trustworthiness, which did not seem to be spontaneously encoded from faces. For intelligence, an isolation effect was found only when the experiment required a judgement that led to activation of the appropriate stereotype.     

The dissociable influence of social context on judgements of facial attractiveness and trustworthiness

The cheerleader effect occurs when the same face is rated to be more attractive when it is seen in a group compared to when seen alone. We investigated whether this phenomenon also occurs for trustworthiness judgements, and examined how these effects are influenced by the characteristics of the individual being evaluated and those of the group they are seen in. Across three experiments, we reliably replicated the cheerleader effect. Most faces became more attractive in a group. Yet, the size of the cheerleader effect that each face experienced was not related to its own attractiveness, nor to the attractiveness of the group or the group’s digitally averaged face. We discuss the implications of our findings for the hierarchical encoding and contrast mechanisms that have previously been used to explain the cheerleader effect. Surprisingly, judgements of facial trustworthiness did not experience a ‘cheerleader effect’. Instead, we found that untrustworthy faces became significantly more trustworthy in all groups, while there was no change for faces that were already trustworthy alone. Taken together, our results demonstrate that social context can have a dissociable influence on our first impressions, depending on the trait being evaluated.     

Effects of inversion and negation on social inferences from faces

Judgments about personality and other social characteristics based on facial appearance are remarkably consistent across individuals. However, whereas the facial cues that underpin age and sex judgments are already well understood, the physical bases for judgments of characteristics such as intelligence or trustworthiness are still unknown. Inversion and photographic negation are used here to investigate the visual processes underlying social inferences from the face and to explore whether various judgments might rely on different perceptual representations. In experiment 1, the perceptions of age, sex, attractiveness, approachability, intelligence, and trustworthiness, but not distinctiveness, were affected by inversion, and all these characteristics were affected by negation. The effects of inversion and negation were independent, suggesting that they impaired the encoding of different types of information. Moreover, an independent manipulation of hue and luminance in experiment 2 showed that the effects of negation were mainly due to the reversal of luminance values. These results are consistent with the view that information about the configuration of features (the processing of which is impaired by inversion) and information about surface properties (the processing of which is impaired by brightness negation) are both used in the perception of social characteristics from faces. In addition, the fact that there was a similar pattern of impairment across most judgments suggests that there is an initial common perceptual representation of the face, from which most characteristics are inferred.     

男性化与女性化对面孔偏好的影响—— 基于图像处理技术和眼动的检验

采用图像处理技术和眼动探讨了性别二态线索对面孔偏好的影响。实验1发现非面孔线索未掩蔽和掩蔽时, 感知男性化技术与原始照片条件下女性化的男性面孔更有吸引力和信任度; 性别二态技术条件下, 非面孔线索未掩蔽时男性化的男性面孔更有吸引力和信任度。实验2表明被试对男性面孔的平均瞳孔大小和注视次数均大于和多于女性面孔, 首次注视时间短于女性面孔; 被试对男性化面孔的首次注视时间和首次注视持续时间均长于女性化面孔。     

Facial attractiveness impressions precede trustworthiness inferences: lower detection thresholds and faster decision latencies

Prior research has found a relationship between perceived facial attractiveness and perceived personal trustworthiness. We examined the time course of attractiveness relative to trustworthiness evaluation of emotional and neutral faces. This served to explore whether attractiveness might be used as an easily accessible cue and a quick shortcut for judging trustworthiness. Detection thresholds and judgment latencies as a function of expressive intensity were measured. Significant correlations between attractiveness and trustworthiness consistently held for six emotional expressions at four intensities, and neutral faces. Importantly, perceived attractiveness preceded perceived trustworthiness, with lower detection thresholds and shorter decision latencies. This reveals a time course advantage for attractiveness, and suggests that earlier attractiveness impressions could bias trustworthiness inferences. A heuristic cognitive mechanism is hypothesised to ease processing demands by relying on simple and observable clues (attractiveness) as a substitute for more complex and not easily accessible information (trustworthiness).     

A dual-process account of female facial attractiveness preferences: Sexual and nonsexual routes

The current study conceptualizes facial attractiveness as a dual-process judgment, combining sexual and aesthetic value. We hypothesized that holistic face processing is more integral to perceiving aesthetic preference and feature-based processing is more integral to sexual preference. In order to manipulate holistic versus feature-based processing, we used a variation of the composite face paradigm. Previous work indicates that slightly shifting the top from the bottom half of a face disrupts holistic processing and enhances feature-based processing. In the present study, while nonsexual judgments best explained facial attraction in whole-face images, a reversal occurred for split-face images such that sexual judgments best explained facial attraction, but only for mate-relevant faces (i.e., other-sex). These findings indicate that disrupting holistic processing can decouple sexual from nonsexual judgments of facial attraction, thereby establishing the presence of a dual-process.     

Low-level orientation information for social evaluation in face images

Observers make a range of social evaluations based on facial appearance, including judgments of trustworthiness, warmth, competence, and other aspects of personality. What visual information do people use to make these judgments? While links have been made between perceived social characteristics and other high-level properties of facial appearance (e.g., attractiveness, masculinity), there has been comparatively little effort to link social evaluations to low-level visual features, like spatial frequency and orientation sub-bands, known to be critically important for face processing. We explored the extent to which different social evaluations depended critically on horizontal orientation energy vs. vertical orientation energy, as is the case for face identification and emotion recognition. We found that while trustworthiness judgments exhibited this bias for horizontal orientations, competence and dominance did not, suggesting that social evaluations may depend on a multi-channel representation of facial appearance at early stages of visual processing.     

面孔社会知觉模型发展的回顾与展望

面孔作为一种复杂的特殊刺激,是人类表达自身情绪、认知他人情感的重要工具和途径。面孔识别是人类社会生活的一项重要技能,在缺乏外部线索时,它有助于我们对他人面孔的熟悉度、年龄和种族等方面有一个较明确的认识,从而更有利于人们社会交往和适应环境。大量研究表明,基于面孔的物理特征可以推断面孔所有者的内在特质,而这一推断又会影响个体的行为决策。因此,对面孔的认知不仅要关注面孔结构化特征,也要关注面孔社会化特征。针对面孔结构化特征,学者们提出了一些经典模型,如Bruce-Young模型、NBC模型等;针对面孔社会化特征,Alexander Todorov及其合作者采用主成分分析法,构建了包含信任度和支配度的面孔社会知觉“二维”模型。Clare A.M. Sutherland及其合作者提出,吸引力和信任度是两个独立的维度,由此构建了包含可接近性、年轻的—吸引力和支配度的面孔社会知觉“三维”模型。本文认为,面孔社会知觉模型从“二维”到“三维”的发展可以从吸引力和信任度两个维度的关系进行探讨。面孔在社会互动中传递着大量的信息,其中较为重要的是面孔信任度和面孔吸引力。其中,信任度评价具有决定性意义,信任一个不值得信任的人可能会给自身造成危害,而没信任一个值得信任的人往往意味着失去了合作的机会;吸引力评价则具有进化上的意义,吸引力往往与潜在配偶的繁殖能力有关,尤其体现在长期择偶关系之中。总结以往的面孔识别模型与本文介绍的面孔社会知觉模型,未来基于面孔特征的识别或特质推断可以从以下几方面进行思考：第一,选取生态化效度更高的面孔刺激材料;第二,进行跨文化检验模型的普适性;第三,从面孔识别模型向面孔社会知觉模型的发展需要进一步探索内在的认知神经机制;第四,进一步拓宽面孔社会知觉的研究领域。     

The role of holistic processing in judgments of facial attractiveness

Previous work has demonstrated that facial identity recognition, expression recognition, gender categorisation, and race categorisation rely on a holistic representation. Here we examine whether a holistic representation is also used for judgments of facial attractiveness. Like past studies, we used the composite paradigm to assess holistic processing (Young et al 1987, Perception 16 747-759). Experiment 1 showed that top halves of upright faces are judged to be more attractive when aligned with an attractive bottom half than when aligned with an unattractive bottom half. To assess whether this effect resulted from holistic processing or more general effects, we examined the impact of the attractive and unattractive bottom halves when upright halves were misaligned and when aligned and misaligned halves were presented upside-down. The bottom halves had no effect in either condition. These results demonstrate that the perceptual processes underlying upright facial-attractiveness judgments represent the face holistically. Our findings with attractiveness judgments and previous demonstrations involving other aspects of face processing suggest that a common holistic representation is used for most types of face processing.     

Facial first impressions from another angle: How social judgements are influenced by changeable and invariant facial properties

First impressions made to photographs of faces can depend as much on momentary characteristics of the photographed image (within‐person variability) as on consistent properties of the face of the person depicted (between‐person variability). Here, we examine two important sources of within‐person variability: emotional expression and viewpoint. We find more within‐person variability than between‐person variability for social impressions of key traits of trustworthiness, dominance, and attractiveness, which index the main dimensions in theoretical models of facial impressions. The most important source of this variability is the emotional expression of the face, but the viewpoint of the photograph also affects impressions and modulates the effects of expression. For example, faces look most trustworthy with a happy expression when they are facing the perceiver, compared to when they are facing elsewhere, whereas the opposite is true for anger and disgust. Our findings highlight the integration of these different sources of variability in social impression formation.     

The perception of attractiveness and trustworthiness in male faces affects hypothetical voting decisions differently in wartime and peacetime scenarios

Facial appearance of candidates has been linked to real election outcomes. Here we extend these findings by examining the contributions of attractiveness and trustworthiness in male faces to perceived votability. We first use real faces to show that attractiveness and trustworthiness are positively and independently related to perceptions of good leadership (rating study). We then show that computer graphic manipulations of attractiveness and trustworthiness influence choice of leader (Experiments 1 and 2). Finally, we show that changing context from wartime to peacetime can affect which face receives the most votes. Attractive faces were relatively more valued for wartime and trustworthy faces relatively more valued for peacetime (Experiments 1 and 2). This pattern suggests that attractiveness, which may indicate health and fitness, is perceived to be a useful attribute in wartime leaders, whereas trustworthiness, which may indicate prosocial traits, is perceived to be more important during peacetime. Our studies highlight the possible role of facial appearance in voting behaviour and the role of attributions of attractiveness and trust. We also show that there may be no general characteristics of faces that make them perceived as the best choice of leader; leaders may be chosen because of characteristics that are perceived as the best for leaders to possess in particular situations.     

The perception of attractiveness and trustworthiness in male faces affects hypothetical voting decisions differently in wartime and peacetime scenarios

Facial appearance of candidates has been linked to real election outcomes. Here we extend these findings by examining the contributions of attractiveness and trustworthiness in male faces to perceived votability. We first use real faces to show that attractiveness and trustworthiness are positively and independently related to perceptions of good leadership (rating study). We then show that computer graphic manipulations of attractiveness and trustworthiness influence choice of leader (Experiments 1 and 2). Finally, we show that changing context from wartime to peacetime can affect which face receives the most votes. Attractive faces were relatively more valued for wartime and trustworthy faces relatively more valued for peacetime (Experiments 1 and 2). This pattern suggests that attractiveness, which may indicate health and fitness, is perceived to be a useful attribute in wartime leaders, whereas trustworthiness, which may indicate prosocial traits, is perceived to be more important during peacetime. Our studies highlight the possible role of facial appearance in voting behaviour and the role of attributions of attractiveness and trust. We also show that there may be no general characteristics of faces that make them perceived as the best choice of leader; leaders may be chosen because of characteristics that are perceived as the best for leaders to possess in particular situations.     

Neural time course and brain sources of facial attractiveness vs. trustworthiness judgment

Prior research has shown that the more (or less) attractive a face is judged, the more (or less) trustworthy the person is deemed and that some common neural networks are recruited during facial attractiveness and trustworthiness evaluation. To interpret the relationship between attractiveness and trustworthiness (e.g., whether perception of personal trustworthiness may depend on perception of facial attractiveness), we investigated their relative neural processing time course. An event-related potential (ERP) paradigm was used, with localization of brain sources of the scalp neural activity. Face stimuli with a neutral, angry, happy, or surprised expression were presented in an attractiveness judgment, a trustworthiness judgment, or a control (no explicit social judgment) task. Emotional facial expression processing occurred earlier (N170 and EPN, 150-290 ms post-stimulus onset) than attractiveness and trustworthiness processing (P3b, 400-700 ms). Importantly, right-central ERP (C2, C4, C6) differences reflecting discrimination between “yes” (attractive or trustworthy) and “no” (unattractive or untrustworthy) decisions occurred at least 400 ms earlier for attractiveness than for trustworthiness, in the absence of LRP motor preparation differences. Neural source analysis indicated that facial processing brain networks (e.g., LG, FG, and IPL—extending to pSTS), also right-lateralized, were involved in the discrimination time course differences. This suggests that attractiveness impressions precede and might prime trustworthiness inferences and that the neural time course differences reflect truly facial encoding processes.     

Computer graphic studies of the role of facial similarity in judgements of attractiveness

Anecdotally, spouses are often said to resemble one another. This study investigates the effects of similarity between participants and stimuli on judgements of facial attractiveness: does “like prefer like”? Using computer graphic techniques, opposite sex facial stimuli were generated from subjects' photographs. Experiment 1 showed a correlation between attractiveness and similarity but the effect can be explained by the attractiveness of average faces. Beyond this, there was a trend for individual subjects to rate opposite sex images with a similar face shape to their own face as more attractive than other subjects. Experiment 2 allowed subjects to interactively manipulate an opposite sex facial image along a continuum from a self-similar shape, through an average face shape, to a face with opposite characteristics. No significant preferences for self-similar or opposite characteristics were found. Preferences for average faces are stronger than preferences for self-similar faces.     

Computer graphic studies of the role of facial similarity in judgements of attractiveness

Anecdotally, spouses are often said to resemble one another. This study investigates the effects of similarity between participants and stimuli on judgements of facial attractiveness: does “like prefer like”? Using computer graphic techniques, opposite sex facial stimuli were generated from subjects' photographs. Experiment 1 showed a correlation between attractiveness and similarity but the effect can be explained by the attractiveness of average faces. Beyond this, there was a trend for individual subjects to rate opposite sex images with a similar face shape to their own face as more attractive than other subjects. Experiment 2 allowed subjects to interactively manipulate an opposite sex facial image along a continuum from a self-similar shape, through an average face shape, to a face with opposite characteristics. No significant preferences for self-similar or opposite characteristics were found. Preferences for average faces are stronger than preferences for self-similar faces.     

Do facial first impressions reflect a shared social reality?

Influential facial impression models have repeatedly shown that trustworthiness, youthful–attractiveness, and dominance dimensions subserve a wide variety of first impressions formed from strangers’ faces, suggestive of a shared social reality. However, these models are built from impressions aggregated across observers. Critically, recent work has now shown substantial inter-observer differences in facial impressions, raising the important question of whether these dimensional models based on aggregated group data are meaningful at the individual observer level. We addressed this question with a novel case series approach, using factor analyses of ratings of twelve different traits to build individual models of facial impressions for different observers. Strikingly, three dimensions of trustworthiness, youthful/attractiveness, and competence/dominance appeared across the majority of these individual observer models, demonstrating that the dimensional approach is indeed meaningful at the individual level. Nonetheless, we also found differences in the stability of the competence/dominance dimension across observers. Taken together, results suggest that individual differences in impressions arise in the context of a largely common structure that supports a shared social reality.     

Facial and self‐report questionnaire measures capture different aspects of romantic partner preferences

Romantic relationship researchers often use self‐report measures of partner preferences based on verbal questionnaires. These questionnaires show that partner preferences involve an evaluation in terms of underlying factors of vitality–attractiveness, status‐resources, and warmth–trustworthiness. However, when people first encounter a potential partner, they can usually derive a wealth of impressions from their face, and little is known about the relationship between verbal self‐reports and impressions derived from faces. We conducted four studies investigating potential parallels and differences between facial impressions and verbal self‐reports. Study 1 showed that when evaluating highly variable everyday face images in a context that does not require considering them as potential partners, participants can reliably perceive the traits and factors that are related to partner preferences. However, despite being capable of these nuanced evaluations, Study 2 found that when asked to evaluate images of faces as potential romantic partners, participants’ preferences become dominated by attractiveness‐related concerns. Study 3 confirmed this dominance of facial attractiveness using morphed face‐like images. Study 4 showed that attractiveness dominates partner preferences for faces even when task instructions imply that warmth–trustworthiness or status–resources should be of primary importance. In contrast to verbal questionnaire measures of partner preferences, evaluations of faces focus heavily on attractiveness, whereas questionnaire self‐reports tend on average to prioritize warmth–trustworthiness over attractiveness. Evaluations of faces and verbal self‐report measures therefore capture different aspects of partner preferences.