First impressions from faces in the real world: Commentary on Sutherland and Young (2022)

The study of first impressions from faces now emphasizes the need to understand trait inferences made to naturalistic face images (British Journal of Psychology, 113, 2022, 1056). Face recognition algorithms based on deep convolutional neural networks simultaneously represent invariant, changeable and environmental variables in face images. Therefore, we suggest them as a comprehensive ‘face space’ model of first impressions of naturalistic faces. We also suggest that to understand trait inferences in the real world, a logical next step is to consider trait inferences made to whole people (faces and bodies). On the role of cultural contributions to trait perception, we think it is important for the field to begin to consider the way in which trait inferences motivate (or not) behaviour in independent and interdependent cultures.     

Incidental learning of trust from eye-gaze: Effects of race and facial trustworthiness

Humans rapidly make inferences about individuals’ trustworthiness on the basis of their facial features and perceived group membership. We examine whether incidental learning about trust from shifts in gaze direction is influenced by these facial features. To do so, we examined two types of face category: the race of the face and the initial trustworthiness of the face based on physical appearance. We find that cueing of attention by eye-gaze is unaffected by race or initial levels of trust, whereas incidental learning of trust from gaze behaviour is selectively influenced. That is, learning of trust is reduced for other-race faces, as predicted by reduced abilities to identify members of other races (Experiment 1). In contrast, converging findings from an independently gathered set of data showed that the initial trustworthiness of faces did not influence learning of trust (Experiment 2). These results show that learning about the behaviour of other-race faces is poorer than for own-race faces, but that this cannot be explained by differences in the perceived trustworthiness of different groups.     

First impressions: making up your mind after a 100-ms exposure to a face

People often draw trait inferences from the facial appearance of other people. We investigated the minimal conditions under which people make such inferences. In five experiments, each focusing on a specific trait judgment, we manipulated the exposure time of unfamiliar faces. Judgments made after a 100-ms exposure correlated highly with judgments made in the absence of time constraints, suggesting that this exposure time was sufficient for participants to form an impression. In fact, for all judgments-attractiveness, likeability, trustworthiness, competence, and aggressiveness-increased exposure time did not significantly increase the correlations. When exposure time increased from 100 to 500 ms, participants' judgments became more negative, response times for judgments decreased, and confidence in judgments increased. When exposure time increased from 500 to 1,000 ms, trait judgments and response times did not change significantly (with one exception), but confidence increased for some of the judgments; this result suggests that additional time may simply boost confidence in judgments. However, increased exposure time led to more differentiated person impressions.     

Learning about faces: effects of trustworthiness on affective evaluation

The results of two studies on the relationship between evaluations of trustworthiness, valence and arousal of faces are reported. In Experiment 1, valence and trustworthiness judgments of faces were positively correlated, while arousal was negatively correlated with both trustworthiness and valence. In Experiment 2, learning about faces based on their emotional expression and the extent to which this learning is influenced by perceived trustworthiness was investigated. Neutral faces of different models differing in trustworthiness were repeatedly associated with happy or with angry expressions and the participants were asked to categorize each neutral face as belonging to a "friend" or to an "enemy" based on these associations. Four pairing conditions were defined in terms of the congruency between trustworthiness level and expression: Trustworthy-congruent, trustworthy-incongruent, untrustworthy-congruent and untrustworthy-incongruent. Categorization accuracy during the learning phase and face evaluation after learning were measured. During learning, participants learned to categorize with similar efficiency trustworthy and untrustworthy faces as friends or enemies and thus no effects of congruency were found. In the evaluation phase, faces of enemies were rated as more negative and arousing than those of friends, thus showing that learning was effective to change the affective value of the faces. However, faces of untrustworthy models were still judged on average more negative and arousing than those of trustworthy ones. In conclusion, although face trustworthiness did not influence learning of associations between faces and positive or negative social information it did have a significant influence on face evaluation that was manifest even after that learning.     

The dissociable influence of social context on judgements of facial attractiveness and trustworthiness

The cheerleader effect occurs when the same face is rated to be more attractive when it is seen in a group compared to when seen alone. We investigated whether this phenomenon also occurs for trustworthiness judgements, and examined how these effects are influenced by the characteristics of the individual being evaluated and those of the group they are seen in. Across three experiments, we reliably replicated the cheerleader effect. Most faces became more attractive in a group. Yet, the size of the cheerleader effect that each face experienced was not related to its own attractiveness, nor to the attractiveness of the group or the group’s digitally averaged face. We discuss the implications of our findings for the hierarchical encoding and contrast mechanisms that have previously been used to explain the cheerleader effect. Surprisingly, judgements of facial trustworthiness did not experience a ‘cheerleader effect’. Instead, we found that untrustworthy faces became significantly more trustworthy in all groups, while there was no change for faces that were already trustworthy alone. Taken together, our results demonstrate that social context can have a dissociable influence on our first impressions, depending on the trait being evaluated.     

Facial attractiveness impressions precede trustworthiness inferences: lower detection thresholds and faster decision latencies

Prior research has found a relationship between perceived facial attractiveness and perceived personal trustworthiness. We examined the time course of attractiveness relative to trustworthiness evaluation of emotional and neutral faces. This served to explore whether attractiveness might be used as an easily accessible cue and a quick shortcut for judging trustworthiness. Detection thresholds and judgment latencies as a function of expressive intensity were measured. Significant correlations between attractiveness and trustworthiness consistently held for six emotional expressions at four intensities, and neutral faces. Importantly, perceived attractiveness preceded perceived trustworthiness, with lower detection thresholds and shorter decision latencies. This reveals a time course advantage for attractiveness, and suggests that earlier attractiveness impressions could bias trustworthiness inferences. A heuristic cognitive mechanism is hypothesised to ease processing demands by relying on simple and observable clues (attractiveness) as a substitute for more complex and not easily accessible information (trustworthiness).     

Appearance-based inferences bias source memory

Previous research varying the trustworthiness of appearance has demonstrated that facial characteristics contribute to source memory. Two studies extended this work by investigating the contribution to source memory of babyfaceness, a facial quality known to elicit strong spontaneous trait inferences. Young adult participants viewed younger and older babyfaced and mature-faced individuals paired with sentences that were either congruent or incongruent with the target??s facial characteristics. Identifying a source as dominant or submissive was least accurate when participants chose between a target whose behavior was incongruent with facial characteristics and a lure whose face mismatched the target in appearance but matched the source memory question. In Experiment 1, this effect held true when older sources were identified, but not own-age, younger sources. When task difficulty was increased in Experiment 2, the relationship between face?Cbehavior congruence and lure facial characteristics persisted, but it was not moderated by target age even though participants continued to correctly identify fewer older than younger sources. Taken together, these results indicate that trait expectations associated with variations in facial maturity can bias source memory for both own- and other-age faces, although own-age faces are less vulnerable to this bias, as is shown in the moderation by task difficulty.     

Abnormalities in early visual processes are linked to hypersociability and atypical evaluation of facial trustworthiness: An ERP study with Williams syndrome

Accurate assessment of trustworthiness is fundamental to successful and adaptive social behavior. Initially, people assess trustworthiness from facial appearance alone. These assessments then inform critical approach or avoid decisions. Individuals with Williams syndrome (WS) exhibit a heightened social drive, especially toward strangers. This study investigated the temporal dynamics of facial trustworthiness evaluation in neurotypic adults (TD) and individuals with WS. We examined whether differences in neural activity during trustworthiness evaluation may explain increased approach motivation in WS compared to TD individuals. Event-related potentials were recorded while participants appraised faces previously rated as trustworthy or untrustworthy. TD participants showed increased sensitivity to untrustworthy faces within the first 65–90 ms, indexed by the negative-going rise of the P1 onset (oP1). The amplitude of the oP1 difference to untrustworthy minus trustworthy faces was correlated with lower approachability scores. In contrast, participants with WS showed increased N170 amplitudes to trustworthy faces. The N170 difference to low–high-trust faces was correlated with low approachability in TD and high approachability in WS. The findings suggest that hypersociability associated with WS may arise from abnormalities in the timing and organization of early visual brain activity during trustworthiness evaluation. More generally, the study provides support for the hypothesis that impairments in low-level perceptual processes can have a cascading effect on social cognition.     

Facial and self‐report questionnaire measures capture different aspects of romantic partner preferences

Romantic relationship researchers often use self‐report measures of partner preferences based on verbal questionnaires. These questionnaires show that partner preferences involve an evaluation in terms of underlying factors of vitality–attractiveness, status‐resources, and warmth–trustworthiness. However, when people first encounter a potential partner, they can usually derive a wealth of impressions from their face, and little is known about the relationship between verbal self‐reports and impressions derived from faces. We conducted four studies investigating potential parallels and differences between facial impressions and verbal self‐reports. Study 1 showed that when evaluating highly variable everyday face images in a context that does not require considering them as potential partners, participants can reliably perceive the traits and factors that are related to partner preferences. However, despite being capable of these nuanced evaluations, Study 2 found that when asked to evaluate images of faces as potential romantic partners, participants’ preferences become dominated by attractiveness‐related concerns. Study 3 confirmed this dominance of facial attractiveness using morphed face‐like images. Study 4 showed that attractiveness dominates partner preferences for faces even when task instructions imply that warmth–trustworthiness or status–resources should be of primary importance. In contrast to verbal questionnaire measures of partner preferences, evaluations of faces focus heavily on attractiveness, whereas questionnaire self‐reports tend on average to prioritize warmth–trustworthiness over attractiveness. Evaluations of faces and verbal self‐report measures therefore capture different aspects of partner preferences.     

Social Trait Information in Deep Convolutional Neural Networks Trained for Face Identification

Faces provide information about a person's identity, as well as their sex, age, and ethnicity. People also infer social and personality traits from the face — judgments that can have important societal and personal consequences. In recent years, deep convolutional neural networks (DCNNs) have proven adept at representing the identity of a face from images that vary widely in viewpoint, illumination, expression, and appearance. These algorithms are modeled on the primate visual cortex and consist of multiple processing layers of simulated neurons. Here, we examined whether a DCNN trained for face identification also retains a representation of the information in faces that supports social‐trait inferences. Participants rated male and female faces on a diverse set of 18 personality traits. Linear classifiers were trained with cross validation to predict human‐assigned trait ratings from the 512 dimensional representations of faces that emerged at the top‐layer of a DCNN trained for face identification. The network was trained with 494,414 images of 10,575 identities and consisted of seven layers and 19.8 million parameters. The top‐level DCNN features produced by the network predicted the human‐assigned social trait profiles with good accuracy. Human‐assigned ratings for the individual traits were also predicted accurately. We conclude that the face representations that emerge from DCNNs retain facial information that goes beyond the strict limits of their training.     

男性化与女性化对面孔偏好的影响—— 基于图像处理技术和眼动的检验

采用图像处理技术和眼动探讨了性别二态线索对面孔偏好的影响。实验1发现非面孔线索未掩蔽和掩蔽时, 感知男性化技术与原始照片条件下女性化的男性面孔更有吸引力和信任度; 性别二态技术条件下, 非面孔线索未掩蔽时男性化的男性面孔更有吸引力和信任度。实验2表明被试对男性面孔的平均瞳孔大小和注视次数均大于和多于女性面孔, 首次注视时间短于女性面孔; 被试对男性化面孔的首次注视时间和首次注视持续时间均长于女性化面孔。     

The person reference process in spontaneous trait inferences

Five studies examined whether spontaneous trait inferences uniquely reference the person who performed a trait-implying behavior. On each study trial in 5 studies, participants saw 2 faces and a behavioral sentence referring to one of them. Later, participants saw face-trait pairs and indicated whether they had seen the trait word in the sentence presented with the face. Participants falsely recognized implied traits more when these traits were paired with actors' faces than with control faces. This effect was replicated for a large set effaces (120), after a week delay between study and recognition test, when equal attention was paid to each face, and when the orientation of the face at recognition was different from the orientation at encoding.     

Age differences in facial trustworthiness judgement based on multiple facial cues

Multiple facial cues such as facial expression and face gender simultaneously influence facial trustworthiness judgement in adults. The current work was to examine the effect of multiple facial cues on trustworthiness judgement across age groups. Eight-, 10-year-olds, and adults detect trustworthiness from happy and neutral adult faces (female and male faces) in Experiment 1. Experiment 2 included both adult and child faces wearing happy, angry, and neutral expressions. Nine-, 11-, 13-year-olds, and adults had to rate facial trustworthiness with a 7-point Likert scale. The results of Experiments 1 and 2 revealed that facial expression and face gender independently affected facial trustworthiness judgement in children aged 10 and below but simultaneously affected judgement in children aged 11 and above, adolescents, and adults. There was no own-age bias in children and adults. The results showed that children younger than 10 could not process multiple facial cues in the same manner as in older children and adults when judging trustworthiness. The current findings provide evidence for the stable-feature account, but not for the own-age bias account or the expertise account.     

Correcting erroneous inferences in memory: The role of source credibility

People often continue to rely on erroneous information about people and events, even in the face of subsequent counter information. The current study examined whether this information could be effectively corrected by a credible source. We examined two aspects of credibility: trustworthiness and expertise. Experiment 1 showed that receiving a correction from a source high in trustworthiness and expertise reduced participants’ use of original information when making inferences. Experiment 2 showed that source expertise alone was not sufficient to reduce participants’ reliance on the original information. The results from Experiment 3 showed that source trustworthiness alone significantly decreased participants’ use of the original information when making inferences. The results suggest that people may be able to reduce their use of original information if they receive a correction from a person who is deemed to be highly trustworthy. These findings have implications for decision making in politics and other applied areas.     

Effects of inversion and negation on social inferences from faces

Judgments about personality and other social characteristics based on facial appearance are remarkably consistent across individuals. However, whereas the facial cues that underpin age and sex judgments are already well understood, the physical bases for judgments of characteristics such as intelligence or trustworthiness are still unknown. Inversion and photographic negation are used here to investigate the visual processes underlying social inferences from the face and to explore whether various judgments might rely on different perceptual representations. In experiment 1, the perceptions of age, sex, attractiveness, approachability, intelligence, and trustworthiness, but not distinctiveness, were affected by inversion, and all these characteristics were affected by negation. The effects of inversion and negation were independent, suggesting that they impaired the encoding of different types of information. Moreover, an independent manipulation of hue and luminance in experiment 2 showed that the effects of negation were mainly due to the reversal of luminance values. These results are consistent with the view that information about the configuration of features (the processing of which is impaired by inversion) and information about surface properties (the processing of which is impaired by brightness negation) are both used in the perception of social characteristics from faces. In addition, the fact that there was a similar pattern of impairment across most judgments suggests that there is an initial common perceptual representation of the face, from which most characteristics are inferred.     

Older adults’ neural activation in the reward circuit is sensitive to face trustworthiness

We examined older adult (OA) and younger adult (YA) neural sensitivity to face trustworthiness in reward circuit regions, previously found to respond to trustworthiness in YA. Interactions of face trustworthiness with age revealed effects exclusive to OA in the amygdala and caudate, and an effect that was not moderated by age in the dorsal anterior cingulate cortex (dACC). OA, but not YA, showed a nonlinear amygdala response to face trustworthiness, with significantly stronger activation response to high than to medium trustworthy faces, and no difference between low and medium or high. This may explain why an earlier study investigating OA amygdala activation to trustworthiness failed to find a significant effect, since only the linear low versus high trustworthiness difference was assessed. OA, but not YA, also showed significantly stronger activation to high than to low trustworthy faces in the right caudate, indicating a positive linear effect, consistent with previous YA research, as well as significantly stronger activation to high than to medium but not low trustworthy faces in the left caudate, indicating a nonlinear effect. Activation in dACC across both age groups showed a positive linear effect consistent with previous YA research. Finally, OA rated the faces as more trustworthy than did YA across all levels of trustworthiness. Future research should examine whether the null effects for YA were due to our inclusion of older faces. Research also should investigate possible implications of our findings for more ecologically valid OA responses to people who vary in facial trustworthiness.     

The perception of attractiveness and trustworthiness in male faces affects hypothetical voting decisions differently in wartime and peacetime scenarios

Facial appearance of candidates has been linked to real election outcomes. Here we extend these findings by examining the contributions of attractiveness and trustworthiness in male faces to perceived votability. We first use real faces to show that attractiveness and trustworthiness are positively and independently related to perceptions of good leadership (rating study). We then show that computer graphic manipulations of attractiveness and trustworthiness influence choice of leader (Experiments 1 and 2). Finally, we show that changing context from wartime to peacetime can affect which face receives the most votes. Attractive faces were relatively more valued for wartime and trustworthy faces relatively more valued for peacetime (Experiments 1 and 2). This pattern suggests that attractiveness, which may indicate health and fitness, is perceived to be a useful attribute in wartime leaders, whereas trustworthiness, which may indicate prosocial traits, is perceived to be more important during peacetime. Our studies highlight the possible role of facial appearance in voting behaviour and the role of attributions of attractiveness and trust. We also show that there may be no general characteristics of faces that make them perceived as the best choice of leader; leaders may be chosen because of characteristics that are perceived as the best for leaders to possess in particular situations.