Caricaturing facial expressions

The physical differences between facial expressions (e.g. fear) and a reference norm (e.g. a neutral expression) were altered to produce photographic-quality caricatures. In Experiment 1, participants rated caricatures of fear, happiness and sadness for their intensity of these three emotions; a second group of participants rated how 'face-like' the caricatures appeared. With increasing levels of exaggeration the caricatures were rated as more emotionally intense, but less 'face-like'. Experiment 2 demonstrated a similar relationship between emotional intensity and level of caricature for six different facial expressions. Experiments 3 and 4 compared intensity ratings of facial expression caricatures prepared relative to a selection of reference norms - a neutral expression, an average expression, or a different facial expression (e.g. anger caricatured relative to fear). Each norm produced a linear relationship between caricature and rated intensity of emotion; this finding is inconsistent with two-dimensional models of the perceptual representation of facial expression. An exemplar-based multidimensional model is proposed as an alternative account.     

Distinctiveness and expertise effects with homogeneous stimuli: towards a model of configural coding

Recent studies using Brennan's computerized caricature generator have demonstrated distinctiveness effects consistent with the idea that faces are coded in terms of their individual distinctive properties. Based on these findings it is suggested that, for homogeneous classes whose members share a common configuration, distinctive configural information may be coded as metric deviations from a spatial norm. Experiments are described which demonstrate similar distinctiveness effects in bird identification. Transformations that increase distinctiveness (caricatures) produced faster identification and a higher recognition proportion, for both experts and nonexperts, than transformations that reduce distinctiveness (anticaricatures). This distinctiveness advantage is consistent with the norm-based coding idea. Furthermore, within certain limits, increasing distinctiveness did not impair performance relative to that for veridical drawings. For experts there was also a caricature advantage, such that 50% caricatures of birds in a highly homogeneous and familiar class (passerines) were identified more quickly, provided that they were recognized at all, than uncaricatured veridical drawings. The significance of a caricature advantage for the visual coding of configural information is discussed.     

Understanding the multiframe caricature advantage for recognizing facial composites

Eyewitnesses often construct a “composite” face of a person they saw commit a crime, a picture that police use to identify suspects. We described a technique (Frowd, Bruce, Ross, McIntyre, & Hancock, 2007) based on facial caricature to facilitate recognition of these images: Correct naming substantially improves when composites are seen with progressive positive caricature, where distinctive information is enhanced, and then with progressive negative caricature, the opposite. Over the course of four experiments, the underpinnings of this mechanism were explored. Positive-caricature levels were found to be largely responsible for improving naming of composites, with some benefit from negative-caricature levels. Also, different frame-presentation orders (forward, reverse, random, repeated) facilitated equivalent naming benefit relative to static composites. Overall, the data indicate that composites are usually constructed as negative caricatures.     

Children's recognition of caricatures

This study examined children's and adults' perception and recognition of facial stimuli that were either systematically exaggerated (caricatures) or de-exaggerated (anticaricatures) relative to a norm face. The results showed that all age groups perceived caricatures as the most distinctive versions of a face and anticaricatures as the least distinctive, although the effect was smallest for 6-year-olds. In general, caricatures were identified as quickly as the veridical faces and faster than the anticaricatures. Across all age groups, participants' familiarity with the stimulus faces interacted with degree of caricature to determine speed of processing as well as choice of best likeness. The results are discussed in relation to the idea that distinctiveness information in a face is represented in relation to a norm.     

Nonlinear,near photo-realistic caricatures using a parametric facial appearance model

A mathematical model previously developed for use in computer vision applications is presented as an empirical model for face space. The term appearance space is used to distinguish this from previous models. Appearance space is a linear vector space that is dimensionally optimal, enables us to model and describe any human facial appearance, and possesses characteristics that are plausible for the representation of psychological face space. Randomly sampling from a multivariate distribution for a location in appearance space produces entirely plausible faces, and manipulation of a small set of defining parameters enables the automatic generation of photo-realistic caricatures. The appearance space model leads us to the new concept of nonlinear caricatures, and we show that the accepted linear method for caricature is only a special case of a more general paradigm. Nonlinear methods are also viable, and we present examples of photographic quality caricatures, using a number of different transformation functions. Results of a simple experiment are presented that suggest that nonlinear transformations can accurately capture key aspects of the caricature effect. Finally, we discuss the relationship between appearance space, caricature, and facial distinctiveness. On the basis of our new theoretical framework, we suggest an experimental approach that can yield new evidence for the plausibility of face space and its ability to explain processes of recognition.     

Helping the cognitive system learn: exaggerating distinctiveness and uniqueness

The caricature advantage demonstrates that performance is better when exaggerated stimuli are presented rather than a faithful image. This can be understood with respect to a theoretical framework in which caricaturing maximises the distinctiveness and thus minimises any perceptual or representational confusion. In this study we examine the possibility to harness caricatures to enhance learning. Thus, during learning the caricatures help the cognitive system pick up the unique and distinctive features of the learned material. This in turn helps to construct representations that correctly direct attention to the critical information. We trained 113 participants to identify aircraft across any orientation and found that the use of caricature is advantageous. However, the caricature advantage was most effective in complex learning where it is difficult to differentiate among different aircraft. Furthermore, the caricature advantage for subsequent recognition is attenuated when over‐learning has been achieved. These results are discussed in terms of the learning situations in which caricatures can be most effective in enhancing learning. Copyright © 2007 John Wiley & Sons, Ltd.     

The face typicality-recognizability relationship: Encoding or retrieval locus?

Using a crossover recognition memory testing paradigm, we tested whether the effects on face recognition of the memorability component of face typicality (Vokey & Read, 1992, 1995) are due primarily to the encoding process occurring during study or to the retrieval process occurring at test. At study, faces were either veridical in form or at moderate (Experiment 1) or extreme (Experiment 2) levels of caricature. The variable of degree of facial caricature at study was crossed with the degree of caricature at test. The primary contribution of increased memorability to increased hit rate was through increased distinctiveness at study. Increased distinctiveness at test contributed to substantial reductions in the false alarm rate, too. Signal detection analyses confirmed that the mirror effects obtained were primarily stimulus/memory-based, rather than decision-based. Contrary to the conclusion of Vokey and Read (1992), we found that increments in face memorability produced increments in face recognition that were due at least as much to enhanced encoding of studied faces as they were to increased rejection of distractor faces.     

AVERAGENESS, EXAGGERATION, AND FACIAL ATTRACTIVENESS

Abstract— Langlois and her colleagues reported in this journal that composite faces are more attractive than the component faces used to create them, and conjectured that averageness is attractive (Langlois & Roggman, 1990, Langlois, Roggman, & Musselman, 1994) However, extremes may also be attractive (Perrett, May, & Yoshikawa, 1994). We investigated the effect of averageness (proximity to a norm or average face) on attractiveness using a computerized caricature generator to very averageness. Attractiveness increased with averageness (Experiment 1) and was negatively correlated with distinctiveness, a subjective measure of the converse of averageness (Experiments 1 and 2) Extremes (caricatures) were not attractive Line-drawing composites, which avoid some of the problems associated with gray-level composites, were significantly more attractive and less distinctive (more average) than individual faces (Experiment 2) These results support the claim that averageness is attractive.     

Caricature generalization benefits for faces learned with enhanced idiosyncratic shape or texture

Recent findings show benefits for learning and subsequent recognition of faces caricatured in shape or texture, but there is little evidence on whether this caricature learning advantage generalizes to recognition of veridical counterparts at test. Moreover, it has been reported that there is a relatively higher contribution of texture information, at the expense of shape information, for familiar compared to unfamiliar face recognition. The aim of this study was to examine whether veridical faces are recognized better when they were learned as caricatures compared to when they were learned as veridicals—what we call a caricature generalization benefit. Photorealistic facial stimuli derived from a 3-D camera system were caricatured selectively in either shape or texture by 50 %. Faces were learned across different images either as veridicals, shape caricatures, or texture caricatures. At test, all learned and novel faces were presented as previously unseen frontal veridicals, and participants performed an old–new task. We assessed accuracies, reaction times, and face-sensitive event-related potentials (ERPs). Faces learned as caricatures were recognized more accurately than faces learned as veridicals. At learning, N250 and LPC were largest for shape caricatures, suggesting encoding advantages of distinctive facial shape. At test, LPC was largest for faces that had been learned as texture caricatures, indicating the importance of texture for familiar face recognition. Overall, our findings demonstrate that caricature learning advantages can generalize to and, importantly, improve recognition of veridical versions of faces.     

Compensation of neural delays in visual‐motor behaviour: No evidence for shorter afferent delays for visual motion

Abstract

Faces and other objects that share a configuration present a special problem to the visual system. Two components of the visual system's solution to this homogeneity problem have been identified. Inversion studies have identified the use of relational features (Diamond &; Carey, 1986; Rhodes, Brake, &; Atkinson, 1993), and caricature studies have identified norm-based coding (Carey, Rhodes, Diamond, &; Hamilton, in preparation; Rhodes, Brennan, &; Carey, 1987; Rhodes &; McLean, 1990). Here we explore a possible link between these two components, asking whether caricature effects depend selectively on exaggeration of relational features. If so, then inversion, which makes relational features particularly difficult to code (compared with isolated features), should reduce caricature effects. In three experiments we found a caricature equivalence effect (caricatures identified as accurately as undistorted images and both better than anticaricatures) that was unaffected by orientation, suggesting that relational feature coding is not necessary for caricatures to be effective. Therefore, caricature and inversion effects reflect distinct components of face recognition. Caricature level and orientation also interacted differently with other factors, as would be expected if their effects depend upon different underlying processes. For one set of faces there was a caricature advantage in accuracy (Experiments 1 and 3). This superportrait effect occurred even for subjects who were unfamiliar with the faces prior to the experiment (Experiment 3), a result with important forensic implications. Furthermore, the effect was restricted to upright faces. Therefm, although caricatures can be recognized as well as undistorted images whatever features are exaggerated, exaggeration of relational features may be needed for a superportrait effect.     

Differences in holistic processing do not explain cultural differences in the recognition of facial expression

The aim of this study was to investigate the causes of the own-race advantage in facial expression perception. In Experiment 1, we investigated Western Caucasian and Chinese participants’ perception and categorization of facial expressions of six basic emotions that included two pairs of confusable expressions (fear and surprise; anger and disgust). People were slightly better at identifying facial expressions posed by own-race members (mainly in anger and disgust). In Experiment 2, we asked whether the own-race advantage was due to differences in the holistic processing of facial expressions. Participants viewed composite faces in which the upper part of one expression was combined with the lower part of a different expression. The upper and lower parts of the composite faces were either aligned or misaligned. Both Chinese and Caucasian participants were better at identifying the facial expressions from the misaligned images, showing interference on recognizing the parts of the expressions created by holistic perception of the aligned composite images. However, this interference from holistic processing was equivalent across expressions of own-race and other-race faces in both groups of participants. Whilst the own-race advantage in recognizing facial expressions does seem to reflect the confusability of certain emotions, it cannot be explained by differences in holistic processing.     

The neural fate of individual item representations in visual working memory

Previous research has demonstrated an interaction between eye gaze and selected facial emotional expressions, whereby the perception of anger and happiness is impaired when the eyes are horizontally averted within a face, but the perception of fear and sadness is enhanced under the same conditions. The current study reexamined these claims over six experiments. In the first three experiments, the categorization of happy and sad expressions (Experiments 1 and 2) and angry and fearful expressions (Experiment 3) was impaired when eye gaze was averted, in comparison to direct gaze conditions. Experiment 4 replicated these findings in a rating task, which combined all four expressions within the same design. Experiments 5 and 6 then showed that previous findings, that the perception of selected expressions is enhanced under averted gaze, are stimulus and task-bound. The results are discussed in relation to research on facial expression processing and visual attention.     

Manipulation of colour and shape information and its consequence upon recognition and best-likeness judgments

Previous forays into the study of recognition have revealed an advantage for line-drawn and photographic shape caricatures of faces in reaction-time paradigms. When a presentation-time technique was used, photographs with enhanced colour intensity and saturation were also found to provide superior recognition accuracy to veridical images. This has provided strong evidence that distinctive information can produce a recognition advantage for famous faces in both colour and shape domains. Such a presentation-time paradigm allows the display of stimuli over a range of brief display periods. Using this paradigm, subjects recognised photorealistic target faces caricatured in shape with greater accuracy than veridical images, consistent with previous findings when reaction time was used as a measure. Subjects were also asked to identify the best likeness for individuals using photorealistic stimuli and an interactive paradigm with shape caricature, colour caricature, and contrast control varied by the user in real-time. The best likeness with shape manipulation was a slight anticaricature, while with colour-caricature and contrast-control images a mildly exaggerated image was selected as the best likeness. Thus, although images caricatured substantially in colour or shape (+40%) induce superior recognition compared to veridical images, such substantial exaggerations are not necessarily seen as best likenesses under prolonged exposure.     

Configural information in facial expression perception

Composite facial expressions were prepared by aligning the top half of one expression (e.g., anger) with the bottom half of another (e.g., happiness). Experiment 1 shows that participants are slower to identify the expression in either half of these composite images relative to a "noncomposite" control condition in which the 2 halves are misaligned. This parallels the composite effect for facial identity (A. W. Young, D. Hellawell, & D. C. Hay, 1987), and like its identity counterpart, the effect is disrupted by inverting the stimuli (Experiment 2). Experiment 3 shows that no composite effect is found when the top and bottom sections contain different models' faces posing the same expression; this serves to exclude many nonconfigural interpretations of the composite effect (e.g., that composites are more "attention-grabbing" than noncomposites). Finally, Experiment 4 demonstrates that the composite effects for identity and expression operate independently of one another.     

An application of caricature: How to improve the recognition of facial composites

Facial caricatures exaggerate the distinctive features of a face and may elevate the recognition of a familiar face. We investigate whether the recognition of facial composites, or pictures of criminal faces, could be similarly enhanced. In this study, participants first estimated the degree of caricature necessary to make composites most identifiable. Contrary to expectation, an anticaricature was found to be best, presumably as this tended to reduce the appearance of errors. In support of this explanation, more positive caricature estimates were assigned to morphed composites: representations that tend to contain less overall error. In addition, anticaricaturing reduced identification for morphed composites but enhanced identification for individual composites. Although such improvements were too small to be of value to law enforcement, a sizeable naming benefit was observed when presenting a range of caricature states, which appeared to capitalize on individual differences in the internal representation of familiar faces.     

Mixed emotions: holistic and analytic perception of facial expressions

In the face literature, it is debated whether the identification of facial expressions requires holistic (i.e., whole face) or analytic (i.e., parts-based) information. In this study, happy and angry composite expressions were created in which the top and bottom face halves formed either an incongruent (e.g., angry top + happy bottom) or congruent composite expression (e.g., happy top + happy bottom). Participants reported the expression in the target top or bottom half of the face. In Experiment 1, the target half in the incongruent condition was identified less accurately and more slowly relative to the baseline isolated expression or neutral face conditions. In contrast, no differences were found between congruent and the baseline conditions. In Experiment 2, the effects of exposure duration were tested by presenting faces for 20, 60, 100 and 120 ms. Interference effects for the incongruent faces appeared at the earliest 20 ms interval and persisted for the 60, 100 and 120 ms intervals. In contrast, no differences were found between the congruent and baseline face conditions at any exposure interval. In Experiment 3, it was found that spatial alignment impaired the recognition of incongruent expressions, but had no effect on congruent expressions. These results are discussed in terms of holistic and analytic processing of facial expressions.     

Mixed emotions: Holistic and analytic perception of facial expressions

In the face literature, it is debated whether the identification of facial expressions requires holistic (i.e., whole face) or analytic (i.e., parts-based) information. In this study, happy and angry composite expressions were created in which the top and bottom face halves formed either an incongruent (e.g., angry top + happy bottom) or congruent composite expression (e.g., happy top + happy bottom). Participants reported the expression in the target top or bottom half of the face. In Experiment 1, the target half in the incongruent condition was identified less accurately and more slowly relative to the baseline isolated expression or neutral face conditions. In contrast, no differences were found between congruent and the baseline conditions. In Experiment 2, the effects of exposure duration were tested by presenting faces for 20, 60, 100 and 120 ms. Interference effects for the incongruent faces appeared at the earliest 20 ms interval and persisted for the 60, 100 and 120 ms intervals. In contrast, no differences were found between the congruent and baseline face conditions at any exposure interval. In Experiment 3, it was found that spatial alignment impaired the recognition of incongruent expressions, but had no effect on congruent expressions. These results are discussed in terms of holistic and analytic processing of facial expressions.     

The effects of distinctiveness on memory and metamemory for face-name associations

We examined the influence of face and name distinctiveness on memory and metamemory for face-name associations. Four types of monitoring judgements were solicited during encoding and retrieval of face-name pairs that contained distinct or typical faces (Experiment 1) or names (Experiment 2). The beneficial effects of distinctiveness on associative memory were symmetrical between faces and names, such that relative to their typical counterparts, distinct faces enhanced memory for names, and distinct names enhanced memory for faces. These effects were also apparent in metamemory. Estimates of prospective and retrospective memory performance were greater for face-name associations that contained a distinct face or name compared with a typical face or name, regardless of whether the distinct item was a cue or target. Moreover, the predictive validity of prospective monitoring improved with name distinctiveness, whereas the predictive validity of retrospective monitoring improved with facial distinctiveness. Our results indicate that distinctiveness affects not only the strength of the association between a face and a name, but also the ability to monitor that association.     

The effects of distinctiveness on memory and metamemory for face–name associations

We examined the influence of face and name distinctiveness on memory and metamemory for face–name associations. Four types of monitoring judgements were solicited during encoding and retrieval of face–name pairs that contained distinct or typical faces (Experiment 1) or names (Experiment 2). The beneficial effects of distinctiveness on associative memory were symmetrical between faces and names, such that relative to their typical counterparts, distinct faces enhanced memory for names, and distinct names enhanced memory for faces. These effects were also apparent in metamemory. Estimates of prospective and retrospective memory performance were greater for face–name associations that contained a distinct face or name compared with a typical face or name, regardless of whether the distinct item was a cue or target. Moreover, the predictive validity of prospective monitoring improved with name distinctiveness, whereas the predictive validity of retrospective monitoring improved with facial distinctiveness. Our results indicate that distinctiveness affects not only the strength of the association between a face and a name, but also the ability to monitor that association.     

Judging approachability on the face of it: the influence of face and body expressions on the perception of approachability

The aim of the current study was to examine how emotional expressions displayed by the face and body influence the decision to approach or avoid another individual. In Experiment 1, we examined approachability judgments provided to faces and bodies presented in isolation that were displaying angry, happy, and neutral expressions. Results revealed that angry expressions were associated with the most negative approachability ratings, for both faces and bodies. The effect of happy expressions was shown to differ for faces and bodies, with happy faces judged more approachable than neutral faces, whereas neutral bodies were considered more approachable than happy bodies. In Experiment 2, we sought to examine how we integrate emotional expressions depicted in the face and body when judging the approachability of face-body composite images. Our results revealed that approachability judgments given to face-body composites were driven largely by the facial expression. In Experiment 3, we then aimed to determine how the categorization of body expression is affected by facial expressions. This experiment revealed that body expressions were less accurately recognized when the accompanying facial expression was incongruent than when neutral. These findings suggest that the meaning extracted from a body expression is critically dependent on the valence of the associated facial expression.