Culture and facial expressions of emotion

With over a century of theoretical developments and empirical investigation in broad fields (e.g., anthropology, psychology, evolutionary biology), the universality of facial expressions of emotion remains a central debate in psychology. How near or far, then, is this debate from being resolved? Here, I will address this question by highlighting and synthesizing the significant advances in the field that have elevated knowledge of facial expression recognition across cultures. Specifically, I will discuss the impact of early major theoretical and empirical contributions in parallel fields and their later integration in modern research. With illustrative examples, I will show that the debate on the universality of facial expressions has arrived at a new juncture and faces a new generation of exciting questions.     

Representation of facial expressions of emotion

Inversion interferes with the encoding of configural and holistic information more than it does with the encoding of explicitly represented and isolated parts. Accordingly, if facial expressions are explicitly represented in the face representation, their recognition should not be greatly affected by face orientation. In the present experiment, response times to detect a difference in hair color in line-drawn faces were unaffected by face orientation, but response times to detect the presence of brows and mouth were longer with inverted than with upright faces, independent of the emergent expression (neutral, happy, sad, and angry). Expressions are not explicitly represented; rather, they and the face configuration are represented as undecomposed wholes.     

Flashbulb memories: Conceptual and methodological issues

Abstract

Although flashbulb memory research is now well established, it is still not clear exactly what researchers are referring to as flashbulbs, and what is the best way to address the phenomenon. There are at least two ways in which the term “flashbulbs” is used, and at least two conceptual approaches that can be used to research them. The first usage corresponds to the bold theoretical conjectures put forward by Brown and Kulik (1977). The second results from empirical classification and intuitively lacks the essence conveyed by the first meaning. The two approaches concentrate on the cognitive and societal aspects, respectively. Although these are not incompatible, they make different assumptions and use different methodologies. We argue that research should be directed towards more unified theorising, and we describe methodologies appropriate for this approach.     

Visual-field bias in the judgment of facial expression of emotion

The left and right hemispheres of the brain are differentially related to the processing of emotions. Although there is little doubt that the right hemisphere is relatively superior for processing negative emotions, controversy exists over the hemispheric role in the processing of positive emotions. Eighty right-handed normal male participants were examined for visual-field (left-right) differences in the perception of facial expressions of emotion. Facial composite (RR, LL) and hemifacial (R, L) sets depicting emotion expressions of happiness and sadness were prepared. Pairs of such photographs were presented bilaterally for 150 ms, and participants were asked to select the photographs that looked more expressive. A left visual-field superiority (a right-hemisphere function) was found for sad facial emotion. A hemispheric advantage in the perception of happy expression was not found.     

Judgments of facial expressions of emotion in profile

Despite the fact that facial expressions of emotion have signal value, there is surprisingly little research examining how that signal can be detected under various conditions, because most judgment studies utilize full-face, frontal views. We remedy this by obtaining judgments of frontal and profile views of the same expressions displayed by the same expressors. We predicted that recognition accuracy when viewing faces in profile would be lower than when judging the same faces from the front. Contrarily, there were no differences in recognition accuracy as a function of view, suggesting that emotions are judged equally well regardless of from what angle they are viewed.     

Preattentive analysis of facial expressions of emotion

Abstract

Some experiments have shown that a face having an expression different from the others in a crowd can be detected in a time that is independent of crowd size. Although this pop-out effect suggests that the valence of a face is available preattentively, it is possible that it is only the detection of sign features (e.g. angle of brow) which triggers an internal code for valence. In experiments testing the merits of valence and feature explanations, subjects searched displays of schematic faces having sad, happy, and vacant mouth expressions for a face having a discrepant sad or happy expression. Because inversion destroys holistic face processing and the implicit representation of valence, a critical test was whether pop-out occurred for inverted faces. Flat search functions (pop-out) for upright and inverted faces provided equivocal support for both explanations. But intercept effects found only with normal faces indicated valences had been analysed at an early stage of stimulus encoding.     

Congruence of meaning between facial expressions of emotion and selected emotion terms

How similar are the meanings of facial expressions of emotion and the emotion terms frequently used to label them? In three studies, subjects made similarity judgments and emotion self-report ratings in response to six emotion categories represented in Ekman and Friesen's Pictures of Facial Affect, and their associated labels. Results were analyzed with respect to the constituent facial movements using the Facial Action Coding System, and using consensus analysis, multidimensional scaling, and inferential statistics. Shared interpretation of meaning was found between individuals and the group, with congruence between the meaning in facial expressions, labeling using basic emotion terms, and subjects' reported emotional responses. The data suggest that (1) the general labels used by Ekman and Friesen are appropriate but may not be optimal, (2) certain facial movements contribute more to the perception of emotion than do others, and (3) perception of emotion may be categorical rather than dimensional.     

Dynamic facial expressions of emotion induce representational momentum

Two experiments were conducted to explore whether representational momentum (RM) emerges in the perception of dynamic facial expression and whether the velocity of change affects the size of the effect. Participants observed short morphing animations of facial expressions from neutral to one of the six basic emotions. Immediately afterward, they were asked to select the last images perceived. The results of the experiments revealed that the RM effect emerged for dynamic facial expressions of emotion: The last images of dynamic stimuli that an observer perceived were of a facial configuration showing stronger emotional intensity than the image actually presented. The more the velocity increased, the more the perceptual image of facial expression intensified. This perceptual enhancement suggests that dynamic information facilitates shape processing in facial expression, which leads to the efficient detection of other people's emotional changes from their faces.     

Conceptual,methodological, and clinical issues in cognitive-behavioral assessment

This article reviews cognitive-behavioral assessment principles and procedures. The functions of such assessments are noted, and issues and advances in cognitive assessment are discussed. The need for integrated cognitive, behavioral, and affective assessments is then explored. Finally, conceptual methodological, and clinical issues in the integration of assessments and study of reciprocal determinants are presented.Preparation of this paper was supported in part by a General Research Board Faculty Research Award from the University of Maryland. The author would like to thank Steve Graham, Donald Meichenbaum, Barbara Keogh, and Bernice Wong for their feedback during the preparation of this paper.     

Universals and cultural differences in the judgments of facial expressions of emotion

We present here new evidence of cross-cultural agreement in the judgement of facial expression. Subjects in 10 cultures performed a more complex judgment task than has been used in previous cross-cultural studies. Instead of limiting the subjects to selecting only one emotion term for each expression, this task allowed them to indicate that multiple emotions were evident and the intensity of each emotion. Agreement was very high across cultures about which emotion was the most intense. The 10 cultures also agreed about the second most intense emotion signaled by an expression and about the relative intensity among expressions of the same emotion. However, cultural differences were found in judgments of the absolute level of emotional intensity.     

Communal and agentic behaviour in response to facial emotion expressions

Facial emotions are important for human communication. Unfortunately, traditional facial emotion recognition tasks do not inform about how respondents might behave towards others expressing certain emotions. Approach‐avoidance tasks do measure behaviour, but only on one dimension. In this study 81 participants completed a novel Facial Emotion Response Task. Images displaying individuals with emotional expressions were presented in random order. Participants simultaneously indicated how communal (quarrelsome vs. agreeable) and how agentic (dominant vs. submissive) they would be in response to each expression. We found that participants responded differently to happy, angry, fearful, and sad expressions in terms of both dimensions of behaviour. Higher levels of negative affect were associated with less agreeable responses specifically towards happy and sad expressions. The Facial Emotion Response Task might complement existing facial emotion recognition and approach‐avoidance tasks.     

The forced-choice paradigm and the perception of facial expressions of emotion

The view that certain facial expressions of emotion are universally agreed on has been challenged by studies showing that the forced-choice paradigm may have artificially forced agreement. This article addressed this methodological criticism by offering participants the opportunity to select a none of these terms are correct option from a list of emotion labels in a modified forced-choice paradigm. The results show that agreement on the emotion label for particular facial expressions is still greater than chance, that artifactual agreement on incorrect emotion labels is obviated, that participants select the none option when asked to judge a novel expression, and that adding 4 more emotion labels does not change the pattern of agreement reported in universality studies. Although the original forced-choice format may have been prone to artifactual agreement, the modified forced-choice format appears to remedy that problem.     

Sender repertoires of pure and blended facial expressions of emotion

Six actors attempted to communicate by facial expression seven assumedly basic emotions (pleasure, surprise, fear, hate, sorrow, disgust and interest), and all pairwise blends, e.g., fear+sorrow. One hundred and eighty-two subjects (divided into groups as to the six actors) judged pictures of these emotions by three methods: (1) mapping, placing the pictures on coordinate systems with denotated axes, (2) identification and (3) sorting similar emotions into the same pile, followed by multidimensional scaling and cluster analyses. Recognition of the emotions was fairly good, though not equally good for all emotions and their blends; also the actors' ability to express emotions varied. Emotions of opposite hedonic tone did not blend well. Interest seemed to lend poignancy to the basic emotion with which it was blended rather than to constitute an emotion in itself. Expressions seemed to be more easily identified if the actor did not try to feel the emotion too deeply.     

Discrimination of facial expressions of emotion by depressed subjects

A frequent complaint of depressed people concerns their poor interpersonal relationships. Yet, although nonverbal cues are considered of primary importance in interpersonal communication, the major theories of depression focus little attention on nonverbal social perception. The present study investigated the ability of depressed, disturbed control, and normal American adults to make rapid discriminations of facial emotion. We predicted and found that depressed subjects were slower than normal subjects in facial emotion discrimination but were not slower in word category discrimination. These findings suggest that current theories of depression may need to address difficulties with nonverbal information processing. There were also no significant differences between depressed and disturbed control subjects, suggesting that the unique social-behavioral consequences of depression have yet to be identified.     

Conceptual and methodological issues in examining behavioral development through environment-organism interactions

The importance of understanding behavior in terms of interactions between organismic and environmental variables has become more salient and calls for research focused on such interactions have been made. However, several conceptual paths may encourage investigating and understanding behavior in terms of organism-environment interactions. One such path is the development and testing of constructs which cut across the traditional organism-environment dichotomy and conceptualize behavioral development as fundamentally an organism-environment interaction. In this paper, a metatheoretical framework for thinking about behavioral development as fundamentally an organism-environment interaction is presented. Issues involved in conceptualizing and examining behavior and behavioral development as fundamentally an organism-environment interaction are also examined by reviewing the concept of affordances and some of the illustrative research that has been conducted. From the review, it is suggested that research which attempts to understand behavior as inseparably a function of organism-environment interactions will benefit if additional methodological avenues are developed. Marken's (1997, Psychological Methods, 2, 436–446) test for controlled variables is presented as an example of one such method. Finally, suggestions for developing the ideas reviewed in this paper for other research domains (i.e., anxiety in children) are also presented.     

Conceptual,methodological, and clinical issues in the assessment of anxiety disorders

Many conceptual, methodological, and clinical issues remain unresolved in the assessment of anxiety disorders. Despite the prevalence, incidence, chronicity, and severity of anxiety disorders, research efforts and funding have fallen behind with regard both to other disorders and to addressing critical issues in the field. The primary objective of this paper is to provide a scientific critique regarding a number of often ignored yet salient considerations in anxiety-disorders assessment. Critical analyses of and recommendations regarding the multidimensional nature of anxiety, comorbidity, uniformity myths, synchrony, normative comparisons, psychometric properties of measures, and treatment integrity are offered. Finally, promising areas of clinical research are presented to enhance further the current understanding of the complexities inherent in assessing anxiety disorders.Preparation of this paper was supported in part by NIMH Grant MH36299.     

Common cues to emotion in the dynamic facial expressions of speech and song

Speech and song are universal forms of vocalization that may share aspects of emotional expression. Research has focused on parallels in acoustic features, overlooking facial cues to emotion. In three experiments, we compared moving facial expressions in speech and song. In Experiment 1, vocalists spoke and sang statements each with five emotions. Vocalists exhibited emotion-dependent movements of the eyebrows and lip corners that transcended speech–song differences. Vocalists’ jaw movements were coupled to their acoustic intensity, exhibiting differences across emotion and speech–song. Vocalists’ emotional movements extended beyond vocal sound to include large sustained expressions, suggesting a communicative function. In Experiment 2, viewers judged silent videos of vocalists’ facial expressions prior to, during, and following vocalization. Emotional intentions were identified accurately for movements during and after vocalization, suggesting that these movements support the acoustic message. Experiment 3 compared emotional identification in voice-only, face-only, and face-and-voice recordings. Emotion judgements for voice-only singing were poorly identified, yet were accurate for all other conditions, confirming that facial expressions conveyed emotion more accurately than the voice in song, yet were equivalent in speech. Collectively, these findings highlight broad commonalities in the facial cues to emotion in speech and song, yet highlight differences in perception and acoustic-motor production.