Effect-based control of facial expressions: evidence from action-effect compatibility

Facial expressions such as smiling or frowning are normally followed by, and often aim at, the observation of corresponding facial expressions in social counterparts. Given this contingency between one’s own and other persons’ facial expressions, the production of such facial actions might be the subject of so-called action–effect compatibility effects. In the present Experiment 1, we confirmed this assumption. Participants were required to smile or frown. The generation of these expressions was harder when participants produced predictable feedback from a virtual counterpart that was incompatible with their own facial expression; for example, smiling produced the presentation of a frowning face. The results of Experiment 2 revealed that this effect vanishes with inverted faces as action feedback, which shows that the phenomenon is bound to the instantaneous emotional interpretation of the feedback. These results comply with the assumption that the generation of facial expressions is controlled by an anticipation of these expressions’ effects in the social environment.     

The effect of facial feedback on the evaluation of statements describing everyday situations and the role of awareness

According to theories of embodiment enacting a smile or a frown can positively or negatively influence one’s evaluations, even without awareness of one’s facial activity. While some previous studies found evidence for facial feedback effects, recent replication attempts could not confirm these findings. Are our decisions throughout the day amenable to the state of our facial muscles? We tested the effect of smiling and frowning on the evaluation of emotional sentences describing everyday situations. While most previous studies based their assessment of awareness on verbal debriefing interviews without explicitly defined criteria, we employed a written debriefing questionnaire in order to avoid potential bias when identifying participants’ awareness. Our results indicate that smiling/frowning increased/decreased sentence ratings only for participants aware of their expressions. This emphasizes the importance of more rigorous awareness tests in facial feedback studies. Our results support the view that facial feedback cannot necessarily influence us without conscious mediation.     

When smiles (and frowns) speak words: Does power impact the correspondence between self-reported affect and facial expressions?

Self-reported experiences are often poor indicators of outward expressions. Here we examine social power as a variable that may impact the relationship between self-reported affect and facial expressions. Earlier studies addressing this issue were limited by focusing on a single facial expression (smiling) and by using different, less sensitive methods that yielded mostly null results. Sampling, for the first time, self-reported affect repeatedly in response to different negative, neutral and positive stimuli, and measuring concurrent facial muscle activation via electromyography, we found that high power (vs. baseline) increased the correspondence between self-reported positive affect and smiling. There was also an indication that high power (vs. baseline) bolstered the association between self-reported negative affect and frowning but the effect did not pass more stringent criteria for significance (p ≤ .005) and was therefore deemed inconclusive. The prediction that low power (vs. baseline) decreases the correspondence between self-reported affect and smiling and frowning facial expressions was not supported. Taken together, it would appear that (high) power can impact the relationship between self-reported affect and facial expressions, but it remains to be seen whether this effect extends beyond smiling facial expressions.     

Smiling, frowning, and autonomic activity in mildly depressed and nondepressed men in response to emotional imagery of social contexts

The study examined self-reported emotion and facial muscle and autonomic activity of depressed and nondepressed men in response to the social context of emotional situations. 20 university men, assessed on the Beck Depression Inventory, were asked to imagine happy and sad situations with and without visualizing other people. No differences were found between men classified as depressed and nondepressed on self-reported emotion and facial muscle activity. Smiling did not show differences between social contexts although self-reported happiness was increased during happy-social compared to happy-solitary imagery. Adjusting smiling for social context differences in happiness showed less smiling during happy-social than during happy-solitary imagery. In contrast, self-reported sadness and frowning were greater during sad-social compared to sad-solitary imagery. No differences between social contexts were found when frowning was adjusted for social context differences in sadness. Depressed-scoring men showed higher mean heart rate during sad-social than sad-solitary imagery whereas nondepressed-scoring men showed higher mean heart rate during happy social compared to happy-solitary imagery. The results indicate that men may frown more when sad but generally do not smile more during happy-social imagery, independent of depression. Depressed mood may affect heart rate during sad imagery but may not alter facial muscle activity and self:reported emotion in men.     

You may look unhappy unless you smile: The distinctiveness of a smiling face against faces without an explicit smile

An expressionless face is often perceived as rude whereas a smiling face is considered as hospitable. Repetitive exposure to such perceptions may have developed stereotype of categorizing an expressionless face as expressing negative emotion. To test this idea, we displayed a search array where the target was an expressionless face and the distractors were either smiling or frowning faces. We manipulated set size. Search reaction times were delayed with frowning distractors. Delays became more evident as the set size increased. We also devised a short-term comparison task where participants compared two sequential sets of expressionless, smiling, and frowning faces. Detection of an expression change across the sets was highly inaccurate when the change was made between frowning and expressionless face. These results indicate that subjects were confused with expressed emotions on frowning and expressionless faces, suggesting that it is difficult to distinguish expressionless face from frowning faces.     

Brighten up: Smiles facilitate perceptual judgment of facial lightness

The metaphoric expression ‘bright smile’ may reflect the actual judgment of facial lightness under varying emotional expressions. The present research examined whether people in fact judge smiling faces as perceptually brighter than frowning faces. Four studies demonstrated that participants believed smiling faces were brighter compared to frowning faces in a binary choice task and in an absolute judgment task. The results suggest that emotional expressions (i.e., smiles and frowns) can bias judgments of facial brightness in ways consistent with the metaphor. Among other implications, such results suggest that stereotypes about darker-skinned individuals may be attenuated by smiles.     

The effect of emotional clarity and attention to emotion on job satisfaction: A mediating role of emotion regulation among Chinese medical staff

The present study examined the relationships among attention to emotion, emotional clarity, emotion regulation, and job satisfaction, and tested whether the plausible associations between emotional processes (e.g., attention to emotion, emotional clarity) and job satisfaction can be mediated by emotion regulation in a sample of Chinese medical staff. In total, 1,766 medical staff in Guangdong province completed questionnaires including the demographics, the Minnesota Satisfaction Questionnaire, Emotional Clarity, Attention to Emotion, and the Emotion Regulation Questionnaire. Results showed significant direct effect of emotional clarity, but not attention to emotion on job satisfaction. Cognitive reappraisal significantly mediated the associations between emotional processes (e.g., attention to emotion, emotional clarity) and job satisfaction whereas expressive suppression was not a statistically significant mediator. These results suggest that attention to emotion and emotional clarity contribute to job satisfaction by increasing certain emotion regulation strategies such as reappraisal. Intervention or medical education programs targeting enhancing emotional clarity and reappraisal may be beneficial for increasing job satisfaction of medical staff in China.     

Automatic behavioural responses to valence: Evidence that facial action is facilitated by evaluative processing

Are motor schemata of facial action spontaneously activated upon the processing of evaluative information? In this case, the processing of positive evaluative information should immediately trigger the motor schema of smiling, and the processing of negative information should trigger frowning. This hypothesis was tested in two experiments in which participants were required to respond to positive and negative words by either smiling or frowning. Electromyogram (EMG) activity was recorded over the brow muscle region (corrugator supercilii) and over the cheek muscle region (zygomaticus major) in order to quantify the latency of muscular response as a dependent measure. In Experiment 1 we found that participants were faster at contracting their zygomaticus muscle (which is involved in smiling) when evaluating positive words, and faster at contracting their corrugator muscle (which is involved in frowning) when evaluating negative words. In Experiment 2, participants were required to respond with the contraction of one of the two muscles whenever a word appeared on the computer screen. Again, we found that responses were faster to congruent response valence combinations than to incongruent response valence combinations. These findings support the hypothesis that evaluative processing is directly linked to motor schemata of facial muscles.     

Toddlers’ affective responses to sociomoral scenes: Insights from physiological measures

A growing literature suggests that preverbal infants are sensitive to sociomoral scenes and prefer prosocial agents over antisocial agents. It remains unclear, however, whether and how emotional processes are implicated in infants’ responses to prosocial/antisocial actions. Although a recent study found that infants and toddlers showed more positive facial expressions after viewing helping (vs. hindering) events, these findings were based on naïve coder ratings of facial activity; furthermore, effect sizes were small. The current studies examined 18- and 24-month-old toddlers’ real-time reactivity to helping and hindering interactions using three physiological measures of emotion-related processes. At 18 months, activity in facial musculature involved in smiling/frowning was explored via facial electromyography (EMG). At 24 months, stress (sweat) was explored via electrodermal activity (EDA). At both ages, arousal was explored via pupillometry. Behaviorally, infants showed no preferences for the helper over the hinderer across age groups. EMG analyses revealed that 18-month-olds showed higher corrugator activity (more frowning) during hindering (vs. helping) actions, followed by lower corrugator activity (less frowning) after hindering (vs. helping) actions finished. These findings suggest that antisocial actions elicited negativity, perhaps followed by brief disengagement. EDA analyses revealed no significant event-related differences. Pupillometry analyses revealed that both 18- and 24-month-olds’ pupils were smaller after viewing hindering (vs. helping), replicating recent evidence with 5-month-olds and suggesting that toddlers also show less arousal following hindering than following helping. Together, these results provide new evidence with respect to whether and how arousal/affective processes are involved when infants process sociomoral scenarios.     

Facial reactions to emotional stimuli: Automatically controlled emotional responses

Based on a model in which the facial muscles can be both automatically/involuntarily controlled and voluntarily controlled by conscious processes, we explore whether spontaneously evoked facial reactions can be evaluated in terms of criteria for what characterises an automatic process. In three experiments subjects were instructed to not react with their facial muscles, or to react as quickly as possible by wrinkling the eyebrows (frowning) or elevating the cheeks (smiling) when exposed to pictures of negative or positive emotional stimuli, while EMG activity was measured from the corrugator supercilii and zygomatic major muscle regions. Consistent with the proposition that facial reactions are automatically controlled, the results showed that the corrugator muscle reaction was facilitated to negative stimuli and the zygomatic muscle reaction was facilitated to positive stimuli. The results further showed that, despite the fact that subjects were required to not react with their facial muscles at all, they could not avoid producing a facial reaction that corresponded to the negative and positive stimuli.     

Error monitoring in the hemispheres: the effect of lateralized feedback on lexical decision.

Does each hemisphere have its own system for monitoring and responding to errors? Three experiments investigate the effect of presenting lateralized accuracy feedback in a bilateral lexical decision task. We presented feedback after each trial in either the left visual field (LVF) or right visual field (RVF). In Experiment 1 the feedback stimuli were faces smiling or frowning, in Experiment 2 we used colored squares, and Experiment 3 tested the effect of verbal feedback. Negative feedback presented in the LVF tended to improve performance on the following trial, while the same negative feedback in the RVF tended to disrupt performance on the following trial. This result was strongest with the faces as feedback, was less pronounced with colored squares, and disappeared with verbal feedback. The results are interpreted as suggesting a right hemisphere superiority for error monitoring that depends on the mode of feedback.     

Emotion and Pain: A Functional Cerebral Systems Integration

Emotion and pain are psychological constructs that have received extensive attention in neuropsychological research. However, neuropsychological models of emotional processing have made more progress in describing how brain regions interact to process emotion. Theories of emotional processing can describe inter-hemispheric and intra-hemispheric interactions during emotional processing. Due to similarities between emotion and pain, it is thought that emotional models can be applied to pain. The following review examines the neuropsychology of emotion and pain using a functional cerebral systems approach. Specific comparisons are made between pain and anger. Attention is given to differences in cerebral function and physiology that may contribute to the processing of emotion and pain. Suggestions for future research in emotion and pain are given.     

Duchenne smile,emotional experience,and autonomic reactivity: a test of the facial feedback hypothesis

This study examined the modulatory function of Duchenne and non-Duchenne smiles on subjective and autonomic components of emotion. Participants were asked to hold a pencil in their mouth to either facilitate or inhibit smiles and were not instructed to contract specific muscles. Five conditions--namely lips pressing, low-level non-Duchenne smiling, high-level non-Duchenne smiling, Duchenne smiling, and control--were produced while participants watched videoclips that were evocative of positive or negative affect. Participants who displayed Duchenne smiles reported more positive experience when pleasant scenes and humorous cartoons were presented. Furthermore, they tended to exhibit different patterns of autonomic arousal when viewing positive scenes. These results support thefacial feedback hypothesis and suggest that facial feedback has more powerful effects when facial configurations represent valid analogs of basic emotional expressions.     

Embodied Attitude Change: A Self‐Validation Perspective

Our behavior can change what we like and dislike. Although it seems clear that we might like something more when we smile (versus frown), or when we nod our heads (versus shake), it is important to understand the processes responsible for these changes in evaluation. It might be that agreement behaviors such as smiling and nodding work as cue, make us think about everything in a positive light, or it might be that they encourage us not to think much about the information we receive. This review describes the basic processes underlying embodied change, highlighting the role of a recently discovered meta‐cognitive process (called self‐validation) by which bodily responses can validate or invalidate (instead of changing) our thoughts. This new mechanism can account for some already established outcomes in embodied persuasion (e.g., more persuasion with smiling than frowning), but by a different process than postulated previously (smiling increases confidence in thoughts), as well as for some new findings (e.g., more persuasion for low than high powerful postures; more self‐confidence when performing doubtful postures).     

Racial discrimination by low-prejudiced whites. Facial movements as implicit measures of attitudes related to behavior

We investigated the relationship of implicit racial prejudice to discriminatory behavior. White university students chose the best of three applicants (two were White and one was Black) for a prestigious teaching fellowship. They then completed the Implicit Association Test (IAT), a measure of implicit racial bias. Three weeks later, participants completed a second implicit measure of racial bias by viewing photos of Whites and Blacks while facial electromyography (EMG) was recorded from sites corresponding to the muscles used in smiling and frowning. Analyses revealed that bias in cheek EMG activity was related to the race of the chosen applicant, whereas bias on the IAT was not. Motivations to control prejudiced reactions were not related to EMG activity or the race of the applicant chosen, but were related to IAT bias. The findings indicate that facial EMG can be used as an implicit measure of prejudice related to discrimination.     

The face of fluency: Semantic coherence automatically elicits a specific pattern of facial muscle reactions

This study shows that high conceptual fluency induced by hidden semantic coherence automatically triggers a specific pattern of facial expressions. In the present study, word triads that either had or had not a common remote associate were read by individuals while automatic facial responses were recorded. Although participants were ignorant about the underlying semantic structure, participants’ faces showed an activation of the smiling muscle zygomaticus major (indicating increased positive affect), a relaxation of the frowning muscle corrugator supercilii (indicating decreased negative affect and mental effort), and a relaxation of the forehead muscle frontalis (indicating increased familiarity) after reading coherent compared to incoherent word triads. Implications for intuitive judgements of semantic coherence are discussed.     

Recognition,discrimination and categorization of smiling by 5-month-old infants

Perceiving emotions correctly is foundational to the development of interpersonal skills. Five-month-old infants’ abilities to recognize, discriminate and categorize facial expressions of smiling were tested in three coordinated experiments. Infants were habituated to four degrees of smiling modeled by the same or different people; following habituation, infants were presented with a new degree of smile worn by the same and by a new person (Experiment 1), a new degree of smile and a fearful expression worn by the same person (Experiment 2) or a new degree of smile and a fearful expression worn by new people (Experiment 3). Infants showed significant novelty preferences for the new person smiling and for the fearful expressions over the new degree of smiling. These findings indicate that infants at 5 months can categorize the facial expression of smiling in static faces, and yet recognize the same person despite changes in facial expression; this is the youngest age at which these abilities have been demonstrated. The findings are discussed in light of the significance of emotion expression face processing in social interaction and infants’ categorization of faces.     

哭泣表情面孔的注意偏向:眼动的证据

研究采用双选择Oddball范式和线索-靶子范式,并结合眼动技术,以微笑、哭泣和中性表情面孔为刺激材料,综合考察哭泣表情面孔在识别和解离过程中的注意偏向。研究发现:在识别阶段,哭泣表情面孔的识别正确率和反应速度都显著优于微笑表情面孔,进一步的兴趣区注视偏向分析发现,哭泣和微笑表情面孔的注视模式既具有一致的规律,又存在细微的差异;在解离阶段,返回抑制受线索表情类型的影响,在有效线索条件下,哭泣表情线索呈现后个体对目标刺激的平均注视时间和眼跳潜伏期都显著短于其它表情线索。表明哭泣表情面孔在识别和解离过程中具有不同的注意偏向表现,在识别阶段表现为反应输出优势和注视模式上的一致性与差异性;在解离阶段表现为有效线索条件下,对目标刺激定位和视觉加工的促进作用。     

Dismissing-avoidant pattern of attachment and mimicry reactions at different levels of information processing

Individuals with a dismissing-avoidant pattern of attachment are assumed to repress anxiety-related signals, a disposition hypothesized to interfere with facial mimicry and emotional contagion. Further, they are assumed to have one internal working model associated with anxiety, operating out of awareness at early, automatic stages of information processing, and another positive model operating at later, cognitively controlled stages of processing. The main aim of the present investigation was to compare facial mimicry in dismissing-avoidant and non-dismissing subjects at different levels of information processing. Pictures of happy and angry faces were exposed to 61 subjects at three different exposure times (17, 56, and 2,350 ms) in order to elicit facial muscle reactions, first at automatic levels and then at a more controlled levels. Corrugator activity ("frowning muscles") represented negative emotions and zygomaticus activity ("smiling muscles") positive emotions. The dismissing-avoidant subjects scored significantly lower on emotional empathy than the non-dismissing subjects. At the automatic level the dismissing-avoidant subjects showed "normal" corrugator responses (negative emotions) upon exposure to angry faces. At the cognitively controlled level of processing (2,350 ms) a significant interaction effect was shown between Faces x Muscles x Attachment pattern. The dismissing-avoidant subjects showed no corrugator response and an increased zygomaticus response ("smiling reaction") to the angry face, whereas the non-dismissing subjects reacted with a significant mimicking reaction. The dismissing-avoidant subjects' tendency to "smiling" in response to the angry face at the controlled level (2,350 ms) may be interpreted as a repression of their earlier, automatically evoked (56 ms) negative emotional reaction.     

A computational model based on Gross’ emotion regulation theory

Emotion regulation describes how a subject can use certain strategies to affect emotion response levels. Usually, models for emotion regulation assume mechanisms based on feedback loops that indicate how to change certain aspects of behavior or cognitive functioning in order to get a more satisfactory emotion response level. Adaptation of such feedback loops is usually left out of consideration. This paper introduces an adaptive computational model for emotion regulation by formalizing the model informally described by Gross (1998). The model has been constructed using a high-level modeling language, and integrates both quantitative aspects (such as levels of emotional response) and qualitative aspects (such as decisions to regulate one’s emotion). This model includes mechanisms for adaptivity of the degree of flexibility of the emotion regulation process. Also, the effects of events like traumas or therapies on emotion regulation can be simulated. Based on this computational model, a number of simulation experiments have been performed and evaluated.