When the smile is a cue to familiarity

The question discussed in the two following experiments concerns the effect of facial expressions on face recognition. Famous and unknown faces with neutral or smiling expression were presented for different inspection durations (15 ms vs 1000 ms). Subjects had to categorize these faces as famous or unknown (Experiment 1), or estimate their degree of familiarity on a rating scale (Experiment 2). Results showed that the smile increased ratings of familiarity for unfamiliar faces (Experiments 1 and 2) and for famous faces (Experiment 2). These data are discussed in the framework of current face-recognition models and are interpreted in terms of social value of the smile. It is proposed that the smiling bias found here acts at the level of the decision process.     

Discrimination of facial expression by 5-month-old infants of nondepressed and clinically depressed mothers

Five-month-old infants of nondepressed and clinically depressed mothers were habituated to either a face with a neutral expression or the same face with a smile. Infants of nondepressed mothers subsequently discriminated between neutral and smiling facial expressions, whereas infants of clinically depressed mothers failed to make the same discrimination.     

When the smile is a cue to familiarity

The question discussed in the two following experiments concerns the effect of facial expressions on face recognition. Famous and unknown faces with neutral or smiling expression were presented for different inspection durations (15 ms vs 1000 ms). Subjects had to categorise these faces as famous or unknown (Experiment 1), or estimate their degree of familiarity on a rating scale (Experiment 2). Results showed that the smile increased ratings of familiarity for unfamiliar faces (Experiments 1 and 2) and for famous faces (Experiment 2). These data are discussed in the framework of current face-recognition models and are interpreted in terms of social value of the smile. It is proposed that the smiling bias found here acts at the level of the decision process.     

A smile biases the recognition of eye expressions: Configural projection from a salient mouth

A smile is visually highly salient and grabs attention automatically. We investigated how extrafoveally seen smiles influence the viewers' perception of non-happy eyes in a face. A smiling mouth appeared in composite faces with incongruent non-happy (fearful, neutral, etc.) eyes, thus producing blended expressions, or it appeared in intact faces with genuine expressions. Attention to the eye region was spatially cued while foveal vision of the mouth was blocked by gaze-contingent masking. Participants judged whether the eyes were happy or not. Results indicated that the smile biased the evaluation of the eye expression: The same non-happy eyes were more likely to be judged as happy and categorized more slowly as not happy in a face with a smiling mouth than in a face with a non-smiling mouth or with no mouth. This bias occurred when the mouth and the eyes appeared simultaneously and aligned, but also to some extent when they were misaligned and when the mouth appeared after the eyes. We conclude that the highly salient smile projects to other facial regions, thus influencing the perception of the eye expression. Projection serves spatial and temporal integration of face parts and changes.     

Effect-based control of facial expressions: evidence from action-effect compatibility

Facial expressions such as smiling or frowning are normally followed by, and often aim at, the observation of corresponding facial expressions in social counterparts. Given this contingency between one’s own and other persons’ facial expressions, the production of such facial actions might be the subject of so-called action–effect compatibility effects. In the present Experiment 1, we confirmed this assumption. Participants were required to smile or frown. The generation of these expressions was harder when participants produced predictable feedback from a virtual counterpart that was incompatible with their own facial expression; for example, smiling produced the presentation of a frowning face. The results of Experiment 2 revealed that this effect vanishes with inverted faces as action feedback, which shows that the phenomenon is bound to the instantaneous emotional interpretation of the feedback. These results comply with the assumption that the generation of facial expressions is controlled by an anticipation of these expressions’ effects in the social environment.     

When does the brain distinguish between genuine and ambiguous smiles? An ERP study

Event-related brain potentials (ERPs) were recorded to assess the processing time course of ambiguous facial expressions with a smiling mouth but neutral, fearful, or angry eyes, in comparison with genuinely happy faces (a smile and happy eyes) and non-happy faces (neutral, fearful, or angry mouth and eyes). Participants judged whether the faces looked truly happy or not. Electroencephalographic recordings were made from 64 scalp electrodes to generate ERPs. The neural activation patterns showed early P200 sensitivity (differences between negative and positive or neutral expressions) and EPN sensitivity (differences between positive and neutral expressions) to emotional valence. In contrast, sensitivity to ambiguity (differences between genuine and ambiguous expressions) emerged only in later LPP components. Discrimination of emotional vs. neutral affect occurs between 180 and 430 ms from stimulus onset, whereas the detection and resolution of ambiguity takes place between 470 and 720 ms. In addition, while blended expressions involving a smile with angry eyes can be identified as not happy in the P200 (175–240 ms) component, smiles with fearful or neutral eyes produce the same ERP pattern as genuinely happy faces, thus revealing poor discrimination.     

Brighten up: Smiles facilitate perceptual judgment of facial lightness

The metaphoric expression ‘bright smile’ may reflect the actual judgment of facial lightness under varying emotional expressions. The present research examined whether people in fact judge smiling faces as perceptually brighter than frowning faces. Four studies demonstrated that participants believed smiling faces were brighter compared to frowning faces in a binary choice task and in an absolute judgment task. The results suggest that emotional expressions (i.e., smiles and frowns) can bias judgments of facial brightness in ways consistent with the metaphor. Among other implications, such results suggest that stereotypes about darker-skinned individuals may be attenuated by smiles.     

Categorization and understanding of facial expressions in 4‐month‐old infants

This study examined whether 4‐month‐olds (N = 40) could perceptually categorize happy and angry faces, and show appropriate behavior in response to these faces. During the habituation phase, infants were shown the same type of facial expressions (happy or angry) posed by three models, and their behavior in response to those faces was observed. During the test phase immediately after the habituation phase, infants saw a novel emotional expression and a familiar expression posed by a new model, and their looking times were measured. The results indicated that, although 4‐month‐olds could perceptually categorize happy and angry faces accurately, they responded positively to both expression types. These findings suggest that, although infants can perceptually categorize facial expressions at 4 months of age, they require further time to learn the affective meanings of the facial expressions.     

Influence of emotional facial expressions on 3-5-year-olds’ face recognition

Three experiments examined 3- and 5-year-olds’ recognition of faces in constant and varied emotional expressions. Children were asked to identify repeatedly presented target faces, distinguishing them from distractor faces, during an immediate recognition test and during delayed assessments after 10 min and one week. Emotional facial expression remained neutral (Experiment 1) or varied between immediate and delayed tests: from neutral to smile and anger (Experiment 2), from smile to neutral and anger (Experiment 3, condition 1), or from anger to neutral and smile (Experiment 3, condition 2). In all experiments, immediate face recognition was not influenced by emotional expression for either age group. Delayed face recognition was most accurate for faces in identical emotional expression. For 5-year-olds, delayed face recognition (with varied emotional expression) was not influenced by which emotional expression had been displayed during the immediate recognition test. Among 3-year-olds, accuracy decreased when facial expressions varied from neutral to smile and anger but was constant when facial expressions varied from anger or smile to neutral, smile or anger. Three-year-olds’ recognition was facilitated when faces initially displayed smile or anger expressions, but this was not the case for 5-year-olds. Results thus indicate a developmental progression in face identity recognition with varied emotional expressions between ages 3 and 5.     

The contribution of facial regions to judgements of happiness and trustworthiness from dynamic expressions

What expressive facial features and processing mechanisms make a person look trustworthy, relative to happy? Participants judged the un/happiness or un/trustworthiness of people with dynamic expressions in which the eyes and/or the mouth unfolded from neutral to happy or vice versa. Faces with an unfolding smile looked more trustworthy and happier than faces with a neutral mouth, regardless of the eye expression. Unfolding happy eyes increased both trustworthiness and happiness only in the presence of a congruent unfolding smiling mouth. Nevertheless, the contribution of the mouth was greater for happiness than for trustworthiness; and the mouth was especially visually salient for expressions favouring happiness more than trustworthiness. We conclude that the categorisation of facial happiness is more automatically driven by the visual saliency of a single feature, that is, the smiling mouth, while perception of trustworthiness is more strategic, with the eyes being necessarily incorporated into a configural face representation.     

Effects of mask use and other-race on face perception,emotion recognition,and social distancing during the COVID-19 pandemic

We tested the effect of mask use and other-race effect on (a) face recognition, (b) recognition of facial expressions, and (c) social distance. Caucasian subjects were tested in a matching-to-sample paradigm with either masked or unmasked Caucasian and Asian faces. The participants exhibited the best performance in recognizing an unmasked face condition and the poorest to recognize a masked face that they had seen earlier without a mask. Accuracy was poorer for Asian faces than Caucasian faces. The second experiment presented Asian or Caucasian faces having emotional expressions, with and without masks. The participants' emotion recognition performance decreased for masked faces. From the most accurately to least accurately recognized emotions were as follows: happy, neutral, disgusted, fearful. Performance was poorer for Asian stimuli compared to Caucasian. In Experiment 3 the same participants indicated the social distance they would prefer with each pictured person. They preferred a wider distance with unmasked faces compared to masked faces. Distance from farther to closer was as follows: disgusted, fearful, neutral, and happy. They preferred wider social distance for Asian compared to Caucasian faces. Altogether, findings indicated that during the COVID-19 pandemic mask wearing decreased recognition of faces and emotional expressions, negatively impacting communication among people from different ethnicities.     

Perception and Expressing Habits of Smiling and Angry Expressions Modulated by Facial Physical Attractiveness in Asian Female Persons

In this study, we investigated the effects of facial physical attractiveness on perception and expressing habit of smiling and angry expressions. In experiment 1, 20 participants rated 60 photo subjects’ smiling and angry expressions of uncontrolled physical expression configuration. The results showed that for the angry faces, the perceived expression intensity and the expression naturalness in the attractive group were significantly stronger than those in the unattractive group; for the smiling faces, this attractiveness bias was not observed. In experiment 2, using artificial expressions made by an identical expression template, interestingly, the perceived expression intensity and the expression naturalness of the smiling faces in the attractive group were stronger than those in the unattractive group, while the impression strength of anger between the two groups was approximately the same. A comparison of the two observations suggests that facial physical attractiveness can enhance the perceived intensity of a smiling expression but not an angry expression, and that the inconsistencies between the two experiments are due to the difference of expressing habits between unattractive and attractive persons. These results have implications as regards the effect of facial attractiveness on the expressing habits of expression senders and the person’s development of social skills.     

Smiling faces rated more feminine than serious faces in Japan

It has been reported that women and girls smile more frequently and more effectively than men and boys. It is expected that this correlation between femaleness and smiling affects the processing of faces, and consequently, smiling faces may be perceived to be more feminine. Participants viewed 30 photographs featuring smiling and serious facial expressions of both male and female subjects and rated them for femininity or masculinity. The result indicated that smiling faces significantly more frequently gave the impression of being more feminine. The interaction between the sex of the faces and their expression was not significant.     

Fearful faces modulate looking duration and attention disengagement in 7-month-old infants

The present study investigated whether facial expressions modulate visual attention in 7-month-old infants. First, infants' looking duration to individually presented fearful, happy, and novel facial expressions was compared to looking duration to a control stimulus (scrambled face). The face with a novel expression was included to examine the hypothesis that the earlier findings of greater allocation of attention to fearful as compared to happy faces could be due to the novelty of fearful faces in infants' rearing environment. The infants looked longer at the fearful face than at the control stimulus, whereas no such difference was found between the other expressions and the control stimulus. Second, a gap/overlap paradigm was used to determine whether facial expressions affect the infants' ability to disengage their fixation from a centrally presented face and shift attention to a peripheral target. It was found that infants disengaged their fixation significantly less frequently from fearful faces than from control stimuli and happy faces. Novel facial expressions did not have a similar effect on attention disengagement. Thus, it seems that adult-like modulation of the disengagement of attention by threat-related stimuli can be observed early in life, and that the influence of emotionally salient (fearful) faces on visual attention is not simply attributable to the novelty of these expressions in infants' rearing environment.     

哭泣表情面孔的注意偏向:眼动的证据

研究采用双选择Oddball范式和线索-靶子范式,并结合眼动技术,以微笑、哭泣和中性表情面孔为刺激材料,综合考察哭泣表情面孔在识别和解离过程中的注意偏向。研究发现:在识别阶段,哭泣表情面孔的识别正确率和反应速度都显著优于微笑表情面孔,进一步的兴趣区注视偏向分析发现,哭泣和微笑表情面孔的注视模式既具有一致的规律,又存在细微的差异;在解离阶段,返回抑制受线索表情类型的影响,在有效线索条件下,哭泣表情线索呈现后个体对目标刺激的平均注视时间和眼跳潜伏期都显著短于其它表情线索。表明哭泣表情面孔在识别和解离过程中具有不同的注意偏向表现,在识别阶段表现为反应输出优势和注视模式上的一致性与差异性;在解离阶段表现为有效线索条件下,对目标刺激定位和视觉加工的促进作用。     

The effects of smiling on perceived age defy belief

It is a common belief that smiling makes people appear younger. Empirical findings, however, suggest that smiling faces are actually perceived as older than neutral faces. Here we show that these two apparently contradictory phenomena can co-exist in the same person. In the first experiment, participants were first asked to estimate the ages of a series of smiling or neutral faces. After that, they were asked to estimate the average age of the set of neutral and smiling faces they had just evaluated. Finally, they were asked what effect smiling has on one’s perceived age. In the experimental session, smiling faces were perceived as older than neutral faces. Nevertheless, after the experiment, consistent with their retrospective evaluations, participants recalled smiling faces as being younger than the neutral faces. Experiment 2 replicated and extended these results to a set of emotional expressions that also included surprised faces. Smiling faces were again perceived as older than neutral faces, which were in turn perceived as older than surprised faces. Again, retrospective evaluations were consistent with the belief that smiling makes people look younger. The findings show that this belief, well-rooted in popular media, is a complete misconception.     

All smiles are positive, but some smiles are more positive than others

Disagreement as to whether all smiling or specific types of smiling index positive emotion early in life was addressed by examining when infants produced different types of smiling and other facial expressions. Thirteen infants were observed weekly from 1 to 6 months of age. Smiling alone--without cheek raising or mouth opening--was relatively more likely than periods without smiling both when mothers were smiling and when infants were gazing at their mothers' faces. Cheek-raise (Duchenne) smiling was relatively more likely than smiling alone only when mothers were smiling. Open-mouth (play) smiling was relatively more likely than smiling alone only when infants were gazing directly at mothers' faces. Smiling involving both cheek raising and mouth opening was relatively likely both when mothers were smiling and when infants were gazing at mothers' faces and became increasingly likely with age when both conditions co-occurred. The cheek-raise and open-mouth dimensions of smiling appear to be associated with, respectively, the amplification of processes of sharing positive affect and of visual engagement that are present to a lesser degree in smiling alone.     

Facial expression recognition in peripheral versus central vision: role of the eyes and the mouth

This study investigated facial expression recognition in peripheral relative to central vision, and the factors accounting for the recognition advantage of some expressions in the visual periphery. Whole faces or only the eyes or the mouth regions were presented for 150 ms, either at fixation or extrafoveally (2.5° or 6°), followed by a backward mask and a probe word. Results indicated that (a) all the basic expressions were recognized above chance level, although performance in peripheral vision was less impaired for happy than for non-happy expressions, (b) the happy face advantage remained when only the mouth region was presented, and (c) the smiling mouth was the most visually salient and most distinctive facial feature of all expressions. This suggests that the saliency and the diagnostic value of the smile account for the advantage in happy face recognition in peripheral vision. Because of saliency, the smiling mouth accrues sensory gain and becomes resistant to visual degradation due to stimulus eccentricity, thus remaining accessible extrafoveally. Because of diagnostic value, the smile provides a distinctive single cue of facial happiness, thus bypassing integration of face parts and reducing susceptibility to breakdown of configural processing in peripheral vision.     

Infant responses to adult happy and sad vocal and facial expressions during face-to-face interactions

We examined 5-month-olds’ responses to adult facial versus vocal displays of happy and sad expressions during face-to-face social interactions in three experiments. Infants interacted with adults in either happy-sad-happy or happy-happy-happy sequences. Across experiments, either facial expressions were present while presence/absence of vocal expressions was manipulated or visual access to facial expressions was blocked but vocal expressions were present throughout. Both visual attention and infant affect were recorded. Although infants looked more when vocal expressions were present, they smiled significantly more to happy than to sad facial expressions regardless of presence or absence of the voice. In contrast, infants showed no evidence of differential responding to voices when faces were obscured; their smiling and visual attention simply declined over time. These results extend findings from non-social contexts to social interactions and also indicate that infants may require facial expressions to be present to discriminate among adult vocal expressions of affect.     

The relation of facial affect recognition and empathy to delinquency in youth offenders

Associations among facial affect recognition, empathy, and self-reported delin-quency were studied in a sample of 29 male youth offenders at a probation placement facility. Youth offenders were asked to recognize facial expressions of emotions from adult faces, child faces, and cartoon faces. Youth offenders also responded to a series of statements on emotional empathy, and provided self-reported acts of delinquency. Findings revealed a moderate positive relationship between ability to recognize the expression, angry, in adult faces, and self-reported acts of delinquent behavior, which included physical violence, theft, and vandalism. Findings revealed a moderate inverse relationship between ability to recognize facial expressions of emotions in child faces and self-reported acts of physical violence. With respect to specific facial expressions of emotions in child faces, a moderate inverse relationship was found between ability to recognize the expression, fearful, and self-reported acts of physical violence. A moderate positive relationship was found between ability to recognized the expression, fearful, in child faces, and ability to empathize with the emotional experiences of others. Strong and moderate links were found between the negative expressions, fearful and sad, and angry and sad, respectively. Additionally, a strong inverse relationship was found between ability to emphathize with the emotional experiences of others and self-reported acts of delinquent behavior. Lastly, a strong positive relationship was found between covert and overt self-reported acts of delinquent behavior. Results from this exploratory investigation suggest a link between facial affect recognition, empathy, and delinquency. Findings have important implications for educators and counselors who work with youth offenders within probation placement facilities.