Gaze and emotional expression: The effects of message positivity-negativity and emotional intensity

The effects of emotional positivity-negativity and emotional intensity on actor's gaze were examined by simulating emotional situations to a camera. Female subjects were first asked to act out a neutral message as if they were speaking to a person to obtain a baseline for direct gaze. Subjects were then asked to perform a positive or a negative message to the camera. Half the subjects attempted to express the message with strong emotion; half expressed it with weak, ambivalent emotion. As expected, it was found that more direct gaze was maintained when expressing strong emotion. Whether the message was positive or negative did not affect gaze direction. The results were discussed in relation to the dimensions of nonverbal communication.     

Task-irrelevant direct gaze facilitates visual search for deviant facial expression

The detection of emotional expression is important particularly when the expression is directed towards the viewer. Therefore, we conjectured that the efficiency in visual search for deviant emotional expression is modulated by gaze direction, which is one of the primary clues for encoding the focus of social attention. To examine this hypothesis, two visual search tasks were conducted. In Emotional Face Search, the participants were required to detect an emotional expression amongst distractor faces with neutral expression; in Neutral Face Search they were required to detect a neutral target among emotional distractors. The results revealed that target detection was accelerated when the target face had direct gaze compared to averted gaze for fearful, angry, and neutral targets, but no effect of distractor gaze direction was observed. An additional experiment including multiple display sizes has shown a shallower search slope in search for a target face with direct gaze than that with averted gaze, indicating that the advantage of a target face with direct gaze is attributable to efficient orientation of attention towards target faces. These results indicate that direct gaze facilitates detection of target face in visual scenery even when gaze discrimination is not the primary task at hand.     

The combined effect of gaze direction and facial expression on cueing spatial attention

Empirical evidence shows an effect of gaze direction on cueing spatial attention, regardless of the emotional expression shown by a face, whereas a combined effect of gaze direction and facial expression has been observed on individuals' evaluative judgments. In 2 experiments, the authors investigated whether gaze direction and facial expression affect spatial attention depending upon the presence of an evaluative goal. Disgusted, fearful, happy, or neutral faces gazing left or right were followed by positive or negative target words presented either at the spatial location looked at by the face or at the opposite spatial location. Participants responded to target words based on affective valence (i.e., positive/negative) in Experiment 1 and on letter case (lowercase/uppercase) in Experiment 2. Results showed that participants responded much faster to targets presented at the spatial location looked at by disgusted or fearful faces but only in Experiment 1, when an evaluative task was used. The present findings clearly show that negative facial expressions enhance the attentional shifts due to eye-gaze direction, provided that there was an explicit evaluative goal present.     

VOCAL EXPRESSION OF EMOTION:

Abstract— Acoustic properties of speech likely provide external cues about internal emotional processes, a phenomenon called vocal expression of emotion. Testing this supposition, we examined fundamental frequency (F₀) and two perturbation measures, jitter and shimmer, in short speech samples recorded from subjects performing a lexical decision task. Statistically significant differences were found between baseline and on task values and as interaction effects involving differences in trait levels of emotional intensity and the proportion of success versus failure feedback received. These results indicate that acoustic properties of speech can be used to index emotional processes and that characteristic differences in emotional intensity may mediate vocal expression of emotion     

Detection of emotional faces is modulated by the direction of eye gaze

Emotionally expressive faces have shown enhanced detectability over neutral faces, but little is known about the effect of eye gaze on detecting the presence of emotional faces. Emotional expressions and gaze direction are both cues to the intentions of another person, and gaze direction has been shown to affect recognition accuracy and perceived intensity of emotional faces. The current study showed that fearful faces were detected more frequently with an averted gaze than with a direct gaze in an attentional blink task, whereas angry and happy faces were detected more frequently with a direct gaze than with an averted gaze. The results are in line with the shared signal hypothesis and appraisal theory and suggest that selection for awareness was based on a rapid evaluation of the intentions of another person as conveyed by their facial expression and gaze direction.     

The development of emotional face and eye gaze processing

Recent research has demonstrated that infants' attention towards novel objects is affected by an adult's emotional expression and eye gaze toward the object. The current event-related potential (ERP) study investigated how infants at 3, 6, and 9 months of age process fearful compared to neutral faces looking toward objects or averting gaze away from objects. Furthermore, we examined how the processing of novel objects is affected by gaze direction and emotional expression. We hypothesized that an adult's fearful expression should be particularly salient when it is directed toward a referent in the environment. Furthermore, responses to objects should be increased if the face previously expressed fear toward the object. Three-month-olds did not show differential neural responses to fearful vs. neutral faces regardless of gaze direction. Six-month-olds showed an enhanced negative central (Nc) component for fearful relative to neutral faces looking toward objects, but not when eye gaze was averted away from the objects. Furthermore, 6-month-olds showed an enhanced Nc for objects that had been gaze-cued by a fearful compared to a neutral face. Nine-month-olds showed an enhanced Nc for fearful relative to neutral faces in both eye gaze conditions and showed an enhanced Nc for objects that had been gaze-cued by a neutral face. The findings are discussed in the context of social cognitive and brain development.     

Are all experiences of fit created equal? Two paths to persuasion

Regulatory fit influences the effectiveness of persuasion through two paths: 1) a “feeling right” as “feeling good about the target” effect where feeling right is a positive feeling that transfers positivity directly to the target, similar to “feelings as information” or fluency effects, and 2) a “feeling right” as “feeling confident about the evaluation” effect where feeling right is feeling confident about one's evaluative judgments of the target that increases reliance on those evaluations. We propose that the involvement with an attitude-related issue in a persuasion message is one key factor that determines when each effect will occur. Five studies demonstrate that under high involvement, fit increased reliance on evaluative reactions to the target, making a target of a positive advocacy message evaluated as more positive and a target of a negative advocacy message evaluated as more negative; and under low involvement, fit increased the positivity of feelings toward the target regardless of the valence of the message advocacy, making the evaluation of the target more positive for either a positive or negative advocacy message.     

Increased gaze following for fearful faces. It depends on what you’re looking for!

An oculomotor visual search task was used to investigate how participants follow the gaze of a non-predictive and task irrelevant distractor gaze, and the way in which this gaze following is influenced by the emotional expression (fearful vs. happy) as well as participants' goal. Previous research has suggested that fearful emotions should result in stronger cueing effects than happy faces. Our results demonstrated that the degree to which the emotional expression influenced this gaze following varied as a function of the search target. When searching for a threatening target, participants were more likely to look in the direction of eye gaze on a fearful compared to a happy face. However, when searching for a pleasant target, this stronger cueing effect for fearful faces disappeared. Therefore, gaze following is influenced by contextual factors such as the emotional expression, as well as the participant's goal.     

Cognition and Emotion in TV Message Processing: How Valence,Arousing Content,Structural Complexity,and Information Density Affect the Availability of Cognitive Resources

This paper examines whether emotional message content alters the effects of structural complexity and information density on available resources, measured by secondary task reaction times (STRTs), and message encoding, measured by audio recognition. In addition, hypotheses relating motivational activation and resource availability based on the motivational activation concepts of positivity offset (greater appetitive activation in a neutral environment) and negativity bias (faster aversive activation) influence are tested. Results replicate previous research supporting the contention that STRTs measure available resources. In addition, they show that the basic pattern of STRTs and recognition as a function of allocated and required resources is relatively consistent regardless of emotional content of the message. Emotion appears to function as a constant, increasing both resource allocation and resources required. Finally, these data provide some initial support for predicted relationships between motivational activation and resource allocation based on the constructs of positivity offset and negativity bias.     

注视方向和面部表情对注意朝向的影响

摘 要 本文以三种表情面孔为材料,运用事件相关电位（ERP）方法探讨表情线索在注意朝向中与注视转移发生的交互及两者如何共同影响观察者的反应。结果发现：（1）线索效应在三种表情面孔的两种SOA中都出现了;（2）SOA较长时,注视线索效应量间的显著差异出现在中性和恐惧面孔、高兴和恐惧面孔间;（3）面部表情的效应出现在了表情线索诱发的P1成分上;（4）目标诱发的P1和N1说明了注视线索效应的存在及与表情间的交互。结论：表情线索先对观察者的朝向反应产生影响,随后是注视线索及其与表情线索发生的交互。     

Emotional expression modulates perceived gaze direction

Gaze perception is an important social skill, as it portrays information about what another person is attending to. Gaze direction has been shown to affect interpretation of emotional expression. Here the authors investigate whether the emotional facial expression has a reciprocal influence on interpretation of gaze direction. In a forced-choice yes-no task, participants were asked to judge whether three faces expressing different emotions (anger, fear, happiness, and neutral) in different viewing angles were looking at them or not. Happy faces were more likely to be judged as looking at the observer than were angry, fearful, or neutral faces. Angry faces were more often judged as looking at the observer than were fearful and neutral expressions. These findings are discussed on the background of approach and avoidance orientation of emotions and of the self-referential positivity bias.     

Predictive gaze cues affect face evaluations: The effect of facial emotion

When we see someone change their direction of gaze, we spontaneously follow their eyes because we expect people to look at interesting objects. Bayliss and Tipper (2006) examined the consequences of observing this expectancy being either confirmed or violated by faces producing reliable or unreliable gaze cues. Participants viewed different faces that would consistently look at the target, or consistently look away from the target: The faces that consistently looked towards targets were subsequently chosen as being more trustworthy than the faces that consistently looked away from targets. The current work demonstrates that these gaze contingency effects are only detected when faces create a positive social context by smiling, but not in the negative context when all the faces held angry or neutral expressions. These data suggest that implicit processing of the reward contingencies associated with gaze cues relies on a positive emotional expression to maintain expectations of a favourable outcome of joint attention episodes.     

Emotionally meaningful targets enhance orienting triggered by a fearful gazing face

Studies investigating the effect of emotional expression on spatial orienting to a gazed-at location have produced mixed results. The present study investigated the role of affective context in the integration of emotion processing and gaze-triggered orienting. In three experiments, a face gazed non-predictively to the left or right, and then its expression became fearful or happy. Participants identified (Experiments 1 and 2) or detected (Experiment 3) a peripheral target presented 225 or 525 ms after the gaze cue onset. In Experiments 1 and 3 the targets were either threatening (a snarling dog) or non-threatening (a smiling baby); in Experiment 2 the targets were neutral. With emotionally valenced targets, the gaze-cuing effect was larger when the face was fearful compared to happy—but only with the longer cue–target interval. With neutral targets, there was no interaction between gaze and expression. Our results indicate that a meaningful context optimises attentional integration of gaze and expression information.     

The relationships between processing facial identity,emotional expression,facial speech,and gaze direction during development

Four experiments were conducted with 5- to 11-year-olds and adults to investigate whether facial identity, facial speech, emotional expression, and gaze direction are processed independently of or in interaction with one another. In a computer-based, speeded sorting task, participants sorted faces according to facial identity while disregarding facial speech, emotional expression, and gaze direction or, alternatively, according to facial speech, emotional expression, and gaze direction while disregarding facial identity. Reaction times showed that children and adults were able to direct their attention selectively to facial identity despite variations of other kinds of face information, but when sorting according to facial speech and emotional expression, they were unable to ignore facial identity. In contrast, gaze direction could be processed independently of facial identity in all age groups. Apart from shorter reaction times and fewer classification errors, no substantial change in processing facial information was found to be correlated with age. We conclude that adult-like face processing routes are employed from 5 years of age onward.     

“Avoiding or approaching eyes”? Introversion/extraversion affects the gaze-cueing effect

We investigated whether the extra-/introversion personality dimension can influence processing of others’ eye gaze direction and emotional facial expression during a target detection task. On the basis of previous evidence showing that self-reported trait anxiety can affect gaze-cueing with emotional faces, we also verified whether trait anxiety can modulate the influence of intro-/extraversion on behavioral performance. Fearful, happy, angry or neutral faces, with either direct or averted gaze, were presented before the target appeared in spatial locations congruent or incongruent with stimuli’s eye gaze direction. Results showed a significant influence of intra-/extraversion dimension on gaze-cueing effect for angry, happy, and neutral faces with averted gaze. Introverts did not show the gaze congruency effect when viewing angry expressions, but did so with happy and neutral faces; extraverts showed the opposite pattern. Importantly, the influence of intro-/extraversion on gaze-cueing was not mediated by trait anxiety. These findings demonstrated that personality differences can shape processing of interactions between relevant social signals.     

Maternal postpartum depression is a risk factor for infant emotional variability at 4 months

Maternal postpartum depression (PPD) is a risk for disruption of mother–infant interaction. Infants of depressed mothers have been found to display less positive, more negative, and neutral affect. Other studies have found that infants of mothers with PPD inhibit both positive and negative affect. In a sample of 28 infants of mothers with PPD and 52 infants of nonclinical mothers, we examined the role of PPD diagnosis and symptoms for infants’ emotional variability, measured as facial expressions, vocal protest, and gaze using microanalysis, during a mother–infant face-to-face interaction. PPD symptoms and diagnosis were associated with (a) infants displaying fewer high negative, but more neutral/interest facial affect events, and (b) fewer gaze off events.  PPD diagnosis, but not symptoms, was associated with less infant vocal protest. Total duration of seconds of infant facial affective displays and gaze off was not related to PPD diagnosis or symptoms, suggesting that when infants of depressed mothers display high negative facial affect or gaze off, these expressions are more sustained, indicating lower infant ability to calm down and re-engage, interpreted as a disturbance in self-regulation. The findings highlight the importance of not only examining durations, but also frequencies, as the latter may inform infant emotional variability.     

Gaze cueing elicited by emotional faces is influenced by affective context

When we observe someone shift their gaze to a peripheral event or object, a corresponding shift in our own attention often follows. This social orienting response, joint attention, has been studied in the laboratory using the gaze cueing paradigm. Here, we investigate the combined influence of the emotional content displayed in two critical components of a joint attention episode: The facial expression of the cue face, and the affective nature of the to-be-localized target object. Hence, we presented participants with happy and disgusted faces as cueing stimuli, and neutral (Experiment 1), pleasant and unpleasant (Experiment 2) pictures as target stimuli. The findings demonstrate an effect of ‘emotional context’ confined to participants viewing pleasant pictures. Specifically, gaze cueing was boosted when the emotion of the gazing face (i.e., happy) matched that of the targets (pleasant). Demonstrating modulation by emotional context highlights the vital flexibility that a successful joint attention system requires in order to assist our navigation of the social world.     

Beyond surprise: the puzzle of infants' expressive reactions to expectancy violation

The reactions of 58 infants to expectancy violation by digitally filtering the experimenter's voice were studied in a cross-sectional design for ages 5, 7, 9, 11-12, and 14 months. The results show that behavioral freezing and changes in gaze direction, but not facial or vocal expression, are reliable responses to expectancy violation. The pattern suggests that a transition in the infant's capacity for cognitive evaluation of novel and discrepant events may occur around age 9 months. These findings confirm the consistent failure to find prototypical facial surprise reactions in research on novel or impossible situations. Componential theories of emotion, which predict adaptive behavior patterns from appraisal processes, may provide clues for underlying mechanisms and generate hypotheses on age-related changes in emotional expression.     

Attention and gaze shifting in dual-task and go/no-go performance with vocal responding

Evidence from go/no-go performance on the Eriksen flanker task with manual responding suggests that individuals gaze at stimuli just as long as needed to identify them (e.g., Sanders, 1998). In contrast, evidence from dual-task performance with vocal responding suggests that gaze shifts occur after response selection (e.g., Roelofs, 2008a). This difference in results may be due to the nature of the task situation (go/no-go vs. dual task) or the response modality (manual vs. vocal). We examined this by having participants vocally respond to congruent and incongruent flanker stimuli and shift gaze to left- or right-pointing arrows. The arrows required a manual response (dual task) or determined whether the vocal response to the flanker stimuli had to be given or not (go/no-go). Vocal response and gaze shift latencies were longer on incongruent than congruent trials in both dual-task and go/no-go performance. The flanker effect was also present in the manual response latencies in dual-task performance. Ex-Gaussian analyses revealed that the flanker effect on the gaze shifts consisted of a shift of the entire latency distribution. These results suggest that gaze shifts occur after response selection in both dual-task and go/no-go performance with vocal responding.     

The interaction between gaze direction and facial expressions in newborns

The ability to decode facial expressions is an important component of social interaction and functioning. This ability is even more fundamental early in life, prior to the development of verbal communication. However, it is still unclear whether newborns can detect, discriminate and process facial expressions, and, if so, what the mechanisms underlying this ability are. In this study, we extend the investigation of perceived emotional expression by manipulating gaze direction with different facial expressions. Specifically, newborns were presented with faces displaying neutral, fearful, or happy facial expressions accompanied with direct or averted gaze, and tested in a visual preference paradigm. Four experiments were conducted in which different combinations of expression and gaze were used. However, only in the fourth experiment did newborns show a visual preference for a specific emotional display; they looked significantly longer at a happy face than a neutral one only when both were accompanied with direct gaze. These results provide support for the advantage of happy facial expressions in the development of a face processing system and suggest that this preference reflects experience acquired during the first few days after birth.