Processing emotional facial expressions: The role of anxiety and awareness

In this paper, the role of self-reported anxiety and degree of conscious awareness as determinants of the selective processing of affective facial expressions is investigated. In two experiments, an attentional bias toward fearful facial expressions was observed, although this bias was apparent only for those reporting high levels of trait anxiety and only when the emotional face was presented in the left visual field. This pattern was especially strong when the participants were unaware of the presence of the facial stimuli. In Experiment 3, a patient with right-hemisphere brain damage and visual extinction was presented with photographs of faces and fruits on unilateral and bilateral trials. On bilateral trials, it was found that faces produced less extinction than did fruits. Moreover, faces portraying a fearful or a happy expression tended to produce less extinction than did neutral expressions. This suggests that emotional facial expressions may be less dependent on attention to achieve awareness. The implications of these results for understanding the relations between attention, emotion, and anxiety are discussed.     

Negative emotionality influences the effects of emotion on time perception

In this study I used a temporal bisection task to test if greater overestimation of time due to negative emotion is moderated by individual differences in negative emotionality. The effects of fearful facial expressions on time perception were also examined. After a training phase, participants estimated the duration of facial expressions (anger, happiness, fearfulness) and a neutral-baseline facial expression. In accordance to the operation of an arousal-based process, the duration of angry expressions was consistently overestimated relative to other expressions and the baseline condition. In support of a role for individual differences in negative emotionality on time perception, temporal bias due to angry and fearful expressions was positively correlated to individual differences in self-reported negative emotionality. The results are discussed in relation both to the literature on attentional bias to facial expressions in anxiety and fearfulness and also, to the hypothesis that angry expressions evoke a fear-specific response.     

Sad or fearful? The influence of body posture on adults’ and children’s perception of facial displays of emotion

The current research investigated the influence of body posture on adults' and children's perception of facial displays of emotion. In each of two experiments, participants categorized facial expressions that were presented on a body posture that was congruent (e.g., a sad face on a body posing sadness) or incongruent (e.g., a sad face on a body posing fear). Adults and 8-year-olds made more errors and had longer reaction times on incongruent trials than on congruent trials when judging sad versus fearful facial expressions, an effect that was larger in 8-year-olds. The congruency effect was reduced when faces and bodies were misaligned, providing some evidence for holistic processing. Neither adults nor 8-year-olds were affected by congruency when judging sad versus happy expressions. Evidence that congruency effects vary with age and with similarity of emotional expressions is consistent with dimensional theories and "emotional seed" models of emotion perception.     

The influence of anxiety on the initial selection of emotional faces presented in binocular rivalry

Neurocognitive theories of anxiety predict that threat-related information can be evaluated before attentional selection, and can influence behaviour differentially in high anxious compared to low anxious individuals. We investigate this further by presenting emotional and neutral faces in an adapted binocular rivalry paradigm. We show that the initial selection of emotional faces presented in binocular rivalry is highly influenced by self-reported state and trait anxiety-level. Heightened anxiety was correlated with increased perception of angry and fearful faces, and decreased perception of happy expressions. These results are consistent with recent evidence of involuntary selection of threat in anxiety.     

Temporal processing of emotional stimuli: the capture and release of attention by angry faces

Neuroimaging data suggest that emotional information, especially threatening faces, automatically captures attention and receives rapid processing. While this is consistent with the majority of behavioral data, behavioral studies of the attentional blink (AB) additionally reveal that aversive emotional first target (T1) stimuli are associated with prolonged attentional engagement or "dwell" time. One explanation for this difference is that few AB studies have utilized manipulations of facial emotion as the T1. To address this, schematic faces varying in expression (neutral, angry, happy) served as the T1 in the current research. Results revealed that the blink associated with an angry T1 face was, primarily, of greater magnitude than that associated with either a neutral or happy T1 face, and also that initial recovery from this processing bias was faster following angry, compared with happy, T1 faces. The current data therefore provide important information regarding the time-course of attentional capture by angry faces: Angry faces are associated with both the rapid capture and rapid release of attention.     

All eyes on me?! Social anxiety and self-directed perception of eye gaze

To date, only little is known about the self-directed perception and processing of subtle gaze cues in social anxiety that might however contribute to excessive feelings of being looked at by others. Using a web-based approach, participants (n=174) were asked whether or not briefly (300 ms) presented facial expressions modulated in gaze direction (0°, 2°, 4°, 6°, 8°) and valence (angry, fearful, happy, neutral) were directed at them. The results demonstrate a positive, linear relationship between self-reported social anxiety and stronger self-directed perception of others' gaze directions, particularly for negative (angry, fearful) and neutral expressions. Furthermore, faster responding was found for gaze more clearly directed at socially anxious individuals (0°, 2°, and 4°) suggesting a tendency to avoid direct gaze. In sum, the results illustrate an altered self-directed perception of subtle gaze cues. The possibly amplifying effects of social stress on biased self-directed perception of eye gaze are discussed.     

Identification of angry faces in the attentional blink

According to cognitive and neural theories of emotion, attentional processing of innate threat stimuli, such as angry facial expressions, is prioritised over neutral stimuli. To test this hypothesis, the present study used a modified version of the rapid serial visual presentation (RSVP) paradigm to investigate the effect of emotional face stimuli on the attentional blink (AB). The target stimuli were schematic faces which depicted threatening (angry), positive or neutral facial expressions. Results showed that performance accuracy was enhanced (i.e., the AB was reduced) on trials in which the second target was an angry face, rather than a neutral face. Results extend previous research by demonstrating that angry faces reduce the AB, and that this effect is found for schematic facial expressions. These findings further support the proposal that, when there is competition for attentional resources, threat stimuli are given higher priority in processing compared with non-threatening stimuli.     

特质焦虑在面部表情前注意加工阶段的影响：来自ERP的证据

为探讨高特质焦虑者在前注意阶段对情绪刺激的加工模式以明确其情绪偏向性特点, 本研究采用偏差-标准反转Oddball范式探讨了特质焦虑对面部表情前注意加工的影响。结果发现: 对于低特质焦虑组, 悲伤面孔所诱发的早期EMMN显著大于快乐面孔, 而对于高特质焦虑组, 快乐和悲伤面孔所诱发的早期EMMN差异不显著。并且, 高特质焦虑组的快乐面孔EMMN波幅显著大于低特质焦虑组。结果表明, 人格特质是影响面部表情前注意加工的重要因素。不同于普通被试, 高特质焦虑者在前注意阶段对快乐和悲伤面孔存在相类似的加工模式, 可能难以有效区分快乐和悲伤情绪面孔。     

Effects of anxiety and attention control on processing pictorial and linguistic emotional information

This study investigated the role of executive attention control in modulating selective processing of emotional information in anxiety. It was hypothesized that the combination of high anxiety and poor attention control would be associated with greater difficulty in ignoring task-irrelevant threat-related information. The study included both faces and words as stimuli. Cognitive interference effects were assessed using two emotional Stroop tasks: one with angry, fearful, happy and neutral faces, and one with threat-related, positive, and neutral words. An objective measure of attention control was obtained from the Attention network task. There were four participant groups with high/low trait anxiety and high/low attention control. Results indicated that the combination of high anxiety and poor attention control was associated with greater cognitive interference by emotional faces (including angry faces), compared to neutral faces. This interference effect was not evident in participants with high anxiety and high attentional control, or in low-anxious individuals. There was no evidence of associations between anxiety, attention control, and the interference effect of emotional words. Results indicate that high anxiety and poor attention control together predict enhanced processing of emotionally salient information, such as angry facial expressions. Implications for models of emotion processing are discussed.     

Infant and maternal responses to emotional facial expressions: A longitudinal study

The current longitudinal study (N = 107) examined mothers’ facial emotion recognition using reaction time and their infants’ affect-based attention at 5, 7, and 14 months of age using eyetracking. Our results, examining maternal and infant responses to angry, fearful and happy facial expressions, show that only maternal responses to angry facial expressions were robustly and positively linked across time points, indexing a consistent trait-like response to social threat among mothers. However, neither maternal responses to happy or fearful facial expressions nor infant responses to all three facial emotions show such consistency, pointing to the changeable nature of facial emotion processing, especially among infants. In general, infants’ attention toward negative emotions (i.e., angry and fear) at earlier timepoints was linked to their affect-biased attention for these emotions at 14 months but showed greater dynamic change across time. Moreover, our results provide limited evidence for developmental continuity in processing negative emotions and for the bidirectional interplay of infant affect-biased attention and maternal facial emotion recognition. This pattern of findings suggests that infants’ affect-biased attention to facial expressions of emotion are characterized by dynamic changes.     

Probing the attentional control theory in social anxiety: An emotional saccade task

Volitional attentional control has been found to rely on prefrontal neuronal circuits. According to the attentional control theory of anxiety, impairment in the volitional control of attention is a prominent feature in anxiety disorders. The present study investigated this assumption in socially anxious individuals using an emotional saccade task with facial expressions (happy, angry, fearful, sad, neutral). The gaze behavior of participants was recorded during the emotional saccade task, in which participants performed either pro- or antisaccades in response to peripherally presented facial expressions. The results show that socially anxious persons have difficulties in inhibiting themselves to reflexively attend to facial expressions: They made more erratic prosaccades to all facial expressions when an antisaccade was required. Thus, these findings indicate impaired attentional control in social anxiety. Overall, the present study shows a deficit of socially anxious individuals in attentional control—for example, in inhibiting the reflexive orienting to neutral as well as to emotional facial expressions. This result may be due to a dysfunction in the prefrontal areas being involved in attentional control.     

The influence of indirect and direct emotional processing on memory for facial expressions

We used the remember-know procedure (Tulving, 1985 ) to test the behavioural expression of memory following indirect and direct forms of emotional processing at encoding. Participants (N=32) viewed a series of facial expressions (happy, fearful, angry, and neutral) while performing tasks involving either indirect (gender discrimination) or direct (emotion discrimination) emotion processing. After a delay, participants completed a surprise recognition memory test. Our results revealed that indirect encoding of emotion produced enhanced memory for fearful faces whereas direct encoding of emotion produced enhanced memory for angry faces. In contrast, happy faces were better remembered than neutral faces after both indirect and direct encoding tasks. These findings suggest that fearful and angry faces benefit from a recollective advantage when they are encoded in a way that is consistent with the predictive nature of their threat. We propose that the broad memory advantage for happy faces may reflect a form of cognitive flexibility that is specific to positive emotions.     

The effects of social anxiety on emotional face discrimination and its modulation by mouth salience

People high in social anxiety experience fear of social situations due to the likelihood of social evaluation. Whereas happy faces are generally processed very quickly, this effect is impaired by high social anxiety. Mouth regions are implicated during emotional face processing, therefore differences in mouth salience might affect how social anxiety relates to emotional face discrimination. We designed an emotional facial expression recognition task to reveal how varying levels of sub-clinical social anxiety (measured by questionnaire) related to the discrimination of happy and fearful faces, and of happy and angry faces. We also categorised the facial expressions by the salience of the mouth region (i.e. high [open mouth] vs. low [closed mouth]). In a sample of 90 participants higher social anxiety (relative to lower social anxiety) was associated with a reduced happy face reaction time advantage. However, this effect was mainly driven by the faces with less salient closed mouths. Our results are consistent with theories of anxiety that incorporate an oversensitive valence evaluation system.     

The emotional body and time perception

We examined the effects of emotional bodily expressions on the perception of time. Participants were shown bodily expressions of fear, happiness and sadness in a temporal bisection task featuring different stimulus duration ranges. Stimulus durations were judged to be longer for bodily expressions of fear than for those of sadness, whereas no significant difference was observed between sad and happy postures. In addition, the magnitude of the lengthening effect of fearful versus sad postures increased with duration range. These results suggest that the perception of fearful bodily expressions increases the level of arousal which, in turn, speeds up the internal clock system underlying the representation of time. The effect of bodily expressions on time perception is thus consistent with findings for other highly arousing emotional stimuli, such as emotional facial expressions.     

Perception of facial expression depends on prior attention

Attending versus ignoring a stimulus can later determine how it will be affectively evaluated. Here, we asked whether attentional states could also modulate subsequent sensitivity to facial expressions of emotion. In a dual-task procedure, participants first rapidly searched for a gender-defined face among two briefly displayed neutral faces. Then a test face with the previously attended or ignored face’s identity was presented, and participants judged whether it was emotionally expressive (happy, angry, or fearful) or neutral. Intensity of expression in the test face was varied so that an expression detection threshold could be determined. When fearful or angry expressions were judged, expression sensitivity was worse for faces bearing the same identity as a previously ignored versus attended face. When happy expressions were judged, sensitivity was unaffected by prior attention. These data support the notion that the motivational value of stimuli may be reduced by processes associated with selective ignoring.     

Neurocognitive assessment of emotional context sensitivity

Sensitivity to emotional context is an emerging construct for characterizing adaptive or maladaptive emotion regulation, but few measurement approaches exist. The current study combined behavioral and neurocognitive measures to assess context sensitivity in relation to self-report measures of adaptive emotional flexibility and well-being. Sixty-six adults completed an emotional go/no-go task using happy, fearful, and neutral faces as go and no-go cues, while EEG was recorded to generate event-related potentials (ERPs) reflecting attentional selection and discrimination (N170) and cognitive control (N2). Context sensitivity was measured as the degree of emotional facilitation or disruption in the go/no-go task and magnitude of ERP response to emotion cues. Participants self-reported on emotional flexibility, anxiety, and depression. Overall participants evidenced emotional context sensitivity, such that when happy faces were go stimuli, accuracy improved (greater behavioral facilitation), whereas when fearful faces were no-go stimuli, errors increased (disrupted behavioral inhibition). These indices predicted emotional flexibility and well-being: Greater behavioral facilitation following happy cues was associated with lower depression and anxiety, whereas greater disruption in behavioral inhibition following fearful cues was associated with lower flexibility. ERP indices of context sensitivity revealed additional associations: Greater N2 to fear go cues was associated with less anxiety and depression, and greater N2 and N170 to happy and fear no-go cues, respectively, were associated with greater emotional flexibility and well-being. Results suggest that pleasant and unpleasant emotions selectively enhance and disrupt components of context sensitivity, and that behavioral and ERP indices of context sensitivity predict flexibility and well-being.     

Amplification of attentional blink by distress‐related facial expressions: Relationships with alexithymia and affectivity

The present studies aimed to analyse the modulatory effect of distressing facial expressions on attention processing. The attentional blink (AB) paradigm is one of the most widely used paradigms for studying temporal attention, and is increasingly applied to study the temporal dynamics of emotion processing. The aims of this study were to investigate how identifying fear and pain facial expressions (Study 1) and fear and anger facial expressions (Study 2) would influence the detection of subsequent stimuli presented within short time intervals, and to assess the moderating influence of alexithymia and affectivity on this effect. It has been suggested that high alexithymia scorers need more attentional resources to process distressing facial expressions and that negative affectivity increases the AB. We showed that fear, anger and pain produced an AB and that alexithymia moderated it such that difficulty in describing feelings (Study 1) and externally oriented thinking (Study 2) were associated with higher interference after the processing of fear and anger at short time presentations. These studies provide evidence that distressing facial expressions modulate the attentional processing at short time intervals and that alexithymia influences the early attentional processing of fear and anger expressions. Controlling for state affect did not change these conclusions.     

Looking for foes and friends: perceptual and emotional factors when finding a face in the crowd

In a face-in-the-crowd setting, the authors examined visual search for photographically reproduced happy, angry, and fearful target faces among neutral distractor faces in 3 separate experiments. Contrary to the hypothesis, happy targets were consistently detected more quickly and accurately than angry and fearful targets, as were directed compared with averted targets. There was no consistent effect of social anxiety. A facial emotion recognition experiment suggested that the happy search advantage could be due to the ease of processing happy faces. In the final experiment with perceptually controlled schematic faces, the authors reported more effective detection of angry than happy faces. This angry advantage was most obvious for highly socially anxious individuals when their social fear was experimentally enhanced.     

Differential impact of emotional task relevance on three indices of prioritised processing for fearful and angry facial expressions

It is commonly assumed that threatening expressions are perceptually prioritised, possessing the ability to automatically capture and hold attention. Recent evidence suggests that this prioritisation depends on the task relevance of emotion in the case of attention holding and for fearful expressions. Using a hybrid attentional blink (AB) and repetition blindness (RB) paradigm we investigated whether task relevance also impacts on prioritisation through attention capture and perceptual salience, and if these effects generalise to angry expressions. Participants judged either the emotion (relevant condition) or gender (irrelevant condition) of two target facial stimuli (fearful, angry or neutral) imbedded in a stream of distractors. Attention holding and capturing was operationalised as modulation of AB deficits by first target (T1) and second target (T2) expression. Perceptual salience was operationalised as RB modulation. When emotion was task-relevant (Experiment 1; N?=?29) fearful expressions captured and held attention, and were more perceptually salient than neutral expressions. Angry expressions captured attention, but were less perceptually salient and capable of holding attention than fearful and neutral expressions. When emotion was task-irrelevant (Experiment 2; N?=?30), only fearful attention capture and perceptual salience effects remained significant. Our findings highlight the importance for threat-prioritisation research to heed both the type of threat and prioritisation investigated.     

Emotional faces capture spatial attention in 5-year-old children

Emotional facial expressions are important social cues that convey salient affective information. Infants, younger children, and adults all appear to orient spatial attention to emotional faces with a particularly strong bias to fearful faces. Yet in young children it is unclear whether or not both happy and fearful faces extract attention. Given that the processing of emotional faces is believed by some to serve an evolutionarily adaptive purpose, attentional biases to both fearful and happy expressions would be expected in younger children. However, the extent to which this ability is present in young children and whether or not this ability is genetically mediated is untested. Therefore, the aims of the current study were to assess the spatial-attentional properties of emotional faces in young children, with a preliminary test of whether this effect was influenced by genetics. Five-year-old twin pairs performed a dot-probe task. The results suggest that children preferentially direct spatial attention to emotional faces, particularly right visual field faces. The results provide support for the notion that the direction of spatial attention to emotional faces serves an evolutionarily adaptive function and may be mediated by genetic mechanisms.