Detection of emotional faces: salient physical features guide effective visual search

In this study, the authors investigated how salient visual features capture attention and facilitate detection of emotional facial expressions. In a visual search task, a target emotional face (happy, disgusted, fearful, angry, sad, or surprised) was presented in an array of neutral faces. Faster detection of happy and, to a lesser extent, surprised and disgusted faces was found both under upright and inverted display conditions. Inversion slowed down the detection of these faces less than that of others (fearful, angry, and sad). Accordingly, the detection advantage involves processing of featural rather than configural information. The facial features responsible for the detection advantage are located in the mouth rather than the eye region. Computationally modeled visual saliency predicted both attentional orienting and detection. Saliency was greatest for the faces (happy) and regions (mouth) that were fixated earlier and detected faster, and there was close correspondence between the onset of the modeled saliency peak and the time at which observers initially fixated the faces. The authors conclude that visual saliency of specific facial features--especially the smiling mouth--is responsible for facilitated initial orienting, which thus shortens detection. (PsycINFO Database Record (c) 2008 APA, all rights reserved).     

Visual search for emotional faces in children

The ability to rapidly detect facial expressions of anger and threat over other salient expressions has adaptive value across the lifespan. Although studies have demonstrated this threat superiority effect in adults, surprisingly little research has examined the development of this process over the childhood period. In this study, we examined the efficiency of children's facial processing in visual search tasks. In Experiment 1, children (N=49) aged 8 to 11 years were faster and more accurate in detecting angry target faces embedded in neutral backgrounds than vice versa, and they were slower in detecting the absence of a discrepant face among angry than among neutral faces. This search pattern was unaffected by an increase in matrix size. Faster detection of angry than neutral deviants may reflect that angry faces stand out more among neutral faces than vice versa, or that detection of neutral faces is slowed by the presence of surrounding angry distracters. When keeping the background constant in Experiment 2, children (N=35) aged 8 to 11 years were faster and more accurate in detecting angry than sad or happy target faces among neutral background faces. Moreover, children with higher levels of anxiety were quicker to find both angry and sad faces whereas low anxious children showed an advantage for angry faces only. Results suggest a threat superiority effect in processing facial expressions in young children as in adults and that increased sensitivity for negative faces may be characteristic of children with anxiety problems.     

The face in the crowd effect: Threat-detection advantage with perceptually intermediate distractors

The ability to quickly perceive threatening facial expressions allows one to detect emotional states and respond appropriately. The anger superiority hypothesis predicts that angry faces capture attention faster than happy faces. Previous studies have used photographic (Hansen & Hansen, 1988) and schematic face images (e.g., Eastwood, Smilek, & Merikle, 2001; Ohman, Lunqvist, & Esteves, 2001) in studying the anger superiority effect, but specific confounds due to the construction of stimuli have led to conflicting findings. In the current study, participants performed a visual search for either angry or happy target faces among crowds of novel, perceptually intermediate morph distractors. A threat-detection advantage was evident where participants showed faster reaction times and greater accuracy in detecting angry over happy faces. Search slopes, however, did not significantly differ. Results suggest a threat-detection advantage mediated by serial rather than preattentive processing.     

The face in the crowd revisited: a threat advantage with schematic stimuli

Schematic threatening, friendly, and neutral faces were used to test the hypothesis that humans preferentially orient their attention toward threat. Using a visual search paradigm, participants searched for discrepant faces in matrices of otherwise identical faces. Across 5 experiments, results consistently showed faster and more accurate detection of threatening than friendly targets. The threat advantage was obvious regardless of whether the conditions favored parallel or serial search (i.e., involved neutral or emotional distractors), and it was valid for inverted faces. Threatening angry faces were more quickly and accurately detected than were other negative faces (sad or "scheming"), which suggests that the threat advantage can be attributed to threat rather than to the negative valence or the uniqueness of the target display.     

Looking for foes and friends: perceptual and emotional factors when finding a face in the crowd

In a face-in-the-crowd setting, the authors examined visual search for photographically reproduced happy, angry, and fearful target faces among neutral distractor faces in 3 separate experiments. Contrary to the hypothesis, happy targets were consistently detected more quickly and accurately than angry and fearful targets, as were directed compared with averted targets. There was no consistent effect of social anxiety. A facial emotion recognition experiment suggested that the happy search advantage could be due to the ease of processing happy faces. In the final experiment with perceptually controlled schematic faces, the authors reported more effective detection of angry than happy faces. This angry advantage was most obvious for highly socially anxious individuals when their social fear was experimentally enhanced.     

Angry faces are tracked more easily than neutral faces during multiple identity tracking

We investigated whether and how emotional facial expressions affect sustained attention in face tracking. In a multiple-identity and object tracking paradigm, participants tracked multiple target faces that continuously moved around together with several distractor faces, and subsequently reported where each target face had moved to. The emotional expression (angry, happy, and neutral) of the target and distractor faces was manipulated. Tracking performance was better when the target faces were angry rather than neutral, whereas angry distractor faces did not affect tracking. The effect persisted when the angry faces were presented upside-down and when surface features of the faces were irrelevant to the ongoing task. There was only suggestive and weak evidence for a facilitatory effect of happy targets and a distraction effect of happy distractors in comparison to neutral faces. The results show that angry expressions on the target faces can facilitate sustained attention on the targets via increased vigilance, yet this effect likely depends on both emotional information and visual features of the angry faces.     

Facial Expressions of Emotion: Are Angry Faces Detected More Efficiently?

The rapid detection of facial expressions of anger or threat has obvious adaptive value. In this study, we examined the efficiency of facial processing by means of a visual search task. Participants searched displays of schematic faces and were required to determine whether the faces displayed were all the same or whether one was different. Four main results were found: (1) When displays contained the same faces, people were slower in detecting the absence of a discrepant face when the faces displayed angry (or sad/angry) rather than happy expressions. (2) When displays contained a discrepant face people were faster in detecting this when the discrepant face displayed an angry rather than a happy expression. (3) Neither of these patterns for same and different displays was apparent when face displays were inverted, or when just the mouth was presented in isolation. (4) The search slopes for angry targets were significantly lower than for happy targets. These results suggest that detection of angry facial expressions is fast and efficient, although does not "pop-out" in the traditional sense.     

Attentional capture by irrelevant emotional distractor faces

We establish attentional capture by emotional distractor faces presented as a "singleton" in a search task in which the emotion is entirely irrelevant. Participants searched for a male (or female) target face among female (or male) faces and indicated whether the target face was tilted to the left or right. The presence (vs. absence) of an irrelevant emotional singleton expression (fearful, angry, or happy) in one of the distractor faces slowed search reaction times compared to the singleton absent or singleton target conditions. Facilitation for emotional singleton targets was found for the happy expression but not for the fearful or angry expressions. These effects were found irrespective of face gender and the failure of a singleton neutral face to capture attention among emotional faces rules out a visual odd-one-out account for the emotional capture. The present study thus establishes irrelevant, emotional, attentional capture.     

Social anxiety and interpretation of ambiguous smiles

This study investigated whether social anxiety facilitates the discrimination between genuine and ambiguous smiles. Socially anxious (N=20) and nonanxious (N=20) participants categorized as “happy” or “not happy” faces with either (1) a truly happy expression (i.e., happy eyes and a smile), (2) truly nonhappy expressions (e.g., angry eyes and an angry mouth), or (3) blended expressions with a smiling mouth and nonhappy (e.g., angry, sad, etc.) eyes. Results indicated that, relative to nonanxious participants, those high in social anxiety were more likely to judge as “not happy” any blended expression with nonhappy eyes, and they were faster in judging as “not happy” the blended expressions with angry, fearful, or disgusted eyes (but not those with sad, surprised, or neutral eyes). These results suggest, respectively, that social anxiety inhibits a benign interpretation of all the ambiguous expressions with a smile, and speeds up the detection of threatening eyes in such expressions. Importantly, no differences appeared as a function of social anxiety for truly happy or nonhappy faces. This rules out a response-bias explanation, and also reveals that social anxiety does not affect sensitivity in the recognition of prototypical expressions.     

Modeling automatic threat detection: development of a face-in-the-crowd task

An angry face is expected to be detected faster than a happy face because of an early, stimulus-driven analysis of threat-related properties. However, it is unclear to what extent results from the visual search approach-the face-in-the-crowd task-mirror this automatic analysis. The paper outlines a model of automatic threat detection that combines the assumption of a neuronal system for threat detection with contemporary theories of visual search. The model served as a guideline for the development of a new face-in-the-crowd task. The development involved three preliminary studies that provided a basis for the selection of angry and happy facial stimuli resembling each other in respect to perceptibility, homogeneity, and intensity. With these stimuli a signal detection version of the search task was designed and tested. For crowds composed of neutral faces, the sensitivity measure d' proved the expected detection advantage of angry faces compared to happy faces. However, the emotional expression made no difference if a neutral face had to be detected in crowd composed of either angry or happy faces. Results are in line with the assumption of a stimulus-driven shift of attention giving rise to the superior detection of angry target faces.     

Facing threat: infants' and adults' visual scanning of faces with neutral, happy, sad, angry, and fearful emotional expressions

Human faces are among the most important visual stimuli that we encounter at all ages. This importance partly stems from the face as a conveyer of information on the emotional state of other individuals. Previous research has demonstrated specific scanning patterns in response to threat-related compared to non-threat-related emotional expressions. This study investigated how visual scanning patterns toward faces which display different emotional expressions develop during infancy. The visual scanning patterns of 4-month-old and 7-month-old infants and adults when looking at threat-related (i.e., angry and fearful) versus non-threat-related (i.e., happy, sad, and neutral) emotional faces were examined. We found that infants as well as adults displayed an avoidant looking pattern in response to threat-related emotional expressions with reduced dwell times and relatively less fixations to the inner features of the face. In addition, adults showed a pattern of eye contact avoidance when looking at threat-related emotional expressions that was not yet present in infants. Thus, whereas a general avoidant reaction to threat-related facial expressions appears to be present from very early in life, the avoidance of eye contact might be a learned response toward others' anger and fear that emerges later during development.     

视觉搜索中的情绪干扰项预习效应

干扰项预习效应是视觉搜索的试次间效应, 反映了过去不成功的搜索经验对注意的抑制。本研究中, 被试对情绪材料进行视觉搜索时, 同一个画面中的刺激的情绪效价可能一致, 也可能存在一个效价与众不同的靶子。实验任务是要求被试找到该靶子, 并对它的非情绪特征进行辨别反应。本研究包括3个实验, 分别采用情绪面孔的照片、情绪性动物图片、情绪性动物示意图, 均发现了情绪干扰项预习效应。也就是说, 当先呈现无靶子的试次再呈现有靶子的试次, 且有靶子的试次中干扰项的效价与之前无靶子试次中的刺激的效价一致时, 被试的反应要比靶子的效价与之前无靶子试次中刺激效价一致时更快。这些结果表明, 选择性注意系统可以利用以往的情绪信息引导注意的分配, 使当前注意偏离那些曾经搜索过但没有找到靶子的情绪特征, 而且这些情绪信息可能是由人脸表达的, 也可能是由于人以外的因素表达的。这些结果体现了情绪与认知的交互作用, 尤其是个体对情绪的已有经验对视觉选择注意的引导作用。     

Gaze behavior predicts memory bias for angry facial expressions in stable dysphoria

Interpersonal theories suggest that depressed individuals are sensitive to signs of interpersonal rejection, such as angry facial expressions. The present study examined memory bias for happy, sad, angry, and neutral facial expressions in stably dysphoric and stably nondysphoric young adults. Participants' gaze behavior (i.e., fixation duration, number of fixations, and distance between fixations) while viewing these facial expressions was also assessed. Using signal detection analyses, the dysphoric group had better accuracy on a surprise recognition task for angry faces than the nondysphoric group. Further, mediation analyses indicated that greater breadth of attentional focus (i.e., distance between fixations) accounted for enhanced recall of angry faces among the dysphoric group. There were no differences between dysphoria groups in gaze behavior or memory for sad, happy, or neutral facial expressions. Findings from this study identify a specific cognitive mechanism (i.e., breadth of attentional focus) that accounts for biased recall of angry facial expressions in dysphoria. This work also highlights the potential for integrating cognitive and interpersonal theories of depression.     

Facilitated detection of angry faces: Initial orienting and processing efficiency

In a visual search task, displays of four schematic faces (angry, sad, happy, or neutral) were presented. Participants decided whether the faces were all the same or whether one was different. A discrepant angry face in a context of three neutral faces was detected faster than other faces. This occurred in the absence of a higher probability of first fixation on the angry face. Moreover, angry faces were more accurately detected even when presented parafoveally. These results are not consistent with the hypothesis that angry faces are detected faster because they are looked at earlier. In contrast, angry faces were looked at less than other faces during the search process and were more accurately detected than other faces when the display duration was reduced to 150 ms. These results support the processing efficiency hypothesis, according to which fewer attentional resources are needed to identify angry faces, which would account for their speeded detection time. In addition, parafoveal analysis of the angry faces may start preattentively, which would account for the fewer and shorter fixations that they need later, when they come under the focus of attention.     

Recognition advantage of happy faces in extrafoveal vision: Featural and affective processing

Happy, surprised, disgusted, angry, sad, fearful, and neutral facial expressions were presented extrafoveally (2.5° away from fixation) for 150 ms, followed by a probe word for recognition (Experiment 1) or a probe scene for affective valence evaluation (Experiment 2). Eye movements were recorded and gaze-contingent masking prevented foveal viewing of the faces. Results showed that (a) happy expressions were recognized faster than others in the absence of fixations on the faces, (b) the same pattern emerged when the faces were presented upright or upside-down, (c) happy prime faces facilitated the affective evaluation of emotionally congruent probe scenes, and (d) such priming effects occurred at 750 but not at 250 ms prime–probe stimulus–onset asynchrony. This reveals an advantage in the recognition of happy faces outside of overt visual attention, and suggests that this recognition advantage relies initially on featural processing and involves processing of positive affect at a later stage.     

The face in the crowd effect unconfounded: happy faces, not angry faces, are more efficiently detected in single- and multiple-target visual search tasks

Is it easier to detect angry or happy facial expressions in crowds of faces? The present studies used several variations of the visual search task to assess whether people selectively attend to expressive faces. Contrary to widely cited studies (e.g., ?hman, Lundqvist, & Esteves, 2001) that suggest angry faces "pop out" of crowds, our review of the literature found inconsistent evidence for the effect and suggested that low-level visual confounds could not be ruled out as the driving force behind the anger superiority effect. We then conducted 7 experiments, carefully designed to eliminate many of the confounding variables present in past demonstrations. These experiments showed no evidence that angry faces popped out of crowds or even that they were efficiently detected. These experiments instead revealed a search asymmetry favoring happy faces. Moreover, in contrast to most previous studies, the happiness superiority effect was shown to be robust even when obvious perceptual confounds--like the contrast of white exposed teeth that are typically displayed in smiling faces--were eliminated in the happy targets. Rather than attribute this effect to the existence of innate happiness detectors, we speculate that the human expression of happiness has evolved to be more visually discriminable because its communicative intent is less ambiguous than other facial expressions.     

Processing emotional category congruency between emotional facial expressions and emotional words

Facial expressions are critical for effective social communication, and as such may be processed by the visual system even when it might be advantageous to ignore them. Previous research has shown that categorising emotional words was impaired when faces of a conflicting valence were simultaneously presented. In the present study, we examined whether emotional word categorisation would also be impaired when faces of the same (negative) valence but different emotional category (either angry, sad or fearful) were simultaneously presented. Behavioural results provided evidence for involuntary processing of basic emotional facial expression category, with slower word categorisation when the face and word categories were incongruent (e.g., angry word and sad face) than congruent (e.g., angry word and angry face). Event-related potentials (ERPs) time-locked to the presentation of the word-face pairs also revealed that emotional category congruency effects were evident from approximately 170 ms after stimulus onset.     

Processing emotional category congruency between emotional facial expressions and emotional words

Facial expressions are critical for effective social communication, and as such may be processed by the visual system even when it might be advantageous to ignore them. Previous research has shown that categorising emotional words was impaired when faces of a conflicting valence were simultaneously presented. In the present study, we examined whether emotional word categorisation would also be impaired when faces of the same (negative) valence but different emotional category (either angry, sad or fearful) were simultaneously presented. Behavioural results provided evidence for involuntary processing of basic emotional facial expression category, with slower word categorisation when the face and word categories were incongruent (e.g., angry word and sad face) than congruent (e.g., angry word and angry face). Event-related potentials (ERPs) time-locked to the presentation of the word–face pairs also revealed that emotional category congruency effects were evident from approximately 170 ms after stimulus onset.     

Aging and visual search: automatic and controlled attentional bias to threat faces

Using a visual search paradigm, we investigated how age affected attentional bias to emotional facial expressions. In Experiments 1 and 2, participants searched for a discrepant facial expression in a matrix of otherwise homogeneous faces. Both younger and older adults showed a more effective search when the discrepant face was angry rather than happy or neutral. However, when the angry faces served as non-target distractors, younger adults' search was less effective than happy or neutral distractor conditions. In contrast, older adults showed a more efficient search with angry distractors than happy or neutral distractors, indicating that older adults were better able to inhibit angry facial expressions. In Experiment 3, we found that even a top-down search goal could not override the angry face superiority effect in guiding attention. In addition, RT distribution analyses supported that both younger and older adults performed the top-down angry face search qualitatively differently from the top-down happy face search. The current research indicates that threat face processing involves automatic attentional shift and a controlled attentional process. The current results suggest that age only influenced the controlled attentional process.     

Emotional distraction unbalances visual processing

Brain mechanisms used to control nonemotional aspects of cognition may be distinct from those regulating responses to emotional stimuli, with activity of the latter being detrimental to the former. Previous studies have shown that suppression of irrelevant emotional stimuli produces a largely right-lateralized pattern of frontal brain activation, thus predicting that emotional stimuli may invoke temporary, lateralized costs to performance on nonemotional cognitive tasks. To test this, we briefly (85 ms) presented a central, irrelevant, expressive (angry, happy, sad, or fearful) or neutral face 100 ms prior to a letter search task. The presentation of emotional versus neutral faces slowed subsequent search for targets appearing in the left, but not the right, hemifield, supporting the notion of a right-lateralized, emotional response mechanism that competes for control with nonemotional cognitive processes. Presentation of neutral, scrambled, or inverted neutral faces produced no such laterality effects on visual search response times.