Beware the eyes behind the mask: The capture and hold of selective attention by backward masked fearful eyes

Fearful facial expressions are important social indicators of environmental threat. Among the various features of a fearful face, the eyes appear to be particularly important for recognizing and responding to these social cues. One way in which fearful faces facilitate observers’ behavior is by automatically capturing attention. This is true for both consciously and nonconsciously processed fearful faces. Recent research suggests that consciously processed fearful eyes alone are sufficient to capture observers’ attention. However, it is unknown as to whether or not nonconsciously processed, backward masked, fearful eyes are sufficient to facilitate spatial attention. To test this possibility, two dot-probe experiments with masked fearful eye stimuli were performed. In Experiment 1, we found that, relative to scrambled eyes, masked fearful eyes facilitate attentional orienting and delay attentional disengagement. In Experiment 2, we replicated this effect when comparing backward masked fearful to neutral eyes. Thus, the data suggest that nonconscious fearful eyes facilitate spatial attention through facilitated orienting and delayed disengagement.     

The orienting of spatial attention to backward masked fearful faces is associated with variation in the serotonin transporter gene

Threat signals facilitate spatial attention, even when awareness of these signals has been restricted through the use of backward masking. However, unrestricted/unmasked threat cues tend to delay the disengagement of attention, whereas restricted/masked threat facilitates orienting, suggesting different underlying mechanisms. Within the general population, the serotonin transporter gene polymorphism (5HTTLPR) is associated with one's allocation of attention to unmasked threat signals. However, it is unclear to what extent the 5HTTLPR gene may be involved in nonconscious biases to masked threat, and whether or not such biases are driven by facilitated orienting or delayed disengagement. Participants were genotyped and performed a dot-probe task with backward masked fearful and neutral faces. Results indicate that short-allele carriers of the 5HTTLPR gene nonconsciously orient spatial attention to masked fearful faces. On the other hand, homozygous long-allele individuals tended to direct attention away from masked fearful faces. All participants' performance was at chance in a posttask assessment of awareness for the masked faces. The results add to current literature on the 5HTTLPR and attention biases, and suggest that threat signals facilitate the orienting of attention in short-allele carriers of the 5HTTLPR gene even under restricted processing conditions.     

Spatial attention-related modulation of the N170 by backward masked fearful faces

Facial expressions are a basic form of non-verbal communication that convey important social information to others. The relevancy of this information is highlighted by findings that backward masked facial expressions facilitate spatial attention. This attention effect appears to be mediated through a neural network consisting of the amygdala, anterior cingulate, and visual cortex. However, a direct investigation of the neural time course associated with orienting to such stimuli has yet to be performed. In the current investigation, a backward masked fearful face dot-probe task was performed while ERPs were recorded. Reaction time results suggest that spatial attention is captured by backward masked fearful faces and attention is focused at the location of the fear stimulus. Masked right visual field fearful faces enhanced the N170 amplitudes of contralateral occipito-temporal electrodes. The rapid contralateral N170 enhancement was positively correlated with participants’ behavioral index of spatial attention. Thus, backward masked fearful face-elicited spatial attention facilitates behavior and modulates the early stage of facial processing reflected by the N170.     

Attending to the fear in your eyes: Facilitated orienting and delayed disengagement

Fearful facial expressions convey threat-related information and automatically elicit modulations in spatial attention. The eye-region appears to be a particularly important feature for recognising and responding to fearful faces. However, it is unknown as to whether or not fearful eyes initiate modulations in spatial attention. In the current study, three dot-probe experiments with fearful and neutral eye stimuli were performed. The results of Experiment 1 demonstrate that fearful eyes capture spatial attention through facilitated attentional orienting to threat and delayed attentional disengagement from threat. In Experiments 2 and 3, these attentional effects were replicated, while ruling out the influence of overall size/shape and brightness differences between fearful and neutral eyes, respectively. Thus, fearful eye-whites appear to be a salient feature of fearful facial expressions that elicit modulations in spatial attention.     

Links between rapid ERP responses to fearful faces and conscious awareness

To study links between rapid ERP responses to fearful faces and conscious awareness, a backward‐masking paradigm was employed where fearful or neutral target faces were presented for different durations and were followed by a neutral face mask. Participants had to report target face expression on each trial. When masked faces were clearly visible (200 ms duration), an early frontal positivity, a later more broadly distributed positivity, and a temporo‐occipital negativity were elicited by fearful relative to neutral faces, confirming findings from previous studies with unmasked faces. These emotion‐specific effects were also triggered when masked faces were presented for only 17 ms, but only on trials where fearful faces were successfully detected. When masked faces were shown for 50 ms, a smaller but reliable frontal positivity was also elicited by undetected fearful faces. These results demonstrate that early ERP responses to fearful faces are linked to observers' subjective conscious awareness of such faces, as reflected by their perceptual reports. They suggest that frontal brain regions involved in the construction of conscious representations of facial expression are activated at very short latencies.     

Effects of mask use and other-race on face perception,emotion recognition,and social distancing during the COVID-19 pandemic

We tested the effect of mask use and other-race effect on (a) face recognition, (b) recognition of facial expressions, and (c) social distance. Caucasian subjects were tested in a matching-to-sample paradigm with either masked or unmasked Caucasian and Asian faces. The participants exhibited the best performance in recognizing an unmasked face condition and the poorest to recognize a masked face that they had seen earlier without a mask. Accuracy was poorer for Asian faces than Caucasian faces. The second experiment presented Asian or Caucasian faces having emotional expressions, with and without masks. The participants' emotion recognition performance decreased for masked faces. From the most accurately to least accurately recognized emotions were as follows: happy, neutral, disgusted, fearful. Performance was poorer for Asian stimuli compared to Caucasian. In Experiment 3 the same participants indicated the social distance they would prefer with each pictured person. They preferred a wider distance with unmasked faces compared to masked faces. Distance from farther to closer was as follows: disgusted, fearful, neutral, and happy. They preferred wider social distance for Asian compared to Caucasian faces. Altogether, findings indicated that during the COVID-19 pandemic mask wearing decreased recognition of faces and emotional expressions, negatively impacting communication among people from different ethnicities.     

Fearful faces modulate looking duration and attention disengagement in 7-month-old infants

The present study investigated whether facial expressions modulate visual attention in 7-month-old infants. First, infants' looking duration to individually presented fearful, happy, and novel facial expressions was compared to looking duration to a control stimulus (scrambled face). The face with a novel expression was included to examine the hypothesis that the earlier findings of greater allocation of attention to fearful as compared to happy faces could be due to the novelty of fearful faces in infants' rearing environment. The infants looked longer at the fearful face than at the control stimulus, whereas no such difference was found between the other expressions and the control stimulus. Second, a gap/overlap paradigm was used to determine whether facial expressions affect the infants' ability to disengage their fixation from a centrally presented face and shift attention to a peripheral target. It was found that infants disengaged their fixation significantly less frequently from fearful faces than from control stimuli and happy faces. Novel facial expressions did not have a similar effect on attention disengagement. Thus, it seems that adult-like modulation of the disengagement of attention by threat-related stimuli can be observed early in life, and that the influence of emotionally salient (fearful) faces on visual attention is not simply attributable to the novelty of these expressions in infants' rearing environment.     

The involvement of distinct visual channels in rapid attention towards fearful facial expressions

This paper reports five experiments demonstrating that the low spatial frequency components of faces are critical to the production of rapid attentional responses towards fearful facial expressions. In our main experiments, low spatial frequency (LSF) or high spatial frequency (HSF) face pairs, consisting of one fearful and one neutral expression, were presented on a computer screen for a brief period. Participants were required to identify as quickly as possible the orientation of a bar target that immediately replaced one of the faces. Responses were faster when targets replaced the location of LSF fearful faces, compared with LSF neutral faces. By contrast, there were no differences between responses to targets replacing HSF fearful versus HSF neutral faces. This facilitation in spatial orienting occurred specifically with short time intervals between faces and target, and is consistent with a rapid processing of fear cues from LSF inputs that can serve to guide attention towards threat events.     

Amygdala activation during masked presentation of emotional faces predicts conscious detection of threat-related faces

It has been argued that critical functions of the human amygdala are to modulate the moment-to-moment vigilance level and to enhance the processing and the consolidation of memories of emotionally arousing material. In this functional magnetic resonance study, pictures of human faces bearing fearful, angry, and happy expressions were presented to nine healthy volunteers using a backward masking procedure based on neutral facial expression. Activation of the left and right amygdala in response to the masked fearful faces (compared to neutral faces) was significantly correlated with the number of fearful faces detected. In addition, right but not left amygdala activation in response to the masked angry faces was significantly related to the number of angry faces detected. The present findings underscore the role of the amygdala in the detection and consolidation of memory for marginally perceptible threatening facial expression.     

Anxiety and sensitivity to eye gaze in emotional faces

This paper reports three studies in which stronger orienting to perceived eye gaze direction was revealed when observers viewed faces showing fearful or angry, compared with happy or neutral, emotional expressions. Gaze-related spatial cueing effects to laterally presented fearful faces and centrally presented angry faces were also modulated by the anxiety level of participants, with high- but not low-state anxious individuals revealing enhanced shifts of attention. In contrast, both high- and low-state anxious individuals demonstrated enhanced orienting to averted gaze when viewing laterally presented angry faces. These results provide novel evidence for the rapid integration of facial expression and gaze direction information, and for the regulation of gaze-cued attention by both the emotion conveyed in the perceived face and the degree of anxiety experienced by the observer.     

The combined effect of gaze direction and facial expression on cueing spatial attention

Empirical evidence shows an effect of gaze direction on cueing spatial attention, regardless of the emotional expression shown by a face, whereas a combined effect of gaze direction and facial expression has been observed on individuals' evaluative judgments. In 2 experiments, the authors investigated whether gaze direction and facial expression affect spatial attention depending upon the presence of an evaluative goal. Disgusted, fearful, happy, or neutral faces gazing left or right were followed by positive or negative target words presented either at the spatial location looked at by the face or at the opposite spatial location. Participants responded to target words based on affective valence (i.e., positive/negative) in Experiment 1 and on letter case (lowercase/uppercase) in Experiment 2. Results showed that participants responded much faster to targets presented at the spatial location looked at by disgusted or fearful faces but only in Experiment 1, when an evaluative task was used. The present findings clearly show that negative facial expressions enhance the attentional shifts due to eye-gaze direction, provided that there was an explicit evaluative goal present.     

The amygdala is involved in affective priming effect for fearful faces

The object of this study was to investigate whether the amygdala is involved in affective priming effect after stimuli are encoded unconsciously and consciously. During the encoding phase, each masked face (fearful or neutral) was presented to participants six times for 17ms each, using a backward masking paradigm. During the retrieval phase, participants made a fearful/neutral judgment for each face. Half of the faces had the same valence as that seen during encoding (congruent condition) and the other half did not (incongruent condition). Participants were divided into unaware and aware groups based on their subjective and objective awareness assessments. The fMRI results showed that during encoding, the amygdala elicited stronger activation for fearful faces than neutral faces but differed in the hemisphere according to the awareness level. During retrieval, the amygdala showed a significant repetition priming effect, with the congruent faces producing less activation than the incongruent faces, especially for fearful faces. These data suggest that the amygdala is important in unconscious retrieving of memories for emotional faces whether they are encoded consciously or unconsciously.     

Awareness of faces is modulated by their emotional meaning

A central question in perception is how stimuli are selected for access to awareness. This study investigated the impact of emotional meaning on detection of faces using the attention blink paradigm. Experiment 1 showed that fearful faces were detected more frequently than neutral faces, and Experiment 2 revealed preferential detection of fearful faces compared with happy faces. To rule out image artifacts as a cause for these results, Experiment 3 manipulated the emotional meaning of neutral faces through fear conditioning and showed a selective increase in detection of conditioned faces. These results extend previous reports of preferential detection of emotional words or schematic objects and suggest that fear conditioning can modulate detection of formerly neutral stimuli.     

Both fearful and happy expressions interact with gaze direction by 200 ms SOA to speed attention orienting

Attention orienting towards a gazed-at location is fundamental to social attention. Whether gaze cues can interact with emotional expressions other than those signalling environmental threat to modulate this gaze cueing, and whether this integration changes over time, remains unclear. With four experiments we demonstrate that, when perceived motion inherent to dynamic displays is controlled for, gaze cueing is enhanced by both fearful and happy faces compared to neutral faces. This enhancement is seen with stimulus-onset asynchronies ranging from 200–700?ms. Thus, gaze cueing can be reliably modulated by positive expressions, albeit to a smaller degree than fearful ones, and this gaze–emotion integration impacts behaviour as early as 200?ms post-cue onset.     

哭泣表情面孔的注意偏向:眼动的证据

研究采用双选择Oddball范式和线索-靶子范式,并结合眼动技术,以微笑、哭泣和中性表情面孔为刺激材料,综合考察哭泣表情面孔在识别和解离过程中的注意偏向。研究发现:在识别阶段,哭泣表情面孔的识别正确率和反应速度都显著优于微笑表情面孔,进一步的兴趣区注视偏向分析发现,哭泣和微笑表情面孔的注视模式既具有一致的规律,又存在细微的差异;在解离阶段,返回抑制受线索表情类型的影响,在有效线索条件下,哭泣表情线索呈现后个体对目标刺激的平均注视时间和眼跳潜伏期都显著短于其它表情线索。表明哭泣表情面孔在识别和解离过程中具有不同的注意偏向表现,在识别阶段表现为反应输出优势和注视模式上的一致性与差异性;在解离阶段表现为有效线索条件下,对目标刺激定位和视觉加工的促进作用。     

Emotional modulation of attention orienting by gaze varies with dynamic cue sequence

ABSTRACT

Recent gaze cueing studies using dynamic cue sequences have reported increased attention orienting by gaze with faces expressing fear, surprise or anger. Here, we investigated whether the type of dynamic cue sequence used impacted the magnitude of this effect. When the emotion was expressed before or concurrently with gaze shift, no modulation of gaze-oriented attention by emotion was seen. In contrast, when the face cue averted gaze before expressing an emotion (as if reacting to the object after first localizing it), the gaze orienting effect was clearly increased for fearful, surprised and angry faces compared to neutral faces. Thus, the type of dynamic sequence used, and in particular the order in which the gaze shift and the facial expression are presented, modulate gaze-oriented attention, with maximal modulation seen when the expression of emotion follows gaze shift.     

Where is the chocolate? Rapid spatial orienting toward stimuli associated with primary rewards

Some stimuli can orient attentional resources and access awareness even if they appear outside the focus of voluntary attention. Stimuli with low-level perceptual salience and stimuli with an emotional content can modulate attention independently of voluntary processes. In Experiment 1, we used a spatial cuing task to investigate whether stimuli that are controlled for their perceptual salience can modulate the rapid orienting of attention based exclusively on their affective relevance. Affective relevance was manipulated through a Pavlovian conditioning paradigm in which an arbitrary and affectively neutral perceptual stimulus was associated with a primary reward (i.e., a chocolate odor). Results revealed that, after conditioning, attentional resources were rapidly oriented toward the stimulus that was previously associated with the reward. In Experiment 2, we used the very same conditioning procedure, but we devaluated the reward after conditioning for half of the participants through a sensory-specific satiation procedure. Strikingly, when the reward was devaluated, attention was no longer oriented toward reward-associated stimuli. Our findings therefore suggest that reward associations rapidly modulate visual processing independently of both voluntary processing and the perceptual salience of the stimulus. This supports the notion that stimuli associated with primary rewards modulate rapid attention orienting on the basis of the affective relevance of the stimulus.     

A tale of two negatives: differential memory modulation by threat-related facial expressions

Facial expressions serve as cues that encourage viewers to learn about their immediate environment. In studies assessing the influence of emotional cues on behavior, fearful and angry faces are often combined into one category, such as "threat-related," because they share similar emotional valence and arousal properties. However, these expressions convey different information to the viewer. Fearful faces indicate the increased probability of a threat, whereas angry expressions embody a certain and direct threat. This conceptualization predicts that a fearful face should facilitate processing of the environment to gather information to disambiguate the threat. Here, we tested whether fearful faces facilitated processing of neutral information presented in close temporal proximity to the faces. In Experiment 1, we demonstrated that, compared with neutral faces, fearful faces enhanced memory for neutral words presented in the experimental context, whereas angry faces did not. In Experiment 2, we directly compared the effects of fearful and angry faces on subsequent memory for emotional faces versus neutral words. We replicated the findings of Experiment 1 and extended them by showing that participants remembered more faces from the angry face condition relative to the fear condition, consistent with the notion that anger differs from fear in that it directs attention toward the angry individual. Because these effects cannot be attributed to differences in arousal or valence processing, we suggest they are best understood in terms of differences in the predictive information conveyed by fearful and angry facial expressions.     

Multiple contributions to priming effects for familiar faces: analyses with backward masking and event-related potentials

The model of face recognition by Bruce and Young postulates a pool of structural representations for familiar faces in long-term memory, so-called face recognition units (FRUs). Event-related brain potentials show early repetition priming effects for familiar faces around 250-300 ms [N250r or early repetition effect (ERE)], which are thought to reflect the activation of these FRUs. However, small N250r effects are also seen for unfamiliar faces suggesting that priming of perceptual codes (i.e., pictorial and structural codes) also contributes to early repetition effects. Using a face-familiarity task in Experiment 1, we aimed to eliminate these perceptual contributions to face priming by backward masking the prime face with a different, unfamiliar face. As expected, a repetition priming effect appeared only for familiar faces. Experiment 2 used a semantic-decision task and compared the effects of different kinds of masks that interfered with either pictorial codes or with pictorial and structural codes. Our findings indicate that both structural codes and memory representations contribute to the N250r and that unfamiliar-face masks interfere only with structural codes. Face-masks may therefore provide a useful tool to extract the pure contributions of memory representations (i.e., FRUs) to repetition priming.     

Early detection and avoidance of threatening faces during passive viewing

To evaluate whether there is an early attentional bias towards negative stimuli, we tracked participants' eyes while they passively viewed displays composed of four Ekman faces. In Experiment 1 each display consisted of three neutral faces and one face depicting fear or happiness. In half of the trials, all faces were inverted. Although the passive viewing task should have been very sensitive to attentional biases, we found no evidence that overt attention was biased towards fearful faces. Instead, people tended to actively avoid looking at the fearful face. This avoidance was evident very early in scene viewing, suggesting that the threat associated with the faces was evaluated rapidly. Experiment 2 replicated this effect and extended it to angry faces. In sum, our data suggest that negative facial expressions are rapidly analysed and influence visual scanning, but, rather than attract attention, such faces are actively avoided.