Emotional and neutral scenes in competition: orienting, efficiency, and identification

To investigate preferential processing of emotional scenes competing for limited attentional resources with neutral scenes, prime pictures were presented briefly (450 ms), peripherally (5.2° away from fixation), and simultaneously (one emotional and one neutral scene) versus singly. Primes were followed by a mask and a probe for recognition. Hit rate was higher for emotional than for neutral scenes in the dual- but not in the single-prime condition, and A' sensitivity decreased for neutral but not for emotional scenes in the dual-prime condition. This preferential processing involved both selective orienting and efficient encoding, as revealed, respectively, by a higher probability of first fixation on—and shorter saccade latencies to—emotional scenes and by shorter fixation time needed to accurately identify emotional scenes, in comparison with neutral scenes.     

Emotional scenes in peripheral vision: selective orienting and gist processing, but not content identification

Emotional-neutral pairs of visual scenes were presented peripherally (with their inner edges 5.2 degrees away from fixation) as primes for 150 to 900 ms, followed by a centrally presented recognition probe scene, which was either identical in specific content to one of the primes or related in general content and affective valence. Results indicated that (a) if no foveal fixations on the primes were allowed, the false alarm rate for emotional probes was increased; (b) hit rate and sensitivity (A') were higher for emotional than for neutral probes only when a fixation was possible on only one prime; and (c) emotional scenes were more likely to attract the first fixation than neutral scenes. It is concluded that the specific content of emotional or neutral scenes is not processed in peripheral vision. Nevertheless, a coarse impression of emotional scenes may be extracted, which then leads to selective attentional orienting or--in the absence of overt attention--causes false alarms for related probes.     

Time course of attentional bias to emotional scenes in anxiety: Gaze direction and duration

Pictures of emotionally neutral, positive, and negative (threat- or harm-related) scenes were presented for 3 seconds, paired with nonemotional control pictures. The eye fixations of high and low trait anxiety participants were monitored. Intensity of stimulus emotionality was varied, with two levels of perceptual salience for each picture (colour vs. greyscale). Regardless of perceptual salience, high anxiety was associated with preferential attention: (a) towards all types of emotional stimuli in initial orienting, as revealed by a higher probability of first fixation on the emotional picture than on the neutral picture of a pair; (b) towards positive and harm stimuli in a subsequent stage of early engagement, as shown by longer viewing times during the first 500 ms following onset of the pictures; and with (c) attention away from (i.e., avoidance) harm stimuli in a later phase, as indicated by shorter viewing times and lower frequency of fixation during the last 1000 ms of picture exposure. This suggests that the nature of the attentional bias varies as a function of the time course in the processing of emotional pictures.     

Time course of attentional bias to emotional scenes in anxiety: Gaze direction and duration

Pictures of emotionally neutral, positive, and negative (threat‐ or harm‐related) scenes were presented for 3 seconds, paired with nonemotional control pictures. The eye fixations of high and low trait anxiety participants were monitored. Intensity of stimulus emotionality was varied, with two levels of perceptual salience for each picture (colour vs. greyscale). Regardless of perceptual salience, high anxiety was associated with preferential attention: (a) towards all types of emotional stimuli in initial orienting, as revealed by a higher probability of first fixation on the emotional picture than on the neutral picture of a pair; (b) towards positive and harm stimuli in a subsequent stage of early engagement, as shown by longer viewing times during the first 500 ms following onset of the pictures; and with (c) attention away from (i.e., avoidance) harm stimuli in a later phase, as indicated by shorter viewing times and lower frequency of fixation during the last 1000 ms of picture exposure. This suggests that the nature of the attentional bias varies as a function of the time course in the processing of emotional pictures.     

Processing of emotional visual scenes outside the focus of spatial attention: The role of eccentricity

Pairs of emotional-neutral pictures were presented parafoveally or peripherally (i.e., 2.2° or 5.2° away from fixation) as primes for 150 ms, followed by a recognition probe. The probe was either identical or related in semantic content to one of the primes. Physical features (colour, size, and spatial orientation) were always different for the primes and the probe. Results indicated that, for parafoveal displays, hit rate and sensitivity (A′) were higher for the identical emotional probes than for the identical neutral probes; in contrast, for peripheral displays there were more false alarms for the related emotional probes than for the related neutral probes. It is concluded that processing of specific semantic content is more likely to be obtained from emotional than from neutral scenes in parafoveal vision, whereas an overall, vague impression is extracted in peripheral vision.     

Parafoveal semantic processing of emotional visual scenes

The authors investigated whether emotional pictorial stimuli are especially likely to be processed in parafoveal vision. Pairs of emotional and neutral visual scenes were presented parafoveally (2.1 degrees or 2.5 degrees of visual angle from a central fixation point) for 150-3,000 ms, followed by an immediate recognition test (500-ms delay). Results indicated that (a) the first fixation was more likely to be placed onto the emotional than the neutral scene; (b) recognition sensitivity (A') was generally higher for the emotional than for the neutral scene when the scenes were paired, but there were no differences when presented individually; and (c) the superior sensitivity for emotional scenes survived changes in size, color, and spatial orientation, but not in meaning. The data suggest that semantic analysis of emotional scenes can begin in parafoveal vision in advance of foveal fixation.     

Gaze Patterns When Looking at Emotional Pictures: Motivationally Biased Attention

Pictures of either emotionally neutral, pleasant (affectionate), or unpleasant (threat and injury) scenes were paired with nonemotional control pictures and presented for 3 s, while eye fixations were monitored. Preferential attention to the emotional picture of eah pair occurred at an early processing stage: The probability of placement of the first fixation and the proportion of viewing time during the first 500 ms were higher for both pleasant and unpleasant pictures than for neutral pictures, whereas later fixation location and time were not differentially affected. This suggests that, when emotional and nonemotional stimuli are presented simultaneously, emotional meaning captures initial overt orienting and engages attention early, as measured by gaze direction and duration. The possibility that this effect could be accounted for by perceptual differences—such as luminance and complexity—between emotional and neutral pictures was ruled out.     

Extrafoveal capture of attention by emotional scenes: affective valence versus visual saliency

ABSTRACT

Pairs of emotional (pleasant or unpleasant) and neutral scenes were presented peripherally (≥5° away from fixation) during a central letter-discrimination task. Selective attentional capture was assessed by means of eye movement orienting, i.e., probability of first fixating a scene and the time until first fixation. Static and dynamic visual saliency values of the scenes were computationally modelled. Results revealed selective orienting to both pleasant and unpleasant relative to neutral scenes. Importantly, such effects remained in the absence of visual saliency differences, even though saliency influenced eye movements. This suggests that selective attention to emotional scenes is genuinely driven by the processing of affective significance in extrafoveal vision.     

Perceptual processing of natural scenes at rapid rates: Effects of complexity, content, and emotional arousal

During rapid serial visual presentation (RSVP), the perceptual system is confronted with a rapidly changing array of sensory information demanding resolution. At rapid rates of presentation, previous studies have found an early (e.g., 150–280 ms) negativity over occipital sensors that is enhanced when emotional, as compared with neutral, pictures are viewed, suggesting facilitated perception. In the present study, we explored how picture composition and the presence of people in the image affect perceptual processing of pictures of natural scenes. Using RSVP, pictures that differed in perceptual composition (figure–ground or scenes), content (presence of people or not), and emotional content (emotionally arousing or neutral) were presented in a continuous stream for 330 ms each with no intertrial interval. In both subject and picture analyses, all three variables affected the amplitude of occipital negativity, with the greatest enhancement for figure–ground compositions (as compared with scenes), irrespective of content and emotional arousal, supporting an interpretation that ease of perceptual processing is associated with enhanced occipital negativity. Viewing emotional pictures prompted enhanced negativity only for pictures that depicted people, suggesting that specific features of emotionally arousing images are associated with facilitated perceptual processing, rather than all emotional content.     

Binding neutral information to emotional contexts: Brain dynamics of long-term recognition memory

There is abundant evidence in memory research that emotional stimuli are better remembered than neutral stimuli. However, effects of an emotionally charged context on memory for associated neutral elements is also important, particularly in trauma and stress-related disorders, where strong memories are often activated by neutral cues due to their emotional associations. In the present study, we used event-related potentials (ERPs) to investigate long-term recognition memory (1-week delay) for neutral objects that had been paired with emotionally arousing or neutral scenes during encoding. Context effects were clearly evident in the ERPs: An early frontal ERP old/new difference (300–500 ms) was enhanced for objects encoded in unpleasant compared to pleasant and neutral contexts; and a late central-parietal old/new difference (400–700 ms) was observed for objects paired with both pleasant and unpleasant contexts but not for items paired with neutral backgrounds. Interestingly, objects encoded in emotional contexts (and novel objects) also prompted an enhanced frontal early (180–220 ms) positivity compared to objects paired with neutral scenes indicating early perceptual significance. The present data suggest that emotional—particularly unpleasant—backgrounds strengthen memory for items encountered within these contexts and engage automatic and explicit recognition processes. These results could help in understanding binding mechanisms involved in the activation of trauma-related memories by neutral cues.     

Direct control of fixation times in scene viewing: Evidence from analysis of the distribution of first fixation duration

Participants' eye movements were monitored in two scene viewing experiments that manipulated the task-relevance of scene stimuli and their availability for extrafoveal processing. In both experiments, participants viewed arrays containing eight scenes drawn from two categories. The arrays of scenes were either viewed freely (Free Viewing) or in a gaze-contingent viewing mode where extrafoveal preview of the scenes was restricted (No Preview). In Experiment 1a, participants memorized the scenes from one category that was designated as relevant, and in Experiment 1b, participants chose their preferred scene from within the relevant category. We examined first fixations on scenes from the relevant category compared to the irrelevant category (Experiments 1a and 1b), and those on the chosen scene compared to other scenes not chosen within the relevant category (Experiment 1b). A survival analysis was used to estimate the first discernible influence of the task-relevance on the distribution of first-fixation durations. In the free viewing condition in Experiment 1a, the influence of task relevance occurred as early as 81 ms from the start of fixation. In contrast, the corresponding value in the no preview condition was 254 ms, demonstrating the crucial role of extrafoveal processing in enabling direct control of fixation durations in scene viewing. First fixation durations were also influenced by whether or not the scene was eventually chosen (Experiment 1b), but this effect occurred later and affected fewer fixations than the effect of scene category, indicating that the time course of scene processing is an important variable mediating direct control of fixation durations.     

Electrophysiological correlates of emotional face processing after mild traumatic brain injury in preschool children

Evidence suggests that social skills are affected by childhood mild traumatic brain injury (mTBI), but the neural and affective substrates of these difficulties are still underexplored. In particular, nothing is known about consequences on the perception of emotional facial expressions, despite its critical role in social interactions and the importance of the preschool period in the development of this ability. This study thus aimed to investigate the electrophysiological correlates of emotional facial expressions processing after early mTBI. To this end, 18 preschool children (mean age 53 ± 8 months) who sustained mTBI and 15 matched healthy controls (mean age 55 ± 11 months) were presented with pictures of faces expressing anger, happiness, or no emotion (neutral) while event-related potentials (ERP) were recorded. The main results revealed that P1 amplitude was higher for happy faces than for angry faces, and that N170 latency was shorter for emotional faces than for neutral faces in the control group only. These findings suggest that preschool children who sustain mTBI do not present the early emotional effects that are observed in healthy preschool children at visuospatial and visual expertise stages. This study provides new evidence regarding the consequences of childhood mTBI on socioemotional processing, by showing alterations of emotional facial expressions processing, an ability known to underlie social competence and appropriate social interactions.     

Brain processing of task-relevant and task-irrelevant emotional words: An ERP study

Although there is evidence for preferential perceptual processing of written emotional information, the effects of attentional manipulations and the time course of affective processing require further clarification. In this study, we attempted to investigate how the emotional content of words modulates cerebral functioning (event-related potentials, ERPs) and behavior (reaction times, RTs) when the content is task-irrelevant (emotional Stroop Task, EST) or task-relevant (emotional categorization task, ECT), in a sample of healthy middle-aged women. In the EST, the RTs were longer for emotional words than for neutral words, and in the ECT, they were longer for neutral and negative words than for positive words. A principal components analysis of the ERPs identified various temporospatial factors that were differentially modified by emotional content. P2 was the first emotion-sensitive component, with enhanced factor scores for negative nouns across tasks. The N2 and late positive complex had enhanced factor scores for emotional relative to neutral information only in the ECT. The results reinforce the idea that written emotional information has a preferential processing route, both when it is task-irrelevant (producing behavioral interference) and when it is task-relevant (facilitating the categorization). After early automatic processing of the emotional content, late ERPs become more emotionally modulated as the level of attention to the valence increases.     

Bringing color to emotion: The influence of color on attentional bias to briefly presented emotional images

Is color a critical feature in emotional content extraction and involuntary attentional orienting toward affective stimuli? Here we used briefly presented emotional distractors to investigate the extent to which color information can influence the time course of attentional bias in early visual cortex. While participants performed a demanding visual foreground task, complex unpleasant and neutral background images were displayed in color or grayscale format for a short period of 133 ms and were immediately masked. Such a short presentation poses a challenge for visual processing. In the visual detection task, participants attended to flickering squares that elicited the steady-state visual evoked potential (SSVEP), allowing us to analyze the temporal dynamics of the competition for processing resources in early visual cortex. Concurrently we measured the visual event-related potentials (ERPs) evoked by the unpleasant and neutral background scenes. The results showed (a) that the distraction effect was greater with color than with grayscale images and (b) that it lasted longer with colored unpleasant distractor images. Furthermore, classical and mass-univariate ERP analyses indicated that, when presented in color, emotional scenes elicited more pronounced early negativities (N1–EPN) relative to neutral scenes, than when the scenes were presented in grayscale. Consistent with neural data, unpleasant scenes were rated as being more emotionally negative and received slightly higher arousal values when they were shown in color than when they were presented in grayscale. Taken together, these findings provide evidence for the modulatory role of picture color on a cascade of coordinated perceptual processes: by facilitating the higher-level extraction of emotional content, color influences the duration of the attentional bias to briefly presented affective scenes in lower-tier visual areas.     

Primacy of emotional vs. semantic scene recognition in peripheral vision

Emotional scenes were presented peripherally (5.2° away from fixation) or foveally (at fixation) for 150 ms. In affective evaluation tasks viewers judged whether a scene was unpleasant or not, or whether it was pleasant or not. In semantic categorisation tasks viewers judged whether a scene involved animals or humans (superordinate-level task), or whether it portrayed females or males (subordinate-level task). The same stimuli were used for the affective and the semantic task. Results indicated that in peripheral vision affective evaluation was less accurate and slower than animal/human discrimination, and did not show any advantage over gender discrimination. In addition, performance impairment in the peripheral relative to the foveal condition was greater or equivalent for affective than for semantic categorisation. These findings cast doubts on the specialness and the primacy of affective over semantic recognition. The findings are also relevant when considering the role of the subcortical “low route” in emotional processing.     

Children prenatally exposed to maternal anxiety devote more attentional resources to neutral pictures

Maternal anxiety during pregnancy can negatively affect fetal neurodevelopment, predisposing the offspring to a higher risk of behavioral and emotional problems later in life. The current study investigates the association between maternal anxiety during pregnancy and child affective picture processing using event‐related brain potentials (ERPs). Mothers reported anxiety during the second trimester using the anxiety subscale of the Symptom Checklist (SCL‐90). At age 4 years, child affective picture processing (N = 86) was measured by recording ERPs during viewing of neutral, pleasant, and unpleasant pictures selected from the International Affective Pictures System. The late positive potential (LPP)—an ERP component reflecting individual differences in affective processing—was used as child outcome. The expected positive association between maternal anxiety and LPP amplitude for unpleasant pictures was not found. Nevertheless, we found a positive association between maternal anxiety during pregnancy and LPP amplitudes for neutral pictures in the middle and late time window at anterior locations (all p < .05). These associations remained significant after adjusting for maternal postnatal anxiety and gestational age at birth and after FDR correction for multiple comparisons. Our study provides neurophysiological evidence that children prenatally exposed to higher maternal anxiety devote more attentional resources to neutral pictures, but not to unpleasant pictures. Possibly, these children show enhanced vigilance for threat when viewing neutral pictures. Although useful in dangerous environments, this enhanced vigilance may predispose children prenatally exposed to higher maternal anxiety to developing behavioral and/or emotional problems later in life. A video abstract of this article can be viewed at: https://www.youtube.com/watch?v=kEzYi6IS2HA     

Effects of test sequence on anterograde and retrograde impairment of negative emotional scenes1

Abstract: The present study examined recognition for sequences of scenes depicting emotional compared with neutral events. In two experiments, participants were presented with a thematic series of 18 slides of scenes in which the content of two critical scenes in the middle of the series were either emotional (dead men's bodies) or neutral (an opera). A two‐item, forced‐choice recognition paradigm was used to test participants’ immediate memory performance of all 18 slides of scenes. In Experiment 1, anterograde and retrograde amnesic effects were observed for the emotional, but not the neutral scenes when a test sequence of scenes was used that did not match the original presentation order. In contrast, in Experiment 2 the test sequence matched the order seen during the original presentation, and both the anterograde and retrograde amnesic effects were not found. These results indicate that the reinstatement of the original event context is an important factor for the recognition of negative emotional memories.     

Effects of emotional content on working memory capacity

Emotional events tend to be remembered better than neutral events, but emotional states and stimuli may also interfere with cognitive processes that underlie memory performance. The current study investigated the effects of emotional content on working memory capacity (WMC), which involves both short term storage and executive attention control. We tested competing hypotheses in a preregistered experiment (N?=?297). The emotional enhancement hypothesis predicts that emotional stimuli attract attention and additional processing resources relative to neutral stimuli, thereby making it easier to encode and store emotional information in WMC. The emotional impairment hypothesis, by contrast, predicts that emotional stimuli interfere with attention control and the active maintenance of information in working memory. Participants completed a common measure of WMC (the operation span task; Turner, M. L., &; Engle, R. W. [1989]. Is working memory capacity task dependent? Journal of Memory and Language, 28, 127–154) that included either emotional or neutral words. Results revealed that WMC was reduced for emotional words relative to neutral words, consistent with the emotional impairment hypothesis.     

Cross-cultural differences in item and background memory: examining the influence of emotional intensity and scene congruency

After viewing a scene, individuals differ in what they prioritise and remember. Culture may be one factor that influences scene memory, as Westerners have been shown to be more item-focused than Easterners (see Masuda, T., & Nisbett, R. E. (2001). Attending holistically versus analytically: Comparing the context sensitivity of Japanese and Americans. Journal of Personality and Social Psychology, 81, 922–934). However, cultures may differ in their sensitivity to scene incongruences and emotion processing, which may account for cross-cultural differences in scene memory. The current study uses hierarchical linear modeling (HLM) to examine scene memory while controlling for scene congruency and the perceived emotional intensity of the images. American and East Asian participants encoded pictures that included a positive, negative, or neutral item placed on a neutral background. After a 20-min delay, participants were shown the item and background separately along with similar and new items and backgrounds to assess memory specificity. Results indicated that even when congruency and emotional intensity were controlled, there was evidence that Americans had better item memory than East Asians. Incongruent scenes were better remembered than congruent scenes. However, this effect did not differ by culture. This suggests that Americans’ item focus may result in memory changes that are robust despite variations in scene congruency and perceived emotion.     

Emotional content enhances true but not false memory for categorized stimuli

Past research has shown that emotion enhances true memory, but that emotion can either increase or decrease false memory. Two theoretical possibilities—the distinctiveness of emotional stimuli and the conceptual relatedness of emotional content—have been implicated as being responsible for influencing both true and false memory for emotional content. In the present study, we sought to identify the mechanisms that underlie these mixed findings by equating the thematic relatedness of the study materials across each type of valence used (negative, positive, or neutral). In three experiments, categorically bound stimuli (e.g., funeral, pets, and office items) were used for this purpose. When the encoding task required the processing of thematic relatedness, a significant true-memory enhancement for emotional content emerged in recognition memory, but no emotional boost to false memory (Exp. 1). This pattern persisted for true memory with a longer retention interval between study and test (24 h), and false recognition was reduced for emotional items (Exp. 2). Finally, better recognition memory for emotional items once again emerged when the encoding task (arousal ratings) required the processing of the emotional aspect of the study items, with no emotional boost to false recognition (Exp. 3). Together, these findings suggest that when emotional and neutral stimuli are equivalently high in thematic relatedness, emotion continues to improve true memory, but it does not override other types of grouping to increase false memory.