The costs and benefits of processing emotional stimuli during rapid serial visual presentation

Using a dual-target identification task during rapid serial visual presentation (RSVP), we examined facilitation and interference effects exerted by emotional stimuli. Emotionally arousing first targets (T1s) were encoded with higher accuracy than neutral T1s. At the same time, identification of a second neutral target (T2) was impaired reflecting a failure of disengaging attention from arousing T1s. Similar interference was triggered by arousing filler stimuli that were not voluntarily searched for in the RSVP stream (Experiment 2). In Experiment 3, we showed that interference is reduced (though facilitation for arousing T1s is maintained) when the second task itself involves variations in emotional arousal. Vice versa, when arousal associated with the T2 stimulus was predictable, interference recurred (Experiment 4). Our findings indicate that the perceived emotional intensity of a stimulus is a determinant of successful identification during RSVP: Encoding of arousing stimuli is reliably facilitated. Interference effects with subsequent processing arise independently and are strongly modulated by the overall task context and specific processing strategies.     

Emotional state affects the initiation of forward gait

The aim of the current study was to determine the extent to which pleasant and unpleasant emotional states impact the initiation of forward gait. Participants initiated gait and walked for several steps following the presentation of low arousing pleasant, high arousing pleasant, low arousing unpleasant, high arousing unpleasant, and neutral pictures. Reaction time, displacement, and velocity of the center of pressure (COP) trajectory, and length and velocity of the first and second steps were calculated. Exposure to the highly arousing unpleasant pictures reduced reaction times compared to all other affective conditions. Compared to the low arousing unpleasant pictures, exposure to the high and low arousing pleasant pictures increased the displacement of the COP movement during the anticipatory postural adjustment phase of gait initiation. Additionally, exposure to the low arousing pleasant pictures increased the velocity of the COP movement during the anticipatory postural adjustment phase, compared to the high and low arousing unpleasant pictures. Exposure to the high and low arousing pleasant pictures increased the velocity of the first step relative to the low arousing unpleasant pictures. These findings demonstrate that highly arousing unpleasant emotional states accelerate the initial motor response, but pleasant emotional states generally facilitate the initiation of forward gait due to the approach-oriented directional salience of the movement. These findings extend the scope of the motivational direction hypothesis by demonstrating the effects of emotional reactivity on the initiation of gait.     

The fear potentiated startle effect

A differential conditioning study examined whether an acoustic startle probe, presented during extinction of an aversively conditioned visual stimulus, potentiated the reflex eyeblink response in humans and whether this potentiation varied with the change in affective valence of the conditioned stimulus. Sixty college students were randomly assigned to view a series of two slides, depicting either unpleasant/highly arousing, unpleasant/moderate arousing, neutral/calm, pleasant/moderate arousing or pleasant/highly arousing scenes and objects (duration: 8 sec). During preconditioning (8 trials) and extinction (24 trials) acoustic startle probes (white noise bursts [50 ms; 95 dBA] were administered during and between slide presentation). During acquisition (16 trials) CS+ was reinforced by an electric shock. Startle response magnitudes significantly increased from preconditioning to extinction and were substantially larger to CS+. Conditioned startle reflex augmentation linearly increased with the pleasantness of the slides. Furthermore, subjects showed a greater post-conditioning increase of judged aversiveness to slides that they had previously reported to be more pleasant, exactly paralleling the startle reflex results.

     

The fear potentiated startle effect. Blink reflex modulation as a result of classical aversive conditioning

A differential conditioning study examined whether an acoustic startle probe, presented during extinction of an aversively conditioned visual stimulus, potentiated the reflex eyeblink response in humans and whether this potentiation varied with the change in affective valence of the conditioned stimulus. Sixty college students were randomly assigned to view a series of two slides, depicting either unpleasant/highly arousing, unpleasant/moderate arousing, neutral/calm, pleasant/moderate arousing or pleasant/highly arousing scenes and objects (duration: 8 sec). During preconditioning (8 trials) and extinction (24 trials) acoustic startle probes (white noise bursts [50 ms; 95 dBA] were administered during and between slide presentation). During acquisition (16 trials) CS+ was reinforced by an electric shock. Startle response magnitudes significantly increased from preconditioning to extinction and were substantially larger to CS+. Conditioned startle reflex augmentation linearly increased with the pleasantness of the slides. Furthermore, subjects showed a greater post-conditioning increase of judged aversiveness to slides that they had previously reported to be more pleasant, exactly paralleling the startle reflex results.     

Early modulation of visual perception by emotional arousal: Evidence from steady-state visual evoked brain potentials

Allocation of processing resources to emotional picture stimuli was examined using steady-state visual evoked brain potentials (ssVEPs). Participants viewed a set of 60 colored affective pictures from the International Affective Picture System, presented in a flickering mode at 10 Hz in order to elicit ssVEPs. Phase and amplitude of the 10-Hz ssVEP were examined for six picture categories: threat and mutilation (unpleasant), families and erotica (pleasant), and household objects and persons (neutral). Self-reported affective arousal and hedonic valence of the picture stimuli were assessed by means of subjective ratings. Viewing affectively arousing (unpleasant and pleasant) pictures was associated with enhanced ssVEP amplitude at parieto-occipital recording sites, as compared with neutral stimuli. Phase information suggested increased coactivation of right occipitotemporal and frontotemporal sources during processing of affectively arousing stimuli. These findings are consistent with reentrant modulation of early visual processing by distributed networks including subcortical and neocortical structures according to a stimulus's motivational relevance.     

Direction of association between targets in a RSVP task influences priming at very short but not long SOAs

When two targets are presented using rapid serial visual presentation (RSVP) and the interval between the targets is 200–500 ms, detection or identification of the second target is impaired. This impairment in second target report is known as the attentional blink (AB). This study sought to examine the impact of the direction of target association on priming during an AB task using very short and long SOAs. Two experiments were conducted using dual-stream RSVP tasks and targets that either shared an associative relationship or were unrelated to one another. The direction of association between the targets was also varied so that associatively related targets were presented in the forward (strongest association from target 1 to target 2) or backward directions of association (strongest association from target 2 to target 1). In Experiment 1 very short SOAs between targets (27–213 ms) were used. Priming was evident at the same SOAs for both targets presented in the backward direction of association. However, for targets presented in the forward direction of association, priming occurred for target 1 and target 2 at different SOAs. Experiment 2 used longer SOAs between targets (107 to 535 ms) and it was determined that while direction of association between the targets did not affect priming, there was a larger priming effect for target 2 than for target 1. The results of the two experiments indicate that direction of association between targets influences priming in RSVP tasks that use very short but not long SOAs. The results are discussed in relation to the two-stage response competition model of Potter et al. (J Exp Psychol Hum Percept Perform 28:1149–1162, 2002).     

Binding neutral information to emotional contexts: Brain dynamics of long-term recognition memory

There is abundant evidence in memory research that emotional stimuli are better remembered than neutral stimuli. However, effects of an emotionally charged context on memory for associated neutral elements is also important, particularly in trauma and stress-related disorders, where strong memories are often activated by neutral cues due to their emotional associations. In the present study, we used event-related potentials (ERPs) to investigate long-term recognition memory (1-week delay) for neutral objects that had been paired with emotionally arousing or neutral scenes during encoding. Context effects were clearly evident in the ERPs: An early frontal ERP old/new difference (300–500 ms) was enhanced for objects encoded in unpleasant compared to pleasant and neutral contexts; and a late central-parietal old/new difference (400–700 ms) was observed for objects paired with both pleasant and unpleasant contexts but not for items paired with neutral backgrounds. Interestingly, objects encoded in emotional contexts (and novel objects) also prompted an enhanced frontal early (180–220 ms) positivity compared to objects paired with neutral scenes indicating early perceptual significance. The present data suggest that emotional—particularly unpleasant—backgrounds strengthen memory for items encountered within these contexts and engage automatic and explicit recognition processes. These results could help in understanding binding mechanisms involved in the activation of trauma-related memories by neutral cues.     

Sparing and impairing: Emotion modulation of the attentional blink and the spread of sparing in a 3-target RSVP task

The performance impairment (attentional blink, AB) on a second target (T2) when it is presented within 200-500 ms after a first target (T1) during rapid serial visual presentation (RSVP) is typically attributed to resource depletion. The AB does not occur when targets appear in immediate sequence (sparing). Recently, this account has been challenged by findings that the lag 1 sparing can spread to later lags when using a 3-target RSVP. Two experiments using the 3-targets RSVP investigated the relative contribution of resource depletion and attentional enhancement and/or inhibition on the AB and the sparing when T1 (Exp. 1) or T3 (Exp. 2) are emotionally salient. Findings showed a greater sparing for neutral T3s when preceded by negative compared with neutral T1s (Exp. 1) and for negative T3s (Exp. 2). In contrast, the AB on neutral T3s was greater after negative than after neutral T1s (Exp. 1), but it was reduced when T3 was negative (Exp. 2). The AB and the sparing also depended on how many targets before T3 were correctly reported. These findings indicate that although there is a cost for processing multiple targets, the emotional modulations of the AB and the sparing are better explained by an interplay between emotion-enhancement and capacity limitations on temporal selective attention.     

Orienting, emotion, and memory: phasic and tonic variation in heart rate predicts memory for emotional pictures in men

Arousal-related processes associated with heightened heart rate (HR) predict memory enhancement, especially for emotionally arousing stimuli. In addition, phasic HR deceleration reflects "orienting" and sensory receptivity during perception of stimuli. We hypothesized that both tonic elevations in HR as well as phasic HR deceleration during viewing of pictures would be associated with deeper encoding and better subsequent memory for stimuli. Emotional pictures are more memorable and cause greater HR deceleration than neutral pictures. Thus, we predicted that the relations between cardiac activity and memory enhancement would be most pronounced for emotionally-laden compared to neutral pictures. We measured HR in 53 males during viewing of unpleasant, neutral, and pleasant pictures, and tested memory for the pictures two days later. Phasic HR deceleration during viewing of individual pictures was greater for subsequently remembered than forgotten pictures across all three emotion categories. Elevated mean HR across the entire encoding epoch also predicted better memory performance, but only for emotionally arousing pictures. Elevated mean HR and phasic HR deceleration were associated, such that individuals with greater tonic HR also showed greater HR decelerations during picture viewing, but only for emotionally arousing pictures. Results suggest that tonic elevations in HR are associated both with greater orienting and heightened memory for emotionally arousing stimuli.     

Pupillary activity while listening to verbal passages

Twelve college students were presented with neutral, pleasant, and unpleasant verbal passages each of 120 sec duration. Changes in pupil diameter before, during, and after each passage were continuously monitored. Dilation accompanied the pleasant and unpleasant passages relative to the neutral passage. No evidence for defensive pupillary constriction was found. Habituation occurred during periods of silence as well as during the stimulus passages. These results suggest that a study reported by Hess and Goodwin (1974) as demonstrating pupillary constriction to unpleasant visual material may be interpreted as reflecting differential habituation.     

The moderating effects of stimulus valence and arousal on memory suppression

This study examined the separate and combined effects of stimulus valence and arousal on retrieval inhibition. Participants performed Anderson and Green's (2001) memory suppression task with stimuli varying across dimensions of valence and arousal. Memory was tested through free and cued recall as well as speeded recognition. Results showed that both stimulus valence and arousal influenced the extent to which participants successfully inhibited retrieval, but not in the ways anticipated. Specifically, the strongest inhibition effects were for highly arousing, pleasant words. In addition, unpleasant stimuli that were suppressed were better recalled during both cued and free-recall tasks than pleasant stimuli that were suppressed. Across all tests of memory performance, there were no significant differences between the experimental conditions for highly arousing, unpleasant words. The implications of these findings are discussed.     

Eye movement assessment of selective attentional capture by emotional pictures

The eye-tracking method was used to assess attentional orienting to and engagement on emotional visual scenes. In Experiment 1, unpleasant, neutral, or pleasant target pictures were presented simultaneously with neutral control pictures in peripheral vision under instruction to compare pleasantness of the pictures. The probability of first fixating an emotional picture, and the frequency of subsequent fixations, were greater than those for neutral pictures. In Experiment 2, participants were instructed to avoid looking at the emotional pictures, but these were still more likely to be fixated first and gazed longer during the first-pass viewing than neutral pictures. Low-level visual features cannot explain the results. It is concluded that overt visual attention is captured by both unpleasant and pleasant emotional content.     

Attentional Resources Measured by Reaction Times Highlight Differences Within Pleasant and Unpleasant,High Arousing Stimuli

Simple reaction times (RTs) to acoustic tones were recorded during picture viewing in order to investigate attentional resource allocation to threat stimuli compared with pleasant (sport/adventure) and neutral (household objects) contents. Stimuli were selected as equally arousing according to standardized subjective ratings. In the late stage of picture processing threat pictures showed shorter RTs compared with neutral and pleasant ones. In a second study, a choice-RT task was employed, and a wider range of both pleasant and unpleasant contents was shown. Results indicated slower RTs when blood/injury and erotic couples were presented, compared with other threat, and with other positive (sport/adventure) scenes. Specifically, erotic couples require a greater amount of attentional resources compared with sport/adventure; the same is true for blood/injury stimuli as compared with threat. Remarkable differences were thus shown in attentional deployment to specific stimulus contents within the same valence category. These differences should be taken into account when using such stimuli to investigate emotional processing.     

Early adolescents show sustained susceptibility to cognitive interference by emotional distractors

A child's ability to continuously pay attention to a cognitive task is often challenged by distracting events. Distraction is especially detrimental in a learning or classroom environment in which attended information is typically associated with establishing skills and knowledge. Here we report a study examining the effect of emotional distractors on performance in a subsequent visual lexical decision task in 11- to 13-year-old students (n=30). Lexical decisions about neutral verbs and verb-like pseudowords (i.e., targets) were analysed as a function of the preceding distractor type (pleasant, neutral, or unpleasant photos) and the picture–target stimulus-onset asynchrony (SOA; 200 or 600 ms). Across distractor categories, emotionally arousing pictures prolonged decisions about word targets when compared to neutral pictures, irrespective of the SOA. The present results demonstrate that similar to adults, early adolescent students exhibit sustained susceptibility to cognitive interference by irrelevant emotional events.     

Accelerative and decelerative effects of hedonic valence and emotional arousal during visual scene processing

Perceptual processing of natural scene pictures is enhanced when the scene conveys emotional content. Such “motivated attention” to pleasant and unpleasant pictures has been shown to improve identification accuracy in non-speeded behavioural tasks. An open question is whether emotional content also modulates the speed of visual scene processing. In the present studies we show that unpleasant content reliably slowed two-choice categorization of pictures, irrespective of physical image properties, perceptual complexity, and categorization instructions. Conversely, pleasant content did not slow or even accelerated choice reactions, relative to neutral scenes. As indicated by lateralized readiness potentials, these effects occurred at cognitive processing rather than motor preparation/execution stages. Specifically, analysis of event-related potentials showed a prolongation of early scene discrimination for stimuli perceived as emotionally arousing, regardless of valence, and reflected in delayed peaks of the N1 component. In contrast, the timing of other processing steps, reflected in the P2 and late positive potential components and presumably related to post-discriminatory processes such as stimulus–response mapping, appeared to be determined by hedonic valence, with more pleasant scenes eliciting faster processing. Consistent with this model, varying arousal (low/high) within the emotional categories mediated the effects of valence on choice reaction speed. Functionally, arousal may prolong stimulus analysis in order to prevent erroneous and potentially harmful decisions. Pleasantness may act as a safety signal allowing rapid initiation of overt responses.     

Perceptual,affective, and cognitive judgments of odors: pleasantness and handedness effects

The present study sought to examine the differential processing of pleasant, neutral, and unpleasant odors. The effects of the nostril stimulated (left or right) and the type of judgment (perceptual, affective, or cognitive) performed on the olfactory stimuli were also studied. To this end, 64 subjects were asked to smell pleasant, neutral, and unpleasant odors under four conditions (detection, intensity, pleasantness, and familiarity tasks). The participants were to perform these tasks as quickly as possible, while response times were recorded. The results showed that (i) unpleasant odors were assessed more rapidly than neutral or pleasant odors, and that this was specifically true (ii) during right nostril stimulation, and (iii) during pleasantness assessment, suggesting possible differential cerebral hemisphere involvement, with a right-side advantage for processing of unpleasant affect in olfaction. A handedness effect on familiarity judgment is also discussed.     

Emotional modulation of attention affects time perception: Evidence from event-related potentials

Emotional effects on human time perception are generally attributed to arousal speeding up or slowing down the internal clock. The aim of the present study is to investigate the less frequently considered role of attention as an alternative mediator of these effects with the help of event-related potentials (ERPs). Participants produced short intervals (0.9, 1.5, 2.7, and 3.3 s) while viewing high arousal images with pleasant and unpleasant contents in comparison to neutral images. Behavioral results revealed that durations were overproduced for the 0.9 s interval whereas, for 2.7 and 3.3 s intervals, underproduction was observed. The effect of affective valence was present for the shorter durations and decreased as the target intervals became longer. More specifically, the durations for unpleasant images were less overproduced in the 0.9 s intervals, and for the 1.5 s trials, durations for unpleasant images were slightly underproduced, compared to pleasant images, which were overproduced. The analysis of different ERP components suggests possible attention processes related to the timing of affective images in addition to changes in pacemaker speed. Early Posterior Negativity (EPN) was larger for positive than for negative images, indicating valence-specific differences in activation of early attention mechanisms. Within the early P1 and the Late Positive Potential (LPP) components, both pleasant and unpleasant stimuli exhibited equal affective modulation. Contingent Negative Variation (CNV) remained independent of both timing performance and affective modulation. This pattern suggests that both pleasant and unpleasant stimuli enhanced arousal and captured attention, but the latter effect was more pronounced for pleasant stimuli. The valence-specificity of affective attention revealed by ERPs combined with behavioral timing results suggests that attention processes indeed contribute to emotion-induced temporal distortions, especially for longer target intervals.     

Capturing and holding attention: The impact of emotional words in rapid serial visual presentation

When two masked, to-be-attended targets are presented within approximately 500 msec of each other, accurate report of the second target (T2) suffers more than when targets are presented farther apart in time--an attentional blink (AB). In the present study, the AB was found to be larger when taboo words were presented as a first target (T1), as compared with the AB found when emotionally neutral, negative, or positive words were presented as T1, suggesting that taboo words received preferential attentional processing. Comparable results were also obtained when taboo words were presented as to-be-ignored distractors in single-target rapid serial visual presentation (RSVP). Arousal, but not valence, ratings of the emotional words predicted accuracy on subsequent targets in both dual- and single-task RSVP. Recognition memory for taboo words accounted fully for the negative relationships between arousal ratings and accuracy on subsequent targets, suggesting that arousal-triggered changes in attentional allocation influenced encoding of taboo words at the time they were encountered.     

Emotion and motor preparation: A transcranial magnetic stimulation study of corticospinal motor tract excitability

In the present study, we examined whether preparing motor responses under different emotional conditions alters motor evoked potentials (MEPs) elicited by transcranial magnetic stimulation delivered to the motor cortex. Analyses revealed three findings: (1) Reaction times were expedited during exposure to unpleasant images, as compared with pleasant and neutral images; (2) force amplitude was greater during exposure to unpleasant images, as compared with pleasant and neutral images; and (3) MEPs were larger while participants viewed unpleasant images, as compared with neutral images. Hence, coupling the preparation of motor responses with the viewing of emotional images led to arousal-driven changes in corticospinal motor tract excitability, whereas movement speed and force production varied as a function of emotional valence. These findings demonstrate that the effects of emotion on the motor system manifest at varying sensitivity levels across behavioral and neurophysiological measures. Moreover, they validate the action readiness component of emotional experience by demonstrating that emotional states influence the execution of future movements but, alone, do not lead to overt movement.     

Attending to affect: appraisal strategies modulate the electrocortical response to arousing pictures

Arousing (unpleasant and pleasant) pictures elicit increased neurophysiological measures of perceptual processing. In particular, the electrocortical late positive potential (LPP) is enhanced for arousing, compared with neutral, pictures. To determine whether the magnitude of the LPP is sensitive to the way stimuli are appraised, 16 participants viewed both pleasant and unpleasant pictures and categorized them along an affective or nonaffective dimension. Results indicate that the LPP was reduced for both pleasant and unpleasant pictures when participants made nonaffective, compared with affective, judgments. These results are consistent with previous studies that have used functional neuroimaging to investigate the role of appraisal on emotional processing. The results are further discussed in terms of the utility of using the LPP to study emotion regulation.