Cognitive engagement in emotional text reading: concurrent recordings of eye movements and head motion

ABSTRACT

The present study examined the effects of emotions on eye movements, head motion, and iPad motion during reading. Thirty-one participants read neutral, emotionally negative texts and emotionally positive texts on a digital tablet and both participants’ eye movements and body movements were recorded using respectively eye-tracking glasses and a motion capture system. The results showed that emotionally positive texts were read faster than neutral texts, and that readers’ movements decreased when reading emotional texts regardless of valence polarity. Recent studies suggested that postural movements may reflect cognitive engagement and especially the engagement in the task to be done. Our findings seem to validate this hypothesis of a bodily engagement in reading emotional contents. The present results suggest that the novel methodology of eye and postural movement recordings is informative in studying the readers’ embodied engagement during reading emotional materials.     

Effects of Material Emotional Valence on the Time Course of Massive Repetition Priming

Learning through repetition is a fundamental form and also an effective method of language learning critical for achieving proficient and automatic language use. Massive repetition priming as a common research paradigm taps into the dynamic processes involved in repetition learning. Research with this paradigm has so far used only emotionally neutral materials and ignored emotional factors, which seems inappropriate given the well-documented impact of emotion on cognitive processing. The present study used massive repetition priming to investigate whether the emotional valence of learning materials affects implicit language learning. Participants read a list of Chinese words and made speeded perceptual judgments about the spatial configuration of the two characters in a word. Each word was repeated 15 times in the whole learning session. There were three types of words, negative, positive, or neutral in their emotional valence, presented in separate blocks. Although similar levels of asymptotic performance were reached for different valence conditions showing comparable total effects of learning, learning of the positive words was found to be associated with fewer plateaus of shorter durations and to reach saturation earlier, compared with neutral and negative words. The results showed for the first time that the emotional valence of learning materials has significant effects on the time course of learning so that positive materials are learned faster and more efficiently, relative to negative and neutral materials. The study indicates the importance to explicitly consider the role of emotional factors in implicit language learning research.     

Emotion words affect eye fixations during reading

Emotion words are generally characterized as possessing high arousal and extreme valence and have typically been investigated in paradigms in which they are presented and measured as single words. This study examined whether a word's emotional qualities influenced the time spent viewing that word in the context of normal reading. Eye movements were monitored as participants read sentences containing an emotionally positive (e.g., lucky), negative (e.g., angry), or neutral (e.g., plain) word. Target word frequency (high or low) was additionally varied to help determine the temporal locus of emotion effects, with interactive results suggesting an early lexical locus of emotion processing. In general, measures of target fixation time demonstrated significant effects of emotion and frequency as well as an interaction. The interaction arose from differential effects with negative words that were dependent on word frequency. Fixation times on emotion words (positive or negative) were consistently faster than those on neutral words with one exception-high-frequency negative words were read no faster than their neutral counterparts. These effects emerged in the earliest eye movement measures, namely, first and single fixation duration, suggesting that emotionality, as defined by arousal and valence, modulates lexical processing. Possible mechanisms involved in processing emotion words are discussed, including automatic vigilance and desensitization, both of which imply a key role for word frequency. Finally, it is important that early lexical effects of emotion processing can be established within the ecologically valid context of fluent reading.     

不同熟练类型双语者情绪Stroop中的自动化情绪通达

采用情绪Stroop范式探讨3种不同熟练类型双语者在L1(The first language,简称L1)和L2(The second language,简称L2)条件下的自动化情绪通达。实验设计为2(L1和L2)×3(全面熟练双语者、阅读型熟练双语者和听说型熟练双语者)×3(积极词、消极词和中性词)的混合设计,记录3组被试对词汇颜色判断的反应时和错误率。结果:(1)全面熟练双语者和阅读型熟练双语者在L1和L2条件下对情绪词汇颜色命名的反应时显著大于中性词汇;(2)听说型熟练双语者在L1条件下对情绪词汇颜色命名的反应时大于中性词汇,而L2条件下3种词汇并无差异。结论:(1)全面熟练双语者在L1和L2条件下均出现了自动化情绪通达;阅读型熟练双语者在L1和L2条件下也出现了自动化情绪通达;(2)听说型熟练双语者在L2条件下没有达到自动化情绪通达,其情绪联结性弱于L1条件。不同语言习得类型的熟练双语者在情绪Stroop任务中情绪自动化通达的表现是不同的。     

Response bias in "remembering" emotional stimuli: a new perspective on age differences

Older adults sometimes show a recall advantage for emotionally positive, rather than neutral or negative, stimuli (S. T. Charles, M. Mather, & L. L. Carstensen, 2003). In contrast, younger adults respond "old" and "remember" more often to negative materials in recognition tests. For younger adults, both effects are due to response bias changes rather than to enhanced memory accuracy (S. Dougal & C. M. Rotello, 2007). We presented older and younger adults with emotional and neutral stimuli in a remember-know paradigm. Signal-detection and model-based analyses showed that memory accuracy did not differ for the neutral, negative, and positive stimuli, and that "remember" responses did not reflect the use of recollection. However, both age groups showed large and significant response bias effects of emotion: Younger adults tended to say "old" and "remember" more often in response to negative words than to positive and neutral words, whereas older adults responded "old" and "remember" more often to both positive and negative words than to neutral stimuli.     

Taboo,emotionally valenced,and emotionally neutral word norms

Although taboo words are used to study emotional memory and attention, no easily accessible normative data are available that compare taboo, emotionally valenced, and emotionally neutral words on the same scales. Frequency, inappropriateness, valence, arousal, and imageability ratings for taboo, emotionally valenced, and emotionally neutral words were made by 78 native-English-speaking college students from a large metropolitan university. The valenced set comprised both positive and negative words, and the emotionally neutral set comprised category-related and category-unrelated words. To account for influences of demand characteristics and personality factors on the ratings, frequency and inappropriateness measures were decomposed into raters’ personal reactions to the words versus raters’ perceptions of societal reactions to the words (personal use vs. familiarity and offensiveness vs. tabooness, respectively). Although all word sets were rated higher in familiarity and tabooness than in personal use and offensiveness, these differences were most pronounced for the taboo set. In terms of valence, the taboo set was most similar to the negative set, although it yielded higher arousal ratings than did either valenced set. Imageability for the taboo set was comparable to that of both valenced sets. The ratings of each word are presented for all participants as well as for single-sex groups. The inadequacies of the application of normative data to research that uses emotional words and the conceptualization of taboo words as a coherent category are discussed. Materials associated with this article may be accessed at the Psychonomic Society’s Archive of Norms, Stimuli, and Data, www.psychonomic.org/archive.     

Emotionality,distinctiveness, and recollective experience

Two experiments investigated the effects of emotional stimuli on recollective experience in recognition memory. In Experiment 1, words judged to evoke a positive emotional response (e.g., warmth, freedom) or a negative emotional response (e.g., mucus, corpse) were associated with more “remember” responses than emotionally neutral words (e.g., crate, border) when presented in mixed lists. This effect was stronger with negative words than with positive words. In Experiment 2 the effects of emotional stimuli were eliminated when participants studied pure lists of either all emotional or all neutral words. These findings are discussed in relation to Rajaram's (1996) distinctiveness account of recollective experience.     

Emotional activation in the first and second language

Late Finnish–English bilinguals were presented with neutral, positive, negative and taboo words in a modified Stroop paradigm in both Finnish and English. Significant interference from negative and taboo words compared to neutral words was found in both languages, whereas positive words were not found to differ significantly from neutral words. Furthermore, no differences in the size of the interference were present between languages. This suggests that, for late bilinguals with good knowledge of their second language, the first (L1) and second (L2) language are equally capable of activating the emotional response to word stimuli representing threat, and thus interfering with the cognitive processes involved in responding to colour. This effect was equivalent for negative and taboo words.     

Emotion effects during reading: Influence of an emotion target word on eye movements and processing

Recently, Scott, O'Donnell and Sereno reported that words of high valence and arousal are processed with greater ease than neutral words during sentence reading. However, this study unsystematically intermixed emotion (label a state of mind, e.g., terrified or happy) and emotion-laden words (refer to a concept that is associated with an emotional state, e.g., debt or marriage). We compared the eye-movement record while participants read sentences that contained a neutral target word (e.g., chair) or an emotion word (no emotion-laden words were included). Readers were able to process both positive (e.g., happy) and negative emotion words (e.g., distressed) faster than neutral words. This was true across a wide range of early (e.g., first fixation durations) and late (e.g., total times on the post-target region) measures. Additional analyses revealed that State Trait Anxiety Inventory scores interacted with the emotion effect and that the emotion effect was not due to arousal alone.     

Wheel chairs and arm chairs: A novel experimental design for the emotional Stroop effect

The emotional Stroop effect demonstrates that people are slower to name the ink colour of emotionally charged words than that of neutral words. Attributing this slowdown to emotionality or threat requires that the emotion and neutral words presented are equal on all extraneous variables. However, it is impossible in principle to match the two types of words on all conceivable variables. To address the problem, we presented the same set of words, polarised to be negative in one condition and neutral in another by using appropriate prime words that produced the desired valence through idiomatic two-word expressions. Across two studies, participants took longer to name the colour of the same words when they were rendered negative than when they were rendered neutral. This difference reflects a true emotional Stroop effect given the control provided for all potentially confounding variables tied to the target stimuli. The new procedure also enables researchers to calculate item-specific emotional Stroop effects for the first time.     

情绪效价的记忆增强效应:存储或提取优势?

情绪效价和情绪唤醒是描述情绪的两个维度。情绪增强记忆效应表明情绪唤醒事件的记忆往往优于非情绪唤醒事件的记忆,但关于积极情绪记忆和消极情绪记忆哪个在记忆中处于优势仍存在争论。实验以情绪词对和中性词对为实验材料。实验一探讨积极情绪词语或消极情绪词语的记忆优势; 实验二探讨积极情绪环境或消极情绪环境中中性词语的记忆优势。在两种实验条件下,积极情绪下的自由回忆都优于消极情绪下的自由回忆; 多项加工树的存储—提取模型使用实验自由回忆和线索回忆的结果将记忆的存储和提取优势分离开来,结果表明:积极情绪事件记忆优势发生在存储阶段,而积极情绪环境记忆优势发生在存储和提取阶段; 积极情绪事件记忆偏向支持“刺激后编码增强假设”,积极情绪环境记忆偏向支持“唤醒—偏向竞争假设”。     

The attentional blink effect: influence of negative words in an affective valence categorization task

In this study, we explored the emotional modulation of the Attentional Blink effect. In a Rapid Serial Visual Presentation procedure, a word (Target 1), either positive, negative or neutral, was followed by the word "WATER" (Target 2) in one half of the trials. The task included two conditions. In one of them, participants only had to detect the word "WATER". In double-response trials, participants also categorized Target 1's valence. Results showed that the detection of Target 2 was impaired in the double-response condition, this impairment being greater when negative word appeared as Target 1, as compared to positive and neutral words. However, these effects were independent on the Anxiety-Trait levels of participants. Overall, the pattern of data suggests that cognitive resources are focused on negative stimuli when their negative valence is emotionally salient enough.     

The impact of emotion on prospective memory and monitoring: No pain, big gain

The emotionally enhanced memory effect is robust across studies of retrospective memory, with heightened recall for items with emotional content (e.g., words like ??murder??) relative to neutral items (e.g., words like ??envelope??). Only a handful of studies have examined the influence of emotion on prospective memory (PM), with mixed results. In some cases emotion enhances PM, and in others it impairs PM. Interpretation of these findings is clouded by methodological differences across studies and by the fact that, to date, no study has examined the impact of emotion on PM monitoring. In our study, we assessed PM performance when PM targets were neutral, negative, and positive, and also investigated monitoring across these different PM target types. Participants showed heightened PM performance for positive and negative relative to neutral targets, yet there was no evidence of additional monitoring for emotional targets. In fact, measures of monitoring were significantly reduced when the PM targets were emotional rather than neutral. Our findings suggest that it is possible to boost PM performance in a focal task using emotional cues, and that the use of emotional cues reduces the need for monitoring.     

Electrophysiological differences in the processing of affective information in words and pictures

It is generally assumed that affective picture viewing is related to higher levels of physiological arousal than is the reading of emotional words. However, this assertion is based mainly on studies in which the processing of either words or pictures has been investigated under heterogenic conditions. Positive, negative, relaxing, neutral, and background (stimulus fragments) words and pictures were presented to subjects in two experiments under equivalent experimental conditions. In Experiment 1, neutral words elicited an enhanced late positive component (LPC) that was associated with an increased difficulty in discriminating neutral from background stimuli. In Experiment 2, high-arousing pictures elicited an enhanced early negativity and LPC that were related to a facilitated processing for these stimuli. Thus, it seems that under some circumstances, the processing of affective information captures attention only with more biologically relevant stimuli. Also, these data might be better interpreted on the basis of those models that postulate a different access to affective information for words and pictures.     

情绪名词的具体性效应：来自ERP的证据

词汇的具体性和情绪性是影响词汇加工的不同因素, 高具体性和情绪性都能够促进词汇的加工。本研究同时操纵词汇的具体性和情绪性, 使用词汇判定任务和愉悦度判断任务, 探讨了情绪名词的具体性效应及其具体性效应是否受词汇情绪信息的影响。结果发现：情绪名词的具体性效应受内隐或外显情绪条件的影响, 具体的情绪词比抽象的情绪词反应时间更短、正确率更高, 诱发了更大的N400和减小的LPC, 但LPC的具体性效应只表现在内隐情绪任务中。词汇的具体性和情绪性的相互影响发生在内隐情绪任务中的语义加工阶段, 正性、负性的具体词和抽象词的加工在N400成分上差异不显著, 而中性具体词和抽象词在N400成分上差异显著, 说明词汇的情绪信息为抽象词的加工提供了充分的语境, 因此消除了具体词的加工优势。     

中性抽象词和具体词情绪信息获得的差异

采用词汇迫选学习范式考察不同类型词汇获得情绪信息的认知机制。结果发现：（1）在迫选过程中与积极图片匹配的具体词汇喜好度显著高于与消极图片匹配的喜好度,而抽象词学习并未表现出这样的效应。（2）积极图片下被选择词汇的喜好度显著高于未被选择词汇的喜好度,而消极图片下被选择词汇与未被选择词汇的喜好度差异不显著。该结果表明具体词相较于抽象词更易获得相应情绪信息,积极情绪比消极情绪信息更易被习得。     

Effects of level of processing on memory for affectively valenced words

In this study we tested whether subjects remember affectively valenced stimuli better than neutral stimuli when their attention is not focused on the affective charge of the stimuli during encoding. We tested memory for positive, negative, and neutral words in three memory tasks and using two encoding conditions (physical and semantic). Our results show that subjects remember affectively valenced stimuli better than neutral stimuli when they encode them according to their emotional content as well as to other features of the stimuli. However, although both positive and negative words are better remembered than neutral ones when semantically encoded, only positive words are better remembered than neutral ones when physically encoded. These results suggest that the affective charge of a stimulus (especially when positive) can affect retention even when a subject's attention has not focused on it during encoding.     

The role of valence and frequency in the emotional Stroop task

People are generally slower to name the color of emotion-laden words than they are to name that of emotionally neutral words. However, an analysis of this emotional Stroop effect (Larsen, Mercer, & Balota, 2006) indicates that the emotion-laden words used are sometimes longer, have lower frequencies, and have smaller orthographic neighborhoods than the emotionally neutral words. This difference in word characteristics raises the possibility that the emotional Stroop effect is partly caused by lexical rather than by emotional aspects of the stimuli-a conclusion supported by the finding that reaction times to name the color of low-frequency words are longer than those for high-frequency words (Burt, 2002). To examine the relative contributions of valence and frequency in color naming, we had 64 participants complete an experiment in which each of these variables was manipulated in a 3 x 2 factorial design; length, orthographic neighborhood density, and arousal were balanced. The data indicate that valence and word frequency interact in contributing to the emotional Stroop effect.     

Emotional memory for words: Separating content and context

We developed a technique to examine the effects of emotional content and context on verbal memory. Two sets of sentences were devised: in the first, each sentence was emotionally arousing due to the inclusion of an emotional “target” word. In the second set, “targets” were replaced with well-matched neutral words. Subjects read aloud a selection of emotional and neutral sentences, and were then surprised with memory tasks after a range of time delays. Emotional target words were remembered significantly better than neutral words in all experiments. Recognition of emotional words was relatively stable despite increasing delays between encoding and recognition testing, in contrast to memory for neutral words, which decayed over time. Memory for neutral non-target words was enhanced when words had been presented in an emotional context. The results confirm the phenomenon of emotional enhancement of memory at short and long delays and suggest that emotional context may be encoded independently of word meaning.     

Paying attention to emotion: an fMRI investigation of cognitive and emotional stroop tasks

In this research, we investigated the degree to which brain systems involved in ignoring emotionally salient information differ from those involved in ignoring nonemotional information. The design allowed examination of regional brain activity, using fMRI during color-word and emotional Stroop tasks. Twelve participants indicated the color of words while ignoring word meaning in conditions in which neutral words were contrasted to emotionally negative, emotionally positive, and incongruent color words. Dorsolateral frontal lobe activity was increased by both negative and incongruent color words, indicating a common system for maintaining an attentional set in the presence of salient distractors. In posterior regions of the brain, activity depended on the nature of the information to be ignored. Ignoring color-incongruent words increased left parietal activity and decreased parahippocampal gyrus activity, whereas ignoring negative emotional words increased bilateral occipito-temporal activity and decreased amygdala activity. The results indicate that emotion and attention are intimately related via a network of regions that monitor for salient information, maintain attention on the task, suppress irrelevant information, and select appropriate responses.