When language gets emotional: Irony and the embodiment of affect in discourse

Although there is increasing evidence to suggest that language is grounded in perception and action, the relationship between language and emotion is less well understood. We investigate the grounding of language in emotion using a novel approach that examines the relationship between the comprehension of a written discourse and the performance of affect-related motor actions (hand movements towards and away from the body). Results indicate that positively and negatively valenced words presented in context influence motor responses (Experiment 1), whilst valenced words presented in isolation do not (Experiment 3). Furthermore, whether discourse context indicates that an utterance should be interpreted literally or ironically can influence motor responding, suggesting that the grounding of language in emotional states can be influenced by discourse-level factors (Experiment 2). In addition, the finding of affect-related motor responses to certain forms of ironic language, but not to non-ironic control sentences, suggests that phrasing a message ironically may influence the emotional response that is elicited.     

Do readers mentally represent characters' emotional states?

Abstract

Subjects read stories that described concrete actions, such as a main character stealing money from a store where his best friend worked and later learning that his friend had been fired. Following each story, subjects read a target sentence that contained an emotion word that either matched the emotional state implied by the story (e.g. guilt) or mismatched that emotional state. In Experiment 1, target sentences were read more slowly when the mismatched emotion words were the perceived opposites of the emotional states implied by the stories (e.g. pride). In Experiment 2, target sentences were read more slowly when the mismatched emotion words shared the affective valence of the implied emotional state; therefore, readers must represent more than simply the affective valence of the emotional states. Instead of reading target sentences that contained matching versus mismatching emotion words, subjects in Experiment 3 simply pronounced matching versus mismatching emotion words. Mismatching emotion words were pronounced more slowly. These experiments suggest that readers form explicit, lifelike, mental representations of fictional characters' emotional states, and readers form these representations as a normal part of reading comprehension.     

Semantic facilitation across sensory modalities in the processing of individual words and sentences

The effect of semantic priming upon lexical decisions made for words in isolation (Experiment 1) and during sentence comprehension (Experiment 2) was investigated using a cross-modal lexical decision task. In Experiment 1, subjects made lexical decisions to both auditory and visual stimuli. Processing auditorily presented words facilitated subsequent lexical decisions on semantically related visual words. In Experiment 2, subjects comprehended auditorily presented sentences while simultaneously making lexical decisions for visually presented stimuli. Lexical decisions were facilitated when a visual word appeared immediately following a related word in the sentential material. Lexical decisions were also facilitated when the visual word appeared three syllables following closure of the clause containing the related material. Arguments are made for autonomy of semantic priming during sentence comprehension.     

具身模拟程度和具体性对词语效价表征的影响

采用词性判断和启动加工任务考察具身模拟程度和具体性对词语效价具身表征的影响。结果发现,在具身模拟程度低的空间表征中,只有敏感的负性词出现了效价和远近距离的相容效应;在模拟程度高的趋避表征中,正性词和负性词都与趋避动作产生了相容效应,并且具体词的效价和趋避表征之间的联结强于抽象词。     

话题结构对语篇情绪累加的影响

在阅读理解的过程中,读者能够自动对语篇中的情绪进行推断。本研究采用自定步速阅读的方法,分别在外显和内隐两种情绪加工的任务下,考察话题结构对语篇情绪累加的影响。结果发现,在实验一的外显情绪判断任务下,话题结构未显示出对语篇情绪累加的明显作用;在实验二的内隐情绪理解任务下,当话题延续时,读者对有两个情绪线索的语篇的阅读时间短于仅有一个情绪线索的语篇,此时情绪的累加促进了当前句的加工,而话题转换时,二者没有显著差异,说明此时读者在新结构下建立当前句的情绪表征,并不在先前情绪的基础上进行累加。     

Contextual interference processing during fast categorisations of facial expressions

We examined interference effects of emotionally associated background colours during fast valence categorisations of negative, neutral and positive expressions. According to implicitly learned colour–emotion associations, facial expressions were presented with colours that either matched the valence of these expressions or not. Experiment 1 included infrequent non-matching trials and Experiment 2 a balanced ratio of matching and non-matching trials. Besides general modulatory effects of contextual features on the processing of facial expressions, we found differential effects depending on the valance of target facial expressions. Whereas performance accuracy was mainly affected for neutral expressions, performance speed was specifically modulated by emotional expressions indicating some susceptibility of emotional expressions to contextual features. Experiment 3 used two further colour–emotion combinations, but revealed only marginal interference effects most likely due to missing colour–emotion associations. The results are discussed with respect to inherent processing demands of emotional and neutral expressions and their susceptibility to contextual interference.     

Affective theory of mind inferences contextually influence the recognition of emotional facial expressions

The recognition of emotional facial expressions is often subject to contextual influence, particularly when the face and the context convey similar emotions. We investigated whether spontaneous, incidental affective theory of mind inferences made while reading vignettes describing social situations would produce context effects on the identification of same-valenced emotions (Experiment 1) as well as differently-valenced emotions (Experiment 2) conveyed by subsequently presented faces. Crucially, we found an effect of context on reaction times in both experiments while, in line with previous work, we found evidence for a context effect on accuracy only in Experiment 1. This demonstrates that affective theory of mind inferences made at the pragmatic level of a text can automatically, contextually influence the perceptual processing of emotional facial expressions in a separate task even when those emotions are of a distinctive valence. Thus, our novel findings suggest that language acts as a contextual influence to the recognition of emotional facial expressions for both same and different valences.     

Emotions in reading: Disgust, empathy and the contextual learning hypothesis

Emotion effects in reading have typically been investigated by manipulating words' emotional valence and arousal in lexical decision. The standard finding is that valence and arousal can have both facilitatory and inhibitory effects, which is hard to reconcile with current theories of emotion processing in reading. Here, we contrasted these theories with the contextual-learning hypothesis, according to which, sensitivity to a specific emotion - disgust in the present study - rather than valence or arousal affects lexical decision performance. Participants were divided into two groups (high versus low disgust sensitivity). Results showed that participants with high disgust sensitivity showed an inhibitory effect, whereas participants with low-disgust sensitivity showed a facilitatory effect. Individual differences in lexical decision performance were predicted by disgust sensitivity but not valence, arousal, or general emotion sensitivity. These findings highlight the need to focus on individual differences both in studies and theories of emotion processing in reading.     

Event-based plausibility immediately influences on-line language comprehension

In some theories of sentence comprehension, linguistically relevant lexical knowledge, such as selectional restrictions, is privileged in terms of the time-course of its access and influence. We examined whether event knowledge computed by combining multiple concepts can rapidly influence language understanding even in the absence of selectional restriction violations. Specifically, we investigated whether instruments can combine with actions to influence comprehension of ensuing patients of (as in Rayner, Warren, Juhuasz, & Liversedge, 2004; Warren & McConnell, 2007). Instrument-verb-patient triplets were created in a norming study designed to tap directly into event knowledge. In self-paced reading (Experiment 1), participants were faster to read patient nouns, such as hair, when they were typical of the instrument-action pair (Donna used the shampoo to wash vs. the hose to wash). Experiment 2 showed that these results were not due to direct instrument-patient relations. Experiment 3 replicated Experiment 1 using eyetracking, with effects of event typicality observed in first fixation and gaze durations on the patient noun. This research demonstrates that conceptual event-based expectations are computed and used rapidly and dynamically during on-line language comprehension. We discuss relationships among plausibility and predictability, as well as their implications. We conclude that selectional restrictions may be best considered as event-based conceptual knowledge rather than lexical-grammatical knowledge.     

Categorical perception of emotional facial expressions does not require lexical categories

Does our perception of others' emotional signals depend on the language we speak or is our perception the same regardless of language and culture? It is well established that human emotional facial expressions are perceived categorically by viewers, but whether this is driven by perceptual or linguistic mechanisms is debated. We report an investigation into the perception of emotional facial expressions, comparing German speakers to native speakers of Yucatec Maya, a language with no lexical labels that distinguish disgust from anger. In a free naming task, speakers of German, but not Yucatec Maya, made lexical distinctions between disgust and anger. However, in a delayed match-to-sample task, both groups perceived emotional facial expressions of these and other emotions categorically. The magnitude of this effect was equivalent across the language groups, as well as across emotion continua with and without lexical distinctions. Our results show that the perception of affective signals is not driven by lexical labels, instead lending support to accounts of emotions as a set of biologically evolved mechanisms.     

Time course and task dependence of emotion effects in word processing

The emotional content of stimuli influences cognitive performance. In two experiments, we investigated the time course and mechanisms of emotional influences on visual word processing in various tasks by recording event-related brain potentials (ERPs). The stimuli were verbs of positive, negative, and neutral valence. In Experiment 1, where lexical decisions had to be performed on single verbs, both positive and negative verbs were processed more quickly than neutral verbs and elicited a distinct ERP component, starting around 370 msec. In Experiment 2, the verbs were embedded in a semantic context provided by single nouns. Likewise, structural, lexical, and semantic decisions for positive verbs were accelerated, and an ERP effect with a scalp distribution comparable to that in Experiment 1 now started about 200 msec earlier. These effects may signal an automatic allocation of attentional resources to emotionally arousing words, since they were not modulated by different task demands. In contrast, a later ERP effect of emotion was restricted to lexical and semantic decisions and, thus, appears to indicate more elaborated, task-dependent processing of emotional words.     

Priming of emotion recognition

Four experiments investigated priming of emotion recognition using a range of emotional stimuli, including facial expressions, words, pictures, and nonverbal sounds. In each experiment, a prime-target paradigm was used with related, neutral, and unrelated pairs. In Experiment 1, facial expression primes preceded word targets in an emotion classification task. A pattern of priming of emotional word targets by related primes with no inhibition of unrelated primes was found. Experiment 2 reversed these primes and targets and found the same pattern of results, demonstrating bidirectional priming between facial expressions and words. Experiment 2 also found priming of facial expression targets by picture primes. Experiment 3 demonstrated that priming occurs not just between pairs of stimuli that have a high co-occurrence in the environment (for example, nonverbal sounds and facial expressions), but with stimuli that co-occur less frequently and are linked mainly by their emotional category (for example, nonverbal sounds and printed words). This shows the importance of the prime and target sharing a common emotional category, rather than their previous co-occurrence. Experiment 4 extended the findings by showing that there are category-based effects as well as valence effects in emotional priming, supporting a categorical view of emotion recognition.     

Protective buffering and emotional desynchrony among spousal caregivers of cancer patients.

OBJECTIVE: To examine protective buffering and emotional desynchrony among spousal caregivers of cancer survivors. DESIGN: Repeated measures; 42 caregivers engaged in 2 videotaped, oral emotional expression exercises: 1 in the presence of their patient and 1 in the absence of their patient. MAIN OUTCOME MEASURES: Felt emotion (self-report) and expressed emotion (lexical expression or words uttered and coder-derived facial expression). Other measures assessed mental and physical health, dyadic satisfaction, and dispositional emotional inhibition. RESULTS: Protective buffering differed by communicative channel (lexical vs. facial). Caregivers' facial expressions were more positive when the patient was present versus absent. In contrast, the valence of caregivers' words did not differ per patient presence. Facial protective buffering was unrelated to health and dyadic outcomes. Lexical protective buffering was inversely related to both caregiver and patient marital satisfaction. Dispositional emotional inhibition was inversely related to caregiver mental health and marital satisfaction. Desynchrony occurred when the patient was present but was counter to prediction; felt emotion was more positive than expressed emotion. CONCLUSION: Results provide behavioral evidence of facial protective buffering. To the extent that lexical buffering occurs, it poses a dyadic risk, and chronic inhibition poses both psychological and dyadic risks. Future research is needed to refine the operational definition of desynchrony and to examine the biopsychosocial sequelae of buffering.     

Facial expressions can inhibit the activation of gender stereotypes

ABSTRACT

Using faces as the priming stimuli, the present study explored the influence of facial expressions on the activation of gender stereotypes using a lexical decision paradigm. Experiment 1 explored the activation of gender stereotypes when the facial primes contained only gender information. The results showed that gender stereotypes were activated. In Experiment 2, the facial primes contained both gender category and expression information. The results indicated that gender stereotypes were not activated. Experiment 3 required the participants to make emotion, gender, or impression decisions concerning the facial primes before the lexical decision task. The results showed that gender stereotypes were not activated in emotion and impression decisions conditions, whereas stereotypes were activated in gender decisions condition. These finding suggest that facial expressions can inhibit automatic activation of gender stereotypes, unless the perceivers perform gender categorization processing to prime faces intentionally.     

Categorical and dimensional perceptions in decoding emotional facial expressions

We investigated whether categorical perception and dimensional perception can co-occur while decoding emotional facial expressions. In Experiment 1, facial continua with endpoints consisting of four basic emotions (i.e., happiness-fear and anger-disgust) were created by a morphing technique. Participants rated each facial stimulus using a categorical strategy and a dimensional strategy. The results show that the happiness-fear continuum was divided into two clusters based on valence, even when using the dimensional strategy. Moreover, the faces were arrayed in order of the physical changes within each cluster. In Experiment 2, we found a category boundary within other continua (i.e., surprise-sadness and excitement-disgust) with regard to the arousal and valence dimensions. These findings indicate that categorical perception and dimensional perception co-occurred when emotional facial expressions were rated using a dimensional strategy, suggesting a hybrid theory of categorical and dimensional accounts.     

Valence specific laterality effects in prosody: expectancy account and the effects of morphed prosody and stimulus lead

The majority of studies have demonstrated a right hemisphere (RH) advantage for the perception of emotions. Other studies have found that the involvement of each hemisphere is valence specific, with the RH better at perceiving negative emotions and the LH better at perceiving positive emotions [Reuter-Lorenz, P., & Davidson, R.J. (1981) Differential contributions of the 2 cerebral hemispheres to the perception of happy and sad faces. Neuropsychologia, 19, 609-613]. To account for valence laterality effects in emotion perception we propose an 'expectancy' hypothesis which suggests that valence effects are obtained when the top-down expectancy to perceive an emotion outweighs the strength of bottom-up perceptual information enabling the discrimination of an emotion. A dichotic listening task was used to examine alternative explanations of valence effects in emotion perception. Emotional sentences (spoken in a happy or sad tone of voice), and morphed-happy and morphed-sad sentences (which blended a neutral version of the sentence with the pitch of the emotion sentence) were paired with neutral versions of each sentence and presented dichotically. A control condition was also used, consisting of two identical neutral sentences presented dichotically, with one channel arriving before the other by 7 ms. In support of the RH hypothesis there was a left ear advantage for the perception of sad and happy emotional sentences. However, morphed sentences showed no ear advantage, suggesting that the RH is specialised for the perception of genuine emotions and that a laterality effect may be a useful tool for the detection of fake emotion. Finally, for the control condition we obtained an interaction between the expected emotion and the effect of ear lead. Participants tended to select the ear that received the sentence first, when they expected a 'sad' sentence, but not when they expected a 'happy' sentence. The results are discussed in relation to the different theoretical explanations of valence laterality effects in emotion perception.     

Activation of lexical and syntactic target language properties in translation

Is reading for translation equal to reading in monolingual contexts? Horizontal/parallel theories of translation propose that normal reading and reading for translation differ because the translator engages in partial reformulation while reading for translating the source text. In contrast, vertical/serial theories assume that the translators first extract the meaning of the message, and only then they proceed to reformulate it. In two experiments, we manipulated lexical and syntactic properties of the target language (TL) while translators read for repetition or for translation. On-line sentence comprehension was affected by the lexical frequency of words in the TL (Experiment 1) and the syntactic congruency between the source language (SL) and TL sentences (Experiment 2). However, the influence of lexical and syntactic TL properties was restricted to the reading for translation task. According to our results, the horizontal view of translation includes code-to-code links between the SL and TL involving at least the lexical and syntactic level of processing.     

Effects of prime task on affective priming by facial expressions of emotion

Priming of affective word evaluation by pictures of faces showing positive and negative emotional expressions was investigated in two experiments that used a double task procedure where participants were asked to respond to the prime or to the target on different trials. The experiments varied between-subjects the prime task assignment and the prime-target interval (SOA, stimulus onset asynchrony). Significant congruency effects (that is, faster word evaluation when prime and target had the same valence than when they were of opposite valence) were observed in both experiments. When the prime task oriented the subjects to an affectively irrelevant property of the faces (their gender), priming was observed at SOA 300 ms but not at SOA 1000 ms (Experiment 1). However, when the prime task assignment explicitly oriented the subjects to the valence of the face, priming was observed at both SOA durations (Experiment 2). These results show, first, that affective priming by pictures of facial emotion can be obtained even when the subject has an explicit goal to process a non-affective property of the prime. Second, sensitivity of the priming effect to SOA duration seems to depend on whether it is mediated by intentional or unintentional activation of the valence of the face prime.     

话题结构对语篇情绪更新的影响

读者在阅读理解的过程中, 能够推断出故事主角的情绪状态, 并能随着语篇中的情绪变化做出情绪更新。在加工情绪信息的同时, 读者也加工语篇结构方面的信息, 二者皆有可能随着语篇的展开而发生变化。本研究采用自定步速阅读的方法, 分别在外显和内隐两种情绪加工任务下, 考察话题结构对语篇情绪更新的影响。结果发现, 在实验1的外显情绪判断任务下, 话题结构未显示出对语篇情绪更新的作用; 在实验2和实验3的内隐情绪理解任务下, 话题延续时, 情绪转换句的阅读时间长于情绪延续句, 此时情绪更新需要额外的加工时间; 而话题转换时, 二者没有显著差异, 说明此时读者在新结构下建立当前句的情绪表征, 并不受到先前情绪的影响。