声乐与器乐情绪加工的ERP研究

借助跨通道情绪启动范式考察声乐与器乐情绪加工的电生理差异。启动刺激是声乐和器乐曲(小提琴演奏), 目标刺激是与音乐情绪一致或不一致的面孔表情图片。结果显示, 与一致条件相比, 与面孔情绪不一致的器乐曲诱发了N400, 而与面孔情绪不一致的声乐曲诱发了LPC。这些结果表明, 声乐与器乐情绪加工的电生理反应存在差异。     

Processing emotion information from both the face and body: An eye-movement study

This study examined the perception of emotional expressions, focusing on the face and the body. Photographs of four actors expressing happiness, sadness, anger, and fear were presented in congruent (e.g., happy face with happy body) and incongruent (e.g., happy face with fearful body) combinations. Participants selected an emotional label using a four-option categorisation task. Reaction times and accuracy for the categorisation judgement, and eye movements were the dependent variables. Two regions of interest were examined: face and body. Results showed better accuracy and faster reaction times for congruent images compared to incongruent images. Eye movements showed an interaction in which there were more fixations and longer dwell times to the face and fewer fixations and shorter dwell times to the body with incongruent images. Thus, conflicting information produced a marked effect on information processing in which participants focused to a greater extent on the face compared to the body.     

Action Understanding in the Superior Temporal Sulcus Region

ABSTRACT— The posterior superior temporal sulcus (STS) region plays an important role in the perception of social acts, although its full role has not been completely clarified. This functional magnetic resonance imaging experiment examined activity in the STS region as participants viewed actions that were congruent or incongruent with intentions established by a previous emotional context. Participants viewed an actress express either a positive or a negative emotion toward one of two objects and then subsequently pick up one of them. If the object that was picked up had received positive regard, or if the object that was not picked up had received negative regard, the action was congruent; otherwise, the action was incongruent. Activity in the right posterior STS region was sensitive to the congruency between the action and the actress's emotional expression (i.e., STS activity was greater on incongruent than on congruent trials). These findings suggest that the posterior STS represents not only biological motion, but also how another person's motion is related to his or her intentions.     

On the dynamics of implicit emotion regulation: Counter-regulation after remembering events of high but not of low emotional intensity

Valence biases in attention allocation were assessed after remembering positive or negative personal events that were either still emotionally hot or to which the person had already adapted psychologically. Differences regarding the current state of psychological adjustment were manipulated experimentally by instructing participants to recall distant vs. recent events (Experiment 1) or affectively hot events vs. events to which the person had accommodated already (Experiment 2). Valence biases in affective processing were measured with a valence search task. Processes of emotional counter-regulation (i.e., attention allocation to stimuli of opposite valence to the emotional event) were elicited by remembering affectively hot events, whereas congruency effects (i.e., attention allocation to stimuli of the same valence as the emotional event) were obtained for events for which a final appraisal had already been established. The results of our study help to resolve conflicting findings from the literature regarding congruent vs. incongruent effects of remembering emotional events on affective processing. We discuss implications of our findings for the conception of emotions and for the dynamics of emotion regulation processes.     

Processing emotional category congruency between emotional facial expressions and emotional words

Facial expressions are critical for effective social communication, and as such may be processed by the visual system even when it might be advantageous to ignore them. Previous research has shown that categorising emotional words was impaired when faces of a conflicting valence were simultaneously presented. In the present study, we examined whether emotional word categorisation would also be impaired when faces of the same (negative) valence but different emotional category (either angry, sad or fearful) were simultaneously presented. Behavioural results provided evidence for involuntary processing of basic emotional facial expression category, with slower word categorisation when the face and word categories were incongruent (e.g., angry word and sad face) than congruent (e.g., angry word and angry face). Event-related potentials (ERPs) time-locked to the presentation of the word–face pairs also revealed that emotional category congruency effects were evident from approximately 170 ms after stimulus onset.     

Pleasing frowns, disappointing smiles: an ERP investigation of counterempathy

The biological predisposition to resonate emotionally with another person is regarded as a critical aspect of social interaction. There are, however, situations in which the emotional response to others is discordant with their emotional experience. Using event-related potentials, the present study investigated the neural underpinnings of this phenomenon, termed "counterempathy." Participants played a card game under the belief that they were playing jointly with another player who sat in an adjoining room and whose smiles and frowns in response to winning or losing in the game they could observe on a computer screen. Depending upon the experimental setting, the other player's facial expressions conveyed either of two opposing values to the participant. In the empathic setting, his emotional expressions were congruent with the participant's outcome (win or loss), whereas in the counterempathic setting, they indicated incongruent outcomes. Results revealed a reversed pattern of brain responses to facial expressions between congruent and incongruent conditions at ~170 ms (N170) over the temporal cortex. That is, N170 was sensitive to frowns in the congruent condition and to smiles in the incongruent condition, both indicating losses for the participant. Furthermore, frowns in the incongruent condition yielded larger medial frontal negativity (MFN) over the medial prefrontal cortex, which correlated with the subjective pleasantness about one's own winning in the incongruent condition. These findings demonstrate that (1) counterempathic responses are associated with modulation of early sensory processing of emotional cues, (2) that MFN is sensitive to the detection of another person's loss during positive inequity, and (3) that MFN is associated with a pleasant feeling during positive inequity, which is possibly related to "Schadenfreude."     

情绪韵律调节情绪词识别的ERP研究

采用韵律/词汇干扰范式和延迟匹配任务, 通过两个ERP实验, 考察了汉语口语中情绪韵律能否、以及如何调节情绪词的识别。实验一中, 不同类型的情绪韵律分组呈现, ERP结果显示, 同与情绪韵律效价一致的情绪词相比, 与情绪韵律效价不一致的情绪词诱发了走向更负的P200、N300和N400成分; 实验二中, 不同类型的情绪韵律随机呈现, 上述效价一致性效应依然存在。实验结果表明, 情绪韵律能够调节情绪词识别, 主要表现在对情绪词的音韵编码和语义加工的双重易化上。     

Depth of facial expression processing depends on stimulus visibility: Behavioral and electrophysiological evidence of priming effects

Participants performed a priming task during which emotional faces served as prime stimuli and emotional words served as targets. Prime-target pairs were congruent or incongruent, and two levels of prime visibility were obtained by varying the duration of the masked primes. To probe a neural signature of the impact of the masked primes, lateralized readiness potentials (LRPs) were recorded over motor cortex. In the high-visibility condition, responses to word targets were faster when the prime-target pairs were congruent than when they were incongruent, providing evidence of priming effects. In line with the behavioral results, the electrophysiological data showed that high-visibility face primes resulted in LRP differences between congruent and incongruent trials, suggesting that prime stimuli initiated motor preparation. Contrary to the above pattern, no evidence for reaction time or LRP differences was observed in the low-visibility condition, revealing that the depth of facial expression processing is dependent on stimulus visibility.     

Holistic person processing: faces with bodies tell the whole story

Faces and bodies are typically encountered simultaneously, yet little research has explored the visual processing of the full person. Specifically, it is unknown whether the face and body are perceived as distinct components or as an integrated, gestalt-like unit. To examine this question, we investigated whether emotional face-body composites are processed in a holistic-like manner by using a variant of the composite face task, a measure of holistic processing. Participants judged facial expressions combined with emotionally congruent or incongruent bodies that have been shown to influence the recognition of emotion from the face. Critically, the faces were either aligned with the body in a natural position or misaligned in a manner that breaks the ecological person form. Converging data from 3 experiments confirm that breaking the person form reduces the facilitating influence of congruent body context as well as the impeding influence of incongruent body context on the recognition of emotion from the face. These results show that faces and bodies are processed as a single unit and support the notion of a composite person effect analogous to the classic effect described for faces.     

Can the eyes reveal a person’s emotions? Biasing role of the mouth expression

In this study we investigated how perception of the eye expression in a face is influenced by the mouth expression, even when only the eyes are directly looked at. The same eyes appeared in a face with either an incongruent smiling, angry, or sad mouth, a congruent mouth, or no mouth. Attention was directed to the eyes by means of cueing and there were no fixations on the mouth. Participants evaluated whether the eyes were happy (or angry, or sad) or not. Results indicated that the smile biased the evaluation of the eyes towards happiness to a greater extent than an angry or a sad mouth did towards anger or sadness. The smiling mouth was also more visually salient than the angry and the sad mouths. We conclude that the role of the eyes as a “window” to a person’s emotional and motivational state is constrained and distorted by the configural projection of an expressive mouth, and that this effect is enhanced by the high visual saliency of the smile.     

Gender differences on the semantic flanker task using transposed-letter target words

Previous research has demonstrated that men and women are differentially influenced by irrelevant distractors. Other lines of evidence have suggested that increasing the perceptual load of a task reduces distractor interference for participants generally. The present study examined these effects using a semantic version of the flanker task; participants made speeded responses to category target words that were flanked by irrelevant distractors. The response mapping between the target and flanker words was either congruent (mapped to the same motor response) or incongruent (target word mapped to a different motor response to that of the flankers). Target words were presented either normally (e.g., table: low perceptual load) or with the beginning letters transposed (e.g., atble: high perceptual load). The results revealed that women showed a larger congruency effect than men but this was not due to greater interference on incongruent trials. While men and women made faster responses to normal than to transposed target words, this was similar in magnitude. The magnitude of the flanker effect for normal and transposed target words was significantly correlated in men but not in women. These findings are consistent with the view that women may process target words to a deeper level than men and therefore may engage in more conflict monitoring then men.     

Speech perception and vocal expression of emotion

Two experiments using identical stimuli were run to determine whether the vocal expression of emotion affects the speed with which listeners can identify emotion words. Sentences were spoken in an emotional tone of voice (Happy, Disgusted, or Petrified), or in a Neutral tone of voice. Participants made speeded lexical decisions about the word or pseudoword in sentence-final position. Critical stimuli were emotion words that were either semantically congruent or incongruent with the tone of voice of the sentence. Experiment 1, with randomised presentation of tone of voice, showed no effect of congruence or incongruence. Experiment 2, with blocked presentation of tone of voice, did show such effects: Reaction times for congruent trials were faster than those for baseline trials and incongruent trials. Results are discussed in terms of expectation (e.g., Kitayama, 1990, 1991, 1996) and emotional connotation, and implications for models of word recognition are considered.     

Integration of faces and voices, but not faces and names, in person recognition

Recent studies on cross-modal recognition suggest that face and voice information are linked for the purpose of person identification. We tested whether congruent associations between familiarized faces and voices facilitated subsequent person recognition relative to incongruent associations. Furthermore, we investigated whether congruent face and name associations would similarly benefit person identification relative to incongruent face and name associations. Participants were familiarized with a set of talking video-images of actors, their names, and their voices. They were then tested on their recognition of either the face, voice, or name of each actor from bimodal stimuli which were either congruent or novel (incongruent) associations between the familiarized face and voice or face and name. We found that response times to familiarity decisions based on congruent face and voice stimuli were facilitated relative to incongruent associations. In contrast, we failed to find a benefit for congruent face and name pairs. Our findings suggest that faces and voices, but not faces and names, are integrated in memory for the purpose of person recognition. These findings have important implications for current models of face perception and support growing evidence for multisensory effects in face perception areas of the brain for the purpose of person recognition.     

Comparing to perfection: How cultural norms for appearance affect social comparisons and self-image

Theory and research suggests that cultural norms for appearance present unrealistic standards of beauty which may contribute to women's body dissatisfaction. In Study 1, women described their appearance more negatively than men and made more upward social comparisons about their bodies, but not about other domains. Women also compared more than men with unrealistic targets (e.g., models). In Study 2, we explored the role of cultural norms for appearance in social comparisons with relevant (peer) or irrelevant (model) superior targets. When cultural norms were not salient, participants judged a peer to be more relevant, compared more with the peer, and were more negatively affected by the peer. However, when cultural norms were salient, participants judged a professional model to be equally relevant, compared more with the model and felt worse after exposure to the model. We discuss the powerful role of cultural norms in determining social comparison processes and self-appraisals.     

Look away! Eyes and arrows engage oculomotor responses automatically

The present study investigates how people’s voluntary saccades are influenced by where another person is looking, even when this is counterpredictive of the intended saccade direction. The color of a fixation point instructed participants to make saccades either to the left or right. These saccade directions were either congruent or incongruent with the eye gaze of a centrally presented schematic face. Participants were asked to ignore the eyes, which were congruent only 20% of the time. At short gaze—fixation-cue stimulus onset asynchronies (SOAs; 0 and 100 msec), participants made more directional errors on incongruent than on congruent trials. At a longer SOA (900 msec), the pattern tended to reverse. We demonstrate that a perceived eye gaze results in an automatic saccade following the gaze and that the gaze cue cannot be ignored, even when attending to it is detrimental to the task. Similar results were found for centrally presented arrow cues, suggesting that this interference is not unique to gazes.     

Facial expressions modulate the gaze orienting effect on sound localization judgement

Recent studies have shown that cueing eye gaze can affect the processing of visual information, and this phenomenon is called the gaze-orienting effect (visual-GOE). Emerging evidence has shown that the cueing eye gaze also affects the processing of auditory information (auditory-GOE). However, it is unclear whether the auditory-GOE is modulated by emotion. We conducted three behavioural experiments to investigate whether cueing eye gaze influenced the orientation judgement to a sound, and whether the effect was modulated by facial expressions. The current study set four facial expressions (angry, fearful, happy, and neutral), manipulated the display type of facial expressions, and changed the sequence of gaze and emotional expressions. Participants were required to judge the sound orientation after facial expressions and gaze cues. The results showed that the orientation judgement of sound was influenced by gaze direction in all three experiments, and the orientation judgement of sound was faster when the face was oriented to the target location (congruent trials) than when the face was oriented away from the target location (incongruent trials). The modulation of emotion on auditory-GOE was observed only when gaze shifted followed by facial expression (Exp3); the auditory-GOE was significantly greater for angry faces than for neutral faces. These findings indicate that auditory-GOE as a social phenomenon exists widely, and the effect was modulated by facial expression. Gaze shift before the presentation of emotion was the key influencing factor for the emotional modulation in an auditory target gaze-orienting task. Our findings suggest that the integration of facial expressions and eye gaze was context-dependent.     

自然场景与身体动作对面孔表情识别的影响

本研究以消极情绪间感知相似性较低的厌恶、恐惧面孔表情为材料,提供5个情绪性语言标签减少文字背景对面孔识别的促进作用,通过2个实验对自然场景以及身体动作对面孔表情识别的影响进行了研究,旨在考察面孔表情与自然场景间的情绪一致性对情绪面孔识别和自然场景加工的影响,以及加入与自然场景情绪相冲突的身体动作对面孔表情识别可能产生的影响。研究结果表明:(1)尽管增加了情绪性语言标签选项数量,自然场景的情绪对面孔表情识别的影响依旧显著;(2)当面孔表情与自然场景情绪不一致时,面孔识别需要更多依赖对自然场景的加工,因此对自然场景的加工程度更高;(3)身体动作会在一定程度上干扰自然场景对面孔表情识别的影响,但自然场景依然对情绪面孔的表情识别有重要作用。     

Gender effects on social support provision and receipt

This study was conducted to examine the influence of gender on social support provision and receipt using both self-report and observational methodologies. In response to another person sharing a problem, we predicted that men would be more likely than women to provide advice, and women would be more likely than men to provide emotional support. We also predicted women would be more likely than men to receive emotional support, and men would be more likely than women to receive negative support. Sixty-one pairs of college students, same-sex and mixed-sex dyads, shared a problem with each other. Problem-sharing transactions were audiotaped and transcribed for content analysis. Opposite-sex providers offered more emotional support than did same-sex providers, whereas same-sex providers listened more than did opposite-sex providers. No gender differences were found for advice-giving. Men were more likely than women to receive negative support. These results suggest that gender composition of the dyad has a greater influence on support provision and receipt than provider or recipient gender alone.     

Preattentive processing of audio-visual emotional signals

Previous research has shown that redundant information in faces and voices leads to faster emotional categorization compared to incongruent emotional information even when attending to only one modality. The aim of the present study was to test whether these crossmodal effects are predominantly due to a response conflict rather than interference at earlier, e.g. perceptual processing stages. In Experiment 1, participants had to categorize the valence and rate the intensity of happy, sad, angry and neutral unimodal or bimodal face–voice stimuli. They were asked to rate either the facial or vocal expression and ignore the emotion expressed in the other modality. Participants responded faster and more precisely to emotionally congruent compared to incongruent face–voice pairs in both the Attend Face and in the Attend Voice condition. Moreover, when attending to faces, emotionally congruent bimodal stimuli were more efficiently processed than unimodal visual stimuli. To study the role of a possible response conflict, Experiment 2 used a modified paradigm in which emotional and response conflicts were disentangled. Incongruency effects were significant even in the absence of response conflicts. The results suggest that emotional signals available through different sensory channels are automatically combined prior to response selection.     

Using art for comparison and distraction: Effects on negative emotions and judgements of satisfaction

Abstract

Two studies examined whether emotional comparison and distraction with emotion congruent and incongruent art would improve the well-being of dysphoric undergraduates. In both studies, subjects: (1) imagined a sad event; (2) compared their mood to that expressed by incongruent art (upward comparison) or congruent art (downward comparison); or focused on technical features of incongruent art (incongruent distraction) or congruent art (congruent distraction); and (3) rated their emotions and life satisfaction. The incongruent distraction group reported feeling more positive and more satisfied, and the downward comparison group reported feeling more satisfied, than the upward comparison or congruent distraction groups. Thus, comparison and distraction can improve well-being when directed towards emotion congruent and incongruent art, respectively.