The processing of auditory and visual recognition of self-stimuli

This study examined self-recognition processing in both the auditory and visual modalities by determining how comparable hearing a recording of one’s own voice was to seeing photograph of one’s own face. We also investigated whether the simultaneous presentation of auditory and visual self-stimuli would either facilitate or inhibit self-identification. Ninety-one participants completed reaction-time tasks of self-recognition when presented with their own faces, own voices, and combinations of the two. Reaction time and errors made when responding with both the right and left hand were recorded to determine if there were lateralization effects on these tasks. Our findings showed that visual self-recognition for facial photographs appears to be superior to auditory self-recognition for voice recordings. Furthermore, a combined presentation of one’s own face and voice appeared to inhibit rather than facilitate self-recognition and there was a left-hand advantage for reaction time on the combined-presentation tasks.     

Investigations of hemispheric specialization of self-voice recognition

Three experiments investigated functional asymmetries related to self-recognition in the domain of voices. In Experiment 1, participants were asked to identify one of three presented voices (self, familiar or unknown) by responding with either the right or the left-hand. In Experiment 2, participants were presented with auditory morphs between the self-voice and a familiar voice and were asked to perform a forced-choice decision on speaker identity with either the left or the right-hand. In Experiment 3, participants were presented with continua of auditory morphs between self- or a familiar voice and a famous voice, and were asked to stop the presentation either when the voice became "more famous" or "more familiar/self". While these experiments did not reveal an overall hand difference for self-recognition, the last study, with improved design and controls, suggested a right-hemisphere advantage for self-compared to other-voice recognition, similar to that observed in the visual domain for self-faces.     

Recognizing one's own face

We report two studies of facial self-perception using individually tailored, standardized facial photographs of a group of volunteers and their partners. A computerized morphing procedure was used to merge each target face with an unknown control face. In the first set of experiments, a discrimination task revealed a delayed response time for the more extensively morphed self-face stimuli. In a second set of experiments, functional magnetic resonance imaging (fMRI) was used to measure brain activation while subjects viewed morphed versions of either their own or their partner's face, alternating in blocks with presentation of an unknown face. When subjects viewed themselves (minus activation for viewing an unknown face), increased blood oxygenation was detected in right limbic (hippocampal formation, insula, anterior cingulate), left prefrontal cortex and superior temporal cortex. In the partner (versus unknown) experiment, only the right insula was activated. We suggest that a neural network involving the right hemisphere in conjunction with left-sided associative and executive regions underlies the process of visual self-recognition. Together, this combination produces the unique experience of self-awareness.     

Self-recognition and the right prefrontal cortex

Although the anatomical and functional substrates subserving face recognition have been subject to extensive investigation, the underpinnings of self-face recognition are not well understood. Given the evidence that own-face recognition has been demonstrated by a select number of species, it is intriguing to speculate whether self-face recognition is accomplished via a 'self-network' or simply a 'face-network' within the brain. Furthermore, the relationship of self-recognition to other self-processes, such as self-evaluation and autobiographical retrieval, are not clearly defined. However, data from fMRI, ERPs and repetitive transcranial magnetic stimulation as well as from split-brain studies and patients with focal lesions, indicate that the prefrontal cortex, with possible right hemisphere lateralization, may be a preferential component in self-recognition. Studies using these methods, as well as PET, have indicated that the self-processes of self-evaluation and autobiographical memory preferentially engage networks within the right fronto-temporal region. Although it is highly improbable that there is a 'self-recognition' or 'self' center, it appears that there may be a bias for the processing of 'self' within the right prefrontal cortex.     

Unequal impairment in the recognition of positive and negative emotions after right hemisphere lesions: a left hemisphere bias for happy faces

The processing of several important aspects of a human face was investigated in a single patient (LZ), who had a large infarct of the right hemisphere involving the parietal, and temporal lobes with extensions into the frontal region. LZ showed selective problems with recognizing emotional expressions, whereas she was flawless in recognizing gender, familiarity, and identity. She was very poor in recognizing negative facial expressions (fear, disgust, anger, sadness), but scored as well as the controls on the positive facial expression of happiness. However, in two experiments using both static and dynamic face stimuli, we showed that LZ also did not have a proper notion of what a facial expression of happiness looks like, and could not adequately apply this label. We conclude that the proper recognition of both negative and positive facial expressions relies on the right hemisphere, and that the left hemisphere produces a default state resulting in a bias towards evaluating expressions as happy. We discuss the implications of the current findings for the main models that aim to explain hemispheric specializations for processing of positive and negative emotions.     

自我面孔识别的独特性

与识别他人的面孔相比,自我面孔识别在行为反应、种系发生、个体发展以及脑机制等方面都具有很大的独特性。行为指标方面,自我面孔识别在速度上快于识别他人的面孔;种系发生方面,只有人类和大猩猩等高级灵长类动物才具有识别自己面孔的能力;个体发展方面,儿童出生后不久即能识别他人面孔,但要在18个月左右才能表现出自我面孔识别能力;脑机制方面,神经心理学和脑成像研究结果表明自我面孔识别可能主要是右脑的功能。该领域的研究进展将为深入了解自我的形成机理提供一个新的探视“窗口”。     

自我表征的可塑性:基于橡胶手错觉的研究

自我识别是人类自我觉知的行为标记。传统方法认为稳定的自我表征是自我识别的基础。随着对橡胶手错觉及一系列自我表征和自我识别错觉的揭示,这一能让人将外部客体感知为自身一部分的错觉研究使得我们能够以多感官整合的方式来研究自我表征和自我识别。拥有感和自主感被认为是我们进行自我识别的两类基本体验,本文对一系列橡胶手错觉范式研究的系统回顾表明,拥有感和自主感会发生改变,这说明人的自我表征是可变的和可塑的。     

我听故我在？自我声音识别机制的探索

自我声音是自我相关信息之一,同时也是个体识别身份时最重要的标志之一。声音具有骨传导和空气传导的传导方式和个体动机水平的差异都影响个体自我声音识别。在进行自我声音识别认知加工的过程中,会激活右半球额叶大部分脑区,并且在P3和N2成分上与在非我身份声音识别中同样存在显著差异。从声音刺激和个体动机两种角度来开展自我声音识别研究,并结合进化心理学与脑成像技术探索其神经机制,宜成为未来研究的一个方向。     

Right hemispheric self-awareness: a critical assessment

In this commentary I evaluate the claim made by that since self-recognition results from right hemispheric activity, self-awareness too is likely to be produced by the activity of the same hemisphere. This reasoning is based on the assumption that self-recognition represents a valid operationalization of self-awareness; I present two views that challenge this rationale. Keenan et al. also support their claim with published evidence relating brain activity and self-awareness; I closely examine their analysis of one specific review of literature and conclude that it appears to be biased. Finally, recent research suggests that inner speech (which is associated with left hemispheric activity) is linked to self-awareness-an observation that further casts doubt on the existence of a right hemispheric self-awareness.     

Hemisphere-dependent holistic processing of familiar faces

In two behavioral experiments involving lateralized stimulus presentation, we tested whether one of the most commonly used measures of holistic face processing—the composite face effect—would be more pronounced for stimuli presented to the right as compared to the left hemisphere. In experiment 1, we investigated the composite face effect in a verbal identification task, similar to its original report (Young, Hellawell, & Hay, 1987). Aligning top and bottom halves of composite face stimuli led to performance decreases irrespective of hemifield, indicating holistic processing of comparable magnitude for inputs provided separately to either hemisphere. However, when matching of the same top parts was required in experiment 2, an alignment-dependent performance decrease was found for stimuli presented in the left, but not right visual field. These observations suggest that the right hemisphere dominates in early stages of holistic processing, as indexed by the composite face effect, but that later processes such as face identification and naming are based on unified representations that are independent of input lateralization. Moreover, the composite face effect may not rely on the exact same representation(s) when measured in matching and identification tasks.     

Ratings of emotion in faces are influenced by the visual field to which stimuli are presented

This experiment was designed to assess the differential impact of initially presenting affective information to the left versus right hemisphere on both the perception of and response to the input. Nineteen right-handed subjects were presented with faces expressing happiness and sadness. Each face was presented twice to each visual field for an 8-sec duration. The electro-oculogram (EOG) was monitored and fed back to subjects to train them to keep their eyes focused on the central fixation point as well as to eliminate trials confounded by eye movement artifact. Following each slide presentation, subjects rated the intensity of the emotional expression depicted in the face and their emotional reaction to the face on a series of 7-point rating scales. Subjects reported perceiving more happiness in response to stimuli initially presented to the left hemisphere (right visual field) compared to presentations of the identical faces to the right hemisphere (left visual field). This effect was predominantly a function of ratings on sad faces. A similar, albeit less robust, effect was found on self-ratings of happiness (the degree to which the face elicited the emotion in the viewer). These data challenge the view that the right hemisphere is uniquely involved in all emotional behavior. The implications of these findings for theories concerning the lateralization of emotional behavior are discussed.     

Stereotypes and recognition memory for faces and voices of good guys and bad guys

This study tested first whether 240 undergraduate students share high consensual agreement in their selection of faces and voices which fit criminal and non-criminal ‘occupations’ second, whether there are significant relationships between trait impressions and voice characteristics for persons selected as exemplars of criminals and non-criminals; and third, whether categorization of targets into ‘good guys’ and ‘bad guys’ influences recognition memory. Subjects' selections of exemplars of criminals and non-criminals from video recordings of the face and voice, or face-only, or voice-only of 15 white men were done with high confidence in a significantly non-random manner. Significant correlations were found between trait impressions and vocal characteristics in all three presentation modes which differentiated good guys from bad guys. Recognition memory for target voices was significantly inferior to the recognition of face and voice targets, and face-only targets. Recognition confidence scores were significantly higher for good guys over bad guys, especially in the voice-only condition. The results were discussed in terms of the probability that stereotyping of faces and voices can influence decision-making in the legal process.     

Sense of body and sense of action both contribute to self-recognition

Recognizing oneself, easy as it appears to be, seems at least to require awareness of one's body and one's actions. To investigate the contribution of these factors to self-recognition, we presented normal subjects with an image of both their own and the experimenter's hand. The hands could make the same, a different or no movement and could be displayed in various orientations. Subjects had to tell whether the indicated hand was theirs or not. The results showed that a congruence between visual signals and signals indicating the position of the body is one component on which self-recognition is based. Recognition of one's actions is another component. Subjects had most difficulty in recognizing their hand when movements were absent. When the two hands made different movements, subjects relied exclusively on the movement cue and recognition was almost perfect. Our findings are in line with pathological alterations in the sense of body and the sense of action.     

The neural correlates of visual self-recognition

This paper presents a review of studies that were aimed at determining which brain regions are recruited during visual self-recognition, with a particular focus on self-face recognition. A complex bilateral network, involving frontal, parietal and occipital areas, appears to be associated with self-face recognition, with a particularly high implication of the right hemisphere. Results indicate that it remains difficult to determine which specific cognitive operation is reflected by each recruited brain area, in part due to the variability of used control stimuli and experimental tasks. A synthesis of the interpretations provided by previous studies is presented. The relevance of using self-recognition as an indicator of self-awareness is discussed. We argue that a major aim of future research in the field should be to identify more clearly the cognitive operations induced by the perception of the self-face, and search for dissociations between neural correlates and cognitive components.     

Perceiving emotion from a talker: How face and voice work together

The experiment investigated how the addition of emotion information from the voice affects the identification of facial emotion. We presented whole face, upper face, and lower face displays and examined correct recognition rates and patterns of response confusions for auditory-visual (AV), auditory-only (AO), and visual-only (VO) expressive speech. Emotion recognition accuracy was superior for AV compared to unimodal presentation. The pattern of response confusions differed across the unimodal conditions and across display type. For AV presentation, a response confusion only occurred when such a confusion was present in each modality separately, thus response confusions were reduced compared to unimodal presentations. Emotion space (calculated from the confusion data) differed across display types for the VO presentations but was more similar for the AV ones indicating that the addition of the auditory information acted to harmonize the various VO response patterns. These results are discussed with respect to how bimodal emotion recognition combines auditory and visual information.     

Perceptual biases in processing facial identity and emotion

Normal observers demonstrate a bias to process the left sides of faces during perceptual judgments about identity or emotion. This effect suggests a right cerebral hemisphere processing bias. To test the role of the right hemisphere and the involvement of configural processing underlying this effect, young and older control observers and patients with right hemisphere damage completed two chimeric faces tasks (emotion judgment and face identity matching) with both upright and inverted faces. For control observers, the emotion judgment task elicited a strong left-sided perceptual bias that was reduced in young controls and eliminated in older controls by face inversion. Right hemisphere damage reversed the bias, suggesting the right hemisphere was dominant for this task, but that the left hemisphere could be flexibly recruited when right hemisphere mechanisms are not available or dominant. In contrast, face identity judgments were associated most clearly with a vertical bias favouring the uppermost stimuli that was eliminated by face inversion and right hemisphere lesions. The results suggest these tasks involve different neurocognitive mechanisms. The role of the right hemisphere and ventral cortical stream involvement with configural processes in face processing is discussed.     

建言类型对领导者建言采纳的影响：面子与幽默的作用

以说服和面子理论为基础,通过两个研究探讨领导者建言采纳行为的影响因素及作用机制。结果发现：相对于促进型建言,抑制型建言给领导带来的面子威胁更大,且领导者感知面子威胁在建言类型与建言采纳之间起部分的中介作用。而幽默类型与水平影响领导者感知面子威胁的程度,积极幽默水平越高,领导者感知面子威胁的程度越低,其建言采纳可能性越高。这表明领导者感知面子威胁在建言类型与建议采纳间起中介作用,幽默调节了此中介效应。     

Infant face interest is associated with voice information and maternal psychological health

Early infant interest in their mother's face is driven by an experience based face processing system, and is associated with maternal psychological health, even within a non clinical community sample. The present study examined the role of the voice in eliciting infants’ interest in mother and stranger faces and in the association between infant face interest and maternal psychological health.Infants aged 3.5-months were shown photographs of their mother's and a stranger's face paired with an audio recording of their mother's and a stranger's voice that was either matched (e.g., mother's face and voice) or mismatched (e.g., mother's face and stranger's voice). Infants spent more time attending to the stranger's matched face and voice than the mother's matched face and voice and the mismatched faces and voices. Thus, infants demonstrated an earlier preference for a stranger's face when given voice information than when the face is presented alone. In the present sample, maternal psychological health varied with 56.7% of mothers reporting mild mood symptoms (depression, anxiety or stress response to childbirth). Infants of mothers with significant mild maternal mood symptoms looked longer at the faces and voices compared to infants of mothers who did not report mild maternal mood symptoms. In sum, infants’ experience based face processing system is sensitive to their mothers’ maternal psychological health and the multimodal nature of faces.     

The perception of emotions by ear and by eye

Emotions are expressed in the voice as well as on the face. As a first step to explore the question of their integration, we used a bimodal perception situation modelled after the McGurk paradigm, in which varying degrees of discordance can be created between the affects expressed in a face and in a tone of voice. Experiment 1 showed that subjects can effectively combine information from the two sources, in that identification of the emotion in the face is biased in the direction of the simultaneously presented tone of voice. Experiment 2 showed that this effect occurs also under instructions to base the judgement exclusively on the face. Experiment 3 showed the reverse effect, a bias from the emotion in the face on judgement of the emotion in the voice. These results strongly suggest the existence of mandatory bidirectional links between affect detection structures in vision and audition.     

Echoic memory and voice quality: Recency recall is not enhanced by varying presentation voice

Three experiments explored the effects on immediate recall of varying voice of presentation. Experiment 1 showed that the free-recall recency effect was not enhanced by presenting list words alternately in a male and a female voice. Experiment 2 replicated this result and also showed that recall of a given recency item from such a list was no more probable when the subjects were informed immediately following presentation that they need not recall the words presented in the other voice. Experiment 3 replicated previous findings of a reduction in the “suffix effect” when presentation voice is changed for the suffix item. The relation of this result to those of Experiments 1 and 2 is discussed.