When faces and voices come together: Face width-to-height ratio and voice pitch contribute independently to social perception

Prior research has shown that the face's width-to-height ratio (fWHR) and the voice's pitch influence social perception. Yet, the relative contribution of either cue has been largely unexplored. We examined the simultaneous effects of fWHR and pitch on social evaluations. Experiment 1 (N = 102) tested how such cues shaped global impressions. Experiment 2 (N = 121) tested fWHR and pitch's effect on behavioural affiliative intentions, framing social interaction as a physical or an intellectual competition. Experiment 3 (N = 57) assessed whether variations in fWHR and pitch could influence trait attribution (i.e., physical formidability and intelligence). Individuals with large faces or low-pitched voices elicited negative impressions, positive behavioural intentions in a physical competition, and the attribution of stronger formidability but lower intelligence. Across the studies, cues exerted independent effects. The implications of these findings for research on cross-modal social perception are discussed.     

Antecedents of information-processing skills in infants: Habituation, novelty responsiveness, and cross-modal transfer

Three skills which characterize cognitive functioning in human infants in the middle of the first year of life—habituation, novelty responsiveness, and cross-modal transfer—predict mental ability in later childhood. Antecedents of each skill at 5 months postnatal were examined in a short-term prospective longitudinal study of infant ability and maternal intelligence and interaction style. Infant perceptuocognitive performance at 2 months, maternal intelligence, and maternal responsiveness at 5 months relate to the expression of the three infant cognitive skills, but in different ways. Variation in infant information-processing abilities can be explained by specific child and maternal factors that are evident soon after birth.     

象似性和手语学习经验对中国手语-汉语跨模态语义启动效应的影响

采用启动条件下的词汇判断任务,考察熟练手语使用者和无手语经验成年听人的跨模态语义启动效应。结果发现：1)在象似词条件下,两组被试判断汉语语义相关词的反应时均快于语义无关词,说明手语象似词和汉语词之间存在跨模态语义启动效应。2)在非象似词条件下,仅手语熟练被试判断汉语语义相关词的反应时快于语义无关词,无手语经验被试判断汉语语义相关词和无关词的速度没有差异。这是由于前者心理词库中的手语词和口语词共享语义表征,而后者主要依赖手语象似词的视觉模拟性。整个研究表明,中国手语和汉语间存在跨模态语义启动效应,但该效应受到手语词象似性和手语学习经历的调节。     

人名发音与脸型的跨模态映射效应

摘要:本文基于无意义词与简单几何体之间的跨模态映射效应,来研究社会知觉中人名发音与脸型的关系。本研究控制了人名发音的唇形和人物面孔的轮廓,通过简单匹配范式来考察人名发音与面孔之间是否存在跨模态映射效应。结果发现：被试将圆唇人名与圆面孔匹配、扁唇人名与尖面孔匹配的概率,均显著大于随机水平。该结果说明了人名发音和脸型之间存在跨模态映射效应,这不仅拓宽了声音-形状跨模态映射的研究范围,对于人们取名字方面具有一定的指导意义。     

语言差异对跨通道情绪启动效应的影响

采用跨通道启动范式,探讨言语与面孔情绪加工的相互影响效应,以及语言差异（母语：汉语;非母语：英语）在其中的影响作用。实验1以言语情绪词为启动刺激,面孔情绪为目标刺激,结果发现,相比于英语启动刺激条件,在汉语启动刺激条件下的面孔情绪判断具有更好的表现;在积极情绪启动条件下,言语情绪刺激能够启动面孔情绪刺激。实验2以面孔情绪为启动刺激,言语情绪词为目标刺激,结果发现,相比于英语目标刺激条件,在汉语目标刺激条件下的言语情绪判断具有更好的表现;在积极情绪启动条件下,面孔情绪刺激能够启动言语情绪刺激。研究结果表明,言语情绪与面孔情绪的加工能够相互影响,但这种相互关系仅表现在积极情绪启动条件下。此外,母语和非母语在情绪功能上具有差异性。     

跨视听通道主动遗忘的期待加工与抑制控制过程：来自ERPs的证据

基于视觉通道的研究表明,人们可以通过主动抑制记忆提取而实现遗忘。但目前对跨通道的主动遗忘尚缺乏探讨。本研究以声音为记忆线索,以文字为目标记忆,采用“想/不想”范式,探究主动遗忘在跨视听通道条件下的可行性。结果发现,“不想”条件下目标记忆的回忆率低于基线条件,主动遗忘发生。此外,我们通过分离任务指令和记忆线索的呈现时间,在中央区域的ERP中发现了记忆抑制的期待效应;并在额叶观察到“不想”条件下晚期正成分的增强,反映了持续的抑制控制过程。本研究不但验证了跨视听通道主动遗忘的可能性,而且第一次从ERPs角度分离了跨通道遗忘相关的期待加工和抑制控制过程。     

Cross-modal working memory binding and word recognition skills: how specific is the link?

Recent research has suggested that the creation of temporary bound representations of information from different sources within working memory uniquely relates to word recognition abilities in school-age children. However, it is unclear to what extent this link is attributable specifically to the binding ability for cross-modal information. This study examined the performance of Grade 3 (8–9 years old) children on binding tasks requiring either temporary association formation of two visual items (i.e., within-modal binding) or pairs of visually presented abstract shapes and auditorily presented nonwords (i.e., cross-modal binding). Children’s word recognition skills were related to performance on the cross-modal binding task but not on the within-modal binding task. Further regression models showed that cross-modal binding memory was a significant predictor of word recognition when memory for its constituent elements, general abilities, and crucially, within-modal binding memory were taken into account. These findings may suggest a specific link between the ability to bind information across modalities within working memory and word recognition skills.     

Cross-modal working memory binding and learning of visual-phonological associations in children with reading difficulties

Reading decoding requires the association of a visual input (the printed word) with a verbal output (the spoken word), and the learning of visual-phonological associations via repeated exposure occurs both explicitly (by instruction and training) and implicitly (by exposure to written material). However, a general ability to implicitly learn visual-phonological associations (or cross-modal bindings) in children with reading difficulties (RD) has not been deeply explored. The present paper examined this issue in two studies comparing groups of children with RD with matched groups of control children in a working memory binding task involving sequences of variable combinations of nonsense shapes and nonwords (odd trials), as well as fixed combinations (even trials). Stimuli presentation was followed by a recognition test in which the nonwords were given one at a time and the children were required to mouse click on their respective shapes. In Study 1, fixed bindings were presented in random sequences across even trials, and the recognition test presented the nonwords at random. In Study 2, fixed bindings were presented in the same order across even trials, and the recognition test presented the nonwords following the same sequence order. In both studies, a consistent and strong learning effect of fixed bindings was observed for the control groups, with significantly better performance than the groups with RD. Such results suggest that poor cross-modal binding learning is associated with reading difficulties. Implications for the study and treatment of dyslexia are discussed.     

Visual movement perception in deaf and hearing individuals

A number of studies have investigated changes in the perception of visual motion as a result of altered sensory experiences. An animal study has shown that auditory-deprived cats exhibit enhanced performance in a visual movement detection task compared to hearing cats (Lomber, Meredith, & Kral, 2010). In humans, the behavioural evidence regarding the perception of motion is less clear. The present study investigated deaf and hearing adult participants using a movement localization task and a direction of motion task employing coherently-moving and static visual dot patterns. Overall, deaf and hearing participants did not differ in their movement localization performance, although within the deaf group, a left visual field advantage was found. When discriminating the direction of motion, however, deaf participants responded faster and tended to be more accurate when detecting small differences in direction compared with the hearing controls. These results conform to the view that visual abilities are enhanced after auditory deprivation and extend previous findings regarding visual motion processing in deaf individuals.