早期视听整合加工——来自MMN的证据

视听整合是指当呈现的视觉和听觉信号在时间、空间上大致接近时,视觉和听觉系统倾向于整合的加工过程。失匹配负波(Mismatch Negativity,MMN)作为反映大脑早期加工的成分,表征偏差的信息输入与感觉记忆痕迹之间的神经失匹配。以MMN作为探测指标的视听整合加工研究,主要包括MMN在阅读理解中字母和语音、韵律信息、麦格克效应等方面的视听整合加工,以及分析跨通道视听整合相互竞争、相互补充的关系。未来研究需聚焦于其他通道的跨通道整合加工,同时应拓展MMN的诱发范式。

The characteristics and mechanisms of audiovisual integration: Evidence from mismatch negativity

Audiovisual integration refers to the cognitive process in which auditory and visual events that are presented at the same time and the same location tend to integrate with each other.Mismatch Negativity (MMN),as an index of early cortical processing,is usually used to explore whether there is mismatch between deviant information and traces of sensory memory.Previous studies on audiovisual integration mainly focused on the integration of letters and phonology,integration of non-language visual information and prosodic auditory information,Mcgurk Effect,as well as the mechanisms underlying the integration processing.This paper reviewed those recent studies and analyzed the possible factors that would influence the integration of auditory and visual processing.Future research should focus on the integration of information from multiple modalities.