多媒体学习中图文加工的认知神经机制

多媒体学习的认知理论和图文理解整合模型指出, 多媒体学习中图片和文字在早期阶段的加工遵循双通道假设, 在晚期不同表征的信息进行整合完成知识建构。理论上的探讨得到了神经科学实证研究的支持。脑成像研究发现, 图、文加工在早期的前语义阶段存在差异, 但晚期的信息整合阶段共享了同一语义系统。事件相关电位研究也发现在早期图片诱发了独特的N300成分, 而晚期图、文均诱发了N400效应。尽管现有研究已经明确了图、文共享同一语义系统, 但是信息是如何在这一系统中进行整合的还需要进一步的研究。

The Cognitive and Neural Mechanism of Text and Picture Processing in Multimedia Learning

According to the cognitive theory of multimedia learning and the integrated theory of text and picture comprehension, text and picture are processed through distinct channels at the early stage, and then integrated into a whole. The theories are supported by empirical researches in neuroscience. Brain imaging studies have shown that the processing of text and picture is different in the semantic pre-process, but shares the same semantic neural system in information integration later. Event-related potential studies have found that only picture evokes a N300 in the early stage, while both picture and text induce the N400 effect later. Although existing studies have provided clear evidence that text and picture share the same semantic system, further research is needed to explore how the information is integrated in this system.