Computational exploration of metaphor comprehension processes using a semantic space model

Recent metaphor research has revealed that metaphor comprehension involves both categorization and comparison processes. This finding has triggered the following central question: Which property determines the choice between these two processes for metaphor comprehension? Three competing views have been proposed to answer this question: the conventionality view ( Bowdle & Gentner, 2005 ), aptness view ( Glucksberg & Haught, 2006b ), and interpretive diversity view ( Utsumi, 2007 ); these views, respectively, argue that vehicle conventionality, metaphor aptness, and interpretive diversity determine the choice between the categorization and comparison processes. This article attempts to answer the question regarding which views are plausible by using cognitive modeling and computer simulation based on a semantic space model. In the simulation experiment, categorization and comparison processes are modeled in a semantic space constructed by latent semantic analysis. These two models receive word vectors for the constituent words of a metaphor and compute a vector for the metaphorical meaning. The resulting vectors can be evaluated according to the degree to which they mimic the human interpretation of the same metaphor; the maximum likelihood estimation determines which of the two models better explains the human interpretation. The result of the model selection is then predicted by three metaphor properties (i.e., vehicle conventionality, aptness, and interpretive diversity) to test the three views. The simulation experiment for Japanese metaphors demonstrates that both interpretive diversity and vehicle conventionality affect the choice between the two processes. On the other hand, it is found that metaphor aptness does not affect this choice. This result can be treated as computational evidence supporting the interpretive diversity and conventionality views.     

Investigating joint attention mechanisms through spoken human-robot interaction

Referential gaze during situated language production and comprehension is tightly coupled with the unfolding speech stream ( [Griffin, 2001] , [Meyer et al., 1998] and [Tanenhaus et al., 1995] ). In a shared environment, utterance comprehension may further be facilitated when the listener can exploit the speaker’s focus of (visual) attention to anticipate, ground, and disambiguate spoken references. To investigate the dynamics of such gaze-following and its influence on utterance comprehension in a controlled manner, we use a human–robot interaction setting. Specifically, we hypothesize that referential gaze is interpreted as a cue to the speaker’s referential intentions which facilitates or disrupts reference resolution. Moreover, the use of a dynamic and yet extremely controlled gaze cue enables us to shed light on the simultaneous and incremental integration of the unfolding speech and gaze movement.We report evidence from two eye-tracking experiments in which participants saw videos of a robot looking at and describing objects in a scene. The results reveal a quantified benefit-disruption spectrum of gaze on utterance comprehension and, further, show that gaze is used, even during the initial movement phase, to restrict the spatial domain of potential referents. These findings more broadly suggest that people treat artificial agents similar to human agents and, thus, validate such a setting for further explorations of joint attention mechanisms.     

语言理解中情绪的动态模拟

采用混合实验设计, 句子-图片匹配范式和动态过程再现范式, 以包含静态情绪和动态变化情绪信息的句子为实验材料, 以被试对图片的反应时间为因变量指标, 通过不同时间间隔的设置以及不同的实验程序, 探讨了语言理解中静态情绪和动态情绪的心理模拟及其时间进程。结果表明：(1)被试对情绪的心理模拟与句中的语言描述一致, 情绪语境能够激活被试的经验模拟。(2)被试在句子理解加工的初期就能迅速、即时地模拟静态情绪信息, 且这种模拟具有一定的稳定性和持久性。(3)被试可以对动态变化的情绪进行动态的心理模拟, 不过这种模拟所需的时间要长, 是在句子理解加工的后期完成的。被试对不同情绪变化方向的句子模拟受到原情绪状态的影响, 当阅读由消极情绪向积极情绪变化的句子时, 由于被试固着于原来的消极情绪而发生了模拟积极情绪的困难。     

句子阅读理解过程中句意的建构时间

一般语言学理论认为, 在句子阅读理解过程中, 句子意义建构是基于词汇语义整合的, 其反映在N400之上, 开始于词语呈现后约250 ms。然而, 近年关于语义P600效应的研究却提示句意建构可能存在多通道或方式, 读者甚至可能在N400反映的加工出现之前就已建立了初步句意。为探明在句子阅读理解过程中是否存在比N400反映的加工更早的句意建构, 以及如果存在这样的句意建构, 其是从何时开始的, 本研究开展了四个实验。实验1发现被试在句末双字词呈现200 ms后已将其联系到上文语义表征而建立了句意, 提示句意建构开始于N400反映的加工出现之前。实验2与3进一步发现, 读者开始建立句意的时间约在句末词呈现了150 ms之时。实验4排除了实验1~3效应的其他一些可能解释, 提升了实验1~3结果的可靠性。总体上, 本研究提示：在句子阅读理解过程中, 读者在句末双字词呈现了约150 ms之时就已建立了句意; 可能存在比N400反映的加工更早的句意建构。     

语言理解中的动作知觉：基于具身认知的视角

具身认知理论是目前认知科学领域中最新的研究范式和取向, 它认为人的认知过程依赖于感知和动作系统, 强调身体在认知中发挥重要作用。具身语言理解则认为, 身体、动作和知觉系统在语言认知中也起着不可或缺的作用。文章在简要回顾具身语言理解的相关理论如索引假设、浸入式经历者框架、语言神经理论的基础上, 重点从语言理解的四个层面的实证研究, 即音位、单词、句子、语篇, 证实具身语言理解的观点。未来的研究应该着眼于用具身认知观点来解释更高级的抽象语言表征, 具身单词、句子、语篇的具体表征形式, 并利用具身语言认知的观点进行认知的本土化研究。     

Second-Order Positive Comprehension and Frege’s Basic Law V

Richard Heck and John Burgess have shown that Frege’s Basic Law V is consistent with predicative comprehension and that the resulting theory interprets Robinson Arithmetic. There are also many other ways to keep Frege from being contradictory. This paper shows that Basic Law V is also consistent with positive comprehension and that the resulting theory also interprets Robinson Arithmetic. In addition, the theory of positive Frege provides a new understanding of Dummett’s “indefinitely extensible concepts.”     

语篇理解中语义整合的神经机制及其影响因素

语义整合是把当前阅读中新出现的词语与之前的语境进行语义联结以形成连贯表征的过程。在语篇理解中, 很多理论都确定了整合这一过程的重要性, 语义整合是达成语篇连贯的一个关键步骤, 探究其神经机制及影响因素对理解语篇有重要意义。已有的ERP研究表明语篇理解中的语义整合是即时发生的; 已有的fMRI研究和神经震荡的分析提供了参与这一过程的具体脑区和神经网络的证据。其影响因素主要包括语篇内因素、非言语因素和个体差异。     

Living Being and Speaking Being: Toward a Dialogical Approach to Intentionality

One of the main goals of cognitive science is to shed light on human knowledge. This paper states that, if daily conversations, literature, and private thought, are proper expressions of human behavior, then cognitive sciences ought to elaborate a concept of knowledge suited to this kind of activities. I draw upon the notion of discourse in Bakhtin to specify the attributes of knowing needed to account for human behavior, whose manifestations in everyday life are not reduced to representing objects but essentially oriented toward responding to others. As a central aspect of knowledge, I focus on intentionality and offer a discussion about different aspects of it. Specifically, I examine the difference between intentionality as the faculty of representation (aboutness) and intentionality as the subjective positioning toward contextually relevant ideological perspectives (meaning).

Contextual override of pragmatic anomalies: evidence from eye movements

Readers typically experience processing difficulty when they encounter a word that is anomalous within the local context, such as 'The mouse picked up the dynamite...'. The research reported here demonstrates that by placing a sentence in a fictional scenario that is already well known to the reader (e.g., a Tom and Jerry cartoon, as a context for the example sentence above), the difficulty usually associated with these pragmatic anomalies can be immediately eliminated, as reflected in participants' eye movement behaviour. This finding suggests that readers can rapidly integrate information from their common ground, specifically, their cultural knowledge, whilst interpreting incoming text, and provides further evidence that incoming words are immediately integrated within the global discourse.