Differences in the Timing of Implausibility Detection for Recipient and Instrument Prepositional Phrases

We conducted two word-by-word reading experiments to investigate the timing of implausibility detection for recipient and instrument prepositional phrases (PPs). These PPs differ in thematic role, relative frequency, and possibly in argument status. The results showed a difference in the timing of garden path effects such that the detection of implausible dative recipients (which are clearly arguments) was delayed relative to the detection of implausible instruments (which may not be arguments). They also demonstrated that commitments to syntactic structure were made at the preposition for both dative and instrument PPs. While these results refute delay models of parsing (e.g., Britt, 1994) and syntax-first accounts of PP-attachment (e.g., Frazier, 1978; Frazier & Clifton, 1996), they support constraint-based lexicalist models that enable verb bias and plausibility information to compete (Garnsey, Pearlmutter, Myers, & Lotocky, 1997).     

The developing constraints on parsing decisions: the role of lexical-biases and referential scenes in child and adult sentence processing

Two striking contrasts currently exist in the sentence processing literature. First, whereas adult readers rely heavily on lexical information in the generation of syntactic alternatives, adult listeners in world-situated eye-gaze studies appear to allow referential evidence to override strong countervailing lexical biases (Tanenhaus, Spivey-Knowlton, Eberhard, and Sedivy, 1995). Second, in contrast to adults, children in similar listening studies fail to use this referential information and appear to rely exclusively on verb biases or perhaps syntactically based parsing principles (Trueswell, Sekerina, Hill, and Logrip, 1999). We explore these contrasts by fully crossing verb bias and referential manipulations in a study using the eye-gaze listening technique with adults (Experiment 1) and five-year-olds (Experiment 2). Results indicate that adults combine lexical and referential information to determine syntactic choice. Children rely exclusively on verb bias in their ultimate interpretation. However, their eye movements reveal an emerging sensitivity to referential constraints. The observed changes in information use over ontogenetic time best support a constraint-based lexicalist account of parsing development, which posits that highly reliable cues to structure, like lexical biases, will emerge earlier during development and more robustly than less reliable cues.     

Distributed cortical networks for syntax processing: Broca's area as the common denominator

Different types of syntactic information (word category, grammatical gender) are processed at different times during word recognition. However, it is an open issue which brain systems support these processes. In the present event-related fMRI study, subjects performed either a syntactic gender decision task on German nouns (GEN), a word category decision task (WC, nouns vs. prepositions), or a physical baseline task (BASE). Reaction times in WC were faster than in GEN, supporting earlier electrophysiological results. Relative to BASE, both syntactic tasks activated the inferior tip of BA 44. In addition, BA 45 showed activation in GEN, whereas BA 47 was activated in WC. The imaging data indicate that the inferior portion of BA 44 together with type-specific prefrontal areas supports both initial word category related and later syntactic processes.     

语言理解中情绪的动态模拟

采用混合实验设计, 句子-图片匹配范式和动态过程再现范式, 以包含静态情绪和动态变化情绪信息的句子为实验材料, 以被试对图片的反应时间为因变量指标, 通过不同时间间隔的设置以及不同的实验程序, 探讨了语言理解中静态情绪和动态情绪的心理模拟及其时间进程。结果表明：(1)被试对情绪的心理模拟与句中的语言描述一致, 情绪语境能够激活被试的经验模拟。(2)被试在句子理解加工的初期就能迅速、即时地模拟静态情绪信息, 且这种模拟具有一定的稳定性和持久性。(3)被试可以对动态变化的情绪进行动态的心理模拟, 不过这种模拟所需的时间要长, 是在句子理解加工的后期完成的。被试对不同情绪变化方向的句子模拟受到原情绪状态的影响, 当阅读由消极情绪向积极情绪变化的句子时, 由于被试固着于原来的消极情绪而发生了模拟积极情绪的困难。     

Embodiment Effects and Language Comprehension in Alzheimer's Disease

It has been shown that when participants are asked to make sensibility judgments on sentences that describe a transfer of an object toward or away from their body, they are faster to respond when the response requires a movement in the same direction as the transfer described in the sentence. This phenomenon is known as the action compatibility effect (ACE). This study investigates whether the ACE exists for volunteers with Alzheimer's disease (AD), whether the ACE can facilitate language comprehension, and also whether the ACE can still be produced if the order of the two events is inverted, that is, whether overt movement can prime comprehension of transfer sentences. In Study 1, participants with AD, younger, and older adults were tested on an adaptation of the ACE Paradigm. In Study 2, the same paradigm was modified to include an arm movement that participants had to perform prior to sentence exposure on screen. In Study 1, young, older adults, and individuals with AD were faster to respond when the direction of the response movement matched the directionality implied by the sentence (ACE). In Study 2, no traditional ACE was found; participants were faster when the direction of the movement immediately preceding the sentence matched the directionality of the sentence. It was found that compatibility effects generated a relative advantage, that transfer schemata are easier to process, and that an ACE‐like effect can be the result of mutual priming between language and movement. Results suggested preservation in AD of the neural systems for action engaged during language comprehension, and conditions under which comprehension in AD can be facilitated in real life may be identified.     

Listening comprehension and working memory are impaired in attention-deficit hyperactivity disorder irrespective of language impairment

This study investigated listening comprehension and working memory abilities in children with attention-deficit hyperactivity disorder (ADHD), presenting with and without language impairments (LI). A 4-group design classified a community sample (n = 77) of boys aged 9–12 into ADHD, ADHD + LI, LI, and Normal groups. Children completed tests of basic language and cognitive skills, verbal and spatial working memory, and passage-level listening comprehension. Multivariate analyses and post hoc comparisons indicated that ADHD children who did not have co-occurring LI comprehended factual information from spoken passages as well as normal children, but were poorer at comprehending inferences and monitoring comprehension of instructions. ADHD children did not differ from normal children in verbal span, but showed significantly poorer verbal working memory, spatial span, and spatial working memory. The ADHD + LI and LI groups were most impaired in listening comprehension and working memory performance, but did not differ from each other. Listening comprehension skills were significantly correlated with both verbal and spatial working memory, and parent–teacher ratings of inattention and hyperactivity/impulsivity. Findings that children with ADHD but no LI showed subtle higher-level listening comprehension deficits have implications for both current diagnostic practices and conceptualizations of ADHD.     

Age-related changes in the appreciation of novel metaphoric semantic relations

ABSTRACT

In the present study we tested the possibility that older adults differ from younger adults in their appreciation of metaphoric semantic relations, and that age-related changes occur due to the perception of novel metaphors. In the first experiment 35 younger (mean age?=?23.1) and 35 older adults (mean age?=?75.3) were asked to rate the plausibility of metaphoric, literal, and unrelated word pairs. Relative to young participants, older participants rated fewer expressions as metaphorically plausible. The second experiment was conducted to examine whether the findings of the first experiment could be accounted for by an age-associated difference in the appreciation of metaphors with different levels of familiarity. In the second experiment, 25 younger (mean age?=?24.4) and 25 older adults (mean age?=?77.5) were asked to rate the familiarity level of the plausible metaphoric expressions. Relative to young participants, older participants rated fewer expressions as novel and more expressions as familiar. The results suggest that novelty plays an important role in appreciating the plausibility of semantic relationships, and age-related changes are associated with the appreciation of the novelty of expressions.     

Investigating joint attention mechanisms through spoken human-robot interaction

Referential gaze during situated language production and comprehension is tightly coupled with the unfolding speech stream ( [Griffin, 2001] , [Meyer et al., 1998] and [Tanenhaus et al., 1995] ). In a shared environment, utterance comprehension may further be facilitated when the listener can exploit the speaker’s focus of (visual) attention to anticipate, ground, and disambiguate spoken references. To investigate the dynamics of such gaze-following and its influence on utterance comprehension in a controlled manner, we use a human–robot interaction setting. Specifically, we hypothesize that referential gaze is interpreted as a cue to the speaker’s referential intentions which facilitates or disrupts reference resolution. Moreover, the use of a dynamic and yet extremely controlled gaze cue enables us to shed light on the simultaneous and incremental integration of the unfolding speech and gaze movement.We report evidence from two eye-tracking experiments in which participants saw videos of a robot looking at and describing objects in a scene. The results reveal a quantified benefit-disruption spectrum of gaze on utterance comprehension and, further, show that gaze is used, even during the initial movement phase, to restrict the spatial domain of potential referents. These findings more broadly suggest that people treat artificial agents similar to human agents and, thus, validate such a setting for further explorations of joint attention mechanisms.     

Computational exploration of metaphor comprehension processes using a semantic space model

Recent metaphor research has revealed that metaphor comprehension involves both categorization and comparison processes. This finding has triggered the following central question: Which property determines the choice between these two processes for metaphor comprehension? Three competing views have been proposed to answer this question: the conventionality view ( Bowdle & Gentner, 2005 ), aptness view ( Glucksberg & Haught, 2006b ), and interpretive diversity view ( Utsumi, 2007 ); these views, respectively, argue that vehicle conventionality, metaphor aptness, and interpretive diversity determine the choice between the categorization and comparison processes. This article attempts to answer the question regarding which views are plausible by using cognitive modeling and computer simulation based on a semantic space model. In the simulation experiment, categorization and comparison processes are modeled in a semantic space constructed by latent semantic analysis. These two models receive word vectors for the constituent words of a metaphor and compute a vector for the metaphorical meaning. The resulting vectors can be evaluated according to the degree to which they mimic the human interpretation of the same metaphor; the maximum likelihood estimation determines which of the two models better explains the human interpretation. The result of the model selection is then predicted by three metaphor properties (i.e., vehicle conventionality, aptness, and interpretive diversity) to test the three views. The simulation experiment for Japanese metaphors demonstrates that both interpretive diversity and vehicle conventionality affect the choice between the two processes. On the other hand, it is found that metaphor aptness does not affect this choice. This result can be treated as computational evidence supporting the interpretive diversity and conventionality views.