Embodied Simulations Are Modulated by Sentential Perspective

There is considerable evidence that language comprehenders derive lexical‐semantic meaning by mentally simulating perceptual and motor attributes of described events. However, the nature of these simulations—including the level of detail that is incorporated and contexts under which simulations occur—is not well understood. Here, we examine the effects of first‐ versus third‐person perspective on mental simulations during sentence comprehension. First‐person sentences describing physical transfer towards or away from the body (e.g., “You threw the microphone,” “You caught the microphone”) modulated response latencies when responses were made along a front‐back axis, consistent with the action‐sentence compatibility effect (ACE). This effect was not observed for third‐person sentences (“He threw the microphone,” “He caught the microphone”). The ACE was observed when making responses along a left‐right axis for third‐person, but not first‐person sentences. Abstract sentences (e.g., “He heard the message”) did not show an ACE along either axis. These results show that perspective is a detail that is simulated during action sentence comprehension, and that motoric activations are flexible and affected by the pronominal perspective used in the sentence.     

Embodiment Effects and Language Comprehension in Alzheimer's Disease

It has been shown that when participants are asked to make sensibility judgments on sentences that describe a transfer of an object toward or away from their body, they are faster to respond when the response requires a movement in the same direction as the transfer described in the sentence. This phenomenon is known as the action compatibility effect (ACE). This study investigates whether the ACE exists for volunteers with Alzheimer's disease (AD), whether the ACE can facilitate language comprehension, and also whether the ACE can still be produced if the order of the two events is inverted, that is, whether overt movement can prime comprehension of transfer sentences. In Study 1, participants with AD, younger, and older adults were tested on an adaptation of the ACE Paradigm. In Study 2, the same paradigm was modified to include an arm movement that participants had to perform prior to sentence exposure on screen. In Study 1, young, older adults, and individuals with AD were faster to respond when the direction of the response movement matched the directionality implied by the sentence (ACE). In Study 2, no traditional ACE was found; participants were faster when the direction of the movement immediately preceding the sentence matched the directionality of the sentence. It was found that compatibility effects generated a relative advantage, that transfer schemata are easier to process, and that an ACE‐like effect can be the result of mutual priming between language and movement. Results suggested preservation in AD of the neural systems for action engaged during language comprehension, and conditions under which comprehension in AD can be facilitated in real life may be identified.     

The Action-Sentence Compatibility Effect: It's All in the Timing

When participants are asked to make sensibility judgments on sentences that describe action toward the body (i.e., "Mark dealt the cards to you") or away from the body (i.e., "You dealt the cards to Mark"), they are faster to respond when the response requires an arm movement in the same direction as the action described by the sentence. This congruence effect is known as the Action–Sentence Compatibility Effect (ACE). This study reports 4 experiments that extend our understanding of the ACE by exploring how the time at which one prepares the motor response required for the sensibility judgment affects the magnitude of the ACE. Results show that the ACE arises only when participants have the opportunity to plan their motor response while they are processing the sentence.     

Grounding language in action

We report a new phenomenon associated with language comprehension: the action-sentence compatibility effect (ACE). Participants judged whether sentences were sensible by making a response that required moving toward or away from their bodies. When a sentence implied action in one direction (e.g., "Close the drawer" implies action away from the body), the participants had difficulty making a sensibility judgment requiring a response in the opposite direction. The ACE was demonstrated for three sentences types: imperative sentences, sentences describing the transfer of concrete objects, and sentences describing the transfer of abstract entities, such as "Liz told you the story." These dataare inconsistent with theories of language comprehension in which meaning is represented as a set of relations among nodes. Instead, the data support an embodied theory of meaning that relates the meaning of sentences to human action.     

Seeing, acting, understanding: motor resonance in language comprehension

Observing actions and understanding sentences about actions activates corresponding motor processes in the observer-comprehender. In 5 experiments, the authors addressed 2 novel questions regarding language-based motor resonance. The 1st question asks whether visual motion that is associated with an action produces motor resonance in sentence comprehension. The 2nd question asks whether motor resonance is modulated during sentence comprehension. The authors' experiments provide an affirmative response to both questions. A rotating visual stimulus affects both actual manual rotation and the comprehension of manual rotation sentences. Motor resonance is modulated by the linguistic input and is a rather immediate and localized phenomenon. The results are discussed in the context of theories of action observation and mental simulation.     

The action-sentence compatibility effect in Japanese sentences

The action-sentence compatibility effect (ACE) is a phenomenon in which a reader's response to a sentence is made faster when there is congruity between the action described in the sentence and the action that makes up the response. Previous studies showed the ACE occurs in action-related sentences in several languages. However, all these were SVO (verb-object) languages, in which verbs are placed before object nouns; this order is reversed in SOV languages. Moreover, those studies investigated hand responses. This study assessed the existence of the ACE in Japanese, an SOV language, and in foot responses. 24 female participants judged the sensibility of Japanese sentences that described actions and responded with either their foot or hand as an effector. Reaction times were significantly faster when there was congruity between the effector described in the sentences and the effector actually used for the response. However, sentence dependency was also found in the foot responses.     

“Pushing the Button While Pushing the Argument”: Motor Priming of Abstract Action Language

In a behavioral study we analyzed the influence of visual action primes on abstract action sentence processing. We thereby aimed at investigating mental motor involvement during processes of meaning constitution of action verbs in abstract contexts. In the first experiment, participants executed either congruous or incongruous movements parallel to a video prime. In the second experiment, we added a no‐movement condition. After the execution of the movement, participants rendered a sensibility judgment on action sentence targets. It was expected that congruous movements would facilitate both concrete and abstract action sentence comprehension in comparison to the incongruous and the no‐movement condition. Results in Experiment 1 showed a concreteness effect but no effect of motor priming. Experiment 2 revealed a concreteness effect as well as an interaction effect of the sentence and the movement condition. The findings indicate an involvement of motor processes in abstract action language processing on a behavioral level.     

The relation between comprehending and remembering some complex sentences

This research concerns the distinction between processes in sentence comprehension and those in sentence memory. Comprehension was monitored by timing subjects while they decided whether a sentence was true or false of their knowledge of the world. The memory process was tapped by examining subjects' incidental memory for the sentences they had previously verified. The verification latencies indicated that at the time of comprehension, sentences likeIt is true that a fire isn't cold were often recoded into an equivalent affirmative form, namely,It is true that a fire is hot. However, negative sentences likeIt isn't true that a fire is cold were not recoded during comprehension. Recoding in recall occurred only for those types of sentences that were recoded at the time of comprehension.     

The immediate processing of sentences

Two independent groups of subjects, under instruction orienting them towards understanding or towards memorizing sentences were timed to respond to a brief auditory signal which occurred at some point during the course of a sentence. Latency appeared to be primarily a function of the task, such that the deeper the semantic processing of the sentence the longer the reaction time. Together with other aspects of the data, it is argued that such tasks affect the extent to which a subject retrieves the meanings of the words in a sentence and integrates them at the end of it. Concrete and abstract sentences were processed in fundamentally the same way. The conclusion drawn is that speech comprehension is an integrative process, under voluntary control, which collates together different aspects of the speech signal.     

Priming prepositional phrase attachment: Evidence from eye-tracking and event-related potentials

Three syntactic-priming experiments investigated the effect of structurally similar or dissimilar prime sentences on the processing of target sentences, using eye tracking (Experiment 1) and event-related potentials (ERPs) (Experiments 2 and 3) All three experiments tested readers' response to sentences containing a temporary syntactic ambiguity. The ambiguity occurred because a prepositional phrase modifier (PP-modifier) could attach either to a preceding verb or to a preceding noun. Previous experiments have established that (a) noun-modifying expressions are harder to process than verb-modifying expressions (when test sentences are presented in isolation); and (b) for other kinds of sentences, processing a structurally similar prime sentence can facilitate processing a target sentence. The experiments reported here were designed to determine whether a structurally similar prime could facilitate processing of noun-attached modifiers and whether such facilitation reflected syntactic-structure-building or semantic processes. These findings have implications for accounts of structural priming during online comprehension and for accounts of syntactic representation and processing in comprehension.     

Perception of motion affects language processing

Recently developed accounts of language comprehension propose that sentences are understood by constructing a perceptual simulation of the events being described. These simulations involve the re-activation of patterns of brain activation that were formed during the comprehender's interaction with the world. In two experiments we explored the specificity of the processing mechanisms required to construct simulations during language comprehension. Participants listened to (and made judgments on) sentences that described motion in a particular direction (e.g. "The car approached you"). They simultaneously viewed dynamic black-and-white stimuli that produced the perception of movement in the same direction as the action specified in the sentence (i.e. towards you) or in the opposite direction as the action specified in the sentence (i.e. away from you). Responses were faster to sentences presented concurrently with a visual stimulus depicting motion in the opposite direction as the action described in the sentence. This suggests that the processing mechanisms recruited to construct simulations during language comprehension are also used during visual perception, and that these mechanisms can be quite specific.     

Memory-load interference in syntactic processing

Participants remembered a short set of words while reading syntactically complex sentences (object–extracted clefts) and syntactically simpler sentences (subject–extracted clefts) in a memory–load study. The study also manipulated whether the words in the set and the words in the sentence were of matched or unmatched types (common nouns vs. proper names). Performance in sentence comprehension was worse for complex sentences than for simpler sentences, and this effect was greater when the type of words in the memory load matched the type of words in the sentence. These results indicate that syntactic processing is not modular, instead suggesting that it relies on working memory resources that are used for other nonsyntactic processes. Further, the results indicate that similarity–based interference is an important constraint on information processing that can be overcome to some degree during language comprehension by using the coherence of language to construct integrated representations of meaning.     

Processing abstract language modulates motor system activity

Embodiment theory proposes that neural systems for perception and action are also engaged during language comprehension. Previous neuroimaging and neurophysiological studies have only been able to demonstrate modulation of action systems during comprehension of concrete language. We provide neurophysiological evidence for modulation of motor system activity during the comprehension of both concrete and abstract language. In Experiment 1, when the described direction of object transfer or information transfer (e.g., away from the reader to another) matched the literal direction of a hand movement used to make a response, speed of responding was faster than when the two directions mismatched (an action-sentence compatibility effect). In Experiment 2, we used single-pulse transcranial magnetic stimulation to study changes in the corticospinal motor pathways to hand muscles while reading the same sentences. Relative to sentences that do not describe transfer, there is greater modulation of activity in the hand muscles when reading sentences describing transfer of both concrete objects and abstract information. These findings are discussed in relation to the human mirror neuron system.     

汉语句子可继续性对句子理解加工的即时影响

通过操纵动词与后接词的关系,来产生搭配异常并控制句子的可继续性,研究汉语词汇信息在句子加工中的即时作用。实验一利用跨通道技术,发现动一名词搭配异常对目标名词的加工有即时影响,形容词条件下可继续性对目标形容词的加工有即时影响;实验二采用眼动技术,发现名词条件和形容词条件下可继续性均有显著的即时影响。结果显示,语义等多种词汇信息被通达后立即共同参与了汉语句子加工。     

Language comprehenders mentally represent the shapes of objects

We examined the prediction that people activate perceptual symbols during language comprehension. Subjects read sentences describing an animal or object in a certain location. The shape of the object or animal changed as a function of its location (e.g., eagle in the sky, eagle in a nest). However, this change was only implied by the sentences. After reading a sentence, subjects were presented with a line drawing of the object in question. They judged whether the object had been mentioned in the sentence (Experiment 1) or simply named the object (Experiment 2). In both cases, responses were faster when the pictured object's shape matched the shape implied by the sentence than when there was a mismatch. These results support the hypothesis that perceptual symbols are routinely activated in language comprehension.     

Non-symbolic arithmetic abilities and mathematics achievement in the first year of formal schooling

We examine the nature of motor representations evoked during comprehension of written sentences describing hand actions. We distinguish between two kinds of hand actions: a functional action, applied when using the object for its intended purpose, and a volumetric action, applied when picking up or holding the object. In Experiment 1, initial activation of both action representations was followed by selection of the functional action, regardless of sentence context. Experiment 2 showed that when the sentence was followed by a picture of the object, clear context-specific effects on evoked action representations were obtained. Experiment 3 established that when a picture of an object was presented alone, the time course of both functional and volumetric actions was the same. These results provide evidence that representations of object-related hand actions are evoked as part of sentence processing. In addition, we discuss the conditions that elicit context-specific evocation of motor representations.     

Intonational marking of given and new information: Some consequences for comprehension

The role of intonation in conveying discourse relationships in auditory sentence comprehension was investigated in two experiments. Using the simple comprehension time paradigm, Experiment 1 found that sentences with accented new information were understood faster than sentences with a neutral intonation contour and that the presence of accent in context sentences facilitated comprehension of subsequent targets. Both experiments showed faster comprehension times in conditions in which accent placement was appropriate for the information structure of the sentence. In Experiment I, comprehension times were faster when the accent fell on the information focus than when it fell elsewhere in the sentence. In Experiment 2, faster times resulted when new information was accented and given information was not, compared to conditions in which this accent pattern was reversed. This effect held for both active and passive sentences, and whether the new information occurred in the subject or object position.     

Attentional resource and processing speed limitations during sentence processing in Parkinson's disease

Several studies have suggested that patients with Parkinson's disease (PD) have sentence comprehension difficulty in part because of their limited executive resources. However, these assessments confound the executive resources contributing to sentence comprehension with the resources needed for task performance. In the present study, we used a word detection technique that minimizes task demands in order to evaluate attentional and processing speed resources during the comprehension of simple sentences without subordinate clauses and sentences containing subject-relative and object-relative center-embedded subordinate clauses. We found that PD patients have poor sensitivity to phonetic errors embedded in unbound grammatical morphemes, regardless of the clausal structure of the sentence, suggesting difficulty attending to grammatical morphemes. We also found that PD patients are significantly slowed in their sensitivity to phonetic errors in content words embedded in object-relative center-embedded sentences. Slowed sensitivity to content words in object-relative sentences was correlated with timed executive measures of planning. On a traditional measure of comprehension, these PD patients were impaired for sentences containing object-relative center-embedded clauses compared to sentences with subject-relative center-embedded clauses, and comprehension of object-relative sentences was correlated with executive measures. Our findings are consistent with the claim that limited executive resources for strategic attention and processing speed contribute to the sentence comprehension difficulties of PD patients.     

语言理解中的动作知觉：基于具身认知的视角

具身认知理论是目前认知科学领域中最新的研究范式和取向, 它认为人的认知过程依赖于感知和动作系统, 强调身体在认知中发挥重要作用。具身语言理解则认为, 身体、动作和知觉系统在语言认知中也起着不可或缺的作用。文章在简要回顾具身语言理解的相关理论如索引假设、浸入式经历者框架、语言神经理论的基础上, 重点从语言理解的四个层面的实证研究, 即音位、单词、句子、语篇, 证实具身语言理解的观点。未来的研究应该着眼于用具身认知观点来解释更高级的抽象语言表征, 具身单词、句子、语篇的具体表征形式, 并利用具身语言认知的观点进行认知的本土化研究。     

世界知识在句子理解中的整合时程

Hagoort等(2004)应用背离范式发现世界知识和单词意义在句末的整合是同时进行的。本研究将背离信息提前到句首短语中,旨在探讨世界知识在句子阅读过程中被整合的时程特征。实验采用四词句子为材料,其中第二个词（目标词）含有单词意义或世界知识背离信息,记录并比较被试在阅读后三个词时诱发的脑电变化。结果发现：与正确句子比较,无论是单词意义背离还是世界知识背离,背离目标词均引发出经典的N400,二者在峰值时间和始潜时上无显著差异,但世界知识背离信息诱发的N400波幅值相对较小。句中的后继单词不再诱发类似的N400;但到句子结尾,两类含有背离信息句子的句末正常单词又诱发出类似N400的一个负波。结果提示,在句子理解过程中,世界知识的整合与单词意义的整合相似,可能是随着句子理解过程即时进行的,整合的结果不影响后继信息的加工;但到了句末,读者在对整个句子内容作真实性判断时会对先前进行过的整合再进行考察。