语言理解中的动作知觉：基于具身认知的视角

具身认知理论是目前认知科学领域中最新的研究范式和取向, 它认为人的认知过程依赖于感知和动作系统, 强调身体在认知中发挥重要作用。具身语言理解则认为, 身体、动作和知觉系统在语言认知中也起着不可或缺的作用。文章在简要回顾具身语言理解的相关理论如索引假设、浸入式经历者框架、语言神经理论的基础上, 重点从语言理解的四个层面的实证研究, 即音位、单词、句子、语篇, 证实具身语言理解的观点。未来的研究应该着眼于用具身认知观点来解释更高级的抽象语言表征, 具身单词、句子、语篇的具体表征形式, 并利用具身语言认知的观点进行认知的本土化研究。     

The Influence of Motor Imagery on Postural Sway: Differential Effects of Type of Body Movement and Person Perspective

The present study examined the differential effects of kinesthetic imagery (first person perspective) and visual imagery (third person perspective) on postural sway during quiet standing. Based on an embodied cognition perspective, the authors predicted that kinesthetic imagery would lead to activations in movement-relevant motor systems to a greater degree than visual imagery. This prediction was tested among 30 participants who imagined various motor activities from different visual perspectives while standing on a strain gauge plate. The results showed that kinesthetic imagery of lower body movements, but not of upper body movements, had clear effects on postural parameters (sway path length and frequency contents of sway). Visual imagery, in contrast, had no reliable effects on postural activity. We also found that postural effects were not affected by the vividness of imagery. The results suggest that during kinesthetic motor imagery participants partially simulated (re-activated) the imagined movements, leading to unintentional postural adjustments. These findings are consistent with an embodied cognition perspective on motor imagery.     

抽象动词的具身表征：运动特征的影响

本研究使用具身行为范式—动作-句子相符效应（ACE）探讨了动词运动特征在抽象动词具身表征中的作用。实验1验证ACE在考察感觉运动系统参与双音节动词表征问题上的可行性,结果在具体动词中得到了ACE。实验2以不同运动特征值的抽象动词为材料,在高运动抽象动词中得到了ACE,但在低运动抽象动词中未发现ACE,且ACE大小与运动特征评分显著相关。结果证明了感觉运动系统在抽象动词表征中的参与,支持抽象概念的具身表征观点。     

Developmental emergence of holistic processing in word recognition

Holistic processing (HP) of faces refers to the obligatory, simultaneous processing of the parts and their relations, and it emerges over the course of development. HP is manifest in a decrement in the perception of inverted versus upright faces and a reduction in face processing ability when the relations between parts are perturbed. Here, adopting the HP framework for faces, we examined the developmental emergence of HP in another domain for which human adults have expertise, namely, visual word processing. Children, adolescents, and adults performed a lexical decision task and we used two established signatures of HP for faces: the advantage in perception of upright over inverted words and nonwords and the reduced sensitivity to increasing parts (word length). Relative to the other groups, children showed less of an advantage for upright versus inverted trials and lexical decision was more affected by increasing word length. Performance on these HP indices was strongly associated with age and with reading proficiency. Also, the emergence of HP for word perception was not simply a result of improved visual perception over the course of development as no group differences were observed on an object decision task. These results reveal the developmental emergence of HP for orthographic input, and reflect a further instance of experience-dependent tuning of visual perception. These results also add to existing findings on the commonalities of mechanisms of word and face recognition.

Research Highlights

• Children showed less of an advantage for upright versus inverted trials compared to adolescents and adults.
• Relative to the other groups, lexical decision in children was more affected by increasing word length.
• Performance on holistic processing (HP) indices was strongly associated with age and with reading proficiency.
• HP emergence for word perception was not due to improved visual perception over development as there were no group differences on an object decision task.

     

Evidence for the activation of sensorimotor information during visual word recognition: the body-object interaction effect

We examined the effects of sensorimotor experience in two visual word recognition tasks. Body-object interaction (BOI) ratings were collected for a large set of words. These ratings assess perceptions of the ease with which a human body can physically interact with a word's referent. A set of high BOI words (e.g., mask) and a set of low BOI words (e.g., ship) were created, matched on imageability and concreteness. Facilitatory BOI effects were observed in lexical decision and phonological lexical decision tasks: responses were faster for high BOI words than for low BOI words. We discuss how our findings may be accounted for by (a) semantic feedback within the visual word recognition system, and (b) an embodied view of cognition (e.g., Barsalou's perceptual symbol systems theory), which proposes that semantic knowledge is grounded in sensorimotor interactions with the environment.     

句子理解中颜色信息的心理表征

采用混合实验设计、实时和事后的句子-图片匹配范式, 以隐含物体典型颜色和非典型颜色信息的句子为实验材料, 以被试对图片的反应时间和阅读时间为因变量指标, 通过不同时间间隔的设置以及不同的实验程序, 探讨了句子理解中静态和动态颜色信息心理表征的特点。结果表明：(1)在加工时间有限的情况下, 两个加工任务是否竞争相同的认知资源是造成句-图范式下匹配易化和不匹配易化的关键因素。(2)对于句子隐含的静态颜色信息, 大脑对典型颜色信息的心理表征具有即时性和局部性, 而对非典型颜色信息的心理表征还具有非局部性的特点。(3)对于句子隐含的动态颜色信息, 大脑不能对其进行即时的心理表征, 这种动态颜色信息的心理表征是在句子阅读晚期发生的。     

语境预测性对阅读中字词加工过程的影响：眼动证据

研究包含3项实验,通过观察语境预测性与目标词汇的整词词频、词内汉字字频间交互作用,以探讨阅读中语境预测性如何影响中文词汇加工问题。研究以双字词为例,实验1操控目标词汇的语境预测性与整词词频,结果发现,语境预测性与整词词频交互作用不显著。实验2操控目标词汇的语境预测性与首字字频,结果发现,语境预测性与首字字频交互作用不显著。实验1和实验2的贝叶斯分析都倾向于支持交互作用不存在假设。实验3操控目标词汇的语境预测性与尾字字频,结果发现,语境预测性与尾字字频交互影响首次注视时间、凝视时间、总注视时间和再注视概率。由此可知,语境预测性与整词词频、首字字频变量相对独立地影响词汇加工;语境预测性直接影响词内汉字(尾字)的加工过程。     

Language and age effects in children's processing of word order

We compare the processing of transitive sentences in young learners of a strict word order language (English) and two languages that allow noun omissions and many variant word orders: Turkish, a case-marked language, and Mandarin Chinese, a non case-marked language. Children aged 1–3 years listened to simple transitive sentences in the typical word order of their language, paired with two visual scenes, only one of which matched the sentence. Multiple measures of comprehension (percent of looking to match, latency to look to match, number of switches of attention) revealed a general pattern of early sensitivity to word order, coupled with language and age effects in children's processing efficiency. In particular, English learners showed temporally speedier processing of transitive sentences than Turkish learners, who also displayed more uncertainty about the matching scene. Mandarin learners behaved like Turkish learners in showing slower processing of sentences, and all language groups displayed faster processing by older than younger children. These results demonstrate that sentence processing is sensitive to crosslinguistic features beginning early in language development.     

Perceptual simulation in developing language comprehension

We tested an embodied account of language proposing that comprehenders create perceptual simulations of the events they hear and read about. In Experiment 1, children (ages 7–13 years) performed a picture verification task. Each picture was preceded by a prerecorded spoken sentence describing an entity whose shape or orientation matched or mismatched the depicted object. Responses were faster for matching pictures, suggesting that participants had formed perceptual-like situation models of the sentences. The advantage for matching pictures did not increase with age. Experiment 2 extended these findings to the domain of written language. Participants (ages 7–10 years) of high and low word reading ability verified pictures after reading sentences aloud. The results suggest that even when reading is effortful, children construct a perceptual simulation of the described events. We propose that perceptual simulation plays a more central role in developing language comprehension than was previously thought.     

中文词间词和词内词预视加工的差异：词间阴影的作用

为了考察词语的属性特征对预视加工的影响, 实验操纵注视字与预视字是否属于一个语言单元, 利用眼动轨迹记录法并结合边界范式以探讨其对预视效应的影响。此外, 考察了词边界信息对词间词和词内词预视加工的影响。结果显示, 词内词的预视效应大于词间词, 词间阴影、非词阴影条件下的预视效应和正常条件之间没有差异。说明阴影提供的词边界对词间词和词内词的预视加工无影响, 支持词切分和词汇识别模型, 即词切分和词汇识别是同时进行的。     

Perception of motion affects language processing

Recently developed accounts of language comprehension propose that sentences are understood by constructing a perceptual simulation of the events being described. These simulations involve the re-activation of patterns of brain activation that were formed during the comprehender's interaction with the world. In two experiments we explored the specificity of the processing mechanisms required to construct simulations during language comprehension. Participants listened to (and made judgments on) sentences that described motion in a particular direction (e.g. "The car approached you"). They simultaneously viewed dynamic black-and-white stimuli that produced the perception of movement in the same direction as the action specified in the sentence (i.e. towards you) or in the opposite direction as the action specified in the sentence (i.e. away from you). Responses were faster to sentences presented concurrently with a visual stimulus depicting motion in the opposite direction as the action described in the sentence. This suggests that the processing mechanisms recruited to construct simulations during language comprehension are also used during visual perception, and that these mechanisms can be quite specific.     

Parallel processing of whole words and morphemes in visual word recognition

Models of morphological processing make different predictions about whether morphologically complex written words are initially decomposed and recognized on the basis of their morphemic subunits or whether they can directly be accessed as whole words and at what point semantics begin to influence morphological processing. In this study, we used unprimed and masked primed lexical decision to compare truly suffixed (darkest) and pseudosuffixed words (glossary) with within-boundary (d ra kest/g ol ssary) to across-boundary (dar ek st/glos as ry) letter transpositions. Significant transposed-letter similarity effects were found independently of the morphological position of the letter transposition, demonstrating that, in English, morphologically complex whole-word representations can be directly accessed at initial word processing stages. In a third masked primed lexical decision experiment, the same materials were used in the context of stem target priming, and it was found that truly suffixed primes facilitate the recognition of their stem-target (darkest–DARK) to the same extent as pseudosuffixed primes (glossary–GLOSS), which is consistent with theories of early morpho-orthographic decomposition. Taken together, our findings provide evidence for both whole-word access and morphological decomposition at initial stages of visual word recognition and are discussed in the context of a hybrid account.     

情绪概念加工与情绪面孔知觉的相互影响

通过3个实验探讨情绪概念加工与情绪面孔知觉是否存在相互影响, 以及加工深度对两者关系的影响。实验1采用情绪面孔启动范式, 探讨较深的情绪概念加工层面对情绪概念与情绪面孔的关系的影响。实验2更改概念任务, 探讨较浅的概念加工层面对两者关系的影响。实验3缩短启动面孔呈现时间, 探讨较浅的面孔知觉层面对两者关系的影响。通过研究主要得出以下结论：(1)情绪概念加工与情绪面孔知觉确实存在相互影响; (2)概念加工深度影响两者关系的方向性, 在较深的概念加工层面, 两者的关系是双向的, 在较浅的概念加工层面, 两者的关系是单向的; (3)知觉加工深度也影响两者关系的方向性, 在较深的知觉加工层面, 两者的关系是双向的, 在较浅的知觉加工层面, 没有发现两者的相互影响。本研究为抽象概念的具身表征提供了实证支持。     

Representing object colour in language comprehension

Embodied theories of cognition hold that mentally representing something red engages the neural subsystems that respond to environmental perception of that colour. This paper examines whether implicit perceptual information on object colour is represented during sentence comprehension even though doing so does not necessarily facilitate task performance. After reading a sentence that implied a particular colour for a given object, participants were presented with a picture of the object that either matched or mismatched the implied colour. When asked if the pictured object was mentioned in the preceding sentence, people's responses were faster when the colours mismatched than when they matched, suggesting that object colour is represented differently to other object properties such as shape and orientation. A distinction between stable and unstable embodied representations is proposed to allow embodied theories to account for these findings.     

Studying the grammatical aspects of word recognition: lexical priming,parsing, and syntactic ambiguity resolution

Two experiments are reported examining the relationship between lexical and syntactic processing during language comprehension, combining techniques common to the on-line study of syntactic ambiguity resolution with priming techniques common to the study of lexical processing. By manipulating grammatical properties of lexical primes, we explore how lexically based knowledge is activated and guides combinatory sentence processing. Particularly, we find that nouns (like verbs, see Trueswell & Kim, 1998) can activate detailed lexically specific syntactic information and that these representations guide the resolution of relevant syntactic ambiguities pertaining to verb argument structure. These findings suggest that certain principles of knowledge representation common to theories of lexical knowledge—such as overlapping and distributed representations—also characterize grammatical knowledge. Additionally, observations from an auditory comprehension study suggest similar conclusions about the lexical nature of parsing in spoken language comprehension. They also suggest that thematic role and syntactic preferences are activated during word recognition and that both influence combinatory processing.     

Accent modulates access to word meaning: Evidence for a speaker-model account of spoken word recognition

Speech carries accent information relevant to determining the speaker’s linguistic and social background. A series of web-based experiments demonstrate that accent cues can modulate access to word meaning. In Experiments 1–3, British participants were more likely to retrieve the American dominant meaning (e.g., hat meaning of “bonnet”) in a word association task if they heard the words in an American than a British accent. In addition, results from a speeded semantic decision task (Experiment 4) and sentence comprehension task (Experiment 5) confirm that accent modulates on-line meaning retrieval such that comprehension of ambiguous words is easier when the relevant word meaning is dominant in the speaker’s dialect. Critically, neutral-accent speech items, created by morphing British- and American-accented recordings, were interpreted in a similar way to accented words when embedded in a context of accented words (Experiment 2). This finding indicates that listeners do not use accent to guide meaning retrieval on a word-by-word basis; instead they use accent information to determine the dialectic identity of a speaker and then use their experience of that dialect to guide meaning access for all words spoken by that person. These results motivate a speaker-model account of spoken word recognition in which comprehenders determine key characteristics of their interlocutor and use this knowledge to guide word meaning access.     

语言理解中主体职业特征与动作表征的激活

运用句-配范式以及句子理解与身体反应相互作用的实验范式,探讨 “做某事的是某人”与“某人做某事”两类句式理解过程中主体职业特征与动作表征的激活。结果发现,在“做某事的是某人”句子理解过程中,主体的职业特征和动作表征得到了激活,但在“某人做某事”句子理解过程中,主体职业特征表征和动作表征只有其中一种表征处于匹配状态时,另一种表征才能得到明显的激活。这表明,句子理解过程中,主体职业特征表征得到了激活,而主体职业特征表征与动作执行器表征的同时激活则受到对方匹配情况的影响,知觉符号理论得到了进一步的证明。