语义表征具身理论:情绪在概念表征中的作用

概念如何被表征是认知科学的热点问题,其中抽象概念如何表征是当前具身认知最具争议性的话题之一。与前期概念隐喻理论(强调意象图式)和知觉符号理论(强调情境内省信息)的观点不同,语义表征具身理论强调情绪经验信息在抽象概念表征和加工中的作用。具体而言,具体概念的表征主要来自感觉运动信息,而抽象概念的表征主要来自情绪经验信息和语言信息。研究证明,抽象概念的高情绪经验信息能够促进词汇的加工,且这一促进作用受词汇情绪效价的调节。未来研究应进一步考虑影响情绪经验信息发挥作用的因素,比如语言信息的丰富性、情绪唤醒或个体的情绪状态等。     

词汇具体性对情绪名词效价加工影响的ERP研究

具体性和抽象性是词汇同一特性的两极, 是直接影响词汇加工过程的重要因素。本研究采用快速序列视觉呈现范式, 结合脑电技术探讨在有限注意资源内, 词汇具体性对情绪名词加工过程的影响。结果发现：名词加工早期和晚期阶段的ERP成分受到情绪效价的调节, 情绪词比中性词诱发了更大的N170和LPC波幅; 名词加工早期和晚期阶段的ERP成分也受到词汇具体性的调节, 具体词比抽象词诱发了更大的N170和LPC波幅; 词汇具体性影响情绪名词加工的晚期阶段, LPC波幅能够分辨出不同情绪效价的抽象词, 对于具体词仅能区分出情绪与非情绪, 这说明抽象词可能比具体词负载了更多的情绪信息, 反映出对情绪信息的精细加工过程。     

中文双字词的具体性效应研究

通过词汇决定任务来考察中文双字词的具体性效应,并检验双重编码理论和语境有效性模型对具体性效应的预测。实验一在刺激单独呈现的条件下操纵词的频率,结果发现在低频的情况下对抽象词的判断时间显著长于具体词,但是在中频情况下没有显著差异;实验二用低频具体词和低频抽象词做重复启动实验,发现重复启动不能消除具体性效应;实验三为低频具体词和低频抽象词提供句子语境,结果发现在一致性句子语境条件下具体性效应消失。以上实验结果既不完全符合双重编码理论的预测,也不完全符合语境有效性模型的预测。     

Disentangling Context Availability and Concreteness in Lexical Decision and W ord Translation

This study examines contrasting predictions of the dual coding theory and the context availability hypothesis regarding concreteness effects in monolingual and bilingual lexical processing. In three experiments, concreteness was controlled for or confounded with rated context availability. In the first experiment, bilingual subjects performed lexical decision in their native language (Dutch, L1). In the second experiment, lexical decision performance of bilinguals in their second language (English, L2) was examined. In the third experiment, bilinguals translated words 'forwards' (from L1 to L2) or 'backwards' (from L2 to L1). Both monolingual and bilingual tasks showed a concreteness effect when concreteness was confounded with context availability. However, concreteness effects disappeared when abstract and concrete words were matched on context availability, and even occasionally reversed. Implications of these results for theories that account for concreteness effects, particulary in bilingual processing, are discussed.     

The contributions of language and experience to the representation of abstract and concrete words: Different weights but similar organizations

In the present studies, we evaluated the contributions of language and sensorimotor information to the representation of abstract and concrete words and the possibility that the organizations of the two types of concepts follow different organizational principles: association, for abstract concepts, and semantic similarity, for concrete concepts. In Study 1, we examined the two strongest associates of concrete and abstract words from published free association norms. Study 2 then extended this analysis to individual data collected with a free association task. Language associations were more important for abstract than for concrete words, but for sensorimotor information no differences were observed between the two types of concepts. Also, no clear evidence was found for different qualitative organizational principles for abstract and concrete concepts. Multiple representational systems thus seem to be engaged in the conceptual processing of abstract and concrete concepts, while it remains to be investigated whether their representations follow different organizational principles.     

Neural dichotomy of word concreteness: a view from functional neuroimaging

Our perception about the representation and processing of concrete and abstract concepts is based on the fact that concrete words are highly imagined and remembered faster than abstract words. In order to explain the processing differences between abstract and concrete concepts, various theories have been proposed, yet there is no unanimous consensus about its neural implication. The present study investigated the processing of concrete and abstract words during an orthography judgment task (implicit semantic processing) using functional magnetic resonance imaging to validate the involvement of the neural regions. Relative to non-words, both abstract and concrete words show activation in the regions of bilateral hemisphere previously associated with semantic processing. The common areas (conjunction analyses) observed for abstract and concrete words are bilateral inferior frontal gyrus (BA 44/45), left superior parietal (BA 7), left fusiform gyrus and bilateral middle occipital. The additional areas for abstract words were noticed in bilateral superior temporal and bilateral middle temporal region, whereas no distinct region was noticed for concrete words. This suggests that words with abstract concepts recruit additional language regions in the brain.     

Red-hot: How colour and semantic temperature processing interact in a Stroop-like paradigm

Temperature concepts and colour are commonly associated (i.e., red is “hot” and blue is “cold”), although their direction of influence (unidirectional, bidirectional) is unknown. Semantic Stroop effects, whereby words like fire influence colour categorization, suggest automatic semantic processing influences colour processing. The experiential framework of language comprehension indicates abstract concepts like temperature words simulate concrete experiences in their representation, where expressions like “red-hot” suggest colour processing influences conceptual processing. Participants categorized both colour (Experiment 1: red, blue; Experiment 2: red, green, blue) and word-meaning with matched lists of hot and cold meaning words in each colour. In Experiments 1 and 2, semantic categorization showed congruency effects across hot and cold words, while colour categorization showed facilitation only with hot words in Experiment 2. This asymmetry reflects a more consistent influence of colour categorization on semantic categorization than the reverse, suggesting experiential grounding effects may be more robust than the effects of semantic processing on colour processing.     

The distinctiveness of emotion concepts: a comparison between emotion, abstract, and concrete words

Are the concepts represented by emotion words different from abstract words in memory? We examined the distinct characteristics of emotion concepts in 3 separate experiments. The first demonstrated that emotion words are better recalled than both concrete and abstract words in a free recall task. In the second experiment, ratings of abstract, concrete, and emotion words were compared on concreteness, imageability, and context availability scales. Results revealed a difference between all 3 word types on each of the 3 scales. The third experiment investigated priming in a lexical decision task for homogeneous (abstract-abstract and emotion-emotion) and heterogeneous (abstract-emotion and emotion-abstract) associated word pairs. Priming occurred only for the homogeneous and heterogeneous abstract-emotion word pair conditions. Possible explanations for these findings are discussed in terms of the circumplex, hierarchical, and semantic activation models. The results are most consistent with the predictions of the semantic activation model.     

感知运动信息在概念表征中的作用

研究概念的表征问题对理解概念的本质非常重要,传统认知和具身认知视角下的概念表征理论争议的焦点在于感觉运动信息在表征中的作用。传统认知视角下的离身认知认为感知觉运动信息会转化成抽象的符号,概念表征不包含感知觉运动信息。概念表征的具身观点认为感知觉运动信息是概念表征的基础。对感知运动信息在概念表征中起作用这一命题已经达成共识。未来研究应该关注感知运动信息起作用的机制,以及抽象概念表征等问题,进一步完善发展概念表征理论。     

情绪概念加工与情绪面孔知觉的相互影响

通过3个实验探讨情绪概念加工与情绪面孔知觉是否存在相互影响, 以及加工深度对两者关系的影响。实验1采用情绪面孔启动范式, 探讨较深的情绪概念加工层面对情绪概念与情绪面孔的关系的影响。实验2更改概念任务, 探讨较浅的概念加工层面对两者关系的影响。实验3缩短启动面孔呈现时间, 探讨较浅的面孔知觉层面对两者关系的影响。通过研究主要得出以下结论：(1)情绪概念加工与情绪面孔知觉确实存在相互影响; (2)概念加工深度影响两者关系的方向性, 在较深的概念加工层面, 两者的关系是双向的, 在较浅的概念加工层面, 两者的关系是单向的; (3)知觉加工深度也影响两者关系的方向性, 在较深的知觉加工层面, 两者的关系是双向的, 在较浅的知觉加工层面, 没有发现两者的相互影响。本研究为抽象概念的具身表征提供了实证支持。     

Content differences for abstract and concrete concepts

Concept properties are an integral part of theories of conceptual representation and processing. To date, little is known about conceptual properties of abstract concepts, such as idea. This experiment systematically compared the content of 18 abstract and 18 concrete concepts, using a feature generation task. Thirty-one participants listed characteristics of the concepts (i.e., item properties) or their relevant context (i.e., context properties). Abstract concepts had significantly fewer intrinsic item properties and more properties expressing subjective experiences than concrete concepts. Situation components generated for abstract and concrete concepts differed in kind, but not in number. Abstract concepts were predominantly related to social aspects of situations. Properties were significantly less specific for abstract than for concrete concepts. Thus, abstractness emerged as a function of several, both qualitative and quantitative, factors.     

Bidirectional associations of power and size in a priming task

Recent studies have shown that the size of a word's font affects people's judgements of its power. This result has been regarded as evidence for the association between power and size. It remains unclear, however, whether this association is bidirectional. The present study used a priming paradigm to determine whether processing power words was not only affected by processing size but also whether the reverse was true, consistent with metaphor representation being bidirectional. In Experiment 1, shapes in different sizes were used as priming materials, and power words were used as targets. In Experiment 2, to test the directionality of power and size, we tested two conditions using the exact same tasks but in reverse order: power words priming shapes and shapes priming power words. In Experiment 3, a significant priming effect was replicated when power words primed shapes in a lexical decision task rather than a powerful/powerless decision task. We found an interplay between power and size in all of the experiments. The bidirectional associations between power and size were in line with the strong version of Metaphoric Structuring, which claims that concrete concepts should influence abstract concepts and abstract domains should affect concrete domains. Thus, power is partially understood in terms of size, which demonstrates that abstract concepts are grounded in sensory motor processing.     

Constructing Semantic Models From Words,Images, and Emojis

A number of recent models of semantics combine linguistic information, derived from text corpora, and visual information, derived from image collections, demonstrating that the resulting multimodal models are better than either of their unimodal counterparts, in accounting for behavioral data. Empirical work on semantic processing has shown that emotion also plays an important role especially in abstract concepts; however, models integrating emotion along with linguistic and visual information are lacking. Here, we first improve on visual and affective representations, derived from state-of-the-art existing models, by choosing models that best fit available human semantic data and extending the number of concepts they cover. Crucially then, we assess whether adding affective representations (obtained from a neural network model designed to predict emojis from co-occurring text) improves the model's ability to fit semantic similarity/relatedness judgments from a purely linguistic and linguistic–visual model. We find that, given specific weights assigned to the models, adding both visual and affective representations improves performance, with visual representations providing an improvement especially for more concrete words, and affective representations improving especially the fit for more abstract words.     

Dual-coding, context-availability, and concreteness effects in sentence comprehension: an electrophysiological investigation.

Event-related potentials were recorded in 2 experiments while participants read sentences in a word-by-word congruency judgment task. Sentence final words were either congruent, semantically anomalous (Experiments 1 and 2), or neutral (Experiment 2) with respect to sentence context. Half of all final words referred to concrete and half to abstract concepts. A different scalp distribution of the N400 to concrete and abstract final words was found for anomalous and neutral, but not congruent sentences. Although the interaction of context and concreteness is consistent with the context-availability model, the differential scalp distribution of effects for concrete and abstract words, as well as larger context effects for concrete words, was interpreted as being more consistent with an extended dual-code account of semantic processing.     

Linking somatic and symbolic representation in semantic memory: the dynamic multilevel reactivation framework

Biological plausibility is an essential constraint for any viable model of semantic memory. Yet, we have only the most rudimentary understanding of how the human brain conducts abstract symbolic transformations that underlie word and object meaning. Neuroscience has evolved a sophisticated arsenal of techniques for elucidating the architecture of conceptual representation. Nevertheless, theoretical convergence remains elusive. Here we describe several contrastive approaches to the organization of semantic knowledge, and in turn we offer our own perspective on two recurring questions in semantic memory research: (1) to what extent are conceptual representations mediated by sensorimotor knowledge (i.e., to what degree is semantic memory embodied)? (2) How might an embodied semantic system represent abstract concepts such as modularity, symbol, or proposition? To address these questions, we review the merits of sensorimotor (i.e., embodied) and amodal (i.e., disembodied) semantic theories and address the neurobiological constraints underlying each. We conclude that the shortcomings of both perspectives in their extreme forms necessitate a hybrid middle ground. We accordingly propose the Dynamic Multilevel Reactivation Framework—an integrative model predicated upon flexible interplay between sensorimotor and amodal symbolic representations mediated by multiple cortical hubs. We discuss applications of the dynamic multilevel reactivation framework to abstract and concrete concept representation and describe how a multidimensional conceptual topography based on emotion, sensation, and magnitude can successfully frame a semantic space containing meanings for both abstract and concrete words. The consideration of ‘abstract conceptual features’ does not diminish the role of logical and/or executive processing in activating, manipulating and using information stored in conceptual representations. Rather, it proposes that the materials upon which these processes operate necessarily combine pure sensorimotor information and higher-order cognitive dimensions involved in symbolic representation.     

Metaphor: Bridging embodiment to abstraction

Embodied cognition accounts posit that concepts are grounded in our sensory and motor systems. An important challenge for these accounts is explaining how abstract concepts, which do not directly call upon sensory or motor information, can be informed by experience. We propose that metaphor is one important vehicle guiding the development and use of abstract concepts. Metaphors allow us to draw on concrete, familiar domains to acquire and reason about abstract concepts. Additionally, repeated metaphoric use drawing on particular aspects of concrete experience can result in the development of new abstract representations. These abstractions, which are derived from embodied experience but lack much of the sensorimotor information associated with it, can then be flexibly applied to understand new situations.     

The Role of Sensory Perception,Emotionality and <Emphasis Type="BoldItalic">Lifeworld</Emphasis> in Auditory Word Processing: Evidence from Congenital Blindness and Synesthesia

Although it has been established that human beings process concrete and abstract words differently, it is still a matter of debate what factors contribute to this difference. Since concrete concepts are closely tied to sensory perception, perceptual experience seems to play an important role in their processing. The present study investigated the processing of nouns during an auditory lexical decision task. Participants came from three populations differing in their visual-perceptual experience: congenitally blind persons, word-color synesthetes, and sighted non-synesthetes. Specifically, three features with potential relevance to concreteness were manipulated: sensory perception, emotionality, and Husserlian lifeworld, a concept related to the inner versus the outer world of the self. In addition to a classical concreteness effect, our results revealed a significant effect of lifeworld: words that are closely linked to the internal states of humans were processed faster than words referring to the outside world. When lifeworld was introduced as predictor, there was no effect of emotionality. Concerning participants’ perceptual experience, an interaction between participant group and item characteristics was found: the effects of both concreteness and lifeworld were more pronounced for blind compared to sighted participants. We will discuss the results in the context of embodied semantics, and we will propose an approach to concreteness based on the individual’s bodily experience and the relatedness of a given concept to the self.     

Hemispheric processing asymmetries: implications for memory

Recent research has demonstrated that memory for words elicits left hemisphere activation, faces right hemisphere activation, and nameable objects bilateral activation. This pattern of results was attributed to dual coding of information, with the left hemisphere employing a verbal code and the right a nonverbal code. Nameable objects can be encoded either verbally or nonverbally and this accounts for their bilateral activation. We investigated this hypothesis in a callosotomy patient. Consistent with dual coding, the left hemisphere was superior to the right in memory for words, whereas the right was superior for faces. Contrary to prediction, performance on nameable pictures was not equivalent in the two hemispheres, but rather resulted in a right hemisphere superiority. In addition, memory for pictures was significantly better than for either words or faces. These findings suggest that the dual code hypothesis is an oversimplification of the processing capabilities of the two hemispheres.     

Are there qualitative differences in the representation of abstract and concrete words? Within-language and cross-language evidence from the semantic priming paradigm

The different organizational frameworks theory proposes that there is a qualitative difference between the representation of concrete and abstract words in memory: Concrete concepts would be primarily organized in terms of semantic similarity whereas abstract concepts would be mainly organized by their association with other concepts. Evidence in support of this proposal has been mostly obtained with neuropsychological populations and, to a lesser extent, with healthy participants. In the present work, we tested the different organizational frameworks theory by using, for the first time, a semantic priming paradigm both within language and across languages. The results revealed that there was priming for both semantically similar and associative relations when words were concrete. However, with abstract words, priming was only observed when pairs and targets were associated. These results do not support the proposal of Crutch and coworkers, suggesting that the experimental paradigm as well as the type of relations tested may modulate the pattern of effects obtained with concrete and abstract words.     

多元表征假设：概念表征机制的新观点

传统的认知主义认为概念表征是与主体的感知系统无关的抽象符号。而具身理论则认为,概念表征以主体的感觉、知觉运动系统为基础的,感知系统在概念表征中具有中心作用。然而,具身性假设无法恰当的解释抽象概念表征这一问题。这种局限性说明主体的概念系统可能具有多元表征机制：既包括感知表征以加工与身体经验相关的具体知识,也包括抽象符号表征以加工与身体经验无关的抽象知识。来自病理学、认知神经科学和行为实验的实证研究证明了不同类型的概念会涉及不同的表征机制,证实了多元表征存在的合理性。今后的研究应探讨各种表征机制之间的关系等问题。