The embodied cognition theory and the motor component of “yes” and “no” verbal responses

Most of the experiments which give theories of embodied cognition their empirical anchorage only take into consideration the motor responses induced by the task or the motor component of the visual stimulus. And yet, these motor responses are often associated with a linguistic answer. Our hypothesis is that “YES” and “NO” verbal responses have a motor component. In a first experiment we showed that producing a verbal response (YES vs. NO) involves motor planning (pushing vs. pulling): participants push a lever more quickly when they have to answer “yes” than “no”, and conversely, they pull a lever more quickly when they have to answer “no” than “yes”. Moreover, in a second experiment, we showed that perceiving the words “YES” and “NO”, on its own, leads to the same motor planning than when “yes” and “no” answers actually have to be produced. Participants detect the word “YES” faster when they have to push a lever than when they have to pull it and conversely they detect the word “NO” faster when they have to pull the lever than when they have to push it down. These results are discussed in reference to “online” and “offline embodiment” concepts and to the cognitive linguistic theories.     

Linguistic and Perceptual Mapping in Spatial Representations: An Attentional Account

Building on evidence for embodied representations, we investigated whether Spanish spatial terms map onto the NEAR/FAR perceptual division of space. Using a long horizontal display, we measured congruency effects during the processing of spatial terms presented in NEAR or FAR space. Across three experiments, we manipulated the task demands in order to investigate the role of endogenous attention in linguistic and perceptual space mapping. We predicted congruency effects only when spatial properties were relevant for the task (reaching estimation task, Experiment 1) but not when attention was allocated to other features (lexical decision, Experiment 2; and color, Experiment 3). Results showed faster responses for words presented in Near‐space in all experiments. Consistent with our hypothesis, congruency effects were observed only when a reaching estimate was requested. Our results add important evidence for the role of top‐down processing in congruency effects from embodied representations of spatial terms.     

Representing object colour in language comprehension

Embodied theories of cognition hold that mentally representing something red engages the neural subsystems that respond to environmental perception of that colour. This paper examines whether implicit perceptual information on object colour is represented during sentence comprehension even though doing so does not necessarily facilitate task performance. After reading a sentence that implied a particular colour for a given object, participants were presented with a picture of the object that either matched or mismatched the implied colour. When asked if the pictured object was mentioned in the preceding sentence, people's responses were faster when the colours mismatched than when they matched, suggesting that object colour is represented differently to other object properties such as shape and orientation. A distinction between stable and unstable embodied representations is proposed to allow embodied theories to account for these findings.     

Affordance Compatibility Effect for Word Learning in Virtual Reality

Rich sensorimotor interaction facilitates language learning and is presumed to ground conceptual representations. Yet empirical support for early stages of embodied word learning is currently lacking. Finding evidence that sensorimotor interaction shapes learned linguistic representations would provide crucial support for embodied language theories. We developed a gamified word learning experiment in virtual reality in which participants learned the names of six novel objects by grasping and manipulating objects with either their left or right hand. Participants then completed a word–color match task in which they were tested on the same six words and objects. Participants were faster to respond to stimuli in the match task when the response hand was compatible with the hand used to interact with the named object, an effect we refer to as affordance compatibility. In two follow up experiments, we found that merely observing virtual hands interact with the objects was sufficient to acquire a smaller affordance compatibility effect, and we found that the compatibility effect was driven primarily by responses with a compatible hand and not by responses in a compatible spatial location. Our results support theoretical views of language which ground word representations in sensorimotor experiences, and they suggest promising future routes to explore the sensorimotor foundations of higher cognition through immersive virtual experiments.     

Dutch modality exclusivity norms: Simulating perceptual modality in space

Perceptual information is important for the meaning of nouns. We present modality exclusivity norms for 485 Dutch nouns rated on visual, auditory, haptic, gustatory, and olfactory associations. We found these nouns are highly multimodal. They were rated most dominant in vision, and least in olfaction. A factor analysis identified two main dimensions: one loaded strongly on olfaction and gustation (reflecting joint involvement in flavor), and a second loaded strongly on vision and touch (reflecting joint involvement in manipulable objects). In a second study, we validated the ratings with similarity judgments. As expected, words from the same dominant modality were rated more similar than words from different dominant modalities; but – more importantly – this effect was enhanced when word pairs had high modality strength ratings. We further demonstrated the utility of our ratings by investigating whether perceptual modalities are differentially experienced in space, in a third study. Nouns were categorized into their dominant modality and used in a lexical decision experiment where the spatial position of words was either in proximal or distal space. We found words dominant in olfaction were processed faster in proximal than distal space compared to the other modalities, suggesting olfactory information is mentally simulated as “close” to the body. Finally, we collected ratings of emotion (valence, dominance, and arousal) to assess its role in perceptual space simulation, but the valence did not explain the data. So, words are processed differently depending on their perceptual associations, and strength of association is captured by modality exclusivity ratings.     

道德概念的空间形象性：语言因素和具身因素的共同作用

采用事件相关电位(ERP)技术探讨抽象道德概念的空间形象性效应, 以及语言因素和具身因素对该效应的影响机制及其加工进程。实验1检验词对空间位置对道德词对语义判断(反义程度)所产生的影响, 结果表明不符合空间形象性呈现条件(即道德-下, 不道德-上)诱发了较大的N400, 并且词对语义判断的反应时较长; 实验2检验词对语义的反义程度对道德词对空间形象性判断所产生的影响, 结果表明语义无关词对诱发了较大的N200和N700, 并且词对空间形象性判断的反应时较长。研究结果表明, 抽象道德概念的加工能够表现出空间形象性效应, 该效应由语言因素和具身因素共同塑造, 前者在概念加工过程中优先被激活并发挥持久影响, 后者仅在概念加工的中期发挥作用。     

Visible embodiment: Gestures as simulated action

Spontaneous gestures that accompany speech are related to both verbal and spatial processes. We argue that gestures emerge from perceptual and motor simulations that underlie embodied language and mental imagery. We first review current thinking about embodied cognition, embodied language, and embodied mental imagery. We then provide evidence that gestures stem from spatial representations and mental images. We then propose the gestures-as-simulated-action framework to explain how gestures might arise from an embodied cognitive system. Finally, we compare this framework with other current models of gesture production, and we briefly outline predictions that derive from the framework.     

Automatic avoidance tendencies in individuals with contamination-related obsessive-compulsive symptoms

We used an approach-avoidance task (AAT) to examine response to threatening stimuli in 20 individuals high in contamination-related obsessive-compulsive symptoms (HCs) and 21 individuals low in contamination-related obsessive-compulsive symptoms (LCs). Participants were instructed to respond to contamination-related and neutral pictures by pulling a joystick towards themselves or by pushing it away from themselves. Moving the joystick changed the size of the image to simulate approaching or distancing oneself from the object. Consistent with our hypothesis, the HC group was significantly slower in pulling contamination-related pictures than in pulling neutral pictures, whereas in the LC group there was no difference between speed of pulling contamination-related pictures and neutral pictures. Contrary to our hypothesis, we did not find support for faster pushing away of contamination-related pictures than neutral pictures by the HC group. Moreover, the degree of avoidance of contamination-related stimuli when pulling - but not when pushing - was significantly correlated with self-reported contamination-related obsessive-compulsive symptoms. These results suggest a biased behavioral response for threatening objects in individuals high in contamination fears only when inhibiting the prepotent response to avoid threatening stimuli and not when performing a practiced avoidance response. Thus, our results validate the use of the AAT as a measure of inhibited and uninhibited automatic avoidance reactions to emotional information in individuals with contamination-related obsessive-compulsive symptoms.     

Self-control in action: implicit dispositions toward goals and away from temptations

Five studies examined whether, in self-control dilemmas, individuals develop an implicit disposition to approach goals and avoid temptations, psychologically as well as physically. Using a method developed by A. K. Solarz (1960; see also K. L. Duckworth, J. A. Bargh, M. Garcia, & S. Chaiken, 2002), the authors assessed the time for pulling and pushing a lever in response to goal- and temptation-related stimuli (e.g., studying and partying). The results show that individuals offset the influence of tempting activities by automatically avoiding these stimuli (faster pushing responses) and by approaching stimuli related to an overarching goal (faster pulling responses). These implicit self-control dispositions varied as a function of the magnitude of the self-control conflict, itself defined by how strongly individuals were attracted to temptations and held the longer term goal. These dispositions were further shown to play a role in successful self-control.     

Body satisfaction, sexual self-schemas and subjective well-being in women

The objectification of women's bodies in western culture creates special emphasis on women's representations of embodied aspects of themselves. I argue that women's satisfaction with their bodies is likely to have particularly strong implications for other embodied aspects of self: in this case, representations of their sexual selves. This paper examines the relationships between women's body satisfaction, their sexual self-schemas, and components of subjective well-being in a sample of 91 Australian women aged between 18 and 68. Body satisfaction and dimensions of women's actual sexual self-schemas predicted satisfaction with life, positive and negative affect. The relationships between body satisfaction and both positive affect and satisfaction with life were partially mediated by the positive dimensions of sexual self-schemas. This finding suggests that at least some of the negative consequences associated with body dissatisfaction are due to the negative implications of body dissatisfaction for women's beliefs about their sexual selves.     

Gender differences on the semantic flanker task using transposed-letter target words

Previous research has demonstrated that men and women are differentially influenced by irrelevant distractors. Other lines of evidence have suggested that increasing the perceptual load of a task reduces distractor interference for participants generally. The present study examined these effects using a semantic version of the flanker task; participants made speeded responses to category target words that were flanked by irrelevant distractors. The response mapping between the target and flanker words was either congruent (mapped to the same motor response) or incongruent (target word mapped to a different motor response to that of the flankers). Target words were presented either normally (e.g., table: low perceptual load) or with the beginning letters transposed (e.g., atble: high perceptual load). The results revealed that women showed a larger congruency effect than men but this was not due to greater interference on incongruent trials. While men and women made faster responses to normal than to transposed target words, this was similar in magnitude. The magnitude of the flanker effect for normal and transposed target words was significantly correlated in men but not in women. These findings are consistent with the view that women may process target words to a deeper level than men and therefore may engage in more conflict monitoring then men.     

Gender differences on the semantic flanker task using transposed-letter target words

Previous research has demonstrated that men and women are differentially influenced by irrelevant distractors. Other lines of evidence have suggested that increasing the perceptual load of a task reduces distractor interference for participants generally. The present study examined these effects using a semantic version of the flanker task; participants made speeded responses to category target words that were flanked by irrelevant distractors. The response mapping between the target and flanker words was either congruent (mapped to the same motor response) or incongruent (target word mapped to a different motor response to that of the flankers). Target words were presented either normally (e.g., table: low perceptual load) or with the beginning letters transposed (e.g., atble: high perceptual load). The results revealed that women showed a larger congruency effect than men but this was not due to greater interference on incongruent trials. While men and women made faster responses to normal than to transposed target words, this was similar in magnitude. The magnitude of the flanker effect for normal and transposed target words was significantly correlated in men but not in women. These findings are consistent with the view that women may process target words to a deeper level than men and therefore may engage in more conflict monitoring then men.     

空间-时间联合编码效应：来自手动和眼动证据

本研究探讨汉语背景下不同反应方式（手动,眼动）、不同方位（水平,垂直）上空间-时间联合编码效应（STEARC效应）存在的可能性。四个实验均采用两类时间词语诱发被试的时间表征,采用2（时间：过去、将来）×2（反应手/眼跳方向：左、右/上、下）的被试内设计。结果表明汉语背景下的人们将过去和身体左边（上）联系在一起,把将来和右边（下）联系在一起,人们存在自左向右和自上而下的STEARC效应,这种效应不存在手动和眼动的分离,人们对时间的表征不仅是一条时间线,更是一个心理时间地图。     

How to switch on and switch off semantic priming effects for natural and artifactual categories: activation processes in category memory depend on focusing specific feature dimensions

"Semantic priming" refers to the phenomenon that people react faster to target words preceded by semantically related rather than semantically unrelated words. We wondered whether momentary mind sets modulate semantic priming for natural versus artifactual categories. We interspersed a category priming task with a second task that required participants to react to either the perceptual or action features of simple geometric shapes. Focusing on perceptual features enhanced semantic priming effects for natural categories, whereas focusing on action features enhanced semantic priming effects for artifactual categories. In fact, significant priming effects emerged only for those categories thought to rely on the features activated by the second task. This result suggests that (a) priming effects depend on momentary mind set and (b) features can be weighted flexibly in concept representations; it is also further evidence for sensory-functional accounts of concept and category representation.     

The Role of Sensory Perception,Emotionality and <Emphasis Type="BoldItalic">Lifeworld</Emphasis> in Auditory Word Processing: Evidence from Congenital Blindness and Synesthesia

Although it has been established that human beings process concrete and abstract words differently, it is still a matter of debate what factors contribute to this difference. Since concrete concepts are closely tied to sensory perception, perceptual experience seems to play an important role in their processing. The present study investigated the processing of nouns during an auditory lexical decision task. Participants came from three populations differing in their visual-perceptual experience: congenitally blind persons, word-color synesthetes, and sighted non-synesthetes. Specifically, three features with potential relevance to concreteness were manipulated: sensory perception, emotionality, and Husserlian lifeworld, a concept related to the inner versus the outer world of the self. In addition to a classical concreteness effect, our results revealed a significant effect of lifeworld: words that are closely linked to the internal states of humans were processed faster than words referring to the outside world. When lifeworld was introduced as predictor, there was no effect of emotionality. Concerning participants’ perceptual experience, an interaction between participant group and item characteristics was found: the effects of both concreteness and lifeworld were more pronounced for blind compared to sighted participants. We will discuss the results in the context of embodied semantics, and we will propose an approach to concreteness based on the individual’s bodily experience and the relatedness of a given concept to the self.     

The role of perceptually represented structure in analogical problem solving

Current models of analogical reasoning assume that representations of source examples and target problems occur in an amodal format--that is, a representation whose construction and processing are independent of activity in the perceptual and motor cortices of the brain. We examined the possible use of kinesthetic information--perceptual structures associated with the sensation of space and force--in the representation of source examples and target problems. Participants who recreated a source story while acting out the key elements were more likely to access the story when later working on the target problem than were participants who only verbally recreated the story or who verbally recreated it as well as sketched it. We argue that enactment made kinesthetic and spatial features more salient in participants' source story representations and that this aided performance. These results suggest that current models of analogical reasoning might be improved by including perceptual information as part of their representational schemes.     

Words, pictures, and priming: on semantic activation, conscious identification, and the automaticity of information processing

We investigated the encoding mechanisms involved in the perceptual recognition of words and pictures. Latencies in naming word and picture targets were analyzed as a function of several characteristics of a preceding prime, including whether it was a word or a picture, its duration of exposure, the interval between the prime and target onset, and whether or not the prime was consciously identified and reported by the subject. Results indicated that a common semantic code is available that can represent the meaning of either a word or a picture. This semantic representation, however, appears to be more easily activated by picture primes than by word primes and seems to benefit the naming of picture targets more than the naming of word targets. Despite the advantage for pictures with respect to semantic activation, overall processing in the naming task was slower and more attention demanding for pictures than for words. Comparison of our data with data on classification, in which an opposite pattern occurs (overall processing appears to be slower and more attention demanding for words than for pictures), suggests that, on the average, pictures have faster and more automatic access to their meanings than to their names but that words have faster and more automatic access to their names than to their meanings. This conclusion concerning the relative ability of stimuli to activate different kinds of internal representations has implications for a theory of the basis and development of automaticity.     

Verbal response-effect compatibility

Ideomotor theory states that motor responses are activated by an anticipation of their sensory effects. We assumed that anticipated effects would produce response-effect (R-E) compatibility when there is dimensional overlap of effects and responses. In a four-choice task, visual digit stimuli called for verbal responses (color names). Each response produced a written response-effect on the screen. In different groups, the response-effect was a colored color word (e.g., blue in blue), a white color word, or a colored nonword (Xs in blue). In different blocks, the predictable effects were either incompatible (e.g., response "blue" --> effect: green) or compatible with the response. We found faster responses with compatible than with incompatible R-E mappings. The compatibility effect was strongest with colored words, intermediate with white words, and smallest with colored nonwords. We conclude that effect anticipation influences response selection on both a perceptual level (related to the word's color) and a conceptual level (related to the word's meaning).     

Automatic behavioural responses to valence: Evidence that facial action is facilitated by evaluative processing

Are motor schemata of facial action spontaneously activated upon the processing of evaluative information? In this case, the processing of positive evaluative information should immediately trigger the motor schema of smiling, and the processing of negative information should trigger frowning. This hypothesis was tested in two experiments in which participants were required to respond to positive and negative words by either smiling or frowning. Electromyogram (EMG) activity was recorded over the brow muscle region (corrugator supercilii) and over the cheek muscle region (zygomaticus major) in order to quantify the latency of muscular response as a dependent measure. In Experiment 1 we found that participants were faster at contracting their zygomaticus muscle (which is involved in smiling) when evaluating positive words, and faster at contracting their corrugator muscle (which is involved in frowning) when evaluating negative words. In Experiment 2, participants were required to respond with the contraction of one of the two muscles whenever a word appeared on the computer screen. Again, we found that responses were faster to congruent response valence combinations than to incongruent response valence combinations. These findings support the hypothesis that evaluative processing is directly linked to motor schemata of facial muscles.     

网络词语与非网络词语的知觉差异:时间知觉、空间距离知觉与知觉范围

根据具身认知理论,人们的认知会受到身体活动的影响。网络环境下人的身体活动受到限制,因而其认知活动与非网络环境存在很大的差异。本研究目的在于考察人们对网络词语与非网络的日常词语的时间知觉,空间距离知觉与知觉范围是否有差异。结果发现被试对网络词语的时间知觉更长;网络词语的空间距离感与日常词语没有显著差异;在启动网络词语之后,被试的知觉范围缩小,对中心刺激的反应显著快于边缘刺激。本研究发现了网络词语加工在时间知觉和知觉范围上的变化。