Dissociation and association of the embodied representation of tool-use verbs and hand verbs: An fMRI study

Embodied semantic theories suppose that representation of word meaning and actual sensory-motor processing are implemented in overlapping systems. According to this view, association and dissociation of different word meaning should correspond to dissociation and association of the described sensory-motor processing. Previous studies demonstrate that although tool-use actions and hand actions have overlapping neural substrates, tool-use actions show greater activations in frontal–parietal–temporal regions that are responsible for motor control and tool knowledge processing. In the present study, we examined the association and the dissociation of the semantic representation of tool-use verbs and hand action verbs. Chinese verbs describing tool-use or hand actions without tools were included, and a passive reading task was employed. All verb conditions showed common activations in areas of left middle frontal gyrus, left inferior frontal gyrus (BA 44/45) and left inferior parietal lobule relative to rest, and all conditions showed significant effects in premotor areas within the mask of hand motion effects. Contrasts between tool-use verbs and hand verbs demonstrated that tool verbs elicited stronger activity in left superior parietal lobule, left middle frontal gyrus and left posterior middle temporal gyrus. Additionally, psychophysiological interaction analyses demonstrated that tool verbs indicated greater connectivity among these regions. These results suggest that the brain regions involved in tool-use action processing also play more important roles in tool-use verb processing and that similar systems may be responsible for word meaning representation and actual sensory-motor processing.     

Getting a grip on numbers: numerical magnitude priming in object grasping

To investigate the functional connection between numerical cognition and action planning, the authors required participants to perform different grasping responses depending on the parity status of Arabic digits. The results show that precision grip actions were initiated faster in response to small numbers, whereas power grips were initiated faster in response to large numbers. Moreover, analyses of the grasping kinematics reveal an enlarged maximum grip aperture in the presence of large numbers. Reaction time effects remained present when controlling for the number of fingers used while grasping but disappeared when participants pointed to the object. The data indicate a priming of size-related motor features by numerals and support the idea that representations of numbers and actions share common cognitive codes within a generalized magnitude system.     

Finger–digit compatibility in Arabic numeral processing

Finger–digit response compatibility was tested by asking participants to identify Arabic digits by pressing 1 of 10 keys with all 10 fingers. The direction of the finger–digit mapping was varied by manipulating the global direction of the hand–digit mapping as well as the direction of the finger–digit mapping within each hand (in each case, from small to large digits, or the reverse). The hypothesis of a left-to-right mental number line predicted that a complete left-to-right mapping should be easier whereas the hypothesis of a representation based on finger counting predicted that a counting-congruent mapping should be easier. The results show that when all 10 fingers are used to answer, a mapping congruent with the prototypical finger-counting strategy reported by the participants leads to better performance than does a mapping congruent with a left-to-right oriented mental number line, both in palm-down and palm-up postures of the hands, and they demonstrate that finger-counting strategies influence the way that numerical information is mentally represented and processed.     

Creating number semantics through finger movement perception

Communication, language and conceptual knowledge related to concrete objects may rely on the sensory–motor systems from which they emerge. How abstract concepts can emerge from these systems is however still unknown. Here we report a functional interaction between a specific meaningful finger movement, such as a finger grip closing, and a concept as abstract as numerical magnitude. Participants were presented with Arabic digits to recall before or after they perceived a biological or non-biological hand movement. The results show that perceiving a grip closing slows down the processing of large magnitude numbers. Importantly, we show that this motor-to-semantic interaction differs from the reverse semantic-to-motor interaction, and that it does not result from a general movement amplitude processing as it is only observed for biological hand movements. These results demonstrate the functional link between number meaning and goal-directed finger movements, and show how abstract concept semantics can emerge from the sensory–motor circuits of the brain.     

不同注意条件下大数与小数的加工差异

考察在注意（注视点）与非注意（非注视点）条件下数字加工的距离效应和符号效应。采用小数（1－4）和大数（6－9）的中文与阿拉伯数字为材料,以判断数字是否大于5为任务。实验结果表明：⑴ 在注意条件下,大小数都出现了距离效应;而在非注意条件下,只有小数出现距离效应;⑵ 在注意条件下,大小数都没有出现符号效应;而在非注意条件下,只有小数出现符号效应,中文数字绩效显著好于阿拉伯数字。     

Developing number–space associations: SNARC effects using a color discrimination task in 5-year-olds

Human adults’ numerical representation is spatially oriented; consequently, participants are faster to respond to small/large numerals with their left/right hand, respectively, when doing a binary classification judgment on numbers, known as the SNARC (spatial–numerical association of response codes) effect. Studies on the emergence and development of the SNARC effect remain scarce. The current study introduces an innovative new paradigm based on a simple color judgment of Arabic digits. Using this task, we found a SNARC effect in children as young as 5.5 years. In contrast, when preschool children needed to perform a magnitude judgment task necessitating exact number knowledge, the SNARC effect started to emerge only at 5.8 years. Moreover, the emergence of a magnitude SNARC but not a color SNARC was linked to proficiency with Arabic digits. Our results suggest that access to a spatially oriented approximate magnitude representation from symbolic digits emerges early in ontogenetic development. Exact magnitude judgments, on the other hand, rely on experience with Arabic digits and, thus, necessitate formal or informal schooling to give access to a spatially oriented numerical representation.     

Costs and benefits of tool-use on the perception of reachable space

Previous studies have shown that using a tool modifies in a short time-scale both near-body space perception and arm-length representation in the body schema. However, to date no research has specifically investigated the effect of tool-use on an action-related perceptual task. We report here a study assessing the effect of tool-use on the perception of reachable space for perceptual estimates made in reference to either the tool or the hand. Using the tool on distal objects resulted in an extension of perceived reachable space with the tool and reduced the variability of reachability estimates. Tool use also extended perceived reachable space with the hand, but with a concomitant increase of the variability of reachability estimates. These findings suggest that tool incorporation into the represented arm following tool-use improves the anticipation of action possibilities with the tool, while hand representation becomes less accurate.     

Infants’ developing expectations of possible and impossible tool-use events between ages 8 and 12 months

Infants’ developing causal expectations for the outcome of a simple tool-use event from ages 8 to 12 months were investigated. Causal expectations were studied by comparing infants’ developing tool-use actions (i.e. as tool-use agents) with their developing perceptual reactions (i.e. as tool-use observers) to possible and impossible tool-use events. In Experiment 1, tool-use actions were studied by presenting infants, ages 8 and 12 months, with tool-use object-retrieval problems. In Experiment 2, a second age-matched sample of infants watched a comparable series of possible and impossible tool-use events in which a tool was used to retrieve a goal-object. Two core related findings were made. First, infants’ causal action and causal perception develop in parallel. In both action and perception, supporting tool-use develops before surrounding tool-use. Second, infants’ tool-use action develops before their causal perception of comparable tool-use events. The findings support the constructivist hypothesis that infants’ causal actions may develop before and inform their causal perceptions.     

Finger-number interaction: an ideomotor account

Recent findings have shown that processing numerical magnitude may interact with finger movements through goal-directed movements. Here we tested these number-finger interactions in a response-effect (R-E) paradigm. During a learning phase, participants read meaningless consonant-vowel (CV) syllables immediately followed by unrelated opening or closing finger movements; during a transfer test, they again named these CV syllables in response to processing a small or a large number. The results showed that responding to a large magnitude number during the transfer phase was slower in an incompatible situation, that is, when the answer was the CV syllable that had been associated to a grip closure during the learning phase. This interference effect demonstrates that ideomotor principles can account for the link between the meaning of numbers and the perception of actions through an anticipated-magnitude code.     

Pliers,not fingers: Tool-action effect in a motor intention paradigm

Tool-use representations have been suggested to be supported by the representation of hand actions and/or by the representation of tool actions. A major issue is to know which one of these two representations is preferentially activated when people intend to use a tool. To address this issue, we developed a paradigm in which, in 20% of trials, participants had to press a button and actually use pliers to move an object in response to a predefined target symbol. Importantly, two masks hiding the symbols performed “opening” or “closing” actions before symbols appeared. In Experiment 1, participants used normal pliers: Hand’s opening actions induced pliers’ opening actions and vice versa for hands’ closing actions. Results indicated a compatibility effect between masks’ actions and pliers’ actions. Participants were faster to press the button in response to the target symbol when opening and closing actions of the masks were congruent with the corresponding actions of the hand. In Experiment 2 participants used inverse pliers: Hand’s opening actions involved pliers’ closing actions and vice versa. In this situation, results showed that the congruency of masks’ actions occurred with pliers’ actions and not hand’s actions. Altogether, these findings demonstrate that intention of use is preferentially based on the representation of tool actions, and have important implications for the domain of neuropsychology of tool use and the theories of goal-directed behavior.     

内源性注意与外源性注意对数字加工的不同影响

分别采用内源性注意和外源性注意实验范式,材料为小数（1－4）和大数（6－9）的中文与阿拉伯数字,任务为判断数字是否大于5,考察在注意与非注意条件下不同大小数字加工的距离效应和符号效应。结果发现：⑴在内源性线索和外源性线索的注意条件下,大小数都出现了距离效应;但在非注意条件下,内源性线索时的大小数都出现了距离效应,而外源性线索时只有小数出现了距离效应,大数的距离效应明显减弱或消失。⑵在内源性线索和外源性线索的注意条件下,大小数都没有出现符号效应;但在非注意条件下,大数没有出现符号效应,而小数出现了符号效应（阿拉伯数字的绩效比中文数字差）,并且内源性线索时的符号效应强度小于外源性线索。     

A review of ideomotor approaches to perception,cognition, action,and language: advancing a cultural recycling hypothesis

The term “cultural recycling” derives from the neuronal recycling hypothesis, which suggests that representations of cultural inventions like written words, Arabic numbers, or tools can occupy brain areas dedicated to other functions. In the present selective review article, we propose a recycling hypothesis for the ideomotor mechanism. The ideomotor approach assumes that motor actions are controlled by the anticipation of the expected perceptual consequences that they aim to generate in the environment. Arguably, such action–perception mechanisms contribute to motor behaviour for human and non-human animals since millions of years. However, recent empirical studies suggest that the ideomotor mechanism can also contribute to word processing, number representation, and arithmetic. For instance, it has been shown that the anticipatory simulation of abstract semantics, like the numerical quantitative value of three items can prime processing of the associated Arabic number “3”. Arabic numbers, words, or tools represent cultural inventions, so that, from a theoretical perspective, we suggest an ideomotor recycling hypothesis for the interaction with such artefacts. In this view, the ideomotor mechanism spreads its influence to other functions beyond motor control, and is recycled to flexibly adapt different human behaviours towards dealing with more abstract concepts.     

Intuitive mapping between nonsymbolic quantity and observed action across development

Adults’ concurrent processing of numerical and action information yields bidirectional interference effects consistent with a cognitive link between these two systems of representation. This link is in place early in life: infants create expectations of congruency across numerical and action-related stimuli (i.e., a small [large] hand aperture associated with a smaller [larger] numerosity). Although these studies point to a developmental continuity of this mapping, little is known about the later development and thus how experience shapes such relationships. We explored how number–action intuitions develop across early and later childhood using the same methodology as in adults. We asked 3-, 6-, and 8-year-old children, as well as adults, to relate the magnitude of an observed action (a static hand shape, open vs. closed, in Experiment 1; a dynamic hand movement, opening vs. closing, in Experiment 2) to either a small or large nonsymbolic quantity (numerosity in Experiment 1 and numerosity and/or object size in Experiment 2). From 6 years of age, children started performing in a systematic congruent way in some conditions, but only 8-year-olds (added in Experiment 2) and adults performed reliably above chance in this task. We provide initial evidence that early intuitions guiding infants’ mapping between magnitude across nonsymbolic number and observed action are used in an explicit way only from late childhood, with a mapping between action and size possibly being the most intuitive. An initial coarse mapping between number and action is likely modulated with extensive experience with grasping and related actions directed to both arrays and individual objects.     

Finger-digit compatibility in Arabic numeral processing

Finger-digit response compatibility was tested by asking participants to identify Arabic digits by pressing 1 of 10 keys with all 10 fingers. The direction of the finger-digit mapping was varied by manipulating the global direction of the hand-digit mapping as well as the direction of the finger-digit mapping within each hand (in each case, from small to large digits, or the reverse). The hypothesis of a left-to-right mental number line predicted that a complete left-to-right mapping should be easier whereas the hypothesis of a representation based on finger counting predicted that a counting-congruent mapping should be easier. The results show that when all 10 fingers are used to answer, a mapping congruent with the prototypical finger-counting strategy reported by the participants leads to better performance than does a mapping congruent with a left-to-right oriented mental number line, both in palm-down and palm-up postures of the hands, and they demonstrate that finger-counting strategies influence the way that numerical information is mentally represented and processed.     

Two routes for the processing of verbal numbers: evidence from the SNARC effect

The functional locus of the semantic system is an important issue in number processing. In the present article, the necessity of addressing a central semantic magnitude system in the processing of printed verbal number words is evaluated by looking at the presence of a spatial-numerical association of response codes or SNARC effect. This effect consists of an association of number magnitude and response-preference (preferred responses to small numbers with the left hand and to large numbers with the right hand) and reflects semantic access. Two experiments were run. In Experiment 1, participants performed a parity judgment task which requires access to number semantics. A SNARC effect was observed. In Experiment 2 a phoneme monitoring task was used, which can, in principle, be performed through direct asemantic transcoding. No SNARC effect occurred. Apparently, written number words access the semantic system only if this is necessary for correct task completion. Hence, a semantic and an asemantic route can be postulated for the processing of word numerals. These observations contrast with the processing of Arabic numerals for which semantic effects are omnipresent. Implications of this explicit demonstration of a dissimilarity between the processing of digits and of number words are discussed. Received: 25 October 2000 / Accepted: 21 May 2001     

数量对时间知觉的影响-来自抽象数量和实际数量的证据

本研究采用抽象数量和实际数量叠加的方式呈现刺激,进一步探讨数量对时间知觉的影响。两个实验都运用时间的系列比较任务,以抽象数量和实际数量这两种数量的一致和不一致为条件,将阿拉伯数字和其字体大小叠加及阿拉伯数字和其呈现个数叠加的方式系列呈现在屏幕中央,要求被试比较判断刺激呈现的时间长短。结果显示被试均依靠实际数量的大小判断时间长短,而似乎忽略了抽象数量的存在。这一结果表明实际数量对时间知觉的影响要比抽象数量大,支持并扩展了数量理论。     

Embodied numerosity: Implicit hand-based representations influence symbolic number processing across cultures

In recent years, a strong functional relationship between finger counting and number processing has been suggested. Developmental studies have shown specific effects of the structure of the individual finger counting system on arithmetic abilities. Moreover, the orientation of the mental quantity representation (“number line”) seems to be influenced by finger counting habits. However, it is unclear whether the structure of finger counting systems still influences symbolic number processing in educated adults.In the present transcultural study, we pursued this question by examining finger-based sub-base-five effects in an Arabic number comparison task with three different groups of participants (German deaf signers, German and Chinese hearing adults). We observed sub-base-five effects in all groups, but particularly so for both German groups who use an explicit sub-base-five system in their finger counting habits. It is concluded that bodily experiences – namely finger counting – influence the structure of the abstract mental number representations even in adults. Thus, the present findings support the general idea that even seemingly abstract cognition may at least partially be rooted in our bodily experiences.     

Understanding the experimenter's intention improves 16-month-olds’ observational learning of the use of a novel tool

Our aim was to investigate why 16-month-old infants fail to master a novel tool-use action via observational learning. We hypothesized that 16-month-olds’ difficulties may be due to not understanding the goal of the observed action. To test this hypothesis, we investigated whether showing infants an explicit demonstration of the goal of the action before demonstrating the action would improve observational learning compared with a classic demonstration of the target action. We examined 16-month-old infants who observed a tool-use action consisting of grasping a rake-like tool to retrieve an out-of-reach toy, under five conditions. Only when infants were shown the goal of the action before demonstration did they show some success.     

Number processing of Arabic and Hebrew bilinguals: Evidence supporting the distance effect

In the current study, a direct assessment of the effect of language lexical‐syntactic structure and magnitude semantic access on numerical processing was made by contrasting the performance of Arabic/Hebrew bilinguals in a digital (Hindi‐digits/Arabic‐digits) and verbal numerical comparison task (Arabic, an inverted language: Units‐Decades, Hebrew, a non‐inverted language: Decades‐Units). Our data revealed in the digital presentation format (Experiment 1) a regular distance effect in Arabic language‐Hindi digits and Hebrew language‐Arabic digits, characterized by an inverse relation between reaction times and numerical distance with no difference in the mean reaction times of participants in Arabic‐L1 and Hebrew‐L2. This indicates that both lexical digits of two‐digit numbers in L1 and L2 are similarly processed and semantically accessed. However in the verbal presentation format (Experiment 2) a similar pattern of distance effect was found, but the mean reaction times in Arabic were lower than in Hebrew in each numerical distance. This indicates that the processing of two‐digit number words in L1 and L2 is semantically accessed and determined by the syntactic structure of each language.     

Numeric comparison in a visually-guided manual reaching task

Nearly all studies on perception and cognition have used discrete responses to infer internal cognitive processes. In the current study, we demonstrate that visually-guided manual reaching can provide new opportunities to access internal processes over time. In each trial, participants were required to compare a single digit Arabic number presented on the center square with the standard, 5. Participants were asked to reach and touch one of three squares on the screen with their index finger while their hand movement trajectories were recorded: the left square for 1-4, the center for 5, and the right for 6-9. Direct evidence for an analogue representation of numbers was found in early as well as in later portions of hand trajectories, showing systematic shifts in position for small differences in numerical magnitude.