Creating number semantics through finger movement perception

Communication, language and conceptual knowledge related to concrete objects may rely on the sensory–motor systems from which they emerge. How abstract concepts can emerge from these systems is however still unknown. Here we report a functional interaction between a specific meaningful finger movement, such as a finger grip closing, and a concept as abstract as numerical magnitude. Participants were presented with Arabic digits to recall before or after they perceived a biological or non-biological hand movement. The results show that perceiving a grip closing slows down the processing of large magnitude numbers. Importantly, we show that this motor-to-semantic interaction differs from the reverse semantic-to-motor interaction, and that it does not result from a general movement amplitude processing as it is only observed for biological hand movements. These results demonstrate the functional link between number meaning and goal-directed finger movements, and show how abstract concept semantics can emerge from the sensory–motor circuits of the brain.     

Creating semantics in tool use

This article presents the first evidence for a functional link between tool use and the processing of abstract symbols like Arabic numbers. Participants were required to perform a tool-use task after the processing of an Arabic number. These numbers represented either a small (2 or 3) or a large magnitude (8 or 9). The tool-use task consisted in using inverse pliers for gripping either a small or a large object. The inverse pliers enable to dissociate the hand action from the tool action in relation to the object (i.e., closing the hand led to an opening of the tool and vice versa). The number/tool hypothesis predicts that the quantity representation associated with Arabic numbers will interact with the action of the tool toward the object. Conversely, the number/hand hypothesis predicts that the quantity associated with numbers will interact with the action of the hand toward the tool. Results confirmed the first hypothesis and rejected the second. Indeed, large numbers interacted with the action of the tool, such that participants were longer to perform an “opening-hand/closing-tool” action after the processing of large numbers. Moreover, no effect was detected for small numbers, confirming previous studies which used only finger movements. Altogether, our finding suggests that the well-known finger/number interaction can be reversed with tool use.     

Implicit motor sequence learning is represented in response locations

Previous work (Willingham, 1999) has indicated that implicit motor sequence learning is not primarily perceptual; that is, what is learned is not a sequence of stimuli. Still other work has indicated that implicit motor sequence learning is not specific to particular muscle groups or effectors. In the present work, we tested whether implicit motor sequence learning would be represented as a sequence of response locations. In Experiment 1, learning showed very poor transfer when the response locations were changed, even though the stimulus positions were unchanged. In Experiment 2, participants switched their hand positions at transfer, so that one group of participants pushed the same sequence of keys but used a different sequence of finger movements to do so, whereas another group pushed a different sequence of keys but used the same sequence of finger movements used at training. Knowledge of the sequence was shown at transfer only if the sequence of response locations was maintained, not the sequence of finger movements.     

Perceptual-center modeling is affected by including acoustic rate-of-change modulations

This study investigated the acoustic correlates of perceptual centers (p-centers) in CV and VC syllables and developed an acoustic p-center model. In Part 1, listeners located syllables’ p-centers by a method-of-adjustment procedure. The CV syllables contained the consonants /?/, /r/, /n /, /t/, /d/, /k/, and /g/; the VCs, the consonants /?/, /r/, and /n/. The vowel in all syllables was /a/. The results of this experiment replicated and extended previous findings regarding the effects of phonetic variation on p-centers. In Part 2, a digital signal processing procedure was used to acoustically model p-center perception. Each stimulus was passed through a six-band digital filter, and the outputs were processed to derive low-frequency modulation components. These components were weighted according to a perceived modulation magnitude function and recombined to create sixpsychoacoustic envelopes containing modulation energies from 3 to 47 Hz. In this analysis, p-centers were found to be highly correlated with the time-weighted function of the rate-of-change in the psychoacoustic envelopes, multiplied by the psychoacoustic envelope magnitude increment. The results were interpreted as suggesting (1) the probable role of low-frequency energy modulations in p-center perception, and (2) the presence of perceptual processes that integrate multiple articulatory events into a single syllabic event.     

Rubbing your stomach while tapping your fingers: interference between motor planning and semantic judgments.

Previous research (Klatzky et al., 1989) shows that the time required to make sensible/nonsensible judgments about an action-object phrase (e.g., "rub your stomach") is reliably faster when the phrase is preceded by a cure representing a specific prototypical hand shape (vs. a neutral cue). The current experiments investigated the effects of preparing for an alternate task (finger tapping vs. syllable vocalization) on facilitatory priming of sensibility judgments. Preparation for finger tapping reduced the magnitude of the priming effect more than preparation for vocalization, suggesting that resources accessed during semantic processing of action-object phrases are also used during manual response preparation. The results support the existence of a system representing manual actions that is limited in the number of activities that can be represented at one time and that is not so general that it represents manual and vocal tract movements.     

Linguistic and perceptual-motor contributions to the kinematic properties of the braille reading finger

Recordings of the dominant finger during the reading of braille sentences by experienced readers reveal that the velocity of the finger changes frequently during the traverse of a line of text. These changes, not previously reported, involve a multitude of accelerations and decelerations, as well as reversals of direction. We investigated the origin of these velocity intermittencies (as well as movement reversals) by asking readers to twice read out-loud or silently sentences comprising high- or low-frequency words which combined to make grammatical sentences that were either meaningful or nonmeaningful. In a control condition we asked braille readers to smoothly scan lines of braille comprised of meaningless cell combinations. Word frequency and re-reading each contribute to the kinematics of finger movements, but neither sentence meaning nor the mode of reading do so. The velocity intermittencies were so pervasive that they are not easily attributable either to linguistic processing, text familiarity, mode of reading, or to sensory-motor interactions with the textured patterns of braille, but seem integral to all braille finger movements except reversals. While language-related processing can affect the finger movements, the effects are superimposed on a highly intermittent velocity profile whose origin appears to lie in the motor control of slow movements.     

Neonatal finger and arm movements as determined by a social and an object context

What kind of hand and finger movements are newborn infants preoccupied with, and how are these movements organized and controlled? These questions were studied in two experiments under three conditions: a social condition, in which the mother (in expt 1) or the experimenter (in expt 2) sat face to face with the infant; an object condition, in which a ball moving slowly and irregularly was presented to the infant; and a baseline condition (in expt 1) without ball or mother present. The size of the ball and the distance to it was chosen so that it approximately corresponded to the visual angle of the head of the model. Twenty-six neonates participated in the study ranging from 2 to 6 days of age at the time of observation. All infants were in an alert, optimal awake state during the experiments. The infants' finger movements were scored from video recordings. The result revealed a large variety of relatively independent finger movements. It was found that finger movements differed both in quantity and quality between the three conditions. There were many more finger movements in the social condition than in the object and baseline conditions. In addition, there were relatively more transitional finger movements and flexions of the hand in the social condition, and relatively more thumb-index finger activity and extensions of the hand in the object condition. Finally, the arms were more often forward extended in the object condition than in the social condition. The results support the notion that neonates show different modes of functioning towards people and objects.     

Stimulus-dependent modulation of perceptual and motor learning in a serial reaction time task

In two experiments, we investigated the impact of spatial attributes on the representation acquired during a serial reaction time task. Two sequences were used, in which structural regularities occurred either in the horizontal or in the vertical locations of successive stimuli. After training with the dominant hand, participants were required to respond with the non-dominant hand to either the original sequence or to a mirror-ordered version of the original sequence that required finger movements homologous to those used during training. We observed that a difference in reaction times between the two transfer conditions was smaller in the vertical sequence than in the horizontal sequence. This pattern of results was independent of whether three fingers (Experiment 1) were used or only one finger (Experiment 2) was used for responding. This result suggests that perceptual and motor learning mechanisms may be weighted differently depending on the context in which the stimulus is presented.     

Larger,smaller, odd or even? Task-specific effects of optokinetic stimulation on the mental number space

Previous studies have shown that number processing can induce spatial biases in perception and action and can trigger the orienting of visuospatial attention. Few studies, however, have investigated how spatial processing and visuospatial attention influences number processing. In the present study, we used the optokinetic stimulation (OKS) technique to trigger eye movements and thus overt orienting of visuospatial attention. Participants were asked to stare at OKS, while performing parity judgements (Experiment 1) or number comparison (Experiment 2), two numerical tasks that differ in terms of demands on magnitude processing. Numerical stimuli were acoustically presented, and participants responded orally. We examined the effects of OKS direction (leftward or rightward) on number processing. The results showed that rightward OKS abolished the classic number size effect (i.e., faster reaction times for small than large numbers) in the comparison task, whereas the parity task was unaffected by OKS direction. The effect of OKS highlights a link between visuospatial orienting and processing of number magnitude that is complementary to the more established link between numerical and visuospatial processing. We suggest that the bidirectional link between numbers and space is embodied in the mechanisms subserving sensorimotor transformations for the control of eye movements and spatial attention.     

Learning and transfer of a relative phase pattern and a joint amplitude ratio in a rhythmic multijoint arm movement

According to the coordination dynamics perspective, one can characterize the learning of novel relative phase patterns as the formation of a stable attractor in the coordination landscape of the order parameter relative phase. The authors examined 18 participants' learning and transfer of a 90 degrees relative phase pattern and a 0.6-joint-amplitude ratio between the elbow and wrist. Variability in the relative phasing and the joint amplitude ratio between the elbow and wrist decreased with practice. Positive transfer of the 90 degrees relative phase pattern was not dependent on the learning arm (dominant or nondominant). Positive transfer of the joint amplitude ratio was dependent on the learning arm and the direction of transfer. The results demonstrated that relative phase is an order parameter that characterizes the coordination dynamics of learning and transferring multijoint arm movements, and they provide preliminary evidence that joint amplitude ratios act as order parameters in the learning and transfer of multijoint arm movements.     

Differential vowel duration associated with children's word-final fricative deletion.

This study assessed whether 3 children, 5 to 6 years old, who deleted word-final fricatives preserve the voicing contrast for those fricatives by producing dif ferential duration of the preceding vowel. The children's CV syllable productions were compared to their CV(C) syllable productions in which the final consonant was intended but actually deleted. Analysis indicated that all 3 children exhibited significantly longer vowel duration, in CV syllables than in CV(C) syllables. This differential duration of the preceding vowel was shown in both isolation and carrier phrase conditions. Of the 3 children 2 preserved the voicing contrast by showing significantly longer vowels preceding voiced consonants as compared to voiceless consonants. One child did this in both isolation and carrier phrase conditions and the other child did this in isolation only. All 3 children manipulated vowel duration to signify the linguis tic contrast, therefore these findings support a linguistic perspective of speech development which focuses on the acquisition and knowledge of the linguistic rules of the language. In addition, the large amount of variability in vowel duration for CV and CV(C) syllables and the marked variability in performance across children support a biological view of a developing vocal tract undergoing structural and physiological changes.     

Transfer of movement sequences: bigger is better

Experiment 1 was conducted to determine if proportional transfer from "small to large" scale movements is as effective as transferring from "large to small." We hypothesize that the learning of larger scale movement will require the participant to learn to manage the generation, storage, and dissipation of forces better than when practicing smaller scale movements. Thus, we predict an advantage for transfer of larger scale movements to smaller scale movements relative to transfer from smaller to larger scale movements. Experiment 2 was conducted to determine if adding a load to a smaller scale movement would enhance later transfer to a larger scale movement sequence. It was hypothesized that the added load would require the participants to consider the dynamics of the movement to a greater extent than without the load. The results replicated earlier findings of effective transfer from large to small movements, but consistent with our hypothesis, transfer was less effective from small to large (Experiment 1). However, when a load was added during acquisition transfer from small to large was enhanced even though the load was removed during the transfer test. These results are consistent with the notion that the transfer asymmetry noted in Experiment 1 was due to factors related to movement dynamics that were enhanced during practice of the larger scale movement sequence, but not during the practice of the smaller scale movement sequence. The findings that the movement structure is unaffected by transfer direction but the movement dynamics are influenced by transfer direction is consistent with hierarchal models of sequence production.     

How motor practice shapes memory: retrieval but not extra study can cause forgetting

We investigated the retrieval specificity of retrieval-induced forgetting (RIF) of motor sequences. In two experiments, participants learned sequential finger movements, each consisting of the movement of two fingers of either the left or the right hand. In the learning phase, these motor sequences were graphically presented and were to be learned as responses to simultaneously presented letter stimuli. Subsequently, participants selectively practiced half the items of one hand. A final recall test then assessed memory for all initially learned items. We contrasted different kinds of selective practice with each other. Whereas retrieval practice required retrieving motor sequences in response to letter stimuli from the learning phase, extra study was an extension of the learning phase, that is, participants performed motor sequences in response to the same animation graphic display as in the learning phase again accompanied by the letter stimulus. All practice conditions strengthened the practiced items, but only retrieval practice resulted in RIF. Thus, the strengthening of items through practice did not suffice to induce forgetting of related motor sequences. Retrieval was a necessary component for practice to shape memory for body movements by impairing the subsequent recall of motor sequences that were related to the practiced motor sequences.     

Large individual differences in minor ear output during dichotic listening

Using dichotic consonant-vowel (CV) stimuli, 150 highly educated adults were segregated into two groups. In the high-output group (n = 63), the mean number of CV syllables reported by the minor ear was more than half that of the major ear, while for the low-output group (n = 87), it was less than one-fourth. The low minor ear performance of the latter group immediately disappeared when CV syllables were separated by 90 ms. These subjects (44 male, 43 females) were unaware of their temporary minor ear incapacities. Although the mechanism and brain laterality significance of this phenomenon remain to be clarified, preliminary research indicates that members of each of these two groups have other differences in common.     

Speech and nonspeech sequence skill learning in adults who stutter

Two studies compared the speech and nonspeech sequence skill learning of nine persons who stutter (PWS) and nine matched fluent speakers (PNS). Sequence skill learning was defined as a continuing process of stable improvement in speed and/or accuracy of sequencing performance over practice and was measured by comparing PWS's and PNS's performance curves of accuracy, reaction time, and sequence duration, as well as retention and transfer. In experiment one, participants completed a 30-trial finger tapping sequence and in experiment two, a 30-trial read-aloud sequence of nonsense syllables. Significant between-group differences were found in the speed of sequencing performance after practice, and on retention and transfer tests. These results partially supported the inference that PWS demonstrated differences in early stages of sequence skill learning compared to PNS. EDUCATIONAL OBJECTIVES: As a result of this activity the participant will be able to: (1) define skill learning and the important indicators of skill learning; (2) summarize the reviewed literature concerning the performance of PWS on speech and nonspeech sequencing tasks over practice; and (3) explain the implication of reaction time differences over practice between PWS and PNS.     

不同手指表征方式对数量表征能力的影响

采用距离启动范式,考察中国文化背景下不同手指表征方式对数量表征能力的影响。实验首先验证单手表征中不同手指数量表征方式对小数字（1～5）认知表征的影响;实验2则进一步采用中国人特有的单手手指表征,考察其对大数字（5～9）认知表征的影响。结果表明,小数字中出现了标准手指表征方式语义层面的位置编码、非标准手指表征方式知觉层面总和编码的激活;但大数字中两种手指表征方式均出现了语义层面位置编码的激活。此结果与计算模型理论一致,说明当手指数量从少到多变化时,标准手指表征方式为语义性的符号数量表征;而非标准手指表征方式由知觉性的非符号向语义性符号数量表征过渡。     

Aspects of the syntax of behavior: Syllable structure and speech rate

This paper shows that maximal rate of speech varies as a function of syllable structure. For example, CCV syllables such as [sku] and CVC syllables such as [kus] are produced faster than VCC syllables such as [usk] when subjects repeat these syllables as fast as possible. Spectrographic analyses indicated that this difference in syllable duration was not confined to any one portion of the syllables: the vowel, the consonants and even the interval between syllable repetitions was longer for VCC syllables than for CVC and CCV syllables. These and other findings could not be explained in terms of word frequency, transition frequency of adjacent phonemes, or coarticulation between segments. Moreover, number of phonemes was a poor predictor of maximal rate for a wide variety of syllable structures, since VCC structures such as [ulk] were produced slower than phonemically longer CCCV structures such as [sklu], and V structures such as [a] were produced no faster than phonemically longer CV structures such as [ga]. These findings could not be explained by traditional models of speech production or articulatory difficulty but supported a complexity metric derived from a recently proposed theory of the serial production of syllables. This theory was also shown to be consistent with the special status of CV syllables suggested by Jakobson as well as certain aspects of speech errors, tongue-twisters and word games such as Double Dutch.     

Attentional engagement during syllable discrimination: The role of salient prosodic cues in 6- to 8-month-old infants

Prosodic cues drive speech segmentation and guide syllable discrimination. However, less is known about the attentional mechanisms underlying an infant's ability to benefit from prosodic cues. This study investigated how 6- to 8-month-old Italian infants allocate their attention to strong vs. weak syllables after familiarization with four repeats of a single CV sequence with alternating strong and weak syllables (different syllables on each trial). In the discrimination test-phase, either the strong or the weak syllable was replaced by a pure tone matching the suprasegmental characteristics of the segmental syllable, i.e., duration, loudness and pitch, whereas the familiarized stimulus was presented as a control. By using an eye-tracker, attention deployment (fixation times) and cognitive resource allocation (pupil dilation) were measured under conditions of high and low saliency that corresponded to the strong and weak syllabic changes, respectively. Italian learning infants were found to look longer and also to show, through pupil dilation, more attention to changes in strong syllable replacement rather than weak syllable replacement, compared to the control condition. These data offer insights into the strategies used by infants to deploy their attention towards segmental units guided by salient prosodic cues, like the stress pattern of syllables, during speech segmentation.     

Finger posing primes number comprehension

Canonical finger postures, as used in counting, activate number knowledge, but the exact mechanism for this priming effect is unclear. Here we dissociated effects of visual versus motor priming of number concepts. In Experiment 1, participants were exposed either to pictures of canonical finger postures (visual priming) or actively produced the same finger postures (motor priming) and then used foot responses to rapidly classify auditory numbers (targets) as smaller or larger than 5. Classification times revealed that manually adopted but not visually perceived postures primed magnitude classifications. Experiment 2 obtained motor priming of number processing through finger postures also with vocal responses. Priming only occurred through canonical and not through non-canonical finger postures. Together, these results provide clear evidence for motor priming of number knowledge. Relative contributions of vision and action for embodied numerical cognition and the importance of canonicity of postures are discussed.     

Is an attention-based associative account of adjacent and nonadjacent dependency learning valid?

Pacton and Perruchet (2008) reported that participants who were asked to process adjacent elements located within a sequence of digits learned adjacent dependencies but did not learn nonadjacent dependencies and conversely, participants who were asked to process nonadjacent digits learned nonadjacent dependencies but did not learn adjacent dependencies. In the present study, we showed that when participants were simply asked to read aloud the same sequences of digits, a task demand that did not require the intentional processing of specific elements as in standard statistical learning tasks, only adjacent dependencies were learned. The very same pattern was observed when digits were replaced by syllables. These results show that the perfect symmetry found in Pacton and Perruchet was not due to the fact that the processing of digits is less sensitive to their distance than the processing of syllables, tones, or visual shapes used in most statistical learning tasks. Moreover, the present results, completed with a reanalysis of the data collected in Pacton and Perruchet (2008), demonstrate that participants are highly sensitive to violations involving the spacing between paired elements. Overall, these results are consistent with the Pacton and Perruchet's single-process account of adjacent and nonadjacent dependencies, in which the joint attentional processing of the two events is a necessary and sufficient condition for learning the relation between them, irrespective of their distance. However, this account should be completed to encompass the notion that the presence or absence of an intermediate event is an intrinsic component of the representation of an association.