Effects of utterance length on lip kinematics in aphasia

Most existing models of language production and speech motor control do not explicitly address how language requirements affect speech motor functions, as these domains are usually treated as separate and independent from one another. This investigation compared lip movements during bilabial closure between five individuals with mild aphasia and five age and gender-matched control speakers when the linguistic characteristics of the stimuli were varied by increasing the number of syllables. Upper and lower lip movement data were collected for mono-, bi- and tri-syllabic nonword sequences using an AG 100 EMMA system. Each task was performed under both normal and fast rate conditions. Single articulator kinematic parameters (peak velocity, amplitude, duration, and cyclic spatio-temporal index) were measured to characterize lip movements. Results revealed that compared to control speakers, individuals with aphasia showed significantly longer movement duration and lower movement stability for longer items (bi- and tri-syllables). Moreover, utterance length affected the lip kinematics, in that the monosyllables had smaller peak velocities, smaller amplitudes and shorter durations compared to bi- and trisyllables, and movement stability was lowest for the trisyllables. In addition, the rate-induced changes (smaller amplitude and shorter duration with increased rate) were most prominent for the short items (i.e., monosyllables). These findings provide further support for the notion that linguistic changes have an impact on the characteristics of speech movements, and that individuals with aphasia are more affected by such changes than control speakers.     

An acquired deficit of audiovisual speech processing

We report a 53-year-old patient (AWF) who has an acquired deficit of audiovisual speech integration, characterized by a perceived temporal mismatch between speech sounds and the sight of moving lips. AWF was less accurate on an auditory digit span task with vision of a speaker's face as compared to a condition in which no visual information from the lower face was available. He was slower in matching words to pictures when he saw congruent lip movements compared to no lip movements or non-speech lip movements. Unlike normal controls, he showed no McGurk effect. We propose that multisensory binding of audiovisual language cues can be selectively disrupted.     

Reflex responses of human lip muscles to mechanical stimulation during speech

The role played by reflex pathways in the production of movement has been a significant issue for motor control theorists interested in a wide variety of motor behaviors. From studies of locomotion and chewing, it appears that gains in reflex pathways can be altered so that activity in these pathways does not produce destabilizing responses during movement. In speech production, recent experimental evidence has been interpreted to suggest that autogenetic lip reflexes (perioral reflexes) are suppressed during sustained phonation or speech production. The present study was conducted to assess the effects of phonation, direction of movement, and ongoing speech production on reflex responses of lip muscles. The present results suggest, in contrast to earlier work, that this reflex pathway is not suppressed or absent because the amplitude of the observed response depends upon the activation levels of the various muscles of the lower lip and, therefore, indirectly on the nature of the gesture the subject is instructed to produce.     

Reflex Responses of Human Lip Muscles to Mechanical Stimulation During Speech

The role played by reflex pathways in the production of movement has been a significant issue for motor control theorists interested in a wide variety of motor behaviors. From studies of locomotion and chewing, it appears that gains in reflex pathways can be altered so that activity in these pathways does not produce destabilizing responses during movement. In speech production, recent experimental evidence has been interpreted to suggest that autogenetic lip reflexes (perioral reflexes) are suppressed during sustained phonation or speech production. The present study was conducted to assess the effects of phonation, direction of movement, and ongoing speech production on reflex responses of lip muscles. The present results suggest, in contrast to earlier work, that this reflex pathway is not suppressed during phonation or speech. However, the response may appear to be suppressed or absent because the amplitude of the observed response depends upon the activation levels of the various muscles of the lower lip and, therefore, indirectly on the nature of the gesture the subject is instructed to produce.     

言语与手部运动关系的研究回顾

言语与手部运动之间存在复杂的联系。该文总结了两类手部运动（伴随言语发生的手势运动和抓握运动）与言语之间关系的行为和脑科学研究成果。发现：（1）伴随言语产生的意义手势可促进言语加工,特别是词汇的提取过程;（2）观察手的抓握运动影响言语产生时唇的运动和声音成分;（3）对词语的知觉影响抓握运动的早期计划阶段;（4）言语产生可增加手运动皮层的兴奋性。作者由此认为,言语加工与手势间的联系不仅表现为神经通路的重叠和相互激活,而且可能在外显行为上也相互影响     

The impact of threat and cognitive stress on speech motor control in people who stutter

PurposeIn the present study, an Emotional Stroop and Classical Stroop task were used to separate the effect of threat content and cognitive stress from the phonetic features of words on motor preparation and execution processes.MethodA group of 10 people who stutter (PWS) and 10 matched people who do not stutter (PNS) repeated colour names for threat content words and neutral words, as well as for traditional Stroop stimuli. Data collection included speech acoustics and movement data from upper lip and lower lip using 3D EMA.ResultsPWS in both tasks were slower to respond and showed smaller upper lip movement ranges than PNS. For the Emotional Stroop task only, PWS were found to show larger inter-lip phase differences compared to PNS. General threat words were executed with faster lower lip movements (larger range and shorter duration) in both groups, but only PWS showed a change in upper lip movements. For stutter specific threat words, both groups showed a more variable lip coordination pattern, but only PWS showed a delay in reaction time compared to neutral words. Individual stuttered words showed no effects. Both groups showed a classical Stroop interference effect in reaction time but no changes in motor variables.ConclusionThis study shows differential motor responses in PWS compared to controls for specific threat words. Cognitive stress was not found to affect stuttering individuals differently than controls or that its impact spreads to motor execution processes.Educational objectives: After reading this article, the reader will be able to: (1) discuss the importance of understanding how threat content influences speech motor control in people who stutter and non-stuttering speakers; (2) discuss the need to use tasks like the Emotional Stroop and Regular Stroop to separate phonetic (word-bound) based impact on fluency from other factors in people who stutter; and (3) describe the role of anxiety and cognitive stress on speech motor processes.     

The relation between oral movement control and speech

A large series of neurological patients, selected solely on the basis that they had damage restricted to one hemisphere of the brain, was given a variety of tests of basic speech and praxic function. Within the left-damaged group, patients were further identified as aphasic or nonaphasic, based on preexisting standard tests of aphasia. Subgroups of aphasics were studied on the basis of lesion location, rather than on the basis of aphasia type. The focus of the study was the relation between the production of speech and nonspeech oral movements, particularly across anterior and posterior lesions. Reproduction of single nonverbal oral movements and of single isolated speech sounds was found to be very highly correlated, and both depended selectively on the left anterior region of the brain. This same region was critically important for rapid repeated articulation of a syllable, suggesting that it mediates control at some "unit" level of movement, in a phenomenological sense, for both speech and nonspeech movements. Other "speech" regions in the left hemisphere appeared to be dispensable for the production of single oral movements, whether these were verbal or nonverbal movements. However, for most aphasic patients, an area in the left posterior region was inferred to be essential for production of multiple oral movements, whether nonverbal or verbal, suggesting a critical role in the accurate selection of movements. Within the posterior region, there was further differentiation for multisyllabic speech into a parietal system, which appeared to mediate primarily praxic function, and a temporal system, which appeared to mediate verbal-echolalic function. Aphasias from anterior and posterior lesions resembled "Broca's" and "Wernicke's" aphasia only insofar as they differed in fluency, with anterior aphasics clearly less fluent. Tests of speech comprehension did not differentiate the groups. It is suggested that classifying aphasic patients via lesion location rather than aphasic typology might yield a view of functional subsystems different from those commonly accepted.     

Multitimescale dynamical interactions between speech rhythm and gesture

Temporal patterns in human movement, and in speech in particular, occur on multiple timescales. Regularities in such patterns have been observed between speech gestures, which are relatively quick movements of articulators (e.g., tongue fronting and lip protrusion), and also between rhythmic units (e.g., syllables and metrical feet), which occur more slowly. Previous work has shown that patterns in both domains can be usefully modeled with oscillatory dynamical systems. To investigate how rhythmic and gestural domains interact, an experiment was conducted in which speakers performed a phrase repetition task, and gestural kinematics were recorded using electromagnetic articulometry. Variance in relative timing of gestural movements was correlated with variance in rhythmic timing, indicating that gestural and rhythmic systems interact in the process of planning and producing speech. A model of rhythmic and gestural planning oscillators with multifrequency coupling is presented, which can simulate the observed covariability between rhythmic and gestural timing.     

Gesture in the developing brain

Speakers convey meaning not only through words, but also through gestures. Although children are exposed to co-speech gestures from birth, we do not know how the developing brain comes to connect meaning conveyed in gesture with speech. We used functional magnetic resonance imaging (fMRI) to address this question and scanned 8- to 11-year-old children and adults listening to stories accompanied by hand movements, either meaningful co-speech gestures or meaningless self-adaptors. When listening to stories accompanied by both types of hand movement, both children and adults recruited inferior frontal, inferior parietal, and posterior temporal brain regions known to be involved in processing language not accompanied by hand movements. There were, however, age-related differences in activity in posterior superior temporal sulcus (STSp), inferior frontal gyrus, pars triangularis (IFGTr), and posterior middle temporal gyrus (MTGp) regions previously implicated in processing gesture. Both children and adults showed sensitivity to the meaning of hand movements in IFGTr and MTGp, but in different ways. Finally, we found that hand movement meaning modulates interactions between STSp and other posterior temporal and inferior parietal regions for adults, but not for children. These results shed light on the developing neural substrate for understanding meaning contributed by co-speech gesture.     

Developmental features of rapid aiming arm movements across the lifespan

Using a lifespan approach, the authors investigated developmental features of the control of ballistic aiming arm movements by manipulating movement complexity, response uncertainty, and the use of precues. Four different age groups of participants (6- and 9-year-old boys and girls and 24- and 73-year-old men and women, 20 participants in each age group) performed 7 types of rapid aiming arm movements on the surface of a digitizer. Their movement characteristics such as movement velocity, normalized jerk, relative timing, movement linearity, and intersegment intervals were profiled. Analyses of variance with repeated measures were conducted on age and task effects in varying movement complexity (Study 1), response uncertainty (Study 2), and precue use (Study 3) conditions. Young children and senior adults had slower, more variant, less smooth, and less linear arm movements than older children and young adults. Increasing the number of movement segments resulted in slower and more variant responses. Movement accuracy demands or response uncertainty interacted with age so that the 6- and 74-year-old participants had poorer performances but responded similarly to the varying treatments. Even though older children and young adults had better performances than young children and senior adults, their arm movement performance declined when response uncertainty increased. The analyses suggested that young children's and senior adults' performances are poorer because less of their movement is under central control, and they therefore use on-line adjustments. In addition, older children and young adults use a valid precue more effectively to prepare for subsequent movements than do young children and senior adults, suggesting that older children and young adults are more capable of organizing motor responses than are young children and senior adults.     

Movement adaptations in 7- to 10-year-old typically developing children: evidence for a transition in feedback-based motor control

We used a modified double-step pointing task to study movement adaptations in 7- to 10-year-old typically developing children. We found that the majority (63%) were able to optimally adapt fast, goal-directed visually-guided movements to a late change in target location meeting the requirements of speed and accuracy. A minority (35%) failed to meet the requirement of accuracy resulting in a less optimal adaptation. The results showed that the ability to adapt movements optimally develops before the age of 7 years in typically developing children. Literature proposes a transition in development of motor control around the age of 8 years. The present results replicate and extend this by suggesting that this transition affects the later phases of fast, goal-directed visually-guided movements rather than the early phases, such as movement programming and acceleration. Finally, the results indicate that the optimally adapted movements were the result of a specific strategy in which a specific component of movement execution was slowed on all trials. This suggests that 7- to 10-year-old typically developing children have developed implicit knowledge about which movement components are the most efficient to adapt.     

An Analysis of Speech Disfluencies of Turkish Speakers Based on Age Variable

The focus of this research is to verify the influence of the age variable on fluent Turkish native speakers’ production of the various types of speech disfluencies. To accomplish this, four groups of native speakers of Turkish between ages 4–8, 18–23, 33–50 years respectively and those over 50-year-olds were constructed. A total of 84 participants took part in this study. Prepared and unprepared speech samples of at least 300 words were collected from each participant via face-to-face interviews that were tape recorded and transcribed; for practical reasons, only the unprepared speech samples were collected from children. As a result, for the prepared speech situation, there was no statistically significant difference in terms of age in the production rates of filled gaps, false starts, slips of the tongue and repetitions; however, participants in the over 50-year-old group produced more hesitations and prolongations than participants in the 18–23 and 33–50-year-old groups. For the unprepared speech situation, age variable was not effective on the production rates of filled gaps. However, 4–8 and over 50-year-old participants produced more hesitations and prolongations than the 18–23 and 33–50-year-old groups. 4–8-year-old children produced more slips of the tongue than the 18–23 and 33–50-year-old groups, and more false starts and repetitions than the participants in the other three age groups (18–23, 33–50, over 50). Further analyses revealed more extensive insights related to the types of disfluencies, the position of disfluencies, and the linguistic units involved in disfluency production in Turkish speech.     

Interactions of speech and manual movement in a syncopated task

The present study examined interactions of speech production and finger-tapping movement, using a syncopated motor task with two movements in 10 male right-handed undergraduate students (M age = 21.0 yr.; SD = 1.4). On the syncopated task, participants were required to produce one movement exactly midway between two other movements (target interresponse interval: 250 msec.). They were divided into two groups, the tap-preceding group and speech-preceding group. The author observed that the right hand showed a more variable peak force and intertap interval than the left hand in the speech-preceding group, indicating an asymmetrical interference of two movements. On the other hand, the mean differences between onsets of speech and tapping movement were shorter than 250 msec. over all conditions (the shortest mean difference was 50 msec.), suggesting a mutual entrainment of two movements. An asymmetry of entrainment was observed in the speech-preceding group, in which speech production was more strongly entrained with movements of the right hand than with those of the left hand.     

Neural modeling and imaging of the cortical interactions underlying syllable production

This paper describes a neural model of speech acquisition and production that accounts for a wide range of acoustic, kinematic, and neuroimaging data concerning the control of speech movements. The model is a neural network whose components correspond to regions of the cerebral cortex and cerebellum, including premotor, motor, auditory, and somatosensory cortical areas. Computer simulations of the model verify its ability to account for compensation to lip and jaw perturbations during speech. Specific anatomical locations of the model's components are estimated, and these estimates are used to simulate fMRI experiments of simple syllable production.     

Lip reading in infants: Attention to speech presented in- and out-of-synchrony

Twelve 10- to 16-week-old infants were presented with nursery rhymes spoken with speech sounds and lip movements in-synchrony and out-of-synchrony by 400 msec. Two observers measured the amount of time the infants did not attend to the two types of stimuli. The results showed that the infants attended significantly less to the out-of-synchrony presentation than to the in-synchrony presentation. This finding was interpreted as an indication that young infants are aware of the congruence between lip movements and speech sounds.     

Hearing by eye

Recent work on integration of auditory and visual information during speech perception has indicated that adults are surprisingly good at, and rely extensively on, lip reading. The conceptual status of lip read information is of interest: such information is at the same time both visual and phonological. Three experiments investigated the nature of short term coding of lip read information in hearing subjects. The first experiment used asynchronous visual and auditory information and showed that a subject's ability to repeat words, when heard speech lagged lip movements, was unaffected by the lag duration, both quantitatively and qualitatively. This suggests that lip read information is immediately recoded into a durable code. An experiment on serial recall of lip read items showed a serial position curve containing a recency effect (characteristic of auditory but not visual input). It was then shown that an auditory suffix diminishes the recency effect obtained with lip read stimuli. These results are consistent with the hypothesis that seen speech, that is not heard, is encoded into a durable code which has some shared properties with heard speech. The results of the serial recall experiments are inconsistent with interpretations of the recency and suffix effects in terms of precategorical acoustic storage, for they demonstrate that recency and suffix effects can be supra-modal.     

A simple procedure for accurately manipulating face-voice synchrony when dubbing speech onto videotape

A system is described involving an audio-video tape recorder, a control device, and a delay timer that dubs speech sounds onto prerecorded lip movements on videotape. Accuracy of synchrony or measured asynchrony between the sound and lip movements is a few milliseconds.     

The somatotopy of speech: Phonation and articulation in the human motor cortex

A sizable literature on the neuroimaging of speech production has reliably shown activations in the orofacial region of the primary motor cortex. These activations have invariably been interpreted as reflecting “mouth” functioning and thus articulation. We used functional magnetic resonance imaging to compare an overt speech task with tongue movement, lip movement, and vowel phonation. The results showed that the strongest motor activation for speech was the somatotopic larynx area of the motor cortex, thus reflecting the significant contribution of phonation to speech production. In order to analyze further the phonatory component of speech, we performed a voxel-based meta-analysis of neuroimaging studies of syllable-singing (11 studies) and compared the results with a previously-published meta-analysis of oral reading (11 studies), showing again a strong overlap in the larynx motor area. Overall, these findings highlight the under-recognized presence of phonation in imaging studies of speech production, and support the role of the larynx motor cortex in mediating the “melodicity” of speech.     

Oral Motor Abilities Are Task Dependent: A Factor Analytic Approach to Performance Rate

Measures of performance rates in speech-like or volitional nonspeech oral motor tasks are frequently used to draw inferences about articulation rate abnormalities in patients with neurologic movement disorders. The study objective was to investigate the structural relationship between rate measures of speech and of oral motor behaviors different from speech. A total of 130 patients with neurologic movement disorders and 130 healthy subjects participated in the study. Rate data was collected for oral reading (speech), rapid syllable repetition (speech-like), and rapid single articulator movements (nonspeech). The authors used factor analysis to determine whether the different rate variables reflect the same or distinct constructs. The behavioral data were most appropriately captured by a measurement model in which the different task types loaded onto separate latent variables. The data on oral motor performance rates show that speech tasks and oral motor tasks such as rapid syllable repetition or repetitive single articulator movements measure separate traits.     

Developmental Features of Rapid Aiming Arm Movements Across the Lifespan

Using a lifespan approach, the authors investigated developmental features of the control of ballistic aiming arm movements by manipulating movement complexity, response uncertainty, and the use of precues. Four different age groups of participants (6- and 9-year-old boys and girls and 24- and 73-year- old men and women, 20 participants in each age group) performed 7 types of rapid aiming arm movements on the surface of a digitizer. Their movement characteristics such as movement velocity, normalized jerk, relative timing, movement linearity, and intersegment intervals were profiled. Analyses of variance with repeated measures were conducted on age and task effects in varying movement complexity (Study 1), response uncertainty (Study 2), and precue use (Study 3) conditions. Young children and senior adults had slower, more variant, less smooth, and less linear arm movements than older children and young adults. Increasing the number of movement segments resulted in slower and more variant responses. Movement accuracy demands or response uncertainty interacted with age so that the 6- and 74-year-old participants had poorer performances but responded similarly to the varying treatments. Even though older children and young adults had better performances than young children and senior adults, their arm movement performance declined when response uncertainty increased. The analyses suggested that young children's and senior adults' performances are poorer because less of their movement is under central control, and they therefore use on-line adjustments. In addition, older children and young adults use a valid precue more effectively to prepare for subsequent movements than do young children and senior adults, suggesting that older children and young adults are more capable of organizing motor responses than arc young children and senior adults.