Phonotactic probability influences speech production

Speakers are faster and more accurate at processing certain sound sequences within their language. Does this reflect the fact that these sequences are frequent or that they are phonetically less complex (e.g., easier to articulate)? It has been difficult to contrast these two factors given their high correlation in natural languages. In this study, participants were exposed to novel phonotactic constraints de-correlating complexity and frequency by subjecting the same phonological structure to varying degrees of probabilistic constraint. Participants' behavior was sensitive to variations in frequency, demonstrating that phonotactic probability influences speech production independent of phonetic complexity.     

Network structure influences speech production

Network science provides a new way to look at old questions in cognitive science by examining the structure of a complex system, and how that structure might influence processing. In the context of psycholinguistics, clustering coefficient-a common measure in network science-refers to the extent to which phonological neighbors of a target word are also neighbors of each other. The influence of the clustering coefficient on spoken word production was examined in a corpus of speech errors and a picture-naming task. Speech errors tended to occur in words with many interconnected neighbors (i.e., higher clustering coefficient). Also, pictures representing words with many interconnected neighbors (i.e., high clustering coefficient) were named more slowly than pictures representing words with few interconnected neighbors (i.e., low clustering coefficient). These findings suggest that the structure of the lexicon influences the process of lexical access during spoken word production.     

Prenatal maternal speech influences newborns' perception of speech sounds

Pregnant women recited a particular speech passage aloud each day during their last 6 weeks of pregnancy. Their newborns were tested with an operant-choice procedure to determine whether the sounds of the recited passage were more reinforcing than the sounds of a novel passage. The previously recited passage was more reinforcing. The reinforcing value of the two passages did not differ for a matched group of control subjects. Thus, third-trimester fetuses experience their mothers' speech sounds and that prenatal auditory experience can influence postnatal auditory preferences.     

Visual influences on interactive speech alignment

Speech alignment describes the unconscious tendency to produce speech that shares characteristics with perceived speech (eg Goldinger, 1998 Psychological Review 105 251-279). In the present study we evaluated whether seeing a talker enhances alignment over just hearing a talker. Pairs of participants performed an interactive search task which required them to repeatedly utter a series of keywords. Half of the pairs performed the task while hearing each other, while the other half could see and hear each other. Alignment was assessed by naive judges rating the similarity of interlocutors' keywords recorded before, during, and after the interactive task. Results showed that interlocutors aligned more when able to see one another suggesting that visual information enhances speech alignment.     

Lexical influences in audiovisual speech perception

Phoneme identification with audiovisually discrepant stimuli is influenced hy information in the visual signal (the McGurk effect). Additionally, lexical status affects identification of auditorily presented phonemes. The present study tested for lexical influences on the McGurk effect. Participants identified phonemes in audiovisually discrepant stimuli in which lexical status of the auditory component and of a visually influenced percept was independently varied. Visually influenced (McGurk) responses were more frequent when they formed a word and when the auditory signal was a nonword (Experiment 1). Lexical effects were larger for slow than for fast responses (Experiment 2), as with auditory speech, and were replicated with stimuli matched on physical properties (Experiment 3). These results are consistent with models in which lexical processing of speech is modality independent.     

Visual influences on speech perception processes

An experiment is reported, the results of which confirm and extend an earlier observation that visual information for the speaker’s lip movements profoundly modifies the auditorv perception of natural speech by normally hearing subjects. The effect is most pronounced when there is auditory information for a bilabial utterance combined with visual information for a nonlabial utterance. However, the effect is also obtained with the reverse combination, although to a lesser extent. These findings are considered for their relevance to auditory theories of speech perception.     

Cognitive influences on cross-language speech perception in infancy

Previous research has shown that young infants can discriminate both native and nonnative phonetic contrasts with ease. By 10 to 12 months of age, however, infants—like adults—typically have difficulty discriminating consonant contrasts that are not used to distinguish meaning in their native language. Although the timing of this change in speech perception has been firmly established, little is currently known about the processes or mechanisms involved in this selective and adaptive reorganization in nonnative phonetic discrimination. This study was designed to determine if there is a relation between age-related changes in speech perception performance and other developing cognitive abilities. A total of 40 8- to 10-month-old infants were tested on a nonnative consonant discrimination task and then on two additional tasks (a visual categorization task and an object search task) in an attempt to determine whether changes in nonnative consonant perception coincide with changes in these other areas of cognitive/perceptual functioning. The results indicate that changes in task performance occur in synchrony across all three tasks, and that this synchrony is not explained by simple age effects. These findings suggest that domain-general cognitive/perceptual competencies may influence developmental changes in speech perception by the end of the 1st year of life.     

Orthography influences the perception and production of speech

One intriguing question in language research concerns the extent to which orthographic information impacts on spoken word processing. Previous research has faced a number of methodological difficulties and has not reached a definitive conclusion. Our research addresses these difficulties by capitalizing on recent developments in the area of word learning. Participants were trained to criterion on a set of associations between novel pictures and novel spoken words. Spelling-sound consistent or spelling-sound inconsistent spellings were introduced on the 2nd day, and the influence of these spellings on speech processing was assessed on the 3rd day. Results showed significant orthographic effects on speech perception and speech production in a situation in which spelling-sound consistency was manipulated with perfect experimental control. Results are discussed in terms of a highly interactive language system in which there is a rapid and automatic flow of activation in both directions between orthographic and phonological representations.     

Attention modulates somatosensory influences in passive speech listening

Previous studies showed that manipulating the speech production system influenced speech perception. This influence was mediated by task difficulty, listening conditions, and attention. In the present study we investigated the specificity of a somatosensory manipulation – a spoon over the tongue – in passive listening. We measured the mismatch negativity (MMN) while participants listened to vowels that differ in their articulation – the tongue height – and familiarity – native and unknown vowels. The same participants heard the vowels in a spoon and no-spoon block. The order of the blocks was counterbalanced across participants. Results showed no effect of the spoon. Instead, starting with the spoon enhanced the MMN amplitude. A second experiment showed the same MMN enhancement for starting with a somatosensory manipulation applied to a non-articulator – the hand. This result suggests that starting a study with a somatosensory manipulation raises attention to the task.     

The role of person and object in eliciting early imitation

The role of person and object in eliciting early imitation was examined in this study. Twenty-seven infants, between 5 and 8 weeks old were assigned randomly to two conditions. In the person condition (N = 12) they were presented with tongue protrusions and mouth openings modeled by an adult, whereas in the object condition (N = 15) they were presented with these gestures simulated by two objects. Two infant behaviors were coded; mouth openings and tongue protrusions. Infants in the person condition selectively reproduced the mouth open and tongue protrusion gestures at significant levels, infants in the object condition did not. Instead of reproducing the congruent gestures (mouth openings and tongue protrusions when they were modeled) infants in the object condition reproduced the incongruent gestures at significant levels. Together, the findings indicate that imitation is a social response, which has implications for the development of nonverbal communication and speech.     

Conversational coherency

A major goal of this work is to specify some steps of the process by which participants maintain coherency in their conversations. The underlying element of the analysis is a construct called a “context space.” Roughly, a group of utterances that refers to a single issue or episode forms the basis for a context space. Superficially, a conversation is a sequence of utterances; at a deeper level it is a structured entity whose utterances can be parsed into hierarchically related context spaces. As a conversation proceeds, each conversant builds a discourse model that includes the conversation's context space structure, a notion of the present discourse topic, and a list of items being focused upon. Conversational coherency depends upon a lack of conflict between the respective models of the participants. Conflicts are prevented by speakers following high level syntactic and semantic relational rules that enable listeners to identify their discourse models. These rules, given in the study, are highly integrated with the view of conversation presented here—a hierarchy of related context spaces.     

Cascading influences on the production of speech: evidence from articulation

Recent investigations have supported the suggestion that phonological speech errors may reflect the simultaneous activation of more than one phonemic representation. This presents a challenge for speech error evidence which is based on the assumption of well-formedness, because we may continue to perceive well-formed errors, even when they are not produced. To address this issue, we present two tongue-twister experiments in which the articulation of onset consonants is quantified and compared to baseline measures from cases where there is no phonemic competition. We report three measure of articulatory variability: changes in tongue-to-palate contact using electropalatography (EPG, Experiment 1), changes in midsagittal spline of the tongue using ultrasound (Experiment 2), and acoustic changes manifested as voice-onset time (VOT). These three sources provide converging evidence that articulatory variability increases when competing onsets differ by one phonological feature, but the increase is attenuated when onsets differ by two features. This finding provides clear evidence, based solely on production, that the articulation of phonemes is influenced by cascading activation from the speech plan.     

从动作模仿到社会认知：自我-他人控制的作用

在社会互动中, 人们具有自动模仿他人动作的倾向。尽管这种自动模仿有利于个体理解他人动作的感受, 但有时也会与自身的动作意图产生冲突。因此我们需要将自身动作意图与他人动作进行区分并调控二者之间的冲突。这种能力被称为自我-他人控制(self-other control, SOC)。与动作模仿控制相同, 心理理论、观点采择和共情等更高级的社会认知同样涉及对自我和他人信息的加工。很多证据表明, SOC可能是一种领域普遍的(domain-general)加工机制, 即在动作模仿控制和其他社会认知中, 大脑对自我和他人双方信息的区分和冲突调控共用同一套SOC系统。最近一些研究发现, 相比于抑制自身优势反应的抑制控制(inhibitory control), SOC是社会认知中一个更为关键的影响因素, 抑制控制对社会认知的作用受到SOC的调节。此外, SOC的领域普遍性提示我们, 未来可以通过简单的动作模仿控制训练, 来为社会认知受损个体(如孤独症和述情障碍者)进行康复训练。     

Adaptation to different mouth shapes influences visual perception of ambiguous lip speech

We investigated the effects of adaptation to mouth shapes associated with different spoken sounds (sustained /m/ or /u/) on visual perception of lip speech. Participants were significantly more likely to label ambiguous faces on an /m/-to-/u/ continuum as saying /u/ following adaptation to /m/ mouth shapes than they were in a preadaptation test. By contrast, participants were significantly less likely to label the ambiguous faces as saying /u/ following adaptation to /u/ mouth shapes than they were in a preadaptation test. The magnitude of these aftereffects was equivalent when the same individual was shown in the adaptation and test phases of the experiment and when different individuals were presented in the adaptation and test phases. These findings present novel evidence that adaptation to natural variations in facial appearance influences face perception, and they extend previous research on face aftereffects to visual perception of lip speech.     

Automatic imitation

"Automatic imitation" is a type of stimulus-response compatibility effect in which the topographical features of task-irrelevant action stimuli facilitate similar, and interfere with dissimilar, responses. This article reviews behavioral, neurophysiological, and neuroimaging research on automatic imitation, asking in what sense it is "automatic" and whether it is "imitation." This body of research reveals that automatic imitation is a covert form of imitation, distinct from spatial compatibility. It also indicates that, although automatic imitation is subject to input modulation by attentional processes, and output modulation by inhibitory processes, it is mediated by learned, long-term sensorimotor associations that cannot be altered directly by intentional processes. Automatic imitation provides an important tool for the investigation of the mirror neuron system, motor mimicry, and complex forms of imitation. It is a new behavioral phenomenon, comparable with the Stroop and Simon effects, providing strong evidence that even healthy adult humans are prone, in an unwilled and unreasoned way, to copy the actions of others.     

Language experience influences audiovisual speech integration in unimodal and bimodal bilingual infants

Infants as young as 2 months can integrate audio and visual aspects of speech articulation. A shift of attention from the eyes towards the mouth of talking faces occurs around 6 months of age in monolingual infants. However, it is unknown whether this pattern of attention during audiovisual speech processing is influenced by speech and language experience in infancy. The present study investigated this question by analysing audiovisual speech processing in three groups of 4‐ to 8‐month‐old infants who differed in their language experience: monolinguals, unimodal bilinguals (infants exposed to two or more spoken languages) and bimodal bilinguals (hearing infants with Deaf mothers). Eye‐tracking was used to study patterns of face scanning while infants were viewing faces articulating syllables with congruent, incongruent and silent auditory tracks. Monolinguals and unimodal bilinguals increased their attention to the mouth of talking faces between 4 and 8 months, while bimodal bilinguals did not show any age difference in their scanning patterns. Moreover, older (6.6 to 8 months), but not younger, monolinguals (4 to 6.5 months) showed increased visual attention to the mouth of faces articulating audiovisually incongruent rather than congruent faces, indicating surprise or novelty. In contrast, no audiovisual congruency effect was found in unimodal or bimodal bilinguals. Results suggest that speech and language experience influences audiovisual integration in infancy. Specifically, reduced or more variable experience of audiovisual speech from the primary caregiver may lead to less sensitivity to the integration of audio and visual cues of speech articulation.     

Infants' imitation of goal-directed actions: the role of movements and action effects

This paper reviews studies on infants' imitation of goal-directed actions in the first two years of life. Special emphasis is given to the role of the two observable components of an action, that is, the movement and the action effects, on infants' replication of target actions. The reviewed studies provide evidence that infants benefit most from a full demonstration of both movements and effects. If movements are demonstrated in isolation, infants may encode this information, but they preferentially reproduce actions that lead to salient effects. If action effects are presented in isolation, infants younger than 19 months usually fail to emulate the unseen movements that would be necessary to produce these effects. Infants' ability to predict action effects or to infer unseen movements from incomplete demonstrations improves substantially at the end of the second year of life. It is concluded that the capability to learn relations between movements and action effects by observation, and the knowledge about movement-effect relations acquired so far, may be important factors underlying the developmental changes in infants' imitation of goal-directed actions.     

The role of ‘action-effects’ and agency in toddlers’ imitation

We report an experiment on imitation by children between 14 and 26 months in which the presence or absence of an outcome of the procedure to be imitated was varied against whether the procedure was one performed by the experimenter or by a descending arrow. The presence of an outcome did not affect performance positively when the procedure was performed by the experimenter, but it did when it was performed by the descending arrow. When there was an outcome, performance on the experimenter-perform and the arrow-perform conditions did not differ. We argue that this result puts pressure on theories like ‘the theory of common coding’ (W. Prinz) which view the presence of an outcome as being crucial to imitation.     

节律在听觉言语理解中的作用

言语理解是听者接受外部语音输入并且获得意义的心理过程。日常交流中,听觉言语理解受多尺度节律信息的影响,常见有韵律结构节律、语境节律、和说话者身体语言节律三方面外部节律。它们改变听者在言语理解中的音素判别、词汇感知以及言语可懂度等过程。内部节律表现为大脑内神经振荡,其能够表征外部言语输入在不同时间尺度下的层级特征。外部节律性刺激与内部神经活动的神经夹带能够优化大脑对言语刺激的处理,并受到听者自上而下的认知过程的调节进一步增强目标言语的内在表征。我们认为它可能是实现内外节律相互联系并共同影响言语理解的关键机制。对内外节律及其联系机制的揭示能够为理解言语这种在多层级时间尺度上具有结构规律的复杂序列提供了一个研究窗口。