Seeing to hear better: evidence for early audio-visual interactions in speech identification

Lip reading is the ability to partially understand speech by looking at the speaker's lips. It improves the intelligibility of speech in noise when audio-visual perception is compared with audio-only perception. A recent set of experiments showed that seeing the speaker's lips also enhances sensitivity to acoustic information, decreasing the auditory detection threshold of speech embedded in noise [J. Acoust. Soc. Am. 109 (2001) 2272; J. Acoust. Soc. Am. 108 (2000) 1197]. However, detection is different from comprehension, and it remains to be seen whether improved sensitivity also results in an intelligibility gain in audio-visual speech perception. In this work, we use an original paradigm to show that seeing the speaker's lips enables the listener to hear better and hence to understand better. The audio-visual stimuli used here could not be differentiated by lip reading per se since they contained exactly the same lip gesture matched with different compatible speech sounds. Nevertheless, the noise-masked stimuli were more intelligible in the audio-visual condition than in the audio-only condition due to the contribution of visual information to the extraction of acoustic cues. Replacing the lip gesture by a non-speech visual input with exactly the same time course, providing the same temporal cues for extraction, removed the intelligibility benefit. This early contribution to audio-visual speech identification is discussed in relationships with recent neurophysiological data on audio-visual perception.     

Young children's sensitivity to probabilistic phonotactics in the developing lexicon

A series of three experiments examined children's sensitivity to probabilistic phonotactic structure as reflected in the relative frequencies with which speech sounds occur and co-occur in American English. Children, ages 212 and 312 years, participated in a nonword repetition task that examined their sensitivity to the frequency of individual phonetic segments and to the frequency of combinations of segments. After partialling out ease of articulation and lexical variables, both groups of children repeated higher phonotactic frequency nonwords more accurately than they did low phonotactic frequency nonwords, suggesting sensitivity to phoneme frequency. In addition, sensitivity to individual phonetic segments increased with age. Finally, older children, but not younger children, were sensitive to the frequency of larger (diphone) units. These results suggest not only that young children are sensitive to fine-grained acoustic-phonetic information in the developing lexicon but also that sensitivity to all aspects of the sound structure increases over development. Implications for the acoustic nature of both developing and mature lexical representations are discussed.     

Semantic gender assignment regularities in German

Gender assignment relates to a native speaker's knowledge of the structure of the gender system of his/her language, allowing the speaker to select the appropriate gender for each noun. Whereas categorical assignment rules and exceptional gender assignment are well investigated, assignment regularities, i.e., tendencies in the gender distribution identified within the vocabulary of a language, are still controversial. The present study is an empirical contribution trying to shed light on the gender assignment system native German speakers have at their disposal. Participants presented with a category (e.g., predator) and a pair of gender-marked pseudo-words (e.g., der Trelle vs. die Stisse) preferentially selected the pseudo-word preceded by the gender-marked determiner "associated" with the category (e.g., masculine). This finding suggests that semantic regularities might be part of the gender assignment system of native speakers.     

The word frequency effect in picture naming: contrasting two hypotheses using homonym pictures

Models of speech production disagree on whether or not homonyms have a shared word-form representation. To investigate this issue, a picture-naming experiment was carried out using Dutch homonyms of which both meanings could be presented as a picture. Naming latencies for the low-frequency meanings of homonyms were slower than for those of the high-frequency meanings. However, no frequency effect was found for control words, which matched the frequency of the homonyms' meanings. Subsequent control experiments indicated that the difference in naming latencies for the homonyms could be attributed to processes earlier than word-form retrieval. Specifically, it appears that low name agreement slowed down the naming of the low-frequency homonym pictures.     

Stress priming in picture naming: an SOA study

This study investigates whether or not the representation of lexical stress information can be primed during speech production. In four experiments, we attempted to prime the stress position of bisyllabic target nouns (picture names) having initial and final stress with auditory prime words having either the same or different stress as the target (e.g., WORtel-MOtor vs. koSTUUM-MOtor; capital letters indicate stressed syllables in prime-target pairs). Furthermore, half of the prime words were semantically related, the other half unrelated. Overall, picture names were not produced faster when the prime word had the same stress as the target than when the prime had different stress, i.e., there was no stress-priming effect in any experiment. This result would not be expected if stress were stored in the lexicon. However, targets with initial stress were responded to faster than final-stress targets. The reason for this effect was neither the quality of the pictures nor frequency of occurrence or voice-key characteristics. We hypothesize here that this stress effect is a genuine encoding effect, i.e., words with stress on the second syllable take longer to be encoded because their stress pattern is irregular with respect to the lexical distribution of bisyllabic stress patterns, even though it can be regular with respect to metrical stress rules in Dutch. The results of the experiments are discussed in the framework of models of phonological encoding.     

Neighbourhood effects on error rates in speech production

Models of speech production differ on whether phonological neighbourhoods should affect processing, and on whether effects should be facilitatory or inhibitory. Inhibitory effects of large neighbourhoods have been argued to underlie apparent anti-frequency effects, whereby high-frequency default features are more prone to mispronunciation errors than low-frequency nondefault features. Data from the original SLIPs experiments that found apparent anti-frequency effects are analysed for neighbourhood effects. Effects are facilitatory: errors are significantly less likely for words with large numbers of neighbours that share the characteristic that is being primed for error ("friends"). Words in the neighbourhood that do not share the target characteristic ("enemies") have little effect on error rates. Neighbourhood effects do not underlie the apparent anti-frequency effects. Implications for models of speech production are discussed.     

The impact of semantic transparency of morphologically complex words on picture naming

We examined the contribution of semantic similarity to morphological priming effects, using the immediate (Exp. 1 and 3) and the delayed variant (Exp. 2) of picture-word interference. Distractor words were either compounds morphologically related to the picture name, but differing with respect to their semantic transparency (hummingbird, jailbird (Exp. 1); butterfly, butter dish (Exp. 3)), or form-related non-compound words (e.g., trombone). All three experiments revealed strong facilitation of picture naming due to morphologically related distractors. Form-related distractors facilitated picture naming in the immediate variant only, and to a lesser degree than compounds. Interestingly, the size of the morphemic effect was almost identical for semantically transparent and opaque complex words, which suggests that they share morphemic representations. These results suggest that morphological complexity in speech production is coded at the level of form representations, independent of semantic transparency.     

评发生认识论的"反省抽象"范畴

论文分析了皮亚杰发生认识论中“反省抽象”范畴的发展脉络、主要内涵及其与某些相关概念(如概括化、平衡化、矛盾与否定的构造、意识化与觉知等)的联系。作者认为：反省抽象不仅体现皮亚杰的独创性．而且也是发生认识沦中最为核心和最为重要的概念。它合理地解释了知识创新的源泉,使发生认识论的逻辑一数学范畴研究及认知发展一般规律的研究奠基于科学认识论之上。作者主张应准确继承皮亚杰的学术遗产,深化对认知发展机制的探索。     

Learning about life and death in early childhood

have argued that young children initially understand biological phenomena in terms of vitalism, a mode of construal in which "life" or "life-force" is the central causal-explanatory concept. This study investigated the development of vitalistic reasoning in young children's concepts of life, the human body and death. Sixty preschool children between the ages of 3 years, 7 months and 5 years, 11 months participated. All children were initially given structured interviews to assess their knowledge of (1) human body function and (2) death. From this sample 40 children in the Training group were taught about the human body and how it functions to maintain life. The Control group (n=20) received no training. All 60 children were subsequently reassessed on their knowledge of human body function and death. Results from the initial interviews indicated that young children who spontaneously appealed to vitalistic concepts in reasoning about human body functioning were also more sophisticated in their understanding of death. Results from the posttraining interviews showed that children readily learned to adopt a vitalistic approach to human body functioning, and that this learning coincided with significant development in their understanding of human body function, and of death. The overall pattern of results supports the claim that the acquisition of a vitalistic causal-explanatory framework serves to structure children's concepts and facilitates learning in the domain of biology.     

Functional analysis and treatment of self-injurious behavior in young children a summary of 30 cases

The assessment and treatment of self-injurious behavior (SIB) has received much attention in the literature; however, few studies have focused on early intervention for this behavior. In the current study, functional analyses with developmentally appropriate modifications were conducted in an outpatient clinic with 30 children (aged 10 months to 4 years 11 months) to assess SIB and problem behavior in its early stages. The reported mean age of SIB onset was 17 months, and head banging was the most prevalent topography. Functional analyses identified sources of reinforcement for SIB in 62.1% of cases; with the inclusion of all forms of problem behavior, sources of reinforcement were identified for 87.5% of cases. Function-based treatments were developed for 24 cases, with functional communication training prescribed most often (70.8% of cases). Implications of these findings for the development of early intervention programs for SIB are discussed.