Evaluation of a dynamical model of speech perception

Previous work (Tuller, Case, Ding, & Kelso, 1994) has revealed signature properties of nonlinear dynamical systems in how people categorize speech sounds. The data were modeled by using a twowell potential function that deformed with stimulus properties and was sensitive to context. Here we evaluate one prediction of the model—namely, that the rate of change of the potential’s slope should increase when the category is repeatedly perceived. Judged goodness of category membership was used as an index of the slope of the potential. Stimuli from a “say”-“stay” continuum were presented with gap duration changing sequentially throughout the range from 0 to 76 to 0 msec, or from 76 to 0 to 76 msec. Subjects identified each token as either “say” or “stay” and rated how good an exemplar it was of the identified category. As predicted, the same physical stimulus presented at the end of a sequence was judged a better exemplar of the category than was the identical stimulus presented at the beginning of the sequence. In contrast, stimuli presented twice near the middle of a sequence with few (or no) stimuli between them, as well as stimuli presented with an intervening random set, showed no such differences. These results confirm the hypothesis of a context-sensitive dynamical representation underlying speech.     

Acoustic memory and the perception of speech

The nature of acoustic memory and its relationship to the categorizing process in speech perception is investigated in three experiments on the serial recall of lists of syllables. The first study confirms previous reports that sequences comprising the syllables, bah, dah, and gah show neither enhanced retention when presented auditorily rather than visually, nor a recency effect—both occurred with sequences in which vowel sounds differed (bee, bih, boo). This was found not to be a simple vowel-consonant difference since acoustic memory effects did occur with consonant sequences that were acoustically more discriminable (sha, ma, ga and ash, am, ag). Further experiments used the stimulus suffix effect to provide evidence of acoustic memory, and showed (1), increasing the acoustic similarity of the set grossly impairs acoustic memory effects for vowels as well as consonants, and (2) such memory effects are no greater for steady-state vowels than for continuously changing diphthongs. It is concluded that the usefulness of the information that can be retrieved from acoustic memory depends on the acoustic similarity of the items in the list rather than on their phonetic class or whether or not they have “encoded” acoustic cues. These results question whether there is any psychological evidence for “encoded” speech sounds being categorized in ways different from other speech sounds.     

Testing the concurrent and predictive relations among articulation accuracy, speech perception, and phoneme awareness

The relations among articulation accuracy, speech perception, and phoneme awareness were examined in a sample of 97 typically developing children ages 48 to 66 months. Of these 97 children, 46 were assessed twice at ages 4 and 5 years. Children completed two tasks for each of the three skills, assessing these abilities for the target phoneme /r/ and the control phoneme /m/ in the word-initial position. Concurrent analyses revealed that phoneme-specific relations existed among articulation, awareness, and perception. Articulation accuracy of /r/ predicted speech perception and phoneme awareness for /r/ after controlling for age, vocabulary, letter-word knowledge, and speech perception or phoneme awareness for the control phoneme /m/. The longitudinal analyses confirmed the pattern of relations. The findings are consistent with a model whereby children's articulation accuracy affects preexisting differences in phonological representations and, consequently, affects how children perceive, discriminate, and manipulate speech sounds.     

Interference between phonemes during phoneme monitoring: evidence for an interactive activation model of speech perception

We explore the recent finding (Newman & Dell, 1978) that the time needed to detect a target phoneme in a phoneme monitoring task is increased when the preceding word contains a phoneme similar to the target. Normal adult native speakers of English monitored auditorily presented sentences and responded as quickly as possible whenever they detected a specified phoneme. We found that preceding word-initial phonemes, despite being processed more quickly, increased the response latency to the following target phoneme more than did preceding word-medial phonemes. There was also an increase in response latency even when the subject could be highly certain that the similar preceding phoneme was not an instance of the target phoneme. We argue that the interference effects are due to fundamental characteristics of perceptual processing and that more time is needed to categorize the target phoneme. We present a computer simulation using an interactive activation model of speech perception to demonstrate the plausibility of our explanation.     

Dichotic speech perception: A comparison between stuttering and nonstuttering children

A stop consonant-vowel dichotic listening task was administered to 90 right- handed boys, 30 in each age group of 5, 7, and 9 yr. Half in each group were stutterers, half nonstutterers. Two and a half times as many stutterers as nonstutterers were found to display either a left-ear advantage (LEA) or no ear advantage (NEA). This finding suggested a greater tendency on the part of stutterers, as opposed to nonstutterers, for reversed or bilateral representation of the auditory speech areas of the brain. In addition, both stutterers and nonstutterers displayed significant developmental increases in the number of times they were able to identify both dichotic speech stimuli, thereby supporting the hypothesis of an age-related increase in children's total information processing capacity. The results are discussed in terms of the differences between stutterers and nonstutterers with respect to the issues of motor representation, cognitive modes, and higher-order linguistic processes.     

Effects of the match between listener expectancies and coarticulatory cues on the perception of speech

Several experiments have attempted to establish the order in which various linguistic units (e.g., syllables and words) are processed. This article presents an alternative interpretation (the target-stimulus mismatch interpretation) for those earlier results. This interpretation states that the closer the match between the listener's expectancies about how the stimulus will sound (the target) and the sound of the acoustic stimulus the listener actually hears (the stimulus), the faster the listener will recognize the stimulus. This interpretation was tested in an experiment in which the match between the target and the stimulus was varied by manipulating the acoustic (coarticulatory) properties of the stimulus while the size of the target (syllable) was held constant. The results suggest that earlier findings explained in terms of linguistic units or levels can be explained more readily by the target-stimulus mismatch interpretation, and these results provide evidence that coarticulatory information is utilized by the perceiver of speech.     

Developmental dyslexia and discrimination in speech perception: a dynamic model study

At the behavioral level one of the primary disturbances involved in congenital dyslexia concerns phonological processing. At the neuroarchitectural level autopsies have revealed ectopies, e.g., a reduced number of neurons in the upper layers of the cortex and an increased number in the lower ones. In dynamic models of interacting neuronal populations the behavioral level can be related to the neurophysiological level. In this study an attempt is made to do so at the cortical level. The first focus of this model study are the results of a Finnish experiment assessing geminate stop perception in quasi speech stimuli by 6 month old infants using a head turning paradigm and evoked potentials. The second focus of this study are the results of a Dutch experiment assessing discrimination of transients in speech stimuli, by adult dyslexics and controls and 2 month old infants. There appears to be a difference in the phonemic perceptual boundaries of children at genetic risk for dyslexia and control children as revealed in the Finnish study. Assuming a lowered neuronal density in the 'dyslexic' model, reflecting ectopies, it may be postulated that less neuronal surface is available for synaptic connections resulting in a lowered synaptic density and thus a lowered amount of available neurotransmitter. A lowered synaptic density also implies a reduced amount of membrane surface available for neurotransmitter metabolism. By assuming both, a reduced upper bound of neurotransmitter and a reduced metabolic transmitter rate in the dynamic model, the Finnish experimental results can be approximated closely. This applies both to data from behavioral head turning and that of the evoked potential study. In the Dutch study adult dyslexics show poor performance in discriminating transients in the speech signal compared to the controls. The same stimuli were used in a a study comparing infants from dyslexic families and controls. Using the same transmitter parameters as in modeling the results of the Finnish study, also in this case the experimental results for adults and infants can be approximated closely. Simulation of behavioral and pharmaceutical interventions with the model provide predictions which can be put to the test in experiments.     

Orthography influences the perception and production of speech

One intriguing question in language research concerns the extent to which orthographic information impacts on spoken word processing. Previous research has faced a number of methodological difficulties and has not reached a definitive conclusion. Our research addresses these difficulties by capitalizing on recent developments in the area of word learning. Participants were trained to criterion on a set of associations between novel pictures and novel spoken words. Spelling-sound consistent or spelling-sound inconsistent spellings were introduced on the 2nd day, and the influence of these spellings on speech processing was assessed on the 3rd day. Results showed significant orthographic effects on speech perception and speech production in a situation in which spelling-sound consistency was manipulated with perfect experimental control. Results are discussed in terms of a highly interactive language system in which there is a rapid and automatic flow of activation in both directions between orthographic and phonological representations.     

The perception of alternated speech

When speech is rapidly alternated between the two ears, intelligibility declines as rates approach 3–5 switching cycles/sec and then paradoxically returns to a good level beyond that point. The present study examines previous explanations of the phenomenon by comparing intelligibility of alternated speech with that for presentation of an interrupted message to a single ear. Results favor one of two possible explanations, and a theoretical model to account for the effect is proposed.     

Seeking the neurobiological bases of speech perception

One of the most highly developed human abilities is communication by speech. Throughout the years, research on speech perception has demonstrated that humans are well adapted to extract highly encoded linguistic information from the speech signal. The sophisticated nature of these capacities and their early appearance during development suggest the existence of a rich biological substrate for speech perception. In the present paper, we describe some of these important capacities and examine research from different domains that may help illuminate the nature of their biological foundations.     

Chronometric analysis of speech perception

The relationship between the phonological properties of speech sounds and the corresponding semantic entries was studied in two experiments using response time measures. Monosyllabic words and nonsense words were used in both experiments. In Experiment I. Ss were each presented with individual items and were required, in three different conditions, to respond positively if (1) the item contained a particular final consonant, (2) the item was a real word, (3) the item contained either a particular consonant or was a real word. Latencies indicated that separate retrieval of phonological and lexical information took about the same time. but that their combined retrieval was longer, indicating a serial or overlapping process. In Experiment II, Ss were presented with pairs of items, and they responded positively if (1) the two items were physically identical, (2) the two items were lexically identical (both real words or both nonsense words). Response latencies were longer for lexical than for physical matches. Lexical matches were’ significantly slower than physical matches even on the same pair of items. The results imply differential accessibility to separate loci of phonological and semantic features.     

Perceptual independence in the perception of speech

The purpose of the experiments and analyses was to discover whether the “independence” model, which successfully accounts for the perception of synthetic multi-dimensional stimuli, would also describe the perception of speech in noise. Two sets of four words were chosen which could be considered phonetically to be describable in terms of two dimensions. The S/R matrix was analysed as if the stimuli were bi-dimensional elementary stimuli. Satisfactory fits were obtained by the independence model. Two analyses were conducted upon data from Miller and Nicely (1955) and Conrad (1964) to discover whether the perception of phonemes was also predictable on the independence model. In general this was found to be the case.     

Hearing-impaired children's rhythm perception and speech

The role of rhythm in the speech intelligibility of 18 hearing-impaired children, aged 15 years with hearing losses from 40 to 108 db, was investigated. Their perceptual judgement of visual rhythm sequences was superior to that of the hearing controls, but their scores were not correlated with their speech intelligibility.     

Subliminal speech perception and auditory streaming

Current theories of consciousness assume a qualitative dissociation between conscious and unconscious processing: while subliminal stimuli only elicit a transient activity, supraliminal stimuli have long-lasting influences. Nevertheless, the existence of this qualitative distinction remains controversial, as past studies confounded awareness and stimulus strength (energy, duration). Here, we used a masked speech priming method in conjunction with a submillisecond interaural delay manipulation to contrast subliminal and supraliminal processing at constant prime, mask and target strength. This delay induced a perceptual streaming effect, with the prime popping out in the supraliminal condition. By manipulating the prime-target interval (ISI), we show a qualitatively distinct profile of priming longevity as a function of prime awareness. While subliminal priming disappeared after half a second, supraliminal priming was independent of ISI. This shows that the distinction between conscious and unconscious processing depends on high-level perceptual streaming factors rather than low-level features (energy, duration).