The effects of experimental variables on the perception of American English /r/ and /l/ by Japanese listeners.

The effects of variations in response categories, subjects' perception of natural speech, and stimulus range on the identification of American English /r/ and /l/ by native speakers of Japanese were investigated. Three experiments using a synthesized /rait/-/lait/ series showed that all these variables affected identification and discrimination performance by Japanese subjects. Furthermore, some of the perceptual characteristics of /r/ and /l/ for Japanese listeners were clarified: (1) Japanese listeners identified some of the stimuli of the series as /w/. (2) A positive correlation between the perception of synthesized stimuli and naturally spoken stimuli was found. Japanese listeners who were able to easily identify naturally spoken stimuli perceived the synthetic series categorically but still perceived a /w/ category on the series. (3) The stimulus range showed a striking effect on identification consistency; identification of /r/ and /l/ was strongly affected by the stimulus range, the /w/ identification less so. This indicates that Japanese listeners tend to make relative judgments between /r/ and /l/.     

The relationship between perception and production of /w/, /r/, and /l/ by three-year-old children

Twenty-one normally developing 3-year-old children were tested on two approximant consonant contrasts, rake-lake and wake-rake, and a control contrast, wake-bake. Perception was assessed in a two-choice picture identification paradigm; stimuli were (1) natural and computer synthesized “clear cases” of the minimal pairs, and (2) synthetic stimulus series which interpolated on acoustic dimensions that differentiate the minimal pairs. As a group, the children showed very accurate perception of the minimal pairs. Performance on the synthetic series yielded consistent identification of the endpoint stimuli and monotonic functions with abrupt crossovers at the phoneme boundary. Children who did not yet articulate /r/ and /l/ appropriately showed somewhat less consistent perception than children who produced all phonemes correctly.     

Training Japanese listeners to identify English /r/ and /l/: long-term retention of learning in perception and production.

Previous work from our laboratories has shown that monolingual Japanese adults who were given intensive high-variability perceptual training improved in both perception and production of English /r/-/l/ minimal pairs. In this study, we extended those findings by investigating the long-term retention of learning in both perception and production of this difficult non-native contrast. Results showed that 3 months after completion of the perceptual training procedure, the Japanese trainees maintained their improved levels of performance of the perceptual identification task. Furthermore, perceptual evaluations by native American English listeners of the Japanese trainees' pretest, posttest, and 3-month follow-up speech productions showed that the trainees retained their long-term improvements in the general quality, identifiability, and overall intelligibility of their English/r/-/l/ word productions. Taken together, the results provide further support for the efficacy of high-variability laboratory speech sound training procedures, and suggest an optimistic outlook for the application of such procedures for a wide range of "special populations."     

Training Japanese listeners to identify English /r/and /l/: Long-term retention of learning in perception and production

Previous work from our laboratories has shown that monolingual Japanese adults who were given intensive high-variability perceptual training improved in both perception and production of English /r/-/l/ minimal pairs. In this study, we extended those findings by investigating the long-term retention of learning in both perception and production of this difficult non-native contrast. Results showed that 3 months after completion of the perceptual training procedure, the Japanese trainees maintained their improved levels of performance on the perceptual identification task. Furthermore, perceptual evaluations by native American English listeners of the Japanese trainees’ pretest, posttest, and 3-month follow-up speech productions showed that the trainees retained their long-term improvements in the general quality, identifiability, and overall intelligibility of their English /r/-/l/ word productions. Taken together, the results provide further support for the efficacy of high-variability laboratory speech sound training procedures, and suggest an optimistic outlook for the application of such procedures for a wide range of “special populations.” nt]mis|This work was supported by NIDCD Training Grant DC-00012 and by NIDCD Research Grant DC-00111 to Indiana University.     

Phonological abstraction without phonemes in speech perception

Recent evidence shows that listeners use abstract prelexical units in speech perception. Using the phenomenon of lexical retuning in speech processing, we ask whether those units are necessarily phonemic. Dutch listeners were exposed to a Dutch speaker producing ambiguous phones between the Dutch syllable-final allophones approximant [r] and dark [l]. These ambiguous phones replaced either final /r/ or final /l/ in words in a lexical-decision task. This differential exposure affected perception of ambiguous stimuli on the same allophone continuum in a subsequent phonetic-categorization test: Listeners exposed to ambiguous phones in /r/-final words were more likely to perceive test stimuli as /r/ than listeners with exposure in /l/-final words. This effect was not found for test stimuli on continua using other allophones of /r/ and /l/. These results confirm that listeners use phonological abstraction in speech perception. They also show that context-sensitive allophones can play a role in this process, and hence that context-insensitive phonemes are not necessary. We suggest there may be no one unit of perception.     

Perceptual magnet and phoneme boundary effects in speech perception: do they arise from a common mechanism?

The question of whether sensitivity peaks at vowel boundaries (i.e., phoneme boundary effects) and sensitivity minima near excellent category exemplars (i.e., perceptual magnet effects) stem from the same stage of perceptual processing was examined in two experiments. In Experiment 1, participants gave phoneme identification and goodness ratings for 13 synthesized English /i/ and /e/ vowels. In Experiment 2, participants discriminated pairs of these vowels. Either the listeners discriminated the entire range of stimuli within each block of trials, or the range within each block was restricted to a single stimulus pair. In addition, listeners discriminated either one-step or two-step intervals along the stimulus series. The results demonstrated that sensitivity peaks at vowel boundaries were more influenced by stimulus range than were perceptual magnet effects; peaks in sensitivity near the /i/-/e/ boundary were reduced with restricted stimulus ranges and one-step intervals, but minima in discrimination near the best exemplars of /i/ were present in all conditions.     

‘Please sort these voice recordings into 2 identities’: Effects of task instructions on performance in voice sorting studies

We investigated the effects of two types of task instructions on performance on a voice sorting task by listeners who were either familiar or unfamiliar with the voices. Listeners were asked to sort 15 naturally varying stimuli from two voice identities into perceived identities. Half of the listeners sorted the recordings freely into as many identities as they perceived; the other half were forced to sort stimuli into two identities only. As reported in previous studies, unfamiliar listeners formed more clusters than familiar listeners. Listeners therefore perceived different naturally varying stimuli from the same identity as coming from different identities, while being highly accurate at telling apart the stimuli from different voices. We further show that a change in task instructions – forcing listeners to sort stimuli into two identities only – helped unfamiliar listeners to overcome this selective failure at ‘telling people together’. This improvement, however, came at the cost of an increase in errors in telling people apart. For familiar listeners, similar non-significant trends were apparent. Therefore, even when informed about correct number of identities, listeners may fail to accurately perceive identity further highlighting that voice identity perception in the context of natural within-person variability is a challenging task. We discuss our results in terms of similarities and differences to findings in the face perception literature and their importance in applied settings, such as forensic voice identification.     

An effect of linguistic experience: The discrimination of [r] and [l] by native speakers of Japanese and English

To test the effect of linguistic experience on the perception of a cue that is known to be effective in distinguishing between [r] and [l] in English, 21 Japanese and 39 American adults were tested on discrimination of a set of synthetic speech-like stimuli. The 13 “speech” stimuli in this set varied in the initial stationary frequency of the third formant (F3) and its subsequent transition into the vowel over a range sufficient to produce the perception of [r a] and [l a] for American subjects and to produce [r a] (which is not in phonemic contrast to [l a ]) for Japanese subjects. Discrimination tests of a comparable set of stimuli consisting of the isolated F3 components provided a “nonspeech” control. For Americans, the discrimination of the speech stimuli was nearly categorical, i.e., comparison pairs which were identified as different phonemes were discriminated with high accuracy, while pairs which were identified as the same phoneme were discriminated relatively poorly. In comparison, discrimination of speech stimuli by Japanese subjects was only slightly better than chance for all comparison pairs. Performance on nonspeech stimuli, however, was virtually identical for Japanese and American subjects; both groups showed highly accurate discrimination of all comparison pairs. These results suggest that the effect of linguistic experience is specific to perception in the “speech mode.”     

Training to use voice onset time as a cue to talker identification induces a left-ear/right-hemisphere processing advantage

We examined the effect of perceptual training on a well-established hemispheric asymmetry in speech processing. Eighteen listeners were trained to use a within-category difference in voice onset time (VOT) to cue talker identity. Successful learners (n=8) showed faster response times for stimuli presented only to the left ear than for those presented only to the right. The development of a left-ear/right-hemisphere advantage for processing a prototypically phonetic cue supports a model of speech perception in which lateralization is driven by functional demands (talker identification vs. phonetic categorization) rather than by acoustic stimulus properties alone.     

The perception of /r/ and /l/ in syllable-initial and syllable-final position

American English liquids /r/ and /l/ have been considered intermediate between stop consonants and vowels acoustically, articulatorily, phonologically, and perceptually. Cutting (1947a) found position-dependent ear advantages for liquids in a dichotic listening task: syllable-initial liquids produced significant right ear advantages, while syllable-final liquids produced no reliable ear advantages. The present study employed identification and discrimination tasks to determine whether /r/and /l/ are perceived differently depending on syllable position when perception is tested by a different method. Fifteen subjects listened to two synthetically produced speech series—/li/ to /ri/ and /il/ to /ir/—in which stepwise variations of the third formant cued the difference in consonant identity. The results indicated that: (1) perception did not differ between syllable positions (in contrast to the dichotic listening results), (2) liquids in both syllable positions were perceived categorically, and (3) discrimination of a nonspeech control series did not account for the perception of the speech sounds.     

Directional tendencies of Hebrew, Japanese, and English readers.

Consistent left-right and right-left reading habits are associated with corresponding directional tendencies in the reproduction of horizontally displayed visual stimuli. Inconsistent reading habits should therefore be associated with inconsis tent directional tendencies. This hypothesis was tested on Japanese readers whose reading habits were inconsistent by asking them to reproduce four series of 12-item horizontal stimulus arrays. The hypothesis was partially supported by the data which showed that, like Hebrew readers who also have inconsistent reading habits, the directional tendencies shown by the 68 Japanese readers were significantly weaker on some tasks that those shown by the 16 English readers whose left-right reading habits were consistent. The data were interpreted as showing that acquired reading habits may affect directionality in perception of visual stimuli.     

Detection and identification thresholds for consonant-vowel syllables

Detection and identification thresholds were obtained for 6- and 10-year-old normal children and normal adults using five-formant synthesized consonant-vowel ([baHdflrfea]) stimuli. Sixyear-old children were found to have poorer detection than adults, just as they do for pure tones. For the identification task, the slopes of the performance-intensity functions were more shallow for 6-year-old children than for 10-year-olds and adults. Consequently, compared with 10-yearolds and adults, 6-year-old listeners require a greater increase in stimulus intensity above detection threshold to identify these stimuli at a high performance level. The influence of acoustic characteristics of the stimuli on all listeners is also discussed.     

非言语声音影响汉语听者言语声音的知觉

采用启动范式, 以汉语听者为被试, 考察了非言语声音是否影响言语声音的知觉。实验1考察了纯音对辅音范畴连续体知觉的影响, 结果发现纯音影响到辅音范畴连续体的知觉, 表现出频谱对比效应。实验2考察了纯音和复合音对元音知觉的影响, 结果发现与元音共振峰频率一致的纯音或复合音加快了元音的识别, 表现出启动效应。两个实验一致发现非言语声音能够影响言语声音的知觉, 表明言语声音知觉也需要一个前言语的频谱特征分析阶段, 这与言语知觉听觉理论的观点一致。     

Neurological evidence in support of a specialized phonetic processing module

Event-related potentials (ERPs) were utilized to study brain activity while subjects listened to speech and nonspeech stimuli. The effect of duplex perception was exploited, in which listeners perceive formant transitions that are isolated as nonspeech "chirps," but perceive formant transitions that are embedded in synthetic syllables as unique linguistic events with no chirp-like sounds heard at all (Mattingly et al., 1971). Brain ERPs were recorded while subjects listened to and silently identified plain speech-only tokens, duplex tokens, and tone glides (perceived as "chirps" by listeners). A highly controlled set of stimuli was developed that represented equivalent speech and nonspeech stimulus tokens such that the differences were limited to a single acoustic parameter: amplitude. The acoustic elements were matched in terms of number and frequency of components. Results indicated that the neural activity in response to the stimuli was different for different stimulus types. Duplex tokens had significantly longer latencies than the pure speech tokens. The data are consistent with the contention of separate modules for phonetic and auditory stimuli.     

Coherence masking protection in speech sounds: The role of formant synchrony

Three experiments were performed to examine listeners’ thresholds for identifying stimuli whose spectra were modeled after the vowels /i/ and /ε/, with the differences between these stimuli restricted to the frequency of the first formant. The stimuli were presented in a low-pass masking noise that spectrally overlapped the first formant but not the higher formants. Identification thresholds were lower when the higher formants were present than when they were not, even though the first formant contained the only distinctive information for stimulus identification. This indicates that listeners were more sensitive in identifying the first formant energy through its contribution to the vowel than as an independent percept; this effect is given the namecoherence masking protection. The first experiment showed this effect for synthetic vowels in which the distinctive first formant was supported by a series of harmonics that progressed through the higher formants. In the second two experiments, the harmonics in the first formant region were removed, and the first formant was simulated by a narrow band of noise. This was done so that harmonic relations did not provide a basis for grouping the lower formant with the higher formants; coherence masking protection was still observed. However, when the temporal alignment of the onsets and offsets of the higher and lower formants was disrupted, the effect was eliminated, although the stimuli were still perceived as vowels. These results are interpreted as indicating that general principles of auditory grouping that can exploit regularities in temporal patterns cause acoustic energy belonging to a coherent speech sound to stand out in the auditory scene.     

Emotion colors time perception unconsciously

Emotion modulates our time perception. So far, the relationship between emotion and time perception has been examined with visible emotional stimuli. The present study investigated whether invisible emotional stimuli affected time perception. Using continuous flash suppression, which is a kind of dynamic interocular masking, supra-threshold emotional pictures were masked or unmasked depending on whether the retinal position of continuous flashes on one eye was consistent with that of the pictures on the other eye. Observers were asked to reproduce the perceived duration of a frame stimulus that was concurrently presented with a masked or unmasked emotional picture. As a result, negative emotional stimuli elongated the perceived duration of the frame stimulus in comparison with positive and neutral emotional stimuli, regardless of the visibility of emotional pictures. These results suggest that negative emotion unconsciously accelerates an internal clock, altering time perception.     

Effects of nonconscious perception on motor response

The present study reviews the literature on the empirical evidence for the dissociation between perception and action. We first review several key studies on brain-damaged patients, such as those suffering from blindsight and visual/tactile agnosia, and on experimental findings examining pointing movements in normal people in response to a nonconsciously perceived stimulus. We then describe three experiments we conducted using simple reaction time (RT) tasks with backward masking, in which the first (weak) and second (strong) electric stimuli were consecutively presented with a 40-ms interstimulus interval (ISI). First, we compared simple RTs for three stimulus conditions: weak alone, strong alone, and double, i.e., weak plus strong (Experiment 1); then, we manipulated the intensity of the first stimulus from the threshold (T) to 1.2T and 2T, with the second stimulus at 4T (Experiment 2); finally, we tested three different ISIs (20, 40, and 60 ms) with the stimulus intensities at 1.2T and 4T for the first and second stimuli (Experiment 3). These experiments showed that simple RTs were shorter for the double condition than for the strong-alone condition, indicating that motor processes under the double condition may be triggered by sensory inputs arising from the first stimulus. Our results also showed that the first stimulus was perceived without conscious awareness. These findings suggested that motor processes may be dissociated from conscious perceptual processes and that these two processes may not take place in a series but, rather, in parallel. We discussed the likely mechanisms underlying nonconscious perception and motor response to a nonconsciously perceived stimulus.     

Learning foreign sounds in an alien world: videogame training improves non-native speech categorization

Although speech categories are defined by multiple acoustic dimensions, some are perceptually weighted more than others and there are residual effects of native-language weightings in non-native speech perception. Recent research on nonlinguistic sound category learning suggests that the distribution characteristics of experienced sounds influence perceptual cue weights: Increasing variability across a dimension leads listeners to rely upon it less in subsequent category learning (Holt & Lotto, 2006). The present experiment investigated the implications of this among native Japanese learning English /r/-/l/ categories. Training was accomplished using a videogame paradigm that emphasizes associations among sound categories, visual information, and players' responses to videogame characters rather than overt categorization or explicit feedback. Subjects who played the game for 2.5h across 5 days exhibited improvements in /r/-/l/ perception on par with 2-4 weeks of explicit categorization training in previous research and exhibited a shift toward more native-like perceptual cue weights.     

Human adults and human infants show a "perceptual magnet effect" for the prototypes of speech categories, monkeys do not

Many perceptual categories exhibit internal structure in which category prototypes play an important role. In the four experiments reported here, the internal structure of phonetic categories was explored in studies involving adults, infants, and monkeys. In Experiment 1, adults rated the category goodness of 64 variants of the vowel i parallel on a scale from 1 to 7. The results showed that there was a certain location in vowel space where listeners rated the i parallel vowels as best instances, or prototypes. The perceived goodness of i parallel vowels declined systematically as stimuli were further removed from the prototypic i parallel vowel. Experiment 2 went beyond this initial demonstration and examined the effect of speech prototypes on perception. Either the prototypic or a nonprototypic i parallel vowels was used as the referent stimulus and adults' generalization to other members of the category was examined. Results showed that the typicality of the speech stimulus strongly affected perception. When the prototype of the category served as the referent vowel, there was significantly greater generalization to other i parallel vowels, relative to the situation in which the nonprototype served as the referent. The notion of a perceptual magnet was introduced. The prototype of the category functioned like a perceptual magnet for other category members; it assimilated neighboring stimuli, effectively pulling them toward the prototype. In Experiment 3, the ontogenetic origins of the perceptual magnet effect were explored by testing 6-month-old infants. The results showed that infants' perception of vowels was also strongly affected by speech prototypes. Infants showed significantly greater generalization when the prototype of the vowel category served as the referent; moreover, their responses were highly correlated with those of adults. In Experiment 4, Rhesus monkeys were tested to examine whether or not the prototype's magnet effect was unique to humans. The animals did not provide any evidence of speech prototypes; they did not exhibit the magnet effect. It is suggested that the internal organization of phonetic categories around prototypic members is an ontogenetically early, species-specific, aspect of the speech code.     

Time,change, and motion: The effects of stimulus movement on temporal perception

The effects of stimulus motion on time perception were examined in five experiments. Subjects judged the durations (6–18 sec) of a series of computer-generated visual displays comprised of varying numbers of simple geometrical forms. In Experiment 1, subjects reproduced the duration of displays consisting of stationary or moving (at 20 cm/sec) stimulus figures. In Experiment 2, subjects reproduced the durations of stimuli that were either stationary, moving slowly (at 10 cm/sec), or moving fast (at 30 cm/sec). In Experiment 3, subjects used the production method to generate specified durations for stationary, slow, and fast displays. In Experiments 4 and 5, subjects reproduced the duration of stimuli that moved at speeds ranging from 0 to 45 cm/sec. Each experiment showed that stimulus motion lengthened perceived time. In general, faster speeds lengthened perceived time to a greater degree than slower speeds. Varying the number of stimuli appearing in the displays had only limited effects on time judgments. Other findings indicated that shorter intervals tended to be overestimated and longer intervals underestimated (Vierordt’s law), an effect which applied to both stationary and moving stimuli. The results support a change model of perceived time, which maintains that intervals associated with more changes are perceived to be longer than intervals with fewer changes.