Effects of phase changes in low-numbered harmonics on the internal representation of complex sounds

A series of experiments investigated the effect of phase changes in lownumbered single harmonics in target sounds that were either synthesized steady-state vowels or periodic signals having only a single formant. A matching procedure was used in which subjects selected a sound along a continuum differing in first formant frequency in order to get the best match with the target sound; perceptual effects of the phase manipulations in the target were detected as a change in the matched first formant frequency. Stimuli had to contain at least three harmonics to produce the effect, but it did not require a particular starting phase of the components. A suppression phenomenon is discussed, in which phase changes alter the phase-locking characteristics of auditory fibres tuned to low-numbered harmonics.     

The perception of back vowels: Centre of gravity hypothesis

According to the formant centre of gravity (FCOG) hypothesis, two vowel formants in close proximity are merged during perceptual analysis, and their contribution to vowel quality depends on the centre of gravity of the formant cluster. Findings consistent with this hypothesis are that two formants can be replaced by a single formant of intermediate centre frequency, provided their separation is less than 3-3.5 Bark; and that changes in their relative amplitudes produce systematic shifts in vowel quality. In Experiment 1, listeners adjusted the frequencies of F1 and F2 in a synthesized 6-formant vowel (with the F1-F2 separation fixed at 250 Hz, i.e. less than 3 Bark) to find the best phonetic match to a reference vowel with modified formant amplitudes. Contrary to FCOG predictions, F2 attenuation did not produce lower frequency matches. Raising the amplitude of F2 led to predicted upward shifts in formant frequencies of the matched vowel, but with increased variability of matches for some stimuli. In Experiment 2, listeners identified synthesized vowels with a range of separations of F1 and F2. Formant amplitude manipulations had no effect on listeners' judgements when the fundamental frequency was low (125 Hz). Small shifts in vowel quality appeared for stimuli with a high fundamental (250 Hz), but the shifts were significantly larger for F1-F2 separations greater than 3.5 Bark. These effects of formant amplitude are qualitatively different from those observed with single-formant vowels and are generally incompatible with a formant-averaging mechanism.     

知觉组织对时序知觉的双重影响:同时判断任务的证据

本研究探讨知觉组织对时序知觉的双重影响。实验采用三条线段构成的C形为实验材料,操纵图形朝向和SOA水平(实验1和实验2)、图形颜色(实验3)以及反应限制(实验4),要求被试完成同时判断任务。结果发现,在不同的SOA条件下,图形对向条件的同时判断频率均显著高于图形反向条件(实验1),即使在知觉组织线索弱化时这种现象仍然存在(实验2和实验3),而且知觉组织对时序知觉的影响不是由于被试的反应偏向导致的(实验4)。结果说明知觉组织对时序知觉存在双重影响:当两个刺激同时出现时,知觉组织能够提高时序知觉表现; 而当两个刺激非同时出现时,知觉组织显著降低时序知觉表现。     

Grouping frequency components of vowels: When is a harmonic not a harmonic?

When one harmonic of a vowel starts before and stops after the others, its contribution to the vowel's phonetic quality is reduced. Two experiments demonstrate that this reduction cannot be attributed entirely to adaptation. The first experiment shows that a harmonic that starts at the same time as a short vowel but continues after the vowel has ended contributes almost as little to the vowel's phonetic quality as a harmonic that starts before but stops at the same time as the vowel. The second experiment shows that the small contribution to vowel quality of a harmonic that starts before a vowel can be increased by adding an additional tone that will in turn form a perceptual group with that part of the harmonic preceding the vowel. The experiments demonstrate that some perceptual grouping operations are performed before the first formant of a vowel is estimated from the amplitudes of its component harmonics.     

Coherence masking protection in speech sounds: The role of formant synchrony

Three experiments were performed to examine listeners’ thresholds for identifying stimuli whose spectra were modeled after the vowels /i/ and /ε/, with the differences between these stimuli restricted to the frequency of the first formant. The stimuli were presented in a low-pass masking noise that spectrally overlapped the first formant but not the higher formants. Identification thresholds were lower when the higher formants were present than when they were not, even though the first formant contained the only distinctive information for stimulus identification. This indicates that listeners were more sensitive in identifying the first formant energy through its contribution to the vowel than as an independent percept; this effect is given the namecoherence masking protection. The first experiment showed this effect for synthetic vowels in which the distinctive first formant was supported by a series of harmonics that progressed through the higher formants. In the second two experiments, the harmonics in the first formant region were removed, and the first formant was simulated by a narrow band of noise. This was done so that harmonic relations did not provide a basis for grouping the lower formant with the higher formants; coherence masking protection was still observed. However, when the temporal alignment of the onsets and offsets of the higher and lower formants was disrupted, the effect was eliminated, although the stimuli were still perceived as vowels. These results are interpreted as indicating that general principles of auditory grouping that can exploit regularities in temporal patterns cause acoustic energy belonging to a coherent speech sound to stand out in the auditory scene.     

Categorization and normalization of vowels by 3-year-old children

A two-alternative, forced-choice procedure was used in two experiments to test 3-year-old children’s categorization of natural vowel tokens produced by several talkers. An appropriate pointing response (right or left) was visually reinforced with one of two television displays. In Experiment 1, the stimuli were isolated tokens of /a/ and /i/ produced by a male adult, a female adult, a male child, and a female child. In Experiment 2, the stimuli were isolated tokens of /æ/ and /∧/ produced by the same talkers. In both experiments, 3-year-olds spontaneously generalized their pointing responses from the male adult vowel tokens to the corresponding vowels produced by the other talkers. Children reinforced for an arbitrary grouping of the two vowel categories persisted in categorizing on the basis of vowel quality. Results from both experiments demonstrate the presence of perceptual constancy for vowel tokens across talkers. In particular, the results from Experiment 2 provide evidence for normalization of isolated, quasi-steady-state vowel tokens because the formant values for tokens of /∧/ produced by the woman and the two children were closer to the formant frequencies of the male adult’s /æ/ than to the male adult’s /∧/.     

Perception of spectral changes in multi-tone complexes

Amplitude changes of the spectral components of a complex tone, relative to each other, are usually well perceived, even if the over-all intensity is kept fixed. Three experiments are reported: Experiment 1 dealt with the detectability of amplitude changes in two-tone complexes of fixed frequencies. Experiment 2 examined detection of slope changes in ramp-shaped spectral envelopes of two-and three-tone complexes as a function of spectral spacing. As a control experiment for some conditions a roving intensity level was used. Experiment 3 investigated the detectability of changes in the spectral slope of multi-tone complexes as a function of the number of components. The results of the experiments show that detection of spectral changes in a sound is strongly dependent on the frequency spacing of the components. It is concluded that the auditory system is capable of comparing the relative energy distributions over different critical bands. Within a critical band there exists an optimum frequency separation with respect to the detection of relative amplitude change.     

Spatial frequency content of visual imagery

Three experiments employing the McCollough paradigm were conducted to determine the spatial-frequency content of visual imagery. In Experiment 1, large and reliable pattern-contingent color aftereffects were obtained after adaptation to visual imagery. The direction of the aftereffects indicated that subjects were adapting to higher spatial frequencies in their imagery. These results contrast with the data of Experiment 2, which demonstrate that color aftereffects obtained with adaptation to physically present stimuli are mediated by the fundamental spatial frequency components. The magnitude of the imagery-induced aftereffects in Experiment 1 equaled the magnitude of the externally induced aftereffects obtained in Experiment 2 with the same subjects. By blurring the to-be-imaged patterns (Experiment 3), the fundamental Fourier components became the salient perceptual features of the stimuli, and the direction of the imagery-induced aftereffects was reversed from that of Experiment 1, indicating that the spatial frequency content of the imagery had changed from higher to lower frequencies. Under normal viewing conditions, subjects use the higher spatial frequencies associated with the perceptually salient edges of stimuli to construct their images. The results of Experiments 1 and 3 are discussed in light of a current controversy over the nature of information representation in imagery, and it is concluded that support has been obtained for the analog model of visual imagery.     

Influence of vocalic context on perception of the [∫]-[s] distinction

When synthetic fricative noises from a [∫]-[s] continuum are followed by [a] or [u] (with appropriate formant transitions), listeners perceive more instances of [s] in the context of [u] than in the context of [a]. Presumably, this reflects a perceptual adjustment for the coarticulatory effect of rounded vowels on preceding fricatives. In Experiment 1, we found that varying the duration of the fricative noise leaves the perceptual context effect unchanged, whereas insertion of a silent interval following the noise reduces the effect substantially. Experiment 2 suggested that it is temporal separation rather than the perception of an intervening stop consonant that is responsible for this reduction, in agreement with recent, analogous observations on anticipatory coarticulation. In Experiment 3, we showed that the vowel context effect disappears when the periodic stimulus portion is synthesized so as to contain no formant transitions. To dissociate the contribution of formant transitions from contextual effects due to vowel quality per se, Experiment 4 employed synthetic fricative noises followed by periodic portions excerpted from naturally produced [∫a], [sa], [∫u], and [su]. The results showed strong and largely independent effects of formant transitions and vowel quality on fricative perception. In addition, we found a strong speaker (male vs. female) normalization effect. All three influences on fricative perception were reduced by temporal separation of noise and periodic stimulus portions. Although no single hypothesis can explain all of our results, they are generally supportive of the view that some knowledge of the dynamics of speech production has a role in speech perception.     

Perceptual grouping in space and time: Evidence from the Ternus display

We report three experiments investigating the effect of perceptual grouping on the appearance of a bistable apparent-motion (Ternus) display. Subjects viewed a Ternus display embedded in an array of context elements that could potentially group with the Ternus elements. In contrast to several previous findings, we found that grouping influenced apparent motion perception. In Experiment 1, apparent motion perception was significantly affected via grouping by shape similarity, even when the visible persistence of the elements was controlled. In Experiment 2, elements perceived as moving without context were perceived as stationary when grouped with stationary context elements. In Experiment 3, elements perceived as stationary without context were perceived as moving when grouped with moving context elements. We argue that grouping in the spatial and temporal domains interact to yield perceptual experience of apparent-motion displays.     

Perceptual grouping and distance estimates in typical and atypical development: comparing performance across perception, drawing and construction tasks

Perceptual grouping is a pre-attentive process which serves to group local elements into global wholes, based on shared properties. One effect of perceptual grouping is to distort the ability to estimate the distance between two elements. In this study, biases in distance estimates, caused by four types of perceptual grouping, were measured across three tasks, a perception, a drawing and a construction task in both typical development (TD: Experiment 1) and in individuals with Williams syndrome (WS: Experiment 2). In Experiment 1, perceptual grouping distorted distance estimates across all three tasks. Interestingly, the effect of grouping by luminance was in the opposite direction to the effects of the remaining grouping types. We relate this to differences in the ability to inhibit perceptual grouping effects on distance estimates. Additive distorting influences were also observed in the drawing and the construction task, which are explained in terms of the points of reference employed in each task. Experiment 2 demonstrated that the above distortion effects are also observed in WS. Given the known deficit in the ability to use perceptual grouping in WS, this suggests a dissociation between the pre-attentive influence of and the attentive deployment of perceptual grouping in WS. The typical distortion in relation to drawing and construction points towards the presence of some typical location coding strategies in WS. The performance of the WS group differed from the TD participants on two counts. First, the pattern of overall distance estimates (averaged across interior and exterior distances) across the four perceptual grouping types, differed between groups. Second, the distorting influence of perceptual grouping was strongest for grouping by shape similarity in WS, which contrasts to a strength in grouping by proximity observed in the TD participants.     

Spatial frequency requirements for audiovisual speech perception

Spatial frequency band-pass and low-pass filtered images of a talker were used in an audiovisual speech-in-noise task. Three experiments tested subjects' use of information contained in the different filter bands with center frequencies ranging from 2.7 to 44.1 cycles/face (c/face). Experiment 1 demonstrated that information from a broad range of spatial frequencies enhanced auditory intelligibility. The frequency bands differed in the degree of enhancement, with a peak being observed in a mid-range band (11-c/face center frequency). Experiment 2 showed that this pattern was not influenced by viewing distance and, thus, that the results are best interpreted in object spatial frequency, rather than in retinal coordinates. Experiment 3 showed that low-pass filtered images could produce a performance equivalent to that produced by unfiltered images. These experiments are consistent with the hypothesis that high spatial resolution information is not necessary for audiovisual speech perception and that a limited range of spatial frequency spectrum is sufficient.     

学习、频率和结构方式对汉字知觉干扰效应的影响

知觉干扰存效应是指之前更模糊的刺激的呈现对之后同一模糊刺激的识别的抑制。实验-考察了学习和频率、实验二考察了学习和结构方式对汉字知觉干扰存效应的影响。结果发现：1．汉字与图片一样,不存在材料有限现象,在学习和不学习条件下,汉字识别中均存在知觉干扰效应;2．学习以及频率和结构方式对汉字知觉干扰效应的影响也不显著;3．频率、学习和结构方式对汉字识别的影响显著。这些结果似乎表明当激活超过一定的水平时,和汉字激活水平有关的因素对知觉干扰效应不再起作用。失匹配假说可更好的解释激活水平的作用以及材料有限现象。     

The revelation effect in frequency judgment

In three experiments, we explored the revelation effect in a frequency judgment task. Participants estimated the frequency of words that had been presented one, two, four, or eight times. At test, half the words were revealed by completing word fragments, and half were presented intact. Estimated frequencies were reliably higher for revealed than for intact words, and in two of the three experiments, the revelation effect became larger as actual frequency increased. A revelation effect was obtained whether the revealed word was the same as (Experiment 1) or different from (Experiment 2) the word judged for frequency. Frequency estimates were higher for more distorted test items (Experiment 3).     

Harmonic,melodic, and frequency height influences in the perception of multivoiced music

Two experiments addressed the influences of harmonic relations, melody location, and relative frequency height on the perceptual organization of multivoiced music. In Experiment 1, listeners detected pitch changes in multivoiced piano music. Harmonically related pitch changes and those in the middle-frequency range were least noticeable. All pitch changes were noticeable in the high-frequency voice containing the melody (the most important voice), suggesting that melody can dominate harmonic relations. However, the presence of upper partials in the piano timbre used may have accounted for the harmonic effects. Experiment 2 employed pure sine tones, and replicated the effects of Experiment 1. In addition, the influence of the high-frequency melody on the noticeability of harmonically related pitches was lessened by the presence of a second melody. These findings suggest that harmonic, melodic, and relative frequency height relationships among voices interact in the perceptual organization of multivoiced music.     

Multidimensional voice program analysis in profoundly deaf children: quantifying frequency and amplitude control

Characterization of the vocal profile of profoundly deaf children using an objective voice analysis was carried out in a university-based pediatric otolaryngology clinic. 21 persons ages 3.5 to 18 years were assessed. From each sustained phonation of the vowel /a/ the following acoustic variables were extracted: fundamental frequency (F0), jitter percentage, shimmer percentage, fundamental frequency variation (vF0), peak amplitude variation (vAM), and first, second, and third formant frequencies (F1, F2, F3). Mean F0 was 267.8 Hz and consistent with established normative data. Mean measurements of jitter (0.88%) and shimmer (3.5%) were also within normal limits. The notable feature of the acoustic analysis was a statistically significant elevation in vF0 (2.81%) and vAM (23.58%). With the exception of one subject, the F1, F2, and F3 formant frequencies were comparable to those for normal hearing children. Auditory deprivation results in poor long-term control of frequency and amplitude during sustained phonation. The inability to maintain a sustained phonation may represent the partial collapse of an internal model of voice and speech.     

Developmental versus sensory deficit effects on perceptual processing in the reading disabled

Thirty children and 5 adults participated in two experiments designed to compare visual processing in normal and reading disabled children. The children were aged 8, 10, and 12 years. In Experiment 1, subjects were asked to detect the temporal order of two briefly presented stimuli. In Experiment 2, subjects sorted cards containing bracket stimuli that did or did not produce perceptual grouping effects. Poor readers required more time to make accurate temporal order judgments and showed stronger perceptual grouping effects. For both good and poor readers, the amount of time necessary to make a correct temporal order judgment decreased, and perceptual grouping effects became weaker with age. However, the magnitude of the difference between the groups did not lessen with age. These results suggest that there are visual processing differences between good and poor readers that do not appear to correct by age 12.     

Parallel and competitive processes in hierarchical analysis: perceptual grouping and encoding of closure.

The role of perceptual grouping and the encoding of closure of local elements in the processing of hierarchical patterns was studied. Experiments 1 and 2 showed a global advantage over the local level for 2 tasks involving the discrimination of orientation and closure, but there was a local advantage for the closure discrimination task relative to the orientation discrimination task. Experiment 3 showed a local precedence effect for the closure discrimination task when local element grouping was weakened by embedding the stimuli from Experiment 1 in a background made up of cross patterns. Experiments 4A and 4B found that dissimilarity of closure between the local elements of hierarchical stimuli and the background figures could facilitate the grouping of closed local elements and enhanced the perception of global structure. Experiment 5 showed that the advantage for detecting the closure of local elements in hierarchical analysis also held under divided- and selective-attention conditions. Results are consistent with the idea that grouping between local elements takes place in parallel and competes with the computation of closure of local elements in determining the selection between global and local levels of hierarchical patterns for response.     

Auditory objects of attention: the role of interaural time differences.

The role of interaural time difference (ITD) in perceptual grouping and selective attention was explored in 3 experiments. Experiment 1 showed that listeners can use small differences in ITD between 2 sentences to say which of 2 short, constant target words was part of the attended sentence, in the absence of talker or fundamental frequency differences. Experiments 2 and 3 showed that listeners do not explicitly track components that share a common ITD. Their inability to segregate a harmonic from a target vowel by a difference in ITD was not substantially changed by the vowel being placed in a sentence context, where the sentence shared the same ITD as the rest of the vowel. The results indicate that in following a particular auditory sound source over time, listeners attend to perceived auditory objects at particular azimuthal positions rather than attend explicitly to those frequency components that share a common ITD.     

Perceptual grouping of speech components differing in fundamental frequency and onset-time

Are there general auditory grouping principles that allow the sounds of a single speaker to be grouped together before phonetic categorisation? Four experiments are reported on the use made of a common fundamental frequency or a common starting time in grouping formants together to form phonetic categories. The first experiment shows that the perception of a vowel category is unaffected by formants being excited at different fundamentals or starting at 100-ms intervals. The second and third experiments show no effect of a different fundamental on the combination of the timbres of pairs of formants presented either binaurally or dichotically to form diphthongs. Onset-time also has no effect with binaural presentation. The fourth experiment finds both an effect of grouping formants by a common fundaental using formant trajectories that do not overlap in frequency, and also an effect of onset-time. Neither a common fundamental nor common onset-time is either a necessary or a sufficient condition for formants to be grouped into a common speech category, although they can be shown to exert an influence. Both these variables exert a considerable influence on the number of sounds that subjects report hearing, even under conditions where they do not influence the reported speech category, indicating a dissociation between mechanisms concerned with “how many” sound sources there are, and those concerned with “what” a source consists of.