Illusory continuity without sufficient sound energy to fill a temporal gap: Examples of crossing glide tones

The gap transfer illusion is an auditory illusion where a temporal gap inserted in a longer glide tone is perceived as if it were in a crossing shorter glide tone. Psychophysical and phenomenological experiments were conducted to examine the effects of sound-pressure-level (SPL) differences between crossing glides on the occurrence of the gap transfer illusion. We found that the subjective continuity-discontinuity of the crossing glides changed as a function of the relative level of the shorter glide to the level of the longer glide. When the relative level was approximately between -9 and +2 dB, listeners perceived the longer glide as continuous and the shorter glide as discontinuous, that is, the gap transfer illusion took place. The glides were perceived veridically below this range, that is, gap transfer did not take place, whereas above this range the longer glide and the shorter glide were both perceived as continuous. The fact that the longer glide could be perceived as continuous even when the crossing shorter glide was 9 dB weaker indicates that the longer glide's subjective continuity cannot be explained within the conventional framework of auditory organization, which assumes reallocation of sound energy from the shorter to the longer glide. The implicated mechanisms are discussed in terms of the temporal configuration of onsets and terminations and the time-frequency distribution of sound energy. (PsycINFO Database Record (c) 2012 APA, all rights reserved).     

The effect of a flashing visual stimulus on the auditory continuity illusion

The effect of a visual stimulus on the auditory continuity illusion was examined. Observers judged whether a tone that was repeatedly alternated with a band-pass noise was continuous or discontinuous. In most observers, a transient visual stimulus that was synchronized with the onset of the noise increased the limit of illusory continuity in terms of maximum noise duration and maximum tone level. The smaller the asynchrony between the noise onset and the visual stimulus onset, the larger the visual effect on this illusion. On the other hand, detection of a tone added to the noise was not enhanced by the visual stimulus. These results cannot be fully explained by the conventional theory that illusory continuity is created by the decomposition of peripheral excitation produced by the occluding sound.     

Dominance of persistence over adaptation in forward masking

Persistence of excitation and neural adaptation are competing theories proposed to explain the mechanisms underlying psychophysical forward masking. Previous research has been directed towards finding models that accurately describe the phenomenon but cannot account for the underlying explanation. The current study was designed to determine which theory best accounts for results obtained from behavioral gap duration adjustment tasks. Thirteen adults adjusted the gap within asymmetrical noise markers to be subjectively equal to the gap within equal-intensity-noise markers. The duration of the perceived gap between the asymmetrical markers is expected to vary depending on which theory dominates perception. The persistence of excitation mechanism would lead to longer duration gaps when the second noise marker is lower in intensity than the preceding. Neural adaptation would result in matched gaps that are shorter in duration when the second noise marker was lower in level. The outcome of our data analysis is consistent with the persistence of excitation as a dominant mechanism in forward masking.     

听觉信息掩蔽的亚成分：基于行为和脑成像研究的证明

听觉掩蔽的机制是解决嘈杂声学环境下对特定目标声音进行加工, 即“鸡尾酒会”问题的关键。听觉掩蔽可以分为能量掩蔽和信息掩蔽两种类型。前者是因为目标和掩蔽声音在听觉外周在时间和频率上的重叠所造成的, 而后者被认为是掩蔽声音在听觉中枢和目标声音竞争加工资源所造成的。长久以来, 信息掩蔽一直被当作一种单一成分的现象, 这一概念框架已经成为制约对其机制进行深入研究的一个瓶颈。信息掩蔽中至少包含有知觉信息掩蔽和认知信息掩蔽两种亚成分, 它们源于不同的中枢机制。多个说话人声音掩蔽的条件下, 总体掩蔽量是能量掩蔽、知觉信息掩蔽和认知信息掩蔽等成分总和的结果。操纵掩蔽和目标声音的知觉空间分离、掩蔽声音的可懂度以及掩蔽和目标声音的知觉相似度, 可以实现对两种信息掩蔽亚成分的双重分离。应用功能性核磁共振成像技术可以发现两者有不同的神经机制。     

Shrinkage in the perceived duration of speech and tone by acoustic replacement1

Abstract: To investigate mechanisms for perceiving the duration of an auditory event, an effect of perceptual grouping upon perceived duration was studied psychophysically. In the first experiment, the perceived duration of a spoken word was measured under three conditions of acoustic continuity (i.e., (a) intact, (b) noise‐replaced, and (c) gap‐replaced) as a function of the duration of the target stimulus. Under the noise‐replaced condition, a portion of the target stimulus was physically replaced with a noise burst. Under the gap‐replaced condition, the replacement was made with a gap. The gap‐replacement resulted in a prominent shrinkage of the perceived duration. In the case of noise‐replacement, the amount of shrinkage was moderate but highly significant, although the word employed was perceived to be phonetically intact. Independent of this effect of replacement, the amount of shrinkage was also affected by the physical duration of the target stimulus. The second experiment tested an effect of noise replacement on the perceived duration of a tone burst. In this case, the noise replacement also shrunk the perceived duration of the non‐speech stimulus. This noise‐induced shrinkage could be regarded as being general for the auditory duration. The phenomenon is discussed in relation to a revised model for perceived duration.     

集中和分散注意对多感觉整合中听觉主导效应的影响

听觉主导效应是指多感觉通道信息整合过程中,听觉通道中的信息得到优先加工,从而主导其他感觉通道的信息。研究采用经典的声音诱发闪光错觉的范式,通过两个实验操纵了注意资源的分配方式以及实验任务难度,考察了主动注意听觉通道的声音刺激对声音诱发闪光错觉产生的影响,以及任务难度对声音诱发闪光错觉的影响。结果发现:(1)裂变错觉会受到注意资源分配程度的影响,但是融合错觉则不然;(2)任务难度既不会影响裂变错觉,也不会影响融合错觉。说明了分散注意能够影响听觉主导效应中的裂变错觉,并且这种主导效应与任务难度无关。     

Auditory induction: Reciprocal changes in alternating sounds

When portions of a sound are replaced by a potential masker, the missing fragments may be perceptually restored, resulting in apparent continuity of the interrupted signal. This phenomenon has been examined extensively by using pulsation threshold, auditory induction, and phonemic restoration paradigms in which two sounds, the inducer and the inducee, are alternated (ABABA ... ), and the conditions required for apparent continuity of the lower amplitude inducee are determined. Previous studies have generally neglected to examine concomitant changes produced in the inducing sound. Results from the present experiments have demonstrated decreases in the loudness of inducers using inducer/inducee pairs consisting of tone/tone and noise/noise, as well as the noise/speech pairs associated with phonemic restorations. Interestingly, reductions in inducer loudness occurred even when the inducee was heard as discontinuous, and these decreases in loudness were accompanied by graded increases in apparent duration of the inducee, contrary to the conventional view of auditory induction as an all-or-none phenomenon. Under some conditions, the reduced loudness of the inducer was coupled with a marked alteration in its timbre. Especially profound changes in the inducer quality occurred when the alternating stimuli were tones having the same frequency and differing only in intensity-it seems that following subtraction of components corresponding to the inducee, an anomalous auditory residue remained that did not correspond to the representation of a tone.     

The perception of concurrent sound objects in harmonic complexes impairs gap detection

Since the introduction of the concept of auditory scene analysis, there has been a paucity of work focusing on the theoretical explanation of how attention is allocated within a complex auditory scene. Here we examined signal detection in situations that promote either the fusion of tonal elements into a single sound object or the segregation of a mistuned element (i.e., harmonic) that "popped out" as a separate individuated auditory object and yielded the perception of concurrent sound objects. On each trial, participants indicated whether the incoming complex sound contained a brief gap or not. The gap (i.e., signal) was always inserted in the middle of one of the tonal elements. Our findings were consistent with an object-based account in which perception of two simultaneous auditory objects interfered with signal detection. This effect was observed for a wide range of gap durations and was greater when the mistuned harmonic was perceived as a separate object. These results suggest that attention may be initially shared among concurrent sound objects thereby reducing listeners' ability to process acoustic details belonging to a particular sound object. These findings provide new theoretical insight for our understanding of auditory attention and auditory scene analysis.     

Illusory recouplings of onsets and terminations of glide tone components

We present a new auditory illusion, the gap transfer illusion, supported by phenomenological and psychophysical data. In a typical situation, an ascending frequency glide of 2,500 msec with a temporal gap of 100 msec in the middle and a continuously descending frequency glide of 500 msec cross each other at their central positions. These glides move at the same constant speed in logarithmic frequency in opposite directions. The temporal gap in the long glide is perceived as if it were in the short glide. The same kind of subjective transfer of a temporal gap can take place also when the stimulus pattern is reversed in time. This phenomenon suggests that onsets and terminations of glide components behave as if they were independent perceptual elements. We also find that when two long frequency glides are presented successively with a short temporal overlap, a long glide tone covering the whole duration of the pattern and a short tone around the temporal middle can be perceived. To account for these results, we propose an event construction model, in which perceptual onsets and terminations are coupled to construct auditory events and the proximity principle connects these elements.     

Hearing visuo‐tactile synchrony – Sound‐induced proprioceptive drift in the invisible hand illusion

The rubber hand illusion (RHI) and its variant the invisible hand illusion (IHI) are useful for investigating multisensory aspects of bodily self‐consciousness. Here, we explored whether auditory conditioning during an RHI could enhance the trisensory visuo‐tactile‐proprioceptive interaction underlying the IHI. Our paradigm comprised of an IHI session that was followed by an RHI session and another IHI session. The IHI sessions had two parts presented in counterbalanced order. One part was conducted in silence, whereas the other part was conducted on the backdrop of metronome beats that occurred in synchrony with the brush movements used for the induction of the illusion. In a first experiment, the RHI session also involved metronome beats and was aimed at creating an associative memory between the brush stroking of a rubber hand and the sounds. An analysis of IHI sessions showed that the participants’ perceived hand position drifted more towards the body‐midline in the metronome relative to the silent condition without any sound‐related session differences. Thus, the sounds, but not the auditory RHI conditioning, influenced the IHI. In a second experiment, the RHI session was conducted without metronome beats. This confirmed the conditioning‐independent presence of sound‐induced proprioceptive drift in the IHI. Together, these findings show that the influence of visuo‐tactile integration on proprioceptive updating is modifiable by irrelevant auditory cues merely through the temporal correspondence between the visuo‐tactile and auditory events.     

Subjectively divided tone components in the gap transfer illusion

When a long glide with a short temporal gap in its middle crosses with a continuous short glide at the temporal midpoint of both glides, the gap is perceived in the short glide instead of in the long glide. In the present article, we tested possible explanations for this "gap transfer illusion" by obtaining points of subjective equality of the pitches and durations of the two short tones that are subjectively divided by the gap. The results of two experiments showed that neither an explanation in terms ofenvelope patterns nor explanations in terms of combinationtones or acoustic beats could account for the perception of the short tones in the gap transfer illusion. Rather, the results were compatible with the idea that the illusory tones were formed by the perceptual integration of onsets and offsets of acoustically different sounds. Implications for the perceptual construction of auditory events are discussed.     

Lexical Mediation Between Sight and Sound in Speechreading

In two experiments, we investigated whether simultaneous speech reading can influence the detection of speech in envelope-matched noise. Subjects attempted to detect the presence of a disyllabic utterance in noise while watching a speaker articulate a matching or a non-matching utterance. Speech detection was not facilitated by an audio-visual match, which suggests that listeners relied on low-level auditory cues whose perception was immune to cross-modal top-down influences. However, when the stimuli were words (Experiment 1), there was a (predicted) relative shift in bias, suggesting that the masking noise itself was perceived as more speechlike when its envelope corresponded to the visual information. This bias shift was absent, however, with non-word materials (Experiment 2). These results, which resemble earlier findings obtained with orthographic visual input, indicate that the mapping from sight to sound is lexically mediated even when, as in the case of the articulatory-phonetic correspondence, the cross-modal relationship is non-arbitrary.     

Is the weber fraction a function of physical or perceived input?

It is well known that a given physical input (e.g. intensity of light or sound, length or weight of an object) does not always give rise to the same sensation. For example, arrow heads affect the perceived length of lines (Muller-Lyer illusion) and size affects the apparent weight of an object (size-weight illusion). It is generally assumed that the differential threshold is a simple function of the physical intensity of the stimulus. We may however ask whether the differential threshold is affected by illusions.

To try to answer this question we estimate differential thresholds under a pair of conditions in which the relevant input is the same but appears different. Using the size-weight illusion, we have found that the differential threshold for weight is greater for a set of small weights than for a set of larger and apparently lighter weights.     

Does irrelevant music cause an irrelevant sound effect for auditory items?

The irrelevant sound effect (ISE) describes the significant reduction in verbal serial recall during irrelevant sounds with distinct temporal-spectral variations (changing-state sound). Whereas the ISE is well-documented for the serial recall of visual items accompanied by irrelevant speech and nonspeech sounds, an ISE caused by nonspeech sounds has not been reported for auditory items. Closing this empirical gap, Experiment 1 (n=90) verified that instrumental staccato-music reduces auditory serial recall compared to legato-music and silence. Its detrimental impact was not due to perceptual masking, disturbed encoding, or increased listening effort, as the employed experimental design and methods ensured. The found nonspeech ISE in auditory serial recall is corroborated by Experiment 1b (n=60), which, by using the same experimental design and methods, replicated the well-known ISE during irrelevant changing-state speech compared to steady-state speech, pink noise, and silence.     

Feature assignment in perception of auditory figure

Because the environment often includes multiple sounds that overlap in time, listeners must segregate a sound of interest (the auditory figure) from other co-occurring sounds (the unattended auditory ground). We conducted a series of experiments to clarify the principles governing the extraction of auditory figures. We distinguish between auditory "objects" (relatively punctate events, such as a dog's bark) and auditory "streams" (sounds involving a pattern over time, such as a galloping rhythm). In Experiments 1 and 2, on each trial 2 sounds-an object (a vowel) and a stream (a series of tones)-were presented with 1 target feature that could be perceptually grouped with either source. In each block of these experiments, listeners were required to attend to 1 of the 2 sounds, and report its perceived category. Across several experimental manipulations, listeners were more likely to allocate the feature to an impoverished object if the result of the grouping was a good, identifiable object. Perception of objects was quite sensitive to feature variation (noise masking), whereas perception of streams was more robust to feature variation. In Experiment 3, the number of sound sources competing for the feature was increased to 3. This produced a shift toward relying more on spatial cues than on the potential contribution of the feature to an object's perceptual quality. The results support a distinction between auditory objects and streams, and provide new information about the way that the auditory world is parsed.     

Binaural release from temporal induction

This study examined the effects of interaural phase difference (IPhD) relations in temporal induction (TI)—that is, the perceived continuity of a fainter sound (inducee) through an interrupting higher amplitude sound (inducer). The extent of TI was measured both directly as the upper amplitude level for continuity and indirectly as the loudness reduction of the inducer. It was found that TI was inhibited when the IPhD of the inducer and the IPhD of the inducee differed. It was also found that the extent of induction was positively related to the masking potential of the inducer as measured by the binaural masking level difference procedure. These results suggest that TI involves processes that are affected by interaural phase differences and that the masking potential rule, shown by previous studies to apply in the frequency domain, applies also in the IPhD domain. The present findings are consistent with the hypothesis that TI results from allocation of a portion of the neural excitation produced by the inducer over to the inducee if the inducer has the appropriate masking potential. As a consequence, obliterated signals can be selectively restored on the basis of both frequency-specific monaural cues and azimuth-related binaural cues, abilities that can enhance detection of signals under the noisy conditions of everyday life.     

Nonsimultaneous auditory masking in the budgerigar (Melopsittacus undulatus)

The frequency resolving power of budgerigars and that of humans were compared on several nonsimultaneous masking procedures in which one pure tone is used to mask another. Similar patterns of frequency selectivity were found for all three masking procedures (forward, backward, and combined forward-backward) for both species. Budgerigars showed considerably greater frequency resolving power on all three procedures than humans. Budgerigars also showed differences in frequency resolving power across masking conditions, but human listeners did not. These results indicate that the budgerigar auditory system may be even more highly tuned than was previously thought and suggest fundamental differences between the mechanisms of frequency selectivity of bird and those of humans.     

Coherence masking protection in speech sounds: The role of formant synchrony

Three experiments were performed to examine listeners’ thresholds for identifying stimuli whose spectra were modeled after the vowels /i/ and /ε/, with the differences between these stimuli restricted to the frequency of the first formant. The stimuli were presented in a low-pass masking noise that spectrally overlapped the first formant but not the higher formants. Identification thresholds were lower when the higher formants were present than when they were not, even though the first formant contained the only distinctive information for stimulus identification. This indicates that listeners were more sensitive in identifying the first formant energy through its contribution to the vowel than as an independent percept; this effect is given the namecoherence masking protection. The first experiment showed this effect for synthetic vowels in which the distinctive first formant was supported by a series of harmonics that progressed through the higher formants. In the second two experiments, the harmonics in the first formant region were removed, and the first formant was simulated by a narrow band of noise. This was done so that harmonic relations did not provide a basis for grouping the lower formant with the higher formants; coherence masking protection was still observed. However, when the temporal alignment of the onsets and offsets of the higher and lower formants was disrupted, the effect was eliminated, although the stimuli were still perceived as vowels. These results are interpreted as indicating that general principles of auditory grouping that can exploit regularities in temporal patterns cause acoustic energy belonging to a coherent speech sound to stand out in the auditory scene.     

Perceptual completion of a sound with a short silent gap

Listeners reported the perceptual completion of a sound in stimuli consisting of two crossing frequency glides of unequal duration that shared a short silent gap (40 ms or less) at their crossing point. Even though both glides shared the gap, it was consistently perceived only in the shorter glide, whereas the longer glide could be perceptually completed. Studies on perceptual completion in the auditory domain reported so far have shown that completion of a sound with a gap occurs only if the gap is filled with energy from another sound. In the stimuli used here, however, no such substitute energy was present in the gap, showing evidence for perceptual completion of a sound without local stimulation ('modal' completion). Perceptual completion of the long glide occurred under both monaural and dichotic presentation of the gap-sharing glides; it therefore involves central stages of auditory processing. The inclusion of the gap in the short glide, rather than in both the long and the short glide, is explained in terms of auditory event and stream formation.     

Incidental sounds of locomotion in animal cognition

The highly synchronized formations that characterize schooling in fish and the flight of certain bird groups have frequently been explained as reducing energy expenditure. I present an alternative, or complimentary, hypothesis that synchronization of group movements may improve hearing perception. Although incidental sounds produced as a by-product of locomotion (ISOL) will be an almost constant presence to most animals, the impact on perception and cognition has been little discussed. A consequence of ISOL may be masking of critical sound signals in the surroundings. Birds in flight may generate significant noise; some produce wing beats that are readily heard on the ground at some distance from the source. Synchronization of group movements might reduce auditory masking through periods of relative silence and facilitate auditory grouping processes. Respiratory locomotor coupling and intermittent flight may be other means of reducing masking and improving hearing perception. A distinct border between ISOL and communicative signals is difficult to delineate. ISOL seems to be used by schooling fish as an aid to staying in formation and avoiding collisions. Bird and bat flocks may use ISOL in an analogous way. ISOL and interaction with animal perception, cognition, and synchronized behavior provide an interesting area for future study.