Illusory conjunctions of pitch and duration in unfamiliar tone sequences

In 3 experiments, the authors examined short-term memory for pitch and duration in unfamiliar tone sequences. Participants were presented a target sequence consisting of 2 tones (Experiment 1) or 7 tones (Experiments 2 and 3) and then a probe tone. Participants indicated whether the probe tone matched 1 of the target tones in both pitch and duration. Error rates were relatively low if the probe tone matched 1 of the target tones or if it differed from target tones in pitch, duration, or both. Error rates were remarkably high, however, if the probe tone combined the pitch of 1 target tone with the duration of a different target tone. The results suggest that illusory conjunctions of these dimensions frequently occur. A mathematical model is presented that accounts for the relative contribution of pitch errors, duration errors, and illusory conjunctions of pitch and duration.     

Interference in Immediate Spatial Memory: Shifts of Spatial Attention or Central executive Involvement?

Interference in serial spatial memory was investigated in six experiments. Experiment 1 replicated Experiment 2 by Smyth and Scholey (1994) in showing that listening to tones that originated from different directions interfered with spatial memory. Experiment 2 showed, however, that the effect of mere listening was not observed when this was the only interference condition experienced by the subject. In Experiment 3, a binary pitch discrimination task performed on spatially separated tones impaired recall performance to the same extent as did left-right decisions. The same disrupting effect was also observed when the tones were presented from the same direction in the pitch discrimination task (Experiment 4) as well as in a binary loudness discrimination task (Experiment 5). Finally, repeating heard words did not interfere, whereas a pitch discrimination performed on these same words disrupted recall (Experiment 6). It is argued that the disrupting effects reflect not a specifically spatial interference, but a central executive involvement in the rehearsal process in serial spatial memory.     

The effect of intensity on relative pitch

In two experiments, we examined the effect of intensity and intensity change on judgements of pitch differences or interval size. In Experiment 1, 39 musically untrained participants rated the size of the interval spanned by two pitches within individual gliding tones. Tones were presented at high intensity, low intensity, looming intensity (up-ramp), and fading intensity (down-ramp) and glided between two pitches spanning either 6 or 7 semitones (a tritone or a perfect fifth interval). The pitch shift occurred in either ascending or descending directions. Experiment 2 repeated the conditions of Experiment 1 but the shifts in pitch and intensity occurred across two discrete tones (i.e., a melodic interval). Results indicated that participants were sensitive to the differences in interval size presented: Ratings were significantly higher when two pitches differed by 7 semitones than when they differed by 6 semitones. However, ratings were also dependent on whether the interval was high or low in intensity, whether it increased or decreased in intensity across the two pitches, and whether the interval was ascending or descending in pitch. Such influences illustrate that the perception of pitch relations does not always adhere to a logarithmic function as implied by their musical labels, but that identical intervals are perceived as substantially different in size depending on other attributes of the sound source.     

The effect of intensity on relative pitch

In two experiments, we examined the effect of intensity and intensity change on judgements of pitch differences or interval size. In Experiment 1, 39 musically untrained participants rated the size of the interval spanned by two pitches within individual gliding tones. Tones were presented at high intensity, low intensity, looming intensity (up-ramp), and fading intensity (down-ramp) and glided between two pitches spanning either 6 or 7 semitones (a tritone or a perfect fifth interval). The pitch shift occurred in either ascending or descending directions. Experiment 2 repeated the conditions of Experiment 1 but the shifts in pitch and intensity occurred across two discrete tones (i.e., a melodic interval). Results indicated that participants were sensitive to the differences in interval size presented: Ratings were significantly higher when two pitches differed by 7 semitones than when they differed by 6 semitones. However, ratings were also dependent on whether the interval was high or low in intensity, whether it increased or decreased in intensity across the two pitches, and whether the interval was ascending or descending in pitch. Such influences illustrate that the perception of pitch relations does not always adhere to a logarithmic function as implied by their musical labels, but that identical intervals are perceived as substantially different in size depending on other attributes of the sound source.     

Sequential grouping of pure-tone percepts evoked by the segregation of components from a complex tone

A sudden change applied to a single component can cause its segregation from an ongoing complex tone as a pure-tone-like percept. Three experiments examined whether such pure-tone-like percepts are organized into streams by extending the research of Bregman and Rudnicky (1975). Those authors found that listeners struggled to identify the presentation order of 2 pure-tone targets of different frequency when they were flanked by 2 lower frequency "distractors." Adding a series of matched-frequency "captor" tones, however, improved performance by pulling the distractors into a separate stream from the targets. In the current study, sequences of discrete pure tones were substituted by sequences of brief changes applied to an otherwise constant 1.2-s complex tone. Pure-tone-like percepts were evoked by applying 6-dB increments to individual components of a complex comprising harmonics 1-7 of 300 Hz (Experiment 1) or 0.5-ms changes in interaural time difference to individual components of a log-spaced complex (range 160-905 Hz; Experiment 2). Results were consistent with the earlier study, providing clear evidence that pure-tone-like percepts are organized into streams. Experiment 3 adapted Experiment 1 by presenting a global amplitude increment either synchronous with, or just after, the last captor prior to the 1st distractor. In the former case, for which there was no pure-tone-like percept corresponding to that captor, the captor sequence did not aid performance to the same extent as previously. It is concluded that this change to the captor-tone stream partially resets the stream-formation process, and so the distractors and targets became likely to integrate once more.     

Perceived intensity effects in the octave illusion

We showed that there is an intensity aspect to the octave illusion in addition to the pitch and location aspects originally reported by Deutsch (1974). In Experiment 1, we asked participants to directly compare the stimulus giving rise to the illusion (ILLU) with one mimicking its most commonly reported percept (illusion consistent; IC) and showed that they were easily able to distinguish between the two. In Experiment 2, we demonstrated a clear difference between the perceived loudness of ILLU and IC when IC follows ILLU, but not when IC precedes ILLU. In Experiments 3 and 4, we showed that this effect depends on the alternation of high and low tones between the ears in an extended pattern. In Experiment 5, we showed that this difference in perceived loudness disappears if the interval between the ILLU and IC stimuli is sufficiently large.     

Effects of redundant auditory stimuli on reaction time

Auditory redundancy gains were assessed in two experiments in which a simple reaction time task was used. In each trial, an auditory stimulus was presented to the left ear, to the right ear, or simultaneously to both ears. The physical difference between auditory stimuli presented to the two ears was systematically increased across experiments. No redundancy gains were observed when the stimuli were identical pure tones or pure tones of different frequencies (Experiment 1). A clear redundancy gain and evidence of coactivation were obtained, however, when one stimulus was a pure tone and the other was white noise (Experiment 2). Experiment 3 employed a two-alternative forced choice localization task and provided evidence that dichotically presented pure tones of different frequencies are apparently integrated into a single percept, whereas a pure tone and white noise are not fused. The results extend previous findings of redundancy gains and coactivation with visual and bimodal stimuli to the auditory modality. Furthermore, at least within this modality, the results indicate that redundancy gains do not emerge when redundant stimuli are integrated into a single percept.     

Expectancy in melody: tests of children and adults

Melodic expectancies among children and adults were examined. In Experiment 1, adults, 11-year-olds, and 8-year-olds rated how well individual test tones continued fragments of melodies. In Experiment 2, 11-, 8-, and 5-year-olds sang continuations to 2-tone stimuli. Response patterns were analyzed using 2 models of melodic expectancy. Despite having fewer predictor variables, the 2-factor model (E. G. Schellenberg, 1997) equaled or surpassed the implication-realization model (E. Narmour, 1990) in predictive accuracy. Listeners of all ages expected the next tone in a melody to be proximate in pitch to the tone heard most recently. Older listeners also expected reversals of pitch direction, specifically for tones that changed direction after a disruption of proximity and for tones that formed symmetric patterns.     

On cross-modal similarity: the perceptual structure of pitch, loudness, and brightness

Examined how pitch and loudness correspond to brightness. In the Experiment 1, 16 Ss identified which of 2 lights more resembled each of 16 tones; in Experiment 2, 8 of the same 16 Ss rated the similarity of lights to lights, tones to tones, and lights to tones. (1) Pitch and loudness both contributed to cross-modal similarity, but for most Ss pitch contributed more. (2) Individuals differed as to whether pitch or loudness contributed more; these differences were consistent across matching and similarity scaling. (3) Cross-modal similarity depended largely on relative stimulus values. (4) Multidimensional scaling revealed 2 perceptual dimensions, loudness and pitch, with brightness common to both. A simple quantitative model can describe the cross-modal comparisons, compatible with the view that perceptual similarity may be characterized through a malleable spatial representation that is multimodal as well as multidimensional.     

Influence of tonal context and timbral variation on perception of pitch

In this study, spectral timbre's effect on pitch perception is examined in varying contexts. In two experiments, subjects detected pitch deviations of tones differing in brightness in an isolated context in which they compared two tones, in a tone-series context in which they judged whether the last tone of a simple sequence was in or out of tune, and in a melodic context in which they determined whether the last note of familiar melodies was in or out of tune. Timbre influenced pitch judgments in all the conditions, but increasing tonal context allowed the subjects to extract pitch information more accurately. This appears to be due to two factors: (1) The presence of extra tones creates a stronger reference point from which to judge pitch, and (2) the melodies' tonal structure gives more cues that facilitate pitch extraction, even in the face of conflicting spectral information.     

Pitch perception and retention: two cumulative benefits of selective attention

By presenting, before a "chord" of three pure tones with remote frequencies, a tone relatively close in frequency to one component (T1) of the chord, one can direct the listener's attention onto T1 within the chord. In the first part of the present study, it was found that this increases the accuracy with which the pitch of T1 is perceived. The attentional cue improved the discrimination between the frequency of T1 and that of another tone (T2) presented immediately after the chord or very shortly (300 msec) after it. No improvement was found when T1 was presented alone instead of within a chord. A subsequent experiment, in which the chord and T2 were separated by either 300 msec or 4 sec, indicated that the attentional cue improved not only the perception, but also the memorization of the pitch of T1 (especially when T1 was the intermediate component of the chord). It is argued that the positive effect of attention on memory took place when the pitch percept was encoded into memory, rather than after the formation of the pitch memory trace.     

A frog in your throat or in your ear? Searching for the causes of poor singing

Singing is a cultural universal and an important part of modern society, yet many people fail to sing in tune. Many possible causes have been posited to explain poor singing abilities; foremost among these are poor perceptual ability, poor motor control, and sensorimotor mapping errors. To help discriminate between these causes of poor singing, we conducted 5 experiments testing musicians and nonmusicians in pitch matching and judgment tasks. Experiment 1 introduces a new instrument called a slider, on which participants can match pitches without using their voice. Pitch matching on the slider can be directly compared with vocal pitch matching, and results showed that both musicians and nonmusicians were more accurate using the slider than their voices to match target pitches, arguing against a perceptual explanation of singing deficits. Experiment 2 added a self-matching condition and showed that nonmusicians were better at matching their own voice than a synthesized voice timbre, but were still not as accurate as on the slider. This suggests a timbral translation type of mapping error. Experiments 3 and 4 demonstrated that singers do not improve over multiple sung responses, or with the aid of a visual representation of pitch. Experiment 5 showed that listeners were more accurate at perceiving the pitch of the synthesized tones than actual voice tones. The pattern of results across experiments demonstrates multiple possible causes of poor singing, and attributes most of the problem to poor motor control and timbral-translation errors, rather than a purely perceptual deficit, as other studies have suggested.     

Context sensitivity and invariance in perception of octave-ambiguous tones

Three experiments investigated the influence of unambiguous (UA) context tones on the perception of octave-ambiguous (OA) tones. In Experiment 1, pairs of OA tones spanning a tritone interval were preceded by pairs of UA tones instantiating a rising or falling interval between the same pitch classes. Despite the inherent ambiguity of OA tritone pairs, most participants showed little or no priming when judging the OA tritone as rising or falling. In Experiments 2 and 3, participants compared the pitch heights of single OA and UA tones representing either the same pitch class or being a tritone apart. These judgments were strongly influenced by the pitch range of the UA tones, but only slightly by the spectral center of the OA tones. Thus, the perceived pitch height of single OA tones is context sensitive, but the perceived relative pitch height of two OA tones, as described in previous research on the “tritone paradox,” is largely invariant in UA tone contexts.     

Evidence for two pitch encoding mechanisms using a selective auditory training paradigm

The neural mechanisms underlying the perception of pitch, a sensory attribute of paramount importance in hearing, have been a matter of debate for over a century. A question currently at the heart of the debate is whether the pitch of all harmonic complex tones can be determined by the auditory system's using a single mechanism, or whether two different neural mechanisms are involved, depending on the stimulus conditions. When the harmonics are widely spaced, as is the case at high fundamental frequencies (FOs), and/or when the frequencies of the harmonics are low, the frequency components of the sound fall in different peripheral auditory channels and are then "resolved" by the peripheral auditory system. In contrast, at low F0s, or when the harmonics are high in frequency, several harmonics interact within the passbands of the same auditory filters, being thus "unresolved" by the peripheral auditory system. The idea that more than one mechanism mediates the encoding of pitch depending on the resolvability status of the harmonics was investigated here by testing for transfer of learning in F0 discrimination between different stimulus conditions involving either resolved or unresolved harmonics after specific training in one of these conditions. The results, which show some resolvability-specificity of F0-discrimination learning, support the hypothesis that two different underlying mechanisms mediate the encoding of the F0 of resolved and unresolved harmonics.     

Tonal expectations influence pitch perception

In this study, we investigated the influence of tonal relatedness on pitch perception in melodies. Tonal expectations for target tones were manipulated in melodic contexts while controlling sensory expectations, thus allowing us to assess specifically the influence oftonal expectations on pitch perception. Three experimentsprovided converging evidence that tonal relatedness modulates pitch perception in nonmusician listeners. Experiment 1 showed, with a rating task, the influence of the tonal relatedness of a target tone on listeners' judgments of tuning/mistuning. Experiment 2 showed, with a priming task, that pitch processing of in-tune tones was faster for tonally related targets than for less related targets. Experiment 3 showed, with a comparison task, that discrimination performance for small mistunings was better when the to-be-compared tones were tonally related to the melodic context. Findings are discussed in relation to psychoacoustic research on contextual pitch perception and to studies showing facilitation of early processing steps via knowledge- and attention-related processes.     

Processes underlying dimensional interactions: Correspondences between linguistic and nonlinguistic dimensions

In six experiments, we examined speeded classification when one dimension was linguistic and the other was nonlinguistic. In five of these, attributes on the dimensions corresponded meaningfully, having in common the concepts "high" and "low." For example, in Experiment 1, the visually presented words HI and LO were paired with high- or low-pitched tones; in Experiment 2, the dimensions were visual words and vertical position, in Experiment 3, they were spoken words and position, and in Experiments 4 and 5, spoken words and pitch. For each dimension in each pair, subjects suffered Garner interference when dimensions were varied orthogonally. Garner interference remained constant across 15 blocks of trials (Experiment 5). Subjects also showed significant congruity effects in all experiments, with attributes from congruent stimuli (e.g., HI/high pitch) classified faster than attributes from incongruent stimuli (e.g., HI/low pitch). These results differ from those obtained previously with noncorresponding pairs of linguistic-nonlinguistic dimensions. The results also differ from those obtained with traditional Stroop dimensions (colors and color words; Experiment 6), which showed minimal Garner interference and diminishing congruity effects across blocks of trials. We conclude that the interactions found here represent cross-talk between channels within a semantic level of processing. We contrast our view with current models of dimensional interaction.     

Auditory grouping based on fundamental frequency and formant peak frequency

The perceptual grouping of a four-tone cycle was studied as a function of differences in fundamental frequencies and the frequencies of spectral peaks. Each tone had a single formant and at least 13 harmonics. In Experiment 1 the formant was created by filtering a flat spectrum and in Experiment 2 by adding harmonics. Fundamental frequency was found to be capable of controlling grouping even when the spectra spanned exactly the same frequency range. Formant peak separation became more effective as the sharpness (amplitude of the peak relative to a spectral pedestal) increased. The effect of each type of acoustic difference depended on the task. Listeners could group the tones by either sort of difference but were also capable of resisting the disruptive effect of the other one. This was taken as evidence for the presence of a schema-based process of perceptual grouping and the relative weakness of primitive segregation.     

Referential coding contributes to the horizontal SMARC effect

The present study tested whether coding of tone pitch relative to a referent contributes to the correspondence effect between the pitch height of an auditory stimulus and the location of a lateralized response. When left-right responses are mapped to high or low pitch tones, performance is better with the high-right/low-left mapping than with the opposite mapping, a phenomenon called the horizontal SMARC effect. However, when pitch height is task irrelevant, the horizontal SMARC effect occurs only for musicians. In Experiment 1, nonmusicians performed a pitch discrimination task, and the SMARC effect was evident regardless of whether a referent tone was presented. However, in Experiment 2, for a timbre-judgment task, nonmusicians showed a SMARC effect only when a referent tone was presented, whereas musicians showed a SMARC effect that did not interact with presence/absence of the referent. Dependence of the SMARC effect for nonmusicians on a reference tone was replicated in Experiment 3, in which judgments of the color of a visual stimulus were made in the presence of a concurrent high- or low-pitched pure tone. These results suggest that referential coding of pitch height is a key determinant for the horizontal SMARC effect when pitch height is irrelevant to the task.     

The perception of pure and mistuned musical fifths and major thirds: Thresholds for discrimination,beats, and identification

In Experiment 1, the discriminability of pure and mistuned musical intervals consisting of simultaneously presented complex tones was investigated. Because of the interference of nearby harmonics, two features of beats were varied independently: (1) beat frequency, and (2) the depth of the level variation. Discrimination thresholds (DTs) were expressed as differences in level (AL) between the two tones. DTs were determined for musical fifths and major thirds, at tone durations of 250, 500, and 1,000 msec, and for beat frequencies within a range of .5 to 32 Hz. The results showed that DTs were higher (smaller values of ΔL) for major thirds than for fifths, were highest for the lowest beat frequencies, and decreased with increasing tone duration. Interaction of tone duration and beat frequency showed that DTs were higher for short tones than for sustained tones only when the mistuning was not too large. It was concluded that, at higher beat frequencies, DTs could be based more on the perception of interval width than on the perception of beats or roughness. Experiments 2 and 3 were designed to ascertain to what extent this was true. In Experiment 2, beat thresholds (BTs) for a large number of different beat frequencies were determined. In Experiment 3, DTs, BTs, and thresholds for the identification of the direction of mistuning (ITs) were determined. For mistuned fifths and major thirds, sensitivity to beats was about the same. ITs for fifths and major thirds were not significantly different; deviations from perfect at threshold ranged from about 20 to 30 cents. Comparison of the different thresholds revealed that DTs are mainly determined by sensitivity to beats. Detailed analysis, however, indicated that perception of interval width is a relevant aspect in discrimination, especially for the fifths.     

Perception of missing fundamental by a species of songbird (Sturnus vulgaris)

Two experiments investigated whether a species of songbird perceives missing fundamentals in sounds containing complex frequencies. In Experiment 1, European starlings were trained to discriminate between two sinusoids. This discrimination persisted when the sinusoids were replaced with waveforms composed solely of four consecutive higher harmonics of the training frequencies. In Experiment 2, starlings trained to discriminate between two complex frequencies consisting of sets of higher harmonics transferred the discrimination to the sinusoidal fundamentals. The results demonstrate that starlings can perceive harmonic or periodic structure, and show that a species of songbird can use harmonic structure to gain information about its auditory environment. The findings, together with those obtained from fish and mammals, suggest that periodicity pitch perception may be a general process in vertebrate hearing.