Motion aftereffects with horizontally moving sound sources in the free field

A horizontally moving sound was presented to an observer seated in the center of an anechoic chamber. The sound, either a 500-Hz low-pass noise or a 6300-Hz high-pass noise, repeatedly traversed a semicircular arc in the observer's front hemifield at ear level (distance: 1.5 m). At 10-sec intervals this adaptor was interrupted, and a 750-msec moving probe (a 500-Hz low-pass noise) was presented from a horizontal arc 1.6 m in front of the observer. During a run, the adaptor was presented at a constant velocity (-200 degrees to +200 degrees/sec), while probes with velocities varying from -10 degrees to +10 degrees/sec were presented in a random order. Observers judged the direction of motion (left or right) of each probe. As in the case of stimuli presented over headphones (Grantham & Wightman, 1979), an auditory motion aftereffect (MAE) occurred: subjects responded "left" to probes more often when the adaptor moved right than when it moved left. When the adaptor and probe were spectrally the same, the MAE was greater than when they were from different spectral regions; the magnitude of this difference depended on adaptor speed and was subject-dependent. It is proposed that there are two components underlying the auditory MAE: (1) a generalized bias to respond that probes move in the direction opposite to that of the adaptor, independent of their spectra; and (2) a loss of sensitivity to the velocity of moving sounds after prolonged exposure to moving sounds having the same spectral content.     

A comparison of the contrast effects in sound localization in the horizontal and vertical planes

The effect of a background sound on the auditory localization of a single sound source was examined. Nine loudspeakers were arranged crosswise in the horizontal and the median vertical plane. They ranged from -20 degrees to +20 degrees, with the center loudspeaker at 0 degree azimuth and elevation. Using vertical and horizontal centimeter scales, listeners verbally estimated the position of a 500-ms broadband noise stimulus being presented at the same time as a 2 s background sound, emitted by one of the four outer loudspeakers. When the background sound consisted of continuous broadband noise, listeners consistently shifted the apparent target positions away from the background sound locations. This auditory contrast effect, which is consistent with earlier findings, equally occurred in both planes. But when the background sound was changed to a pulse train of noise bursts, the contrast effect decreased in the horizontal plane and increased in the vertical plane. This discrepancy might be due to general differences in the processing of interaural and spectral localization information.     

Frame effects in visual search for line orientation

In the present study, we investigated the effects of surrounding frames on visual search for line orientation. Every line item presented in the display was surrounded by a square frame of identical size and orientation. The orientations of the frames, as well as those of the target and distractor lines, were either vertical or tilted. In six experiments, the surrounding frames caused substantial changes in search efficiency for vertical targets and for tilted targets. The search asymmetry between the two types of targets was reversed when the frame was tilted at the same angle as the tilted line. Several variations of the frames (a pair of parallel lines, squares with gaps, and squares with circular contours inside) also changed search efficiency significantly. Taken together, these results imply that three different sources contribute to frame effects: distractor roles played by the frame components, orientation contrast from the frame contour, and interference in local orientation processing (Hayward & Burke, 2000). Implications of the present findings are discussed in reference to rod-and-frame effects (Witkin & Asch, 1948) and to the effects of a large frame surrounding an entire display of lines (Marendaz, 1998; Treisman, 1985).     

Auditory psychomotor coordination and visual search performance

In Experiments 1 and 2, the time to locate and identify a visual target (visual search performance in a two-alternative forced-choice paradigm) was measured as a function of the location of the target relative to the subject's initial line of gaze. In Experiment 1, tests were conducted within a 260 degree region on the horizontal plane at a fixed elevation (eye level). In Experiment 2, the position of the target was varied in both the horizontal (260 degrees) and the vertical (+/- 46 degrees from the initial line of gaze) planes. In both experiments, and for all locations tested, the time required to conduct a visual search was reduced substantially (175-1,200 msec) when a 10-Hz click train was presented from the same location as that occupied by the visual target. Significant differences in latencies were still evident when the visual target was located within 10 degrees of the initial line of gaze (central visual field). In Experiment 3, we examined head and eye movements that occur as subjects attempt to locate a sound source. Concurrent movements of the head and eyes are commonly encountered during auditorily directed search behavior. In over half of the trials, eyelid closures were apparent as the subjects attempted to orient themselves toward the sound source. The results from these experiments support the hypothesis that the auditory spatial channel has a significant role in regulating visual gaze.     

Adaptation to auditory motion in the horizontal plane: effect of prior exposure to motion on motion detectability.

Thresholds for auditory motion detectability were measured in a darkened anechoic chamber while subjects were adapted to horizontally moving sound sources of various velocities. All stimuli were 500-Hz lowpass noises presented at a level of 55 dBA. The threshold measure employed was the minimum audible movement angle (MAMA)--that is, the minimum angle a horizontally moving sound must traverse to be just discriminable from a stationary sound. In an adaptive, two-interval forced-choice procedure, trials occurred every 2-5 sec (Experiment 1) or every 10-12 sec (Experiment 2). Intertrial time was "filled" with exposure to the adaptor--a stimulus that repeatedly traversed the subject's front hemifield at ear level (distance: 1.7 m) at a constant velocity (-150 degrees/sec to +150 degrees/sec) during a run. Average MAMAs in the control condition, in which the adaptor was stationary (0 degrees/sec,) were 2.4 degrees (Experiment 1) and 3.0 degrees (Experiment 2). Three out of 4 subjects in each experiment showed significantly elevated MAMAs (by up to 60%), with some adaptors relative to the control condition. However, there were large intersubject differences in the shape of the MAMA versus adaptor velocity functions. This loss of sensitivity to motion that most subjects show after exposure to moving signals is probably one component underlying the auditory motion aftereffect (Grantham, 1989), in which judgments of the direction of moving sounds are biased in the direction opposite to that of a previously presented adaptor.     

Influence of acoustic context on sound localization: An auditory Roelofs effect

The Roelofs effect is a visual direction illusion: if a large rectangular frame is seen offset from the straight-ahead direction, a small target presented simultaneously is mislocalized in the opposite direction. To investigate whether a similar context illusion might affect auditory localization, we presented a frame of 6 speakers driven with a 300-Hz square wave, 30° left or right of center. The target was a speaker driven with the same waveform, with the two sources in random phase relationship. The target was mislocalized in a direction opposite the frame, an auditory Roelofs effect. A second experiment, using dissimilar sounds for frame and target, yielded no frame-dependent mislocalizations. The effect appeared both in verbal position estimation, a measure of cognitive localization, and in open-loop pointing, a measure of localization in a sensorimotor system. We conclude that audition possesses only one representation of space, in contrast to the two (cognitive and sensorimotor) of vision. The auditory representation corresponds most closely to vision's cognitive system.     

Binaural and monaural localization of sound in two-dimensional space

Two experiments were conducted. In experiment 1, part 1, binaural and monaural localization of sounds originating in the left hemifield was investigated. 104 loudspeakers were arranged in a 13 x 8 matrix with 15 degrees separating adjacent loudspeakers in each column and in each row. In the horizontal plane (HP), the loudspeakers extended from 0 degrees to 180 degrees; in the vertical plane (VP), they extended from -45 degrees to 60 degrees with respect to the interaural axis. Findings of special interest were: (i) binaural listeners identified the VP coordinate of the sound source more accurately than did monaural listeners, and (ii) monaural listeners identified the VP coordinate of the sound source more accurately than its HP coordinate. In part 2, it was found that foreknowledge of the HP coordinate of the sound source aided monaural listeners in identifying its VP coordinate, but the converse did not hold. In experiment 2, part 1, localization performances were evaluated when the sound originated from consecutive 45 degrees segments of the HP, with the VP segments extending from -22.5 degrees to 22.5 degrees. Part 2 consisted of measuring, on the same subjects, head-related transfer functions by means of a miniature microphone placed at the entrance of their external ear canal. From these data, the 'covert' peaks (defined and illustrated in text) of the sound spectrum were extracted. This spectral cue was advanced to explain why monaural listeners in this study as well as in other studies performed better when locating VP-positioned sounds than when locating HP-positioned sounds. It is not claimed that there is inherent advantage for localizing sound in the VP; rather, monaural localization proficiency, whether in the VP or HP, depends on the availability of covert peaks which, in turn, rests on the spatial arrangement of the sound sources.     

Evidence for 40-Hz oscillatory short-term visual memory revealed by human reaction-time measurements

Four experiments show that presentation of a synchronous premask frame within a 40-Hz, flickering premask matrix primes subsequent detection of a Kanizsa-type square by generation of a 40-Hz prime. Reaction time (RT) priming effects indicated a 150-200-ms prime duration following premask display. RTs were also found to be sensitive to the phase relationship between offset of the premask display relative to the onset time of the target: Priming effects were maximal when the target was presented out of phase with premask presentation (i.e., at interstimulus intervals displaced by 180 degrees relative to the 40-Hz rhythm of premask-frame presentation). Taken together, these results demonstrate the existence of a very short-term visual memory that oscillates at 40 Hz. The findings are discussed in the context of complementary psychological and neurophysiological findings related to visual-object coding and the role of gamma-band activity in the brain.     

A comparison of the effects of spatial separation on apparent motion in the auditory and visual modalities

In the present investigation, the effects of spatial separation on the interstimulus onset intervals (ISOIs) that produce auditory and visual apparent motion were compared. In Experiment 1, subjects were tested on auditory apparent motion. They listened to 50-msec broadband noise pulses that were presented through two speakers separated by one of six different values between 0 degrees and 160 degrees. On each trial, the sounds were temporally separated by 1 of 12 ISOIs from 0 to 500 msec. The subjects were instructed to categorize their perception of the sounds as "single," "simultaneous," "continuous motion," "broken motion," or "succession." They also indicated the proper temporal sequence of each sound pair. In Experiments 2 and 3, subjects were tested on visual apparent motion. Experiment 2 included a range of spatial separations from 6 degrees to 80 degrees; Experiment 3 included separations from .5 degrees to 10 degrees. The same ISOIs were used as in Experiment 1. When the separations were equal, the ISOIs at which auditory apparent motion was perceived were smaller than the values that produced the same experience in vision. Spatial separation affected only visual apparent motion. For separations less than 2 degrees, the ISOIs that produced visual continuous motion were nearly equal to those which produced auditory continuous motion. For larger separations, the ISOIs that produced visual apparent motion increased.     

Mental rotation under head tilt: Factors influencing the location of the subjective reference frame

We report five experiments on the effect of head tilt on the mental rotation of patterns to the “upright.” In Experiment 1, subjects rotated alphanumeric characters, displayed within a circular surround. Experiment 2 was similar except that the character was an unfamiliar letter-like symbol. In Experiment 3, subjects again rotated alphanumeric characters, but they were displayed within a rectangular frame tilted 60° to the right. Experiment 4 was similar, except that the subjects were instructed to rotate the characters to the “upright” defined by the tilted frame. In all four experiments, the subjects performed the task with their heads either upright or tilted 60°. In Experiment 5, subjects had their heads and bodies tilted 90°, and rotated alphanumeric characters displayed within a circular surround. In all except Experiment 4, analysis of response latencies revealed that the subjective vertical lay closer to the gravitational than to the retinal vertical, although it was somewhat displaced in the direction of the head tilt—more so in Experiments 2 and 3 than in Experiment 1, and more so still in Experiment 5. In Experiment 4, instructions to adopt the axes of the frame land thus of the retina) succeeded in bringing the subjective vertical closer to the retinal than to the gravitational vertical, although the subjective vertical was still some 20° on average from the gravitational vertical. The results show that the subjective reference frame is distinct from both gravitational and the retinal frames, and that the gravitational frame exerts the stronger influence. They also argue against the primacy of a “retinal factor” in the perception of orientation.     

Echo suppression and discrimination suppression aspects of the precedence effect

The precedence effect is a phenomenon that may occur when a sound from one direction (the lead) is followed within a few milliseconds by the same or a similar sound from another direction (the lag, or the echo). Typically, the lag sound is not heard as a separate event, and changes in the lag sound’s direction cannot be discriminated. The hypothesis is proposed in this study that these two aspects of precedence (echo suppression and discrimination suppression) are at least partially independent phenomena. Two experiments were conducted in which pairs of noise bursts were presented to subjects from two loudspeakers in the horizontal plane to simulate a lead sound and a lag sound (the echo). Echo suppression threshold was measured as the minimum echo delay at which subjects reported hearing two sounds rather than one sound; discrimination suppression threshold was measured as the minimum echo delay at which subjects could reliably discriminate between two positions of the echo. In Experiment 1, it was found that echo suppression threshold was the same as discrimination suppression threshold when measured with a single burst pair (average 5.4 msec). However, when measured after presentation of a train of burst pairs (a condition that may produce “buildup of suppression”), discrimination suppression threshold increased to 10.4 msec, while echo suppression threshold increased to 26.4 msec. The greater buildup of echo suppression than of discrimination suppression indicates that the two phenomena are distinct under buildup conditions and may be the reflection of different underlying mechanisms. Experiment 2 investigated the effect of the directional properties of the lead and lag sounds on discrimination suppression and echo suppression. There was no consistent effect of the spatial separation between lead and lag sources on discrimination suppression or echo suppression, nor was there any consistent difference between the two types of thresholds (overall average threshold was 5.9 msec). The negative result in Experiment 2 may have been due to the measurements being obtained only for single-stimulus conditions and not for buildup conditions that may involve more central processing by the auditory system.     

Specificity of auditory implicit and explicit memory: Is perceptual priming for environmental sounds exemplar specific?

Previous research (Stuart & Jones, 1995) has suggested that identification of environmental sounds may be mediated by abstract sound recognition units. This article reports the results of four repetition priming experiments that find evidence to the contrary. Participants attempted to identify environmental sounds from the initial sound stems (Experiments 1 and 2) or when the sounds were embedded in white noise (Experiments 3 and 4). Repetition of an identical exemplar sound led to more priming than did exposure to a different exemplar, provided that the perceptual difference between the two different exemplars was sufficiently large. Such an exemplar specificity effect was independent of the depth of prior encoding. A similar exemplar specificity effect was also found in explicit stem-cued recall (Experiments 1 and 2) and recognition (Experiment 3). Depth of encoding dissociated performance on tests of repetition priming and explicit memory. These results suggest that a significant amount of specific information is remembered, both implicitly and explicitly, to characterize individual exemplars of a sound category.     

Distractor clustering enhances detection speed and accuracy during selective listening

The effects of distractor clustering on target detection were examined in two experiments in which subjects attended to binaural tone bursts of one frequency while ignoring distracting tones of two competing frequencies. The subjects pressed a button in response to occasional target tones of longer duration (Experiment 1) or increased loudness (Experiment 2). In evenly spaced conditions, attended and distractor frequencies differed by 6 and 12 semitones, respectively (e.g., 2096-Hz targets vs. 1482- and 1048-Hz distractors). In clustered conditions, distractor frequencies were grouped; attended tones differed from the distractors by 6 and 7 semitones, respectively (e.g., 2096-Hz targets vs. 1482- and 1400-Hz distractors). The tones were presented in randomized sequences at fixed or random stimulus onset asynchronies (SOAs). In both experiments, clustering of the unattended frequencies improved the detectability of targets and speeded target reaction times, Similar effects were found at fixed and variable SO As. Results from the analysis of stimulus sequence suggest that clustering improved performance primarily by reducing the interference caused by distractors that immediately preceded the target.     

Auditory apparent motion under binaural and monaural listening conditions

This investigation examined the ability of listeners to perceive apparent motion under binaural and monaural listening conditions. Fifty-millisecond broadband noise sources were presented through two speakers separated in space by either 10 degrees, 40 degrees, or 160 degrees, centered about the subject's midline. On each trial, the sources were temporally separated by 1 of 12 interstimulus onset intervals (ISOIs). Six listeners were asked to place their experience of these sounds into one of five categories (single sound, simultaneous sounds, continuous motion, broken motion, or successive sounds), and to indicate either the proper temporal sequence of presentation or the direction of motion, depending on whether or not motion was perceived. Each listener was tested at all spatial separations under binaural and monaural listening conditions. Motion was perceived in the binaural listening condition at all spatial separations tested for ISOIs between 20 and 130 msec. In the monaural listening condition, motion was reliably heard by all subjects at 10 degrees and 40 degrees for the same range of ISOIs. At 160 degrees, only 3 of the 6 subjects consistently reported motion. However, when motion was perceived in the monaural condition, the direction of motion could not be determined.     

Distraction and facilitation--two faces of the same coin?

Unexpected and task-irrelevant sounds can capture our attention and may cause distraction effects reflected by impaired performance in a primary task unrelated to the perturbing sound. The present auditory-visual oddball study examines the effect of the informational content of a sound on the performance in a visual discrimination task. The informational content was modulated by varying the sound-target interval and the probability of target occurrence. Effects of informational content were examined with two types of distractors: a burst of white noise (deviant) and environmental sounds (novel). Behavioral results reveal the following. (1) Novel and deviant sounds do not necessarily cause behavioral distraction effects when they are uninformative with respect to both time and probability of occurrence of a visual target. (2) Novel, but not deviant, sounds cause an unspecific bias toward facilitation. (3) The informational content of task-irrelevant sounds speeds reaction times, indicating the use of information not directly related to the task for enhancing performance. (4) It is suggested that performance in deviant and novel trials is the sum of the costs of attentional orienting and benefits of information as well as benefits of unspecific activation for novels.     

When sound affects vision: effects of auditory grouping on visual motion perception

Two identical visual targets moving across each other can be perceived either to bounce off or to stream through each other. A brief sound at the moment the targets coincide biases perception toward bouncing. We found that this bounce-inducing effect was attenuated when other identical sounds (auditory flankers) were presented 300 ms before and after the simultaneous sound. The attenuation occurred only when the simultaneous sound and auditory flankers had similar acoustic characteristics and the simultaneous sound was not salient. These results suggest that there is an aspect of auditory-grouping (saliency-assigning) processes that is context-sensitive and can be utilized by the visual system for solving ambiguity. Furthermore, control experiments revealed that such auditory context did not affect the perceptual qualities of the simultaneous sound. Because the attenuation effect is not manifest in the perception of acoustic characteristics of individual sound elements, we conclude that it is a genuine cross-modal effect.     

Binocular vision enhances phase discrimination by filtering the background.

Previous studies have shown that the detectability of a noise-masked target can be enhanced under stereoscopic viewing when the target's interocular disparity differs from that of the noise. This enhanced detectability can be accounted for by a model postulating that the binocular system linearly sums the left-eye and right-eye views of a visual scene. This model also predicts enhanced phase discrimination under specifiable interocular disparities of target and noise. Two experiments were conducted in which subjects were asked to discriminate between two luminance patterns (target and foil) that differed only in phase. The target patterns were constructed by summating two vertical sinusoidal gratings in which the phase difference between the higher and the lower spatial frequency gratings was 45 degrees. The foils contained the same two component frequencies, with a phase difference of -45 degrees. Thus, targets and foils were mirror images of one another. The ability of subjects to discriminate between these stereoscopically viewed mirror-image patterns was investigated under two sets of interocular disparities: those that, according to our model, would unmask one or both spatial frequency components, and those that would leave both components masked by the noise. Phase discrimination was enhanced only when both component frequencies of the target and foil were unmasked. The implications of these findings for template-matching and phase-discrimination models of pattern discrimination are considered.     

Representational momentum in spatial hearing

The final position of a moving visual object usually appears to be displaced in the direction of motion. We investigated this phenomenon, termed representational momentum, in the auditory modality. In a dark anechoic environment, an acoustic target (continuous noise or noise pulses) moved from left to right or from right to left along the frontal horizontal plane. Listeners judged the final position of the target using a hand pointer. Target velocity was 8 degrees s(-1) or 16 degrees s(-1). Generally, the final target positions were localised as displaced in the direction of motion. With presentation of continuous noise, target velocity had a strong influence on mean displacement: displacements were stronger with lower velocity. No influence of sound velocity on displacement was found with motion of pulsed noise. Although these findings suggest that the underlying mechanisms may be different in the auditory and visual modality, the occurrence of displacements indicates that representational-momentum-like effects are not restricted to the visual modality, but may reflect a general phenomenon with judgments of dynamic events.     

How chimpanzees (<Emphasis Type="Italic">Pan troglodytes</Emphasis>) perform in a modified emotional Stroop task

The emotional Stroop task is an experimental paradigm developed to study the relationship between emotion and cognition. Human participants required to identify the color of words typically respond more slowly to negative than to neutral words (emotional Stroop effect). Here we investigated whether chimpanzees (Pan troglodytes) would show a comparable effect. Using a touch screen, eight chimpanzees were trained to choose between two simultaneously presented stimuli based on color (two identical images with differently colored frames). In Experiment 1, the images within the color frames were shapes that were either of the same color as the surrounding frame or of the alternative color. Subjects made fewer errors and responded faster when shapes were of the same color as the frame surrounding them than when they were not, evidencing that embedded images affected target selection. Experiment 2, a modified version of the emotional Stroop task, presented subjects with four different categories of novel images: three categories of pictures of humans (veterinarian, caretaker, and stranger), and control stimuli showing a white square. Because visits by the veterinarian that include anaesthetization can be stressful for subjects, we expected impaired performance in trials presenting images of the veterinarian. For the first session, we found correct responses to be indeed slower in trials of this category. This effect was more pronounced for subjects whose last anaesthetization experience was more recent, indicating that emotional valence caused the slowdown. We propose our modified emotional Stroop task as a simple method to explore which emotional stimuli affect cognitive performance in nonhuman primates.     

Importance of head axes in perception of cutaneous patterns drawn on vertical body surfaces

The "disembodied eye" phenomenon (Corcoran, 1977), that is, the observation that a cutaneous (tactile) pattern is perceived as right-left reversed or not, depending on whether it is presented on the forehead or the back of the head, was extended by incorporating a top-bottom axis into a model of the frame of reference in cutaneous-pattern perception. In two experiments, 21 and 15 subjects were asked to report the letter perceived when one of four letters (p, q, b, or d) was tactually presented. The sites studied were vertical body surfaces (Experiment 1) and hands alongside the body (Experiment 2). The positions for the presentations varied according to the height (head, shoulder, waist, thigh, and calf levels) and the orientation of the surface: forward-, backward-, and side-facing. Although the results for the head and back surfaces supported the notion of a "disembodied eye" behind the individual, other frames were needed: On the forward-facing surfaces below the waist, the prevailing perception was 180 degrees rotated, as if the subjects were looking at the surface by bending forward. An additional frame of reference was introduced for the forward-facing surfaces in lower positions and was described as head axes projected onto body surfaces within the possibility of actual body movements.