Localization of moving sound

The final position of a moving sound source usually appears to be displaced in the direction of motion. We tested the hypothesis that this phenomenon, termed auditory representational momentum, is already emerging during, not merely after, the period of motion. For this purpose, we investigated the localization of a moving sound at different points in time. In a dark anechoic environment, an acoustic target moved along the frontal horizontal plane. In the initial, middle, or final phase of the motion trajectory, subjects received a tactile stimulus and determined the current position of the moving target at the moment of the stimulus by performing either relative-judgment or pointing tasks. Generally, in the initial phase of the auditory motion, the position was perceived to be displaced in the direction of motion, but this forward displacement disappeared in the further course of the motion. When the motion stimulus had ceased, however, its final position was again shifted in the direction of motion. The latter result suggests that representational momentum in spatial hearing is a phenomenon specific to the final point of motion. Mental extrapolation of past trajectory information is discussed as a potential source of this perceptual displacement.     

Localization of moving sound

The final position of a moving sound source usually appears to be displaced in the direction of motion. We tested the hypothesis that this phenomenon, termed auditory representational momentum, is already emerging during, not merely after, the period of motion. For this purpose, we investigated the localization of a moving sound at different points in time. In a dark anechoic environment, an acoustic target moved along the frontal horizontal plane. In the initial, middle, or final phase of the motion trajectory, subjects received a tactile stimulus and determined the current position of the moving target at the moment of the stimulus by performing either relative-judgment or pointing tasks. Generally, in the initial phase of the auditory motion, the position was perceived to be displaced in the direction of motion, but this forward displacement disappeared in the further course of the motion. When the motion stimulus had ceased, however, its final position was again shifted in the direction of motion. The latter result suggests that representational momentum in spatial hearing is a phenomenon specific to the final point of motion. Mental extrapolation of past trajectory information is discussed as a potential source of this perceptual displacement.     

The nature of the visual environment induces implicit biases during language-mediated visual search

Four eyetracking experiments examined whether semantic and visual-shape representations are routinely retrieved from printed word displays and used during language-mediated visual search. Participants listened to sentences containing target words that were similar semantically or in shape to concepts invoked by concurrently displayed printed words. In Experiment 1, the displays contained semantic and shape competitors of the targets along with two unrelated words. There were significant shifts in eye gaze as targets were heard toward semantic but not toward shape competitors. In Experiments 2–4, semantic competitors were replaced with unrelated words, semantically richer sentences were presented to encourage visual imagery, or participants rated the shape similarity of the stimuli before doing the eyetracking task. In all cases, there were no immediate shifts in eye gaze to shape competitors, even though, in response to the Experiment 1 spoken materials, participants looked to these competitors when they were presented as pictures (Huettig & McQueen, 2007). There was a late shape-competitor bias (more than 2,500 ms after target onset) in all experiments. These data show that shape information is not used in online search of printed word displays (whereas it is used with picture displays). The nature of the visual environment appears to induce implicit biases toward particular modes of processing during language-mediated visual search.     

3-D localization of virtual sound sources: Effects of visual environment, pointing method, and training

The ability to localize sound sources in three-dimensional space was tested in humans. In Experiment 1, naive subjects listened to noises filtered with subject-specific head-related transfer functions. The tested conditions included the pointing method (head or manual pointing) and the visual environment (VE; darkness or virtual VE). The localization performance was not significantly different between the pointing methods. The virtual VE significantly improved the horizontal precision and reduced the number of front-back confusions. These results show the benefit of using a virtual VE in sound localization tasks. In Experiment 2, subjects were provided with sound localization training. Over the course of training, the performance improved for all subjects, with the largest improvements occurring during the first 400 trials. The improvements beyond the first 400 trials were smaller. After the training, there was still no significant effect of pointing method, showing that the choice of either head- or manual-pointing method plays a minor role in sound localization performance. The results of Experiment 2 reinforce the importance of perceptual training for at least 400 trials in sound localization studies.     

Achieving visual object constancy across plane rotation and depth rotation.

Visual object constancy is the ability to recognise an object from its image despite variation in the image when the object is viewed from different angles. I describe research which probes the human visual system's ability to achieve object constancy across plane rotation and depth rotation. I focus on the ecologically important case of recognising familiar objects, although the recognition of novel objects is also discussed. Cognitive neuropsychological studies of patients with specific deficits in achieving object constancy are reviewed, in addition to studies which test neurally intact subjects. In certain cases, the recognition of invariant features allows objects to be recognised irrespective of the view depicted, particularly if small, distinctive sets of objects are presented repeatedly. In contrast, in most situations, recognition is sensitive to both the view in-plane and in-depth from which an object is depicted. This result suggests that multiple, view-specific, stored representations of familiar objects are accessed in everyday, entry-level visual recognition, or that transformations such as mental rotation or interpolation are used to transform between retinal images of objects and view-specific, stored representations.     

Scent and sound of vision: expressing scent or sound as visual forms

This article describes three experiments on the possibility of expressing scent or sound into visual forms made by design engineering students. The hypothesis tested was that people are able to pick up patterns in the energy flow that the students transposed from one perceptual sense to another. In Exp. 1 subjects were given different scents and were asked to choose a sculpture designed according these scents. In Exp. 2 subjects were given different musical pieces and asked to match them with portable cassette players designed according to this music. Exp. 3 was identical to Exp. 2 but different music selections, similar to the ones in Exp. 2, were used. In all three experiments subjects were indeed able to perform the tasks above chance level. Results are discussed within the framework of the theory of direct perception of Gibson.     

The effect of sound on visual apparent movement

Twelve subjects found the longest possible interstimulus interval (ISI) at which they perceived continuous apparent motion of one light instead of partial motion or succession between two lights. In the visual condition, two lights only were presented. In the bimodal conditions, binaurally presented tones were presented synchronously with the lights, and the lights and tones were either spatially congruent (in phase) or incongruent (180 degrees out of phase). Bimodal presentations lowered the upper ISI threshold for the perception of visual apparent motion, and the reduction was greater when the tones and lights were spatially congruent. The threshold reduction may be caused by a perceptual inference about localization of the lights in space or by a change in visual persistence.     

Linking sight and sound: fMRI evidence of primary auditory cortex activation during visual word recognition

We describe two studies that used repetition priming paradigms to investigate brain activity during the reading of single words. Functional magnetic resonance images were collected during a visual lexical decision task in which nonword stimuli were manipulated with regard to phonological properties and compared to genuine English words. We observed a region in left-hemisphere primary auditory cortex linked to a repetition priming effect. The priming effect activity was observed only for stimuli that sound like known words; moreover, this region was sensitive to strategic task differences. Thus, a brain region involved in the most basic aspects of auditory processing appears to be engaged in reading even when there is no environmental oral or auditory component.     

Infants' reactions to visual movement of the environment

It has been demonstrated many times that the posture of infants is affected by movement of the visual environment. However, in previous studies, measurements taken with infants less than 10 to 12 months of age have always been recorded with the infants in a sitting position. An experiment is reported in which the postural reactions to a sinusoidal movement of the visual environment were recorded in infants 7 months of age and older standing with support. Fifty subjects divided into five groups (mean age 7.15 to 48.6 months) participated in the experiment. The groups differed in age and motor ability. Movement of the visual environment was achieved by means of a floorless room that could be moved sinusoidally in the anteroposterior axis. The subjects had to stand holding a horizontal bar fixed to a force-measurement platform. For each subject, measurements were made during four 60 s intervals: two with movement of the room and two with the room stationary. For all groups, reactions in the anteroposterior axis were stronger than in the lateral axis and this was true for both stimulus conditions. Comparison of the differences between the movement and stationary conditions in the anteroposterior axis, as a function of age, shows that the youngest infants seemed paradoxically to give stronger reactions when the room was stationary than when it was moving; the inverse was true for older infants and this difference increased with age. An analysis of the data with fast Fourier transforms reveals that the majority of subjects showed a pattern of postural reactions where the dominant (peak) frequency was identical to the peak frequency of room movement.(ABSTRACT TRUNCATED AT 250 WORDS)     

Localization of sound in the vertical plane with and without high-frequency spectral cues

Binaural localization of 3.0-kHz high- and lowpass noise presented in the median vertical plane (MVP) and lateral vertical plane (LVP) was investigated. We anticipated superior performance when localizing the highpass noise hy virtue of the availability of pinna cues. The viability of this supposition was strengthened by monaural localization tests in which performance proficiency for the highpass noise exceeded that for the lowpass noise (p < .01). The main result showed that binaural localization of proficiency for highpass noise surpassed that for lowpass noise for all listening conditions (p < .01). However, the importance of binaural temporal and level differences in vertical-plane localization was demonstrated by the highly respectable performances when the lowpass noise was presented in the LVP. Data from binaural localization in the MVP and monaural localization in the LVP suggested that the influence of pinna cues diminishes for source elevations above 45°.     

The effects of stimulus rotation and familiarity in visual search

Rauschenberger and Yantis (2006) observed that an intersecting circle-line combination enjoyed significantly greater search efficiency when it was oriented to resemble a "Q" than when it was oriented so that the intersecting line was vertical (cf. Treisman and Souther, 1985). Although a control experiment made it unlikely that the obliqueness of the line was responsible for the observed benefit, there was no direct evidence that this benefit was attributable to the "Q-ness" of the stimulus. In the present study, a subset of Rauschenberger and Yantis's experiments was repeated with Chinese subjects, who had never been exposed to the Latin alphabet. For these subjects, there was no benefit for the"Q"-like stimulus, in contrast to the results of Rauschenberger and Yantis's study. These results show that a simple 45 degrees rotation of a stimulus can affect search efficiency significantly--but only when this rotation bestows meaning, or familiarity, to that stimulus.     

Localization of sound in the vertical plane with and without high-frequency spectral cues.

Binaural localization of 3.0-kHz high- and lowpass noise presented in the median vertical plane (MVP) and lateral vertical plane (LVP) was investigated. We anticipated superior performance when localizing the highpass noise by virtue of the availability of pinna cues. The viability of this supposition was strengthened by monaural localization tests in which performance proficiency for the highpass noise exceeded that for the lowpass noise (p less than .01). The main result showed that binaural localization of proficiency for highpass noise surpassed that for lowpass noise for all listening conditions (p less than .01). However, the importance of binaural temporal and level differences in vertical-plane localization was demonstrated by the highly respectable performances when the lowpass noise was presented in the LVP. Data from binaural localization in the MVP and monaural localization in the LVP suggested that the influence of pinna cues diminishes for source elevations above 45 degrees.     

Visual memory and the perception of a stable visual environment

The visual world appears stable and continuous despite eye movements. One hypothesis about how this perception is achieved is that the contents of successive fixations are fused in memory according to environmental coordinates. Two experiments failed to support this hypothesis; they showed that one's ability to detect a grating presented after a saccade is unaffected by the presentation of a grating with the same spatial frequency in the same spatial location before the saccade. A third experiment tested an alternative explanation of perceptual stability that claims that the contents of successive fixations are compared, rather than fused, across saccades, allowing one to determine whether the world has remained stable. This hypothesis was supported: Experienced subjects could accurately determine whether two patterns viewed in successive fixations were identical or different, even when the two patterns appeared in different spatial positions across the saccade. Taken together, these results suggest that perceptual stability and information integration across saccades rely on memory for the relative positions of objects in the environment, rather than on the spatiotopic fusion of visual information from successive fixations.