Localization of moving sound

The final position of a moving sound source usually appears to be displaced in the direction of motion. We tested the hypothesis that this phenomenon, termed auditory representational momentum, is already emerging during, not merely after, the period of motion. For this purpose, we investigated the localization of a moving sound at different points in time. In a dark anechoic environment, an acoustic target moved along the frontal horizontal plane. In the initial, middle, or final phase of the motion trajectory, subjects received a tactile stimulus and determined the current position of the moving target at the moment of the stimulus by performing either relative-judgment or pointing tasks. Generally, in the initial phase of the auditory motion, the position was perceived to be displaced in the direction of motion, but this forward displacement disappeared in the further course of the motion. When the motion stimulus had ceased, however, its final position was again shifted in the direction of motion. The latter result suggests that representational momentum in spatial hearing is a phenomenon specific to the final point of motion. Mental extrapolation of past trajectory information is discussed as a potential source of this perceptual displacement.     

Localization of moving sound

The final position of a moving sound source usually appears to be displaced in the direction of motion. We tested the hypothesis that this phenomenon, termed auditory representational momentum, is already emerging during, not merely after, the period of motion. For this purpose, we investigated the localization of a moving sound at different points in time. In a dark anechoic environment, an acoustic target moved along the frontal horizontal plane. In the initial, middle, or final phase of the motion trajectory, subjects received a tactile stimulus and determined the current position of the moving target at the moment of the stimulus by performing either relative-judgment or pointing tasks. Generally, in the initial phase of the auditory motion, the position was perceived to be displaced in the direction of motion, but this forward displacement disappeared in the further course of the motion. When the motion stimulus had ceased, however, its final position was again shifted in the direction of motion. The latter result suggests that representational momentum in spatial hearing is a phenomenon specific to the final point of motion. Mental extrapolation of past trajectory information is discussed as a potential source of this perceptual displacement.     

A comparison of visual and auditory representational momentum in spatial tasks

Similarities have been observed in the localization of the final position of moving visual and moving auditory stimuli: Perceived endpoints that are judged to be farther in the direction of motion in both modalities likely reflect extrapolation of the trajectory, mediated by predictive mechanisms at higher cognitive levels. However, actual comparisons of the magnitudes of displacement between visual tasks and auditory tasks using the same experimental setup are rare. As such, the purpose of the present free-field study was to investigate the influences of the spatial location of motion offset, stimulus velocity, and motion direction on the localization of the final positions of moving auditory stimuli (Experiment 1 and 2) and moving visual stimuli (Experiment 3). To assess whether auditory performance is affected by dynamically changing binaural cues that are used for the localization of moving auditory stimuli (interaural time differences for low-frequency sounds and interaural intensity differences for high-frequency sounds), two distinct noise bands were employed in Experiments 1 and 2. In all three experiments, less precise encoding of spatial coordinates in paralateral space resulted in larger forward displacements, but this effect was drowned out by the underestimation of target eccentricity in the extreme periphery. Furthermore, our results revealed clear differences between visual and auditory tasks. Displacements in the visual task were dependent on velocity and the spatial location of the final position, but an additional influence of motion direction was observed in the auditory tasks. Together, these findings indicate that the modality-specific processing of motion parameters affects the extrapolation of the trajectory.     

Does representational momentum reflect a distortion of the length or the endpoint of a trajectory?

Observers viewed a moving target, and after the target vanished, indicated either the initial position or the final position of the target. In Experiment 1, an auditory tone cued observers to indicate either the initial position or the final position; in Experiment 2, different groups of observers indicated the initial position or the final position. Judgments of the initial position were displaced backward in the direction opposite to motion, and judgments of the final position were displaced forward in the direction of motion. The data suggest that the remembered trajectory is longer than the actual trajectory, and the displacement pattern is not consistent with the hypothesis that representational momentum results from a distortion of memory for the location of a trajectory.     

Saccadic suppression of displacement is strongest in central vision

Perception of target displacement is severely degraded if the displacement occurs during a saccadic eye movement, but the variation of this effect across the visual field is unknown. A small target was displaced from a starting point at the midline, or 10 deg to the right or left, while the eye made a saccade from the 10 deg right position to the 10 deg left position. Saccades were detected and the target displaced on line. Assessed with a signal detection measure, suppression was stronger in central vision than in more peripheral locations for all three subjects. Leftward and rightward displacements yielded equal thresholds. The results complement the findings of others to reveal a picture of perceptual events during saccades, with both deeper saccadic suppression and faster correction of spatial values (the correspondences between retinal position and perceived egocentric direction), favouring more accurate spatial processing in central vision than in the periphery.     

A comparison of auditory and visual apparent motion presented individually and with crossmodal moving distractors

Unimodal auditory and visual apparent motion (AM) and bimodal audiovisual AM were investigated to determine the effects of crossmodal integration on motion perception and direction-of-motion discrimination in each modality. To determine the optimal stimulus onset asynchrony (SOA) ranges for motion perception and direction discrimination, we initially measured unimodal visual and auditory AMs using one of four durations (50, 100, 200, or 400 ms) and ten SOAs (40-450 ms). In the bimodal conditions, auditory and visual AM were measured in the presence of temporally synchronous, spatially displaced distractors that were either congruent (moving in the same direction) or conflicting (moving in the opposite direction) with respect to target motion. Participants reported whether continuous motion was perceived and its direction. With unimodal auditory and visual AM, motion perception was affected differently by stimulus duration and SOA in the two modalities, while the opposite was observed for direction of motion. In the bimodal audiovisual AM condition, discriminating the direction of motion was affected only in the case of an auditory target. The perceived direction of auditory but not visual AM was reduced to chance levels when the crossmodal distractor direction was conflicting. Conversely, motion perception was unaffected by the distractor direction and, in some cases, the mere presence of a distractor facilitated movement perception.     

Control of Rapid Arm Movements When Target Position Is Altered During Saccadic Suppression

This experiment examined whether rapid arm movements can be corrected in response to a change in target position that occurs just prior to movement onset, during saccadic suppression of displacement. Because the threshold of retinal input reaches its highest magnitude at that time, displacement of the visual target of a saccade is not perceived. Subjects (N = 6) were instructed to perform very rapid arm movements toward visual targets located 16, 20, and 24 degrees from midline (on average, movement time was 208 ms). On some trials the 20 degrees target was displaced 4 degrees either to the right or to the left during saccadic suppression. For double-step trials, arm movements did not deviate from their original trajectory. Movement endpoints and movement structure (i.e., velocity-and acceleration-time profiles) were similar whether or not target displacements occurred, showing the failure of proprioceptive signals or internal feedback loops to correct the arm trajectory. Following this movement, terminal spatially oriented movements corrected the direction of the initial movement (as compared with the single-step control trials) when the target eccentricity decreased by 4 degrees. Subjects were unaware of these spatial corrections. Therefore, spatial corrections of hand position were driven by the goal level of the task, which was updated by oculomotor corrective responses when a target shift occurred.     

Visual stability with goal-directed eye and arm movements toward a target displaced during saccadic suppression

This experiment tested whether the perceived stability of the environment is altered when there is a combination of eye and visually open-loop hand movements toward a target displaced during the eye movements, i.e., during saccadic suppression. Visual-target eccentricity randomly decreased or increased during eye movements and subjects reported whether they perceived a target displacement or not, and if so, the direction of the displacement. Three experimental conditions, involving different combinations of eye and arm movements, were tested: (a) eye movements only; (b) simultaneous eye and rapid arm movements toward the target; and (c) simultaneous eye and arm movements with a restraint blocking the arm as soon as the hand left the starting position. The perceptual threshold of target displacements resulting in an increased target eccentricity was greater when subjects combined eye and arm movements toward the target object, specially for the no-restraint condition. Subjects corrected most of their arm trajectory toward the displaced target despite the short movement times (average MT = 189 ms). After the movements, the null error feedback of the hand's final position presumably overlapped the retino-oculomotor signal error and could be responsible for the deficient perception of target displacements. Thus, subjects interpreted the terminal hand positions as being within the range of the endpoint variability associated with the production of rapid arm movements rather than as a change of the environment. These results suggest that a natural strategy adopted for processing spatial information, especially in a competing situation, could favour a constancy tendency, avoiding systematic perception of a change of environment for any noise or variability at the central or peripheral levels.     

Targets of the memorized position and visual contexts]

The goal of this study was to determine whether a sensorimotor or cognitive encoding is used to encode a target position and save it into iconic memory. The methodology consisted of disrupting a manual aiming movement to a memorized visual target by displacing the visual field containing the target. The nature of the encoding was inferred from the nature and the size of the errors relative to a control. The target was presented either centrally or in the right periphery. Participants moved their hand from the left to the right of fixation. Black and white vertical stripes covered the whole visual field. The visual field was either stationary throughout the trial or was displaced to the right or left at the extinction of the target or at the start of the hand movement. In the latter case, the displacement of the visual field obviously could only be taken into account by the participant during the gesture. In this condition, our hypothesis was that the aiming error would follow the direction of visual field displacement. Results showed three major effects: (1) Vision of the hand during the gesture improved the final accuracy; (2) visual field displacement produced an underestimation of the target distance only when the hand was not visible during the gesture and was always in the same direction displacement; and (3) the effect of the stationary structured visual field on aiming precision when the hand was not visible depended on the distance to the target. These results suggest that a stationary structured visual field is used to support the memory of the target position. The structured visual field is more critical when the hand is not visible and when the target appears in peripheral rather than central vision. This suggests that aiming depends on memory of the relative peripheral position of the target (allocentric reference). However, in the present task, cognitive encoding does not maintain the "position" of the target in memory without reference to the environment. The systematic effect of the visual field displacement on the manual aiming suggests that the role of environmental reference frames in memory for position is not well understood. Some studies, in particular those of Giesbrecht and Dixon (1999) and Glover and Dixon (2001), suggested differing roles of the environment in the retention of the target position and the control of aiming movements toward the target. The present observations contribute to understanding the mechanism involved in locating and grasping objects with the hand.     

Environmental invariants in the representation of motion: Implied dynamics and representational momentum,gravity, friction,and centripetal force

Memory for the final position of a moving target is often shifted or displaced from the true final position of that target. Early studies of this memory shift focused on parallels between the momentum of the target and the momentum of the representation of the target and called this displacementrepresentational momentum, but many factors other than momentum contribute to the memory shift. A consideration of the empirical literature on representational momentum and related types of displacement suggests there are at least four different types of factors influencing the direction and magnitude of such memory shifts: stimulus characteristics (e.g., target direction, target velocity), implied dynamics and environmental invariants (e.g., implied momentum, gravity, friction, centripetal force), memory averaging of target and nontarget context (e.g., biases toward previous target locations or nontarget context), and observers’ expectations (both tacit and conscious) regarding future target motion and target/context interactions. Several theories purporting to account for representational momentum and related types of displacement are also considered.     

Representational momentum and related displacements in spatial memory: A review of the findings

Memory for the final location of a moving target is often displaced in the direction of target motion, and this has been referred to asrepresentational momentum. Characteristics of the target (e.g., velocity, size, direction, and identity), display (e.g., target format, retention interval, and response method), context (landmarks, expectations, and attribution of motion source), and observer (e.g., allocation of attention, eye movements, and psychopathology) that influence the direction and magnitude of displacement are reviewed. Specific conclusions regarding numerous variables that influence displacement (e.g., presence of landmarks or surrounding context), as well as broad-based conclusions regarding displacement in general (e.g., displacement does not reflect objective physical principles, may reflect aspects of naive physics, does not solely reflect eye movements, may involve some modular processing, and reflects high-level processes) are drawn. A possible computational theory of displacement is suggested in which displacement (1) helps bridge the gap between perception and action and (2) plays a critical part in localizing stimuli in the environment.     

Congruency effects between auditory and tactile motion: Extending the phenomenon of cross-modal dynamic capture

Behavioral studies of multisensory integration in motion perception have focused on the particular case of visual and auditory signals. Here, we addressed a new case: audition and touch. In Experiment 1, we tested the effects of an apparent motion stream presented in an irrelevant modality (audition or touch) on the perception of apparent motion streams in the other modality (touch or audition, respectively). We found significant congruency effects (lower performance when the direction of motion in the irrelevant modality was incongruent with the direction of the target) for the two possible modality combinations. This congruency effect was asymmetrical, with tactile motion distractors having a stronger influence on auditory motion perception than vice versa. In Experiment 2, we used auditory motion targets and tactile motion distractors while participants adopted one of two possible postures: arms uncrossed or arms crossed. The effects of tactile motion on auditory motion judgments were replicated in the arms-uncrossed posture, but they dissipated in the arms-crossed posture. The implications of these results are discussed in light of current findings regarding the representation of tactile and auditory space.     

线索呈现的时空特性对表征动量的影响

为揭示注意对表征动量的影响机制,我们结合线索提示和表征动量范式,通过两个实验比较高、低相关线索分别在诱导期间与保持间隔呈现对表征动量的影响,结果发现：(1)高相关线索的时间特性主效应不显著,最终位置均发生边缘性的向前偏移。(2)低相关线索呈现在诱导期间时,表征动量显著;呈现在保持间隔时,发生向后偏移。这些表明,随着注意增大,表征动量减小;高相关线索更有利于定位,而低相关线索易受时间特性的影响。研究结果验证表征动量的双加工理论。     

Motion aftereffects with horizontally moving sound sources in the free field

A horizontally moving sound was presented to an observer seated in the center of an anechoic chamber. The sound, either a 500-Hz low-pass noise or a 6300-Hz high-pass noise, repeatedly traversed a semicircular arc in the observer's front hemifield at ear level (distance: 1.5 m). At 10-sec intervals this adaptor was interrupted, and a 750-msec moving probe (a 500-Hz low-pass noise) was presented from a horizontal arc 1.6 m in front of the observer. During a run, the adaptor was presented at a constant velocity (-200 degrees to +200 degrees/sec), while probes with velocities varying from -10 degrees to +10 degrees/sec were presented in a random order. Observers judged the direction of motion (left or right) of each probe. As in the case of stimuli presented over headphones (Grantham & Wightman, 1979), an auditory motion aftereffect (MAE) occurred: subjects responded "left" to probes more often when the adaptor moved right than when it moved left. When the adaptor and probe were spectrally the same, the MAE was greater than when they were from different spectral regions; the magnitude of this difference depended on adaptor speed and was subject-dependent. It is proposed that there are two components underlying the auditory MAE: (1) a generalized bias to respond that probes move in the direction opposite to that of the adaptor, independent of their spectra; and (2) a loss of sensitivity to the velocity of moving sounds after prolonged exposure to moving sounds having the same spectral content.     

Representational momentum contributes to motion induced mislocalization of stationary objects

The influence of a moving target on memory for the location of a briefly presented stationary object was examined. When the stationary object was aligned with the final portion of the moving target's trajectory, memory for the location of the stationary object was displaced forward (i.e., in the direction of motion of the moving target); the magnitude of forward displacement increased with increases in the velocity of the moving target, decreased with increases in the distance of the stationary object from the final location of the moving target, and increased and then decreased with increases in retention interval. It is suggested that forward displacement in memory for a stationary object aligned with the final portion of a moving target's trajectory reflects an influence of representational momentum of the moving target on memory for the location of the stationary object. Implications of the data for theories of representational momentum and motion induced mislocalization are discussed.     

Representational momentum in memory for pitch

When a visual pattern is displayed at successively different orientations such that a rotation or translation is implied, an observer's memory for the final position is displaced forward. This phenomenon of representational momentum shares some similarities with physical momentum. For instance, the amount of memory shift is proportional to the implied velocity of the inducing display; representational momentum is specifically proportional to the final, not the average, velocity; representational momentum follows a continuous stopping function for the first 250 ms or so of the retention interval. In a previous paper (Kelly & Freyd, 1987) we demonstrated a forward memory asymmetry using implied changes in pitch, for subjects without formal musical training. In the current paper we replicate our earlier finding and show that the forward memory asymmetry occurs for subjects with formal musical training as well (Experiment 1). We then show the structural similarity between representational momentum in memory for pitch with previous reports of parametric effects using visual stimuli. We report a velocity effect for auditory momentum (Experiment 2), we demonstrate specifically that the velocity effect depends on the implied acceleration (Experiment 3), and we show that the stopping function for auditory momentum is qualitatively the same as that for visual momentum (Experiment 4). We consider the implications of these results for theories of mental representation.     

A matter of design: No representational momentum without predictability

When observers are asked to localize the final position of a moving target, a forward shift of the judged final position is observed. So far, the forward shift has been attributed to the influence of mental continuation of the final target position (representational momentum). However, studies investigating forward displacement have used highly predictable target motion. The direction of target motion and the final target position were often varied between subjects. Thus, observers may have expected the target to travel in a particular direction or vanish at a particular location before a given trial started. In this study, direction of motion and final position were treated as fixed or random factors. The forward shift and the reversal of the shift with time (memory averaging) were absent when both factors were randomized. Thus, the forward shift with implied motion is restricted to repeatedly observed motion sequences that allow for pre-trial motion prediction.     

Auditory motion aftereffects

Observers were adapted to simulated auditory movement produced by dynamically varying the interaural time and intensity differences of tones (500 or 2,000 Hz) presented through headphones. At lO-sec intervals during adaptation, various probe tones were presented for 1 sec (the frequency of the probe was always the same as that of the adaptation stimulus). Observers judged the direction of apparent movement (“left” or “right”) of each probe tone. At 500 Hz, with a 200-deg/sec adaptation velocity, “stationary” probe tones were consistently judged to move in the direction opposite to that of the adaptation stimulus. We call this result an auditory motion aftereffect. In slower velocity adaptation conditions, progressively less aftereffect was demonstrated. In the higher frequency condition (2,000 Hz, 200-deg/sec adaptation velocity), we found no evidence of motion aftereffect. The data are discussed in relation to the well-known visual analog-the “waterfall effect.” Although the auditory aftereffect is weaker than the visual analog, the data suggest that auditory motion perception might be mediated, as is generally believed for the visual system, by direction-specific movement analyzers.     

Misperception of exocentric directions in auditory space

Previous studies have demonstrated large errors (over 30 degrees ) in visually perceived exocentric directions (the direction between two objects that are both displaced from the observer's location; e.g., Philbeck et al. [Philbeck, J. W., Sargent, J., Arthur, J. C., & Dopkins, S. (2008). Large manual pointing errors, but accurate verbal reports, for indications of target azimuth. Perception, 37, 511-534]). Here, we investigated whether a similar pattern occurs in auditory space. Blindfolded participants either attempted to aim a pointer at auditory targets (an exocentric task) or gave a verbal estimate of the egocentric target azimuth. Targets were located at 20-160 degrees azimuth in the right hemispace. For comparison, we also collected pointing and verbal judgments for visual targets. We found that exocentric pointing responses exhibited sizeable undershooting errors, for both auditory and visual targets, that tended to become more strongly negative as azimuth increased (up to -19 degrees for visual targets at 160 degrees ). Verbal estimates of the auditory and visual target azimuths, however, showed a dramatically different pattern, with relatively small overestimations of azimuths in the rear hemispace. At least some of the differences between verbal and pointing responses appear to be due to the frames of reference underlying the responses; when participants used the pointer to reproduce the egocentric target azimuth rather than the exocentric target direction relative to the pointer, the pattern of pointing errors more closely resembled that seen in verbal reports. These results show that there are similar distortions in perceiving exocentric directions in visual and auditory space.     

线索提示对表征动量的影响

研究结合线索提示和表征动量范式,实验1、2均采用2有无线索(有线索,无线索)×4诱导期间时距(1250ms,1750ms,2250ms,2750ms)混合实验设计,探讨线索呈现的加工阶段和时距对表征动量的影响。实验1恒定保持间隔时距,在不同时距的诱导期间呈现线索,发现线索主效应不显著,但表征动量呈减小趋势;时距主效应不显著。实验2变化诱导时距,在恒定的保持间隔呈现线索,发生向后偏移现象,线索主效应显著;时距主效应不显著。研究结果表明,随着注意的增加,表征动量效应减小;注意时距不显著影响表征动量,而注意阶段显著影响表征动量。研究结果为表征动量的双加工理论提供了实证支持。