注意促进运动知觉判断的时间进程

本研究通过控制深度视觉线索, 分析3D SFM (structure from motion)知觉中的眼动特征, 探讨注意对SFM知觉判断的影响及其时间进程。结果显示, 有线索刺激比模糊刺激的判断更加快、更加肯定(百分比更高); 眼睛移动方向和微眼跳方向都分别与知觉判断的运动方向具有一致性; 微眼跳频次、峰速度和幅度也都分别表现出深度线索的促进效应。实验结果表明, SFM知觉过程大致分为速度计算和构建三维结构两个阶段; 注意对SFM知觉的调节作用主要发生在构建三维结构阶段; 注意从150 ms开始指向选择对象, 驻留持续约200 ms后, 从局部运动矢量流转移到整体运动方向的知觉判断。     

Multiplicative effects of intention on the perception of bistable apparent motion

When viewing ambiguous displays, observers can, via intentional efforts, affect which perceptual interpretation they perceive. Specifically, observers can increase the probability of seeing the desired percept. Little is known, however, about how intentional efforts interact with sensory inputs in exerting their effects on perception. In two experiments, the current study explored the possibility that intentional efforts might operate by multiplicatively enhancing the stimulus-based activation of the desired perceptual representation. Such a possibility is suggested by recent neurophysiological research on attention. In support of this idea, when we presented bistable apparent motion displays under stimulus conditions differentially favoring one motion percept over the other, observers' intentional efforts to see a particular motion were generally more effective under conditions in which stimulus factors favored the intended motion percept.     

The advantage of mentally rotating clockwise

The time taken to decide whether a character is shown in its mirror or normal version has been shown to increase approximately linearly with the angular departure from an up-right position. Additionally, in some studies, decisions took longer for clockwise tilted characters than for counterclockwise tilted ones. Other studies do not report the latter effect. We argue that inconsistencies across studies are caused by variance in participants' strategies. The task employed here was specifically designed to bring these strategies and thereby the direction of rotation under experimental control. From the EEG recorded during the rotation period, we extracted an event-related slow potential whose amplitude is sensitive to the amount of mental rotation. In both strategy conditions, the slow potential's amplitude was lower for clockwise than for counterclockwise rotations. We take this as evidence that mental rotation of alphanumeric characters is easier in a clockwise than in a counterclockwise direction.     

Modeling body state-dependent multisensory integration

The brain often integrates multisensory sources of information in a way that is close to the optimal according to Bayesian principles. Since sensory modalities are grounded in different, body-relative frames of reference, multisensory integration requires accurate transformations of information. We have shown experimentally, for example, that a rotating tactile stimulus on the palm of the right hand can influence the judgment of ambiguously rotating visual displays. Most significantly, this influence depended on the palm orientation: when facing upwards, a clockwise rotation on the palm yielded a clockwise visual judgment bias; when facing downwards, the same clockwise rotation yielded a counterclockwise bias. Thus, tactile rotation cues biased visual rotation judgment in a head-centered reference frame. Recently, we have generated a modular, multimodal arm model that is able to mimic aspects of such experiments. The model co-represents the state of an arm in several modalities, including a proprioceptive, joint angle modality as well as head-centered orientation and location modalities. Each modality represents each limb or joint separately. Sensory information from the different modalities is exchanged via local forward and inverse kinematic mappings. Also, re-afferent sensory feedback is anticipated and integrated via Kalman filtering. Information across modalities is integrated probabilistically via Bayesian-based plausibility estimates, continuously maintaining a consistent global arm state estimation. This architecture is thus able to model the described effect of posture-dependent motion cue integration: tactile and proprioceptive sensory information may yield top-down biases on visual processing. Equally, such information may influence top-down visual attention, expecting particular arm-dependent motion patterns. Current research implements such effects on visual processing and attention.     

Modeling body state-dependent multisensory integration

The brain often integrates multisensory sources of information in a way that is close to the optimal according to Bayesian principles. Since sensory modalities are grounded in different, body-relative frames of reference, multisensory integration requires accurate transformations of information. We have shown experimentally, for example, that a rotating tactile stimulus on the palm of the right hand can influence the judgment of ambiguously rotating visual displays. Most significantly, this influence depended on the palm orientation: when facing upwards, a clockwise rotation on the palm yielded a clockwise visual judgment bias; when facing downwards, the same clockwise rotation yielded a counterclockwise bias. Thus, tactile rotation cues biased visual rotation judgment in a head-centered reference frame. Recently, we have generated a modular, multimodal arm model that is able to mimic aspects of such experiments. The model co-represents the state of an arm in several modalities, including a proprioceptive, joint angle modality as well as head-centered orientation and location modalities. Each modality represents each limb or joint separately. Sensory information from the different modalities is exchanged via local forward and inverse kinematic mappings. Also, re-afferent sensory feedback is anticipated and integrated via Kalman filtering. Information across modalities is integrated probabilistically via Bayesian-based plausibility estimates, continuously maintaining a consistent global arm state estimation. This architecture is thus able to model the described effect of posture-dependent motion cue integration: tactile and proprioceptive sensory information may yield top–down biases on visual processing. Equally, such information may influence top–down visual attention, expecting particular arm-dependent motion patterns. Current research implements such effects on visual processing and attention.     

Visual motion disambiguation by a subliminal sound

There is growing interest in the effect of sound on visual motion perception. One model involves the illusion created when two identical objects moving towards each other on a two-dimensional visual display can be seen to either bounce off or stream through each other. Previous studies show that the large bias normally seen toward the streaming percept can be modulated by the presentation of an auditory event at the moment of coincidence. However, no reports to date provide sufficient evidence to indicate whether the sound bounce-inducing effect is due to a perceptual binding process or merely to an explicit inference resulting from the transient auditory stimulus resembling a physical collision of two objects. In the present study, we used a novel experimental design in which a subliminal sound was presented either 150 ms before, at, or 150 ms after the moment of coincidence of two disks moving towards each other. The results showed that there was an increased perception of bouncing (rather than streaming) when the subliminal sound was presented at or 150 ms after the moment of coincidence compared to when no sound was presented. These findings provide the first empirical demonstration that activation of the human auditory system without reaching consciousness affects the perception of an ambiguous visual motion display.     

Visual field differences for clockwise and counterclockwise mental rotation

Geometric line drawings were presented to normal subjects in the left visual field (LVF) or right visual field (RVF) at various degrees of rotation from a centrally presented vertical standard. The task of the subject was to indicate with a reaction time (RT) response whether the laterally presented stimulus could be rotated into the vertical standard or if it was a rotated mirror image of the standard. In Study 1, an overall right hemisphere superiority was found for RT and accuracy on match trials. Most interestingly, interactions between Visual Field and Rotation Angle for the match accuracy data and between Visual Field and Direction of Rotation (clockwise or counterclockwise) for the match RT slopes were found. These interactions suggested that clockwise rotations were more readily performed in the LVF and counterclockwise rotations in the RVF, consistent with other literature for mental rotation. The purpose of Study 2 was to replicate this finding of visual field differences for rotation direction using a design in which direction and degree of rotation were varied orthogonally. No main effect of Visual Field was found. However, significant interactions between Visual Field and Rotation Angle were found for both RT and accuracy, confirming the presence of visual field differences for rotation direction in a new sample of subjects. These differences were discussed in terms of the possibly greater relevance of medially directed stimuli and a possible hemispheric bias for rotation direction, and in terms of interhemispheric transmission factors.     

Overshadowing in operant conditioning as a function of discriminability

Pigeons were trained in an operant, go/no-go, discrimination by successive presentations of discrete, positive and negative trials. In separate groups, the rate of discriminaion learning based on an auditory cue, on visual cues of different discriminability, and on combined auditory and visual cues was determined. The auditory cue was tone/no-tone, the visual cue was a difference in brightness level on the key. Following discrimination training, stimulus control was tested in extinction by presenting tone or notone at each of four key-brightness levels.Learning was more rapid with two cues than with either cue singly, demonstrating summation. The contribution made by the tone cue to the learning of the discrimination decreased with increasing discriminability of the light cue. The control exerted by the tone cue also decreased (i.e., the tone cue was overshadowed) with increasing discriminability of the light cue. In certain cases, the tone cue decreased control by brightness, showing that in two-cue discriminations each cue may reduce the control exerted by the other.     

Visual inertia of rotating 3-D objects

Five experiments were designed to determine whether a rotating, transparent 3-D cloud of dots (simulated sphere) could influence the perceived direction of rotation of a subsequent sphere. Experiment 1 established conditions under which the direction of rotation of a virtual sphere was perceived unambiguously. When a near-far luminance difference and perspective depth cues were present, observers consistently saw the sphere rotate in the intended direction. In Experiment 2, a near-far luminance difference was used to create an unambiguous rotation sequence that was followed by a directionally ambiguous rotation sequence that lacked both the near-far luminance cue and the perspective cue. Observers consistently saw the second sequence as rotating in the same direction as the first, indicating the presence of 3-D visual inertia. Experiment 3 showed that 3-D visual inertia was sufficiently powerful to bias the perceived direction of a rotation sequence made unambiguous by a near-far luminance cue. Experiment 5 showed that 3-D visual inertia could be obtained using an occlusion depth cue to create an unambiguous inertia-inducing sequence. Finally, Experiments 2, 4, and 5 all revealed a fast-decay phase of inertia that lasted for approximately 800 msec, followed by an asymptotic phase that lasted for periods as long as 1,600 msec. The implications of these findings are examined with respect to motion mechanisms of 3-D visual inertia.     

First-order and second-order spectral 'motion' mechanisms in the human auditory system

Light energy displaced along the retinal photoreceptor array leads to a perception of visual motion. In audition, displacement of mechanical energy along the cochlear hair cell array is conceptually similar but leads to a perception of 'movement' in frequency space (spectral motion)--a rising or falling pitch. In vision there are other types of stimuli that also evoke a percept of motion but do not involve a displacement of energy across the photoreceptors (second-order stimuli). In this study, we used psychophysical methods to determine if such second-order stimuli also exist in audition, and if the resulting percept would rival that of first-order spectral motion. First-order auditory stimuli consisted of a frequency sweep of sixteen non-harmonic tones between 297 and 12123 Hz. Second-order stimuli consisted of the same tones, but with a random subset turned on at the beginning of a trial. During the trial, each tone in sequence randomly changed state (ON-to-OFF, or OFF-to-ON). Thus, state transitions created a 'sweep' having no net energy displacement correlated to the sweep direction. At relatively slow sweep speeds, subjects readily identified the sweep direction for both first-order and second-order stimuli, though accuracy decreased for second-order stimuli as the sweep speed increased. This latter characteristic is also true of some second-order visual stimuli. These results suggest a stronger parallelism between auditory and visual processing than previously appreciated.     

Distinguishing clockwise from counterclockwise: Does it require mental rotation?

In three experiments, subjects were timed as they judged whether stimuli, presented in different angular orientations, represented clockwise or counterclockwise directions. In each experiment, there was also a control condition in which the subjects were required to make mirror image judgments relative to some canonical orientation. Analysis of reaction times suggested that, in the control tasks, the subjects generally rotated the stimuli mentally to the canonical orientation before making their decision. Mental rotation was invoked less frequently in the case of the experimental tasks, suggesting at least limited access to an orientation-free code representing the difference between clockwise and counterclockwise. This was most evident in Experiment 1, where the stimuli represented 1-h jumps of a hand on a clock face. It was less so in Experiment 2, where direction of motion was indicated in a static display. In Experiment 3, only a few subjects proved able to use an orientation-free, clockwise versus counterclockwise rubric in order to discriminate normal from backward letters.     

Time-dependent effects of kinesthetic input

Sensory input can be used by the nervous system to control the spatial parameters of motor responses (e.g., distance, velocity, and direction) by initializing these parameters before movement onset and then by adjusting these parameters during movement. Sensory input can also be used to trigger movements. In the experiments reported in this paper, we compared the effects of kinesthetic input on a triggered motor response when the kinesthetic input was generated at different times relative to the onset of the motor response. Human subjects responded to a visual stimulus by intentionally increasing elbow torque to a target level. Kinesthetic input was generated by unexpectedly rotating each subject's elbow 100 ms before the onset of the intentional torque response (early) or coincident with the onset of the intentional torque response (late). The effect of early kinesthetic input on the intentional torque response markedly differed from the effect of late kinesthetic input. The effect of early kinesthetic input was relatively independent of the direction of elbow rotation, had a different dependence on the amplitude of rotation, and required a shorter duration of rotation compared to the effect of late kinesthetic input. These differences in the effects of early and late kinesthetic input might be related to the initialization, triggering, and adjustment of motor responses.     

Perceiving object motion using vision and touch

In a previous experiment, we showed that bistable visual object motion was partially disambiguated by tactile input. Here, we investigated this effect further by employing a more potent visuotactile stimulus. Monocular viewing of a tangible wire-frame sphere (TS) rotating about its vertical axis produced bistable alternations of direction. Touching the TS biased simultaneous and subsequent visual perception of motion. Both of these biases were in the direction of the tactile stimulation and, therefore, constituted facilitation or priming, as opposed to interference or adaptation. Although touching the TS biased visual perception, tactile stimulation was not able to override the ambiguous visual percept. This led to periods of sensory conflict, during which visual and tactile motion percepts were incongruent. Visual and tactile inputs can sometimes be fused to form a coherent percept of object motion but, when they are in extreme conflict, can also remain independent.     

The flash-lag effect during illusory chopstick rotation

In the 'flash-lag' effect, a static object that is briefly flashed next to a moving object appears to lag behind the moving object. A flash was put up next to an intersection that appeared to be moving clockwise along a circular path but was actually moving counterclockwise [the chopstick illusion; Anstis, 1990, in AI and the Eye Eds A Blake, T Troscianko (London: John Wiley) pp 105 117; 2003, in Levels of Perception Eds L Harris, M Jenkin (New York: Springer) pp 90 93]. As a result, the flash appeared displaced clockwise. This was appropriate to the physical, not the subjective, direction of rotation, and it suggests that the flash-lag illusion occurs early in the visual system, before motion signals are parsed into moving objects.     

A comparison of auditory and visual apparent motion presented individually and with crossmodal moving distractors

Unimodal auditory and visual apparent motion (AM) and bimodal audiovisual AM were investigated to determine the effects of crossmodal integration on motion perception and direction-of-motion discrimination in each modality. To determine the optimal stimulus onset asynchrony (SOA) ranges for motion perception and direction discrimination, we initially measured unimodal visual and auditory AMs using one of four durations (50, 100, 200, or 400 ms) and ten SOAs (40-450 ms). In the bimodal conditions, auditory and visual AM were measured in the presence of temporally synchronous, spatially displaced distractors that were either congruent (moving in the same direction) or conflicting (moving in the opposite direction) with respect to target motion. Participants reported whether continuous motion was perceived and its direction. With unimodal auditory and visual AM, motion perception was affected differently by stimulus duration and SOA in the two modalities, while the opposite was observed for direction of motion. In the bimodal audiovisual AM condition, discriminating the direction of motion was affected only in the case of an auditory target. The perceived direction of auditory but not visual AM was reduced to chance levels when the crossmodal distractor direction was conflicting. Conversely, motion perception was unaffected by the distractor direction and, in some cases, the mere presence of a distractor facilitated movement perception.     

An experimental evaluation of three theories of auditory stream segregation

Three theories of auditory stream segregation were evaluated. In two-part trials, subjects heard an induction sequence, whose effects upon an immediately subsequent test sequence were measured. The rhythm and total duration of Induction Sequence tones were varied in two experiments. The similarity between induction and test sequences aided segregation, but rhythmic predictability and longer tone durations did not. Frequency alternation during the induction sequence was not necessary to induce segregation in the test sequence. Furthermore, peripheral processes inadequately account for the segregation effects found. The data suggest that, once a distinct percept emerges from an auditory scene, properties derived from the percept (particularly changes) are fed back to control the ongoing analysis of that auditory scene. A neural adaptation to stimuli with constant properties may form part of this analysis.     

Attentional modulation in perception of visual motion events.

Identical visual targets moving across each other with equal and constant speed can be perceived either to bounce off or to stream through each other. This bistable motion perception has been studied mostly in the context of motion integration. Since the perception of most ambiguous motion is affected by attention, there is the possibility of attentional modulation occurring in this case as well. We investigated whether distraction of attention from the moving targets would alter the relative frequency of each percept. During the observation of the streaming/bouncing motion event in the peripheral visual field, visual attention was disrupted by an abrupt presentation of a visual distractor at various timings and locations (experiment 1; exogenous distraction of attention) or by the demand of an additional discrimination task (experiments 2 and 3; endogenous distraction of attention). Both types of distractions of attention increased the frequency of the bouncing percept and decreased that of the streaming percept. These results suggest that attention may facilitate the perception of object motion as continuing in the same direction as in the past.     

Effects of circular motion on judgment of rotation direction and depth order in visual motion

Abstract:  The rotation direction and depth order of a rotating sphere consisting of random dots often reverses while it is viewed under orthographic projection. However, if a short viewing distance is simulated under perspective projection, the correct rotation direction can be perceived. There are two motion cues for the rotation direction and depth order. One is the speed cue; points with higher velocities are closer to the observer. The other is the vertical motion cue; vertical motion is induced when the dots recede from or approach the observer. It was examined whether circular motion, which does not have any depth information but induces vertical velocities, masks the vertical motion cue. In Experiment 1, the effects of circular motion on the judgment of the rotation direction of a rotating sphere were examined. The magnitude of the two cues (the speed cue and the vertical velocity cue) as well as the angular speed of circular motion was varied. It was found that the performance improved as the vertical velocity increased and that the speed cue had slight effects on the judgment of the rotation direction. It was also found that the performance worsened as the angular speed of the circular motion was increased. In Experiment 2, the effects of circular motion on depth judgment of a rotating half sphere were investigated. The performance worsened as the angular speed of the circular motion increased, as in Experiment 1. These results suggest that the visual system cannot compensate perfectly for circular motion for the judgment of the rotation direction and depth order.     

试次历史对跨通道非空间返回抑制的影响

个体对刺激的反应不仅受刺激本身的影响, 还会受到先前刺激的影响, 表现为对当前试次中刺激的反应会受到前一试次的影响, 即试次历史。本研究采用“线索-中性线索-靶子”范式探讨前一试次有效性对跨通道的非空间返回抑制的影响。实验1通过连续两个试次间的线索有效性考察在跨通道非空间返回抑制中试次历史的影响。为了在跨通道非空间返回抑制中减小试次历史的影响, 实验2通过延长试次间时间间隔考察跨通道非空间返回抑制中试次历史的作用是否减小。结果发现, 前一试次线索无效时, 当前试次中的返回抑制效应量显著小于前一试次有效时, 这种影响会根据试次中线索和靶子通道的不同而不同。并且当延长试次间的时间间隔可以有效地减少前一试次对当前试次的影响。因此本研究表明, 试次历史能够对跨通道非空间返回抑制产生影响, 并且这种影响可以通过增大试次间时间间隔来减小。     

Switching in the cocktail party: exploring intentional control of auditory selective attention

Using a novel variant of dichotic selective listening, we examined the control of auditory selective attention. In our task, subjects had to respond selectively to one of two simultaneously presented auditory stimuli (number words), always spoken by a female and a male speaker, by performing a numerical size categorization. The gender of the task-relevant speaker could change, as indicated by a visual cue prior to auditory stimulus onset. Three experiments show clear performance costs with instructed attention switches. Experiment 2 varied the cuing interval to examine advance preparation for an attention switch. Experiment 3 additionally isolated auditory switch costs from visual cue priming by using two cues for each gender, so that gender repetition could be indicated by a changed cue. Experiment 2 showed that switch costs decreased with prolonged cuing intervals, but Experiment 3 revealed that preparation did not affect auditory switch costs but only visual cue priming. Moreover, incongruent numerical categories in competing auditory stimuli produced interference and substantially increased error rates, suggesting continued processing of task-relevant information that often leads to responding to the incorrect auditory source. Together, the data show clear limitations in advance preparation of auditory attention switches and suggest a considerable degree of inertia in intentional control of auditory selection criteria.