Attentional modulation in perception of visual motion events.

Identical visual targets moving across each other with equal and constant speed can be perceived either to bounce off or to stream through each other. This bistable motion perception has been studied mostly in the context of motion integration. Since the perception of most ambiguous motion is affected by attention, there is the possibility of attentional modulation occurring in this case as well. We investigated whether distraction of attention from the moving targets would alter the relative frequency of each percept. During the observation of the streaming/bouncing motion event in the peripheral visual field, visual attention was disrupted by an abrupt presentation of a visual distractor at various timings and locations (experiment 1; exogenous distraction of attention) or by the demand of an additional discrimination task (experiments 2 and 3; endogenous distraction of attention). Both types of distractions of attention increased the frequency of the bouncing percept and decreased that of the streaming percept. These results suggest that attention may facilitate the perception of object motion as continuing in the same direction as in the past.     

Interactions between apparent motion rivalry in vision and touch

In multistable perception, the brain alternates between several perceptual explanations of ambiguous sensory signals. It is unknown whether multistable processes can interact across the senses. In the study reported here, we presented subjects with unisensory (visual or tactile), spatially congruent visuotactile, and spatially incongruent visuotactile apparent motion quartets. Congruent stimulation induced pronounced visuotactile interactions, as indicated by increased dominance times for both vision and touch, and an increased percentage bias for the percept already dominant under unisensory stimulation. Thus, the joint evidence from vision and touch stabilizes the more likely perceptual interpretation and thereby decelerates the rivalry dynamics. Yet the temporal dynamics depended also on subjects' attentional focus and was generally slower for tactile than for visual reports. Our results support Bayesian approaches to perceptual inference, in which the probability of a perceptual interpretation is determined by combining visual, tactile, or visuotactile evidence with modality-specific priors that depend on subjects' attentional focus. Critically, the specificity of visuotactile interactions for spatially congruent stimulation indicates multisensory rather than cognitive-bias mechanisms.     

Assessing the effects of audiovisual semantic congruency on the perception of a bistable figure

Bistable figures provide a fascinating window through which to explore human visual awareness. Here we demonstrate for the first time that the semantic context provided by a background auditory soundtrack (the voice of a young or old female) can modulate an observer's predominant percept while watching the bistable "my wife or my mother-in-law" figure (Experiment 1). The possibility of a response-bias account-that participants simply reported the percept that happened to be congruent with the soundtrack that they were listening to-was excluded in Experiment 2. We further demonstrate that this crossmodal semantic effect was additive with the manipulation of participants' visual fixation (Experiment 3), while it interacted with participants' voluntary attention (Experiment 4). These results indicate that audiovisual semantic congruency constrains the visual processing that gives rise to the conscious perception of bistable visual figures. Crossmodal semantic context therefore provides an important mechanism contributing to the emergence of visual awareness.     

Occluded motion alters event perception

We employed audiovisual stream/bounce displays, in which two moving objects with crossing trajectories are more likely to be perceived as bouncing off, rather than streaming through, each other when a brief sound is presented at the coincidence of the two objects. However, Kawachi and Gyoba (Perception 35:1289–1294, 2006b) reported that the presence of an additional moving object near the two objects altered the perception of a bouncing event to that of a streaming event. In this study, we extended this finding and examined whether alteration of the event perception could be induced by the visual context, such as by occluded object motion near the stream/bounce display. The results demonstrated that even when the sound was presented, the continuous occluded motion strongly biased observers’ percepts toward the streaming percept during a short occlusion interval (approximately 100 ms). In contrast, when the continuous occluded motion was disrupted by introducing a spatiotemporal gap in the motion trajectory or by removing occlusion cues such as deletion/accretion, the bias toward the streaming percept declined. Thus, we suggest that a representation of object motion generated under a limited occlusion interval interferes with audiovisual event perception.     

Task usefulness affects perception of rivalrous images

In bistable perception, several interpretations of the same physical stimulus are perceived in alternation. If one interpretation appears to help the observer to be successful in an auxiliary task, will that interpretation be seen more often than the other? We addressed this question using rivalrous stimuli. One of the elicited percepts presented an advantage for a separate visual search task that was run in close temporal proximity to the rivalry task. We found that the percept that was useful for the search task became dominant over the alternate percept. Observers were not aware of the manipulation that made one percept more useful, which suggests that usefulness was learned implicitly. The learning influenced only the first percept of each rivalrous presentation, but the bias persisted even when the useful percept was no longer useful. The long-lasting aspect of the effect distinguishes it from other documented attentional effects on bistable perception. Therefore, using implicit learning, we demonstrated that task usefulness can durably change the appearance of a stimulus.     

Congruency effects between auditory and tactile motion: Extending the phenomenon of cross-modal dynamic capture

Behavioral studies of multisensory integration in motion perception have focused on the particular case of visual and auditory signals. Here, we addressed a new case: audition and touch. In Experiment 1, we tested the effects of an apparent motion stream presented in an irrelevant modality (audition or touch) on the perception of apparent motion streams in the other modality (touch or audition, respectively). We found significant congruency effects (lower performance when the direction of motion in the irrelevant modality was incongruent with the direction of the target) for the two possible modality combinations. This congruency effect was asymmetrical, with tactile motion distractors having a stronger influence on auditory motion perception than vice versa. In Experiment 2, we used auditory motion targets and tactile motion distractors while participants adopted one of two possible postures: arms uncrossed or arms crossed. The effects of tactile motion on auditory motion judgments were replicated in the arms-uncrossed posture, but they dissipated in the arms-crossed posture. The implications of these results are discussed in light of current findings regarding the representation of tactile and auditory space.     

Neural synergy between kinetic vision and touch

Ambiguous visual information often produces unstable visual perception. In four psychophysical experiments, we found that unambiguous tactile information about the direction of rotation of a globe whose three-dimensional structure is ambiguous significantly influences visual perception of the globe. This disambiguation of vision by touch occurs only when the two modalities are stimulated concurrently, however. Using functional magnetic resonance imaging, we discovered that touching the rotating globe, even when not looking at it, reliably activates the middle temporal visual area (MT+), a brain region commonly thought to be crucially involved in registering structure from motion. Considered together, our results show that the brain draws on somatosensory information to resolve visual conflict.     

Multiplicative effects of intention on the perception of bistable apparent motion

When viewing ambiguous displays, observers can, via intentional efforts, affect which perceptual interpretation they perceive. Specifically, observers can increase the probability of seeing the desired percept. Little is known, however, about how intentional efforts interact with sensory inputs in exerting their effects on perception. In two experiments, the current study explored the possibility that intentional efforts might operate by multiplicatively enhancing the stimulus-based activation of the desired perceptual representation. Such a possibility is suggested by recent neurophysiological research on attention. In support of this idea, when we presented bistable apparent motion displays under stimulus conditions differentially favoring one motion percept over the other, observers' intentional efforts to see a particular motion were generally more effective under conditions in which stimulus factors favored the intended motion percept.     

Tactile stimulation disambiguates the perception of visual motion paths

Although visual perception traditionally has been considered to be impenetrable by non-visual information, there are a rising number of reports discussing cross-modal influences on visual perception. In two experiments, we investigated how coinciding vibrotactile stimulation affects the perception of two discs that move toward each other, superimpose in the center of the screen, and then move apart. Whereas two discs streaming past each other was the dominant impression when the visual event was presented in isolation, a brief coinciding vibrotactile stimulation at the moment of overlap biased the visual impression toward two discs bouncing off each other (Experiment 1). Further, the vibrotactile stimulation actually changed perceptual processing by reducing the amount of perceived overlap between the discs (Experiment 2), which has been demonstrated to be associated with a higher proportion of bouncing impressions. We propose that tactile-induced quantitative changes in the visual percept might alter the quality of the visual percept (from streaming to bouncing), thereby adding to the understanding of how cross-modal information interacts with early visual perception and how this interaction influences subsequent visual impressions.     

Stream/bounce perception and the effect of depth cues in chimpanzees (Pan troglodytes)

The stream/bounce display represents an ambiguous motion event in which two identical visual objects move toward one another and the objects overlap completely before they pass each another. In our perception, they can be interpreted as either streaming past one another or bouncing off each other. Previous studies have shown that the streaming percept of the display is generic for humans, suggesting the inertial nature of the motion integration process. In this study, chimpanzees took part in behavioral experiments using an object-tracking task to reveal the characteristics of their stream/bounce perception. Chimpanzees did not show a tendency toward a dominant "stream" perception of the stream/bounce stimulus. However, depth cues, such as X-junctions and local motion coherence, did promote the stream percept in chimpanzees. These results suggest both similarities and differences between chimpanzees and humans with respect to motion integration and object individuation processes.     

Visual motion interferes with tactile motion perception

Previous studies have demonstrated that visual apparent motion can alter the judgment of auditory apparent motion. We investigated the effect of visual apparent motion on judgments of the direction of tactile apparent motion. When visual motion was presented at the same time as, but in a direction opposite to, tactile motion, accuracy in judging the direction of tactile apparent motion was substantially reduced. This reduction in performance is referred to as 'the congruency effect'. Similar effects were observed when the visual display was placed either near to the tactile display or at some distance from the tactile display (experiment 1). In experiment 2, the relative alignment between the visual and tactile directions of motion was varied. The size of the congruency effect was similar at 0 degrees and 45 degrees alignments but much reduced at a 90 degrees alignment. In experiment 3, subjects made confidence ratings of their judgments of the direction of the tactile motion. The results indicated that the congruency effect was not due to subjects being unsure of the direction of motion and being forced to guess. In experiment 4, static visual stimuli were shown to have no effect on the judgments of direction of the tactile stimuli. The extent to which the congruency effect reflects capture effects and is the result of perceptual versus post-perceptual processes is discussed.     

Stimulus eccentricity and spatial frequency interact to determine circular vection.

While early research suggested that peripheral vision dominates the perception of self-motion, subsequent studies found little or no effect of stimulus eccentricity. In contradiction to these broad notions of 'peripheral dominance' and 'eccentricity independence', the present experiments showed that the spatial frequency of optic flow interacts with its eccentricity to determine circular vection magnitude--central stimulation producing the most compelling vection for high-spatial-frequency stimuli and peripheral stimulation producing the most compelling vection for lower-spatial-frequency stimuli. This interaction appeared to be due, in part at least, to the effect that the higher-spatial-frequency moving pattern had on subjects' ability to organise optic flow into related motion about a single axis. For example, far-peripheral exposure to this high-spatial-frequency pattern caused many subjects to organise the optic flow into independent local regions of motion (a situation which clearly favoured the perception of object motion not self-motion). It is concluded that both high-spatial-frequency and low-spatial-frequency mechanisms are involved in the visual perception of self-motion--with their activities depending on the nature and eccentricity of the motion stimulation.     

Spatial patterns in tactile perception: is there a tactile field?

Previous studies of tactile spatial perception focussed either on a single point of stimulation, on local patterns within a single skin region such as the fingertip, on tactile motion, or on active touch. It remains unclear whether we should speak of a tactile field, analogous to the visual field, and supporting spatial relations between stimulus locations. Here we investigate this question by studying perception of large-scale tactile spatial patterns on the hand, arm and back. Experiment 1 investigated the relation between perception of tactile patterns and the identification of subsets of those patterns. The results suggest that perception of tactile spatial patterns is based on representing the spatial relations between locations of individual stimuli. Experiment 2 investigated the spatial and temporal organising principles underlying these relations. Experiment 3 showed that tactile pattern perception makes reference to structural representations of the body, such as body parts separated by joints. Experiment 4 found that precision of pattern perception is poorer for tactile patterns that extend across the midline, compared to unilateral patterns. Overall, the results suggest that the human sense of touch involves a tactile field, analogous to the visual field. The tactile field supports computation of spatial relations between individual stimulus locations, and thus underlies tactile pattern perception.     

Tracking without perceiving: a dissociation between eye movements and motion perception

Can people react to objects in their visual field that they do not consciously perceive? We investigated how visual perception and motor action respond to moving objects whose visibility is reduced, and we found a dissociation between motion processing for perception and for action. We compared motion perception and eye movements evoked by two orthogonally drifting gratings, each presented separately to a different eye. The strength of each monocular grating was manipulated by inducing adaptation to one grating prior to the presentation of both gratings. Reflexive eye movements tracked the vector average of both gratings (pattern motion) even though perceptual responses followed one motion direction exclusively (component motion). Observers almost never perceived pattern motion. This dissociation implies the existence of visual-motion signals that guide eye movements in the absence of a corresponding conscious percept.     

Segmenting the body into parts: Evidence from biases in tactile perception

How do we individuate body parts? Here, we investigated the effect of body segmentation between hand and arm in tactile and visual perception. In a first experiment, we showed that two tactile stimuli felt farther away when they were applied across the wrist than when they were applied within a single body part (palm or forearm), indicating a “category boundary effect”. In the following experiments, we excluded two hypotheses, which attributed tactile segmentation to other, nontactile factors. In Experiment 2, we showed that the boundary effect does not arise from motor cues. The effect was reduced during a motor task involving flexion and extension movements of the wrist joint. Action brings body parts together into functional units, instead of pulling them apart. In Experiments 3 and 4, we showed that the effect does not arise from perceptual cues of visual discontinuities. We did not find any segmentation effect for the visual percept of the body in Experiment 3, nor for a neutral shape in Experiment 4. We suggest that the mental representation of the body is structured in categorical body parts delineated by joints, and that this categorical representation modulates tactile spatial perception.     

Segmenting the body into parts: evidence from biases in tactile perception

How do we individuate body parts? Here, we investigated the effect of body segmentation between hand and arm in tactile and visual perception. In a first experiment, we showed that two tactile stimuli felt farther away when they were applied across the wrist than when they were applied within a single body part (palm or forearm), indicating a "category boundary effect". In the following experiments, we excluded two hypotheses, which attributed tactile segmentation to other, nontactile factors. In Experiment 2, we showed that the boundary effect does not arise from motor cues. The effect was reduced during a motor task involving flexion and extension movements of the wrist joint. Action brings body parts together into functional units, instead of pulling them apart. In Experiments 3 and 4, we showed that the effect does not arise from perceptual cues of visual discontinuities. We did not find any segmentation effect for the visual percept of the body in Experiment 3, nor for a neutral shape in Experiment 4. We suggest that the mental representation of the body is structured in categorical body parts delineated by joints, and that this categorical representation modulates tactile spatial perception.     

Learning to perceive object unity: a connectionist account

To explore questions of how human infants begin to perceive partly occluded objects, we devised two connectionist models of perceptual development. The models were endowed with an existing ability to detect several kinds of visual information that have been found important in infants’ and adults’ perception of object unity (motion, co‐motion, common motion, relatability, parallelism, texture and T‐junctions). They were then presented with stimuli consisting of either one or two objects and an occluding screen. The models’ task was to determine whether the object or objects were joined when such a percept was ambiguous, after specified amounts of training with events in which a subset of possible visual information was provided. The model that was trained in an enriched environment achieved superior levels of performance and was able to generalize veridical percepts to a wide range of novel stimuli. Implications for perceptual development in humans, current theories of development and origins of knowledge are discussed.     

The whole moves less than the spin of its parts

When individually moving elements in the visual scene are perceptually grouped together into a coherently moving object, they can appear to slow down. In the present article, we show that the perceived speed of a particular global-motion percept is not dictated completely by the speed of the local moving elements. We investigated a stimulus that leads to bistable percepts, in which local and global motion may be perceived in an alternating fashion. Four rotating dot pairs, when arranged into a square-like configuration, may be perceived either locally, as independently rotating dot pairs, or globally, as two large squares translating along overlapping circular trajectories. Using a modified version of this stimulus, we found that the perceptually grouped squares appeared to move more slowly than the locally perceived rotating dot pairs, suggesting that perceived motion magnitude is computed following a global analysis of form. Supplemental demos related to this article can be downloaded from app.psychonomic-journals.org/content/supplemental.     

Rapid volitional control of apparent motion during percept generation

How rapidly can one voluntarily influence percept generation? The time course of voluntary visual–spatial attention is well studied, but the time course of intentional control over percept generation is relatively unknown. We investigated the latter question using “one-shot” apparent motion. When a vertical or horizontal pair of squares is replaced by its 90º-rotated version, the bottom-up signal is ambiguous. From this ambiguous signal, it is known that people can intentionally generate a percept of rotation in a desired direction (clockwise or counterclockwise). To determine the time course of this intentional control, we instructed participants to voluntarily induce rotation in a precued direction (clockwise rotation when a high-pitched tone was heard, and counterclockwise rotation when a low-pitched tone was heard), and then to report the direction of rotation that was actually perceived. We varied the delay between the instructional cue and the rotated frame (cue-lead time) from 0 to 1,067 ms. Intentional control became more effective with longer cue-lead times (asymptotically effective at 533 ms). Notably, intentional control was reliable even with a zero cue-lead time; control experiments ruled out response bias and the development of an auditory–visual association as explanations. This demonstrates that people can interpret an auditory cue and intentionally generate a desired motion percept surprisingly rapidly, entirely within the subjectively instantaneous moment in which the visual system constructs a percept of apparent motion.     

Tactile "capture" of audition

Previous research has demonstrated that the localization of auditory or tactile stimuli can be biased by the simultaneous presentation of a visual stimulus from a different spatial position. We investigated whether auditory localization judgments could also be affected by the presentation of spatially displaced tactile stimuli, using a procedure designed to reveal perceptual interactions across modalities. Participants made left-right discrimination responses regarding the perceived location of sounds, which were presented either in isolation or together with tactile stimulation to the fingertips. The results demonstrate that the apparent location of a sound can be biased toward tactile stimulation when it is synchronous, but not when it is asynchronous, with the auditory event. Directing attention to the tactile modality did not increase the bias of sound localization toward synchronous tactile stimulation. These results provide the first demonstration of the tactile capture of audition.