Interaction of Perception and Action in Discrete and Continuous Rapid Aiming Tasks

Previously, we have shown that discrete and continuous rapid aiming tasks are governed by distinct visuomotor control mechanisms by assessing the combined visual illusion effects on the perceived and effective index of difficulty (ID). All participants were perceptually biased by the combined visual illusion before they performed the rapid aiming tasks. In the current study, the authors manipulated the order of performing perceptual and motor tasks to examine whether perceptual or motor experience with the illusory visual target would influence the subsequent perceived and effective ID in discrete and continuous tapping tasks. The results supported our hypothesis showing that perceptual experience with the illusory visual target in the discrete condition reduced the effective ID in the subsequent discrete tapping task, and motor experience with the illusory visual target in the continuous condition reduced the illusion effects on the perceived ID in the subsequent perceptual judgment task. The study demonstrates the coinfluence of perception and action, and suggests that perception and action influence one another with different magnitude depending on the spatial frame of reference used to perform the perceptuomotor task.     

Retinal and extraretinal information in movement perception: how to invert the Filehne illusion

During a pursuit eye movement made in darkness across a small stationary stimulus, the stimulus is perceived as moving in the opposite direction to the eyes. This so-called Filehne illusion is usually explained by assuming that during pursuit eye movements the extraretinal signal (which informs the visual system about eye velocity so that retinal image motion can be interpreted) falls short. A study is reported in which the concept of an extraretinal signal is replaced by the concept of a reference signal, which serves to inform the visual system about the velocity of the retinae in space. Reference signals are evoked in response to eye movements, but also in response to any stimulation that may yield a sensation of self-motion, because during self-motion the retinae also move in space. Optokinetic stimulation should therefore affect reference signal size. To test this prediction the Filehne illusion was investigated with stimuli of different optokinetic potentials. As predicted, with briefly presented stimuli (no optokinetic potential) the usual illusion always occurred. With longer stimulus presentation times the magnitude of the illusion was reduced when the spatial frequency of the stimulus was reduced (increased optokinetic potential). At very low spatial frequencies (strongest optokinetic potential) the illusion was inverted. The significance of the conclusion, that reference signal size increases with increasing optokinetic stimulus potential, is discussed. It appears to explain many visual illusions, such as the movement aftereffect and center-surround induced motion, and it may bridge the gap between direct Gibsonian and indirect inferential theories of motion perception.     

A dot that went for a walk: People prefer lines drawn with human-like kinematics

A dominant theory of embodied aesthetic experience (Freedberg & Gallese, 2007, Trends in Cognitive Sciences, 11, 197) posits that the appreciation of visual art is linked to the artist’s movements when creating the artwork, yet a direct link between the kinematics of drawing actions and the aesthetics of drawing outcomes has not been experimentally demonstrated. Across four experiments, we measured aesthetic responses of students from arts and non-arts backgrounds to drawing movements generated from computational models of human writing. Experiment 1 demonstrated that human-like drawing movements with bell-shaped velocity profiles (Sigma Lognormal [SL] and Minimum Jerk [MJ]) are perceived as more natural and pleasant than movements with a uniform profile, and in both Experiments 1 and 2 movements that were perceived as more natural were also preferred. Experiment 3 showed that this effect persists if lower-level dynamic stimulus features are fully matched across experimental and control conditions. Furthermore, aesthetic preference for human-like movements were associated with greater perceptual fluency in Experiment 3, evidenced by unbiased estimations of the duration of natural movements. In Experiment 4, line drawings with visual features consistent with the dynamics of natural, human-like movements were preferred, but only by art students. Our findings directly link the aesthetics of human action to the visual aesthetics of drawings, but highlight the importance of incorporating artistic expertise into embodied accounts of aesthetic experience.     

集中和分散注意对多感觉整合中听觉主导效应的影响

听觉主导效应是指多感觉通道信息整合过程中,听觉通道中的信息得到优先加工,从而主导其他感觉通道的信息。研究采用经典的声音诱发闪光错觉的范式,通过两个实验操纵了注意资源的分配方式以及实验任务难度,考察了主动注意听觉通道的声音刺激对声音诱发闪光错觉产生的影响,以及任务难度对声音诱发闪光错觉的影响。结果发现:(1)裂变错觉会受到注意资源分配程度的影响,但是融合错觉则不然;(2)任务难度既不会影响裂变错觉,也不会影响融合错觉。说明了分散注意能够影响听觉主导效应中的裂变错觉,并且这种主导效应与任务难度无关。     

See what you’ve done! Active touch affects the number of perceived visual objects

Previous research has shown that visual perception is affected by sensory information from other modalities. For example, sound can alter the visual intensity or the number of visual objects perceived. However, when touch and vision are combined, vision normally dominates—a phenomenon known asvisual capture. Here we report a cross-modal interaction between active touch and vision: The perceived number of brief visual events (flashes) is affected by the number of concurrently performed finger movements (keypresses). This sensorimotor illusion occurred despite little ambiguity in the visual stimuli themselves and depended on a close temporal proximity between movement execution and vision.     

Age-related differences in the visual processes implied in perception and action: distance and location parameters

The aim of the two present experiments was to examine the ontogenetic development of the dissociation between perception and action in children using the Duncker illusion. In this illusion, a moving background alters the perceived direction of target motion. Targets were held stationary while appearing to move in an induced displacement. In Experiment 1, 30 children aged 7, 9, and 12 years and 10 adults made a perceptual judgment or pointed as accurately as possible, with their index finger, to the last position of the target. The 7-year-old children were more perceptually deceived than the others by the Duncker illusion but there were no differences for the goal-directed pointing movements. In Experiment 2, 50 children aged 7, 8, 9, 10, and 11 years made a perceptual judgment or reproduced as accurately as possible, with a handle, the distance traveled by the target. Participants were perceptually deceived by the illusion, judging the target as moving although it was stationary. When reproducing the distance covered by the target, children were unaffected by the Duncker illusion. Our results suggest that the separation of the allocentric visual perception pathway from the egocentric action pathway occurs before 7 years of age.     

The duration of a brief event in the mind's eye.

A new illusion of perceived duration associated with focused spatial attention is reported. Brief flashes in attended locations were perceived to last longer than the same flashes in unattended locations. That illusion was shown to be completely independent of another illusion concerning the perceived onset of a flash, ruling out the possibility that the effect on perceived duration is derivative of a comparison between perceived onset and offset. The illusion also occurred when the event duration was composed of a temporal gap rather than a brief flash, ruling out low-level visible persistence as a basis for the illusion. Taken together, the results point to cortical connections from higher brain centers' both speeding and prolonging the visual signals occurring in lower sensory regions. Those temporal consequences could easily subserve many of the perceptual benefits ascribed to attention for spatial and intensive properties.     

The moving rubber hand illusion revisited: Comparing movements and visuotactile stimulation to induce illusory ownership

The rubber hand illusion is a perceptual illusion in which a model hand is experienced as part of one’s own body. In the present study we directly compared the classical illusion, based on visuotactile stimulation, with a rubber hand illusion based on active and passive movements. We examined the question of which combinations of sensory and motor cues are the most potent in inducing the illusion by subjective ratings and an objective measure (proprioceptive drift). In particular, we were interested in whether the combination of afferent and efferent signals in active movements results in the same illusion as in the purely passive modes. Our results show that the illusion is equally strong in all three cases. This demonstrates that different combinations of sensory input can lead to a very similar phenomenological experience and indicates that the illusion can be induced by any combination of multisensory information.     

Observing repetitive finger movements modulates response times of auditorily cued finger movements

Our motor and perceptual representations of actions seem to be intimately linked and the human mirror neuron system (MNS) has been proposed as the mediator. In two experiments, we presented biological or non-biological movement stimuli that were either congruent or incongruent to a required response prompted by a tone. When the tone occurred with the onset of the last movement in a series, i.e., it was perceived during the movement presentation, congruent biological stimuli resulted in faster reaction times than congruent non-biological stimuli. The opposite was observed for incongruent stimuli. When the tone was presented after visual movement stimulation, however, no such interaction was present. This implies that biological movement stimuli only affect motor behaviour during visual processing but not thereafter. These data suggest that the MNS is an "online" system; longstanding repetitive visual stimulation (Experiment 1) has no benefit in comparison to only one or two repetitions (Experiment 2).     

Implicit motor sequence learning is not purely perceptual

Many reports have indicated that implicit learning of sequences in a choice response time task is primarily perceptual; subjects learn the sequence of stimuli rather than the sequence of motor responses. Three experiments tested whether implicit motor sequence learning could be purely perceptual: no support was found for that hypothesis. Subjects who merely watched stimuli did not learn the sequence implicitly (Experiment 1), and sequence learning transferred robustly to a different set of stimulus cues (Experiment 2). In the final experiment, the stimulus-response mapping was changed at transfer so that one group of subjects pushed the same sequence of keys but saw new stimuli, whereas another group pushed a different sequence of keys but saw the same stimuli. Transfer to the new mapping was shown only if the motor sequence was kept constant, not the perceptual sequence. It is proposed that subjects learn a sequence of response locations in this and similar tasks.     

Effects of nonconscious perception on motor response

The present study reviews the literature on the empirical evidence for the dissociation between perception and action. We first review several key studies on brain-damaged patients, such as those suffering from blindsight and visual/tactile agnosia, and on experimental findings examining pointing movements in normal people in response to a nonconsciously perceived stimulus. We then describe three experiments we conducted using simple reaction time (RT) tasks with backward masking, in which the first (weak) and second (strong) electric stimuli were consecutively presented with a 40-ms interstimulus interval (ISI). First, we compared simple RTs for three stimulus conditions: weak alone, strong alone, and double, i.e., weak plus strong (Experiment 1); then, we manipulated the intensity of the first stimulus from the threshold (T) to 1.2T and 2T, with the second stimulus at 4T (Experiment 2); finally, we tested three different ISIs (20, 40, and 60 ms) with the stimulus intensities at 1.2T and 4T for the first and second stimuli (Experiment 3). These experiments showed that simple RTs were shorter for the double condition than for the strong-alone condition, indicating that motor processes under the double condition may be triggered by sensory inputs arising from the first stimulus. Our results also showed that the first stimulus was perceived without conscious awareness. These findings suggested that motor processes may be dissociated from conscious perceptual processes and that these two processes may not take place in a series but, rather, in parallel. We discussed the likely mechanisms underlying nonconscious perception and motor response to a nonconsciously perceived stimulus.     

In space, the past can be recast but not the present

We address the relationship between perception and spatial, working memory. Specifically, we argue that perceptual experience following the creation of a representation of target location affects it in a systematic way. We designed a motor task in which observers had to point to the initial or final position of a horizontally drifting target embedded in a vertically drifting background. The target was perceived as having an illusory motion component in a direction opposite that of the inducer dots [Duncker, 1938, Source Book of Gestalt Psychology (London: Kegan Paul, Trench, Trubner and Co)]. For both positions, there was an identical time delay before the observer could respond. Nonetheless, estimates of the initial target position were significantly biased by the illusion in a direction opposite the perceived target motion, and both bias and variability were significantly greater than those of the target's final position. In prior studies on positional accuracy with induced displacement, a delay before a pointing response led to an unbiased position estimate obtained without delay to become biased, leading investigators to argue for a long-lasting, inaccurate cognitive system that overrules an accurate, nonetheless transient, motor one (Bridgeman et al, 1997, Perceptual Psychology 59 456-469). Since the same motor task with identical delay on either position yielded different outcomes, a hypothesis based on distinct motor and cognitive representations of visual space is untenable here. Instead, we argue that an online representation of the target's original position is updated in an ongoing fashion in order to reconcile the perceived illusion with the veridically perceived present (current target location).     

Do domestic dogs (<Emphasis Type="Italic">Canis lupus familiaris</Emphasis>) perceive the Delboeuf illusion?

In the last decade, visual illusions have been repeatedly used as a tool to compare visual perception among species. Several studies have investigated whether non-human primates perceive visual illusions in a human-like fashion, but little attention has been paid to other mammals, and sensitivity to visual illusions has been never investigated in the dog. Here, we studied whether domestic dogs perceive the Delboeuf illusion. In human and non-human primates, this illusion creates a misperception of item size as a function of its surrounding context. To examine this effect in dogs, we adapted the spontaneous preference paradigm recently used with chimpanzees. Subjects were presented with two plates containing food. In control trials, two different amounts of food were presented in two identical plates. In this circumstance, dogs were expected to select the larger amount. In test trials, equal food portion sizes were presented in two plates differing in size: if dogs perceived the illusion as primates do, they were expected to select the amount of food presented in the smaller plate. Dogs significantly discriminated the two alternatives in control trials, whereas their performance did not differ from chance in test trials with the illusory pattern. The fact that dogs do not seem to be susceptible to the Delboeuf illusion suggests a potential discontinuity in the perceptual biases affecting size judgments between primates and dogs.     

Gaze stability of observers watching Op Art pictures

It has been the matter of some debate why we can experience vivid dynamic illusions when looking at static pictures composed from simple black and white patterns. The impression of illusory motion is particularly strong when viewing some of the works of 'Op Artists, such as Bridget Riley's painting Fall. Explanations of the illusory motion have ranged from retinal to cortical mechanisms, and an important role has been attributed to eye movements. To assess the possible contribution of eye movements to the illusory-motion percept we studied the strength of the illusion under different viewing conditions, and analysed the gaze stability of observers viewing the Riley painting and control patterns that do not produce the illusion. Whereas the illusion was reduced, but not abolished, when watching the painting through a pinhole, which reduces the effects of accommodation, it was not perceived in flash afterimages, suggesting an important role for eye movements in generating the illusion for this image. Recordings of eye movements revealed an abundance of small involuntary saccades when looking at the Riley pattern, despite the fact that gaze was kept within the dedicated fixation region. The frequency and particular characteristics of these rapid eye movements can vary considerably between different observers, but, although there was a tendency for gaze stability to deteriorate while viewing a Riley painting, there was no significant difference in saccade frequency between the stimulus and control patterns. Theoretical considerations indicate that such small image displacements can generate patterns of motion signals in a motion-detector network, which may serve as a simple and sufficient, but not necessarily exclusive, explanation for the illusion. Why such image displacements lead to perceptual results with a group of Op Art and similar patterns, but remain invisible for other stimuli, is discussed.     

Illusory recouplings of onsets and terminations of glide tone components

We present a new auditory illusion, the gap transfer illusion, supported by phenomenological and psychophysical data. In a typical situation, an ascending frequency glide of 2,500 msec with a temporal gap of 100 msec in the middle and a continuously descending frequency glide of 500 msec cross each other at their central positions. These glides move at the same constant speed in logarithmic frequency in opposite directions. The temporal gap in the long glide is perceived as if it were in the short glide. The same kind of subjective transfer of a temporal gap can take place also when the stimulus pattern is reversed in time. This phenomenon suggests that onsets and terminations of glide components behave as if they were independent perceptual elements. We also find that when two long frequency glides are presented successively with a short temporal overlap, a long glide tone covering the whole duration of the pattern and a short tone around the temporal middle can be perceived. To account for these results, we propose an event construction model, in which perceptual onsets and terminations are coupled to construct auditory events and the proximity principle connects these elements.     

Judgments of synchrony between auditory and moving or still visual stimuli.

The flash-lag effect is a visual illusion wherein intermittently flashed, stationary stimuli seem to trail after a moving visual stimulus despite being flashed synchronously. We tested hypotheses that the flash-lag effect is due to spatial extrapolation, shortened perceptual lags, or accelerated acquisition of moving stimuli, all of which call for an earlier awareness of moving visual stimuli over stationary ones. Participants judged synchrony of a click either to a stationary flash of light or to a series of adjacent flashes that seemingly bounced off or bumped into the edge of the visual display. To be judged synchronous with a stationary flash, audio clicks had to be presented earlier--not later--than clicks that went with events, like a simulated bounce (Experiment 1) or crash (Experiments 2-4), of a moving visual target. Click synchrony to the initial appearance of a moving stimulus was no different than to a flash, but clicks had to be delayed by 30-40 ms to seem synchronous with the final (crash) positions (Experiment 2). The temporal difference was constant over a wide range of motion velocity (Experiment 3). Interrupting the apparent motion by omitting two illumination positions before the last one did not alter subjective synchrony, nor did their occlusion, so the shift in subjective synchrony seems not to be due to brightness contrast (Experiment 4). Click synchrony to the offset of a long duration stationary illumination was also delayed relative to its onset (Experiment 5). Visual stimuli in motion enter awareness no sooner than do stationary flashes, so motion extrapolation, latency difference, and motion acceleration cannot explain the flash-lag effect.     

The modulation of haptic line bisection by a visual illusion and optokinetic stimulation

Research has shown that a variety of different sensory manipulations, including visual illusions, transcutaneous nerve stimulation, vestibular caloric stimulation, optokinetic stimulation, and prism adaptation, can all influence people's performance on spatial tasks such as line bisection. It has been suggested that these manipulations may act upon the 'higher-order' levels of representation used to code spatial information. We investigated whether we could influence haptic line bisection in normal participants crossmodally by varying the visual background that participants viewed. In experiment 1, participants haptically bisected wooden rods while looking at a variant of the Oppel - Kundt visual illusion. Haptic-bisection judgments were influenced by the orientation of the visual illusion (in line with previous unimodal visual findings). In experiment 2, haptic-bisection judgments were also influenced by the presence of a leftward or rightward moving visual background. In experiments 3 and 4, the position of the to-be-bisected stimuli was varied with respect to the participant's body midline. The results confirmed an effect of optokinetic stimulation, but not of the Oppel -Kundt illusion, on participants' tactile-bisection errors, suggesting that the two manipulations might differentially affect haptic processing. Taken together, these results suggest that the 'higher-order' levels of spatial representation upon which perceptual judgments and/or motor responses are made may have multisensory or amodal characteristics.     

The line-motion illusion can be reversed by motion signals after the line disappears

In the line-motion illusion, a briefly flashed line appears to propagate from the locus of attention, despite being physically presented on the screen all at once. It has been proposed that the illusion reflects low-level visual information processing that occurs faster at the locus of attention (Hikosaka et al 1993 Vision Research 33 1219-1240; Perception 22 517-526). Such an explanation implicitly embeds the assumption that speeding or slowing of neural signals will map directly onto perceptual timing. This 'online' hypothesis presupposes that signals which arrive first are perceived first. However, other evidence suggests that events in a window of time after the disappearance of a visual stimulus can influence the brain's interpretation of that stimulus (Eagleman and Sejnowski 2000 Science 287 2036-2038; 289 1107a; 290 1051a; 2002 Trends in Neuroscience 25 293). If the online hypothesis were true, we should expect that events occurring after the flashing of the line would not change the illusion. Consistent with our hypothesis that awareness is an a posteriori reconstruction, we demonstrate that the perceived direction of illusory line-motion can be reversed by manipulating stimuli after the line has disappeared.     

Grasping visual illusions: no evidence for a dissociation between perception and action

Neuropsychological studies prompted the theory that the primate visual system might be organized into two parallel pathways, one for conscious perception and one for guiding action. Supporting evidence in healthy subjects seemed to come from a dissociation in visual illusions: In previous studies, the Ebbinghaus (or Titchener) illusion deceived perceptual judgments of size, but only marginally influenced the size estimates used in grasping. Contrary to those results, the findings from the present study show that there is no difference in the sizes of the perceptual and grasp illusions if the perceptual and grasping tasks are appropriately matched. We show that the differences found previously can be accounted for by a hitherto unknown, nonadditive effect in the illusion. We conclude that the illusion does not provide evidence for the existence of two distinct pathways for perception and action in the visual system.