Interaction of cognitive and sensorimotor maps of visual space

Studies of saccadic suppression and induced motion have suggested separate representations of visual space for perception and visually guided behavior. Because these methods required stimulus motion, subjects might have confounded motion and position. We separated cognitive and sensorimotor maps without motion of target, background, or eye, with an “induced Roelofs effect”: a target inside an off-center frame appears biased opposite the direction of the frame. A frame displayed to the left of a subject’s center line, for example, will make a target inside the frame appear farther to the right than its actual position. The effect always influences perception, but in half of our subjects it did not influence pointing. Cognitive and sensorimotor maps interacted when the motor response was delayed; all subjects now showed a Roelofs effect for pointing, suggesting that the motor system was being fed from the biased cognitive map. A second experiment showed similar results when subjects made an open-ended cognitive response instead of a five-alternative forced choice. Experiment 3 showed that the results were not due to shifts in subjects’ perception of the felt straight-ahead position. In Experiment 4, subjects pointed to the target and judged its location on the same trial. Both measures showed a Roelofs effect, indicating that each trial was treated as a single event and that the cognitive representation was accessed to localize this event in both response modes.     

Interaction of Perception and Action in Discrete and Continuous Rapid Aiming Tasks

Previously, we have shown that discrete and continuous rapid aiming tasks are governed by distinct visuomotor control mechanisms by assessing the combined visual illusion effects on the perceived and effective index of difficulty (ID). All participants were perceptually biased by the combined visual illusion before they performed the rapid aiming tasks. In the current study, the authors manipulated the order of performing perceptual and motor tasks to examine whether perceptual or motor experience with the illusory visual target would influence the subsequent perceived and effective ID in discrete and continuous tapping tasks. The results supported our hypothesis showing that perceptual experience with the illusory visual target in the discrete condition reduced the effective ID in the subsequent discrete tapping task, and motor experience with the illusory visual target in the continuous condition reduced the illusion effects on the perceived ID in the subsequent perceptual judgment task. The study demonstrates the coinfluence of perception and action, and suggests that perception and action influence one another with different magnitude depending on the spatial frame of reference used to perform the perceptuomotor task.     

Attenuation of size illusion effect in dual-task conditions

We over-estimate or under-estimate the size of an object depending its background structure (e.g., the Ebbinghaus illusion). Since deciding and preparing to execute a movement is based on perception, motor performance deteriorates due to the faulty perception of information. Therefore, such cognitive process can be a source of a failure in motor performance, although we feel in control of our performance through conscious cognitive activities. If a movement execution process can avoid distraction by the illusion-deceived conscious process, the effect of the visual illusion on visuomotor performance can be eliminated or attenuated. This study investigated this hypothesis by examining two task performances developed for a target figure inducing the Ebbinghaus size illusion: showing visually perceived size of an object by index finger-thumb aperture (size-matching), and reaching out for the object and pretending to grasp it (pantomimed grasping). In these task performances, the size of the index finger-thumb aperture becomes larger or smaller than the actual size, in accordance with the illusion effect. This study examined whether the size illusion effect can be weakened or eliminated by the dual-task condition where actors’ attention to judge the object’s size and to produce the aperture size is interrupted. 16 participants performed the size-matching and pantomimed grasping tasks while simultaneously executing a choice reaction task (dual task) or without doing so (single task). Using an optical motion capture system, the size-illusion effect was analyzed in terms of the aperture size, which indicates the visually perceived object size. The illusion effect was attenuated in the dual task condition, compared to it in the single task condition. This suggests that the dual task condition modulated attention focus on the aperture movement and therefore the aperture movement was achieved with less distraction caused by illusory information.     

The fluttering-heart illusion: a new hypothesis

The fluttering-heart illusion is a perceived lagging behind of a colour target on a background of a different colour when the two are oscillated together. It has been proposed that the illusion is caused by a differential in the perceptual latencies of different colours (Helmholtz 1867/1962), a differential in rod-cone latencies (von Kries 1896) and rod-cone interactions (von Grünau 1975, 1976 Vision Research 15 431-436, 437-440; 16 397-401; see list of references there). The purpose of this experiment was to assess the hypothesis that the fluttering-heart illusion is caused by a differential in the perceived velocities of chromatic and achromatic motion. To evaluate this hypothesis, we tested observers possessing normal colour vision and deuteranopes. The perceived delay of a chromatic target relative to an achromatic target was measured as a function of background cone contrast and target colour. For observers with normal colour vision, the perceived delay of the chromatic target is greater in the L-S than the L-M testing conditions. The reverse is observed in deuteranope observers. We suggest that this is caused by the absence of an L-M opponent mechanism contributing to chromatic motion in deuteranopes. Greater background cone contrasts tended to yield smaller perceived delays in both normal and deuteranope observers, indicating that greater chromatic modulation decreases the perceived delay of the colour target. These results support the hypothesis that the fluttering-heart illusion can be explained by a differential in the perceived velocities of chromatic and achromatic motion.     

Motion versus position in the perception of head-centred movement

Abstract. Observers can recover motion with respect to the head during an eye movement by comparing signals encoding retinal motion and the velocity of pursuit. Evidently there is a mismatch between these signals because perceived head-centred motion is not always veridical. One example is the Filehne illusion, in which a stationary object appears to move in the opposite direction to pursuit. Like the motion aftereffect, the phenomenal experience of the Filehne illusion is one in which the stimulus moves but does not seem to go anywhere. This raises problems when measuring the illusion by motion nulling because the more traditional technique confounds perceived motion with changes in perceived position. We devised a new nulling technique using global-motion stimuli that degraded familiar position cues but preserved cues to motion. Stimuli consisted of random-dot patterns comprising signal and noise dots that moved at the same retinal 'base' speed. Noise moved in random directions. In an eye-stationary speed-matching experiment we found noise slowed perceived retinal speed as 'coherence strength' (ie percentage of signal) was reduced. The effect occurred over the two-octave range of base speeds studied and well above direction threshold. When the same stimuli were combined with pursuit, observers were able to null the Filehne illusion by adjusting coherence. A power law relating coherence to retinal base speed fit the data well with a negative exponent. Eye-movement recordings showed that pursuit was quite accurate. We then tested the hypothesis that the stimuli found at the null-points appeared to move at the same retinal speed. Two observers supported the hypothesis, a third partially, and a fourth showed a small linear trend. In addition, the retinal speed found by the traditional Filehne technique was similar to the matches obtained with the global-motion stimuli. The results provide support for the idea that speed is the critical cue in head-centred motion perception.     

Fast Responses of the Human Hand to Changes in Target Position

If a target toward which an individual moves his hand suddenly moves, he adjusts the movement of his hand accordingly. Does he use visual information on the target's velocity to anticipate where he will reach the target? These questions were addressed in the present study. Subjects (N = 6 in each of 4 experiments) were instructed to hit a disk with a rod as soon as it appeared on a screen. Trajectories of the hand toward stationary disks were compared with those toward disks that jumped leftward or rightward as soon as the subject's hand started moving toward the screen, and with those in which either the disk or the background started moving leftward or rightward. About 110 ms after the disk was suddenly displaced, the moving hand was diverted in the direction of the perturbation. When the background moved, the disk's perceived position shifted in the direction in which the background was moving, but the disk appeared to be moving in the opposite direction. When hitting such disks, subjects adjusted their movement in accordance with the perceived position, rather than moving their hand in the direction of the perceived motion in anticipation of the disk's future displacement. Thus, subjects did not use the perceived velocity to anticipate where they would reach the target but responded only to the change in position     

Representation and learning in motor action – Bridges between experimental research and cognitive robotics

To gain a better understanding of the functionality of representation and categorization in action and interaction, it is fundamental that researchers understand how movements are represented in long-term memory. It is our position that human motor control requires that our actions be planned and represented in terms of intended perceptual effects and future task demands, and that the individual has a well-structured mental representation of the task so that the movement can be carried out successfully. Basic Action Concepts (BACs) are identified as major building blocks of cognitive representation in long-term memory, which are cognitive tools used to master the functional demands of movement tasks. In this paper, we consider relevant issues in research methodology and present an experimental method that can be used to assess action-relevant representational structures. This method permits us to observe the strong relationship between cognitive representation and performance in manual action. For example, the specific differences in the mental representations of participants are strongly related to skill level, as well as biomechanical and task constraints. We then discuss results from our learning experiments, where we have examined the development and changes in cognitive representation over time. From these experiments we have found that cognitive reference structures include task-specific spatial information, which provides the basis for action control in skilled voluntary movement. We have implemented these results on various robotic platforms. We argue that the insights gained from various experimental approaches in the field of cognitive psychology and motor control enable researchers to explore the possibilities and limitations of artificial control architectures in robot systems. Finally, we argue that this is not a unidirectional process. Researchers from the field of cognitive psychology and motor control can profit from the advances in technological systems, which enhance the understanding of human motor control in skilled voluntary action.     

Influence of acoustic context on sound localization: An auditory Roelofs effect

The Roelofs effect is a visual direction illusion: if a large rectangular frame is seen offset from the straight-ahead direction, a small target presented simultaneously is mislocalized in the opposite direction. To investigate whether a similar context illusion might affect auditory localization, we presented a frame of 6 speakers driven with a 300-Hz square wave, 30° left or right of center. The target was a speaker driven with the same waveform, with the two sources in random phase relationship. The target was mislocalized in a direction opposite the frame, an auditory Roelofs effect. A second experiment, using dissimilar sounds for frame and target, yielded no frame-dependent mislocalizations. The effect appeared both in verbal position estimation, a measure of cognitive localization, and in open-loop pointing, a measure of localization in a sensorimotor system. We conclude that audition possesses only one representation of space, in contrast to the two (cognitive and sensorimotor) of vision. The auditory representation corresponds most closely to vision's cognitive system.     

Spatio-temporal probing of apparent rotational movement

A visual bar alternately presented in vertical and horizontal orientations appeared to rotate 90° through one of two pairs of opposite quadrants. Subjects judged whether a probe dot, interjected at some delay and angular deviation from the vertical bar, appeared before or after the bar “passed through” the corresponding angular orientation. When the motion was perceived in the probed quadrant, percent “before” responses dropped abruptly from near 100% to near 0% as delay increased, and the drop occurred at longer delays for probes at larger angular deviations. Under physically identical conditions, when the motion was perceived in an unprobed quadrant, percent “before” responses varied much less with delay and insignificantly with angular position. The accuracy of the judgments in the first case suggests the internal generation of an ordered sequence of intermediate representations during each apparent rotation.     

Dynamic illusion effects in a reaching task: evidence for separate visual representations in the planning and control of reaching.

The effects of an orientation illusion on perception and 2 different actions were investigated. An 8-cm x 2-cm cylindrical bar was placed in front of participants at various orientations. A background grating was used to induce an orientation illusion. In a perception task, the illusion affected participants' ability to align the bar with their sagittal planes. In one reaching task, a similar effect of the illusion was found on the choice between 2 possible grasping postures. In a second reaching task involving a single grasping posture, the orientation illusion affected the orientation of the hand at the beginning of the reach but not near its end. The authors argue that reaching trajectories are planned and initiated through a context-dependent representation but are corrected on-line through a context-independent representation. The relation of this model to a more general dichotomy between perception and action is discussed.     

The effect of hand position and pattern motion on temporal order judgments

Subjects made temporal order judgments (TOJs) of tactile stimuli presented to the fingerpads. The subjects judged which one of two locations had been stimulated first. The tactile stimuli were patterns that simulated movement across the fingerpads. Although irrelevant to the task, the direction of movement of the patterns biased the TOJs. If the pattern at one location moved in the direction of the second location, the subjects tended to judge the first location as leading the second location. If the pattern moved in the opposite direction, that location was judged as trailing. In a series of experiments, the effect of the spatial position of the hands and fingers on TOJs and the perception of the direction of pattern movement were examined. Changing the position of the hands so that the patterns no longer moved directly toward each other reduced or eliminated the effect of motion on TOJs. In a variation of Aristotle's illusion, the moving patterns were presented to crossed and uncrossed fingers. The results indicated that, contrary to Aristotle's illusion, the subjects processed the moving patterns relative to an environmental framework, rather than to the local direction of motion on the fingerpads. Presenting the patterns to crossed hands produced results similar to those obtained with crossed fingers: The subjects processed the patterns according to an environmental framework.     

Representational Momentum Beyond Internalized Physics

Abstract— Prediction of future motion is necessary in order to successfully deal with moving objects. Implicit measures have been used to evaluate the sources of information used in this task. For instance, observers may be asked to localize the final position of a moving target. Judgments have been found to be displaced in the direction of motion (forward displacement), suggesting that observers have internalized a mental analogue of physical momentum. However, more recent studies have shown that forward displacement may not be caused by cognitive mechanisms alone. Rather, predictive mechanisms at the perceptual and motor levels may contribute to the forward error. Supporting the notion that mechanisms of anticipation may be embodied, the forward error was found to depend on the execution of eye and pointing movements. Also, forward displacement depended on the motion type that was presented (smooth vs. jerky or implied), which suggests that attention moves to the next expected target position to facilitate responses to this position.     

Response coding in the Simon task

Recent findings indicate that two distinct mechanisms can contribute to a Simon effect: a visuomotor information transmission on the one hand and a cognitive code interference on the other hand (see for e.g., Wiegand & Wascher, in Journal of Experimental Psychology: Human Perception and Performance 2005a). Furthermore, it was proposed that the occurrence of one or the other mechanism strongly depends on the way responses are coded. Visuomotor information transmission seems to depend on a correspondence between stimulus position and spatial anatomical status of the effector, whereas cognitive code interference is thought to be based on relative response location codes. To further test the spatial anatomic coding hypothesis, three experiments were conducted, in which the Simon effect with unimanual responses was investigated for horizontal (Experiment 1 and 2) and vertical (Experiment 3) stimulus-response (S-R) relations. Based on the finding of a decreasing effect function (indicating the presence of visuomotor information transmission) for horizontal and vertical S-R relations, it was concluded that visuomotor information transmission occurs whenever there is an overlap between the spatial stimulus feature and parameters of the motor representation of the response. Furthermore, the specific motor representation seems to be task dependent, that is, it entails those response parameters that clearly differentiate between the two response alternatives in a given task situation.     

Segregation of cognitive and motor aspects of visual function using induced motion

Targets were displaced to cancel an apparent displacement induced by a step motion of a background or were held stationary while appearing to jump in an induced displacement. Target and background were then extinguished, and the subject pointed to the target’s last position. When the target had appeared to move but did not, background position did not significantly affect pointing; when the target had moved but appeared to remain stationary (displacement canceled by opposite induced displacement), pointing depended upon the target’s egocentric position. A similar result was obtained with sinusoidal motion. In terms of a two visual-systems hypothesis, the motor system uses more veridical spatial information and is less affected by relative changes in two retinal signals than is the cognitive system.     

Cues facilitate detection of motion in dynamic random-dot patterns

In 1981 Ball and Sekuler showed that a briefly flashed line which primed the subject to the direction of target motion improved the detection of a target. Our aim was to study whether a pointing arrow and random-dot patterns that move in one of four possible directions can prime detection of motion for higher-contrast stimuli. When the motion of a target was primed and the cue validity was 100%, the target's position was more easily detected. Improvement was significant when the direction indicated by the cue and a target's direction were either the same or opposite relative to each other. When the subjects (n = 5 each experiment) did not know the direction of the target before the presentation of the stimulus field, no improvement was found. A discussion of attention to the cue is presented.     

Perception of the Ebbinghaus illusion in four-day-old domestic chicks (Gallus gallus)

In the Ebbinghaus size illusion, a central circle surrounded by small circles (inducers) appears bigger than an identical one surrounded by large inducers. Previous studies have failed to demonstrate sensitivity to this illusion in pigeons and baboons, leading to the conclusion that avian species (possibly also nonhuman primates) might lack the neural substrate necessary to perceive the Ebbinghaus illusion in a human-like fashion. Such a substrate may have been only recently evolved in the primate lineage. Here, we show that this illusion is perceived by 4-day-old domestic chicks. During rearing, chicks learnt, according to an observational-learning paradigm, to find food in proximity either of a big or of a small circle. Subjects were then tested with Ebbinghaus stimuli: two identical circles, one surrounded by larger and the other by smaller inducers. The percentage of approaches to the perceptually bigger target in animals reinforced on the bigger circle (and vice versa for the other group) was computed. Over four experiments, we demonstrated that chicks are reliably affected by the illusory display. Subjects reinforced on the small target choose the configuration with big inducers, in which the central target appears perceptually smaller; the opposite is true for subjects reinforced on the big target. This result has important implications for the evolutionary history of the neural substrate involved in the perception of the Ebbinghaus illusion.     

Priming by motion too rapid to be consciously seen

When a rapidly rotating ring of dots was briefly flashed, observers saw only a solid ring with no discriminable rotation. However, when this stimulus served as a prime that was followed by a target that consisted of a clearly rotating ring of dots, response times (RTs) to report the target's rotation were shorter when the prime and target directions were congruent than when they were incongruent. In accord with shape priming data, this priming effect increased monotonically with the prime-target stimulus-onset asynchrony (SOA). The prime also biased the perceived direction of an ambiguous apparent motion target, but only at an intermediate SOA. At the same SOA, we also found that target presentations enabled above-chance discrimination of prime's rotation direction. These outcomes demonstrate the processing of motion direction information that is not phenomenally represented. They suggest a common mechanism may mediate the priming of RTs by shape and motion, whereas a different mechanism mediates perceptual measures of motion priming.     

Position constancy during pursuit eye movement: An investigation of the filehne illusion

Experiments were performed to investigate the Filehne illusion, the apparent movement of the background during pursuit eye movements. In a dark room subjects tracked a luminous target as it moved at 3°/s or 10.5/s in front of an illuminated background which was either stationary or moved at a fraction of the target speed in the same or opposite direction. Subjects reported whether the background appeared to move and the direction of the movement. Results reveal only a partial loss of position constancy for the background during tracking. The stationary background is perceived to move slightly in the direction opposite to that in which the tracked target is moving. These results seemed best described as an instance of perceptual underconstancy and led to the speculation that the source of the illusion is an underestimation of the rate of pursuit eye movements. An experimental test of this hypothesis which produced supporting evidence is reported.     

Stereoscopic depth and the occlusion illusion

In the occlusion illusion, the visible portion of a partly occluded object appears larger than a physically identical nonoccluded region. Stereoscopic displays allowed for a direct test of the apparent-distance hypothesis. In Experiments 1A and 1B, we measured both the perceived size and the perceived depth of partly occluded targets when the binocular disparity of both targets and occluders was varied. Stereoscopic occlusion greatly increased perceived target size but not perceived target distance. A reduced illusion was still present when the target was stereoscopically in front of the abutting rectangle, however. Experiments 2A and 2B showed similar results, even when the occluding figures were illusory rectangles that formed no explicit T-junctions. Experiment 3 showed that an unexpected negative size illusion on control trials was primarily due to adaptation to the occlusion illusion on other trials. The present findings eliminate apparent-distance explanations of the occlusion illusion but are consistent with other hypotheses, such as partial modal completion and selective dimensional expansion.     

A Simon effect induced by induced moton and location: evidence for a direct linkage of cognitive and motor maps

It has been argued that two distinct maps of visual space are formed: a cognitive map that is susceptible to illusions, and a motor map that represents the physical world veridically. In the present study, subjects responded to a nonspatial attribute of a visual target stimulus by pressing a left or right key, while an illusory horizontal displacement of the target was induced. A Simon-type effect was obtained to the induced target motion or position shift-that is, responses were faster when the illusory target motion or location corresponded to the response position. Further experiments indicated that the observed effects cannot be accounted for by attentional shifts. These results suggest that the content of the cognitive map does not only influence perceptual judgments but is also responsible for the automatic activation of response codes. In other words, perception and action seem to be fed by a common, cognitively penetrable, spatial representation.