Interference with spatial working memory: An eye movement is more than a shift of attention

In the present experiments, we examined whether shifts of attention selectively interfere with the maintenance of both verbal and spatial information in working memory and whether the interference produced by eye movements is due to the attention shifts that accompany them. In Experiment 1, subjects performed either a spatial or a verbal working memory task, along with a secondary task requiring fixation or a secondary task requiring shifts of attention. The results indicated that attention shifts interfered with spatial, butnot with verbal, working memory, suggesting that the interference is specific to processes within the visuospatial sketchpad. In Experiment 2, subjects performed a primary spatial working memory task, along with a secondary task requiring fixation, an eye movement, or an attention shift executed in the absence of an eye movement. The results indicated that both eye movements and attention shifts interfered with spatial working memory. Eye movements interfered to a much greater extent than shifts of attention, however, suggesting that eye movements may contribute a unique source of interference, over and above the interference produced by the attention shifts that accompany them.     

Interference with Rehearsal in Spatial Working Memory in the Absence of Eye Movements

We have previously argued that rehearsal in spatial working memory is interfered with by spatial attention shifts rather than simply by movements to locations in space (Smyth & Scholey, 1994). It is possible, however, that the stimuli intended to induce attention shifts in our experiments also induced eye movements and interfered either with an overt eye movement rehearsal strategy or with a covert one. In the first experiment reported here, subjects fixated while they maintained a sequence of spatial items in memory before recalling them in order. Fixation did not affect recall, but auditory spatial stimuli presented during the interval did decrease performance, and it was further decreased if the stimuli were categorized as coming from the right or the left. A second experiment investigated the effects of auditory spatial stimuli to which no response was ever required and found that these did not interfere with performance, indicating that it is the spatial salience of targets that leads to interference. This interference from spatial input in the absence of any overt movement of the eyes or limbs is interpreted in terms of shifts of spatial attention or spatial monitoring, which Morris (1989) has suggested affects spatial encoding and which our findings suggest also affects reactivation in rehearsal.     

Towardsa clarification of spatial processing

Three experiments that adopt an interference paradigm to investigate characteristics of a type of movement causing interference with spatial processing are reported. Experiment 1 illustrates the importance of distinguishing between movement and attention to movement when investigating the movement characteristics of spatial processing. The technique of passive movement is used to minimize attention in the subsequent experiments. Experiment 2 confirms earlier experiments showing that passive movement causes interference in spatial processing. However, it extends the previous findings by demonstrating that passive movement is detrimental to spatial processing only when the movement is to a sequence of locations known in advance by the subjects. Experiment 3 demonstrates that the movement interference cannot be interpreted as a general interference effect but that it is selective for spatial processing. The results of these experiments permit a more precise delineation of the disruptive effects of movement in spatial processing and allow an explicit definition of spatial processing to be put forward.     

Attention demands of movements as a function of their duration and velocity

The attention demands of initiating and controlling discrete movements were examined as a function of their movement time (MT) and average movement velocity. Experiment 1 showed that the attention required to execute a movement decreased as MT decreased, although Experiment 2 through independently manipulating MT and movement velocity, revealed that movement velocity is the key determiner of attention demands rather than MT. The attention demands of preparing a high velocity movement are greater than during its execution with the reverse being the case for relatively slow velocity movements. The results are compatible with the view that it is the initiation of error corrections that are attention demanding (Keele 1973).     

Compatibility between observed and executed finger movements: comparing symbolic, spatial, and imitative cues

Intuitively, one can assume that imitating a movement is an easier task than responding to a symbolic stimulus like a verbal instruction. Support for this suggestion can be found in neuropsychological research as well as in research on stimulus-response compatibility. However controlled experimental evidence for this assumption is still lacking. We used a stimulus-response compatibility paradigm to test the assumption. In a series of experiments, it was tested whether observed finger movements have a stronger influence on finger movement execution than a symbolic or spatial cue. In the first experiment, we compared symbolic cues with observed finger movements using an interference paradigm. Observing finger movements strongly influenced movement execution, irrespective of whether the finger movement was the relevant or the irrelevant stimulus dimension. In the second experiment, effects of observed finger movements and spatial finger cues were compared. The observed finger movement dominated the spatial finger cue. A reduction in the similarity of observed and executed action in the third experiment led to a decrease of the influence of observed finger movement, which demonstrates the crucial role of the imitative relation of observed and executed action for the described effects. The results are discussed in relation to recent models of stimulus-response compatibility. Neurocognitive support for the strong relationship between movement observation and movement execution is reported.     

Motor interference and facilitation arising from observed movement kinematics

Previous studies demonstrate that observing the movements of others can interfere with concurrent movement execution. This interference effect is attributed to incongruence between the observed and executed movements. The study presented here examined different aspects of observed and executed movement congruency. Participants attempted to trace straight lines in the air using one of two movement tasks while observing an experimenter perform movements varied by their task and spatial congruency. The data revealed that kinematic aspects of the observed movements were incorporated into the observer's own movements. Observing the same kinematics led to interference or facilitation effects depending on whether the direction of the observed movement was congruent or incongruent with the movement the participant performed. These data suggest that low-level properties of observed movements can modulate participant performance.     

The influence of movement cues on intermanual interactions

In two experiments, we studied intermanual interactions in bimanual reversal movements and bimanual aiming movements. Targets were presented on a monitor or directly on the table on which the movements were produced. Amplitudes for each hand were cued symbolically or spatially either in advance of an imperative signal or simultaneous with it. In contrast to findings of Diedrichsen et al. (Psychological Science, 12, 493–498, 2001), reaction times for different-amplitude movements were longer than for same-amplitude movements both for symbolic and spatial cues presented on the monitor and directly on the table. However, with symbolic cues the effect of the relation between target amplitudes was considerably stronger than with spatial cues, no matter where the cues were presented. Intermanual correlations of amplitudes, movement times, and reaction times were smaller with different than with same target amplitudes, and this modulation was more pronounced when targets and cues were presented on the monitor than when they were presented on the table. The findings are taken to suggest that the basic reaction-time disadvantage of different-amplitude movements results from interference between concurrent processes of amplitude specification. Additional factors like interference between concurrent processes of mapping cues on movement characteristics may add strongly to it.     

Retinal masking during pursuit eye movements: implications for spatiotopic visual persistence

White (1976) reported that presentation of a masking stimulus during a pursuit eye movement interfered with the perception of a target stimulus that shared the same spatial, rather than retinal, coordinates as the mask. This finding has been interpreted as evidence for the existence of spatiotopic visual persistence. We doubted White's results because they implied a high degree of position constancy during pursuit eye movements, contrary to previous research, and because White did not monitor subjects' eye position during pursuit; if White's subjects did not make continuous pursuit eye movements, it might appear that masking was spatial when in fact it was retinal. We attempted to replicate White's results and found that when eye position was monitored to ensure that subjects made continuous pursuit movements, masking was retinal rather than spatial. Subjects' phenomenal impressions also indicated that retinal, rather than spatial, factors underlay performance in this task. The implications of these and other results regarding the existence of spatiotopic visual persistence are discussed.     

Oculomotor control and the maintenance of spatially and temporally distributed events in visuo-spatial working memory

Previous studies have demonstrated that working memory for spatial location can be significantly disrupted by concurrent eye or limb movement (Baddeley, 1986; Smyth, Pearson, & Pendleton, 1988). Shifts in attention alone can also interfere with spatial span (Smyth & Scholey, 1994), even with no corresponding movement of the eyes or limbs (Smyth, 1996). What is not clear from these studies is how comparable is the magnitude of effect caused by different forms of spatial disrupter. Recently, it has been demonstrated that limb movements produce as much interference with spatial span as do reflexive saccades (Lawrence, Myerson, Oonk, & Abrams, 2001). In turn this has led to the hypothesis that all spatially directed movement can produce similar effects in visuo-spatial working memory. This paper reports the results of five experiments that have contrasted the effect of concurrent eye movement, limb movement, and covert attention shifts on participants' working memory for sequences of locations. All conditions involving concurrent eye movement produced significantly greater reduction in span than equivalent limb movement or covert attention shifts with eyes fixated. It is argued that these results demonstrate a crucial role for oculomotor control processes during the rehearsal of location-specific representations in working memory.     

Mental object rotation and the planning of hand movements.

Recently, we showed that the simultaneous execution of rotational hand movements interferes with mental object rotation, provided that the axes of rotation coincide in space. We hypothesized that mental object rotation and the programming of rotational hand movements share a common process presumably involved in action planning. Two experiments are reported here that show that the mere planning of a rotational hand movement is sufficient to cause interference with mental object rotation. Subjects had to plan different spatially directed hand movements that they were asked to execute only after they had solved a mental object rotation task. Experiment 1 showed that mental object rotation was slower if hand movements were planned in a direction opposite to the presumed mental rotation direction, but only if the axes of hand rotation and mental object rotation were parallel in space. Experiment 2 showed that this interference occurred independent of the preparatory hand movements observed in Experiment 1. Thus, it is the planning of hand movements and not their preparation or execution that interferes with mental object rotation. This finding underlines the idea that mental object rotation is an imagined (covert) action, rather than a pure visual-spatial imagery task, and that the interference between mental object rotation and rotational hand movements is an interference between goals of actions.     

Mental object rotation and the planning of hand movements

Recently, we showed that the simultaneous execution of rotational hand movements interferes with mental object rotation, provided that the axes of rotation coincide in space. We hypothesized that mental object rotation and the programming of rotational hand movements share a common process presumably involved in action planning. Two experiments are reported here that show that the mere planning of a rotational hand movement is sufficient to cause interference with mental object rotation. Subjects had to plan different spatially directed hand movements that they were asked to execute only after they had solved a mental object rotation task. Experiment 1 showed that mental object rotation was slower if hand movements were planned in a direction opposite to the presumed mental rotation direction, but only if the axes of hand rotation and mental object rotation were parallel in space. Experiment 2 showed that this interference occurred independent of the preparatory hand movements observed in Experiment 1. Thus, it is the planning of hand movements and not their preparation or execution that interferes with mental object rotation. This finding underlines the idea that mental object rotation is an imagined (covert) action, rather than a pure visual-spatial imagery task, and that the interference between mental object rotation and rotational hand movements is an interference between goals of actions.     

Motor coordination uses external spatial coordinates independent of developmental vision

The constraints that guide bimanual movement coordination are informative about the processing principles underlying movement planning in humans. For example, symmetry relative to the body midline benefits finger and hand movements independent of hand posture. This symmetry constraint has been interpreted to indicate that movement coordination is guided by a perceptual code. Although it has been assumed implicitly that the perceptual system at the heart of this constraint is vision, this relationship has not been tested. Here, congenitally blind and sighted participants made symmetrical and non-symmetrical (that is, parallel) bimanual tapping and finger oscillation movements. For both groups, symmetrical movements were executed more correctly than parallel movements, independent of anatomical constraints like finger homology and hand posture. For the blind, the reliance on external spatial factors in movement coordination stands in stark contrast to their use of an anatomical reference frame in perceptual processing. Thus, the externally coded symmetry constraint evident in bimanual coordination can develop in the absence of the visual system, suggesting that the visual system is not critical for the establishment of an external-spatial reference frame in movement coordination.     

Oculocentric coding of inhibited eye movements to recently attended locations

Results are reported for experiments that examined eye movements directed toward recently cued objects. In 1 experiment participants were slower to initiate saccades toward the earlier location of an object that had been cued, even though the cued object had subsequently moved away from that location. Other experiments involved exploring the reference frame within which the inhibited eye movements are encoded. These experiments revealed that the eye movement that is inhibited is encoded in an oculocentric-rather than an environmental-reference frame. However, simple detection as indexed by manual keypress responses is encoded in an environmental reference frame. The results have implications for inhibition of return, for the link between eye movements and attention, and for the nature of the spatial reference frames in which both covert and overt movements of attention are encoded.     

Does high state anxiety exacerbate distractor interference?

Attentional Control Theory states that anxiety can cause attention to be allocated to irrelevant sources of information by hindering the ability to control attention and focus on the information that matters. In a separate line of inquiry, action-centred views of attention state that non-target distractors involuntarily activate response codes that may cause interference with target-directed movements (distractor interference effect). Due to the proposed negative effects of anxiety on attentional control, we examined whether anxiety could also modulate distractor interference. Participants executed target-directed aiming movements to one of three targets with the potential of a distractor being presented at near or far locations. Distractors were presented at different times with respect to the target presentation in order to explore the excitatory (0, −100 ms) and inhibitory (−850 ms) processing of the distractor. As a broad indication of the effect of anxiety, the analysis of no distractor trials indicated a lower proportion of time and displacement to reach peak velocity under high compared to low anxiety conditions. Meanwhile, the typical excitatory influence of the distractors located near, compared to far, at a short distractor-onset asynchrony was found in movement time and overall response time. However, this distractor excitation was even greater under high compared to low anxiety in the reaction time component of the response. These findings broadly implicate the attentional control perspective, but they further indicate an influence of anxiety on the excitation rather than inhibition of responses.     

Spatial orientation of a limb using egocentric reference points

Testing the hypothesis that spatial localization can be based on an abstracted spatial location code, rather than on stored proprioceptive information, orientation of an unseen limb was contrasted under intra- and interlimb-movement conditions. In Experiment 1, movements were executed in the midline either vertically upward or horizontally forward in the sagittal plane. These results revealed that intralimb errors were smaller than interlimb errors only at the most distant criterion spatial targets, and it was hypothesized that positioning of a limb could be mediated by a spatial location code if spatial targets were coded in association with body reference points. Experiment 2 tested the egocentric referent hypothesis further by manipulating the availability of body-based spatial reference points under intra- and interlimb conditions. At spatial targets that could be coded in conjunction with body reference points, no difference was found between intra- and interlimb accuracy. In contrast, at spatial targets where body reference points were absent, or at least made difficult to rely on, accuracy was greater in the intralimb condition. It was concluded that spatial reference points, in this instance body-based, are necessary if the spatial positioning of a limb is to be based on the spatial location code. The data were also discussed within a more comprehensive framework of spatial frames of reference.     

When goals constrain: Eye movements and memory for goal‐Oriented map study

Perspective goals, such as studying a map to learn a route through an environment or the overall layout of an environment, produce memory congruent with the goal‐directed rather than the studied perspective. One explanation for this finding is that perspective goals guide attention towards actively gathering relevant information during learning. A second explanation is that information is automatically organized into a goal‐congruent spatial model that guides retrieval. Both explanations predict goal‐congruent memory, but only the former one predicts eye movement differences during study. The present experiment investigated the effect of perspective goals on eye movement during map study and the flexibility of resulting spatial memories. Results demonstrate eye movements towards goal‐congruent map elements during learning, and lasting memory effects at test. These findings carry implications for the design of adaptive hand‐held and in‐vehicle navigation interfaces that accommodate for varied user goals. Copyright © 2008 John Wiley & Sons, Ltd.     

How infant-directed actions enhance infants’ attention,learning, and exploration: Evidence from EEG and computational modeling

When teaching infants new actions, parents tend to modify their movements. Infants prefer these infant-directed actions (IDAs) over adult-directed actions and learn well from them. Yet, it remains unclear how parents’ action modulations capture infants’ attention. Typically, making movements larger than usual is thought to draw attention. Recent findings, however, suggest that parents might exploit movement variability to highlight actions. We hypothesized that variability in movement amplitude rather than higher amplitude is capturing infants’ attention during IDAs. Using EEG, we measured 15-month-olds’ brain activity while they were observing action demonstrations with normal, high, or variable amplitude movements. Infants’ theta power (4–5 Hz) in fronto-central channels was compared between conditions. Frontal theta was significantly higher, indicating stronger attentional engagement, in the variable compared to the other conditions. Computational modelling showed that infants’ frontal theta power was predicted best by how surprising each movement was. Thus, surprise induced by variability in movements rather than large movements alone engages infants’ attention during IDAs. Infants with higher theta power for variable movements were more likely to perform actions successfully and to explore objects novel in the context of the given goal. This highlights the brain mechanisms by which IDAs enhance infants’ attention, learning, and exploration.     

Shift and deviate: Saccades reveal that shifts of covert attention evoked by trained spatial stimuli are obligatory

The premotor theory of attention predicts that motor movements, including manual movements and eye movements, are preceded by an obligatory shift of attention to the location of the planned response. We investigated whether the shifts of attention evoked by trained spatial cues (e.g., Dodd & Wilson, 2009) are obligatory by using an extreme prediction of the premotor theory: If individuals are trained to associate a color cue with a manual movement to the left or right, the shift of attention evoked by the color cue should also influence eye movements in an unrelated task. Participants were trained to associate an irrelevant color cue with left/right space via a training session in which directional responses were made. Experiment 1 showed that, posttraining, vertical saccades deviated in the direction of the trained response, despite the fact that the color cue was irrelevant. Experiment 2 showed that latencies of horizontal saccades were shorter when an eye movement had to be made in the direction of the trained response. These results demonstrate that the shifts of attention evoked by trained stimuli are obligatory, in addition to providing support for the premotor theory and for a connection between the attentional, motor, and oculomotor systems.     

Bimanual cross-talk during reaching movements is primarily related to response selection,not the specification of motor parameters

Simultaneous reaching movements made with the two hands can show a considerable increase in reaction time (RT) when they differ in terms of direction or extent, compared to when the movements involve the same direction and extent. This cost has been attributed to cross-talk in the specification of the motor parameters for the two hands. However, a recent study [Diedrichsen, Hazeltine, Kennerley, & Ivry, (2001). Psychological Science, 12, 493-498] indicates that when reaching movements are cued by the onset of the target endpoint, no compatibility effects are observed. To determine why directly cued movements are immune from interference, we varied the stimulus onset asynchrony for the two movements and used different combinations of directly cued and symbolically cued movements. In two experiments, compatibility effects were only observed when both movements were symbolically cued. No difference was found between compatible and incompatible movements when both movements were directly cued or when one was directly cued and the other was symbolically cued. These results indicate that interference is not related to the specification of movement parameters but instead emerges from processes associated with response selection. Moreover, the data suggest that cross-talk, when present, primarily shortens the RT of the second movement on compatible trials rather than lengthening this RT on incompatible trials.     

Separate movement planning and spatial assimilation effects in sequential bimanual aiming movements

This study extended earlier work by showing spatial assimilations in sequential bimanual aiming movements when the participant preplanned only the first movement of a two-movement sequence. Right-handed participants (n=20, aged 18 to 22 years) made rapid lever reversals of 20 degrees and 60 degrees singly and sequentially with an intermovement interval of 2.5 sec. Following blocked single practice of both movements in each hand (15 trials each), two sets of 30 sequential practice trials were completed. The sequences began with either the long or the short movement and the participant always knew the goal of the first movement. During the intermovement interval, the experimenter gave instructions to complete the sequence with a short movement, a long movement, or no movement in a random order. Compared to the single trials, both movements in the sequence overshot the short-distance and undershot the long-distance goal. Spatial errors increased when a change in the movement goal was required for the second movement in the sequence. The experiment demonstrated that separate planning of sequential aiming movements can reduce spatial assimilation effects, but interference due to practice organization and switching the task's goal must also be overcome in order to produce accurate aiming movements.