Attentional focussing and spatial stimulus-response compatibility

Summary The relative functional significance of attention shifts and attentional zooming for the coding of stimulus position in spatial compatibility tasks is demonstrated by proposing and testing experimentally a tentative explanation of the absence of a Simon effect in Experiment 3 of Umiltà and Liotti (1987). It is assumed that the neutral point of the spatial frame of reference for coding spatial position is at the position where attention is focussed immediately before exposition of the stimulus pattern. If a stimulus pattern is exposed to the right or the left of this position a spatial compatibility effect can be observed when the stimulus-response pairing is incompatible. Generalizing from this, one can say that a spatial compatibility effect will be observed if the last step in attentional focussing of the stimulus attribute specifying the response is a horizontal or a vertical attention shift. If the last step in focussing is attentional zooming (change in the representational level attended to), the stimulus pattern is localized at the horizontal and the vertical positions where the last attention shift had positioned the focus. In this case the spatial code is neutral on these dimensions and so no spatial compatibility effect should result. To test this model we conducted two experiments. Experiment 1 replicated the finding of Umiltà and Liotti that there is no Simon effect in the condition with no delay between a positional cue (two small boxes on the left or right of a fixation cross) and the imperative stimulus, whereas in the condition with a delay of 500 ms a Simon effect was observed. In a comparison condition with a single, rather large cue instead of two small boxes (forcing attention to zoom in), no Simon effect was observed under either delay condition. Experiment 2 used a spatial compatibility task proper with the same experimental conditions as Experiment 1. But in contrast to those of Experiment 1, the results show strong compatibility effects in all cue and delay conditions. The absence of a Simon effect in some experimental conditions in Experiment 1 and the presence of a spatial compatibility effect proper in all conditions in Experiment 2 are consistently accounted for with the proposed attentional explanation of spatial coding and spatial compatibility effects.     

Attention shifts produce spatial stimulus codes

Summary In the Simon task the spatial position of the stimulus, though task irrelevant, influences speed of response. We (Umiltà & Nicoletti, 1992) proposed that the orienting of attention to the imperative stimulus produces a Stroop-like interference. This paper reports the results of three experiments that provide empirical support for two predictions of this hypothesis. One is that the stimulus spatial code is formed with relation to the position to which attention is directed. The other prediction is that the Simon effect is obtained on condition that attention can orient to the stimulus.Some of the results of Experiments 1 and 2 were reported briefly in Umiltà and Nicoletti (1992)     

The role of attention for the Simon effect

Summary It has been claimed that spatial attention plays a decisive role in the effect of irrelevant spatial stimulus-response correspondence (i. e., the Simon effect), especially the way the attentional focus is moved onto the stimulus (lateral shifting rather than zooming). This attentional-movement hypothesis is contrasted with a referential-coding hypothesis, according to which spatial stimulus coding depends on the availability of frames or objects of reference rather than on certain attentional movements. In six experiments, reference objects were made available to aid spatial coding, which either appeared simultaneously with the stimulus (Experiments 1–3), or were continuously visible (Experiments 4–6). In contrast to previous experiments and to the attentional predictions, the Simon effect occurred even though the stimuli were precued by large frames surrounding both possible stimulus positions (Experiment 1), even when the reference object's salience was markedly reduced (Experiment 2), or when the precueing frames were made more informative (Experiment 3). Furthermore, it was found that the Simon effect is not reduced by spatial correspondence between an uninformative spatial precue and the stimulus (Experiment 4), and it does not depend on the location of spatial precues appearing to the left or right of both possible stimulus locations (Experiment 5). This was true even when the precue was made task-relevant in order to ensure attentional focusing (Experiment 6). In sum, it is shown that the Simon effect does not depend on the kind of attentional operation presumably performed to focus onto the stimulus. It is argued that the available data are consistent with a coding approach to the Simon effect which, however, needs to be developed to be more precise as to the conditions for spatial stimulus coding.     

Influences of response position and hand posture on the orthogonal Simon effect

When lateralized responses are made to the locations of vertically arrayed stimuli, two types of mapping effect have been reported: an overall up-right/down-left advantage and mapping preferences that vary with response position. According to Cho and Proctor's (2003) multiple asymmetric codes account, these orthogonal stimulus-response compatibility effects are due to the correspondence of stimulus polarity and response polarity, as determined by the positions relative to multiple frames of reference. The present study examined these two types of orthogonal compatibility for situations in which participants made left-right responses to the colours of a vertically arrayed stimulus set, and stimulus location was irrelevant. Although a significant orthogonal Simon effect was not evident when responding at a centred, neutral response position, the effect was modulated by response eccentricity (Experiment 2) and hand posture (Experiment 3). These effects are qualitatively similar to those obtained when stimulus location is task relevant. The results imply that, as Proctor and Cho's (2006) polarity correspondence principle suggests, the stimulus polarity code activates the response code of corresponding polarity even when stimulus location is irrelevant to the task.     

Influences of response position and hand posture on the orthogonal Simon effect

When lateralized responses are made to the locations of vertically arrayed stimuli, two types of mapping effect have been reported: an overall up–right/down–left advantage and mapping preferences that vary with response position. According to Cho and Proctor's (2003) multiple asymmetric codes account, these orthogonal stimulus–response compatibility effects are due to the correspondence of stimulus polarity and response polarity, as determined by the positions relative to multiple frames of reference. The present study examined these two types of orthogonal compatibility for situations in which participants made left–right responses to the colours of a vertically arrayed stimulus set, and stimulus location was irrelevant. Although a significant orthogonal Simon effect was not evident when responding at a centred, neutral response position, the effect was modulated by response eccentricity (Experiment 2) and hand posture (Experiment 3). These effects are qualitatively similar to those obtained when stimulus location is task relevant. The results imply that, as Proctor and Cho's (2006) polarity correspondence principle suggests, the stimulus polarity code activates the response code of corresponding polarity even when stimulus location is irrelevant to the task.     

Modes of spatial coding in the Simon task*

Many models of the Simon effect assume that categorical spatial representations underlie the phenomenon. The present study tested this assumption explicitly in two experiments, both of which involved eight possible spatial positions of imperative stimuli arranged horizontally on the screen. In Experiment 1, the eight stimulus locations were marked with eight square boxes that appeared at the same time during a trial. Results showed gradually increasing Simon effects from the central locations to the outer locations. In Experiment 2, the eight stimulus locations consisted of a combination of three frames of spatial reference (hemispace, hemifield, and position relative to the fixation), with each frame appearing in different timings. In contrast to Experiment 1, results showed an oscillating pattern of the Simon effect across the horizontal positions. These findings are discussed in terms of grouping factors involved in the Simon task. The locations seem to be coded as a single continuous dimension when all are visible at once as in Experiment 1, but they are represented as a combination of the lateral categories (“left” vs. “right”) with multiple frames of reference when the reference frames are presented successively as in Experiment 2.     

Spontaneous decay of response-code activation

Summary Two experiments investigated whether theTwo experiments investigated whether the Simon effect (i. e.., faster responses to spatially corresponding than to noncorresponding stimuli, with stimulus location being irrelevant) is affected by the frequency of noncorrespondence trials. Stimulus discriminability (Experiment 1) and immediate or delayed stimulus formation (Experiment 2) was varied in order to manipulate the temporal relationship between coding of the relevant stimulus information and of stimulus location. As was expected, the Simon effect decreased from high to low discriminability and from immediate- to delayed-stimulus formation. This is consistent with the notion of a gradual decay of location-induced response-code activation. Moreover, the Simon effect decreased with increasing frequency of noncorrespondence trials and was even reversed with higher frequency. This demonstrates strategic preparation of stimulus processing and/or response selection based on irrelevant location information. However, frequency did not modify the interaction between S-R correspondence and stimulus discriminability or stimulus formation, this suggesting that code decay is not a result of a strategy, but an automatic process.     

A Simon effect in memory retrieval: Evidence for the response-discrimination account

According to the traditional view, the effects of irrelevant stimulus location on the selection of a spatial response to a nonspatial stimulus feature (Simon effect) result from long-term associations between spatial stimulus codes and spatially corresponding response codes. According to an alternative view, the response-discrimination account, Simon effects arise from interactions between spatial stimulus codes and response labels in working memory (WM). The latter account predicts Simon effects when participants use spatial labels for response representation in WM, even when the actual responses have no spatial features (e.g., saying the word "plate"). The prediction was tested in an experiment, in which participants first encoded two words at different locations, and then responded to a stimulus by saying the word from the location indicated by stimulus color. The manipulation concerned the correspondence between irrelevant location of the colored stimulus and the retrieval cue for the vocal responses (i.e., word location in the encoding display). A Simon effect in memory retrieval was observed, supporting the response-discrimination account.     

The Simon effect and visual motion

Summary S-R compatibility and Simon effects were studied for real visual motion. In Experiment 1, two small stimulus lights were constantly visible, 5° to the left and right of fixation; after a random delay, one began to move at 2°/s. In Experiment 2, a single stimulus light moving at 2°/s suddenly appeared 5° to the left or right of fixation, i. e., motion onset and stimulus onset coincided. In both experiments, subjects responded by a key press with their left or right index finger as soon as they detected motion. In Condition A responses were made to the position (left or right) from which the motion started, irrespective of its direction (position compatibility); in Condition B responses were made to the direction of motion (leftward or rightward) irrespective of whether motion started to the left or to the right of fixation (direction compatibility). The results show strong compatibility effects for both position and direction of motion in both experiments. A Simon effect, however, occurred only when position was task irrelevant in Experiment 1; no Simon effect was found in Experiment 2. The data only partly confirm previous results obtained with apparent motion. The selective lack of a Simon effect supports the integrated model of Umiltá and Nicoletti (1992), which requires orienting of attention for the Simon effect to occur. It is specifically assumed that this attention-orienting is triggered only by the saccade program and does not extend to the pursuit program that is initiated by smooth stimulus motion.     

The Simon effect in vocal responses

The Simon effect refers to the finding that faster responses are made to non-spatial stimulus features (e.g., color) when the positions of stimulus and response correspond than when they do not correspond. The usual explanation is that a spatial stimulus code automatically activates a corresponding spatial response code. Recently, however, the Simon effect has also been observed in vocal responses. The present study investigated the properties of Simon effects in the vocal modality. Experiment 1 compared horizontal and vertical Simon effects in vocal responses and found similar patterns of sequential modulations, but different time-courses. Yet the observed results are similar to those described in the literature for manual Simon effects. Experiments 2 and 3 used a dual-task procedure to investigate the impact of manual response codes on the encoding of irrelevant location and the initiation of vocal responses, respectively. Results suggest close links between manual response codes and conceptually corresponding vocal response codes.     

Auditory stimulus-response compatibility: Is there a contribution of stimulus-hand correspondence?

 Simon, Hinrichs, and Craft found that when subjects responded to a tone in the left or right ear with a left or right keypress, both ear-response-location correspondence and ear-hand correspondence affected reaction time. This outcome is in contrast to results obtained for auditory and visual Simon tasks (i.e., tasks in which stimulus location is irrelevant) as well as results obtained in visual stimulus-response (S-R) compatibility studies, which show only an effect of spatial S-R correspondence. Experiment 1 was a replication of Simon et al.'s experiment in which spatial mapping and hand placement (uncrossed, crossed) were varied. The results were inconsistent with those of Simon et al., showing no ear-hand compatibility effect. Experiment 2 was a second replication with an additional condition examined in which the stimuli were visual locations. The results showed no contribution of stimulus-hand correspondence for either auditory or visual stimuli. Experiment 3 was a replication of another experiment by Simon et al. in which tone pitch was relevant and tone location irrelevant. Like Simon et al.'s data, our results showed no indication that stimulus-hand correspondence is a significant factor. Overall, our results imply that regardless of whether tone location is relevant or irrelevant, ear-response-location correspondence is the only factor that contributes to S-R compatibility in auditory two-choice reaction tasks. Received: 15 March 1999 / Accepted: 8 June 1999     

Enhancement of the Simon effect by response precuing.

When stimuli are presented to the left or right of fixation, and stimulus location is irrelevant, responses are faster if the stimulus location coincides with the location of the assigned response. This phenomenon is called the Simon effect. The present study examined the influence on the Simon effect of attentional precues that signaled the likely stimulus location and intentional precues that signaled the likely response. Experiment 1 was a close procedural replication of an experiment by Verfaellie, Bowers, and Heilman (1988); consistent with their findings, the Simon effect was enhanced by the intentional precue and unaffected by the attentional precue. Experiments 2 and 3 demonstrated the importance of the intentional precue with simpler procedures that involved only intentional and attentional precues, respectively. Finally, the intentional precuing enhancement of the Simon effect was obtained when two stimuli were assigned to each response, regardless of whether the hands were uncrossed (experiment 4) or crossed (experiment 5). Overall, the results indicate that response precuing enhances the Simon effect and favor response-selection accounts over those that attribute the effect to stimulus identification.     

Orthogonal stimulus–response compatibility effects emerge even when the stimulus position is task irrelevant

The above-right/below-left mapping advantage with vertical stimuli and horizontal responses is known as the orthogonal stimulus–response compatibility (SRC) effect. We investigated whether the orthogonal SRC effect emerges with irrelevant stimulus dimensions. In Experiment 1, participants responded with a right or left key press to the colour of the stimulus presented above or below the fixation. We observed an above-right/below-left advantage (orthogonal Simon effect). In Experiment 2, we manipulated the polarity in the response dimension by varying the horizontal location of the response set. The orthogonal Simon effect decreased and even reversed as the left response code became more positive. This result provides evidence for the automatic activation of the positive and negative response codes by the corresponding positive and negative stimulus codes. These findings extended the orthogonal SRC effect based on coding asymmetry to an irrelevant stimulus dimension.     

The role of instructions,practice, and stimulus-hand correspondence on the Simon effect

Numerous studies of two-choice reaction tasks, including auditory and visual Simon tasks (i.e., tasks in which stimulus location is irrelevant) and visual compatibility tasks, have found that only spatial stimulus-response (S-R) correspondence affected S-R compatibility. Their results provided no indication that stimulus-hand correspondence was a significant factor. However, Wascher et al. (2001) suggested that hand coding plays a role in visual and auditory Simon tasks when the instructions are in terms of the finger/hand used for responding. The present experiments examined whether instructing subjects in terms of response locations or fingers/hands influenced the Simon effect for visual and auditory tasks. In Experiments 1-3, only spatial S-R correspondence contributed significantly to the Simon effect, even when the instructions were in terms of the fingers/hands. However, in Experiment 4, which used auditory stimuli and finger/hand instructions, the contribution of stimulus-hand correspondence increased with practice.     

Age differences in response selection for pure and mixed stimulus-response mappings and tasks

Two experiments examined effects of mixed stimulus-response mappings and tasks for older and younger adults. In Experiment 1, participants performed two-choice spatial reaction tasks with blocks of pure and mixed compatible and incompatible mappings. In Experiment 2, a compatible or incompatible mapping was mixed with a Simon task for which the mapping of stimulus color to location was relevant and stimulus location was irrelevant. In both experiments, older adults showed larger mixing costs than younger adults and larger compatibility effects, with the differences particularly pronounced in Experiment 1 when location mappings were mixed. In mixed conditions, when stimulus location was relevant, older adults benefited more than younger adults from complete repetition of the task and stimulus from the preceding trial. When stimulus location was irrelevant, the benefit of complete repetition did not differ reliably between age groups. The results suggest that the age-related deficit associated with mixing mappings and tasks is primarily due to older adults having more difficulty separating task sets that activate conflicting response codes.     

Orthogonal stimulus-response compatibility effects emerge even when the stimulus position is task irrelevant

The above-right/below-left mapping advantage with vertical stimuli and horizontal responses is known as the orthogonal stimulus-response compatibility (SRC) effect. We investigated whether the orthogonal SRC effect emerges with irrelevant stimulus dimensions. In Experiment 1, participants responded with a right or left key press to the colour of the stimulus presented above or below the fixation. We observed an above-right/below-left advantage (orthogonal Simon effect). In Experiment 2, we manipulated the polarity in the response dimension by varying the horizontal location of the response set. The orthogonal Simon effect decreased and even reversed as the left response code became more positive. This result provides evidence for the automatic activation of the positive and negative response codes by the corresponding positive and negative stimulus codes. These findings extended the orthogonal SRC effect based on coding asymmetry to an irrelevant stimulus dimension.     

Transfer of noncorresponding spatial associations to the auditory Simon task

Four experiments examined transfer of noncorresponding spatial stimulus-response associations to an auditory Simon task for which stimulus location was irrelevant. Experiment 1 established that, for a horizontal auditory Simon task, transfer of spatial associations occurs after 300 trials of practice with an incompatible mapping of auditory stimuli to keypress responses. Experiments 2-4 examined transfer effects within the auditory modality when the stimuli and responses were varied along vertical and horizontal dimensions. Transfer occurred when the stimuli and responses were arrayed along the same dimension in practice and transfer but not when they were arrayed along orthogonal dimensions. These findings indicate that prior task-defined associations have less influence on the auditory Simon effect than on the visual Simon effect, possibly because of the stronger tendency for an auditory stimulus to activate its corresponding response.     

S-R compatibility effects due to context-dependent spatial stimulus coding

Responses are faster with spatial S-R correspondence than with noncorrespondence (spatial compatibility effect), even if stimulus location is irrelevant (Simon effect). In two experiments, we sought to determine whether stimuli located above and below a fixation point are coded as left and right (and thus affect the selection of left and right responses) if the visual context suggests such a coding. So, stimuli appeared on the left or right eye of a face’s image that was tilted by 90° to one side or the other (Experiment 1) or varied between upright and 45° or 90° tilting (Experiment 2). Whether stimulus location was relevant (Experiment 1) or not (Experiment 2), responses were faster with correspondence of (face-based) stimulus location and (egocentrically defined) response location, even if stimulus and response locations varied on physically orthogonal dimensions. This suggests that object-based spatial stimulus codes are formed automatically and thus influence the speed of response selection.     

Transfer of orthogonal stimulus–response mappings to an orthogonal Simon task

When up–down stimulus locations are mapped to left–right keypresses, an overall advantage for the up–right/down–left mapping is often obtained that varies as a function of response eccentricity. This orthogonal stimulus–response compatibility (SRC) effect also occurs when stimulus location is irrelevant, a phenomenon called the orthogonal Simon effect, and has been attributed to correspondence of stimulus and response code polarities. The Simon effect for horizontal stimulus–response (S–R) arrangements has been shown to be affected by short-term S–R associations established through the mapping used for a prior SRC task in which stimulus location was relevant. We examined whether such associations also transfer between orthogonal SRC and Simon tasks and whether correspondence of code polarities continues to contribute to performance in the Simon task. In Experiment 1, the orthogonal Simon effect was larger after practising with an up–right/down–left mapping of visual stimuli to responses than with the alternative mapping, for which the orthogonal Simon effect tended to reverse. Experiment 2 showed similar results when practice was with high (up) and low (down) pitch tones, though the influence of practice mapping was not as large as that in Experiment 1, implying that the short-term S–R associations acquired in practice are at least in part not modality specific. In Experiment 3, response eccentricity and practice mapping were shown to have separate influences on the orthogonal Simon effect, as expected if both code polarity and acquired S–R associations contribute to performance.     

Transfer of orthogonal stimulus-response mappings to an orthogonal Simon task

When up-down stimulus locations are mapped to left-right keypresses, an overall advantage for the up-right/down-left mapping is often obtained that varies as a function of response eccentricity. This orthogonal stimulus-response compatibility (SRC) effect also occurs when stimulus location is irrelevant, a phenomenon called the orthogonal Simon effect, and has been attributed to correspondence of stimulus and response code polarities. The Simon effect for horizontal stimulus-response (S-R) arrangements has been shown to be affected by short-term S-R associations established through the mapping used for a prior SRC task in which stimulus location was relevant. We examined whether such associations also transfer between orthogonal SRC and Simon tasks and whether correspondence of code polarities continues to contribute to performance in the Simon task. In Experiment 1, the orthogonal Simon effect was larger after practising with an up-right/down-left mapping of visual stimuli to responses than with the alternative mapping, for which the orthogonal Simon effect tended to reverse. Experiment 2 showed similar results when practice was with high (up) and low (down) pitch tones, though the influence of practice mapping was not as large as that in Experiment 1, implying that the short-term S-R associations acquired in practice are at least in part not modality specific. In Experiment 3, response eccentricity and practice mapping were shown to have separate influences on the orthogonal Simon effect, as expected if both code polarity and acquired S-R associations contribute to performance.