Object-based correspondence effects for action-relevant and surface-property judgments with keypress responses: evidence for a basis in spatial coding

It has been proposed that grasping affordances produce a Simon-type correspondence effect for left–right keypress responses and the location of the graspable part of an object for judgments based on action-relevant properties such as shape, but not on surface properties. We tested the implications of this grasping affordance account and contrasted them with the ones derived from a spatial coding account that distinguishes holistic processing of integral dimensions and analytic processing of separable dimensions. In Experiments 1–3, judgments about the color of a door handle showed a Simon effect relative to the handle’s base, whereas judgments about the handle’s shape showed no Simon effect. In Experiment 4, when the middle of the handle was colored, the Simon effect was obtained relative to the base, but when the color was at the tip of the handle or near the base, Simon effects were obtained relative to the color location. For Experiment 5, only the base was colored, and the Simon effect was larger for a passive rather than active handle state, as in the color-judgment conditions of Experiments 2–4 in which the colored region overlapped with the base. In Experiment 6, orientation judgments showed no Simon effect, as the shape judgments did in Experiments 1 and 2. The findings of (a) an absence of Simon effects for shape and orientation judgments, (b) no larger Simon effects for active than passive handle states, and (c) isolation of the changing component for color judgments are consistent with the spatial coding account, according to which the distinction between object shape/orientation and color is one of integral versus separable dimensions.     

基于客体的空间一致性效应:功能可见性或空间位置编码?

采用空间Simon任务范式,考察基于客体空间一致性效应到底是手柄的功能可见性引起,还是其空间位置编码导致。实验1采用Pellicano等(2010)研究中的带手柄电筒,要求被试完成与抓握功能相关的形状判断任务,结果表明,唯有当电筒开时,被试产生了基于客体的空间一致性效应。实验2去除电筒可抓握的手柄,发现无论电筒开或关,均出现了更大的基于客体空间一致性效应。上述结果与空间编码假说一致,表明空间位置编码是产生基于客体空间一致性效应的原因。     

Further evidence that object-based correspondence effects are primarily modulated by object location not by grasping affordance

Tipper, Paul and Hayes found object-based correspondence effects for door-handle stimuli for shape judgments but not colour. They reasoned that a grasping affordance is activated when judging dimensions related to a grasping action (shape), but not for other dimensions (colour). Cho and Proctor, however, found the effect with respect to handle position when the bases of the door handles were centred (so handles were positioned left or right; the base-centred condition) but not when the handles were centred (the object-centred condition), suggesting that the effect is driven by object location, not grasping affordance. We conducted an independent replication of Cho and Proctor's design, but with behavioural and event-related potential measures. Participants made shape judgments in Experiment 1 and colour judgments in Experiment 2 on the same door-handle objects. Correspondence effects on response time and errors were obtained in both experiments for the base-centred condition but not the object-centred condition. Effects were absent in the P1 and N1 data, which are consistent with the hypothesis of little binding between visual processing of grasping component and action. These findings question the grasping-affordance view but support a spatial-coding view, suggesting that correspondence effects are modulated primarily by object location.     

Transfer of noncorresponding spatial associations to the auditory Simon task

Four experiments examined transfer of noncorresponding spatial stimulus-response associations to an auditory Simon task for which stimulus location was irrelevant. Experiment 1 established that, for a horizontal auditory Simon task, transfer of spatial associations occurs after 300 trials of practice with an incompatible mapping of auditory stimuli to keypress responses. Experiments 2-4 examined transfer effects within the auditory modality when the stimuli and responses were varied along vertical and horizontal dimensions. Transfer occurred when the stimuli and responses were arrayed along the same dimension in practice and transfer but not when they were arrayed along orthogonal dimensions. These findings indicate that prior task-defined associations have less influence on the auditory Simon effect than on the visual Simon effect, possibly because of the stronger tendency for an auditory stimulus to activate its corresponding response.     

The role of instructions,practice, and stimulus-hand correspondence on the Simon effect

Numerous studies of two-choice reaction tasks, including auditory and visual Simon tasks (i.e., tasks in which stimulus location is irrelevant) and visual compatibility tasks, have found that only spatial stimulus-response (S-R) correspondence affected S-R compatibility. Their results provided no indication that stimulus-hand correspondence was a significant factor. However, Wascher et al. (2001) suggested that hand coding plays a role in visual and auditory Simon tasks when the instructions are in terms of the finger/hand used for responding. The present experiments examined whether instructing subjects in terms of response locations or fingers/hands influenced the Simon effect for visual and auditory tasks. In Experiments 1-3, only spatial S-R correspondence contributed significantly to the Simon effect, even when the instructions were in terms of the fingers/hands. However, in Experiment 4, which used auditory stimuli and finger/hand instructions, the contribution of stimulus-hand correspondence increased with practice.     

Perceptual and attentional factors in encoding irrelevant spatial information

Numerous studies found superior performance when the irrelevant location of a stimulus and response location were corresponding than when they were not corresponding (Simon effect), suggesting that stimulus location is processed in an obligatory manner. The present study compared Simon effects from the location of a relevant (i.e., to-be-attended) object to those from the location of an irrelevant (i.e., to-be-ignored) object. In four experiments, participants were presented with a rectangular frame and a square, with the relevant object in green or red color and the irrelevant object in gray or white color. Participants’ task was to respond with a lateral keypress to the color of the relevant object, and we varied spatial correspondence between the location of the relevant or the irrelevant object and the response, respectively. Results consistently showed larger Simon effects from the location of the relevant than from the irrelevant object, even when the irrelevant object was made very salient. These results suggest that location processing is largely confined to relevant (i.e., attended) objects, stressing the role of attention shifts for location encoding.     

基于客体的一致性效应的产生机制

采用具有不同深度信息的剪影和图片刺激为材料,要求被试完成形状判断任务,探究基于客体的一致性效应的产生机制。实验1中客体刺激呈现于屏幕中央位置;实验2进一步增强了刺激空间呈现的左右位置倾向;实验3则通过交叉手的范式分离了反应位置和反应手不同的编码对一致性效应的作用。结果发现:当刺激不存在显著的左右位置信息时,剪影刺激出现了一致性效应,图片则没有;而当刺激的空间位置信息显著时,剪影和图片均出现了一致性效应,这一效应在反应位置和反应手编码分离后仍然存在。因此得出结论:空间位置编码假说对解释基于客体的一致性效应的产生有重要作用。     

Flowers and spiders in spatial stimulus-response compatibility: does affective valence influence selection of task-sets or selection of responses?

The present study examined the effect of stimulus valence on two levels of selection in the cognitive system, selection of a task-set and selection of a response. In the first experiment, participants performed a spatial compatibility task (pressing left and right keys according to the locations of stimuli) in which stimulus-response mappings were determined by stimulus valence. There was a standard spatial stimulus-response compatibility (SRC) effect for positive stimuli (flowers) and a reversed SRC effect for negative stimuli (spiders), but the same data could be interpreted as showing faster responses when positive and negative stimuli were assigned to compatible and incompatible mappings, respectively, than when the assignment was opposite. Experiment 2 disentangled these interpretations, showing that valence did not influence a spatial SRC effect (Simon effect) when task-set retrieval was unnecessary. Experiments 3 and 4 replaced keypress responses with joystick deflections that afforded approach/avoidance action coding. Stimulus valence modulated the Simon effect (but did not reverse it) when the valence was task-relevant (Experiment 3) as well as when it was task-irrelevant (Experiment 4). Therefore, stimulus valence influences task-set selection and response selection, but the influence on the latter is limited to conditions where responses afford approach/avoidance action coding.     

Transfer effects of incompatible location-relevant mappings on a subsequent visual or auditory Simon task

Two experiments investigated the influence of practice with an incompatible mapping of left and right stimuli to keypress responses on performance of a subsequent Simon task, for which stimulus location was irrelevant, after a delay of 5 min or 1 week. In Experiment 1, the visual Simon effect was eliminated when the practice modality was auditory and reversed to favor noncorresponding responses when it was visual, and there was no significant effect of delay interval. In Experiment 2, significant auditory Simon effects were obtained that did not vary as a function of practice modality, with delay having only a marginal effect on the magnitude of the Simon effect. The elimination of the visual Simon effect in the transfer session is most likely due to the short-term stimulus-response associations defined for the incompatible spatial mapping remaining active during the transfer session. Because the auditory Simon effect is stronger than the visual one, more practice with the incompatible mapping may be necessary to produce reliable transfer effects for it.     

Display-control arrangement correspondence and logical recoding in the Hedge and Marsh reversal of the Simon effect

When left and right keypresses are made to stimuli in left and right locations, and stimulus location is irrelevant to the task, responses are typically faster when stimulus location corresponds with response location than when it does not (the Simon effect). This effect reverses when the relevant stimulus-response mapping is incompatible, with responses being slower when stimulus and response locations correspond (the Hedge and Marsh reversal). Simon et al. (Acta Psychol. 47 (1981) 63) reported an exception to the Hedge and Marsh reversal for a situation in which the relevant stimulus dimension was the color of a centered visual stimulus and the irrelevant location information was left or right tone location. In contrast, similar experiments have found a reversal of the Simon effect for tone location when relevant visual locations were mapped incompatibly to responses. We conducted four experiments to investigate this discrepancy. Both results were replicated. With an incompatible mapping, irrelevant tone location showed a small reverse Simon effect when the relevant visual dimension was physical location but not when the color of a centered stimulus or the direction in which an arrow pointed conveyed the visual location information. The reversal occurred in a more standard Hedge and Marsh task in which the irrelevant dimension was location of the colored stimulus, but only when the response keys were visibly labeled. Several of the results suggest that display-control arrangement correspondence is the primary cause of the Hedge and Marsh reversal, with logical recoding playing only a secondary role.     

Sequential analysis of a Simon task--evidence for an attention-shift account

 We investigated the attention-shift hypothesis of the Simon effect by analysing the effect of repeating relevant colour or irrelevant location of the stimulus in four serial reaction time tasks. In Experiment 1 with short response-stimulus intervals (RSI), we assume that there is no time to engage attention at the fixation cross before the onset of a new stimulus. In agreement with the hypothesis, Experiment 1 reveals no Simon effect when the stimulus location is repeated. In Experiment 2 with long RSI, we observe a Simon effect for location repetitions and alternations. In Experiment 3 with long RSI, we hinder the disengagement of attention by displaying the stimulus after response execution. As expected, the Simon effect is reduced for location repetitions. In Experiment 4 with stimuli additionally presented at the fixation cross, responses are faster if the attention shift towards the centrally presented stimulus corresponds with the location of the required response. Additionally, we argue that binding of the stimulus features into an object or event file better explains the so-called blocking of the automatic response-priming route after a noncorresponding trial. Received: 2 February 2000 / Accepted: 10 November 2000     

Simon效应及其反转现象作用机制的研究

研究运用任务干扰的实验范式,试图从探讨刺激出现的空间位置与反应效果之间的关系来推测Simon效应及其反转现象的作用机制。结果表明:(1)当相关刺激-反应匹配不相容时,颜色刺激在左、右位置呈现,当明显标记反应键时,出现Simon效应的反转。(2)当手指遮住反应键的标记时,没有反转。(3)当颜色刺激在中央位置,声音在左、右耳发生时,没有反转。说明显示-控制排列对应性是产生Simon效应反转的最重要因素,逻辑再编码只起到次要的作用。     

Enhancement of the Simon effect by response precuing.

When stimuli are presented to the left or right of fixation, and stimulus location is irrelevant, responses are faster if the stimulus location coincides with the location of the assigned response. This phenomenon is called the Simon effect. The present study examined the influence on the Simon effect of attentional precues that signaled the likely stimulus location and intentional precues that signaled the likely response. Experiment 1 was a close procedural replication of an experiment by Verfaellie, Bowers, and Heilman (1988); consistent with their findings, the Simon effect was enhanced by the intentional precue and unaffected by the attentional precue. Experiments 2 and 3 demonstrated the importance of the intentional precue with simpler procedures that involved only intentional and attentional precues, respectively. Finally, the intentional precuing enhancement of the Simon effect was obtained when two stimuli were assigned to each response, regardless of whether the hands were uncrossed (experiment 4) or crossed (experiment 5). Overall, the results indicate that response precuing enhances the Simon effect and favor response-selection accounts over those that attribute the effect to stimulus identification.     

Auditory stimulus-response compatibility: Is there a contribution of stimulus-hand correspondence?

 Simon, Hinrichs, and Craft found that when subjects responded to a tone in the left or right ear with a left or right keypress, both ear-response-location correspondence and ear-hand correspondence affected reaction time. This outcome is in contrast to results obtained for auditory and visual Simon tasks (i.e., tasks in which stimulus location is irrelevant) as well as results obtained in visual stimulus-response (S-R) compatibility studies, which show only an effect of spatial S-R correspondence. Experiment 1 was a replication of Simon et al.'s experiment in which spatial mapping and hand placement (uncrossed, crossed) were varied. The results were inconsistent with those of Simon et al., showing no ear-hand compatibility effect. Experiment 2 was a second replication with an additional condition examined in which the stimuli were visual locations. The results showed no contribution of stimulus-hand correspondence for either auditory or visual stimuli. Experiment 3 was a replication of another experiment by Simon et al. in which tone pitch was relevant and tone location irrelevant. Like Simon et al.'s data, our results showed no indication that stimulus-hand correspondence is a significant factor. Overall, our results imply that regardless of whether tone location is relevant or irrelevant, ear-response-location correspondence is the only factor that contributes to S-R compatibility in auditory two-choice reaction tasks. Received: 15 March 1999 / Accepted: 8 June 1999     

S-R compatibility effects due to context-dependent spatial stimulus coding

Responses are faster with spatial S-R correspondence than with noncorrespondence (spatial compatibility effect), even if stimulus location is irrelevant (Simon effect). In two experiments, we sought to determine whether stimuli located above and below a fixation point are coded as left and right (and thus affect the selection of left and right responses) if the visual context suggests such a coding. So, stimuli appeared on the left or right eye of a face’s image that was tilted by 90° to one side or the other (Experiment 1) or varied between upright and 45° or 90° tilting (Experiment 2). Whether stimulus location was relevant (Experiment 1) or not (Experiment 2), responses were faster with correspondence of (face-based) stimulus location and (egocentrically defined) response location, even if stimulus and response locations varied on physically orthogonal dimensions. This suggests that object-based spatial stimulus codes are formed automatically and thus influence the speed of response selection.     

The role of attention for the Simon effect

Summary It has been claimed that spatial attention plays a decisive role in the effect of irrelevant spatial stimulus-response correspondence (i. e., the Simon effect), especially the way the attentional focus is moved onto the stimulus (lateral shifting rather than zooming). This attentional-movement hypothesis is contrasted with a referential-coding hypothesis, according to which spatial stimulus coding depends on the availability of frames or objects of reference rather than on certain attentional movements. In six experiments, reference objects were made available to aid spatial coding, which either appeared simultaneously with the stimulus (Experiments 1–3), or were continuously visible (Experiments 4–6). In contrast to previous experiments and to the attentional predictions, the Simon effect occurred even though the stimuli were precued by large frames surrounding both possible stimulus positions (Experiment 1), even when the reference object's salience was markedly reduced (Experiment 2), or when the precueing frames were made more informative (Experiment 3). Furthermore, it was found that the Simon effect is not reduced by spatial correspondence between an uninformative spatial precue and the stimulus (Experiment 4), and it does not depend on the location of spatial precues appearing to the left or right of both possible stimulus locations (Experiment 5). This was true even when the precue was made task-relevant in order to ensure attentional focusing (Experiment 6). In sum, it is shown that the Simon effect does not depend on the kind of attentional operation presumably performed to focus onto the stimulus. It is argued that the available data are consistent with a coding approach to the Simon effect which, however, needs to be developed to be more precise as to the conditions for spatial stimulus coding.     

An electrophysiological study of the object-based correspondence effect: Is the effect triggered by an intended grasping action?

We examined Goslin, Dixon, Fischer, Cangelosi, and Ellis’s (Psychological Science 23:152–157, 2012) claim that the object-based correspondence effect (i.e., faster keypress responses when the orientation of an object’s graspable part corresponds with the response location than when it does not) is the result of object-based attention (vision–action binding). In Experiment 1, participants determined the category of a centrally located object (kitchen utensil vs. tool), as in Goslin et al.’s study. The handle orientation (left vs. right) did or did not correspond with the response location (left vs. right). We found no correspondence effect on the response times (RTs) for either category. The effect was also not evident in the P1 and N1 components of the event-related potentials, which are thought to reflect the allocation of early visual attention. This finding was replicated in Experiment 2 for centrally located objects, even when the object was presented 45 times (33 more times than in Exp. 1). Critically, the correspondence effects on RTs, P1s, and N1s emerged only when the object was presented peripherally, so that the object handle was clearly located to the left or right of fixation. Experiment 3 provided further evidence that the effect was observed only for the base-centered objects, in which the handle was clearly positioned to the left or right of center. These findings contradict those of Goslin et al. and provide no evidence that an intended grasping action modulates visual attention. Instead, the findings support the spatial-coding account of the object-based correspondence effect.     

The relationship between stimulus processing and response selection in the Simon task: Evidence for a temporal overlap

Summary As is indicated by the Simon effect, choice reactions can be carried out faster when the response corresponds spatially to the stimulus, even if the stimulus location is irrelevant to the task. In Experiments 1–4 the relationships between the Simon effect and stimulus eccentricity, signal quality, and signal-background contrast are investigated. The Simon effect was found to interact with all of these factors, at least when manipulated blockwise. These results are at odds with previous results and are difficult to interpret from an additive-factor-method view. An alternative interpretation is suggested that attributes the results to the temporal relationship between the processing of the relevant stimulus information and stimulus location. The assumption is that a decrease in the Simon effect is caused by every experimental manipulation that markedly increases the temporal distance between the coding of the relevant stimulus information and that of the irrelevant stimulus location. This assumption was tested in Experiment 5 in a more direct way. The stimuli were built up on a screen over time, so that the temporal distance between the presence of location and identity information could be controlled experimentally. The results provide further support for a temporal-delay interpretation of interactions between irrelevant stimulus-response correspondence and factors that affect early stages of information processing.     

Mixing incompatibly mapped location-relevant trials with location-irrelevant trials: effects of stimulus mode on the reverse Simon effect

When location-relevant trials with an incompatible spatial stimulus-response mapping are mixed with location-irrelevant trials, responses on the latter trials are faster when stimulus and response locations do not correspond than when they do. Experiments 1 and 2 showed that this reverse “Simon effect” also occurs when the location information is presented verbally or symbolically on both location-relevant and location-irrelevant trials. The reversal was absent, however, in conditions of Experiments 1–3 in which the mode of presentation was different on the location-relevant trials than on the location-irrelevant trials. Experiment 4 demonstrated that differences in physical characteristics between the location-relevant and location-irrelevant stimuli were not sufficient to eliminate the reverse Simon effect. These findings imply that the short-term associations between stimulus location information and responses defined for the location-relevant task are relatively mode specific. Received: 21 December 1999 / Accepted: 26 April 2000     

The Simon effect in vocal responses

The Simon effect refers to the finding that faster responses are made to non-spatial stimulus features (e.g., color) when the positions of stimulus and response correspond than when they do not correspond. The usual explanation is that a spatial stimulus code automatically activates a corresponding spatial response code. Recently, however, the Simon effect has also been observed in vocal responses. The present study investigated the properties of Simon effects in the vocal modality. Experiment 1 compared horizontal and vertical Simon effects in vocal responses and found similar patterns of sequential modulations, but different time-courses. Yet the observed results are similar to those described in the literature for manual Simon effects. Experiments 2 and 3 used a dual-task procedure to investigate the impact of manual response codes on the encoding of irrelevant location and the initiation of vocal responses, respectively. Results suggest close links between manual response codes and conceptually corresponding vocal response codes.