S-R compatibility and response selection

In serial stage models, perception and action are usually thought to be linked to each other by an S-R translation mechanism. However, phenomena of S-R compatibility suggest a more direct relationship between perceptual and action domains. We discuss behavioral and psychophysiological evidence that irrelevant stimulus information automatically activates response codes, but then decays over time.

In a series of reaction time studies and electrophysiological experiments, we investigated both temporal and functional properties of the assumed automatic response activation process. We found that the amount of interference due to irrelevant spatial information depends upon how long its availability precedes that of the information relevant for response selection. This indicates that response activation decays rather quickly. If response-relevant and irrelevant spatial information are simultaneously available, electrophysiological measurements show that automatic activation of the spatially corresponding response rises soon after stimulus onset, but then dissipates and gets replaced by the activation of the response indicated by the relevant stimulus attribute.

We conclude that these findings do not support a pure translation account, but rather suggest the presence of two parallel and (at least partially) independent routes from perception to action: A direct route, allowing for automatic activation of response codes if stimulus and response features overlap, and an indirect route linking S and R codes in an arbitrary manner. Via the direct route responses may be primed independent of task-specific contingencies, while the correct response is selected via the indirect route. This use suggests that (a) the transmission of stimulus information to response stages does not (fully) depend on task relevance and that (b) different stimulus features can be transmitted asynchronously and independently from one another.     

A role for set in the control of automatic spatial response activation

Spatial stimulus-response (S-R) compatibility effects are widely assumed to reflect the automatic activation of a spatial response by the spatial attributes of a stimulus. The experiments reported here investigate the role of the participant's set in enabling or interacting with this putatively automatic spatial response activation. Participants performed a color discrimination task (Experiment 1) or a localization task (Experiment 2). In each experiment, two different S-R mappings were used and a task-cue indicated the appropriate mapping on each trial. S-R compatibility and the time between the task-cue and target were manipulated, and compatibility effects were assessed as a function of (a) the time between the task-cue and the stimulus, and (b) whether the S-R mapping repeated or switched on consecutive trials. Critically, whether response mappings repeated or switched on consecutive trials determined the relation between compatibility effects and the time between task-cue and stimulus. These results are discussed in terms of an interaction between automatic spatial response activation and the participant's set.     

Sequence learning in Parkinson's disease: the effect of spatial stimulus-response compatibility

Patients with Parkinson's disease (PD) have repeatedly demonstrated reduced sequence-specific learning effects in serial reaction time tasks (SRTs). Previous research with PD patients has mainly employed the 'classical' SRT task, involving a spatially compatible assignment of stimuli and responses. From cognitive research, it is known that spatial compatibility triggers rapid, automatic responses in the direction of the stimulus. Automatic responding has shown to be disinhibited in PD patients and may therefore interfere with stimulus anticipation during the learning process. The aim of the present study was to test this hypothesis by investigating if reduced sequence-specific learning depends on spatial stimulus-response compatibility. PD patients and age-matched controls were examined either with an SRT variant involving central stimulus presentation, thereby preventing automatic linking of stimulus and response locations, or with a spatially compatible SRT task. Patients showed reduced sequence-specific learning effects only when the stimulus-response assignment was spatially compatible. This pattern of results confirms the hypothesis that sequence learning deficits in PD may result from a predominance of automatic response activation over learning-based stimulus anticipations during the learning phase.     

Imitative response tendencies following observation of intransitive actions

Clear and unequivocal evidence shows that observation of object affordances or transitive actions facilitates the activation of a compatible response. By contrast, the evidence showing response facilitation following observation of intransitive actions is less conclusive because automatic imitation and spatial compatibility have been confounded. Three experiments tested whether observation of a finger movement (i.e., an intransitive action) in a choice reaction-time task facilitates the corresponding finger movement response because of imitation, a common spatial code, or some combination of both factors. The priming effects of a spatial and an imitative stimulus were tested in combination (Experiment 1), in opposition (Experiment 2), and independently (Experiment 3). Contrary to previous findings, the evidence revealed significant contributions from both automatic imitation and spatial compatibility, but the priming effects from an automatic tendency to imitate declined significantly across a block of trials whereas the effects of spatial compatibility remained constant or increased slightly. These differential effects suggest that priming associated with automatic imitation is mediated by a different regime than priming associated with spatial compatibility.     

Validity and boundary conditions of automatic response activation in the Simon task.

Three experiments were conducted to determine whether spatial stimulus-response compatibility effects are caused by automatic response activation by stimulus properties or by interference between codes during translation of stimulus into response coordinates. The main evidence against activation has been that in a Simon task with hands crossed, responses are faster at the response location ipsilateral to the stimulus though manipulated by the hand contralateral to the stimulus. The experiments were conducted with hands in standard and in crossed positions and electroencephalogram measures showed coactivation of the motor cortex induced by stimulus position primarily during standard hand positions with visual stimuli. Only in this condition did the Simon effect decay with longer response times. The visual Simon effect appeared to be due to specific mechanisms of visuomotor information transmission that are not responsible for the effects obtained with crossed hands or auditory stimuli.     

Is automatic imitation a specialized form of stimulus–response compatibility? Dissociating imitative and spatial compatibilities

In recent years research on automatic imitation has received considerable attention because it represents an experimental platform for investigating a number of interrelated theories suggesting that the perception of action automatically activates corresponding motor programs. A key debate within this research centers on whether automatic imitation is any different than other long-term S-R associations, such as spatial stimulus-response compatibility. One approach to resolving this issue is to examine whether automatic imitation shows similar response characteristics as other classes of stimulus-response compatibility. This hypothesis was tested by comparing imitative and spatial compatibility effects with a two alternative forced-choice stimulus-response compatibility paradigm. The stimulus on each trial was a left or right hand with either the index or middle finger tapping down. Speeded responses were performed with the index or middle finger of the right hand in response to the identity or the left-right spatial position of the stimulus finger. Two different tasks were administered: one that involved responding to the stimulus (S-R) and one that involved responding to the opposite stimulus (OS-R; i.e., the one not presented on that trial). Based on previous research and a connectionist model, we predicted standard compatibility effects for both spatial and imitative compatibility in the S-R task, and a reverse compatibility effect for spatial compatibility, but not for imitative compatibility, in the OS-R task. The results from the mean response times, mean percentage of errors, and response time distributions all converged to support these predictions. A second noteworthy result was that the recoding of the finger identity in the OS-R task required significantly more time than the recoding of the left-right spatial position, but the encoding time for the two stimuli in the S-R task was equivalent. In sum, this evidence suggests that the processing of spatial and imitative compatibility is dissociable with regard to two different processes in dual processing models of stimulus-response compatibility.     

Mixing compatible and incompatible mappings: Elimination, reduction, and enhancement of spatial compatibility effects

In two-choice tasks, the compatible mapping of left stimulus to left response and right stimulus to right response typically yields better performance than does the incompatible mapping. Nonetheless, when compatible and incompatible mappings are mixed within a block of trials, the spatial compatibility effect is eliminated. Two experiments evaluated whether the elimination of compatibility effects by mixing compatible and incompatible mappings is a general or specific phenomenon. Left-right physical locations, arrow directions, and location words were mapped to keypress responses in Experiment 1 and vocal responses in Experiment 2. With keypresses, mixing compatible and incompatible mappings eliminated the compatibility effect for physical locations and arrow directions, but enhanced it for words. With vocal responses, mixing significantly reduced the compatibility effect only for words. Overall, the mixing effects suggest that elimination or reduction of compatibility effects occurs primarily when the stimulus-response sets have both conceptual and perceptual similarity. This elimination may be due to suppression of a direct response-selection route, but to account for the full pattern of mixing effects it is also necessary to consider changes in an indirect response-selection route and the temporal activation properties of different stimulus-response sets.     

Are Automatic Imitation and Spatial Compatibility Mediated by Different Processes?

Automatic imitation or “imitative compatibility” is thought to be mediated by the mirror neuron system and to be a laboratory model of the motor mimicry that occurs spontaneously in naturalistic social interaction. Imitative compatibility and spatial compatibility effects are known to depend on different stimulus dimensions—body movement topography and relative spatial position. However, it is not yet clear whether these two types of stimulus–response compatibility effect are mediated by the same or different cognitive processes. We present an interactive activation model of imitative and spatial compatibility, based on a dual‐route architecture, which substantiates the view they are mediated by processes of the same kind. The model, which is in many ways a standard application of the interactive activation approach, simulates all key results of a recent study by Catmur and Heyes (2011) . Specifically, it captures the difference in the relative size of imitative and spatial compatibility effects; the lack of interaction when the imperative and irrelevant stimuli are presented simultaneously; the relative speed of responses in a quintile analysis when the imperative and irrelevant stimuli are presented simultaneously; and the different time courses of the compatibility effects when the imperative and irrelevant stimuli are presented asynchronously.     

Dilution of compatibility effects in Simon-type tasks depends on categorical similarity between distractors and diluters

The presence of a distracting stimulus during performance of the Stroop color-naming task leads to dilution of the Stroop effect. Because the automatic activation of word meaning may interfere with the task-relevant stimulus feature (text color; stimulus-stimulus [S-S] interference) and the response (saying the text color; stimulus-response [S-R] interference), it is unclear which of these types of interference is diluted. We introduce a new dilution paradigm using word- and arrow-based Simon tasks, in which only S-R interference is present. Participants made a left or right response to a central color target. A task-irrelevant location-word (Experiment 1) or arrow (Experiment 2) distractor adjacent to the target produced S-R compatibility effects. An additional neutral word or symbol series (diluter) was sometimes presented on the opposite side of the target from the distractor. The compatibility effect was smaller when the distractor and diluter category domains matched than when they mismatched. This result provides evidence that S-R compatibility effects are susceptible to the presence of diluters that are categorically similar to the distractors.     

Modulation of motor area activity during observation of unnatural body movements

We investigated the processes underlying stimulus-response compatibility by using a lateralized auditory stimulus in a simple and choice reaction time (RT) paradigm. Participants were asked to make either a left or right key lift in response to either a control (80 dB) or startling (124 dB) stimulus presented to either the left ear, right ear, or both ears. In the simple RT paradigm, we did not find a compatibility effect for either control or startle trials but did find a right-ear advantage which we attribute to anatomical asymmetry of auditory pathways. In the choice RT paradigm, we found compatibility effects for both startle and control trials as well a high incidence of error for contralateral stimulus-response mapping. We attribute these results to automatic activation of the ipsilateral response, which must then be inhibited prior to initiation of the correct response. The presence of compatibility effects for startle trials also suggest that similar pathways are being used to initiate movements in a choice RT situation, as opposed to involuntary triggering that is thought to occur in a simple RT situation.     

Stimulus-response compatibility effects in go-no-go tasks: a dimensional overlap account

According to the automatic response activation hypothesis of the dimensional overlap (DO) model (Kornblum, Stevens, Whipple, & Requin, 1999), stimulus-response compatibility effects are expected to occur in go-no-go tasks. This prediction is confirmed in two experiments in which subjects moved a hand to one side of the field on presentation of a go stimulus. Although the direction of movement was known in advance and the spatial attribute of the go stimuli was irrelevant to the go-no-go decision, the subjects' response time was shorter when the spatial attribute to the go stimulus corresponded to that of the response than when it did not. These effects are shown to depend on the similarity of the go and the no-go stimuli, as well as on whether the spatial attribute of the go stimuli was its actual location or its meaning. We discuss these results in terms of the temporal dynamics of automatic and controlled response processes, as hypothesized in the DO model.     

Parallel response selection in dual-task situations via automatic category-to-response translation

In contrast to the response selection bottleneck theory of dual-task performance, recent studies have demonstrated compatibility effects between secondary and primary responses on Task 1, suggesting that response information for two tasks may be generated in parallel. In two experiments, we examined the nature of Task 2 response activation in parallel with Task 1, using a psychological refractory period paradigm. Evidence of Task 2 to Task 1 response priming when each Task 2 stimulus was unique indicated that automatic parallel generation of response information occurred for Task 2 via abstract semantic category-to-response translation processes, independent of any direct stimulus-response influences. These findings are discussed in terms of their implications for the traditional response selection bottleneck theory of dual-task performance.     

Action-effect codes in and before the central bottleneck: evidence from the psychological refractory period paradigm

Voluntary motor actions aim at and are thus governed by predictable action effects. Therefore, representations of an action's effects normally must become activated prior to the action itself. In 5 psychological refractory period experiments the authors investigated whether the activation of such effect representations coincides with the response selection stage of information-processing theories. Participants performed 2 choice reaction tasks, separated by variable stimulus onset asynchronies. The authors varied the compatibility between responses and forthcoming sensorial effects (Experiments 1, 2, 3, and 5) or between responses and effect-resembling stimuli (Experiments 4 and 5) in one of the tasks. They observed that compatibility influences from forthcoming (anticipated) response effects were located within the response selection bottleneck, whereas compatibility influences from action-preceding (perceived) effects were due to processes before the bottleneck. These results point to a crucial role of the endogenous activation of action-effect representations for the selection of voluntary motor responses.     

Automatic motor activation by mere instruction

Previous behavioral studies have shown that instructions about stimulus–response (S-R) mappings can influence task performance even when these instructions are irrelevant for the current task. In the present study, we tested whether automatic effects of S–R instructions occur because the instructed stimuli automatically activate their corresponding responses. We registered the lateralized readiness potentials (LRPs) that were evoked by the instructed stimuli while participants were performing a task for which those mappings were irrelevant. Instructed S–R mappings clearly affected task performance in electrophysiological and behavioral measures. The LRP was found to deflect in the direction of the response tendency that corresponded with the instructed S–R mapping. Early activation of the instructed response was observed but occurred predominantly on slow trials. In contrast, response conflict evoked by instructed S–R mappings did not modulate the N2 amplitude. The results strongly suggest that, like experienced S–R mappings, instructed S–R mappings can lead to automatic response activation, but possibly via a different route.     

The role of input–output modality compatibility in task switching

Input–output (I–O) modality compatibility refers to the similarity of stimulus modality and modality of response-related sensory consequences. A previous study found higher switch costs in task switching in I–O modality incompatible tasks (auditory-manual and visual-vocal) than in I–O modality compatible tasks (auditory-vocal and visual-manual). However, these tasks had spatially compatible S–R mappings, which implied dimensional overlap (DO). DO may have led to automatic activation of the corresponding compatible responses in the incorrect response modality, thus increasing interference effects. The present study was aimed to examine the influence of DO on I–O modality compatibility effects. In two experiments, we found that I–O modality compatibility affects task switching even in tasks without DO, which even tended to result in further increased modality influences. This finding suggests that I–O modality mappings affect response selection by affecting between-task cross-talk not on the level of specific response codes but on the level of modality-specific processing pathways.     

Evidence for effects of phonological correspondence between visible speech and written syllables

The present study investigated compatibility effects between written and spoken syllables. Participants saw the syllables "Ba" or "Da" printed on a speaker's mouth that was articulating either /b wedge / or /d wedge /. Participants classified either the printed syllable or the mouth movement by pressing a left or right key. Responses were faster when mouth movement and letters were congruent regardless of imperative stimulus dimension. As the two stimulus dimensions (mouth movements and letters) showed dimensional overlap, but did not overlap with the response, stimulus-response compatibility was ruled out according to some models. It is argued that the compatibility effect was due to the competition of phonological codes at a stage preceding response selection. Also, the results lend support to the view that Stroop-like tasks are ambiguous with regard to the locus of compatibility effects. Stimulus-response and stimulus-stimulus compatibility may be observed.     

Differential dynamics of spatial and non-spatial stimulus-response compatibility effects: a dual task LRP study

Choice reaction times are shorter when stimulus and response features are compatible rather than incompatible. Recent studies revealed that spatial compatibility effects in Simon tasks are strongly attenuated when there is temporal overlap with a different high-priority task. In contrast, non-spatial variants of the Simon task appear to be unaffected by task overlap. The present study used the lateralized readiness potential (LRP) within a dual task design to elucidate the dynamics underlying these differential effects for a color and a spatial variant of the Simon task. In the color version there was no sign of early response priming by irrelevant stimulus features in the LRP. The color compatibility effect was independent of task overlap and reflected in the LRP onset latency. In contrast, in the spatial version, priming by irrelevant stimulus location showed up and was mirrored by early LRP activation. Response priming and the corresponding Simon effect, however, were present only in case of little temporal overlap with the primary task. The absence of spatial compatibility effects at strong temporal overlap suggests that response conflicts due to stimulus-related priming depend on the availability of processing resources.     

Working-memory load decreases mappings effects in spatial-compatibility tasks

The paper investigates the role of working memory for the translation of spatial stimuli into spatial responses. Performance is typically superior with compatible mapping between stimulus and response locations than with incompatible mapping (spatial-mapping effect). According to popular dual-route models, the spatial-mapping effect may arise from differences in the effectiveness of S–R translation, and/or from the effects of automatic response activation. Working-memory load should not affect the automatic route, but delay S–R translation in the incompatible condition, increasing the mapping effect under load. These predictions were tested in two dual-task experiments. Participants performed a spatial-compatibility task with compatible or incompatible S–R mapping, while memorizing different amounts of spatial (Experiment 1) or verbal (Experiment 2) information. In both experiments, working-memory load decreased the mapping effect, but did not eliminate it. Results are at odds with the dual-route account. An alternative explanation based on the response-discrimination account (Ansorge and Wühr in J Exp Psychol Hum Percept Perform 30:365–377, 2004) is proposed.     

Orthogonal stimulus–response compatibility effects emerge even when the stimulus position is task irrelevant

The above-right/below-left mapping advantage with vertical stimuli and horizontal responses is known as the orthogonal stimulus–response compatibility (SRC) effect. We investigated whether the orthogonal SRC effect emerges with irrelevant stimulus dimensions. In Experiment 1, participants responded with a right or left key press to the colour of the stimulus presented above or below the fixation. We observed an above-right/below-left advantage (orthogonal Simon effect). In Experiment 2, we manipulated the polarity in the response dimension by varying the horizontal location of the response set. The orthogonal Simon effect decreased and even reversed as the left response code became more positive. This result provides evidence for the automatic activation of the positive and negative response codes by the corresponding positive and negative stimulus codes. These findings extended the orthogonal SRC effect based on coding asymmetry to an irrelevant stimulus dimension.     

A computational model of action resonance and its modulation by emotional stimulation

Recent research has shown that stimulus–response compatibility (SRC) effects can be modulated by the emotional state of the participant and, more specifically, that the SRC effect is larger when aversive emotional stimulation precedes the seen movement [Rumiati, R. I. & Grecucci, A. (submitted for publication). On the emotional modulation of action]. In the present study, we propose that this effect arises from four assumptions: First, that the cortical representations subserving observation and execution of the same actions overlap and resonate; second, that graded persistence of activation due to observed movement facilitates subsequent movement execution; third, that movement representations that are similar but different compete for activation; and fourth, that aversive emotional states enhance the processing of events. By means of a set of simulations, we demonstrate that each of these assumptions plays a critical role in capturing the compatibility effect and its emotional modulation. We further employ the model to clarify the debate between synergistic and competitive views of cognition/emotion interactions, and demonstrate how emotionally-driven stimulus–response compatibility effects may be modulated by task demands, thus offering a possible resolution to the long-standing debate between synergistic and competitive interactions between emotion and cognition.