Anticipatory response control in motor sequence learning: evidence from stimulus-response compatibility

Three experiments using a serial four-choice reaction-time (RT) task explored the interaction of sequence learning and stimulus-based response conflict. In Experiment 1, the spatial stimulus-response (S-R) mapping was manipulated between participants. Incompatible S-R mappings produced much higher RTs than the compatible mapping, but sequence learning decreased this S-R compatibility effect. In Experiment 2, the spatial stimulus feature was made task-irrelevant by assigning responses to symbols that were presented at unpredictable locations. The data indicated a Simon effect (i.e., increased RT when irrelevant stimulus location is spatially incompatible with response location) that was reduced by sequence learning. However, this effect was observed only in participants who developed an explicit sequence representation. Experiment 3 replicated this learning-based modulation of the Simon effect using explicit sequence-learning instructions. Taken together, the data support the notion that explicit sequence learning can lead to motor 'chunking', so that pre-planned response sequences are shielded from conflicting stimulus information.     

Interactions between perception and action in a reaction task with overlapping S-R assignments

 We have used a novel task to study relationships between perception and action. Four experiments studied stimulus-response (S-R) relationships under conditions in which stimuli and responses were functionally unrelated (i.e., not assigned to each other by instruction) and merely overlapped in time. On each trial, participants carried out movements on a graphic tablet while observing motions displayed on a computer screen. The movement on trial n was specified by the motion observed on the previous trial n-1, whereas the motion observed on trial n specified the movement to be performed on trial n+1. Results showed that stimulus motion had a contrast-like impact on response movement. Watching a small motion while performing a medium-sized movement increased movement size, whereas watching a large motion led to a decrease (Experiment 1). Further experiments showed that the contrast pattern was not affected by the mode of motion presentation (Experiment 2), or by the interval between motion and movement execution (Experiment 3). Contrast was also observed in the reverse direction, i.e., from action to perception (Experiment 4). We propose that the contrast effect is due to a mechanism for selective code modification. This mechanism acts to increase the distinctiveness of simultaneously activated perception and action codes in a common representational domain. Received: 11 July 2000 / Accepted: 4 March 2001     

Response readiness modulates the development of association-based automaticity in masked priming

The current study investigated the role of the automatization of stimulus and response (S-R) associations and response readiness in triggering the motor activation for masked primes in two experiments. The automatization of associations was manipulated by employing different types of stimuli, and response readiness was manipulated by varying the relative frequency of Go trials in a modified Go/No-Go task. Compatibility (compatible and incompatible), stimulus type (arrows and parallel lines), and test session (Sessions 1, 2, and 3) were manipulated in a high response-readiness condition (Experiment 1) and in a low response-readiness condition (Experiment 2). Negative compatibility effects (NCEs) occurred regardless of session and experiment in the arrow stimuli condition. However, in the parallel-line stimuli condition, no significant compatibility effect (CE) appeared regardless of the experiment in Sessions 1 and 2, whereas a significant NCE appeared in Experiment 1 but not in Experiment 2 in Session 3. These results are consistent with the claim that motor activation can only occur if the association between specific stimuli and specific responses has been automatized by previous practice, and response readiness can modulate the development of automaticity, but this modulation will have a minimal effect once the association is automatized. The findings also provide experimental evidence for the assumption that the formation of association-based automaticity could be modulated by top-down control (e.g., response readiness).     

Response coding in the Simon task

Recent findings indicate that two distinct mechanisms can contribute to a Simon effect: a visuomotor information transmission on the one hand and a cognitive code interference on the other hand (see for e.g., Wiegand & Wascher, in Journal of Experimental Psychology: Human Perception and Performance 2005a). Furthermore, it was proposed that the occurrence of one or the other mechanism strongly depends on the way responses are coded. Visuomotor information transmission seems to depend on a correspondence between stimulus position and spatial anatomical status of the effector, whereas cognitive code interference is thought to be based on relative response location codes. To further test the spatial anatomic coding hypothesis, three experiments were conducted, in which the Simon effect with unimanual responses was investigated for horizontal (Experiment 1 and 2) and vertical (Experiment 3) stimulus-response (S-R) relations. Based on the finding of a decreasing effect function (indicating the presence of visuomotor information transmission) for horizontal and vertical S-R relations, it was concluded that visuomotor information transmission occurs whenever there is an overlap between the spatial stimulus feature and parameters of the motor representation of the response. Furthermore, the specific motor representation seems to be task dependent, that is, it entails those response parameters that clearly differentiate between the two response alternatives in a given task situation.     

S-R associations, their extinction, and recovery in an animal model of anxiety: a new associative account of phobias without recall of original trauma

Associative accounts of the etiology of phobias have been criticized because of numerous cases of phobias in which the client does not remember a relevant traumatic event (i.e., Pavlovian conditioning trial), instructions, or vicarious experience with the phobic object. In three lick suppression experiments with rats as subjects, we modeled an associative account of such fears. Experiment 1 assessed stimulus-response (S-R) associations in first-order fear conditioning. After behaviorally complete devaluation of the unconditioned stimulus, the target stimulus still produced strong conditioned responses, suggesting that an S-R association had been formed and that this association was not significantly affected when the outcome was devalued through unsignaled presentations of the unconditioned stimulus. Experiments 2 and 3 examined extinction and recovery of S-R associations. Experiment 2 showed that extinguished S-R associations returned when testing occurred outside of the extinction context (i.e., renewal) and Experiment 3 found that a long delay between extinction and testing also produced a return of the extinguished S-R associations (i.e., spontaneous recovery). These experiments suggest that fears for which people cannot recall a cause are explicable in an associative framework, and indicate that those fears are susceptible to relapse after extinction treatment just like stimulus-outcome (S-O) associations.     

Is automatic imitation a specialized form of stimulus–response compatibility? Dissociating imitative and spatial compatibilities

In recent years research on automatic imitation has received considerable attention because it represents an experimental platform for investigating a number of interrelated theories suggesting that the perception of action automatically activates corresponding motor programs. A key debate within this research centers on whether automatic imitation is any different than other long-term S-R associations, such as spatial stimulus-response compatibility. One approach to resolving this issue is to examine whether automatic imitation shows similar response characteristics as other classes of stimulus-response compatibility. This hypothesis was tested by comparing imitative and spatial compatibility effects with a two alternative forced-choice stimulus-response compatibility paradigm. The stimulus on each trial was a left or right hand with either the index or middle finger tapping down. Speeded responses were performed with the index or middle finger of the right hand in response to the identity or the left-right spatial position of the stimulus finger. Two different tasks were administered: one that involved responding to the stimulus (S-R) and one that involved responding to the opposite stimulus (OS-R; i.e., the one not presented on that trial). Based on previous research and a connectionist model, we predicted standard compatibility effects for both spatial and imitative compatibility in the S-R task, and a reverse compatibility effect for spatial compatibility, but not for imitative compatibility, in the OS-R task. The results from the mean response times, mean percentage of errors, and response time distributions all converged to support these predictions. A second noteworthy result was that the recoding of the finger identity in the OS-R task required significantly more time than the recoding of the left-right spatial position, but the encoding time for the two stimuli in the S-R task was equivalent. In sum, this evidence suggests that the processing of spatial and imitative compatibility is dissociable with regard to two different processes in dual processing models of stimulus-response compatibility.     

Impact of planned movement direction on judgments of visual locations

The present study examined if and how the direction of planned hand movements affects the perceived direction of visual stimuli. In three experiments participants prepared hand movements that deviated regarding direction (“Experiment 1” and “2”) or distance relative to a visual target position (“Experiment 3”). Before actual execution of the movement, the direction of the visual stimulus had to be estimated by means of a method of adjustment. The perception of stimulus direction was biased away from planned movement direction, such that with leftward movements stimuli appeared somewhat more rightward than with rightward movements. Control conditions revealed that this effect was neither a mere response bias, nor a result of processing or memorizing movement cues. Also, shifting the focus of attention toward a cued location in space was not sufficient to induce the perceptual bias observed under conditions of movement preparation (“Experiment 4”). These results confirm that characteristics of planned actions bias visual perception, with the direction of bias (contrast or assimilation) possibly depending on the type of the representations (categorical or metric) involved.     

The influence of flankers on race categorization of faces

Context affects multiple cognitive and perceptual processes. In the present study, we asked how the context of a set of faces would affect the perception of a target face??s race in two distinct tasks. In Experiments 1 and 2, participants categorized target faces according to perceived racial category (Black or White). In Experiment 1, the target face was presented alone or with Black or White flanker faces. The orientation of flanker faces was also manipulated to investigate how face inversion effect would interact with the influences of flanker faces on the target face. The results showed that participants were more likely to categorize the target face as White when it was surrounded by inverted White faces (an assimilation effect). Experiment 2 further examined how different aspects of the visual context would affect the perception of the target face by manipulating flanker faces?? shape and pigmentation, as well as their orientation. The results showed that flanker faces?? shape and pigmentation affected the perception of the target face differently. While shape elicited a contrast effect, pigmentation appeared to be assimilative. These novel findings suggest that the perceived race of a face is modulated by the appearance of other faces and their distinct shape and pigmentation properties. However, the contrast and assimilation effects elicited by flanker faces?? shape and pigmentation may be specific to race categorization, since the same stimuli used in a delayed matching task (Experiment 3) revealed that flanker pigmentation induced a contrast effect on the perception of target pigmentation.     

A Simon effect for stimulus-response duration

A non-spatial variant of the Simon effect for the stimulus-response (S-R) feature of duration is reported. In Experiment 1 subjects were required to press a single response key either briefly or longer in response to the colour of a visual stimulus that varied in its presentation duration. Short keypresses were initiated faster with short than with long stimulus duration whereas the inverse was observed with long keypresses. In Experiment 2 subjects were required to press a left or right key (according to stimulus form) either briefly or longer (according to stimulus colour). The stimuli concurrently varied in their location (left or right) and duration (short or long), which were both task irrelevant. Approximately additive correspondence effects for S-R location and S-R duration were observed. To summarize, the results suggest that the irrelevant stimulus features of location and duration are processed automatically and prime corresponding responses in an independent manner.     

Memory for sequences of stimuli and responses

Two experiments sought to determine if pigeons could discriminate and remember recent sequences of stimuli and responses. A variant of Konorski's short-term memory procedure involving successive presentation of sample and test stimuli was used. The samples were stimulus-response pairs of the form, (S-R)₁–(S-R)₂. Differential test responding disclosed memory of the two-item samples, with birds showing earlier and greater control by the second item than the first (Experiment 1). When the retention interval separating the second item of the sample sequence from the test stimulus was lenghtened from .5 to 2.0 or 4.0 sec, a systematic loss of stimulus control resulted; however, when varied over the same temporal range, the interval between the two items of the sample sequence had a much smaller effect, or none at all (Experiment 2). These results support an account of response-sequence differentiation that stresses short-term memory of organized behavior patterns.     

S-R compatibility effects due to context-dependent spatial stimulus coding

Responses are faster with spatial S-R correspondence than with noncorrespondence (spatial compatibility effect), even if stimulus location is irrelevant (Simon effect). In two experiments, we sought to determine whether stimuli located above and below a fixation point are coded as left and right (and thus affect the selection of left and right responses) if the visual context suggests such a coding. So, stimuli appeared on the left or right eye of a face’s image that was tilted by 90° to one side or the other (Experiment 1) or varied between upright and 45° or 90° tilting (Experiment 2). Whether stimulus location was relevant (Experiment 1) or not (Experiment 2), responses were faster with correspondence of (face-based) stimulus location and (egocentrically defined) response location, even if stimulus and response locations varied on physically orthogonal dimensions. This suggests that object-based spatial stimulus codes are formed automatically and thus influence the speed of response selection.     

Transfer of orthogonal stimulus-response mappings to an orthogonal Simon task

When up-down stimulus locations are mapped to left-right keypresses, an overall advantage for the up-right/down-left mapping is often obtained that varies as a function of response eccentricity. This orthogonal stimulus-response compatibility (SRC) effect also occurs when stimulus location is irrelevant, a phenomenon called the orthogonal Simon effect, and has been attributed to correspondence of stimulus and response code polarities. The Simon effect for horizontal stimulus-response (S-R) arrangements has been shown to be affected by short-term S-R associations established through the mapping used for a prior SRC task in which stimulus location was relevant. We examined whether such associations also transfer between orthogonal SRC and Simon tasks and whether correspondence of code polarities continues to contribute to performance in the Simon task. In Experiment 1, the orthogonal Simon effect was larger after practising with an up-right/down-left mapping of visual stimuli to responses than with the alternative mapping, for which the orthogonal Simon effect tended to reverse. Experiment 2 showed similar results when practice was with high (up) and low (down) pitch tones, though the influence of practice mapping was not as large as that in Experiment 1, implying that the short-term S-R associations acquired in practice are at least in part not modality specific. In Experiment 3, response eccentricity and practice mapping were shown to have separate influences on the orthogonal Simon effect, as expected if both code polarity and acquired S-R associations contribute to performance.     

Between-task transfer of learning from spatial compatibility to a color stroop task

Responses to a relevant stimulus dimension are faster and more accurate when the stimulus and response spatially correspond compared to when they do not, even though stimulus position is irrelevant (Simon effect). It has been demonstrated that practicing with an incompatible spatial stimulus-response (S-R) mapping before performing a Simon task can eliminate this effect. In the present study we assessed whether a learned spatially incompatible S-R mapping can be transferred to a nonspatial conflict task, hence supporting the view that transfer effects are due to acquisition of a general "respond to the opposite stimulus value" rule. To this aim, we ran two experiments in which participants performed a spatial compatibility task with either a compatible or an incompatible mapping and then transferred, after a 5 min delay, to a color Stroop task. In Experiment 1, responses were executed by pressing one of two keys on the keyboard in both practice and transfer tasks. In Experiment 2, responses were manual in the practice task and vocal in the transfer task. The spatially incompatible practice significantly reduced the color Stroop effect only when responses were manual in both tasks. These results suggest that during practice participants develop a response-selection strategy of emitting the alternative spatial response.     

Intertrial interval and sequential effects in magnitude scaling.

The intertrial interval (ITI) was varied within subjects in magnitude estimation and cross-modality matching experiments. Fits of a recently proposed time series regression model show that the influence of the previous stimulus intensity on the current response decreases when the ITI is increased. The results can be interpreted as showing that an assimilative or additive perceptual or memory effect decreases with an increase in ITI. Fits of an earlier model, on the other hand, suggest that the influence of the previous stimulus intensity increases with an increase in ITI, which is counter to expectations. The new regression model (a) provides a simple explanation for the counterintuitive results obtained with the earlier model, (b) shows that assimilation in perception or memory can appear as contrast, and (c) reduces to a simpler model for longer ITIs.     

The Simon effect and visual motion

Summary S-R compatibility and Simon effects were studied for real visual motion. In Experiment 1, two small stimulus lights were constantly visible, 5° to the left and right of fixation; after a random delay, one began to move at 2°/s. In Experiment 2, a single stimulus light moving at 2°/s suddenly appeared 5° to the left or right of fixation, i. e., motion onset and stimulus onset coincided. In both experiments, subjects responded by a key press with their left or right index finger as soon as they detected motion. In Condition A responses were made to the position (left or right) from which the motion started, irrespective of its direction (position compatibility); in Condition B responses were made to the direction of motion (leftward or rightward) irrespective of whether motion started to the left or to the right of fixation (direction compatibility). The results show strong compatibility effects for both position and direction of motion in both experiments. A Simon effect, however, occurred only when position was task irrelevant in Experiment 1; no Simon effect was found in Experiment 2. The data only partly confirm previous results obtained with apparent motion. The selective lack of a Simon effect supports the integrated model of Umiltá and Nicoletti (1992), which requires orienting of attention for the Simon effect to occur. It is specifically assumed that this attention-orienting is triggered only by the saccade program and does not extend to the pursuit program that is initiated by smooth stimulus motion.     

Acting while perceiving: assimilation precedes contrast

To explore the nature of specific interactions between concurrent perception and action, participants were asked to move one of their hands in a certain direction while simultaneously observing an independent stimulus motion of a (dis)similar direction. The kinematics of the hand trajectories revealed a form of contrast effect (CE) in that the produced directions were biased away from the perceived directions ("Experiment 1"). Specifically, the endpoints of horizontal movements were lower when having watched an upward as opposed to a downward motion. However, when participants moved under higher speed constraints and were not presented with the stimulus motion prior to initiating their movements, the CE was preceded by an assimilation effect, i.e., movements were biased toward the stimulus motion directions ("Experiment 2"). These findings extend those of related studies by showing that CEs of this type actually correspond to the second phase of a bi-phasic pattern of specific perception-action interference.     

Control of stimulus-response translation in dual-task performance

In contradiction to stimulus-response- (S-R-) translation bottleneck models of dual-task control, stimulus processing in a primary task is affected by its compatibility with the response in a secondary, later performed task (Hommel, 1998a)- an indication of parallel S-R translation. Here we show that this backward-compatibility effect is independent of working-memory load, whether this is induced by an extra memory task (Experiment 1) or by increasing the number of S-R alternatives in the primary task (Experiment 2). However, backward effects occur even when the secondary task is no longer carried out (Experiment 3) and they are strongly affected by the inconsistency of previously used S-R mappings (Experiment 4). These findings suggest that S-R translation is (or can be) capacity-independent and automatic even under multiple-task conditions, and that it is mediated by direct S-R associations that emerge after only little practice.     

Auditory stimulus-response compatibility: Is there a contribution of stimulus-hand correspondence?

 Simon, Hinrichs, and Craft found that when subjects responded to a tone in the left or right ear with a left or right keypress, both ear-response-location correspondence and ear-hand correspondence affected reaction time. This outcome is in contrast to results obtained for auditory and visual Simon tasks (i.e., tasks in which stimulus location is irrelevant) as well as results obtained in visual stimulus-response (S-R) compatibility studies, which show only an effect of spatial S-R correspondence. Experiment 1 was a replication of Simon et al.'s experiment in which spatial mapping and hand placement (uncrossed, crossed) were varied. The results were inconsistent with those of Simon et al., showing no ear-hand compatibility effect. Experiment 2 was a second replication with an additional condition examined in which the stimuli were visual locations. The results showed no contribution of stimulus-hand correspondence for either auditory or visual stimuli. Experiment 3 was a replication of another experiment by Simon et al. in which tone pitch was relevant and tone location irrelevant. Like Simon et al.'s data, our results showed no indication that stimulus-hand correspondence is a significant factor. Overall, our results imply that regardless of whether tone location is relevant or irrelevant, ear-response-location correspondence is the only factor that contributes to S-R compatibility in auditory two-choice reaction tasks. Received: 15 March 1999 / Accepted: 8 June 1999     

Stimulus-response compatibility for absolute and relative spatial correspondence in reaching and in button pressing

Three experiments tested whether stimulus-response (S-R) compatibility might be a function of absolute (as opposed to relative) spatial correspondence-that is, the distance between a stimulus and the place of response. Experiment 1 studied reaching movements toward one of two targets in response to one of six visual stimuli. Stimulus-response pairs that shared relative position were faster than those that did not, and reaction time was faster when the stimulus and one of the potential targets were in close proximity. In Experiment 2 the same effects were found when the hands started from a different position, implicating stimulus target distance, rather than stimulus-hand distance as the critical variable. Experiment 3 employed keypress responses instead of reaches, and the distance effect was nearly absent. The implications of these results are discussed in terms of categorical (e.g. left-right) vs. quantitative (e.g. distance) S-R variables in spatial compatibility.     

Visual stimulus intensity and location probability: Interactive effects on choice reaction time

Three prevalent models predict different stimulus intensity effects on RT. These are: the serial-stage model (additivity), the variable criterion model (larger intensity effects with slower responding), and the temporal overlap model (smaller intensity effects with slower responding). The predictions were tested in a dual-response situation including oculomotor and manual responses (RT). Other variables were stimulus location probability (expectancy), foreperiod (alertness), and stimulus intensity (encoding. In Experiment I, an Intensity x Probability interaction was found such that the intensity-effect was smaller at low stimulus probability. Three further experiments were performed in order to specify some of the conditions relevant for this phenomenon. The results are consistent with the temporal-overlap interpretation. It was suggested that the obtained interaction results from a processing delay due to increased demands for cognitive and response processing (Stanovich & Pachella, 1977), or to the attention switch to an unexpected S-R event.