Stimulus congruence and stimulus-response compatibility: Two variables disentangled in an auditory reaction time task

Abstract

Stimulus—response (S-R) compatibility was a tem fmt used by Wtts and Seeger (1953) to describe effcts observed on reaction time (RT) when the stimulus—response relationship was varied, as in the following instructions: “move to tbe right when the stimulus appears on the right” (compatible) or “move to the left when the stimulus appears on the right” (incompatible). This term was later employed in a broader sense (Simon & Rudell, 1967) with paradigms involving elaborate stimuli, such as the verbal command ‘RIGHT’ delivered to the right tar (compatible) or to the left ear (incompatible). In such paradigms. subjects respond faster when the response is delivered on the same side as the stimulus (the so-called “Simon effect”). It has been shown, however, that this effect could be reversed under some circumstanas in the visual domain. In this paper, we report data showing that it can also be reversed in the auditory domain when using the above-mentioned verbal commands. This brings further evidence that stimulus-response compatibility and the Simon effect difier in essence, with the latter effect reflecting the influence of stimulus congruence, the correspondence relationship borne by the two simultaneous characteristics of the stimulus. Stimulus congruence and stimulus-response compatibility had indeed independent influences on RT, which in a serially connected information-processing modcl would imply that they act upon independent stages.     

Evidence for a response preparation bottleneck during dual-task performance: Effect of a startling acoustic stimulus on the psychological refractory period

The present study was designed to investigate the mechanism associated with dual-task interference in a psychological refractory period (PRP) paradigm. We used a simple reaction time paradigm consisting of a vocal response (R1) and key-lift task (R2) with a stimulus onset asynchrony (SOA) between 100 ms and 1500 ms. On selected trials we implemented a startling acoustic stimulus concurrent with the second stimulus to determine if we could involuntarily trigger the second response. Our results indicated that the PRP delay in the second response was present for both control and startle trials at short SOAs, suggesting the second response was not prepared in advance. These results support a response preparation bottleneck and can be explained via a neural activation model of preparation. In addition, we found that the reflexive startle activation was reduced in the dual-task condition for all SOAs, a result we attribute to prepulse inhibition associated with dual-task processing.     

Spatial S-R compatibility with orthogonal stimulus-response relationship

Spatial stimulus-response (S-R) compatibility with unimanual two-finger choice reactions was investigated under conditions in which the spatial orientation of response keys was either parallel to or perpendicular to the orientation of the stimuli. Subjects responded to green or red lights in the left or right visual field (irrelevant stimulus location). The response keys were oriented horizontally on the left or right side of the body midline parallel to the stimuli, and were pressed with the palms facing down (Condition A), or were oriented orthogonally to the stimuli in the midsaggital plane, either horizontally and pressed with palms facing down (B) or facing up (C), or vertically and pressed with palms facing the body (D). The results for Condition A demonstrate the usual spatial S-R compatibility effect between field of stimulation and spatial position of responding finger. For Conditions B and D, a strong reaction time advantage still obtained for those stimulus-finger pairings that are compatible under Condition A. Condition C revealed an RT advantage for the opposite pairings. This shift of the compatibility effect from Condition B to Condition C indicates that the left/right distinction of fingers does not follow a simple, fixed spatio-anatomical mapping rule. The results are discussed within the framework of a hierarchical model of spatial S-R compatibility, with spatial coding and spatio-anatomical mapping as factors.     

A parallel distributed processing model of stimulus-stimulus and stimulus-response compatibility.

A parallel distributed processing (PDP) model is proposed to account for choice reaction time (RT) performance in diverse cognitive and perceptual tasks such as the Stroop task, the Simon task, the Eriksen flanker task, and the stimulus-response compatibility task that are interrelated in terms of stimulus-stimulus and stimulus-response overlap (Kornblum, 1992). In multilayered (input-intermediate-output) networks, neuron-like nodes that represent stimulus and response features are grouped into mutually inhibitory modules that represent stimulus and response dimensions. The stimulus-stimulus overlap is implemented by a convergence of two input modules onto a common intermediate module, and the stimulus-response overlap by direct pathways representing automatic priming of outputs. Mean RTs are simulated in various simple tasks and, furthermore, predictions are generated for complex tasks based on performance in simpler tasks. The match between simulated and experimental results lends strong support for our PDP model of compatibility.     

Lateral stimulus-response compatibility effects in the oculomotor system.

Eye movement reaction time (RT) was measured in simple and choice RT situations in which monaural tones were presented to the left or right ear. In the choice RT conditions, tones of one frequency signaled a left looking response and tones of another frequency signaled a right looking response. In the simple RT condition, tones were presented in 2 blocks signaling right or left looking responses. RTs were measured by electro-oculogram (EOG), with electrodes placed over the outer canthus of each eye. In the choice RT condition, oculomotor RTs were faster when the tones signaling right or left looking were presented in the ears corresponding to the direction of looking than when they occured in the opposite ear. No such correspondence was present in the simple RT condition. Ss also performed a manual choice RT task. The lateral stimulus- response (S-R) compatibility effects obtained confirmed previous findings and were of the same magnitude as those obtained in the oculomotor response modality. Asymmetry in correlations between oculomotor and manual compatibility effects suggests differential hemispheric mediation.     

Proprioception and Stimulus-Response Compatibility

Sixteen subjects pressed a left or right key in response to lateralized visual stimuli, in uncrossed (left index finger on left key, right finger on right key) and crossed conditions (left finger on right key and vice versa), with varying finger separations. Visual, tactile, or 'efference copy' cues about relative finger positions were unavailable. Subjects had to press the key on the same side as (compatible group) or opposite side to the stimulus (incompatible group). Separate proprioceptive judgements of the relative finger positions were obtained. Findings of an overall reaction time (RT) advantage for compatible instructions and for uncrossed hands were replicated. With decreasing finger separation the RT advantage for compatible instructions decreased, and the probability of responding with either hand increased. The compatibility effect disappeared completely at the 6-cm crossed position, not at the position that was hardest to judge proprioceptively. This suggests that two forms of neural activation are summed: automatic activation of the anatomically same-side limb, and an integrated, rule-based activation. The results further demonstrate that independent proprioceptive cues from each limb, unassociated with skin contact between the limbs, can mediate the determination of relative position for response selection in stimulus-response compatibility tasks.     

Right hemisphere comprehension of verbs in patients with complete forebrain commissurotomy: Use of the dichotic method and manual performance

The paradigm of dichotic listening was used to investigate verbal comprehension in the right, so-called “nonverbal,” hemisphere. Verbal commands were presented to the right and left ears in the simultaneous (dichotic) paradigm. There were striking instances, especially when the left hemisphere was occupied with some extraneous task, in which the right hemisphere understood the verbal command and executed the appropriate motor responses. In those instances the left hemisphere gave no overt response. Although the left hemisphere was usually dominant, it can be nevertheless concluded that not only can the right hemisphere understand verbal commands but can also express itself manually by executing actions more complex than object retrieval or pointing. As has been known for some time, the blockage of the ipsilateral pathway seems so complete during dichotic listening in the commissurotomy patient that there is no report of the words in the left ear—only of those presented to the right. At the same time there is normal report when words are presented to the left ear alone. It was found in the present study, however, that this model is too simple and only applies to the verbal response paradigm of dichotic listening. Under circumstances of dichotic presentation where the stimulus in the left ear (ipsilateral pathway) is necessary or important to the left hemisphere for completing a task, words from both pathways are reported. One may conclude that there exists a gating mechanism in each hemisphere that controls the monitoring of each auditory pathway and the degree of ipsilateral suppression.     

Is automatic imitation a specialized form of stimulus–response compatibility? Dissociating imitative and spatial compatibilities

In recent years research on automatic imitation has received considerable attention because it represents an experimental platform for investigating a number of interrelated theories suggesting that the perception of action automatically activates corresponding motor programs. A key debate within this research centers on whether automatic imitation is any different than other long-term S-R associations, such as spatial stimulus-response compatibility. One approach to resolving this issue is to examine whether automatic imitation shows similar response characteristics as other classes of stimulus-response compatibility. This hypothesis was tested by comparing imitative and spatial compatibility effects with a two alternative forced-choice stimulus-response compatibility paradigm. The stimulus on each trial was a left or right hand with either the index or middle finger tapping down. Speeded responses were performed with the index or middle finger of the right hand in response to the identity or the left-right spatial position of the stimulus finger. Two different tasks were administered: one that involved responding to the stimulus (S-R) and one that involved responding to the opposite stimulus (OS-R; i.e., the one not presented on that trial). Based on previous research and a connectionist model, we predicted standard compatibility effects for both spatial and imitative compatibility in the S-R task, and a reverse compatibility effect for spatial compatibility, but not for imitative compatibility, in the OS-R task. The results from the mean response times, mean percentage of errors, and response time distributions all converged to support these predictions. A second noteworthy result was that the recoding of the finger identity in the OS-R task required significantly more time than the recoding of the left-right spatial position, but the encoding time for the two stimuli in the S-R task was equivalent. In sum, this evidence suggests that the processing of spatial and imitative compatibility is dissociable with regard to two different processes in dual processing models of stimulus-response compatibility.     

Gain control in the auditory system: absolute identification of intensity within and across the two ears

A number of studies have suggested that the auditory system employs nonlinear gain control to modulate its response to a broad range of stimulus intensities (e.g., Parker, Murphy, & Schneider, 2002), but the precise location and nature of this mechanism remains uncertain. To address these issues, we investigated the extent to which gain control in one ear was influenced by auditory events in the other ear. Listeners were asked to identify which of four sounds, varying in intensity (25, 30, 35, and 40 dB [SPL]), had been presented to the left ear. Subsequent test sets included an 80-dB (SPL) stimulus presented to either the left (ipsilateral) or the right (contralateral) ear. Ipsilateral presentations of the 80-dB (SPL) stimulus produced a greater reduction in identification accuracy among the original four sounds than did contralateral presentations, but both presentations caused a reduction in gain. In a second experiment, the perceived laterality of a sound was manipulated by presenting the same sound to both ears with an interaural time delay. When the 80-dB (SPL) stimulus was added to the set of quiet sounds (which were presented to both ears but were perceived to be in the left ear because of the interaural time delay), identification accuracy was reduced by the same amount, independently of whether the 80-dB (SPL) stimulus was perceived only in the ipsilateral ear or only in the contralateral ear.     

Prepared movements are elicited early by startle

A startle stimulus has been shown to elicit a ballistic response in a reaction time (RT) task at very short latencies without involvement of the cerebral cortex (J. Valls-Sole, J. C. Rothwell, F. Gooulard, G. Cossu, & E. Munoz, 1999). The present authors examined the nature of the startle response. A simple RT task was used in which 8 participants performed arm extension movements to 3 target distances (20 degrees, 40 degrees, and 60 degrees ) in a blocked design. An unpredictable startling acoustic stimulus (124 dB) replaced the imperative stimulus in certain trials. The authors verified the presence of a startle response independent from the prepared response by observing electromyographic (EMG) activity in sternocleidomastoid and orbicularis oculi muscles. Findings indicated that when the participant was startled, the intended voluntary response was produced at significantly shorter response latencies. Furthermore, the kinematic variables of the observed response during startle trials for all 3 target distances were mostly unchanged. The EMG characteristics of the responses were not modified, indicating that the response produced was indeed the prepared and intended response.     

Cardiac modulation of startle: Effects on eye blink and higher cognitive processing

Cardiac cycle time has been shown to affect pre-attentive brainstem startle processes, such as the magnitude of acoustically evoked reflexive startle eye blinks. These effects were attributed to baro-afferent feedback mechanisms. However, it remains unclear whether cardiac cycle time plays a role in higher startle-related cognitive processes, as well. Twenty-five volunteers responded first by ’fast as possible’ button pushes (reaction time, RT), and second, rated perceived intensity of 60 acoustic startle stimuli (85, 95, or 105 dB; 50 ms duration; binaural; instantaneous rise time), which were presented either 230 or 530 ms after the R-wave, and eye blink responses were measured by EMG. RT was divided into evaluation and motor response time according to previous research. Increasing stimulus intensity enhanced startle eye blink, intensity ratings, and RT components. Eye blinks and intensity judgments were lower when startle was elicited at a latency of R + 230 ms, but RT components were differentially affected: the evaluative component was attenuated, and the motor component was accelerated when stimuli were presented 230 ms after the R-wave. We conclude that the cardiac cycle affects the attentive processing of acoustic startle stimuli.     

Neural correlates of partial transmission of sensorimotor information in the cerebral cortex

Using single neuron recordings in monkey primary motor (MI) cortex, two series of experiments were conducted in order to know whether response preparation can begin before perceptual processing finishes, thus providing evidence for a temporal overlap of perceptual and motor processes.

In Experiment 1, a “left/right, Go/No-Go” reaction time (RT) task was used. One monkey was trained to perform wrist flexion/extension movements to align a pointer with visual targets. The visual display was organized to provide a two-dimensional stimulus: side (an easy discrimination between left and right targets) which determined movement direction, and distance (a difficult discrimination between distal and proximal targets) which determined whether or not the movement was to be made. Changes in neuronal activity, when they were time-locked to the stimulus, were almost similar in the Go and No-Go trials, and when they were time-locked to movement onset, were markedly reduced in No-Go as compared to Go trials.

In Experiment 2, a stimulus-response compatibility (SRC) task was used. Two monkeys were trained to align a pointer with visual targets, on either left or right. In the spatially “compatible” trials, they had to point at the stimulus position, whereas in the “incompatible” trials, they had to point at the target located in the opposite side. For 12.5% of neurons, changes in activity associated with incompatible trials looked like changes in activity associated with movements performed in the opposite direction during compatible trials, thus suggesting the hypothesis of an automatic activation of the congruent, but incorrect response.

Results of both experiments provide evidence for a partial transmission of information from visual to motor cortical areas: that is, in the No-Go trials of the first task, information about movement direction, before the decision to perform or not this movement was made, and, in the incompatible trials of the SRC task, information about the congruent, but incorrect response, before the incongruent, but correct response was programmed.     

Action planning during the presentation of stimulus sequences: Effects of compatible and incompatible stimuli

Experimental designs that require the simultaneous perception and reproduction of a stimulus sequence could help to clarify the relationship between perception and action. This contribution examines a specific stimulus-response compatibility with the reproduction of simple stimulus sequences. In the procedure a response just prepared or one to be prepared is confronted with a new incoming stimulus that is compatible or incompatible with the response. Interference is predicted from a framework in which stimulus perception and action control are assumed to share common codes.Five arrows were successively presented at 1-s intervals. The arrows pointed either to the left or to the right with equal probability. One of the five arrows was accompanied by a randomly presented go signal. Subjects then had to reproduce the sequence by pressing corresponding left or right keys while the stimulus presentation continued. Reaction-time latencies and reaction intervals within a sequence were analyzed in six experiments. Results showed increasing reaction-time latencies the later the go signal was presented — that is, the longer the sequence to be reproduced was. In contrast to previous findings, this effect interacted with the compatibility between the arrow displayed together with the go signal and the first reaction. It is argued that the go signal initiates a transfer of a cognitive action plan to a peripheral motor program and that this process is subject to interference the more the current stimulus is at odds with one of the first parameter specification.     

Long-term response-stimulus associations can influence distractor-response bindings

Strong associations between target stimuli and responses usually facilitate fast and effortless reactions. The present study investigated whether long-term associations between distractor stimuli and responses modulate behavior. In particular, distractor stimuli can affect behavior due to distractor-based stimulus-response retrieval, a phenomenon called distractor-response binding: An ignored stimulus becomes temporarily associated with a response and retrieves it at stimulus repetition. In a flanker task, participants ignored left and right pointing arrows and responded to a target letter either with left and right (strongly associated) responses or with upper and lower (weakly associated) responses. Binding effects were modulated in dependence of the long-term association strength between distractors and responses. If the association was strong (arrows pointing left and right with left and right responses), binding effects emerged but only in case of compatible responses. If the long-term association between distractors and responses was weak (arrows pointing left and right with upper and lower responses), binding was weaker and not modulated by compatibility. In contrast, sequential compatibility effects were not modulated by association strength between distractor and response. The results indicate that existing long-term associations between stimuli responses may modulate the impact of an ignored stimulus on action control.     

Potentiation of the acoustic startle response by a conditioned stimulus paired with acoustic startle stimulus in rats

The hypothesis that the standard acoustic startle habituation paradigm contains the elements of Pavlovian fear conditioning was tested. In a potentiated startle response paradigm, a startle stimulus and a light conditioned stimulus (CS) were paired. A startle stimulus then was tested alone or following the CS. Freezing behavior was measured to index conditioned fear. The startle response was potentiated on CS trials, and rats froze more in CS than in non-CS periods. In Experiment 1, response to a previously habituated, weak startle stimulus was potentiated. In Experiment 2, response to the same stimulus used as the unconditioned stimulus (US) in training was potentiated. This CS-potentiated response retarded the course of response decrements over training sessions as compared with an explictly unpaired control group. Conditioned fear is a standard feature of this habituation paradigm, serves to potentiate the startle response, and provides an associative dimension lacking in the habituation process per se.     

The role of attention in the affordance effect: can we afford to ignore it?

It has been established that the task-irrelevant orientation of an object's graspable handle produces a stimulus-response compatibility effect, resulting in faster reaction times when the location of the response corresponds to that of the object's handle. There is ongoing debate whether to attribute this affordance effect to motoric or to attentional components. In an attempt to reconcile these two viewpoints, we employed a novel experimental approach for investigating the relationship between attention and affordance. Using 3-D positional sound, auditory spatial attention was manipulated in order to explore its effects on affordance. Subjects were presented images of everyday graspable objects and had to respond bimanually (left or right) whether the object (featuring a leftward or rightward handle) was presented upright or upside-down. Prior to each affording object, sound localization cues were manipulated so as to orient auditory attention to the left, or to the right of the interaural axis (control). We obtained a peculiar pattern of results, which not only appears to provide support for an attention-shift account of affordance but does so in a cross-modal context.     

Pitch and pitch change interact in auditory displays

Designing auditory displays requires understanding how different attributes of sound are processed. Operators must often listen to a particular stimulus dimension and make control actions contingent on the auditory information. Three experiments used a selective-listening paradigm to examine interactions between auditory dimensions. Participants were instructed to attend to either relative pitch or direction of pitch change of dynamic stimuli. With vertically arranged keypress responses, reactions to both dimensions showed stimulus-response compatibility effects, indicating that pitch is treated spatially. Direction of pitch change affected responses to pitch; level of pitch more strongly affected responses to pitch change. To reduce deleterious effects of irrelevant pitch information, auditory display designers can restrict the pitch range used to display dynamic data.     

Mixing compatible and incompatible mappings: Elimination, reduction, and enhancement of spatial compatibility effects

In two-choice tasks, the compatible mapping of left stimulus to left response and right stimulus to right response typically yields better performance than does the incompatible mapping. Nonetheless, when compatible and incompatible mappings are mixed within a block of trials, the spatial compatibility effect is eliminated. Two experiments evaluated whether the elimination of compatibility effects by mixing compatible and incompatible mappings is a general or specific phenomenon. Left-right physical locations, arrow directions, and location words were mapped to keypress responses in Experiment 1 and vocal responses in Experiment 2. With keypresses, mixing compatible and incompatible mappings eliminated the compatibility effect for physical locations and arrow directions, but enhanced it for words. With vocal responses, mixing significantly reduced the compatibility effect only for words. Overall, the mixing effects suggest that elimination or reduction of compatibility effects occurs primarily when the stimulus-response sets have both conceptual and perceptual similarity. This elimination may be due to suppression of a direct response-selection route, but to account for the full pattern of mixing effects it is also necessary to consider changes in an indirect response-selection route and the temporal activation properties of different stimulus-response sets.     

Stimulus-response compatibility affects auditory Stroop interference

The contribution of stimulus-response compatibility to Stroop interference was tested in an auditory version of the Stroop test. The words “high” and “low” were presented in high and low pitches with either the pitch or the word designated as the relevant dimension. College students categorized the relevant stimulus dimension with a verbal response, a buttonpress, or a pitched hum. Significant interference occurred in the incompatible conditions (pitch-verbal, word-hum, pitch-button), but not in the compatible conditions (pitch-hum, word-verbal, word-button). The results indicated that stimulus-response compatibility was an important determinant of observed interference. It was suggested that stimulus-response incompatibility contributed to the response competition that presumably occurs in Stroop tasks.     

A forced-attention dichotic listening fMRI study on 113 subjects

We report fMRI and behavioral data from 113 subjects on attention and cognitive control using a variant of the classic dichotic listening paradigm with pairwise presentations of consonant-vowel syllables. The syllable stimuli were presented in a block-design while subjects were in the MR scanner. The subjects were instructed to pay attention to and report either the left or right ear stimulus. The hypothesis was that paying attention to the left ear stimulus (FL condition) induces a cognitive conflict, requiring cognitive control processes, not seen when paying attention to the right ear stimulus (FR condition), due to the perceptual salience of the right ear stimulus in a dichotic situation. The FL condition resulted in distinct activations in the left inferior prefrontal gyrus and caudate nucleus, while the right inferior frontal gyrus and caudate were activated in both the FL and FR conditions, and in a non-instructed (NF) baseline condition.