Effects of visual cue and response assignment on spatial stimulus coding in stimulus–response compatibility

Tlauka and McKenna (2000 Tlauka, M. and McKenna, F. P. 2000. Hierarchical knowledge influences stimulus–response compatibility effects. Quarterly Journal of Experimental Psychology, 53A: 85–103.  [Google Scholar]) reported a reversal of the traditional stimulus–response compatibility (SRC) effect (faster responding to a stimulus presented on the same side than to one on the opposite side) when the stimulus appearing on one side of a display is a member of a superordinate unit that is largely on the opposite side. We investigated the effects of a visual cue that explicitly shows a superordinate unit, and of assignment of multiple stimuli within each superordinate unit to one response, on the SRC effect based on superordinate unit position. Three experiments revealed that stimulus–response assignment is critical, while the visual cue plays a minor role, in eliciting the SRC effect based on the superordinate unit position. Findings suggest bidirectional interaction between perception and action and simultaneous spatial stimulus coding according to multiple frames of reference, with contribution of each coding to the SRC effect flexibly varying with task situations.     

Influences of multiple spatial stimulus and response codes on orthogonal stimulus—response compatibility

When up-down stimuli are mapped to left-right responses, an up-right/down-left mapping advantage is found that is modified by response eccentricity and hand posture. These effects can be attributed to correspondence of asymmetric stimulus and response codes formed relative to multiple reference frames. We examined the influence of stimulus-set location on these orthogonal stimulus-response compatibility (SRC) effects. In Experiment 1, the stimulus set appeared in the upper or lower display positions. A spatial code for stimulus-set location was formed, producing Simon-type response eccentricity and hand posture effects, but this code had no influence on the coding of the relevant stimuli. In Experiment 2, the stimulus set appeared in the left, center, or right positions relative to the response location, which also varied, to dissociate the effects of response location, relative to the stimulus display and body midline. The former factor influenced the orthogonal SRC effect for both unimanual switch movements and bimanual keypresses, and the latter factor influenced the effect for only unimanual switch movements. Stimulus-set location causes orthogonal Simon-type effects when varied along the stimulus dimension and provides a referent for response coding when varied along the response dimension.     

Effects of face and inanimate-object contexts on stimulus–response compatibility

Prior studies have shown that a left–right spatial compatibility effect occurs for vertically oriented stimuli relative to a background context of a face rotated 90° clockwise or counterclockwise from upright. For stimuli presented at the location of the eyes, the mapping of the right eye to a right response and the left eye to a left response, as would be viewed by the participant, yields better performance than does the opposite mapping. An issue of current interest in social cognition is whether animate objects are processed differently from inanimate ones. We investigated this issue in two experiments in which we compared the compatibility effects obtained with inanimate objects to those obtained with animate, face stimuli. The results showed left–right compatibility effects from the participant’s perspective for vehicles and faces from frontal and profile views, as well as for a road sign. Our findings indicate that coding of stimulus location relative to an external frame of reference is not restricted to face backgrounds.     

Dissociable effects of auditory attention switching and stimulus–response compatibility

Using a task-switching variant of dichotic listening, we examined the ability to intentionally switch auditory attention between two speakers. We specifically focused on possible interactions with stimulus–response compatibility. In each trial, two words, one spoken by a male and another by a female, were presented dichotically via headphones. In one experimental group, two animal names were presented, and the relevant animal had to be judged as smaller or larger than a sheep by pressing a left or right response key. In another group, two number words were presented and had to be judged as smaller or larger than 5. In each trial, a visual cue indicated the gender of the relevant speaker. Performance was worse when the gender of the relevant speaker switched from trial to trial. These switch costs were larger for animal names than for number words, suggesting stronger interference with slower access to semantic categories. Responses were slower if the side of the target stimulus (as defined by the relevant gender) was spatially incompatible with the required response (as defined by the size judgment). This stimulus–response compatibility effect did not differ across stimulus material and did not interact with attentional switch costs. These results indicate that auditory switch costs and stimulus–response compatibility effects are dissociable, referring to target selection and response selection, respectively.     

Effector identity and orthogonal stimulus–response compatibility in blindness to response-compatible stimuli

Perceiving a visual stimulus is hampered when the stimulus is compatible with simultaneously prepared or executed action (blindness effect). We explored the roles of the effector identity of the responding hand and of orthogonal compatibility (above-right/below-left correspondence) in the blindness effect. In Experiment 1, participants conducted bimanual key presses with vertically arranged responses while perceiving a brief presentation of rightward or leftward arrowheads. A blindness effect based on the effector identity did emerge, but only with the above-right/below-left key-hand arrangement. An orthogonal blindness effect was not found in Experiment 2 with a horizontal key-press action task and a vertical arrowhead perception task. We concluded that the anatomical identity of the responding hand was not integrated into the action plan with an orthogonally incompatible key-hand arrangement. The findings are discussed in terms of the generality and limits of the blindness effect, and hierarchical response coding.     

Unlearning a stimulus–response association

After a response has been associated with a particular stimulus, would this association be “unlearned” when the circumstances call for a new response to be made to that stimulus? This question was investigated in the present study with a negative priming (NP) paradigm developed by Shiu and Kornblum (1996). In the study, participants first practiced with a particular pairing of stimuli and responses in a four-choice reaction time (RT) task. Then, in the transfer phase, they switched to a different pairing of the same set of stimuli and responses. The results showed that a transfer response was slow if this response and the stimulus in the preceding trial had been paired in the training phase. Such NP effects persisted even after extended practice with the new pairing, suggesting that the “old” stimulus–response (SR) associations remain despite acquisition of some “new” associations.     

On the relation between object and action: Response consistency and stimulus–response compatibility

A series of four experiments investigated factors influencing the selection of objects and responses associated with the objects. The experiments focused on the interaction between response consistency and the spatial compatibility of the response (involving inhibition of an irrelevant distractor) in conditions of task switching. To test for the response consistency effect, a cue indicated the dimension of the display to be selected for the participant's response. The stimulus displays were either consistent, neutral, or inconsistent (including a distractor stimulus) with the response to the stimulus. The responses were either compatible or incompatible with the location of the stimulus. Intertrial dependences were examined by switching or repeating the tasks across trials. The results suggest that links between objects and actions set up by targets can be replaced by links between a distractor and a response under certain conditions. The implications for stimulus and response selection are discussed.     

SNARC (spatial–numerical association of response codes) meets SPARC (spatial–pitch association of response codes): Automaticity and interdependency in compatibility effects

Concepts, including the mental number line, or addressing pitch as high and low, suggest that the spatial–numerical and spatial–pitch association of response codes (SNARC and SPARC) effects are domain-specific and thus independent. Alternatively, there may be dependencies between these effects, because they share common automatic or controlled decision mechanisms. In two experiments, participants were presented with spoken numbers in different pitches; their numerical value, pitch, and response compatibility were varied systematically. This allowed us to study SNARC and SPARC effects in a factorial design (see also Fischer, Riello, Giordano, &; Rusconi, 2013 Fischer, M. H., Riello, M., Giordano, B. L., &; Rusconi, E. (2013). Singing numbers?…?in cognitive space--a dual-task study of the link between pitch, space, and numbers. Topics in Cognitive Science, 5(2), 354–366. Retrieved from http://doi.org/10.1111/tops.12017[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). Participants judged the stimuli on numerical magnitude, pitch, or parity (odd–even). In all tasks, the SNARC and SPARC effects had superadditive interactions. These were interpreted as both effects sharing a common mechanism. The task variation probes the mechanism: In the magnitude judgement task, numerical magnitude was explicit, whereas pitch was implicit; in the pitch judgement task, it was vice versa. In the parity judgement task, both dimensions were implicit. Regardless of whether they were implicit or explicit, both SNARC and SPARC effects occurred in all tasks. We concluded that by not requiring focal attention the common mechanism operates automatically.     

Reaction time measures in deception research: Comparing the effects of irrelevant and relevant stimulus–response compatibility

Evidence regarding the validity of reaction time (RT) measures in deception research is mixed. One possible reason for this inconsistency is that structurally different RT paradigms have been used. The aim of this study was to experimentally investigate whether structural differences between RT tasks are related to how effective those tasks are for capturing deception. We achieved this aim by comparing the effectiveness of relevant and irrelevant stimulus–response compatibility (SRC) tasks. We also investigated whether an intended but not yet completed mock crime could be assessed with both tasks. Results showed (1) a larger compatibility effect in the relevant SRC task compared to the irrelevant SRC task, (2) for both the completed and the intended crime. These results were replicated in a second experiment in which a semantic feature (instead of color) was used as critical response feature in the irrelevant SRC task. The findings support the idea that a structural analysis of deception tasks helps to identify RT measures that produce robust group effects, and that strong compatibility effects for both enacted crimes as well as merely intended crimes can be found with RT measures that are based on the manipulation of relevant SRC.     

The influence of the response–stimulus interval on implicit and explicit learning of stimulus sequence

Three experiments investigated the influence of the response-stimulus interval (RSI) on implicit and explicit learning of stimulus sequences. Participants responded to numerals presented in predetermined positions with alternating long and short RSIs. Half of the participants were instructed explicitly to learn the position sequence. In the transfer phase of Experiments 1 and 2, changing RSI patterns reduced the expression of incidental and intentional learning of position sequence. In Experiment 3 the position sequence was transformed, except that sub-sequences demarcated by long RSIs remained unchanged; this greatly reduced the expression of intentional learning, and slightly reduced that of incidental learning. These results indicate that in implicit learning, stimulus sequences are learned under the constraints of RSIs, whereas in explicit learning, learning independent of RSIs, as well as learning constrained by RSIs, occurs.     

Phase-oscillator computations as neural models of stimulus–response conditioning and response selection

The activity of collections of synchronizing neurons can be represented by weakly coupled nonlinear phase oscillators satisfying Kuramoto’s equations. In this article, we build such neural-oscillator models, partly based on neurophysiological evidence, to represent approximately the learning behavior predicted and confirmed in three experiments by well-known stochastic learning models of behavioral stimulus–response theory. We use three Kuramoto oscillators to model a continuum of responses, and we provide detailed numerical simulations and analysis of the three-oscillator Kuramoto problem, including an analysis of the stability points for different coupling conditions. We show that the oscillator simulation data are well-matched to the behavioral data of the three experiments.     

Is there evidence for automatic processing of spatial and color attributes present in pictures and words?

The current experiment studies evidence for automatic processing of color and spatial dimensions present in matched pictures and words. Subjects studied four lists of either line drawings or matched words that varied in color (red or green) and position (left or right side), under one of four encoding conditions. Subjects were instructed to encode (1) only the item, (2) the item and its color, 13) the item and its position, or (4) the item and both color and position. All subjects participated in an unexpected final recognition task in which item recognition and recall for both attributes, regardless of original encoding instructions, we:re examined. Color memory appeared to be effortful for both pictures and words, as it was at chance level unless subjects were specifically instructed to encode the information. Position was most poorly recalled when subjects attended only to item information, but memory for this dimension was well above chance in all encoding conditions. The position of the line drawings was better recalled than the position of the words. The implications of these results for Hasher and Zacks’ (1979) model of automatic processes is discussed.     

Approach and avoidance movements are unaffected by cognitive conflict: A comparison of the Simon effect and stimulus–response compatibility

Participants in this study reached from central fixation to a lateral position that either contained or was opposite to the stimulus. Cognitive conflict was induced when the stimulus and response directions did not correspond. In the Simon task, the response direction was cued by the color of the lateral stimulus, and corresponding and noncorresponding trials varied randomly in the same block of trials, resulting in high uncertainty and long reaction times (RTs). In the stimulus-response compatibility (SRC) task, participants reached toward or away from the stimulus in separate blocks of trials, resulting in low uncertainty and short RTs. In the SRC task, cognitive conflict in noncorresponding trials slowed down RTs but hardly affected reach trajectories. In the Simon task, both RTs and reach trajectories were strongly influenced by stimulus-response correspondence. Despite the overall longer RTs in the Simon task, reaches were less direct and deviated toward the stimulus in noncorresponding trials. Thus, cognitive conflict was resolved before movement initiation in the SRC task, whereas it leaked into movement execution in the Simon task. Current theories of the Simon effect, such as the gating of response activation or response code decay, are inconsistent with our results. We propose that the SRC task was decomposed as approaching and avoiding the stimulus, which is sustained by stereotyped visuomotor routines. With complex stimulus-response relationships (Simon task), responses had to be coded as leftward and rightward, with more uncertainty about how to execute the action. This uncertainty permitted cognitive conflict to leak into the movement execution.     

Attentional control of the creation and retrieval of stimulus–response bindings

Two experiments studied the degree to which the creation and retrieval of episodic feature bindings is modulated by attentional control. Experiment 1 showed that the impact of bindings between stimulus and response features varies as a function of the current attentional set: only bindings involving stimulus features that match the current set affect behavior. Experiment 2 varied the time point at which new attentional sets were implemented—either before or after the processing of the to-be-integrated stimuli and responses. The time point did not matter, suggesting that the attentional set has no impact on feature integration proper but controls which features get access to and can thus trigger the retrieval of bindings.     

Is the exogenous orienting of spatial attention truly automatic? Evidence from unimodal and multisensory studies

The last decade has seen great progress in the study of the nature of crossmodal links in exogenous and endogenous spatial attention (see [Spence, C., McDonald, J., & Driver, J. (2004). Exogenous spatial cuing studies of human crossmodal attention and multisensory integration. In C. Spence, & J. Driver (Eds.), Crossmodal space and crossmodal attention (pp. 277-320). Oxford, UK: Oxford University Press.], for a recent review). A growing body of research now highlights the existence of robust crossmodal links between auditory, visual, and tactile spatial attention. However, until recently, studies of exogenous and endogenous attention have proceeded relatively independently. In daily life, however, these two forms of attentional orienting continuously compete for the control of our attentional resources, and ultimately, our awareness. It is therefore critical to try and understand how exogenous and endogenous attention interact in both the unimodal context of the laboratory and the multisensory contexts that are more representative of everyday life. To date, progress in understanding the interaction between these two forms of orienting has primarily come from unimodal studies of visual attention. We therefore start by summarizing what has been learned from this large body of empirical research, before going on to review more recent studies that have started to investigate the interaction between endogenous and exogenous orienting in a multisensory setting. We also discuss the evidence suggesting that exogenous spatial orienting is not truly automatic, at least when assessed in a crossmodal context. Several possible models describing the interaction between endogenous and exogenous orienting are outlined and then evaluated in terms of the extant data.     

Is the sunny side up and the dark side down? Effects of stimulus type and valence on a spatial detection task

In verbal communication, affective information is commonly conveyed to others through spatial terms (e.g. in “I am feeling down”, negative affect is associated with a lower spatial location). This study used a target location discrimination task with neutral, positive and negative stimuli (words, facial expressions, and vocalizations) to test the automaticity of the emotion-space association, both in the vertical and horizontal spatial axes. The effects of stimulus type on emotion-space representations were also probed. A congruency effect (reflected in reaction times) was observed in the vertical axis: detection of upper targets preceded by positive stimuli was faster. This effect occurred for all stimulus types, indicating that the emotion-space association is not dependent on sensory modality and on the verbal content of affective stimuli.     

Is evidence for late selection due to automatic or attentional processing of stimulus identities?

This study determined whether evidence for late selection is due to attention processing or to processing by an automatic system that is separate from attention (two systems framework; Eriksen, Webb, & Fournier, 1990). The task was a two-choice discrimination of a target that appeared in one of two sequentially cued locations in an eight-letter visual display. Attention was directed to the first cued location (cue 1), and whether identification processing occurred at a different location before the second cue (cue 2) directed attention there was determined. Cue validity varied across two experiments, and critical trials were those in which the target appeared at cue 2. For these trials, the target was preceded by a letter (either identical, neutral, or incompatible) that changed to the target at various time intervals following cue 2. Automatic identification was assumed if the incompatible letter interfered with response to the target when it appeared only before cue 2 onset and independent of cue validity. The incompatible letter appearing only before cue 2 onset interfered with the target when the target occurred equally often at cue 1 and cue 2, but not when the target occurred at cue 1 70% and at cue 2 30% of the time. This disconfirms the two systems framework and suggests that attention is required for spatial form processing and response competition.     

Effects of response–stimulus interval manipulation and articulatory suppression on task switching

We conducted three experiments using a list paradigm to examine how articulatory suppression and response–stimulus interval (RSI) manipulation affected task switching. Experiments 1 and 2 tested task-switching performance under a short and long RSI and three concurrent task conditions (control, articulatory suppression, and tapping) without external task cues. The results indicated that alternation had a greater effect under articulatory suppression than under the control and tapping conditions, and that articulatory suppression costs were unrelated to the RSI. In Experiment 3, an external task cue was provided with each stimulus, and the negative effect of articulatory suppression on alternation cost was eliminated. These results indicated that articulatory suppression effects did not differ between conditions of short and long RSI and that the availability of verbal representations of task information was independent of RSI length. This paper discussed the possible roles played by the phonological loop in task-switching paradigms.     

Auditory stimulus-response compatibility: Is there a contribution of stimulus-hand correspondence?

 Simon, Hinrichs, and Craft found that when subjects responded to a tone in the left or right ear with a left or right keypress, both ear-response-location correspondence and ear-hand correspondence affected reaction time. This outcome is in contrast to results obtained for auditory and visual Simon tasks (i.e., tasks in which stimulus location is irrelevant) as well as results obtained in visual stimulus-response (S-R) compatibility studies, which show only an effect of spatial S-R correspondence. Experiment 1 was a replication of Simon et al.'s experiment in which spatial mapping and hand placement (uncrossed, crossed) were varied. The results were inconsistent with those of Simon et al., showing no ear-hand compatibility effect. Experiment 2 was a second replication with an additional condition examined in which the stimuli were visual locations. The results showed no contribution of stimulus-hand correspondence for either auditory or visual stimuli. Experiment 3 was a replication of another experiment by Simon et al. in which tone pitch was relevant and tone location irrelevant. Like Simon et al.'s data, our results showed no indication that stimulus-hand correspondence is a significant factor. Overall, our results imply that regardless of whether tone location is relevant or irrelevant, ear-response-location correspondence is the only factor that contributes to S-R compatibility in auditory two-choice reaction tasks. Received: 15 March 1999 / Accepted: 8 June 1999