Simon congruency effects based on stimulus and response numerosity

Three choice reaction time experiments documented a Simon-type congruence effect involving the numbers of stimuli and responses. In Experiment 1 the stimulus consisted of one or two high- or low-pitch tones, and participants were required to respond with one or two taps of a response key depending on stimulus pitch. Responses were faster when the number of tones matched the required number of response taps than when these numbers mismatched. Experiment 2 showed that a weaker version of this effect can also be obtained using visual stimuli, and Experiment 3 showed that the analogous effect can even be obtained, albeit very weakly, with bimodal stimuli. There was also evidence that the number of stimuli affected the rate of emitting the two-tap response. These results indicate that stimulus numerosity is processed automatically to the level at which it can affect the selection and possibly the execution of a varying number of responses.     

Simon congruency effects based on stimulus and response numerosity

Three choice reaction time experiments documented a Simon-type congruence effect involving the numbers of stimuli and responses. In Experiment 1 the stimulus consisted of one or two high- or low-pitch tones, and participants were required to respond with one or two taps of a response key depending on stimulus pitch. Responses were faster when the number of tones matched the required number of response taps than when these numbers mismatched. Experiment 2 showed that a weaker version of this effect can also be obtained using visual stimuli, and Experiment 3 showed that the analogous effect can even be obtained, albeit very weakly, with bimodal stimuli. There was also evidence that the number of stimuli affected the rate of emitting the two-tap response. These results indicate that stimulus numerosity is processed automatically to the level at which it can affect the selection and possibly the execution of a varying number of responses.     

Observing repetitive finger movements modulates response times of auditorily cued finger movements

Our motor and perceptual representations of actions seem to be intimately linked and the human mirror neuron system (MNS) has been proposed as the mediator. In two experiments, we presented biological or non-biological movement stimuli that were either congruent or incongruent to a required response prompted by a tone. When the tone occurred with the onset of the last movement in a series, i.e., it was perceived during the movement presentation, congruent biological stimuli resulted in faster reaction times than congruent non-biological stimuli. The opposite was observed for incongruent stimuli. When the tone was presented after visual movement stimulation, however, no such interaction was present. This implies that biological movement stimuli only affect motor behaviour during visual processing but not thereafter. These data suggest that the MNS is an "online" system; longstanding repetitive visual stimulation (Experiment 1) has no benefit in comparison to only one or two repetitions (Experiment 2).     

Cross-modal compatibility effects with visual-spatial and auditory-verbal stimulus and response sets

Within the visual-spatial and auditory-verbal modalities, reaction times to a stimulus have been shown to be faster if salient features of the stimulus and response sets correspond than if they do not. Accounts that attribute such stimulus-response compatibility effects to general translation processes predict that similar effects should occur for cross-modal stimulus and response sets. To test this prediction, three experiments were conducted examining four-choice reactions with (I) visual spatial-location stimuli assigned to speech responses, (2) speech stimuli assigned to keypress responses, and (3) symbolic visual stimuli assigned to speech responses. In all the experiments, responses were faster when correpondence between salient features of the stimulus and response sets was maintained, demonstrating that similar principles of translation operate both within and across modalities.     

Second-order schedules with paired auditory brief stimuli

Pigeons were exposed to multiple second-order schedules of paired and unpaired brief stimuli in which responding on the main key was reinforced according to a fixed-interval thirty-second schedule by a brief stimulus (a tone in the paired schedule) and advancement to the next segment of the second-order schedule. In Experiment 1, a response on the second key was required during the tone in its fourth and final presentation to produce food. Responses during earlier brief stimuli indicated the extent to which the final brief stimulus was discriminated from preceding ones. Responding was comparable during all tones, extending prior findings with visual paired brief stimuli and weakening explanations of subjects' failure to discriminate between brief-stimulus presentations in terms of elicited responding. In Experiment 2 the number of fixed-interval segments comprising the second-order schedules varied from one through eight. Although main-key response rates increased across segments in both experiments, they increased much less sharply with a variable number of segments. These results suggest that the increase in main-key response rates across segments is due primarily to a degree of temporal discrimination not reflected on the second key. Main-key response rates were higher on paired auditory brief-stimulus schedules than on unpaired visual brief-stimulus schedules, especially in Experiment 2, thus further extending findings with visual brief stimuli to second-order schedules with auditory brief stimuli.     

Item type,occlusion, and gender differences in mental rotation

Two experiments were conducted to examine the role of item type in mental rotation. In each experiment, participants completed two computerized mental rotation tasks, one with blocks as stimuli and one with human figures as stimuli. The tasks were formatted either as a multiple-choice psychometric test (Experiment 1) or as a same–different type task (Experiment 2). Aside from the expected replication of a decreased effect of occlusion on women's accuracy when processing human figures compared to block figures, it was hypothesized that response times would increase when processing the complex but familiar human figures, compared to the simple but unfamiliar block figures. In Experiment 1, the results relevant to occlusion were replicated. However, the presence of a speed–accuracy trade-off suggested that participants processed human figures faster but less accurately than block figures. In Experiment 2, both men and women performed faster and more accurately when processing occluded human figures than when processing nonoccluded human figures. The effect of item type, its potential link to embodied cognition, and the role of strategy selection on gender differences in mental rotation are discussed.     

Compatibility effects based on stimulus and response numerosity

Four choice reaction time experiments documented a stimulus-response (S-R) compatibility effect involving the numbers of stimuli and responses. In Experiment 1, the stimulus consisted of one or two tones, and the correct response was either one or two taps of a response key. Responses were much faster with a compatible S-R assignment, in which the number of taps matched the number of tones, than with an incompatible assignment in which these numbers mismatched. Experiments 2 and 3 replicated this effect, using visual stimuli and bimodal stimuli, respectively, suggesting that auditory/manual rhythmic compatibility is not essential to it. Experiment 4 showed that an analogous but smaller effect is obtained when stimuli are the digits 1 and 2. This new numerosity-based compatibility effect has general theoretical implications regarding the mechanisms responsible for compatibility effects and practical implications for interface design.     

Matching patterns vs matching digits: The effect of memory dependence and complexity on “same”-“different” reaction times

Two experiments are reported in which “same”-“different” reaction times (RTs) were collected to pairs of stimuli. In Experiment 1 stimuli were matrix patterns, and in Experiment 2 stimuli were digits. In both experiments, the pairs were presented simultaneously (discrimination task) and successively (memory task) for a set of nine simple and a set of nine complex stimuli. The following results were obtained: discrimination RTs were longer than memory RTs; RTs to complex stimuli were longer than RTs to simple stimuli; “same” RTs were faster than “different” RTs across all conditions except simple pattern discrimination, for which “different” RTs were faster than “same” RTs; and discrimination RTs for complex patterns were longer than would be predicted from the other conditions. Some evidence was obtained that the form of encoding for both patterns and digits in the memory task was visual. These results are discussed in terms of encoding and comparison strategies.     

Visual dominance in the pigeon

In Experiment 1, three pigeons were trained to obtain grain by depressing one foot treadle in the presence of a 746-Hertz tone stimulus and by depressing a second foot treadle in the presence of a red light stimulus. Intertrial stimuli included white light and the absence of tone. The latencies to respond on auditory element trials were as fast, or faster, than on visual element trials, but pigeons always responded on the visual treadle when presented with a compound stimulus composed of the auditory and visual elements. In Experiment 2, pigeons were trained on the auditory-visual discrimination task using as trial stimuli increases in the intensity of auditory or visual intertrial stimuli. Again, pigeons showed visual dominance on subsequent compound stimulus test trials. In Experiment 3, on compound test trials, the onset of the visual stimulus was delayed relative to the onset of the auditory stimulus. Visual treadle responses generally occurred with delay intervals of less than 500 milliseconds, and auditory treadle responses generally occurred with delay intervals of greater than 500 milliseconds. The results are discussed in terms of Posner, Nissen, and Klein's (1976) theory of visual dominance in humans.     

S-R compatibility effects due to context-dependent spatial stimulus coding

Responses are faster with spatial S-R correspondence than with noncorrespondence (spatial compatibility effect), even if stimulus location is irrelevant (Simon effect). In two experiments, we sought to determine whether stimuli located above and below a fixation point are coded as left and right (and thus affect the selection of left and right responses) if the visual context suggests such a coding. So, stimuli appeared on the left or right eye of a face’s image that was tilted by 90° to one side or the other (Experiment 1) or varied between upright and 45° or 90° tilting (Experiment 2). Whether stimulus location was relevant (Experiment 1) or not (Experiment 2), responses were faster with correspondence of (face-based) stimulus location and (egocentrically defined) response location, even if stimulus and response locations varied on physically orthogonal dimensions. This suggests that object-based spatial stimulus codes are formed automatically and thus influence the speed of response selection.     

Auditory negative priming in speeded reactions and temporal order judgements

Two experiments are reported that demonstrate negative priming for auditory stimuli. Reaction times and temporal order judgements were used as the dependent measures in Experiments 1 and 2, respectively. In Experiment 1, participants classified tones presented to one ear as wind or string instruments while ignoring tones presented to the other ear. The task was identical for both the prime and the subsequent probe presentations. Probe reactions were slower for previously ignored tones than for tones that had not occurred during the prime presentation. Probe reactions to previously attended tones were faster than reactions to nonrepeated tones. In Experiment 2, the probe reactions were replaced by temporal order judgements. The probability of accepting a tone as antecedent was lower for previously ignored primes than for new tones. No difference was observed between previously attended and new tones. The results are compatible with the conclusion that distractor inhibition is a necessary component of the processes that bring about observable negative priming phenomena.     

Visual and auditory accessory stimulus offset and the Simon effect

We investigated the effect on the right and left responses of the disappearance of a task-irrelevant stimulus located on the right or left side. Participants pressed a right or left response key on the basis of the color of a centrally located visual target. Visual (Experiment 1) or auditory (Experiment 2) task-irrelevant accessory stimuli appeared or disappeared at locations to the right or left of the central target. In Experiment 1, responses were faster when onset or offset of the visual accessory stimulus was spatially congruent with the response. In Experiment 2, responses were again faster when onset of the auditory accessory stimulus and the response were on the same side. However, responses were slightly slower when offset of the auditory accessory stimulus and the response were on the same side than when they were on opposite sides. These findings indicate that transient change information is crucial for a visual Simon effect, whereas sustained stimulation from an ongoing stimulus also contributes to an auditory Simon effect.     

Speech perception and vocal expression of emotion

Two experiments using identical stimuli were run to determine whether the vocal expression of emotion affects the speed with which listeners can identify emotion words. Sentences were spoken in an emotional tone of voice (Happy, Disgusted, or Petrified), or in a Neutral tone of voice. Participants made speeded lexical decisions about the word or pseudoword in sentence-final position. Critical stimuli were emotion words that were either semantically congruent or incongruent with the tone of voice of the sentence. Experiment 1, with randomised presentation of tone of voice, showed no effect of congruence or incongruence. Experiment 2, with blocked presentation of tone of voice, did show such effects: Reaction times for congruent trials were faster than those for baseline trials and incongruent trials. Results are discussed in terms of expectation (e.g., Kitayama, 1990, 1991, 1996) and emotional connotation, and implications for models of word recognition are considered.     

A PRP-study to determine the locus of target priming effects

Visual stimuli that are made invisible by a following mask can nonetheless affect motor responses. To localize the origin of these target priming effects we used the psychological refractory period paradigm. Participants classified tones as high or low, and responded to the position of a visual target that was preceded by a prime. The stimulus onset asynchrony (SOA) between both tasks varied. In Experiment 1 the tone task was followed by the position task and SOA dependent target priming effects were observed. When the visual position task preceded the tone task in Experiment 2, with short SOA the priming effect propagated entirely to the tone task yielding faster responses to tones on visually congruent trials and delayed responses to tones on visually incongruent trials. Together, results suggest that target priming effects arise from processing before and at the level of the central bottleneck such as sensory analysis and response selection.     

Stimulus-response compatibility for absolute and relative spatial correspondence in reaching and in button pressing

Three experiments tested whether stimulus-response (S-R) compatibility might be a function of absolute (as opposed to relative) spatial correspondence-that is, the distance between a stimulus and the place of response. Experiment 1 studied reaching movements toward one of two targets in response to one of six visual stimuli. Stimulus-response pairs that shared relative position were faster than those that did not, and reaction time was faster when the stimulus and one of the potential targets were in close proximity. In Experiment 2 the same effects were found when the hands started from a different position, implicating stimulus target distance, rather than stimulus-hand distance as the critical variable. Experiment 3 employed keypress responses instead of reaches, and the distance effect was nearly absent. The implications of these results are discussed in terms of categorical (e.g. left-right) vs. quantitative (e.g. distance) S-R variables in spatial compatibility.     

Shifting visual attention and selecting motor responses: distinct attentional mechanisms.

Does shifting visual attention require the same central mechanism as that required for selecting overt motor responses? In Experiment 1, Ss performed 2 tasks: a speeded manual response to a tone and an unspeeded report of a cued target letter in a brief masked array. Stimulus onset asynchrony (SOA) between tone and array was varied. If the attention shift to the target was delayed by the first task, then there should be more second-task errors at short SOAs and on trials with slow first-task responses. In fact, SOA effects and dependencies were minimal. Results were unchanged in further experiments in which the relation between cue and target was symbolic, spatially "unnatural," or based on the color of the target. Two additional experiments validated key assumptions of the method. The results confirm that although selection of motor responses constitutes a processing bottleneck, the control of visual attention operates independently of this bottleneck.     

Contextual dependencies in predictive learning

Two experiments assessed contextual dependencies in a predictive-learning task. Subjects learned to associate each of four pictorial stimuli with the occurrence or non-occurrence of a specific outcome. Each of these stimuli, the intentional stimuli, was presented against one of two different visual (Experiment 1) or auditory (Experiment 2) context stimuli. These context stimuli were incidental: subjects were not explicitly instructed to pay any attention to them and each of them in isolation was not predictive of the outcome. During acquisition and testing, subjects expressed the expected relationship between intentional stimulus and outcome by an appropriate key press. At test, intentional stimuli were presented either with the same contextual stimulus as also present during acquisition (same trials), or with the other one (switched trials). The response latency was slower on switched trials than on same trials in each experiment, a result extending previous findings on the effect of environmental contextual stimuli on task performance. Results are discussed in the framework of contextual occasion setting and habituation to contextual stimuli.     

Contextual dependencies in predictive learning

Two experiments assessed contextual dependencies in a predictive-learning task. Subjects learned to associate each of four pictorial stimuli with the occurrence or non-occurrence of a specific outcome. Each of these stimuli, the intentional stimuli, was presented against one of two different visual (Experiment 1) or auditory (Experiment 2) context stimuli. These context stimuli were incidental: subjects were not explicitly instructed to pay any attention to them and each of them in isolation was not predictive of the outcome. During acquisition and testing, subjects expressed the expected relationship between intentional stimulus and outcome by an appropriate key press. At test, intentional stimuli were presented either with the same contextual stimulus as also present during acquisition (same trials), or with the other one (switched trials). The response latency was slower on switched trials than on same trials in each experiment, a result extending previous findings on the effect of environmental contextual stimuli on task performance. Results are discussed in the framework of contextual occasion setting and habituation to contextual stimuli.     

Reversibility of single-incentive selective associations.

Rats were trained to press a lever in the presence of a tone-light compound stimulus and not to press in its absence. In each of two experiments, schedules were designed to make the compound a conditioned punisher for one group and a conditioned reinforcer for the other. In Experiment 1, one group's responding produced food in the presence of the compound but not in its absence. The other group's responding terminated the compound stimulus, and food was presented only in its absence. When tone and light were later presented separately, light controlled more responding than did tone in the former group, but tone gained substantial control in the latter. The same effects were also observed within subjects when the training schedules were switched over groups. In Experiment 2, two groups avoided shock in the presence of the compound stimulus. In the absence of the compound, one group was not shocked, and the other received both response-independent and response-produced shock. When tone and light were presented separately, the former group's responding was mainly controlled by tone, but the latter group's responding was almost exclusively controlled by light. These effects were also observed within subjects when the training schedules were switched over groups. Thus, these single-incentive selective association effects (appetitive in Experiment 1 and aversive in Experiment 2) were completely reversible. The schedules in which the compound should have been a conditioned reinforcer consistently produced visual control, and auditory control increased when the compound should have become a conditioned punisher. Currently accepted accounts of selective associations based on affinities between shock and auditory stimuli and between food and visual stimuli (i.e., stimulus-reinforcer interactions) do not adequately address these results. The contingencies of reinforcement most recently associated with the compound and with its absence, rather than the nature of the reinforcer, determined whether auditory or visual stimulus control developed.     

Flowers and spiders in spatial stimulus-response compatibility: does affective valence influence selection of task-sets or selection of responses?

The present study examined the effect of stimulus valence on two levels of selection in the cognitive system, selection of a task-set and selection of a response. In the first experiment, participants performed a spatial compatibility task (pressing left and right keys according to the locations of stimuli) in which stimulus-response mappings were determined by stimulus valence. There was a standard spatial stimulus-response compatibility (SRC) effect for positive stimuli (flowers) and a reversed SRC effect for negative stimuli (spiders), but the same data could be interpreted as showing faster responses when positive and negative stimuli were assigned to compatible and incompatible mappings, respectively, than when the assignment was opposite. Experiment 2 disentangled these interpretations, showing that valence did not influence a spatial SRC effect (Simon effect) when task-set retrieval was unnecessary. Experiments 3 and 4 replaced keypress responses with joystick deflections that afforded approach/avoidance action coding. Stimulus valence modulated the Simon effect (but did not reverse it) when the valence was task-relevant (Experiment 3) as well as when it was task-irrelevant (Experiment 4). Therefore, stimulus valence influences task-set selection and response selection, but the influence on the latter is limited to conditions where responses afford approach/avoidance action coding.