Cross-modal compatibility effects with visual-spatial and auditory-verbal stimulus and response sets

Within the visual-spatial and auditory-verbal modalities, reaction times to a stimulus have been shown to be faster if salient features of the stimulus and response sets correspond than if they do not. Accounts that attribute such stimulus-response compatibility effects to general translation processes predict that similar effects should occur for cross-modal stimulus and response sets. To test this prediction, three experiments were conducted examining four-choice reactions with (I) visual spatial-location stimuli assigned to speech responses, (2) speech stimuli assigned to keypress responses, and (3) symbolic visual stimuli assigned to speech responses. In all the experiments, responses were faster when correpondence between salient features of the stimulus and response sets was maintained, demonstrating that similar principles of translation operate both within and across modalities.     

Categorizing sounds by pitch: effects of stimulus similarity and response repetition

Two experiments were performed to determine whether categorization of the pitch of a probe tone is influenced by the pitch of, and response made to, a preceding prime tone. The prime and the probe could be drawn either from a pool of low-frequency sounds or from a pool of high-frequency sounds. The results of both experiments indicated that the performance obtained was best when the prime and the probe were the same pitch (and therefore required the same response), intermediate when the two sounds differed in pitch and required different responses, and slowest when the prime and the probe differed in pitch but required the same response (i.e., they were drawn from the same frequency pool). The results of Experiment 2 revealed in addition that when a repeated response was required, performance declined as the magnitude of the frequency change increased and that responses were made more quickly and accurately if the direction of the frequency change was away from the alternative category than if it was toward the alternative category. The results demonstrate that categorization of sounds by pitch is accomplished with reference to a previous processing episode.     

Emergent stimulus relations depend on stimulus correlation and not on reinforcement contingencies

We aimed to investigate whether novel stimulus relations would emerge from stimulus correlations when those relations explicitly conflicted with reinforced relations. In a symbolic matching-to-sample task using kanji characters as stimuli, we arranged class-specific incorrect comparison stimuli in each of three classes. After presenting either Ax or Cx stimuli as samples, choices of Bx were reinforced and choices of Gx or Hx were not. Tests for symmetry, and combined symmetry and transitivity, showed the emergence of three 3-member (AxBxCx) stimulus classes in 5 of 5 human participants. Subsequent tests for all possible emergent relations between Ax, Bx, Cx and the class-specific incorrect comparisons Gx and Hx showed that these relations emerged for 4 of 5 the participants after extended overtraining of the baseline relations. These emergent relations must have been based on stimulus-stimulus correlations, and were not properties of the trained discriminated operants, because they required control by relations explicitly extinguished during training. This result supports theoretical accounts of emergent relations that emphasize stimulus correlation over operant contingencies.     

Target sparing effects in the attentional blink depend on type of stimulus

In a typical attentional blink (AB) experiment, recognition of the second of two serially presented targets is impaired if it occurs around 200-500 ms after the first. However, recognition for the second item is often intact if the two targets occur consecutively (lag-1 sparing). Recent theories of the AB have placed great emphasis on the presence of lag-1 sparing and protracted sparing effects, where accurate performance is seemingly maintained across three or more targets, provided that they are presented consecutively. Here, we show that the type of stimulus (objects vs. letters) used in rapid serial visual presentation streams has a significant effect on the extent of lag-1 sparing, without a commensurate influence on the AB. In addition, multiple consecutive targets produce strikingly different patterns of sparing for objects and letters. These findings suggest that the processes mediating lag-1 sparing are independent of those underlying the AB.     

Compatibility effects based on stimulus and response numerosity

Four choice reaction time experiments documented a stimulus-response (S-R) compatibility effect involving the numbers of stimuli and responses. In Experiment 1, the stimulus consisted of one or two tones, and the correct response was either one or two taps of a response key. Responses were much faster with a compatible S-R assignment, in which the number of taps matched the number of tones, than with an incompatible assignment in which these numbers mismatched. Experiments 2 and 3 replicated this effect, using visual stimuli and bimodal stimuli, respectively, suggesting that auditory/manual rhythmic compatibility is not essential to it. Experiment 4 showed that an analogous but smaller effect is obtained when stimuli are the digits 1 and 2. This new numerosity-based compatibility effect has general theoretical implications regarding the mechanisms responsible for compatibility effects and practical implications for interface design.     

The influence of irrelevant stimulus changes on stimulus and response repetition effects

In this study the influence of irrelevant stimulus changes from one trial to another in a serial reaction time task was investigated. Two experiments were performed in which subjects were required to respond to stimulus colour. Four colours were mapped on two response keys, so that colour and response repetition effects could be dissociated. In Experiment 1, the irrelevant stimulus dimension was location and in Experiment 2 it was shape. Both experiments were performed with a short and a long response-stimulus interval (RSI)-condition. In both experiments, the irrelevant dimension influenced the response repetition effect but not the colour repetition effect. In the reaction times, a response alternation effect was observed only when the irrelevant location of the stimulus changed in the long RSI-condition. The error rates showed a response alternation benefit for both irrelevant dimensions, in the short and the long RSI-condition. The benefit for response alternations is explained in terms of a response bias towards change that is triggered by a changing stimulus feature. We assume that the response bias is stronger for location than for colour and that accuracy is more sensitive to this bias than response latencies.     

Effects of stimulus probability and visual similarity on stimulus encoding

Visual similarity, stimulus probability, and stimulus contrast were manipulated in two memory-scanning experiments to determine how stimulus probability affects encoding. Two hypotheses were tested: The first, a featural facilitation hypothesis, localizes the effect of stimulus probability on feature extraction; the second claims that stimulus probability has its effect on stimulus recognition. In both experiments, visual similarity was found to slow encoding, particularly under low-contrast conditions. This effect was larger for low probability stimuli than for high probability stimuli and increased as the difference in probability between two visually similar stimuli increased. These results are inconsistent with the featural facilitation hypothesis, but can be explained in terms of differential priming of internal recognition responses for members of the stimulus set, such that more probable members are more easily recognized.     

Simon congruency effects based on stimulus and response numerosity

Three choice reaction time experiments documented a Simon-type congruence effect involving the numbers of stimuli and responses. In Experiment 1 the stimulus consisted of one or two high- or low-pitch tones, and participants were required to respond with one or two taps of a response key depending on stimulus pitch. Responses were faster when the number of tones matched the required number of response taps than when these numbers mismatched. Experiment 2 showed that a weaker version of this effect can also be obtained using visual stimuli, and Experiment 3 showed that the analogous effect can even be obtained, albeit very weakly, with bimodal stimuli. There was also evidence that the number of stimuli affected the rate of emitting the two-tap response. These results indicate that stimulus numerosity is processed automatically to the level at which it can affect the selection and possibly the execution of a varying number of responses.     

Probability effects on stimulus evaluation and response processes.

This study investigated the effects of probability information on response preparation and stimulus evaluation. Eight subjects responded with one hand to the target letter H and with the other to the target letter S. The target letter was surrounded by noise letters that were either the same as or different from the target letter. In 2 conditions, the targets were preceded by a warning stimulus unrelated to the target letter. In 2 other conditions, a warning letter predicted that the same letter or the opposite letter would appear as the imperative stimulus with .80 probability. Correct reaction times were faster and error rates were lower when imperative stimuli confirmed the predictions of the warning stimulus. Probability information affected (a) the preparation of motor responses during the foreperiod, (b) the development of expectancies for a particular target letter, and (c) a process sensitive to the identities of letter stimuli but not to their locations.     

Simon congruency effects based on stimulus and response numerosity

Three choice reaction time experiments documented a Simon-type congruence effect involving the numbers of stimuli and responses. In Experiment 1 the stimulus consisted of one or two high- or low-pitch tones, and participants were required to respond with one or two taps of a response key depending on stimulus pitch. Responses were faster when the number of tones matched the required number of response taps than when these numbers mismatched. Experiment 2 showed that a weaker version of this effect can also be obtained using visual stimuli, and Experiment 3 showed that the analogous effect can even be obtained, albeit very weakly, with bimodal stimuli. There was also evidence that the number of stimuli affected the rate of emitting the two-tap response. These results indicate that stimulus numerosity is processed automatically to the level at which it can affect the selection and possibly the execution of a varying number of responses.     

Modality effects in rhythm processing: Auditory encoding of visual rhythms is neither obligatory nor automatic

Modality effects in rhythm processing were examined using a tempo judgment paradigm, in which participants made speeding-up or slowing-down judgments for auditory and visual sequences. A key element of stimulus construction was that the expected pattern of tempo judgments for critical test stimuli depended on a beat-based encoding of the sequence. A model-based measure of degree of beat-based encoding computed from the pattern of tempo judgments revealed greater beat sensitivity for auditory rhythms than for visual rhythms. Visual rhythms with prior auditory exposure were more likely to show a pattern of tempo judgments similar to that for auditory rhythms than were visual rhythms without prior auditory exposure, but only for a beat period of 600 msec. Slowing down the rhythms eliminated the effect of prior auditory exposure on visual rhythm processing. Taken together, the findings in this study support the view that auditory rhythms demonstrate an advantage over visual rhythms in beat-based encoding and that the auditory encoding of visual rhythms can be facilitated with prior auditory exposure, but only within a limited temporal range. The broad conclusion from this research is that “hearing visual rhythms” is neither obligatory nor automatic, as was previously claimed by Guttman, Gilroy, and Blake (2005).     

Couple similarity on stimulus characteristics and marital satisfaction

Murstein's (1970) “stimulus–value–role” theory suggests that mate selection consists of three stages. At each stage people seek different types of information. This study extends previous research on couple similarity by focusing on the “stimulus” stage where people attend to stimulus information—the most salient personal information. This stage has received less attention than the “value” and “role” stages. A sample of 641 married couples from Central Alberta, Canada provided information on a wide range of stimulus characteristics including background, physical and perceptual variables, as well as spirituality and growth orientation for comparison. Correlation results showed evidence for strong and consistent couple similarity on stimulus characteristics, suggesting that those characteristics are important domains to partner selection. Structural equation modeling results indicated that couple similarity (measured by absolute and directional difference score) overall was not a strong predictor of marital satisfaction; however, discrepancies in age, spirituality, and growth orientation were significant predictors of dissatisfaction.     

The impact of stimulus and response variability on S-R correspondence effects

Six experiments investigated how variability on irrelevant stimulus dimensions and variability on response dimensions contribute to spatial and nonspatial stimulus-response (S-R) correspondence effects. Experiments 1-3 showed that, when stimuli varied in location and number, S-R correspondence effects for location or numerosity occurred when responses varied on these dimensions but not when responses were invariant on these dimensions. These results are consistent with the response-discrimination account, according to which S-R correspondence effects should only arise for a dimension that is used for discriminating between responses in working memory. Experiments 4-6 showed that, when responses varied in location and number, both invariant and variable stimulus number produced correspondence effects in S-R numerosity. In summary, the present results indicate that the usefulness of a particular dimension for response discrimination can be sufficient for producing S-R correspondence effects, whereas variability of a stimulus dimension is not sufficient for producing such effects.     

Exposure effects in person perception: Familiarity,similarity, and attraction

Two experiments explored the relationship between familiarity, similarity, and attraction. In the first experiment, subjects viewed photographs of faces at various exposure frequencies and then rated them for likeableness and similarity. Familiar people were regarded by the subjects as both more likeable and more similar to themselves. The effects of familiarity on perceived similarity were primarily mediated by changes in attraction, although some evidence of a direct link between familiarity and perceived similarity was also found. In the second experiment, subjects viewed the same stimuli at a single exposure frequency, and received bogus information regarding the similarity of the people shown therein. Subsequent ratings of likeableness and perceived familiarity revealed that people who seemed similar to the subjects were regarded as both more likeable and more familiar. The effects of similarity on perceived familiarity were almost entirely mediated by changes in attraction. Some of the theoretical implications of these findings are discussed.