Influence of auditory and audiovisual stimuli on the right–left prevalence effect

When auditory stimuli are used in two-dimensional spatial compatibility tasks, where the stimulus and response configurations vary along the horizontal and vertical dimensions simultaneously, a right–left prevalence effect occurs in which horizontal compatibility dominates over vertical compatibility. The right–left prevalence effects obtained with auditory stimuli are typically larger than that obtained with visual stimuli even though less attention should be demanded from the horizontal dimension in auditory processing. In the present study, we examined whether auditory or visual dominance occurs when the two-dimensional stimuli are audiovisual, as well as whether there will be cross-modal facilitation of response selection for the horizontal and vertical dimensions. We also examined whether there is an additional benefit of adding a pitch dimension to the auditory stimulus to facilitate vertical coding through use of the spatial-musical association of response codes (SMARC) effect, where pitch is coded in terms of height in space. In Experiment 1, we found a larger right–left prevalence effect for unimodal auditory than visual stimuli. Neutral, non-pitch coded, audiovisual stimuli did not result in cross-modal facilitation, but did show evidence of visual dominance. The right–left prevalence effect was eliminated in the presence of SMARC audiovisual stimuli, but the effect influenced horizontal rather than vertical coding. Experiment 2 showed that the influence of the pitch dimension was not in terms of influencing response selection on a trial-to-trial basis, but in terms of altering the salience of the task environment. Taken together, these findings indicate that in the absence of salient vertical cues, auditory and audiovisual stimuli tend to be coded along the horizontal dimension and vision tends to dominate audition in this two-dimensional spatial stimulus–response task.     

The representation of pitch in auditory imagery: Evidence from S-R compatibility and distance effects

In three experiments we explored the nature of representations constructed during the perception and imagination of pitch. We employed a same–different task to eliminate the influence of nonauditory information and to minimise use of cognitive strategies on auditory imagery. A reference tone of frequency 1000, 1500, or 2000 Hz, or an imagined tone of a pitch indicated by a visual cue, was followed by a comparison tone (1000, 1500, or 2000 Hz) to which either a speeded same or different response was required. In separate experiments, same–different judgements were mapped to vertically (Experiments 1 and 2) and horizontally arranged responses (Experiment 3). Judgements of tones closer in pitch yielded longer reaction times and higher error rates than more distant tones, indicating a pitch distance effect for perceptual and imagery tasks alike. In addition, in the imagery task, same–different responses were faster when low-pitched tones demanded a bottom or left key response and high-pitched tones a top or right response than vice versa, suggesting that pitch is coded spatially. Together, these behavioural effects support the assumption that both perceived and imagined pitch are translated into an analogical representation in the spatial domain.     

Musical space synesthesia: Automatic,explicit and conceptual connections between musical stimuli and space

In musical–space synesthesia, musical pitches are perceived as having a spatially defined array. Previous studies showed that symbolic inducers (e.g., numbers, months) can modulate response according to the inducer’s relative position on the synesthetic spatial form. In the current study we tested two musical–space synesthetes and a group of matched controls on three different tasks: musical–space mapping, spatial cue detection and a spatial Stroop-like task. In the free mapping task, both synesthetes exhibited a diagonal organization of musical pitch tones rising from bottom left to the top right. This organization was found to be consistent over time. In the subsequent tasks, synesthetes were asked to ignore an auditory or visually presented musical pitch (irrelevant information) and respond to a visual target (i.e., an asterisk) on the screen (relevant information). Compatibility between musical pitch and the target’s spatial location was manipulated to be compatible or incompatible with the synesthetes’ spatial representations. In the spatial cue detection task participants had to press the space key immediately upon detecting the target. In the Stroop-like task, they had to reach the target by using a mouse cursor. In both tasks, synesthetes’ performance was modulated by the compatibility between irrelevant and relevant spatial information. Specifically, the target’s spatial location conflicted with the spatial information triggered by the irrelevant musical stimulus. These results reveal that for musical–space synesthetes, musical information automatically orients attention according to their specific spatial musical-forms. The present study demonstrates the genuineness of musical–space synesthesia by revealing its two hallmarks—automaticity and consistency. In addition, our results challenge previous findings regarding an implicit vertical representation for pitch tones in non-synesthete musicians.     

Interference in immediate spatial memory

It has been suggested that maintenance in visuospatial immediate memory involves implicit motor processes that are analogous to the articulatory loop in verbal memory. An alternative account, which is explored here, is that maintenance is based on shifts of spatial attention. In four experiments, subjects recalled spatial memory span items after an interval, and in a fifth experiment, digit span was recalled after an interval. The tasks carried out during the interval included touching visual targets, repeating heard words, listening to tones from spatially sepa-rated locations, pointing to these tones, pointing to visual targets, and categorizing spatial tar-gets as being from the left or right. Spatial span recall was impaired if subjects saw visual tar-gets or heard tones, and this impairment was increased if either a motor response or a categorical response was made. Repeating words heard in different spatial locations did not impair recall, but reading visually presented words did interfere. For digit span only, the tasks involving a verbal response impaired recall. The results are interpreted within a framework in which active spatial attention is involved in maintaining spatial items in order in memory, and is interfered with by any task (visual, auditory, perceptual, motor) that also makes demands on spatial attention.     

Prismatic Lenses Shift Time Perception

ABSTRACT— Previous studies have demonstrated the involvement of spatial codes in the representation of time and numbers. We took advantage of a well-known spatial modulation (prismatic adaptation) to test the hypothesis that the representation of time is spatially oriented from left to right, with smaller time intervals being represented to the left of larger time intervals. Healthy subjects performed a time-reproduction task and a time-bisection task, before and after leftward and rightward prismatic adaptation. Results showed that prismatic adaptation inducing a rightward orientation of spatial attention produced an overestimation of time intervals, whereas prismatic adaptation inducing a leftward shift of spatial attention produced an underestimation of time intervals. These findings not only confirm that temporal intervals are represented as horizontally arranged in space, but also reveal that spatial modulation of time processing most likely occurs via cuing of spatial attention, and that spatial attention can influence the spatial coding of quantity in different dimensions.     

Auditory stimulus-response compatibility: Is there a contribution of stimulus-hand correspondence?

 Simon, Hinrichs, and Craft found that when subjects responded to a tone in the left or right ear with a left or right keypress, both ear-response-location correspondence and ear-hand correspondence affected reaction time. This outcome is in contrast to results obtained for auditory and visual Simon tasks (i.e., tasks in which stimulus location is irrelevant) as well as results obtained in visual stimulus-response (S-R) compatibility studies, which show only an effect of spatial S-R correspondence. Experiment 1 was a replication of Simon et al.'s experiment in which spatial mapping and hand placement (uncrossed, crossed) were varied. The results were inconsistent with those of Simon et al., showing no ear-hand compatibility effect. Experiment 2 was a second replication with an additional condition examined in which the stimuli were visual locations. The results showed no contribution of stimulus-hand correspondence for either auditory or visual stimuli. Experiment 3 was a replication of another experiment by Simon et al. in which tone pitch was relevant and tone location irrelevant. Like Simon et al.'s data, our results showed no indication that stimulus-hand correspondence is a significant factor. Overall, our results imply that regardless of whether tone location is relevant or irrelevant, ear-response-location correspondence is the only factor that contributes to S-R compatibility in auditory two-choice reaction tasks. Received: 15 March 1999 / Accepted: 8 June 1999     

Visual-auditory interaction in speeded classification: Role of stimulus difference

An experiment examined cross-modal interference and congruence in speeded classification: Subjects had to identify compound (visual-auditory) stimuli as either low or high in spatial position (visual judgment) or low or high in pitch (auditory judgment), in 16 conditions, each of which combined one of four possible pairs of tones, varying in frequency difference, with one of four possible pairs of dots, varying in positional difference. Both classification by position and classification by pitch revealed Garner interference (poorer performance than baseline, with orthogonal variation in the irrelevant dimension) and congruence effects (better performance with congruent than with incongruent stimulus combinations), but pitch classification showed more. Furthermore, the size of the pitch difference strongly affected classification by pitch and less strongly affected classification by position, but the size of the position difference affected neither. The findings are consistent with the view that Garner interference and congruence effects are closely related, perhaps arising from a common source, and suggest that the asymmetries could depend in part on the degree of dimensional overlap between stimuli and responses.     

Space-time compatibility effects in the auditory modality

Previous research suggests that past and future temporal concepts are spatially represented from left to right along a mental line. And these concepts can both prime motor responses to left or right space and direct visual spatial attention. The present study aimed at investigating the nature of this space-time conceptual metaphor in different auditory tasks. In the first experiment, subjects categorized time-related words (past or future) that were presented binaurally. In the second experiment, subjects detected left-ear or right-ear targets following time-related words. The similar space-time compatibility effects were found in these two experiments. Our results demonstrate that the activation of temporal concepts can both prime motor responses to left or right space and influence the orientation of auditory spatial attention, suggesting that the modality of the stimulus input is unimportant for the left-right mapping of time. These results are explained by the "intermediate coding" account.     

The cognitive representation of action: Automatic integration of perceived action effects

Actions have been assumed to be cognitively represented by codes of relevant action features. Six experiments investigated whether irrelevant action features — conditioned response-contingent auditory events — are also coded and integrated into action codes. Subjects responded to visual stimuli by pressing a left- versus right-hand button or by touching a single key once versus twice. Responses produced certain action effects: tones on the left versus the right or tones of low versus high pitch. After subjects had some practice, an inducing stimulus was presented together with the reaction stimulus; this inducing stimulus shared features with the action effect of the correct or incorrect response. If action effects were integrated into action codes, inducing stimuli should activate or prime the associated response. Indeed, substantial effects of correspondence or compatibility between inducing stimuli and irrelevant action effects were found in a variety of tasks. Results are interpreted as evidence for an automatic integration of information about action effects and taken as support of an action-concept model of action-effect integration and stimulus-response compatibility.     

Rhythmic and non-rhythmic auditory precues: Multiple mechanisms mediating movement performance

Rhythmic auditory stimuli presented before a goal-directed movement have been found to improve temporal and spatial movement outcomes. However, little is known about the mechanisms mediating these benefits. The present experiment used three types of auditory stimuli to probe how improved scaling of movement parameters, temporal preparation and an external focus of attention may contribute to changes in movement performance. Three types of auditory stimuli were presented for 1200 ms before movement initiation; three metronome beats (RAS), a tone that stayed the same (tone-same), a tone that increased in pitch (tone-change) and a no sound control, were presented with and without visual feedback for a total of eight experimental conditions. The sound was presented before a visual go-signal, and participants were instructed to reach quickly and accurately to one of two targets randomly identified in left and right hemispace. Twenty-two young adults completed 24 trials per blocked condition in a counterbalanced order. Movements were captured with an Optotrak 3D Investigator, and a 4(sound) by 2(vision) repeated measures ANOVA was used to analyze dependant variables. All auditory conditions had shorter reaction times than no sound. Tone-same and tone-change conditions had shorter movement times and higher peak velocities, with no change in trajectory variability or endpoint error. Therefore, rhythmic and non-rhythmic auditory stimuli impacted movement performance differently. Based on the pattern of results we propose multiple mechanisms impact movement planning processes when rhythmic auditory stimuli are present.     

Hemisphere differences in an auditory Stroop test

In an auditory Stroop test, right-handed subjects were required to judge the pitch of the following stimuli: two pure tones, one at a high frequency and one at a low frequency; two congruent words, “high,” sung at the high frequency, and “low,” sung at the low frequency; and two noncongruent words, “high” at low frequency and “low” at high frequency. A sequence of these stimuli was presented monaurally first to one ear, and then to the other. The Stroop effect (the difference between mean RT to congruent words, and mean RT to noncongruent words) was larger for right ear (left hemisphere) presentation. The same experiment was repeated dichotically with a competing message presented to the opposite ear. Again, the Stroop effect was larger for the right ear, and the ear differences were slightly more marked. The result is interpreted as reflecting hemispheric specialization for linguistic and nonlinguistic processing and a model of Stroop conflict in which response competition varies with the relative availability of the conflicting response.

     

An investigation of spatial representation of pitch in individuals with congenital amusia

Spatial representation of pitch plays a central role in auditory processing. However, it is unknown whether impaired auditory processing is associated with impaired pitch–space mapping. Experiment 1 examined spatial representation of pitch in individuals with congenital amusia using a stimulus–response compatibility (SRC) task. For amusic and non-amusic participants, pitch classification was faster and more accurate when correct responses involved a physical action that was spatially congruent with the pitch height of the stimulus than when it was incongruent. However, this spatial representation of pitch was not as stable in amusic individuals, revealed by slower response times when compared with control individuals. One explanation is that the SRC effect in amusics reflects a linguistic association, requiring additional time to link pitch height and spatial location. To test this possibility, Experiment 2 employed a colour-classification task. Participants judged colour while ignoring a concurrent pitch by pressing one of two response keys positioned vertically to be congruent or incongruent with the pitch. The association between pitch and space was found in both groups, with comparable response times in the two groups, suggesting that amusic individuals are only slower to respond to tasks involving explicit judgments of pitch.     

Impairment of auditory perception and language comprehension in dysphasia

Men with chronic focal brain wounds were examined for their ability to discriminate complex tones, synthesized steady-state vowels, and synthesized consonant—vowel syllables. Subjects with left hemisphere damage, but not right hemisphere damage, were impaired in their ability to respond correctly to rapidly changing acoustic stimuli, regardless of whether stimuli were verbal or nonverbal. The degree of impairment in auditory processing correlated highly with the degree of language comprehension impairment. The pattern of impairment of the group with left hemisphere damage on these perceptual tests was similar to that found in children with developmental language disorders.     

Interference with Rehearsal in Spatial Working Memory in the Absence of Eye Movements

We have previously argued that rehearsal in spatial working memory is interfered with by spatial attention shifts rather than simply by movements to locations in space (Smyth & Scholey, 1994). It is possible, however, that the stimuli intended to induce attention shifts in our experiments also induced eye movements and interfered either with an overt eye movement rehearsal strategy or with a covert one. In the first experiment reported here, subjects fixated while they maintained a sequence of spatial items in memory before recalling them in order. Fixation did not affect recall, but auditory spatial stimuli presented during the interval did decrease performance, and it was further decreased if the stimuli were categorized as coming from the right or the left. A second experiment investigated the effects of auditory spatial stimuli to which no response was ever required and found that these did not interfere with performance, indicating that it is the spatial salience of targets that leads to interference. This interference from spatial input in the absence of any overt movement of the eyes or limbs is interpreted in terms of shifts of spatial attention or spatial monitoring, which Morris (1989) has suggested affects spatial encoding and which our findings suggest also affects reactivation in rehearsal.     

Priming the mental time line

Growing experimental evidence suggests that temporal events are represented on a mental time line, spatially oriented from left to right. Support for the spatial representation of time comes mostly from studies that have used spatially organized responses. Moreover, many of these studies did not avoid possible confounds attributable to target stimuli that simultaneously convey both spatial and temporal dimensions. Here we show that task-irrelevant, lateralized visuospatial primes affect auditory duration judgments. Responses to short durations were faster when the auditory target was paired with left- than with right-sided primes, whereas responses to long durations were faster when paired with right- than with left-sided primes. Thus, when the representations of physical space and time are concurrently activated, physical space may influence time even when a lateralized, spatially encoded response is not required by the task. The time-space interaction reported here cannot be ascribed to any Spatial-Temporal Association of Response Codes effect. It supports the hypothesis that the representation of time is spatially organized, with short durations represented on the left space and longer ones on the right.     

听觉通道下负数的低水平加工引起注意的SNARC效应

采用刺激探测任务,探讨了听觉通道下负数的低水平加工能否引起注意的SNARC效应。结果表明:(1)负数的低水平加工能够产生注意的SNARC效应,即线索为绝对值小的负数时,被试对左耳目标反应更快;线索为绝对值大的负数时,被试对右耳目标反应更快。(2)负数的加工所引起听觉空间注意的转移并不依赖于负数所在的情境,而仅通过其绝对值大小与空间表征发生关联。这一结论与视觉条件下所得到的结论不一致,并支持了系统发生论假说。     

视听刺激突显性对视觉主导效应的影响

本研究使用空间任务-转换范式,控制视、听刺激的突显性,探讨自下而上注意对视觉主导效应的影响。结果表明视、听刺激突显性显著地影响视觉主导效应,实验一中当听觉刺激为高突显性时,视觉主导效应显著减弱。实验二中当听觉刺激为高突显性并且视觉刺激为低突显性时,视觉主导效应进一步减弱但依然存在。结果支持偏向竞争理论,在跨通道视听交互过程中视觉刺激更具突显性,在多感觉整合过程中更具加工优势。     

The effect of exogenous spatial attention on auditory information processing

This study investigated the effect of exogenous spatial attention on auditory information processing. In Experiments 1, 2 and 3, temporal order judgment tasks were performed to examine the effect. In Experiment 1 and 2, a cue tone was presented to either the left or right ear, followed by sequential presentation of two target tones. The subjects judged the order of presentation of the target tones. The results showed that subjects heard both tones simultaneously when the target tone, which was presented on the same side as the cue tone, was presented after the target tone on the opposite side. This indicates that spatial exogenous attention was aroused by the cue tone, and facilitated subsequent auditory information processing. Experiment 3 examined whether both cue position and frequency influence the resulting information processing. The same effect of spatial attention was observed, but the effect of attention to a certain frequency was only partially observed. In Experiment 4, a tone fusion judgment task was performed to examine whether the effect of spatial attention occurred in the initial stages of hearing. The result suggests that the effect occurred in the later stages of hearing.     

Perceptual hysteresis in the judgment of auditory pitch shift

Perceptual hysteresis can be defined as the enduring influence of the recent past on current perception. Here, hysteresis was investigated in a basic auditory task: pitch comparisons between successive tones. On each trial, listeners were presented with pairs of tones and asked to report the direction of subjective pitch shift, as either “up” or “down.” All tones were complexes known as Shepard tones (Shepard, 1964), which comprise several frequency components at octave multiples of a base frequency. The results showed that perceptual judgments were determined both by stimulus-related factors (the interval ratio between the base frequencies within a pair) and by recent context (the intervals in the two previous trials). When tones were presented in ordered sequences, for which the frequency interval between tones was varied in a progressive manner, strong hysteresis was found. In particular, ambiguous stimuli that led to equal probabilities of “up” and “down” responses within a randomized context were almost fully determined within an ordered context. Moreover, hysteresis did not act on the direction of the reported pitch shift, but rather on the perceptual representation of each tone. Thus, hysteresis could be observed within sequences in which listeners varied between “up” and “down” responses, enabling us to largely rule out confounds related to response bias. The strength of the perceptual hysteresis observed suggests that the ongoing context may have a substantial influence on fundamental aspects of auditory perception, such as how we perceive the changes in pitch between successive sounds.     

Spontaneous number discrimination of multi-format auditory stimuli in cotton-top tamarins (Saguinus oedipus)

Studies using operant training have demonstrated that laboratory animals can discriminate the number of objects or events based on either auditory or visual stimuli, as well as the integration of both auditory and visual modalities. To date, studies of spontaneous number discrimination in untrained animals have been restricted to the visual modality, leaving open the question of whether such capacities generalize to other modalities such as audition. To explore the capacity to spontaneously discriminate number based on auditory stimuli, and to assess the abstractness of the representation underlying this capacity, a habituation-discrimination procedure involving speech and pure tones was used with a colony of cotton-top tamarins. In the habituation phase, we presented subjects with either two- or three-speech syllable sequences that varied with respect to overall duration, inter-syllable duration, and pitch. In the test phase, we presented subjects with a counterbalanced order of either two- or three-tone sequences that also varied with respect to overall duration, inter-syllable duration, and pitch. The proportion of looking responses to test stimuli differing in number was significantly greater than to test stimuli consisting of the same number. Combined with earlier work, these results show that at least one non-human primate species can spontaneously discriminate number in both the visual and auditory domain, indicating that this capacity is not tied to a particular modality, and within a modality, can accommodate differences in format.