Audiovisual tau effect

This study investigated how spatial intervals between successive visual flashes are influenced by the temporal intervals between auditory pure tones presented concurrently with the flashes. Three successive visual flashes defined two spatial intervals with different extents as well as two equal temporal intervals. The onsets of the first and third tones were temporally aligned with those of the first and third flashes, while the onset of the second tone was temporally offset to that of the second visual flash, resulting in shorter or longer temporal intervals between pairs of tones. Observers judged which of the first or second spatial intervals between flashes was shorter. The results showed that the shorter temporal interval between tones caused underestimation of the spatial interval between flashes. On the other hand, stimuli without the first and third tones did not result in underestimation of spatial intervals between flashes. These results indicate an audiovisual tau effect, which is triggered by a constant velocity assumption applied to moving objects defined by more than one modality.     

Interference in pitch memory as a function of ear or input

An experiment was conducted to investigate the effect of spatial separation on interference effects in pitch memory. Subjects compared the pitches of two tones that were separated by a sequence of eight interpolated tones. It was found that error rates were lower in sequences where the test and interpolated tones were presented to different ears, compared with sequences where they were presented to the same ear; however, this effect of spatial separation was not large. It is concluded that differences in spatial location can enable the focussing of attention away from the irrelevant tones and so reduce their disruptive effect, but that this occurs only to a limited extent.     

Sequential effects in rudimentary auditory and visual tasks

Three experiments examined sequential effects in choice reaction time tasks. On each trial, a right/left positional judgment was made to a either a pure tone or a luminance increment in a visual array of box elements. In the first two experiments, a preparatory signal was presented prior to each imperative signal to indicate the relevant stimulus modality. At a short stimulus onset asynchrony (SOA) between the preparatory and the imperative signal (i.e., 60 msec), subjects were quicker to repeat the same response than to change their response when presented with successive tones, although no such repetition effect occurred on the visual target trials. Subjects were impaired if the stimulus modality changed across successive trials regardless of the modality of the target. At a longer SOA (i.e., 500 msec), these sequential effects were abolished; subjects were assumed to be able to prepare for the relevant modality because of the presentation of the preparatory signal. When the preparatory signals were omitted, in a final experiment, the modality-switching costs were still evident, but now inhibition of return occurred on both the auditory and the visual target trials-subjects were now impaired in responding when the target reappeared at its immediately previous location. It seems, therefore, that the repetition effect and modality-switching effects do dissociate. The data revealed clear differences between orienting attention to a particular spatial locale and focusing attention to a particular sensory modality.     

Selective lesions of the dentate gyrus produce disruptions in place learning for adjacent spatial locations

The hippocampus (HPP) plays a known role in learning novel spatial information. More specifically, the dentate gyrus (DG) hippocampal subregion is thought to support pattern separation, a mechanism for encoding and separating spatially similar events into distinct representations. Several studies have shown that lesions of the dorsal DG (dDG) in rodents result in inefficient spatial pattern separation for working memory; however, it is unclear whether selective dDG lesions disrupt spatial pattern separation for reference memory. Therefore, the current study investigated the role of the dDG in pattern separation using a spatial reference memory paradigm to determine whether the dDG is necessary for acquiring spatial discriminations for adjacent locations. Male Long-Evans rats were randomly assigned to receive bilateral intracranial infusions of colchicine or saline (control) into the dDG. Following recovery from surgery, each rat was pseudo-randomly assigned to an adjacent arm or separate arm condition and subsequently tested on a place-learning task using an eight-arm radial maze. Rats were trained to discriminate between a rewarded arm and a nonrewarded arm that were either adjacent to one another or separated by a distance of two arm positions. Each rat received 10 trials per day and was tested until the animal reached a criterion of nine correct choices out of 10 consecutive trials across 2 consecutive days of testing. Both groups acquired spatial discriminations for the separate condition at similar rates. However, in the adjacent condition, dDG lesioned animals required significantly more trials to reach the learning criterion than controls. The results suggest that dDG lesions decrease efficiency in pattern separation resulting in impairments in the adjacent condition involving greater overlap among the distal cues. Conversely, in the separate condition, there was less overlap among distal cues during encoding and less need for pattern separation. These findings provide further support for a critical role for the dDG in spatial pattern separation by demonstrating the importance of a processing mechanism that is capable of reducing interference among overlapping spatial inputs across a variety of memory demands.     

Time course of perceptual grouping

An investigation was made of the time course of perceptual grouping that is based on two qualitatively different spatial relationships: proximity and alignment. An index of grouping capacity was used to assess the processing time required before a backward pattern mask interfered with grouping. Stimuli consisted of bistable arrays of disjunct dots that were followed by a mask. Grouping cues, either proximity or alignment, were randomly assigned to either the horizontal or vertical orientation, and subjects indicated whether the dots appeared grouped as a series of horizontal or vertical lines. Spatial metrics of the cues were systematically altered until they no longer served as a cue for grouping, thereby determining the grouping threshold. The stimulus onset asynchrony (SOA) of the mask, relative to the test stimulus, ranged from 33.3 to 150 msec. The SOA at which grouping thresholds first became elevated identified the point at which the mask first interfered with the grouping process, thereby identifying the processing time required for grouping by the specified cue. The processing time for grouping by proximity and alignment differed significantly, requiring means of 87.6 and 118.8 msec, respectively, for processing to be completed. These measurements serve to identify the processing time necessary for spatially integrating stimulus elements into unified forms, thereby delineating temporal constraints at this stage of visual processing.     

Non-musicians also have a piano in the head: evidence for spatial–musical associations from line bisection tracking

The spatial representation of ordinal sequences (numbers, time, tones) seems to be a fundamental cognitive property. While an automatic association between horizontal space and pitch height (left-low pitch, right-high pitch) is constantly reported in musicians, the evidence for such an association in non-musicians is mixed. In this study, 20 non-musicians performed a line bisection task while listening to irrelevant high- and low-pitched tones and white noise (control condition). While pitch height had no influence on the final bisection point, participants’ movement trajectories showed systematic biases: When approaching the line and touching the line for the first time (initial bisection point), the mouse cursor was directed more rightward for high-pitched tones compared to low-pitched tones and noise. These results show that non-musicians also have a subtle but nevertheless automatic association between pitch height and the horizontal space. This suggests that spatial–musical associations do not necessarily depend on constant sensorimotor experiences (as it is the case for musicians) but rather reflect the seemingly inescapable tendency to represent ordinal information on a horizontal line.     

Auditory temporal order and perceived fusion-nonfusion

A pair of pure-tone sine waves, with the first tone presented randomly to either ear, was presented simultaneously or sequentially. The order of occurrence of the tones (temporal order) and the number of tones perceived (fusion-nonfusion) were judged. Three values of stimulus intensity (40, 55, and 70 dB SPL) and 10 values of stimulus onset asynchrony (SOA; 0, 1, 2, and 4 to 28 msec in 4-msec steps) were varied. Of major importance in this investigation was the relationship between the judgmental tasks of temporal order and fusion-nonfusion. Response time and accuracy were the dependent measures used to assess that relationship. The results of two groups of 10 subjects showed an increase in the percentage of correct nonfusion judgments with increases in stimulus intensity and SOA. For correct judgments of temporal order, no significant intensity or SOA effects were noted. Response time for the fusion-nonfusion task was significantly influenced by both stimulus intensity and SOA. For the response times associated with the temporal order task, intensity was significant. More important to this investigation was the observed Intensity by SOA by Task interaction for response time data. These results suggest a hybrid model, with different processes occurring within different stages of this model.     

Cumulation of the tendency to segregate auditory streams: Resetting by changes in location and loudness

In four experiments, the accumulation, over time, of a tendency to hear separate high and low streams in a sequence of high (H) and low (L) tones, presented in a galloping rhythm (HLH-HLH-…), was studied. Each trial was composed of two parts, an induction sequence, then a test sequence, with no break between them. The test sequence was always heard at the far left. When the induction sequence and the test sequence were identical, the presence of the induction sequence increased the tendency for the test sequence to split into two streams. However, when the sequences differed in location (cued by differences in interaural timing or intensity over headphones and by loudspeaker placement in a free field) or when they differed in loudness, the accumulation of the segregative tendency was reset, and the test sequence sounded more integrated. When the induction sequence changed in location or loudness in gradual steps toward the value of the test sequence, resetting was much less. It appears that the accumulation of information about streams in different frequency regions is sensitive to sudden changes in parameters, even when they affect the frequency regions equally. This prevents the system from accumulating data across unrelated events.     

Time course of chord priming

The time course of chord priming was explored in four experiments. In chord priming, a chord (a typical combination of simultaneously sounded tones) primes other chords that are musically related. In the present study, the prime duration and the stimulus onset asynchrony (SOA) between the prime chord and the chord to be judged were varied. Priming occurred at an SOA and prime duration as short as 50 msec, the shortest tested. When the prime duration was held constant at 50 msec, priming occurred at an SOA as long as 2,500 msec, the longest tested, and the magnitude of the priming effect did not diminish. To eliminate a possible role of sensory memory in maintaining the priming effect during the silence following the prime, a 250-msec noise mask was presented immediately following the 50-msec prime. The interpolated noise mask did not eliminate priming, thereby supporting the view that chord priming is the consequence of associative activation.     

Time course of chord priming.

The time course of chord priming was explored in four experiments. In chord priming, a chord (a typical combination of simultaneously sounded tones) primes other chords that are musically related. In the present study, the prime duration and the stimulus onset asynchrony (SOA) between the prime chord and the chord to be judged were varied. Priming occurred at an SOA and prime duration as short as 50 msec, the shortest tested. When the prime duration was held constant at 50 msec, priming occurred at an SOA as long as 2,500 msec, the longest tested, and the magnitude of the priming effect did not diminish. To eliminate a possible role of sensory memory in maintaining the priming effect during the silence following the prime, a 250-msec noise mask was presented immediately following the 50-msec prime. The interpolated noise mask did not eliminate priming, thereby supporting the view that chord priming is the consequence of associative activation.     

Temporal ordering deficits following anterior temporal lobectomy

Subjects were required to report the pitch sequence of two 10-msec tones of different frequency presented monaurally while the stimulus onset asynchrony (SOA) between the two tones was varied. The value of the SOA at which the subjects achieved an 80% correct sequence report was determined by an adaptive procedure without feedback. This measure was compared in the right and left ears, on subjects with a right or left anterior temporal lobectomy and on a normal control group. The results reveal an elevated threshold for performing temporal order judgments in the ear contralateral to the surgical lesion.     

Location specificity in response selection processes for visual stimuli

We used the psychological refractory period paradigm, in which participants respond to two successive tasks (T1 and T2). We created in T2 spatial and color Simon effects, known to be caused by response selection processes. Previous studies in which the spatial Simon effect was manipulated in T2 showed that this effect was underadditive, with stimulus onset asynchrony (SOA) between the targets for T1 and T2. In Experiment 1, we replicated these results with two versions of the spatial Simon effect. In contrast, in Experiment 2 we manipulated two versions of a color Simon effect, revealing an additive relation between the color Simon effect and SOA. These results suggest that the underadditivity obtained with the spatial Simon effect is due to its spatial nature, and that space may play a unique role in response selection processes.     

Spatial frequency differences can determine figure-ground organization

In three experiments we examined the influence of spatial frequency on perceptual organization. In each experiment a pattern was tested that was ambiguous in terms of figure and ground. In each experiment, the stimuli were 20 variations of the pattern, which were generated by filling the two regions of the pattern with horizontal sine wave gratings differing in spatial frequency. Five spatial frequencies were tested: 0.5, 1, 2, 4, and 8 cycles per degree. The response measure was the percentage of response time one of the regions was seen as the figure. This region was seen as the figure a higher percentage of the time in those stimuli where it contained the relatively higher spatial frequency sine wave grating compared with those stimuli where it contained the relatively lower spatial frequency sine wave grating.     

Spatial grouping resolves ambiguity to drive temporal recalibration

Cross-modal temporal recalibration describes a shift in the point of subjective simultaneity (PSS) between 2 events following repeated exposure to asynchronous cross-modal inputs--the adaptors. Previous research suggested that audiovisual recalibration is insensitive to the spatial relationship between the adaptors. Here we show that audiovisual recalibration can be driven by cross-modal spatial grouping. Twelve participants adapted to alternating trains of lights and tones. Spatial position was manipulated, with alternating sequences of a light then a tone, or a tone then a light, presented on either side of fixation (e.g., left tone--left light--right tone--right light, etc.). As the events were evenly spaced in time, in the absence of spatial-based grouping it would be unclear if tones were leading or lagging lights. However, any grouping of spatially colocalized cross-modal events would result in an unambiguous sense of temporal order. We found that adapting to these stimuli caused the PSS between subsequent lights and tones to shift toward the temporal relationship implied by spatial-based grouping. These data therefore show that temporal recalibration is facilitated by spatial grouping.     

Spatial factors in visual attention: some compensatory effects of location and time of arrival of nontargets

It is well established that the identity of nontarget events may affect reaction to a target event, but that spatial separation between the two will reduce such an influence. Two experiments are reported in which an attempt was made to distinguish between two accounts of this effect. On one, some of the information about events spatially distant from the target is shut out from analysis altogether. On the other, such events are fully analysed, but either the analysis proceeds more slowly or else it starts only after a delay. In the experiments the time of arrival of, and the distance between, the target and nontarget events were systematically varied. The conventional effects of the distance of nontargets from target were greatly reduced when the target and nontarget events were asynchronous. If the nontargets arrived first, they had an effect on reaction to the target whether they were near to or far from it. If they arrived second, their identity had no effect at either separation. These results appear to rule out any simple view of attention according to which information outside the target region is denied analysis. Rather, distant nontarget events are analysed, but produce their effects at a later time than less peripheral events.     

Effects of context on auditory stream segregation

The authors examined the effect of preceding context on auditory stream segregation. Low tones (A), high tones (B), and silences (-) were presented in an ABA- pattern. Participants indicated whether they perceived 1 or 2 streams of tones. The A tone frequency was fixed, and the B tone was the same as the A tone or had 1 of 3 higher frequencies. Perception of 2 streams in the current trial increased with greater frequency separation between the A and B tones (Delta f). Larger Delta f in previous trials modified this pattern, causing less streaming in the current trial. This occurred even when listeners were asked to bias their perception toward hearing 1 stream or 2 streams. The effect of previous Delta f was not due to response bias because simply perceiving 2 streams in the previous trial did not cause less streaming in the current trial. Finally, the effect of previous ?f was diminished, though still present, when the silent duration between trials was increased to 5.76 s. The time course of this context effect on streaming implicates the involvement of auditory sensory memory or neural adaptation.     

Temporal discrimination of recycled tonal sequences: Pattern matching and naming of order by untrained listeners

Sets of recycled sequences of four successive tones were presented in all six possible orders to untrained listeners. For pitches within the musical range, recognition (as measured by matching of any unknown order with an array of permuted orders of the same tones) could be accomplished as readily for tonal durations and frequency separations outside the limits employed for melodic construction as inside these limits. Identifying or naming of relative pitches of successive tones was considerably more difficult than matching for these tonal sequences, and appeared to follow different rules based upon duration and upon frequency separation. Use of frequencies above the pitch limits for music (4,500 Hz and above) resulted in poor performance both for matching and naming of order. Introduction of short silent intervals between items was without effect for both tasks. Naming of order and pattern recognition appear to reflect different basic processes, in agreement with earlier formulations based on experiments with phonemic sequences of speech and sequences of unrelated sounds (hisses, tones, buzzes). Special characteristics of tonal sequences are discussed, and some speculations concerning music are offered.     

Stimulus-dependent modulation of perceptual and motor learning in a serial reaction time task

In two experiments, we investigated the impact of spatial attributes on the representation acquired during a serial reaction time task. Two sequences were used, in which structural regularities occurred either in the horizontal or in the vertical locations of successive stimuli. After training with the dominant hand, participants were required to respond with the non-dominant hand to either the original sequence or to a mirror-ordered version of the original sequence that required finger movements homologous to those used during training. We observed that a difference in reaction times between the two transfer conditions was smaller in the vertical sequence than in the horizontal sequence. This pattern of results was independent of whether three fingers (Experiment 1) were used or only one finger (Experiment 2) was used for responding. This result suggests that perceptual and motor learning mechanisms may be weighted differently depending on the context in which the stimulus is presented.     

Auditory spatial alternation transforms auditory time (again): Comments on Lakatos (1993), “Temporal constraints on apparent motion in auditory space”

Lakatos (1993) reported interesting data that indeed support “the hypothesis that the extent of spatial separation between successive sound events directly affects the perception of time intervals between these events” (p. 139). The present comment is an attempt to show that, as far as the horizontal plane is concerned, Lakatos’s hypothesis was already answered qualitatively by Axelrod and coworkers (Axelrod & Guzy, 1968; Axelrod, Guzy, & Diamond, 1968) in their studies of attention shifting, and by ten Hoopen and coworkers, who quantified the amount of “interaural time dilation” (Akerboom, ten Hoopen, Olierook, & van der Schaaf, 1983; ten Hoopen, 1982; ten Hoopen, Vos, & Dispa, 1982). Nonetheless, Lakatos’s study is very worthwhile. It originated from the realm of “apparent motion paradigms,” but I will argue that the study rather used an “auditory streaming paradigm,” and that the data is a welcome contribution to elucidate how the perceptual processes of auditory stream formation and interaural time dilation interact.     

Infants’ auditory enumeration: Evidence for analog magnitudes in the small number range

Vigorous debate surrounds the issue of whether infants use different representational mechanisms to discriminate small and large numbers. We report evidence for ratio-dependent performance in infants’ discrimination of small numbers of auditory events, suggesting that infants can use analog magnitudes to represent small values, at least in the auditory domain. Seven-month-old infants in the present study reliably discriminated two from four tones (a 1:2 ratio) in Experiment 1, when melodic and continuous temporal properties of the sequences were controlled, but failed to discriminate two from three tones (a 2:3 ratio) under the same conditions in Experiment 2. A third experiment ruled out the possibility that infants in Experiment 1 were responding to greater melodic variety in the four-tone sequences. The discrimination function obtained here is the same as that found for infants’ discrimination of large numbers of visual and auditory items at a similar age, as well as for that obtained for similar-aged infants’ duration discriminations, and thus adds to a growing body of evidence suggesting that human infants may share with adults and nonhuman animals a mechanism for representing quantities as “noisy” mental magnitudes.