Task-irrelevant sounds influence both temporal order and apparent-motion judgments about tactile stimuli applied to crossed and uncrossed hands

It has been suggested that judgments about the temporal–spatial order of successive tactile stimuli depend on the perceived direction of apparent motion between them. Here we manipulated tactile apparent-motion percepts by presenting a brief, task-irrelevant auditory stimulus temporally in-between pairs of tactile stimuli. The tactile stimuli were applied one to each hand, with varying stimulus onset asynchronies (SOAs). Participants reported the location of the first stimulus (temporal order judgments: TOJs) while adopting both crossed and uncrossed hand postures, so we could scrutinize skin-based, anatomical, and external reference frames. With crossed hands, the sound improved TOJ performance at short (≤300 ms) and at long (>300 ms) SOAs. When the hands were uncrossed, the sound induced a decrease in TOJ performance, but only at short SOAs. A second experiment confirmed that the auditory stimulus indeed modulated tactile apparent motion perception under these conditions. Perceived apparent motion directions were more ambiguous with crossed than with uncrossed hands, probably indicating competing spatial codes in the crossed posture. However, irrespective of posture, the additional sound tended to impair potentially anatomically coded motion direction discrimination at a short SOA of 80 ms, but it significantly enhanced externally coded apparent motion perception at a long SOA of 500 ms. Anatomically coded motion signals imply incorrect TOJ responses with crossed hands, but correct responses when the hands are uncrossed; externally coded motion signals always point toward the correct TOJ response. Thus, taken together, these results suggest that apparent-motion signals are likely taken into account when tactile temporal–spatial information is reconstructed.

     

内源性空间线索有效性对视听觉整合的影响

采用内源性线索-靶子范式, 操纵线索类型(有效线索、无效线索)和靶刺激通道类型(视觉刺激、听觉刺激、视听觉刺激)两个自变量, 通过两个实验, 分别设置50%和80%两种内源性空间线索有效性来考察不同空间线索有效性条件下内源性空间注意对视听觉整合的影响。结果发现, 当线索有效性为50%时(实验1), 有效线索位置和无效线索位置的视听觉整合效应没有显著差异; 当线索有效性为80%时(实验2), 有效线索位置的视听觉整合效应显著大于无效线索位置的视听觉整合效应。结果表明, 线索有效性不同时, 内源性空间注意对视听觉整合产生了不同的影响, 高线索有效性条件下内源性空间注意能够促进视听觉整合效应。     

Does temporal contiguity moderate contingency learning in a speeded performance task?

In four experiments, we varied the time between the onset of distracting nonwords and target colour words in a word-word version of the colour-word contingency learning paradigm. Contingencies were created by pairing a distractor nonword more often with one target colour word than with other colour words. A contingency effect corresponds to faster responses to the target colour word on high-contingency trials (i.e., distractor nonword followed by the target colour word with which it appears most often) than on low-contingency trials (i.e., distractor nonword followed by a target colour word with which it appears only occasionally). Roughly equivalent-sized contingency effects were found at stimulus-onset asynchronies (SOAs) of 50, 250, and 450?ms in Experiment 1, and 50, 500, and 1,000?ms in Experiment 2. In Experiment 3, a contingency effect was observed at SOAs of -50, -200, and -350?ms. In Experiment 4, interstimulus interval (ISI) was varied along with SOA, and learning was equivalent for 200-, 700-, and 1,200-ms SOAs. Together, these experiments suggest that the distracting stimulus does not need to be presented in close temporal contiguity with the response to induce learning. Relations to past research on causal judgement and implications for further contingency learning research are discussed.     

Spatial and temporal factors determine auditory-visual interactions in human saccadic eye movements

In this paper, we show that human saccadic eye movements toward a visual target are generated with a reduced latency when this target is spatially and temporally aligned with an irrelevant auditory nontarget. This effect gradually disappears if the temporal and/or spatial alignment of the visual and auditory stimuli are changed. When subjects are able to accurately localize the auditory stimulus in two dimensions, the spatial dependence of the reduction in latency depends on the actual radial distance between the auditory and the visual stimulus. If, however, only the azimuth of the sound source can be determined by the subjects, the horizontal target separation determines the strength of the interaction. Neither saccade accuracy nor saccade kinematics were affected in these paradigms. We propose that, in addition to an aspecific warning signal, the reduction of saccadic latency is due to interactions that take place at a multimodal stage of saccade programming, where theperceived positions of visual and auditory stimuli are represented in a common frame of reference. This hypothesis is in agreement with our finding that the saccades often are initially directed to the average position of the visual and the auditory target, provided that their spatial separation is not too large. Striking similarities with electrophysiological findings on multisensory interactions in the deep layers of the midbrain superior colliculus are discussed.     

On the role of eye movements and saccade preparation in generating auditory inhibition of return.

In three experiments, listeners were required to either localize or identify the second of two successive sounds. The first sound (the cue) and the second sound (the target) could originate from either the same or different locations, and the interval between the onsets of the two sounds (Stimulus Onset Asynchrony, SOA) was varied. Sounds were presented out of visual range at 135 azimuth left or right. In Experiment 1, localization responses were made more quickly at 100 ms SOA when the target sounded from the same location as the cue (i.e., a facilitative effect), and at 700 ms SOA when the target and cue sounded from different locations (i.e., an inhibitory effect). In Experiments 2 and 3, listeners were required to monitor visual information presented directly in front of them at the same time as the auditory cue and target were presented behind them. These two experiments differed in that in order to perform the visual task accurately in Experiment 3, eye movements to visual stimuli were required. In both experiments, a transition from facilitation at a brief SOA to inhibition at a longer SOA was observed for the auditory task. Taken together these results suggest that location-based auditory IOR is not dependent on either eye movements or saccade programming to sound locations.     

Does temporal contiguity moderate contingency learning in a speeded performance task?

In four experiments, we varied the time between the onset of distracting nonwords and target colour words in a word–word version of the colour–word contingency learning paradigm. Contingencies were created by pairing a distractor nonword more often with one target colour word than with other colour words. A contingency effect corresponds to faster responses to the target colour word on high-contingency trials (i.e., distractor nonword followed by the target colour word with which it appears most often) than on low-contingency trials (i.e., distractor nonword followed by a target colour word with which it appears only occasionally). Roughly equivalent-sized contingency effects were found at stimulus-onset asynchronies (SOAs) of 50, 250, and 450 ms in Experiment 1, and 50, 500, and 1,000 ms in Experiment 2. In Experiment 3, a contingency effect was observed at SOAs of –50, –200, and –350 ms. In Experiment 4, interstimulus interval (ISI) was varied along with SOA, and learning was equivalent for 200-, 700-, and 1,200-ms SOAs. Together, these experiments suggest that the distracting stimulus does not need to be presented in close temporal contiguity with the response to induce learning. Relations to past research on causal judgement and implications for further contingency learning research are discussed.     

Direction of association between targets in a RSVP task influences priming at very short but not long SOAs

When two targets are presented using rapid serial visual presentation (RSVP) and the interval between the targets is 200–500 ms, detection or identification of the second target is impaired. This impairment in second target report is known as the attentional blink (AB). This study sought to examine the impact of the direction of target association on priming during an AB task using very short and long SOAs. Two experiments were conducted using dual-stream RSVP tasks and targets that either shared an associative relationship or were unrelated to one another. The direction of association between the targets was also varied so that associatively related targets were presented in the forward (strongest association from target 1 to target 2) or backward directions of association (strongest association from target 2 to target 1). In Experiment 1 very short SOAs between targets (27–213 ms) were used. Priming was evident at the same SOAs for both targets presented in the backward direction of association. However, for targets presented in the forward direction of association, priming occurred for target 1 and target 2 at different SOAs. Experiment 2 used longer SOAs between targets (107 to 535 ms) and it was determined that while direction of association between the targets did not affect priming, there was a larger priming effect for target 2 than for target 1. The results of the two experiments indicate that direction of association between targets influences priming in RSVP tasks that use very short but not long SOAs. The results are discussed in relation to the two-stage response competition model of Potter et al. (J Exp Psychol Hum Percept Perform 28:1149–1162, 2002).     

Audiotactile temporal order judgments

We report a series of three experiments in which participants made unspeeded 'Which modality came first?' temporal order judgments (TOJs) to pairs of auditory and tactile stimuli presented at varying stimulus onset asynchronies (SOAs) using the method of constant stimuli. The stimuli were presented from either the same or different locations in order to explore the potential effect of redundant spatial information on audiotactile temporal perception. In Experiment 1, the auditory and tactile stimuli had to be separated by nearly 80 ms for inexperienced participants to be able to judge their temporal order accurately (i.e., for the just noticeable difference (JND) to be achieved), no matter whether the stimuli were presented from the same or different spatial positions. More experienced psychophysical observers (Experiment 2) also failed to show any effect of relative spatial position on audiotactile TOJ performance, despite having much lower JNDs (40 ms) overall. A similar pattern of results was found in Experiment 3 when silent electrocutaneous stimulation was used rather than vibrotactile stimulation. Thus, relative spatial position seems to be a less important factor in determining performance for audiotactile TOJ than for other modality pairings (e.g., audiovisual and visuotactile).     

Top-down control over involuntary attention switching in the auditory modality

We tested the effects of predictability on involuntary attention switching to task-irrelevant sound changes (distraction). Behavioral and neurophysiological evidence are provided, showing that the predictability of task-irrelevant sound changes eliminates effects of distraction even though the automatic auditory change detection system remains responsive. Two indices of distraction, slower task performance and cortical brain responses associated with attention switching, were seen only in the unpredictable condition, in which the irrelevant acoustic changes were unexpected. Attention was not involuntarily drawn away from the primary task when the subjects had foreknowledge of when the irrelevant changes would occur. These results demonstrate attentional control over orienting to sound changes and suggest that involuntary attention switching occurs mainly when an irrelevant stimulus change is unexpected. The present data allowed observation of the temporal dynamics of attention switching in the human brain.     

Attentional capture in singleton-detection and feature-search modes

Six experiments were conducted to determine the circumstances under which an irrelevant singleton captures attention. Subjects searched for a target while ignoring a salient distractor that appeared at different stimulus onset asynchronies (SOAs) prior to each search display. Spatial congruency and interference effects were measured. The strategies available to find the target were controlled (only singleton-detection mode, only feature-search mode, or both search strategies available). An irrelevant abrupt onset captured attention in search for a color target, across SOAs, whatever strategies were available. In contrast, in search for a shape target, an irrelevant color singleton captured attention in the singleton-detection condition but delayed response at its location in the feature-search condition, across SOAs. When both strategies were available, capture was short lived (50- to 100-msec SOAs). The theoretical implications of these findings in relation to current views on attentional capture are discussed. ((c) 2003 APA, all rights reserved)     

Timing the “magical number seven”: Presentation rate and regularity affect verbal working memory performance

The informative value of time and temporal structure often remains neglected in cognitive assessments. However, next to information about stimulus identity we can exploit temporal ordering principles, such as regularity, periodicity, or grouping to generate predictions about the timing of future events. Such predictions may improve cognitive performance by optimising adaptation to dynamic stimuli. Here, we investigated the influence of temporal structure on verbal working memory by assessing immediate recall performance for aurally presented digit sequences (forward digit span) as a function of standard (1000 ms stimulus-onset-asynchronies, SOAs), short (700 ms), long (1300 ms) and mixed (700–1300 ms) stimulus timing during the presentation phase. Participant's digit spans were lower for short and mixed SOA presentation relative to standard SOAs. This confirms an impact of temporal structure on the classic “magical number seven,” suggesting that working memory performance can in part be regulated through the systematic application of temporal ordering principles.     

Visual orienting with central and peripheral precues: Deconfounding the contributions of cue eccentricity,cue discrimination and spatial correspondence

Five experiments examined effects of spatial precues on visual attention. Precues consisted of letters (X, T, O) presented bilaterally at central and peripheral locations.In the spatial correspondence conditions targets tended (p= .8) to appear on the same side as one of the letters. In the spatial translation conditions the bilateral letters were identical; one letter (e.g., X) indicated that the target would probably (p= .8) appear on the left, and the other (e.g., T) indicated that the target would probably appear on the right. In the spatial correspondence conditions (Experiments 1, 3A, 4, and 5) response latencies were quicker on valid than invalid trials, even at very brief (0 ms, 33 ms, 66 ms, 100 ms) stimulus onset asynchronies (SOAs) between cue and target onset. Also,the dynamic pattern of cost and benefit resembled that seen in previous studies with unilateral peripheral precues. In the spatial translation conditions (Experiments 2 and 3B), a clear advantage for valid trials was only apparent at somewhat longer SOAs (150 ms, 300 ms, 500 ms). Results show that the need to discriminate between cue stimuli, and the visual eccentricity of cues, are not critical factors mediating attentional effects of spatial precues. However, the presence or absence of spatial correspondence between the location of a cue stimulus and the location of the target was critically important.     

Quantifying temporal ventriloquism in audiovisual synchrony perception

The integration of visual and auditory inputs in the human brain works properly only if the components are perceived in close temporal proximity. In the present study, we quantified cross-modal interactions in the human brain for audiovisual stimuli with temporal asynchronies, using a paradigm from rhythm perception. In this method, participants had to align the temporal position of a target in a rhythmic sequence of four markers. In the first experiment, target and markers consisted of a visual flash or an auditory noise burst, and all four combinations of target and marker modalities were tested. In the same-modality conditions, no temporal biases and a high precision of the adjusted temporal position of the target were observed. In the different-modality conditions, we found a systematic temporal bias of 25–30 ms. In the second part of the first and in a second experiment, we tested conditions in which audiovisual markers with different stimulus onset asynchronies (SOAs) between the two components and a visual target were used to quantify temporal ventriloquism. The adjusted target positions varied by up to about 50 ms and depended in a systematic way on the SOA and its proximity to the point of subjective synchrony. These data allowed testing different quantitative models. The most satisfying model, based on work by Maij, Brenner, and Smeets (Journal of Neurophysiology 102, 490–495, 2009), linked temporal ventriloquism and the percept of synchrony and was capable of adequately describing the results from the present study, as well as those of some earlier experiments.     

Auditory spatial negative priming: What is remembered of irrelevant sounds and their locations?

The categorization and identification of previously ignored visual or auditory stimuli is typically slowed down—a phenomenon that has been called the negative priming effect and can be explained by the episodic retrieval of response-inadequate prime information and/or an inhibitory model. A similar after-effect has been found in visuospatial tasks: participants are slowed down in localizing a visual stimulus that appears at a previously ignored location. In the auditory modality, however, such an after-effect of ignoring a sound at a specific location has never been reported. Instead, participants are impaired in their localization performance when the sound at the previously ignored location changes identity, a finding which is compatible with the so-called feature-mismatch hypothesis. Here, we describe the properties of auditory spatial in contrast to visuospatial negative priming and report two experiments that specify the nature of this auditory after-effect. Experiment 1 shows that the detection of identity-location mismatches is a genuinely auditory phenomenon that can be replicated even when the sound sources are invisible. Experiment 2 reveals that the detection of sound-identity mismatches in the probe depends on the processing demands in the prime. This finding implies that the localization of irrelevant sound sources is not the inevitable consequence of processing the auditory prime scenario but depends on the difficulty of the target search process among distractor sounds.     

Hemispheric asymmetries in auditory distraction

Serial-verbal short-term memory is impaired by irrelevant sound, particularly when the sound changes acoustically (the changing-state effect). In contrast, short-term recall of semantic information is impaired only by the semanticity of irrelevant speech, particularly when it is semantically related to the target memory items (the between-sequence semantic similarity effect). Previous research indicates that the changing-state effect is larger when the sound is presented to the left ear in comparison to the right ear, the left ear disadvantage. In this paper, we report a novel finding whereby the between-sequence semantic similarity effect is larger when the irrelevant speech is presented to the right ear in comparison to the left ear, but this right ear disadvantage is found only when meaning is the basis of recall (Experiments 1 and 3), not when order is the basis of recall (Experiment 2). Our results complement previous research on hemispheric asymmetry effects in cross-modal auditory distraction by demonstrating a role for the left hemisphere in semantic auditory distraction.     

试次历史对跨通道非空间返回抑制的影响

个体对刺激的反应不仅受刺激本身的影响, 还会受到先前刺激的影响, 表现为对当前试次中刺激的反应会受到前一试次的影响, 即试次历史。本研究采用“线索-中性线索-靶子”范式探讨前一试次有效性对跨通道的非空间返回抑制的影响。实验1通过连续两个试次间的线索有效性考察在跨通道非空间返回抑制中试次历史的影响。为了在跨通道非空间返回抑制中减小试次历史的影响, 实验2通过延长试次间时间间隔考察跨通道非空间返回抑制中试次历史的作用是否减小。结果发现, 前一试次线索无效时, 当前试次中的返回抑制效应量显著小于前一试次有效时, 这种影响会根据试次中线索和靶子通道的不同而不同。并且当延长试次间的时间间隔可以有效地减少前一试次对当前试次的影响。因此本研究表明, 试次历史能够对跨通道非空间返回抑制产生影响, 并且这种影响可以通过增大试次间时间间隔来减小。     

The auditory sensory memory trace decays rapidly in newborns

The present study investigated the temporal dynamics of auditory sensory memory in newborns as reflected by the mismatch negativity (MMN), a preattentive electric change-detection response. MMN was obtained from 24 full-term healthy newborns who were either awake or asleep (quiet or active sleep) during the experiments. Stimuli were 1,000 Hz tones (standards) that were occasionally replaced by 1,100 Hz tones (deviants). The constant stimulus onset asynchrony (SOA) was, in separate blocks, either 450, 800, or 1,500 ms. A prominent MMN was obtained at the 800 ms SOA in all three sleep or waking states, whereas no MMN occurred at 450 and 1,500 ms SOAs. In view of the fact that in adults MMN is elicited even with a 10s SOA, these results imply that the time span of auditory memory is considerably shorter in neonates than in adults and 8-12-year-old children.     

Facial affect and temporal order judgments: emotions turn back the clock

The influence of facial affect on the perception of temporal order was examined in the context of the temporal order judgment (TOJ) paradigm. Two schematic faces were presented either simultaneously, or separated by varying stimulus onset asynchronies (SOAs; -100 ms, -34 ms, -17 ms, 17 ms, 34 ms, 100 ms), and participants had to judge which face appeared first. Each schematic face displayed one of three emotions; happy, neutral, or angry. Facial affect was found to influence judgments of temporal order at short SOAs (-17 ms, 0 ms, and 17 ms) but not at the longest SOAs (-100 ms and 100 ms), consistent with the hypothesis that facial affect influences relative onset judgments when they are difficult to make.     

Characteristic sounds make you look at target objects more quickly

When you are looking for an object, does hearing its characteristic sound make you find it more quickly? Our recent results supported this possibility by demonstrating that when a cat target, for example, was presented among other objects, a simultaneously presented “meow” sound (containing no spatial information) reduced the manual response time for visual localization of the target. To extend these results, we determined how rapidly an object-specific auditory signal can facilitate target detection in visual search. On each trial, participants fixated a specified target object as quickly as possible. The target’s characteristic sound speeded the saccadic search time within 215–220 msec and also guided the initial saccade toward the target, compared with presentation of a distractor’s sound or with no sound. These results suggest that object-based auditory—visual interactions rapidly increase the target object’s salience in visual search.     

The spatial constraint in intersensory pairing: no role in temporal ventriloquism

A sound presented in temporal proximity to a light can alter the perceived temporal occurrence of that light (temporal ventriloquism). The authors explored whether spatial discordance between the sound and light affects this phenomenon. Participants made temporal order judgments about which of 2 lights appeared first, while they heard sounds before the 1st and after the 2nd light. Sensitivity was higher (i.e., a lower just noticeable difference) when the sound-light interval was approximately 100 ms rather than approximately 0 ms. This temporal ventriloquist effect was unaffected by whether sounds came from the same or a different position as the lights, whether the sounds were static or moved, or whether they came from the same or opposite sides of fixation. Yet, discordant sounds interfered with speeded visual discrimination. These results challenge the view that intersensory interactions in general require spatial correspondence between the stimuli.