Crossmodal attention switching: Auditory dominance in temporal discrimination tasks

Visual stimuli are often processed more efficiently than accompanying stimuli in another modality. In line with this “visual dominance”, earlier studies on attentional switching showed a clear benefit for visual stimuli in a bimodal visual–auditory modality-switch paradigm that required spatial stimulus localization in the relevant modality. The present study aimed to examine the generality of this visual dominance effect. The modality appropriateness hypothesis proposes that stimuli in different modalities are differentially effectively processed depending on the task dimension, so that processing of visual stimuli is favored in the dimension of space, whereas processing auditory stimuli is favored in the dimension of time. In the present study, we examined this proposition by using a temporal duration judgment in a bimodal visual–auditory switching paradigm. Two experiments demonstrated that crossmodal interference (i.e., temporal stimulus congruence) was larger for visual stimuli than for auditory stimuli, suggesting auditory dominance when performing temporal judgment tasks. However, attention switch costs were larger for the auditory modality than for visual modality, indicating a dissociation of the mechanisms underlying crossmodal competition in stimulus processing and modality-specific biasing of attentional set.     

On the interplay of visuospatial and audiotemporal dominance: Evidence from a multimodal kappa effect

When participants judge multimodal audiovisual stimuli, the auditory information strongly dominates temporal judgments, whereas the visual information dominates spatial judgments. However, temporal judgments are not independent of spatial features. For example, in the kappa effect, the time interval between two marker stimuli appears longer when they originate from spatially distant sources rather than from the same source. We investigated the kappa effect for auditory markers presented with accompanying irrelevant visual stimuli. The spatial sources of the markers were varied such that they were either congruent or incongruent across modalities. In two experiments, we demonstrated that the spatial layout of the visual stimuli affected perceived auditory interval duration. This effect occurred although the visual stimuli were designated to be task-irrelevant for the duration reproduction task in Experiment 1, and even when the visual stimuli did not contain sufficient temporal information to perform a two-interval comparison task in Experiment 2. We conclude that the visual and auditory marker stimuli were integrated into a combined multisensory percept containing temporal as well as task-irrelevant spatial aspects of the stimulation. Through this multisensory integration process, visuospatial information affected even temporal judgments, which are typically dominated by the auditory modality.     

Transient spatial attention and the perceived duration of brief visual events

This study was designed to explore the effects of transient attention—the stimulus-driven component of spatial attention—on the perceived duration of a brief visual event. Observers had to compare the duration of two disks presented successively within a single trial. The disks’ location and duration varied independently. One of these disks, the “attended disk”, was preceded by an attentional cue indicating the disk's location, attracting transient attention in advanced to the disk location. This attentional cue was either a typical onset cue (Experiments 1, 2, and 4) or a singleton cue (Experiment 3) that minimized the differences between the cues. The other disk, the “neutral disk”, was cued with a neutral cue that did not convey information regarding the disk location. We found that the attraction of transient attention to the location of the attended disk prolonged its perceived duration, but only when compared to brief nonattend stimuli.     

Attentional selection of a peripheral ring overrules the central attentional bias

In visual search, distractors that fall between fixation and the target are more disruptive than distractors that fall at the same eccentricity as the target (Wolfe, O'Neill, & Bennett, 1998). This sensitivity to the relative eccentricity of target and distractor elements originates from a space-based bias favoring stimuli closer to the fovea. We show that this spatial bias can be overruled by cuing attention to a ring-shaped object. We rule out various space-based explanations of these findings, including (1) attention to fronto-parallel planes in depth and (2) serial attention to different portions of a ring. We suggest that attentional selection of a ring-shaped object operates independently of, and can overrule, spatial biases in selection.     

Directed attention prolongs the perceived duration of a brief stimulus

Stelmach, Herdman, and McNeil (1994) suggested recently that the perceived duration for attended stimuli is shorter than that for unattended ones. In contrast, the attenuation hypothesis (Thomas & Weaver, 1975) suggests the reverse relation between directed attention and perceived duration. We conducted six experiments to test the validity of the two contradictory hypotheses. In all the experiments, attention was directed to one of two possible stimulus sources. Experiments 1 and 2 employed stimulus durations from 70 to 270 msec. A stimulus appeared in either the visual or the auditory modality. Stimuli in the attended modality were rated as longer than stimuli in the unattended modality. Experiment 3 replicated this finding using a different psychophysical procedure. Experiments 4-6 showed that the finding applies not only to stimuli from different sensory modalities but also to stimuli appearing at different locations within the visual field. The results of all six experiments support the assumption that directed attention prolongs the perceived duration of a stimulus.     

Endogenous shifts of attention cause distortions in the perception of space: Reviewing and examining the attentional repulsion effect

ABSTRACT

The functioning of spatial attention and its effects on visual processing are typically studied using chronometric and accuracy measures of behaviour. However, a growing body of literature has studied the attentional repulsion effect (ARE). Simply put, when attention is focused on one location in the visual field, stimuli appearing nearby the attended location are perceived as being located further away from the attended location than they physically are. The ARE is particularly compelling, as it is best explained by considering the receptive field properties of visual cells, thus allowing for more direct comparisons between behaviour and neural functioning. Nonetheless, most research testing the ARE has manipulated spatial attention exogenously. Furthermore, for studies that have explored endogenous attention and the ARE, empirical evidence is conflicting. Therefore, the aim of the current study was to address this inconsistency by testing the effect of voluntary attention on spatial repulsion using an optimal operationalization of endogenous attention. Centrally presented, highly informative double-cues were used to shift attention, and placeholders were included in the display to help anchor attention. Overall, we observed strong spatial repulsion effects when attention was shifted endogenously, providing compelling evidence that voluntary deployments of attention can cause perceptual distortions of space.     

Temporal order judgment reveals how number magnitude affects visuospatial attention

The existence of spatial components in the mental representation of number magnitude has raised the question regarding the relation between numbers and spatial attention. We present six experiments in which this relation was examined using a temporal order judgment task to index attentional allocation. Results demonstrate that one important consequence of numerical processing is the automatic allocation of spatial attention, which in turn affects the perception of the temporal order of visual events. Given equal onset time, left-side stimuli are perceived to occur before right-side stimuli when a small number (1, 2) is processed, whereas right-side stimuli are perceived to occur before left-side stimuli when a larger number (8, 9) is processed. In addition, we show that this attentional effect is specific to quantity processing and does not generalize to non-numerical ordinal sequences.     

Perceived duration decreases with increasing eccentricity

Previous studies examining the influence of stimulus location on temporal perception yield inhomogeneous and contradicting results. Therefore, the aim of the present study is to soundly examine the effect of stimulus eccentricity. In a series of five experiments, subjects compared the duration of foveal disks to disks presented at different retinal eccentricities on the horizontal meridian. The results show that the perceived duration of a visual stimulus declines with increasing eccentricity. The effect was replicated with various stimulus orders (Experiments 1–3), as well as with cortically magnified stimuli (Experiments 4–5), ruling out that the effect was merely caused by different cortical representation sizes. The apparent decreasing duration of stimuli with increasing eccentricity is discussed with respect to current models of time perception, the possible influence of visual attention and respective underlying physiological characteristics of the visual system.     

空间选择性注意在上下视野间的转移

本实验研究空间选择性注意在上下视野间的转移及其是否受知觉空间的影响。实验采用Posner的位置线索化实验范式和两种深度线索背景,测量分辨任务的反应时(RTs)。实验发现:线索有效时的反应时比线索无效时的反应时短,而且线索对上视野刺激的反应时的影响较大。知觉空间中的深度线索对于注意在上下视野中转移没有显著影响。这些结果表明,空间选择性注意在上下视野转移存在不对称性,并且主要由物理空间决定。     

Voluntary attention increases perceived spatial frequency

Voluntary covert attention selects relevant sensory information for prioritized processing. The behavioral and neural consequences of such selection have been extensively documented, but its phenomenology has received little empirical investigation. Involuntary attention increases perceived spatial frequency (Gobell & Carrasco, 2005), but involuntary attention can differ from voluntary attention in its effects on performance in tasks mediated by spatial resolution (Yeshurun, Montagna, & Carrasco, 2008). Therefore, we ask whether voluntary attention affects the subjective appearance of spatial frequency—a fundamental dimension of visual perception underlying spatial resolution. We used a demanding rapid serial visual presentation task to direct voluntary attention and measured perceived spatial frequency at the attended and unattended locations. Attention increased the perceived spatial frequency of suprathreshold stimuli and also improved performance on a concurrent orientation discrimination task. In the control experiment, we ruled out response bias as an alternative account by using a lengthened interstimulus interval, which allows observers to disengage attention from the cued location. In contrast to the main experiment, the observers showed neither increased perceived spatial frequency nor improved orientation discrimination at the attended location. Thus, this study establishes that voluntary attention increases perceived spatial frequency. This phenomenological consequence links behavioral and neurophysiological studies on the effects of attention.     

Somatosensory prior entry

The perceived timing of sensory events does not necessarily match the actual timing. In the present study, we investigated the effect of location of attention on the perceived timing of somatosensory stimuli. Participants judged the temporal order of two taps, delivered one to each hand, with taps presented at different elevations (upper and lower) on the opposing hands. The task was to discriminate the elevation of the tap presented first (or second). This vertical discrimination task was orthogonal to the horizontal attentional cuing manipulation, removing the response bias confound that has undermined earlier studies investigating the impact of attention on the perceived timing of sensory stimuli. We manipulated spatial attention either (1) exogenously (Experiment 1) in 13 participants, using brief taps to either the left or right hand, or (2) endogenously (Experiment 2) in 22 participants, using centrally presented symbolic cues. The results supported the hypothesis that attended stimuli are perceived more rapidly than unattended stimuli. This effect was larger when attention was exogenously manipulated. Previous research has demonstrated a similar effect for visual stimuli. The present study, which extends this result to somatosensory perception, indicates that the phenomenon may represent a more global feature of the perceptual system, which is possibly mediated by a common modality-independent mechanism.     

视听刺激突显性对视觉主导效应的影响

本研究使用空间任务-转换范式,控制视、听刺激的突显性,探讨自下而上注意对视觉主导效应的影响。结果表明视、听刺激突显性显著地影响视觉主导效应,实验一中当听觉刺激为高突显性时,视觉主导效应显著减弱。实验二中当听觉刺激为高突显性并且视觉刺激为低突显性时,视觉主导效应进一步减弱但依然存在。结果支持偏向竞争理论,在跨通道视听交互过程中视觉刺激更具突显性,在多感觉整合过程中更具加工优势。     

The effect of spatial attention on invisible stimuli

The influence of selective attention on visual processing is widespread. Recent studies have demonstrated that spatial attention can affect processing of invisible stimuli. However, it has been suggested that this effect is limited to low-level features, such as line orientations. The present experiments investigated whether spatial attention can influence both low-level (contrast threshold) and high-level (gender discrimination) adaptation, using the same method of attentional modulation for both types of stimuli. We found that spatial attention was able to increase the amount of adaptation to low- as well as to high-level invisible stimuli. These results suggest that attention can influence perceptual processes independent of visual awareness.     

Spatial orienting in the visual field: a unified perceptual space?

Visual attention can be oriented toward a spatial location in the visual field exogenously by an abrupt onset of a peripheral cue. In a series of behavioral studies on exogenous orienting of attention with a double-cue paradigm, we demonstrated a functional subdivision of perceptual space in the visual field. Specifically, inhibition of return (IOR) is much stronger at periphery relative to perifoveal visual field up to approximately 15° eccentricity, suggesting two dissociable functional areas in the visual field. To further investigate the generality of this functional subdivision of the visual field, we measured IOR effects with another single-cue paradigm and applied a very short cue-target interval that was typically anticipated not to observe any inhibitory effect at all. Consistent with this expectation, no IOR effects at the eccentricities up to 15° were observed. However, significant IOR effects beyond 15° eccentricities were consistently demonstrated. These results not only revealed an early onset of IOR for more peripheral stimuli, but also confirmed that the perceptual space in the visual field is not homogeneous but underlies a functional subdivision with a border of ca. 15° eccentricity.     

Visual impressions of forces between objects: Entraining,enforced disintegration,and shattering

When a moving object (A) contacts a stationary one (B) and Object B then moves, visual impressions of force occur along with a visual impression of causality. It is shown that findings about force impressions that occur with launching effect stimuli generalize to other forms of phenomenal causality, namely entraining, enforced disintegration, and shattering stimuli. In particular, evidence is reported for generality of the force asymmetry, in which the amount of perceived force exerted by Object A is greater than the amount of perceived resistance put up by Object B. Effects of manipulations of kinematic variables also resembled those found in previous experiments. Some unpredicted findings occurred. It is argued that these reflect a change in perceptual interpretation when both objects are in motion prior to contact, due to both objects being perceived as in autonomous motion. The results are consistent with a theoretical account in which force impressions occur by a process of matching kinematic information in visual stimuli to stored representations of actions on objects, which supply information about forces.     

The duration of a brief event in the mind's eye.

A new illusion of perceived duration associated with focused spatial attention is reported. Brief flashes in attended locations were perceived to last longer than the same flashes in unattended locations. That illusion was shown to be completely independent of another illusion concerning the perceived onset of a flash, ruling out the possibility that the effect on perceived duration is derivative of a comparison between perceived onset and offset. The illusion also occurred when the event duration was composed of a temporal gap rather than a brief flash, ruling out low-level visible persistence as a basis for the illusion. Taken together, the results point to cortical connections from higher brain centers' both speeding and prolonging the visual signals occurring in lower sensory regions. Those temporal consequences could easily subserve many of the perceptual benefits ascribed to attention for spatial and intensive properties.     

The effects of spatial frequency and target type on perceived duration

Two experiments are reported that attempt to demonstrate a critical role played by sensory persistence on a standard perceived-duration task employing brief visual stimuli. Experiment 1 examined the effect on perceived duration of varying the spatial frequency of a target. For both 40- and 70-msec flashes, increased spatial frequency resulted in reduced estimates of perceived duration. These results were contrasted with predictions derived from cognitive processing models of duration perception. In Experiment 2, three typical types of target employed in current research (an outlined circle, a “noise”-filled circle, and a completely filled circle) were shown to differ significantly in their perceived duration and in their sensitivity to increases in physical duration. The results were discussed in terms of variable degrees of retinal persistence produced by the three types of targets. The possible implications for specific discrepancies in the literature and across-study comparisons in general were enumerated.     

内外源性空间注意对多感觉整合的影响

本文采用内-外源性空间线索靶子范式, 操控内源性线索有效性(有效线索、无效线索)、外源性线索有效性(有效线索、无效线索)、目标刺激类型(视觉刺激、听觉刺激、视听觉刺激)三个自变量。通过两个不同任务难度的实验(实验1: 简单定位任务; 实验2: 复杂辨别任务)来考察内外源性空间注意对多感觉整合的影响。两个实验结果均发现外源性空间注意显著减弱了多感觉整合效应, 内源性空间注意没有显著增强多感觉整合效应; 实验2中还发现了内源性空间注意会对外源性空间注意减弱多感觉整合效应产生影响。结果表明, 与内源性空间注意不同, 外源性空间注意对多感觉整合的影响不易受任务难度的调控; 当任务较难时内源性空间注意会影响外源性空间注意减弱多感觉整合效应的过程。由此推测, 内外源性空间注意对多感觉整合的调节并非彼此独立、而是相互影响的。     

The subjective duration of audiovisual looming and receding stimuli

Looming visual stimuli (log-increasing in proximal size over time) and auditory stimuli (of increasing sound intensity over time) have been shown to be perceived as longer than receding visual and auditory stimuli (i.e., looming stimuli reversed in time). Here, we investigated whether such asymmetry in subjective duration also occurs for audiovisual looming and receding stimuli, as well as for stationary stimuli (i.e., stimuli that do not change in size and/or intensity over time). Our results showed a great temporal asymmetry in audition but a null asymmetry in vision. In contrast, the asymmetry in audiovision was moderate, suggesting that multisensory percepts arise from the integration of unimodal percepts in a maximum-likelihood fashion.     

The effects of stimulus numerosity,retinal location,and rod contrast on perceived duration of brief visual stimuli

The effects of manipulating three stimulus parameters were determined on a standard perceived duration task using 40- and 70-msec visual stimuli. In Experiment 1, it was found that perceived duration increased with increasing number of target dots but decreased as the area that contained the dots also increased. Experiment 2 examined the effect of varying the retinal location (0, 2, or 4 deg from fovea) of the target dot and found perceived target duration to increase with increasing eccentricity. In Experiment 3, the background luminance for a constant red target was varied so as to alter the scotopic contrast of the target. Perceived duration was minimal for the scotopically matched target and background conditions. The results of all three experiments were discussed in terms of important retinal—and even rod—contributions to tasks of perceived duration.