Divided attention between simultaneous auditory and visual signals

Past studies of simultaneous attention to pairs of visual stimuli have used the “dual-task” paradigm to show that identification of the direction of a change in luminance, whether incremental or decremental, is “capacity-limited,” while simple detection of these changes is governed by “capacity-free” processes. On the basis of that finding, it has been suggested that the contrast between identification and detection reflects different processes in the sensory periphery, namely the responses of magno- and parvocellular receptors. The present study questions that assertion and investigates the contribution of central processing in resource limitation by applying the dual task to a situation in which one stimulus is auditory and one is visual. The results are much the same as before, with identification demonstrating the tradeoff in performance generally attributed to a limited capacity but detection showing no loss compared with single-task controls. This implies that limitations on resources operate at a central level of processing rather than in the auditory and visual peripheries.     

Object-based auditory and visual attention

Theories of visual attention argue that attention operates on perceptual objects, and thus that interactions between object formation and selective attention determine how competing sources interfere with perception. In auditory perception, theories of attention are less mature and no comprehensive framework exists to explain how attention influences perceptual abilities. However, the same principles that govern visual perception can explain many seemingly disparate auditory phenomena. In particular, many recent studies of 'informational masking' can be explained by failures of either auditory object formation or auditory object selection. This similarity suggests that the same neural mechanisms control attention and influence perception across different sensory modalities.     

Dividing attention between two different categories and locations in rapid serial visual presentations

When two targets are embedded in a rapid serial visual presentation (RSVP) stream of distractors, perception of the second target is impaired if the intertarget lag is relatively short (less than 500 msec). This phenomenon, called attentional blink, has been attributed to a temporal inability of attentional resources. Nevertheless, a recent study found that observers could monitor two RSVP streams concurrently for up to four items presented in close succession, suggesting a much larger visual capacity limit. However, such high-capacity performance could be obtained by a rapid shift of attention, rather than concurrent monitoring of multiple locations. Therefore, the present study examined these alternatives. Results from six experiments indicate that observers can concurrently monitor two noncontiguous locations, even when targets and distractors are from different categories, such as digits, English alphabet letters, Japanese characters, and pseudocharacters. These results can be explained in terms of a modified input-filtering model in which a multidimensional attentional set can be flexibly configured at different spatial locations.     

How visual spatial attention alters perception

Visual attention is essential for visual perception. Spatial attention allows us to grant priority in processing and selectively process information at a given location. In this paper, I explain how two kinds of spatial attention: covert (allocated to the target location, without accompanying eye movements) and presaccadic (allocated to the location of the upcoming saccade’s target) affect performance and alter appearance. First, I highlight some behavioral and neuroimaging research on covert attention, which alters performance and appearance in many basic visual tasks. Second, I review studies showing that presaccadic attention improves performance and alters appearance at the saccade target location. Further, these modulations change the processing of feature information automatically, even when it is detrimental to the task at hand. We propose that saccade preparation may support transsaccadic integration. Systematically investigating the common and differential characteristics of covert attention and presaccadic attention will continue to further our understanding of the pervasive selective processing of information, which enables us to make sense of our complex visual world.     

Phasic auditory alerting improves visual conscious perception

Attention is often conceived as a gateway to consciousness (Posner, 1994). Although endogenous spatial attention may be independent of conscious perception (CP) (Koch Tsuchiya, 2007), exogenous spatial orienting seems instead to be an important modulator of CP ( [Chica et al., 2010] and Chica, Lasaponara, et al., 2011). Here, we investigate the role of auditory alerting in CP in normal observers. We used a behavioral task in which phasic alerting tones were presented either at unpredictable or at predictable time intervals prior to the occurrence of a near-threshold visual target. We find, for the first time in neurologically intact observers, that phasic alertness increases CP, both objectively and subjectively. This result is consistent with evidence showing that phasic alerting can ameliorate the spatial bias exhibited by visual neglect patients (Robertson, Mattingley, Rorden, & Driver, 1998). The alerting network may increase the activity of fronto-parietal networks involved in top-down amplification required to bring a stimulus into consciousness (Dehaene, Changeux, Naccache, Sackur, & Sergent, 2006).     

Eye position and visual attention influence perceived auditory direction

The singular and joint effects of eccentric visual fixation and peripheral visual attention upon the perceived auditory median plane (PAMP) of the head were examined in four subjects. They positioned a hidden, horizontally-moving sound source to the perceived median plane of the head, while fixating a light 20 degrees or 45 degrees to the right or left of the actual median plane, and attending to another light in peripheral vision. Analysis by multiple linear regression yielded a model for each subject which indicated the nature and weighting of those factors contributing to variance reduction in PAMP judgments. Three subjects showed a strong linear attention effect, resulting in shifts of the PAMP away from the locus of attention. Similarly, a strong linear fixation effect was discovered in two subjects, a weak effect in another, and a nonlinear, inverse fixation effect in the last. Additional factors were noted for some subjects. Possible explanations of the observed effects were discussed. The study indicates that both visual attention and visual fixation are critical factors in experiments on auditory space perception although inter-individual differences do exist in the nature and strength of the effects.     

Neuronal effects of auditory distraction on visual attention

Selective attention in the presence of distraction is a key aspect of healthy cognition. The underlying neurobiological processes, have not, however, been functionally well characterized. In the present study, we used functional magnetic resonance imaging to determine how ecologically relevant distracting noise affects cortical activity in 27 healthy adults during two versions of the visual Sustained Attention To Response Task (SART) that differ in difficulty (and thus attentional load). A significant condition (noise or silence) by task (easy or difficult) interaction was observed in several areas, including dorsolateral prefrontal cortex (DLPFC), fusiform gyrus (FG), posterior cingulate (PCC), and pre-supplementary motor area (PreSMA). Post hoc analyses of interaction effects revealed deactivation of DLPFC, PCC, and PreSMA during distracting noise under conditions of low attentional load, and activation of FG and PCC during distracting noise under conditions of high attentional load. These results suggest that distracting noise may help alert subjects to task goals and reduce demands on cortical resources during tasks of low difficulty and attentional load. Under conditions of higher load, however, additional cognitive resources may be required in the presence of noise.     

A developmental study of attention to auditory and visual signals

Three experiments tested for developmental changes in attention to simple auditory and visual signals. Subject pressed a single button in response to the onset (Experiment 1) or offset (Experiment 2) of either a tone or a light. During one block of trials subjects knew which stimulus would come on or go off on each trial (precue condition) whereas during the other block of trials no precue was provided. In both experiments subjects as young as 4 years old responded more rapidly with precues, indicating that they were able to allocate their attention to the indicated modality. Experiment 3 utilized a choice reaction paradigm (in which subjects pressed different buttons in response to the onset of the light and the tone) in order to examine their attention allocation when no precues were provided. It was found that the adults and 7-year-olds tended to allocate their attention to vision rather than audition when no precue was provided. The results with the 4-year-olds were not entirely consistent, but suggested a similar biasing of attention to vision on their part as well.     

A common source of attention for auditory and visual tracking

Tasks that require tracking visual information reveal the severe limitations of our capacity to attend to multiple objects that vary in time and space. Although these limitations have been extensively characterized in the visual domain, very little is known about tracking information in other sensory domains. Does tracking auditory information exhibit characteristics similar to those of tracking visual information, and to what extent do these two tracking tasks draw on the same attention resources? We addressed these questions by asking participants to perform either single or dual tracking tasks from the same (visual–visual) or different (visual–auditory) perceptual modalities, with the difficulty of the tracking tasks being manipulated across trials. The results revealed that performing two concurrent tracking tasks, whether they were in the same or different modalities, affected tracking performance as compared to performing each task alone (concurrence costs). Moreover, increasing task difficulty also led to increased costs in both the single-task and dual-task conditions (load-dependent costs). The comparison of concurrence costs between visual–visual and visual–auditory dual-task performance revealed slightly greater interference when two visual tracking tasks were paired. Interestingly, however, increasing task difficulty led to equivalent costs for visual–visual and visual–auditory pairings. We concluded that visual and auditory tracking draw largely, though not exclusively, on common central attentional resources.     

Looking where you listen: visual cues and auditory attention

In the non-laboratory environment, we are generally able to see the source of the sounds to which we are attending. In a preliminary examination of how and to what degree we might use this visual information, subjects shadowed one of two female voices when able to see the persons speaking (Experiment I) or when able to see, and thus precisely localize, the auditory loudspeakers (Experiment II). Selective performance was improved by being able to see the lip movements of the people whose voices were heard, and by being able to localize visually the sources of the voices.     

The role of attention in visual and auditory suffix effects

Memory & Cognition - The auditory suffix effect (SE), in which recall of the terminal items of a sequence is impaired by presenting a redundant item at the end of the sequence, has been...     

Dividing attention between color and shape: Evidence of coactivation

When attention is divided between spatially distinct objects, the time-to detect a target decreases when two or more targets are present. This redundancy gain can be accounted for by an interactive race model (Mordkoff & Yantis, 1991) in which separate decisions are made about each object, but environmental contingencies among the objects can influence decision times. In the present study, we examined whether the model also accounts for performance when attention must be divided between stimulus attributes other than spatial location. Subjects made target-present responses when displays included a prespecified color, a prespecified letter, or both target features. The data violated the predictions of all separate-activations models, including the interactive race model. Two control experiments ruled out an alternative account based on task complexity. We conclude that coactivation occurs when target attributes from two separable dimensions are simultaneously present, but not when target attributes come from the same dimension. A modular hybrid of race and coactivation models is tentatively proposed.     

Dividing attention between the color and the shape of objects

In many dual-task experiments, the priority observers give to each task is experimentally varied. Most experiments using this methodology have studied the effect of dividing attention between spatially distinct objects. We examined performance when attention had to be divided between stimulus attributes other than spatial location. In the first experiment, observers identified the color and the shape of a single letter. Accuracy was the same for single- and dual-task conditions, and a trialby-trial analysis revealed a strong positive correlation in the correct identification of the color and the shape. In the second experiment, color and shape judgments were separated in space, with opposite results: Dual-task performance was worse than single-task performance, and the trial-by-trial analysis indicated a strong negative correlation between tasks. The results indicated that often only one dimension was processed within a trial. The results support object and space models of attention.     

Crossmodal object-based attention: auditory objects affect visual processing

According to the object-based view, visual attention can be deployed to "objects" or perceptual units, regardless of spatial locations. Recently, however, the notion of object has also been extended to the auditory domain, with some authors suggesting possible interactions between visual and auditory objects. Here we show that task-irrelevant auditory objects may affect the deployment of visual attention, providing evidence that crossmodal links can also occur at an object-based level. Hence, in addition to the well documented control of visual objects over what we hear, our findings demonstrate that, in some cases, auditory objects can affect visual processing.     

Target-directed visual attention is a prerequisite for action-specific perception

Witt et al. (2008) have recently shown that golfers who putt with more success perceive the hole to be bigger than golfers who putt with less success. In three experiments, we systematically examined whether this phenomenon, labelled action-specific perception, depends on directing visual attention towards the action target. In Experiment 1 we replicated previously reported action-specific effects on perception in golf putting. In 3 and 4 we directly assessed whether action-specific effects on perception in golf putting are dependent on focusing visual attention on the target. To this end, the participants performed the putting task while visual attention towards the target was either completely withheld (Experiment 2) or divided over the target and other task-relevant objects (Experiment 3). No action-specific effects were found when visual attention towards the action target was occluded or partially diverted from the target. Together, our results provide evidence to suggest that focusing visual attention on the target while performing the action is a prerequisite for the emergence of action-specific perception.     

Evaluation and integration of visual and auditory information in speech perception

Three experiments were carried out to investigate the evaluation and integration of visual and auditory information in speech perception. In the first two experiments, subjects identified /ba/ or /da/ speech events consisting of high-quality synthetic syllables ranging from /ba/ to /da/ combined with a videotaped /ba/ or /da/ or neutral articulation. Although subjects were specifically instructed to report what they heard, visual articulation made a large contribution to identification. The tests of quantitative models provide evidence for the integration of continuous and independent, as opposed to discrete or nonindependent, sources of information. The reaction times for identification were primarily correlated with the perceived ambiguity of the speech event. In a third experiment, the speech events were identified with an unconstrained set of response alternatives. In addition to /ba/ and /da/ responses, the /bda/ and /tha/ responses were well described by a combination of continuous and independent features. This body of results provides strong evidence for a fuzzy logical model of perceptual recognition.     

On the relation between auditory spatial attention and auditory perceptual asymmetries

Laterality investigators have typically interpreted any perceptual asymmetry as a direct expression of the functional organization of the brain. However, many other confounding factors, including the asymmetric distribution of attention, may also contribute to either the magnitude or the direction of any of these advantages. In two experiments, attention was manipulated in a dichotic listening paradigm by presenting a preexposural tone cue to the ear from which the subject was required to report. The time available to orient attention was manipulated by varying the time period between the onset of the cue and the onset of the trial (stimulus onset asynchrony, or SOA).Results indicated that a right ear advantage for the identification of verbal material obtained at a 150-msec SOA was almost completely eliminated at an SOA of 450 msec. In addition, the direction of the ear advantage for emotion identification was found to depend on task difficulty. A left ear advantage, apparent when task difficulty was minimal, was reversed to a right ear advantage when difficulty was increased. These data are taken as evidence that, when subjects are faced with a difficult dichotic task, there is a general tendency for right-handed subjects to bias their attention toward the right ear. Such a tendency is shown not only to have likely seriously compromised the results of past investigations of functional perceptual asymmetries but also to be inconsistent with previously proposed theories of dichotic listening performance.     

Age-related changes in visual and auditory sustained attention in preschool-aged children

Objective: The development of sustained attention in the preschool years is not yet fully understood. Delineating age-related changes of attentional proficiencies and deficiencies is important for understanding atypical developmental trajectories, specifically in neurodevelopmental disorders that are characterized by attentional difficulties. The objective of the current study was to develop preschool-appropriate measures for assessing sustained attention and to chart developmental changes in attention in early childhood. Method: Using adapted computerized paradigms, the present study investigated age-related changes in visual and auditory sustained attention in seventy typically developing children aged 3 to 6 years. Results: The results indicated that similar age-related gains in performance emerged across both visual and auditory attention tasks. Conclusion: The findings suggest that the adapted measures developed in this study are sensitive enough to capture developmental variations in attention performance.