Spontaneous allocation of visual attention: dominant role of uniqueness

Common sense suggests that unique or abruptly changing (transient) elements in a visual scene often draw attention involuntarily. Visual search studies paint a seemingly different picture, however: Unique items usually draw attention involuntarily only when observers seek a unique target. One type of transient— abrupt onsets—draws attention involuntarily, but only when the observer is seeking an onset (Folk, Remington, & Johnston, 1992). One way of reconciling common-sense with these findings is to suppose that when people view a scene with no specific goal or task, they adopt adefault set, which might prioritize novelty and/or transients. In two experiments, 336 subjects saw a single display of six items for 900 msec, expecting to have to describe it (Experiment 1) or make an aesthetic judgment about it (Experiment 2). One item in the display was either uniquely flashing (surrounded by static items) or uniquely static (surrounded by flashing items). In both studies, the unique item, even if static, was more often reported than the nonunique item, with flashing items enjoying an additional advantage.     

Exogenous and endogenous control of attention: the effect of visual onsets and offsets

Two experiments were carried out to investigate the relation between exogenous and endogenous control of visual attention. Subjects searched for a target letter among three nontarget letters that were positioned on an imaginary circle around a fixation point. At different cue-display intervals, a centrally located arrowhead cue reliably indicated the location of the target letter. At different SOAs, a peripheral line segment near one of the letters was either abruptly switched on (Experiment 1) or abruptly switched off (Experiment 2). Presenting the central arrowhead after display onset prevents attention from being focused in advance on the critical location. In this unfocused attentional state, both onset and offset transients attracted attention. When the central arrowhead was available in advance, the focusing of attention prior to display onset precluded attention attraction to the location of the onset or offset transient. Contrary to an offset transient, an onset transient presented at the attended location disrupted performance, indicating that an onset within the spotlight of attention attracts attention. The results are reconciled by means of the zoom-lens theory of attention, suggesting that outside the focus of attention, abrupt transients are not capable of attracting attention. Since the size of the zoom lens is under voluntary control, it can be argued that transients do not fulfill the intentionality criterion of automaticity.     

New reflections on visual search: Interitem symmetry matters!

A 90 degrees rotation of a display can turn a relatively easy visual search into a more difficult one. A series of experiments examined the possible causes of this effect, including differences in overall item shape and response mapping (Experiment 1), the interpretation of scene lighting (Experiment 2), the axis of internal symmetry of the search items (Experiment 3), and the axes of interitem symmetry between target and distractor items (Experiment 4). Only the elimination of differences in interitem mirror symmetry resulted in equal search efficiency in the upright and rotated displays. This finding is strong support for the view that visual search is guided by an analysis that considers interitem relations.     

Aging and involuntary attention capture: electrophysiological evidence for preserved attentional control with advanced age

The present study examined whether people become more susceptible to capture by salient objects as they age. Participants searched a target display for a letter in a specific color and indicated its identity. In Experiment 1, this target display was preceded by a non-informative cue display containing one target-color box, one ignored-color box, and two white boxes. On half of the trials, this cue display also contained a salient-but-irrelevant abrupt onset. To assess capture by the target-color cue, we used the N2pc component of the event-related potential, thought to reflect attentional allocation to the left or right visual field. The target-color box in the cue display produced a substantial N2pc effect for younger adults and, most importantly, this effect was not diminished by the presence of an abrupt onset. Therefore, the abrupt onset was unable to capture attention away from the target-color cue. Critically, older adults demonstrated the same resistance to capture by the abrupt onset. Experiment 2 extended these findings to irrelevant color singleton cues. Thus, we argue that the ability to attend to relevant stimuli and resist capture by salient-but-irrelevant stimuli is preserved with advancing age.     

Grouping reduces visual extinction: Neuropsychological evidence for weight-linkage in visual selection

Abstract

We tested two subjects following damage to right parietal cortex to see if their failure to detect a left visual stimulus in the presence of a simultaneous right stimulus (visual extinction) could be modulated by perceptual grouping between the left and right stimuli. Subjects performed a simple detection task for brief displays in which items could appear in the left or right visual field, both fields, or neither field. On trials in which items appeared in both fields, we found that left omissions (extinction errors) were dramatically reduced when the two items formed a good perceptual group, either on the basis of Gestalt factors such as similarity and symmetry (Experiment 1). or by forming a familiar configuration (Experiment 2). We suggest that extinction may be a spatially specific exaggeration of a normal attention limitation, in which the contralesional item is disadvantaged in the competition for selection. However, this obstacle to selection can be overcome if, as a result of grouping, ipsilesional and contralesional items become allies rather than competitors for selection.     

Serial deployment of attention during visual search

This study examined whether objects are attended in serial or in parallel during a demanding visual search task. A component of the event-related potential waveform, the N2pc wave, was used as a continuous measure of the allocation of attention to possible targets in the search arrays. Experiment 1 demonstrated that the relative allocation of attention shifts rapidly, favoring one item and then another. In Experiment 2, a paradigm was used that made it possible to track the absolute allocation of attention to individual items. This experiment showed that attention was allocated to one object for 100-150 ms before attention began to be allocated to the next object. These findings support models of attention that posit serial processing in demanding visual search tasks.     

Dynamic states in working memory modulate guidance of visual attention: Evidence from an n-back paradigm

Items held in working memory (WM) can automatically bias attention when they reappear in visual displays. Recent evidence, however, suggests that WM biases of attention may be reduced under certain conditions, for example with increasing memory load. We employed a dual task paradigm to investigate how WM biases are affected by dynamic updating of memory contents. 1-back and 2-back versions of a memory task with colour stimuli were interrupted at intervals by an unrelated visual search task. Reappearance in the search display of the item that was currently active in WM guided attention, while suppressed or inactive items did not. We conclude that the rapid updating of memory contents facilitates the shifting of memory representations into different activity states on a moment-to-moment basis. The finding is consistent with models that propose that only one item can be “active” in WM at any one time to guide attention.     

The ventriloquist effect does not depend on the direction of automatic visual attention.

Previously, we showed that the visual bias of auditory sound location, or ventriloquism, does not depend on the direction of deliberate, or endogenous, attention (Bertelson, Vroomen, de Gelder, & Driver, 2000). In the present study, a similar question concerning automatic, or exogenous, attention was examined. The experimental manipulation was based on the fact that exogenous visual attention can be attracted toward a singleton--that is, an item different on some dimension from all other items presented simultaneously. A display was used that consisted of a row of four bright squares with one square, in either the left- or the rightmost position, smaller than the others, serving as the singleton. In Experiment 1, subjects made dichotomous left-right judgments concerning sound bursts, whose successive locations were controlled by a psychophysical staircase procedure and which were presented in synchrony with a display with the singleton either left or right. Results showed that the apparent location of the sound was attracted not toward the singleton, but instead toward the big squares at the opposite end of the display. Experiment 2 was run to check that the singleton effectively attracted exogenous attention. The task was to discriminate target letters presented either on the singleton or on the opposite big square. Performance deteriorated when the target was on the big square opposite the singleton, in comparison with control trials with no singleton, thus showing that the singleton attracted attention away from the target location. In Experiment 3, localization and discrimination trials were mixed randomly so as to control for potential differences in subjects' strategies in the two preceding experiments. Results were as before, showing that the singleton attracted attention, whereas sound localization was shifted away from the singleton. Ventriloquism can thus be dissociated from exogenous visual attention and appears to reflect sensory interactions with little role for the direction of visual spatial attention.     

Contextual cueing reduces interference from task-irrelevant onset distractors

Three experiments were conducted to examine the interaction of top-down and bottom-up influences on visual search. More specifically, we examined the extent to which stimulus-driven capture of attention by abrupt onset distractors would disrupt the acquisition and expression of memory-based guidance of attention as exemplified by the contextual cueing effect (Chun & Jiang, 1998, 1999). In Experiment 1 onset distractors were introduced at the beginning of practice on the search task. Results indicated that onset distractors and repeated distractor patterns had independent and opposing influences on the efficiency of search. Experiment 2 ruled out an alternative hypothesis concerning the capture of attention by abrupt onsets. In Experiment 3, abrupt onset distractors were introduced following several hundred trials of practice with repeated and new distractor patterns in visual search. In this case contextual cueing observed in the repeated distractor configuration condition partially suppressed the detrimental influence of the abrupt onset distractors on search performance. These data are discussed in terms of the interaction of top-down and bottom-up influences on visual search.     

The ventriloquist effect does not depend on the direction of automatic visual attention

Previously, we showed that the visual bias of auditory sound location, or ventriloquism, does not depend on the direction of deliberate, orendogenous, attention (Bertelson, Vroomen, de Gelder, & Driver, 2000). In the present study, a similar question concerning automatic, orexogenous, attention was examined. The experimental manipulation was based on the fact that exogenous visual attention can be attracted toward asingleton—that is, an item different on some dimension from all other items presented simultaneously. A display was used that consisted of a row of four bright squares with one square, in either the left- or the rightmost position,smaller than the others, serving as the singleton. In Experiment 1, subjects made dichotomous left-right judgments concerning sound bursts, whose successivelocations were controlled by a psychophysical staircase procedure and which were presented in synchrony with a display with the singleton either left or right. Results showed that the apparent location of the sound was attractednot toward the singleton, but instead toward the big squares at the opposite end of the display. Experiment 2 was run to check that the singleton effectively attracted exogenous attention. The task was to discriminate target letters presented either on the singleton or on the opposite big square. Performance deteriorated when the target was on the big square opposite the singleton, in comparison with control trials with no singleton, thus showing that the singleton attracted attention away from the target location. In Experiment 3, localization and discrimination trials were mixed randomly so as to control for potential differences in subjects’ strategies in the two preceding experiments. Results were as before, showing that the singleton attracted attention, whereas sound localization was shifted away from the singleton. Ventriloquism can thus be dissociated from exogenous visual attention and appears to reflect sensory interactions with little role for the direction of visual spatial attention.     

The contributions of visual and central attention to visual working memory

We investigated the role of two kinds of attention—visual and central attention—for the maintenance of visual representations in working memory (WM). In Experiment 1 we directed attention to individual items in WM by presenting cues during the retention interval of a continuous delayed-estimation task, and instructing participants to think of the cued items. Attending to items improved recall commensurate with the frequency with which items were attended (0, 1, or 2 times). Experiments 1 and 3 further tested which kind of attention—visual or central—was involved in WM maintenance. We assessed the dual-task costs of two types of distractor tasks, one tapping sustained visual attention and one tapping central attention. Only the central attention task yielded substantial dual-task costs, implying that central attention substantially contributes to maintenance of visual information in WM. Experiment 2 confirmed that the visual-attention distractor task was demanding enough to disrupt performance in a task relying on visual attention. We combined the visual-attention and the central-attention distractor tasks with a multiple object tracking (MOT) task. Distracting visual attention, but not central attention, impaired MOT performance. Jointly, the three experiments provide a double dissociation between visual and central attention, and between visual WM and visual object tracking: Whereas tracking multiple targets across the visual filed depends on visual attention, visual WM depends mostly on central attention.     

Hierarchical encoding in visual working memory: ensemble statistics bias memory for individual items

Influential models of visual working memory treat each item to be stored as an independent unit and assume that there are no interactions between items. However, real-world displays have structure that provides higher-order constraints on the items to be remembered. Even in the case of a display of simple colored circles, observers can compute statistics, such as mean circle size, to obtain an overall summary of the display. We examined the influence of such an ensemble statistic on visual working memory. We report evidence that the remembered size of each individual item in a display is biased toward the mean size of the set of items in the same color and the mean size of all items in the display. This suggests that visual working memory is constructive, encoding displays at multiple levels of abstraction and integrating across these levels, rather than maintaining a veridical representation of each item independently.     

An electrophysiological study of attention capture by salience: Does rarity enable capture?

Several behavioural studies have suggested that rarity is critical for enabling irrelevant, salient objects to capture attention. We tested this hypothesis using the N2pc thought to reflect attentional allocation. A cue display was followed by a target display in which participants identified the letter in a specific colour. Experiment 1 pitted rare, irrelevant abrupt onset cues (appearing on only 20% of trials) against target-relevant colour cues. The relevant colour cue produced large N2pc and cue validity effects even when competing with a rare, salient, simultaneous abrupt onset. Similar results occurred even when abrupt onset frequency was reduced to only 10% of trials (Experiment 2). Experiment 3 examined rare, irrelevant colour singleton cues (20% of trials). Despite being rare and salient, these singleton cues produced no N2pc or cue validity effect indicating little attentional capture. Experiment 4 greatly increased colour cue salience by adding four background boxes, increasing colour contrast and tripling the cue display duration (from 50 to 150 ms). Small cue validity and N2pc effects were obtained, but did not strongly depend on degree of rarity (20% vs. 100%). We argue that rarity by itself is neither necessary nor sufficient to produce attention capture.     

The size of an attentional window affects working memory guidance

We ask whether attentional guidance from working memory (WM) is influenced by the size of an attentional window. Participants adopted either a focused or a diffuse attentional window when responding to a search display. Prior to the search display an initial cue had to be held in memory (Experiment 1A, visual WM; Experiment 1C, verbal WM) or merely identified (Experiment 1B, identification). In all cases, search performance was affected by the re-presentation of the cue in the search display, with the cuing effects (either cost or benefit) being larger when the cue was held in memory than when it was merely identified. Critically, the magnitude of the cuing benefit increased when participants adopted a diffuse attentional window. This held for effects that are based on items held in WM and for effects that are based only on item priming. The results suggest that variations in the size of an attentional window modulate top-down (both WM conditions) as well as bottom-up guidance of attention (identification condition).     

The effect of items in working memory on the deployment of attention and the eyes during visual search

Paying attention to an object facilitates its storage in working memory. The authors investigate whether the opposite is also true: whether items in working memory influence the deployment of attention. Participants performed a search for a prespecified target while they held another item in working memory. In some trials this memory item was present in the search display as a distractor. Such a distractor has no effect on search time if the search target is in the display. In that case, the item in working memory is unlikely to be selected as a target for an eye movement, and if the eyes do land on it, fixation duration is short. In the absence of the target, however, there is a small but significant effect of the memory item on search time. The authors conclude that the target for visual search has a special status in working memory that allows it to guide attention. Guidance of attention by other items in working memory is much weaker and can be observed only if the search target is not present in the display.     

The control of attention by abrupt visual onsets and offsets

A letter can be presented visually either by the abrupt appearance of lines that make up the letter (onset transient) or by the abrupt disappearance of extra lines from a form in which the letter is embedded (offset transient). Recent evidence from visual-search tasks has suggested that onset transients have absolute priority over offset transients with respect to the allocation of visual attention. Specifically, these studies have found that a single onset-transient target letter pops out of a background of offset-transient distractor letters (i.e., time to detect the target is independent of the number of distractors), which indicates that attention is automatically directed to the location of an onset-transient stimulus even when there are competing offset transients (Yantis & Jonides, 1984). Because of the way the offset letters were created, however, the total display change (number of offset line-segments plus number of onset line-segments) was greater for onset than for offset letters. Thus, onset targets might have popped out because they produced greater overall display changes rather than because they were the only letters with onset transients. In the present study, a figure that included more offset-transient line segments in the offset-transient letters was used. Under these conditions, onset-transient targets did not pop out of a background of offset-transient distractors. It is suggested that visual attention may be influenced by total display change and, therefore, that onset transients are not necessarily sufficient to control attention when there are many competing offset transients.     

Working memory and the guidance of visual attention: Consonance-driven orienting

Two experiments investigated the potential role of the content of working memory in guiding visual attention. Experiment 1 showed that maintaining a shape in working memory resulted in a decisive preference for moving attention to the same shape in the background when those shapes were task irrelevant. Experiment 2 showed a similar preference for words that were semantically related to an item held in working memory. We suggest that keeping an item active in working memory automatically results in a tendency for attention to be “attracted” to stimuli that are related to that item either visually or semantically.     

Attentional capture by abrupt onsets and feature singletons produces inhibitory surrounds

Two experiments found that form discriminations to a target item were inhibited when the target appeared adjacent to an attentionally salient item. Experiment 1 manipulated the attentional salience of an irrelevant color singleton through the attentional set adopted by the subjects. Color singletons captured attention when the target was itself a feature singleton, but not when the target was defined as a conjunction of features. Attentional capture was accompanied by an inhibitory region (i.e., slowed target reaction times), which dissipated with distance from the color singleton. In Experiment 2, the attentional salience of abrupt onsets and color singletons was compared. Irrelevant abrupt onsets captured attention, whereas irrelevant color singletons failed to capture attention. Again, an inhibitory region surrounded the attentionally salient abrupt onsets, but not the color singletons. The results are discussed in the context of current models of visual spatial attention and suggest a distinction between attentional preparation and attentional selection.     

Uniqueness of abrupt visual onset in capturing attention

Yantis and Jonides (1984) demonstrated that the detection of a target in visual search was markedly enhanced when the target was presented as an abruptly onset character embedded among other characters whose presentation was not characterized by abrupt onset. This effect was attributed to a shift of attention caused by abrupt onset. In the present article, we report experiments investigating whether abrupt onset is simply one member of a large class of stimulus characteristics, all of which are capable of capturing attention. To test this possibility, we compared abrupt onset with differences in stimulus luminance and hue to determine whether these also could elicit shifts of attention. They could not.     

Interactive activation in visual word recognition: constraints imposed by the joint effects of spatial attention and semantics

Two lexical-decision experiments investigated the effects of semantic priming and stimulus intensity when target location varied and was cued by an abrupt onset. In Experiment 1, the spatial cue was a good predictor of target location, and in Experiment 2 it was not. The results indicate that word recognition processes were postponed until spatial attention was focused on the target and that whether attention further affected word recognition depended on cue validity. The joint effects of cue validity and priming interacted when cue validity was high but were additive when cue validity was low. The joint effects of stimulus intensity and semantic priming also varied according to cue validity (i.e., interactive when high and additive when low). The results are discussed in terms of their implications for visual word recognition, the distinction between exogenous and endogenous spatial attention, and how attention is affected by visual word recognition processes.