Flexible cue combination in the guidance of attention in visual search

Hodsoll and Humphreys (2001) have assessed the relative contributions of stimulus-driven and user-driven knowledge on linearly- and nonlinearly separable searches. However, the target feature used to determine linear separability in their task (i.e., target size) was required to locate the target. In the present work, we investigated the contributions of stimulus-driven and user-driven knowledge when a linearly- or a nonlinearly-separable feature is available but not required for target identification. We asked observers to complete a series of standard color × orientation conjunction searches in which target size was either linearly- or nonlinearly separable from the size of the distractors. When guidance by color × orientation and guidance by size information are both available, observers rely on whichever information results in the best search efficiency. This is the case irrespective of whether we provide target foreknowledge by blocking stimulus conditions, suggesting that feature information is used in both a stimulus-driven and a user-driven fashion.     

The path of visual attention

Visual cuing is one paradigm often used to study object- and space-based visual selective attention. A primary finding is that shifts of attention within an object can be accomplished faster than equidistant shifts between objects. The present study used a visual cuing paradigm to examine how an object's size (i.e., internal distance) and shape, influences object- and space-based visual selective attention. The first two experiments manipulated object size and compared attentional shift performance with objects where the within-object distance between cued and uncued target locations was either equal to the between-object distance (1:1 ratio condition) or three times the between-object distance (3:1 ratio condition). Within-object shifts took longer for the larger objects, but an advantage over between-object shifts was still evident. Influences associated with the shapes of the larger objects suggested by the results of the first two experiments were tested and rejected in Experiment 3. Overall, the results indicate that within-object shifts of attention become slower as the within-object distance increases, but nevertheless are still accomplished faster than between-object shifts.     

On the limits of top-down control of visual selection

In the present study, observers viewed displays in which two equally salient color singletons were simultaneously present. Before each trial, observers received a word cue (e.g., the word red, or green) or a symbolic cue (a circle colored red or green) telling them which color singleton to select on the upcoming trial. Even though many theories of visual search predict that observers should be able to selectively attend the target color singleton, the results of the present study show that observers could not select the target singleton without interference from the irrelevant color singleton. The results indicate that the irrelevant color singleton captured attention. Only when the color of the target singleton remained the same from one trial to the next was selection perfect--an effect that is thought to be the result of passive automatic intertrial priming. The results of the present study demonstrate the limits of top-down attentional control.     

Explicit awareness supports conditional visual search in the retrieval guidance paradigm

In four experiments we explored whether participants would be able to use probabilistic prompts to simplify perceptually demanding visual search in a task we call the retrieval guidance paradigm. On each trial a memory prompt appeared prior to (and during) the search task and the diagnosticity of the prompt(s) was manipulated to provide complete, partial, or non-diagnostic information regarding the target's color on each trial (Experiments 1–3). In Experiment 1 we found that the more diagnostic prompts was associated with faster visual search performance. However, similar visual search behavior was observed in Experiment 2 when the diagnosticity of the prompts was eliminated, suggesting that participants in Experiment 1 were merely relying on base rate information to guide search and were not utilizing the prompts. In Experiment 3 participants were informed of the relationship between the prompts and the color of the target and this was associated with faster search performance relative to Experiment 1, suggesting that the participants were using the prompts to guide search. Additionally, in Experiment 3 a knowledge test was implemented and performance in this task was associated with qualitative differences in search behavior such that participants that were able to name the color(s) most associated with the prompts were faster to find the target than participants who were unable to do so. However, in Experiments 1–3 diagnosticity of the memory prompt was manipulated via base rate information, making it possible that participants were merely relying on base rate information to inform search in Experiment 3. In Experiment 4 we manipulated diagnosticity of the prompts without manipulating base rate information and found a similar pattern of results as Experiment 3. Together, the results emphasize the importance of base rate and diagnosticity information in visual search behavior. In the General discussion section we explore how a recent computational model of hypothesis generation (HyGene; Thomas, Dougherty, Sprenger, & Harbison, 2008), linking attention with long-term and working memory, accounts for the present results and provides a useful framework of cued recall visual search.     

Spatially mediated capacity limits in attentive visual perception

Modern theories conceptualize visual selective attention as a competition between objects for the control of cortical receptive fields (RFs). Implicit in this framework is the suggestion that spatially proximal objects, which draw from overlapping pools of RFs, should be more difficult to represent in parallel and with excess capacity than spatially separated objects. The present experiments tested this prediction using analysis of response time distributions in a redundant-targets letter identification task. Data revealed that excess-capacity parallel processing is possible when redundant targets are widely separated within the visual field, but that capacity is near fixed when targets are adjacent. Even at the largest separations tested, however, processing capacity remained strongly limited.     

Top-down and bottom-up control of visual selection

The present paper argues for the notion that when attention is spread across the visual field in the first sweep of information through the brain visual selection is completely stimulus-driven. Only later in time, through recurrent feedback processing, volitional control based on expectancy and goal set will bias visual selection in a top-down manner. Here we review behavioral evidence as well as evidence from ERP, fMRI, TMS and single cell recording consistent with stimulus-driven selection. Alternative viewpoints that assume a large role for top-down processing are discussed. It is argued that in most cases evidence supporting top-down control on visual selection in fact demonstrates top-down control on processes occurring later in time, following initial selection. We conclude that top-down knowledge regarding non-spatial features of the objects cannot alter the initial selection priority. Only by adjusting the size of the attentional window, the initial sweep of information through the brain may be altered in a top-down way.     

Time course of visual attention across perceptual levels and objects

Theories of shifts of visual attention based on attentional blink or dwell time do not directly address shifts of attention across different levels (global or local) involving multiple objects. Two experiments were conducted employing the attentional dwell time paradigm to investigate the shifts of visual attention between objects selected at same or different levels. Participants were instructed to identify two successive compound stimuli at a pre-specified level (global or local) presented at two different locations with variable SOA. The initial pair of locations in which the stimulus was presented was fixed in Experiment 1 but not in Experiment 2. Experiment 1 results showed very little impairment for second target identification when both the targets were at the global level. Attentional shift was better with both targets at the same level compared to different levels. Experiment 2 results showed that local followed by global target identification is difficult at short SOAs compared to other conditions. The results indicate that scope of attention affects the time course of visual attention. Global processing could be performed with very little capacity limitation simultaneously with distributed attention. The default mode of attention might be distributed and attention becomes focused for target identification. Different mechanisms may underlie shifts in focused attention between different locations and changes in attentional set required by changes in perceptual levels.     

Disgust-specific modulation of early attention processes

Although threatening images are known to attract and keep our attention, little is known about the existence of emotion-specific attention effects. In this study (N = 46), characteristics of an anticipated, disgust-specific effect were investigated by means of a covert orienting paradigm incorporating pictures that were either disgust-evoking, fear-evoking, happiness-evoking or neutral. Attention adhesion to these pictures was measured by the time necessary to identify a peripheral target, presented 100, 200, 500, or 800 ms after picture onset. Main results showed that reaction times were delayed for targets following the disgust-evoking pictures by 100 and 200 ms, suggesting that only these pictures temporarily grabbed hold of participants' attention. These delays were similar for ignore- and attend-instructions, and they were not affected by the participants' anxiety levels or disgust sensitivity. The disgust-specific influence on early attention processes thus appeared very robust, occurring in the majority of participants and without contribution of voluntary- and strategic-attention processes. In contrast, a smaller and less reliable effect of all emotional (arousing) pictures was present in the form of delayed responding in the 100 ms cue-target interval. This effect was more transitory and apparent only in participants with relatively high state-anxiety scores. Practical and theoretical consequences of these findings are discussed.     

Investigating sustained attention ability in the elderly by using two different approaches: Inhibiting ongoing behavior versus responding on rare occasions

Previous studies on sustained attention ability in the elderly produced inconsistent results. The aim of this study was to evaluate sustained attention performance in younger and older individuals by using, in a within-subjects design, two versions of the same task (the sustained attention to response task, SART) in which only in the response mode differed: in a traditionally formatted task (TFT), subjects had to respond to rare targets, and in a Go/No-Go task they had to withhold response to rare targets. Results showed that in the TFT SART only the older group exhibited a vigilance decrement. On the contrary, only young individuals showed a vigilance decrement in the Go/No-Go SART. These results showed that older individuals, who also reported less mind wandering and a higher level of motivation, exhibited preserved sustained attention ability in the Go/No-Go SART, which could be explained by increased engagement of cognitive control mechanisms in this population. The discrepancy in performance depending on the approach used also underlines the need for further studies on the nature of attention failures and their underlying mechanisms.     

Attentional control settings prevent abrupt onsets from capturing visual spatial attention

When a visual distractor appears earlier than a visual target in a target-detection task, response time is faster if the distractor appears at the same location as the target. When a visual distractor appears concurrently with a visual target in a target-detection task, response time is slowed relative to when no distractor is presented. Both effects have been taken as evidence of the capture of visual spatial attention, yet capture by early distractors is contingent on top-down attentional control settings (ACSs), and capture by concurrent distractors is not. The present study evaluated whether this incongruity is attributable to the timing of distractors (earlier than vs. concurrently with the target), or to the employed comparisons (same location/different location vs. distractor/no distractor). Using a task that presented both early and concurrent distractors, we observed that, regardless of timing, capture was contingent on ACSs when assessed by the same-location/different-location comparison. This result suggests that, although irrelevant stimuli cause nonspatial purely stimulus-driven effects, the capture of visual spatial attention is contingent on ACSs.     

Endogenous saccades are preceded by shifts of visual attention: evidence from cross-saccadic priming effects

The present study examines whether endogenous saccades are preceded by shifts of attention. Three experiments are reported in which participants were required to execute a saccadic eye movement to a certain location and to subsequently identify the orientation of a target triangle. Prior to the execution of the saccade a prime was presented, which was compatible or incompatible with the target. A priming effect (faster responses in the compatible condition than in the incompatible condition) occurred only when the prime was presented at the saccade destination, and this effect was larger when the prime was presented during oculomotor programming than when it was presented prior to oculomotor programming. The results indicate that an endogenous shift of attention precedes endogenous saccades, providing further support for theories of visual selection that assume a tight coupling between attention and saccades.     

Emotional valence of spoken words influences the spatial orienting of attention

The influence of the affective content of speech on the spatial orienting of auditory attention was examined by adapting the dot probe task. Two words, one of which was emotional in one quarter of the trials, were played simultaneously from a left- and a right-located loudspeaker, respectively, and followed (or not) by a lateralized beep to be detected (Experiments 1 and 2) or localized (Experiment 3). Taboo words induced attentional biases towards their spatial location in all experiments, as did negative words in Experiment 3, but not positive words. Thus, in audition, the identification of an emotional word automatically activates the information about its spatial origin. Moreover, for both word types, attentional biases were only observed when the emotional word was presented on the participant's right side, suggesting that the dominant left hemisphere processing of words constrains the occurrence of spatial congruency effects.     

Spatial distribution of attentional bias in visuo-spatial working memory following multiple cues

When attention is focused on one location, its spatial distribution depends on many factors, such as the distance between the attended location and the target location, the presence of visual meridians in between them, and the way, endogenous or exogenous, by which attention is oriented. However, it is not well known how attention distributes when more than one location is endogenously or exogenously cued, which was the focus of the current study. Furthermore, the distribution of attention has been manly investigated in perception. In the present study we faced this issue from a different perspective, by examining the spatial distribution of the attentional bias in visuo-spatial working memory (VSWM), when attention is oriented either exogenously or endogenously, i.e., after two peripheral vs. central symbolic cues (also manipulating cue–target predictability). Results indicated a systematic difference between endogenous and exogenous attention regarding the distribution of the attentional bias over VSWM. In fact, attentional bias following endogenous cues was affected by the presence of visual meridians and by the split of the attentional focus, converging in a unipolar attentional distribution, independently of cue–target predictability. On the other hand, when pulled by exogenous cues, attention distributed uni-modally or multi-modally depending on the distance between the cued locations, with larger effects for highly predictive cues. Results are discussed in terms of space-based, object-based and perceptual grouping mechanisms.     

Are spatial responses to visuospatial stimuli and spoken responses to auditory letters ideomotor-compatible tasks? Examination of set-size effects on dual-task interference

Previous studies have paired a visual-manual Task 1 with an auditory-vocal Task 2 to evaluate whether the psychological refractory period (PRP) effect is eliminated with two ideomotor-compatible tasks (for which stimuli resemble the response feedback). The present study varied the number of stimulus-response alternatives for Task 1 in three experiments to determine whether set-size and PRP effects were absent, as would be expected if the tasks bypass limited-capacity response-selection processes. In Experiments 1 and 2, the visual-manual task was used as Task 1, with lever-movement and keypress responses, respectively. In Experiment 3, the auditory-vocal task was used as Task 1 and the visual-manual task as Task 2. A significant lengthening of reaction time for 4 vs. 2 alternatives was found for the visual-manual Task 1 and the Task 2 PRP effect in Experiments 1 and 2, suggesting that the visual-manual task is not ideomotor compatible. Neither effect of set size was significant for the auditory-vocal Task 1 in Experiment 3, but there was still a Task 2 PRP effect. Our results imply that neither version of the visual-manual task is ideomotor compatible; other considerations suggest that the auditory-vocal task may also still require response selection.     

Simultaneous attentional guidance by working-memory and selection history reveals two distinct sources of attention

Recent theories of attention have proposed that selection history is a separate, dissociable source of information that influences attention. The current study sought to investigate the simultaneous involvement of selection history and working-memory on attention during visual search. Experiments 1 and 2 used target feature probability to manipulate selection history and found significant effects of both working-memory and selection history, although working-memory dominated selection history when they cued different locations. Experiment 3 eliminated the contribution of voluntary refreshing of working-memory and replicated the main effects, although selection history became dominant. Using the same methodology, but with reduced probability cue validity, both effects were present in Experiment 4 and did not significantly differ in their contribution to attention. Effects of selection history and working-memory never interacted. These results suggest that selection history and working-memory are separate influences on attention and have little impact on each other. Theoretical implications for models of attention are discussed.     

The components of visual attention and the ubiquitous Simon effect

Spatial responding is influenced by the degree of correspondence between the stimulus–response (S–R) code activated by the target's task-irrelevant location and the S–R code activated by the target's non-spatial, task-relevant feature. A generally accepted explanation of this “Simon effect,” named after its discoverer, is that there is a natural tendency to respond towards the source of stimulation. First we will review the ubiquity of the Simon effect. Then we will review the literature, including our own studies when appropriate, that has explored the relationship between the Simon effect and the components of attention: alertness, orienting and executive control, with an emphasis on visual orienting. The Simon effect is reduced when participants are not alert and when executive control is effective in filtering out the irrelevant location information. When attention is oriented endogenously, or is captured exogenously by uninformative peripheral stimulation, the Simon effect is additive with attentional facilitation (i.e., the Simon effect is the same magnitude for targets presented at attended and unattended locations). Yet, some forms of orienting, such as orienting directed by gaze and biased by inhibition of return, modulate the Simon effect. We will explore the implications of these patterns of additivity and interaction for our understanding of both the Simon effect and spatial attention.     

Altering attentional control settings causes persistent biases of visual attention

Attentional control settings have an important role in guiding visual behaviour. Previous work within cognitive psychology has found that the deployment of general attentional control settings can be modulated by training. However, research has not yet established whether long-term modifications of one particular type of attentional control setting can be induced. To address this, we investigated persistent alterations to feature search mode, also known as an attentional bias, towards an arbitrary stimulus in healthy participants. Subjects were biased towards the colour green by an information sheet. Attentional bias was assessed using a change detection task. After an interval of either 1 or 2 weeks, participants were then retested on the same change detection task, tested on a different change detection task where colour was irrelevant, or were biased towards an alternative colour. One experiment included trials in which the distractor stimuli (but never the target stimuli) were green. The key finding was that green stimuli in the second task attracted attention, despite this impairing task performance. Furthermore, inducing a second attentional bias did not override the initial bias toward green objects. The attentional bias also persisted for at least two weeks. It is argued that this persistent attentional bias is mediated by a chronic change to participants’ attentional control settings, which is aided by long-term representations involving contextual cueing. We speculate that similar changes to attentional control settings and continuous cueing may relate to attentional biases observed in psychopathologies. Targeting these biases may be a productive approach to treatment.     

Testing the limits of cognitive plasticity in older adults: application to attentional control

Laboratory based training studies suggest that older adults can benefit from training in tasks that tap control aspects of attention. This was further explored in the present study in which older and younger adults completed an adaptive and individualized dual-task training program. The testing-the-limits approach was used [Lindenberger, U., & Baltes, P. B. (1995). Testing-the-limits and experimental simulation: Two methods to explicate the role of learning in development. Human Development, 38, 349-360.] in order to gain insight into how attentional control can be improved in older adults. Results indicated substantial improvement in overlapping task performance in both younger and older participants suggesting the availability of cognitive plasticity in both age groups. Improvement was equivalent among age groups in response speed and performance variability but larger in response accuracy for older adults. The results suggest that time-sharing skills can be substantially improved in older adults.     

The automatic orienting of attention to goal-relevant stimuli

It is often assumed that attention is automatically allocated to stimuli relevant to one’s actual goals. However, the existing evidence for this idea is limited in several ways. We investigated whether words relevant to a person’s current goal influence the orienting of attention even when an intention to attend to the goal-relevant stimuli is not present. In two experiments, participants performed a modified spatial cueing paradigm combined with a second task that induced a goal. The results of the experiments showed that the induced goal led to the orientation of attention to goal-relevant words in the spatial cueing task. This effect was not found for words semantically related to the goal-relevant words. The results provide evidence for motivational accounts of attention, which state that the automatic allocation of attention is guided by the current goals of a person.     

The effects of video game playing on attention, memory, and executive control

Expert video game players often outperform non-players on measures of basic attention and performance. Such differences might result from exposure to video games or they might reflect other group differences between those people who do or do not play video games. Recent research has suggested a causal relationship between playing action video games and improvements in a variety of visual and attentional skills (e.g., [Green, C. S., & Bavelier, D. (2003). Action video game modifies visual selective attention. Nature, 423, 534-537]). The current research sought to replicate and extend these results by examining both expert/non-gamer differences and the effects of video game playing on tasks tapping a wider range of cognitive abilities, including attention, memory, and executive control. Non-gamers played 20+ h of an action video game, a puzzle game, or a real-time strategy game. Expert gamers and non-gamers differed on a number of basic cognitive skills: experts could track objects moving at greater speeds, better detected changes to objects stored in visual short-term memory, switched more quickly from one task to another, and mentally rotated objects more efficiently. Strikingly, extensive video game practice did not substantially enhance performance for non-gamers on most cognitive tasks, although they did improve somewhat in mental rotation performance. Our results suggest that at least some differences between video game experts and non-gamers in basic cognitive performance result either from far more extensive video game experience or from pre-existing group differences in abilities that result in a self-selection effect.