Area activation: a computational model of saccadic selectivity in visual search

The Area Activation Model (Pomplun, Reingold, Shen, & Williams, 2000) is a computational model predicting the statistical distribution of saccadic endpoints in visual search tasks. Its basic assumption is that saccades in visual search tend to foveate display areas that provide a maximum amount of task‐relevant information for processing during the subsequent fixation. In the present study, a counterintuitive prediction by the model is empirically tested, namely that saccadic selectivity towards stimulus features depends on the spatial arrangement of search items. We find good correspondence between simulated and empirically observed selectivity patterns, providing strong support for the Area Activation Model.     

Attention modulates saccadic inhibition magnitude

Visual transient events during ongoing eye movement tasks inhibit saccades within a precise temporal window, spanning from around 60–120 ms after the event, having maximum effect at around 90 ms. It is not yet clear to what extent this saccadic inhibition phenomenon can be modulated by attention. We studied the saccadic inhibition induced by a bright flash above or below fixation, during the preparation of a saccade to a lateralized target, under two attentional manipulations. Experiment 1 demonstrated that exogenous precueing of a distractor's location reduced saccadic inhibition, consistent with inhibition of return. Experiment 2 manipulated the relative likelihood that a distractor would be presented above or below fixation. Saccadic inhibition magnitude was relatively reduced for distractors at the more likely location, implying that observers can endogenously suppress interference from specific locations within an oculomotor map. We discuss the implications of these results for models of saccade target selection in the superior colliculus.     

On the generality of the displaywide contingent orienting hypothesis: Can a visual onset capture attention without top-down control settings for displaywide onset?

The contingent orienting hypothesis (Folk, Remington, & Johnston, 1992) states that attentional capture is contingent on top-down control settings induced by task demands. Past studies supporting this hypothesis have identified three kinds of top-down control settings: for target-specific features, for the strategy to search for a singleton, and for visual features in the target display as a whole. Previously, we have found stimulus-driven capture by onset that was not contingent on the first two kinds of settings (Yeh & Liao, 2008). The current study aims to test the third kind: the displaywide contingent orienting hypothesis (Gibson & Kelsey, 1998). Specifically, we ask whether an onset stimulus can still capture attention in the spatial cueing paradigm when attentional control settings for the displaywide onset of the target are excluded by making all letters in the target display emerge from placeholders. Results show that a preceding uninformative onset cue still captured attention to its location in a stimulus-driven fashion, whereas a color cue captured attention only when it was contingent on the setting for displaywide color. These results raise doubts as to the generality of the displaywide contingent orienting hypothesis and help delineate the boundary conditions on this hypothesis.     

Postattentive vision

Much research has examined preattentive vision: visual representation prior to the arrival of attention. Most vision research concerns attended visual stimuli; very little research has considered postattentive vision. What is the visual representation of a previously attended object once attention is deployed elsewhere? The authors argue that perceptual effects of attention vanish once attention is redeployed. Experiments 1-6 were visual search studies. In standard search, participants looked for a target item among distractor items. On each trial, a new search display was presented. These tasks were compared to repeated search tasks in which the search display was not changed. On successive trials, participants searched the same display for new targets. Results showed that if search was inefficient when participants searched a display the first time, it was inefficient when the same, unchanging display was searched the second, fifth, or 350th time. Experiments 7 and 8 made a similar point with a curve tracing paradigm. The results have implications for an understanding of scene perception, change detection, and the relationship of vision to memory.     

Attentional capture by color without any relevant attentional set

The aim of the present study was to investigate mechanisms underlying attentional capture by color. Previous work has shown that a color singleton is able to summon attention only in the presence of a relevant attentional set, whereas when a color singleton is not useful for a task, evidence for purely stimulus-driven attentional capture is controversial. Three visual search experiments (T-L task) were conducted using a method different from that based on set sizes, consisting of monitoring target-singleton distance in a unique display size. In Experiment 1, we demonstrated that attention can be summoned in a real stimulus-driven manner by an irrelevant color singleton. Experiment 2A extended this observation, showing that the color singleton attracted attention even when capture was detrimental. However, Experiment 2B showed that such capture can be strategically prevented. Finally, in Experiment 3, we examined whether such a capture was due to a spatial shift or to a filtering cost, providing evidence supporting the shift hypothesis. Stimulus-driven capture was observed when color was neither the defining nor the reported target attribute (Yantis, 1993) and when subjects naive of visual search tasks were used. The present results give experimental support to many contemporary models of visual attention.     

Contextual cuing by global features

In visual search tasks, attention can be guided to a target item--appearing amidst distractors--on the basis of simple features (e.g., finding the red letter among green). Chun and Jiang's (1998) contextual cuing effect shows that reaction times (RTs) are also speeded if the spatial configuration of items in a scene is repeated over time. In the present studies, we ask whether global properties of the scene can speed search (e.g., if the display is mostly red, then the target is at location X). In Experiment 1A, the overall background color of the display predicted the target location, and the predictive color could appear 0, 400, or 800 msec in advance of the search array. Mean RTs were faster in predictive than in nonpredictive conditions. However, there was little improvement in search slopes. The global color cue did not improve search efficiency. Experiments 1B-1F replicated this effect using different predictive properties (e.g., background orientation-texture and stimulus color). The results showed a strong RT effect of predictive background, but (at best) only a weak improvement in search efficiency. A strong improvement in efficiency was found, however, when the informative background was presented 1,500 msec prior to the onset of the search stimuli and when observers were given explicit instructions to use the cue (Experiment 2).     

Task-irrelevant direct gaze facilitates visual search for deviant facial expression

The detection of emotional expression is important particularly when the expression is directed towards the viewer. Therefore, we conjectured that the efficiency in visual search for deviant emotional expression is modulated by gaze direction, which is one of the primary clues for encoding the focus of social attention. To examine this hypothesis, two visual search tasks were conducted. In Emotional Face Search, the participants were required to detect an emotional expression amongst distractor faces with neutral expression; in Neutral Face Search they were required to detect a neutral target among emotional distractors. The results revealed that target detection was accelerated when the target face had direct gaze compared to averted gaze for fearful, angry, and neutral targets, but no effect of distractor gaze direction was observed. An additional experiment including multiple display sizes has shown a shallower search slope in search for a target face with direct gaze than that with averted gaze, indicating that the advantage of a target face with direct gaze is attributable to efficient orientation of attention towards target faces. These results indicate that direct gaze facilitates detection of target face in visual scenery even when gaze discrimination is not the primary task at hand.     

Effects of task-irrelevant grouping on visual selection in partial report

Perceptual grouping modulates performance in attention tasks such as partial report and change detection. Specifically, grouping of search items according to a task-relevant feature improves the efficiency of visual selection. However, the role of task-irrelevant feature grouping is not clearly understood. In the present study, we investigated whether grouping of targets by a task-irrelevant feature influences performance in a partial-report task. In this task, participants must report as many target letters as possible from a briefly presented circular display. The crucial manipulation concerned the color of the elements in these trials. In the sorted-color condition, the color of the display elements was arranged according to the selection criterion, and in the unsorted-color condition, colors were randomly assigned. The distractor cost was inferred by subtracting performance in partial-report trials from performance in a control condition that had no distractors in the display. Across five experiments, we manipulated trial order, selection criterion, and exposure duration, and found that attentional selectivity was improved in sorted-color trials when the exposure duration was 200 ms and the selection criterion was luminance. This effect was accompanied by impaired selectivity in unsorted-color trials. Overall, the results suggest that the benefit of task-irrelevant color grouping of targets is contingent on the processing locus of the selection criterion.     

New insights on eye blindness and hand sight: Temporal constraints of visuo-motor networks

Pioneer experiments on saccadic suppression have shown that this effect is not followed by motor disorientation: Conscious perception of a target displacement can be dissociated from correct manual target reaching. It has subsequently been demonstrated that movement corrections with the same latency and spatial characteristics can be produced in conditions allowing perceptual awareness of perturbation of a target as in condition inducing saccadic suppression. In addition to the qualitative dissociation between motor performance and conscious awareness, quantitative temporal dissociations in action can be observed by manipulating different features of the visual target. When the target of an ongoing simple action is perturbed, a temporal advantage is found for responses to perturbations of location relative to colour and shape. Furthermore, there seems to be a temporal advantage for automatic motor corrections made in response to a target displacement as compared to other responses (other ongoing movement adjustments, movement interruption, conditional motor response such as pressing a key, verbal response, delayed matching-to-sample tasks). Thus, this paper reviews evidence for the fact that the temporal characteristics of any given response to a stimulus are dependent both on the sensory processes and on the type of response generated. Accordingly, identification responses (such as verbal report) to a visual stimulus are much slower than motor corrections of an ongoing movement in response to a target location change because of different processing times of the stimulus features (“What” compared to “Where”) and of the response itself (“What” compared to “How”). The existence of two continua (What/Where and What/How) is proposed between these two extreme stimulus- response combinations. This model may be a useful framework to better understand visuo-motor transformations and the network of connections between visual and motor areas.     

Effects of relevant and irrelevant color singletons on inhibition of return and attentional capture

We tested whether color singletons lead to saccadic and manual inhibition of return (IOR; i.e., slower responses at cued locations) and whether IOR depended on the relevance of the color singletons. The target display was preceded by a nonpredictive cue display. In three experiments, half of the cues were response-relevant, because participants had to perform a discrimination task at the cued location. With the exception of Experiment 2, none of the cue colors matched the target color. We observed saccadic IOR after color singletons, which was greater for slow than for fast responses. Furthermore, when the relevant cue color matched the target color, we observed attentional capture (i.e., faster responses at cued locations) with rapid responses, but IOR with slower responses, which provides evidence for attentional deallocation. When the cue display was completely response-irrelevant in two additional experiments, we did not find evidence for IOR. Instead, we found attentional capture when the cue color matched the target color. Also, attentional capture was greater for rapid responses and with short cue–target intervals. Thus, IOR emerges when cues are relevant and do not match the target color, whereas attentional capture emerges with relevant and irrelevant cues that match the target color.     

Visual search by children: the effect of background variation and the use of visual cues

A visual search task was used to assess developmental changes in children's selective attention to specified portions of a visual display. Seven-, nine-, and twelve-year-olds searched for a target letter in matrices of letters, each of which was centered in a form. On each matrix the forms were uniform or they varied in color, shape or both color and shape. The children searched with either no cues or with color or shape cues that could be used to restrict and speed their search. In all conditions search speed increased with age. Comparisons among conditions revealed three different age trends. With no cues children of all ages were slowed comparably by variation in background forms. With color cues all children increased their search speeds relative to no-cue speeds, suggesting selective fixation, but the 12-year-olds benefited most from the cues. With shape cues the search speed of 9- and 12-year-olds was slowed while that of 7-year-olds was either unchanged or was slowed only slightly. These different trends caution against overly general statements of changes with age in selective attention, and highlight the need to consider both particular task requirements and the processes used by subjects of different ages in tasks requiring selective attention.     

Control of reflexive and voluntary saccades in the gap effect

In two experiments, we examined whether voluntary and reflexive saccades shared a common fixation disengagement mechanism, Participants were required to perform a variety of tasks, each requiring a different level of information processing of the display prior to execution of the saccade. In Experiment 1, participants executed either a prosaccade or an antisaccade upon detecting a stimulus array. In Experiment 2, participants executed a prosaccade to a stimulus array only if the array contained a target item. The target could be a line (easy search) or a digit (difficult search). The critical manipulation in both experiments was the relative timing between the removal of the fixation stimulus and the onset of the stimulus array. In both experiments, it was found that saccadic latencies were shortest when the fixation stimulus was removed before the onset of the stimulus array—a gap effect. It was concluded that reflexive and voluntary saccades share a common fixation disengagement mechanism that is largely independent of higher level cognitive processes.     

Control' of reflexive and voluntary saccades in the gap effect.

In two experiments, we examined whether voluntary and reflexive saccades shared a common fixation disengagement mechanism. Participants were required to perform a variety of tasks, each requiring a different level of information processing of the display prior to execution of the saccade. In Experiment 1, participants executed either a prosaccade or an antisaccade upon detecting a stimulus array. In Experiment 2, participants executed a prosaccade to a stimulus array only if the array contained a target item. The target could be a line (easy search) or a digit (difficult search). The critical manipulation in both experiments was the relative timing between the removal of the fixation stimulus and the onset of the stimulus array. In both experiments, it was found that saccadic latencies were shortest when the fixation stimulus was removed before the onset of the stimulus array--a gap effect. It was concluded that reflexive and voluntary saccades share a common fixation disengagement mechanism that is largely independent of higher level cognitive processes.     

The transference of visual search between two unrelated tasks: Measuring the temporal characteristics of carry-over

Investigations into the persistence of top-down control settings do not accurately reflect the nature of dynamic tasks. They typically involve extended practice with an initial task, and this initial task usually shares similar stimuli with a second task. Recent work shows that visual attention and search can be affected by limited exposure to a preceding, unrelated task, and the current study explored the temporal characteristics of this “carry-over” effect. Thirty-four participants completed one, four, or eight simple letter searches and then searched a natural scene. The spatial layout of letters influenced spread of search in the pictures, and this was further impacted by the time spent in the initial task, yet the carry-over effect diminished quickly. The results have implications for theories of top-down control and models that attempt to predict search in natural scenes. They are also relevant to real-world tasks in which performance is closely related to visual attention and search.     

Does conspicuity enhance distraction? Saliency and eye landing position when searching for objects

While visual saliency may sometimes capture attention, the guidance of eye movements in search is often dominated by knowledge of the target. How is the search for an object influenced by the saliency of an adjacent distractor? Participants searched for a target amongst an array of objects, with distractor saliency having an effect on response time and on the speed at which targets were found. Saliency did not predict the order in which objects in target-absent trials were fixated. The within-target landing position was distributed around a modal position close to the centre of the object. Saliency did not affect this position, the latency of the initial saccade, or the likelihood of the distractor being fixated, suggesting that saliency affects the allocation of covert attention and not just eye movements.     

Measuring the time course of selection during visual search

In visual search tasks, observers can guide their attention towards items in the visual field that share features with the target item. In this series of studies, we examined the time course of guidance toward a subset of items that have the same color as the target item. Landolt Cs were placed on 16 colored disks. Fifteen distractor Cs had gaps facing up or down while one target C had a gap facing left or right. Observers searched for the target C and reported which side contained the gap as quickly as possible. In the absence of other information, observers must search at random through the Cs. However, during the trial, the disks changed colors. Twelve disks were now of one color and four disks were of another color. Observers knew that the target C would always be in the smaller color set. The experimental question was how quickly observers could guide their attention to the smaller color set. Results indicate that observers could not make instantaneous use of color information to guide the search, even when they knew which two colors would be appearing on every trial. In each study, it took participants 200–300 ms to fully utilize the color information once presented. Control studies replicated the finding with more saturated colors and with colored C stimuli (rather than Cs on colored disks). We conclude that segregation of a display by color for the purposes of guidance takes 200–300 ms to fully develop.     

On the distinction between visual salience and stimulus-driven attentional capture.

It is often assumed that the efficient detection of salient visual objects in search reflects stimulus-driven attentional capture. Evidence for this assumption, however, comes from tasks in which the salient object is task relevant and therefore may elicit a deliberate deployment of attention. In 9 experiments, participants searched for a nonsalient target (vertical among tilted bars). In each display, 1 bar was highly salient in a different dimension (e.g., color or motion). When the target and salient elements coincided only rarely, reducing the incentive to attend deliberately to the salient stimuli, response times depended little on whether the target was salient, although some interesting exceptions were observed. It is concluded that efficient selection of an element in visual search does not constitute evidence that the element captures attention in a purely stimulus-driven fashion.     

Saccades predict and synchronize to visual rhythms irrespective of musical beats

ABSTRACT

Music has been shown to entrain movement. One of the body’s most frequent movements, saccades, are arguably subject to a timer that may also be susceptible to musical entrainment. We developed a continuous and highly-controlled visual search task and varied the timing of the search target presentation, it was either gaze-contingent, tap-contingent, or visually-timed. We found: (1) explicit control of saccadic timing is limited to gross duration variations and imprecisely synchronized; (2) saccadic timing does not implicitly entrain to musical beats, even when closely aligned in phase; (3) eye movements predict visual onsets produced by motor-movements (finger-taps) and externally-timed sequences, beginning fixation prior to visual onset; (4) eye movement timing can be rhythmic, synchronizing to both motor-produced and externally timed visual sequences; each unaffected by musical beats. These results provide evidence that saccadic timing is sensitive to the temporal demands of visual tasks and impervious to influence from musical beats.     

Response times and eye movements in feature and conjunction search as a function of target eccentricity

In four experiments, saccadic eye movements, reaction times (RTs), and accuracy were measured as observers searched for feature or conjunction targets presented at several eccentricities. A conjunction search deficit, evidenced by a large eccentricity effect on RTs, accuracy, and number of saccades, was seen in Experiments 1A and 1B. Experiment 2 indicated that, when saccades were precluded, there was an even larger eccentricity effect for conjunction search targets. In Experiment 3, practice in a conjunction search task allowed both RT and number of saccades to become independent of eccentricity. Additionally, there was evidence of feature-based selectivity in that observers were more likely to fixate distractors that had the same contrast as the target. Results are consistent with the view that the oculomotor and attentional systems are functionally linked and provide constraints for models of visual attention and search.     

Immunity to attentional capture at ignored locations

Certain stimuli have the power to rapidly and involuntarily capture spatial attention against our will. The present study investigated whether such stimuli capture spatial attention even when they appear in ignored regions of visual space. In other words, which force is more powerful: attentional capture or spatial filtering? Participants performed a spatial cuing task, searching for a letter target defined by color (e.g., green) and then reporting that letter’s identity. Two of the four search locations were always irrelevant. Unlike many previous experiments, participants were forced to ignore these locations because they always contained a target-colored distractor letter. Experiment 1 assessed capture by a salient-but-irrelevant abrupt onset cue appearing 150 ms before the search display. One might expect onset cues to capture attention even at ignored locations given that the main function of capture, presumably, is to rapidly alert observers to unexpected yet potentially important stimuli. However, they did not. Experiment 2 replicated this result with a different neutral baseline condition. Experiment 3 replicated the absence of capture effects at ignored locations with an even more potent stimulus: a relevant cue possessing the target color. We propose that people are effectively immune to attentional capture by objects in ignored locations – spatial filtering dominates attentional capture.