Efficient visual search without top-down or bottom-up guidance

Two types of mechanisms have dominated theoretical accounts of efficient visual search. The first are bottom-up processes related to the characteristics of retinotopic feature maps. The second are top-down mechanisms related to feature selection. To expose the potential involvement of other mechanisms, we introduce a new search paradigm whereby a target is defined only in a context-dependent manner by multiple conjunctions of feature dimensions. Because targets in a multiconjunction task cannot be distinguished from distractors either by bottom-up guidance or top-down guidance, current theories of visual search predict inefficient search. While inefficient search does occur for the multiple conjunctions of orientation with color or luminance, we find efficient search for multiple conjunctions of luminance/size, luminance/shape, and luminance/topology. We also show that repeated presentations of either targets or a set of distractors result in much faster performance and that bottom-up feature extraction and top-down selection cannot account for efficient search on their own. In light of this, we discuss the possible role of perceptual organization in visual search. Furthermore, multiconjunction search could provide a new method for investigating perceptual grouping in visual search.     

Perceptual selectivity is task dependent: The pop-out effect poops out

An attempt was made to determine why evidence for perceptual selectivity based on conceptual category (e.g., digits vs. letters) has been found in some experiments but not in others. Experiments using the partial-report paradigm find no partial-report superiority when the report is cued by category, whereas, in recent visual search studies, evidence for perceptual selectivity has been obtained for arrays containing a single item that was categorically different from the other items (e.g., a digit among letters). Using a search task, Experiment 1 investigated the possibility that the number of categorically different items in the arrays could be a determinant of selectivity. One, two, or three digits and a variable number of letters were presented on each trial, and subjects determined if a particular digit was present. No evidence of selectivity was obtained, even for the one-digit condition. Experiment 2 verified this result, and Experiment 3 extended the failure of selectivity to a search task in which the possible targets differed in color from the distractor items. In Experiment 4, subjects counted the number of digits or red letters in arrays in which black letters were the distractor items. The counting task was used to eliminate the requirement in our previous tasks that the subjects search forspecific items. Evidence was obtained in the counting task for selectivity based on the color difference but not on the categorical difference. The color stimuli used in the counting task were essentially the same as those that did not yield any evidence of selectivity in the search task. The results suggest that task demands are an important determinant of whether or not perceptual selectivity will occur.     

A salient distractor does not disrupt conjunction search

Leading theories of attention posit that bottom-up and top-down factors simultaneously affect attentional priority in visual search. Recent evidence, however, suggests that subjects may rely exclusively on top-down guidance when searching for a target defined by a specific known feature (Bacon & Egeth, 1994). In the present experiment, we addressed this issue in a conjunction search task. We investigated how searching for a green O among green Ts and red Os is affected by the presence of a distractor with a unique shape (green X), color (blue O), or both (blue X). We showed that the salient distractor does not disrupt performance on target-present trials, but produces a large interference on target-absent trials. We conclude that salience-based and top-down processes are alternative modes of guidance, rather than joint contributors in the allocation of attentional priority.     

Bottom-up guidance in visual search for conjunctions

Understanding the relative role of top-down and bottom-up guidance is crucial for models of visual search. Previous studies have addressed the role of top-down and bottom-up processes in search for a conjunction of features but with inconsistent results. Here, the author used an attentional capture method to address the role of top-down and bottom-up processes in conjunction search. The role of bottom-up processing was assayed by inclusion of an irrelevant-size singleton in a search for a conjunction of color and orientation. One object was uniquely larger on each trial, with chance probability of coinciding with the target; thus, the irrelevant feature of size was not predictive of the target's location. Participants searched more efficiently for the target when it was also the size singleton, and they searched less efficiently for the target when a nontarget was the size singleton. Although a conjunction target cannot be detected on the basis of bottom-up processing alone, participants used search strategies that relied significantly on bottom-up guidance in finding the target, resulting in interference from the irrelevant-size singleton.     

The ignoring paradox: Cueing distractor features leads first to selection, then to inhibition of to-be-ignored items

Observers find a target item more quickly when they have foreknowledge of target-defining attributes, such as identity, color, or location. However, it is less clear whether foreknowledge of nontarget attributes can also speed search. Munneke, Van der Stigchel, and Theeuwes Acta Psychologica 129:101?C107, (2008) found that observers found the target more quickly when they were cued to ignore a region of space where a target would not appear. Using a similar paradigm, we explored the effects of cueing nontarget features on search. We found that when we cued observers to ignore nontarget features, search was slowed. The results from a probe-dot detection task revealed that this slowing occurred because, paradoxically, observers initially selected an item appearing in the to-be-ignored color. Finally, we found that cueing nontarget features sped search when placeholders matching the location of the to-be-ignored color preceded presentation of the search display by at least 800?ms; thus, it appears that some limited inhibition of to-be-ignored items occurs following selection. Taken together, these results suggest that observers are unable to explicitly avoid selection of items matching known nontarget features. Instead, when nontarget features are cued, observers select the to-be-ignored feature or the locations of objects matching that feature early in search, and only inhibit them after this selection process.     

比较视觉搜索任务的认知老化研究

本研究通过增加组成图片的图形数量和改变目标图形的特征,考察老年人和大学生在比较视觉搜索任务中的眼动特点和图形特征加工的优先性。结果表明与青年人相比,老年人在比较视觉搜索过程中总注视时间和注视次数增加,平均眼跳幅度减少,对目标刺激的注视时间增加。老年人和青年人在目标刺激的注视过程中都表现出图形维度数量的优先性,即表现为颜色和形状都不同的目标刺激注视时间最短,颜色不同和形状不同的目标刺激在注视时间上差异不显著。说明老年人在比较视觉搜索过程中存在认知老化,在图形特征加工的优先性上结果和青年人一致,以上结果与年龄和研究任务有关。     

Visual marking and change detection

The preview benefit from prior exposure of response-irrelevant (distracter) objects in visual search has been accounted for in terms of top-down inhibition (i.e. visual marking), bottom-up abrupt onset capture, or asynchrony-dependent perceptual segregation. We assess the relative contribution of abrupt onset and visual marking in a paradigm combining visual search with a visual working memory task. We investigated time-based selection of multiple objects for storage in visual working memory, using a change detection paradigm (Luck and Vogel in Nature 390:279–281, 1997) with distracter preview. We varied preview exposure (short vs. long), in a series of three experiments. The contribution of asynchrony-related perceptual segregation was assessed across experiments by varying the complexity of the stimuli (colored squares, oriented bars and oriented T-shapes) and the type of change detection (color or orientation), resulting in different levels of perceptual segregation between visual elements. The results suggest that bottom-up abrupt onset, visual marking and perceptual segregation factors co-operate in time-based selection for storage in visual working memory.     

Does partial difficult search help difficult search?

Olds, Cowan, and Jolicoeur (2000a, 2000b) showed that exposure to a display that affords pop-out search a target among distractors of only one color) can assist processing of a related display that requires difficult search. They added distractors of an additional color to the initial simple display and analyzed response time distributions to show that exposure to the initial display aided subsequent search in the difficult portion (this finding was called search assistance). To test whether search assistance depends on perceptual grouping of the initial items, we presented initial items that were more difficult to group (two colors of distractors, instead of just one). The target appeared (on 50% of the trials) among distractors of two colors, and then after a delay, more distractors of those two colors were added to the display. Exposure to the initial easier portion of the display did not assist processing of the second portion of the display when the initial display contained a large number of items; we found tentative evidence for assistance with small numbers of initial items. In the Olds et al. (2000a, 2000b) studies, it was easy to group the initial distractor items, because they were all the same color. In contrast, in the present study, it was difficult to group the heterogeneous initial distractor items. Search assistance is found only when initial item grouping is relatively easy, and thus we conclude that search assistance depends on grouping.     

Part—whole information is useful in visual search for size × size but not orientation × orientation conjunctions

In visual search tasks, subjects look for a target among a variable number of distractor items. If the target is defined by a conjunction of two different features (e.g., color × orientation), efficient search is possible when parallel processing of information about color and about orientation is used to “guid” the deployment of attention to the target. Another type of conjunction search has targets defined by two instances of one type of feature (e.g., a conjunction of two colors). In this case, search is inefficient when the target is an item defined by parts of two different colors but much more efficient if the target can be described as a whole item of one color with a part of another color (Wolfe, Friedman-Hill, & Bilsky, 1994). In this paper, we show that the same distinction holds for size. “Part— whole” size × size conjunction searches are efficient; “part-part” searches are not (Experiments 1–3). In contrast, all orientation × orientation searches are inefficient (Experiments 4–6). This difference between preattentive processing of color and size, on the one hand, and orientation, on the other, may reflect structural relationships between features in real-world objects.     

自我相关信息对视觉搜索主动抑制的易化作用

工作记忆表征会以自上而下的方式调控注意选择过程, 其中一种表现就是能够对储存的干扰物表征产生注意的主动抑制, 进而提高对目标的搜索效率。另一方面, 凸显性刺激也会以自下而上的方式优先捕获注意。那么, 当保持在工作记忆中的干扰物为更具社会凸显性特征的刺激(如与自己有关的信息)时, 会对视觉搜索过程中的注意抑制产生怎样的影响, 目前尚不清楚。本研究采用短暂联结任务和工作记忆引导的视觉搜索任务范式, 探讨了自我凸显性对注意主动抑制的影响。结果发现, 相比他人和中性条件, 当工作记忆表征为自我联结刺激时, 目标搜索反应更快。本研究从行为层面为自我相关信息能够易化主动抑制过程提供了证据。     

The reconfiguration of task set has no effect on the efficiency of feature search

In this study, we investigated whether or not the reconfiguration of a set task could modulate the efficiency of feature search. In Experiment 1, target set size was manipulated. The results revealed that enumerating targets defined by color yields a much steeper slope when executed simultaneously with a discrimination task than when done singly. However, when distractor set size was manipulated, there was no significant difference in the efficiency of individualizing targets from distractors between the two task conditions, no matter whetherthe search was guided by bottom-up information (Experiment 2) or top-down information (Experiment 3). Drawing upon these results, the authors propose that (1) an additional task can impair the efficiency of enumeration, resulting in a steep slope of counting even when target set size is quite small, and (2) in feature search, the visual system first reconfigures the task set to match the input feature information and then detects the targets with an optimal efficiency, which does not support the theory proposed by Di Lollo, Kawahara, Zuvic, and Visser (2001; Di Lollo, Smilek, Kawahara, & Ghorashi, 2005).     

Interactions between search mechanisms in conjunction search.

We report the results of a technique designed to measure interactions between different visual search processes. We interrupted pop-out search before it produced a detection response, by adding extra distractors to the display so that a target initially defined by a single feature difference (e.g., a yellow horizontal line among yellow vertical lines) could then only be found on the basis of the conjunction of two features (a yellow horizontal line among yellow vertical lines and pink horizontal lines; difficult search). This technique has been used to measure the duration of the perceptual components of pop-out search, independent of over-all response time, for targets presented among different sets of distractors. In addition, when pop-out failed because it was interrupted, past work has shown that it nevertheless provided useful information to the processes responsible for difficult search. That is, partial pop-out assisted difficult search, when extra distractors made search difficult because the target was between the two types of distractors in the relevant feature space (Olds, Cowan, & Jolicoeur, 2000a,b,c). The present results demonstrate that partial pop-out also assists difficult search when difficult search is a conjunction search, and therefore these interactions may occur at a stage where information from different feature dimensions is combined.     

Consolidation of multifeature items in visual working memory: Central capacity requirements for visual consolidation

In the present study, we examined whether greater attentional resources are required for consolidating two features (e.g., color and orientation) than for consolidating one feature (e.g., color) in visual working memory (WM). We used a dual-task procedure: Subjects performed a WM task and a secondary probe task, sometimes concurrently. In the WM task, subjects decided whether two displays (containing one to four objects composed of one or two features) were the same or different. In the probe task, subjects made a speeded discrimination response to a tone. Performance in both tasks was impaired when they were performed concurrently; however, performance costs in the tone task were not greater for multi- than for single-feature conditions (when the orientation and conjunction conditions were considered). Results suggested that equivalent attentional resources were necessary for consolidation of single-orientation or multifeature items.     

Faster target selection in preview visual search depends on luminance onsets: behavioral and electrophysiological evidence

To investigate how target detection in visual search is modulated when a subset of distractors is presented in advance (preview search), we measured search performance and the N2pc component as an electrophysiological marker of attentional target selection. Targets defined by a color/shape conjunction were detected faster and the N2pc emerged earlier in preview search relative to a condition in which all items were presented simultaneously. Behavioral and electrophysiological preview benefits disappeared when stimuli were equiluminant with their background, in spite of the fact that targets were feature singletons among the new items in preview search. The results demonstrate that previewing distractors expedites the spatial selection of targets at early sensory-perceptual stages, and that these preview benefits depend on rapid attentional capture by luminance onsets.     

Mechanisms of priming of pop-out: Stored representations or feature-gain modulations?

Previous research has shown that repetition of a task-relevant attention-capturing feature facilitates popout search. This priming of pop-out effect is due to some residual memory from recent trials. We explore two possible mechanisms of priming of pop-out: a top-down attentional benefit from a memory of the previous target representation that is stored in visual short-term memory (VSTM) and a bottom-up change of attentional gains from perceptual features of the previously attended target. We manipulated participants’ ability to form a memory trace in VSTM by occupying it with a distractor task and found that occupying VSTM did not interfere with priming of pop-out. We next manipulated attentional gains associated with feature values by inserting an irrelevant task between pop-out searches. We found that the color of the target from the intervening perceptual task influenced pop-out search: The current pop-out search was facilitated when the intervening task’s target matched the target color of the pop-out search. These results suggest that priming of pop-out might not be due to a memory trace of the previous targets in VSTM but, rather, might be due to changes in attentional control based on priming from relatively low-level feature representations of previously attended objects.     

A new estimation of the duration of attentional dwell time

How rapidly can attention move from one object to the next? Previous studies in which the dwell time paradigm was used have estimated attentional switch times of 200–500 msec, results incompatible with the search rate estimates of 25–50 msec shown in numerous visual search studies. It has been argued that dwell times are so long in the dwell time paradigm because the attentional shifts measured are unlike those used in visual search. In the present experiment, a variation of a visual search task was used, in which serial endogenous (volitional) deployments of attention were measured directly by means of a probe reaction time task. The experiment revealed a dwell time of about 250 msec, consistent with the faster estimates from other dwell time studies. This result suggests that endogenous shifts of attention may be relatively slow and that the faster attentional shifts estimated from visual search tasks may be due to the involvement of bottom-up processes.     

Attentional set protects visual marking from visual transients

When some distractors (old items) appear before others (new items) in an inefficient visual search task, the old items are excluded from the search (visual marking). Previous studies have shown that changing the shape of old items eliminates this effect, suggesting that shape identity must be maintained for successful visual marking. However, the contribution of top-down target knowledge to the maintenance of visual marking under shape change conditions has not been systematically examined. The present study tested whether the vulnerability of visual marking to shape change is contingent on observers' attentional set, by manipulating compatibility of the set and the domains in which the change occurs. The results indicated that visual marking survived shape changes when the observer's attentional set was consistent with critical features between the old and new items. This protection was observed when the set was based on explicit instructions at the beginning of the experiment, and when the task set was implicitly carried over from the previous task. These results suggest that top-down processes play a role in maintaining memory templates by enhancing the grouping and suppression processes during visual search, despite disruptive bottom-up signals.     

Attention capacity and task difficulty in visual search

When a visual search task is very difficult (as when a small feature difference defines the target), even detection of a unique element may be substantially slowed by increases in display set size. This has been attributed to the influence of attentional capacity limits. We examined the influence of attentional capacity limits on three kinds of search task: difficult feature search (with a subtle featural difference), difficult conjunction search, and spatial-configuration search. In all 3 tasks, each trial contained sixteen items, divided into two eight-item sets. The two sets were presented either successively or simultaneously. Comparison of accuracy in successive versus simultaneous presentations revealed that attentional capacity limitations are present only in the case of spatial-configuration search. While the other two types of task were inefficient (as reflected in steep search slopes), no capacity limitations were evident. We conclude that the difficulty of a visual search task affects search efficiency but does not necessarily introduce attentional capacity limits.     

Concurrent deployment of visual attention and response selection bottleneck in a dual-task: Electrophysiological and behavioural evidence

Visual attention and response selection are limited in capacity. Here, we investigated whether visual attention requires the same bottleneck mechanism as response selection in a dual-task of the psychological refractory period (PRP) paradigm. The dual-task consisted of an auditory two-choice discrimination Task 1 and a conjunction search Task 2, which were presented at variable temporal intervals (stimulus onset asynchrony, SOA). In conjunction search, visual attention is required to select items and to bind their features resulting in a serial search process around the items in the search display (i.e., set size). We measured the reaction time of the visual search task (RT2) and the N2pc, an event-related potential (ERP), which reflects lateralized visual attention processes. If the response selection processes in Task 1 influence the visual attention processes in Task 2, N2pc latency and amplitude would be delayed and attenuated at short SOA compared to long SOA. The results, however, showed that latency and amplitude were independent of SOA, indicating that visual attention was concurrently deployed to response selection. Moreover, the RT2 analysis revealed an underadditive interaction of SOA and set size. We concluded that visual attention does not require the same bottleneck mechanism as response selection in dual-tasks.     

目标或背景:联合搜索知觉学习的内容

采用颜色-形状联合搜索任务探讨短期特征联结知觉学习的效果和机制。训练被试在由不同颜色和形状组合的字母干扰子中搜索具有特定颜色和形状的目标字母,训练时间约为40分钟。通过训练,被试搜索特定的颜色-形状联结的目标字母的能力有所提升,并且学习效应能够迁移至背景改变目标不变的条件中,但是不能迁移至背景不变目标改变的条件中。这一结果提示,被试在进行短期联合搜索知觉学习时,学习到的是目标,而并非背景或目标与背景的联系。