Simultaneous control of attention by multiple working memory representations

Working memory representations play a key role in controlling attention by making it possible to shift attention to task-relevant objects. Visual working memory has a capacity of three to four objects, but recent studies suggest that only one representation can guide attention at a given moment. We directly tested this proposal by monitoring eye movements while observers performed a visual search task in which they attempted to limit attention to objects drawn in two colors. When the observers were motivated to attend to one color at a time, they searched many consecutive items of one color (long run lengths) and exhibited a delay prior to switching gaze from one color to the other (switch cost). In contrast, when they were motivated to attend to both colors simultaneously, observers' gaze switched back and forth between the two colors frequently (short run lengths), with no switch cost. Thus, multiple working memory representations can concurrently guide attention.     

Divided attention: Storing and classifying briefly presented objects

Although in many studies divided attention has been examined by having people perform the same task (e.g., report or search) with a large number of objects, in few studies have people had to perform two logically independent tasks involving the same brief display. In two experiments, subjects saw 200-msec arrays of characters. In dual-task blocks, theyclassified the color of some or all of the items (making an immediate response) andstored the shape of some of the items for a later recognition test. There was not much mutual interference between classifying and storing per se. However, the tasks were by no means independent: there was substantial interference whendifferent objects from the array had to be stored for one task and classified for the other. The results confirm that wholly unrelated visual tasks depend on the same input-attention system and suggest that attending to an object for any purpose may entail storing a representation of it in visual short-term memory.     

Affective evidence that inhibition is involved in separating accessory representations from active representations in visual working memory

ABSTRACT

The multiple state theory of working memory suggests that representations are divided into two states: focused-on active representations and accessory memories held for later use. Here we tested two competing hypotheses regarding the neurocognitive mechanisms responsible for this separation: (1) that accessory memories undergo inhibition or (2) that accessory memories are amplified less than active representations. We explored whether accessory memories undergo affective devaluation, a known index of the involvement of inhibition in a visual task. On each trial participants memorized four items, were cued to focus on one, and then completed a visual search or an affective evaluation task. While search distractors matching the colour of an active item slowed search, those matching an accessory memory did not, replicating previous findings that only active items guide search. Also, accessory items were affectively devalued compared to baseline and active items, supporting the hypothesis that accessory memories undergo inhibition.     

Consolidation of multifeature items in visual working memory: Central capacity requirements for visual consolidation

In the present study, we examined whether greater attentional resources are required for consolidating two features (e.g., color and orientation) than for consolidating one feature (e.g., color) in visual working memory (WM). We used a dual-task procedure: Subjects performed a WM task and a secondary probe task, sometimes concurrently. In the WM task, subjects decided whether two displays (containing one to four objects composed of one or two features) were the same or different. In the probe task, subjects made a speeded discrimination response to a tone. Performance in both tasks was impaired when they were performed concurrently; however, performance costs in the tone task were not greater for multi- than for single-feature conditions (when the orientation and conjunction conditions were considered). Results suggested that equivalent attentional resources were necessary for consolidation of single-orientation or multifeature items.     

The capacity of visual short-term memory is set both by visual information load and by number of objects

Previous research has suggested that visual short-term memory has a fixed capacity of about four objects. However, we found that capacity varied substantially across the five stimulus classes we examined, ranging from 1.6 for shaded cubes to 4.4 for colors (estimated using a change detection task). We also estimated the information load per item in each class, using visual search rate. The changes we measured in memory capacity across classes were almost exactly mirrored by changes in the opposite direction in visual search rate (r2=.992 between search rate and the reciprocal of memory capacity). The greater the information load of each item in a stimulus class (as indicated by a slower search rate), the fewer items from that class one can hold in memory. Extrapolating this linear relationship reveals that there is also an upper bound on capacity of approximately four or five objects. Thus, both the visual information load and number of objects impose capacity limits on visual short-term memory.     

预览搜索中基于颜色的两种自上而下加工

预览搜索（preview search）研究是近几年来注意选择研究领域新的热点。本研究将预览搜索任务和探测任务相结合,通过两个实验证明了预览搜索中存在基于颜色的自上而下加工。在每次实验中,先出现预览项目,然后让被试根据有无提示音完成搜索任务或探测任务。在实验一中,探测点的颜色为旧项目同色和无关色两种;在实验二中,探测点的颜色为新项目同色和无关色两种。结果发现,旧项目同色的探测子的反应时长于无关色反应时,而新项目同色的探测子的反应时短于无关色反应时。笔者认为这是由于在预览阶段,可能存在两种自上而下加工,一种是主要基于旧项目颜色的抑制定势,另一种是基于靶子颜色的预期定势。这两种自上而下的调控机制可以解释预览效应的原因,同时利用颜色等特征的格式塔组织也在预览搜索中起着重要的作用     

You’re looking for what? Comparing search for familiar,nameable objects to search for unfamiliar,novel objects

Searching for items in one’s environment often includes considerable reliance on semantic knowledge. The present study examines the importance of semantic information in visual and memory search, especially with respect to whether the items reside in long-term or working memory. In Experiment 1, participants engaged in hybrid visual memory search for items that were either highly familiar or novel. Importantly, the relatively large number of targets in this hybrid search task necessitated that targets be stored in some form of long-term memory. We found that search for familiar objects was more efficient than search for novel objects. In Experiment 2, we investigated search for familiar versus novel objects when the number of targets was low enough to be stored in working memory. We also manipulated how often participants in Experiment 2 were required to update their target (every trial vs. every block) in order to control for target templates that were stored in long-term memory as a result of repeated exposure over trials. We found no differences in search efficiency for familiar versus novel objects when templates were stored in working memory. Our results suggest that while semantic information may provide additional individuating features that are useful for object recognition in hybrid search, this information could be irrelevant or even distracting when searching for targets stored in working memory.     

Visual Search Remains Efficient When Visual Working Memory is Full

Many theories of attention have proposed that visual working memory plays an important role in visual search tasks. The present study examined the involvement of visual working memory in search using a dual-task paradigm in which participants performed a visual search task while maintaining no, two, or four objects in visual working memory. The presence of a working memory load added a constant delay to the visual search reaction times, irrespective of the number of items in the visual search array. That is, there was no change in the slope of the function relating reaction time to the number of items in the search array, indicating that the search process itself was not slowed by the memory load. Moreover, the search task did not substantially impair the maintenance of information in visual working memory. These results suggest that visual search requires minimal visual working memory resources, a conclusion that is inconsistent with theories that propose a close link between attention and working memory.     

DIFFERENCES BETWEEN OBJECTS AND NONOBJECTS IN VISUAL EXTINCTION:

Abstract— We used visual extinction as a method for investigating the influence of objects on selective visual attention. Two subjects demonstrating extinction following damage to right parietal cortex were tested in a simple detection task. The task required only that subjects detect the presence or absence of any item in the left and right visual fields. Both subjects showed an advantage for good objects in the impaired field However, this advantage for good objects held only in the presence of a simultaneous stimulus in the undamaged field. We suggest that objects are not simply easier lo detect than nonobjects, instead we argue that objects are stronger competitors for attentional selection.     

The insistence of vision: Why do people look at a salient stimulus when it signals target absence?

Researchers and practitioners across many fields would benefit from the ability to predict human search time in complex visual displays. However, a missing element in our ability to predict search time is our ability to quantify the exogenous attraction of visual objects in terms of their impact on search time. The current work represents an initial step in this direction. We present two experiments using a quadrant search task to investigate how exogenous and endogenous factors influence human visual search. In Experiment 1, we measure the oculomotor capture—or the tendency of a stimulus to elicit a saccade—of a salient quadrant under conditions in which the salient quadrant does not predict target location. Despite the irrelevance of quadrant salience, we find that subjects persist in making saccades towards the salient quadrant at above-chance levels. We then present a Bayesian-based ideal performer model that predicts search time and oculomotor capture when the salient quadrant never contains the search target. Experiment 2 tested the predictions of the ideal performer model and revealed human performance to be in close correspondence with the model. We conclude that, in our speeded search task, the influence of an exogenous attractor on saccades can be quantified in terms of search time costs and, when these costs are considered, both search time and search behaviour reflect a boundedly optimal adaptation to the cost structure of the environment.     

Strategic and automatic effects of visual working memory on attention in visual search

Previous research indicates that visual attention can be automatically captured by sensory inputs that match the contents of visual working memory. However, Woodman and Luck (2007) showed that information in working memory can be used flexibly as a template for either selection or rejection according to task demands. We report two experiments that extend their work. Participants performed a visual search task while maintaining items in visual working memory. Memory items were presented for either a short or long exposure duration immediately prior to the search task. Memory was tested by a change-detection task immediately afterwards. On a random half of trials items in memory matched either one distractor in the search task (Experiment 1) or three (Experiment 2). The main result was that matching distractors speeded or slowed target detection depending on whether memory items were presented for a long or short duration. These effects were more in evidence with three matching distractors than one. We conclude that the influence of visual working memory on visual search is indeed flexible but is not solely a function of task demands. Our results suggest that attentional capture by perceptual inputs matching information in visual working memory involves a fast automatic process that can be overridden by a slower top-down process of attentional avoidance.     

Do birds (pigeons and bantams) know how confident they are of their perceptual decisions?

Rhesus monkeys are known to recognize confidence about their immediate perceptual and cognitive decisions by using a betting procedure (Son and Kornell in The missing link in cognition: origins of self-reflective consciousness. Oxford University Press, New York, pp 296–320, 2005; Kornell et al. in Psychol Sci 18:64–71, 2007). In this report, we examined whether this ability is shared in two avian species (pigeons and bantams) in order to know how widespread this metacognitive ability is among animals. We trained pigeons and bantams to search for a differently colored disk (target) among others (distracters) displayed on a touch-sensitive monitor. In test, the subjects were required to choose one of two confidence icons, “risk” and “safe”, after the visual search. A peck at the “risk” icon after a correct response in the visual search (i.e., a peck at the target) was reinforced by food and light, while that after an incorrect response (i.e., a peck at a distracter) resulted in a timeout. A peck at the “safe” icon was always reinforced by food and light, or by light only, regardless of the visual search result. The percentages of “safe” choices after incorrect responses were higher than after correct responses in all six pigeons and two of three bantams. This behavior generalized to novel stimuli in some subjects, and even to a novel line-classification task in a pigeon. These results suggest that these two distantly related avian species have in common a metacognitive ability that allows them to recognize confidence about their immediate perceptual decisions.     

The hard-won benefits of familiarity in visual search: naturally familiar brand logos are found faster

Familiar items are found faster than unfamiliar ones in visual search tasks. This effect has important implications for cognitive theory, because it may reveal how mental representations of commonly encountered items are changed by experience to optimize performance. It remains unknown, however, whether everyday items with moderate levels of exposure would show benefits in visual search, and if so, what kind of experience would be required to produce them. Here, we tested whether familiar product logos were searched for faster than unfamiliar ones, and also familiarized subjects with previously unfamiliar logos. Subjects searched for preexperimentally familiar and unfamiliar logos, half of which were familiarized in the laboratory, amongst other, unfamiliar distractor logos. In three experiments, we used an N-back-like familiarization task, and in four others we used a task that asked detailed questions about the perceptual aspects of the logos. The number of familiarization exposures ranged from 30 to 84 per logo across experiments, with two experiments involving across-day familiarization. Preexperimentally familiar target logos were searched for faster than were unfamiliar, nonfamiliarized logos, by 8 % on average. This difference was reliable in all seven experiments. However, familiarization had little or no effect on search speeds; its average effect was to improve search times by 0.7 %, and its effect was significant in only one of the seven experiments. If priming, mere exposure, episodic memory, or relatively modest familiarity were responsible for familiarity’s effects on search, then performance should have improved following familiarization. Our results suggest that the search-related advantage of familiar logos does not develop easily or rapidly.     

Auditory attention causes visual inattentional blindness

When engaged in a visual task, we can fail to detect unexpected events that would otherwise be very noticeable. Here we ask whether a common auditory task, such as that of attending to a verbal stream, can also make us blind to the presence of visual objects that we do not anticipate. In two experiments, one hundred and twenty observers watched a dynamic display while performing either a visual or an auditory attention task, or both simultaneously. When observers were listening to verbal material, in order to either understand it or to remember it (auditory task), their probability of detecting an unexpected visual object was no higher than when they were counting bounces of moving items (visual task), although in the former case the observers' eyes and attention could move around the display freely rather than remaining focused on tracked items. Previous research has shown that attending to verbal material does not affect responses to lights flashing at irregular intervals, suggesting that driving performance is not hampered by listening. The lights, however, were expected. Our data imply that listening to the radio while driving, or to a portable audio player while walking or biking, can impair our reactions to objects or events that we do not expect.     

Spontaneous allocation of visual attention: dominant role of uniqueness

Common sense suggests that unique or abruptly changing (transient) elements in a visual scene often draw attention involuntarily. Visual search studies paint a seemingly different picture, however: Unique items usually draw attention involuntarily only when observers seek a unique target. One type of transient— abrupt onsets—draws attention involuntarily, but only when the observer is seeking an onset (Folk, Remington, & Johnston, 1992). One way of reconciling common-sense with these findings is to suppose that when people view a scene with no specific goal or task, they adopt adefault set, which might prioritize novelty and/or transients. In two experiments, 336 subjects saw a single display of six items for 900 msec, expecting to have to describe it (Experiment 1) or make an aesthetic judgment about it (Experiment 2). One item in the display was either uniquely flashing (surrounded by static items) or uniquely static (surrounded by flashing items). In both studies, the unique item, even if static, was more often reported than the nonunique item, with flashing items enjoying an additional advantage.     

Inhibitory tagging in an interrupted visual search

Inhibition of return facilitates visual search, biasing attention away from previously examined locations. Prior research has shown that, as a result of inhibitory tags associated with rejected distractor items, observers are slower to detect small probes presented at these tagged locations than they are to detect probes presented at locations that were unoccupied during visual search, but only when the search stimuli remain visible during the probe-detection task. Using an interrupted visual search task, in which search displays alternated with blank displays, we found that inhibitory tagging occurred in the absence of the search array when probes were presented during these blank displays. Furthermore, by manipulating participants’ attentional set, we showed that these inhibitory tags were associated only with items that the participants actively searched. Finally, by probing before the search was completed, we also showed that, early in search, processing at distractor locations was actually facilitated, and only as the search progressed did evidence for inhibitory tagging arise at those locations. These results suggest that the context of a visual search determines the presence or absence of inhibitory tagging, as well as demonstrating for the first time the temporal dynamics of location prioritization while search is ongoing.     

Visual marking inhibits singleton capture

This paper is concerned with how we prioritize the selection of new objects in visual scenes. We present four experiments investigating the effects of distractor previews on visual search through new objects. Participants viewed a set of to-be-ignored nontargets, with the task being to search for a target in a second set, added to the first after 1000ms. This second set could contain a salient feature singleton, defined in terms of its color, orientation, or both color and orientation. When the singleton was a distractor, search was slowed relative to when there was no singleton. Search was facilitated when the singleton was a target. Interestingly, both the interference and facilitation effects were modulated when the preview shared features with the singleton. Follow-up experiments showed that this reduction of singleton effects was not due to: (i) low-level sensory aspects of the displays, (ii) increased heterogeneity in the search set in the preview condition, or (iii) color-based grouping of old and new items. Instead, we suggest that there is an inhibitory carry-over from the first to the second set of items based on feature similarity. We suggest the suppression stems from a process termed visual marking, which suppresses irrelevant visual objects in anticipation of more relevant new objects (Watson & Humphreys, 1997). The findings argue against alternative explanations such as the automatic capture by abrupt new onsets account.     

Dynamic states in working memory modulate guidance of visual attention: Evidence from an n-back paradigm

Items held in working memory (WM) can automatically bias attention when they reappear in visual displays. Recent evidence, however, suggests that WM biases of attention may be reduced under certain conditions, for example with increasing memory load. We employed a dual task paradigm to investigate how WM biases are affected by dynamic updating of memory contents. 1-back and 2-back versions of a memory task with colour stimuli were interrupted at intervals by an unrelated visual search task. Reappearance in the search display of the item that was currently active in WM guided attention, while suppressed or inactive items did not. We conclude that the rapid updating of memory contents facilitates the shifting of memory representations into different activity states on a moment-to-moment basis. The finding is consistent with models that propose that only one item can be “active” in WM at any one time to guide attention.     

Baby arithmetic: one object plus one tone

Recent studies using a violation-of-expectation task suggest that preverbal infants are capable of recognizing basic arithmetical operations involving visual objects. There is still debate, however, over whether their performance is based on any expectation of the arithmetical operations, or on a general perceptual tendency to prefer visually familiar and complex displays. Here we provide new evidence that 5-month-old infants recognize basic arithmetic operations across sensory modalities. Using a violation-of-expectation task that eliminated the possibility of the familiarity and complexity preference, 5-month-old infants were presented alternatively with two types of arithmetical events: the expected, correct outcomes of operations (1 object+1 tone=2 objects and 1 object+2 tones=3 objects) and the unexpected, incorrect ones (1 object+2 tones=2 objects and 1 object+1 tone=3 objects). Results showed that subjects looked significantly longer at the unexpected events than at the expected events, suggesting that infants are able to recognize basic arithmetic operations across sensory modalities.     

工作记忆与知觉负载对工作记忆表征引导注意的调节

本研究采用4个眼动实验探讨不同知觉负载条件下的视觉搜索任务中工作记忆负载对基于工作记忆表征的注意引导效应的影响。实验1和实验3采用低知觉负载的视觉搜索任务,结果在视觉工作记忆负载为1和2时观察到了显著的注意引导效应,但当负载增加到4时注意引导效应消失了;实验2和实验4采用高知觉负载的视觉搜索任务,结果发现注意引导效应在工作记忆负载增加到2时就已经消失了。上述结果表明:工作记忆负载和知觉负载都能够通过调控认知资源的方式来影响工作记忆表征对注意的引导,当认知资源充足时,工作记忆能够同时保持多个记忆表征对视觉注意的引导。