Working memory dependence of spatial contextual cueing for visual search

When spatial stimulus configurations repeat in visual search, a search facilitation, resulting in shorter search times, can be observed that is due to incidental learning. This contextual cueing effect appears to be rather implicit, uncorrelated with observers’ explicit memory of display configurations. Nevertheless, as I review here, this search facilitation due to contextual cueing depends on visuospatial working memory resources, and it disappears when visuospatial working memory is loaded by a concurrent delayed match to sample task. However, the search facilitation immediately recovers for displays learnt under visuospatial working memory load when this load is removed in a subsequent test phase. Thus, latent learning of visuospatial configurations does not depend on visuospatial working memory, but the expression of learning, as memory‐guided search in repeated displays, does. This working memory dependence has also consequences for visual search with foveal vision loss, where top‐down controlled visual exploration strategies pose high demands on visuospatial working memory, in this way interfering with memory‐guided search in repeated displays. Converging evidence for the contribution of working memory to contextual cueing comes from neuroimaging data demonstrating that distinct cortical areas along the intraparietal sulcus as well as more ventral parieto‐occipital cortex are jointly activated by visual working memory and contextual cueing.     

Top‐down contextual knowledge guides visual attention in infancy

The visual context in which an object or face resides can provide useful top‐down information for guiding attention orienting, object recognition, and visual search. Although infants have demonstrated sensitivity to covariation in spatial arrays, it is presently unclear whether they can use rapidly acquired contextual knowledge to guide attention during visual search. In this eye‐tracking experiment, 6‐ and 10‐month‐old infants searched for a target face hidden among colorful distracter shapes. Targets appeared in Old or New visual contexts, depending on whether the visual search arrays (defined by the spatial configuration, shape and color of component items in the search display) were repeated or newly generated throughout the experiment. Targets in Old contexts appeared in the same location within the same configuration, such that context covaried with target location. Both 6‐ and 10‐month‐olds successfully distinguished between Old and New contexts, exhibiting faster search times, fewer looks at distracters, and more anticipation of targets when contexts repeated. This initial demonstration of contextual cueing effects in infants indicates that they can use top‐down information to facilitate orienting during memory‐guided visual search.     

Time to guide: Evidence for delayed attentional guidance in contextual cueing

Contextual cueing experiments show that, when displays are repeated, reaction times (RTs) to find a target decrease over time even when the observers are not aware of the repetition. Recent evidence suggests that this benefit in standard contextual cueing tasks is not likely to be due to an improvement in attentional guidance (Kunar, Flusberg, Horowitz, & Wolfe, 2007). Nevertheless, we ask whether guidance can help participants find the target in a repeated display, if they are given sufficient time to encode the display. In Experiment 1 we increased the display complexity so that it took participants longer to find the target. Here we found a larger effect of guidance than in a condition with shorter RTs. Experiment 2 gave participants prior exposure to the display context. The data again showed that with more time participants could implement guidance to help find the target, provided that there was something in the search stimuli locations to guide attention to. The data suggest that, although the benefit in a standard contextual cueing task is unlikely to be a result of guidance, guidance can play a role if it is given time to develop.     

Response time modeling reveals multiple contextual cuing mechanisms

Contextual cuing refers to a response time (RT) benefit that occurs when observers search through displays that have been repeated over the course of an experiment. Although it is generally agreed that contextual cuing arises via an associative learning mechanism, there is uncertainty about the type(s) of process(es) that allow learning to influence RT. We contrast two leading accounts of the contextual cuing effect that differ in terms of the general process that is credited with producing the effect. The first, the expedited search account, attributes the cuing effect to an increase in the speed with which the target is acquired. The second, the decision threshold account, attributes the cuing effect to a reduction in the response threshold used by observers when making a subsequent decision about the target (e.g., judging its orientation). We use the diffusion model to contrast the quantitative predictions of these two accounts at the level of individual observers. Our use of the diffusion model allows us to also explore a novel decision-level locus of the cuing effect based on perceptual learning. This novel account attributes the RT benefit to a perceptual learning process that increases the quality of information used to drive the decision process. Our results reveal both individual differences in the process(es) involved in contextual cuing but also identify several striking regularities across observers. We find strong support for both the decision threshold account as well as the novel perceptual learning account. We find relatively weak support for the expedited search account.     

Redundancy effects in the perception and memory of visual objects

Is visual representation of an object affected by whether surrounding objects are identical to it, different from it, or absent? To address this question, we tested perceptual priming, visual short-term, and long-term memory for objects presented in isolation or with other objects. Experiment 1 used a priming procedure, where the prime display contained a single face, four identical faces, or four different faces. Subjects identified the gender of a subsequent probe face that either matched or mismatched with one of the prime faces. Priming was stronger when the prime was four identical faces than when it was a single face or four different faces. Experiments 2 and 3 asked subjects to encode four different objects presented on four displays. Holding memory load constant, visual memory was better when each of the four displays contained four duplicates of a single object, than when each display contained a single object. These results suggest that an object's perceptual and memory representations are enhanced when presented with identical objects, revealing redundancy effects in visual processing.     

High-capacity spatial contextual memory

Humans show implicit memory for complex spatial layouts, which aids in subsequent processing of these layouts. Research efforts in the past 5 years have focused primarily on a single session of training involving a dozen repeated displays. Yet every day, people encounter many more visual layouts than were presented in such experiments. In this study, we trained subjects to learn 60 repeated displays, randomly intermixed within 1,800 nonrepeated displays, spread over 5 consecutive days. On each day, the subjects conducted visual search on 360 new displays and a new set of 12 repeated displays, each repeated 30 times. Contextual memory was observed daily. One week after the fifth session, the subjects still searched faster on the repeated displays learned previously. We conclude that the visual system has a high capacity for learning and retaining repeated spatial context, an ability that may compensate for our severe limitations in visual attention and working memory.     

Aging and implicit learning: explorations in contextual cuing

In contextual cuing, faster responses are made to repeated displays containing context-target associations than to novel displays without such covariances. We report that healthy older adults showed learning impairments in contextual cuing when compared with younger adults. The display properties in the task were altered to artificially increase younger adults' response times to match those of older adults and to produce faster responses in older participants; however, younger participants' learning remained intact, whereas older participants continued to show impairments under these conditions. These results suggest that older adults have intrinsic deficits in contextual cuing that cannot be attributed to their slower overall response speed.     

How is spatial context learning integrated over signal versus noise? A primacy effect in contextual cueing

Over repeated exposure to particular visual search displays, subjects are able to implicitly extract regularities that then make search more efficient-a phenomenon known as contextual cueing. Here we explore how the learning involved in contextual cueing is formed, maintained, and updated over experience. During an initial training phase, a group of signal first subjects searched through a series of predictive displays (where distractor locations were perfectly correlated with the target location), followed with no overt break by a series of unpredictive displays (where repeated contexts were uncorrelated with target locations). A second noise first group of subjects encountered the unpredictive displays followed by the predictive displays. Despite the fact that both groups had the same overall exposure to signal and noise, only the signal first group demonstrated subsequent contextual cueing. This primacy effect indicates that initial experience can result in hypotheses about regularities in displays-or the lack thereof-which then become resistant to updating. The absence of regularities in early stages of training even blocked observers from learning predictive regularities later on.     

空间工作记忆负载对真实场景情境提示效应的影响

重复的画面布局能够促进观察者对目标项的搜索 (情境提示效应)。本研究采用双任务范式,分别在视觉搜索任务的学习阶段 (实验2a) 和测验阶段 (实验2b) 加入空间工作记忆任务, 并与单任务基线 (实验1)进行比较, 考察空间工作记忆负载对真实场景搜索中情境线索学习和情境提示效应表达的影响。结果发现: 空间负载会增大学习阶段的情境提示效应量, 同时削弱测验阶段的情境提示效应量, 而不影响情境线索的外显提取。由此可见, 真实场景中情境线索的学习和提示效应的表达均会受到有限的工作记忆资源的影响, 但情境线索提取的外显性不变。     

Rapid resumption of interrupted visual search. New insights on the interaction between vision and memory

A modified visual search task demonstrates that humans are very good at resuming a search after it has been momentarily interrupted. This is shown by exceptionally rapid response time to a display that reappears after a brief interruption, even when an entirely different visual display is seen during the interruption and two different visual searches are performed simultaneously. This rapid resumption depends on the stability of the visual scene and is not due to display or response anticipations. These results are consistent with the existence of an iterative hypothesis-testing mechanism that compares information stored in short-term memory (the perceptual hypothesis) with information about the display (the sensory pattern). In this view, rapid resumption occurs because a hypothesis based on a previous glance of the scene can be tested very rapidly in a subsequent glance, given that the initial hypothesis-generation step has already been performed.     

Integrating spatial context learning over contradictory signals: Recency effects in contextual cueing

Contextual cueing is a visual search phenomenon in which memory of global visual context guides spatial attention towards task-relevant portions of the search display. Recent work has shown that the learning processes underlying contextual cueing exhibit primacy effects; they are more sensitive to early experience than to later experience. These results appear to pose difficulties for associative accounts which typically predict recency effects; behaviour being most strongly influenced by recent experience. The current study utilizes trial sequences that consist of two contradictory sets of regularities. In contrast to previous results, robust recency effects were observed. In a second study it is demonstrated that this recency effect can be minimized, but not reversed by systematically manipulating task-irrelevant features of the search display. These results provide additional support for an associative account of contextual cueing and suggest that contextual cueing may, under some circumstances, be more sensitive to recent experience.     

Limitations of perceptual segmentation on contextual cueing in visual search

In visual search, detection of a target in a repeated layout is faster than search within a novel arrangement, demonstrating that contextual invariances can implicitly guide attention to the target location (“contextual cueing”; Chun & Jiang, 1998). Here, we investigated how display segmentation processes influence contextual cueing. Seven experiments showed that grouping by colour and by size can considerably reduce contextual cueing. However, selectively attending to a relevant subgroup of items (that contains the target) preserved context-based learning effects. Finally, the reduction of contextual cueing by means of grouping affected both the latent learning and the recall of display layouts. In sum, all experiments show an influence of grouping on contextual cueing. This influence is larger for variations of spatial (as compared to surface) features and is consistent with the view that learning of contextual relations critically interferes with processes that segment a display into segregated groups of items.     

Using real-world scenes as contextual cues for search

Research on contextual cueing has demonstrated that with simple arrays of letters and shapes, search for a target increases in efficiency as associations between a search target and its surrounding visual context are learned. We investigated whether the visual context afforded by repeated exposure to real-world scenes can also guide attention when the relationship between the scene and a target position is arbitrary. Observers searched for and identified a target letter embedded in photographs of real-world scenes. Although search time within novel scenes was consistent across trials, search time within repeated scenes decreased across repetitions. Unlike previous demonstrations of contextual cueing, however, memory for scene-target covariation was explicit. In subsequent memory tests, observers recognized repeated contexts more often than those that were presented once and displayed superior recall of target position within the repeated scenes. In addition, repetition of inverted scenes, which made the scene more difficult to identify, produced a markedly reduced rate of learning, suggesting semantic information concerning object and scene identity are used to guide attention.     

Contextual cueing is not flexible

Target detection is faster when search displays repeat, but properties of the memory representations that give rise to this contextual cueing effect remain uncertain. We adapted the contextual cueing task using an ABA design and recorded the eye movements of healthy young adults to determine whether the memory representations are flexible. Targets moved to a new location during the B phase and then returned to their original locations (second A phase). Contextual cueing effects in the first A phase were reinstated immediately in the second A phase, and response time costs eventually gave way to a repeated search advantage in the B phase, suggesting that two target-context associations were learned. However, this apparent flexibility disappeared when eye tracking data were used to subdivide repeated displays based on B-phase viewing of the original target quadrant. Therefore, memory representations acquired in the contextual cueing task resist change and are not flexible.     

Intertrial temporal contextual cuing: association across successive visual search trials guides spatial attention

Contextual cuing refers to the facilitation of performance in visual search due to the repetition of the same displays. Whereas previous studies have focused on contextual cuing within single-search trials, this study tested whether 1 trial facilitates visual search of the next trial. Participants searched for a T among Ls. In the training phase, the spatial layout on trial N=1 was predictive of the target location on trial N. In the testing phase, the predictive value was removed. Results revealed an intertrial temporal contextual cuing effect: Search speed became progressively shorter in the training phase, but it significantly lengthened during testing. The authors conclude that the visual system is capable of retaining spatial contextual memory established earlier to facilitate perception.     

The time course of attentional deployment in contextual cueing

The time course of attention is a major characteristic on which different types of attention diverge. In addition to explicit goals and salient stimuli, spatial attention is influenced by past experience. In contextual cueing, behaviorally relevant stimuli are more quickly found when they appear in a spatial context that has previously been encountered than when they appear in a new context. In this study, we investigated the time that it takes for contextual cueing to develop following the onset of search layout cues. In three experiments, participants searched for a T target in an array of Ls. Each array was consistently associated with a single target location. In a testing phase, we manipulated the stimulus onset asynchrony (SOA) between the repeated spatial layout and the search display. Contextual cueing was equivalent for a wide range of SOAs between 0 and 1,000 ms. The lack of an increase in contextual cueing with increasing cue durations suggests that as an implicit learning mechanism, contextual cueing cannot be effectively used until search begins.     

Short- and long-term effects of cannabinoids on the extinction of contextual fear memory in rats

Facilitation of memory extinction by manipulation of the endocannabinoid (eCB) system has been recently studied in several paradigms. Our previous results pointed to facilitation of contextual fear memory extinction by a low dose of a cannabinoid agonist, with a suggestion of short-term effects. The aim of the present study was to further investigate the effects of cannabinoid drugs in the short- and long-term extinction of conditioned fear using an extended extinction protocol. Male Wistar rats were placed in a conditioning chamber and after 3 min received a footshock (1.5 mA, 1 s). On the next day, they received i.p. drug treatment (WIN55212-2 0.25 mg/kg, AM404 10 mg/kg, SR141716 A 1 mg/kg) and were re-exposed to the conditioning chamber for 30 min (extinction training). No-Extinction groups received the same drug treatment, but were exposed for 3 min to the conditioning chamber. A drug-free test of contextual memory (3 min) was performed 7 days later. The cannabinoid agonist WI55212-2 and the inhibitor of eCB metabolism/uptake AM404 facilitated short-term extinction. In addition, long-term effects induced by treatments with WIN55212 and AM404 were completely divergent to those of SR141716A treatment. The present results confirm and extend previous findings showing that the eCB system modulates short-term fear memory extinction with long-lasting consequences.     

The contents of perceptual hypotheses: Evidence from rapid resumption of interrupted visual search

Observers can resume a previously interrupted visual search trial significantly more quickly than they can start a new search trial (Lleras, Rensink, & Enns, 2005). This rapid resumption of search is possible because evidence accumulated during the previous exposure, a perceptual hypothesis, can carry over to a subsequent presentation. We present four interrupted visual search experiments in which the content of the perceptual hypotheses used during visual search trials was characterized. These experiments suggest that prior to explicit target identification, observers have accumulated evidence about the locations, but not the identities, of local, task-relevant distractors, as well as preliminary evidence for the identity of the target. Our results characterize the content of perceptual search hypotheses and highlight the utility of interrupted search for studying online search processing prior to target identification.     

Spatial constraints on learning in visual search: modeling contextual cuing

Predictive visual context facilitates visual search, a benefit termed contextual cuing (M. M. Chun & Y. Jiang, 1998). In the original task, search arrays were repeated across blocks such that the spatial configuration (context) of all of the distractors in a display predicted an embedded target location. The authors modeled existing results using a connectionist architecture and then designed new behavioral experiments to test the model's assumptions. The modeling and behavioral results indicate that learning may be restricted to the local context even when the entire configuration is predictive of target location. Local learning constrains how much guidance is produced by contextual cuing. The modeling and new data also demonstrate that local learning requires that the local context maintain its location in the overall global context.     

Contextual cueing under working memory load: Selective interference of visuospatial load with expression of learning

In a series of experiments, we investigated the dependence of contextual cueing on working memory resources. A visual search task with 50 % repeated displays was run in order to elicit the implicit learning of contextual cues. The search task was combined with a concurrent visual working memory task either during an initial learning phase or a later test phase. The visual working memory load was either spatial or nonspatial. Articulatory suppression was used to prevent verbalization. We found that nonspatial working memory load had no effect, independent of presentation in the learning or test phase. In contrast, visuospatial load diminished search facilitation in the test phase, but not during learning. We concluded that visuospatial working memory resources are needed for the expression of previously learned spatial contexts, whereas the learning of contextual cues does not depend on visuospatial working memory.