Learning in repeated visual search

Visual search (e.g., finding a specific object in an array of other objects) is performed most effectively when people are able to ignore distracting nontargets. In repeated search, however, incidental learning of object identities may facilitate performance. In three experiments, with over 1,100 participants, we examined the extent to which search could be facilitated by object memory and by memory for spatial layouts. Participants searched for new targets (real-world, nameable objects) embedded among repeated distractors. To make the task more challenging, some participants performed search for multiple targets, increasing demands on visual working memory (WM). Following search, memory for search distractors was assessed using a surprise two-alternative forced choice recognition memory test with semantically matched foils. Search performance was facilitated by distractor object learning and by spatial memory; it was most robust when object identity was consistently tied to spatial locations and weakest (or absent) when object identities were inconsistent across trials. Incidental memory for distractors was better among participants who searched under high WM load, relative to low WM load. These results were observed when visual search included exhaustive-search trials (Experiment 1) or when all trials were self-terminating (Experiment 2). In Experiment 3, stimulus exposure was equated across WM load groups by presenting objects in a single-object stream; recognition accuracy was similar to that in Experiments 1 and 2. Together, the results suggest that people incidentally generate memory for nontarget objects encountered during search and that such memory can facilitate search performance.     

Explicit awareness supports conditional visual search in the retrieval guidance paradigm

In four experiments we explored whether participants would be able to use probabilistic prompts to simplify perceptually demanding visual search in a task we call the retrieval guidance paradigm. On each trial a memory prompt appeared prior to (and during) the search task and the diagnosticity of the prompt(s) was manipulated to provide complete, partial, or non-diagnostic information regarding the target's color on each trial (Experiments 1–3). In Experiment 1 we found that the more diagnostic prompts was associated with faster visual search performance. However, similar visual search behavior was observed in Experiment 2 when the diagnosticity of the prompts was eliminated, suggesting that participants in Experiment 1 were merely relying on base rate information to guide search and were not utilizing the prompts. In Experiment 3 participants were informed of the relationship between the prompts and the color of the target and this was associated with faster search performance relative to Experiment 1, suggesting that the participants were using the prompts to guide search. Additionally, in Experiment 3 a knowledge test was implemented and performance in this task was associated with qualitative differences in search behavior such that participants that were able to name the color(s) most associated with the prompts were faster to find the target than participants who were unable to do so. However, in Experiments 1–3 diagnosticity of the memory prompt was manipulated via base rate information, making it possible that participants were merely relying on base rate information to inform search in Experiment 3. In Experiment 4 we manipulated diagnosticity of the prompts without manipulating base rate information and found a similar pattern of results as Experiment 3. Together, the results emphasize the importance of base rate and diagnosticity information in visual search behavior. In the General discussion section we explore how a recent computational model of hypothesis generation (HyGene; Thomas, Dougherty, Sprenger, & Harbison, 2008), linking attention with long-term and working memory, accounts for the present results and provides a useful framework of cued recall visual search.     

工作记忆表征引导视觉注意选择的眼动研究

工作记忆表征能否引导视觉注意选择？目前实验结果尚不一致。有研究者认为能否观察到注意引导效应取决于视觉搜索类型。研究采用工作记忆任务与视觉搜索任务相结合的双任务范式, 结合眼动追踪技术, 对不同视觉搜索类型下的注意引导效应进行验证。实验1结果发现, 不管视觉搜索任务的靶子是否变化, 在早期的眼动指标上都发现了显著的注意引导效应, 但注意引导效应在靶子固定的视觉搜索任务下表现得更强。实验2在平衡两种视觉搜索任务中的工作记忆负载后发现, 两种视觉搜索任务下都出现了显著的注意引导效应, 但没有发现实验1中所出现的任务间差异。实验结果否定了视觉搜索类型对注意引导效应的决定性影响, 同时也提示工作记忆负载可能在注意引导效应中起重要作用。     

The cost of remembering to remember in event-based prospective memory: investigating the capacity demands of delayed intention performance

Prospective memory tasks are often accomplished during the performance of other activities. Despite the dual-task nature of prospective memory, little attention has been paid to how successful prospective memory performance affects ongoing activities. In the first 2 experiments, participants performing an embedded prospective memory task had longer response times on nonprospective memory target trials of a lexical decision task than participants performing the lexical decision task alone. In the prospective memory groups, longer lexical decision response times were associated with better prospective memory performance (Experiments 1, 2, and 3), a pattern not demonstrated with an embedded retrospective memory task (Experiment 2). The results of Experiment 3 suggest that the retrieval of a delayed intention, or the prospective component, can require capacity.     

Effects of pointing compared with naming and observing during encoding on item and source memory in young and older adults

Research showed that source memory functioning declines with ageing. Evidence suggests that encoding visual stimuli with manual pointing in addition to visual observation can have a positive effect on spatial memory compared with visual observation only. The present study investigated whether pointing at picture locations during encoding would lead to better spatial source memory than naming (Experiment 1) and visual observation only (Experiment 2) in young and older adults. Experiment 3 investigated whether response modality during the test phase would influence spatial source memory performance. Experiments 1 and 2 supported the hypothesis that pointing during encoding led to better source memory for picture locations than naming or observation only. Young adults outperformed older adults on the source memory but not the item memory task in both Experiments 1 and 2. In Experiments 1 and 2, participants manually responded in the test phase. Experiment 3 showed that if participants had to verbally respond in the test phase, the positive effect of pointing compared with naming during encoding disappeared. The results suggest that pointing at picture locations during encoding can enhance spatial source memory in both young and older adults, but only if the response modality is congruent in the test phase.     

Visual similarity effects on short-term memory for order: The case of verbally labeled pictorial stimuli

Four experiments examined the effect of visual similarity on immediate memory for order. Experiments 1 and 2 used easily nameable line drawings. Following a sequential presentation in either silent or suppression conditions, participants were presented with the drawings in a new, random order and were required to remember their original serial position. In Experiment 3, participants first learned to associate a verbal label with an abstract matrix pattern. Then they completed an immediate memory task in which they had to name the matrices aloud during presentation. At recall, the task required remembering either the order of the matrices or the order of their names. In Experiment 4, participants learned to associate nonword labels with schematic line drawings of faces; the phonemic similarity of the verbal labels was also manipulated. All four experiments indicate that the representations supporting performance comprise both verbal and visual features. The results are consistent with a multiattribute encoding view.     

Working memory capacity predicts search accuracy for novel as well as repeated targets

Visual search behaviour is guided by mental representations of targets that direct attention toward relevant features in the environment. Electrophysiological data suggests these target templates are maintained by visual working memory during search for novel targets and rapidly transfer to long term memory with target repetition. If this account is correct, an individual’s working memory capacity should be more predictive of search performance for novel targets than repeated targets. Across six experiments, we tested this hypothesis using both single (Experiments 5 and 6) and multiple (Experiments 1–4) target search tasks with three different types of stimuli (real world objects, letters, and triple conjunction shapes). Each target set was repeated for six consecutive trials. In addition, we estimated visual working memory capacity using a change detection working memory task. Overall, working memory capacity did not predict response time or efficiency in the visual search task. However, working memory capacity was equally predictive of search accuracy for both novel and repeated targets. These results suggest that working memory requirements do not substantially differ between novel and repeated target search, and working memory capacity may continue to play an important role in the encoding or maintenance of target representations after they are presumed to be in long term memory.     

Object appearance and picture-specific viewpoint are not integrated in long-term memory

Previous work has demonstrated that visual long-term memory (VLTM) stores detailed information about object appearance. The current experiments investigate whether object appearance information in VLTM is integrated within representations that contain picture-specific viewpoint information. In three experiments using both incidental and intentional encoding instructions, participants were unable to perform above chance on recognition tests that required recognizing the conjunction of object appearance and viewpoint information (Experiments 1a, 1b, 2, and 3). However, performance was better when object appearance information (Experiments 1a, 1b, and 2) or picture-specific viewpoint information (Experiment 3) alone was sufficient to succeed on the memory test. These results replicate previous work demonstrating good memory for object appearance and viewpoint. However the current results suggest that object appearance and viewpoint are not episodically integrated in VLTM.     

Incidental and intentional visual memory: What memories are and are not affected by encoding tasks?

Prior research into the impact of encoding tasks on visual memory (Castelhano & Henderson, 2005) indicated that incidental and intentional encoding tasks led to similar memory performance. The current study investigated whether different encoding tasks impacted visual memories equally for all types of objects in a conjunction search (e.g., targets, colour distractors, object category distractors, or distractors unrelated to the target). In sequences of pictures, participants searched for prespecified targets (e.g., green apple; Experiment 1), memorized all objects (Experiment 2), searched for specified targets while memorizing all objects (Experiment 3), searched for postidentified targets (Experiment 4), or memorized all objects with one object prespecified (Experiment 5). Encoding task significantly improved visual memory for targets and led to worse memory for unrelated distractors, but did not influence visual memory of distractors that were related to the target's colour or object category. The differential influence of encoding task indicates that the relative importance of the object both positively and negatively influences the memory retained.     

The relationship between online visual representation of a scene and long-term scene memory

In 3 experiments the author investigated the relationship between the online visual representation of natural scenes and long-term visual memory. In a change detection task, a target object either changed or remained the same from an initial image of a natural scene to a test image. Two types of changes were possible: rotation in depth, or replacement by another object from the same basic-level category. Change detection during online scene viewing was compared with change detection after delay of 1 trial (Experiments 2A and 2B) until the end of the study session (Experiment 1) or 24 hr (Experiment 3). There was little or no decline in change detection performance from online viewing to a delay of 1 trial or delay until the end of the session, and change detection remained well above chance after 24 hr. These results demonstrate that long-term memory for visual detail in a scene is robust.     

Failures of retrieval and comparison constrain change detection in natural scenes

In a change detection paradigm, a target object in a natural scene either rotated in depth, was replaced by another object token, or remained the same. Change detection performance was reliably higher when a target postcue allowed participants to restrict retrieval and comparison processes to the target object (Experiment 1). Change detection performance remained excellent when the target object was not attended at change (Experiment 2) and when a concurrent verbal working memory load minimized the possibility of verbal encoding (Experiment 3). Together, these data demonstrate that visual representations accumulate in memory from attended objects as the eyes and attention are oriented within a scene and that change blindness derives, at least in part, from retrieval and comparison failure.     

You’re looking for what? Comparing search for familiar,nameable objects to search for unfamiliar,novel objects

Searching for items in one’s environment often includes considerable reliance on semantic knowledge. The present study examines the importance of semantic information in visual and memory search, especially with respect to whether the items reside in long-term or working memory. In Experiment 1, participants engaged in hybrid visual memory search for items that were either highly familiar or novel. Importantly, the relatively large number of targets in this hybrid search task necessitated that targets be stored in some form of long-term memory. We found that search for familiar objects was more efficient than search for novel objects. In Experiment 2, we investigated search for familiar versus novel objects when the number of targets was low enough to be stored in working memory. We also manipulated how often participants in Experiment 2 were required to update their target (every trial vs. every block) in order to control for target templates that were stored in long-term memory as a result of repeated exposure over trials. We found no differences in search efficiency for familiar versus novel objects when templates were stored in working memory. Our results suggest that while semantic information may provide additional individuating features that are useful for object recognition in hybrid search, this information could be irrelevant or even distracting when searching for targets stored in working memory.     

Panoramic search: the interaction of memory and vision in search through a familiar scene

How do observers search through familiar scenes? A novel panoramic search method is used to study the interaction of memory and vision in natural search behavior. In panoramic search, observers see part of an unchanging scene larger than their current field of view. A target object can be visible, present in the display but hidden from view, or absent. Visual search efficiency does not change after hundreds of trials through an unchanging scene (Experiment 1). Memory search, in contrast, begins inefficiently but becomes efficient with practice. Given a choice between vision and memory, observers choose vision (Experiments 2 and 3). However, if forced to use their memory on some trials, they learn to use memory on all trials, even when reliable visual information remains available (Experiment 4). The results suggest that observers make a pragmatic choice between vision and memory, with a strong bias toward visual search even for memorized stimuli.     

Visual long-term memory and change blindness: Different effects of pre- and post-change information on one-shot change detection using meaningless geometric objects

To clarify the relationship between visual long-term memory (VLTM) and online visual processing, we investigated whether and how VLTM involuntarily affects the performance of a one-shot change detection task using images consisting of six meaningless geometric objects. In the study phase, participants observed pre-change (Experiment 1), post-change (Experiment 2), or both pre- and post-change (Experiment 3) images appearing in the subsequent change detection phase. In the change detection phase, one object always changed between pre- and post-change images and participants reported which object was changed. Results showed that VLTM of pre-change images enhanced the performance of change detection, while that of post-change images decreased accuracy. Prior exposure to both pre- and post-change images did not influence performance. These results indicate that pre-change information plays an important role in change detection, and that information in VLTM related to the current task does not always have a positive effect on performance.     

Scene and position specificity in visual memory for objects

This study investigated whether and how visual representations of individual objects are bound in memory to scene context. Participants viewed a series of naturalistic scenes, and memory for the visual form of a target object in each scene was examined in a 2-alternative forced-choice test, with the distractor object either a different object token or the target object rotated in depth. In Experiments 1 and 2, object memory performance was more accurate when the test object alternatives were displayed within the original scene than when they were displayed in isolation, demonstrating object-to-scene binding. Experiment 3 tested the hypothesis that episodic scene representations are formed through the binding of object representations to scene locations. Consistent with this hypothesis, memory performance was more accurate when the test alternatives were displayed within the scene at the same position originally occupied by the target than when they were displayed at a different position.     

The influence of action on visual search: behavioral response toward stimuli modifies the selection process

In five experiments, we investigated how simple actions (as assessed via a go/no-go task) influence visual search. In Experiments 1 and 2, participants responded (go) when a color name (cue) matched a colored shape (prime), and did not respond (no-go) when they mismatched. Participants then searched a visual array for a tilted line, either embedded within the prime (valid prime) or within a different shape of a different color (invalid prime). For go trials, but not for no-go trials, the validity of the prime influenced search behavior so that faster RTs were observed when the prime was valid as compared with when it was invalid. In Experiment 3, the go/no-go task was based on the shape of the prime. The color of the prime, but not the shape, was re-presented in the search array, and its validity produced a similar pattern as in Experiments 1-2. In Experiment 4, participants responded when the color name and prime mismatched. Reaction times indicated that attentional set had an influence on the validity differences in Experiments 1-3. In Experiment 5, the go/no-go task was based on whether a digit matched a digit appearing within the prime. Go trials produced similar validity effects as observed in Experiments 1-3.     

Attention shifts or volatile representations: What causes binding deficits in visual working memory?

The current study tested two hypotheses of feature binding memory: The attention hypothesis, which suggests that attention is needed to maintain feature bindings in visual working memory (VWM) and the volatile representation hypothesis, which suggests that feature bindings in memory are volatile and easily overwritten, but do not require sustained attention. Experiment 1 tested the attention hypothesis by measuring shifts of overt attention during the study array of a change detection task; serial shifts of attention did not disrupt feature bindings. Experiments 2 and 3 encouraged encoding of more volatile (Experiment 2) or durable (Experiment 3) representations during the study array. Binding change detection performance was impaired in Experiment 2, but not in Experiment 3, suggesting that binding performance is impaired when encoding supports a less durable memory representation. Together, these results suggest that although feature bindings may be volatile and easily overwritten, attention is not required to maintain feature bindings in VWM.     

The role of color in visual search in real-world scenes: evidence from contextual cuing

Because the importance of color in visual tasks such as object identification and scene memory has been debated, we sought to determine whether color is used to guide visual search in contextual cuing with real-world scenes. In Experiment 1, participants searched for targets in repeated scenes that were shown in one of three conditions: natural colors, unnatural colors that remained consistent across repetitions, and unnatural colors that changed on every repetition. We found that the pattern of learning was the same in all three conditions. In Experiment 2, we did a transfer test in which the repeating scenes were shown in consistent colors that suddenly changed on the last block of the experiment. The color change had no effect on search times, relative to a condition in which the colors did not change. In Experiments 3 and 4, we replicated Experiments 1 and 2, using scenes from a color-diagnostic category of scenes, and obtained similar results. We conclude that color is not used to guide visual search in real-world contextual cuing, a finding that constrains the role of color in scene identification and recognition processes.     

网络成瘾倾向者在视觉工作记忆引导下的注意捕获

采用工作记忆任务和视觉搜索任务相结合的双任务范式, 探讨网络成瘾倾向者在视觉工作记忆引导下的注意捕获。实验1考察了单一分心刺激视场中分心刺激的性质对网络成瘾倾向者选择性注意的影响, 实验2通过控制匹配试验出现的概率来诱发不同的抑制动机, 探讨多分心刺激视场中两种抑制动机下网络成瘾倾向者的注意表现。结果发现：(1)无论在单一分心刺激还是多分心刺激视场中, 网络成瘾倾向被试的目标搜索反应时均显著短于正常组被试, 且两组的搜索正确率没有差异。(2)在单一分心刺激视场中, 无论是与工作记忆项目匹配还是不匹配的分心刺激都会捕获正常组被试的注意, 但不会捕获网络成瘾倾向被试的注意。(3)在多分心刺激视场中, 当抑制动机水平较低时, 两组被试均对匹配分心物产生注意捕获效应, 且网络成瘾倾向被试受工作记忆引导的注意捕获效应小于正常组被试; 当抑制动机较高时, 两组被试均对匹配分心物产生注意抑制效应, 且没有差异。研究结果表明, 面对非网络相关视觉刺激时, 网络成瘾倾向者受工作记忆引导的注意捕获效应小于正常组, 并表现出了知觉加工上的优势。     

Effects of memory load on visual search

It remains unclear how memory load affects attentional processes in visual search (VS). No effects, as well as beneficial and detrimental effects of memory load, have been found in this type of task. The main goal of the present research was to explore whether memory load has a modulating effect on VS by means of a different attentional set induced by the order of trials (mixed vs. blocked) and by the time presentation of visual display (long vs. short). In Experiment 1, we randomized the order of type of trial (5, 10 and 15 items presented in the display) while it remained constant (10 items) in Experiments 2A and 2B. In the later experiments, we also changed time presentation of visual display (3000 vs. 1300 ms, respectively). Results showed no differential effects of memory load in Experiments 1 and 2A, but they showed up in Experiment 2B: RTs were longer in the attentional task for trials under high memory load conditions. Although our hypothesis of the attentional set is supported by the results, other theoretical implications are also worth discussing in order to better understand how memory load may modulate attentional processes in VS.