Incidental and intentional visual memory: What memories are and are not affected by encoding tasks?

Prior research into the impact of encoding tasks on visual memory (Castelhano & Henderson, 2005) indicated that incidental and intentional encoding tasks led to similar memory performance. The current study investigated whether different encoding tasks impacted visual memories equally for all types of objects in a conjunction search (e.g., targets, colour distractors, object category distractors, or distractors unrelated to the target). In sequences of pictures, participants searched for prespecified targets (e.g., green apple; Experiment 1), memorized all objects (Experiment 2), searched for specified targets while memorizing all objects (Experiment 3), searched for postidentified targets (Experiment 4), or memorized all objects with one object prespecified (Experiment 5). Encoding task significantly improved visual memory for targets and led to worse memory for unrelated distractors, but did not influence visual memory of distractors that were related to the target's colour or object category. The differential influence of encoding task indicates that the relative importance of the object both positively and negatively influences the memory retained.     

Executive working memory load does not compromise perceptual processing during visual search: Evidence from additive factors analysis

Executive working memory (WM) load reduces the efficiency of visual search, but the mechanisms by which this occurs are not fully known. In the present study, we assessed the effect of executive load on perceptual processing during search. Participants performed a serial oculomotor search task, looking for a circle target among gapped-circle distractors. The participants performed the task under high and low executive WM load, and the visual quality (Experiment 1) or discriminability of targets and distractors (Experiment 2) was manipulated across trials. By the logic of the additive factors method (Sternberg, 1969, 1998), if WM load compromises the quality of perceptual processing during visual search, manipulations of WM load and perceptual processing difficulty should produce nonadditive effects. Contrary to this prediction, the effects of WM load and perceptual difficulty were additive. The results imply that executive WM load does not degrade perceptual analysis during visual search.     

Guidance of attention by information held in working memory

Information held in working memory (WM) can guide attention during visual search. The authors of recent studies have interpreted the effect of holding verbal labels in WM as guidance of visual attention by semantic information. In a series of experiments, we tested how attention is influenced by visual features versus category-level information about complex objects held in WM. Participants either memorized an object’s image or its category. While holding this information in memory, they searched for a target in a four-object search display. On exact-match trials, the memorized item reappeared as a distractor in the search display. On category-match trials, another exemplar of the memorized item appeared as a distractor. On neutral trials, none of the distractors were related to the memorized object. We found attentional guidance in visual search on both exact-match and category-match trials in Experiment 1, in which the exemplars were visually similar. When we controlled for visual similarity among the exemplars by using four possible exemplars (Exp. 2) or by using two exemplars rated as being visually dissimilar (Exp. 3), we found attentional guidance only on exact-match trials when participants memorized the object’s image. The same pattern of results held when the target was invariant (Exps. 2–3) and when the target was defined semantically and varied in visual features (Exp. 4). The findings of these experiments suggest that attentional guidance by WM requires active visual information.     

Visual working memory load disrupts the space‐based attentional guidance of target selection

During visual search, the selection of target objects is guided by stored representations of target‐defining features (attentional templates). It is commonly believed that such templates are maintained in visual working memory (WM), but empirical evidence for this assumption remains inconclusive. Here, we tested whether retaining non‐spatial object features (shapes) in WM interferes with attentional target selection processes in a concurrent search task that required spatial templates for target locations. Participants memorized one shape (low WM load) or four shapes (high WM load) in a sample display during a retention period. On some trials, they matched them to a subsequent memory test display. On other trials, a search display including two lateral bars in the upper or lower visual field was presented instead, and participants reported the orientation of target bars that were defined by their location (e.g., upper left or lower right). To assess the efficiency of attentional control under low and high WM load, EEG was recorded and the N2pc was measured as a marker of attentional target selection. Target N2pc components were strongly delayed when concurrent WM load was high, indicating that holding multiple object shapes in WM competes with the simultaneous retention of spatial attentional templates for target locations. These observations provide new electrophysiological evidence that such templates are maintained in WM, and also challenge suggestions that spatial and non‐spatial contents are represented in separate independent visual WM stores.     

You’re looking for what? Comparing search for familiar,nameable objects to search for unfamiliar,novel objects

Searching for items in one’s environment often includes considerable reliance on semantic knowledge. The present study examines the importance of semantic information in visual and memory search, especially with respect to whether the items reside in long-term or working memory. In Experiment 1, participants engaged in hybrid visual memory search for items that were either highly familiar or novel. Importantly, the relatively large number of targets in this hybrid search task necessitated that targets be stored in some form of long-term memory. We found that search for familiar objects was more efficient than search for novel objects. In Experiment 2, we investigated search for familiar versus novel objects when the number of targets was low enough to be stored in working memory. We also manipulated how often participants in Experiment 2 were required to update their target (every trial vs. every block) in order to control for target templates that were stored in long-term memory as a result of repeated exposure over trials. We found no differences in search efficiency for familiar versus novel objects when templates were stored in working memory. Our results suggest that while semantic information may provide additional individuating features that are useful for object recognition in hybrid search, this information could be irrelevant or even distracting when searching for targets stored in working memory.     

Stressing the mind: the effect of cognitive load and articulatory suppression on attentional guidance from working memory

Four experiments explored the effect of cognitive load on the time course of top-down guidance of attention from working memory (WM). Observers had to search for a target presented among several distractors, with the target and distractor stimuli embedded inside different objects. On half of the trials, one of the distractor objects was cued by a matching item held in WM. When a single item was maintained in memory, search performance was impaired relative to a neutral baseline, where the memory and search displays did not match. These effects of WM on subsequent search were reduced by including a verbal suppression task during the WM and search displays, and by varying the WM load. The degree of competition for resources in WM is a key factor in determining the time course and magnitude of the interaction between WM and visual selection.     

工作记忆表征精度加工需求对注意引导的影响

采用注意捕获范式, 通过行为和事件相关脑电位(ERP)实验, 探讨工作记忆表征精度加工需求对注意引导的影响, 行为结果发现, 在低精度加工需求条件下, 只有一个工作记忆表征引导注意, 且处于高激活状态的工作记忆表征产生的注意捕获大于低激活状态; 而在高精度加工需求条件下, 有两个工作记忆表征引导注意, 且处于高、低激活状态的工作记忆表征产生的注意捕获没有差异。ERP结果显示, 高精度加工需求条件下诱发的NSW和LPC大于低精度加工需求条件; 在高精度加工需求条件下, 干扰项与记忆项匹配比不匹配时, 诱发更大的N2和更小的N2pc, 而在低精度加工需求条件下, 干扰项与记忆项匹配和不匹配时诱发的N2、N2pc没有差异。研究表明, 工作记忆表征精度加工需求影响注意引导的机制可能是高精度加工需求下, 工作记忆表征消耗的认知资源增加, 搜索目标获得的资源减少, 干扰项捕获的注意增加。     

The properties of object representations constructed during visual search in natural scenes

To investigate properties of object representations constructed during a visual search task, we manipulated the proportion of trials/task within a block: In a search-frequent block, 80% of trials were search tasks; remaining trials presented a memory task; in a memory-frequent block, this proportion was reversed. In the search task, participants searched for a toy car (Experiments 1 and 2) or a T-shape object (Experiment 3). In the memory task, participants had to memorize objects in a scene. Memory performance was worse in the search-frequent block than in the memory-frequent block in Experiments 1 and 3, but not in Experiment 2 (token change in Experiment 1; type change in Experiments 2 and 3). Experiment 4 demonstrated that lower performance in the search-frequent block was not due to eye-movement behaviour. Results suggest that object representations constructed during visual search are different from those constructed during memorization and they are modulated by type of target.     

多身份追踪中基于表情特征的分组效应

探讨了表情因素作为身份特征对多身份追踪中分组效应的影响。采用多身份追踪范式, 8个客体为表情图片(正性、负性、中性)其中4个为目标, 对45名被试进行了有无眉毛线索对追踪表现影响的测查。实验条件分别为：目标表情与非目标表情完全不相同组(4水平, 简称分组)、目标表情与非目标表情都由两种相同数量的表情混合组成(3水平, 简称配对)与基线组(8个客体表情相同)。发现分组水平的成绩显著优于基线组, 配对水平的成绩显著低于基线组, 并表现出了负性表情的追踪优势; 另外, 有无眉毛线索对追踪表现无显著影响。这一结果说明多身份追踪中存在基于表情特征的分组效应, 负性表情的分组知觉高于正性表情。     

Selective learning of spatial configuration and object identity in visual search

To conduct an efficient visual search, visual attention must be guided to a target appropriately. Previous studies have suggested that attention can be quickly guided to a target when the spatial configurations of search objects or the object identities have been repeated. This phenomenon is termed contextual cuing. In this study, we investigated the effect of learning spatial configurations, object identities, and a combination of both configurations and identities on visual search. The results indicated that participants could learn the contexts of spatial configurations, but not of object identities, even when both configurations and identities were completely correlated (Experiment 1). On the other hand, when only object identities were repeated, an effect of identity learning could be observed (Experiment 2). Furthermore, an additive effect of configuration learning and identity learning was observed when, in some trials, each context was the relevant cue for predicting the target (Experiment 3). Participants could learn only the context that was associated with target location (Experiment 4). These findings indicate that when multiple contexts are redundant, contextual learning occurs selectively, depending on the predictability of the target location.     

Cognitive control over working memory biases of selection

Across many studies, researchers have found that representations in working memory (WM) can guide visual attention toward items that match the features of the WM contents. While some researchers have contended that this occurs involuntarily, others have suggested that the impact of WM contents on attention can be strategically controlled. Here, we varied the probability that WM items would coincide with either targets or distractors in a visual search task to examine (1) whether participants could intentionally enhance or inhibit the influence of WM items on attention and (2) whether cognitive control over WM biases would also affect access to the memory contents in a surprise recognition test. We found visual search to be faster when the WM item coincided with the search target, and this effect was enhanced when the memory item reliably predicted the location of the target. Conversely, visual search was slowed when the memory item coincided with a search distractor, and this effect was diminished, but not abolished, when the memory item was reliably associated with distractors. This strategic dampening of the influence of WM items on attention came at a price to memory, however, as participants were slowest to perform WM recognition tests on blocks in which the WM contents were consistently invalid. These results document that attentional capture by WM contents is partly, but not fully, malleable by top-down control, which appears to adjust the state of the WM contents to optimize search behavior. These data illustrate the role of cognitive control in modulating the strength of WM biases of selection, and they support a tight coupling between WM and attention.     

Automatic guidance of visual attention from verbal working memory

Previous studies have shown that visual attention can be captured by stimuli matching the contents of working memory (WM). Here, the authors assessed the nature of the representation that mediates the guidance of visual attention from WM. Observers were presented with either verbal or visual primes (to hold in memory, Experiment 1; to verbalize, Experiment 2; or merely to attend, Experiment 3) and subsequently were required to search for a target among different distractors, each embedded within a colored shape. In half of the trials, an object in the search array matched the prime, but this object never contained the target. Despite this, search was impaired relative to a neutral baseline in which the prime and search displays did not match. An interesting finding is that verbal primes were effective in generating the effects, and verbalization of visual primes elicited similar effects to those elicited when primes were held in WM. However, the effects were absent when primes were only attended. The data suggest that there is automatic encoding into WM when items are verbalized and that verbal as well as visual WM can guide visual attention.     

Neural substrates of successful working memory and long-term memory formation in a relational spatial memory task

Working memory (WM) tasks may involve brain activation actually implicated in long-term memory (LTM). In order to disentangle these two memory systems, we employed a combined WM/LTM task, using a spatial relational (object-location) memory paradigm and analyzed which brain areas were associated with successful performance for either task using fMRI. Critically, we corrected for the performance on the respective memory task when analyzing subsequent memory effects. The WM task consisted of a delayed-match-to-sample task assessed in an MRI scanner. Each trial consisted of an indoor or outdoor scene in which the exact configuration of four objects had to be remembered. After a short delay (7–13 s), the scene was presented from a different angle and spatial recognition for two objects was tested. After scanning, participants received an unexpected subsequent recognition memory (LTM) task, where the two previously unprobed objects were tested. Brain activity during encoding, delay phase and probe phase was analyzed based on WM and LTM performance. Results showed that successful WM performance, when corrected for LTM performance, was associated with greater activation in the inferior frontal gyrus and left fusiform gyrus during the early stage of the maintenance phase. A correct decision during the WM probe was accompanied by greater activation in a wide network, including bilateral hippocampus, right superior parietal gyrus and bilateral insula. No voxels exhibited supra-threshold activity during the encoding phase, and we did not find any differential activity for correct versus incorrect trials in the WM task when comparing LTM correct versus LTM incorrect trials.     

A secondary task is not always costly: Context‐based guidance of visual search survives interference from a demanding working memory task

Repeatedly encountering a visual search display with the target located at a fixed position relative to the distractors facilitates target detection, relative to novel displays – which is attributed to search guidance by (acquired) long‐term memory (LTM) of the distractor ‘context’ of the target. Previous research has shown that this ‘contextual cueing’ effect is severely impeded during learning when participants have to perform a demanding spatial working memory (WM) task concurrently with the search task, though it does become manifest when the WM task is removed. This has led to the proposal that search guidance by LT context memories critically depends on spatial WM to become ‘expressed’ in behaviour. On this background, this study, of two experiments, asked: (1) Would contextual cueing eventually emerge under dual‐task learning conditions if the practice on the task(s) is extended beyond the short training implemented in previous studies? and given sufficient practice, (2) Would performing the search under dual‐task conditions actually lead to an increased cueing effect compared to performing the visual search task alone? The answer is affirmative to both questions. In particular, Experiment 1 showed that a robust contextual cueing effect emerges within 360–720 dual‐task trials as compared to some 240 single‐task trials. Further, Experiment 2 showed that when dual‐ and single‐task conditions are performed in alternating trials blocks, the cueing effect for the very same set of repeated displays is significantly larger in dual‐task blocks than in single‐task blocks. This pattern of effects suggests that dual‐task practice eventually leads to direct, or ‘automatic’, guidance of visual search by learnt spatial LTM representations, bypassing WM processes. These processes are normally engaged in single‐task performance might actually interfere with direct LTM‐based search guidance.     

Age differences in what is viewed and remembered in complex conjunction search

Older and younger adults searched arrays of 12 unique real-world photographs for a specified object (e.g., a yellow drill) among distractors (e.g., yellow telephone, red drill, and green door). Eye-tracking data from 24 of 48 participants in each age group showed generally similar search patterns for the younger and older adults but there were some interesting differences. Older adults processed all the items in the arrays more slowly than the younger adults (e.g., they had longer fixation durations, gaze durations, and total times), but this difference was exaggerated for target items. We also found that older and younger adults differed in the sequence in which objects were searched, with younger adults fixating the target objects earlier in the trial than older adults. Despite the relatively longer fixation times on the targets (in comparison to the distractors) for older adults, a surprise visual recognition test revealed a sizeable age deficit for target memory but, importantly, no age differences for distractor memory.     

身份交换对多身份追踪表现的影响

本研究探讨了身份交换对多身份追踪表现的影响。实验1和实验2分别考察了全部报告法和部分报告法下身份交换对多身份追踪表现的具体影响。结果均发现, 身份交换对身份−位置绑定干扰程度越大, 位置追踪和身份识别容量也均越低, 但位置容量始终高于身份容量, 并且这些特性在不同追踪负荷上相同。此外, 部分报告法比全部报告法更具有容量测量优势。实验3则进一步从听觉通道上控制了语音复述对当前任务的干扰, 所得结果仍支持实验1和实验2。这表明, 身份交换对多身份追踪的干扰机制是身份−位置绑定机制受到损害, 而非语音复述的作用。     

Effects of semantic priming on visual encoding of pictures

We investigated the effects of semantic priming on initial encoding of briefly presented pictures of objects and scenes. Pictures in four experiments were presented for varying durations and were followed immediately by a mask. In Experiments 1 and 2, pictures of simple objects were either preceded or not preceded by the object's category name (e.g., dog). In Experiment 1 we measured immediate object identification; in Experiment 2 we measured delayed old/new recognition in which targets and distractors were from the same categories. In Experiment 3 naturalistic scenes were either preceded or not preceded by the scene's category name (e.g., supermarket). We measured delayed recognition in which targets and distractors were described by the same category names. In Experiments 1-3, performance was better for primed than for unprimed pictures. Experiment 4 was similar to Experiment 2 in that we measured delayed recognition for simple objects. As in Experiments 1-3, a prime that preceded the object improved subsequent memory performance for the object. However, a prime that followed the object did not affect subsequent performance. Together, these results imply that priming leads to more efficient information acquisition. We offer a picture-processing model that accounts for these results. The model's central assumption is that knowledge of a picture's category (gist) increases the rate at which visual information is acquired from the picture.     

Reinforcement of inhibitory positional priming by spatial working memory contents

This study examined whether positional priming of pop-out is modulated by spatial working memory (WM). In Experiments 1A and 1B, observers were presented with a to-be-memorized item (Experiment 1A: triangle; Experiment 1B: circle) prior to performing a block of search trials, with triangular stimulus configurations (one target, two distractors) on an underlying elliptical frame. Each search block was followed by a memory test (i.e., memory conditions). In Experiment 1C, the presentation of the memory item (triangle) was immediately followed by the memory test, and the search block was performed after this test (i.e., no-memory condition). It was found that targets presented at a previous target were detected faster and targets presented at a previous distractor location slower, relative to a previous empty (‘neutral’) stimulus location, respectively. While facilitatory position priming was uninfluenced by the memory manipulation, inhibitory positional priming was larger in the memory than no-memory condition, but only when the memory stimulus (triangle) matched the (triangle) configuration formed by the three search items. This finding of larger inhibitory priming under memory conditions provides further evidence that positional priming, rather than being purely bottom-up determined, is open to top-down influences.     

Age differences in what is viewed and remembered in complex conjunction search

Older and younger adults searched arrays of 12 unique real-world photographs for a specified object (e.g., a yellow drill) among distractors (e.g., yellow telephone, red drill, and green door). Eye-tracking data from 24 of 48 participants in each age group showed generally similar search patterns for the younger and older adults but there were some interesting differences. Older adults processed all the items in the arrays more slowly than the younger adults (e.g., they had longer fixation durations, gaze durations, and total times), but this difference was exaggerated for target items. We also found that older and younger adults differed in the sequence in which objects were searched, with younger adults fixating the target objects earlier in the trial than older adults. Despite the relatively longer fixation times on the targets (in comparison to the distractors) for older adults, a surprise visual recognition test revealed a sizeable age deficit for target memory but, importantly, no age differences for distractor memory.     

Incidental visual memory for targets and distractors in visual search

We explored incidental retention of visual details of encountered objects during search. Participants searched for conjunction targets in 32 arrays of 12 pictures of real-world objects and then performed a token discrimination task that examined their memory for visual details of the targets and distractors from the search task. The results indicate that even though participants had not been instructed to memorize the objects, the visual details of search targets and distractor objects related to the targets were retained after the search. Distractor objects unrelated to the search target were remembered more poorly. Eye-movement measures indicated that the objects that were remembered were looked at more frequently during search than those that were not remembered. These results provide support that detailed visual information is included incidentally in the visual representation of an object after the object is no longer in view.