Not all visual memories are created equal

Two experiments examined how well the long-term visual memories of objects that are encountered multiple times during visual search are updated. Participants searched for a target two or four times (e.g., white cat) among distractors that shared the target's colour, category, or were unrelated while their eye movements were recorded. Following the search, a surprise visual memory test was given. With additional object presentations, only target memory reliably improved; distractor memory was unaffected by the number of object presentations. Regression analyses using the eye movement variables as predictors indicated that number of object presentations predicted target memory with no additional impact of other viewing measures. In contrast, distractor memory was best predicted by the viewing pattern on the distractor objects. Finally, Experiment 2 showed that target memory was influenced by number of target object presentations, not number of searches for the target. Each of these experiments demonstrates visual memory differences between target and distractor objects and may provide insight into representational differences in visual memory.     

Incidental visual memory for objects in scenes

Three experiments were conducted to investigate the existence of incidentally acquired, long-term, detailed visual memory for objects embedded in previously viewed scenes. Participants performed intentional memorization and incidental visual search learning tasks while viewing photographs of real-world scenes. A visual memory test for previously viewed objects from these scenes then followed. Participants were not aware that they would be tested on the scenes following incidental learning in the visual search task. In two types of memory tests for visually specific object information (token discrimination and mirror-image discrimination), performance following both the memorization and visual search conditions was reliably above chance. These results indicate that recent demonstrations of good visual memory during scene viewing are not due to intentional scene memorization. Instead, long-term visual representations are incidentally generated as a natural product of scene perception.     

空间工作记忆负载对真实场景情境提示效应的影响

重复的画面布局能够促进观察者对目标项的搜索 (情境提示效应)。本研究采用双任务范式,分别在视觉搜索任务的学习阶段 (实验2a) 和测验阶段 (实验2b) 加入空间工作记忆任务, 并与单任务基线 (实验1)进行比较, 考察空间工作记忆负载对真实场景搜索中情境线索学习和情境提示效应表达的影响。结果发现: 空间负载会增大学习阶段的情境提示效应量, 同时削弱测验阶段的情境提示效应量, 而不影响情境线索的外显提取。由此可见, 真实场景中情境线索的学习和提示效应的表达均会受到有限的工作记忆资源的影响, 但情境线索提取的外显性不变。     

The boundary conditions of priming of visual search: From passive viewing through task-relevant working memory load

Priming of visual search has a dominating effect upon attentional shifts and is thought to play a decisive role in visual stability. Despite this importance, the nature of the memory underlying priming remains controversial. To understand more fully the necessary conditions for priming, we contrasted passive versus active viewing of visual search arrays. There was no priming from passive viewing of search arrays, while it was strong for active search of the same displays. Displays requiring no search resulted in no priming, again showing that search is needed for priming to occur. Finally, we introduced working memory load during visual search in an effort to disrupt priming. The memorized items had either the same colors as or different colors from the visual search items. Retaining items in working memory inhibited priming of the working memory task-relevant colors, while little interference was observed for unrelated colors. The picture that emerges of priming is that it requires active attentional processing of the search items in addition to the operation of visual working memory, where the task relevance of the working memory load plays a key role.     

The relationship between online visual representation of a scene and long-term scene memory

In 3 experiments the author investigated the relationship between the online visual representation of natural scenes and long-term visual memory. In a change detection task, a target object either changed or remained the same from an initial image of a natural scene to a test image. Two types of changes were possible: rotation in depth, or replacement by another object from the same basic-level category. Change detection during online scene viewing was compared with change detection after delay of 1 trial (Experiments 2A and 2B) until the end of the study session (Experiment 1) or 24 hr (Experiment 3). There was little or no decline in change detection performance from online viewing to a delay of 1 trial or delay until the end of the session, and change detection remained well above chance after 24 hr. These results demonstrate that long-term memory for visual detail in a scene is robust.     

Incidental memory for parts of scenes from eye movements

Incidental memory for parts of scenes was examined in two search experiments and one memory control experiment. Eye movements were recorded during the search experiments and used to select gaze-contingent sections from search scenes for a surprise memory recognition task. Results from the recognition task showed incidental memory was better for sections viewed longer and with multiple fixations. Sections not fixated during search were still recognized above chance as well. Differences in sections did not affect memory performance in a control experiment when viewing time was held constant. These results show that memory for parts of scenes can occur incidentally during search and encoding of tested sections is better with longer viewing time and with multiple fixations.     

Spatial working memory maintenance: Does attention play a role? A visual search study

Recent studies have proposed that a common mechanism may underlie spatial attention and spatial working memory. One proposal is that spatial working memory is maintained by attention-based rehearsal [Awh, E., Jonides, J., & Reuter-Lorenz, P. A. (1998). Rehearsal in spatial working memory. Journal of Experimental Psychology: Human Perception and Performance, 24(3), 780-790], and so a spatial attention shift during the retention interval of a spatial location should impair its memory performance. In the present study, participants engaged in single-item, parallel or serial search tasks while remembering a spatial location. Although memory tended to bias all searches, the need for an attentional shift during the retention interval impaired memory performance only in single-item search, but not in other searches. These findings suggest that previous evidence for the attention-based rehearsal account does not generalize to visual search. Results are discussed with regard to the relationship between spatial attention and spatial working memory.     

Indirect assessment of visual working memory for simple and complex objects

Previous research has shown that visual search performance is modulated by the current contents in visual working memory (VWM), even when the contents of VWM are irrelevant to the search task. For example, visual search is faster when the target--rather than a distractor--is surrounded by a shape currently held in VWM. This study uses the modulation of visual search by VWM to investigate properties of VWM. Participants wereasked to remember the color or the shape of novel polygons whose "goodness" of figure varied according to Garner's (1962) rotation and reflection transformation principle. During the memory retention interval, participants searched for a tilted line among vertical lines embedded inside colored polygons. Search was faster when the target--rather than a distractor--was enclosed by the remembered polygons. The congruity effect diminished with increasing memory load and decreasing figure goodness. We conclude that congruity effects in visual search can indirectly assess VWM representation strength.     

视空工作记忆负载对真实场景搜索绩效的影响

采用视空工作记忆任务和真实场景搜索任务相结合的双任务范式, 结合眼动技术将搜索过程划分为起始阶段、扫描阶段和确认阶段, 探究视空工作记忆负载对真实场景搜索绩效的影响机制, 同时考查试次间搜索目标是否变化、目标模板的具体化程度以及搜索场景画面的视觉混乱度所起的调节作用。结果表明, 视空工作记忆负载会降低真实场景搜索的成绩, 在搜索过程中表现为视空负载条件下扫描阶段持续时间的延长、注视点数目的增加和空间负载条件下确认阶段持续时间的延长, 视空负载对搜索过程的影响与目标模板的具体化程度有关; 空间负载会降低真实场景搜索的效率, 且与搜索画面的视觉混乱度有关, 而客体负载则不会。由此可见, 视空工作记忆负载对真实场景搜索绩效的影响不同, 空间负载对搜索过程的影响比客体负载更长久, 二者均受到目标模板具体化程度的调节; 仅空间负载会降低真实场景的搜索效率, 且受到搜索场景画面视觉混乱度的调节。     

Transfer of spatial context from visual to haptic search

Under incidental learning conditions, spatial layouts can be acquired implicitly and facilitate visual search (contextual-cueing effect). We examined whether the contextual-cueing effect is specific to the visual modality or transfers to the haptic modality. The participants performed 320 (experiment 1) or 192 (experiment 2) visual search trials based on a typical contextual-cueing paradigm, followed by haptic search trials in which half of the trials had layouts used in the previous visual search trials. The visual contextual-cueing effect was obtained in the learning phase. More importantly, the effect was transferred from visual to haptic searches; there was greater facilitation of haptic search trials when the spatial layout was the same as in the previous visual search trials, compared with trials in which the spatial layout differed from those in the visual search. This suggests the commonality of spatial memory to allocate focused attention in both visual and haptic modalities.     

Individual differences in visual imagery determine how event information is remembered

Individuals differ in how they mentally imagine past events. When reminiscing about a past experience, some individuals remember the event accompanied by rich visual images, while others will remember it with few of these images. In spite of the implications that these differences in the use of imagery have to the understanding of human memory, few studies have taken them into consideration. We examined how imagery interference affecting event memory retrieval was differently modulated by spatial and object imagery ability. We presented participants with a series of video-clips depicting complex events. Participants subsequently answered true/false questions related to event, spatial, or feature details contained in the videos, while simultaneously viewing stimuli that interfered with visual imagery processes (dynamic visual noise; DVN) or a control grey screen. The impact of DVN on memory accuracy was related to individual differences in spatial imagery ability. Individuals high in spatial imagery were less accurate at recalling details from the videos when simultaneously viewing the DVN stimuli compared to those low in spatial imagery ability. This finding held for questions related to the event and spatial details but not feature details. This study advocates for the inclusion of individual differences when studying memory processes.     

Automatic processing, code dissimilarity, and the efficiency of successive memory searches.

Two experiments examined the effects of automatic processing and code dissimilarity on the performance of successive memory searches through a single memory set having the same or different kinds of information (i.e., verbal and spatial). The results of both experiments showed that the total time to complete the successive searches was less when automatic processing was involved compared with when both searches required controlled processing. Performance of the successive searches improved substantially with practice. Both experiments also showed an asymmetrical temporal interference between the two searches. Aspects of the to-be-performed second search did not affect first-search reaction times (RTs), but performing the first search did affect the second-search RTs. The interfering effect of the first search was greatest when controlled processes that used the same code were required for both searches, whether the code was verbal or spatial. Several interpretations are offered for the interference generated by the first search. The joint effects of automatic processing and code dissimilarity are also discussed.     

Panoramic search: the interaction of memory and vision in search through a familiar scene

How do observers search through familiar scenes? A novel panoramic search method is used to study the interaction of memory and vision in natural search behavior. In panoramic search, observers see part of an unchanging scene larger than their current field of view. A target object can be visible, present in the display but hidden from view, or absent. Visual search efficiency does not change after hundreds of trials through an unchanging scene (Experiment 1). Memory search, in contrast, begins inefficiently but becomes efficient with practice. Given a choice between vision and memory, observers choose vision (Experiments 2 and 3). However, if forced to use their memory on some trials, they learn to use memory on all trials, even when reliable visual information remains available (Experiment 4). The results suggest that observers make a pragmatic choice between vision and memory, with a strong bias toward visual search even for memorized stimuli.     

Visual search is slowed when visuospatial working memory is occupied

Visual working memory plays a central role in most models of visual search. However, a recent study showed that search efficiency was not impaired when working memory was filled to capacity by a concurrent object memory task (Woodman, Vogel, & Luck, 2001). Objects and locations may be stored in separate working memory subsystems, and it is plausible that visual search relies on the spatial subsystem, but not on the object subsystem. In the present study, we sought to determine whether maintaining spatial information in visual working memory impairs the efficiency of a concurrent visual search task. Visual search efficiency and spatial memory accuracy were both impaired when the search and the memory tasks were performed concurrently, as compared with when the tasks were performed separately. These findings suggest that common mechanisms are used to process information during difficult visual search tasks and to maintain spatial information in working memory.     

The role of spatial working memory in visual search efficiency

Many theories have proposed that visual working memory plays an important role in visual search. In contrast, by showing that a nonspatial working memory load did not interfere with search efficiency, Woodman, Vogel, and Luck (2001) recently proposed that the role of working memory in visual search is insignificant. However, the visual search process may interfere with spatial working memory. In the present study, a visual search task was performed concurrently with either a spatial working memory task (Experiment 1) or a nonspatial working memory task (Experiment 2). We found that the visual search process interfered with a spatial working memory load, but not with a nonspatial working memory load. These results suggest that there is a distinction between spatial and nonspatial working memory in terms of interactions with visual search tasks. These results imply that the visual search process and spatial working memory storage require the same limited-capacity mechanisms.     

Object–scene inconsistencies do not capture gaze: evidence from the flash-preview moving-window paradigm

In the present study, we investigated the influence of object-scene relationships on eye movement control during scene viewing. We specifically tested whether an object that is inconsistent with its scene context is able to capture gaze from the visual periphery. In four experiments, we presented rendered images of naturalistic scenes and compared baseline consistent objects with semantically, syntactically, or both semantically and syntactically inconsistent objects within those scenes. To disentangle the effects of extrafoveal and foveal object-scene processing on eye movement control, we used the flash-preview moving-window paradigm: A short scene preview was followed by an object search or free viewing of the scene, during which visual input was available only via a small gaze-contingent window. This method maximized extrafoveal processing during the preview but limited scene analysis to near-foveal regions during later stages of scene viewing. Across all experiments, there was no indication of an attraction of gaze toward object-scene inconsistencies. Rather than capturing gaze, the semantic inconsistency of an object weakened contextual guidance, resulting in impeded search performance and inefficient eye movement control. We conclude that inconsistent objects do not capture gaze from an initial glimpse of a scene.     

Perceived shape regularity does not depend on regularities along the contour

In four experiments we investigated whether human observers are able to use certain regularities in polygons when they have to indicate which polygon they perceive as the more regular in a paired comparison task. From our results we conclude that regularities that are restricted to the contour do not play a role in judgments of regularity. For instance, equilateral polygons are not considered to be more regular than entirely random polygons. Only bilaterally symmetric polygons are consistently judged as regular. However, we show that this is caused by regularities across the polygon. These results are at odds with approaches that assume that regularities along the contour play an important part in visual perception.     

Rapid resumption of interrupted visual search. New insights on the interaction between vision and memory

A modified visual search task demonstrates that humans are very good at resuming a search after it has been momentarily interrupted. This is shown by exceptionally rapid response time to a display that reappears after a brief interruption, even when an entirely different visual display is seen during the interruption and two different visual searches are performed simultaneously. This rapid resumption depends on the stability of the visual scene and is not due to display or response anticipations. These results are consistent with the existence of an iterative hypothesis-testing mechanism that compares information stored in short-term memory (the perceptual hypothesis) with information about the display (the sensory pattern). In this view, rapid resumption occurs because a hypothesis based on a previous glance of the scene can be tested very rapidly in a subsequent glance, given that the initial hypothesis-generation step has already been performed.     

Using real-world scenes as contextual cues for search

Research on contextual cueing has demonstrated that with simple arrays of letters and shapes, search for a target increases in efficiency as associations between a search target and its surrounding visual context are learned. We investigated whether the visual context afforded by repeated exposure to real-world scenes can also guide attention when the relationship between the scene and a target position is arbitrary. Observers searched for and identified a target letter embedded in photographs of real-world scenes. Although search time within novel scenes was consistent across trials, search time within repeated scenes decreased across repetitions. Unlike previous demonstrations of contextual cueing, however, memory for scene-target covariation was explicit. In subsequent memory tests, observers recognized repeated contexts more often than those that were presented once and displayed superior recall of target position within the repeated scenes. In addition, repetition of inverted scenes, which made the scene more difficult to identify, produced a markedly reduced rate of learning, suggesting semantic information concerning object and scene identity are used to guide attention.     

Inhibition of return functions within but not across searches

Inhibition of return (IOR) facilitates visual search by discouraging the reinspection of recently processed items. We investigated whether IOR operates across two consecutive searches of the same display for different targets. In Experiment 1, we demonstrated that IOR is present within each of the two searches. In Experiment 2, we found no evidence for IOR across searches. In Experiment 3, we showed that IOR is present across the two searches when the first search is interrupted, suggesting that the completion of the search is what causes the resetting of IOR. We concluded that IOR is a partially flexible process that can be reset when the task completes, but not necessarily when it changes. When resetting occurs, this flexibility ensures that the inhibition of previously visited locations does not interfere with the new search.