Visual memory and visual perception: when memory improves visual search

This study examined the relationship between memory and perception in order to identify the influence of a memory dimension in perceptual processing. Our aim was to determine whether the variation of typical size between items (i.e., the size in real life) affects visual search. In two experiments, the congruency between typical size difference and perceptual size difference was manipulated in a visual search task. We observed that congruency between the typical and perceptual size differences decreased reaction times in the visual search (Exp. 1), and noncongruency between these two differences increased reaction times in the visual search (Exp. 2). We argue that these results highlight that memory and perception share some resources and reveal the intervention of typical size difference on the computation of the perceptual size difference.     

The types of stimuli loaded in memory can modulate its effects on visual search

The effects of memory load in visual search (VS) have shown a diversity of results from the absence through beneficial and detrimental effects of a concurrent memory load in VS performance. One of the hypotheses intended to explain the heterogeneity of results follows the idea proposed by certain models in the context of VS that the contents of working memory (WM) can modulate the attentional processes involved in VS (Desimone & Duncan, 1995; Duncan & Humphreys, 1989). In four experiments, we manipulated the similarity of information maintained in WM and those materials playing the role of target and distractors in the VS task. The results showed a beneficial effect in the first two experiments, where the materials in WM matched the target in VS. However, when they matched the distractors in the attentional task there is no effect in the slope of the search function. Present results strengthen those theories supporting that visual working memory is fractionated to allow for maintenance of items not essential to the attentional task (Downing & Dodds, 2004).     

Aging, memory and visual search

Potential age-related differences in the memory processes that underlie visual search are examined in the present study. Using a dynamic, gaze-contingent search paradigm developed to assess memory for previously examined distractors, older adults demonstrated no memory deficit. Surprisingly, older adults made fewer refixations compared to their younger counterparts, indicating better memory for previously inspected objects. This improved memory was not the result of a speed-accuracy trade-off or larger Inhibition-of-Return effects for older than for younger adults. Additional analyses suggested that older adults may derive their benefit from finer spatial encoding of search items. These findings suggest that some of the memory processes that support visual search are relatively age invariant.     

Processing differences between memory search and foveal visual search

The ability to detect small differences in the positions of two lines (vernier acuity) showed some improvement with practice in all eight subjects, even for subjects given no error feedback. The average decline in threshold with training (2,000–2,500 responses) was about 40%. We used three target orientations: vertical, horizontal, and right oblique. Orientational differences remained stable in only one subject. In five subjects, orientational differences present at the beginning of training diminished or disappeared with increased experience; in two, they increased.     

Interrupted visual searches reveal volatile search memory

This study investigated memory from interrupted visual searches. Participants conducted a change detection search task on polygons overlaid on scenes. Search was interrupted by various disruptions, including unfilled delay, passive viewing of other scenes, and additional search on new displays. Results showed that performance was unaffected by short intervals of unfilled delay or passive viewing, but it was impaired by additional search tasks. Across delays, memory for the spatial layout of the polygons was retained for future use, but memory for polygon shapes, background scene, and absolute polygon locations was not. The authors suggest that spatial memory aids interrupted visual searches, but the use of this memory is easily disrupted by additional searches.     

Effects of memory load on visual search

It remains unclear how memory load affects attentional processes in visual search (VS). No effects, as well as beneficial and detrimental effects of memory load, have been found in this type of task. The main goal of the present research was to explore whether memory load has a modulating effect on VS by means of a different attentional set induced by the order of trials (mixed vs. blocked) and by the time presentation of visual display (long vs. short). In Experiment 1, we randomized the order of type of trial (5, 10 and 15 items presented in the display) while it remained constant (10 items) in Experiments 2A and 2B. In the later experiments, we also changed time presentation of visual display (3000 vs. 1300 ms, respectively). Results showed no differential effects of memory load in Experiments 1 and 2A, but they showed up in Experiment 2B: RTs were longer in the attentional task for trials under high memory load conditions. Although our hypothesis of the attentional set is supported by the results, other theoretical implications are also worth discussing in order to better understand how memory load may modulate attentional processes in VS.     

Incidental visual memory for targets and distractors in visual search

We explored incidental retention of visual details of encountered objects during search. Participants searched for conjunction targets in 32 arrays of 12 pictures of real-world objects and then performed a token discrimination task that examined their memory for visual details of the targets and distractors from the search task. The results indicate that even though participants had not been instructed to memorize the objects, the visual details of search targets and distractor objects related to the targets were retained after the search. Distractor objects unrelated to the search target were remembered more poorly. Eye-movement measures indicated that the objects that were remembered were looked at more frequently during search than those that were not remembered. These results provide support that detailed visual information is included incidentally in the visual representation of an object after the object is no longer in view.     

Working memory can enhance unconscious visual perception

We demonstrate that unconscious processing of a stimulus property can be enhanced when there is a match between the contents of working memory and the stimulus presented in the visual field. Participants first held a cue (a colored circle) in working memory and then searched for a brief masked target shape presented simultaneously with a distractor shape. When participants reported having no awareness of the target shape at all, search performance was more accurate in the valid condition, where the target matched the cue in color, than in the neutral condition, where the target mismatched the cue. This effect cannot be attributed to bottom-up perceptual priming from the presentation of a memory cue, because unconscious perception was not enhanced when the cue was merely perceptually identified but not actively held in working memory. These findings suggest that reentrant feedback from the contents of working memory modulates unconscious visual perception.     

In search of remembrance: evidence for memory in visual search

Observers searched for a target among distractors while the display items traded places every 110 ms. Search was slower when the target was always relocated to a position previously occupied by a distractor than when the items remained in place, showing the importance of memory for locations in a visual search task. Experiment 2 repeated a previous study in which items could move to any location within the display, but used a larger range of set sizes than tested in the earlier study. A cost in search times to relocating items was found at the larger set sizes, most likely reflecting that the probability that the target would replace a distractor increased witht he set size. The findings provide strong evidence for the role of memory for locations within trials in a visual search task.     

Spatial and nonspatial working memory and visual search

It has been indicated that visual search is interfered with in spatial working memory (WM), although not in nonspatial WM. In this study, the effects on visual search of individual differences in spatial and nonspatial WM were examined. Two visual search conditions were used: a conjunction search condition comprising two features (color and shape) and a disjunction condition comprising only one feature (color or shape). 96 participants (42 men, 54 women, M age = 20.9 yr., SD = 3.5) participated in this study. The participants were divided into high and low WM groups based on their spatial and nonspatial WM test scores. As a result, statistically significant group differences in the conjunction search rate were observed in spatial WM but not in nonspatial WM. These results suggest there is a relationship between visual search and the individual spatial WM ability, but this does not hold for nonspatial WM.     

Automatic and intentional memory processes in visual search

Previous research has indicated that saccade target selection during visual search is influenced by scanning history. Already inspected items are less likely to be chosen as saccade targets as long as the number intervening saccades is small. Here, we adapted Jacoby’s (1991) process dissociation procedure to assess the role of intentional and automatic processes in saccade target selection. Results indicate a large automatic component biasing participants to move their eyes to unexamined locations. However, an intentional component allowed participants to both reinspect old items and aid their selection of new items. A second experiment examined inhibition of return (IOR) as a candidate for the observed automatic component. IOR was found for items that had been previously examined. It is concluded that both automatic and intentional memory traces are available to guide the eyes during search.     

Explicit memory for rejected distractors during visual search

Although memory for the identities of examined items is not used to guide visual search, identity memory may be acquired during visual search. In all experiments reported here, search was occasionally terminated and a memory test was presented for the identity of a previously examined item. Participants demonstrated memory for the locations of the examined items by avoiding revisits to these items and memory performance for the items’ identities was above chance but lower than expected based on performance in intentional memory tests. Memory performance improved when the foil was not from the search set, suggesting that explicit identity memory is not bound to memory for location. Providing context information during test improved memory for the most recently examined item. Memory for the identities of previously examined items was best when the most recently examined item was tested, contextual information was provided, and location memory was not required.     

The contents of visual working memory reduce uncertainty during visual search

Information held in visual working memory (VWM) influences the allocation of attention during visual search, with targets matching the contents of VWM receiving processing benefits over those that do not. Such an effect could arise from multiple mechanisms: First, it is possible that the contents of working memory enhance the perceptual representation of the target. Alternatively, it is possible that when a target is presented among distractor items, the contents of working memory operate postperceptually to reduce uncertainty about the location of the target. In both cases, a match between the contents of VWM and the target should lead to facilitated processing. However, each effect makes distinct predictions regarding set-size manipulations; whereas perceptual enhancement accounts predict processing benefits regardless of set size, uncertainty reduction accounts predict benefits only with set sizes larger than 1, when there is uncertainty regarding the target location. In the present study, in which briefly presented, masked targets were presented in isolation, there was a negligible effect of the information held in VWM on target discrimination. However, in displays containing multiple masked items, information held in VWM strongly affected target discrimination. These results argue that working memory representations act at a postperceptual level to reduce uncertainty during visual search.     

Working memory can compare two visual items without accessing visual consciousness

Recent studies argued that unconscious visual information could access the working memory, however, it is still unclear whether the central executive could be activated unconsciously. We investigated, using a delayed match-to-sample task, whether the central executive is an unconscious process. In the experiment of the present study, participants were asked to compare the locations of two given visual targets. Both targets (or one of the two targets, depending on the experimental condition) were masked by a visual masking paradigm. The results showed an above-chance-level performance even in the condition that participants compared two unconscious targets. However, when the trials with the non-visual conscious experience of the target were removed from the analysis, the performance was no longer significantly different from chance level. Our results suggest that the central executive could be activated unconsciously by some level of stimulus signal, that is still below the threshold for a subjective report.     

Searching while loaded: Visual working memory does not interfere with hybrid search efficiency but hybrid search uses working memory capacity

In “hybrid search” tasks, such as finding items on a grocery list, one must search the scene for targets while also searching the list in memory. How is the representation of a visual item compared with the representations of items in the memory set? Predominant theories would propose a role for visual working memory (VWM) either as the site of the comparison or as a conduit between visual and memory systems. In seven experiments, we loaded VWM in different ways and found little or no effect on hybrid search performance. However, the presence of a hybrid search task did reduce the measured capacity of VWM by a constant amount regardless of the size of the memory or visual sets. These data are broadly consistent with an account in which VWM must dedicate a fixed amount of its capacity to passing visual representations to long-term memory for comparison to the items in the memory set. The data cast doubt on models in which the search template resides in VWM or where memory set item representations are moved from LTM through VWM to earlier areas for comparison to visual items.     

Implied motion language can influence visual spatial memory

How do language and vision interact? Specifically, what impact can language have on visual processing, especially related to spatial memory? What are typically considered errors in visual processing, such as remembering the location of an object to be farther along its motion trajectory than it actually is, can be explained as perceptual achievements that are driven by our ability to anticipate future events. In two experiments, we tested whether the prior presentation of motion language influences visual spatial memory in ways that afford greater perceptual prediction. Experiment 1 showed that motion language influenced judgments for the spatial memory of an object beyond the known effects of implied motion present in the image itself. Experiment 2 replicated this finding. Our findings support a theory of perception as prediction.     

Recollection can be weak and familiarity can be strong

The remember-know procedure is widely used to investigate recollection and familiarity in recognition memory, but almost all of the results obtained with that procedure can be readily accommodated by a unidimensional model based on signal-detection theory. The unidimensional model holds that remember judgments reflect strong memories (associated with high confidence, high accuracy, and fast reaction times), whereas know judgments reflect weaker memories (associated with lower confidence, lower accuracy, and slower reaction times). Although this is invariably true on average, a new 2-dimensional account (the continuous dual-process model) suggests that remember judgments made with low confidence should be associated with lower old-new accuracy but higher source accuracy than know judgments made with high confidence. We tested this prediction--and found evidence to support it--using a modified remember-know procedure in which participants were first asked to indicate a degree of recollection-based or familiarity-based confidence for each word presented on a recognition test and were then asked to recollect the color (red or blue) and screen location (top or bottom) associated with the word at study. For familiarity-based decisions, old-new accuracy increased with old-new confidence, but source accuracy did not (suggesting that stronger old-new memory was supported by higher degrees of familiarity). For recollection-based decisions, both old-new accuracy and source accuracy increased with old-new confidence (suggesting that stronger old-new memory was supported by higher degrees of recollection). These findings suggest that recollection and familiarity are continuous processes and that participants can indicate which process mainly contributed to their recognition decisions.     

Aging and guided visual search: the role of visual working memory

In the present study, we examined age-related differences in utilizing learned associations to guide visual search. Participants viewed an object cue that was associated with 1 or 2 target colors, followed by a search array. Older adults showed slower RTs, larger visual search slopes, and reduced cue–target association knowledge than did younger adults. We also found increased search RTs and higher error rates when the cue was associated with 2 colors instead of 1. However, visual search slopes did not vary with the number of associated colors. This indicates that participants could activate multiple templates simultaneously to guide the search or retrieve associative information directly from the long-term memory. Furthermore, regression analyses showed that VWMC can predict both visual search performances and cue–target association knowledge. More broadly, our results demonstrate that VWMC can modify the effects of age on cued visual search performance.