Organization of visual short-term memory

The authors examined the organization of visual short-term memory (VSTM). Using a change-detection task, they reported that VSTM stores relational information between individual items. This relational processing is mediated by the organization of items into spatial configurations. The spatial configuration of visual objects is important for VSTM of spatial locations, colors, and shapes. When color VSTM is compared with location VSTM, spatial configuration plays an integral role because configuration is important for color VSTM, whereas color is not important for location VSTM. The authors also examined the role of attention and found that the formation of configuration is modulated by both top-down and bottom-up attentional factors. In summary, the authors proposed that VSTM stores the relational information of individual visual items on the basis of global spatial configuration.     

Spatial reference in multiple object tracking

Spatial reference in multiple object tracking is available from configurations of dynamic objects and static reference objects. In three experiments, we studied the use of spatial reference in tracking and in relocating targets after abrupt scene rotations. Observers tracked 1, 2, 3, 4, and 6 targets in 3D scenes, in which white balls moved on a square floor plane. The floor plane was either visible thus providing static spatial reference or it was invisible. Without scene rotations, the configuration of dynamic objects provided sufficient spatial reference and static spatial reference was not advantageous. In contrast, with abrupt scene rotations of 20°, static spatial reference supported in relocating targets. A wireframe floor plane lacking local visual detail was as effective as a checkerboard. Individually colored geometric forms as static reference objects provided no additional benefit either, even if targets were centered on these forms at the abrupt scene rotation. Individualizing the dynamic objects themselves by color for a brief interval around the abrupt scene rotation, however, did improve performance. We conclude that attentional tracking of moving targets proceeds within dynamic configurations but detached from static local background.     

Understanding the object benefit in visual short-term memory: the roles of feature proximity and connectedness

Past research has identified visual objects as the units of information processing in visual short-term memory (VSTM) and has shown that two features from the same object can be remembered in VSTM as well (or almost as well) as one feature of that object and are much better remembered than the same two features from two spatially separated objects. It is not clear, however, what drives this object benefit in VSTM. Is it the shared spatial location (proximity), the connectedness among features of an object, or both? In six change detection experiments, both location/proximity and connectedness were found to be crucial in determining the magnitude of the object benefit in VSTM. Together, these results indicate that location/proximity and connectedness are essential elements in defining a coherent visual object representation in VSTM.     

Eye movements and the integration of visual memory and visual perception

Because visual perception has temporal extent, temporally discontinuous input must be linked in memory. Recent research has suggested that this may be accomplished by integrating the active contents of visual short-term memory (VSTM) with subsequently perceived information. In the present experiments, we explored the relationship between VSTM consolidation and maintenance and eye movements, in order to discover how attention selects the information that is to be integrated. Specifically, we addressed whether stimuli needed to be overtly attended in order to be included in the memory representation or whether covert attention was sufficient. Results demonstrated that in static displays in which the to-be-integrated information was presented in the same spatial location, VSTM consolidation proceeded independently of the eyes, since subjects made few eye movements. In dynamic displays, however, in which the to-be-integrated information was presented in different spatial locations, eye movements were directly related to task performance. We conclude that these differences are related to different encoding strategies. In the static display case, VSTM was maintained in the same spatial location as that in which it was generated. This could apparently be accomplished with covert deployments of attention. In the dynamic case, however, VSTM was generated in a location that did not overlap with one of the to-be-integrated percepts. In order to "move" the memory trace, overt shifts of attention were required.     

客体运动方向的视觉工作记忆存储方式

采用变化觉察范式,以独立运动的客体为对象,通过两个实验,探讨多个客体的运动方向在视觉工作记忆中的存储机制,即单个对象独立存储,抑或其存储受多个客体构型的影响。实验一和实验二相继考察了非目标客体运动方向变化,以及是否存在非目标客体对觉察目标客体运动方向的影响。结果发现,非目标客体运动方向变化条件下的觉察正确率显著低于不变的条件,然而只呈现目标客体条件下的觉察正确率与同时呈现目标和非目标条件无显著差异。该结果与前人在静态条件下对目标客体的觉察受目标客体和非目标客体整体构型影响的结论不一致。本研究的结果支持多个客体的运动方向信息在工作记忆中是以独立方式存储的假设。     

Effects of modally completed surfaces on change detection

The phenomenon of change blindness suggests that we have a severe capacity limitation in scene perception. The storage of surface representations can overcome this limitation by providing efficient cues about objects in the world. Five experiments examined whether subjective surfaces are preferentially processed in visual short-term memory (VSTM) in a change detection task using a flicker paradigm. Even with the same amount of physical change applied to the figures, people were faster and more accurate in detecting a change involving the presence and absence of a subjective surface than in detecting changes involving subjective contours or rotational symmetry. The effects were not solely due to the configuration of the inducers or to the attentional set. The advantage for the subjective surface reflects the faster encoding into VSTM. Modally completed surfaces play important roles not only in visual perception and search, but also in visual cognition involving VSTM.     

客体运动方向的视觉工作记忆容量

记忆动态场景中多客体的特征和时空信息是人类重要的认知活动。目前有关视觉工作记忆的研究虽然广泛探讨了对视觉信息的存储容量及机制,然而所采用的刺激材料均呈现于静态场景中,且不包含运动信息。而有关多客体追踪的研究只关注动态场景中多客体信息的实时更新,而不涉及一段时间内对客体信息的保持。本研究结合视觉工作记忆领域的变化觉察范式和多客体追踪范式,以独立运动的客体为刺激材料,探讨多个客体的运动方向信息在工作记忆中的存储容量问题。结果表明,在工作记忆中能够存储大约3个客体的运动方向信息。     

Visual short-term memory during smooth pursuit eye movements

Visual short-term memory (VSTM) was probed while observers performed smooth pursuit eye movements. Smooth pursuit keeps a moving object stabilized in the fovea. VSTM capacity for position was reduced during smooth pursuit compared with a condition with eye fixation. There was no difference between a condition in which the items were approximately stabilized on the retina because they moved with the pursuit target and a condition in which the items moved across the retina because they were stationary in space. The reduction of capacity for position was eliminated when miniature items were presented on the pursuit target. Similarly, VSTM capacity for color did not differ between smooth pursuit and fixation. The results suggest that visuospatial attention is tied to the target during smooth pursuit, which impairs VSTM for the position of peripheral objects. Sensory memory during smooth pursuit was only slightly impaired.     

Exploring the memory advantage for moving scenes

Recognition memory is better for moving images than for static images (the dynamic superiority effect), and performance is best when the mode of presentation at test matches that at study (the study–test congruence effect). We investigated the basis for these effects. In Experiment 1, dividing attention during encoding reduced overall performance but had little effect on the dynamic superiority or study–test congruence effects. In addition, these effects were not limited to scenes depicting faces. In Experiment 2, movement improved both old–new recognition and scene orientation judgements. In Experiment 3, movement improved the recognition of studied scenes but also increased the spurious recognition of novel scenes depicting the same people as studied scenes, suggesting that movement increases the identification of individual objects or actors without necessarily improving the retrieval of associated information. We discuss the theoretical implications of these results and highlight directions for future investigation.     

Object-position binding in visual short-term memory for sequentially presented unfamiliar stimuli

The effect of spatial position on visual short-term memory (VSTM) for sequentially presented objects has been investigated relatively little, despite the fact that vision in natural environments is characterised by frequent changes in object position and gaze location. We investigated the effect of reusing previously examined spatial positions on VSTM for object appearance. Observers performed a yes-no recognition task following a memory display comprising briefly presented 1/f noise discs (ie possessing spectral properties akin to natural images) shown sequentially at random coordinates. At test, single stimuli were presented either at original spatial positions, new positions, or at a fixed central position. Results, interpreted in terms of appearance and position preview effects, indicate that, where original spatial positions were reused at test, memory performance was elevated by more than 25%, despite that spatial position was task-irrelevant (in the sense that it could not be used to facilitate a correct response per se). This study generalises object-spatial-position binding theory to a sequential display scenario in which the influences of extrafoveal processing, spatial context cues, and long-term memory support were minimised, thereby eliminating the hypothesis that object priming is the principal cause of the 'same-position advantage' in VSTM.     

The effect of noun animacy on the processing of unambiguous sentences: Evidence from French relative clauses

It has previously been shown that moving images are remembered better than static ones. In two experiments, we investigated the basis for this dynamic superiority effect. Participants studied scenes presented as a single static image, a sequence of still images, or a moving video clip, and 3 days later completed a recognition test in which familiar and novel scenes were presented in all three formats. We found a marked congruency effect: For a given study format, accuracy was highest when test items were shown in the same format. Neither the dynamic superiority effect nor the study–test congruency effect was affected by encoding (Experiment 1) or retrieval (Experiment 2) manipulations, suggesting that these effects are relatively impervious to strategic control. The results demonstrate that the spatio-temporal properties of complex, realistic scenes are preserved in long-term memory.     

Object-based representations govern both the storage of information in visual short-term memory and the retrieval of information from it

Interest is growing in how information is retained in visual short-term memory (VSTM). We describe an experiment that assesses VSTM within the context of multidimensional signal detection theory. On every trial, participants were presented with a 250-ms display containing four colored shapes. They were then probed 900 ms later with a colored shape and made separate old/new judgments about the color and the shape. In any particular trial, one, both, or neither of the probed features had been presented. Performance differed according to whether both probed features belonged to a single object or to two different objects. When both probed features belonged to the same object, featural retrieval was better than would be predicted by independent feature storage. When both probed features belonged to two different objects, featural retrieval was worse than would be predicted by independent feature storage. We conclude that storage in and retrieval from VSTM operate on the basis of object-based representations.     

Erratum to: The organization of room geometry and object layout geometry in human memory

Research with humans and with nonhuman species has suggested a special role of room geometry in spatial memory functioning. In two experiments, participants learned the configuration of a room with four corners, along with the configuration of four objects within the room, while standing in a fixed position at the room’s periphery. The configurations were either rectangular (Experiment 1) or irregular (Experiment 2). Room geometry was not recalled better than object layout geometry, and memories for both configurations were orientation dependent. These results suggest that room geometry and object layout geometry are represented similarly in human memory, at least in situations that promote long-term learning of object locations. There were also some differences between corners and objects in orientation dependence, suggesting that the two sources of information are represented in similar but separate spatial reference systems.     

Visual working memory for dynamic objects: Impaired binding between object feature and location

In daily life, people frequently need to observe dynamic objects and temporarily maintain their representations in visual working memory (VWM). The present study explored the mechanism underlying the binding between perceptual features and locations of dynamic objects in VWM. In three experiments, we measured and compared the memory performance for feature-location binding of multiple dynamic and static objects. The results showed that the feature-location binding was impaired for the dynamic objects compared with the static objects. The impairment persisted when the global spatial configuration of the objects remained intact during the motion, as well as when the binding task was relatively easy, such as binding between single-feature objects and coarse locations. The results indicate that object features and locations are not maintained in VWM as well-integrated object files; rather, the formation of feature-location binding may require additional processes, which are disrupted by the constant change of locations in dynamic circumstances. We propose a consolidation process as possible underlying mechanism, and discuss factors that may influence the strength of feature-location binding in dynamic circumstances.     

Orienting attention to locations in mental representations

Many cognitive processes depend on our ability to hold information in mind, often well beyond the offset of the original sensory input. The capacity of this visual short-term memory (VSTM) is limited to around three to four items. Recent research has demonstrated that the content of VSTM can be modulated by top-down attentional biases. This has been demonstrated using retrodictive spatial cues, termed "retro-cues," which orient subjects' attention to spatial locations within VSTM. In the present article, we tested whether the use of these cues is modulated by memory load and cue delay. There are a number of important conclusions: (1) Top-down biases can operate on very brief iconic traces as well as on older VSTM representations (Exp. 1). (2) When operating within capacity, subjects use the cue to prioritise where they initiate their memory search, rather than to discard uncued items (Exps. 2 and 3). (3) When capacity is exceeded, there is little benefit to top-down biasing relative to a neutral condition; however, unattended items are lost, with there being a substantial cost of invalid spatial cueing (Exp. 3). (4) These costs and benefits of orienting spatial attention differ across iconic memory and VSTM representations when VSTM capacity is exceeded (Exp. 4).     

Attention effects during visual short-term memory maintenance: protection or prioritization?

Interactions between visual attention and visual short-term memory (VSTM) play a central role in cognitive processing. For example, attention can assist in selectively encoding items into visual memory. Attention appears to be able to influence items already stored in visual memory, as well; cues that appear long after the presentation of an array of objects can affect memory for those objects (Griffin & Nobre, 2003). In five experiments, we distinguished two possible mechanisms for the effects of cues on items currently stored in VSTM. A protection account proposes that attention protects the cued item from becoming degraded during the retention interval. By contrast, aprioritization account suggests that attention increases a cued item's priority during the comparison process that occurs when memory is tested. The results of the experiments were consistent with the first of these possibilities, suggesting that attention can serve to protect VSTM representations while they are being maintained.     

The influence of spatial pattern on visual short-term memory for contrast

Several psychophysical studies of visual short-term memory (VSTM) have shown high-fidelity storage capacity for many properties of visual stimuli. On judgments of the spatial frequency of gratings, for example, discrimination performance does not decrease significantly, even for memory intervals of up to 30 s. For other properties, such as stimulus orientation and contrast, however, such “perfect storage” behavior is not found, although the reasons for this difference remain unresolved. Here, we report two experiments in which we investigated the nature of the representation of stimulus contrast in VSTM using spatially complex, two-dimensional random-noise stimuli. We addressed whether information about contrast per se is retained during the memory interval by using a test stimulus with the same spatial structure but either the same or the opposite local contrast polarity, with respect to the comparison (i.e., remembered) stimulus. We found that discrimination thresholds got steadily worse with increasing duration of the memory interval. Furthermore, performance was better when the test and comparison stimuli had the same local contrast polarity than when they were contrast-reversed. Finally, when a noise mask was introduced during the memory interval, its disruptive effect was maximal when the spatial configuration of its constituent elements was uncorrelated with those of the comparison and test stimuli. These results suggest that VSTM for contrast is closely tied to the spatial configuration of stimuli and is not transformed into a more abstract representation.     

The distribution of attention within objects in multiple-object scenes: prioritization by spatial probabilities and a center bias

This study investigates how the attentional distribution within objects is affected by spatial probabilities, bias toward objects' centers (Alvarez & Scholl, 2005), and object motion. In a multiple-object tracking task, observers tracked line objects while simultaneously detecting probes appearing on the objects. Experiments 1 and 2 manipulated the probabilities of probes appearing at the centers and ends of objects. Overall, probe detection was better at centers than at ends, but it was also affected by probe location probabilities; when probe locations were 100% certain, the center advantage was eliminated. Experiment 3 manipulated rotational, translational, and size-change components of object motion. The center advantage still occurred with stationary objects, and its magnitude was not affected by different motion types. These results indicate that attention is biased toward the centers of objects in multiple-object scenes, both for stationary and moving objects. They also imply that attentional prioritizations based on spatial probabilities can accompany moving objects.     

Testing visual short-term memory of pigeons (Columba livia) and a rhesus monkey (Macaca mulatta) with a location change detection task

Change detection is commonly used to assess capacity (number of objects) of human visual short-term memory (VSTM). Comparisons with the performance of non-human animals completing similar tasks have shown similarities and differences in object-based VSTM, which is only one aspect (“what”) of memory. Another important aspect of memory, which has received less attention, is spatial short-term memory for “where” an object is in space. In this article, we show for the first time that a monkey and pigeons can be accurately trained to identify location changes, much as humans do, in change detection tasks similar to those used to test object capacity of VSTM. The subject’s task was to identify (touch/peck) an item that changed location across a brief delay. Both the monkey and pigeons showed transfer to delays longer than the training delay, to greater and smaller distance changes than in training, and to novel colors. These results are the first to demonstrate location-change detection in any non-human species and encourage comparative investigations into the nature of spatial and visual short-term memory.