Storage of features, conjunctions and objects in visual working memory

Working memory can be divided into separate subsystems for verbal and visual information. Although the verbal system has been well characterized, the storage capacity of visual working memory has not yet been established for simple features or for conjunctions of features. The authors demonstrate that it is possible to retain information about only 3-4 colors or orientations in visual working memory at one time. Observers are also able to retain both the color and the orientation of 3-4 objects, indicating that visual working memory stores integrated objects rather than individual features. Indeed, objects defined by a conjunction of four features can be retained in working memory just as well as single-feature objects, allowing many individual features to be retained when distributed across a small number of objects. Thus, the capacity of visual working memory must be understood in terms of integrated objects rather than individual features.     

A core knowledge architecture of visual working memory

Visual working memory (VWM) is widely thought to contain specialized buffers for retaining spatial and object information: a 'spatial-object architecture.' However, studies of adults, infants, and nonhuman animals show that visual cognition builds on core knowledge systems that retain more specialized representations: (1) spatiotemporal representations for object tracking, (2) object identity representations for object recognition, and (3) view-dependent snapshots for place recognition. In principle, these core knowledge systems may retain information separately from one another. Consistent with this hypothesis, this study provides evidence that these three types of information are subject to independent working memory storage limits. These results, combined with those from previous studies, indicate that VWM contains three specialized buffers for retaining spatiotemporal information, object identity information, and snapshot information. Thus, VWM buffers parallel core knowledge systems. This 'core knowledge architecture' links the study of visual working memory to the study of the biological foundations of visual cognition.     

客体运动方向的视觉工作记忆容量

记忆动态场景中多客体的特征和时空信息是人类重要的认知活动。目前有关视觉工作记忆的研究虽然广泛探讨了对视觉信息的存储容量及机制,然而所采用的刺激材料均呈现于静态场景中,且不包含运动信息。而有关多客体追踪的研究只关注动态场景中多客体信息的实时更新,而不涉及一段时间内对客体信息的保持。本研究结合视觉工作记忆领域的变化觉察范式和多客体追踪范式,以独立运动的客体为刺激材料,探讨多个客体的运动方向信息在工作记忆中的存储容量问题。结果表明,在工作记忆中能够存储大约3个客体的运动方向信息。     

Perceptual organization influences visual working memory

Previous studies have demonstrated that top-down factors can bias the storage of information in visual working memory. However, relatively little is known about the role that bottom-up stimulus characteristics play in visual working memory storage. In the present study, subjects performed a change detection task in which the to-be-remembered objects were organized in accordance with Gestalt grouping principles. When an attention-capturing cue was presented at the location of one object, other objects that were perceptually grouped with the cued object were more likely to be stored in working memory than were objects that were not grouped with the cued object. Thus, objects that are grouped together tend to be stored together, indicating that bottom-up perceptual organization influences the storage of information in visual working memory.     

The Cost of Accessing an Object's Feature Stored in Visual Working Memory

The effects of accessing or retrieving information held in working memory are poorly understood compared to what we know about the nature of information storage in this limited-capacity memory system. Previous studies of object-based attention have often relied upon memory-demanding tasks, and this work could indicate that accessing a piece of information in visual working memory may have deleterious effects upon the other representations being maintained. In the present study, we tested the hypothesis that accessing a feature of an object represented in visual working memory degrades the representations of the other stored objects' features. Our findings support this hypothesis and point to important new questions about the nature of effects resulting from accessing information stored in visual working memory.     

客体运动速度的视觉工作记忆容量

自Luck等人的研究以来,诸多研究者对客体信息在视觉工作记忆中的表征与存储问题进行了探讨。现有研究主要采用呈现于静态场景的客体作为刺激材料,而不涉及对客体运动特征信息的短时存储。本研究结合多客体追踪范式和视觉工作记忆的变化觉察范式,通过比较检测项全部呈现方式与单检测项呈现方式条件下,客体运动速度的视觉工作记忆绩效,探讨了多个客体的运动速度信息在工作记忆中的存储方式和容量问题。结果表明,在工作记忆中能够存储约3仑独立客体的运动速度信息。     

两维特征图形的客体和空间工作记忆存储研究

研究采用单探测变化检测范式,考察了两维特征图形在视觉客体和视觉空间工作记忆中的存储机制,并对其容量进行测定。40名被试(平均年龄20.56±1.73岁)随机分为两个等组,分别完成实验一和实验二。实验一的刺激图形由颜色和形状两基本特征组成,实验二的刺激为由不同颜色和开口朝向组成的兰道环。两个实验结果均显示:(1)特征交换变化条件下的记忆成绩与单特征变化条件下最差的记忆成绩差异不显著;(2)空间工作记忆任务的成绩显著优于客体工作记忆任务;(3)被试在视觉工作记忆中能存储2~3个客体和3~4个空间位置。这表明,由两种不同维度特征组成的图形在视觉客体和视觉空间工作记忆中均以整合方式进行存储,空间工作记忆的容量大于客体工作记忆。     

Visual working memory as the substrate for mental rotation

In mental rotation, a mental representation of an object must be rotated while the actual object remains visible. Where is this representation stored while it is being rotated? To answer this question, observers were asked to perform a mental rotation task during the delay interval of a visual working memory task. When the working memory task required the storage of object features, substantial bidirectional interference was observed between the memory and rotation tasks, and the interference increased with the degree of rotation. However, rotation-dependent interference was not observed when a spatial working memory task was used instead of an object working memory task. Thus, the object working memory subsystem—not the spatial working memory subsystem—provides the buffer in which object representations are stored while they undergo mental rotation. More broadly, the nature of the information being stored—not the nature of the operations performed on this information—may determine which subsystem stores the information.     

Dynamic visual noise interferes with storage in visual working memory

Several studies have demonstrated that dynamic visual noise (DVN) does not interfere with memory for random matrices. This has led to suggestions that (a) visual working memory is distinct from imagery, and (b) visual working memory is not a gateway between sensory input and long-term storage. A comparison of the interference effects of DVN with memory for matrices and colored textures shows that DVN can interfere with visual working memory, probably at a level of visual detail not easily supported by long-term memory structures or the recoding of the visual pattern elements. The results support a gateway model of visuospatial working memory and raise questions about the most appropriate ways to measure and model the different levels of representation of information that can be held in visual working memory.     

Interactions between visual working memory and selective attention

The relationship between working memory and selective attention has traditionally been discussed as operating in one direction: Attention filters incoming information, allowing only relevant information into short-term processing stores. This study tested the prediction that the contents of visual working memory also influence the guidance of selective attention. Participants held a sample object in working memory on each trial. Two objects, one matching the sample and the other novel, were then presented simultaneously. As measured by a probe task, attention shifted to the object matching the sample. This effect generalized across object type, attentional-probe task, and working memory task. In contrast, a matched task with no memory requirement showed the opposite pattern, demonstrating that this effect is not simply due to exposure to the sample. These results confirm a specific prediction about the influence of working memory contents on the guidance of attention.     

Remembering more than meets the eye: a study of memory confusions about incomplete visual information

The purpose of this series of four experiments was to examine the possible role of spontaneous imagery in memory confusions about the way in which visual information had been experienced. After viewing pictures of familiar objects, complete or incomplete in visual form, participants were asked to remember the way in which the objects had been presented. Although, as predicted, memory for the objects themselves was quite good, participants falsely remembered seeing complete versions of pictures that were actually presented as incomplete. These false reports were observed across a variety of encoding and testing conditions. The results suggest that the false reports (referred to here as completion errors) are due to internal representations based on filling-in processes in response to the encoding of incomplete visual information. As such, the results also speak to alternative explanations for the completion errors and, more broadly, to theoretical perspectives that draw on filling-in processes when accounting for object identification and object memory.     

A bilateral advantage for storage in visual working memory

Various studies have demonstrated enhanced visual processing when information is presented across both visual hemifields rather than in a single hemifield (the bilateral advantage). For example, Alvarez and Cavanagh (2005) reported that observers were able to track twice as many moving visual stimuli when the tracked items were presented bilaterally rather than unilaterally, suggesting that independent resources enable tracking in the two visual fields. Motivated by similarities in the apparent capacity and neural substrates that mediate tracking and visual working memory (WM), the present work examined whether or not a bilateral advantage also arises during storage in visual WM. Using a recall procedure to assess working memory for orientation information, we found a reliable bilateral advantage; recall error was smaller with bilateral sample displays than with unilateral displays. To demonstrate that the bilateral advantage influenced storage per se rather than just encoding efficiency, we replicated the observed bilateral advantage using sequentially presented stimuli. Finally, to further characterize how bilateral presentations enhanced storage in working memory, we measured both the number and the resolution of the stored items and found that bilateral presentations lead to an increased probability of storage, rather than enhanced mnemonic resolution. Thus, the bilateral advantage extends beyond the initial selection and encoding of visual information to influence online maintenance in visual working memory.     

Visual memory for agents and their actions

Humans spend a considerable amount of time remembering other individuals' actions. Nevertheless, it is unclear how the visual system stores information about the identities of agents and their actions. To address this, I used a change detection method where observers were asked to remember agents and the actions they performed. Results show that observers can maintain information about both 2-3 agents and 2-3 actions simultaneously. However, they are highly impaired for remembering which agent performed which action, indicating that agent and action information are retained separately in visual working memory. Further experiments show that agent and action information can be bound together when the visual input contains the appropriate cues. However, this binding process significantly reduces the total amount of information that can be retained. Together, these results show that (1) an additional, resource-demanding process is needed to integrate agent and action information stored in separate working memory stores, and (2) the extent to which these two types of information are bound into integrated units depends largely on the presence of specific cues in the visual input.     

Binding actions and scenes in visual long-term memory

How does visual long-term memory store representations of different entities (e.g., objects, actions, and scenes) that are present in the same visual event? Are the different entities stored as an integrated representation in memory, or are they stored separately? To address this question, we asked observers to view a large number of events; in each event, an action was performed within a scene. Afterward, the participants were shown pairs of action–scene sets and indicated which of the two they had seen. When the task required recognizing the individual actions and scenes, performance was high (80 %). Conversely, when the task required remembering which actions had occurred within which scenes, performance was significantly lower (59 %). We observed this dissociation between memory for individual entities and memory for entity bindings across multiple testing conditions and presentation durations. These experiments indicate that visual long-term memory stores information about actions and information about scenes separately from one another, even when an action and scene were observed together in the same visual event. These findings also highlight an important limitation of human memory: Situations that require remembering actions and scenes as integrated events (e.g., eyewitness testimony) may be particularly vulnerable to memory errors.     

Feature-based memory-driven attentional capture: visual working memory content affects visual attention

In 7 experiments, the authors explored whether visual attention (the ability to select relevant visual information) and visual working memory (the ability to retain relevant visual information) share the same content representations. The presence of singleton distractors interfered more strongly with a visual search task when it was accompanied by an additional memory task. Singleton distractors interfered even more when they were identical or related to the object held in memory, but only when it was difficult to verbalize the memory content. Furthermore, this content-specific interaction occurred for features that were relevant to the memory task but not for irrelevant features of the same object or for once-remembered objects that could be forgotten. Finally, memory-related distractors attracted more eye movements but did not result in longer fixations. The results demonstrate memory-driven attentional capture on the basis of content-specific representations.     

视觉工作记忆中的加工与存储机制:回顾与思考

在视觉工作记忆的研究中,是否可能划分出视觉空间工作记忆和视觉物体工作记忆两个子系统还没有定论.子系统划分成立的基本前提是以特征为存储单位.当前关于存储单位的理论有特征理论、客体理论和双重存储等不同观点,多数视觉信息加工与存储机制的研究支持双重存储说.注意与视觉信息的加工和存储相互影响,因此,加工及存储机制的研究就要在具体的注意水平上进行.     

Remembering more than meets the eye: A study of memory confusions about incomplete visual information

The purpose of this series of four experiments was to examine the possible role of spontaneous imagery in memory confusions about the way in which visual information had been experienced. After viewing pictures of familiar objects, complete or incomplete in visual form, participants were asked to remember the way in which the objects had been presented. Although, as predicted, memory for the objects themselves was quite good, participants falsely remembered seeing complete versions of pictures that were actually presented as incomplete. These false reports were observed across a variety of encoding and testing conditions. The results suggest that the false reports (referred to here as completion errors) are due to internal representations based on filling-in processes in response to the encoding of incomplete visual information. As such, the results also speak to alternative explanations for the completion errors and, more broadly, to theoretical perspectives that draw on filling-in processes when accounting for object identification and object memory.     

重新检视工作记忆在视觉搜索中的作用

视觉搜索是人类从作用于视觉系统的大量信息中选择相关信息进入信息加工系统的一种认知功能, 同时也是研究选择性注意的一种常用范式。工作记忆作为一种服务于当前任务信息的存储与加工的认知系统, 在视觉搜索过程中扮演着关键角色。为了深入了解工作记忆在视觉搜索过程中的作用机制, 在梳理已有成果的基础上, 分别从工作记忆对靶子模板的储存、视觉搜索项目与靶子模板在工作记忆中的匹配及工作记忆对已检测过搜索项目的记忆三个方面进行综述。最后结论表明工作记忆确实在视觉搜索过程中起作用, 但其作用机制仍存在较多争议。     

Trade-offs between gaze and working memory use

Eye movements during natural tasks suggest that observers do not use working memory to capacity but instead use eye movements to acquire relevant information immediately before needed. Results here however, show that this strategy is sensitive to memory load and to observers' expectations about what information will be relevant. Depending upon the predictability of what object features would be needed in a brick sorting task, subjects spontaneously modulated the order in which they sampled and stored visual information using working memory more when the task was predictable and reverting to a just-in-time strategy when the task was unpredictable and the memory load was higher. This self organization was evidenced by subjects' sequence of eye movements and also their sorting decisions following missed feature changes. These results reveal that attentional selection, fixations, and use of working memory reflect a dynamic optimization with respect to a set of constraints, such as task predictablity and memory load. They also reveal that change blindness depends critically on the local task context, by virtue of its influence on the information selected for storage in working memory.     

When do spatial and visual working memory interact?

This study examined how spatial working memory and visual (object) working memory interact, focusing on two related questions: First, can these systems function independently from one another? Second, under what conditions do they operate together? In a dual-task paradigm, participants attempted to remember locations in a spatial working memory task and colored objects in a visual working memory task. Memory for the locations and objects was subject to independent working memory storage limits, which indicates that spatial and visual working memory can function independently from one another. However, additional experiments revealed that spatial working memory and visual working memory interact in three memory contexts: when retaining (1) shapes, (2) integrated color-shape objects, and (3) colored objects at specific locations. These results suggest that spatial working memory is needed to bind colors and shapes into integrated object representations in visual working memory. Further, this study reveals a set of conditions in which spatial and visual working memory can be isolated from one another.