Location and binding in visual working memory

Visual working memory (VWM) wa sexplored separatelyfor features and for their binding. Features were better recognized when the probes retained the same binding as in the original display, but changing the locations had little effect overall. However, there were strong interactions of location with binding and with matching or new features, suggesting that, when objects are attended, features and locations are spontaneously integrated in VWM. Despite this, when the locations arechanged, features can also be accessed with little decrement, perhaps from separate feature maps. Bindings, on the other hand, are more vulnerable to location changes, suggesting that locations play a central role in the early maintenance and retrieval of bound objects as well as in their initial encoding, at least when verbal coding is prevented. The results qualify past claims about the separation of locations and objects in VWM.     

客体在视觉工作记忆中的存储机制

采用变化觉察范式,通过两个实验对不同类型视觉信息在工作记忆中的存储机制进行了探讨。实验一中要求记忆的客体由颜色和形状两基本特征构成;实验二中的客体为具有不同颜色及开口朝向的兰道环。通过观察检测项变化方式对记忆绩效的影响,获得以下结论:（1）对颜色和形状两基本特征的存储以整合客体为单位;（2）兰道环的颜色与开口朝向信息难以以整合客体方式存储。笔者推测,视觉工作记忆中存储的整合客体并非如现有理论假设的,是在集中注意参与下创建的,而是由并行加工阶段所获信息构成;客体中所含需集中注意提取的细节特征信息难以与其基本特征信息整合于该客体表征     

Does maintaining bindings in visual working memory require more attention than maintaining features?

ABSTRACT

Whether more attention is required for maintaining bindings than maintaining features in visual working memory (VWM) remains an open question. If maintaining bindings in VWM does not require more attention than maintaining features, is it related to the stability of binding representations? In this study, we explored whether maintaining bindings requires more attention than maintaining features for similar and dissimilar objects by inserting a feature report task into the maintenance phase of VWM in Experiments 1 and 2. We also investigated whether the effect of similarity on the attentional requirement for maintaining bindings and features is due to the stability of VWM representations by inserting a suffix during the maintenance phase of VWM in Experiment 3. The results showed that when object-based attention was consumed, bindings were more impaired than features for dissimilar objects but not for similar objects. We also found that the bindings of similar objects were less interfered by the suffix than those of dissimilar objects. Our findings suggest that maintaining bindings does not require more attention than maintaining features when the binding representations are stable in VWM and similarity improves the stability of binding representations.     

What’s the object of object working memory in infancy? Unraveling ‘what’ and ‘how many’

Infants have a bandwidth-limited object working memory (WM) that can both individuate and identify objects in a scene, (answering ‘how many?’ or ‘what?’, respectively). Studies of infants’ WM for objects have typically looked for limits on either ‘how many’ or ‘what’, yielding different estimates of infant capacity. Infants can keep track of about three individuals (regardless of identity), but appear to be much more limited in the number of specific identities they can recall. Why are the limits on ‘how many’ and ‘what’ different? Are the limits entirely separate, do they interact, or are they simply two different aspects of the same underlying limit?We sought to unravel these limits in a series of experiments which tested 9- and 12-month-olds’ WM for object identities under varying degrees of difficulty. In a violation-of-expectation looking-time task, we hid objects one at a time behind separate screens, and then probed infants’ WM for the shape identity of the penultimate object in the sequence. We manipulated the difficulty of the task by varying both the number of objects in hiding locations and the number of means by which infants could detect a shape change to the probed object. We found that 9-month-olds’ WM for identities was limited by the number of hiding locations: when the probed object was one of two objects hidden (one in each of two locations), 9-month-olds succeeded, and they did so even though they were given only one means to detect the change. However, when the probed object was one of three objects hidden (one in each of three locations), they failed, even when they were given two means to detect the shape change. Twelve-month-olds, by contrast, succeeded at the most difficult task level.Results show that WM for ‘how many’ and for ‘what’ are not entirely separate. Individuated objects are tracked relatively cheaply. Maintaining bindings between indexed objects and identifying featural information incurs a greater attentional/memory cost. This cost reduces with development. We conclude that infant WM supports a small number of featureless object representations that index the current locations of objects. These can have featural information bound to them, but only at substantial cost.     

The privileged role of location in visual working memory

Reports have conflicted about the possible special role of location in visual working memory (WM). One important question is: Do we maintain the locations of objects in WM even when they are irrelevant to the task at hand? Here we used a continuous response scale to study the types of reporting errors that participants make when objects are presented at the same or at different locations in space. When several objects successively shared the same location, participants exhibited a higher tendency to report features of the wrong object in memory; that is, they responded with features that belonged to objects retained in memory but not probed at retrieval. On the other hand, a similar effect was not observed when objects shared a nonspatial feature, such as color. Furthermore, the effect of location on reporting errors was present even when its manipulation was orthogonal to the task at hand. These findings are consistent with the view that binding together different nonspatial features of an object in memory might be mediated through an object’s location. Hence, spatial location may have a privileged role in WM. The relevance of these findings to conceptual models, as well as to neural accounts of visual WM, is discussed.     

The benefit of surface uniformity for encoding boundary features in visual working memory

Using a change detection paradigm, the present study examined an object-based encoding benefit in visual working memory (VWM) for two boundary features (two orientations in Experiments 1-2 and two shapes in Experiments 3-4) assigned to a single object. Participants remembered more boundary features when they were conjoined into a single object of uniform color than when they were not bound together into an object. However, such an object-based benefit diminished or disappeared when those features occurred on different parts of an object, as defined by surface discontinuity or by negative minima of curvature. These results suggest that the number of boundary features that can be stored in VWM is influenced by the hierarchical structure of objects: surface uniformity facilitates the integration of two boundary features into a single object representation, but this integration is weakened when the features occur on different parts of an object.     

The perceptual root of object-based storage: an interactive model of perception and visual working memory

Mainstream theories of visual perception assume that visual working memory (VWM) is critical for integrating online perceptual information and constructing coherent visual experiences in changing environments. Given the dynamic interaction between online perception and VWM, we propose that how visual information is processed during visual perception can directly determine how the information is going to be selected, consolidated, and maintained in VWM. We demonstrate the validity of this hypothesis by investigating what kinds of perceptual information can be stored as integrated objects in VWM. Three criteria for object-based storage are introduced: (a) automatic selection of task-irrelevant features, (b) synchronous consolidation of multiple features, and (c) stable maintenance of feature conjunctions. The results show that the outputs of parallel perception meet all three criteria, as opposed to the outputs of serial attentive processing, which fail all three criteria. These results indicate that (a) perception and VWM are not two sequential processes, but are dynamically intertwined; (b) there are dissociated mechanisms in VWM for storing information identified at different stages of perception; and (c) the integrated object representations in VWM originate from the "preattentive" or "proto" objects created by parallel perception. These results suggest how visual perception, attention, and VWM can be explained by a unified framework.     

客体同维度特征的视觉工作记忆存储机制

客体理论认为视觉工作记忆的存储单位是客体, 人类能够把组成物体的所有特征整合成一个单元进行记忆, 不管这些特征是来自不同维度还是同一维度。然而同一维度多个特征可以被整合成客体记忆的结果只被少数研究证实, 大量研究发现同一维度的多个特征不能被整合记忆, 这形成了弱客体理论的基本观点。为了解决两大理论之间的争议, 本研究主要探究同维度特征能否被整合记忆。通过分析以往研究, 我们认为实验范式和物体意义两个因素可能是导致之前大部分研究没有发现维度内特征能够被整合记忆的原因。因此, 实验1采用回忆报告范式替代以往研究经常使用的变化觉察范式, 结果发现, 同一维度的多个特征难以被整合记忆。实验2以记忆无意义物体的特征为基线, 探究在记忆有意义物体的特征时是否可能将多个特征进行整合记忆。结果发现, 对于有意义物体的特征的记忆成绩并没有显著好于记忆无意义物体特征的成绩, 说明即使采用具有较强整合线索的有意义物体作为载体, 同一维度多个特征也难以被整合记忆。两个实验结果进一步支持了弱客体理论。     

视觉工作记忆的同类别存储优势

概念规律如记忆项间的类别关系如何影响视觉工作记忆容量是一个有争议的问题。针对该问题, 学界存在两种预测截然不同的假说：(1)混合类别优势假说, (2)同类别优势假说。综述文献发现, 该类研究均采用带有细节特征的真实客体作为实验材料, 因此前人研究中发现的混合类别优势效应或同类别优势效应中必然混有低水平知觉特征的影响。故本研究采用去除细节信息的动物剪影作为记忆材料来排除上述因素的影响, 旨在厘清上述两种假设, 并采用对侧延迟活动作为神经指标, 来进一步探讨概念规律影响工作记忆容量的内在机制。两个行为实验发现, 不论记忆项同时呈现还是序列呈现, 均存在同类别记忆优势效应。脑电实验结果发现相比记忆不同类别客体, 记忆同等数量的同类别客体诱发的对侧延迟活动的幅值更小。上述结果一致表明, 视觉工作记忆可借助概念的方式将同类别客体加以组织, 从而有效扩大视觉工作记忆容量, 支持了同类别优势假说。     

客体复杂度影响工作记忆可存储的客体数目

采用变化觉察范式,以对侧延迟活动（contralateral delay activity,CDA）的幅值为指标,通过操纵记忆刺激的复杂程度,对视觉工作记忆中可存储的客体数目（即工作记忆容量）问题进行了探讨。结果表明,2个复杂客体条件下的CDA幅值与4个复杂客体条件无显著差异,而4个简单客体条件的CDA幅值显著高于2个简单客体条件,即CDA的幅值受客体复杂度的调节。基于该结果推论：并非视觉工作记忆总能存储4个客体,其可存储的客体数目受客体复杂度影响。     

基于空间方位信息的构型对视觉工作记忆绩效的影响

通过考察构成视觉客体构型的两种因素在视觉工作记忆任务中的影响, 探讨了构型对视觉工作记忆绩效的作用机制。采用变化觉察实验范式, 在构型朝向不变和旋转两种条件下, 系统地控制构型中的客体相对方位和整体几何形态两种因素的变化, 考察其对视觉工作记忆绩效的影响。实验结果显示, 无论构型朝向不变还是旋转, 只要客体相对方位保持一致, 工作记忆绩效就可以维持较高水平, 而几何形态没有表现出显著作用。上述发现提示构型客体相对方位是构型影响视觉工作记忆绩效的主要因素。     

Current directions in visual working memory research: An introduction and emerging insights

Visual working memory (VWM) is a core construct in the cognitive (neuro‐)sciences, assumed to serve as a hub for information exchange and thus supporting a multitude of cognitive functions related to processing visual information. Here, we give an introduction into key terms and paradigms and an overview of ongoing debates in the field, to which the articles collected in this Special Issue on ‘Current Directions in Visual Working Memory Research’ contribute. Our aim is to extract, from this overview, some ‘emerging’ theoretical insights concerning questions such as the optimal way to examine VWM, which types of mental representations contribute to performance on VWM tasks, and how VWM keeps features from the same object together and apart from features of concurrently maintained objects (the binding problem).     

Asymmetrical access to color and location in visual working memory

Models of visual working memory (VWM) have benefitted greatly from the use of the delayed-matching paradigm. However, in this task, the ability to recall a probed feature is confounded with the ability to maintain the proper binding between the feature that is to be reported and the feature (typically location) that is used to cue a particular item for report. Given that location is typically used as a cue-feature, we used the delayed-estimation paradigm to compare memory for location to memory for color, rotating which feature was used as a cue and which was reported. Our results revealed several novel findings: 1) the likelihood of reporting a probed object’s feature was superior when reporting location with a color cue than when reporting color with a location cue; 2) location report errors were composed entirely of swap errors, with little to no random location reports; and 3) both colour and location reports greatly benefitted from the presence of nonprobed items at test. This last finding suggests that it is uncertainty over the bindings between locations and colors at memory retrieval that drive swap errors, not at encoding. We interpret our findings as consistent with a representational architecture that nests remembered object features within remembered locations.     

The effect of body and part-based motion on the recognition of unfamiliar objects

We investigated the role of global (body) and local (parts) motion on the recognition of unfamiliar objects. Participants were trained to categorise moving objects and were then tested on their recognition of static images of these targets using a priming paradigm. Each static target shape was primed by a moving object that comprised either the same body and parts motion; same body, different parts motion; different body, same part motion as the learned target or was non-moving. Only the same body but not the same part motion facilitated shape recognition (Experiment 1), even when either motion was diagnostic of object identity (Experiment 2). When parts motion was more related to the object's body motion then it facilitated the recognition of the static target (Experiment 3). Our results suggest that global and local motions are independently accessed during object recognition and have important implications for how objects are represented in memory.     

Feature binding in children and young adults

The authors measured memory for individual features (objects only or locations only) and the combination of those features (objects and locations) in 9-, 12-, and 21-year-old students with a yes or no recognition task. Analysis of recognition memory performance (d' scores) revealed that although age differences existed in memory for individual features, age differences were greater in the tasks that required memory for combined features (objects and locations). Hierarchical multiple regression analyses indicated that age remained a significant predictor of memory performance in the combination condition even after the authors statistically removed memory performance in object and location conditions and the interaction effects of object and location. These results provide evidence for developmental differences in the binding of features in memory.     

Distinct capacity limits for attention and working memory: Evidence from attentive tracking and visual working memory paradigms

A hallmark of both visual attention and working memory is their severe capacity limit: People can attentively track only about four objects in a multiple object tracking (MOT) task and can hold only up to four objects in visual working memory (VWM). It has been proposed that attention underlies the capacity limit of VWM. We tested this hypothesis by determining the effect of varying the load of a MOT task performed during the retention interval of a VWM task and comparing the resulting dual-task costs with those observed when a VWM task was performed concurrently with another VWM task or with a verbal working memory task. Instead of supporting the view that the capacity limit of VWM is solely attention based, the results indicate that VWM capacity is set by the interaction of visuospatial attentional, central amodal, and local task-specific sources of processing.     

A secret agent? How infants learn about the identity of objects in a causal scene

Four experiments examined the role of correlations between dynamic and static parts on 12- to 16-month-olds' ability to learn the identity of agents and recipients in a simple causal event. Infants were habituated to events in which objects with a dynamic or static part acted as an agent or a recipient and then were tested with an event in which the part-causal role relations were switched. Experiment 1 revealed that 16-month-olds, but not 12-month-olds, associate a dynamic part with the role of agent and a static part with the role of recipient. Experiment 2 showed that 12- and 16-month-olds do not associate a static part with the role of agent or a dynamic part with the role of recipient. Experiment 3 demonstrated that 14-month-olds will learn the relations presented in Experiment 1 and Experiment 2. Experiment 4 revealed that 12-month-olds were able to discriminate the two geometric figures in the events. The results are discussed with respect to infants' developing ability to attend to correlations between dynamic and static cues and the mechanism underlying early object concept acquisition.     

多特征刺激在视觉工作记忆中的存储模式

使用事件相关电位技术, 采用变化觉察范式, 以双色块和单色块为刺激材料, 通过两个实验探讨了多特征刺激在视觉工作记忆中的存储模式。实验1通过对双色块和单色块的比较来考察特征数量对视觉工作记忆资源分配的影响, 通过操控双色方块的变化幅度来考察精度需求对资源分配的影响。结果发现, 特征数量的增加诱发了更强的对侧延迟活动(CDA), 而精度需求的提高并没有引起对侧延迟活动上的差异, 却诱发了指示自上而下的控制的晚期正成分(LPC)的增强。实验2通过在测验阶段加入指示可能变化的部分的提示符, 发现提示符并未能促进变化觉察的行为反应。整个研究表明, 特征数量影响视觉工作记忆资源的分配, 而精度需求并不起作用, 同时多特征刺激在视觉工作记忆中的存储单位并不是单个的独立特征, 而是整合的客体。     

现实场景典型空间位置关系客体的解码效应

通过探讨典型空间关系客体对中单个客体的视觉工作记忆,考察空间位置关系的解码特征和主动客体记忆优势。结果发现：（1）当客体以符合空间位置关系方式呈现时,记忆更准确;（2）符合空间位置关系条件下单个客体提取反应时更长,上方客体反应时更短,记忆更准确;（3）兼具空间位置关系与动作关系客体对中的主动客体记忆正确率更高。结果表明,现实场景客体空间分组中单个客体提取时存在解码现象和顺序效应,对现实中的上方与主动客体存在加工偏好。     

A memory span of one? Object identification in 6.5-month-old infants

Infants' abilities to identify objects based on their perceptual features develop gradually during the first year and possibly beyond. Earlier we reported [Káldy, Z., & Leslie, A. M. (2003). Identification of objects in 9-month-old infants: Integrating 'what' and 'where' information. Developmental Science, 6, 360-373] that infants at 9 months of age are able to use shape information to identify two objects and follow their spatiotemporal trajectories behind occlusion. On the other hand, another recent study suggests that infants at 4-5 months of age cannot identify objects by features and bind them to locations [Mareschal, D., & Johnson, M. H. (2003). The "what" and "where" of object representations in infancy. Cognition, 88, 259-276]. In the current study, we investigated the developmental steps between these two benchmark ages by testing 6.5-month-old infants. Experiment 1 and 2 adapted the paradigm used in our previous studies with 9-month-olds that involves two objects hidden sequentially behind separate occluders. This technique allows us to address object identification and to examine whether only one or both object identities are being tracked. Results of experiment 1 showed that 6.5-month-old infants could identify at least one of two objects based on shape and experiment 2 found that this ability holds for only one, the last object hidden. We propose that at this age, infants' working memory capacity is limited to one occluded object if there is a second intervening hiding. If their attention is distracted by an intervening object during the memory maintenance period, the memory of the first object identity appears to be lost. Results of experiment 3 supported this hypothesis with a simpler one-screen setup. Finally, results of experiment 4 show that temporal decay of the memory trace (without an intervening hiding) by itself cannot explain the observed pattern of results. Taken together, our findings suggest that at six months of age infants can store but a single object representation with bound shape information, most likely in the ventral stream. The memory span of one may be due to immaturity of the neural structures underlying working memory such that intervening items overwrite the existing storage.