Feature binding in visual short-term memory is unaffected by task-irrelevant changes of location,shape, and color

Three experiments used a change detection paradigm across a range of study–test intervals to address the respective contributions of location, shape, and color to the formation of bindings of features in sensory memory and visual short-term memory (VSTM). In Experiment 1, location was designated task irrelevant and was randomized between study and test displays. The task was to detect changes in the bindings between shape and color. In Experiments 2 and 3, shape and color, respectively, were task irrelevant and randomized, with bindings tested between location and color (Experiment 2) and location and shape (Experiment 3). At shorter study–test intervals, randomizing location was most disruptive, followed by shape and then color. At longer intervals, randomizing any task-irrelevant feature had no impact on change detection for bindings between features, and location had no special role. Results suggest that location is crucial for initial perceptual binding but loses that special status once representations are formed in VSTM, which operates according to different principles, than do visual attention and perception.     

Encoding color and shape from different parts of an object in visual short-term memory

Can we find an object-based encoding benefit in visual short-term memory (VSTM) when the features to be remembered are from different parts of an object? Using object parts defined by either figure-ground separation or negative minima of curvature, results from five experiments in which the visual change detection paradigm was used showed that the object-based encoding benefit in VSTM is modulated by how features are assigned to parts of an object: Features are best retained when the color and shape features to be remembered belong to the same part of an object. Although less well retained in comparison, features from different parts of an object are still better remembered than features from spatially separated objects. An object-based feature binding therefore exists even when the color and shape features to be remembered are from different parts of an object.     

Priming and binding in and across perception and action: A correlational analysis of the internal structure of event files

Individual performance was compared across three different tasks that tap into the binding of stimulus features in perception, the binding of action features in action planning, and the emergence of stimulus–response bindings (“event files”). Within a task correlations between the size of binding effects were found within visual perception (e.g., the strength of shape–location binding correlated positively with the strength of shape–colour binding) but not between perception and action planning, suggesting different, domain-specific binding mechanisms. To some degree, binding strength was predicted by priming effects of the respective features, especially if these features varied on a dimension that matched the current attentional set.     

Is visual short-term memory object based? Rejection of the “strong-object” hypothesis

Is the capacity of visual short-term memory (VSTM) limited by the number of objects or by the number of features? VSTM for objects with either one feature or two color features was tested. Results show that capacity was limited primarily by the number of colors to be memorized, not by the number of objects. This result held up with variations in color saturation, blocked or mixed conditions, duration of memory image, and absence or presence of verbal load. However, conjoining features into objects improved VSTM capacity when size-orientation and color-orientation conjunctions were tested. Nevertheless, the number of features still mattered. When feature heterogeneity was controlled, VSTM for conjoined objects was worse than VSTM for objects made of single features. Our results support a weak-object hypothesis of VSTM capacity that suggests that VSTM is limited by both the number of objects and the feature composition of those objects.     

Rapid development of feature binding in visual short-term memory

The binding of object identity (color) and location in visual short-term memory (VSTM) was examined in 6.5- to 12.5-month-old infants (N= 144). Although we previously found that by age 6.5 months, infants can represent both color and location in VSTM, in the present study we observed that 6.5-month-old infants could not remember trivially simple color-location combinations across a 300-ms delay. However, 7.5-month-old infants could bind color and location as effectively as 12.5-month-old infants. Control conditions confirmed that the failure of 6.5-month-old infants was not a result of perceptual or attentional limitations. This rapid development of VSTM binding between 6.5 and 7.5 months occurs during a period of rapid increase in VSTM storage capacity and just after a period of dramatic neuroanatomical changes in parietal cortex. Thus, the ability to bind features and the ability to store multiple objects may both depend on a process that is mediated by posterior parietal cortex and is perhaps related to focused attention.     

Is visual short-term memory object based? Rejection of the "strong-object" hypothesis

Is the capacity of visual short-term memory (VSTM) limited by the number of objects or by the number of features? VSTM for objects with either one feature or two color features was tested. Results show that capacity was limited primarily by the number of colors to be memorized, not by the number of objects. This result held up with variations in color saturation, blocked or mixed conditions, duration of memory image, and absence or presence of verbal load. However, conjoining features into objects improved VSTM capacity when size-orientation and color-orientation conjunctions were tested. Nevertheless, the number of features still mattered. When feature heterogeneity was controlled, VSTM for conjoined objects was worse than VSTM for objects made of single features. Our results support a weak-object hypothesis of VSTM capacity that suggests that VSTM is limited by both the number of objects and the feature composition of those objects.     

Object-based representations govern both the storage of information in visual short-term memory and the retrieval of information from it

Interest is growing in how information is retained in visual short-term memory (VSTM). We describe an experiment that assesses VSTM within the context of multidimensional signal detection theory. On every trial, participants were presented with a 250-ms display containing four colored shapes. They were then probed 900 ms later with a colored shape and made separate old/new judgments about the color and the shape. In any particular trial, one, both, or neither of the probed features had been presented. Performance differed according to whether both probed features belonged to a single object or to two different objects. When both probed features belonged to the same object, featural retrieval was better than would be predicted by independent feature storage. When both probed features belonged to two different objects, featural retrieval was worse than would be predicted by independent feature storage. We conclude that storage in and retrieval from VSTM operate on the basis of object-based representations.     

Internal attention to features in visual short-term memory guides object learning

Attending to objects in the world affects how we perceive and remember them. What are the consequences of attending to an object in mind? In particular, how does reporting the features of a recently seen object guide visual learning? In three experiments, observers were presented with abstract shapes in a particular color, orientation, and location. After viewing each object, observers were cued to report one feature from visual short-term memory (VSTM). In a subsequent test, observers were cued to report features of the same objects from visual long-term memory (VLTM). We tested whether reporting a feature from VSTM: (1) enhances VLTM for just that feature (practice-benefit hypothesis), (2) enhances VLTM for all features (object-based hypothesis), or (3) simultaneously enhances VLTM for that feature and suppresses VLTM for unreported features (feature-competition hypothesis). The results provided support for the feature-competition hypothesis, whereby the representation of an object in VLTM was biased towards features reported from VSTM and away from unreported features (Experiment 1). This bias could not be explained by the amount of sensory exposure or response learning (Experiment 2) and was amplified by the reporting of multiple features (Experiment 3). Taken together, these results suggest that selective internal attention induces competitive dynamics among features during visual learning, flexibly tuning object representations to align with prior mnemonic goals.     

Grouping and binding in visual short-term memory

Findings of 2 experiments are reported that challenge the current understanding of visual short-term memory (VSTM). In both experiments, a single study display, containing 6 colored shapes, was presented briefly and then probed with a single colored shape. At stake is how VSTM retains a record of different objects that share common features: In the 1st experiment, 2 study items sometimes shared a common feature (either a shape or a color). The data revealed a color sharing effect, in which memory was much better for items that shared a common color than for items that did not. The 2nd experiment showed that the size of the color sharing effect depended on whether a single pair of items shared a common color or whether 2 pairs of items were so defined-memory for all items improved when 2 color groups were presented. In explaining performance, an account is advanced in which items compete for a fixed number of slots, but then memory recall for any given stored item is prone to error. A critical assumption is that items that share a common color are stored together in a slot as a chunk. The evidence provides further support for the idea that principles of perceptual organization may determine the manner in which items are stored in VSTM. (PsycINFO Database Record (c) 2012 APA, all rights reserved).     

Testing visual short-term memory of pigeons (Columba livia) and a rhesus monkey (Macaca mulatta) with a location change detection task

Change detection is commonly used to assess capacity (number of objects) of human visual short-term memory (VSTM). Comparisons with the performance of non-human animals completing similar tasks have shown similarities and differences in object-based VSTM, which is only one aspect (“what”) of memory. Another important aspect of memory, which has received less attention, is spatial short-term memory for “where” an object is in space. In this article, we show for the first time that a monkey and pigeons can be accurately trained to identify location changes, much as humans do, in change detection tasks similar to those used to test object capacity of VSTM. The subject’s task was to identify (touch/peck) an item that changed location across a brief delay. Both the monkey and pigeons showed transfer to delays longer than the training delay, to greater and smaller distance changes than in training, and to novel colors. These results are the first to demonstrate location-change detection in any non-human species and encourage comparative investigations into the nature of spatial and visual short-term memory.     

Understanding the object benefit in visual short-term memory: the roles of feature proximity and connectedness

Past research has identified visual objects as the units of information processing in visual short-term memory (VSTM) and has shown that two features from the same object can be remembered in VSTM as well (or almost as well) as one feature of that object and are much better remembered than the same two features from two spatially separated objects. It is not clear, however, what drives this object benefit in VSTM. Is it the shared spatial location (proximity), the connectedness among features of an object, or both? In six change detection experiments, both location/proximity and connectedness were found to be crucial in determining the magnitude of the object benefit in VSTM. Together, these results indicate that location/proximity and connectedness are essential elements in defining a coherent visual object representation in VSTM.     

Mechanisms of priming of pop-out: Stored representations or feature-gain modulations?

Previous research has shown that repetition of a task-relevant attention-capturing feature facilitates popout search. This priming of pop-out effect is due to some residual memory from recent trials. We explore two possible mechanisms of priming of pop-out: a top-down attentional benefit from a memory of the previous target representation that is stored in visual short-term memory (VSTM) and a bottom-up change of attentional gains from perceptual features of the previously attended target. We manipulated participants’ ability to form a memory trace in VSTM by occupying it with a distractor task and found that occupying VSTM did not interfere with priming of pop-out. We next manipulated attentional gains associated with feature values by inserting an irrelevant task between pop-out searches. We found that the color of the target from the intervening perceptual task influenced pop-out search: The current pop-out search was facilitated when the intervening task’s target matched the target color of the pop-out search. These results suggest that priming of pop-out might not be due to a memory trace of the previous targets in VSTM but, rather, might be due to changes in attentional control based on priming from relatively low-level feature representations of previously attended objects.     

Developmental changes in infants’ visual short-term memory for location

To examine the development of visual short-term memory (VSTM) for location, we presented 6- to 12-month-old infants (N = 199) with two side-by-side stimulus streams. In each stream, arrays of colored circles continually appeared, disappeared, and reappeared. In the changing stream, the location of one or more items changed in each cycle; in the non-changing streams the locations did not change. Eight- and 12.5-month-old infants showed evidence of memory for multiple locations, whereas 6.5-month-old infants showed evidence of memory only for a single location, and only when that location was easily identified by salient landmarks. In the absence of such landmarks, 6.5-month-old infants showed evidence of memory for the overall configuration or shape. This developmental trajectory for spatial VSTM is similar to that previously observed for color VSTM. These results additionally show that infants’ ability to detect changes in location is dependent on their developing sensitivity to spatial reference frames.     

Selective attention to the color and direction of moving stimuli: Electrophysiological correlates of hierarchical feature selection

Event-related brain potentials (ERPs) were recorded from subjects who attended to pairs of adjacent colored squares that were flashed sequentially to produce a perception of movement. The task was to attend selectively to stimuli in one visual field and to detect slower moving targets that contained the critical value of the attended feature, be it color or movement direction. Attention to location was reflected by a modulation of the early P1 and N1 components of the ERP, whereas selection of the relevant stimulus feature was associated with later selection negativity components. ERP indices of feature selection were elicited only by stimuli at the attended location and had distinctive scalp distributions for features mediated by “ventral” (color) and “dorsal” (motion) cortical areas. ERP indices of target selection were also contingent on the prior selection of location but initially did not depend on the selection of the relevant feature. These ERP data reveal the timing of sequential, parallel, and contingent stages of visual processing and support early-selection theories of attention that stipulate attentional control over the initial processing of stimulus features.     

Object-position binding in visual short-term memory for sequentially presented unfamiliar stimuli

The effect of spatial position on visual short-term memory (VSTM) for sequentially presented objects has been investigated relatively little, despite the fact that vision in natural environments is characterised by frequent changes in object position and gaze location. We investigated the effect of reusing previously examined spatial positions on VSTM for object appearance. Observers performed a yes-no recognition task following a memory display comprising briefly presented 1/f noise discs (ie possessing spectral properties akin to natural images) shown sequentially at random coordinates. At test, single stimuli were presented either at original spatial positions, new positions, or at a fixed central position. Results, interpreted in terms of appearance and position preview effects, indicate that, where original spatial positions were reused at test, memory performance was elevated by more than 25%, despite that spatial position was task-irrelevant (in the sense that it could not be used to facilitate a correct response per se). This study generalises object-spatial-position binding theory to a sequential display scenario in which the influences of extrafoveal processing, spatial context cues, and long-term memory support were minimised, thereby eliminating the hypothesis that object priming is the principal cause of the 'same-position advantage' in VSTM.     

视觉工作记忆中特征绑定关系的记忆机制

弱客体理论认为, 视觉工作记忆系统是由众多特征存储的子系统组成, 不同纬度的特征独立存储在相应的有限容量的子系统中, 相互之间不会竞争记忆资源。而对于特征之间绑定关系的记忆存在不同的观点。一种观点认为绑定关系的记忆需要注意维持, 因此绑定关系的记忆会占用到特征记忆的资源; 另一种观点认为绑定关系的记忆是自动发生的, 不需要注意的维持。本实验的目的是探究特征绑定关系的记忆是否是自动发生的。在实验中, 我们设计了两种任务, 一种任务是只记忆颜色, 另一种任务是记忆颜色跟位置及其之间的绑定关系, 并测试分析视觉工作记忆相关的ERP成分CDA。结果发现两种任务条件下的CDA波幅之间没有显著差异, 说明视觉工作记忆中的特征绑定是自动发生的。     

Organization of visual short-term memory

The authors examined the organization of visual short-term memory (VSTM). Using a change-detection task, they reported that VSTM stores relational information between individual items. This relational processing is mediated by the organization of items into spatial configurations. The spatial configuration of visual objects is important for VSTM of spatial locations, colors, and shapes. When color VSTM is compared with location VSTM, spatial configuration plays an integral role because configuration is important for color VSTM, whereas color is not important for location VSTM. The authors also examined the role of attention and found that the formation of configuration is modulated by both top-down and bottom-up attentional factors. In summary, the authors proposed that VSTM stores the relational information of individual visual items on the basis of global spatial configuration.     

Testing effects in visual short-term memory: The case of an object's size

In many daily activities, we need to form and retain temporary representations of an object’s size. Typically, such visual short-term memory (VSTM) representations follow perception and are considered reliable. Here, participants were asked to hold in mind a single simple object for a short duration and to reproduce its size by adjusting the length and width of a test probe. Experiment 1 revealed two powerful findings: First, similar to a recently reported perceptual illusion, participants greatly overestimated the size of open objects – ones with missing boundaries – relative to the same-size fully closed objects. This finding confirms that object boundaries are critical for size perception and memory. Second, and in contrast to perception, even the size of the closed objects was largely overestimated. Both inflation effects were substantial and were replicated and extended in Experiments 2–5. Experiments 6–8 used a different testing procedure to examine whether the overestimation effects are due to inflation of size in VSTM representations or to biases introduced during the reproduction phase. These data showed that while the overestimation of the open objects was repeated, the overestimation of the closed objects was not. Taken together, these findings suggest that similar to perception, only the size representation of open objects is inflated in VSTM. Importantly, they demonstrate the considerable impact of the testing procedure on VSTM tasks and further question the use of reproduction procedures for measuring VSTM.     

Feature-based attention across saccades: Pop-out in color search is spatiotopic

Our perception of the world remains stable despite the retinal shifts that occur with each saccade. The role of spatial attention in matching pre- to postsaccadic visual information has been well established, but the role of feature-based attention remains unclear. In this study, we examined the transsaccadic processing of a color pop-out target. Participants made a saccade towards a neutral target and performed a search task on a peripheral array presented once the saccade landed. A similar array was presented just before the saccade and we analyzed what aspect of this preview benefitted the postsaccadic search task. We assessed the preview effect in the spatiotopic and retinotopic reference frames, and the potential transfer of feature selectivity across the saccade. In the first experiment, the target and distractor colors remained identical for the preview and the postsaccadic array and performance improved. The largest benefit was observed at the spatiotopic location. In the second experiment, the target and distractor colors were swapped across the saccade. All responses were slowed but the cost was least at the spatiotopic location. Our results show that the preview attracted spatial attention to the target location, which was then remapped, and suggest that previewed features, specifically colors, were transferred across the saccade. Furthermore, the preview induced a spatiotopic advantage regardless of whether the target switched color or not, suggesting that spatiotopy was established independently of feature processing. Our results support independent priming effects of features versus location and underline the role of feature-based selection in visual stability.     

视觉信息分布调节信息整合策略：来自眼动的证据

以空白单元格定位为实验任务,操纵序列点阵的分布,考察视觉短时记忆与视知觉的信息整合机制。实验一发现任务正确率与点阵1的圆点数呈近似U形关系。实验二发现在拐点前后被试的眼动模式从偏向于注视圆点位置转为偏向于注视空格位置。因此,视觉信息的分布模式调节整合策略,当处于视觉短时记忆中的圆点数在其容量之内时,采用图像—知觉整合策略,反之,则采用转换—比较策略。