Internal attention to features in visual short-term memory guides object learning

Attending to objects in the world affects how we perceive and remember them. What are the consequences of attending to an object in mind? In particular, how does reporting the features of a recently seen object guide visual learning? In three experiments, observers were presented with abstract shapes in a particular color, orientation, and location. After viewing each object, observers were cued to report one feature from visual short-term memory (VSTM). In a subsequent test, observers were cued to report features of the same objects from visual long-term memory (VLTM). We tested whether reporting a feature from VSTM: (1) enhances VLTM for just that feature (practice-benefit hypothesis), (2) enhances VLTM for all features (object-based hypothesis), or (3) simultaneously enhances VLTM for that feature and suppresses VLTM for unreported features (feature-competition hypothesis). The results provided support for the feature-competition hypothesis, whereby the representation of an object in VLTM was biased towards features reported from VSTM and away from unreported features (Experiment 1). This bias could not be explained by the amount of sensory exposure or response learning (Experiment 2) and was amplified by the reporting of multiple features (Experiment 3). Taken together, these results suggest that selective internal attention induces competitive dynamics among features during visual learning, flexibly tuning object representations to align with prior mnemonic goals.     

What are the units of visual short-term memory, objects or spatial locations?

We investigated whether the capacity of visual short-term memory (VSTM) is defined by number of objects or number of spatial locations. Previous work is consistent with either alternative. To distinguish these factors, we used overlapping stimuli that allowed us to independently manipulate the number of spatial locations while holding constant the number of objects and features to be encoded (Duncan, 1984; Vecera & Farah, 1994). In Experiment 1, the number of spatial locations had no effect on VSTM, suggesting that VSTM is object based. Experiments 2 and 3 ruled out alternative explanations based on perceptual segregation difficulty or decision noise factors. Our results provide additional support to Luck and Vogel's (1997) demonstration that integrated objects form the units of VSTM capacity.     

Understanding the object benefit in visual short-term memory: the roles of feature proximity and connectedness

Past research has identified visual objects as the units of information processing in visual short-term memory (VSTM) and has shown that two features from the same object can be remembered in VSTM as well (or almost as well) as one feature of that object and are much better remembered than the same two features from two spatially separated objects. It is not clear, however, what drives this object benefit in VSTM. Is it the shared spatial location (proximity), the connectedness among features of an object, or both? In six change detection experiments, both location/proximity and connectedness were found to be crucial in determining the magnitude of the object benefit in VSTM. Together, these results indicate that location/proximity and connectedness are essential elements in defining a coherent visual object representation in VSTM.     

Surface assignment modulates object formation for visual short-term memory

Recent results have suggested that the operational units of visual short-term memory (VSTM) are whole objects, rather than features or the total amount of information to be remembered. Here, for the first time, the influence of surface assignment on object formation for VSTM was investigated. The observers had to memorize the features of four briefly presented (300 ms) two-part objects, followed by a mask and a cue indicating which object to report on. The experiments contrasted whether there were any apparent depth differences between the two parts of each object, and whether observers had to report on only one or both features of the post-cued target object. Depth differences induced with stereoscopic disparity, and with a pictorial depth cue (simple interposition of object features), interfered strongly with performance when both features of an object needed to be memorized, but aided performance when only a single feature needed to be remembered. Furthermore, there was considerable within-feature interference consistent with some previous findings, but contradicting others. The potential implications for conceptions of VSTM are discussed in the light of two hypothesized stages: an early feature-based stage, as well as a higher-level object-based stage where the depth manipulations exert their effects. The results argue for a strong modulatory influence of surface assignment on object formation for a VSTM task.     

Object-based representations govern both the storage of information in visual short-term memory and the retrieval of information from it

Interest is growing in how information is retained in visual short-term memory (VSTM). We describe an experiment that assesses VSTM within the context of multidimensional signal detection theory. On every trial, participants were presented with a 250-ms display containing four colored shapes. They were then probed 900 ms later with a colored shape and made separate old/new judgments about the color and the shape. In any particular trial, one, both, or neither of the probed features had been presented. Performance differed according to whether both probed features belonged to a single object or to two different objects. When both probed features belonged to the same object, featural retrieval was better than would be predicted by independent feature storage. When both probed features belonged to two different objects, featural retrieval was worse than would be predicted by independent feature storage. We conclude that storage in and retrieval from VSTM operate on the basis of object-based representations.     

See what I mean? An ERP study of the effect of background knowledge on novel object processing

Two event-related potential (ERP) experiments were used to examine the representation of object feature information and background knowledge in semantic memory. Participants were trained on novel object categories with three features and were tested with new exemplars that were complete or were missing one to two features that were essential or nonessential to object function. In both a category membership judgment task (Experiment 1) and a parts detection task (Experiment 2), the N400, a functionally specific measure of semantic access, was graded with feature number but was insensitive to knowledge-based feature importance. A separable ERP effect related to knowledge was seen in Experiment 1 as an enhanced frontocentral negativity (beginning ∼300 msec) to exemplars missing a nonessential versus an essential feature, but this effect did not manifest when background knowledge was less task relevant (Experiment 2). Thus, similarity- and knowledge-based effects are separable, and the locus of knowledge effects varies with task demands but does not seem to arise from facilitated semantic access.     

Visual cognition influences early vision: the role of visual short-term memory in amodal completion

A partly occluded visual object is perceptually filled in behind the occluding surface, a process known as amodal completion or visual interpolation. Previous research focused on the image-based properties that lead to amodal completion. In the present experiments, we examined the role of a higher-level visual process-visual short-term memory (VSTM)-in amodal completion. We measured the degree of amodal completion by asking participants to perform an object-based attention task on occluded objects while maintaining either zero or four items in visual working memory. When no items were stored in VSTM, participants completed the occluded objects; when four items were stored in VSTM, amodal completion was halted (Experiment 1). These results were not caused by the influence of VSTM on object-based attention per se (Experiment 2) or by the specific location of to-be-remembered items (Experiment 3). Items held in VSTM interfere with amodal completion, which suggests that amodal completion may not be an informationally encapsulated process, but rather can be affected by high-level visual processes.     

Encoding color and shape from different parts of an object in visual short-term memory

Can we find an object-based encoding benefit in visual short-term memory (VSTM) when the features to be remembered are from different parts of an object? Using object parts defined by either figure-ground separation or negative minima of curvature, results from five experiments in which the visual change detection paradigm was used showed that the object-based encoding benefit in VSTM is modulated by how features are assigned to parts of an object: Features are best retained when the color and shape features to be remembered belong to the same part of an object. Although less well retained in comparison, features from different parts of an object are still better remembered than features from spatially separated objects. An object-based feature binding therefore exists even when the color and shape features to be remembered are from different parts of an object.     

Color and context: An ERP study on intrinsic and extrinsic feature binding in episodic memory

Episodic memory for intrinsic item and extrinsic context information is postulated to rely on two distinct types of representation: object and episodic tokens. These provide the basis for familiarity and recollection, respectively. Electrophysiological indices of these processes (ERP old-new effects) were used together with behavioral data to test these assumptions. We manipulated an intrinsic object feature (color; Experiment 1) and a contextual feature (background; Experiments 1 and 2). In an inclusion task (Experiment 1), the study-test manipulation of color affected object recognition performance and modulated ERP old-new effects associated with both familiarity and recollection. In contrast, a contextual manipulation had no effect, although both intrinsic and extrinsic information was available in a direct feature (source memory) test. When made task relevant (exclusion task; Experiment 2), however, context affected the ERP recollection effect, while still leaving the ERP familiarity effect uninfluenced. We conclude that intrinsic features bound in object tokens are involuntarily processed during object recognition, thus influencing familiarity, whereas context features bound in episodic tokens are voluntarily accessed, exclusively influencing recollection. Figures depicting all the electrodes analyzed are available in an online supplement at www.psychonomic.org/archive.     

Feature binding in visual short term memory: A General Recognition Theory analysis

Creating and maintaining accurate bindings of elementary features (e.g., color and shape) in visual short-term memory (VSTM) is fundamental for veridical perception. How are low-level features bound in memory? The present work harnessed a multivariate model of perception – the General Recognition Theory (GRT) – to unravel the internal representations underlying feature binding in VSTM. On each trial, preview and target colored shapes were presented in succession, appearing in either repeated or altered spatial locations. Participants gave two same/different responses: one with respect to color and one with respect to shape. Converging GRT analyses on the accuracy confusion matrices provided substantial evidence for binding in the form of violations of perceptual independence at the level of the individual stimulus, such that positive correlations were obtained when both features repeated or alternated together, while negative correlations were obtained when one feature repeated and the other alternated. This “cloverleaf” GRT pattern of binding was similar whether the spatial location of the preview and target repeated or altered. The current results are consistent with: (a) the discrete memory “slots” model of VSTM, and (b) the notion that spatial location is not necessary for the formation of “object files.” The GRT approach presented here offers a viable quantitative model for testing various questions regarding feature binding in VSTM.     

The capacity of visual short-term memory is not a fixed number of objects

Luck and Vogel (1997) have reported several striking results in support of the view that visual short-term memory (VSTM) has a fixed capacity of four objects, irrespective of how many relevant features those objects comprise. However, more recent studies have challenged this account, indicating only a weak effect of the number of objects once other factors are more evenly equated across conditions. Here, we employed a symmetry manipulation to verify object segmentation in our displays, to demonstrate that when spatial and masking factors are held constant, the number of objects per se has no effect on VSTM. Instead, VSTM capacity may reflect the number of object "parts" or feature conjunctions in a given display.     

Mechanisms of priming of pop-out: Stored representations or feature-gain modulations?

Previous research has shown that repetition of a task-relevant attention-capturing feature facilitates popout search. This priming of pop-out effect is due to some residual memory from recent trials. We explore two possible mechanisms of priming of pop-out: a top-down attentional benefit from a memory of the previous target representation that is stored in visual short-term memory (VSTM) and a bottom-up change of attentional gains from perceptual features of the previously attended target. We manipulated participants’ ability to form a memory trace in VSTM by occupying it with a distractor task and found that occupying VSTM did not interfere with priming of pop-out. We next manipulated attentional gains associated with feature values by inserting an irrelevant task between pop-out searches. We found that the color of the target from the intervening perceptual task influenced pop-out search: The current pop-out search was facilitated when the intervening task’s target matched the target color of the pop-out search. These results suggest that priming of pop-out might not be due to a memory trace of the previous targets in VSTM but, rather, might be due to changes in attentional control based on priming from relatively low-level feature representations of previously attended objects.     

Is visual short-term memory object based? Rejection of the “strong-object” hypothesis

Is the capacity of visual short-term memory (VSTM) limited by the number of objects or by the number of features? VSTM for objects with either one feature or two color features was tested. Results show that capacity was limited primarily by the number of colors to be memorized, not by the number of objects. This result held up with variations in color saturation, blocked or mixed conditions, duration of memory image, and absence or presence of verbal load. However, conjoining features into objects improved VSTM capacity when size-orientation and color-orientation conjunctions were tested. Nevertheless, the number of features still mattered. When feature heterogeneity was controlled, VSTM for conjoined objects was worse than VSTM for objects made of single features. Our results support a weak-object hypothesis of VSTM capacity that suggests that VSTM is limited by both the number of objects and the feature composition of those objects.     

Is visual short-term memory object based? Rejection of the "strong-object" hypothesis

Is the capacity of visual short-term memory (VSTM) limited by the number of objects or by the number of features? VSTM for objects with either one feature or two color features was tested. Results show that capacity was limited primarily by the number of colors to be memorized, not by the number of objects. This result held up with variations in color saturation, blocked or mixed conditions, duration of memory image, and absence or presence of verbal load. However, conjoining features into objects improved VSTM capacity when size-orientation and color-orientation conjunctions were tested. Nevertheless, the number of features still mattered. When feature heterogeneity was controlled, VSTM for conjoined objects was worse than VSTM for objects made of single features. Our results support a weak-object hypothesis of VSTM capacity that suggests that VSTM is limited by both the number of objects and the feature composition of those objects.     

Binding feature dimensions in visual short-term memory

We explored several possible influences on binding in visual short-term memory (VSTM) performance. The task was to report whether a test object was the same (“old” trials) or different (“new” trials) from any of the sample objects seen a second ago. The objects were composed of two features that varied from continuous to discrete shapes and colors. In “old” trials the test object appeared either in the same or different position. In “new” trials the test object differed along both features, requiring storage of only one feature per object; along one feature, requiring no binding but storage of all features; or it was created by recombining features from the sample, which requires binding. Existing storage hypotheses are unable to explain the similar sensitivity (d′) obtained in the two last conditions when position remained the same and may suggest that links are created between positions and features. Highest sensitivity occurred when the test object remained at the same position, required no binding, and discrete features were used. Object-type × position, and feature combination × position interactions occurred, suggesting different storage modes depending on whether objects change position during retention.     

Feature binding in visual short-term memory is unaffected by task-irrelevant changes of location,shape, and color

Three experiments used a change detection paradigm across a range of study–test intervals to address the respective contributions of location, shape, and color to the formation of bindings of features in sensory memory and visual short-term memory (VSTM). In Experiment 1, location was designated task irrelevant and was randomized between study and test displays. The task was to detect changes in the bindings between shape and color. In Experiments 2 and 3, shape and color, respectively, were task irrelevant and randomized, with bindings tested between location and color (Experiment 2) and location and shape (Experiment 3). At shorter study–test intervals, randomizing location was most disruptive, followed by shape and then color. At longer intervals, randomizing any task-irrelevant feature had no impact on change detection for bindings between features, and location had no special role. Results suggest that location is crucial for initial perceptual binding but loses that special status once representations are formed in VSTM, which operates according to different principles, than do visual attention and perception.     

Does visual short-term memory have a high-capacity stage?

Visual short-term memory (VSTM) has long been considered a durable, limited-capacity system for the brief retention of visual information. However, a recent work by Sligte et al. (Plos One 3:e1699, 2008) reported that, relatively early after the removal of a memory array, a cue allowed participants to access a fragile, high-capacity stage of VSTM that is distinct from iconic memory. In the present study, we examined whether this stage division is warranted by attempting to corroborate the existence of an early, high-capacity form of VSTM. The results of four experiments did not support Sligte et al.’s claim, since we did not obtain evidence for VSTM retention that exceeded traditional estimates of capacity. However, performance approaching that observed in Sligte et al. can be achieved through extensive practice, providing a clear explanation for their findings. Our evidence favors the standard view of VSTM as a limited-capacity system that maintains a few object representations in a relatively durable form.     

视觉长时记忆激活度对促进视觉短时记忆的影响

短时记忆与长时记忆的关系是记忆领域研究的重要内容。基于此, 研究者们就视觉长时记忆是否能促进视觉短时记忆的问题展开了大量研究, 但所得出的结论并不一致。通过不同程度的学习形成不同激活度的视觉长时记忆, 考察对几何图形的视觉长时记忆是否能对变化检测中的短时记忆起到促进作用。结果发现, 低激活水平的视觉长时记忆不能促进视觉短时记忆, 而事先存在且高度激活的视觉长时记忆对视觉短时记忆却具有促进作用; 同时, 随着视觉长时记忆激活水平的提高, 刺激间间隔的效应值也逐渐减小。本研究说明, 视觉长时记忆能否促进视觉短时记忆取决于视觉长时记忆的激活水平, 高激活的视觉长时记忆对阻止视觉短时记忆痕迹的迅速消退具有重要意义。     

Updating and feature overwriting in short-term memory for timbre

Previous research has demonstrated a potent, stimulus-specific form of interference in short-term auditory memory. This effect has been interpreted in terms of interitem confusion and grouping, but the present experiments suggested that interference might be a feature-specific phenomenon. Participants compared standard and comparison tones over a 10-sec interval and were required to determine whether they differed in timbre. A single interfering distractor tone was presented either 50 msec or 8 sec after the offset of the standard (Experiment 1) or 2 sec prior to its onset (Experiment 2). The distractor varied in the number of features it shared with the standard and comparison, and this proved critical, since performance on the task was greatly impaired when the distractor either consisted of novel, unshared features (Experiment 1) or contained the distinguishing feature of the comparison tone (Experiments 1 and 2). These findings were incompatible with earlier accounts of forgetting but were fully explicable by the recent timbre memory model, which associates interference in short-term auditory memory with an "updating" process and feature overwriting. These results suggest similarities with the mechanisms that underlie forgetting in verbal short-term memory.     

The influence of expertise and of physical complexity on visual short-term memory consolidation

We investigated whether the expertise of a perceiver and the physical complexity of a stimulus influence consolidation of visual short-term memory (VSTM) in a S1-S2 (Stimulus 1-Stimulus 2) change detection task. Consolidation is assumed to make transient perceptual representations in VSTM more durable, and it is investigated by postexposure of a mask shortly after offset of the perceived stimulus (S1; 17 to 483?ms). We presented colours, Chinese characters, pseudocharacters, and novel symbols to novices (Germans) or experts of Chinese language (Chinese readers). Physical complexity was manipulated by the number of strokes. Unfamiliar material was remembered worse than familiar material (Experiments 1, 2, and 3). For novices the absolute VSTM performance was better for physically simple than for complex material, whereas for experts the complexity did not matter-Chinese readers memorized Chinese characters (Experiment 3). Articulatory suppression did not change these effects (Experiment 2). We always observed a strong effect of SOA, but this effect was influenced neither by physical complexity nor by expertise; only the length of the interstimulus interval between S1 and the mask was relevant. This was observed even with short stimulus onset asynchrony (SOA) of 100?ms (Experiment 2) and in comparing colours and characters (Experiment 5). However, masks impaired memory if they were presented at the locations of the to-be-memorized items, but not beside them-that is, interference was location-based (Experiment 6). We explain the effect of SOA by the assumption that it takes time to stop encoding of information presented at item locations with the offset of S1. The increasing resistance against interference by irrelevant material appears as consolidation of S1.