Binding feature dimensions in visual short-term memory

We explored several possible influences on binding in visual short-term memory (VSTM) performance. The task was to report whether a test object was the same (“old” trials) or different (“new” trials) from any of the sample objects seen a second ago. The objects were composed of two features that varied from continuous to discrete shapes and colors. In “old” trials the test object appeared either in the same or different position. In “new” trials the test object differed along both features, requiring storage of only one feature per object; along one feature, requiring no binding but storage of all features; or it was created by recombining features from the sample, which requires binding. Existing storage hypotheses are unable to explain the similar sensitivity (d′) obtained in the two last conditions when position remained the same and may suggest that links are created between positions and features. Highest sensitivity occurred when the test object remained at the same position, required no binding, and discrete features were used. Object-type × position, and feature combination × position interactions occurred, suggesting different storage modes depending on whether objects change position during retention.     

Disruption of visual feature binding in working memory

In a series of five experiments, we studied the effect of a visual suffix on the retention in short-term visual memory of both individual visual features and objects involving the binding of two features. Experiments 1A, 1B, and 2 involved suffixes consisting of features external to the to-be-remembered set and revealed a modest but equivalent disruption on individual and bound feature conditions. Experiments 3A and 3B involved suffixes comprising features that could potentially have formed part of the to-be-remembered set (but did not on that trial). Both experiments showed greater disruption of retention for objects comprising bound features than for their individual features. The results are interpreted as differentiating two components of suffix interference, one affecting memory for features and bindings equally, the other affecting memory for bindings. The general component is tentatively identified with the attentional cost of operating a filter to prevent the suffix from entering visual working memory, whereas the specific component is attributed to the particular fragility of bound representations when the filter fails.     

Selective working memory disables inhibition of visual features

Recent research suggests that information held in working memory can facilitate subsequent attentional processing. Here, we explore the negative corollary of this conception: Under which circumstances does information in working memory disrupt subsequent processing? Seventy participants performed visual discriminations in a dual-task paradigm. They were asked to judge colors or shapes in an online attention task under three different working-memory conditions: Same, Switch, or Unknown. In the Same condition, participants selectively maintained one visual feature in working memory, from the same dimension as in the online attention task. In the Switch condition, participants selectively maintained one visual feature in working memory, but had to focus on another visual dimension in the online attention task. In the Unknown condition, participants could not predict which visual feature would be relevant for the working-memory task. We found that irrelevant features in the online attention task were particularly difficult to ignore in the Switch condition, that is, when the irrelevant features belong to a visual dimension that is simultaneously prioritized in selective working memory. The findings are consistent with accounts in terms of neural overlap between working-memory and attention circuits, and suggest that mechanisms of selection, rather than resource limitations, critically determine the extent of visual interference.     

Action relevance induces an attentional weighting of representations in visual working memory

Information maintained in visual working memory (VWM) can be strategically weighted according to its task-relevance. This is typically studied by presenting cues during the maintenance interval, but under natural conditions, the importance of certain aspects of our visual environment is mostly determined by intended actions. We investigated whether representations in VWM are also weighted with respect to their potential action relevance. In a combined memory and movement task, participants memorized a number of items and performed a pointing movement during the maintenance interval. The test item in the memory task was subsequently presented either at the movement goal or at another location. We found that performance was better for test items presented at a location that corresponded to the movement goal than for test items presented at action-irrelevant locations. This effect was sensitive to the number of maintained items, suggesting that preferential maintenance of action relevant information becomes particularly important when the demand on VWM is high. We argue that weighting according to action relevance is mediated by the deployment of spatial attention to action goals, with representations spatially corresponding to the action goal benefitting from this attentional engagement. Performance was also better at locations next to the action goal than at locations farther away, indicating an attentional gradient spreading out from the action goal. We conclude that our actions continue to influence visual processing at the mnemonic level, ensuring preferential maintenance of information that is relevant for current behavioral goals.     

Attention is required for maintenance of feature binding in visual working memory

Working memory and attention are intimately connected. However, understanding the relationship between the two is challenging. Currently, there is an important controversy about whether objects in working memory are maintained automatically or require resources that are also deployed for visual or auditory attention. Here we investigated the effects of loading attention resources on precision of visual working memory, specifically on correct maintenance of feature-bound objects, using a dual-task paradigm. Participants were presented with a memory array and were asked to remember either direction of motion of random dot kinematograms of different colour, or orientation of coloured bars. During the maintenance period, they performed a secondary visual or auditory task, with varying levels of load. Following a retention period, they adjusted a coloured probe to match either the motion direction or orientation of stimuli with the same colour in the memory array. This allowed us to examine the effects of an attention-demanding task performed during maintenance on precision of recall on the concurrent working memory task. Systematic increase in attention load during maintenance resulted in a significant decrease in overall working memory performance. Changes in overall performance were specifically accompanied by an increase in feature misbinding errors: erroneous reporting of nontarget motion or orientation. Thus in trials where attention resources were taxed, participants were more likely to respond with nontarget values rather than simply making random responses. Our findings suggest that resources used during attention-demanding visual or auditory tasks also contribute to maintaining feature-bound representations in visual working memory—but not necessarily other aspects of working memory.     

Coordination in visual working memory

Coordination of mental procedures is considered in terms of control processes (Baddeley, 1989) in visual working memory and appears to be a separable aspect of the demand imposed by cascaded serial processes (Carlson & Lundy, 1992). The main task required subjects to indicate whether symbolically suggested rotations and reflections correctly describe the difference between matrix patterns of filled-in squares within a 3 x 3 grid or between line drawings. Experiments were carried out to show that coordination is a separable component in this transformation task. A marker for coordination is the difference between the time taken to execute two transformations as a whole and the sum of the component transformations in isolation. The separate coordination demand was found in an experiment with matrix patterns mentioned, in an experiment with letter-like line drawings, and also in an experiment that forced subjects to maintain whole-pattern representations. A last experiment checked whether coordination is carried out by an autonomous control unit. There was a self-paced control of serial presentation of transformation symbols instead of a simultaneous presentation of those symbols. This additional external triggering resulted in a substantial decrease in the demand for coordination. Coordination of mental procedures and temporary representations is a fundamental constraint on the use of working-memory processes.     

Ageing and feature binding in visual working memory: The role of presentation time

A large body of research has clearly demonstrated that healthy ageing is accompanied by an associative memory deficit. Older adults exhibit disproportionately poor performance on memory tasks requiring the retention of associations between items (e.g., pairs of unrelated words). In contrast to this robust deficit, older adults’ ability to form and temporarily hold bound representations of an object's surface features, such as colour and shape, appears to be relatively well preserved. However, the findings of one set of experiments suggest that older adults may struggle to form temporary bound representations in visual working memory when given more time to study objects. However, these findings were based on between-participant comparisons across experimental paradigms. The present study directly assesses the role of presentation time in the ability of younger and older adults to bind shape and colour in visual working memory using a within-participant design. We report new evidence that giving older adults longer to study memory objects does not differentially affect their immediate memory for feature combinations relative to individual features. This is in line with a growing body of research suggesting that there is no age-related impairment in immediate memory for colour-shape binding.     

Age differences in dimension weighting on visual feature search

Two experiments examined age‐difference effects in visual feature search for two types of prior information (knowledge about target‐defining features and intertrial transition of target‐defining features). In Experiment 1, younger participants had shorter reaction times searching for a target in blocks where the target was defined by a single feature dimension compared to where the target was defined across dimensions (within‐dimension facilitation; WDF). However, WDF was not found in older participants. Intertrial facilitation (ITF), a dimension‐based carryover effect in consecutive trials, was observed both for young and older participants. Experiment 2 provided participants with probabilistic knowledge about target‐defining features. Again, young participants showed a facilitatory effect related to this knowledge, but this effect was reduced in older participants. However, intertrial facilitation was observed for young and older adults to the same degree. These results are not consistent with general age‐related decrement in the maintenance of dimension weighting, but support a dual mechanism of dimension weighting (Kumada, 2001). The results suggest that knowledge‐based control of dimension weighting declined with ageing, but involuntary shift of dimension weighting by intertrial transition of target‐defining features is maintained in ageing.     

Similarity effects in visual working memory

Perceptual similarity is an important property of multiple stimuli. Its computation supports a wide range of cognitive functions, including reasoning, categorization, and memory recognition. It is important, therefore, to determine why previous research has found conflicting effects of inter-item similarity on visual working memory. Studies reporting a similarity advantage have used simple stimuli whose similarity varied along a featural continuum. Studies reporting a similarity disadvantage have used complex stimuli from either a single or multiple categories. To elucidate stimulus conditions for similarity effects in visual working memory, we tested memory for complex stimuli (faces) whose similarity varied along a morph continuum. Participants encoded 3 morphs generated from a single face identity in the similar condition, or 3 morphs generated from different face identities in the dissimilar condition. After a brief delay, a test face appeared at one of the encoding locations for participants to make a same/different judgment. Two experiments showed that similarity enhanced memory accuracy without changing the response criterion. These findings support previous computational models that incorporate featural variance as a component of working memory load. They delineate limitations of models that emphasize cortical resources or response decisions.     

Selective attention to elements in working memory

Three experiments with an arithmetic working memory task examine the object switch effect first reported by Garavan (1998), which was interpreted as evidence for a focus of attention within working memory. Experiments 1a and 1b showed object switch costs with a task that requires selective access to items in working memory, but did not involve counting, and did not require updating of working memory contents, thus ruling out two alternative explanations of Garavan's results. Experiment 2 showed object switch costs with a task that required no selective access to working memory contents, but involved updating, thus providing evidence for a second component to the overall object switch costs. Further analyses revealed that the object switch cost increased with memory set size; that there were (smaller) switch costs when the switch was to an item of the same type; that repeating an arithmetic operation does not have the same effect as repeating the object it is applied to; and that object switching is not mediated by backward inhibition of the previously focused object.     

Encoding strategies in self-initiated visual working memory

During a typical day, visual working memory (VWM) is recruited to temporarily maintain visual information. Although individuals often memorize external visual information provided to them, on many other occasions they memorize information they have constructed themselves. The latter aspect of memory, which we term self-initiated WM, is prevalent in everyday behavior but has largely been overlooked in the research literature. In the present study we employed a modified change detection task in which participants constructed the displays they memorized, by selecting three or four abstract shapes or real-world objects and placing them at three or four locations in a circular display of eight locations. Half of the trials included identical targets that participants could select. The results demonstrated consistent strategies across participants. To enhance memory performance, participants reported selecting abstract shapes they could verbalize, but they preferred real-world objects with distinct visual features. Furthermore, participants constructed structured memory displays, most frequently based on the Gestalt organization cue of symmetry, and to a lesser extent on cues of proximity and similarity. When identical items were selected, participants mostly placed them in close proximity, demonstrating the construction of configurations based on the interaction between several Gestalt cues. The present results are consistent with recent findings in VWM, showing that memory for visual displays based on Gestalt organization cues can benefit VWM, suggesting that individuals have access to metacognitive knowledge on the benefit of structure in VWM. More generally, this study demonstrates how individuals interact with the world by actively structuring their surroundings to enhance performance.     

视觉工作记忆的过滤效能

过滤效能反映了视觉工作记忆的干扰抑制功能, 研究者可基于储存容量或表征精度对其进行测量, 其神经加工过程主要分为觉察分心项目、过滤启动、实现过滤或储存, 涉及前额叶皮层和基底核、后顶叶皮层的协同作用。过滤效能的变化方向受到年龄、特殊障碍、情绪、认知特点等因素的影响。未来研究仍需解决的问题包括厘清过滤效能与工作记忆容量的关系, 辨明过滤效能的心理实现过程, 探索不同年龄、特殊障碍和职业等群体过滤效能的脑机制以及提升基础研究范式的生态学效度。     

Movement and attention in visual working memory

Three experiments that adopt an interference technique to investigate the involvement of movement in the production of a spatial code are described. Arm movements rather than the more commonly employed eye movements are used to provide initial information about the sorts of movements relevant to the code and to allow an empirical separation of the contributions of movement and attention. The results confirm the interference effects of incompatible movement on the generation of the spatial code and show that movement per se rather than attention to the movement can cause a performance decrement.     

Location and binding in visual working memory

Visual working memory (VWM) wa sexplored separatelyfor features and for their binding. Features were better recognized when the probes retained the same binding as in the original display, but changing the locations had little effect overall. However, there were strong interactions of location with binding and with matching or new features, suggesting that, when objects are attended, features and locations are spontaneously integrated in VWM. Despite this, when the locations arechanged, features can also be accessed with little decrement, perhaps from separate feature maps. Bindings, on the other hand, are more vulnerable to location changes, suggesting that locations play a central role in the early maintenance and retrieval of bound objects as well as in their initial encoding, at least when verbal coding is prevented. The results qualify past claims about the separation of locations and objects in VWM.     

Interactions between visual working memory representations

We investigated whether the representations of different objects are maintained independently in working memory or interact with each other. Observers were shown two sequentially presented orientations and required to reproduce each orientation after a delay. The sequential presentation minimized perceptual interactions so that we could isolate interactions between memory representations per se. We found that similar orientations were repelled from each other whereas dissimilar orientations were attracted to each other. In addition, when one of the items was given greater attentional priority by means of a cue, the representation of the high-priority item was not influenced very much by the orientation of the low-priority item, but the representation of the low-priority item was strongly influenced by the orientation of the high-priority item. This indicates that attention modulates the interactions between working memory representations. In addition, errors in the reported orientations of the two objects were positively correlated under some conditions, suggesting that representations of distinct objects may become grouped together in memory. Together, these results demonstrate that working-memory representations are not independent but instead interact with each other in a manner that depends on attentional priority.     

Auditory and visual spatial working memory

A series of experiments compared short-term memory for object locations in the auditory and visual modalities. The stimulus materials consisted of sounds and pictures presented at different locations in space. Items were presented in pure- or mixed-modality lists of increasing length. At test, participants responded to renewed presentation of the objects by indicating their original position. If two independent modality-specific and resource-limited short-term memories support the remembering of locations, memory performance should be higher in the mixed-modality than in the pure-modality condition. Yet, memory performance was the same for items in both types of list. In addition, responses to the memory load manipulation in both modalities showed very similar declines in performance. The results are interpreted in terms of object files binding object and location information in episodic working memory, independently of the input modality.     

Perceptual organization influences visual working memory

Previous studies have demonstrated that top-down factors can bias the storage of information in visual working memory. However, relatively little is known about the role that bottom-up stimulus characteristics play in visual working memory storage. In the present study, subjects performed a change detection task in which the to-be-remembered objects were organized in accordance with Gestalt grouping principles. When an attention-capturing cue was presented at the location of one object, other objects that were perceptually grouped with the cued object were more likely to be stored in working memory than were objects that were not grouped with the cued object. Thus, objects that are grouped together tend to be stored together, indicating that bottom-up perceptual organization influences the storage of information in visual working memory.     

Distractor devaluation requires visual working memory

Visual stimuli seen previously as distractors in a visual search task are subsequently evaluated more negatively than those seen as targets. An attentional inhibition account for this distractor-devaluation effect posits that associative links between attentional inhibition and to-be-ignored stimuli are established during search, stored, and then later reinstantiated, implying that distractor devaluation may require visual working memory (WM) resources. To assess this, we measured distractor devaluation with and without a concurrent visual WM load. Participants viewed a memory array, performed a simple search task, evaluated one of the search items (or a novel item), and then viewed a memory test array. Although distractor devaluation was observed with low (and no) WM load, it was absent when WM load was increased. This result supports the notions that active association of current attentional states with stimuli requires WM and that memory for these associations plays a role in affective response.     

Dynamic visual noise interferes with storage in visual working memory

Several studies have demonstrated that dynamic visual noise (DVN) does not interfere with memory for random matrices. This has led to suggestions that (a) visual working memory is distinct from imagery, and (b) visual working memory is not a gateway between sensory input and long-term storage. A comparison of the interference effects of DVN with memory for matrices and colored textures shows that DVN can interfere with visual working memory, probably at a level of visual detail not easily supported by long-term memory structures or the recoding of the visual pattern elements. The results support a gateway model of visuospatial working memory and raise questions about the most appropriate ways to measure and model the different levels of representation of information that can be held in visual working memory.