Improving visual short-term memory by sequencing the stimulus array

When multiple objects are presented briefly and simultaneously in a visual array, visual short-term memory (VSTM) can maintain only a limited number of these items. The present research report reveals that splitting the to-be-remembered items into two sequential arrays significantly increases VSTM performance relative to the simultaneous presentation of the same items. A memory benefit also emerges when the full object array is flashed twice (repeated) rather than being presented continuously for the same duration. Moreover, the sequential and repetition benefits are specifically pronounced for individuals with low performance for simultaneously presented items. Our results suggest that the conventional, simultaneous presentation mode may underestimate VSTM performance due to attentional limitations and/or competition between stimulus representations. In contrast, temporal segregation of the stimulus input may help participants maximize their performance and utilize their full VSTM capacity.     

Integrating sequential arrays in visual short-term memory

Are sequential visual arrays represented as separate images or as a combined image in visual short-term memory (VSTM)? Proponents of the integration account suggest that an image of the first array is gradually formed and integrated with an image of the second to produce a combined representation. This view is evidenced by successful performance in an empty-cell detection task. In this task, on a 4 x 4 square matrix, 7 locations are occupied on a first array, followed by a variable interval, and then by 8 other occupied locations on a second array. Subjects' success in identifying the remaining empty cell has been taken as evidence for integration. In this study, we show that success in this task can be better accounted for by a convert-and-compare process than by an integration process. We conclude that VSTM only supports limited integration across sequential arrays.     

The role of visual short-term memory in empty cell localization

Three experiments examined the visual memory representation supporting performance at long interstimulus intervals (ISIs) in an empty cell localization task. Two arrays of dots within a 4 x 4 grid were displayed briefly in succession. One grid cell did not contain a dot in either array, and the task was to localize the empty cell. In Experiment 1, we replicated previous findings of recovery to high levels of performance at long ISIs. In Experiment 2, we tested whether figural grouping in visual short-term memory (VSTM) supports long-ISI performance by manipulating the complexity of the array pattern. Pattern complexity had no effect on empty cell localization at 0-msec ISI, suggesting dependence on high-capacity visible persistence, but there was a large simple pattern advantage at long ISIs, suggesting dependence on figural grouping in VSTM. Experiment 3 demonstrated that participants typically remember the empty cells of the first array, and not the dots, for comparison with Array 2.     

The influence of expertise and of physical complexity on visual short-term memory consolidation

We investigated whether the expertise of a perceiver and the physical complexity of a stimulus influence consolidation of visual short-term memory (VSTM) in a S1-S2 (Stimulus 1-Stimulus 2) change detection task. Consolidation is assumed to make transient perceptual representations in VSTM more durable, and it is investigated by postexposure of a mask shortly after offset of the perceived stimulus (S1; 17 to 483?ms). We presented colours, Chinese characters, pseudocharacters, and novel symbols to novices (Germans) or experts of Chinese language (Chinese readers). Physical complexity was manipulated by the number of strokes. Unfamiliar material was remembered worse than familiar material (Experiments 1, 2, and 3). For novices the absolute VSTM performance was better for physically simple than for complex material, whereas for experts the complexity did not matter-Chinese readers memorized Chinese characters (Experiment 3). Articulatory suppression did not change these effects (Experiment 2). We always observed a strong effect of SOA, but this effect was influenced neither by physical complexity nor by expertise; only the length of the interstimulus interval between S1 and the mask was relevant. This was observed even with short stimulus onset asynchrony (SOA) of 100?ms (Experiment 2) and in comparing colours and characters (Experiment 5). However, masks impaired memory if they were presented at the locations of the to-be-memorized items, but not beside them-that is, interference was location-based (Experiment 6). We explain the effect of SOA by the assumption that it takes time to stop encoding of information presented at item locations with the offset of S1. The increasing resistance against interference by irrelevant material appears as consolidation of S1.     

Sequential dynamics in visual short-term memory

Visual short-term memory (VSTM) is thought to help bridge across changes in visual input, and yet many studies of VSTM employ static displays. Here we investigate how VSTM copes with sequential input. In particular, we characterize the temporal dynamics of several different components of VSTM performance, including: storage probability, precision, variability in precision, guessing, and swapping. We used a variant of the continuous-report VSTM task developed for static displays, quantifying the contribution of each component with statistical likelihood estimation, as a function of serial position and set size. In Experiments 1 and 2, storage probability did not vary by serial position for small set sizes, but showed a small primacy effect and a robust recency effect for larger set sizes; precision did not vary by serial position or set size. In Experiment 3, the recency effect was shown to reflect an increased likelihood of swapping out items from earlier serial positions and swapping in later items, rather than an increased rate of guessing for earlier items. Indeed, a model that incorporated responding to non-targets provided a better fit to these data than alternative models that did not allow for swapping or that tried to account for variable precision. These findings suggest that VSTM is updated in a first-in-first-out manner, and they bring VSTM research into closer alignment with classical working memory research that focuses on sequential behavior and interference effects.     

A severe capacity limit in the consolidation of orientation information into visual short-term memory

Previous research has suggested that two color patches can be consolidated into visual short-term memory (VSTM) via an unlimited parallel process. Here we examined whether the same unlimited-capacity parallel process occurs for two oriented grating patches. Participants viewed two gratings that were presented briefly and masked. In blocks of trials, the gratings were presented either simultaneously or sequentially. In Experiments 1 and 2, the presentation of the stimuli was followed by a location cue that indicated the grating on which to base one’s response. In Experiment 1, participants responded whether the target grating was oriented clockwise or counterclockwise with respect to vertical. In Experiment 2, participants indicated whether the target grating was oriented along one of the cardinal directions (vertical or horizontal) or was obliquely oriented. Finally, in Experiment 3, the location cue was replaced with a third grating that appeared at fixation, and participants indicated whether either of the two test gratings matched this probe. Despite the fact that these responses required fairly coarse coding of the orientation information, across all methods of responding we found superior performance for sequential over simultaneous presentations. These findings suggest that the consolidation of oriented gratings into VSTM is severely limited in capacity and differs from the consolidation of color information.     

Effects of facial expressions on visual short-term memory in relation to alexithymia traits

We examined dysfunctional memory processing of facial expressions in relation to alexithymia. Individuals with high and low alexithymia, as measured by the Toronto Alexithymia Scale (TAS-20), participated in a visual search task (Experiment 1A) and a change-detection task (Experiments 1B and 2), to assess differences in their visual short-term memory (VSTM). In the visual search task, the participants were asked to judge whether all facial expressions (angry and happy faces) in the search display were the same or different. In the change-detection task, they had to decide whether all facial expressions changed between successive two displays. We found individual differences only in the change-detection task. Individuals with high alexithymia showed lower sensitivity for the happy faces compared to the angry faces, while individuals with low alexithymia showed sufficient recognition for both facial expressions. Experiment 2 examined whether individual differences were observed during early storage or later retrieval stage of the VSTM process using a single-probe paradigm. We found no effect of single-probe, indicating that individual differences occurred at the storage stage. The present results provide new evidence that individuals with high alexithymia show specific impairment in VSTM processes (especially the storage stage) related to happy but not to angry faces.     

What are the units of visual short-term memory, objects or spatial locations?

We investigated whether the capacity of visual short-term memory (VSTM) is defined by number of objects or number of spatial locations. Previous work is consistent with either alternative. To distinguish these factors, we used overlapping stimuli that allowed us to independently manipulate the number of spatial locations while holding constant the number of objects and features to be encoded (Duncan, 1984; Vecera & Farah, 1994). In Experiment 1, the number of spatial locations had no effect on VSTM, suggesting that VSTM is object based. Experiments 2 and 3 ruled out alternative explanations based on perceptual segregation difficulty or decision noise factors. Our results provide additional support to Luck and Vogel's (1997) demonstration that integrated objects form the units of VSTM capacity.     

A bilateral advantage for maintaining objects in visual short term memory

Research has shown that attentional pre-cues can subsequently influence the transfer of information into visual short term memory (VSTM) (Schmidt, B., Vogel, E., Woodman, G., & Luck, S. (2002). Voluntary and automatic attentional control of visual working memory. Perception & Psychophysics, 64(5), 754–763). However, studies also suggest that those effects are constrained by the hemifield alignment of the pre-cues (Holt, J. L., & Delvenne, J.-F. (2014). A bilateral advantage in controlling access to visual short-term memory. Experimental Psychology, 61(2), 127–133), revealing better recall when distributed across hemifields relative to within a single hemifield (otherwise known as a bilateral field advantage). By manipulating the duration of the retention interval in a colour change detection task (1 s, 3 s), we investigated whether selective pre-cues can also influence how information is later maintained in VSTM. The results revealed that the pre-cues influenced the maintenance of the colours in VSTM, promoting consistent performance across retention intervals (Experiments 1 & 4). However, those effects were only shown when the pre-cues were directed to stimuli displayed across hemifields relative to stimuli within a single hemifield. Importantly, the results were not replicated when participants were required to memorise colours (Experiment 2) or locations (Experiment 3) in the absence of spatial pre-cues. Those findings strongly suggest that attentional pre-cues have a strong influence on both the transfer of information in VSTM and its subsequent maintenance, allowing bilateral items to better survive decay.     

视觉信息分布调节信息整合策略：来自眼动的证据

以空白单元格定位为实验任务,操纵序列点阵的分布,考察视觉短时记忆与视知觉的信息整合机制。实验一发现任务正确率与点阵1的圆点数呈近似U形关系。实验二发现在拐点前后被试的眼动模式从偏向于注视圆点位置转为偏向于注视空格位置。因此,视觉信息的分布模式调节整合策略,当处于视觉短时记忆中的圆点数在其容量之内时,采用图像—知觉整合策略,反之,则采用转换—比较策略。     

Parallel consolidation of simple features into visual short-term memory

Although considerable research has examined the storage limits of visual short-term memory (VSTM), little is known about the initial formation (i.e., the consolidation) of VSTM representations. A few previous studies have estimated the capacity of consolidation to be one item at a time. Here we used a sequential-simultaneous manipulation to reexamine the limits of consolidating items into VSTM. Participants viewed briefly presented and masked color patches (targets), which were shown either sequentially or simultaneously. A probe color followed the targets and participants decided whether it matched one of the targets or was a novel color. In four experiments, we consistently found equal performance for sequential and simultaneous presentations for two targets. Worse performance in the simultaneous than the sequential condition was observed for larger set sizes (three and four). Contrary to previous results, suggesting a severe capacity limit of one item, our results indicate that consolidation into VSTM can occur in parallel and without capacity limits for at least two items.     

Dual-task interference in visual working memory: A limitation in storage capacity but not in encoding or retrieval

The concurrent maintenance of two visual working memory (VWM) arrays can lead to profound interference. It is unclear, however, whether these costs arise from limitations in VWM storage capacity (Fougnie & Maro is, 2006) or from interference between the storage of one visual array and encoding or retrieval of another visual array (Cowan & Morey, 2007). Here, we show that encoding a VWM array does not interfere with maintenance of another VWM array unless the two displays exceed maintenance capacity (Experiments 1 and 2). Moreover, manipulating the extent to which encoding and maintenance can interfere with one another had no discernable effect on dual-task performance (Experiment 2). Finally, maintenance of a VWM array was not affected by retrieval of information from another VWM array (Experiment 3). Taken together, these findings demonstrate that dual-task interference between two concurrent VWM tasks is due to a capacity-limited store that is independent from encoding and retrieval processes.     

The capacity of visual short-term memory within and between hemifields

Visual short-term memory (VSTM) and attention are both thought to have a capacity limit of four items [e.g. Luck, S. J., & Vogel, E. K. (1997). The capacity of visual working memory for features and conjunctions. Nature, 309, 279-281; Pylyshyn, Z. W., & Storm, R. W. (1988). Tracking multiple independent targets: evidence for a parallel tracking mechanism. Spatial Vision, 3, 179-197.]. Using the multiple object visual tracking paradigm (MOT), it has recently been shown that twice as many items can be simultaneously attended when they are separated between two visual fields compared to when they are all presented within the same hemifield [Alvarez, G. A., & Cavanagh, P. (2004). Independent attention resources for the left and right visual hemifields (Abstract). Journal of Vision, 4(8), 29a.]. Does VSTM capacity also increase when the items to be remembered are distributed between the two visual fields? The current paper investigated this central issue in two different tasks, namely a color and spatial location change detection task, in which the items were displayed either in the two visual fields or in the same hemifield. The data revealed that only memory capacity for spatial locations and not colors increased when the items were separated between the two visual fields. These findings support the view of VSTM as a chain of capacity limited operations where the spatial selection of stimuli, which dominates in both spatial location VSTM and MOT, occupies the first place and shows independence between the two fields.     

Exogenous attention influences visual short-term memory in infants

Two experiments examined the hypothesis that developing visual attentional mechanisms influence infants' Visual Short-Term Memory (VSTM) in the context of multiple items. Five- and 10-month-old infants (N = 76) received a change detection task in which arrays of three differently colored squares appeared and disappeared. On each trial one square changed color and one square was cued; sometimes the cued item was the changing item, and sometimes the changing item was not the cued item. Ten-month-old infants exhibited enhanced memory for the cued item when the cue was a spatial pre-cue (Experiment 1) and 5-month-old infants exhibited enhanced memory for the cued item when the cue was relative motion (Experiment 2). These results demonstrate for the first time that infants younger than 6 months can encode information in VSTM about individual items in multiple-object arrays, and that attention-directing cues influence both perceptual and VSTM encoding of stimuli in infants as in adults.     

Splitting attention across the two visual fields in visual short-term memory

Humans have the ability to attentionally select the most relevant visual information from their extrapersonal world and to retain it in a temporary buffer, known as visual short-term memory (VSTM). Research suggests that at least two non-contiguous items can be selected simultaneously when they are distributed across the two visual hemifields. In two experiments, we show that attention can also be split between the left and right sides of internal representations held in VSTM. Participants were asked to remember several colors, while cues presented during the delay instructed them to orient their attention to a subset of memorized colors. Experiment 1 revealed that orienting attention to one or two colors strengthened equally participants' memory for those colors, but only when they were from separate hemifields. Experiment 2 showed that in the absence of attentional cues the distribution of the items in the visual field per se had no effect on memory. These findings strongly suggest the existence of independent attentional resources in the two hemifields for selecting and/or consolidating information in VSTM.     

Updating objects in visual short-term memory is feature selective

The purpose of this study was to examine whether the process of updating information in visual short-term memory (VSTM) is object based. We investigated whether modifying the memory of one feature of an object would automatically promote refreshing the memory of all of its other features. The results showed that the facilitative effect of updating was specific to the updated feature of an object and did not spread to its nonupdated features. This feature-selective effect suggests that updating VSTM is not object based (Experiment 1), even though storage was object based (Experiment 2). Control experiments ruled out strategy-based (Experiment 3) and stimulus-related (Experiments 4–6) accounts. Feature-selective updating may indicate that the mechanism used to modify the contents of memory may have a different basis than that used to encode or store information in memory.     

Perceptual asymmetries are preserved in short-term memory tasks

Visual performance is heterogeneous at isoeccentric locations; it is better on the horizontal than on the vertical meridian and worse at the upper than at the lower region of the vertical meridian (Carrasco, Talgar, & Cameron, 2001; Talgar & Carrasco, 2002). It is unknown whether these performance inhomogeneities are also present in spatial frequency tasks and whether asymmetries present during encoding of visual information also emerge in visual short-term memory (VSTM) tasks. Here, we investigated the similarity of the perceptual and VSTM tasks in spatial frequency discrimination (Experiments 1 and 2) and perceived spatial frequency (Experiments 3 and 4). We found that (1) performance in both simultaneous (perceptual) and delayed (VSTM) spatial frequency discrimination tasks varies as a function of location; it is better along the horizontal than along the vertical meridian; and (2) perceived spatial frequency in both tasks is higher along the horizontal than along the vertical meridian. These results suggest that perceived spatial frequency may mediate performance differences in VSTM tasks across the visual field, implying that the quality with which we encode information affects VSTM.     

Feature binding in visual short-term memory is unaffected by task-irrelevant changes of location,shape, and color

Three experiments used a change detection paradigm across a range of study–test intervals to address the respective contributions of location, shape, and color to the formation of bindings of features in sensory memory and visual short-term memory (VSTM). In Experiment 1, location was designated task irrelevant and was randomized between study and test displays. The task was to detect changes in the bindings between shape and color. In Experiments 2 and 3, shape and color, respectively, were task irrelevant and randomized, with bindings tested between location and color (Experiment 2) and location and shape (Experiment 3). At shorter study–test intervals, randomizing location was most disruptive, followed by shape and then color. At longer intervals, randomizing any task-irrelevant feature had no impact on change detection for bindings between features, and location had no special role. Results suggest that location is crucial for initial perceptual binding but loses that special status once representations are formed in VSTM, which operates according to different principles, than do visual attention and perception.     

Are multiple visual short-term memory storages necessary to explain the retro-cue effect?

Recent research has shown that change detection performance is enhanced when, during the retention interval, attention is cued to the location of the upcoming test item. This retro-cue advantage has led some researchers to suggest that visual short-term memory (VSTM) is divided into a durable, limited-capacity storage and a more fragile, high-capacity storage. Consequently, performance is poor on the no-cue trials because fragile VSTM is overwritten by the test display and only durable VSTM is accessible under these conditions. In contrast, performance is improved in the retro-cue condition because attention keeps fragile VSTM accessible. The aim of the present study was to test the assumptions underlying this two-storage account. Participants were asked to encode an array of colors for a change detection task involving no-cue and retro-cue trials. A retro-cue advantage was found even when the cue was presented after a visual (Experiment 1) or a central (Experiment 2) interference. Furthermore, the magnitude of the interference was comparable between the no-cue and retro-cue trials. These data undermine the main empirical support for the two-storage account and suggest that the presence of a retro-cue benefit cannot be used to differentiate between different VSTM storages.     

A visual short-term memory advantage for faces

What determines how much can be stored in visual short-term memory (VSTM)? Studies of VSTM have focused largely on stimulus-based properties such as the number or complexity of the items stored. Recent work also suggests that capacity is severely reduced for items within the same category. However, the importance for VSTM capacity of more qualitative differences in processing for different categories has not been investigated. For example, faces are processed more holistically than other objects. In Experiments 1 and 2, we show that the processing of faces, objects that are crucial socially and for which we possess considerable expertise, overcomes these limitations. More faces can be stored in VSTM than objects from other complex nonface categories. As in prior studies, at short encoding durations we found that capacity for faces was less than that for other categories. However, at longer encoding durations, capacity for faces exceeded that for nonface objects, and this advantage was specific to upright faces. Because inversion reduces holistic processing, the interaction of orientation with VSTM capacity—which occurred for faces but not objects in Experiment 3—suggests that it is holistic processing that confers an advantage for face VSTM when sufficient encoding time is allowed.