Executive processes in visual and spatial working memory tasks

Three experiments are reported, which have investigated the nature of the cognitive mechanisms that underlie performance on specific visuo-spatial working memory tasks, with the emphasis on exploring the extent of central executive involvement. Experiments 1 and 2 employed oral random digit generation as an executive task within a dual-task paradigm. The results of both experiments indicated that visuo-spatial tasks that involve sequential processing of information show more interference with random digit generation than do visuo-spatial tasks that involve simultaneous processing. The third experiment substituted oral random digit generation for executive tasks that did not involve memory for serial order (vigilance tasks adapted from Vandierendonck, De Vooght, & Van der Goten, 1998b). The results indicated significant interference between the vigilance tasks and the sequential visuo-spatial task, but not with the simultaneous visuo-spatial task. Overall the results of the three experiments are interpreted as indicating that serial sequential visuo-spatial tasks involve executive resources to a significantly greater extent than do simultaneous visuo-spatial tasks, and that this can have implications for studies that attempt to make use of such tasks to fractionate separable visual and spatial components within working memory.     

Auditory and visual spatial working memory

A series of experiments compared short-term memory for object locations in the auditory and visual modalities. The stimulus materials consisted of sounds and pictures presented at different locations in space. Items were presented in pure- or mixed-modality lists of increasing length. At test, participants responded to renewed presentation of the objects by indicating their original position. If two independent modality-specific and resource-limited short-term memories support the remembering of locations, memory performance should be higher in the mixed-modality than in the pure-modality condition. Yet, memory performance was the same for items in both types of list. In addition, responses to the memory load manipulation in both modalities showed very similar declines in performance. The results are interpreted in terms of object files binding object and location information in episodic working memory, independently of the input modality.     

Performance dissociation during verbal and spatial working memory tasks

Past research has inconsistently distinguished the neural substrates of various types of working memory. Task design and individual performance differences are known to alter patterns of brain response during working-memory tasks. These task and individual differences may have produced discrepancies in imaging findings. This study of 50 healthy adults (M(age) = 19.6 yr., SD = .8) examined performance during various parametric manipulations of a verbal and spatial n-back working-memory task. Performance systematically dissociated on the basis of working-memory load, working memory type, and stimulus difficulty, with participants having greater accuracy but slower response time during conditions requiring verbal versus spatial working memory. These findings hold implications for cognitive and neuroimaging studies of verbal and spatial working memory and highlight the importance of considering both task design and individual behavior.     

Executive working memory processes in dyslexia: Behavioral and fMRI evidence

Beneventi, H., Tønnessen, F. E., Ersland, L. & Hugdahl, K. (2010). Executive working memory processes in dyslexia: Behavioral and fMRI evidence. Scandinavian Journal of Psychology, 51, 192–202. Dyslexia is an impairment in learning to read and write, primarily associated with a phonological core deficit. However, the manifestation of symptoms in dyslexia also includes impaired working memory (WM). The aim of this study was to investigate cortical activation related to verbal WM in dyslexic and normal readers aged around 13 years, controlling for phonological awareness processing. We used a modified WM n‐back task where the participants remembered the first or last speech segment (phonemes) of the names of common objects shown as pictures. Dyslexic readers were impaired compared with the control group. Compared with the dyslexic readers, controls showed increased fMRI activation in the left superior parietal lobule and the right inferior prefrontal gyrus. Unlike controls, dyslexics did not show a significant increase in activation in WM areas with increased memory load. These findings provide support for a specific working memory deficit in dyslexic individuals.     

Modality and domain specific components in auditory and visual working memory tasks

In the tripartite model of working memory (WM) it is postulated that a unique part system—the visuo-spatial sketchpad (VSSP)—processes non-verbal content. Due to behavioral and neurophysiological findings, the VSSP was later subdivided into visual object and visual spatial processing, the former representing objects’ appearance and the latter spatial information. This distinction is well supported. However, a challenge to this model is the question how spatial information from non-visual sensory modalities, for example the auditory one, is processed. Only a few studies so far have directly compared visual and auditory spatial WM. They suggest that the distinction of two processing domains—one for object and one for spatial information—also holds true for auditory WM, but that only a part of the processes is modality specific. We propose that processing in the object domain (the item’s appearance) is modality specific, while spatial WM as well as object-location binding relies on modality general processes.     

How rats perform spatial working memory tasks: limitations in the use of egocentric and idiothetic working memory

Rats of the Dark Agouti strain were trained on delayed alternation under conditions that should encourage egocentric working memory. In two experiments a T-maze was set within a cross-maze so that different arms could be used for the sample and test runs. The maze had high opaque side-walls, and testing was conducted in low light levels so that distal visual cues might be eliminated. By rotating the maze 90° between the sample and choice run and by using two identical mazes set side by side it was possible to nullify other spatial strategies. Experiments 1 and 2 showed that rats preferentially used place information, intramaze cues, and direction cues, even though only egocentric or idiothetic (nonmatch-to-turn) working memory could successfully solve every trial. Rats were able to maintain an accurate sense of location within the maze even though distal cues were not visible and the animal was moved between the sample and choice runs. Experiment 2 confirmed that another rat strain (Long-Evans) shows the same learning profiles. Both experiments indicate that rats are very poor at using either egocentric or idiothetic information to alternate, and that retention delays as short as 10 s can eliminate the use of these forms of memory.     

How rats perform spatial working memory tasks: Limitations in the use of egocentric and idiothetic working memory

Rats of the Dark Agouti strain were trained on delayed alternation under conditions that should encourage egocentric working memory. In two experiments a T-maze was set within a cross-maze so that different arms could be used for the sample and test runs. The maze had high opaque side-walls, and testing was conducted in low light levels so that distal visual cues might be eliminated. By rotating the maze 90° between the sample and choice run and by using two identical mazes set side by side it was possible to nullify other spatial strategies. Experiments 1 and 2 showed that rats preferentially used place information, intramaze cues, and direction cues, even though only egocentric or idiothetic (nonmatch-to-turn) working memory could successfully solve every trial. Rats were able to maintain an accurate sense of location within the maze even though distal cues were not visible and the animal was moved between the sample and choice runs. Experiment 2 confirmed that another rat strain (Long-Evans) shows the same learning profiles. Both experiments indicate that rats are very poor at using either egocentric or idiothetic information to alternate, and that retention delays as short as 10 s can eliminate the use of these forms of memory.     

空间距离对视觉工作记忆巩固的影响

以往研究发现,个体对不同类型的视觉信息进行视觉工作记忆巩固的模式存在差异,如对于方向信息,一次只能有一个项目被巩固进入视觉工作记忆系统,而对于颜色信息,个体则可以一次巩固两个项目进入视觉工作记忆系统。但对于视觉信息的巩固模式是否会受其他因素的影响,目前仍然没有明确的定论。本研究将探讨视觉信息的巩固模式是否可能受到记忆项目空间距离因素的影响。研究采用变化觉察范式、序列-同时呈现操作及控制记忆项目呈现间距的方法,通过3个实验考察记忆项目之间的空间距离是否能够影响个体对颜色信息和方向信息的巩固模式。在三种空间距离水平上序列呈现或同时呈现两个记忆项目,实验结果一致发现记忆项目之间的空间距离会对视觉工作记忆巩固模式产生明显影响,个体在同时呈现条件下的正确率会随着空间距离的增大而降低。这些结果表明对同一类视觉信息进行巩固的过程中所存在的项目数量限制并不是固定的,个体可以采用序列模式或有限容量的并行模式对同一类信息进行巩固,巩固的模式可能与视觉空间注意的分配以及视觉信息所能获得的注意资源有关。     

The role of spatial working memory in visual search efficiency

Many theories have proposed that visual working memory plays an important role in visual search. In contrast, by showing that a nonspatial working memory load did not interfere with search efficiency, Woodman, Vogel, and Luck (2001) recently proposed that the role of working memory in visual search is insignificant. However, the visual search process may interfere with spatial working memory. In the present study, a visual search task was performed concurrently with either a spatial working memory task (Experiment 1) or a nonspatial working memory task (Experiment 2). We found that the visual search process interfered with a spatial working memory load, but not with a nonspatial working memory load. These results suggest that there is a distinction between spatial and nonspatial working memory in terms of interactions with visual search tasks. These results imply that the visual search process and spatial working memory storage require the same limited-capacity mechanisms.     

Verbal, visual, and spatial working memory in written language production

College students wrote definitions of either abstract or concrete nouns in longhand while performing a concurrent working memory (WM) task. They detected either a verbal (syllable), visual (shape), or spatial (location) stimulus and decided whether it matched the last one presented 15-45s earlier. Writing definitions of both noun types elevated the response time to verbal targets above baseline. Such interference was observed for visual targets only when defining concrete nouns and was eliminated entirely with spatial targets. The interference effect for verbal targets was the same whether they were read or heard, implicating phonological storage. The findings suggest that language production requires phonological or verbal WM. Visual WM is selectively engaged when imaging the referents of concrete nouns.     

Coordination in visual working memory

Coordination of mental procedures is considered in terms of control processes (Baddeley, 1989) in visual working memory and appears to be a separable aspect of the demand imposed by cascaded serial processes (Carlson & Lundy, 1992). The main task required subjects to indicate whether symbolically suggested rotations and reflections correctly describe the difference between matrix patterns of filled-in squares within a 3 x 3 grid or between line drawings. Experiments were carried out to show that coordination is a separable component in this transformation task. A marker for coordination is the difference between the time taken to execute two transformations as a whole and the sum of the component transformations in isolation. The separate coordination demand was found in an experiment with matrix patterns mentioned, in an experiment with letter-like line drawings, and also in an experiment that forced subjects to maintain whole-pattern representations. A last experiment checked whether coordination is carried out by an autonomous control unit. There was a self-paced control of serial presentation of transformation symbols instead of a simultaneous presentation of those symbols. This additional external triggering resulted in a substantial decrease in the demand for coordination. Coordination of mental procedures and temporary representations is a fundamental constraint on the use of working-memory processes.     

Selection of objects and tasks in working memory

When people hold several objects (such as digits or words) in working memory and select one for processing, switching to a new object takes longer than selecting the same object as that on the preceding processing step. Similarly, selecting a new task incurs task- switching costs. This work investigates the selection of objects and of tasks in working memory using a combination of object-switching and task-switching paradigms. Participants used spatial cues to select one digit held in working memory and colour cues to select one task (addition or subtraction) to apply to it. Across four experiments the mapping between objects and their cues and the mapping between tasks and their cues were varied orthogonally. When mappings varied from trial to trial for both objects and tasks, switch costs for objects and tasks were additive, as predicted by sequential selection or resource sharing. When at least one mapping was constant across trials, allowing learning of long-term associations, switch costs were underadditive, as predicted by partially parallel selection. The number of objects in working memory affected object-switch costs but not task-switch costs, counter to the notion of a general resource of executive attention.     

Encoding processes in memory scanning tasks

Three experiments are presented that deal with the effect of stimulus probability on the encoding of both alphanumeric characters and nonsense figures. Experiment I replicated a previous finding of an interaction between stimulus probability and stimulus quality in a memory scanning task with numbers as stimuli. Experiments II and III investigated the same paradigm with unfamiliar visual forms as stimuli, and no interaction was found. Results were interpreted as showing that probability affects the encoding mechanism only when the encoding process results in a representation of the name of the stimulus. When stimulus materials are visual forms without names, probability does not appear to affect encoding processes.     

Electrophysiological correlates of encoding processes in a full-report visual working memory paradigm

Why are some visual stimuli remembered, whereas others are forgotten? A limitation of recognition paradigms is that they measure aggregate behavioral performance and/or neural responses to all stimuli presented in a visual working memory (VWM) array. To address this limitation, we paired an electroencephalography (EEG) frequency-tagging technique with two full-report VWM paradigms. This permitted the tracking of individual stimuli as well as the aggregate response. We recorded high-density EEG (256 channel) while participants viewed four shape stimuli, each flickering at a different frequency. At retrieval, participants either recalled the location of all stimuli in any order (simultaneous full report) or were cued to report the item in a particular location over multiple screen displays (sequential full report). The individual frequency tag amplitudes evoked for correctly recalled items were significantly larger than the amplitudes of subsequently forgotten stimuli, regardless of retrieval task. An induced-power analysis examined the aggregate neural correlates of VWM encoding as a function of items correctly recalled. We found increased induced power across a large number of electrodes in the theta, alpha, and beta frequency bands when more items were successfully recalled. This effect was more robust for sequential full report, suggesting that retrieval demands can influence encoding processes. These data are consistent with a model in which encoding-related resources are directed to a subset of items, rather than a model in which resources are allocated evenly across the array. These data extend previous work using recognition paradigms and stress the importance of encoding in determining later VWM retrieval success.     

基于空间方位信息的构型对视觉工作记忆绩效的影响

通过考察构成视觉客体构型的两种因素在视觉工作记忆任务中的影响, 探讨了构型对视觉工作记忆绩效的作用机制。采用变化觉察实验范式, 在构型朝向不变和旋转两种条件下, 系统地控制构型中的客体相对方位和整体几何形态两种因素的变化, 考察其对视觉工作记忆绩效的影响。实验结果显示, 无论构型朝向不变还是旋转, 只要客体相对方位保持一致, 工作记忆绩效就可以维持较高水平, 而几何形态没有表现出显著作用。上述发现提示构型客体相对方位是构型影响视觉工作记忆绩效的主要因素。     

Ensemble coding remains accurate under object and spatial visual working memory load

A number of studies have provided evidence that the visual system statistically summarizes large amounts of information that would exceed the limitations of attention and working memory (ensemble coding). However the necessity of working memory resources for ensemble coding has not yet been tested directly. In the current study, we used a dual task design to test the effect of object and spatial visual working memory load on size averaging accuracy. In Experiment 1, we tested participants’ accuracy in comparing the mean size of two sets under various levels of object visual working memory load. Although the accuracy of average size judgments depended on the difference in mean size between the two sets, we found no effect of working memory load. In Experiment 2, we tested the same average size judgment while participants were under spatial visual working memory load, again finding no effect of load on averaging accuracy. Overall our results reveal that ensemble coding can proceed unimpeded and highly accurately under both object and spatial visual working memory load, providing further evidence that ensemble coding reflects a basic perceptual process distinct from that of individual object processing.