Neuroanatomical correlates of processing in visual and visuospatial working memory

Working memory is traditionally seen as being organised in a modular way with a central executive orchestrating at least two slave systems (phonological loop and visuospatial sketch pad). Neuroanatomical correlates of the visual and visuospatial subsystems and the central executive are discussed in this article. A series of experiments are presented yielding evidence for a differentiation into active and passive processing in working memory as well as their neuroanatomical correlates in the prefrontal cortex. Data, yielding evidence for an interaction and separation of visual and visuospatial working memory are presented and discussed. Further results are presented which suggest a convergence of these two systems with increasing working memory demands. The discussed findings will give new insight in the organisation of visual and visuospatial working memory on the anatomical level.     

Motor and visual codes interact to facilitate visuospatial memory performance

The spatial working memory system constantly updates spatial representations and many studies have focused on the underlying principles of the encoding and maintenance of visual information. Here we investigated the question of how the production of actions influences spatial working memory. Participants were given a task that required concurrent maintenance of two spatial arrays, one encoded by visual observation accompanied with pointing movements, the other by only visual observation. Across two experiments, movement during encoding was found to facilitate recognition of spatial arrays in a load-dependent manner. The results suggest an action-based encoding principle within the working memory system, and possible underlying action-related mechanisms are discussed.     

Single units and visual cortical organization

The visual system has a parallel and hierarchical organization, evident at every stage from the retina onwards. Although the general benefits of parallel and hierarchical organization in the visual system are easily understood, it has not been easy to discern the function of the visual cortical modules. I explore the view that striate cortex segregates information about different attributes of the image, and dispatches it for analysis to different extrastriate areas. I argue that visual cortex does not undertake multiple relatively independent analyses of the image from which it assembles a unified representation that can be interrogated about the what and where of the world. Instead, occipital cortex is organized so that perceptually relevant information can be recovered at every level in the hierarchy, that information used in making decisions at one level is not passed on to the next level, and, with one rather special exception (area MT), through all stages of analysis all dimensions of the image remain intimately coupled in a retinotopic map. I then offer some explicit suggestions about the analyses undertaken by visual areas in occipital cortex, and conclude by examining some objections to the proposals.     

A purely temporal transparency mechanism in the visual system.

I report evidence for a purely temporal perceptual transparency mechanism. Rapid alternation of two images in the same location can result in the simultaneous experience of both, accompanied by a sense of transparency. This is true even when the sum of the two images does not appear transparent, which suggests that the percept is not mediated by the static transparency processes. At slow rates, alternating gratings were experienced as successive. As the rate was increased, by 8 Hz observers experienced the gratings as simultaneous. The rapidly alternating gratings are apparently processed separately before being combined for awareness by a process that integrates over about 120 ms. A final experiment tested whether the common presentation time of different parts of an image in alternation with another would cause the parts to perceptually bind. Observers did not distinguish between a rapidly alternating intact grating display and one in which halves of the display were exchanged in time. In other words, temporal binding across space did not occur. The temporal transparency phenomenon, in addition to informing theories of transparency and the dynamics of visual processing, may also be useful for the creation of transparent displays for electronic devices.     

Hypnotic suggestion of stimulus change and visual cortical evoked potential.

Two experiments were conducted to determine whether the hypnotic suggestion of stimulus intensity change would affect the physical parameters (latencies, amplitudes) of the visual cortical evoked potential. Stimulus intensity was kept constant as visual cortical evoked potentials were measured under conditions in which it was suggested that stimuli were "bright" or "dim". The results of both experiments led to the conclusion that, under the present condition, hypnotic suggestion of stimulus intensity change did not result in changes in visual cortical evoked potentials.     

Colour, face, and visuospatial imagery abilities in low-vision individuals with visual field deficits

This study investigates to what extent visual perception integrity is necessary for visual mental imagery. Sixteen low-vision participants with severe peripheral visual field loss, 16 with severe central field loss, 6 left brain-damaged patients with right homonymous hemianopia, 6 right brain-damaged patients with left homonymous hemianopia, and 16 normally sighted controls performed perceptual and imagery tasks using colours, faces, and spatial relationships. Results showed that (a) the perceptual and mental image>ry disorders vary according to the type of visual field loss, (b) hemianopics had no more difficulties imagining spatial stimuli in their contralesional hemispace than in their ipsilesional one, and (c) the only hemianopic participant to have perceptual and mental imagery impairments suffered from attentional deficits. Results suggest that (a) visual memory is not definitively established, but rather needs perceptual practice to be maintained, and (b) that visual mental imagery may involve some of the attentional-exploratory mechanisms that are employed in visual behaviour.     

Colour,face, and visuospatial imagery abilities in low-vision individuals with visual field deficits

This study investigates to what extent visual perception integrity is necessary for visual mental imagery. Sixteen low-vision participants with severe peripheral visual field loss, 16 with severe central field loss, 6 left brain-damaged patients with right homonymous hemianopia, 6 right brain-damaged patients with left homonymous hemianopia, and 16 normally sighted controls performed perceptual and imagery tasks using colours, faces, and spatial relationships. Results showed that (a) the perceptual and mental image>ry disorders vary according to the type of visual field loss, (b) hemianopics had no more difficulties imagining spatial stimuli in their contralesional hemispace than in their ipsilesional one, and (c) the only hemianopic participant to have perceptual and mental imagery impairments suffered from attentional deficits. Results suggest that (a) visual memory is not definitively established, but rather needs perceptual practice to be maintained, and (b) that visual mental imagery may involve some of the attentional–exploratory mechanisms that are employed in visual behaviour.     

Modality-specific auditory and visual temporal processing deficits

We studied the attentional blink (AB) and the repetition blindness (RB) effects using an audio-visual presentation procedure designed to overcome several potential methodological confounds in previous cross-modal research. In Experiment 1, two target digits were embedded amongst letter distractors in two concurrent streams (one visual and the other auditory) presented from the same spatial location. Targets appeared in either modality unpredictably at different temporal lags, and the participants' task was to recall the digits at the end of the trial. We evaluated both AB and RB for pairs of targets presented in either the same or different modalities. Under these conditions both AB and RB were observed in vision, AB but not RB was observed in audition, and there was no evidence of AB or RB cross-modally from audition to vision or vice versa. In Experiment 2, we further investigated the AB by including Lag 1 items and observed Lag 1 sparing, thus ruling out the possibility that the observed effects were due to perceptual and/or conceptual masking. Our results support a distinction between a modality-specific interference at the attentional selection stage and a modality-independent interference at later processing stages. They also provide a new dissociation between the AB and RB.     

Direction- and velocity-specific responses from beyond the classical receptive field in the middle temporal visual area (MT)

The true receptive field of more than 90% of neurons in the middle temporal visual area (MT) extends well beyond the classical receptive field (crf), as mapped with conventional bar or spot stimuli, and includes a surrounding region that is 50 to 100 times the area of the crf. These extensive surrounds are demonstrated by simultaneously stimulating the crf and the surround with moving stimuli. The surrounds commonly have directional and velocity-selective influences that are antagonistic to the response from the crf. The crfs of MT neurons are organized in a topographic representation of the visual field. Thus MT neurons are embedded in an orderly visuotopic array, but are capable of integrating local stimulus conditions within a global context. The extensive surrounds of MT neurons may be involved in figure-ground discrimination, preattentive vision, perceptual constancies, and depth perception through motion cues.     

Spatial and temporal processing in the auditory and visual modalities

Three experiments tested the idea that auditory presentation facilitates temporal recall whereas spatial recall is better if the input modality is visual. Lists of words were presented in which the temporal and spatial orders were independent, and instructions to the subjects determined whether recall would be given in a spatial or temporal order. In all three experiments, a significant interaction between the input modality and the type of recall was found, such that visual presentation resulted in superior recall over auditory presentation in the spatial conditions and auditory presentation yielded superior recall to visual in the temporal conditions. The present results contradict an earlier study by Murdock that showed that auditory presentation resulted in better performance than visual presentation in a nominally spatial task. An explanation for the discrepancies between the results of that study and the present one is presented.     

The role of visual and auditory temporal processing in reading irregular and nonsense words.

In the present study, the role of rapid visual and auditory temporal processing in reading irregular and nonsense words was investigated with a group of normal readers. One hundred and five undergraduates participated in various visual and auditory temporal-processing tasks. Readers who primarily adopted the phonological route in reading (nonsense-word readers) showed a trend for better auditory temporal resolution but readers who primarily adopted sight word skills (irregular-word readers) did not exhibit better visual temporal resolution. Both the correlation and stepwise multiple-regression analyses, however, revealed a relationship between visual temporal processing and irregular-word reading as well as a relationship between auditory temporal processing and nonsense-word reading. The results support the involvement of visual and auditory processing in reading irregular and nonsense words respectively, and were discussed with respect to recent findings that only dyslexics with phonological impairment will display temporal deficits. Further, the temporal measures were not effective discriminants for the reading groups, suggesting a lack of association between reading ability and the choice of reading strategy.     

Sound improves diminished visual temporal sensitivity in schizophrenia

Visual temporal processing and multisensory integration (MSI) of sound and vision were examined in individuals with schizophrenia using a visual temporal order judgment (TOJ) task. Compared to a non-psychiatric control group, persons with schizophrenia were less sensitive judging the temporal order of two successively presented visual stimuli. However, their sensitivity to visual temporal order improved as in the control group when two accessory sounds were added (temporal ventriloquism). These findings indicate that individuals with schizophrenia have diminished sensitivity to visual temporal order, but no deficits in the integration of low-level auditory and visual information.     

Cortical dynamics of visual persistence and temporal integration

In a temporal integration experiment, subjects must integrate two visual stimuli, presented at separate times, to perform an identification task. Many researchers have assumed that the persistence of the leading stimulus determines the ability to integrate the leading and trailing stimuli. However, recent studies of temporal integration have challenged that hypothesis by demonstrating that several theories of persistence are incompatible with data on temporal integration. This paper shows that an account of visual persistence given by a neural network model of preattentive vision, called the boundary contour system, explains data on temporal integration. Computer simulations of the model explain why temporal integration becomes more difficult when the display elements are separated by longer interstimulus intervals or are of longer duration or of higher luminance, or are spatially closer together. The model suggests that different mechanisms underlie the inverse duration effects for leading and for trailing elements. The model further predicts interactions of spatial separation, duration, and luminance of the trailing display.     

Endogenous visuospatial precuing effects as a function of age and task demands

This experiment examined the effects of age on processing resource capacity using an endogenous visuospatial precuing task and four levels of resource demands. Younger and older adults made speeded two-choice responses to dim and bright targets that required a line-orientation or a lexical decision. An arrow preceding target onset served as an attentional cue to affect the spatial distribution of resources. It provided accurate information about the target’s location on most trials and inaccurate or neutral information on the remaining trials. Although older adults were slower than younger adults under all conditions and were more affected by the resource demand manipulations, they exhibited a pattern of precuing effects across conditions that was similar to that of the younger adults. Results are consistent with the idea that the visuospatial attention system remains relatively unaffected by aging. However, the data speak against the idea that capacity reduction is the primary contributor to age-related slowing.     

Aging and perception of visual form from temporal structure

In this study, the authors examined age-related changes in participants' ability to perceive global spatial structure defined by temporal fine structure among elements undergoing rapid, irregular change. Participants were also tested on a task involving form recognition from luminance contrast and on a task dependent on perception of 3-dimensional shape from motion. Compared with young adults, older individuals were less sensitive to spatial form defined by temporal structure. In contrast, older observers performed as well as young adults on the other two tasks that were not dependent on temporal sensitivity, ruling out nonsensory factors as the cause of the deficits on the temporal structure task. This selective deficit may reveal reduced sensitivity within the temporal impulse response of the aging visual system, a deficit that could be related to reduced effectiveness of neural inhibition.     

Identification of temporal coherence between auditory and visual channels

Attention, Perception, & Psychophysics - The accuracy of identification of the temporal coherence between auditory and visual channels was examined. Random sequences of sound and light bursts...