Mental representations of spatial and nonspatial relations

Four experiments investigated the representation and integration in memory of spatial and nonspatial relations. Subjects learned two-dimensional spatial arrays in which critical pairs of object names were semantically related (Experiment 1), semantically and episodically related (Experiment 2), or just episodically related (Experiments 3a and 3b). Episodic relatedness was established in a paired-associate learning task that preceded array learning. After learning an array, subjects participated in two tasks: item recognition, in which the measure of interest was priming; and distance estimation. Priming in item recognition was sensitive to the Euclidean distance between object names and, for neighbouring locations, to nonspatial relations. Errors in distance estimations varied as a function of distance but were unaffected by nonspatial relations. These and other results indicated that nonspatial relations influenced the probability of encoding spatial relations between locations but did not lead to distorted spatial memories.     

Strategy selection in a task with spatial and nonspatial components: effects of fimbria-fornix lesions in rats.

The main purpose of the present research was to investigate the ability of rats to learn a 12-arm radial maze task that requires the concurrent utilization of both spatial and intramaze cue information. The task involves in a single trial both place and cue learning as well as reference memory (RM) and working memory (WM). Since the animal can choose place and cue arms in any order, the strategies employed to learn the task can be studied as well as the kinds of memory errors that are made. The results of Experiment 1 showed that the number of errors made on the place and cue components of the task did not differ, and that more RM than WM errors were made early during learning. As the task was learned, the animals tended to choose the place arms before choosing the intramaze cue arms, thus suggesting that a spatial strategy was employed first followed by a cue strategy. In Experiment 2 lesions of the fimbria-fornix resulted in temporary impairments in both RM and WM that were especially apparent on the spatial component of the task. The lesioned rats also switched from choosing mostly place arms early during the trial to choosing more cue arms. While fimbria-fornix lesioned rats recovered from the memory impairments with training, the change in response strategy persisted throughout postoperative testing. The procedure of combining both spatial and non-spatial components concurrently in the same task should prove of value in studying response strategies in animals.     

Multisensory integration of vision and touch in nonspatial feature discrimination tasks

Multisensory integration of nonspatial features between vision and touch was investigated by examining the effects of redundant signals of visual and tactile inputs. In the present experiments, visual letter stimuli and/or tactile letter stimuli were presented, which participants were asked to identify as quickly as possible. The results of Experiment 1 demonstrated faster reaction times for bimodal stimuli than for unimodal stimuli (the redundant signals effect (RSE)). The RSE was due to coactivation of figural representations from the visual and tactile modalities. This coactivation did not occur for a simple stimulus detection task (Experiment 2) or for bimodal stimuli with the same semantic information but different physical stimulus features (Experiment 3). The findings suggest that the integration process might occur at a relatively early stage of object-identification prior to the decision level.     

Attentional effects on preattentive vision: spatial precues affect the detection of simple features

Most accounts of visual perception hold that the detection of primitive features occurs preattentively, in parallel across the visual field. Evidence that preattentive vision operates without attentional limitations comes from visual search tasks in which the detection of the presence of absence of a primitive feature is independent of the number of stimuli in a display. If the detection of primitive features occurs preattentively, in parallel and without capacity limitations, then it should not matter where attention is located in the visual field. The present study shows that even though the detection of a red element in an array of gray elements occurred in parallel without capacity limitations, the allocation of attention did have a large effect on search performance. If attention was directed to a particular region of the display and the target feature was presented elsewhere, response latencies increased. Results indicate that the classic view of preattentive vision requires revision.     

The role of spatial and nonspatial information in visual selection

Even though it is undisputed that prior information regarding the location of a target affects visual selection, the issue of whether information regarding nonspatial features, such as color and shape, has similar effects has been a matter of debate since the early 1980s. In the study described in this article, measures derived from signal detection theory were used to show that perceptual sensitivity is affected by a top-down set for spatial information but not by a top-down set for nonspatial information. This indicates that knowing where the target singleton is affects perceptual selectivity but that knowing what it is does not help selectivity. Furthermore, perceptual sensitivity can be enhanced by nonspatial features, but only through a process related to bottom-up priming. These findings have important implications for models of visual selection.     

The representation and integration in memory of spatial and nonspatial information

A series of experiments investigated whether people could integrate nonspatial information about an object with their knowledge of the object's location in space. In Experiments 1 and 3, subjects learned the locations of cities on a fictitious road map; in Experiments 2, 4, and 5, subjects were already familiar with the locations of buildings on a campus. The subjects then learned facts about the cities on the maps or the buildings on the campus. The question of interest was whether or not these nonspatial facts would be integrated in memory with the spatial knowledge. After learning the facts, subjects were given a location-judgment test in which they had to decide whether an object was in one region of the space or another. Knowledge integration was assessed by comparing levels of performance in two conditions: (a) when a city or a building name was primed by a fact about a neighboring city or building, and (b) when a city or a building name was primed by a fact about a distant city or building. Results showed that responses in Condition a were faster or more accurate, or both faster and more accurate, than responses in Condition b. These results indicate that the spatial and nonspatial information were encoded in a common memory representation.     

Domain-dependent activation during spatial and nonspatial auditory working memory

Visual system has been proposed to be divided into two, the ventral and dorsal, processing streams. The ventral pathway is thought to be involved in object identification whereas the dorsal pathway processes information regarding the spatial locations of objects and the spatial relationships among objects. Several studies on working memory (WM) processing have further suggested that there is a dissociable domain-dependent functional organization within the prefrontal cortex for processing of spatial and nonspatial visual information. Also the auditory system is proposed to be organized into two domain-specific processing streams, similar to that seen in the visual system. Recent studies on auditory WM have further suggested that maintenance of nonspatial and spatial auditory information activates a distributed neural network including temporal, parietal, and frontal regions but the magnitude of activation within these activated areas shows a different functional topography depending on the type of information being maintained. The dorsal prefrontal cortex, specifically an area of the superior frontal sulcus (SFS), has been shown to exhibit greater activity for spatial than for nonspatial auditory tasks. Conversely, ventral frontal regions have been shown to be more recruited by nonspatial than by spatial auditory tasks. It has also been shown that the magnitude of this dissociation is dependent on the cognitive operations required during WM processing. Moreover, there is evidence that within the nonspatial domain in the ventral prefrontal cortex, there is an across-modality dissociation during maintenance of visual and auditory information. Taken together, human neuroimaging results on both visual and auditory sensory systems support the idea that the prefrontal cortex is organized according to the type of information being maintained in WM.     

Attentional focussing and spatial stimulus-response compatibility

Summary The relative functional significance of attention shifts and attentional zooming for the coding of stimulus position in spatial compatibility tasks is demonstrated by proposing and testing experimentally a tentative explanation of the absence of a Simon effect in Experiment 3 of Umiltà and Liotti (1987). It is assumed that the neutral point of the spatial frame of reference for coding spatial position is at the position where attention is focussed immediately before exposition of the stimulus pattern. If a stimulus pattern is exposed to the right or the left of this position a spatial compatibility effect can be observed when the stimulus-response pairing is incompatible. Generalizing from this, one can say that a spatial compatibility effect will be observed if the last step in attentional focussing of the stimulus attribute specifying the response is a horizontal or a vertical attention shift. If the last step in focussing is attentional zooming (change in the representational level attended to), the stimulus pattern is localized at the horizontal and the vertical positions where the last attention shift had positioned the focus. In this case the spatial code is neutral on these dimensions and so no spatial compatibility effect should result. To test this model we conducted two experiments. Experiment 1 replicated the finding of Umiltà and Liotti that there is no Simon effect in the condition with no delay between a positional cue (two small boxes on the left or right of a fixation cross) and the imperative stimulus, whereas in the condition with a delay of 500 ms a Simon effect was observed. In a comparison condition with a single, rather large cue instead of two small boxes (forcing attention to zoom in), no Simon effect was observed under either delay condition. Experiment 2 used a spatial compatibility task proper with the same experimental conditions as Experiment 1. But in contrast to those of Experiment 1, the results show strong compatibility effects in all cue and delay conditions. The absence of a Simon effect in some experimental conditions in Experiment 1 and the presence of a spatial compatibility effect proper in all conditions in Experiment 2 are consistently accounted for with the proposed attentional explanation of spatial coding and spatial compatibility effects.     

Attentional breadth and trade-offs in spatial and temporal acuity

Various manipulations have been shown to induce trade-offs in spatial and temporal acuity. Two experiments examine the role of the breadth of the attentional focus in such trade-offs. In the first experiment, exogenous attentional cues indicated 1, 2, 3, or 4 possible (contiguous) target locations. Half of the subjects performed a perceptual task on the target requiring spatial acuity – detecting spatial gaps in a ring; the other half of the subjects performed a task requiring temporal acuity – detecting a temporal gap in the presentation of the target ring. The results revealed a trade-off in spatial and temporal acuity: as the cue size increased, performance on the spatial task declined and performance on the temporal task improved. A second experiment replicated this pattern using two different tasks: a temporal order judgment task that assessed temporal acuity, and a task requiring the localization of a thin line that assessed spatial acuity.     

Pip and pop: nonspatial auditory signals improve spatial visual search

Searching for an object within a cluttered, continuously changing environment can be a very time-consuming process. The authors show that a simple auditory pip drastically decreases search times for a synchronized visual object that is normally very difficult to find. This effect occurs even though the pip contains no information on the location or identity of the visual object. The experiments also show that the effect is not due to general alerting (because it does not occur with visual cues), nor is it due to top-down cuing of the visual change (because it still occurs when the pip is synchronized with distractors on the majority of trials). Instead, we propose that the temporal information of the auditory signal is integrated with the visual signal, generating a relatively salient emergent feature that automatically draws attention. Phenomenally, the synchronous pip makes the visual object pop out from its complex environment, providing a direct demonstration of spatially nonspecific sounds affecting competition in spatial visual processing.     

The effect of spatial and nonspatial contextual information on visual object memory

Recent research has found visual object memory can be stored as part of a larger scene representation rather than independently of scene context. The present study examined how spatial and nonspatial contextual information modulate visual object memory. Two experiments tested participants’ visual memory by using a change detection task in which a target object's orientation was either the same as it appeared during initial viewing or changed. In addition, we examined the effect of spatial and nonspatial contextual manipulations on change detection performance. The results revealed that visual object representations can be maintained reliably after viewing arrays of objects. Moreover, change detection performance was significantly higher when either spatial or nonspatial contextual information remained the same in the test image. We concluded that while processing complex visual stimuli such as object arrays, visual object memory can be stored as part of a comprehensive scene representation, and both spatial and nonspatial contextual changes modulate visual memory retrieval and comparison.     

Computers in spatial vision research

The original impulse for using computers in a laboratory dedicated to spatial vision research and the current role of computers in experiments are detailed. Although computers are used widely for modeling spatial vision, there is some doubt about whether conventional serial computers are the most appropriate tools for this task.     

Intentional attention switching in dichotic listening: Exploring the efficiency of nonspatial and spatial selection

Using an auditory variant of task switching, we examined the ability to intentionally switch attention in a dichotic-listening task. In our study, participants responded selectively to one of two simultaneously presented auditory number words (spoken by a female and a male, one for each ear) by categorizing its numerical magnitude. The mapping of gender (female vs. male) and ear (left vs. right) was unpredictable. The to-be-attended feature for gender or ear, respectively, was indicated by a visual selection cue prior to auditory stimulus onset. In Experiment 1, explicitly cued switches of the relevant feature dimension (e.g., from gender to ear) and switches of the relevant feature within a dimension (e.g., from male to female) occurred in an unpredictable manner. We found large performance costs when the relevant feature switched, but switches of the relevant feature dimension incurred only small additional costs. The feature-switch costs were larger in ear-relevant than in gender-relevant trials. In Experiment 2, we replicated these findings using a simplified design (i.e., only within-dimension switches with blocked dimensions). In Experiment 3, we examined preparation effects by manipulating the cueing interval and found a preparation benefit only when ear was cued. Together, our data suggest that the large part of attentional switch costs arises from reconfiguration at the level of relevant auditory features (e.g., left vs. right) rather than feature dimensions (ear vs. gender). Additionally, our findings suggest that ear-based target selection benefits more from preparation time (i.e., time to direct attention to one ear) than gender-based target selection.     

Biases of spatial attention in vision and audition

Neurologically normal observers misperceive the midpoint of horizontal lines as systematically leftward of veridical center, a phenomenon known as pseudoneglect. Pseudoneglect is attributed to a tonic asymmetry of visuospatial attention favoring left hemispace. Whereas visuospatial attention is biased toward left hemispace, some evidence suggests that audiospatial attention may possess a right hemispatial bias. If spatial attention is supramodal, then the leftward bias observed in visual line bisection should also be expressed in auditory bisection tasks. If spatial attention is modality specific then bisection errors in visual and auditory spatial judgments are potentially dissociable. Subjects performed a bisection task for spatial intervals defined by auditory stimuli, as well as a tachistoscopic visual line bisection task. Subjects showed a significant leftward bias in the visual line bisection task and a significant rightward bias in the auditory interval bisection task. Performance across both tasks was, however, significantly positively correlated. These results imply the existence of both modality specific and supramodal attentional mechanisms where visuospatial attention has a prepotent leftward vector and audiospatial attention has a prepotent rightward vector of attention. In addition, the biases of both visuospatial and audiospatial attention are correlated.     

Perception of spatial order in extrafoveal vision

Perception of spatial order in central and extrafoveal vision was investigated by means of a task in which observers judged the relative position of a target line segment in a briefly flashed array of six line segments. The line arrays were size-scaled in extrafoveal vision according to the cortical magnification factor derived from the cone and ganglion cell distributions across the human retina, i.e. the stimulus representations in the striate cortex were of equal size in central and eccentric vision. In central vision, observers could judge the relative position of the target with high accuracy but in extrafoveal vision the task was more difficult, especially with short interline distances. However, performance was well above chance level also in extrafoveal vision.