Intrinsic frames of reference in haptic spatial learning

It has been proposed that spatial reference frames with which object locations are specified in memory are intrinsic to a to-be-remembered spatial layout (intrinsic reference theory). Although this theory has been supported by accumulating evidence, it has only been collected from paradigms in which the entire spatial layout was simultaneously visible to observers. The present study was designed to examine the generality of the theory by investigating whether the geometric structure of a spatial layout (bilateral symmetry) influences selection of spatial reference frames when object locations are sequentially learned through haptic exploration. In two experiments, participants learned the spatial layout solely by touch and performed judgments of relative direction among objects using their spatial memories. Results indicated that the geometric structure can provide a spatial cue for establishing reference frames as long as it is accentuated by explicit instructions (Experiment 1) or alignment with an egocentric orientation (Experiment 2). These results are entirely consistent with those from previous studies in which spatial information was encoded through simultaneous viewing of all object locations, suggesting that the intrinsic reference theory is not specific to a type of spatial memory acquired by the particular learning method but instead generalizes to spatial memories learned through a variety of encoding conditions. In particular, the present findings suggest that spatial memories that follow the intrinsic reference theory function equivalently regardless of the modality in which spatial information is encoded.     

How Do Opportunities to View Objects Together in Time Influence Children's Memory for Location?

We conducted three experiments to investigate how opportunities to view objects together in time influence memory for location. Children and adults learned the locations of 20 objects marked by dots on the floor of an open, square box. During learning, participants viewed the objects either simultaneously or in isolation. At test, participants replaced the objects without the aid of the dots. Experiment 1 showed that when the box was divided into quadrants and the objects in each quadrant were categorically related, 7-, 9-, and 11-year-olds and adults in the simultaneous viewing condition exhibited categorical bias, but only 11-year-olds and adults in the isolated viewing condition exhibited categorical bias. Experiment 2 showed that when the objects were categorically related but no boundaries were present, 11-year-olds and adults in the simultaneous viewing condition exhibited categorical bias, but only adults showed bias in the isolated viewing condition. Experiment 3 revealed that adults exhibited bias in both simultaneous and isolated viewing conditions when boundaries were present but the objects were not related. These findings suggest that opportunities to see objects together in time interact with cues available for grouping objects to help children form spatial groups.     

Object individuation in 3-day-old chicks: use of property and spatiotemporal information

Object individuation was investigated in newborn domestic chicks. Chicks' spontaneous tendency to approach the larger group of familiar objects was exploited in a series of five experiments. In the first experiment newborn chicks were reared for 3 days with objects differing in either colour, shape or size. At test, each chick was presented with two groups of events: two objects differing in one property vs. two presentations of the same object. In both cases, all objects involved in the same group of events were sequentially presented and eventually concealed in a different spatial location, and the number of events taking place at each location was equalized. Chicks spontaneously approached the two different objects rather than the single object seen twice. Chicks did not just prefer the more varied set as they did not choose it when the two elements of each group of events were simultaneously presented (Experiment 2). Chicks succeeded when two different objects simultaneously presented were confronted with three identical ones simultaneously presented (Experiment 3), though they failed with sequential presentation of two different objects vs. one object presented three times if they had been familiarized with up to three identical objects (Experiment 4). Chicks instead succeeded if they had been familiarized with objects that were all different from one another (Experiment 5). These young birds thus proved able to use property and spatiotemporal information for object individuation.     

Configural representations in spatial working memory

Two studies investigate the nature of representations in spatial working memory, directly addressing the question of whether people represent the configuration information above and beyond independent positional information when representing multiple sequentially presented locations. In Experiment 1, participants performed a location memory task in which they recalled the location of objects that were presented sequentially on a screen. Comparison of participants' data with simulated data modelled to represent independent positional representation of spatial locations revealed that participants represented the configural properties of shorter sequences (3 and 4 locations) but not of longer ones (5 and 7 locations). Experiment 2 employed a sequential recognition task in which participants were asked to judge whether two consequently presented spatial sequences were identical. These experiments confirmed sensitivity to configural properties of spatial sequences.     

Visual–spatial attention aids the maintenance of object representations in visual working memory

Theories have proposed that the maintenance of object representations in visual working memory is aided by a spatial rehearsal mechanism. In this study, we used two different approaches to test the hypothesis that overt and covert visual–spatial attention mechanisms contribute to the maintenance of object representations in visual working memory. First, we tracked observers’ eye movements while they remembered a variable number of objects during change-detection tasks. We observed that during the blank retention interval, participants spontaneously shifted gaze to the locations that the objects had occupied in the memory array. Next, we hypothesized that if attention mechanisms contribute to the maintenance of object representations, then drawing attention away from the object locations during the retention interval should impair object memory during these change-detection tasks. Supporting this prediction, we found that attending to the fixation point in anticipation of a brief probe stimulus during the retention interval reduced change-detection accuracy, even on the trials in which no probe occurred. These findings support models of working memory in which visual–spatial selection mechanisms contribute to the maintenance of object representations.     

Learning in repeated visual search

Visual search (e.g., finding a specific object in an array of other objects) is performed most effectively when people are able to ignore distracting nontargets. In repeated search, however, incidental learning of object identities may facilitate performance. In three experiments, with over 1,100 participants, we examined the extent to which search could be facilitated by object memory and by memory for spatial layouts. Participants searched for new targets (real-world, nameable objects) embedded among repeated distractors. To make the task more challenging, some participants performed search for multiple targets, increasing demands on visual working memory (WM). Following search, memory for search distractors was assessed using a surprise two-alternative forced choice recognition memory test with semantically matched foils. Search performance was facilitated by distractor object learning and by spatial memory; it was most robust when object identity was consistently tied to spatial locations and weakest (or absent) when object identities were inconsistent across trials. Incidental memory for distractors was better among participants who searched under high WM load, relative to low WM load. These results were observed when visual search included exhaustive-search trials (Experiment 1) or when all trials were self-terminating (Experiment 2). In Experiment 3, stimulus exposure was equated across WM load groups by presenting objects in a single-object stream; recognition accuracy was similar to that in Experiments 1 and 2. Together, the results suggest that people incidentally generate memory for nontarget objects encountered during search and that such memory can facilitate search performance.     

Gender differences in memory for objects and their locations: a study on automatic versus controlled encoding and retrieval contexts

Object-location memory is the only spatial task where female subjects have been shown to outperform males. This result is not consistent across all studies, and may be due to the combination of the multi-component structure of object location memory with the conditions under which different studies were done. Possible gender differences in object location memory and its component object identity memory were assessed in the present study. In order to disentangle these two components, an object location memory task (in which objects had to be relocated in daily environments), and a separate object identity recognition task were carried out. This study also focused on the conditions under which object locations were encoded and retrieved. Only half of the participants were aware of the fact that object locations had to be retrieved later on. Moreover, by applying the 'process dissociation procedure' to the object location memory assessments and the 'remember-know' paradigm to the object identity measure, the amount of explicit (conscious) and implicit (unconscious) retrieval was estimated for each component. In general, females performed better than males on the object location memory task. However, when controlled for object identity memory, females no longer outperformed males, whereas they did not obtain a higher general object identity memory score, nor did they have more explicit or implicit recollection of the object identities. These complicated effects might stem from a difference between males and females, in the way locations or associations between objects and locations are retrieved. In general, participants had more explicit (conscious) recollection than implicit (unconscious) recollection. No effect of encoding context was found, nor any interaction effect of gender, encoding and retrieval context.     

Spatial updating relies on an egocentric representation of space: Effects of the number of objects

Models of spatial updating attempt to explain how representations of spatial relationships between the actor and objects in the environment change as the actor moves. In allocentric models, object locations are encoded in an external reference frame, and only the actor’s position and orientation in that reference frame need to be updated. Thus, spatial updating should be independent of the number of objects in the environment (set size). In egocentric updating models, object locations are encoded relative to the actor, so the location of each object relative to the actor must be updated as the actor moves. Thus, spatial updating efficiency should depend on set size. We examined which model better accounts for human spatial updating by having people reconstruct the locations of varying numbers of virtual objects either from the original study position or from a changed viewing position. In consistency with the egocentric updating model, object localization following a viewpoint change was affected by the number of objects in the environment.     

When do spatial and visual working memory interact?

This study examined how spatial working memory and visual (object) working memory interact, focusing on two related questions: First, can these systems function independently from one another? Second, under what conditions do they operate together? In a dual-task paradigm, participants attempted to remember locations in a spatial working memory task and colored objects in a visual working memory task. Memory for the locations and objects was subject to independent working memory storage limits, which indicates that spatial and visual working memory can function independently from one another. However, additional experiments revealed that spatial working memory and visual working memory interact in three memory contexts: when retaining (1) shapes, (2) integrated color-shape objects, and (3) colored objects at specific locations. These results suggest that spatial working memory is needed to bind colors and shapes into integrated object representations in visual working memory. Further, this study reveals a set of conditions in which spatial and visual working memory can be isolated from one another.     

The effect of spatial and nonspatial contextual information on visual object memory

Recent research has found visual object memory can be stored as part of a larger scene representation rather than independently of scene context. The present study examined how spatial and nonspatial contextual information modulate visual object memory. Two experiments tested participants’ visual memory by using a change detection task in which a target object's orientation was either the same as it appeared during initial viewing or changed. In addition, we examined the effect of spatial and nonspatial contextual manipulations on change detection performance. The results revealed that visual object representations can be maintained reliably after viewing arrays of objects. Moreover, change detection performance was significantly higher when either spatial or nonspatial contextual information remained the same in the test image. We concluded that while processing complex visual stimuli such as object arrays, visual object memory can be stored as part of a comprehensive scene representation, and both spatial and nonspatial contextual changes modulate visual memory retrieval and comparison.     

The benefit of attention is not diminished when distributed over two simultaneous cues

Recent findings have suggested that transient attention can be triggered at two locations simultaneously. However, it is unclear whether doing so reduces the effect of attention at each attended location. In two experiments, we explored the consequences of dividing attention. In the first experiment, we compared the effects of one or two cues against an uncued baseline to determine the consequences of dividing attention in a paradigm with four rapid serial visual presentation (RSVP) streams. The results indicated that two simultaneous cues increase the accuracy of reporting two targets by almost the same amount as a single cue increases the report of a single target. These results suggest that when attention is divided between multiple locations, the attentional benefit at each location is not reduced in proportion to the total number of cues. A consequent prediction of this finding is that the identification of two RSVP targets should be better when they are presented simultaneously rather than sequentially. In a second experiment, we verified this prediction by finding evidence of lag-0 sparing: Two targets presented simultaneously in different locations were reported more easily than two targets separated by 100 ms. These findings argue against a biased-competition theory of attention. We suggest that visual attention, as triggered by a cue or target, is better described by a convergent gradient-field attention model.     

Space-, object-, and feature-based attention interact to organize visual scenes

Biased-competition accounts of attentional processing propose that attention arises from distributed interactions within and among different types of perceptual representations (e.g., spatial, featural, and object-based). Although considerable research has examined the facilitation in processing afforded by attending selectively to spatial locations, or to features, or to objects, surprisingly little research has addressed a key prediction of the biased-competition account: that attending to any stimulus should give rise to simultaneous interactions across all the types of perceptual representations encompassed by that stimulus. Here we show that, when an object in a visual display is cued, space-, feature-, and object-based forms of attention interact to enhance processing of that object and to create a scene-wide pattern of attentional facilitation. These results provide evidence to support the biased-competition framework and suggest that attention might be thought of as a mechanism by which multiple, disparate bottom-up, and even top-down, visual perceptual representations are coordinated and preferentially enhanced.     

Retrieving enduring spatial representations after disorientation

Four experiments tested whether there are enduring spatial representations of objects' locations in memory. Previous studies have shown that under certain conditions the internal consistency of pointing to objects using memory is disrupted by disorientation. This disorientation effect has been attributed to an absence of or to imprecise enduring spatial representations of objects' locations. Experiment 1 replicated the standard disorientation effect. Participants learned locations of objects in an irregular layout and then pointed to objects after physically turning to face an object and after disorientation. The expected disorientation was observed. In Experiment 2, after disorientation, participants were asked to imagine they were facing the original learning direction and then physically turned to adopt the test orientation. In Experiment 3, after disorientation, participants turned to adopt the test orientation and then were informed of the original viewing direction by the experimenter. A disorientation effect was not observed in Experiment 2 or 3. In Experiment 4, after disorientation, participants turned to face the test orientation but were not told the original learning orientation. As in Experiment 1, a disorientation effect was observed. These results suggest that there are enduring spatial representations of objects' locations specified in terms of a spatial reference direction parallel to the learning view, and that the disorientation effect is caused by uncertainty in recovering the spatial reference direction relative to the testing orientation following disorientation.     

Object-position binding in visual memory for natural scenes and object arrays

Nine experiments examined the means by which visual memory for individual objects is structured into a larger representation of a scene. Participants viewed images of natural scenes or object arrays in a change detection task requiring memory for the visual form of a single target object. In the test image, 2 properties of the stimulus were independently manipulated: the position of the target object and the spatial properties of the larger scene or array context. Memory performance was higher when the target object position remained the same from study to test. This same-position advantage was reduced or eliminated following contextual changes that disrupted the relative spatial relationships among contextual objects (context deletion, scrambling, and binding change) but was preserved following contextual change that did not disrupt relative spatial relationships (translation). Thus, episodic scene representations are formed through the binding of objects to scene locations, and object position is defined relative to a larger spatial representation coding the relative locations of contextual objects.     

Path information effects in visual and proprioceptive spatial learning

Objects in an environment are often encountered sequentially during spatial learning, forming a path along which object locations are experienced. The present study investigated the effect of spatial information conveyed through the path in visual and proprioceptive learning of a room-sized spatial layout, exploring whether different modalities differentially depend on the integrity of the path. Learning object locations along a coherent path was compared with learning them in a spatially random manner. Path integrity had little effect on visual learning, whereas learning with the coherent path produced better memory performance than random order learning for proprioceptive learning. These results suggest that path information has differential effects in visual and proprioceptive spatial learning, perhaps due to a difference in the way one establishes a reference frame for representing relative locations of objects.     

Object-position binding in visual short-term memory for sequentially presented unfamiliar stimuli

The effect of spatial position on visual short-term memory (VSTM) for sequentially presented objects has been investigated relatively little, despite the fact that vision in natural environments is characterised by frequent changes in object position and gaze location. We investigated the effect of reusing previously examined spatial positions on VSTM for object appearance. Observers performed a yes-no recognition task following a memory display comprising briefly presented 1/f noise discs (ie possessing spectral properties akin to natural images) shown sequentially at random coordinates. At test, single stimuli were presented either at original spatial positions, new positions, or at a fixed central position. Results, interpreted in terms of appearance and position preview effects, indicate that, where original spatial positions were reused at test, memory performance was elevated by more than 25%, despite that spatial position was task-irrelevant (in the sense that it could not be used to facilitate a correct response per se). This study generalises object-spatial-position binding theory to a sequential display scenario in which the influences of extrafoveal processing, spatial context cues, and long-term memory support were minimised, thereby eliminating the hypothesis that object priming is the principal cause of the 'same-position advantage' in VSTM.     

The infant's acquisition of knowledge of bimodally specified events

Four-month-old infants viewed, for a duration of several minutes, two objects that bounced in synchrony with two percussion sounds. This synchrony was the only information tying each sound to its respective object. During the viewing the infants learned about the relationships between sound and object. Learning was revealed in two ways. In a search test, infants looked for an object when its sound was played. In a transfer test, infants' declining interest in a sound presented alone generalized to the visible object that the sound specified. Studies that reversed the spatial locations of the objects revealed that sound-object learning, rather than place or response learning, guided infants' perceptual exploration.     

Eye movements serialize memory for objects in scenes

A gaze-contingent short-term memory paradigm was used to obtain forgetting functions for realistic objects in scenes. Experiment 1 had observers freely view nine-item scenes. After observers' gaze left a predetermined target, they could fixate from 1-7 intervening nontargets before the scene was replaced by a spatial probe at the target location. The task was then to select the target from four alternatives. A steep recency benefit was found over the 1-2 intervening object range that declined into an above-chance prerecency asymptote over the remainder of the forgetting function. In Experiment 2, we used sequential presentation and variable delays to explore the contributions of decay and extrafoveal processes to these behaviors. We conclude that memory for objects in scenes, when serialized by fixation sequence, shows recency and prerecency effects that are similar to isolated objects presented sequentially over time. We discuss these patterns in the context of the serial order memory literature and object file theory.     

Improving visual short-term memory by sequencing the stimulus array

When multiple objects are presented briefly and simultaneously in a visual array, visual short-term memory (VSTM) can maintain only a limited number of these items. The present research report reveals that splitting the to-be-remembered items into two sequential arrays significantly increases VSTM performance relative to the simultaneous presentation of the same items. A memory benefit also emerges when the full object array is flashed twice (repeated) rather than being presented continuously for the same duration. Moreover, the sequential and repetition benefits are specifically pronounced for individuals with low performance for simultaneously presented items. Our results suggest that the conventional, simultaneous presentation mode may underestimate VSTM performance due to attentional limitations and/or competition between stimulus representations. In contrast, temporal segregation of the stimulus input may help participants maximize their performance and utilize their full VSTM capacity.     

The privileged role of location in visual working memory

Reports have conflicted about the possible special role of location in visual working memory (WM). One important question is: Do we maintain the locations of objects in WM even when they are irrelevant to the task at hand? Here we used a continuous response scale to study the types of reporting errors that participants make when objects are presented at the same or at different locations in space. When several objects successively shared the same location, participants exhibited a higher tendency to report features of the wrong object in memory; that is, they responded with features that belonged to objects retained in memory but not probed at retrieval. On the other hand, a similar effect was not observed when objects shared a nonspatial feature, such as color. Furthermore, the effect of location on reporting errors was present even when its manipulation was orthogonal to the task at hand. These findings are consistent with the view that binding together different nonspatial features of an object in memory might be mediated through an object’s location. Hence, spatial location may have a privileged role in WM. The relevance of these findings to conceptual models, as well as to neural accounts of visual WM, is discussed.