Memory for object location and route direction in virtual large-scale space

In everyday life people have to deal with tasks such as finding a novel path to a certain goal location, finding one's way back, finding a short cut, or making a detour. In all of these tasks people acquire route knowledge. For finding the same way back they have to remember locations of objects like buildings and additionally direction changes. In three experiments using recognition tasks as well as conscious and unconscious spatial priming paradigms memory processes underlying wayfinding behaviour were investigated. Participants learned a route through a virtual environment with objects either placed at intersections (i.e., decision points) where another route could be chosen or placed along the route (non-decision points). Analyses indicate first that objects placed at decision points are recognized faster than other objects. Second, they indicate that the direction in which a route is travelled is represented only at locations that are relevant for wayfinding (e.g., decision points). The results point out the efficient way in which memory for object location and memory for route direction interact.     

Effect of Landmark Type on Route Memory in Unfamiliar Homogenous Environment

Landmarks are objects that have salience that is either visual, semantic or structural. Recent researches have pointed out observer characteristics that make a landmark salient. These have been termed cognitive salience. This study investigated the effects of two components of cognitive salience, familiarity and degree of recognition, on route memory. The first experiment examined the effect of familiarity of landmark and ease with which it could be recognized (degree of recognition) on remembering a route, while in the second experiment only degree of recognition was varied while holding familiarity constant. Two types of landmarks (text and image) were shown to participants who had to recollect course taken at decision points during wayfinding tasks. Participants were shown navigation videos generated using Squareland Model. The videos had six decision points each having one landmark, and the participants were required to indicate the direction of the turn when the landmarks were shown again. Results showed that pictorial landmarks (high degree of recognition) were better facilitators of route memory than textual landmarks (low degree of recognition). Results also indicated that familiar buildings served as better landmarks than unfamiliar buildings. In the second experiment another level of degree of recognition (medium) was added and compared with high and low levels. Results confirmed the findings of the first experiment with high degree of recognition being the best facilitator followed by medium and low degree of recognition. Our findings lend empirical support to the concept of cognitive salience proposed by Caduff and Timpf (Cogn Process 9:249–267, 2008) and highlight the importance of observer characteristics in determining what constitutes as good landmark.     

Event memory and moving in a well-known environment

Research in narrative comprehension has repeatedly shown that when people read about characters moving in well-known environments, the accessibility of object information follows a spatial gradient. That is, the accessibility of objects is best when they are in the same room as the protagonist, and it becomes worse the farther away they are see, e.g., Morrow, Greenspan, & Bower, (Journal of Memory and Language, 26, 165–187, 1987). In the present study, we assessed this finding using an interactive environment in which we had people memorize a map and navigate a virtual simulation of the area. During navigation, people were probed with pairs of object names and indicated whether both objects were in the same room. In contrast to the narrative studies described above, several experiments showed no evidence of a clear spatial gradient. Instead, memory for objects in currently occupied locations (e.g., the location room) was more accessible, especially after a small delay, but no clear decline was evident in the accessibility of information in memory with increased distance. Also, memory for objects along the pathway of movement (i.e., rooms that a person only passed through) showed a transitory suppression effect that was present immediately after movement, but attenuated over time. These results were interpreted in light of the event horizon model of event cognition.     

Gaze behaviour during space perception and spatial decision making

A series of four experiments investigating gaze behavior and decision making in the context of wayfinding is reported. Participants were presented with screenshots of choice points taken in large virtual environments. Each screenshot depicted alternative path options. In Experiment 1, participants had to decide between them to find an object hidden in the environment. In Experiment 2, participants were first informed about which path option to take as if following a guided route. Subsequently, they were presented with the same images in random order and had to indicate which path option they chose during initial exposure. In Experiment 1, we demonstrate (1) that participants have a tendency to choose the path option that featured the longer line of sight, and (2) a robust gaze bias towards the eventually chosen path option. In Experiment 2, systematic differences in gaze behavior towards the alternative path options between encoding and decoding were observed. Based on data from Experiments 1 and 2 and two control experiments ensuring that fixation patterns were specific to the spatial tasks, we develop a tentative model of gaze behavior during wayfinding decision making suggesting that particular attention was paid to image areas depicting changes in the local geometry of the environments such as corners, openings, and occlusions. Together, the results suggest that gaze during a wayfinding tasks is directed toward, and can be predicted by, a subset of environmental features and that gaze bias effects are a general phenomenon of visual decision making.     

Wayfinding: The effects of large displays and 3-D perception

Large displays and stereopsis have been shown to improve performance in several virtual navigation tasks. In the present research, we sought to determine whether wayfinding could benefit from these factors. Participants were tested in a virtual town. There were three viewing conditions: a desktop, a large screen, and a large screen on which the virtual environment was viewed in three dimensions (3-D) using polarized glasses. Participants explored the town and had to remember the location of several landmarks. Their memory of the layout of the town was tested by asking them to navigate from one landmark to another, taking the shortest route possible. All groups performed equally well in terms of the distance traveled to target locations. From this result, we concluded that large displays and 3-D perception do not significantly contribute to wayfinding. Thus, experimental paradigms and training programs that utilize wayfinding are as valuable when administered on standard desktops as on more sophisticated and costly equipment and do not induce simulator sickness as large displays tend to do.     

Individual differences in causal learning and decision making

In judgment and decision making tasks, people tend to neglect the overall frequency of base-rates when they estimate the probability of an event; this is known as the base-rate fallacy. In causal learning, despite people's accuracy at judging causal strength according to one or other normative model (i.e., Power PC, DeltaP), they tend to misperceive base-rate information (e.g., the cause density effect). The present study investigates the relationship between causal learning and decision making by asking whether people weight base-rate information in the same way when estimating causal strength and when making judgments or inferences about the likelihood of an event. The results suggest that people differ according to the weight they place on base-rate information, but the way individuals do this is consistent across causal and decision making tasks. We interpret the results as reflecting a tendency to differentially weight base-rate information which generalizes to a variety of tasks. Additionally, this study provides evidence that causal learning and decision making share some component processes.     

Hippocampus is required for paired associate memory with neither delay nor trial uniqueness

Cued retrieval of memory is typically examined with delay when testing hippocampal functions, as in delayed matching-to-sample tasks. Equally emphasized in the literature, on the other hand, is the hippocampal involvement in making arbitrary associations. Paired associate memory tasks are widely used for examining this function. However, the two variables (i.e., delay and paired association) were often mixed in paired associate tasks, and this makes it difficult to localize the cognitive source of deficits with hippocampal perturbation. Specifically, a few studies have recently shown that rats can learn arbitrary paired associations between certain locations and nonspatial items (e.g., object or flavor) and later can retrieve the paired location when cued by the item remotely. Such tasks involve both (1) delay between sampling the cue and retrieving the target location and (2) arbitrary association between the cueing object and its paired location. Here, we tested whether delay was necessary in a cued paired associate task by using a task in which no delay existed between object cueing and the choice of its paired associate. Moreover, fixed associative relationships between the cueing objects and their paired locations were repeatedly used, thus involving no trial-unique association. Nevertheless, inactivations of the dorsal hippocampus with muscimol severely disrupted retrieval of paired associates, whereas the same manipulations did not affect discriminating individual objects or locations. The results powerfully demonstrate that the hippocampus is inherently required for retrieving paired associations between objects and places, and that delay and trial uniqueness of the paired associates are not necessarily required.     

Developmental profiles for multiple object tracking and spatial memory: typically developing preschoolers and people with Williams syndrome

The ability to track moving objects, a crucial skill for mature performance on everyday spatial tasks, has been hypothesized to require a specialized mechanism that may be available in infancy (i.e. indexes). Consistent with the idea of specialization, our previous work showed that object tracking was more impaired than a matched spatial memory task in individuals with Williams syndrome (WS), a genetic disorder characterized by severe visuo‐spatial impairment. We now ask whether this unusual pattern of performance is a reflection of general immaturity or of true abnormality, possibly reflecting the atypical brain development in WS. To examine these two possibilities, we tested typically developing 3‐ and 4‐year‐olds and people with WS on multiple object tracking (MOT) and memory for static spatial location. The maximum number of objects that could be correctly tracked or remembered (estimated from the k‐statistic) showed similar developmental profiles in typically developing 3‐ and 4‐year‐old children, but the WS profile differed from either age group. People with WS could track more objects than 3‐year‐olds, and the same number as 4‐year‐olds, but they could remember the locations of more static objects than both 3‐ and 4‐year‐olds. Combining these data with those from our previous studies, we found that typically developing children show increases in the number of objects they can track or remember between the ages of 3 and 6, and these increases grow in parallel across the two tasks. In contrast, object tracking in older children and adults with WS remains at the level of 4‐year‐olds, whereas the ability to remember multiple locations of static objects develops further. As a whole, the evidence suggests that MOT and memory for static location develop in tandem typically, but not in WS. Atypical development of the parietal lobe in people with WS could play a causal role in the abnormal, uneven pattern of performance in WS. This interpretation is consistent with the idea that multiple object tracking engages different mechanisms from those involved in memory for static object location, and that the former can be particularly disrupted by atypical development.     

Fire drill: Inattentional blindness and amnesia for the location of fire extinguishers

Fire extinguishers can save lives and are placed in locations that make them easily accessible and in plain view in case of an emergency. However, despite having viewed these bright red objects many times, people may be unaware of their precise locations or even of the fact that they have seen them so often in their workplace environment. We tested the ability of occupants of an office building to recall the location of the nearest fire extinguisher, as well as other objects (e.g., clock, drinking fountain). Despite years of exposure to it, a majority failed to remember the location of the nearest fire extinguisher, although they were able to locate it relatively quickly when asked to search for it. The results support an important distinction between seeing and noticing objects and reveal a novel form of inattentional amnesia for salient objects. The study also created an important learning event via failed retrieval, which could be essential to survival.     

Finding and losing your way in the world: neurocognitive studies on spatial memory

Spatial memory is vitally important for many daily life activities. Without it we would be continuously engaged in a laborious search for our keys or wallet, or we could not find our way back home gain. Given this clear ecological relevance, it has been argued that spatial memory would work to a large extent automatically, without conscious control and awareness. In this talk, examples will be given of studies from the Utrecht Psychological Laboratory on implicit and explicit aspects of wayfinding and object location memory in humans. Moreover, possible underlying neuranatomical correlates will be discussed, as revealed by neuropsychological studies. Finally, spatial memory research will be taken outside the laboratory by means of a study on how people lose things in real-life situations.     

Navigation assistance: a trade-off between wayfinding support and configural learning support

Current GPS-based mobile navigation assistance systems support wayfinding, but they do not support learning about the spatial configuration of an environment. The present study examined effects of visual presentation modes for navigation assistance on wayfinding accuracy, route learning, and configural learning. Participants (high-school students) visited a university campus for the first time and took a predefined assisted tour. In Experiment 1 (n = 84, 42 females), a presentation mode showing wayfinding information from eye-level was contrasted with presentation modes showing wayfinding information included in views that provided comprehensive configural information. In Experiment 2 (n = 48, 24 females), wayfinding information was included in map fragments. A presentation mode which always showed north on top of the device was compared with a mode which rotated according to the orientation of the user. Wayfinding accuracy (deviations from the route), route learning, and configural learning (direction estimates, sketch maps) were assessed. Results indicated a trade-off between wayfinding and configural learning: Presentation modes providing comprehensive configural information supported the acquisition of configural knowledge at the cost of accurate wayfinding. The route presentation mode supported wayfinding at the cost of configural knowledge acquisition. Both presentation modes based on map fragments supported wayfinding. Individual differences in visual-spatial working memory capacity explained a considerable portion of the variance in wayfinding accuracy, route learning, and configural learning. It is concluded that learning about an unknown environment during assisted navigation is based on the integration of spatial information from multiple sources and can be supported by appropriate visualization.     

Reconciling change blindness with long-term memory for objects

How can we reconcile remarkably precise long-term memory for thousands of images with failures to detect changes to similar images? We explored whether people can use detailed, long-term memory to improve change detection performance. Subjects studied a set of images of objects and then performed recognition and change detection tasks with those images. Recognition memory performance exceeded change detection performance, even when a single familiar object in the postchange display consistently indicated the change location. In fact, participants were no better when a familiar object predicted the change location than when the displays consisted of unfamiliar objects. When given an explicit strategy to search for a familiar object as a way to improve performance on the change detection task, they performed no better than in a 6-alternative recognition memory task. Subjects only benefited from the presence of familiar objects in the change detection task when they had more time to view the prechange array before it switched. Once the cost to using the change detection information decreased, subjects made use of it in conjunction with memory to boost performance on the familiar-item change detection task. This suggests that even useful information will go unused if it is sufficiently difficult to extract.     

No evidence of binding items to spatial configuration representations in visual working memory

When detecting changes in visual features (e.g., colour or shape), object locations, represented as points within a configuration, might also be automatically represented in working memory. If the configuration of a scene is represented automatically, the locations of individual items might form part of this representation, irrespective of their relevance to the task. Participants took part in a change-detection task in which they studied displays containing different sets of items (shapes, letters, objects), which varied in their task relevance. Specifically, they were asked to remember the features of two sets, and ignore the third set. During the retention interval, an audio cue indicated which of the to-be-remembered sets would become the target set (having a 50% probability of containing a new feature). At test, they were asked to indicate whether a new feature was present amongst the target set. We measured binding of individual items to the configuration by manipulating the locations of the different sets so that their position in the test display either matched or mismatched their original location in the study display. If items are automatically bound to the configuration, location changes should disrupt performance, even if they were explicitly instructed not to remember the features of that particular set of items. There was no effect on performance of changing the locations of any of the sets between study and test displays, indicating that the configural representation did not enter their decision stage, and therefore that individual item representations are not necessarily bound to the configuration.     

Does information about what things are influence children's memory for where things are?

Two experiments examined how information about what objects are influences memory for where objects are located. Seven-, 9-, and 11-year-old children and adults learned the locations of 20 objects marked by dots on the floor of a box. The objects belonged to 4 categories. In one condition, objects belonging to the same category were located in the same quadrant of the box. In another condition, objects and locations were randomly paired. After learning, participants attempted to replace the objects without the aid of the dots. Children and adults placed the objects in the same quadrant closer together when they were related than when they were unrelated, indicating that object information led to systematic biases in location memory.     

Route navigating without place recognition: what is recognised in recognition-triggered responses?

The use of landmark information in a route-navigation task has been investigated in a virtual environment. After learning a route, subjects were released at intermediate points along the route and asked to indicate the next movement direction required to continue the route. At each decision point, three landmarks were present, one of which was viewed centrally and two which appeared in the periphery of the visual field when approaching the decision point. In the test phase, landmarks could be replaced either within or across places. If all landmarks combined into a new place had been associated with the same movement direction during training, subjects performed as in the control condition. This indicates that they did not need to recognise places as configurations of landmarks. If, however, landmarks that had been associated with conflicting movement directions during training were combined, subjects' performance was reduced. We conclude that local views and objects are recognised individually and that the associated directions are combined in a voting scheme. No evidence was found for a recognition of places as panoramic views or configurations of objects.     

Representations of interobject spatial relations in long-term memory

A growing body of evidence has indicated that human spatial memory is organized in terms of a small number of reference directions and that interobject spatial relations are represented in terms of these directions (e.g., McNamara, 2003). The goal of the present experiments was to investigate whether the selection of reference directions also affects the fidelity with which interobject spatial relations are represented in memory. In two experiments, participants memorized a layout of nine objects and then performed judgments of relative direction (e.g., “Imagine you are standing at the clock, facing the book. Point to the phone.”) at a remote location. Imagined heading (e.g., at the clock, facing the book) and allocentric target direction (e.g., the direction from clock to phone in the allocentric frame of reference used to define imagined heading) were manipulated independently. The results of both experiments showed that the same directions that were benefited in imagined headings were also benefited in allocentric target directions. These findings indicate that interobject spatial relations are preferentially represented when they coincide with a reference direction.     

客体及其位置记忆的眼动研究(中文)

In this paper we briefly describe preliminary data from two experiments that we have carried out to investigate the relationship between visual encoding and memory for objects and their locations within scenes. In these experiments, we recorded participants′ eye movements as they viewed a photograph of a cubicle with 12 objects positioned pseudo-randomly on a desk and shelves. After viewing the photograph, participants were taken to the actual cubicle where they undertook two memory tests. Participants were asked to identify the 12 target objects(from the photograph)presented amongst 12 distractors. They were then required to place each of the objects in the location that they occupied in the photograph. These tests assessed participants′ memory for identity of the objects and their locations. In Experiment 1, we assessed the influence of the encoding period and the test delay on object identity and location memory. In Experiment 2 we manipulated scanning behaviour during encoding by "boxing"some of the objects in the photo. We showed that using boxes to change eye movement behaviour during encoding directly affected the nature of memory for the scene. The results of these studies indicate a fundamental relationship between visual encoding and memory for objects and their locations. We explain our findings in terms of the Visual Memory Model(Hollingworth & Henderson, 2002).     

Spatio-temporal working-memory and short-term object-location tasks use different memory mechanisms

Spatial short-term memory for objects' locations was investigated in a spatial relocation task. During maintenance, dynamic visual noise or spatial tapping were administered as visual or spatial secondary tasks, respectively. Because memory for location should tap the visual component of working memory, a visual but not a spatial secondary task should impair location memory. In fact, neither of the tasks impaired memory (Experiment 1), although the expected dissociation between visual and spatial components was clearly confirmed for a spatio-temporal main task (Corsi test) (Experiment 2). We then contrasted location memory for pictures of objects and of nonsense figures under visual interference. Real objects were relocated much better than nonsense figures, and visual noise was again ineffective (Experiment 3). When spatial tapping was combined with the same material (Experiment 3a), again no influence on memory for locations of objects was observed and only a small influence on remembering nonsense figures. We suggest that the Corsi and the relocation VSWM-tasks use different memory mechanisms. The configuration of objects is reconstructed from perceptual records in an episodic buffer, provided by the same structures that enable visual memory after longer intervals. Rehearsal is not necessary for the persistence of these traces. In contrast, in the Corsi task remembering, a temporal sequence across homogeneous locations needs spatio-temporal marking and therefore active rehearsal of the locations by shifting spatial attention. A spatially demanding secondary task during retention interrupts this rehearsal.     

选择性注意与视觉空间工作记忆的交互作用

传统上只是从单方面讨论了选择性注意与视觉空间工作记忆之间的关系,即认为注意选择有限信息以进入工作记忆。近期的一些研究发现,视觉空间工作记忆的内容影响选择性注意的分配,注意选择工作记忆中保持的空间或物体表征,选择性注意对于正确保持空间或物体信息是必需的认知调节。文章最后指出,关于选择性注意与视觉空间工作记忆交互作用的研究为将来进一步揭示基于空间与基于物体的注意选择之间的交互作用关系提供了一个很好的途径。