Transfer of spatial context from visual to haptic search

Under incidental learning conditions, spatial layouts can be acquired implicitly and facilitate visual search (contextual-cueing effect). We examined whether the contextual-cueing effect is specific to the visual modality or transfers to the haptic modality. The participants performed 320 (experiment 1) or 192 (experiment 2) visual search trials based on a typical contextual-cueing paradigm, followed by haptic search trials in which half of the trials had layouts used in the previous visual search trials. The visual contextual-cueing effect was obtained in the learning phase. More importantly, the effect was transferred from visual to haptic searches; there was greater facilitation of haptic search trials when the spatial layout was the same as in the previous visual search trials, compared with trials in which the spatial layout differed from those in the visual search. This suggests the commonality of spatial memory to allocate focused attention in both visual and haptic modalities.     

Differences in spatial knowledge acquired from maps and navigation

Models of the spatial knowledge people acquire from maps and navigation and the procedures required for spatial judgments using this knowledge are proposed. From a map, people acquire survey knowledge encoding global spatial relations. This knowledge resides in memory in images that can be scanned and measured like a physical map. From navigation, people acquire procedural knowledge of the routes connecting diverse locations. People combine mental simulation of travel through the environment and informal algebra to compute spatial judgments. An experiment in which subjects learned an environment from navigation or from a map evaluates predictions of these models. With moderate exposure, map learning is superior for judgments of relative location and straight-line distances among objects. Learning from navigation is superior for orienting oneself with respect to unseen objects and estimating route distances. With extensive exposure, the performance superiority of maps over navigation vanishes. These and other results are consonant with the proposed mechanisms.     

The role of visual experience on the representation and updating of novel haptic scenes

We investigated the role of visual experience on the spatial representation and updating of haptic scenes by comparing recognition performance across sighted, congenitally and late blind participants. We first established that spatial updating occurs in sighted individuals to haptic scenes of novel objects. All participants were required to recognise a previously learned haptic scene of novel objects presented across the same or different orientation as learning whilst they either remained in the same position to moved to a new position relative to the scene. Scene rotation incurred a cost in recognition performance in all groups. However, overall haptic scene recognition performance was worse in the congenitally blind group. Moreover, unlike the late blind or sighted groups, the congenitally blind group were unable to compensate for the cost in scene rotation with observer motion. Our results suggest that vision plays an important role in representing and updating spatial information encoded through touch and have important implications for the role of vision in the development of neuronal areas involved in spatial cognition.     

Orientation dependence of spatial memory acquired from auditory experience

The present study investigated whether memory for a room-sized spatial layout learned through auditory localization of sounds exhibits orientation dependence similar to that observed for spatial memory acquired from stationary viewing of the environment. Participants learned spatial layouts by viewing objects or localizing sounds and then performed judgments of relative direction among remembered locations. The results showed that direction judgments following auditory learning were performed most accurately at a particular orientation in the same way as were those following visual learning, indicating that auditorily encoded spatial memory is orientation dependent. In combination with previous findings that spatial memories derived from haptic and proprioceptive experiences are also orientation dependent, the present finding suggests that orientation dependence is a general functional property of human spatial memory independent of learning modality.     

Visual mental image generation does not overlap with visual short-term memory: A dual-task interference study

Visual mental imagery and working memory are often assumed to play similar roles in high-order functions, but little is known of their functional relationship. In this study, we investigated whether similar cognitive processes are involved in the generation of visual mental images, in short-term retention of those mental images, and in short-term retention of visual information. Participants encoded and recalled visually or aurally presented sequences of letters under two interference conditions: spatial tapping or irrelevant visual input (IVI). In Experiment 1, spatial tapping selectively interfered with the retention of sequences of letters when participants generated visual mental images from aural presentation of the letter names and when the letters were presented visually. In Experiment 2, encoding of the sequences was disrupted by both interference tasks. However, in Experiment 3, IVI interfered with the generation of the mental images, but not with their retention, whereas spatial tapping was more disruptive during retention than during encoding. Results suggest that the temporary retention of visual mental images and of visual information may be supported by the same visual short-term memory store but that this store is not involved in image generation.     

Learning from maps: the role of visuo‐spatial working memory

The involvement of visuo‐spatial working memory (VSWM) in map learning was tested. While learning a map, participants were asked either to perform or abstain from a secondary interference task. Learning of the map was assessed by means of three different tasks (landmark positioning, pointing, route finding), each tapping a different type of spatial knowledge, namely, relative position knowledge, absolute position knowledge and route knowledge. Results showed that VSWM supports learning of absolute landmark positions but not learning of relative landmark positions. Moreover, VSWM appears to be involved in route learning. Copyright © 2007 John Wiley & Sons, Ltd.     

Structural properties of spatial representations in blind people: Scanning images constructed from haptic exploration or from locomotion in a 3-D audio virtual environment

When people scan mental images, their response times increase linearly with increases in the distance to be scanned, which is generally taken as reflecting the fact that their internal representations incorporate the metric properties of the corresponding objects. In view of this finding, we investigated the structural properties of spatial mental images created from nonvisual sources in three groups (blindfolded sighted, late blind, and congenitally blind). In Experiment 1, blindfolded sighted and late blind participants created metrically accurate spatial representations of a small-scale spatial configuration under both verbal and haptic learning conditions. In Experiment 2, late and congenitally blind participants generated accurate spatial mental images after both verbal and locomotor learning of a full-scale navigable space (created by an immersive audio virtual reality system), whereas blindfolded sighted participants were selectively impaired in their ability to generate precise spatial representations from locomotor experience. These results attest that in the context of a permanent lack of sight, encoding spatial information on the basis of the most reliable currently functional system (the sensorimotor system) is crucial for building a metrically accurate representation of a spatial environment. The results also highlight the potential of spatialized audio-rendering technology for exploring the spatial representations of visually impaired participants.     

Visuo-haptic integration in object identification using novel objects

Although some studies have shown that haptic and visual identification seem to rely on similar processes, few studies have directly compared the two. We investigated haptic and visual object identification by asking participants to learn to recognize (Experiments 1, and 3), or to match (Experiment 2) novel objects that varied only in shape. Participants explored objects haptically, visually, or bimodally, and were then asked to identify objects haptically and/or visually. We demonstrated that patterns of identification errors were similar across identification modality, independently of learning and testing condition, suggesting that the haptic and visual representations in memory were similar. We also demonstrated that identification performance depended on both learning and testing conditions: visual identification surpassed haptic identification only when participants explored the objects visually or bimodally. When participants explored the objects haptically, haptic and visual identification were equivalent. Interestingly, when participants were simultaneously presented with two objects (one was presented haptically, and one was presented visually), object similarity only influenced performance when participants were asked to indicate whether the two objects were the same, or when participants had learned about the objects visually—without any haptic input. The results suggest that haptic and visual object representations rely on similar processes, that they may be shared, and that visual processing may not always lead to the best performance.     

Individual differences in procedures for knowledge acquisition from maps

This study investigated the procedures subjects use to acquire knowledge from maps. In Experiment 1, three experienced and five novice map users provided verbal protocols while attempting to learn a map. The protocols suggested four categories of processes that subjects invoked during learning: attention, encoding, evaluation, and control. Good learners differed from poor learners primarily in their techniques for and success at encoding spatial information, their ability to accurately evaluate their learning progress, and their ability to focus attention on unlearned information. An analysis of the performance of experienced map users suggested that learning depended on particular procedures and not on familiarity with the task. In Experiment 2, subjects were instructed to use (a) six of the effective learning procedures from Experiment 1, (b) six procedures unrelated to learning success, or (c) their own techniques. The effective procedures set comprised three techniques for learning spatial information, two techniques for using self-generated feedback to guide subsequent study behaviors, and a procedure for partitioning the map into sections. Subjects using these procedures performed better than subjects in the other groups. In addition, subjects' visual memory ability predicted the magnitude of the performance differential.     

Integration of spatial information across vision and language

Three experiments investigated whether spatial information acquired from vision and language is maintained in distinct spatial representations on the basis of the input modality. Participants studied a visual and a verbal layout of objects at different times from either the same (Experiments 1 and 2) or different learning perspectives (Experiment 3) and then carried out a series of pointing judgments involving objects from the same or different layouts. Results from Experiments 1 and 2 indicated that participants pointed equally fast on within- and between-layout trials; coupled with verbal reports from participants, this result suggests that they integrated all locations in a single spatial representation during encoding. However, when learning took place from different perspectives in Experiment 3, participants were faster to respond to within- than between-layout trials and indicated that they kept separate representations during learning. Results are compared to those from similar studies that involved layouts learned from perception only.     

Cross-sensory transfer of reference frames in spatial memory

Two experiments investigated whether visual cues influence spatial reference frame selection for locations learned through touch. Participants experienced visual cues emphasizing specific environmental axes and later learned objects through touch. Visual cues were manipulated and haptic learning conditions were held constant. Imagined perspective taking when recalling touched objects was best from perspectives aligned with visually-defined axes, providing evidence for cross-sensory reference frame transfer. These findings advance spatial memory theory by demonstrating that multimodal spatial information can be integrated within a common spatial representation.     

躯体运动促进空间更新的环境依赖效应

Kelly, Avraamides和Loomis (2007)发现被试在新环境中空间更新失败, 而肖承丽和刘传军(2014)发现被试在新环境中可使用想象平移等策略来实现空间更新。为了探索该两项研究的异同, 本研究采用与Kelly等相同的实验范式进行研究。实验1被试在原学习环境中完成实验任务。实验2被试记忆完物体空间位置后, 转移至新环境, 在只依靠离线表征、离线表征与在线表征相协调和离线表征与在线表征相矛盾三种条件下完成相同的实验任务。结果发现, 被试在原环境中通过躯体运动和记忆两种方式促进空间更新, 具有同等有效性, 而在新环境中躯体运动显著差于记忆对空间更新的促进作用; 躯体运动和记忆对空间更新的促进作用在两种环境中均高度相关。研究表明, 躯体运动促进空间更新具有环境依赖效应, 与记忆对空间更新的促进作用相比, 躯体运动对空间更新的促进作用会随着环境的改变而降低。     

Lack of set size effects in spatial updating: Evidence for offline updating

Four experiments required participants to keep track of the locations of (i.e., update) 1, 2, 3, 4, 6, 8, 10, or 15 target objects after rotating. Across all conditions, updating was unaffected by set size. Although some traditional set size effects (i.e., a linear increase of latency with memory load) were observed under some conditions, these effects were independent of the updating process. Patterns of data and participant strategies were inconsistent with the common view of spatial updating as an online process. Instead, the authors concluded that participants formed enduring, long-term memory representations of the layouts at learning that were used to reconstruct spatial information about the layouts as needed (i.e., offline updating). These results support M. Amorim, S. Glasauer, K. Corpinot, and A. Berthoz's (1997) 2-system model of spatial updating that includes both online and offline updating.     

Body-specific representations of spatial location

The body specificity hypothesis (Casasanto, 2009) posits that the way in which people interact with the world affects their mental representation of information. For instance, right- versus left-handedness affects the mental representation of affective valence, with right-handers categorically associating good with rightward areas and bad with leftward areas, and left-handers doing the opposite. In two experiments we test whether this hypothesis can: extend to spatial memory, be measured in a continuous manner, be predicted by extent of handedness, and how the application of such a heuristic might vary as a function of informational specificity. Experiment 1 demonstrates systematic and continuous spatial location memory biases as a function of associated affective information; right-handed individuals misremembered positively- and negatively-valenced locations as further right and left, respectively, relative to their original locations. Left-handed individuals did the opposite, and in general those with stronger right- or left-handedness showed greater spatial memory biases. Experiment 2 tested whether participants would show similar effects when studying a map with high visual specificity (i.e., zoomed in); they did not. Overall we support the hypothesis that handedness affects the coding of affective information, and better specify the scope and nature of body-specific effects on spatial memory.     

触觉二维图像识别中2D-3D空间信息转换的认知机制

可触摸的触觉二维图像是视觉障碍人群获取图像信息的重要方式。目前大多数触觉二维图像都是直接由视觉二维图像转化为的可触摸线条图。在视觉二维图像中, 通常运用透视和视角等视觉原理将三维空间关系转换为二维平面关系。视觉系统经过长期大量知觉学习, 习得了这种二维到三维的映射关系。但是触觉识别二维图像时, 触觉系统如何建立二维平面与三维空间的映射, 目前尚有待进一步的研究。影响触觉识别二维图像中二维-三维空间信息转换的视觉因素主要有透视、视角、遮挡、纹理梯度和镂空, 直接将视觉二维图像转化为的触觉二维图像时, 图像中包含的上述视觉因素通常会干扰触觉识别。结合已有研究, 试图提出“双表象加工模型”来解释触摸二维图像时二维到三维空间信息转换的认知机制。该模型认为触觉识别二维图像依赖于两个表象系统的整合, 即物体表象系统(涉及物体的大小、形状和纹理)与空间表象系统(涉及物体的空间关系、透视和视角)。两种表象系统的信息最终进行整合, 在物体表象和空间表象成功匹配的基础上建立二维图像与三维空间之间的映射, 通达长时记忆中的三维物体表征。双表象加工模型将有助于我们深入认识触知觉的认知机制, 也将为触觉二维图像的设计提供理论依据。     

Active navigation and orientation-free spatial representations

In this study, we examined the orientation dependency of spatial representations following various learning conditions. We assessed the spatial representations of human participants after they had learned a complex spatial layout via map learning, via navigating within a real environment, or via navigating through a virtual simulation of that environment. Performances were compared between conditions involving (1) multiple- versus single-body orientation, (2) active versus passive learning, and (3) high versus low levels of proprioceptive information. Following learning, the participants were required to produce directional judgments to target landmarks. Results showed that the participants developed orientation-specific spatial representations following map learning and passive learning, as indicated by better performance when tested from the initial learning orientation. These results suggest that neither the number of vantage points nor the level of proprioceptive information experienced are determining factors; rather, it is the active aspect of direct navigation that leads to the development of orientation-free representations.     

Euclidean metric representations of haptically explored triangles

This study explored whether people create Euclidean representations of 2-dimensional right triangles from touch and use them to make spatial inferences in accord with Euclidean distance axioms. Blindfolded participants who were instructed to form visual images of triangles felt the vertical and horizontal sides of right triangles, then estimated the lengths (but not the angles) of the 3 triangle sides. In these 3 experiments, length estimates conformed closely to the Euclidean metric when evaluated on application of the Pythagorean theorem. Participants who used a visual imaging strategy were accurate more often than those who used visual imagery less often. In Experiments 2 and 3, a hypotenuse inference was as accurate as a direct haptic judgment of the hypotenuse. These results demonstrated similar accuracy of the hypotenuse judgments when participants made verbal rather than haptic estimates. The findings indicate that participants can form Euclidean representations under certain conditions from felt 2-dimensional right triangles based on visual images.     

客体相似性对不同认知方式个体视觉工作记忆表征的影响

采用整体检测的变化察觉范式,探讨客体的相似性对客体—空间型认知方式个体视觉工作记忆表征的影响。行为结果显示,在不相似客体的视觉工作记忆表征任务中,客体型者在长延时条件的成绩优于空间型者,而在相似客体的视觉工作记忆表征任务中,两者无差异;ERP结果显示,在不相似客体视觉工作记忆表征任务中,与客体型者相比,空间型者在大脑皮层诱发出更大的负SP。以上结果表明,客体型者比空间型者对不相似客体视觉工作记忆加工具有优势,其潜在机制可能在于,客体型者对不相似客体视觉工作记忆表征时的神经活动效能更高。     

The role of visuo-spatial working memory in map learning: new findings from a map drawing paradigm

Recently, increasing attention has been devoted to the study of the role of visuo-spatial working memory (VSWM) in environmental learning and spatial navigation. The present research was aimed at investigating the role of VSWM in map learning using a map drawing paradigm. In the first study, a dual task methodology was used. Results showed that map drawing was selectively impaired by a spatial tapping task that was executed during the map learning phase, hence supporting the hypothesis that VSWM plays an essential role in learning from maps. In the second study, using a correlational methodology, it was shown that performance in simultaneous VSWM tasks, but not in sequential VSWM tasks, predicted map drawing skills. These skills “in turn” correlated with map learning abilities. Finally, in the third study, we replicated the results of the second study, by using a different map. To our knowledge, the present study is the first to find evidence that the simultaneous aspects of VSWM play a fundamental role in learning from maps.