Eye movements disrupt episodic future thinking

Remembering the past and imagining the future both rely on complex mental imagery. We considered the possibility that constructing a future scene might tap a component of mental imagery that is not as critical for remembering past scenes. Whereas visual imagery plays an important role in remembering the past, we predicted that spatial imagery plays a crucial role in imagining the future. For the purpose of teasing apart the different components underpinning scene construction in the two experiences of recalling episodic memories and shaping novel future events, we used a paradigm that might selectively affect one of these components (i.e., the spatial). Participants performed concurrent eye movements while remembering the past and imagining the future. These concurrent eye movements selectively interfere with spatial imagery, while sparing visual imagery. Eye movements prevented participants from imagining complex and detailed future scenes, but had no comparable effect on the recollection of past scenes. Similarities between remembering the past and imagining the future are coupled with some differences. The present findings uncover another fundamental divergence between the two processes.     

Eye movements during visual mental imagery

It has long been debated whether eye movements play a functional role in visual mental imagery. A recent paper by Laeng and Teodorescu presents new evidence that eye movements are stored as a spatial index that is used to arrange the component parts correctly when mental images are generated.     

图形视觉与心理表象眼动模式的比较研究

本研究通过比较图形视觉和心理表象以及不同认知框架下表象加工的眼动参数,揭示图形视觉加工和心理表象加工的特点.结果表明,从视知觉到视觉心理表象,眼动被币新编码,眼动模式更加简洁,视觉心理表象具有一定的概括性;认知框架影响视觉心理表象加工的眼动模式.     

Interference in visual perception by verbal and spatial cognitive activity

In two experiments we tested the hypothesis that cognitive processing based on spatial imagery produces more deterioration of visual perception than cognitive processing based on verbal codes. So, we studied the effect on visual perception of two cognitive tasks, one of spatial imagery and the other a verbal task. In the first one, with 30 participants, we analyzed the mental load and ocular behaviors in both cognitive tasks. In the second experiment, with 29 participants, we studied the effect of both tasks on a visual search task, using a dual-task experimental paradigm. The verbal task presented higher mental load than the imagery task when both tasks were carried out with visual search task, and there was more deterioration in stimulus detection with the verbal task. We can conclude that: (1) cognitive tasks produce important deterioration in the capacities of visual search and identification of stimuli; (2) this deterioration has two components: (a) an inefficient search, associated with alterations of the gaze patterns while performing cognitive tasks, and (b) a general interference, nonspecific to spatial codes, in the process of identification of looked-at stimuli; (3) this cognitive interference is related to the mental load or effort required by the cognitive task.     

任务信息通达对视觉表象眼动的影响

通过两个实验探讨了视觉表象任务信息的通达对表象加工眼动的影响。结果表明, 在低通达条件下, 表象任务的眼动复制了知觉任务的眼动; 随着表象任务信息通达水平的提高, 眼动的注视点平均持续时间、平均眼跳距离和平均眼跳时间会发生规律性变化; 眼动控制与任务信息通达水平对表象眼动的影响存在不同的机制。实验结果佐证了眼动在视觉表象中起机能性作用的观点。     

Do sequence-space synaesthetes have better spatial imagery skills? Maybe not

Sequence-space synaesthesia is a type of visuo-spatial imagery in which numbers or calendar units are experienced to occupy locations in space. Previous studies have claimed that these synaesthetes (1) have stronger self-reported visual (but not spatial) imagery and (2) perform unusually well on mental rotation tasks that are usually taken to reflect spatial (but not visual) imagery. To further investigate whether this form of synaesthesia is related to spatial imagery, we compared synaesthetes to controls on the Object Spatial Imagery Questionnaire, a paper folding test and a mental rotation task. The synaesthetes did not differ from controls in self-reported spatial imagery, but showed a strong trend to report better visual imagery, replicating previously reported data patterns. Consistent with this, their paper folding and mental rotation performance was no better than controls. We also confirmed that, in our pooled sample, performance on both these tasks was positively correlated with self-reported spatial imagery. We suggest our data are more consistent with the view that sequence-space synaesthesia is related to visual than to spatial imagery, and we suggest reasons why previous studies may have found superior mental rotation performance.     

视觉表象眼动的变化：知识还是技能表征的差异？

以表象看到一个运动员完成三级跳远项目为实验任务,对表象任务的信息通达水平、眼动注视点的活动位置和被试对三级跳远项目的知识水平和技能水平进行系统的操纵,通过2个实验探讨了视觉表象眼动的变化是基于知识学习表征差异还是技能训练表征差异的问题。实验1以没有三级跳远运动专业技能知识且对该运动的认知水平也较低的大学生为被试,结果表明,在完成高信息通达水平的表象任务时,注视点需要较短的持续时间,但眼跳距离会增大,眼跳频率会变低;实验2对表象任务的知识学习表征水平和技能训练表征水平进行操纵,分别以对实验任务进行过知识学习和专业技能训练的人为被试,结果表明,随着被试知识习得水平和技能水平表征能力的提高,不同表象任务信息通达水平间的眼动差异将消失,但知识学习和技能表征的差异在平均眼跳时间上有差异,技能训练型的被试其平均眼跳时间要短于知识学习型被试,达到临界水平显著,注视点平均持续时间和平均眼跳距离等均没有差异。     

The roles of imagery,language, and metamemory in cross-modal transfer in children

Summary The relative strengths of association of imagery, language, and metamemory to cross-modal transfer were evaluated in 5-year-olds and 7-year-olds. Children were administered either tactual-visual or visual-tactual cross-modal transfer tasks, as well as two visual imagery tasks (spatial recall and mental rotation), two language competence tasks (vocabulary and word usage), metamemory questions, and a general intelligence task. With intelligence and handedness controlled, only visual imagery related significantly to cross-modal transfer. These findings suggest that mental imagery, as opposed to language competence or metamemory, is a principal component of cross-modal transfer, and they are consistent with the observation that preverbal human infants and infrahuman primates exhibit cross-modal transfer.     

On the Nature of Nonverbal Working Memory Fractionation: A Case of Selective Spatial Short-Term Memory Deficit in a Child

Several lines of research on adult subjects demonstrate a visual/spatial fractionation of nonverbal working memory (WM), while behavioral studies on normal children support the idea of a static/dynamic distinction. In the present paper, we report a child (Z.M.) who failed on nonverbal WM tasks. To verify the nature of his defect, we carried out two experiments: in Experiment 1, Z.M. failed on spatial WM tasks but not on visual WM tasks and was not affected by the static/dynamic format of stimulus presentation; in Experiment 2, this visual/spatial dissociation was extended to the imagery domain. These results are best accounted for within the visual/spatial fractionation of WM and confirmed the role of WM in mental imagery. Clinical and rehabilitative implications of the present findings are also discussed.     

On the nature of nonverbal working memory fractionation: a case of selective spatial short-term memory deficit in a child

Several lines of research on adult subjects demonstrate a visual/spatial fractionation of nonverbal working memory (WM), while behavioral studies on normal children support the idea of a static/dynamic distinction. In the present paper, we report a child (Z.M.) who failed on nonverbal WM tasks. To verify the nature of his defect, we carried out two experiments: in Experiment 1, Z.M. failed on spatial WM tasks but not on visual WM tasks and was not affected by the static/dynamic format of stimulus presentation; in Experiment 2, this visual/spatial dissociation was extended to the imagery domain. These results are best accounted for within the visual/spatial fractionation of WM and confirmed the role of WM in mental imagery. Clinical and rehabilitative implications of the present findings are also discussed.     

Visual mental image generation does not overlap with visual short-term memory: A dual-task interference study

Visual mental imagery and working memory are often assumed to play similar roles in high-order functions, but little is known of their functional relationship. In this study, we investigated whether similar cognitive processes are involved in the generation of visual mental images, in short-term retention of those mental images, and in short-term retention of visual information. Participants encoded and recalled visually or aurally presented sequences of letters under two interference conditions: spatial tapping or irrelevant visual input (IVI). In Experiment 1, spatial tapping selectively interfered with the retention of sequences of letters when participants generated visual mental images from aural presentation of the letter names and when the letters were presented visually. In Experiment 2, encoding of the sequences was disrupted by both interference tasks. However, in Experiment 3, IVI interfered with the generation of the mental images, but not with their retention, whereas spatial tapping was more disruptive during retention than during encoding. Results suggest that the temporary retention of visual mental images and of visual information may be supported by the same visual short-term memory store but that this store is not involved in image generation.     

视觉表象操作加工的眼动实验研究

本研究通过视觉表象旋转和扫描的眼动实验探讨表象的心理表征方式。实验一结果表明,眼动指标具有与反应时相类似的旋转角度效应。实验二结果显示,表象扫描的反应时和眼动指标都具有与知觉扫描加工一样的距离效应。由此可以认为,表象眼动与知觉眼动模式具有相似性;表象具有相对独立的心理表征方式并有其特殊的加工过程;表象的心理表征可以是形象表征,而非一定是抽象的命题或符号表征     

What clocks tell us about the neural correlates of spatial imagery

We review a series of experimental studies aimed at answering some critical questions about the neural basis of spatial imagery. Our group used functional magnetic resonance imaging (fMRI) to explore the neural correlates of an online behaviourally controlled spatial imagery task without need for visual presentation—the mental clock task. Subjects are asked to imagine pairs of times that are presented acoustically and to judge at which of the two times the clock hands form the greater angle. The cortical activation elicited by this task was contrasted with that obtained during other visual, perceptual, verbal, and spatial imagery tasks in several block design studies. Moreover, our group performed an event‐related fMRI study on the clock task to investigate the representation of component cognitive processes in spatial imagery. The bulk of our findings demonstrates that cortical areas in the posterior parietal cortex (PPC), along the intraparietal sulcus, are robustly involved in spatial mental imagery and in other tasks requiring spatial transformations. PPC is bilaterally involved in different kinds of spatial judgement. Yet the degree to which right and left PPC are activated in different tasks is a function of task requirements. From event‐related fMRI data we obtained evidence that left and right PPC are activated asynchronously during the clock task and this could reflect their different functional role in subserving cognitive components of visuospatial imagery.     

Spatial versus object visualizers: A new characterization of visual cognitive style

The visual system processes object properties (such as shape and color) and spatial properties (such as location and spatial relations) in distinct systems, and neuropsychological evidence reveals that mental imagery respects this distinction. The findings reported in this article demonstrate that verbalizers typically perform at an intermediate level on imagery tasks, whereas visualizers can be divided into two groups. Specifically, scores on spatial and object imagery tasks, along with a visualizer-verbalizer cognitive style questionnaire, identified a group of visualizers who scored poorly on spatial imagery tasks but excelled on object imagery tasks. In contrast, a second group of visualizers scored high on spatial imagery tasks but poorly on object imagery tasks. The results also indicate that object visualizers encode and process images holistically, as a single perceptual unit, whereas spatial visualizers generate and process images analytically, part by part. In addition, we found that scientists and engineers excel in spatial imagery and prefer spatial strategies, whereas visual artists excel in object imagery and prefer object-based strategies.     

Colour, face, and visuospatial imagery abilities in low-vision individuals with visual field deficits

This study investigates to what extent visual perception integrity is necessary for visual mental imagery. Sixteen low-vision participants with severe peripheral visual field loss, 16 with severe central field loss, 6 left brain-damaged patients with right homonymous hemianopia, 6 right brain-damaged patients with left homonymous hemianopia, and 16 normally sighted controls performed perceptual and imagery tasks using colours, faces, and spatial relationships. Results showed that (a) the perceptual and mental image>ry disorders vary according to the type of visual field loss, (b) hemianopics had no more difficulties imagining spatial stimuli in their contralesional hemispace than in their ipsilesional one, and (c) the only hemianopic participant to have perceptual and mental imagery impairments suffered from attentional deficits. Results suggest that (a) visual memory is not definitively established, but rather needs perceptual practice to be maintained, and (b) that visual mental imagery may involve some of the attentional-exploratory mechanisms that are employed in visual behaviour.     

A PET meta‐analysis of object and spatial mental imagery

Neuroimaging studies have described the functional neuroanatomy of mental imagery. Taken separately, specific studies vary in the nature of the task used and are limited by statistical power and sensitivity. We took advantage of a multistudy PET database of 54 subjects acquired in our laboratory to reveal the neural bases of spatial versus object mental imagery tasks. Our first goal was to evaluate to what extent the activated foci elicited by both object and spatial studies overlap. A second aim was to compare activations elicited by spatial imagery tasks to those elicited by object imagery tasks. We also explored applying regression analyses to the relationships between the scores on the Mental Rotations Test (MRT) and changes in regional cerebral blood flow (rCBF) during spatial and object imagery tasks. This meta‐analysis yielded the following observations: (1) both spatial and object imagery tasks shared a common neural network composed of occipitotemporal (ventral pathway) and occipitoparietal (dorsal pathway) regions and also by a set of frontal regions (related to memory); (2) the superior parietal cortex was more strongly implicated during spatial imagery; (3) object imagery specifically engaged the anterior part of the ventral pathway, including the fusiform, parahippocampal, and hippocampal gyrus; (4) object imagery activated the early visual cortex, whereas spatial imagery induced a deactivation of the early visual cortex; (5) blood flow values in some of the regions noted above were positively correlated with scores on the MRT: the higher the subjects performed on the MRT, the more pronounced the rCBF was in these regions. These results may reconcile some of the apparent discrepancies among previous studies concerning the activation of early visual cortex in mental imagery. They also contribute to a better knowledge of the neural bases of object and spatial mental imagery.     

Colour,face, and visuospatial imagery abilities in low-vision individuals with visual field deficits

This study investigates to what extent visual perception integrity is necessary for visual mental imagery. Sixteen low-vision participants with severe peripheral visual field loss, 16 with severe central field loss, 6 left brain-damaged patients with right homonymous hemianopia, 6 right brain-damaged patients with left homonymous hemianopia, and 16 normally sighted controls performed perceptual and imagery tasks using colours, faces, and spatial relationships. Results showed that (a) the perceptual and mental image>ry disorders vary according to the type of visual field loss, (b) hemianopics had no more difficulties imagining spatial stimuli in their contralesional hemispace than in their ipsilesional one, and (c) the only hemianopic participant to have perceptual and mental imagery impairments suffered from attentional deficits. Results suggest that (a) visual memory is not definitively established, but rather needs perceptual practice to be maintained, and (b) that visual mental imagery may involve some of the attentional–exploratory mechanisms that are employed in visual behaviour.     

Looking for answers: eye movements in non-visual cognitive tasks

It is not known why people move their eyes when engaged in non-visual cognition. The current study tested the hypothesis that differences in saccadic eye movement rate (EMR) during non-visual cognitive tasks reflect different requirements for searching long-term memory. Participants performed non-visual tasks requiring relatively low or high long-term memory retrieval while eye movements were recorded. In three experiments, EMR was substantially lower for low-retrieval than for high-retrieval tasks, including in an eyes closed condition in Experiment 3. Neither visual imagery nor between-task difficulty was related to EMR, although there was some evidence for a minor effect of within-task difficulty. Comparison of task-related EMRs to EMR during a no-task waiting period suggests that eye movements may be suppressed or activated depending on task requirements. We discuss a number of possible interpretations of saccadic eye movements during non-visual cognition and propose an evolutionary model that links these eye movements to memory search through an elaboration of circuitry involved in visual perception.