Visual mental image generation does not overlap with visual short-term memory: A dual-task interference study

Visual mental imagery and working memory are often assumed to play similar roles in high-order functions, but little is known of their functional relationship. In this study, we investigated whether similar cognitive processes are involved in the generation of visual mental images, in short-term retention of those mental images, and in short-term retention of visual information. Participants encoded and recalled visually or aurally presented sequences of letters under two interference conditions: spatial tapping or irrelevant visual input (IVI). In Experiment 1, spatial tapping selectively interfered with the retention of sequences of letters when participants generated visual mental images from aural presentation of the letter names and when the letters were presented visually. In Experiment 2, encoding of the sequences was disrupted by both interference tasks. However, in Experiment 3, IVI interfered with the generation of the mental images, but not with their retention, whereas spatial tapping was more disruptive during retention than during encoding. Results suggest that the temporary retention of visual mental images and of visual information may be supported by the same visual short-term memory store but that this store is not involved in image generation.     

Verbal recoding of visual stimuli impairs mentalimagetransformations

Two experiments were carried out to test the hypothesis that verbal recoding of visual stimuli in short-term memory influences long-term memory encoding and impairs subsequent mental image operations. Easy and difficult-to-name stimuli were used. When rotated 90 degrees counterclockwise, each stimulus revealed a new pattern consisting of two capital letters joined together. In both experiments, subjects first learned a short series of stimuli and were then asked to rotate mental images of the stimuli in order to detect the hidden letters. In Experiment 1, articulatory suppression was used to prevent subjects from subvocal rehearsal when learning the stimuli, whereas in Experiment 2, verbal labels were presented with each stimulus during learning to encourage a reliance on the verbal code. As predicted, performance in the imagery task was significantly improved by suppression when the stimuli were easy to name (Experiment 1) but was severely disrupted by labeling when the stimuli were difficult to name (Experiment 2). We concluded that verbal recoding of stimuli in short-term memory during learning disrupts the ability to generate veridical mental images from long-term memory.     

The Representation of Left-Right Orientation: A Dissociation Between Imagery and Perceptual Recognition

Eight experiments were conducted to determine whether visual mental imagery preserves left-right orientation in conditions where recognition memory apparently does not. Such a dissociation would suggest that information in memory preserves left-right orientation, but the process that matches input to such representations does not respect this distinction. In the experiments reported here, participants were asked to use one of two methods to indicate which way Abraham Lincoln faces on a US penny: Either they selected the correct profile from two sketches, or they formed a mental image and then specified the direction. If participants had just viewed pennies and were asked to visualize a particular one, they performed far better than chance; in contrast, if imagery was discouraged, they performed poorly when recognizing the profiles perceptually. However, unless actively discouraged from doing so, most participants reported spontaneously visualizing pennies prior to perceptual recognition if they had recently seen pennies.     

Visual mental imagery and visual perception: Structural equivalence revealed by scanning processes

The research reported in the present article investigates whether information is represented the same way in both visual mental imagery and the early phases of visual perception. In Experiment 1, the same participants scanned over patterns of dots in a mental image (with images based on a just-seen pattern), during perception, and in an iconic image. The time to scan increasing distances increased at comparable rates in the three tasks. However, in Experiment 2, when mental images were created from information stored in long-term memory, participants scanned more slowly in the mental image condition. Nevertheless, the rates of scanning in the perceptual tasks were highly correlated with the rates of scanning in the imagery tasks in both experiments. The results provide evidence that mental images and perceived stimuli are represented similarly and can be processed in the same way.     

Does the body image exist in three dimensions? The study of visual mental representation of a body and a nonbody object

Do the mental images of 3-dimensional objects recreate the depth characteristics of the original objects? This investigation of the characteristics of mental images utilized a novel boundary-detection task that required participants to relate a pair of crosses to the boundary of an image mentally projected onto a computer screen. 48 female participants with body attitudes within expected normal range were asked to image their own body and a familiar object from the front and the side. When the visual mental image was derived purely from long-term memory, accuracy was better than chance for the front (64%) and side (63%) of the body and also for the front (55%) and side (68%) of the familiar nonbody object. This suggests that mental images containing depth and spatial information may be generated from information held in long-term memory. Pictorial exposure to views of the front or side of the objects was used to investigate the representations from which this 3-dimensional shape and size information is derived. The results are discussed in terms of three possible representational formats and argue that a front-view 2 1/2-dimensional representation mediates the transfer of information from long-term memory when depth information about the body is required.     

The role of semantic memory in short-term recall: effect of strategic retrieval ability in an elderly population

The present paper examines the relationship between two classic phenomena: semantic effects in short-term recall (STR) tasks, which are interpreted as indicating the involvement of long-term memory (LTM) in the functioning of short-term memory, on the one hand, and the existence of individual differences amongst elderly people in strategic retrieval ability (i.e., the ability to activate representations in LTM in a controlled way) on the other hand. Forty elderly participants completed a STR task under four different conditions which were thought to differentially involve LTM representations. Several executive functions, among which the strategic retrieval ability, were evaluated. The results showed that the participants who obtained the best performances in terms of strategic retrieval ability, and only in this executive ability, also exhibited better performances in the STR task, in particular when this task was performed under conditions which favored the use of LTM.     

Introspection, consciousness, and human information processing

The paper tries, on rational and empirical grounds, to sketch a theory of introspective awareness, considered as an essential aspect of what is usually talked about in terms of "consciousness". The main thesis is that introspective awareness has an important role of play in human information processing. An attempt is made to clarify the connections between introspective awareness, selective attention, and short-term memory. A lot of human information processing goes on pre-attentively, "automatically", without the involvement of introspective awareness. What is introspectively attended to enters short-term memory, where it remains available for various kinds of mental operations; certain kinds of such operations are themselves introspectively accessible, and may become contents of short-term memory, where they in turn can be operated upon, and hence be modified voluntarily by the subject. Finally, various kinds of limitations to introspective awareness are discussed.     

Emotional stimuli exert parallel effects on attention and memory

Because emotional and neutral stimuli typically differ on non-emotional dimensions, it has been difficult to determine conclusively which factors underlie the ability of emotional stimuli to enhance immediate long-term memory. Here we induced arousal by varying participants' goals, a method that removes many potential confounds between emotional and non-emotional items. Hungry and sated participants encoded food and clothing images under divided attention conditions. Sated participants attended to and recalled food and clothing images equivalently. Hungry participants performed worse on the concurrent tone-discrimination task when they viewed food relative to clothing images, suggesting enhanced attention to food images, and they recalled more food than clothing images. A follow-up regression analysis of the factors predicting memory for individual pictures revealed that food images had parallel effects on attention and memory in hungry participants, so that enhanced attention to food images did not predict their enhanced memory. We suggest that immediate long-term memory for food is enhanced in the hungry state because hunger leads to more distinctive processing of food images rendering them more accessible during retrieval.     

Gender Differences in Integration of Images in Visuospatial Memory

We examined gender differences in mental integration of images in visuospatial short-term memory. College students were asked to imagine the combined abstract shape that would be formed by integrating two separate shapes briefly shown on a computer screen. The shapes were presented in four conditions: (1) simultaneously at the center of the screen, (2) simultaneously side-by-side, (3) sequentially at the center, and (4) sequentially side-by-side. Men were faster than women in all four conditions, but were significantly more accurate than women only when the two separate shapes were presented simultaneously side-by-side or sequentially at the center of the screen. We suggest that gender differences in basic visuospatial processes such as image integration may help to explain well-established gender differences in more complex spatial tasks.     

Incidental image memorability

ABSTRACT

Recent studies using intentional memory tasks showed that images differ consistently in memorability. Here, we used a surprise recognition memory test. We asked how incidental encoding would affect the consistency and ranking of the memorability scores. If memorability is truly an intrinsic property of the image, one should not expect large differences between incidental and intentional conditions. On the other hand, participants might process images differently when not anticipating a memory test, yielding different results. The study list of our incidental memory task was identical to our previous, intentional study. Participants were to watch the images of this list carefully as they appeared on the screen one by one (free viewing); supposedly for a study about eye movements. Afterwards, a surprise recognition memory test was administered. Despite the free viewing instructions during the study phase, the resulting incidental image memorability scores still showed high levels of consistency across participants. In addition, the overlap between the incidental and intentional memorability ranking was large. These results provide further support for the idea of memorability as an intrinsic image property and add to its ecological validity, as people rarely memorise images intentionally.     

Perceptual asymmetries are preserved in memory for highly familiar faces of self and friend

We investigated the effect of familiarity on people's perception of facial likeness by asking participants to choose which of two mirror-symmetric chimeric images (made from the left or right half of a photograph of a face) looked more like an original image. In separate trials the participants made this judgment for their own face and for the face of a close friend; half of them matched to a true image of the original and half matched to a mirror image of the original. In the case of matching to a friend's face presented in the familiar orientation, over 80% of participants chose the left-left composite to be a better likeness to the original, whereas only 62% showed the same left-side bias when matching to a mirror image. The difference is significant, and the result contrasts markedly with a second experiment where participants who were unfamiliar with the faces showed comparable left-side biases when matching to true or mirror reversed images. The result suggests that perceptual asymmetries are retained in our long-term memory for highly familiar faces. While matching to images of self also showed an effect of familiarity, the data in this condition show less evidence of perceptual asymmetry and are discussed in relation to recent research on the representation of one's own face.     

Interactive visual imagery and memory search for words and pictures

In a short-term recognition memory experiment with words, subjects: (1) subvocally rehearsed the words, (2) generated a separate visual image for each word, (3) generated an interactive scene with such images, or (4) composed a covert sentence using the words in the memory set. Contrary to Seamon's (1972) results in a similar study, a serial memory search was found in all conditions, instead of the simultaneous scan which was expected when items were combined in interactive images. In a second study with pictures as stimuli, subjects who generated imaginal interactions between separate pictures, viewed interacting pictures, or viewed separate pictures also showed a serial search, i.e., longer RTs were obtained when more stimuli were held m memory. Since interactive imagery facilitated performance in an unexpected paired-associate task with memory set stimuli, one can argue that subjects actually processed or generated such interactions. It was suggested that memory search might not be simultaneous in tasks where the test stimulus constitutes only part of a memory image.     

The representation of nonstructural information in visual memory: Evidence from image combination

Two experiments investigated the differential representation of the figure and ground of a picture in visual short-term and long-term memory. It is known (Hitch, Brandimonte, & Walker, 1995) that subjects find it more difficult to combine mental images of two separately presented pictures in order to identify a novel form when the two pictures are incongruent in color (i.e., when a black-on-white line drawing has to be combined with a white-on-black drawing). In the present experiments, thefigures were depicted in solid form to allow color congruity to be varied independently for figure and ground. Results showed a clear impairment in image combination when the to-be-combined figures were incongruent in color (black-on-gray and white-on-gray) but not when theirgrounds were incongruently colored (gray-on-black and gray-on-white). In this way, image combination was seen to be supported by a representation of the object depicted in the picture rather than by a literal representation of the picture itself (i.e., a pictorial code). In line with previous findings, the same representation was seen to support image combination based on short-term memory (Experiment 1) and long-term memory (Experiment 2), provided that in the latter case verbal recoding was precluded. When verbal recoding was allowed, image combination based on long-term memory was insensitive to color congruity, implying the involvement of a more abstract structural representation.     

视觉表象产生的大脑半球专门化效应

采用Kosslyn单侧视野速示技术, 以英文字母图片为学习材料, 通过三个实验考察了视觉表象产生的大脑半球专门化效应。实验一提出在两种类型的视觉表象产生任务中, 有两种截然不同的加工起作用, 但却不能直接证实这两种不同加工机制的存在。实验二和实验三则进一步证实了两种表象产生任务具有不同的认知加工机制, 并表现出不同的大脑半球专门化效应。上述研究表明: 大脑两半球均参与产生视觉心理表象, 但分工不同, 并表现出不同的单侧化效应: 大脑左半球通过运用类别空间关系产生表象更有效, 大脑右半球运用数量空间关系产生表象更有效。结果进一步拓展了Kosslyn关于视觉空间关系加工的大脑半球专门化观点。     

Working memory and the vividness of imagery

The working memory framework was used to investigate the factors determining the phenomenological vividness of images. Participants rated the vividness of visual or auditory images under control conditions or while performing tasks that differentially disrupted the visuospatial sketchpad and phonological loop subsystems of working memory. In Experiments 1, 2, and 6, participants imaged recently presented novel visual patterns and sequences of tones; ratings of vividness showed the predicted interaction between stimulus modality and concurrent task. The images in experiments 3, 4, 5, and 6 were based on long-term memory (LTM). They also showed an image modality by task interaction, with a clear effect of LTM variables (meaningfulness, activity, bizarreness, and stimulus familiarity), implicating both working memory and LTM in the experience of vividness.     

Short-term memory differences between children predict imagery effects when sentences are read

Children in Grades 4 through 6 read concrete sentences that they were asked to learn. Half the subjects were instructed to construct images representing the sentence meanings. The remaining participants were provided no strategy instructions (control condition). Individual differences in short-term memory were more highly associated with performance in the imagery than in the control condition. There was a clear positive effect of imagery instructions on learning efficiency among students with relatively greater short-term memory; there was no difference in learning efficiency between the imagery and control conditions among students below the median for short-term memory performance. All relevant analyses supported the conclusion that imaginal coding of sentences that are read is demanding of short-term memory capacity.