Explorations of creative visual synthesis in mental imagery

The mental synthesis of visual patterns has been previously studied by instructing subjects to imagine assembling the component parts in specific ways. We report two experiments that show that subjects can often discover recognizable patterns in imagery when the component parts are randomly chosen and are provided without instructions for how they might be assembled. On each trial, the subjects were given a set of three parts, consisting of geometric forms, lines, or alphanumeric characters, and were instructed to close their eyes and imagine combining the parts to make some type of recognizable pattern. They were successful in doing so on about 40 % of the trials. Many of these mentally synthesized patterns were strikingly creative, and few of them could be predicted, either by the experimenter or by the subjects themselves, simply by knowing what the parts were. On the contrary, most of the subjects reported that they had performed the task by imagining various combinations of the parts until a recognizable pattern “emerged.” These findings show that visual discoveries in imagery can be reliably induced under appropriate laboratory conditions.     

Abilities and strategies of blind and sighted subjects in visuo-spatial imagery

An active visuo-spatial memory task was used in order to determine the characteristics of mental imagery in subjects with and without visual experience. Subjects were instructed to generate a mental representation of verbally presented 2D patterns that were placed in a grid and to indicate how many pattern elements were in corresponding positions in the two halves of the grid according to a specific grid axis (vertical or horizontal). Unexpectedly, results showed a similar performance in early blind, late blind and sighted subjects. However, subjects' debriefing showed that the three groups used different strategies. The sighted and the late blind subjects took advantage of a visuo-spatial strategy. They generated a mental image of the matrix and they simplified this image to maintain only the relevant information in memory. In contrast, the early blind subjects encoded each pattern element by its location in a (X,Y) coordinate system without visual representation. This indicates that both early and late blind subjects are able to perform an active visuo-spatial imagery task as well as sighted subjects although they use different strategies.     

Differentiating visual and kinesthetic imagery in mental practice.

Through two experiments, the study sought to emphasize the usefulness of the visual and kinesthetic imagery in mental practice. In Experiment 1, it was hypothesized that when the task to be learned through mental practice necessitates the reproduction of a form by drawing, the visual image, which provides a wide span of apprehension, is more suitable than the kinesthetic image. On the other hand, the kinesthetic image that supplies inputs from the muscles' positions and movements should be more appropriate for the acquisition of the duration of the drawing. In Experiment 2, it was hypothesized that the task, transformed into a motor task necessitating minute coordination of the two hands, would benefit more from kinesthetic imagery. To have optimal control over what was actually experienced during mental practice, the participants' imagery skills were measured. The participants also benefited from prior imagery training. The results demonstrate that when using mental practice to initially acquire a task, visual imagery is better for tasks that emphasize form while kinesthetic imagery is better for those tasks that emphasize timing or minute coordination of the two hands.     

Sex-related differences and visual-spatial mental imagery as factors affecting symbolic motor skill acquisition

The ability of males and females to use visual-spatial imagery as a facilitator of symbolic motor skill acquisition was investigated. Subjects, ordered by gender into control and mental imagery groups, performed 15 trials on a mirrored drawing task. The results indicated that, although both male and female mental imagery groups performed the task more skillfully than the control groups, the male mental imagery group scores over the early stages of performance were better as compared to the female mental imagery group scores. This difference was eradicated during the latter stages of performance. The findings, in addition to supporting the positive effects of mental imagery, lend support to the hypothesis that sex-related differences in selected visual-spatial tasks may be amendable through training followed by practice.     

视觉表象生成系统及其影响因素

视觉表象是在记忆基础上产生的类似知觉的信息表征, 也是人们在日常生活中不可或缺的心理活动之一。本综述介绍了该领域中比较有影响力的表象计算理论模型, 并进一步归纳了视觉表象生成系统的成分及其对应的神经基础。分析结果强调了初级视觉皮层作为“视觉缓冲器”是生成表象的主要机能结构, 以“视觉缓冲器”为基础的表象生成系统的机能受多重因素影响。本综述有助于对视觉表象生成系统形成全面的认识, 促进视觉表象实质的进一步研究。     

初级视觉皮层在表象表征方式研究中的作用

表象的信息表征方式一直是心理学研究的热点问题,脑成像技术在该问题的研究中发挥了巨大作用。本文以初级视觉皮层(V1)在表象表征方式研究中的作用为主线,系统梳理了基于脑成像技术开展的表象实质争论的核心问题,归纳分析了相关争论问题演绎发展的内在逻辑脉络,在此基础上指出了表象研究中需要进一步解决的关键问题,以期能够促进相关研究问题的进一步开展。     

Mental imagery and synaesthesia: Is synaesthesia from internally-generated stimuli possible?

Previous studies provide empirical support for the reported colour experience in grapheme-colour synaesthesia by measuring the synaesthetic experience from an externally presented grapheme. The current study explored the synaesthetic experience resulting from a visual mental image of a grapheme. Grapheme-colour synaesthetes (N=6) and matched controls (N=10 per synaesthete) completed a visual mental imagery task that involved visualising a letter and making a size-based decision about it. The background colour that the grapheme was visualised against was manipulated so that it was congruent or incongruent with the synaesthetic colour for the grapheme being visualised. Compared to matched controls, an effect of colour condition was found for four of the six synaesthetes, although importantly the direction of the effect varied between synaesthetes. In addition, a significant effect of group was found, as the synaesthetes were all faster than the matched controls at the imagery task, regardless of background colour. We conclude that there is some support for subjective reports of imagery-induced synaesthesia, but there are important individual differences. These findings are discussed in relation to both the visual imagery and synaesthesia literature.     

Some consequences of visualization in pattern identification and detection

The goal of this study was to establish some of the conditions under which mental imagery facilitates or interferes with the identification and detection of visual patterns. In Experiment 1, subjects identified simple bar patterns presented at orientations 90 degrees apart under normal viewing conditions. Their reaction times were shorter when they had imagined seeing the patterns in advance at the same orientation, but were longer when they had imagined seeing the patterns at orientations that were in-between those of the actual presented patterns, relative to baseline conditions in which they were instructed not to imagine the patterns. In Experiment 2, where the subjects had only to detect the target patterns without identifying them, there was no effect of image formation or image-target alignment. In Experiment 3, where the detection task was repeated but where the target exposure duration was reduced, imagery significantly interfered with detection. In contrast to the results of Experiment 1, reaction time and error rate in this case were greatest when the imagined patterns were perfectly aligned with the target patterns. These findings demonstrate that whether imagery facilitates or interferes with performance on a visual task depends on the nature and difficulty of the task and on how closely the imagined and presented patterns correspond.     

任务信息通达对视觉表象眼动的影响

通过两个实验探讨了视觉表象任务信息的通达对表象加工眼动的影响。结果表明, 在低通达条件下, 表象任务的眼动复制了知觉任务的眼动; 随着表象任务信息通达水平的提高, 眼动的注视点平均持续时间、平均眼跳距离和平均眼跳时间会发生规律性变化; 眼动控制与任务信息通达水平对表象眼动的影响存在不同的机制。实验结果佐证了眼动在视觉表象中起机能性作用的观点。     

从表征和认知过程上看表象与知觉、记忆的关系

表象、知觉和记忆是一个整合的认知系统。由于知觉和记忆提供了表象生成的材料,因而三者共享相似的表征,并激活广泛而相似的脑区。然而在认知加工过程上三者存在一定的差异。与知觉相比,表象的编码方式更抽象、更依赖过去经验的参与且处理细节能力更弱;与记忆相比,表象更容易受无关信息的干扰。未来对三者关系的研究应关注不同来源和不同类型的表象与知觉、记忆之间的关系,以及工作记忆在三者关系中所起的作用。     

A computational analysis of mental image generation: evidence from functional dissociations in split-brain patients

Recent efforts to build computer simulation models of mental imagery have suggested that imagery is not a unitary phenomenon. Rather, such efforts have led to a modular analysis of the image-generation process, with separate modules that can activate visual memories, inspect parts of imaged patterns, and arrange separate parts into a composite image. This idea was supported by the finding of functional dissociations between the kinds of imagery tasks that could be performed in the left and right cerebral hemispheres of two patients who had previously undergone surgical transection of their corpus callosa. The left hemisphere in both subjects could inspect imaged patterns and could generate single and multipart images. In contrast, although the right hemisphere could inspect imaged patterns and could generate images of overall shape, it had difficulty in generating multipart images. The results suggest a deficit in the module that arranges parts into a composite. The observed pattern of deficits and abilities implied that this module is not used in language, visual perception, or drawing. Furthermore, the results suggest that the basis for this deficit is not a difficulty in simply remembering visual details or engaging in sequential processing.     

Cross‐modal facilitation of mental rotation: Effects of modality and complexity

Performance in a visual mental rotation (MR) task has been reported to predict the ability to recognize retrograde‐transformed melodies. The current study investigated the effects of melodic structure on the MR of sequentially presented visual patterns. Each trial consisted of a five‐segment sequentially presented visual pattern (standard) followed by a five‐tone melody that was either identical in structure to the standard or its retrograde. A visual target pattern was either the rotated version of the standard or unrelated to it. The task was to indicate whether the target pattern was a rotated version of the standard or not. Periodic patterns were not rotated but melodies facilitated the rotation of non‐periodic patterns. For these, rotation latency was determined by a quantitative index of complexity (number of runs). This study provides the first experimental confirmation for cross‐modal facilitation of MR.     

Interference in visual perception by verbal and spatial cognitive activity

In two experiments we tested the hypothesis that cognitive processing based on spatial imagery produces more deterioration of visual perception than cognitive processing based on verbal codes. So, we studied the effect on visual perception of two cognitive tasks, one of spatial imagery and the other a verbal task. In the first one, with 30 participants, we analyzed the mental load and ocular behaviors in both cognitive tasks. In the second experiment, with 29 participants, we studied the effect of both tasks on a visual search task, using a dual-task experimental paradigm. The verbal task presented higher mental load than the imagery task when both tasks were carried out with visual search task, and there was more deterioration in stimulus detection with the verbal task. We can conclude that: (1) cognitive tasks produce important deterioration in the capacities of visual search and identification of stimuli; (2) this deterioration has two components: (a) an inefficient search, associated with alterations of the gaze patterns while performing cognitive tasks, and (b) a general interference, nonspecific to spatial codes, in the process of identification of looked-at stimuli; (3) this cognitive interference is related to the mental load or effort required by the cognitive task.     

Do sequence-space synaesthetes have better spatial imagery skills? Maybe not

Sequence-space synaesthesia is a type of visuo-spatial imagery in which numbers or calendar units are experienced to occupy locations in space. Previous studies have claimed that these synaesthetes (1) have stronger self-reported visual (but not spatial) imagery and (2) perform unusually well on mental rotation tasks that are usually taken to reflect spatial (but not visual) imagery. To further investigate whether this form of synaesthesia is related to spatial imagery, we compared synaesthetes to controls on the Object Spatial Imagery Questionnaire, a paper folding test and a mental rotation task. The synaesthetes did not differ from controls in self-reported spatial imagery, but showed a strong trend to report better visual imagery, replicating previously reported data patterns. Consistent with this, their paper folding and mental rotation performance was no better than controls. We also confirmed that, in our pooled sample, performance on both these tasks was positively correlated with self-reported spatial imagery. We suggest our data are more consistent with the view that sequence-space synaesthesia is related to visual than to spatial imagery, and we suggest reasons why previous studies may have found superior mental rotation performance.     

Mental and perceptual feedback in the development of creative flow

Sketching is considered by artists and designers to be a vital tool in the creative process. However, research shows that externalisation during the creative process (i.e., sketching) is not necessary to create effectively. This study examines whether sketching may play a more important role in the subjective experience of creativity by facilitating the deeply focused, optimal state of consciousness termed ‘flow’ (being ‘in the zone’). The study additionally explored whether sketching affects flow by easing cognitive load or by providing a clearer sense of self-feedback. Participants carried out the creative mental synthesis task (combining sets of simple shapes into creative drawings), experimentally simulating the visual creative process. Ideas were generated either mentally before committing to a final drawing, or with external perceptual support through sketching, and cognitive load was varied by using either three- or five-shape sets. The sketching condition resulted in greater experience of flow and lower perceived task difficulty. However, cognitive load did not affect flow and there was no interaction between load and sketching conditions. These findings are the first to empirically demonstrate that sketching increases flow experience, and that this is not dependent on an associated reduction in overall working memory load.     

Orientation-specific aftereffects to mentally generated lines

After staring at a pattern of tilted lines, subsequent lines appear to be tilted in the opposite direction (direct tilt aftereffect, TAE). In a previous fMRI study we have demonstrated a direct TAE solely induced by the mental imagination accompanied by adaptation of orientation-selective neurons located in the extrastriate cortex, supporting the assumption of a perception-like coding of mental images. In this study we enlarge and specify the evidence for a perception-like coding of orientation-imagination. First, we replicated the previously detected direct TAE induced by line imagination with altered design-variations to control possible perceptual task confounds. Second, we tried to induce two other orientation-specific aftereffects: indirect TAE and contrast-threshold elevation aftereffect by mental imagery. The results replicate a robust direct TAE by mental imagery and by visual stimulation, with no influence of attentional resource allocation or perceptual task confounds. We could not induce an indirect TAE, but observed a perception bias in the opposite direction of the indirect TAE. The mental imagery of lines induced no orientation-selective contrast-threshold elevation aftereffect. In general, mental imagery seems to influence visual perception, indicating that perceptual resources are used by mental imagery. However, the utilisation of visual resources seems to be somewhat different from utilisation by perception.     

视觉表象可视化——视觉表象研究的新途径

功能磁共振技术在表象研究中得到广泛应用是表象研究追求客观化精确性的必然趋势。本文介绍了功能磁共振多变量模式分析方法及其演变历程,探讨了借助该方法实现“视觉表象可视化”的理论依据与亟待解决的关键问题。分析指出“视觉表象可视化”将为表象研究提供全新的研究视角与方法途径。     

Inter-individual neural differences in movement imagery abilities

ObjectivesBuilding on mounting evidence distinguishing the neurological basis of different movement imagery abilities (visual versus kinesthetic), this study compared brain activity (i.e., blood flow changes) through functional magnetic resonance imaging elicited by movement imagery in participants self-reporting good and poor imagery abilities with the Movement Imagery Questionnaire-3. Participants also completed the Vividness of Movement Imagery Questionnaire-2. Method: Thirty-seven females (good imagery ability = 18; poor imagery ability = 19) were randomly presented with four experimental conditions (i.e., Kinesthetic, Internal Perspective, External Perspective and Rest) counterbalanced for condition, during three separate 11-min functional brain scans. Results: Kinesthetic and visual (internal/external) subscale mean differences of the Vividness of Movement Imagery Questionnaire-2 favored good imagers and high Movement Imagery Questionnaire-3 inter-scale correlations evidenced convergent validity. As in prior published work, kinesthetic, internal, and external visual imagery elicited distinct patterns of brain activation relative to rest. Overall, the patterns of brain activity in the good and poor imager groups were remarkably similar, indicating that they both generally relied on a similar brain network during movement imagery. Conclusions: Contrary to processing efficiency hypotheses (i.e., neural efficiency hypothesis) we report that during kinesthetic imagery and external visual imagery only, good imagers actually activated a greater number of spatially distinct cortical sites than did poor imagers. Furthermore, research is needed to fully characterize the neural signature of movement imagery in good and poor imagers. Such research is critical to the appropriate creation and proper application of neuroscience-inspired movement imagery-based learning interventions in healthy and clinical populations.     

Manipulation of visual mental images in children and adults.

Recently, there has been a debate on whether visual patterns can be transformed and reinterpreted in mental imagery. In the present study, task demands and age of subjects were manipulated to see whether children and adults were able to discover a novel visual pattern after transforming a mental image. Two tasks, called combination and subtraction, were devised. They consist of either compounding or taking away parts of images to discover a new construal. Results indicate that not only adults, but also children aged 6 and 10, are able to transform a mental image so as to yield another image with a different interpretation. Task demands had a greater effect on children than adults, consistent with the suggestion that the ease of manipulating mental images is a function of the efficiency of control processes.