Locational representation in imagery: a moving spot task

Subjects with eyes closed imagined a spot moving from cell to cell in a matrix in response to spoken instructions: Up, Down, Left, and Right. After 12 such moves from a given starting point, the subject indicated the final position of the spot. Accuracy was studied as a function of matrix order, which varied from 3 X 3 to 8 X 8. (Visual angles of the displayed matrices were also varied, from 4.6 degrees/cell in one experiment to 1 degree/cell in another, but with little or no effect on results.) The greatest decrement in accuracy occurred between 3 X 3 and 4 X 4 cells. Moreover, showing the subjects a systematic way of structuring matrices (i.e., of dividing them into parts that could be visualized more or less individually) improved performance markedly on all but the 3 X 3 matrix. These results, which agree fairly well with the verbal reports of the subjects, indicate that some capacity limitation of the image system is exceeded in going from a 3 X 3 to a 4 X 4 grid. Implications concerning the nature of imagery are discussed.     

Mental imagery and the third dimension

What sort of medium underlies imagery for three-dimensional scenes? In the present investigation, the time subjects took to scan between objects in a mental image was used to infer the sorts of geometric information that images preserve. Subjects studied an open box in which five objects were suspended, and learned to imagine this display with their eyes closed. In the first experiment, subjects scanned by tracking an imaginary point moving in a straight line between the imagined objects. Scanning times increased linearly with increasing distance between objects in three dimensions. Therefore metric 3-D information must be preserved in images, and images cannot simply be 2-D "snapshots." In a second experiment, subjects scanned across the image by "sighting" objects through an imaginary rifle sight. Here scanning times were found to increase linearly with the two-dimensional separations between objects as they appeared from the original viewing angle. Therefore metric 2-D distance information in the original perspective view must be preserved in images, and images cannot simply be 3-D "scale-models" that are assessed from any and all directions at once. In a third experiment, subjects mentally rotated the display 90 degrees and scanned between objects as they appeared in this new perspective view by tracking an imaginary rifle signt, as before. Scanning times increased linearly with the two-dimensional separations between objects as they would appear from the new relative viewing perspective. Therefore images can display metric 2-D distance information in a perspective view never actually experiences, so mental images cannot simply be "snapshot plus scale model" pairs. These results can be explained by a model in which the three-dimensional structure of objects is encoded in long-term memory in 3-D object-centered coordinate systems. When these objects are imagined, this information is then mapped onto a single 2-D "surface display" in which the perspective properties specific to a given viewing angle can be depicted. In a set of perceptual control experiments, subjects scanned a visible display by (a) simply moving their eyes from one object to another, (b) sweeping an imaginary rifle sight over the display, or (c) tracking an imaginary point moving from one object to another. Eye-movement times varied linearly with 2-D interobject distance, as did time to scan with an imaginary rifle sight; time to tract a point varied independently with the 3-D and 2-D interobject distances. These results are compared with the analogous image scanning results to argue that imagery and perception share some representational structures but that mental image scanning is a process distinct from eye movements or eye-movement commands.     

The role of imagery in the representation of linear orderings

Two experiments were carried out to investigate whether visual imagery was used in representing transitive linear ordering relationships. Subjects were presented with passages describing either a linear ordering or a set inclusion relationship, while being subjected to either visual or verbal interference. Performance was tested by asking subjects to judge the truth or falsity of statements concerning both the information presented in the passages and inferences that could be drawn from this information. In neither experiment was there any evidence for the linear ordering material being selectively disrupted by the visual interference task, as would have been predicted by the imagery theory. Thus it is concluded that linear orderings are probably not represented as visual images.     

The emulation theory of representation: motor control, imagery, and perception

The emulation theory of representation is developed and explored as a framework that can revealingly synthesize a wide variety of representational functions of the brain. The framework is based on constructs from control theory (forward models) and signal processing (Kalman filters). The idea is that in addition to simply engaging with the body and environment, the brain constructs neural circuits that act as models of the body and environment. During overt sensorimotor engagement, these models are driven by efference copies in parallel with the body and environment, in order to provide expectations of the sensory feedback, and to enhance and process sensory information. These models can also be run off-line in order to produce imagery, estimate outcomes of different actions, and evaluate and develop motor plans. The framework is initially developed within the context of motor control, where it has been shown that inner models running in parallel with the body can reduce the effects of feedback delay problems. The same mechanisms can account for motor imagery as the off-line driving of the emulator via efference copies. The framework is extended to account for visual imagery as the off-line driving of an emulator of the motor-visual loop. I also show how such systems can provide for amodal spatial imagery. Perception, including visual perception, results from such models being used to form expectations of, and to interpret, sensory input. I close by briefly outlining other cognitive functions that might also be synthesized within this framework, including reasoning, theory of mind phenomena, and language.     

Studying action representation in children via motor imagery

The use of motor imagery is a widely used experimental paradigm for the study of cognitive aspects of action planning and control in adults. Furthermore, there are indications that motor imagery provides a window into the process of action representation. These notions complement internal model theory suggesting that such representations allow predictions (estimates) about the mapping of the self to parameters of the external world; processes that enable successful planning and execution of action. The ability to mentally represent action is important to the development of motor control. This paper presents a critical review of motor imagery research conducted with children (typically developing and special populations) with focus on its merits and possible shortcomings in studying action representation. Included in the review are age-related findings, possible brain structures involved, experimental paradigms, and recommendations for future work. The merits of this review are associated with the apparent increasing attraction for using and studying motor imagery to understand the developmental aspects of action processing in children.     

Temporal change: the third dimension of personality disorder

Until fairly recently, almost everyone who learned about, or carried out research into, personality disorders was taken in by the notion that personality disorder was a stable entity whose main characteristic was persistence, at least between the time of adolescence to middle age. We also suspected that those with these disorders, unless they received specific and necessarily powerful interventions, would remain continuously handicapped. Now it is clear that change in personality is possible, often rapidly so in some groups, and undergoes dynamic development from its genesis in childhood onward, and, though often achieving equilibrium, can never be said to be fixed in its manifestations. Longitudinal studies also show that personality abnormality identified early in life, whether temporary or longer-lasting, has a major influence on mental development and disorder generally, and, while it is impossible to say at present whether this influence is causal, it does suggest that early intervention could confer long-term benefits. An initiative such as that currently developed for early intervention in psychosis is at least as apt for personality disorder.     

The representation of pitch in auditory imagery: Evidence from S-R compatibility and distance effects

In three experiments we explored the nature of representations constructed during the perception and imagination of pitch. We employed a same–different task to eliminate the influence of nonauditory information and to minimise use of cognitive strategies on auditory imagery. A reference tone of frequency 1000, 1500, or 2000 Hz, or an imagined tone of a pitch indicated by a visual cue, was followed by a comparison tone (1000, 1500, or 2000 Hz) to which either a speeded same or different response was required. In separate experiments, same–different judgements were mapped to vertically (Experiments 1 and 2) and horizontally arranged responses (Experiment 3). Judgements of tones closer in pitch yielded longer reaction times and higher error rates than more distant tones, indicating a pitch distance effect for perceptual and imagery tasks alike. In addition, in the imagery task, same–different responses were faster when low-pitched tones demanded a bottom or left key response and high-pitched tones a top or right response than vice versa, suggesting that pitch is coded spatially. Together, these behavioural effects support the assumption that both perceived and imagined pitch are translated into an analogical representation in the spatial domain.     

Feeling the strain: predicting the third dimension of core affect

This commentary (1) raises the question about the possible conflation of core affect with the neural representation of interoceptive changes in regard to whether biological value is subpersonal or must be experienced, and (2) proposes that Wundt's third dimension of core affect - strain-relaxation - can be accounted for in the target model under a generalised predictive model of attention.     

The representation of conceptual knowledge: visual,auditory, and olfactory imagery compared with semantic processing

Two experiments comparing imaginative processing in different modalities and semantic processing were carried out to investigate the issue of whether conceptual knowledge can be represented in different format. Participants were asked to judge the similarity between visual images, auditory images, and olfactory images in the imaginative block, if two items belonged to the same category in the semantic block. Items were verbally cued in both experiments. The degree of similarity between the imaginative and semantic items was changed across experiments. Experiment 1 showed that the semantic processing was faster than the visual and the auditory imaginative processing, whereas no differentiation was possible between the semantic processing and the olfactory imaginative processing. Experiment 2 revealed that only the visual imaginative processing could be differentiated from the semantic processing in terms of accuracy. These results showed that the visual and auditory imaginative processing can be differentiated from the semantic processing, although both visual and auditory images strongly rely on semantic representations. On the contrary, no differentiation is possible within the olfactory domain. Results are discussed in the frame of the imagery debate.     

On the representation of task information in task switching: Evidence from task and dimension switching

Task switching research has revealed that task changes lead to a performance switch cost. The present study focuses on the organization of task components in the task set. Three different views of task set organization have been distinguished and evidence in favor of each of these has been reported in the literature. In four experiments, we orthogonally varied the categorization task (magnitude and parity) and the stimulus dimension on which the categorization was to be made. Experiments 1, 2, and 4 used Stroop-like number stimuli, whereas Experiment 3 used global-local stimuli to define the stimulus dimension. In Experiments 2-4, the cue-stimulus interval was also varied. The findings showed that a change of any component resulted in a cost, without any reliable difference in the size of these costs. These results are consistent with the flat view on task-set organization, which assumes that the task set binds all elements in an unstructured representation, which is completely reconfigured each time a change to the task set is required. The implications of these findings are discussed in relation to other findings and the different views on task-set organization.     

Age-related changes in motor imagery from early childhood to adulthood: Probing the internal representation of speed-accuracy trade-offs

The purpose of this study was to chart the development of motor imagery ability between 5 and 29 years of age and its relationship to fine-motor skill. 237 participants performed a computerized Virtual Radial Fitts Task (VRFT) as a measure of Motor Imagery (MI) ability. Participants aimed at five targets, positioned along radial axes from a central target circle. The targets differed in width over trials (2.5, 5, 10, 20 or 40 mm). Performance was indexed by the relationship between the movement time (MT) in executed and imagined movements. A subset of participants (11–19 years old, n = 22) also performed the task with their non-preferred hand. We also examined if manual skill (measured by peg board task and posting coins) was related to the executed and imagined MT on the VRFT. Our results showed that the accuracy of the imagined movement improved steadily over childhood, reaching an asymptote during adolescence and into early adulthood. The correlation between the real and virtual MT using the preferred hand did not differ appreciably from that using the non-preferred hand. If the children could perform the tasks with their non-preferred hand (11 years and older), they also scaled performance in relatively precise terms using the less dextrous non-preferred hand. The correlation between real MT on the VRFT and fine-motor performance ranged between .53 and .42, while that for virtual movement was between .37 and .34. MI ability predicts manual skill to a moderate degree.     

Motor imagery ability and internal representation of movement in children with probable developmental coordination disorder

It has been hypothesised that deficits in the functioning of the mirror neuron system (MNS) and internal modelling may contribute to the motor impairments associated with DCD. These processes can be explored behaviourally through motor imagery paradigms. Motor imagery proficiency of children with and without probable DCD (pDCD) was examined using a complex hand rotation task to explore whether motor imagery strategies could be used during more complex tasks. Forty-four boys aged 7–13 years participated, 22 with pDCD (mean = 9.90 years ± 1.57) and 22 controls (mean = 9.68 years ± 1.53). Participants completed the task twice: with and without motor imagery instructions. Stimuli were presented in two rotational axes – palm/back, and eight 45° rotational steps. Both groups showed evidence of following the biomechanical and postural constraints of actual movements. Responses of children with pDCD were slower and less accurate than controls, with group differences increasing alongside task complexity. A greater impact of biomechanical constraints for accuracy was observed in the DCD group. The response characteristics of children with pDCD likely reflects a reduced capacity to mentally manipulate a body schema and reduced visuo-motor processing capabilities. Behaviourally, these processes are linked to MNS and internal modelling function, suggesting deficits in these systems may contribute to the movement difficulties characteristic of DCD.