Studying action representation in children via motor imagery

The use of motor imagery is a widely used experimental paradigm for the study of cognitive aspects of action planning and control in adults. Furthermore, there are indications that motor imagery provides a window into the process of action representation. These notions complement internal model theory suggesting that such representations allow predictions (estimates) about the mapping of the self to parameters of the external world; processes that enable successful planning and execution of action. The ability to mentally represent action is important to the development of motor control. This paper presents a critical review of motor imagery research conducted with children (typically developing and special populations) with focus on its merits and possible shortcomings in studying action representation. Included in the review are age-related findings, possible brain structures involved, experimental paradigms, and recommendations for future work. The merits of this review are associated with the apparent increasing attraction for using and studying motor imagery to understand the developmental aspects of action processing in children.     

Similar effects of visual perception and imagery on simple reaction time

A longstanding issue is whether perception and mental imagery share similar cognitive and neural mechanisms. To cast further light on this problem, we compared the effects of real and mentally generated visual stimuli on simple reaction time (RT). In five experiments, we tested the effects of difference in luminance, contrast, spatial frequency, motion, and orientation. With the intriguing exception of spatial frequency, in all other tasks perception and imagery showed qualitatively similar effects. An increase in luminance, contrast, and visual motion yielded a decrease in RT for both visually presented and imagined stimuli. In contrast, gratings of low spatial frequency were responded to more quickly than those of higher spatial frequency only for visually presented stimuli. Thus, the present study shows that basic dependent variables exert similar effects on visual RT either when retinally presented or when imagined. Of course, this evidence does not necessarily imply analogous mechanisms for perception and imagery, and a note of caution in such respect is suggested by the large difference in RT between the two operations. However, the present results undoubtedly provide support for some overlap between the structural representation of perception and imagery.     

The emergence of motor imagery in children

A total of 80 children (40 5-year-olds and 40 7-year-olds) took part in an experiment to evaluate their capacity to mentally evoke a motor image of their own displacement. Using a chronometry paradigm, movement duration was compared in a task where children were asked to move in order to take a puppet back to its home (actual) and to think about themselves executing the same action (virtual). Movement durations for actual and virtual displacements were obtained in two conditions, where either no information was provided about the weight of the puppet to be displaced (standard situation) or the puppet was described as being heavy (informed situation). A significant correlation between actual and virtual walking durations was observed for 7-year-olds in the informed condition. This result provides evidence for a motor imagery process emerging in 7-year-olds when children are required to think about themselves in action.     

Effects of action on children’s and adults’ mental imagery

The aim of this study was to investigate whether and which aspects of a concurrent motor activity can facilitate children’s and adults’ performance in a dynamic imagery task. Children (5-, 7-, and 9-year-olds) and adults were asked to tilt empty glasses, filled with varied amounts of imaginary water, so that the imagined water would reach the rim. Results showed that in a manual tilting task where glasses could be tilted actively with visual feedback, even 5-year-olds performed well. However, in a blind tilting task and in a static judgment task, all age groups showed markedly lower performance. This implies that visual movement information facilitates imagery. In a task where the tilting movement was visible but regulated by means of an on-and-off remote control, a clear age trend was found, indicating that active motor control and motor feedback are particularly important in imagery performance of younger children.     

Object imagery and object identification: object imagers are better at identifying spatially-filtered visual objects

Object imagery refers to the ability to construct pictorial images of objects. Individuals with high object imagery (high-OI) produce more vivid mental images than individuals with low object imagery (low-OI), and they encode and process both mental images and visual stimuli in a more global and holistic way. In the present study, we investigated whether and how level of object imagery may affect the way in which individuals identify visual objects. High-OI and low-OI participants were asked to perform a visual identification task with spatially-filtered pictures of real objects. Each picture was presented at nine levels of filtering, starting from the most blurred (level 1: only low spatial frequencies—global configuration) and gradually adding high spatial frequencies up to the complete version (level 9: global configuration plus local and internal details). Our data showed that high-OI participants identified stimuli at a lower level of filtering than participants with low-OI, indicating that they were better able than low-OI participants to identify visual objects at lower spatial frequencies. Implications of the results and future developments are discussed.     

Representationalism and the phenomenology of mental imagery

This paper sketches a phenomenological analysis of visual mental imagery and uses it to criticize representationalism and the internalist-versus-externalist framework for understanding consciousness. Contrary to internalist views of mental imagery imagery experience is not the experience of a phenomenal mental picture inspected by the mind’s eye, but rather the mental simulation of perceptual experience. Furthermore, there are experiential differences in perceiving and imagining that are not differences in the properties represented by these experiences. Therefore, externalist representationalism, which maintains that the properties of experience are the external properties represented by experience, is an inadequate account of conscious experience.     

Eye gaze metrics reflect a shared motor representation for action observation and movement imagery

Action observation (AO) and movement imagery (MI) have been reported to share similar neural networks. This study investigated the congruency between AO and MI using the eye gaze metrics, dwell time and fixation number. A simple reach-grasp-place arm movement was observed and, in a second condition, imagined where the movement was presented from the first person perspective (1PP) and the third person perspective (3PP). Dwell time and number of fixations were calculated for whole scene and regions of interest (ROIs). For whole scene, no significant differences were found in the number of fixations for condition (AO, MI) or perspective. Dwell time, however, was significantly longer in AO than MI. For ROIs, the number of fixations was significantly greater in 1PP than 3PP. The data provide support for congruence between motor simulation states but also indicate some functional differences.     

The influence of motor expertise and motor experience on action and actor recognition

Two experiments examined whether different levels of motor and visual experience influence action perception and whether this effect depends on the type of perceptual task. Within an action recognition task (Experiment 1), professional basketball players and novice college students were asked to identify basketball dribbles from point-light displays. Results showed faster reaction times and greater accuracy in experts, but no advantage when observing either own or teammates’ actions compared with unknown expert players. Within an actor recognition task (Experiment 2), the same expert players were asked to identify the model actors. Results showed poor discrimination between teammates and players from another team, but a more accurate assignment of own actions to the own team. When asked to name the actor, experts recognised themselves slightly better than teammates. Results support the hypothesis that motor experience influences action recognition. They also show that the influence of motor experience on the perception of own actions depends on the type of perceptual task.     

Adolescent development of motor imagery in a visually guided pointing task

The development of action representation during adolescence was investigated using a visually guided pointing motor task (VGPT) to test motor imagery. Forty adolescents (24 males; mean age 13.1 years) and 33 adults (15 males; mean age 27.5 years) were instructed to both execute and imagine hand movements from a starting point to a target of varying size. Reaction time (RT) was measured for both Execution (E) and Imagery (I) conditions. There is typically a close association between time taken to execute and image actions in adults because action execution and action simulation rely on overlapping neural circuitry. Further, representations of actions are governed by the same speed-accuracy trade-off as real actions, as expressed by Fitts’ Law. In the current study, performance on the VGPT in both adolescents and adults conformed to Fitts’ Law in E and I conditions. However, the strength of association between E and I significantly increased with age, reflecting a refinement in action representation between adolescence and adulthood.     

The representation of pitch in auditory imagery: Evidence from S-R compatibility and distance effects

In three experiments we explored the nature of representations constructed during the perception and imagination of pitch. We employed a same–different task to eliminate the influence of nonauditory information and to minimise use of cognitive strategies on auditory imagery. A reference tone of frequency 1000, 1500, or 2000 Hz, or an imagined tone of a pitch indicated by a visual cue, was followed by a comparison tone (1000, 1500, or 2000 Hz) to which either a speeded same or different response was required. In separate experiments, same–different judgements were mapped to vertically (Experiments 1 and 2) and horizontally arranged responses (Experiment 3). Judgements of tones closer in pitch yielded longer reaction times and higher error rates than more distant tones, indicating a pitch distance effect for perceptual and imagery tasks alike. In addition, in the imagery task, same–different responses were faster when low-pitched tones demanded a bottom or left key response and high-pitched tones a top or right response than vice versa, suggesting that pitch is coded spatially. Together, these behavioural effects support the assumption that both perceived and imagined pitch are translated into an analogical representation in the spatial domain.     

Effects of imagery training on cognitive performance and use of physiological measures as an assessment tool of mental effort

The effectiveness of motor imagery training on cognitive performance was examined and the physiological mechanisms involved in the contribution of mental practice to motor learning were considered. The subject's mental effort during motor imagery was assessed by using psychophysiological measures and particularly eye blink activity as an 'indirect' measurement of subjects' attention. An electronic flight simulation program (Multiple Attribute Task Battery--MATB) was used to assess performance. Twenty healthy volunteers participated in the study divided in two groups: the control group and the imagery-training group. The subjects of the imagery group were asked for additional imagery training. The subjects of the actual performing group were asked additionally to passively observe the task in order to have equal time of exposure to the task. Performance scores and physiological parameters such as heart rate, respiratory rate, eye blinking activity and muscular activity were recorded during all sessions. The results revealed significantly higher performance level of the imagery-training group than the control group. Heart rate and respiratory rate significantly increased during imagery sessions compared to rest. A slight electromyographic activity was observed during the imagination of movement. Our findings support the notion that mental practice improves motor performance in a task where spatiotemporal or dynamic control of the action is highly required. The effects of mental practice on motor performance could be explained by the existence of a top-down mechanism based on the activation of a central representation of the movements, since the vegetative activation during motor imagery seems to be centrally controlled.     

The influence of visual mental imagery size on metamemory accuracy in judgment of learning

Many studies have found the font size of to-be-remembered words has a significant influence on judgments of learning (JOLs). However, few studies have investigated whether JOLs are affected by the mental imagery size of to-be-remembered words, even when the font sizes themselves are kept identical in study materials. This study investigated whether the visual mental imagery size influences the participants’ JOLs and what the underlying mechanisms are. In Experiments 1 and 2, participants learned words with identical font sizes, mentally generated large or small imageries and then made JOLs. We found that JOLs under the large imagery condition were significantly higher than those under the small imagery condition, but actual recall performance exhibited no significant difference. In Experiment 3, participants pressed a button immediately after mental imagery generation and showed that it took significantly longer to generate large imageries than to generate small imageries, and the difference in JOLs between two conditions was no longer significant. In Experiment 4, we used a questionnaire to investigate the contribution of beliefs and found that participants believed large imageries were easier to remember. These findings indicate that imagery size has a significant impact on JOLs, in which beliefs may play a leading role.     

Exploring the relation between visual mental imagery and affect in the daily life of previously depressed and never depressed individuals

Previously depressed individuals experience disturbances in affect. Affective disturbances may be related to visual mental imagery, given that imagery-based processing of emotional stimuli causes stronger affective responses than verbal processing in experimental laboratory studies. However, the role of imagery-based processing in everyday life is unknown. This study assessed mental imagery in the daily life of previously and never depressed individuals. Higher levels of visual mental imagery was hypothesised to be associated with more affective reactivity to both negatively and positively valenced mental representations.

This study was the first to explore mental imagery in daily life using experience sampling methodology. Previously depressed (n?=?10) and matched never depressed (n?=?11) individuals participated in this study. Momentary affect and imagery-based processing were assessed using the “Imagine your mood” smartphone application. Participants recorded on average 136 momentary reports over a period of 8 weeks.

The expected association between visual mental imagery and affective reactivity was not found. Unexpectedly, in both previously and never depressed individuals, higher levels of imagery-based processing of mental representations in daily life were significantly associated with better momentary mood and more positive affect, regardless of valence.

The causality of effects remains to be examined in future studies.     

The influence of task paradigm on motor imagery ability in children with Developmental Coordination Disorder

Children with Developmental Coordination Disorder (DCD) have difficulty imagining movements such that they conform to the customary temporal constraints of real performance. We examined whether this ability is influenced by the choice of task used to elicit motor imagery (MI). Performance of typically developing (TD) (n = 30) and children with DCD (n = 30) was compared on two tasks: the Visually Guided Pointing Task (VGPT) and the Computerized Virtual Radial Fitts Task (C-VRFT). Since the VGPT places higher demands on executive functions like working memory but requires less spatial planning, we reasoned that the C-VRFT would provide a purer measure of motor imagery (or simulation). Based on our earlier work, we predicted that imagery deficits in DCD would more likely manifest on the C-VRFT. Results showed high correlations between tasks in terms of executed and imagined movement time suggest that both tasks measure MI ability. However, group differences were more pronounced in the imagined condition of the radial Fitts’ task. Taken together, the more spatially complex C-VRFT appears to be a more sensitive measure of motor imagery, better discriminating between DCD and TD. Implications for theory and practice are discussed.     

Discourse-mediation of the mapping between language and the visual world: Eye movements and mental representation

Two experiments explored the mapping between language and mental representations of visual scenes. In both experiments, participants viewed, for example, a scene depicting a woman, a wine glass and bottle on the floor, an empty table, and various other objects. In Experiment 1, participants concurrently heard either ‘The woman will put the glass on the table’ or ‘The woman is too lazy to put the glass on the table’. Subsequently, with the scene unchanged, participants heard that the woman ‘will pick up the bottle, and pour the wine carefully into the glass.’ Experiment 2 was identical except that the scene was removed before the onset of the spoken language. In both cases, eye movements after ‘pour’ (anticipating the glass) and at ‘glass’ reflected the language-determined position of the glass, as either on the floor, or moved onto the table, even though the concurrent (Experiment 1) or prior (Experiment 2) scene showed the glass in its unmoved position on the floor. Language-mediated eye movements thus reflect the real-time mapping of language onto dynamically updateable event-based representations of concurrently or previously seen objects (and their locations).     

Perceptual and motor contributions to the negative compatibility effect

The current study focused on contributions to the negative compatibility effect (NCE) from object-updating at the perceptual level and self-inhibition (i.e., automatic motor inhibition) at the response (motor) level. We hypothesized that contributions to the NCE from these two levels were moderated by the strength of stimulus and reaction (S–R) link: object-updating should have greater impact on the NCE with weak S–R links, but both object-updating and self-inhibition should impact on the NCE when the S–R links became strong. To test this hypothesis, in two experiments we used a novel type of stimuli and manipulated mask relevance (relevant versus irrelevant mask) and prime/target compatibility. Participants performed two tasks over three successive days. Results showed that under equivalent masking effectiveness between the two conditions of mask, a significant NCE was observed only in the relevant mask condition when the S–R links were weak, but both close to equal NCE sizes were observed in the two mask conditions when the S–R links were acquired through practice. The results indicated that perceptual and motor contributions to the NCE were moderated by the strength of S–R links, if the strength of the links was too weak to trigger the following inhibition, the NCE primarily originated from object-updating at the perceptual level; if the strength of the links was reinforced by practice, which exceeded the inhibitory threshold, the NCE originated from both object-updating and self-inhibition, but the latter was primarily responsible.     

Abilities and strategies of blind and sighted subjects in visuo-spatial imagery

An active visuo-spatial memory task was used in order to determine the characteristics of mental imagery in subjects with and without visual experience. Subjects were instructed to generate a mental representation of verbally presented 2D patterns that were placed in a grid and to indicate how many pattern elements were in corresponding positions in the two halves of the grid according to a specific grid axis (vertical or horizontal). Unexpectedly, results showed a similar performance in early blind, late blind and sighted subjects. However, subjects' debriefing showed that the three groups used different strategies. The sighted and the late blind subjects took advantage of a visuo-spatial strategy. They generated a mental image of the matrix and they simplified this image to maintain only the relevant information in memory. In contrast, the early blind subjects encoded each pattern element by its location in a (X,Y) coordinate system without visual representation. This indicates that both early and late blind subjects are able to perform an active visuo-spatial imagery task as well as sighted subjects although they use different strategies.     

Timing of in situ visual information pick-up that differentiates expert and near-expert anticipation in a complex motor skill

The timing of visual information pick-up for visual anticipation was examined by comparing the capability of multiple skill groups, expert and near-expert karate athletes and novices, to block attacks using an in situ temporal occlusion paradigm. Participants stood facing a karate opponent and then attempted to block attacks (kicks and punches), whilst their vision of attacks was occluded: (a) prior to onset of opponent motion (O1), (b) after preparatory head movement (O2), and (c) after initiation of the attacking motion (O3). A no occlusion control condition provided complete vision of attacks (O4). Results revealed that expert anticipation was not significantly different to that of near-experts at O1, but was significantly different to the other group across O2–O4. Expert anticipation, however, was significantly above chance across all occlusion conditions, but near-experts performed above chance at O3 and O4, whilst novices were better than chance at O4. Unexpectedly, unique evidence was found that expert anticipation could be differentiated from near-expert anticipation in the earliest occlusion condition, where it was found that only experts were capable of using visual information from a static opponent to anticipate and block attacks above chance. The findings further understanding of expert visual anticipation to guide motor skills beyond existing expert–novice comparisons.     

Recognition and mental manipulation of body parts dissociate in locked-in syndrome

Several lines of evidence demonstrate that the motor system is involved in motor simulation of actions, but some uncertainty exists about the consequences of lesions of descending motor pathways on mental imagery tasks. Moreover, recent findings suggest that the motor system could also have a role in recognition of body parts. To address these issues in the present study we assessed patients with a complete damage of descending motor pathways (locked-in syndrome, LIS) on the hand laterality task, requiring subjects to decide whether a hand stimulus in a given spatial orientation represents a left or a right hand. LIS patients were less accurate than healthy controls in judging hand laterality; more importantly, LIS patients’ performance was modulated by spatial orientation of hand stimuli whereas it was not affected by biomechanical constraints. These findings demonstrate a dissociation between spared hand recognition and impaired access to action simulation processes in LIS patients.     

运动技能水平与躯体感觉输入对运动表象的影响

运动表象质量与运动技能水平有关,运动表象质量随着运动技能水平的提高而上升。器械使用可使人脑产生可塑性改变,使用者会将器械纳入身体图式。然而,两者影响运动表象的神经心理机制还不清楚。本研究采用功能性磁共振成像探析篮球运动员与新手在不同持球条件下表象投篮时脑功能活动的差异。结果表明运动员表象质量较好,镜像神经系统激活高于新手;持球条件下运动员表象质量显著高于不持球条件下,镜像神经系统激活程度显著低于不持球条件下。研究说明持器械可以显著提高运动员的表象质量,器械使用带来镜像神经系统的可塑性变化。