Coordination Processes of Mental Transformations of Patterns: Practice and Transfer Effects

Regulation and monitoring of successful performance in complex tasks requires decisions regarding which processes to engage in and in what order. Coordination of these activities appears to be a separable aspect of the demands imposed on working memory by cascaded serial processes (Carlson & Lundy, 1992). In the experiments presented here, subjects indicated whether symbolically suggested transformation rules (rotation, reflection) correctly described the difference between two patterns of filledin squares within a 3x3 matrix. Two experiments were carried out with different levels of practice and common transfer tasks. Our aim was to provide evidence for an executive coordinating mechanism on the basis of differential practice and transfer effects. The following results were obtained: (1) Coordination complexity (Mayr & Kliegl, 1993) has a nonadditive effect on transformation time at all levels of practice, suggesting that a substantial deal of time is spent on processes other than executing transformations. (2) Performance on the transfer task indicated that the practised coordination skill was generalised under the conditions of the experiment. Level of practice influenced the transfer pattern, showing more specificity in transfer after extended practice. Taken together, the nonadditive effect as well as the transfer effect suggest that coordination cost reflects separable processing demand. The results constrain the type of interaction between the visual working memory system and the central control component of multicomponent working memory models (Baddeley, 1989).     

Visual similarity effects on short-term memory for order: The case of verbally labeled pictorial stimuli

Four experiments examined the effect of visual similarity on immediate memory for order. Experiments 1 and 2 used easily nameable line drawings. Following a sequential presentation in either silent or suppression conditions, participants were presented with the drawings in a new, random order and were required to remember their original serial position. In Experiment 3, participants first learned to associate a verbal label with an abstract matrix pattern. Then they completed an immediate memory task in which they had to name the matrices aloud during presentation. At recall, the task required remembering either the order of the matrices or the order of their names. In Experiment 4, participants learned to associate nonword labels with schematic line drawings of faces; the phonemic similarity of the verbal labels was also manipulated. All four experiments indicate that the representations supporting performance comprise both verbal and visual features. The results are consistent with a multiattribute encoding view.     

Attentional control and competition between episodic representations

The relationship between attentional control and episodic representation was investigated in six experiments that employed a variant of the classic attentional blink paradigm. We introduced a task-irrelevant (unpredictive) color match between the first and second target stimulus in a three-stream rapid serial visual presentation task. When this match was present, the first target reliably elicited a priming benefit to the identification of the second, lateralized target. However, this was only the case when the identities of the targets did not belong to the same category (digits, letters, or symbols). When targets did belong to the same category, interference was observed instead of priming, particularly at Lag 1. Furthermore, when color was the target-defining feature, interference at Lag 1 gave way to priming at longer lags. The interference effect is attributed to partial overlap between competing episodic target representations, which affects the availability of their overlapping features for successive attentional selection in rapid serial visual presentation.     

Twisting space: are rigid and non-rigid mental transformations separate spatial skills?

Cognitive science has primarily studied the mental simulation of spatial transformations with tests that focus on rigid transformations (e.g., mental rotation). However, the events of our world are not limited to rigid body movements. Objects can undergo complex non-rigid discontinuous and continuous changes, such as bending and breaking. We developed a new task to assess mental visualization of non-rigid transformations. The Non-rigid Bending test required participants to visualize a continuous non-rigid transformation applied to an array of objects by asking simple spatial questions about the position of two forms on a bent transparent sheet of plastic. Participants were to judge the relative position of the forms when the sheet was unbent. To study the cognitive skills needed to visualize rigid and non-rigid events, we employed four tests of mental transformations—the Non-rigid Bending test (a test of continuous non-rigid mental transformation), the Paper Folding test and the Mental Brittle Transformation test (two tests of non-rigid mental transformation with local rigid transformations), and the Vandenberg and Kuse (Percept Motor Skills 47:599–604, 1978) Mental Rotation test (a test of rigid mental transformation). Performance on the Mental Brittle Transformation test and the Paper Folding test independently predicted performance on the Non-rigid Bending test and performance on the Mental Rotation test; however, mental rotation performance was not a unique predictor of mental bending performance. Results are consistent with separable skills for rigid and non-rigid mental simulation and illustrate the value of an ecological approach to the analysis of the structure of spatial thinking.     

Core geometry in perspective

Research on animals, infants, children, and adults provides evidence that distinct cognitive systems underlie navigation and object recognition. Here we examine whether and how these systems interact when children interpret 2D edge‐based perspectival line drawings of scenes and objects. Such drawings serve as symbols early in development, and they preserve scene and object geometry from canonical points of view. Young children show limits when using geometry both in non‐symbolic tasks and in symbolic map tasks that present 3D contexts from unusual, unfamiliar points of view. When presented with the familiar viewpoints in perspectival line drawings, however, do children engage more integrated geometric representations? In three experiments, children successfully interpreted line drawings with respect to their depicted scene or object. Nevertheless, children recruited distinct processes when navigating based on the information in these drawings, and these processes depended on the context in which the drawings were presented. These results suggest that children are flexible but limited in using geometric information to form integrated representations of scenes and objects, even when interpreting spatial symbols that are highly familiar and faithful renditions of the visual world.     

Task-order coordination in dual-task performance and the lateral prefrontal cortex: an event-related fMRI study

A crucial demand in dual tasks suffering from a capacity limited processing mechanism is task-order scheduling, i.e. the control of the order in which the two component tasks are processed by this limited processing mechanism. The present study aims to test whether the lateral prefrontal cortex (LPFC) is associated with this demand. For this, 15 participants performed a psychological refractory paradigm (PRP) type dual task in an event-related functional magnetic resonance (fMRI) experiment. In detail, two choice reaction tasks, a visual (response with right hand) and an auditory (response with left hand), were presented with a temporal offset of 200 ms, while the participants were required to respond to the tasks in the order of their presentation. Importantly, the presentation order of the tasks changed randomly. Based on previous evidence, we argue that trials in which the present task order changed as compared to the previous trial (different-order trials) impose higher demands on task coordination than same-order trials do. The analyses showed that cortical areas along the posterior part of the left inferior frontal sulcus as well as the right posterior middle frontal gyrus were more strongly activated in different-order than in same-order trials, thus supporting the conclusion that one function of the LPFC for dual-task performance is the temporal coordination of two tasks. Furthermore, it is discussed that the present findings favour the active scheduling over the passive queuing hypothesis of dual-task processing.     

The composition of imaginal transformations

Three experiments examine the performance of composite imaginal spatial transformations using tasks in which people perform pairs of distinct imaginal transformations either in close succession or simultaneously. The principal aim of the investigation is to determine, for both modes of composition, whether imaginal transformations combine interactively or noninteractively to determine the temporal course of imaging performance. Specifically, does the time to imagine a given composite transformation reflect the independent contributions of its component transformations, or do component transformations have different effects within different composites? Results obtained under a number of distinct task conditions are most consistent with the proposal of noninteractive composition. However, the temporal effects of particular imaginal transformations are neither consistent nor readily predictable across different task conditions. Implications of these results for analogue-spatial models, task demand, and procedural accounts of imaging are discussed.     

Binding serial order to representations in working memory: a spatial/verbal dissociation

Verbal information is coded naturally as ordered representations in working memory (WM). However, this may not be true for spatial information. Accordingly, we used memory span tasks to test the hypothesis that serial order is more readily bound to verbal than to spatial representations. Removing serial-order requirements improved performance more for spatial locations than for digits. Furthermore, serial order was freely reproduced twice as frequently for digits as for locations. When participants reordered spatial sequences, they minimized the mean distance between items. Participants also failed to detect changes in serial order more frequently for spatial than for verbal sequences. These results provide converging evidence for a dissociation in the binding of serial order to spatial versus verbal representations. There may be separable domain-specific control processes responsible for this binding. Alternatively, there may be fundamental differences in how effectively temporal information can be bound to different types of stimulus features in WM.     

Relations as transformations: Implications for analogical reasoning

We present two experiments assessing whether the size of a transformation instantiating a relation between two states of the world (e.g., shrinks) is a performance factor affecting analogical reasoning. The first experiment finds evidence of transformation size as a significant factor in adolescent analogical problem solving while the second experiment finds a similar effect on adult analogical reasoning using a markedly different analogical completion paradigm. The results are interpreted as providing evidence for the more general framework that cognitive representations of relations are best understood as mental transformations.     

Dissociable stages of problem solving (II): first evidence for process-contingent temporal order of activation in dorsolateral prefrontal cortex

In a companion study, eye-movement analyses in the Tower of London task (TOL) revealed independent indicators of functionally separable cognitive processes during problem solving, with processes of building up an internal representation of the problem preceding actual planning processes. These results imply that processes of internalization and planning should also be distinguishable in time and space with respect to concomitant brain activation patterns. To investigate this possibility, here we conducted analyses of fMRI data for left and right dorsolateral prefrontal cortex (dlPFC) during problem solving in the TOL task by accounting for the trial-by-trial variability of onsets and durations of the different cognitive processing stages. Comparisons between stimulus-locked and response-locked modeling approaches affirmed that activation in left dlPFC was elicited particularly during early processes of internalization, comprising the extraction of goal information and the generation of an internal problem representation, whereas activation in right dlPFC was predominantly attributable to later processes of mental transformations on this representation, that is planning proper. Thus, present data corroborate the proposal that often observed bilateral dlPFC activation patterns during complex cognitive tasks such as problem solving may reflect functionally and, to some extent, even temporally separable processes with opposing lateralizations.     

Relations as transformations: implications for analogical reasoning

We present two experiments assessing whether the size of a transformation instantiating a relation between two states of the world (e.g., shrinks) is a performance factor affecting analogical reasoning. The first experiment finds evidence of transformation size as a significant factor in adolescent analogical problem solving while the second experiment finds a similar effect on adult analogical reasoning using a markedly different analogical completion paradigm. The results are interpreted as providing evidence for the more general framework that cognitive representations of relations are best understood as mental transformations.     

Imagery and Motor Processes — When Are They Connected? The Mental Rotation of Body Parts in Development

Motor influences on the mental transformation of body parts have been observed in both children and adults. Previous findings indicated that these influences were more pronounced in children than in adults, suggesting a stronger link between motor processes and imagery in children. The present series of two experiments casts doubt on the general validity of such an interpretation. Kindergartners' (aged 5–6 years), first graders' (aged 7 years), and adults' performance in the mental rotation of pictures of body parts was monitored for influences of internal representations of motor constraints (motor effect). In both experiments, evidence for mental rotation was obtained for each group. Unexpectedly, kindergarten boys made significantly more errors than kindergarten girls. A motor effect was only found in the second experiment, where it was least pronounced in the youngest age group. Our results suggest that mental transformations of body parts do not necessarily involve motor processes and that embodiment may become stronger with development rather than weaker with certain tasks.     

The Role of Gesture in Supporting Mental Representations: The Case of Mental Abacus Arithmetic

People frequently gesture when problem‐solving, particularly on tasks that require spatial transformation. Gesture often facilitates task performance by interacting with internal mental representations, but how this process works is not well understood. We investigated this question by exploring the case of mental abacus (MA), a technique in which users not only imagine moving beads on an abacus to compute sums, but also produce movements in gestures that accompany the calculations. Because the content of MA is transparent and readily manipulated, the task offers a unique window onto how gestures interface with mental representations. We find that the size and number of MA gestures reflect the length and difficulty of math problems. Also, by selectively interfering with aspects of gesture, we find that participants perform significantly worse on MA under motor interference, but that perceptual feedback is not critical for success on the task. We conclude that premotor processes involved in the planning of gestures are critical to mental representation in MA.     

Context in verbal short-term memory

We tested the hypothesis that stimulus-related contextual information that is incidental to task demands-an episodic code-is automatically, obligatorily encoded and stored as a part of short-term memory (STM) representations. Four experiments employed a running span task to investigate the effects of manipulating two types of contextual information: stimulus grouping and color. Three experiments established that grouping context effects are sensitive neither to volitional control nor to task difficulty and that they generalize across testing procedures (yes/no recognition and immediate serial recall). A fourth experiment demonstrated an effect of manipulating the congruity of the color of stimuli between study and test. These demonstrations of the robustness and generality of context effects in STM are consistent with the predictions of the episodic coding model of STM.     

The coordination of compensatory tracking and anticipatory timing tasks

Two experiments investigated the presence of a coordination factor in a task consisting of compensatory tracking and anticipatory timing components. The task (Intercept task) resembles a computer game in which a rocket must be aimed and fired to shoot an incoming missile. The studies were designed to determine if a coordinating ability exists above and beyond the abilities needed to perform the component tasks alone. We also investigated the nature of coordination abilities through correlations with other types of coordination tasks and measures of intelligence. Is coordination a general cognitive ability that contributes to performance in a wide range of coordination tasks, or is coordination ability task specific? Multiple regression analyses indicated the existence of a coordination ability in the Intercept task. This coordination ability, however, was shown to be unrelated to the coordination of visual and linguistic processing and to psychometric measures of intelligence as assessed by the Armed Services Vocational Aptitude Battery (ASVAB). Coordination of visual and linguistic processing correlated with a component of the ASVAB measuring perceptual speed. We conclude that, although the ability to integrate separate components of a complex task draws on a coordination ability, this ability is domain specific and thus varies depending on the nature of the component tasks.     

Contextual effects in a metaphor verification task

The verbal transformation effect, an auditory illusion in which physically invariant repetitive verbal input undergoes perceptual transformation, has traditionally been interpreted as a speech-specific phenomenon. Experiment 1 showed that the effect is not limited to speech, but occurs in non-speech categories such as music and other complex everyday sounds, with transformations being comparable in nature and number to those in speech. Experiment 2 provided evidence for an alternative, broader-based view of the phenomenon, involving spreading activation through a multidimensional associative network of mental representations, by demonstrating that creating or activating pre-existing links between a single complex non-verbal stimulus and other representations by priming led to an increase in transformations.     

Multistable syllables as enacted percepts: a source of an asymmetric bias in the verbal transformation effect

Perceptual changes are experienced during rapid and continuous repetition of a speech form, leading to an auditory illusion known as the verbal transformation effect. Although verbal transformations are considered to reflect mainly the perceptual organization and interpretation of speech, the present study was designed to test whether or not speech production constraints may participate in the emergence of verbal representations. With this goal in mind, we examined whether variations in the articulatory cohesion of repeated nonsense words--specifically, temporal relationships between articulatory events--could lead to perceptual asymmetries in verbal transformations. The first experiment displayed variations in timing relations between two consonantal gestures embedded in various nonsense syllables in a repetitive speech production task. In the second experiment, French participants repeatedly uttered these syllables while searching for verbal transformation. Syllable transformation frequencies followed the temporal clustering between consonantal gestures: The more synchronized the gestures, the more stable and attractive the syllable. In the third experiment, which involved a covert repetition mode, the pattern was maintained without external speech movements. However, when a purely perceptual condition was used in a fourth experiment, the previously observed perceptual asymmetries of verbal transformations disappeared. These experiments demonstrate the existence of an asymmetric bias in the verbal transformation effect linked to articulatory control constraints. The persistence of this effect from an overt to a covert repetition procedure provides evidence that articulatory stability constraints originating from the action system may be involved in auditory imagery. The absence of the asymmetric bias during a purely auditory procedure rules out perceptual mechanisms as a possible explanation of the observed asymmetries.     

Cognitive constraints on ordering operations: the case of geometric analogies

Many tasks (e.g., solving algebraic equations and running errands) require the execution of several component processes in an unconstrained order. The research reported here uses the geometric analogy task as a paradigm case for studying the ordering of component processes in this type of task. In solving geometric analogies by applying mental transformations such as rotate, change size, and add a part, the order of performing the transformations is unconstrained and does not in principle affect solution accuracy. Nevertheless, solvers may bring cognitive constraints with them to the analogy task that influence the ordering of the transformations. First, we demonstrate that solvers have a preferred order for performing mental transformations during analogy solution. We then investigate three classes of explanations for the preferred order, one based on general information processing considerations, another based on task-specific considerations, and a third based on individual differences in analogy ability. In the first and third experiments, college students solved geometric analogies requiring two or three transformations and indicated the order in which they performed the transformations. There was close agreement on nearly the same order for both types of analogies. In the second experiment, subjects were directed to perform pairs of transformations in the preferred or unpreferred order. Both speed and accuracy were greater for the preferred orders, thus validating subjects' reported orders. Ability differences were observed for only the more difficult three-transformation problems: High- and middle-ability subjects agreed on an overall performance order, but the highs were more consistent in their use of this order. Low-ability subjects did not consistently order the transformations for these difficult problems. The general information processing factor examined was working-memory load. A number of task factors have been shown to affect working-memory load during the solution of inductive reasoning problems. Of these, we chose to examine process difficulty. Because analogies are solved in working memory, performing more difficult transformations earlier may reduce working-memory load and facilitate problem solution. However, the observed performance order was not correlated with transformation difficulty. The first task-specific factor considered was that some transformations may be identified earlier, possibly because of perceptual salience, and that the performance order follows the identification order.(ABSTRACT TRUNCATED AT 400 WORDS)     

Reference frames in mental rotation

Four experiments are reported that investigate whether images or reference frames are transformed during a mental rotation task. In all experiments a display of four identical letters (P1) was presented at either +90 degrees or -90 degrees from upright, and subjects had to decide whether the letters were normal or mirror-image reflections. A single letter (P2) was then presented 100 ms later in a variable orientation with the same task instructions. Reaction times to P2 were assessed to determine whether an image of P2 was rotated to upright or whether an internal reference frame was rotated into congruence with P2 from the orientation of P1. The results as a whole suggest that transformations of P2 can be initiated either relative to upright or relative to the orientation of P1. They further indicate that the probability of using each reference orientation can be changed by procedural variations. The findings are most parsimoniously interpreted as suggesting that mental rotation involves the transformation of reference frames rather than the transformation of template-like representations.     

Development of children's mental representations: effects of age, sex, and school experience

In the present study mental representations in drawings by 158 young children, ages 2 1/2 to 6 yr. old were analysed. The aim was to investigate whether the accuracy of mental representations increased with age and how this development progressed. Also tested were whether the inferred mental representations differed for boys and girls and whether preschool experience affected the drawings. As expected, mental representation increased in complexity with age as measured by Goodenough's score, and girls' mental representations (drawings) were significantly more elaborate than boys. Moreover, attending school early seemed to affect mental representations of the 3-yr.-olds but not the 4-yr.-olds. Results are discussed in terms of internal and external factors in mental representation in drawing a man.