Time course of learning sequence representations in action imagery practice

Action imagery practice (AIP) is effective to improve motor performance in a variety of tasks, though it is often less effective than action execution practice (AEP). In sequence learning, AIP and AEP result in the acquisition of effector-independent representations. However, it is unresolved whether effector-dependent representations can be acquired in AIP. In the present study, we investigated the acquisition of effector-independent representations and effector-dependent representations in AEP and AIP in an implicit sequence learning task (a visual serial-reaction-time task, involving a twelve-element sequence). Participants performed six sessions, each starting with tests. A practice sequence, a mirror sequence, and a different sequence were tested with the practice and transfer hand. In the first four sessions, after the tests, two groups performed either AIP (N = 50) or AEP (N = 54). Improvement in the different sequence indicated sequence-unspecific learning in both AEP and AIP. Importantly, reaction times of the practice hand became shorter in the practice sequence than in the other sequences, indicating implicit sequence learning in both, AEP and AIP. This effect was stronger in the practice hand than in the transfer hand, indicating effector-dependent sequence representations in both AEP and AIP. However, effector-dependent sequence representations were stronger in AEP than in AIP. No significant differences between groups were observed in the transfer hand, although effector-independent sequence representations were observed in AEP only. In conclusion, AIP promotes not only sequence-unspecific stimulus-response coupling and anticipations of the subsequent stimuli, but also anticipations of the subsequent responses.     

Perceptual-motor sequence learning of general regularities and specific sequences.

Participants viewed digit strings and typed them on a computer keyboard. When they used the same key configuration across training and test, they typed test strings that adhered to the same sequence rule as training strings faster than test strings that adhered to the opposite rule (general-regularity [GR] learning), and they typed test strings that were processed repeatedly during training faster than test strings that were not (specific-sequence [SS] learning). However, when they used different key configurations at training and at test, GR learning, but not SS learning, was observed. Conversely, when they did not type but spoke the strings aloud during training, SS learning, but not GR learning, was observed. Results suggest that in addition to declarative memory for specific sequences, relatively independent subsystems underlie procedural learning of perceptual-motor sequence components (producing GR effects) and sequence wholes (producing SS effects).     

Effector-independent and effector-dependent learning in the discrete sequence production task

This study examined whether skill in the discrete sequence production task involves, apart from the typical effector-independent component, an effector-dependent component. To that end, 12 participants practiced two 5-key sequences, each for 1,060 trials. One group practiced with three fingers of one hand, the other group with three fingers of two hands. In a subsequent test phase, participants in both groups executed the same sequences and two new sequences with the hand configuration they had used during practice, and with the hand configuration of the other group. The results provide support for an effector-dependent component in that both groups performed the practiced sequences faster with the hand configuration they had used during practice than with the hand configuration that was new to them. In addition, the unpracticed hand configuration performed the practiced sequences faster than the new sequence, which demonstrated the effector-independent component.     

Representations underlying skill in the discrete sequence production task: effect of hand used and hand position

Various studies suggest that movement sequences are initially learned predominantly in effector-independent spatial coordinates and only after extended practice in effector-dependent coordinates. The present study examined this notion for the discrete sequence production (DSP) task by manipulating the hand used and the position of the hand relative to the body. During sequence learning in Experiment 1, in which sequences were executed by reacting to key-specific cues, hand position appeared important for execution with the practiced but not with the unpracticed hand. In Experiment 2 entire sequences were executed by reacting to one cue. This produced similar results as in Experiment 1. These experiments support the notion that robustness of sequencing skill is based on several codes, one being a representation that is both effector and position dependent.     

效应器在动作序列学习中的作用机制探析

动作序列学习是动作技能学习的重要组成部分,其中大部分动作序列学习都有效应器参与。目前有关效应器在动作序列学习中的作用机制存在两种观点：一是依存于效应器的观点,即动作序列技能的获得依附于具体的效应器,不可向其他效应器迁移,其学习的本质是建立反应或肌肉间的联结。二是独立于效应器的观点,即动作序列技能的获得并不依存于具体效应器,某个效应器获得的技能可以向其他效应器迁移,其学习的本质是建立抽象的刺激表征联结。效应器作用机制随练习程度、意识状态及其他条件的不同而有所变化。     

Effector dependent sequence learning in the serial RT task

At least five earlier studies could not find effector-dependent learning in the keying version of the serial reaction time (RT) task. Experiment 1 examined whether effector-dependent learning occurs when participants practice the serial RT task with three fingers of one hand for about 1,300 sequence repetitions instead of the more common 50-100 repetitions. The results confirm that, following extended practice, sequence learning produces an effector-dependent component. Specifically, an unpracticed hand executed a practiced sequence slower than a practiced hand. However, Experiment 2 showed that effector-dependent sequence learning develops only when fingers of one hand are used, suggesting that effector-dependent sequence learning involves adjustment to the mechanical interactions between the fingers of one hand. In addition, when sequences had been practiced with one hand, mirror versions of the practiced sequences in both experiments showed moderate transfer. But when practiced with two hands no transfer to a mirrored version of the sequence was observed. This suggests that only practice with one hand produces a representation that facilitates the execution of mirror sequences. Generally, the same results were found in more or less aware participants, congruent with the idea that the effector-dependent representation and the representation allowing transfer to mirror sequences are implicit.     

Visual context does not promote concurrent sequence learning

Concurrent sequence learning (CSL) of two or more sequences refers to the concurrent maintenance, in memory, of the two or more sequence representations. Research using the serial reaction time task has established that CSL is possible when the different sequences involve different dimensions (e.g., visuospatial locations versus manual keypresses). Recently some studies have suggested that visual context can promote CSL if the different sequences are embedded in different visual contexts. The results of these studies have been difficult to interpret because of various limitations. Addressing the limitations, the current study suggests that visual context does not promote CSL and that CSL may not be possible when the different sequences involve the same elements (i.e., the same target locations, response keys and effectors).     

Chunking in task sequences modulates task inhibition

In a study of the formation of representations of task sequences and its influence on task inhibition, participants first performed tasks in a predictable sequence (e.g., ABACBC) and then performed the tasks in a random sequence. Half of the participants were explicitly instructed about the predictable sequence, whereas the other participants did not receive these instructions. Task-sequence learning was inferred from shorter reaction times (RTs) in predictable relative to random sequences. Persisting inhibition of competing tasks was indicated by increased RTs in n- 2 task repetitions (e.g., ABA) compared with n- 2 nonrepetitions (e.g., CBA). The results show task-sequence learning for both groups. However, task inhibition was reduced in predictable relative to random sequences among instructed-learning participants who formed an explicit representation of the task sequence, whereas sequence learning and task inhibition were independent in the noninstructed group. We hypothesize that the explicit instructions led to chunking of the task sequence, and that n- 2 repetitions served as chunk points (ABA-CBC), so that within-chunk facilitation modulated the inhibition effect.     

Motor skill learning in the middle-aged: limited development of motor chunks and explicit sequence knowledge

The present study examined whether middle-aged participants, like young adults, learn movement patterns by preparing and executing integrated sequence representations (i.e., motor chunks) that eliminate the need for external guidance of individual movements. Twenty-four middle-aged participants (aged 55–62) practiced two fixed key press sequences, one including three and one including six key presses in the discrete sequence production task. Their performance was compared with that of 24 young adults (aged 18–28). In the middle-aged participants motor chunks as well as explicit sequence knowledge appeared to be less developed than in the young adults. This held especially with respect to the unstructured 6-key sequences in which most middle-aged did not develop independence of the key-specific stimuli and learning seems to have been based on associative learning. These results are in line with the notion that sequence learning involves several mechanisms and that aging affects the relative contribution of these mechanisms.     

Learning what from where: Effects of spatial regularity on nonspatial sequence learning and updating

The current study examined the influence of redundant stimulus features on our ability to build and update representations of our environment. We hypothesized that our ability to process redundant spatial features would speed our ability to adapt to changing nonspatial regularities. Using a computerized version of the children's game “rock–paper–scissors”, undergraduates were instructed to win as often as possible against a computer opponent. The computer's plays were repeating sequences of five choices that were presented either with spatial regularity (i.e., “rock” would always appear on the left, “paper” in the middle, and “scissors” on the right) or without spatial regularity (i.e., the items were equally likely to appear in any of the three locations). Once participants learned a sequence, the computer switched to a different sequence without participants being informed that a switch had occurred. Redundant spatial regularity improved a participant's ability both to learn sequences of plays and to update their plays to reflect new computer sequences. Our results suggest that our perceptual system is sensitive to redundant spatial stimulus features and that this information can improve learning and updating.     

Event Timing and age deficits in higher-order sequence learning

Recent studies have reported age deficits in learning sequences that contain subtle sequential regularities (e.g., Curran (1997) Psychological Research, 60(1-2), 24; D. V. Howard et al. (2004) Psychology and Aging, 19(1), 79; Howard, J. H. Jr, & Howard, D. V. (1997). Psychology and Aging, 12(4), 634). This finding is of potential theoretical interest, but the contribution of sequence event timing to this deficit has not been investigated. This study used an alternating serial reaction time task to examine implicit sequence learning in young adults when event timing mimicked that experienced by older adults in previous research. We varied the response-to-stimulus interval directly in Experiment 1 and indirectly by degrading the stimuli to influence response time in Experiment 2. Results indicate that these "aged" young adults learned the higher-order sequence structure implicitly, but they learned less than young controls and more than old adults on some measures of implicit learning in both experiments. In addition, these two different experimental manipulations produced distinct patterns of deficits despite having nearly identical effects on event sequence timing. These findings suggest that event timing alone cannot explain the age deficits observed in high-order implicit sequence learning.     

Common spatial organization of number and emotional expression: a mental magnitude line

Converging behavioral and neural evidence suggests that numerical representations are mentally organized in left-to-right orientation. Here we show that this format of spatial organization extends to emotional expression. In Experiment 1, right-side responses became increasingly faster as number (represented by Arabic numerals) or happiness (depicted in facial stimuli) increased, for judgments completely unrelated to magnitude. Additional experiments suggest that magnitude (i.e., more/less relations), not valence (i.e., positive/negative), underlies left-to-right orientation of emotional expression (Experiment 2), and that this orientation accommodates to the context-relevant emotion (e.g., happier faces are more rightward when judged on happiness, but more leftward when judged on angriness; Experiment 3). These findings show that people automatically extract magnitude from a variety of stimuli, representing such information in common left-to-right format, perhaps reflecting a mental magnitude line. We suggest that number is but one dimension in a hyper-general representational system uniting disparate dimensions of magnitude and likely subserved by common neural mechanisms in posterior parietal cortex.     

Implicit learning of what comes when and where within a sequence: The time-course of acquiring serial position-item and item-item associations to represent serial order

Much research has been conducted aimed at the representations and mechanisms that enable learning of sequential structures. A central debate concerns the question whether item-item associations (i.e., in the sequence A-B-C-D, B comes after A) or associations of item and serial list position (i.e., B is the second item in the list) are used to represent serial order. Previously, we showed that in a variant of the implicit serial reaction time task, the sequence representation contains associations between serial position and item information (Schuck, Gaschler, Keisler, & Frensch, 2011). Here, we applied models and research methods from working memory research to implicit serial learning to replicate and extend our findings. The experiment involved three sessions of sequence learning. Results support the view that participants acquire knowledge about order structure (item-item associations) and about ordinal structure (serial position-item associations). Analyses suggest that only the simultaneous use of the two types of knowledge acquisition can explain learning-related performance increases. Additionally, our results indicate that serial list position information plays a role very early in learning and that inter-item associations increasingly control behavior in later stages.     

Pure perceptual-based sequence learning

Learning a sequence of target locations when the sequence is uncorrelated with a sequence of responses and target location is not the response dimension (pure perceptual-based sequence learning) was examined. Using probabilistic sequences of target locations, the author shows that such learning can be implicit, is unaffected by distance between target locations, and is mostly limited to first-order transition probabilities. Moreover, the mechanism underlying learning affords processing of information at anticipated target locations and appears to be attention based. Implications for hypotheses of implicit sequence learning are discussed.     

Ordinality and novel sequence learning in jackdaws

A hallmark of higher cognition is the flexible use of information. This requires an abstract representation of the information. In sequence learning, ordinal position knowledge is seen as a more versatile representation when compared to chaining. Here, we assessed which of these mental representations is the most natural and most dominant in jackdaws. Two jackdaws (Corvus monedula) were trained on 14 separate three-item sequences (triplets), made up of abstract images. On each trial, the three items of one triplet were presented in fixed order. The images represented either the first, second or third ordinal position. Test stimuli consisted of the three images and a distractor image that was chosen randomly from the remaining sequences. We rewarded pecking in the correct order to the images belonging to the same sequence. The most common error the birds made was to peck at a distractor item from the same ordinal position. To look at how versatile the jackdaws' ordinal knowledge was, we replaced a familiar item with a novel item in some sequences. We then created novel sequences with these items, which the birds completed correctly. It appears, then, that jackdaws have a concept of ordinal position.     

Coding strategies in number space: memory requirements influence spatial-numerical associations

The tendency to respond faster with the left hand to relatively small numbers and faster with the right hand to relatively large numbers (spatial numerical association of response codes, SNARC effect) has been interpreted as an automatic association of spatial and numerical information. We investigated in two experiments the impact of task-irrelevant memory representations on this effect. Participants memorized three Arabic digits describing a left-to-right ascending number sequence (e.g., 3-4-5), a descending sequence (e.g., 5-4-3), or a disordered sequence (e.g., 5-3-4) and indicated afterwards the parity status of a centrally presented digit (i.e., 1, 2, 8, or 9) with a left/right keypress response. As indicated by the reaction times, the SNARC effect in the parity task was mediated by the coding requirements of the memory tasks. That is, a SNARC effect was only present after memorizing ascending or disordered number sequences but disappeared after processing descending sequences. Interestingly, the effects of the second task were only present if all sequences within one experimental block had the same type of order. Taken together, our findings are inconsistent with the idea that spatial-numerical associations are the result of an automatic and obligatory cognitive process but do suggest that coding strategies might be responsible for the cognitive link between numbers and space.     

Sequence learning

The ability to sequence information is fundamental to human performance. When subjects are asked to respond to one of several possible spatial locations of a stimulus, reaction times and error rates decrease when the target follows a sequence. In this article, we review the numerous theoretical and methodological perspectives that have been used to study sequence learning. The opportunity now exists to integrate evidence from different domains of cognitive science to begin to provide a comprehensive account of sequence learning. We suggest that subjects can learn sequences based on different information in a hierarchical representation, including either sequences of stimuli or sequences of responses. This learning can occur both with and without explicit awareness of the sequence. Multiple modes of learning exist and are subserved by different neural circuits.     

Spatial interference and response control in sequence learning: the role of explicit knowledge

In several sequence learning studies it has been suggested that response control shifts from the stimuli to some internal representation (i.e., motor program) through the learning process. The main questions addressed in this paper are whether this control shift is related to explicit knowledge and whether the formation of these internal representations depends on the stimulus attributes. In one experiment we compared the learning of a response sequence triggered by either spatial location or location symbol (left-right) by using a serial response task (SRT). Symbols were presented at either a centered or random location. The results showed that in the symbolic conditions the shift of response control correlated with the emergence of explicit knowledge. Only participants with complete explicit knowledge seemed to learn the sequence structure beyond probabilistic information (response time "RT" did not depend on the frequency of the response). Moreover, these participants were able to overcome, when needed, spatial interference (RT was the same for both spatially corresponding and non-corresponding trials). However, when spatial location was relevant, RT was always faster, especially for more frequent responses. These results suggest that the relevant stimulus dimension (location or symbol) seems to engage different sequence learning mechanisms.     

The role of memory consolidation in generalisation of new linguistic information

Accounts of memory that postulate complementary learning systems (CLS) have become increasingly influential in the field of language learning. These accounts predict that generalisation of newly learnt linguistic information to untrained contexts requires offline memory consolidation. Such generalisation should not be observed immediately after training, as these accounts claim unconsolidated representations are context and hippocampus-dependent and gain contextual and hippocampal independence only after consolidation. We trained participants on new affixes (e.g., -nule) attached to familiar word stems (e.g., buildnule), testing them immediately or 2days later. Participants showed an immediate advantage for trained affixes in a speeded shadowing task as long as these affixes occurred in the stem contexts in which they were learnt (e.g., buildnule). This learning effect generalised to words with untrained stems (e.g., sailnule) only in the delayed test condition. By contrast, a non-speeded definition selection task showed immediate generalisation. We propose that generalisation can be supported by initial context-dependent memories given sufficient processing time, but that context-independent lexical representations emerge only following consolidation, as predicted by CLS accounts.     

Role of action observation and action in sequence learning and coding

A complex sequence learning task was used to determine if the type of coding acquired through physical practice (PP), observation of the stimulus (Obs-S), or observation of stimulus and action (Obs-SA) differs between conditions and whether the type of observation influences subsequent learning of the task when physical practice was permitted. Participants in the Obs-S group were permitted to watch the sequentially illuminated stimuli on the screen. In the Obs-SA group participants could see both flexion-extension movements of the model's arm performing the sequence and the sequentially illuminated stimuli on the screen. Participants in the PP group actually performed the 16-element sequence with their dominant right arm. Delayed retention tests and two inter-manual transfer tests were completed following each of two acquisition sessions. First, the data indicated that learning the sequence structure, as revealed by response time per element, occurred similarly irrespective of the initial practice condition. Secondly, the movement sequence appeared to be coded in abstract visual-spatial coordinates resulting in effector-independent performance. Finally, observing the model's action and sequential stimuli allows participants to transfer the perceived aspects of the movement sequence into efficient coordination patterns when additional physical practice is permitted.