Determinants of phrasing effects in rat serial pattern learning

Two experiments investigated how brief pauses introduced into serial patterns as phrasing cues would affect pattern learning in rats. In Experiment 1, a 24-element pattern consisted of eight 3-element chunks, whereas a 20-element pattern consisted of four 5-element chunks. In both patterns, 3.0-s temporal pauses placed at chunk boundaries (synchronous phrasing cues) facilitated learning compared to no phrasing. Cues "out of sync" with pattern structure (asynchronous phrasing cues) facilitated learning for the 24-element pattern and retarded learning for the 20-element pattern. Evidence suggested that in the latter case, 3.0-s pauses served as "blank" trials that induced rats to "skip" to the next serial position in sequence. In Experiment 2, shorter 0.5-s pauses served as phrasing cues in the 20-element pattern of Experiment 1. Synchronous short cues facilitated learning, whereas asynchronous phrasing cues had no effect. Furthermore, removal of synchronous cues produced deficits in performance on formerly cued trials, whereas removal of asynchronous cues had no effect. The results of Experiment 2 support the notion that in both experiments phrasing cues served as discriminative cues and indirectly suggest that rats are concurrently sensitive to pattern element cues, extra-sequence cues (such as phrasing cues), and to the relative timing of sequential events.     

Concurrent intramodal learning enhances multisensory responses of symmetric crossmodal learning in robotic audio-visual tracking

Tracking an audio-visual target involves integrating spatial cues about target position from both modalities. Such sensory cue integration is a developmental process in the brain involving learning, with neuroplasticity as its underlying mechanism. We present a Hebbian learning-based adaptive neural circuit for multi-modal cue integration. The circuit temporally correlates stimulus cues within each modality via intramodal learning as well as symmetrically across modalities via crossmodal learning to independently update modality-specific neural weights on a sample-by-sample basis. It is realised as a robotic agent that must orient towards a moving audio-visual target. It continuously learns the best possible weights required for a weighted combination of auditory and visual spatial target directional cues that is directly mapped to robot wheel velocities to elicit an orientation response. Visual directional cues are noise-free and continuous but arising from a relatively narrow receptive field while auditory directional cues are noisy and intermittent but arising from a relatively wider receptive field. Comparative trials in simulation demonstrate that concurrent intramodal learning improves both the overall accuracy and precision of the orientation responses of symmetric crossmodal learning. We also demonstrate that symmetric crossmodal learning improves multisensory responses as compared to asymmetric crossmodal learning. The neural circuit also exhibits multisensory effects such as sub-additivity, additivity and super-additivity.     

How generative drawing affects the learning process: An eye‐tracking analysis

Generative drawing is a learning strategy in which students draw illustrations while reading a text to depict the content of the lesson. In two experiments, students were asked to generate drawings as they read a scientific text or read the same text on influenza with author‐provided illustrations (Experiment 1) or to generate drawings or write verbal summaries as they read (Experiment 2). An examination of students' eye movements during learning showed that students who engaged in generative drawing displayed more rereadings of words, higher proportion of fixations on the important words, higher rate of transitions between words and workspace, and higher proportion of transitions between important words and workspace than students given a text lesson with author‐generated illustrations (Experiment 1) or students who were asked to write a summary (Experiment 2). These findings contribute new evidence to guide theories for explaining how generative drawing affects learning processes.     

追踪手势对视空间学习的增强作用

本研究采用地图学习任务范式考察了追踪手势对视空间学习的影响和增强, 并试图从追踪手势的角度寻找能够有效促进操作者视空间学习的方法。实验1探究了产生追踪手势对视空间学习的增强作用; 实验2采用遮挡范式考察了产生追踪手势增强视空间学习的作用机制, 发现产生追踪手势所提供的视觉信息和感觉运动信息共同作用于视空间学习过程; 实验3从具身认知的视角探索了基于追踪手势的视空间学习增强方式, 发现以自我为参照产生追踪手势可以更好地增强个体的视空间学习。本研究结果很好地支持并补充了手势的具身认知理论。     

Age differences in learning serial patterns: direct versus indirect measures

Adult age differences in learning and retention of a nonverbal sequence were examined using the serial reaction-time task of Nissen and Bullemer (1987), with 20 younger and 20 older Ss. An asterisk appeared in one of 4 spatial locations, and the Ss responded with a corresponding key press. The first 4 blocks each contained 10 repetitions of a 10- or 16-element spatial sequence, and the 5th block contained a random sequence. The difference between response time on Blocks 5 and 4 served as an indirect measure of pattern learning. The direct measure was accuracy in a final generation block in which the Ss predicted which location would appear next. Results were similar to those with verbal materials; the indirect measure revealed age similarity for patterns of both lengths, but the direct measure yielded age differences favoring the young. For both ages and types of measures, the long patterns led to poorer learning than did the short patterns.     

Mental representations of magnitude and order: A dissociation by sensorimotor learning

Numbers and spatially directed actions share cognitive representations. This assertion is derived from studies that have demonstrated that the processing of small- and large-magnitude numbers facilitates motor behaviors that are directed to the left and right, respectively. However, little is known about the role of sensorimotor learning for such number–action associations. In this study, we show that sensorimotor learning in a serial reaction-time task can modify the associations between number magnitudes and spatially directed movements. Experiments 1 and 3 revealed that this effect is present only for the learned sequence and does not transfer to a novel unpracticed sequence. Experiments 2 and 4 showed that the modification of stimulus–action associations by sensorimotor learning does not occur for other sets of ordered stimuli such as letters of the alphabet. These results strongly suggest that numbers and actions share a common magnitude representation that differs from the common order representation shared by letters and spatially directed actions. Only the magnitude representation, but not the order representation, can be modified episodically by sensorimotor learning.     

Dynamic binding of identity and location information: a serial model of multiple identity tracking

Tracking of multiple moving objects is commonly assumed to be carried out by a fixed-capacity parallel mechanism. The present study proposes a serial model (MOMIT) to explain performance accuracy in the maintenance of multiple moving objects with distinct identities. A serial refresh mechanism is postulated, which makes recourse to continuous attention switching, a capacity-limited episodic buffer for identity-location bindings, indexed location information stored in the visuospatial short-term memory, and an active role of long-term memory. As identity-location bindings are refreshed serially, a location error is inherent for all other targets except the focally attended one. The magnitude of this location error is a key factor in predicting tracking accuracy. MOMIT’s predictions were supported by the data of five experiments: performance accuracy decreased as a function of target set-size, speed, and familiarity. A mathematical version of MOMIT fitted nicely to the observed data with plausible parameter estimates for the binding capacity and refresh time.     

Contextual cueing in multiple object tracking

In this study, we examined whether visual context can be learned through a dynamic display and whether it can facilitate sustained attentional tracking by combining a multiple object tracking (MOT) task and a contextual cueing procedure. The trajectories of the targets and distractors in the MOT task were made invariant by repeatedly presenting them. The results revealed that when the targets were repeatedly displayed, tracking performance implicitly improved, and this effect was enhanced when the unattended distractors in the displays were also repeated. However, the repetition of the distractors alone did not produce any effect. Interestingly, when the targets and distractors were switched in a display in which the distractors had been previously repeated, the tracking performance was impaired as compared with that in the case of nonrepeated displays. We concluded that the contextual information in a dynamic display facilitates attentional tracking and that different types of contextual modulations occurred in MOT processes, such as facilitation for attended targets and inhibition for ignored distractors.     

Probability judgment in hierarchical learning: a conflict between predictiveness and coherence

Why are people's judgments incoherent under probability formats? Research in an associative learning paradigm suggests that after structured learning participants give judgments based on predictiveness rather than normative probability. This is because people's learning mechanisms attune to statistical contingencies in the environment, and they use these learned associations as a basis for subsequent probability judgments. We introduced a hierarchical structure into a simulated medical diagnosis task, setting up a conflict between predictiveness and coherence. Thus, a target symptom was more predictive of a subordinate disease than of its superordinate category, even though the latter included the former. Under a probability format participants tended to violate coherence and make ratings in line with predictiveness; under a frequency format they were more normative. These results are difficult to explain within a unitary model of inference, whether associative or frequency-based. In the light of this, and other findings in the judgment and learning literature, a dual-component model is proposed.     

Object-goal positioning influences spatial representation in rats

Three tests investigated how the geometric relation between object/landmarks and goals influenced spatial choice behavior in rats. Two groups searched for hidden food in an object-filled circular arena containing 24 small poles. For the “Proximal” group, four distinct objects in a square configuration were placed close to four baited poles. For the “Distal” group, the identical configuration of objects was rotated 45° relative to the poles containing the hidden food. The Proximal group learned to locate the baited poles more quickly than the Distal group. Tests with removed and rearranged landmarks indicated that the two groups learned to use the objects differently. The results suggested that close proximity of objects to goals encouraged their use as beacons, while greater distance of objects from goals resulted in the global encoding of the geometric properties of the arena and the use of the objects as landmarks. Received: 22 June 1998 / Accepted after revision: 23 January 1999     

Concurrent cognitive processes in rat serial pattern learning: II. Discrimination learning,rule learning,chunk length,and multiple‐item memories

The current experiment examined the factors that determine acquisition for elements of highly structured serial patterns. Three groups of rats were trained on three patterns with parallel rule‐based hierarchical structure, but with 3‐, 4‐, or 5‐element chunks, each with a final violation element. Once rats mastered their patterns, probe patterns were introduced to answer several questions. To assess the extent to which the learned response pattern depended on intrachamber location cues for anticipating different element types, Spatial Shift Probes shifted the starting lever of patterns to locations that positioned chunk boundaries where they had never been experienced during training. To assess the extent to which a phrasing cue is necessary for rats to perform a chunk‐boundary response, a Cue Removal Probe tested whether rats would produce a chunk‐boundary response in the correct serial position if the phrasing cue was omitted. To assess the extent to which cues from multiple trials leading up to the violation element are required to anticipate the violation element, Multiple‐Item Memory Probes required rats to make an unexpected response on one of the elements in the last two chunks of the pattern prior to the violation element. The results indicated that rats used multiple concurrent learning and memory processes to master serial patterns, including discrimination learning, rule learning, encoding of chunk length, and multiple‐item memories.     

Redundant sensory information does not enhance sequence learning in the serial reaction time task

In daily life we encounter multiple sources of sensory information at any given moment. Unknown is whether such sensory redundancy in some way affects implicit learning of a sequence of events. In the current paper we explored this issue in a serial reaction time task. Our results indicate that redundant sensory information does not enhance sequence learning when all sensory information is presented at the same location (responding to the position and/or color of the stimuli; Experiment 1), even when the distinct sensory sources provide more or less similar baseline response latencies (responding to the shape and/or color of the stimuli; Experiment 2). These findings support the claim that sequence learning does not (necessarily) benefit from sensory redundancy. Moreover, transfer was observed between various sets of stimuli, indicating that learning was predominantly response-based.     

Emotional facial expressions affect visual rule learning in 7- to 8-month-old infants

Rule learning (RL) is an implicit learning mechanism that allows infants to detect and generalize rule-like repetition-based patterns (such as ABB and ABA) from a sequence of elements. Increasing evidence shows that RL operates both in the auditory and the visual domain and is modulated by the perceptual expertise with the to-be-learned stimuli. Yet, whether infants’ ability to detect a high-order rule from a sequence of stimuli is affected by affective information remains a largely unexplored issue. Using a visual habituation paradigm, we investigated whether the presence of emotional expressions with a positive and a negative value (i.e., happiness and anger) modulates 7- to 8-month-old infants’ ability to learn a rule-like pattern from a sequence of faces of different identities. Results demonstrate that emotional facial expressions (either positive and negative) modulate infants’ visual RL mechanism, even though positive and negative facial expressions affect infants’ RL in a different manner: while anger disrupts infants’ ability to learn the rule-like pattern from a face sequence, in the presence of a happy face infants show a familiarity preference, thus maintaining their learning ability. These findings show that emotional expressions exert an influence on infants’ RL abilities, contributing to the investigation on how emotion and cognition interact in face processing during infancy.     

Static and dynamic seductive illustration effects on text‐and‐graphic learning processes,perceptions, and outcomes: Evidence from eye tracking

This study aimed to examine how different forms (still pictures vs. animations) of seductive illustrations impact text‐and‐graphic learning processes, perceptions, and outcomes. An eye‐tracking experiment of three groups (static, dynamic, and control) was conducted with 60 college and graduate students while learning with PowerPoint slides about infant motor development milestones. Prior knowledge, learning performance, learning perception, and visual attention were assessed by achievement tests, self‐rated scales, and eye‐tracking measures. Analysis of variance and t test results showed that, under a low task‐load condition, no seductive details effect was found for learning achievement but was found for learning process and perception. Decreased attention was found in the relevant pictures in both experimental groups. With more deeply and intensively processing on the seductive animations, the dynamic group perceived more distractions than the static group. Lag sequential analysis results revealed different visual transitional patterns for the groups, providing deep understandings about the process of seductive details effects.     

Syntactic structure and artificial grammar learning: the learnability of embedded hierarchical structures

Embedded hierarchical structures, such as "the rat the cat ate was brown", constitute a core generative property of a natural language theory. Several recent studies have reported learning of hierarchical embeddings in artificial grammar learning (AGL) tasks, and described the functional specificity of Broca's area for processing such structures. In two experiments, we investigated whether alternative strategies can explain the learning success in these studies. We trained participants on hierarchical sequences, and found no evidence for the learning of hierarchical embeddings in test situations identical to those from other studies in the literature. Instead, participants appeared to solve the task by exploiting surface distinctions between legal and illegal sequences, and applying strategies such as counting or repetition detection. We suggest alternative interpretations for the observed activation of Broca's area, in terms of the application of calculation rules or of a differential role of working memory. We claim that the learnability of hierarchical embeddings in AGL tasks remains to be demonstrated.     

Language learning and control in monolinguals and bilinguals

Parallel language activation in bilinguals leads to competition between languages. Experience managing this interference may aid novel language learning by improving the ability to suppress competition from known languages. To investigate the effect of bilingualism on the ability to control native-language interference, monolinguals and bilinguals were taught an artificial language designed to elicit between-language competition. Partial activation of interlingual competitors was assessed with eye-tracking and mouse-tracking during a word recognition task in the novel language. Eye-tracking results showed that monolinguals looked at competitors more than bilinguals, and for a longer duration of time. Mouse-tracking results showed that monolinguals' mouse movements were attracted to native-language competitors, whereas bilinguals overcame competitor interference by increasing the activation of target items. Results suggest that bilinguals manage cross-linguistic interference more effectively than monolinguals. We conclude that language interference can affect lexical retrieval, but bilingualism may reduce this interference by facilitating access to a newly learned language.     

Facilitation of learning of a simultaneous discrimination between rotated patterns by bumblebees

The failure to discriminate between a pattern consisting of four orthogonal bars and the same pattern rotated by 45° has been interpreted in the literature as evidence against pictorial representations in honeybees. This study determines whether prior training can facilitate the discrimination. In Experiment 1, one group of bumblebees was trained with a rewarding spiral pattern (S+) vs. its unrewarding 45° rotation (S−). A second group was trained with two different patterns, the spiral (S+) and the chevron (S−). Both groups were then tested with the spiral and its rotation, both of which were unrewarding. The first group failed in the discrimination while the second succeeded. The same was true when the training period was defined by choice frequency instead of time (Experiment 2). The facilitation due to prior experience was pattern specific (Experiments 3 and 4). These results show perceptual learning in bumblebees and weaken the case against pictorial representations.     

Disrupted attentional learning in high schizotypy: Evidence of aberrant salience

The relationship between learned variations in attention and schizotypy was examined in two experiments. In Experiment 1, participants low on a negative subscale of schizotypy exhibited an explicit bias in overt attention towards stimuli that were established as predictive of a trial outcome, relative to stimuli that were irrelevant. The same participants also showed a bias in learning about these stimuli when they presented in a novel context. Neither of these effects was observed in participants high in schizotypy. In Experiment 2, participants low on the negative subscale of schizotypy exhibited faster reaction times towards a target that was cued by a stimulus that had a history of predictive validity relative to a stimulus that had a history of irrelevance. Again, this effect was not present in participants high in schizotypy. These results imply a disruption in the normal allocation of attention to cues that have predictive significance in schizotypy.     

Anticipation measures of sequence learning: manual versus oculomotor versions of the serial reaction time task

The serial reaction time (SRT) task has generated a very large amount of research. Nevertheless the debate continues as to the exact cognitive processes underlying implicit sequence learning. Thus, the first goal of this study is to elucidate the underlying cognitive processes enabling sequence acquisition. We therefore compared reaction time (RT) in sequence learning in a standard manual activated (MA) to that in an ocular activated (OA) version of the task, within a single experimental setting. The second goal is to use eye movement measures to compare anticipation, as an additional indication of sequence learning, between the two versions of the SRT. Performance of the group given the MA version of the task (n = 29) was compared with that of the group given the OA version (n = 30). The results showed that although overall, RT was faster for the OA group, the rate of sequence learning was similar to that of the MA group performing the standard version of the SRT. Because the stimulus-response association is automatic and exists prior to training in the OA task, the decreased reaction time in this version of the task reflects a purer measure of the sequence learning that occurs in the SRT task. The results of this study show that eye tracking anticipation can be measured directly and can serve as a direct measure of sequence learning. Finally, using the OA version of the SRT to study sequence learning presents a significant methodological contribution by making sequence learning studies possible among populations that struggle to perform manual responses.     

探究事件相关脑电/脑磁信号中的神经表征模式：基于分类解码和表征相似性分析的方法

探究不同心智活动下的神经表征差异, 是认知神经科学关注的核心问题之一。早期的脑电/脑磁分析方法主要关注组平均后的神经响应水平, 这要求在关注的时间进程上, 各个被试在相同刺激条件下事件相关电位/事件相关磁场的振幅大小和方向、以及地形图分布和极性均要有较高的一致性。近些年来, 研究者们将功能性磁共振成像研究中常用到的两种技术——机器学习中的分类算法(即基于分类的解码)和表征相似性分析——引入到了脑电/脑磁数据分析中。这两种新技术可以克服传统脑电/脑磁数据基于具体电压/磁感应强度波形平均分析的缺点, 具有在个体水平上探究神经表征编码的特点, 为人们探究大脑在不同时间进程上如何对特定的神经表征信息进行动态编码提供了新的思路。两种技术基于不同的方法学原理来抽提个体间一致的脑认知加工机制, 还为脑电/脑磁研究开展跨时域、跨任务、跨模态、跨群体比较不同认知过程中的表征差异提供了更多新颖的途径。我们首先通过与传统的脑电/脑磁分析方法进行比较, 系统性介绍了基于分类的解码和表征相似性分析的原理和操作流程, 之后对两种方法的应用场景进行了梳理, 并在最后对未来可供研究的方向提出了我们的见解。