Information‐Theoretic Properties of Auditory Sequences Dynamically Influence Expectation and Memory

A basic function of cognition is to detect regularities in sensory input to facilitate the prediction and recognition of future events. It has been proposed that these implicit expectations arise from an internal predictive coding model, based on knowledge acquired through processes such as statistical learning, but it is unclear how different types of statistical information affect listeners’ memory for auditory stimuli. We used a combination of behavioral and computational methods to investigate memory for non‐linguistic auditory sequences. Participants repeatedly heard tone sequences varying systematically in their information‐theoretic properties. Expectedness ratings of tones were collected during three listening sessions, and a recognition memory test was given after each session. Information‐theoretic measures of sequential predictability significantly influenced listeners’ expectedness ratings, and variations in these properties had a significant impact on memory performance. Predictable sequences yielded increasingly better memory performance with increasing exposure. Computational simulations using a probabilistic model of auditory expectation suggest that listeners dynamically formed a new, and increasingly accurate, implicit cognitive model of the information‐theoretic structure of the sequences throughout the experimental session.     

Asymmetric interference between domains: evidence from the stimulus order effect in complex span tasks

The stimulus order effect refers to the finding that recall in complex span tasks is better when span lists begin with a longer processing task and end with a shorter task than when these processing tasks are presented in the reverse order. This study independently manipulated processing time and processing difficulty between Long-final and Short-final lists. The processing task required participants to solve arithmetic problems with either verbal (Experiment 1) or visuospatial (Experiment 2) materials. The memory items used in the storage task were either digits (verbal material) or dots-in-matrices (visuospatial materials). Storage of both verbal and visuospatial materials was sensitive to the change in processing difficulty, but not processing time. Furthermore, this study provides further evidence for the asymmetry of domain interference in working memory. The similarities and differences between verbal and visuospatial storage in working memory are discussed.     

内隐序列学习的表征机制及年龄效应研究

该研究从年龄效应这一独特视角探讨了内隐序列学习的表征机制。结果表明:(1)内隐序列学习存在具体联结和抽象层级编码双重表征机制,且在该研究中以抽象编码为主;(2)老、青、幼三组被试的内隐序列学习无显著差异,间接支持了具体联结机制不起主要作用的结论。该研究的推论是:(1)内隐序列学习的表征是一个遵循“最优级编码”的动态过程;(2)该过程不涉及注意机制和短时记忆。     

Stimulus modality and working memory performance in Greek children with reading disabilities: Additional evidence for the pictorial superiority hypothesis

This study investigated the effects of stimulus presentation modality on working memory performance in children with reading disabilities (RD) and in typically developing children (TDC), all native speakers of Greek. It was hypothesized that the visual presentation of common objects would result in improved learning and recall performance as compared to the auditory presentation of stimuli. Twenty children, ages 10–12, diagnosed with RD were matched to 20 TDC age peers. The experimental tasks implemented a multitrial verbal learning paradigm incorporating three modalities: auditory, visual, and auditory plus visual. Significant group differences were noted on language, verbal and nonverbal memory, and measures of executive abilities. A mixed-model MANOVA indicated that children with RD had a slower learning curve and recalled fewer words than TDC across experimental modalities. Both groups of participants benefited from the visual presentation of objects; however, children with RD showed the greatest gains during this condition. In conclusion, working memory for common verbal items is impaired in children with RD; however, performance can be facilitated, and learning efficiency maximized, when information is presented visually. The results provide further evidence for the pictorial superiority hypothesis and the theory that pictorial presentation of verbal stimuli is adequate for dual coding.     

Working memory deficits in boys with attention deficit/hyperactivity disorder (ADHD): An examination of orthographic coding and episodic buffer processes

The episodic buffer component of working memory was examined in children with attention deficit/hyperactivity disorder (ADHD) and typically developing peers (TD). Thirty-two children (ADHD = 16, TD = 16) completed three versions of a phonological working memory task that varied with regard to stimulus presentation modality (auditory, visual, or dual auditory and visual), as well as a visuospatial task. Children with ADHD experienced the largest magnitude working memory deficits when phonological stimuli were presented via a unimodal, auditory format. Their performance improved during visual and dual modality conditions but remained significantly below the performance of children in the TD group. In contrast, the TD group did not exhibit performance differences between the auditory- and visual-phonological conditions but recalled significantly more stimuli during the dual-phonological condition. Furthermore, relative to TD children, children with ADHD recalled disproportionately fewer phonological stimuli as set sizes increased, regardless of presentation modality. Finally, an examination of working memory components indicated that the largest magnitude between-group difference was associated with the central executive. Collectively, these findings suggest that ADHD-related working memory deficits reflect a combination of impaired central executive and phonological storage/rehearsal processes, as well as an impaired ability to benefit from bound multimodal information processed by the episodic buffer.     

A working memory account for spatial-numerical associations

Several psychophysical and neuropsychological investigations have suggested that the mental representation of numbers takes the form of a number line along which magnitude is positioned in ascending order according to our reading habits. A longstanding debate is whether this spatial frame is triggered automatically as intrinsic part of the number semantics or whether it constitutes a short-term representation constructed during task execution. Although several observations clearly favor the working memory account, its causal involvement has not yet been demonstrated. In two experiments we show that information stored in working memory get spatially coded in function of its ordinal position in the sequence and that the spatial–numerical associations typically observed in number categorization tasks draw upon this mechanism.     

Protein analysis meets visual word recognition: a case for string kernels in the brain

It has been recently argued that some machine learning techniques known as Kernel methods could be relevant for capturing cognitive and neural mechanisms ( Jäkel, Schölkopf, & Wichmann, 2009 ). We point out that ‘‘String kernels,’’ initially designed for protein function prediction and spam detection, are virtually identical to one contending proposal for how the brain encodes orthographic information during reading. We suggest some reasons for this connection and we derive new ideas for visual word recognition that are successfully put to the test. We argue that the versatility and performance of String kernels makes a compelling case for their implementation in the brain.     

Simon-like and functional affordance effects with tools: The effects of object perceptual discrimination and object action state

In the present study two separate stimulus–response compatibility effects (functional affordance and Simon-like effects) were investigated with centrally presented pictures of an object tool (a torch) characterized by a structural separation between the graspable portion and the goal-directed portion. In Experiment 1, participants were required to decide whether the torch was red or blue, while in Experiment 2 they were required to decide whether the torch was upright or inverted. Our results showed that with the same stimulus two types of compatibility effect emerged: one based on the direction signalled by the goal-directed portion of the tool (a Simon-like effect as observed in Experiment 1), and the other based on the actions associated with an object (a functional affordance effect as observed in Experiment 2). Both effects emerged independently of the person's intention to act on the stimulus, but depended on the stimulus properties that were processed in order to perform the task.     

Transposed-letter priming effect in Hebrew in the same–different task

We investigated the interaction between morphological structure and transposed-letter priming using the same–different task with Hebrew, a Semitic language in which morphology has been shown to play a key role in visual word recognition. In contrast to the results observed with lexical decision (e.g., Velan & Frost, 2009, 2011), a transposed-letter priming effect was observed irrespective of the morphological structure of the words. We take these results to suggest that morphological decomposition occurs only in the service of lexical access. We discuss further a unique feature of written Arabic, another Semitic language, to explain the apparent conflict between our findings and those reported by Perea, Abu Mallouh, García-Orza, and Carreiras (2010).     

Action–effect congruence during observational learning leads to faster action sequence learning

Common coding theory suggests that any action (pressing a piano key) is intimately linked with its resultant sensory effect (an auditory musical tone). We conducted two experiments to explore the effect of varying auditory action–effect patterns during complex action learning. In Experiment 1, participants were assigned to 1 of 4 groups, watched a silent video of a hand playing a sequence on a piano keyboard with no auditory action effect (observation) and were asked to practise and perform the sequence on an identical keyboard with varying action effects (reproduction). During reproduction, Group 1 heard no auditory tones (identical to observed video), Group 2 heard typical scale-ascending piano tones with each key press, Group 3 heard fixed but out-of-sequence piano tones with each key press, and Group 4 heard random piano tones with each key press. In Experiment two, new participants were assigned to 1 of 2 groups and watched an identical video; however, the video in this experiment contained typical, scale-ascending piano sounds. During reproduction, Group 1 heard no auditory tones while Group 2 heard typical, scale-ascending piano tones with each key press (identical to observed video). Our results showed that participants whose action–effect patterns during reproduction matched those in the observed video learned the action sequence faster than participants whose action–effect patterns during reproduction differed from those in the observed video. Additionally, our results suggest that adding an effect during reproduction (when one is absent during observation) is somewhat more detrimental to action sequence learning than removing an effect during reproduction (when one is present during observation).