Beyond mind-reading: multi-voxel pattern analysis of fMRI data

A key challenge for cognitive neuroscience is determining how mental representations map onto patterns of neural activity. Recently, researchers have started to address this question by applying sophisticated pattern-classification algorithms to distributed (multi-voxel) patterns of functional MRI data, with the goal of decoding the information that is represented in the subject's brain at a particular point in time. This multi-voxel pattern analysis (MVPA) approach has led to several impressive feats of mind reading. More importantly, MVPA methods constitute a useful new tool for advancing our understanding of neural information processing. We review how researchers are using MVPA methods to characterize neural coding and information processing in domains ranging from visual perception to memory search.     

Recognition of transposed melodic sequences

Accuracy of recognition for short (three-note) transposed melodic sequences was measured and compared with accuracy predicted by three models of recognition each of which described a different degree of abstraction and synthesis of the musical intervals contained in the sequence. For subjects with musical training, recognition was best described by a model that assumed abstraction and synthesis of the musical intervals between both adjacent and non-adjacent tones of the sequence. For subjects without musical training, recognition was much less accurate but there was some evidence that intervals between adjacent tones were abstracted. Of major theoretical interest, however, was the finding that none of the models provided a comprehensive account of the data. Not merely the size of the intervals contained in a sequence determines accuracy of recognition of the sequence, but also the order or configuration of the intervals. It is suggested that particular interval configurations facilitate the abstraction of tonal structure.     

Associative, bidirectional changes in neural signaling utilizing NMDA receptor- and endocannabinoid-dependent mechanisms

Persistent, bidirectional changes in synaptic signaling (that is, potentiation and depression of the synapse) can be induced by the precise timing of individual pre- and postsynaptic action potentials. However, far less attention has been paid to the ability of paired trains of action potentials to elicit persistent potentiation or depression. We examined plasticity following the pairing of spike trains in the touch mechanosensory neuron (T cell) and S interneuron (S cell) in the medicinal leech. Long-term potentiation (LTP) of T to S signaling was elicited when the T-cell spike train preceded the S-cell train. An interval 0 to +1 sec between the T- and S-cell spike trains was required to elicit long-term potentiation (LTP), and this potentiation was NMDA receptor (NMDAR)-dependent. Long-term depression (LTD) was elicited when S-cell activity preceded T-cell activity and the interval between the two spike trains was -0.2 sec to -10 sec. This surprisingly broad temporal window involved two distinct cellular mechanisms; an NMDAR-mediated LTD (NMDAR-LTD) when the pairing interval was relatively brief (<-1 sec) and an endocannabinoid-mediated LTD (eCB-LTD) when longer pairing intervals were used (-1 to -10 sec). This eCB-LTD also required activation of a presynaptic transient receptor potential vanilloid (TRPV)-like receptor, presynaptic Ca(2+) release from intracellular stores and activation of voltage-gated Ca(2+) channels (VGCCs). These findings demonstrate that the pairing of spike trains elicits timing-dependent forms of LTP and LTD that are supported by a complex set of cellular mechanisms involving NMDARs and endocannabinoid activation of TRPV-like receptors.     

Temporal control and coordination: the multiple timer model.

We consider the psychological and neurological mechanisms involved in timed behaviors, motor or perceptual tasks that emphasize the temporal relationship between successive events. Two general models for representing temporal information are described. In one model, temporal information is based on the oscillatory activity of an endogenous pacemaker; in the other model, temporal information is interval-based with distinct elements devoted to representing different intervals. We incorporate the interval hypothesis into a process model, the multiple timer model, to account for the timing and coordination of repetitive movements. The model accounts for the patterns of temporal stability observed within each effector and offers a novel account of between-effector coordination. Finally, we consider how timing and temporal coordination may be instantiated in the nervous system.     

The rhythm aftereffect: support for time sensitive neurons with broad overlapping tuning curves

Ivry [Ivry, R. B. (1996). The representation of temporal information in perception and motor control. Current Opinion in Neurobiology, 6, 851-857.] proposed that explicit coding of brief time intervals is accomplished by neurons that are tuned to a preferred temporal interval and have broad overlapping tuning curves. This proposal is analogous to the orientation selective cells in visual area V1. To test this proposal, we used a temporal analog to the visual tilt aftereffect. After adapting to a fast auditory rhythm, a moderately fast test rhythm (400 ms between beats) seemed slow and vice versa. If the speed of the adapting rhythm was made too disparate from speed of the test rhythm the effect was diminished. The effect occurred whether the adapting and test stimuli were presented to the same or different ears, but did not occur when an auditory adapting rhythm was followed by a visual test rhythm. Results support the proposition that explicit time information is coded by neural units tuned to specific temporal intervals with broad overlapping tuning curves. In addition, it appears that there is a single timing mechanism for each incoming sensory mode, but distinct timers for different modes.     

Impaired pitch production and preserved rhythm production in a right brain-damaged patient with amusia

Pre- and postmorbid singing of a patient with amusia due to a right-hemispheric infarction was analyzed acoustically. This particular patient had a premorbid tape recording of her own singing without accompaniment. Appropriateness of pitch interval and rhythm was evaluated based on ratios of pitch and duration between neighboring notes. The results showed that melodic contours and rhythm were preserved but individual pitch intervals were conspicuously distorted. Our results support a hypothesis that pitch and rhythm are subserved by independent neural subsystems. We concluded that action-related acoustic information for controlling pitch intervals is stored in the right hemisphere.     

Behavioral and neural correlates of memory selection and interference resolution during a digit working memory task

Neuroimaging studies have shown the involvement of prefrontal and posterior parietal cortexes in regulating information processing. We conducted behavioral and fMRI experiments to investigate the relationship between memory selection and proactive interference (PI), using a delayed recognition task with a selection cue presented during the delay indicating which two of the four studied digits were relevant to the present test. PI was indexed by the response time differences between rejecting probes matching and not matching the no longer relevant digits. By varying the delay intervals, we found that the effect of PI did not diminish, even for cases in which the postcue interval was extended to 9 sec, but was stronger when the precue interval was lengthened to 5 sec. By examining the correlation between PI index and neural correlates of memory selection, we found that stronger PI is predicted by lower selection-related activity in the left inferior parietal lobe, the precuneus, and the dorsal middle frontal gyrus. Our results suggest that activity in the prefrontal-parietal network may contribute to one’s ability to focus on the task-relevant information and may proactively reduce PI in working memory.     

Sequential estimations of time

Sequential estimations of intervals stored and reproduced by either counting or not counting are compared in experiments with single and repeated presentation of the standard interval. In a non-counting condition the estimates show a negative correlation with the last occurring trial throughout the series after one presentation of the standard. Consequently, in an ongoing process the capacity for (the storage and) the recall of time appears to be limited to the most recent event corresponding with the previous estimate. Correlations are lacking when the standard is presented after every estimate because the most recent information is an external constant. The correlations with the last trial recur when relatively long intervals are used, stored on the basis of various sensory cues. When the difference between the number of these cues is minimized, the correlation disappears. Counting never shows sequential correlations since it favors the coding and storage of time as a number of subjective units. The temporal equivalent of that number is constructed from trial to trial, a representation of the complete interval is not available and the subject does not remember his counting rate.     

Toward an interpretation of dynamic neural activity in terms of chaotic dynamical systems

Using the concepts of chaotic dynamical systems, we present an interpretation of dynamic neural activity found in cortical and subcortical areas. The discovery of chaotic itinerancy in high-dimensional dynamical systems with and without a noise term has motivated a new interpretation of this dynamic neural activity, cast in terms of the high-dimensional transitory dynamics among "exotic" attractors. This interpretation is quite different from the conventional one, cast in terms of simple behavior on low-dimensional attractors. Skarda and Freeman (1987) presented evidence in support of the conclusion that animals cannot memorize odor without chaotic activity of neuron populations. Following their work, we study the role of chaotic dynamics in biological information processing, perception, and memory. We propose a new coding scheme of information in chaos-driven contracting systems we refer to as Cantor coding. Since these systems are found in the hippocampal formation and also in the olfactory system, the proposed coding scheme should be of biological significance. Based on these intensive studies, a hypothesis regarding the formation of episodic memory is given.     

Dissociative states and neural complexity

Recent findings indicate that neural mechanisms of consciousness are related to integration of distributed neural assemblies. This neural integration is particularly vulnerable to past stressful experiences that can lead to disintegration and dissociation of consciousness. These findings suggest that dissociation could be described as a level of neural disintegration reflecting a number of independent processes by means of neural complexity. In the present study measurement of dissociation, traumatic stress symptoms and neural complexity calculated using nonlinear analysis of EEG [during rest conditions], and electrodermal activity (EDA) [during rest and Stroop task] were performed in 52 university students (mean age 24.1). Neural complexity has been described using pointwise correlation dimension (PD2) calculated from EEG and EDA records. While no significant relationship was found between EEG complexity and dissociative symptoms, statistically significant relationship between EDA complexity and dissociative symptoms during rest, but not during the Stroop task, has been found. These results indicate that electrodermal complexity during rest may reflect a level of dissociative symptoms.     

时间判断的视听通道效应的实验研究

该实验用视觉或听觉两种方式一次呈现两个时距,随机地指定其中的一个时距要求被试立即再现或延迟5秒再现。实验结果表明:①对短时距信息(1秒,1.5秒,2秒)的判断,听觉比视觉具有明显的优势,听觉的再现时距较精确,延迟对听觉的时间信息检测的破坏作用较小;而对长时距信息(10秒,11秒,12秒)的判断,却未发现听觉比视觉有优势现象。②通道效应的产生机制源于记忆的特点而不是感觉储存的特点。③对短时距的判断通常表现为正时间顺序误差,而对长时距的判断则表现为负时间顺序误差。     

Four applications of permutation methods to testing a single-mediator model

Four applications of permutation tests to the single-mediator model are described and evaluated in this study. Permutation tests work by rearranging data in many possible ways in order to estimate the sampling distribution for the test statistic. The four applications to mediation evaluated here are the permutation test of ab, the permutation joint significance test, and the noniterative and iterative permutation confidence intervals for ab. A Monte Carlo simulation study was used to compare these four tests with the four best available tests for mediation found in previous research: the joint significance test, the distribution of the product test, and the percentile and bias-corrected bootstrap tests. We compared the different methods on Type I error, power, and confidence interval coverage. The noniterative permutation confidence interval for ab was the best performer among the new methods. It successfully controlled Type I error, had power nearly as good as the most powerful existing methods, and had better coverage than any existing method. The iterative permutation confidence interval for ab had lower power than do some existing methods, but it performed better than any other method in terms of coverage. The permutation confidence interval methods are recommended when estimating a confidence interval is a primary concern. SPSS and SAS macros that estimate these confidence intervals are provided.     

Propofol induction reduces the capacity for neural information integration: Implications for the mechanism of consciousness and general anesthesia

The cognitive unbinding paradigm suggests that the synthesis of neural information is attenuated by general anesthesia. Here, we analyzed the functional organization of brain activities in the conscious and anesthetized states, based on functional segregation and integration. Electroencephalography (EEG) recordings were obtained from 14 subjects undergoing induction of general anesthesia with propofol. We quantified changes in mean information integration capacity in each band of the EEG. After induction with propofol, mean information integration capacity was reduced most prominently in the γ band of the EEG (p = .0001). Furthermore, we demonstrate that loss of consciousness is reflected by the breakdown of the spatiotemporal organization of γ waves. We conclude that induction of general anesthesia with propofol reduces the capacity for information integration in the brain. These data directly support the information integration theory of consciousness and the cognitive unbinding paradigm of general anesthesia.     

Auditory and visual differences in time perception

The present experiment assessed intersensory differences in temporal judgments, that is, auditory stimuli are perceived as longer than physically equivalent visual stimuli. The results confirmed the intersensory difference. Auditorially defined intervals were experienced as longer than visually defined intervals. Auditory boundaries were perceived as longer than visual ones. An interaction of boundary modality and interval modality was obtained which suggested that auditorially defined intervals provided more temporal information about events occurring in close temporal proximity than visually defined intervals. It was hypothesized that cognitive factors, specifically stimulus complexity, would affect the auditory and visual systems differentially. This hypothesis was not substantiated, although highly complex stimuli were experienced as longer than those of low complexity.     

Long-term memory of color stimuli in the jungle crow (Corvus macrorhynchos)

Wild-caught jungle crows (n = 20) were trained to discriminate between color stimuli in a two-alternative discrimination task. Next, crows were tested for long-term memory after 1-, 2-, 3-, 6-, and 10-month retention intervals. This preliminary study showed that jungle crows learn the task and reach a discrimination criterion (80% or more correct choices in two consecutive sessions of ten trials) in a few trials, and some even in a single session. Most, if not all, crows successfully remembered the constantly reinforced visual stimulus during training after all retention intervals. These results suggest that jungle crows have a high retention capacity for learned information, at least after a 10-month retention interval and make no or very few errors. This study is the first to show long-term memory capacity of color stimuli in corvids following a brief training that memory rather than rehearsal was apparent. Memory of visual color information is vital for exploitation of biological resources in crows. We suspect that jungle crows could remember the learned color discrimination task even after a much longer retention interval.     

事件相关振荡与振荡脑网络

事件相关振荡是伴随认知、情感和行为过程的脑电磁振荡活动,观察到其各类调频、调幅和调相现象,这种介观和宏观尺度上大量神经元的集体活动与微观尺度上神经元平均发放率和发放定时相互影响,共同参与神经信息的编码、表征、通讯和调控。动态细胞集群假说认为大脑认知功能是神经网络通过同步振荡相互作用的结果,在基于振荡的大脑理论指引下,多尺度、跨脑区和跨频率事件相关振荡研究为揭开振荡脑网络的工作原理带来了希望     

Temporal specificity of perceptual learning in an auditory discrimination task

Although temporal processing is used in a wide range of sensory and motor tasks, there is little evidence as to whether a single centralized clock or a distributed system underlies timing in the range of tens to hundreds of milliseconds. We investigated this question by studying whether learning on an auditory interval discrimination task generalizes across stimulus types, intervals, and frequencies. The degree to which improvements in timing carry over to different stimulus features constrains the neural mechanisms underlying timing. Human subjects trained on a 100- or 200-msec interval discrimination task showed an improvement in temporal resolution. This learning generalized to a perceptually distinct duration stimulus, as well as to the trained interval presented with tones at untrained spectral frequencies. The improvement in performance did not generalize to untrained intervals. To determine if spectral generalization was dependent on the importance of frequency information in the task, subjects were simultaneously trained on two different intervals identified by frequency. As a whole, our results indicate that the brain uses circuits that are dedicated to specific time spans, and that each circuit processes stimuli across nontemporal stimulus features. The patterns of generalization additionally indicate that temporal learning does not rely on changes in early, subcortical processing, because the nontemporal features are encoded by different channels at early stages.     

Aging and judgments of duration: effects of task complexity and method of estimation.

The effects of aging on judgments of short temporal durations were explored using the prospective paradigm and the methods of verbal estimation and production. Younger and older adults performed a perceptual judgment task at five levels of complexity for periods of 30, 60, and 120 sec. Participants either continued to perform the task for a specified interval (production) or were stopped and then verbally estimated the interval. Older adults gave shorter verbal estimates and longer productions than did younger adults. The methods of verbal estimation and production yielded approximately equal duration judgment ratios once range effects were taken into account. Task complexity had little effect. The major conclusion is that duration judgment ratios decrease from younger to older adults when the intervals are filled with a mental task.     

Aging and judgments of duration: Effects of task complexity and method of estimation

The effects of aging on judgments of short temporal durations were explored using the prospective paradigm and the methods of verbal estimation and production. Younger and older adults performed a perceptual judgment task at five levels of complexity for periods of 30, 60, and 120 sec. Participants either continued to perform the task for a specified interval (production) or were stopped and then verbally estimated the interval. Older adults gave shorter verbal estimates and longer productions than did younger adults. The methods of verbal estimation and production yielded approximately equal duration judgment ratios once range effects were taken into account. Task complexity had little effect. The major conclusion is that duration judgment ratios decrease from younger to older adults when the intervals are filled with a mental task.     

A developmental study of the effect of familiarity on short-term visual memory

An attempt was made to specify whether previously reported limitations on young children's full-report capacity lay in a smaller amount of available information, in a shorter trace duration of information in visual information storage (VIS), or in poorer coding of information into permanent storage. Five- and 8-year-olds and adults were shown an eight-item array of figures. followed at varying intervals by an indicator signaling the subject to report the figure to which the indicator had pointed. The effects of three levels of familiarity or “labelability” were examined. While no age differences were revealed in amount of information available nor in the trace duration of information in VIS, strong age differences emerged in coding of information into permanent storage. Data on latency to verbal labeling and familiarity suggested that verbal labeling could not account for the age trends. Rather, the differences seemed to lie in the use of organized visual coding and rehearsal strategies by adults and their relative lack of use by children.