The brain generates its own sentence melody: a Gestalt phenomenon in speech perception

Brain processes underlying spoken language comprehension comprise auditory encoding, prosodic analysis and linguistic evaluation. Auditory encoding usually activates both hemispheres while language-specific stages are lateralized: analysis of prosodic cues are right-lateralized while linguistic evaluation is left-lateralized. Here, we investigated to what extent the absence of prosodic information influences lateralization. MEG brain-responses indicated that syntactic violations lead to early bi-lateral brain responses for syntax violations. When the pitch of sentences was flattened to diminish prosodic cues, the brain's syntax response was lateralized to the right hemisphere, indicating that the missing pitch was generated automatically by the brain when it was absent. This represents a Gestalt phenomenon, since we perceive more than is actually presented.     

Lexical access in early stages of visual word processing: A single-trial correlational MEG study of heteronym recognition

We present an MEG study of heteronym recognition, aiming to distinguish between two theories of lexical access: the ‘early access’ theory, which entails that lexical access occurs at early (pre 200 ms) stages of processing, and the ‘late access’ theory, which interprets this early activity as orthographic word-form identification rather than genuine lexical access. A correlational analysis method was employed to examine effects of the heteronyms’ form and lexical properties on brain activity. We find support for the ‘late access’ view, in that lexical properties did not affect processing until after 300 ms, while earlier activation was primarily modulated by orthographic form.     

On the early left-anterior negativity (ELAN) in syntax studies

Within the framework of Friederici’s (2002) neurocognitive model of sentence processing, the early left anterior negativity (ELAN) in event-related potentials (ERPs) has been claimed to be a brain marker of syntactic first-pass parsing. As ELAN components seem to be exclusively elicited by word category violations (phrase structure violations), they have been taken as strong empirical support for syntax-first models of sentence processing and have gained considerable impact on psycholinguistic theory in a variety of domains. The present article reviews relevant ELAN studies and raises a number of serious issues concerning the reliability and validity of the findings. We also discuss how baseline problems and contextual factors can contribute to early ERP effects in studies examining word category violations. We conclude that - despite the apparent wealth of ELAN data - the functional significance of these findings remains largely unclear. The present paper does not claim to have falsified the existence of ELANs or syntax-related early frontal negativities. However, by separating facts from myths, the paper attempts to make a constructive contribution to how future ERP research in the area of syntax processing may better advance our understanding of online sentence comprehension.     

Neuronal correlates of full and partial visual conscious perception

Stimuli may induce only partial consciousness—an intermediate between null and full consciousness—where the presence but not identity of an object can be reported. The differences in the neuronal basis of full and partial consciousness are poorly understood. We investigated if evoked and oscillatory activity could dissociate full from partial conscious perception. We recorded human cortical activity with magnetoencephalography (MEG) during a visual perception task in which stimulus could be either partially or fully perceived. Partial consciousness was associated with an early increase in evoked activity and theta/low-alpha-band oscillations while full consciousness was also associated with late evoked activity and beta-band oscillations. Full from partial consciousness was dissociated by stronger evoked activity and late increase in theta oscillations that were localized to higher-order visual regions and posterior parietal and prefrontal cortices. Our results reveal both evoked activity and theta oscillations dissociate partial and full consciousness.     

Contribution of acetylcholine to visual cortex plasticity

Acetylcholine is involved in a variety of brain functions. In the visual cortex, the pattern of cholinergic innervation varies considerably across different mammalian species and across different cortical layers within the same species. The physiological effects of acetylcholine in the visual cortex display complex responses, which are likely due to cholinergic receptor subtype composition in cytoplasm membrane as well as interaction with other transmitter systems within the local neural circuitry. The functional role of acetylcholine in visual cortex is believed to improve the signal-to-noise ratio of cortical neurons during visual information processing. Available evidence suggests that acetylcholine is also involved in experience-dependent visual cortex plasticity. At the level of synaptic transmission, activation of muscarinic receptors has been shown to play a permissive role in visual cortex plasticity. Among the muscarinic receptor subtypes, the M(1) receptor seems to make a predominant contribution towards modifications of neural circuitry. The signal transduction cascade of the cholinergic pathway may act synergistically with that of the NMDA receptor pathway, whose activation is a prerequisite for cortical plasticity.     

Effects of visual complexity and sublexical information in the occipitotemporal cortex in the reading of Chinese phonograms: a single-trial analysis with MEG

We employ a linear mixed-effects model to estimate the effects of visual form and the linguistic properties of Chinese characters on M100 and M170 MEG responses from single-trial data of Chinese and English speakers in a Chinese lexical decision task. Cortically constrained minimum-norm estimation is used to compute the activation of M100 and M170 responses in functionally defined regions of interest. Both Chinese and English participants’ M100 responses tend to increase in response to characters with a high numbers of strokes. English participants’ M170 responses show a posterior distribution and only reflect the effect of the visual complexity of characters. On the other hand, the Chinese participants’ left hemisphere M170 is increased when reading characters with high number of strokes, and their right hemisphere M170 is increased when reading characters with small combinability of semantic radicals. Our results suggest that expertise with words and the decomposition of word forms underlies processing in the left and right occipitotemporal regions in the reading of Chinese characters by Chinese speakers.     

The role of the human extrastriate visual cortex in mirror symmetry discrimination: a TMS-adaptation study

The human visual system is able to efficiently extract symmetry information from the visual environment. Prior neuroimaging evidence has revealed symmetry-preferring neuronal representations in the dorsolateral extrastriate visual cortex; the objective of the present study was to investigate the necessity of these representations in symmetry discrimination. This was accomplished by the use of state-dependent transcranial magnetic stimulation, which combines the fine resolution of adaptation paradigms with the assessment of causality. Subjects were presented with adapters and targets consisting of dot configurations that could be symmetric along either the vertical or horizontal axis (or they could be non-symmetric), and they were asked to perform a symmetry discrimination task on the targets while fixating the center of the screen. TMS was applied during the delay between the adapter and the test stimulus over one of four different sites: Left or Right V1/V2, or left or right dorsolateral extrastriate cortex (DLO). TMS over both Left and Right DLO reduced the adaptation effect in detecting vertical and horizontal symmetry, although the Left DLO effect on horizontal symmetry and the Right DLO effect on both vertical and horizontal symmetry were present only when considering subjects who showed a behavioral adaptation effect in the baseline No-TMS condition. Application of TMS over the Left or Right V1/V2 did not modulate the adaptation effect. Overall, these data suggest that both the Left and Right DLO contain neuronal representations tuned to mirror symmetry which play a causal role in symmetry discrimination.     

Syntactic reconstruction and reanalysis,semantic dead ends,and prefrontal cortex

The left inferior frontal gyrus (LIFG) is crucially has been found to be involved in syntactic processing of various kinds. This study investigates the cortical effects of two types of syntactic processes: (i) Reconstruction in ellipsis (recovery of left-out material given by context, More people have been to Paris than […] to Oslo), using pseudo-elliptical structures (‘dead ends’) as control (More people have been to Paris than I have). (ii) Reanalysis in the face of structural ambiguity in syntactic ‘garden paths’, where the parser initially assigns an incorrect structure and is forced to reanalyze. Reanalysis and reconstruction require additional syntactic processing and were predicted to increase activation in areas otherwise involved in structural computation: LIFG (BA 44, 45), premotor BA 6, and posterior temporal BA 21, 22. This was borne out. The results showed an interaction effect of the types of construction in all three areas reflecting syntactic processing.     

Spatial working memory effects in early visual cortex

The present study investigated how spatial working memory recruits early visual cortex. Participants were required to maintain a location in working memory while changes in blood oxygen level dependent (BOLD) signals were measured during the retention interval in which no visual stimulation was present. We show working memory effects during the retention period in early visual cortex which were retinotopically organized in the sense that evoked BOLD responses were specific to the position of the remembered location on an imaginary clock. We demonstrate that this activity is similar to activity observed in conditions in which participants have to direct spatial attention to the same location. We suggest that during the retention interval modulation of neurons coding the remembered location evoke a baseline shift, providing converging evidence for the notion that spatial working memory may use spatial attention as a rehearsal mechanism.     

From semantics to syntax and back again: argument structure in the third year of life

An essential part of the human capacity for language is the ability to link conceptual or semantic representations with syntactic representations. On the basis of data from spontaneous production, suggested that young children acquire such links on a verb-by-verb basis, with little in the way of a general understanding of linguistic argument structure. Here, we suggest that a receptive understanding of argument structure--including principles linking syntax and conceptual/semantic structure--appears earlier. In a forced-choice pointing task we have shown that toddlers in the third year of life can map a single scene (involving a novel causative action paired with a novel verb) onto two distinct syntactic frames (transitive and intransitive). This suggests that even before toddlers begin generalizing argument structure in their own speech, they have some representation of conceptual/semantic categories, syntactic categories, and a system that links the two.     

Visual asymmetry revisited: Mind wandering preferentially disrupts processing in the left visual field

An emerging theory proposes that visual attention operates in parallel at two distinct time scales – a shorter one (<1 s) associated with moment-to-moment orienting of selective visuospatial attention, and a longer one (>10 s) associated with more global aspects of attention-to-task. Given their parallel nature, here we examined whether these comparatively slower fluctuations in task-related attention show the same visual field asymmetry – namely, a right visual field bias – as often reported for selective visual–spatial attention. Participants performed a target detection task at fixation while event-related potentials (ERP) time-locked to task-irrelevant visual probes presented in the left and right visual fields were recorded. At random intervals, participants were asked to report whether they were “on-task” or “mind wandering”. Our results demonstrated that sensory attenuation during periods of “mind wandering” relative to “on-task”, as measured by the visual P1 ERP component at electrodes sites contralateral to the stimulus, was only observed for probes presented in the left visual field. In contrast, the magnitude of sensory gain in the right visual field was insensitive to whether participants were “on-task” or “mind wandering”. Taken together, our results support the notion that task-related attention at longer time scales and spatial attention at shorter time scales affect the same underlying mechanism in visual cortex.     

Exploring and Exploiting Uncertainty: Statistical Learning Ability Affects How We Learn to Process Language Along Multiple Dimensions of Experience

While the effects of pattern learning on language processing are well known, the way in which pattern learning shapes exploratory behavior has long gone unnoticed. We report on the way in which individual differences in statistical pattern learning affect performance in the domain of language along multiple dimensions. Analyzing data from healthy monolingual adults' performance on a serial reaction time task and a self-paced reading task, we show how individual differences in statistical pattern learning are reflected in readers' knowledge of linguistic co-occurrence patterns and in their exploration and exploitation of content-specific and task-general information. First, we investigated the extent to which an individual's pattern learning correlates with his or her sensitivity to systematic morphological and syntactic co-occurrences, as evidenced while reading authentic sentences. We found that the stream of morphological and syntactic information has a more pronounced effect on the reading speed of, as we will label them, content-sensitive learners in that the more probable the co-occurrence pattern, the faster their reading of that pattern will be. Next, we investigated how differences in pattern learning are reflected in the ways in which individuals approach the reading task itself and adapt to it. Casting this relation in terms of exploration/exploitation strategies, known from Reinforcement Learning, we conclude that content-sensitive learners are also more likely to initially probe (explore) a wider range of directly relevant patterns, which they can later use (exploit) to optimize their reading performance further. By affecting exploratory behavior, pattern learning influences the information that is gathered and becomes available for exploitation, thereby increasing the effect pattern learning has on language cognition.     

The modulatory impact of reward and attention on global feature selection in human visual cortex

Reward powerfully influences human behaviour and perception, with reward effects being observed already on the level of basic sensory processing. Although reward-related modulations generally resemble those related to attentional selection, it is debated whether these effects indeed reflect the same selection operations. Here we focus on neuromagnetic indices of global colour-based attention in visual cortex, and ask whether reward elicits the same or separable underlying modulation effects. Observers performed a colour/orientation selection task where colour served to define the target as well as reward prospect. On each trial a target containing the target colour and one other colour was presented in the left visual field (VF) together with a bicoloured distractor in the right VF. Reward was delivered on correctly performed trials when the reward colour appeared in the target but not when it appeared in the distractor. The effect of global colour selection was assessed by comparing the brain response to the distractor depending on whether it contained the target colour, the reward colour, both, or neither. We observed that both the reward and target colour led to similar increases of the neuromagnetic response between ~200–260 ms originating from the same ventral extrastriate visual cortex areas, albeit slightly temporally lagged. Importantly, the response to the target and reward colour alone always added up to match the response size of their combined presentation. These results suggest that while reward and attention recruit the same global feature selection effects in extrastriate visual cortex, they are likely controlled by independent top-down influences.     

How retaining objects containing multiple features in visual working memory regulates the priority for access to visual awareness

The content of visual working memory influences the access to visual awareness. Thus far, research has focused on retention of a single feature, whereas memoranda in real life typically contain multiple features. Here, we intermixed a delayed match-to-sample task to manipulate VWM content, and a breaking Continuous Flash Suppression (b-CFS) task to measure prioritization for visual awareness. Observers memorized either the color (Exp. 1), the shape (Exp. 2) or both the features (Exp. 3) of an item and indicated the location of a suppressed target. We observed that color-matching targets broke suppression faster than color-mismatching targets both when color was memory relevant or irrelevant. Shape only impacted priority for visual awareness through an interaction with color. We conclude that: (1) VWM can regulate the priority of visual information to access visual awareness along a single feature dimension; (2) different features of a memorandum vary in their potency to impact access to visual awareness, and the more dominant feature may even suppress the effect of the less dominant feature; (3) even stimuli that match an irrelevant feature dimension of the memorandum can be prioritized for visual awareness.     

Proneness to psychosis and selection of objects of visual attention: individual differences in visual marking

Deficits in early visual attention and perceptual organisation have frequently been shown to associate with both poor pre-morbid schizophrenia and those at a greater putative risk of psychosis. The nature of the deficit is unclear. The present study investigated the relationship between speed of visual marking and proneness to psychosis. 20 males and 20 females completed several tasks assessing speed of selection and de-selection of visual objects. As predicted, negative schizotypy was associated with poorer marking in males, but socially desirable responding potentially confounded this result. In addition, impulsive non-conformity swas associated with poorer visual marking, more prominently in females. These results are discussed in relation to possible mechanisms by which psychosis-proneness and impulsivity may restrict the top–down influences operating on early visual attention.     

Strategic and automatic effects of visual working memory on attention in visual search

Previous research indicates that visual attention can be automatically captured by sensory inputs that match the contents of visual working memory. However, Woodman and Luck (2007) showed that information in working memory can be used flexibly as a template for either selection or rejection according to task demands. We report two experiments that extend their work. Participants performed a visual search task while maintaining items in visual working memory. Memory items were presented for either a short or long exposure duration immediately prior to the search task. Memory was tested by a change-detection task immediately afterwards. On a random half of trials items in memory matched either one distractor in the search task (Experiment 1) or three (Experiment 2). The main result was that matching distractors speeded or slowed target detection depending on whether memory items were presented for a long or short duration. These effects were more in evidence with three matching distractors than one. We conclude that the influence of visual working memory on visual search is indeed flexible but is not solely a function of task demands. Our results suggest that attentional capture by perceptual inputs matching information in visual working memory involves a fast automatic process that can be overridden by a slower top-down process of attentional avoidance.     

Positive mood broadens visual attention to positive stimuli

In an attempt to investigate the impact of positive emotions on visual attention within the context of Fredrickson’s (1998) broaden-and-build model, eye tracking was used in two studies to measure visual attentional preferences of college students (n=58, n=26) to emotional pictures. Half of each sample experienced induced positive mood immediately before viewing slides of three similarly-valenced images, in varying central-peripheral arrays. Attentional breadth was determined by measuring the percentage viewing time to peripheral images as well as by the number of visual saccades participants made per slide. Consistent with Fredrickson’s theory, the first study showed that individuals induced into positive mood fixated more on peripheral stimuli than did control participants; however, this only held true for highly-valenced positive stimuli. Participants under induced positive mood also made more frequent saccades for slides of neutral and positive valence. A second study showed that these effects were not simply due to differences in emotional arousal between stimuli. Selective attentional broadening to positive stimuli may act both to facilitate later building of resources as well as to maintain current positive affective states.     

The role of priming in conjunctive visual search

To assess the role of priming in conjunctive visual search tasks, we systematically varied the consistency of the target and distractor identity between different conditions. Search was fastest in the standard conjunctive search paradigm where identities remained constant. Search was slowest when potential target identity varied predictably for each successive trial (the 'switch' condition). The role of priming was also demonstrated on a trial-by-trial basis in a 'streak' condition where target and distractor identity was unpredictable yet was consistent within streaks. When the target to be found was the same for a few trials in a row, search performance became similar to that when the potential target was the same on all trials. A similar pattern was found for the target absent trials, suggesting that priming is based on the whole search array rather than just the target in each case. Further analysis indicated that the effects of priming are sufficiently strong to account for the advantage seen for the conjunctive search task. We conclude that the role of priming in visual search is underestimated in current theories of visual search and that differences in search times often attributed to top-down guidance may instead reflect the benefits of priming.     

Low-level visual attention and its relation to joint attention in autism spectrum disorder

Visual attention is integral to social interaction and is a critical building block for development in other domains (e.g., language). Furthermore, atypical attention (especially joint attention) is one of the earliest markers of autism spectrum disorder (ASD). The current study assesses low-level visual attention and its relation to social attentional processing in youth with ASD and typically developing (TD) youth, aged 7 to 18 years. The findings indicate difficulty overriding incorrect attentional cues in ASD, particularly with non-social (arrow) cues relative to social (face) cues. The findings also show reduced competition in ASD from cues that remain on-screen. Furthermore, social attention, autism severity, and age were all predictors of competing cue processing. The results suggest that individuals with ASD may be biased towards speeded rather than accurate responding, and further, that reduced engagement with visual information may impede responses to visual attentional cues. Once attention is engaged, individuals with ASD appear to interpret directional cues as meaningful. These findings from a controlled, experimental paradigm were mirrored in results from an ecologically valid measure of social attention. Attentional difficulties may be exacerbated during the complex and dynamic experience of actual social interaction. Implications for intervention are discussed.     

Culture and sensory response to visual stimuli

This study investigated the influence of culture on people's sensory responses, such as smell, taste, sound and touch to visual stimuli. The sensory feelings of university students from four countries (Japan, South Korea, Britain and France) to six images were evaluated. The images combined real and abstract objects and were presented on a notebook computer. Overall, 280 participants (144 men and 136 women; n = 70/country) were included in the statistical analysis. The chi‐square independence analysis showed differences and similarities in the sensory responses across countries. Most differences were detected in smell and taste, whereas few variations were observed for sound responses. Large variations in the response were observed for the abstract coral and butterfly images, but few differences were detected in response to the real leaf image. These variations in response were mostly found in the British and Japanese participants.