Syntactic working memory and the establishment of filler-gap dependencies: insights from ERPs and fMRI

In this contribution, we review an ERP experiment and an fMRI experiment which investigated the processing of German wh-questions. On the basis of the ERP results, we will discuss current models of sentence processing and resource distribution during sentence comprehension. We argue that there exists a separate cognitive or neural resource that supports syntactic working memory processes necessary for the temporary maintenance of syntactic information for the parser. In the context of wh-movement, such a memory component is necessary for establishing filler-gap dependencies. The data obtained from the fMRI experiment will be used to discuss the results of previous neuroimaging studies of sentence processing. It is claimed that syntactic working memory, rather than syntactic processing per se, is supported by Broca's Area.     

Sweet-cheeks vs. pea-brain: embodiment,valence, and task all influence the emotional salience of language

Previous research has found that more embodied insults (e.g. numbskull) are identified faster and more accurately than less embodied insults (e.g. idiot). The linguistic processing of embodied compliments has not been well explored. In the present study, participants completed two tasks where they identified insults and compliments, respectively. Half of the stimuli were more embodied than the other half. We examined the late positive potential (LPP) component of event-related potentials in early (400–500?ms), middle (500–600?ms), and late (600–700?ms) time windows. Increased embodiment resulted in improved response accuracy to compliments in both tasks, whereas it only improved accuracy for insults in the compliment detection task. More embodied stimuli elicited a larger LPP than less embodied stimuli in the early time window. Insults generated a larger LPP in the late time window in the insult task; compliments generated a larger LPP in the early window in the compliment task. These results indicate that electrophysiological correlates of emotional language perception are sensitive to both top-down and bottom-up processes.     

Effects of speed of word processing on semantic access: the case of bilingualism

Bilingual speakers generally manifest slower word recognition than monolinguals. We investigated the consequences of the word processing speed on semantic access in bilinguals. The paradigm involved a stream of English words and pseudowords presented in succession at a constant rate. English-Welsh bilinguals and English monolinguals were asked to count the number of letters in pseudowords and actively disregard words. They were not explicitly told that pairs of words in immediate succession were embedded and could either be semantically related or not. We expected that slower word processing in bilinguals would result in semantic access indexed by semantic priming. As expected, bilinguals showed significant semantic priming, indexed by an N400 modulation, whilst monolinguals did not. Moreover, bilinguals were slower in performing the task. The results suggest that bilinguals cannot discriminate between pseudowords and words without accessing semantic information whereas monolinguals can dismiss English words on the basis of subsemantic information.     

Neural correlates of audiovisual integration of semantic category information

Previous studies have found a late frontal-central audiovisual interaction during the time period about 150-220 ms post-stimulus. However, it is unclear to which process is this audiovisual interaction related: to processing of acoustical features or to classification of stimuli? To investigate this question, event-related potentials were recorded during a words-categorization task with stimuli presented in the auditory-visual modality. In the experiment, congruency of the visual and auditory stimuli was manipulated. Results showed that within the window of about 180-210 ms post-stimulus more positive values were elicited by category-congruent audiovisual stimuli than category-incongruent audiovisual stimuli. This indicates that the late frontal-central audiovisual interaction is related to audiovisual integration of semantic category information.     

Does simile comprehension differ from metaphor comprehension? A functional MRI study

Since Aristotle, people have believed that metaphors and similes express the same type of figurative meaning, despite the fact that they are expressed with different sentence patterns. In contrast, recent psycholinguistic models have suggested that metaphors and similes may promote different comprehension processes. In this study, we investigated the neural substrates involved in the comprehension of metaphor and simile using functional magnetic resonance imaging (fMRI) to evaluate whether simile comprehension differs from metaphor comprehension or not. In the metaphor and simile sentence conditions, higher activation was seen in the left inferior frontal gyrus. This result suggests that the activation in both metaphor and simile conditions indicates similar patterns in the left frontal region. The results also suggest that similes elicit higher levels of activation in the medial frontal region which might be related to inference processes, whereas metaphors elicit more right-sided prefrontal activation which might be related to figurative language comprehension.     

Anterior cingulate cortex activation is related to learning potential on the WCST in schizophrenia patients

The remediation of executive function in patients with schizophrenia is important in rehabilitation because these skills affect the patient's capacity to function in the community. There is evidence that instructional techniques can improve deficits in the Wisconsin Card Sorting Test (WCST) in some schizophrenia patients. We used a standard test/training phase/standard test format of the WCST to classify 36 schizophrenia patients as high-achievers, learners or non-retainers. All healthy controls performed as high-achievers. An event-related fMRI design assessed neural activation patterns during post-training WCST performance. Patients showed a linear trend between set-shifting related activation in the anterior cingulate cortex and learning potential, i.e. increased activation in high-achievers, a trend for increased activation in learners, and no activation in non-retainers compared to controls. In addition, activation in the temporoparietal cortex was highest in patients classified as learners, whereas in non-retainers activation was increased in the inferior frontal gyrus compared to controls and high-achieving patients. These results emphasize the relevance of the ACC's neural integrity in learning set-shifting strategies for patients with schizophrenia. Also, our results support the hypothesis that compensatory neural activation in patients with schizophrenia helps them to catch up with healthy controls on cognitive tasks.     

Dissociable stages of problem solving (II): first evidence for process-contingent temporal order of activation in dorsolateral prefrontal cortex

In a companion study, eye-movement analyses in the Tower of London task (TOL) revealed independent indicators of functionally separable cognitive processes during problem solving, with processes of building up an internal representation of the problem preceding actual planning processes. These results imply that processes of internalization and planning should also be distinguishable in time and space with respect to concomitant brain activation patterns. To investigate this possibility, here we conducted analyses of fMRI data for left and right dorsolateral prefrontal cortex (dlPFC) during problem solving in the TOL task by accounting for the trial-by-trial variability of onsets and durations of the different cognitive processing stages. Comparisons between stimulus-locked and response-locked modeling approaches affirmed that activation in left dlPFC was elicited particularly during early processes of internalization, comprising the extraction of goal information and the generation of an internal problem representation, whereas activation in right dlPFC was predominantly attributable to later processes of mental transformations on this representation, that is planning proper. Thus, present data corroborate the proposal that often observed bilateral dlPFC activation patterns during complex cognitive tasks such as problem solving may reflect functionally and, to some extent, even temporally separable processes with opposing lateralizations.     

Evidence for mental ability related individual differences in the attentional blink obtained by an analysis of the P300 component

Attentional blink (AB) refers to impaired identification of a target (T2) when this target follows a preceding target (T1) after about 150-450 ms within a stream of rapidly presented stimuli. Previous research on a possible relation between AB and mental ability (MA) turned out to be highly ambiguous. The present study investigated MA-related individual differences in consolidation of T2 in working memory during the AB as indicated by the P300 component of the event-related potential. Thirty high (HA) and 30 low MA (LA) female participants performed an AB task while their brain activity was recorded. The AB did not differ between the two groups. HA individuals exhibited a larger P300 amplitude and longer P300 latencies during the AB suggesting higher mental effort. This higher mental effort, however, did not result in better performance presumably because of more competition between target and distractor stimuli in HA than LA individuals.     

Defining face perception areas in the human brain: a large-scale factorial fMRI face localizer analysis

A number of human brain areas showing a larger response to faces than to objects from different categories, or to scrambled faces, have been identified in neuroimaging studies. Depending on the statistical criteria used, the set of areas can be overextended or minimized, both at the local (size of areas) and global (number of areas) levels. Here we analyzed a whole-brain factorial functional localizer obtained in a large sample of right-handed participants (40). Faces (F), objects (O; cars) and their phase-scrambled counterparts (SF, SO) were presented in a block design during a one-back task that was well matched for difficulty across conditions. A conjunction contrast at the group level {(F-SF) and (F-O)} identified six clusters: in the pulvinar, inferior occipital gyrus (so-called OFA), middle fusiform gyrus (so-called FFA), posterior superior temporal sulcus, amygdala, and anterior infero-temporal cortex, which were all strongly right lateralized. While the FFA showed the largest difference between faces and cars, it also showed the least face-selective response, responding more to cars than scrambled cars. Moreover, the FFA's larger response to scrambled faces than scrambled cars suggests that its face-sensitivity is partly due to low-level visual cues. In contrast, the pattern of activation in the OFA points to a higher degree of face-selectivity. A BOLD latency mapping analysis suggests that face-sensitivity emerges first in the right FFA, as compared to all other areas. Individual brain analyses support these observations, but also highlight the large amount of interindividual variability in terms of number, height, extent and localization of the areas responding preferentially to faces in the human ventral occipito-temporal cortex. This observation emphasizes the need to rely on different statistical thresholds across the whole brain and across individuals to define these areas, but also raises some concerns regarding any objective labeling of these areas to make them correspond across individual brains. This large-scale analysis helps understanding the set of face-sensitive areas in the human brain, and encourages in-depth single participant analyses in which the whole set of areas is considered in each individual brain.     

Modulation of N400 in chronic non-fluent aphasia using low frequency Repetitive Transcranial Magnetic Stimulation (rTMS)

Low frequency Repetitive Transcranial Magnetic Stimulation (rTMS) has previously been applied to language homologues in non-fluent populations of persons with aphasia yielding significant improvements in behavioral language function up to 43 months post stimulation. The present study aimed to investigate the electrophysiological correlates associated with the application of rTMS through measurement of the semantic based N400 Event-related brain potentials (ERP) component. Low frequency (1 Hz) rTMS was applied to the anterior portion of the homologue to Broca’s area (pars triangularis), for 20 min per day for 10 days, using a stereotactic neuronavigational system. Twelve non-fluent persons with aphasia, 2-6 years post stroke were stimulated. Six participants were randomly assigned to receive real stimulation and six participants were randomly assigned to receive a blind sham control condition. ERP measures were recorded at baseline, 1 week and 2 months subsequent to stimulation. The findings demonstrate treatment related changes observed in the stimulation group when compared to the placebo control group at 2 months post stimulation indicating neuromodulation of N400 as a result of rTMS. No treatment related changes were identified in the stimulation group, when compared to the sham group from baseline to 1 week post stimulation. The electrophysiological results represent the capacity of rTMS to modulate neural language networks and measures of lexical-semantic function in participants with non-fluent aphasia and suggest that time may be an important factor in brain reorganization subsequent to rTMS.