The neural bases of difficult speech comprehension and speech production: Two Activation Likelihood Estimation (ALE) meta-analyses

The role of speech production mechanisms in difficult speech comprehension is the subject of on-going debate in speech science. Two Activation Likelihood Estimation (ALE) analyses were conducted on neuroimaging studies investigating difficult speech comprehension or speech production. Meta-analysis 1 included 10 studies contrasting comprehension of less intelligible/distorted speech with more intelligible speech. Meta-analysis 2 (21 studies) identified areas associated with speech production. The results indicate that difficult comprehension involves increased reliance of cortical regions in which comprehension and production overlapped (bilateral anterior Superior Temporal Sulcus (STS) and anterior Supplementary Motor Area (pre-SMA)) and in an area associated with intelligibility processing (left posterior MTG), and second involves increased reliance on cortical areas associated with general executive processes (bilateral anterior insulae). Comprehension of distorted speech may be supported by a hybrid neural mechanism combining increased involvement of areas associated with general executive processing and areas shared between comprehension and production.     

重读与信息结构对语篇理解加工的影响

该研究利用口语动窗技术和双重任务范式,探索了重读与信息结构的匹配关系对语篇理解加工的影响、以及其发挥作用的内部机制。结果表明：与控制条件相比,不一致性重读阻碍语篇的理解加工,而一致性重读对语篇理解的促进作用相对不明显;重读促进焦点词汇的加工,而不重读促进非焦点词汇的加工,从而说明重读影响语篇理解不仅仅是由于它能调控听者的注意力分配,更重要的是重读的有无传达着不同的信息加工方式。     

Shared language: overlap and segregation of the neuronal infrastructure for speaking and listening revealed by functional MRI

Whether the brain's speech-production system is also involved in speech comprehension is a topic of much debate. Research has focused on whether motor areas are involved in listening, but overlap between speaking and listening might occur not only at primary sensory and motor levels, but also at linguistic levels (where semantic, lexical, and syntactic processes occur). Using functional MRI adaptation during speech comprehension and production, we found that the brain areas involved in semantic, lexical, and syntactic processing are mostly the same for speaking and for listening. Effects of primary processing load (indicative of sensory and motor processes) overlapped in auditory cortex and left inferior frontal cortex, but not in motor cortex, where processing load affected activity only in speaking. These results indicate that the linguistic parts of the language system are used for both speaking and listening, but that the motor system does not seem to provide a crucial contribution to listening.     

Regional cerebral blood flow during comprehension and speech (in cerebrally healthy subjects)

Regional cerebral blood flow (rCBF) was measured by the xenon-133 inhalation method in 10 cerebrally healthy subjects at rest and during linguistic activation tests. These consisted of a comprehension test (binaural listening to a narrative text) and a speech test (making sentences from a list of words presented orally at 30-s intervals). The comprehension task induced a moderate increase in the mean right CBF and in both inferior parietal areas, whereas the speech test resulted in a diffuse increase in the mean CBF of both hemispheres, predominating regionally in both inferior parietal, left operculary, and right upper motor and premotor areas. It is proposed that the activation pattern induced by linguistic stimulation depends on not only specific factors, such as syntactic and semantic aspects of language, but also the contents of the material proposed and the attention required by the test situation.     

Is phonological short-term memory related to phonological analysis stages in auditory sentence processing?

Despite extensive research, the role of phonological short-term memory (STM) during oral sentence comprehension remains unclear. We tested the hypothesis that phonological STM is involved in phonological analysis stages of the incoming words, but not in sentence comprehension per se. We compared phonological STM capacity and processing times for natural sentences and sentences containing phonetically ambiguous words. The sentences were presented for an auditory sentence anomaly judgement task and processing times for each word were measured. STM was measured via nonword and word immediate serial recall tasks, indexing phonological and lexicosemantic STM capacity, respectively. Significantly increased processing times were observed for phonetically ambiguous words, relative to natural stimuli in same sentence positions. Phonological STM capacity correlated with the size of this phonetic ambiguity effect. However, phonological STM capacity did not correlate with measures of later semantic integration processes while lexicosemantic STM did. This study suggests that phonological STM is associated with phonological analysis processes during sentence processing.     

Buzzwords: early cortical responses to emotional words during reading

Electroencephalographic event-related brain potentials were recorded as subjects read, without further instruction, consecutively presented sequences of words. We varied the speed at which the sequences were presented (3 Hz and 1 Hz) and the words' emotional significance. Early event-related cortical responses during reading differentiated pleasant and unpleasant words from neutral words. Emotional words were associated with enhanced brain responses arising in predominantly left occipito-temporal areas 200 to 300 ms after presentation. Emotional words were also spontaneously better remembered than neutral words. The early cortical amplification was stable across 10 repetitions, providing evidence for robust enhancement of early visual processing of stimuli with learned emotional significance and underscoring the salience of emotional connotations during reading. During early processing stages, emotion-related enhancement of cortical activity along the dominant processing pathway is due to arousal, rather than valence of the stimuli. This enhancement may be driven by cortico-amygdaloid connections.     

熟悉主题说明文阅读推理加工的认知神经机制

采用功能磁共振成像(Functional Magnetic Resonance Imaging, fMRI)技术对熟悉主题说明文阅读过程因果推理加工进行研究, 探讨说明文阅读过程中读者是否能够自发进行因果推理加工, 以及阅读焦点的存在是否会对说明文阅读过程中的因果推理加工产生影响。结果表明, 读者在熟悉主题说明文阅读过程中能够自动进行推理加工, 负责推理加工的主要脑区为额叶(尤其是额下回)、顶叶下部及双侧楔前叶等区域。在熟悉主题说明文阅读过程中, 阅读焦点的存在一定程度上使读者的认知加工资源集中在对与焦点相关的推理关系的加工上。     

Sentence processing strategies in healthy seniors with poor comprehension: an fMRI study

We used fMRI to examine patterns of brain recruitment in 22 healthy seniors, half of whom had selective comprehension difficulty for grammatically complex sentences. We found significantly reduced recruitment of left posterolateral temporal [Brodmann area (BA) 22/21] and left inferior frontal (BA 44/6) cortex in poor comprehenders compared to the healthy seniors with good sentence comprehension, cortical regions previously associated with language comprehension and verbal working memory, respectively. The poor comprehenders demonstrated increased activation of left prefrontal (BA 9/46), right dorsal inferior frontal (BA 44/6), and left posterior cingulate (BA 31/23) cortices for the grammatically simpler sentences that they understood. We hypothesize that these brain regions support an alternate, nongrammatical strategy for processing complex configurations of symbolic information. Moreover, these observations emphasize the crucial role of the left perisylvian network for grammatically guided sentence processing in subjects with good comprehension.     

提取学习有利于学习与记忆的认知神经基础

研究表明提取学习相比简单重复学习更加益于记忆的保持。近期的脑成像研究发现, 与简单重复学习相比, 提取学习时前额叶、顶下叶、颞叶及一些皮层下结构的脑激活更大, 这些脑区的激活也能预测随后的记忆成绩。这些研究表明, 在更多认知资源的投入和工作记忆系统的参与下, 提取学习是一个获得、加工、整合和巩固语义关系的过程。提取学习充分调用认知和情感、皮层与皮层下机能, 同时还发挥语义和情景记忆优势来促进学习与记忆。     

Poor reading comprehension despite fast word decoding in children with hydrocephalus

Children with hydrocephalus decode words better than they understand what they read. We tested whether children with hydrocephalus (from myelomeningocele or aqueduct stenosis) (1) decode words slowly, (2) use decoding processes similar to those of neurologically intact peers, and (3) comprehend poorly to the extent that they are slow decoders. We compared speed of word decoding in 33 children with hydrocephalus and 33 controls matched on a pairwise basis for age, grade, and word decoding accuracy. The children with hydrocephalus were as fast as controls in reading words, but, unlike controls, they did not demonstrate an effect of spelling-sound regularity. Further, decoding speed did not contribute to reading comprehension beyond word decoding accuracy. The reading comprehension deficits of good decoders with hydrocephalus are not related to early-stage processing deficits in word recognition speed. Likely origins of comprehension failure in this group are discussed.     

Cortical localisation of the visual and auditory word form areas: a reconsideration of the evidence

In this paper we examine the evidence for human brain areas dedicated to visual or auditory word form processing by comparing cortical activation for auditory word repetition, reading, picture naming, and environmental sound naming. Both reading and auditory word repetition activated left lateralised regions in the frontal operculum (Broca's area), posterior superior temporal gyrus (Wernicke's area), posterior inferior temporal cortex, and a region in the mid superior temporal sulcus relative to baseline conditions that controlled for sensory input and motor output processing. In addition, auditory word repetition increased activation in a lateral region of the left mid superior temporal gyrus but critically, this area is not specific to auditory word processing, it is also activated in response to environmental sounds. There were no reading specific activations, even in the areas previously claimed as visual word form areas: activations were either common to reading and auditory word repetition or common to reading and picture naming. We conclude that there is no current evidence for cortical sites dedicated to visual or auditory word form processing.     

Brain activation on pre-reading tasks reveals at-risk status for dyslexia in 6-year-old children

In this fMRI-study, 6-year-old children considered at risk for dyslexia were compared with an age-/gender-matched control group for differences in brain activation when presented with visual stimuli differing in demands for literacy processing. Stimuli were nameable pictures, brand logos familiar to children, and written words - these were either regularly spelled using early-acquired rules ("alphabetic") or more complex ("orthographic"). Brain responses distinguished between the presentation conditions, as a function of group, within many cortical areas. Activation in the alphabetic and orthographic conditions in the left angular gyrus correlated with individual at-risk index scores, and activation in inferior occipito-temporal regions further indicated differential activation for the two groups related to orthographic processing, especially. Since similar patterns are reported in adult dyslexics when processing written words, it appears that sensitivity to the cortical differentiation of reading networks is established prior to formal literacy training.     

New age-linked asymmetries: aging and the processing of familiar versus novel language on the input versus output side

This research demonstrates 3 new age-linked asymmetries between identifying versus retrieving phonological information. Young and older adults read aloud familiar isolated words (e.g., mind) and novel pseudowords (e.g., mond) in a production task and identified lexical status for identical stimuli in a comprehension task. Young adults made fewer errors than older adults in production but not comprehension (an age-related input-output asymmetry), and they produced pseudowords but not words with fewer errors than older adults (a lexical-status asymmetry). The lexical-status asymmetry also occurred for response onset times but not for output durations (an onset-output asymmetry). All 3 asymmetries were predicted under the transmission deficit hypothesis (D. G. MacKay & D. M. Burke, 1990) but contradict theories such as general slowing that cannot explain why aging affects some types of information processing more than others.     

Learning new names for new objects: cortical effects as measured by magnetoencephalography

We tracked the evolvement of naming-related cortical dynamics with magnetoencephalography when five normal adults successfully learned names and/or meanings of unfamiliar objects. In all subjects, the learning of new names was associated with pronounced cortical effects. The learning effect was of long latency and emerged as a change of activation in the same cortical network that was active during naming of familiar items. In four out of five subjects, the cortical learning effect occurred in the inferior parietal lobe. In three of these subjects, the cortical effect was left-sided. These results suggest that the inferior parietal lobe plays an important role in the acquisition of novel words, presumably as a part of working memory systems.     

Large-scale neural network for sentence processing

Our model of sentence comprehension includes at least grammatical processes important for structure-building, and executive resources such as working memory that support these grammatical processes. We hypothesized that a core network of brain regions supports grammatical processes, and that additional brain regions are activated depending on the working memory demands associated with processing a particular grammatical feature. We used functional magnetic resonance imaging (fMRI) to test this hypothesis by comparing cortical activation patterns during coherence judgments of sentences with three different syntactic features. We found activation of the ventral portion of left inferior frontal cortex during judgments of violations of each grammatical feature. Increased recruitment of the dorsal portion of left inferior frontal cortex was seen during judgments of violations of specific grammatical features that appear to involve a more prominent working memory component. Left posterolateral temporal cortex and anterior cingulate were also implicated in judging some of the grammatical features. Our observations are consistent with a large-scale neural network for sentence processing that includes a core set of regions for detecting and repairing several different kinds of grammatical features, and additional regions that appear to participate depending on the working memory demands associated with processing a particular grammatical feature.     

惯用语理解的多种心理机制：不同的证据

惯用语的理解机制一直是心理语言学研究的热点问题。来自语言学和神经生理学的证据都表明,对惯用语的加工存在多样化趋势,而且加工策略和手段会随个体卷入社会生活的程度而变化。惯用语的加工受加工者自身的隐喻知识以及惯用语本身性质的影响。另外,惯用语加工激活的脑区表明句法和语义分析在惯用语理解中均发挥重要作用,惯用语并没有词汇化,但是不能使用统一的加工模型来整合惯用语的理解机制。惯用语自身性质的多样化导致惯用语理解的多种心理机制。     

藏汉双语者汉语阅读理解的静息态功能连接分析

研究结合静息态全脑功能连接密度和基于种子点的功能连接（FC）分析考察了藏汉双语者汉语（L2）阅读各子能力（细节捕捉和推理判断）的固有脑功能组织特点。结果发现左侧额下回—左侧颞上回和右侧舌回—右侧中央前回之间的FC值均与细节捕捉题得分和推理判断题得分呈显著正相关,但是左侧额下回—右侧顶下小叶之间的FC值只与推理判断题得分呈显著正相关。表明藏汉双语者汉语阅读各子能力之间既有重叠的又有不同的功能连接通路。     

Semantic similarity, predictability, and models of sentence processing

The effects of word predictability and shared semantic similarity between a target word and other words that could have taken its place in a sentence on language comprehension are investigated using data from a reading time study, a sentence completion study, and linear mixed-effects regression modeling. We find that processing is facilitated if the different possible words that could occur in a given context are semantically similar to each other, meaning that processing is affected not only by the nature of the words that do occur, but also the relationships between the words that do occur and those that could have occurred. We discuss possible causes of the semantic similarity effect and point to possible limitations of using probability as a model of cognitive effort.     

Temporospatial analysis of explicit and implicit processing of negative content during word comprehension

Although divergences between explicit and implicit processing of affective content during word comprehension have been reported, the underlying nature of those differences remains in dispute. Prior studies focused on either the timing or the spatial location of the effects. The present study examined the precise dynamics of the processing of negative words when attention is directed to affective content or to non-emotional properties by capitalizing on fine temporal resolution of the event-related potentials (ERPs) and recent advances in source localization. Tasks were used that required accessing knowledge about different semantic properties of negative and neutral words. In the direct task, participants’ attention was directed towards emotional information. By contrast, subjects had to decide whether the words’ referent could be touched or not in the indirect task. Regardless of being processed explicitly or implicitly, negative compared to neutral words were associated with more errors and greater key pressure responses. Electrophysiologically, affective processing was reflected in larger amplitudes to negative words in a late positive component (LPC) at the scalp level, and in increased activity in the pre-supplementary motor area (pre-SMA) at the voxel level. Interestingly, an interaction between emotion and type of task was observed. Negative words were associated with more errors, larger anterior distributed LPC amplitudes and increased activity in the posterior cingulate cortex (PCC) in the direct compared to the indirect task. This LPC effect was modulated by the concreteness of the words. Finally, a task effect was found in a posterior negativity around 220 ms, with enhanced amplitudes to words in the direct compared to the indirect task. The present results suggest that negative information contained in written language is processed irrespective of controlled attention is directed to it or not, but that this processing is reinforced in the former case.     

Speech-associated gestures, Broca's area, and the human mirror system

Speech-associated gestures are hand and arm movements that not only convey semantic information to listeners but are themselves actions. Broca's area has been assumed to play an important role both in semantic retrieval or selection (as part of a language comprehension system) and in action recognition (as part of a "mirror" or "observation-execution matching" system). We asked whether the role that Broca's area plays in processing speech-associated gestures is consistent with the semantic retrieval/selection account (predicting relatively weak interactions between Broca's area and other cortical areas because the meaningful information that speech-associated gestures convey reduces semantic ambiguity and thus reduces the need for semantic retrieval/selection) or the action recognition account (predicting strong interactions between Broca's area and other cortical areas because speech-associated gestures are goal-direct actions that are "mirrored"). We compared the functional connectivity of Broca's area with other cortical areas when participants listened to stories while watching meaningful speech-associated gestures, speech-irrelevant self-grooming hand movements, or no hand movements. A network analysis of neuroimaging data showed that interactions involving Broca's area and other cortical areas were weakest when spoken language was accompanied by meaningful speech-associated gestures, and strongest when spoken language was accompanied by self-grooming hand movements or by no hand movements at all. Results are discussed with respect to the role that the human mirror system plays in processing speech-associated movements.