On-line syntactic processing in aphasia: studies with auditory moving window presentation

Twenty-eight aphasic patients with left hemisphere strokes and matched control subjects were tested on an auditory moving windows task in which successive phrases of a sentence were presented in response to subjects' self-paced button presses and subjects made timed judgments regarding the plausibility of each sentence. Pairs of sentences were presented that differed in syntactic complexity. Patients made more errors and/or took longer in making the plausibility judgments than controls, and were more affected than controls by the syntactic complexity of a sentence in these judgments. Normal subjects showed effects of syntactic structure in self-paced listening. On-line syntactic effects differed in patients as a function of their comprehension level. High-performing patients showed the same effects as normal control subjects; low performing patients did not show the same effects of syntactic structure. On-line syntactic effects also differed in patients as a function of their clinical diagnosis. Broca's aphasic patients' on-line performances suggested that they were not processing complex syntactic structures on-line, while fluent aphasics' performances suggested that their comprehension impairment occurred after on-line processing was accomplished. The results indicate that many aphasic patients retain their ability to process syntactic structure on-line, and that different groups of patients with syntactic comprehension disorders show different patterns of on-line syntactic processing.     

Task Demands and Sentence Comprehension in Patients with Dementia of the Alzheimer's Type

Patients with dementia of the Alzheimer's type (DAT) and matched normal controls were given three tests of syntactic comprehension in which nonlinguistic visual and memory task demands were varied. In all tasks, subjects were presented spoken semantically reversible sentences with a variety of syntactic structures and required to match the sentence to a picture. In the first experiment, subjects matched the spoken sentence to one of two pictures that appeared either before or immediately following the presentation of the sentence. The target picture depicted the spoken sentence correctly and the foil depicted the reversed thematic roles to those in the sentence (i.e., it was a syntactic foil). The second experiment employed a sentence video-verification task in which subjects were required to determine if the spoken sentence matched a videotaped depiction of the action in the sentence or a syntactic foil. In the third experiment, in different conditions, subjects were required to determine whether the spoken sentence matched a single picture or to choose the picture that matched the sentence from an array of two or three pictures. In this experiment, both lexical and syntactic foils were used. In all tasks, DAT patients were affected by the number of propositions in the presented sentence, but not by the syntactic complexity of the sentence. Control subjects also were unaffected by the syntactic complexity of the sentence; the number-of-proposition effect was present in some experiments in the control population. Comparison of performance across the one-, two-, and three-picture versions of the task showed that the magnitude of the effect of number of propositions increased as the number of pictures in the array increased. In addition, analysis of the data from each of the tasks separately showed that the effect of number of propositions only occurred when subjects were attempting to match the target to a syntactic foil (one-picture version) or to choose between the target and a syntactic foil (two- and three-picture versions). The results support the view that patients with DAT do not have disturbances affecting syntactic processing. In addition, they suggest that the effect of number of propositions arises at a stage of analysis that is partially separate from assigning sentence meaning, such as in holding a representation of the sentence in memory until the pictures can be analyzed and encoded and/or in comparing the results of the picture analysis with a stored representation of the sentence meaning.     

Sentence Comprehension Deficits in Alzheimer''s Disease: A Comparison of Off-Line vs. On-Line Sentence Processing

Two studies explored whether sentence comprehension impairments in Alzheimer's disease (AD) are due to deficits in syntactic processing or memory. Study 1 used a picture-pointing sentence comprehension task to measure the final outcome of comprehension in an off-line fashion. It showed the comprehension of 30 patients with AD to be impaired, but suggested that the deficits could not be attributed solely to syntactic impairments. Study 2 investigated the effects of memory on sentence comprehension by comparing off-line (grammaticality judgment) with on-line (cross-modal naming) language processing in 11 AD and 9 control subjects. The results revealed impaired performance in the off-line task but normal performance in the on-line task using the same sentences. Performance on the off-line task correlated with independent measures of verbal working memory. These data are used to argue that sentence comprehension impairments are related to verbal working memory deficits in AD.     

Encouraging prediction during production facilitates subsequent comprehension: Evidence from interleaved object naming in sentence context and sentence reading

Many studies have shown that a supportive context facilitates language comprehension. A currently influential view is that language production may support prediction in language comprehension. Experimental evidence for this, however, is relatively sparse. Here we explored whether encouraging prediction in a language production task encourages the use of predictive contexts in an interleaved comprehension task. In Experiment 1a, participants listened to the first part of a sentence and provided the final word by naming aloud a picture. The picture name was predictable or not predictable from the sentence context. Pictures were named faster when they could be predicted than when this was not the case. In Experiment 1b the same sentences, augmented by a final spill-over region, were presented in a self-paced reading task. No difference in reading times for predictive versus non-predictive sentences was found. In Experiment 2, reading and naming trials were intermixed. In the naming task, the advantage for predictable picture names was replicated. More importantly, now reading times for the spill-over region were considerable faster for predictive than for non-predictive sentences. We conjecture that these findings fit best with the notion that prediction in the service of language production encourages the use of predictive contexts in comprehension. Further research is required to identify the exact mechanisms by which production exerts its influence on comprehension.     

The effects of slowed speech on auditory comprehension in aphasia

The present study investigates the effects of slowed speech on auditory comprehension in aphasia. Specifically, an attempt was made to isolate the effects of added time on comprehension at the language processing stages of auditory perception, by increasing the duration of the vowel segments in each word; word recognition and semantic analysis, by adding silences between words; and syntactic analysis, by adding silences at constituent phrase boundaries. Sentences were also read at a slow rate to see the effects of naturally slowed speech on sentence comprehension. Test sentences consisted of simple active and passive declarative sentences, and complex sentences with embedded medial and final relative clauses. Sentences were either semantically reversible or nonreversible. Thirty-four aphasic patients who varied in both severity and type of aphasia were tested on a picture verification task. Results indicated that slowing facilitated language comprehension significantly only in the syntactic condition. Neither syntactic complexity nor semantic reversibility interacted with slowed speech to facilitate auditory language comprehension. Further, it was only the Wernicke's aphasics who showed significant improvement with time added at constituent boundaries. These results suggest that time alone does not facilitate language comprehension in aphasia, but that rather it is the interaction of time with syntactic processing which improves comprehension.     

Dissociable patterns of brain activity during comprehension of rapid and syntactically complex speech: evidence from fMRI

Sentence comprehension is a complex task that involves both language-specific processing components and general cognitive resources. Comprehension can be made more difficult by increasing the syntactic complexity or the presentation rate of a sentence, but it is unclear whether the same neural mechanism underlies both of these effects. In the current study, we used event-related functional magnetic resonance imaging (fMRI) to monitor neural activity while participants heard sentences containing a subject-relative or object-relative center-embedded clause presented at three different speech rates. Syntactically complex object-relative sentences activated left inferior frontal cortex across presentation rates, whereas sentences presented at a rapid rate recruited frontal brain regions such as anterior cingulate and premotor cortex, regardless of syntactic complexity. These results suggest that dissociable components of a large-scale neural network support the processing of syntactic complexity and speech presented at a rapid rate during auditory sentence processing.     

Syntactic gender processing in the human brain: a review and a model

Despite the increasing number of neuroimaging studies of syntactic gender processing no model is currently available that includes data from visual and auditory language comprehension and language production. This paper provides a systematic review of the neural correlates of syntactic gender processing. Based on anatomical information from cytoarchitectonic probability maps it is argued that the left BA 44 plays a central role for the active use of gender information, e.g., for explicit decisions as well as for subsequent morphological encoding. The left BA 45 is involved in the strategic generation of morphological cues that facilitate gender processing. Model implications for aphasic patients with lesions including or excluding parts of Broca's speech region are discussed.     

Low working memory capacity is only spuriously related to poor reading comprehension

Accounts of comprehension failure, whether in the case of readers with poor skill or when syntactic complexity is high, have overwhelmingly implicated working memory capacity as the key causal factor. However, extant research suggests that this position is not well supported by evidence on the span of active memory during online sentence processing, nor is it well motivated by models that make explicit claims about the memory mechanisms that support language processing. The current study suggests that sensitivity to interference from similar items in memory may provide a better explanation of comprehension failure. Through administration of a comprehensive skill battery, we found that the previously observed association of working memory with comprehension is likely due to the collinearity of working memory with many other reading-related skills, especially IQ. In analyses which removed variance shared with IQ, we found that receptive vocabulary knowledge was the only significant predictor of comprehension performance in our task out of a battery of 24 skill measures. In addition, receptive vocabulary and non-verbal memory for serial order—but not simple verbal memory or working memory—were the only predictors of reading times in the region where interference had its primary affect. We interpret these results in light of a model that emphasizes retrieval interference and the quality of lexical representations as key determinants of successful comprehension.     

The misinterpretation of noncanonical sentences

Research on language comprehension has focused on the resolution of syntactic ambiguities, and most studies have employed garden-path sentences to determine the system's preferences and to assess its use of nonsyntactic sources information. A topic that has been neglected is how syntactically challenging but essentially unambiguous sentences are processed, including passives and object-clefts--sentences that require thematic roles to be assigned in an atypical order. The three experiments described here tested the idea that sentences are processed both algorithmically and heuristically. Sentences were presented aurally and the participants' task was to identify the thematic roles in the sentence (e.g., Who was the do-er?). The first experiment demonstrates that passives are frequently and systematically misinterpreted, especially when they express implausible ideas. The second shows that the surface frequency of a syntactic form does not determine ease of processing, as active sentences and subject-clefts were comprehended equally easily despite the rareness of the latter type. The third experiment compares the processing of subject- and object-clefts, and the results show that they are similar to actives and passives, respectively, again despite the infrequent occurrence in English of any type of cleft. The results of the three experiments suggest that a comprehensive theory of language comprehension must assume that simple processing heuristics are used during processing in addition to (and perhaps sometimes instead of) syntactic algorithms. Moreover, the experiments support the idea that language processing is often based on shallow processing, yielding a merely "good enough" rather than a detailed linguistic representation of an utterance's meaning.     

What artificial grammar learning reveals about the neurobiology of syntax

In this paper we examine the neurobiological correlates of syntax, the processing of structured sequences, by comparing FMRI results on artificial and natural language syntax. We discuss these and similar findings in the context of formal language and computability theory. We used a simple right-linear unification grammar in an implicit artificial grammar learning paradigm in 32 healthy Dutch university students (natural language FMRI data were already acquired for these participants). We predicted that artificial syntax processing would engage the left inferior frontal region (BA 44/45) and that this activation would overlap with syntax-related variability observed in the natural language experiment. The main findings of this study show that the left inferior frontal region centered on BA 44/45 is active during artificial syntax processing of well-formed (grammatical) sequence independent of local subsequence familiarity. The same region is engaged to a greater extent when a syntactic violation is present and structural unification becomes difficult or impossible. The effects related to artificial syntax in the left inferior frontal region (BA 44/45) were essentially identical when we masked these with activity related to natural syntax in the same subjects. Finally, the medial temporal lobe was deactivated during this operation, consistent with the view that implicit processing does not rely on declarative memory mechanisms that engage the medial temporal lobe. In the context of recent FMRI findings, we raise the question whether Broca’s region (or subregions) is specifically related to syntactic movement operations or the processing of hierarchically nested non-adjacent dependencies in the discussion section. We conclude that this is not the case. Instead, we argue that the left inferior frontal region is a generic on-line sequence processor that unifies information from various sources in an incremental and recursive manner, independent of whether there are any processing requirements related to syntactic movement or hierarchically nested structures. In addition, we argue that the Chomsky hierarchy is not directly relevant for neurobiological systems.     

汉语句子理解中句法启动机制的眼动和ERP研究

语言产生的句法启动效应在近20年得到较深入研究。那么, 语言理解和语言产生中, 句法启动效应具有相同的加工机制吗？近些年, 研究者考察了印欧语系语言理解中的启动效应, 但还存在较多争论。这究竟是句法效应, 还是策略或者语义效应, 是词汇驱动还是词汇独立的？而且, 这是人类语言理解的语系特性还是普遍特性？单独采用行为技术、眼动技术或者ERP技术很难为这些争论提供坚实的实验证据和较深入的理论解释。鉴于此, 本项目拟采用眼动和ERP结合的技术, 从心理学、语言学和认知神经科学等多学科交叉的视角考查汉语句子理解的句法启动效应。通过分析眼动和ERP实验提供的一致性和差异性证据, 本项目力图阐明和揭示汉语句子理解中句法启动效应的认知特点和机制, 检验内隐学习理论和论元结构理论在解释句法启动效应时的适用性。     

The consequences of reduced memory span for the comprehension of semantic versus syntactic information

Aphasic patients with restricted memory spans were assessed on their comprehension of syntactically simple sentences varying in numbers of content words and on their comprehension of sentences matched in content words but varying in syntactic complexity. Three different presentation modes were used: unlimited visual presentation, limited visual presentation, and auditory presentation. The difference between performance in the unlimited and limited modes was used as a measure of the extent to which memory decrements caused comprehension failure. These difference scores were related to memory span in order to assess whether the memory involved in sentence processing overlaps that assessed by a memory span task. For the sentences varying in number of content words, performance was worse for the limited presentation modes than the unlimited mode, and the difference between unlimited and limited presentation modes was highly related to memory span. For the sentences varying in syntactic complexity, there was no clear reduction in performance for limited presentation modes, and the difference scores did not relate to memory span. The results support the view that the processing of sentences with many content words draws on the short-term memory capacity assessed by memory span, while the processing of syntactic complexity does not.     

Syntactic processing in Korean-English bilingual production: Evidence from cross-linguistic structural priming

A structural priming experiment investigated whether grammatical encoding in production consists of one or two stages and whether oral bilingual language production is shared at the functional or positional level [Bock, J. K., Levelt, W. (1994). Language production. Grammatical encoding. In M. A. Gernsbacher (Ed.), Handbook of psycholinguistics (pp. 945-984). San Diego, CA: Academic Press] by manipulating syntactic structure and argument order in structurally parallel Korean and English dative sentences. The results revealed that structural priming across languages can occur when both languages share syntactic structure, independent of argument order. Specifically, cross-linguistic argument-order-independent structural priming in canonical Korean postpositional and English prepositional dative structures was observed, providing evidence for shared bilingual syntactic processing occurring at the abstract, functional level within a two-stage grammatical encoding process. This is the first demonstration of cross-linguistic priming of argument-order-independent structural information.     

Give and take: syntactic priming during spoken language comprehension

Syntactic priming during language production is pervasive and well-studied. Hearing, reading, speaking or writing a sentence with a given structure increases the probability of subsequently producing the same structure, regardless of whether the prime and target share lexical content. In contrast, syntactic priming during comprehension has proven more elusive, fueling claims that comprehension is less dependent on general syntactic representations and more dependent on lexical knowledge. In three experiments we explored syntactic priming during spoken language comprehension. Participants acted out double-object (DO) or prepositional-object (PO) dative sentences while their eye movements were recorded. Prime sentences used different verbs and nouns than the target sentences. In target sentences, the onset of the direct-object noun was consistent with both an animate recipient and an inanimate theme, creating a temporary ambiguity in the argument structure of the verb (DO e.g., Show the horse the book; PO e.g., Show the horn to the dog). We measured the difference in looks to the potential recipient and the potential theme during the ambiguous interval. In all experiments, participants who heard DO primes showed a greater preference for the recipient over the theme than those who heard PO primes, demonstrating across-verb priming during online language comprehension. These results accord with priming found in production studies, indicating a role for abstract structural information during comprehension as well as production.     

工作记忆、语境限制强度和句子长度对二语词汇学习的影响

本研究选取初二、高二、大三三个年龄段的被试,考察在句子阅读过程中,工作记忆容量、语境限制强度和句子长度对第二语言词汇学习的影响。研究结果发现,在句子阅读条件下,工作记忆容量是影响第二语言词汇学习的重要因素,高工作记忆容量促进了第二语言词汇的学习;在中等和长句子的条件下,语境的限制性越强,词汇学习的成绩越好;相比初二年龄组被试,高二和大三年龄组被试,在低语境限制性的情况下,阅读的句子越长,第二语言词汇学习效果越差。研究结果说明,个体工作记忆的容量,以及阅读材料等变量,都是影响自然阅读条件下二语词汇学习的重要因素。     

Language facilitates event memory in early childhood: Child comprehension,adult-provided linguistic support and delayed recall at 16 months

Adult-provided supportive language facilitates memory for the past in preverbal and verbal children. Work conducted with 18-month-olds indicates that children benefit from supportive adult language when tested after a 4-week delay but not when tested immediately after sequence demonstration; moreover, findings reveal that supportive language provided only at test may be more facilitative of recall after a delay relative to supportive language provided only at encoding. In the present study, we examined whether child language comprehension abilities moderated the extent to which preverbal children benefitted from supportive language provided at encoding and test. The findings indicated that child language comprehension and supportive language provided at encoding were unassociated with performance at baseline or immediate imitation; however, the moderating effect of child language comprehension on adult-provided supportive language at encoding and test was observed after a 1-week delay. Correlations revealed continuous associations between general comprehension scores and recall performance after the 1-week delay on sequences presented in the most supportive condition at encoding. Taken together, the presented findings reveal that the complex interplay between language and cognition is established in early childhood, with foundational relations emerging before children are capable of verbally reporting on the past.     

汉、英句法结构相似性与第二语言的熟练度对第二语言句法加工的影响

采用事件相关电位（ERP）技术,考察了汉、英句法结构相似性与第二语言（英语）熟练度对第二语言句法加工的影响。实验材料包含与汉语句法结构相似和不同的两种英语句法结构违反的句子。结果发现：与正确句子相比,相似句法违反句在高熟练组被试中,引发正向的ERP波形偏转（150-800ms）,而在低熟练组被试中,只引发了降低的N400（300-550ms）效应;对于不同句法违反句,无论高低熟悉程度的被试,均未出现显著的ERP效应。研究结果表明,第二语言句法与母语的相似性越高,加工起来更容易;第二语言熟练度水平对第二语言句法加工具有一定的促进作用,但受到两种语言句法结构相似性的影响,相似性越高,熟练度的促进作用越大。     

Verb processing during sentence comprehension: Contextual impenetrability

This paper examines verb processing during sentence comprehension. We describe two experiments that assess the interaction between verb complexity and the structural information contained in a sentence. Verb complexity is defined in terms of a verb's possible argument structure arrangements—linguistic information arrayed against a verb's entry in the mental lexicon. Normal subjects had to perform a secondary task presented in the immediate vicinity of the verb while listening to a sentence for meaning. Reaction times to this secondary task show that all of a verb's possible argument structures are momentarily and exhaustively activated in the vicinity of the verb, even in sentences that are structurally biased toward one particular argument structure. We thus argue that verb processing in sentences involves a contextually impenetrable subcomponent of the language comprehension system.Program in Linguistics and Cognitive Science, Department of Psychology, Brandeis University.     

Syntactic and semantic contributions to sentence comprehension in agrammatism

Five aphasic subjects, who demonstrated agrammatic speech, and eight control subjects were presented with a sentence-picture matching task in which the factors of syntactic complexity, semantic reversibility, and sentence plausibility were independently varied. A subset of the sentences was patterned after that presented by A. Caramazza and E. Zurif (1976, Brain and Language, 5, 572-583) who concluded that Broca's aphasics rely on semantic constraints instead of syntactic information for sentence comprehension. Our aphasic subjects showed the same pattern of performance on this subset of sentences. However, the results from the full set of sentence materials we tested show that the aphasic subjects could perform some sentence level syntactic analyses, even when syntactic information conflicted with semantic constraints. The aphasic subjects correctly interpreted most active and passive sentences. They failed, however, to assign thematic roles and adjectives in center-embedded relative sentences, and instead relied on nonsyntactic information. These results show that both semantic and syntactic information contributed to sentence comprehension in the aphasic subjects we tested, in contrast to previous claims that syntactic and semantic processes are completely dissociated in this population.     

Individual differences in field articulation as a factor in language comprehension

Previous research has suggested that performance differences associated with field independence/field articulation (FA) reflect differences in the efficiency of a limited capacity “working memory” (WM) system. An information-processing analysis of language comprehension suggests the involvement of WM. This experiment tested the hypothesis that performance differences in a language comprehension task could be predicted on the basis of level of FA and the mediating role of WM. Three levels of memory load were established by varying the logical structure of sets of semantically related sentences which subjects were required to integrate. In the low memory load condition, there was no difference between high and low FA subjects on a test of integration (inference) and specific memory (recognition). In the high memory load condition, there was a decline in performance for low FA subjects on both inference and recognition. Other aspects of the results suggested that the breakdown in information processing, for low FA subjects in the high memory load condition, occurred during or shortly after initial encoding of the sentences.