Assignment of reference to reflexives and pronouns in picture noun phrases: evidence from eye movements

Most structural Binding Theories predict a complementary distribution between reflexives and pronouns in picture noun phrases containing possessors (e.g. "Ken's picture of himself/him"). In two head-mounted eye-tracking experiments, listeners frequently violated Binding Theory predictions for reflexives, often interpreting the reflexives as taking an antecedent outside of the binding domain, and violating complementarity assumptions. Moreover, the pattern and timing of the eye movements showed Binding Theory violations for reflexives during the earliest moments of reference resolution. The results demonstrate that either binding constraints must be reformulated to decouple pronouns and reflexives or all reflexives in picture noun phrases must be treated as logophors, and thus exempt from structural Binding Theory.     

Slowed Speech Input has a Differential Impact on On-line and Off-line Processing in Children’s Comprehension of Pronouns

The central question underlying this study revolves around how children process co-reference relationships—such as those evidenced by pronouns (him) and reflexives (himself)—and how a slowed rate of speech input may critically affect this process. Previous studies of child language processing have demonstrated that typical language developing (TLD) children as young as 4 years of age process co-reference relations in a manner similar to adults on-line. In contrast, off-line measures of pronoun comprehension suggest a developmental delay for pronouns (relative to reflexives). The present study examines dependency relations in TLD children (ages 5–13) and investigates how a slowed rate of speech input affects the unconscious (on-line) and conscious (off-line) parsing of these constructions. For the on-line investigations (using a cross-modal picture priming paradigm), results indicate that at a normal rate of speech TLD children demonstrate adult-like syntactic reflexes. At a slowed rate of speech the typical language developing children displayed a breakdown in automatic syntactic parsing (again, similar to the pattern seen in unimpaired adults). As demonstrated in the literature, our off-line investigations (sentence/picture matching task) revealed that these children performed much better on reflexives than on pronouns at a regular speech rate. However, at the slow speech rate, performance on pronouns was substantially improved, whereas performance on reflexives was not different than at the regular speech rate. We interpret these results in light of a distinction between fast automatic processes (relied upon for on-line processing in real time) and conscious reflective processes (relied upon for off-line processing), such that slowed speech input disrupts the former, yet improves the latter.     

Why do Alzheimer patients have difficulty with pronouns? Working memory, semantics, and reference in comprehension and production in Alzheimer's disease

Three experiments investigated the extent to which semantic and working-memory deficits contribute to Alzheimer patients' impairments in producing and comprehending referring expressions. In Experiment 1, the spontaneous speech of 11 patients with Alzheimer's disease (AD) contained a greater ratio of pronouns to full noun phrases than did the spontaneous speech produced by 9 healthy controls. Experiments 2 and 3 used a cross-modal naming methodology to compare reference comprehension in another group of 10 patients and 10 age-matched controls. In Experiment 2, patients were less sensitive than healthy controls to the grammatical information necessary for processing pronouns. In Experiment 3, patients were better able to remember referent information in short paragraphs when reference was maintained with full noun phrases rather than pronouns, but healthy controls showed the reverse pattern. Performance in all three experiments was linked to working memory performance but not to word finding difficulty. We discuss these findings in terms of a theory of reference processing, the Informational Load Hypothesis, which views referential impairments in AD as the consequence of normal discourse processing in the context of a working memory impairment.     

语篇中代词指代的研究进展

代词的指代在语篇局部连贯性中具有关键作用。中心理论是代词指称中的重要理论,它解释了语篇中代词的分布规律;注意驱动理论是在中心理沦的基础上结合重音预设解释重音或非重音代词。影响代词指称的因素有语义因素和结构因素。对代词的认知研究另一方面主要集中在对歧义代词的解释．对歧义代词的解释的研究一方面采用重复姓名不利实验范式,另一方面的研究采用的研究方法是探测词任务。在汉语中对代词的研究主要是对文本语篇的研究。     

Differential effects of constraints in the processing of Russian cataphora

Anaphoric relations between pronouns and their antecedents are subject to a number of different linguistic constraints, which exclude the possibility of coreference in specific syntactic or discourse contexts. Constraints on anaphora may, in principle, impact online sentence processing in a couple of different ways. They may act as constraints on the generation of interpretations, preventing illicit anaphoric relations from ever being considered. Alternatively, they may act as later filters on interpretations, rejecting candidate interpretations after initial consideration. A number of previous studies have sought to determine which of these mechanisms accurately describes the online impact of constraints on anaphora. The current studies present evidence that there is no uniform answer to this question, and that the two mechanisms are both used, for different constraints. Evidence for this is drawn from studies on the processing of two constraints on backwards anaphora or cataphora in Russian that apply in superficially similar contexts but that differ in a number of respects. One self-paced reading study and two judgement studies are reported. The self-paced reading study manipulates the gender congruency between a pronoun and a following name in three pairs of conditions. In conditions where the pronoun–name configuration violates no constraints on anaphora a gender mismatch effect was observed following the name, as in previous studies, suggesting that comprehenders actively search for an antecedent following a cataphoric pronoun. In conditions where the pronoun–name configuration violates Principle C of the classical binding theory no effect of the gender manipulation was observed, suggesting that comprehenders do not even consider the possibility of interpretations that violate this constraint. In conditions where the pronoun–name configuration violates a Russian-specific constraint on cataphora a gender match effect was observed following the name, the reverse of the finding in the no-constraint conditions, suggesting that the constraint applies as a filter on candidate interpretations.     

话语参照语境条件下汉语歧义短语的加工

采用移动窗口和眼动记录两种范式 ,以符合“VP +N1+的 +N2”格式的均衡型和述宾型两类汉语歧义短语为背景 ,在两个实验中 ,考察了话语参照语境影响歧义短语句法分析的机制以及时间进程。结果发现 ,在早于解歧区 1的区段上就开始出现话语语境效应。这些发现表明话语参照语境可以通过概念期望机制起作用 ,而并非仅仅通过参照前提机制起作用。此外 ,实验还证明了话语参照语境在句子加工早期的作用。这一结果为句法歧义消解的参照理论和基于制约的模型提供了证据 ,而对宣称最初的句法分析独立于话语语境的花园路径模型 ,提出了质疑     

Favor Referential Representations

Avrutin and Hickok (1993) argue that agrammatic patients have the ability to represent nonreferential or "government" chains ("who... e") but not referential or "binding" chains ("which girl... e"). By contrast, we propose the "referential representation hypothesis," which suggests that agrammatics attempt to cope with their well-known capacity limitations by favoring referential or content-based representations. This predicts that agrammatic patients′ performance should degrade noticeably as task demands increase, and referential demands should take priority over computational ones. In a semantic task, referential phrases should lead to better or more accurate performances. In syntactic tasks, the availability of a referential or content-based representation will interfere with the development of a syntactic representation, resulting in worse syntactic performance on the referential phrases than on nonreferential ones. This predicts that agrammatic patients should incorrectly accept (resumptive) pronoun sentences with a referential wh-phrase because the pronouns will find the semantic or discourse referent of the referential wh-phrase and take it as an antecedent for the pronoun. However, they should reject a (resumptive) pronoun in a sentence with the nonreferential question constituent "who" or "what." "Who" and "what" will remain in syntactic form, since they have only grammatical content and therefore will have only a "nonreferential" syntactic representation. Consequently, they cannot serve as the antecedent of the pronoun. These predictions were largely confirmed by the results of a grammaticality judgement study. Agrammatics performed well on questions with pragmatic biases but failed to distinguish reliably between grammatical and ungrammatical questions where pragmatic biases were neutralized. They assigned especially low ratings to object gap sentences with referential wh-constituents, as predicted. They assigned relatively high ratings to ungrammatical subject pronoun sentences with either type of wh-constituent. The agrammatics accepted ungrammatical reflexive sentences even though syntactic number and gender features alone could have been used to correctly judge the sentences. We attribute this, too, to the unavailability of a reliable syntactic representation of those phrases with referential or extragrammatical semantic content.     

Preschoolers’ appreciation of speaker vocal affect as a cue to referential intent

An eye tracking methodology was used to evaluate 3- and 4-year-old children’s sensitivity to speaker affect when resolving referential ambiguity. Children were presented with pictures of three objects on a screen (including two referents of the same kind, e.g., an intact doll and a broken doll, and one distracter item), paired with a prerecorded referentially ambiguous instruction (e.g., “Look at the doll”). The intonation of the instruction varied in terms of the speaker’s vocal affect: positive-sounding, negative-sounding, or neutral. Analyses of eye gaze patterns indicated that 4-year-olds, but not 3-year-olds, were more likely to look to the referent whose state matched the speaker’s vocal affect as the noun was heard (e.g., looked more often to the broken doll referent in the negative affect condition). These findings indicate that 4-year-olds can use speaker affect to help identify referential mappings during on-line comprehension.     

Eye movements and spoken language comprehension: effects of visual context on syntactic ambiguity resolution

When participants follow spoken instructions to pick up and move objects in a visual workspace, their eye movements to the objects are closely time-locked to referential expressions in the instructions. Two experiments used this methodology to investigate the processing of the temporary ambiguities that arise because spoken language unfolds over time. Experiment 1 examined the processing of sentences with a temporarily ambiguous prepositional phrase (e.g., "Put the apple on the towel in the box") using visual contexts that supported either the normally preferred initial interpretation (the apple should be put on the towel) or the less-preferred interpretation (the apple is already on the towel and should be put in the box). Eye movement patterns clearly established that the initial interpretation of the ambiguous phrase was the one consistent with the context. Experiment 2 replicated these results using prerecorded digitized speech to eliminate any possibility of prosodic differences across conditions or experimenter demand. Overall, the findings are consistent with a broad theoretical framework in which real-time language comprehension immediately takes into account a rich array of relevant nonlinguistic context.     

Eye Movements and Lexical Access in Spoken-Language Comprehension: Evaluating a Linking Hypothesis between Fixations and Linguistic Processing

A growing number of researchers in the sentence processing community are using eye movements to address issues in spoken language comprehension. Experiments using this paradigm have shown that visually presented referential information, including properties of referents relevant to specific actions, influences even the earliest moments of syntactic processing. Methodological concerns about task-specific strategies and the linking hypothesis between eye movements and linguistic processing are identified and discussed. These concerns are addressed in a review of recent studies of spoken word recognition which introduce and evaluate a detailed linking hypothesis between eye movements and lexical access. The results provide evidence about the time course of lexical activation that resolves some important theoretical issues in spoken-word recognition. They also demonstrate that fixations are sensitive to properties of the normal language-processing system that cannot be attributed to task-specific strategies.     

Perception and presupposition in real-time language comprehension: insights from anticipatory processing

Recent studies have shown that listeners use verbs and other predicate terms to anticipate reference to semantic entities during real-time language comprehension. This process involves evaluating the denoted action against relevant properties of potential referents. The current study explored whether action-relevant properties are readily available to comprehension systems as a result of the embodied nature of linguistic and conceptual representations. In three experiments, eye movements were monitored as listeners followed instructions to move depicted objects on a computer screen. Critical instructions contained the verb return (e.g., Now return the block to area 3), which presupposes the previous displacement of its complement object--a property that is not reflected in perceptible or stable characteristics of objects. Experiment 1 demonstrated that predictions for previously displaced objects are generated upon hearing return, ruling out the possibility that anticipatory effects draw directly on static affordances in perceptual symbols. Experiment 2 used a referential communication task to evaluate how communicative relevance constrains the use of perceptually derived information. Results showed that listeners anticipate previously displaced objects as candidates upon hearing return only when their displacement was known to the speaker. Experiment 3 showed that the outcome of the original act of displacement further modulates referential predictions. The results show that the use of perceptually grounded information in language interpretation is subject to communicative constraints, even when language denotes physical actions performed on concrete objects.     

Pronominal Resolution and Gap Filling in Agrammatic Aphasia: Evidence from Eye Movements

This paper reports the results of three studies examining comprehension and real-time processing of pronominal (Experiment 1) and Wh-movement (Experiments 2 and 3) structures in agrammatic and unimpaired speakers using eyetracking. We asked the following questions: (a) Is off-line comprehension of these constructions impaired in agrammatic listeners?, (b) Do agrammatic, like unimpaired, listeners show eye movement patterns indicative of automatic pronominal reference resolution and/or gap-filling?, and (c) Do eyetracking patterns differ when sentences are correctly versus incorrectly interpreted, or do automatic processes prevail in spite of comprehension failure? Results showed that off-line comprehension of both pronoun and Wh-movement structures was impaired in our agrammatic cohort. However, the aphasic participants showed visual evidence of real-time reference resolution as they processed binding structures, including both pronouns and reflexives, as did our unimpaired control participants. Similarly, both the patients and the control participants showed patterns consistent with successful gap filling during processing of Wh-movement structures. For neither pronominal nor movement structures did we find evidence of delayed processing. Notably, these patterns were found for the aphasic participants even when they incorrectly interpreted target sentences, with the exception of object relative constructions. For incorrectly interpreted sentences, we found end of sentence lexical competition effects. These findings indicate that aberrant lexical integration, rather than representational deficits or generally slowed processing, may underlie agrammatic aphasic listener’s comprehension failure.     

Reference in Conceptual Realism

A conceptual theory of the referential and predicable concepts used in basic speech and mental acts is described in which singular and general, complex and simple, and pronominal and nonpronominal, referential concepts are given a uniform account. The theory includes an intensional realism in which the intensional contents of predicable and referential concepts are represented through nominalized forms of the predicate and quantifier phrases that stand for those concepts. A central part of the theory distinguishes between active and deactivated referential concepts, where the latter are represented by nominalized quantifier phrases that occur as parts of complex predicates. Peter Geach's arguments against theories of general reference in Reference and Generality are used as a foil to test the adequacy of the theory. Geach's arguments are shown to either beg the question of general as opposed to singular reference or to be inapplicable because of the distinction between active and deactivated referential concepts.     

Eye movements as a window into real-time spoken language comprehension in natural contexts

When listeners follow spoken instructions to manipulate real objects, their eye movements to the objects are closely time locked to the referring words. We review five experiments showing that this time-locked characteristic of eye movements provides a detailed profile of the processes that underlie real-time spoken language comprehension. Together, the first four experiments showed that listerners immediately integrated lexical, sublexical, and prosodic information in the spoken input with information from the visual context to reduce the set of referents to the intended one. The fifth experiment demonstrated that a visual referential context affected the initial structuring of the linguistic input, eliminating even strong syntactic preferences that result in clear garden paths when the referential context is introduced linguistically. We argue that context affected the earliest moments of language processing because it was highly accessible and relevant to the behavioral goals of the listener.We thank D. Ballard and M. Hayhoe for the use of their laboratory (National Resource Laboratory for the Study of Brain and Behavior). We also thank J. Pelz for his assistance in learning how to use the equipment and K. Kobashi for assisting in the data collection. Finally, we thank Janet Nicol and an anonymous reviewer for their comments and suggestions. The research was supported by NIH resource grant 1-P41-RR09283; NIH HD27206 (M.K.T.); an NSF graduate fellowship (M.J.S.-K.); and a Canadian SSHRC fellowship (J.C.S.).     

Using E-Z reader to model the effects of higher level language processing on eye movements during reading

Although computational models of eye-movement control during reading have been used to explain how saccadic programming, visual constraints, attention allocation, and lexical processing jointly affect eye movements during reading, these models have largely ignored the issue of how higher level, postlexical language processing affects eye movements. The present article shows how one of these models, E-Z Reader (Pollatsek, Reichle, & Rayner, 2006c), can be augmented to redress this limitation. Simulations show that with a few simple assumptions, the model can account for the fact that effects of higher level language processing are not observed on eye movements when such processing is occurring without difficulty, but can capture the patterns of eye movements that are observed when such processing is slowed or disrupted.     

Eye movements during the production of nouns and pronouns

Earlier research has established that speakers usually fixate the objects they name and that the viewing time for an object depends on the time necessary for object recognition and for the retrieval of its name. In three experiments, speakers produced pronouns and noun phrases to refer to new objects and to objects already known. Speakers looked less frequently and for shorter periods at the objects to be named when they had very recently seen or heard of these objects than when the objects were new. Looking rates were higher and viewing times longer in preparation of noun phrases than in preparation of pronouns. If it is assumed that there is a close relationship between eye gaze and visual attention, these results reveal (1) that speakers allocate less visual attention to given objects than to new ones and (2) that they allocate visual attention both less often and for shorter periods to objects they will refer to by a pronoun than to objects they will name in a full noun phrase. The experiments suggest that linguistic processing benefits, directly or indirectly, from allocation of visual attention to the referent object.     

The developing constraints on parsing decisions: the role of lexical-biases and referential scenes in child and adult sentence processing

Two striking contrasts currently exist in the sentence processing literature. First, whereas adult readers rely heavily on lexical information in the generation of syntactic alternatives, adult listeners in world-situated eye-gaze studies appear to allow referential evidence to override strong countervailing lexical biases (Tanenhaus, Spivey-Knowlton, Eberhard, and Sedivy, 1995). Second, in contrast to adults, children in similar listening studies fail to use this referential information and appear to rely exclusively on verb biases or perhaps syntactically based parsing principles (Trueswell, Sekerina, Hill, and Logrip, 1999). We explore these contrasts by fully crossing verb bias and referential manipulations in a study using the eye-gaze listening technique with adults (Experiment 1) and five-year-olds (Experiment 2). Results indicate that adults combine lexical and referential information to determine syntactic choice. Children rely exclusively on verb bias in their ultimate interpretation. However, their eye movements reveal an emerging sensitivity to referential constraints. The observed changes in information use over ontogenetic time best support a constraint-based lexicalist account of parsing development, which posits that highly reliable cues to structure, like lexical biases, will emerge earlier during development and more robustly than less reliable cues.     

Time course of frequency effects in spoken-word recognition: evidence from eye movements

In two experiments, eye movements were monitored as participants followed spoken instructions to click on and move pictures with a computer mouse. In Experiment 1, a referent picture (e.g., the picture of a bench) was presented along with three pictures, two of which had names that shared the same initial phonemes as the name of the referent (e.g., bed and bell). Participants were more likely to fixate the picture with the higher frequency name (bed) than the picture with the lower frequency name (bell). In Experiment 2, referent pictures were presented with three unrelated distractors. Fixation latencies to referents with high-frequency names were shorter than those to referents with low-frequency names. The proportion of fixations to the referents and distractors were analyzed in 33-ms time slices to provide fine-grained information about the time course of frequency effects. These analyses established that frequency affects the earliest moments of lexical access and rule out a late-acting, decision-bias locus for frequency. Simulations using models in which frequency operates on resting-activation levels, on connection strengths, and as a postactivation decision bias provided further constraints on the locus of frequency effects.