Information Integration in Modulation of Pragmatic Inferences During Online Language Comprehension

Upon hearing a scalar adjective in a definite referring expression such as “the big…,” listeners typically make anticipatory eye movements to an item in a contrast set, such as a big glass in the context of a smaller glass. Recent studies have suggested that this rapid, contrastive interpretation of scalar adjectives is malleable and calibrated to the speaker's pragmatic competence. In a series of eye‐tracking experiments, we explore the nature of the evidence necessary for the modulation of pragmatic inferences in language comprehension, focusing on the complementary roles of top–down information ‐ (knowledge about the particular speaker's pragmatic competence)  and bottom‐up cues  (distributional information about the use of scalar adjectives in the environment). We find that bottom‐up evidence alone (e.g., the speaker says “the big dog” in a context with one dog), in large quantities, can be sufficient to trigger modulation of the listener's contrastive inferences, with or without top‐down cues to support this adaptation. Further, these findings suggest that listeners track and flexibly combine multiple sources of information in service of efficient pragmatic communication.     

Adjectives really do modify nouns: the incremental and restricted nature of early adjective acquisition

By 24 months, most children spontaneously and correctly use adjectives. Yet prior laboratory research that has studied lexical acquisition in young children reports that children up to 3-years-old map novel adjectives to object properties only in very limited situations (Child Development 59 (1988) 411; Child Development 64 (1993) 1651; Child Development 71 (2000) 649; Developmental Psychology 36 (2000) 571; Child Development 69 (1998) 1313). In Experiments 1 and 2 we introduced 36-month-olds (Experiment 1) and 24-month-olds (Experiment 2) to novel adjectives while providing rich referential and syntactic information to indicate what the novel words mean. Specifically, we used a given novel adjective to describe multiple familiar objects which shared a salient property; in addition we used the adjectives in full noun phrases, not in conjunction with pronouns. Under these conditions, both groups mapped novel adjectives onto object properties. In Experiment 3 we asked whether the rich referential information was responsible for the successful outcome of the previous two experiments; we introduced novel adjectives to 2- and 3-year-olds as in Experiments 1 and 2, but the adjectives modified nouns of vague (very general) reference ("one", or "thing"). Under these conditions the children failed. We suggest that young word learners require access to the taxonomy of the object type so that the relevant property can be identified. The taxonomically specific nouns of Experiments 1 and 2 accomplish this, whereas the more general, semantically bleached nominals in Experiment 3 do not. Taken together with related findings in the literature, these findings favor an account of lexical acquisition in which layers of information become available incrementally, as a consequence of solving prior parts of the learning problem.     

Adjectives Modulate Sensorimotor Activation Driven by Nouns

We performed three experiments to investigate whether adjectives can modulate the sensorimotor activation elicited by nouns. In Experiment 1, nouns of graspable objects were used as stimuli. Participants had to decide if each noun referred to a natural or artifact, by performing either a precision or a power reach-to-grasp movement. Response grasp could be compatible or incompatible with the grasp typically used to manipulate the objects to which the nouns referred. The results revealed faster reaction times (RTs) in compatible than in incompatible trials. In Experiment 2, the nouns were combined with adjectives expressing either disadvantageous information about object graspability (e.g., sharp) or information about object color (e.g., reddish). No difference in RTs between compatible and incompatible conditions was found when disadvantageous adjectives were used. Conversely, a compatibility effect occurred when color adjectives were combined with nouns referring to natural objects. Finally, in Experiment 3 the nouns were combined with adjectives expressing tactile or shape proprieties of the objects (e.g., long or smooth). Results revealed faster RTs in compatible than in incompatible condition for both noun categories. Taken together, our findings suggest that adjectives can shape the sensorimotor activation elicited by nouns of graspable objects, highlighting that language simulation goes beyond the single-word level.     

The role of perspective in identifying domains of reference

We used the contrastive expectation associated with scalar adjectives to examine whether listeners are sensitive to the distinction between common and privileged information during real-time reference resolution. Our results show that listeners used this distinction to narrow the set of potential referents to objects with contrasts in common ground from the earliest moments. These results extend previous evidence that ground information influences real-time language processing by showing that the distinction between common and privileged information is used without being triggered by unusual circumstances.     

The role of comparison in the extension of novel adjectives

Previous reseach has documented that basic-level object categories provide an initial foundation for mapping adjectives to object properties. Children ranging from 21 months to 3 years can successfully extend a novel adjective (e.g., transparent) to other objects sharing a salient property if the objects are all members of the same basic-level category; if the objects are members of different basic-level categories, they fail to extend adjectives systematically (R. S. Klibanoff & S. R. Waxman, 2000a; S. R. Waxman & D. B. Markow, 1998). The present study proposed that the process of comparison is instrumental in children's ability to move beyond this foundation. To promote comparison, 2 target objects were introduced to 3-year-olds. In Experiment 1, the targets had contrastive properties (e.g., 1 transparent and 1 opaque object); in Experiment 2, the targets had consistent properties (e.g., 2 transparent objects). The results of both experiments illustrate that comparison--a general psychological process--operates in conjunction with naming to support the extension of novel adjectives to properties of objects from diverse basic-level categories.     

Why Boys will be boys and girls will be girls: Understanding colloquial tautologies

What do tautological phrases such asBoys will be boys, A promise is a promise, or War is war mean and how are they understood? These phrases literally appear to be uninformative, yet speakers frequently use such expressions in conversation and listeners have little difficulty comprehending them. Understanding nominal tautologies requires that listeners/readers infer the speaker's attitude toward the noun phrase (e.g.,boys) mentioned in the sentence. The purpose of the present studies was to investigate the role of context, syntactic form, and lexical content in the interpretation of nominal tuatologies. Two studies are reported in which subjects rated the acceptability of different tautological constructions either alone (Experiment 1) or with supporting contextual information (Experiment 2). The results of these studies provide evidence that colloquial tautologies can be interpreted differently in different contexts, but that there are important regularities in the syntactic form and lexical content of these phrases which influence how they are understood. Our findings highlight the importance of speakers/listeners' stereotypical understanding of people, activities, and concrete objects in the use and understanding of different tautological expressions. The implications of this research for psycholinguistic theories of conversational inference and indirect language use are discussed.     

Blue car,red car: Developing efficiency in online interpretation of adjective–noun phrases

Two experiments investigated the development of fluency in interpreting adjective–noun phrases in 30- and 36-month-old English-learning children. Using online processing measures, children’s gaze patterns were monitored as they heard the familiar adjective–noun phrases (e.g. blue car) in visual contexts where the adjective was either informative (e.g. blue car paired with red car or red house) or uninformative (e.g. blue car paired with blue house). Thirty-six-month-olds processed adjective–noun phrases incrementally as adults do, orienting more quickly to the target picture on informative-adjective trials than on control trials. Thirty-month-olds did not make incremental use of informative adjectives, and experienced disruption on trials when the two potential referents were identical in kind. In the younger children, difficulty in integrating prenominal adjectives with the subsequent noun was associated with slower processing speed across conditions. These findings provide evidence that skill in putting color word knowledge to use in real-time language processing emerges gradually over the third year.     

Mapping Words to the World in Infancy: Infants' Expectations for Count Nouns and Adjectives

Three experimentsdocumentthat 14-month-old infants'construal of objects (e.g., purple animals) is influenced by naming, that they can distinguish between the grammatical form noun and adjective, and that they treat this distinction as relevant to meaning. In each experiment, infants extended novel nouns (e.g., "This one is a blicket") specifically to object categories (e.g., animal), and not to object properties (e.g., purple things). This robust noun-category link is related to grammatical form and not to surface differences in the presentation of novelwords (Experiment 3). Infants'extensions of novel adjectives (e.g., "This one is blickish") were more fragile: They extended adjectives specifically to object properties when the property was color (Experiment 1), but revealed a less precise mapping when the property was texture (Experiment 2). These results reveal that by 14 months, infants distinguish between grammatical forms and utilize these distinctions in determining the meaning of novel words.     

Distinguishing the effects of action relations and scene context on object perception

Objects are rarely viewed in isolation, and so how they are perceived is influenced by the context in which they are viewed and their interaction with other objects (e.g., whether objects are colocated for action). We investigated the combined effects of action relations and scene context on an object decision task. Experiment 1 investigated whether the benefit for positioning objects so that they interact is enhanced when objects are viewed within contextually congruent scenes. The results indicated that scene context influenced perception of nonaction-related objects (e.g., monitor and keyboard), but had no effect on responses to action-related objects (e.g., bottle and glass) that were processed more rapidly. In Experiment 2, we reduced the saliency of the object stimuli and found that, under these circumstances, scene context influenced responses to action-related objects. We discuss the data in terms of relatively late effects of scene processing on object perception.     

Spatial distance effects on incremental semantic interpretation of abstract sentences: Evidence from eye tracking

A large body of evidence has shown that visual context information can rapidly modulate language comprehension for concrete sentences and when it is mediated by a referential or a lexical-semantic link. What has not yet been examined is whether visual context can also modulate comprehension of abstract sentences incrementally when it is neither referenced by, nor lexically associated with, the sentence. Three eye-tracking reading experiments examined the effects of spatial distance between words (Experiment 1) and objects (Experiment 2 and 3) on participants’ reading times for sentences that convey similarity or difference between two abstract nouns (e.g., ‘Peace and war are certainly different...’). Before reading the sentence, participants inspected a visual context with two playing cards that moved either far apart or close together. In Experiment 1, the cards turned and showed the first two nouns of the sentence (e.g., ‘peace’, ‘war’). In Experiments 2 and 3, they turned but remained blank. Participants’ reading times at the adjective (Experiment 1: first-pass reading time; Experiment 2: total times) and at the second noun phrase (Experiment 3: first-pass times) were faster for sentences that expressed similarity when the preceding words/objects were close together (vs. far apart) and for sentences that expressed dissimilarity when the preceding words/objects were far apart (vs. close together). Thus, spatial distance between words or entirely unrelated objects can rapidly and incrementally modulate the semantic interpretation of abstract sentences.     

The Effects of Prior Processing Episodes on Basic level Superiority

Four experiments were conducted to investigate the effects of prior processing episodes on people's preference for categorizing objects at the basic level (e.g. dog) relative to their preference for categorizing at the superordinate (e.g. animal) and the subordinate (e.g. Dalmation) levels. The prior processing episode in Experiment 1 was designed to induce subjects to activate representations at the superordinate level, and those in the remaining experiments were designed to induce subjects to differentiate objects at the subordinate level. After the prior processing episodes, subjects performed either a free naming or a picture categorization task that required them to decide whether an illustrated object belonged to a specified category. Results showed that prior processing episodes modestly reduced the superiority of basic level to superordinate level and subordinate level in categorization but not in free naming. The results suggest that the basic-level advantage is subject to the effects of context, but the effects are not as strong as the context effects on other aspects of categorization behaviour (e.g. rating typicality of a category member). Hence, the preference for the basic level is a somewhat more stable, invariant aspect of conceptual representation. Possible determinations of this stability are discussed.     

Young children's use of syntactic cues to learn proper names and count nouns

In 6 experiments, 144 toddlers were tested in groups ranging in mean age from 20 to 37 months. In all experiments, children learned a novel label for a doll or a stuffed animal. The label was modeled syntactically as either a count noun (e.g., "This is a ZAV") or a proper name (e.g., "This is ZAV"). The object was then moved to a new location in front of the child, and a second identical-looking object was placed nearby. The children's task was to choose 1 of the 2 objects as a referent for the novel word. By 24 months, both girls (Experiment 2) and boys (Experiment 5) were significantly more likely to select the labeled object if they heard a proper name than if they heard a count noun. At 20 months, neither girls (Experiments 1 and 6) nor boys (Experiment 1) demonstrated this effect. By their 2nd birthdays, children can use syntactic information to distinguish appropriately between labels for individual objects and those for object categories.     

The developing constraints on parsing decisions: the role of lexical-biases and referential scenes in child and adult sentence processing

Two striking contrasts currently exist in the sentence processing literature. First, whereas adult readers rely heavily on lexical information in the generation of syntactic alternatives, adult listeners in world-situated eye-gaze studies appear to allow referential evidence to override strong countervailing lexical biases (Tanenhaus, Spivey-Knowlton, Eberhard, and Sedivy, 1995). Second, in contrast to adults, children in similar listening studies fail to use this referential information and appear to rely exclusively on verb biases or perhaps syntactically based parsing principles (Trueswell, Sekerina, Hill, and Logrip, 1999). We explore these contrasts by fully crossing verb bias and referential manipulations in a study using the eye-gaze listening technique with adults (Experiment 1) and five-year-olds (Experiment 2). Results indicate that adults combine lexical and referential information to determine syntactic choice. Children rely exclusively on verb bias in their ultimate interpretation. However, their eye movements reveal an emerging sensitivity to referential constraints. The observed changes in information use over ontogenetic time best support a constraint-based lexicalist account of parsing development, which posits that highly reliable cues to structure, like lexical biases, will emerge earlier during development and more robustly than less reliable cues.     

Scale structure: processing minimum standard and maximum standard scalar adjectives

Gradable adjectives denote a function that takes an object and returns a measure of the degree to which the object possesses some gradable property [Kennedy, C. (1999). Projecting the adjective: The syntax and semantics of gradability and comparison. New York: Garland]. Scales, ordered sets of degrees, have begun to be studied systematically in semantics [Kennedy, C. (to appear). Vagueness and grammar: the semantics of relative and absolute gradable predicates. Linguistics and Philosophy; Kennedy, C. and McNally, L. (2005). Scale structure, degree modification, and the semantics of gradable predicates. Language, 81, 345-381; Rotstein, C., and Winter, Y. (2004). Total adjectives vs. partial adjectives: scale structure and higher order modifiers. Natural Language Semantics, 12, 259-288.]. We report four experiments designed to investigate the processing of absolute adjectives with a maximum standard (e.g., clean) and their minimum standard antonyms (dirty). The central hypothesis is that the denotation of an absolute adjective introduces a 'standard value' on a scale as part of the normal comprehension of a sentence containing the adjective (the "Obligatory Scale" hypothesis). In line with the predictions of Kennedy and McNally (2005) and Rotstein and Winter (2004), maximum standard adjectives and minimum standard adjectives systematically differ from each other when they are combined with minimizing modifiers like slightly, as indicated by speeded acceptability judgments. An eye movement recording study shows that, as predicted by the Obligatory Scale hypothesis, the penalty due to combining slightly with a maximum standard adjective can be observed during the processing of the sentence; the penalty is not the result of some after-the-fact inferencing mechanism. Further, a type of 'quantificational variability effect' may be observed when a quantificational adverb (mostly) is combined with a minimum standard adjective in sentences like "The dishes are mostly dirty", which may receive either a degree interpretation (e.g., 80% dirty) or a quantity interpretation (e.g., 80% of the dishes are dirty). The quantificational variability results provide suggestive support for the Obligatory Scale hypothesis by showing that the standard of a scalar adjective influences the preferred interpretation of other constituents in the sentence.     

If you say thee uh you are describing something hard: the on-line attribution of disfluency during reference comprehension

Eye-tracking and gating experiments examined reference comprehension with fluent (Click on the red. . .) and disfluent (Click on [pause] thee uh red . . .) instructions while listeners viewed displays with 2 familiar (e.g., ice cream cones) and 2 unfamiliar objects (e.g., squiggly shapes). Disfluent instructions made unfamiliar objects more expected, which influenced listeners' on-line hypotheses from the onset of the color word. The unfamiliarity bias was sharply reduced by instructions that the speaker had object agnosia, and thus difficulty naming familiar objects (Experiment 2), but was not affected by intermittent sources of speaker distraction (beeps and construction noises; Experiments 3). The authors conclude that listeners can make situation-specific inferences about likely sources of disfluency, but there are some limitations to these attributions.     

Color diagnosticity in object recognition.

Does color influence object recognition? In the present study, the degree to which an object was associated with a specific color was referred to as color diagnosticity. Using a feature listing and typicality measure, objects were identified as either high in color diagnosticity or low in color diagnosticity. According to the color diagnosticity hypothesis, color should more strongly influence the recognition of high color diagnostic (HCD) objects (e.g., a banana) than the recognition of low color diagnostic (LCD) objects (e.g., a lamp). This prediction was supported by results from classification, naming, and verification experiments, in which subjects were faster to identify color versions of HCD objects than they were to identify achromatic versions and incongruent color versions. In contrast, subjects were no faster to identify color versions of LCD objects than they were to identify achromatic and incongruent color versions. Moreover, when shape information was degraded but color information preserved, subjects were less impaired in their recognition of degraded HCD objects than of degraded LCD objects, relative to their nondegraded versions. Collectively, these results suggest that color plays a role in the recognition of HCD objects.     

Visual determinants of preferred adjective order

In referential communication, speakers refer to a target object among a set of context objects. The NPs they produce are characterized by a canonical order of prenominal adjectives: The dimensions that are easiest to detect (e.g., absolute dimensions) are commonly placed closer to the noun than other dimensions (e.g., relative dimensions). This stands in stark contrast to the assumption that language production is an incremental process. According to this incremental-procedural view, the dimensions that are easiest to detect should be named first. In the present paper, an alternative account of the canonical order effect is presented, suggesting that the prenominal adjective ordering rules are a result of the perceptual analysis processes underlying the evaluation of distinctive target features. Analyses of speakers’ eye movements during referential communication (Experiment 1) and analyses of utterance formats produced under time pressure (Experiment 2) provide evidence for the suggested perceptual classification account.     

Perception and presupposition in real-time language comprehension: insights from anticipatory processing

Recent studies have shown that listeners use verbs and other predicate terms to anticipate reference to semantic entities during real-time language comprehension. This process involves evaluating the denoted action against relevant properties of potential referents. The current study explored whether action-relevant properties are readily available to comprehension systems as a result of the embodied nature of linguistic and conceptual representations. In three experiments, eye movements were monitored as listeners followed instructions to move depicted objects on a computer screen. Critical instructions contained the verb return (e.g., Now return the block to area 3), which presupposes the previous displacement of its complement object--a property that is not reflected in perceptible or stable characteristics of objects. Experiment 1 demonstrated that predictions for previously displaced objects are generated upon hearing return, ruling out the possibility that anticipatory effects draw directly on static affordances in perceptual symbols. Experiment 2 used a referential communication task to evaluate how communicative relevance constrains the use of perceptually derived information. Results showed that listeners anticipate previously displaced objects as candidates upon hearing return only when their displacement was known to the speaker. Experiment 3 showed that the outcome of the original act of displacement further modulates referential predictions. The results show that the use of perceptually grounded information in language interpretation is subject to communicative constraints, even when language denotes physical actions performed on concrete objects.     

Color diagnosticity in object recognition

Does color influence object recognition? In the present study, the degree to which an object was associated with a specific color was referred to ascolor diagnosticity. Using a feature listing and typicality measure, objects were identified as either high in color diagnosticity or low in color diagnosticity. According to the color diagnosticity hypothesis, color should more strongly influence the recognition of high color diagnostic (HCD) objects (e.g., a banana) than the recognition of low color diagnostic (LCD) objects (e.g., a lamp). This prediction was supported by results from classification, naming, and verification experiments, in which subjects were faster to identify color versions of HCD objects than they were to identify achromatic versions and incongruent color versions. In contrast, subjects were no faster to identify color versions of LCD objects than they were to identify achromatic and incongruent color versions. Moreover, when shape information was degraded but color information preserved, subjects were less impaired in their recognition of degraded HCD objects than of degraded LCD objects, relative to their nondegraded versions. Collectively, these results suggest that color plays a role in the recognition of HCD objects.