Extensional Superposition and Its Relation to Compositionality in Language and Thought

Semantic composition in language must be closely related to semantic composition in thought. But the way the two processes are explained differs considerably. Focusing primarily on propositional content, language theorists generally take semantic composition to be a truth-conditional process. Focusing more on extensional content, cognitive theorists take it to be a form of concept combination. But though deep, this disconnect is not irreconcilable. Both areas of theory assume that extensional (i.e., denotational) meanings must play a role. As this article demonstrates, they also have the potential to fulfill a mediative function. What is shown is that extensional meanings are themselves inherently compositional. On this basis, it becomes possible to model semantic composition without assuming the existence of any specifically linguistic/conceptual apparatus. Examples are presented to demonstrate this direct style of modeling. Abstract connections between composition in thought and language can then be made, raising the prospect of a more unified, theoretical account of semantic composition.     

Memory Versus Expectation: Processing Relative Clauses in a Flexible Word Order Language

Memory limitations and probabilistic expectations are two key factors that have been posited to play a role in the incremental processing of natural language. Relative clauses (RCs) have long served as a key proving ground for such theories of language processing. Across three self-paced reading experiments, we test the online comprehension of Hungarian subject- and object-extracted RCs (SRCs and ORCs, respectively). We capitalize on the syntactic properties of Hungarian that allow for a variety of word orders within RCs, which helps us to delineate the processing costs associated with memory demand and violated expectations. Results showed a processing cost at the RC verb for structures that have longer verb-argument distances, despite those structures being more frequent in the corpus. These findings thus support theories that attribute processing difficulty to memory limitations, rather than theories that attribute difficulty to less expected structures.     

Language, thought, and real nouns

We test the claim that acquiring a mass-count language, like English, causes speakers to think differently about entities in the world, relative to speakers of classifier languages like Japanese. We use three tasks to assess this claim: object-substance rating, quantity judgment, and word extension. Using the first two tasks, we present evidence that learning mass-count syntax has little effect on the interpretation of familiar nouns between Japanese and English, and that speakers of these languages do not divide up referents differently along an individuation continuum, as claimed in some previous reports [Gentner, D., & Boroditsky, L. (2001). Individuation, relativity, and early word learning. In M. Bowerman, & S. Levinson (Eds.), Language acquisition and conceptual development (pp. 215-256). Cambridge University Press]. Instead, we argue that previous cross-linguistic differences [Imai, M., & Gentner, D. (1997). A cross-linguistic study of early word meaning: Universal ontology and linguistic influence. Cognition, 62, 169-200] are attributable to “lexical statistics” [Gleitman, L., & Papafragou, A. (2005). Language and thought. In K. Holyoak, & R. Morrison (Eds.), Cambridge handbook of thinking and reasoning (pp. 633-661). Cambridge University Press]. Speakers of English are more likely to think that a novel ambiguous expression like “the blicket” refers to a kind of object (relative to speakers of Japanese) because speakers of English are likely to assume that “blicket” is a count noun rather than a mass noun, based on the relative frequency of each kind of word in English. This is confirmed by testing Mandarin-English bilinguals with a word extension task. We find that bilinguals tested in English with mass-count ambiguous syntax extend novel words like English monolinguals (and assume that a word like “blicket” refers to a kind of object). In contrast, bilinguals tested in Mandarin are significantly more likely to extend novel words by material. Thus, online lexical statistics, rather than non-linguistic thought, mediate cross-linguistic differences in word extension. We suggest that speakers of Mandarin, English, and Japanese draw on a universal set of lexical meanings, and that mass-count syntax allows speakers of English to select among these meanings.     

The Processing of Non-canonically Ordered Constituents in Long Distance Dependencies by Pre-school Children: a Real-time Investigation

Four experiments were performed which had the goal of determining how and when young children acquire the ability to understand long distance dependencies. These studies examined the operations underlying the auditory processing of non-canonically ordered constituents in object-relative sentences. Children 4–6 years of age and an adult population participated in the study, which employed a cross modal picture priming methodology to determine when constituents in a non-canonical position are reactivated during ongoing sentence comprehension. The results support the view that even very young children have the same structural processing reflex seen in adults. Namely, children re-activate a non-canonically positioned (fronted) direct object NP immediately at the post-verb gap site during sentence processing.     

Parametric effects of syntactic-semantic conflict in Broca's area during sentence processing

The hypothesized role of Broca’s area in sentence processing ranges from domain-general executive function to domain-specific computation that is specific to certain syntactic structures. We examined this issue by manipulating syntactic structure and conflict between syntactic and semantic cues in a sentence processing task. Functional neuroimaging revealed that activation within several Broca’s area regions of interest reflected the parametric variation in syntactic-semantic conflict. These results suggest that Broca’s area supports sentence processing by mediating between multiple incompatible constraints on sentence interpretation, consistent with this area’s well-known role in conflict resolution in other linguistic and non-linguistic tasks.     

Spicy Adjectives and Nominal Donkeys: Capturing Semantic Deviance Using Compositionality in Distributional Spaces

Sophisticated senator and legislative onion. Whether or not you have ever heard of these things, we all have some intuition that one of them makes much less sense than the other. In this paper, we introduce a large dataset of human judgments about novel adjective‐noun phrases. We use these data to test an approach to semantic deviance based on phrase representations derived with compositional distributional semantic methods, that is, methods that derive word meanings from contextual information, and approximate phrase meanings by combining word meanings. We present several simple measures extracted from distributional representations of words and phrases, and we show that they have a significant impact on predicting the acceptability of novel adjective‐noun phrases even when a number of alternative measures classically employed in studies of compound processing and bigram plausibility are taken into account. Our results show that the extent to which an attributive adjective alters the distributional representation of the noun is the most significant factor in modeling the distinction between acceptable and deviant phrases. Our study extends current applications of compositional distributional semantic methods to linguistically and cognitively interesting problems, and it offers a new, quantitatively precise approach to the challenge of predicting when humans will find novel linguistic expressions acceptable and when they will not.     

Embodied Simulations Are Modulated by Sentential Perspective

There is considerable evidence that language comprehenders derive lexical‐semantic meaning by mentally simulating perceptual and motor attributes of described events. However, the nature of these simulations—including the level of detail that is incorporated and contexts under which simulations occur—is not well understood. Here, we examine the effects of first‐ versus third‐person perspective on mental simulations during sentence comprehension. First‐person sentences describing physical transfer towards or away from the body (e.g., “You threw the microphone,” “You caught the microphone”) modulated response latencies when responses were made along a front‐back axis, consistent with the action‐sentence compatibility effect (ACE). This effect was not observed for third‐person sentences (“He threw the microphone,” “He caught the microphone”). The ACE was observed when making responses along a left‐right axis for third‐person, but not first‐person sentences. Abstract sentences (e.g., “He heard the message”) did not show an ACE along either axis. These results show that perspective is a detail that is simulated during action sentence comprehension, and that motoric activations are flexible and affected by the pronominal perspective used in the sentence.     

A probabilistic model of semantic plausibility in sentence processing

Experimental research shows that human sentence processing uses information from different levels of linguistic analysis, for example, lexical and syntactic preferences as well as semantic plausibility. Existing computational models of human sentence processing, however, have focused primarily on lexico-syntactic factors. Those models that do account for semantic plausibility effects lack a general model of human plausibility intuitions at the sentence level. Within a probabilistic framework, we propose a wide-coverage model that both assigns thematic roles to verb–argument pairs and determines a preferred interpretation by evaluating the plausibility of the resulting ( verb , role , argument ) triples. The model is trained on a corpus of role-annotated language data. We also present a transparent integration of the semantic model with an incremental probabilistic parser. We demonstrate that both the semantic plausibility model and the combined syntax/semantics model predict judgment and reading time data from the experimental literature.     

BOLD response to semantic and syntactic processing during hypoglycemia is load-dependent

This study investigates how syntactic and semantic load factors impact sentence comprehension and BOLD signal under moderate hypoglycemia. A dual session, whole brain fMRI study was conducted on 16 healthy participants using the glucose clamp technique. In one session, they experienced insulin-induced hypoglycemia (plasma glucose at ∼50 mg/dL); in the other, plasma glucose was maintained at euglycemic levels (∼100 mg/dL). During scans subjects were presented with sentences of contrasting syntactic (embedding vs. conjunction) and semantic (reversibility vs. irreversibility) load. Semantic factors dominated the overall load effects on both performance (p < 0.001) and BOLD response (p < 0.01, corrected). Differential BOLD signal was observed in frontal, temporal, temporo-parietal and medio-temporal regions. Hypoglycemia and syntactic factors significantly impacted performance (p = 0.002) and BOLD response (p < 0.01, corrected) in the reversible clause conditions, more extensively in reversible-embedded than in reversible-conjoined clauses. Hypoglycemia resulted in a robust decrease in performance on reversible clauses and exerted attenuating effects on BOLD unselectively across cortical circuits.The dominance of reversibility in all measures underscores the distinction between the syntactic and semantic contrasts. The syntactic is based in a quantitative difference in algorithms interpreting embedded and conjoined structures. We suggest that the semantic is based in a qualitative difference between algorithmic mapping of arguments in reversible clauses and heuristic linking in irreversible clauses. Because heuristics drastically reduce resource demand, the operations they support would resist the load-dependent cognitive consequences of hypoglycemia.     

Linguistic self-correction in the absence of feedback: a new approach to the logical problem of language acquisition

In a series of studies children show increasing mastery of irregular plural forms (such as mice) simply by producing erroneous over-regularized versions of them (such as mouses). We explain this phenomenon in terms of successive approximation in imitation: Children over-regularize early in acquisition because the representations of frequent, regular plural forms develop more quickly, such that at the earliest stages of production they interfere with children's attempts to imitatively reproduce irregular forms they have heard in the input. As the strength of the representations that determine children's productions settle asymptotically, the early advantage for the frequent regular forms is negated, and children's attempts to imitate the irregular forms they have observed become more likely to succeed (a process that produces the classic U-shape in children's acquisition of plural inflection). These data show that children can acquire correct linguistic behavior without feedback in a situation where, as a result of philosophical and linguistic analyses, it has often been argued that it is logically impossible for them to do so.     

Big brown dog or brown big dog? An electrophysiological study of semantic constraints on prenominal adjective order

Event-related brain potentials (ERPs) were recorded while participants read and made acceptability judgments about sentences containing three types of adjective sequences: (1) normal sequences--e.g., Jennifer rode a huge gray elephant; (2) reversed sequences that violate grammatical-semantic constraints on linear order--e.g., *Jennifer rode a gray huge elephant; and (3) contradictory sequences that violate lexical-semantic constraints on compositionality--e.g., *Jennifer rode a small huge elephant. Relative to the control condition, the second adjective elicited a reduced N400 and an enhanced P600 in both the reversal condition and the contradiction condition. We present several alternative accounts of these two effects, but favor an interpretation which treats them as reflecting semantic and syntactic aspects of a temporary reanalysis of the adjective order construction. Furthermore, relative to the control condition, the final noun elicited a robust N400 in the contradiction condition but not in the reversal condition. We suggest that this effect indexes the full registration of the lexical-semantic incompatibility of the two adjectives in the contradiction condition. Finally, we discuss how all of these findings fit into the broader context of recent ERP studies that have reported atypical N400s and robust P600s in response to certain types of semantic anomalies.     

Language learning and control in monolinguals and bilinguals

Parallel language activation in bilinguals leads to competition between languages. Experience managing this interference may aid novel language learning by improving the ability to suppress competition from known languages. To investigate the effect of bilingualism on the ability to control native-language interference, monolinguals and bilinguals were taught an artificial language designed to elicit between-language competition. Partial activation of interlingual competitors was assessed with eye-tracking and mouse-tracking during a word recognition task in the novel language. Eye-tracking results showed that monolinguals looked at competitors more than bilinguals, and for a longer duration of time. Mouse-tracking results showed that monolinguals' mouse movements were attracted to native-language competitors, whereas bilinguals overcame competitor interference by increasing the activation of target items. Results suggest that bilinguals manage cross-linguistic interference more effectively than monolinguals. We conclude that language interference can affect lexical retrieval, but bilingualism may reduce this interference by facilitating access to a newly learned language.     

Grammatical Processing of Spoken Language in Child and Adult Language Learners

This article presents a selective overview of studies that have investigated auditory language processing in children and late second-language (L2) learners using online methods such as event-related potentials (ERPs), eye-movement monitoring, or the cross-modal priming paradigm. Two grammatical phenomena are examined in detail, children’s and adults’ processing of German plural inflections (Lück et al. Brain Res 1077:144–152, 2006; Hahne et al. J Cognitive Neurosci 18:121–134, 2006; Clahsen et al. J Child Language 34:601–622, 2007) and language learners’ processing of filler-gap dependencies in English (Felser C, Roberts L Second Language Res 23:9–36, 2007; Roberts et al. J Psycholinguist Res 36:175–188, 2007). The results from these studies reveal clear differences between native and nonnative processing in both domains of grammar, suggesting that nonnative listeners rely less on grammatical parsing routines during processing than either child or adult native listeners. We also argue that factors such as slower processing speed or cognitive resource limitations only provide a partial account of our findings.     

Shadows of music-language interaction on low frequency brain oscillatory patterns

Electrophysiological studies investigating similarities between music and language perception have relied exclusively on the signal averaging technique, which does not adequately represent oscillatory aspects of electrical brain activity that are relevant for higher cognition. The current study investigated the patterns of brain oscillations during simultaneous processing of music and language using visually presented sentences and auditorily presented chord sequences. Music-syntactically regular or irregular chord functions were presented in sync with syntactically or semantically correct or incorrect words. Irregular chord functions (presented simultaneously with a syntactically correct word) produced an early (150-250 ms) spectral power decrease over anterior frontal regions in the theta band (5-7 Hz) and a late (350-700 ms) power increase in both the delta and the theta band (2-7 Hz) over parietal regions. Syntactically incorrect words (presented simultaneously with a regular chord) elicited a similar late power increase in delta-theta band over parietal sites, but no early effect. Interestingly, the late effect was significantly diminished when the language-syntactic and music-syntactic irregularities occurred at the same time. Further, the presence of a semantic violation occurring simultaneously with regular chords produced a significant increase in later delta-theta power at posterior regions; this effect was marginally decreased when the identical semantic violation occurred simultaneously with a music syntactical violation. Altogether, these results show that low frequency oscillatory networks get activated during the syntactic processing of both music and language, and further, these networks may possibly be shared.     

Syntactic structure building in the anterior temporal lobe during natural story listening

The neural basis of syntax is a matter of substantial debate. In particular, the inferior frontal gyrus (IFG), or Broca’s area, has been prominently linked to syntactic processing, but the anterior temporal lobe has been reported to be activated instead of IFG when manipulating the presence of syntactic structure. These findings are difficult to reconcile because they rely on different laboratory tasks which tap into distinct computations, and may only indirectly relate to natural sentence processing. Here we assessed neural correlates of syntactic structure building in natural language comprehension, free from artificial task demands. Subjects passively listened to Alice in Wonderland during functional magnetic resonance imaging and we correlated brain activity with a word-by-word measure of the amount syntactic structure analyzed. Syntactic structure building correlated with activity in the left anterior temporal lobe, but there was no evidence for a correlation between syntactic structure building and activity in inferior frontal areas. Our results suggest that the anterior temporal lobe computes syntactic structure under natural conditions.     

Syntax and serial recall: How language supports short-term memory for order

The extent to which familiar syntax supports short-term serial recall of visually presented six-item sequences was shown by the superior recall of lists in which item pairs appeared in the order of “adjective–noun” (items 1–2, 3–4, 5–6)—congruent with English syntax—compared to when the order of items within pairs was reversed. The findings complement other evidence suggesting that short-term memory is an assemblage of language processing and production processes more than it is a bespoke short-term memory storage system.     

Examining the evidence for an independent semantic analyzer: an ERP study in Spanish

Recent ERP findings challenge the widespread assumption that syntactic and semantic processes are tightly coupled. Syntactically well-formed sentences that are semantically anomalous due to thematic mismatches elicit a P600, the component standardly associated with syntactic anomaly. This ‘thematic P600’ effect has been attributed to detection of semantically plausible thematic relations that conflict with the surface syntactic structure of the sentence, implying a processing architecture with an independent semantic analyzer. A key finding is that the P600 is selectively sensitive to the presence of plausible verb-argument relations, and that otherwise an N400 is elicited (The hearty meal was devouring … vs. The dusty tabletop was devouring …: Kim & Osterhout, 2005). The current study investigates in Spanish whether the evidence for an independent semantic analyzer is better explained by a standard architecture that rapidly integrates multiple sources of lexical, syntactic, and semantic information. The study manipulated the presence of plausible thematic relations, and varied the choice of auxiliary between passive-biased fue and active-progressive biased estaba. Results show a late positivity that appeared as soon as comprehenders detected an improbable combination of subject animacy, auxiliary bias, or verb voice morphology. This effect appeared at the lexical verb in the fue conditions and at the auxiliary in the estaba conditions. The late positivity elicited by surface thematic anomalies was the same, regardless of the presence of a plausible non-surface interpretation, and no N400 effects were elicited. These findings do not implicate an independent semantic analyzer, and are compatible with standard language processing architectures.