Using Language to Navigate the Infant Mind

ABSTRACT— How do infants represent objects, actions, and relations in events? In this review, we discuss an approach to studying this question that begins with linguistic theory—specifically, semantic structures in language. On the basis of recent research exploring infant cognition and prominent linguistic analyses, we examine whether infants' representations of motion events are articulated in terms of the components proposed by Talmy (1985 ; e.g., path, manner) and whether infants' event representations are defined in terms of broad semantic roles (agent, patient, source, goal) as proposed by Jackendoff (1990) and Dowty (1991) . We show how recent findings in infant cognition are consistent with the idea that the infant's representation of events is a close reflection of the linguistic categories. We especially highlight research that is explicitly guided by linguistic categories likely to have correlates in nonlinguistic cognition to illustrate the usefulness of using language to pose questions about early conceptual representations.     

语篇语境对句子理解的影响：来自N400的证据

N400作为语义违反的特异性ERP组分,其波幅反映了语义整合加工过程的难度,因此可将其作为研究语篇语境意义建构过程的一项重要指标。语篇语境可分为语言语境和非语言语境。前人一系列基于语篇水平的N400研究表明,从语义的角度上看,语言语境对句子理解具有制约和协调作用,其机制涉及词汇语义启动、场景适宜性、文字内容信息以及因果推理等方面;非语言语境对句子理解具有制约和补充作用,但其机制尚不明确。两种不同来源的语义信息在实时理解中是同时得到加工的     

The syntax of event structure.

In this paper we examine the role of events within a theory of lexical semantics. We propose a configurational theory of event structure and examine how it contributes to a lexical semantic theory for natural language. In particular, we argue that an event structure can provide a distinct and useful level of representation for linguistic analysis involving the aspectual properties of verbs, adverbial scope, the role of argument structure, and the mapping from the lexicon to syntax.     

A Probabilistic Constraints Approach to Language Acquisition and Processing

This article provides an overview of a probabilistic constraints framework for thinking about language acquisition and processing. The generative approach attempts to characterize knowledge of language (i.e., competence grammar) and then asks how this knowledge is acquired and used. Our approach is performance oriented: the goal is to explain how people comprehend and produce utterances and how children acquire this skill. Use of language involves exploiting multiple probabilistic constraints over various types of linguistic and nonlinguistic information. Acquisition is the process of accumulating this information, which begins in infancy. The constraint satisfaction processes that are central to language use are the same as the bootstrapping processes that provide entry to language for the child. Framing questions about acquisition in terms of models of adult performance unifies the two topics under a set of common principles and has important consequences for arguments concerning language learnability.     

Bilingualism influences inhibitory control in auditory comprehension

Bilinguals have been shown to outperform monolinguals at suppressing task-irrelevant information. The present study aimed to identify how processing linguistic ambiguity during auditory comprehension may be associated with inhibitory control. Monolinguals and bilinguals listened to words in their native language (English) and identified them among four pictures while their eye-movements were tracked. Each target picture (e.g., hamper) appeared together with a similar-sounding within-language competitor picture (e.g., hammer) and two neutral pictures. Following each eye-tracking trial, priming probe trials indexed residual activation of target words, and residual inhibition of competitor words. Eye-tracking showed similar within-language competition across groups; priming showed stronger competitor inhibition in monolinguals than in bilinguals, suggesting differences in how inhibitory control was used to resolve within-language competition. Notably, correlation analyses revealed that inhibition performance on a nonlinguistic Stroop task was related to linguistic competition resolution in bilinguals but not in monolinguals. Together, monolingual-bilingual comparisons suggest that cognitive control mechanisms can be shaped by linguistic experience.     

Speed of word recognition and vocabulary knowledge in infancy predict cognitive and language outcomes in later childhood

The nature of predictive relations between early language and later cognitive function is a fundamental question in research on human cognition. In a longitudinal study assessing speed of language processing in infancy, Fernald, Perfors and Marchman (2006) found that reaction time at 25 months was strongly related to lexical and grammatical development over the second year. In this follow-up study, children originally tested as infants were assessed at 8 years on standardized tests of language, cognition, and working memory. Speed of spoken word recognition and vocabulary size at 25 months each accounted for unique variance in linguistic and cognitive skills at 8 years, effects that were attributable to strong relations between both infancy measures and working memory. These findings suggest that processing speed and early language skills are fundamental to intellectual functioning, and that language development is guided by learning and representational principles shared across cognitive and linguistic domains.     

A Cognitive Theory of Graphical and Linguistic Reasoning: Logic and Implementation

We discuss external and internal graphical and linguistic representational systems. We argue that a cognitive theory of peoples' reasoning performance must account for (a) the logical equivalence of inferences expressed in graphical and linguistic form, and (b) the implementational differences that affect facility of inference. Our theory proposes that graphical representation limit abstraction and thereby aid “processibility”. We discuss the ideas of specificity and abstraction, and their cognitive relevance. Empirical support both comes from tasks which involve the manipulation of external graphics and tasks that do not. For the former, we take Euler's (1772) circles, provide a novel computational reconstruction, show how it captures abstractions, and contrast it with earlier construals and with Johnson-Laird's (1983) mental models representations. We demonstrate equivalence of the graphical Euler system, and the nongraphical mental models system. For tasks not involving manipulation of external graphics, we discuss text comprehension, and the mental performance of syllogisms. By positing an internal system with the same specificity as Euler's circles, we cover the mental models data, and generate new empirical predictions. Finally, we consider how the architecture of working memory explains why such specific representations are relatively easy to store.     

Hemispheric asymmetries in children's perception of nonlinguistic human affective sounds

In the present work, we developed a database of nonlinguistic sounds that mirror prosodic characteristics typical of language and thus carry affective information, but do not convey linguistic information. In a dichotic-listening task, we used these novel stimuli as a means of disambiguating the relative contributions of linguistic and affective processing across the hemispheres. This method was applied to both children and adults with the goal of investigating the role of developing cognitive resource capacity on affective processing. Results suggest that children's limited computational resources influence how they process affective information and rule out attentional biases as a factor in children's perceptual asymmetries for nonlinguistic affective sounds. These data further suggest that investigation of perception of nonlinguistic affective sounds is a valuable tool in assessing interhemispheric asymmetries in affective processing, especially in parceling out linguistic contributions to hemispheric differences.     

Linguistic versus attentional influences on nonlinguistic categorization in 15-month-old infants

Why linguistic input facilitates nonlinguistic categorization is frequently explained in terms of children's attention to uniquely linguistic forms such as words. However, whether this facilitation is rooted in the children's attention to word forms very early in lexical learning has not been examined directly. A previous experiment (Roberts & Cuff, 1989) provided a set of conditions under which 15-month-olds did not successfully categorize in the absence of linguistic input. The two experiments reported here replicate Roberts and Cuff (1989) exactly, with the exception that either language (Experiment 1) or instrumental music (Experiment 2) was provided as accompanying input. Infants in both experiments successfully categorized and significantly increased attention during habituation. Although directly documenting the influence of language on categorization prior to the “vocabulary explosion,” this influence does not appear attributable to the presence of word forms. Instead, factors common to language and music (e.g., attention-getting properties or factors influencing attention) may facilitate nonlinguistic categorization at the beginnings of word learning.     

Predictive processing and the representation wars: a victory for the eliminativist (via fictionalism)

In this paper I argue that, by combining eliminativist and fictionalist approaches toward the sub-personal representational posits of predictive processing, we arrive at an empirically robust and yet metaphysically innocuous cognitive scientific framework. I begin the paper by providing a non-representational account of the five key posits of predictive processing (“prediction-signal”, “error-signal”, “prior”, “likelihood”, and “posterior probability”). Then, I motivate a fictionalist approach toward the remaining indispensable representational posits of predictive processing, and explain how representation can play an epistemologically indispensable role within predictive processing explanations without thereby requiring that representation metaphysically exists. Finally, I outline four consequences of accepting this approach and explain why they are beneficial: (1) we arrive at a victory for metaphysical eliminativism in the ‘representation wars’; (2) my account fits with extant empirical practice; (3) my account provides guidance for future research; and, (4) my account provides the beginnings of a response to Mark Sprevak’s IBE problem for fictionalist approaches toward sub-personal representation.     

Artificial intelligence,language, and the study of knowledge

This paper studies the relationship of Artificial Intelligence to the study of language and the representation of the underlying knowledge which supports the comprehension process. It develops the view that intelligence is based on the ability to use large amounts of diverse kinds of knowledge in procedural ways, rather than on the possession of a few general and uniform principles. The paper also provides a unifying thread to a variety of recent approaches to natural language comprehension. We conclude with a brief discussion of how Artificial Intelligence may have a radical impact on education if the principles which it utilizes to explore the representation and use of knowledge are made available to the student to use in his own learning experiences.     

How Possessive Relations are Mapped onto Child Language: A View from Mandarin Chinese

The present studies sought to investigate the mapping relations between language and cognition by focusing on how Mandarin-speaking children acquire the mapping between their conceptual knowledge of possession and their linguistic expressions of possession. Two experiments were conducted. Experiment 1 used a comprehension task to explore whether young children are able to map their knowledge of possessive constructions onto their interpretation of possessive relations. Experiment 2 employed a production task to examine whether they are able to map their knowledge of possessive relations onto their linguistic expressions of possession. The findings were that 4-year-olds exhibited correct comprehension and production of possessive DE constructions, indicating that by age 4, Mandarin-speaking children have already established the mapping between their conceptual knowledge of possession and their linguistic expressions of possession. By contrast, 3-year-olds exhibited response patterns that suggest a developmental stage where they use noun–noun compounds to represent possessive relations before they map possessive relations onto possessive constructions.     

Language production and comprehension in an adult with ACoA syndrome

This study explored the prediction that cases with anterior communicating artery (ACoA) syndrome will exhibit deficits in higher-level language production and comprehension. A 65-year-old adult male with a history of ACoA syndrome was tested on higher-level linguistic tasks. The patient's performance on discourse comprehension. discourse production, and linguistic ambiguity comprehension tasks was impaired.     

Non-Linguistic Grammar Learning by 12-Month-Old Infants: Evidence for Constraints on Learning

ABSTRACT

Infants acquiring their native language are adept at discovering grammatical patterns. However, it remains unknown whether these learning abilities are limited to language, or available more generally for sequenced input. The current study is a conceptual replication of a prior language study, and was designed to ask whether infants can track phrase structure-like patterns from nonlinguistic auditory materials (sequences of computer alert sounds). One group of 12-month-olds was familiarized with an artificial grammar including predictive dependencies between sounds concatenated into strings, simulating the basic structure of phrases in natural languages. A second group of infants was familiarized with a grammar that lacked predictive dependencies. All infants were tested on the same set of familiar strings vs. novel (grammar-inconsistent) strings. Only infants exposed to the materials containing predictive dependencies showed successful discrimination between the test sentences, replicating the results from linguistic materials, and suggesting that predictive dependencies facilitate learning from nonlinguistic input.     

Language comprehension vs. language production: age effects on fMRI activation

Normal language acquisition is a process that unfolds with amazing speed primarily in the first years of life. However, the refinement of linguistic proficiency is an ongoing process, extending well into childhood and adolescence. An increase in lateralization and a more focussed productive language network have been suggested to be the neural correlates of this process. However, the processes underlying the refinement of language comprehension are less clear. Using a language comprehension (Beep Stories) and a language production (Vowel Identification) task in fMRI, we studied language representation and lateralization in 36 children, adolescents, and young adults (age 6-24 years). For the language comprehension network, we found a more focal activation with age in the bilateral superior temporal gyri. No significant increase of lateralization with age could be observed, so the neural basis of language comprehension as assessed with the Beep Stories task seems to be established in a bilateral network by late childhood. For the productive network, however, we could confirm an increase with age both in focus and lateralization. Only in the language comprehension task did verbal IQ correlate with lateralization, with higher verbal IQ being associated with more right-hemispheric involvement. In some subjects (24%), language comprehension and language production were lateralized to opposite hemispheres.     

Interactive alignment as an allostatic process: A literature review

Research on interactive alignment encompasses various perspectives, including the recognition of linguistic coordination patterns, mental representation processes between interlocutors, and linguistic and behavioral convergence. In the absence of a literature review that presents the advances in the study of interactive alignment, this study identified 64 theoretical and empirical articles developed over 25 years (1996–2021) following the PRISMA methodology. Methodological and theoretical aspects derived from the analysis of the aforementioned reports are presented, showing how synchronization parameters interact, the associated neural bases, the impact of alignment on the development of joint actions, cognitive load, social interactions in general, and the prediction of language. The discussion and conclusions analyze the information presented and propose a comprehensive analysis from an allostatic perspective (predictive regulation through change) to advance the understanding of interactive alignment.     

The battle for Broca's region

The intense effort to characterize Broca's region has produced many views on its anatomy and function. Here, we present the leading approaches and consider ways to adjudicate among them empirically. Anatomically, we focus on the cytoarchitecture of Brodmann areas 44 and 45, which constitute Broca's region. Functionally, we discuss four views: action perception, working memory, syntactic complexity and syntactic movement. We compare these views, reflect on how they can be distinguished experimentally and review relevant aphasia and functional magnetic resonance imaging (fMRI) studies. Although no single hypothesis accounts for all of the data, the role of Broca's region in language comprehension is best explained by the syntactic movement account. This conclusion opens the door for an attempt to define general principles for the neural representation of linguistic knowledge.     

Children's associations between space and pitch are differentially shaped by language

Musical properties, such as auditory pitch, are not expressed in the same way across cultures. In some languages, pitch is expressed in terms of spatial height (high vs. low), whereas others rely on thickness vocabulary (thick = low frequency vs. thin = high frequency). We investigated how children represent pitch in the face of this variable linguistic input by examining the developmental trajectory of linguistic and non-linguistic space-pitch associations in children who acquire Dutch (a height-pitch language) or Turkish (a thickness-pitch language). Five-year-olds, 7-year-olds, 9-year-olds, and 11-year-olds were tested for their understanding of pitch terminology and their associations of spatial dimensions with auditory pitch when no language was used. Across tasks, thickness-pitch associations were more robust than height-pitch associations. This was true for Turkish children, and also Dutch children not exposed to thickness-pitch vocabulary. Height-pitch associations, on the other hand, were not reliable—not even in Dutch-speaking children until age 11—the age when they demonstrated full comprehension of height-pitch terminology. Moreover, Turkish-speaking children reversed height-pitch associations. Taken together, these findings suggest thickness-pitch associations are acquired in similar ways by children from different cultures, but the acquisition of height-pitch associations is more susceptible to linguistic input. Overall, then, despite cross-cultural stability in some components, there is variation in how children come to represent musical pitch, one of the building blocks of music.

Research Highlights

• Children from diverse cultures differ in their understanding of music vocabulary and in their nonlinguistic associations between spatial dimensions and auditory pitch.
• Height-pitch mappings are acquired late and require additional scaffolding from language, whereas thickness-pitch mappings are acquired early and are less susceptible to language input.
• Space-pitch mappings are not static from birth to adulthood, but change over development, suggesting music cognition is shaped by cross-cultural experience.