‘Ideal learning’ of natural language: Positive results about learning from positive evidence

Gold's [1967. Language identification in the limit. Information and Control, 16, 447-474] celebrated work on learning in the limit has been taken, by many cognitive scientists, to have powerful negative implications for the learnability of language from positive data (i.e., from mere exposure to linguistic input). This provides one, of several, lines of argument that language acquisition must draw on other sources of information, including innate constraints on learning. We consider an ‘ideal learner’ that applies a Simplicity Principle to the problem of language acquisition. The Simplicity Principle chooses the hypothesis that provides the briefest representation of the available data—here, the data are the linguistic input to the child. The Simplicity Principle allows learning from positive evidence alone, given quite weak assumptions, in apparent contrast to results on language learnability in the limit (e.g., Gold, 1967). These results provide a framework for reconsidering the learnability of various aspects of natural language from positive evidence, which has been at the center of theoretical debate in research on language acquisition and linguistics.     

双语(或多语)是否有利抵御老年痴呆症？

近50年来的语言神经科学研究确认了双(多)语经验的认知效应。就10年来双(多)语经验抵御老年痴呆症(特别是阿尔茨海默症, AD)的研究成果进行了深入探讨, 并基于认知储备(cognitive reserve)理论, 从功能和结构两方面探讨了双语(多语)经验抵御AD的神经机制。从外语的类型、熟悉程度、开始习得年龄, 以及研究方法等角度提出了要解决的问题, 旨在推动外语学习和教学, 并为老年化疾病和跨学科语言学研究提供新的思路。     

第二语言获得关键期研究进展

语言获得的关键期是发展心理学的一个重要且有争议的问题。近二十多年来．国外学者对第二语言获得年龄与第二语言的学习速度,第二语言的获得年龄与最后达到水平,第二语言的获得年龄与第二语言的大脑皮质表征和加工的关系等问题进行探讨,得到了复杂的结果。该领域的研究有待进一步控制与年龄相关的变量和认知变量,并将行为和脑功能的研究结合起来．更深入地探讨这一问题。     

Weighted constraints in generative linguistics

Harmonic Grammar (HG) and Optimality Theory (OT) are closely related formal frameworks for the study of language. In both, the structure of a given language is determined by the relative strengths of a set of constraints. They differ in how these strengths are represented: as numerical weights (HG) or as ranks (OT). Weighted constraints have advantages for the construction of accounts of language learning and other cognitive processes, partly because they allow for the adaptation of connectionist and statistical models. HG has been little studied in generative linguistics, however, largely due to influential claims that weighted constraints make incorrect predictions about the typology of natural languages, predictions that are not shared by the more popular OT. This paper makes the case that HG is in fact a promising framework for typological research, and reviews and extends the existing arguments for weighted over ranked constraints.     

Maturational Constraints on Language Learning

This paper suggests that there are constraints on learning required to explain the acquisition of language, in particular, maturational constraints. First, empirical evidence for this claim is reviewed. The evidence from several studies of both first and second language acquisition suggests that normal language learning occurs only when exposure to the language begins early in life. With exposure beginning later in life, asymptotic performance in the language declines: the effects over age of first exposure are approximately linear through childhood, with a flattening of the function in adulthood. These outcomes argue that some type of constraints ensuring successful language learning exist early in life, and weaken with increasing maturation. Second, two hypotheses are considered as to the nature of these maturational changes. One hypothesis is that constraints on learning particular to language acquisition undergo maturational decay. A second hypothesis, which is considered in more detail, suggests that language learning abilities decline because of the expansion of nonlinguistic cognitive abilities.     

Acquisition, learning, or development of language? Skinner's "Verbal Behavior" revisited

In 1957, Skinner, in his "Verbal Behavior", proposed an explanation on how a language is learned. In 1959, Chomsky strongly argued the non-learnability of language, establishing in the field of developmental psycholinguistics the substitution of the term "learning" for that of "acquisition". Currently, the constructivist models describe language acquisition as a process of ontogenetic, gradual, complex, and adaptive change. This new theoretical framework has been especially useful for rereading Verbal Behavior because it facilitates recovering the Skinnerian learning mechanisms. This can be observed in the recent research trends that recapture reinforcement and imitation (echoic responses), although they are now located in the initial phases of the process and are included in a cognitive dynamic that, by gradually increasing its complexity, can achieve grammar. The new constructivist theoretical framework, by retrieving the functional and referential aspects of language, can also take advantage of the classic Skinnerian proposal about the pragmatic types of verbal behavior, providing it with new meaning.     

面向汉语认知与功能特征的语法逻辑

本文研究范畴语法的两种扩充,一是从认知特征角度的扩充,将范畴语法扩充为认知特征范畴语法,通过具有完全性的逻辑证明解决了一些不合语言事实的句子判别问题;二是从功能特征角度的扩充,提出逻辑推理的形式和进一步将二者统一的可能性问题。     

Heuristics in learning classifiers: The acquisition of the classifier system and its implications for the nature of lexical acquisition

Classifiers are like nouns in that they classify entities in the world into lexical categories. However, the lexical nature of the classifier system is very different from that of nouns. We discuss how Japanese and Chinese children learn the meanings of classifiers. We focus on two specific questions: How classifier acquisition is different from noun acquisition; and what the prerequisites are for spontaneously extracting the meanings of classifiers. It is shown that children are very conservative in assigning meaning to classifiers. The pace of learning largely depends on semantic complexity, across languages and within each language. Furthermore, we suspect that learning the meanings of classifiers requires a certain cognitive ability – an ability to synthesize pieces of partial knowledge and form them into a cohesive whole. It may be only when children have developed such an ability that they are able to extract the complex semantic rules of classifiers on their own. We conclude that children take very different routes in learning nouns and classifiers: Unlike noun acquisition, classifier acquisition is guided by a slow, bottom-up process.     

Learning biases predict a word order universal

How recurrent typological patterns, or universals, emerge from the extensive diversity found across the world's languages constitutes a central question for linguistics and cognitive science. Recent challenges to a fundamental assumption of generative linguistics-that universal properties of the human language acquisition faculty constrain the types of grammatical systems which can occur-suggest the need for new types of empirical evidence connecting typology to biases of learners. Using an artificial language learning paradigm in which adult subjects are exposed to a mix of grammatical systems (similar to a period of linguistic change), we show that learners' biases mirror a word-order universal, first proposed by Joseph Greenberg, which constrains typological patterns of adjective, numeral, and noun ordering. We briefly summarize the results of a probabilistic model of the hypothesized biases and their effect on learning, and discuss the broader implications of the results for current theories of the origins of cross-linguistic word-order preferences.     

A computational model of early argument structure acquisition

How children go about learning the general regularities that govern language, as well as keeping track of the exceptions to them, remains one of the challenging open questions in the cognitive science of language. Computational modeling is an important methodology in research aimed at addressing this issue. We must determine appropriate learning mechanisms that can grasp generalizations from examples of specific usages, and that exhibit patterns of behavior over the course of learning similar to those in children. Early learning of verb argument structure is an area of language acquisition that provides an interesting testbed for such approaches due to the complexity of verb usages. A range of linguistic factors interact in determining the felicitous use of a verb in various constructions —associations between syntactic forms and properties of meaning that form the basis for a number of linguistic and psycholinguistic theories of language. This article presents a computational model for the representation, acquisition, and use of verbs and constructions. The Bayesian framework is founded on a novel view of constructions as a probabilistic association between syntactic and semantic features. The computational experiments reported here demonstrate the feasibility of learning general constructions, and their exceptions, from individual usages of verbs. The behavior of the model over the timecourse of acquisition mimics, in relevant aspects, the stages of learning exhibited by children. Therefore, this proposal sheds light on the possible mechanisms at work in forming linguistic generalizations and maintaining knowledge of exceptions.     

Probabilistic models of language processing and acquisition

Probabilistic methods are providing new explanatory approaches to fundamental cognitive science questions of how humans structure, process and acquire language. This review examines probabilistic models defined over traditional symbolic structures. Language comprehension and production involve probabilistic inference in such models; and acquisition involves choosing the best model, given innate constraints and linguistic and other input. Probabilistic models can account for the learning and processing of language, while maintaining the sophistication of symbolic models. A recent burgeoning of theoretical developments and online corpus creation has enabled large models to be tested, revealing probabilistic constraints in processing, undermining acquisition arguments based on a perceived poverty of the stimulus, and suggesting fruitful links with probabilistic theories of categorization and ambiguity resolution in perception.     

Neural network processing of natural language: II. Towards a unified model of corticostriatal function in learning sentence comprehension and non-linguistic sequencing

A central issue in cognitive neuroscience today concerns how distributed neural networks in the brain that are used in language learning and processing can be involved in non-linguistic cognitive sequence learning. This issue is informed by a wealth of functional neurophysiology studies of sentence comprehension, along with a number of recent studies that examined the brain processes involved in learning non-linguistic sequences, or artificial grammar learning (AGL). The current research attempts to reconcile these data with several current neurophysiologically based models of sentence processing, through the specification of a neural network model whose architecture is constrained by the known cortico-striato-thalamo-cortical (CSTC) neuroanatomy of the human language system. The challenge is to develop simulation models that take into account constraints both from neuranatomical connectivity, and from functional imaging data, and that can actually learn and perform the same kind of language and artificial syntax tasks. In our proposed model, structural cues encoded in a recurrent cortical network in BA47 activate a CSTC circuit to modulate the flow of lexical semantic information from BA45 to an integrated representation of meaning at the sentence level in BA44/6. During language acquisition, corticostriatal plasticity is employed to allow closed class structure to drive thematic role assignment. From the AGL perspective, repetitive internal structure in the AGL strings is encoded in BA47, and activates the CSTC circuit to predict the next element in the sequence. Simulation results from Caplan's [Caplan, D., Baker, C., & Dehaut, F. (1985). Syntactic determinants of sentence comprehension in aphasia. Cognition, 21, 117-175] test of syntactic comprehension, and from Gomez and Schvaneveldts' [Gomez, R. L., & Schvaneveldt, R. W. (1994). What is learned from artificial grammars?. Transfer tests of simple association. Journal of Experimental Psychology: Learning, Memory and Cognition, 20, 396-410] artificial grammar learning experiments are presented. These results are discussed in the context of a brain architecture for learning grammatical structure for multiple natural languages, and non-linguistic sequences.     

双语获得的认知过程与浸入式教学的理论基础

本文从语言心理学和认知心理学的角度,介绍了双语获得的认知过程与浸入式教学的理论基础。通过对双语获得的内部过程的探讨,明确指出不同的双语获得途径可能具有两种不同的语言信息加工的模式和产生不同的学习效果和语用能力;特别强调语言与认知发展的关系以及语言认知策略;此外,结合认知神经心理学的研究成果,探讨了双语获得的神经机制。     

Directions in Connectionist Research: Tractable Computations Without Syntactically Structured Representations

Should connectionists abandon the quest for tractably computable cognitive transition functions while retaining syntactically structured mental representations? We argue, in opposition to Horgan, that it should not. We argue that the case against tractably computable functions, based upon the claimed isotropic and Quinean character of cognition, fails since cognition is not as isotropic and Quinean as Fodor and Horgan contend. Moreover, we illustrate how current research in both connectionism and cognitive neuroscience suggests that tractability can be preserved through division of overall computations into modular sub-processes, each of which is tractable. As to syntactically structured representations, we argue that they are unneeded for most cognitive tasks organisms confront, and that when they are needed, they may be provided by external representational media such as natural language. Moreover, we note that increasingly cognitive linguistics has become the ally of connectionism and that the research program of cognitive linguistics suggests that abilities to use natural languages may be developed without requiring syntactically structured mental representations to exist prior to natural language.     

The mind beyond our immediate awareness: Freudian, Jungian, and cognitive models of the unconscious

Abstract: Several branches of cognitive science now focus on the nature of the unconscious. This paper explores some of the findings and models from this research. By introducing formulations based on non‐clinical data, the cognitive scientists—in neural linguistics, computational modelling, and neuroscience—may depart from the older psychoanalytic formulations. An understanding of unconscious neural processes is nevertheless emerging showing how synapses are modified by experience and how learning, conscious and unconscious, is due to this important aspect of brain plasticity. Freud and Jung's formulations about the unconscious psyche, representing the main tenets of depth psychology, are also based on a conception of the mind as extending beyond immediate awareness. However, their models are more hypothetical in that their data, almost exclusively, come from treatments of psychotherapy patients and their verbal accounts. So how do these two conceptions of the unconscious match, where do they differ? And how does the neural understanding in the present research support theories and practices of analytic treatments?     

Deranging the Mental Lexicon

This paper offers a defense of Davidson’s conclusion in ‘A Nice Derangement of Epitaphs’, focusing on the psychology and epistemology of language. Drawing on empirical studies in language acquisition and sociolinguistics, I problematize the traditional idealizing assumption that a person’s mental lexicon consists of two distinct parts—a dictionary, comprising her knowledge of word meanings proper, and an encyclopedia, comprising her wider knowledge of worldly affairs. I argue that the breakdown of the dictionary–encyclopedia distinction can be given a cognitive and functional explanation: facts regarding language learning and the challenges of coping with linguistically diverse environments require that dictionary and encyclopedia remain deeply integrated rather than categorically distinct dimensions of the mental lexicon. This argument provides support for a psychologized version of Davidson’s conclusion in ‘Derangement’: there is no such thing as a language, in the sense that there is no diachronically stable and uniquely specifiable object that could constitute the language which a person knows. I then apply this conclusion to the question of whether the concept of a public language—understood as a more or less stable body of conventions shared by a group of speakers—could nonetheless retain an important explanatory role in philosophy of language and linguistics.     

Incidental Learning of Gender Agreement in L2

Incidental learning of grammar has been an area of interest for many decades; nevertheless, existing research has primarily focused on artificial or semi-artificial languages. The present study examines the incidental acquisition of the grammar of a natural language by exposing adult speakers of an ungendered L1 (English) to the gender agreement patterns in Russian (a language that was novel to the learners). Both receptive and productive knowledge and the mediating role of working memory (WM) in learning were measured. Speakers of the ungendered language were able to successfully acquire receptive but not productive grammatical knowledge in a new language under incidental exposure. WM was engaged in production but not in a grammaticality judgment task in the incidental learning condition, indicating cognitive effort during knowledge retrieval.     

Language and communicative development in Williams syndrome

Williams syndrome, a genetic disorder caused by a microdeletion of approximately 25 genes on chromosome 7q11.23, is associated with mild to moderate intellectual disability or learning difficulties. Most individuals with Williams syndrome evidence a cognitive profile including relative strengths in verbal short-term memory and language, and considerable weakness in visuospatial construction. The syndrome has often been argued to provide strong evidence for the independence of language from other aspects of cognition. We provide a brief history of early research on the language abilities of individuals with Williams syndrome and then review contemporary studies of language and cognition in Williams syndrome, beginning with a consideration of performance on standardized assessments. In the remainder of the article, we first consider early language acquisition, with a focus on speech production and perception, vocabulary acquisition, and communicative/pragmatic development and then consider the language abilities of school-age children and adolescents, focusing on semantics, grammar, and pragmatics. We argue that rather than being the paradigm case for the independence of language from cognition, Williams syndrome provides strong evidence of the interdependence of many aspects of language and cognition.     

Generative connectionist networks and constructivist cognitive development

This article presents a novel computational framework for modeling cognitive development. The new modeling paradigm provides a language with which to compare and contrast radically different facets of children's knowledge. Concepts from the study of machine learning are used to explore the power of connectionist networks that construct their own architectures during learning. These so-called generative algorithms are shown to escape from Fodor's (1980) critique of Constructivist development. We describe one generative connectionist algorithm (cascade-correlation) in detail. We report on the successful use of the algorithm to model cognitive development on balance scale phenomena; seriation; the integration of velocity, time, and distance cues; prediction of effect sizes from magnitudes of causal potencies and effect resistances; and the acquisition of English personal pronouns. The article demonstrates that computer models are invaluable for illuminating otherwise obscure discussions.     

Language,cognition, and second language grammaticality judgments

In first language research, there appear to be two predominant positions relating metalinguistic awareness to language development. One suggests that since metalinguistic awareness is related to primary language acquisition (comprehension and production), general cognitive processes perform a limited role in metalinguistic awareness. The other suggests that since metalinguistic awareness is more closely related to secondary language acquisition (reading and writing), a greater role is assumed by general cognitive processes. There have been some indirect attempts to study the role of language and cognition with respect to second language grammaticality judgments. There is growing evidence that metalinguistic awareness is a reliable indicator of developing second language competence. Furthermore, it has been shown that language aptitude is significantly related to metalinguistic awareness. The present study was designed to investigate the statistical relationship between second language grammaticality judgments and selected cognitive and linguistic variables. The variables studied were second language proficiency, second language classroom achievement, first language reading competence, language aptitude, nonverbal intelligence, field dependence-independence, and a written grammaticality judgment test tapping the ability to recognize, and correct, deviance. Subjects were college students in advanced English-as-a-second-language classes. Multivariate statistical techniques were used to determine the relative contribution of linguistic and cognitive variables to the individual variation demonstrated by the learners in their ability to detect deviance in English. The results showed that second language proficiency, second language achievement in the classroom, and language aptitude were significant predictors of the subjects' ability to make grammaticality judgments. First language reading competence was significantly related to subjects' ability to correct deviance. These observations are discussed in the light of: (1) the relationship among cognition, language, and metalinguistic awareness, and (2) the role of metalinguistic awareness in second language acquisition and second language learning.