On the learnability of frequent and infrequent word orders: An artificial language learning study

Most languages have a basic or "canonical" word order, which determines the relative positions of the subject (S), the verb (V), and the object (O) in a typical declarative sentence. The frequency of occurrence of the six possible word orders among world languages is not distributed uniformly. While SVO and SOV represent around 85% of world languages, orders like VSO (9%) or OSV (0.5%) are much less frequent or extremely rare. One possible explanation for this asymmetry is that biological and cognitive constraints for structured sequence processing make some word orders easier to be processed than others. Therefore, the high frequency of these word orders would be related to their higher learnability. The aim of the present study was to compare the learnability of different word orders between groups of adult subjects. Four artificial languages with different word orders were trained: two frequent (SVO, SOV) and two infrequent (VSO, OSV). In a test stage, subjects were asked to discriminate between new correct sentences and syntax or semantic violations. Higher performance rates and faster responses were observed for more frequent word orders. The results support the hypothesis that more frequent word orders are more easily learned.     

Syntactic structure and artificial grammar learning: the learnability of embedded hierarchical structures

Embedded hierarchical structures, such as "the rat the cat ate was brown", constitute a core generative property of a natural language theory. Several recent studies have reported learning of hierarchical embeddings in artificial grammar learning (AGL) tasks, and described the functional specificity of Broca's area for processing such structures. In two experiments, we investigated whether alternative strategies can explain the learning success in these studies. We trained participants on hierarchical sequences, and found no evidence for the learning of hierarchical embeddings in test situations identical to those from other studies in the literature. Instead, participants appeared to solve the task by exploiting surface distinctions between legal and illegal sequences, and applying strategies such as counting or repetition detection. We suggest alternative interpretations for the observed activation of Broca's area, in terms of the application of calculation rules or of a differential role of working memory. We claim that the learnability of hierarchical embeddings in AGL tasks remains to be demonstrated.     

The neural correlates of statistical learning in a word segmentation task: An fMRI study

Functional magnetic resonance imaging (fMRI) was used to assess neural activation as participants learned to segment continuous streams of speech containing syllable sequences varying in their transitional probabilities. Speech streams were presented in four runs, each followed by a behavioral test to measure the extent of learning over time. Behavioral performance indicated that participants could discriminate statistically coherent sequences (words) from less coherent sequences (partwords). Individual rates of learning, defined as the difference in ratings for words and partwords, were used as predictors of neural activation to ask which brain areas showed activity associated with these measures. Results showed significant activity in the pars opercularis and pars triangularis regions of the left inferior frontal gyrus (LIFG). The relationship between these findings and prior work on the neural basis of statistical learning is discussed, and parallels to the frontal/subcortical network involved in other forms of implicit sequence learning are considered.     

An associative account of the development of word learning

Word learning is a notoriously difficult induction problem because meaning is underdetermined by positive examples. How do children solve this problem? Some have argued that word learning is achieved by means of inference: young word learners rely on a number of assumptions that reduce the overall hypothesis space by favoring some meanings over others. However, these approaches have difficulty explaining how words are learned from conversations or text, without pointing or explicit instruction. In this research, we propose an associative mechanism that can account for such learning. In a series of experiments, 4-year-olds and adults were presented with sets of words that included a single nonsense word (e.g. dax). Some lists were taxonomic (i.,e., all items were members of a given category), some were associative (i.e., all items were associates of a given category, but not members), and some were mixed. Participants were asked to indicate whether the nonsense word was an animal or an artifact. Adults exhibited evidence of learning when lists consisted of either associatively or taxonomically related items. In contrast, children exhibited evidence of word learning only when lists consisted of associatively related items. These results present challenges to several extant models of word learning, and a new model based on the distinction between syntagmatic and paradigmatic associations is proposed.     

Wittgenstein and contemporary theories of word learning

Wittgenstein's positions on word learning, rules of use, and the impossibility of a private language, as expounded in his Philosophical Investigations, are examined in relation to issues of early child word learning. Current theoretical positions in the cognitivist mode are contrasted with the social cultural pragmatic approach, and each is compared to the principles that Wittgenstein advanced. Bloom's [(2000). How children learn the meanings of words. Cambridge, MA: MIT Press] version of the cognitivist theory rejects most of the principles that Wittgenstein advanced, relying on innate cognitive endowments to explain children's success in word learning, using the word-referent mapping paradigm. Nelson's “use without meaning” and Tomasello's [(2003). Constructing a language: A usage-based theory of language acquisition. Cambridge, MA: Harvard University Press] social-pragmatic model of learning from use are presented as representative of Wittgensteinian principles that meaning exists in and is inferred from the uses of words within communal activities (“language games” in “forms of life”).     

Modes of knowledge acquisition and retrieval in artificial grammar learning

The aim of this study was to conceptualize artificial grammar learning (AGL) in terms of two orthogonal dimensions—the mode of knowledge acquisition and the mode of knowledge retrieval—as was done by Perlman and Tzelgov (2006) for sequence learning. Experiment 1 was carried out to validate our experimental task; Experiments 2–4 tested, respectively, performance in the intentional, incidental, and automatic retrieval modes, for each of the three modes of acquisition. Furthermore, signal detection theory (SDT) was used as an analytic tool, consistent with our assumption that the processing of legality-relevant information involves decisions along a continuous dimension of fluency. The results presented support the analysis of AGL in terms of the proposed dimensions. They also indicate that knowledge acquired during training may include many aspects of the presented stimuli (whole strings, relations among elements, etc.). The contribution of the various components to performance depends on both the specific instruction in the acquisition phase and the requirements of the retrieval task.     

The impact of adjacent-dependencies and staged-input on the learnability of center-embedded hierarchical structures

A theoretical debate in artificial grammar learning (AGL) regards the learnability of hierarchical structures. Recent studies using an AⁿBⁿ grammar draw conflicting conclusions (Bahlmann and Friederici, 2006 and [De Vries et al., 2008] ). We argue that 2 conditions crucially affect learning AⁿBⁿ structures: sufficient exposure to zero-level-of-embedding (0-LoE) exemplars and a staged-input. In 2 AGL experiments, learning was observed only when the training set was staged and contained 0-LoE exemplars. Our results might help understanding how natural complex structures are learned from exemplars.     

The acquisition of morphological knowledge investigated through artificial language learning

Affix knowledge plays an important role in visual word recognition, but little is known about how it is acquired. The authors present a new method of investigating the acquisition of affixes in which participants are trained on novel affixes presented in novel word contexts (e.g., sleepnept). Experiment 1 investigated the role of semantic information on affix acquisition by comparing a form-learning condition with a condition in which participants also received definitions for each novel word. Experiment 2 investigated the role of long-term consolidation on affix acquisition by comparing knowledge of learned affixes two days and nearly two months after training. Results demonstrated that episodic knowledge of affixes can be acquired shortly after a single training session using either form or semantic learning, but suggested that the development of lexicalized representations of affixes requires the provision of semantic information during learning as well as a substantial period of offline consolidation.     

Mindfulness reduces habitual responding based on implicit knowledge: Evidence from artificial grammar learning

Participants were unknowingly exposed to complex regularities in a working memory task. The existence of implicit knowledge was subsequently inferred from a preference for stimuli with similar grammatical regularities. Several affective traits have been shown to influence AGL performance positively, many of which are related to a tendency for automatic responding. We therefore tested whether the mindfulness trait predicted a reduction of grammatically congruent preferences, and used emotional primes to explore the influence of affect. Mindfulness was shown to correlate negatively with grammatically congruent responses. Negative primes were shown to result in faster and more negative evaluations. We conclude that grammatically congruent preference ratings rely on habitual responses, and that our findings provide empirical evidence for the non-reactive disposition of the mindfulness trait.     

The metamorphosis of the statistical segmentation output: Lexicalization during artificial language learning

This study combined artificial language learning (ALL) with conventional experimental techniques to test whether statistical speech segmentation outputs are integrated into adult listeners’ mental lexicon. Lexicalization was assessed through inhibitory effects of novel neighbors (created by the parsing process) on auditory lexical decisions to real words. Both immediately after familiarization and post-one week, ALL outputs were lexicalized only when the cues available during familiarization (transitional probabilities and wordlikeness) suggested the same parsing (Experiments 1 and 3). No lexicalization effect occurred with incongruent cues (Experiments 2 and 4). Yet, ALL differed from chance, suggesting a dissociation between item knowledge and lexicalization. Similarly contrasted results were found when frequency of occurrence of the stimuli was equated during familiarization (Experiments 3 and 4). Our findings thus indicate that ALL outputs may be lexicalized as far as the segmentation cues are congruent, and that this process cannot be accounted for by raw frequency.     

Methodological vs. strategic control in artificial grammar learning: A commentary on Norman, Price and Jones (2011)

Norman et al. (2011) reported that participants exposed in succession to two artificial grammars could be able to learn implicitly about them, and could apply their knowledge strategically to select which string corresponds to one of these two grammars. In this commentary, I identify an artifact that could account for the learning obtained not only in this study, but also in some previous studies using the same procedures. I claim that more methodological control is needed before jumping to conclusions on the kind of strategic control that could be achieved unconsciously.     

Perceptual constraints and the learnability of simple grammars

Cognitive processes are often attributed to statistical or symbolic general-purpose mechanisms. Here we show that some spontaneous generalizations are driven by specialized, highly constrained symbolic operations. We explore how two types of artificial grammars are acquired, one based on repetitions and the other on characteristic relations between tones ("ordinal" grammars). Whereas participants readily acquire repetition-based grammars, displaying early electrophysiological responses to grammar violations, they perform poorly with ordinal grammars, displaying no such electrophysiological responses. This outcome is problematic for both general symbolic and statistical models, which predict that both types of grammars should be processed equally easily. This suggests that some simple grammars are acquired using perceptual primitives rather than general-purpose mechanisms; such primitives may be elements of a "toolbox" of specialized computational heuristics, which may ultimately allow constructing a psychological theory of symbol manipulation.     

What artificial grammar learning reveals about the neurobiology of syntax

In this paper we examine the neurobiological correlates of syntax, the processing of structured sequences, by comparing FMRI results on artificial and natural language syntax. We discuss these and similar findings in the context of formal language and computability theory. We used a simple right-linear unification grammar in an implicit artificial grammar learning paradigm in 32 healthy Dutch university students (natural language FMRI data were already acquired for these participants). We predicted that artificial syntax processing would engage the left inferior frontal region (BA 44/45) and that this activation would overlap with syntax-related variability observed in the natural language experiment. The main findings of this study show that the left inferior frontal region centered on BA 44/45 is active during artificial syntax processing of well-formed (grammatical) sequence independent of local subsequence familiarity. The same region is engaged to a greater extent when a syntactic violation is present and structural unification becomes difficult or impossible. The effects related to artificial syntax in the left inferior frontal region (BA 44/45) were essentially identical when we masked these with activity related to natural syntax in the same subjects. Finally, the medial temporal lobe was deactivated during this operation, consistent with the view that implicit processing does not rely on declarative memory mechanisms that engage the medial temporal lobe. In the context of recent FMRI findings, we raise the question whether Broca’s region (or subregions) is specifically related to syntactic movement operations or the processing of hierarchically nested non-adjacent dependencies in the discussion section. We conclude that this is not the case. Instead, we argue that the left inferior frontal region is a generic on-line sequence processor that unifies information from various sources in an incremental and recursive manner, independent of whether there are any processing requirements related to syntactic movement or hierarchically nested structures. In addition, we argue that the Chomsky hierarchy is not directly relevant for neurobiological systems.     

The thematic hierarchy in sentence comprehension: A study on the interaction between verb class and word order in Spanish

Linking is the theory that captures the mapping of the semantic roles of lexical arguments to the syntactic functions of the phrases that realize them. At the sentence level, linking allows us to understand “who did what to whom” in an event. In Spanish, linking has been shown to interact with word order, verb class, and case marking. The current study aims to provide the first piece of experimental evidence about the interplay between word order and verb type in Spanish. We achieve this by adopting role and reference grammar and the extended argument dependency model. Two different types of clauses were examined in a self-paced reading task: clauses with object–experiencer psychological verbs and activity verbs. These types of verbs differ in the way that their syntactic and semantic structures are linked, and thus they provide interesting evidence on how information that belongs to the syntax–semantics interface might influence the predictive and integrative processes of sentence comprehension with alternative word orders. Results indicate that in Spanish, comprehension and processing speed is enhanced when the order of the constituents in the sentence mirrors their ranking on a semantic hierarchy that encodes a verb's lexical semantics. Moreover, results show that during online comprehension, predictive mechanisms based on argument hierarchization are used rapidly to inform the processing system. Our findings corroborate already existing cross-linguistic evidence on the issue and are briefly discussed in the light of other sentence-processing models.     

Understanding how input matters: verb learning and the footprint of universal grammar

Studies under the heading "syntactic bootstrapping" have demonstrated that syntax guides young children's interpretations during verb learning. We evaluate two hypotheses concerning the origins of syntactic bootstrapping effects. The "universalist" view, holding that syntactic bootstrapping falls out from universal properties of the syntax-semantics mapping, is shown to be superior to the "emergentist" view, which holds that argument structure patterns emerge from a process of categorization and generalization over the input. These theories diverge in their predictions about a language in which syntactic structure is not the most reliable cue to a certain meaning. In Kannada, causative morphology is a better predictor of causative meaning than transitivity is. Hence, the emergentist view predicts that Kannada-speaking children will associate causative morphology (in favor of transitive syntax) with causative meaning. The universalist theory, however, predicts the opposite pattern. Using an act-out task, we found that 3-year-old native speakers of Kannada associate argument number and not morphological form with causativity, supporting the universalist approach.     

Grammar overrides frequency: evidence from the online processing of flexible word order

We show that online processing difficulties induced by word order variations in German cannot be attributed to the relative infrequency of the constructions in question, but rather appear to reflect the application of grammatical principles during parsing. Event-related brain potentials revealed that dative-marked objects in the initial position of an embedded sentence do not elicit a neurophysiologically distinct response from subjects, whereas accusative-marked objects do. These differences are predictable on the basis of grammatical distinctions (i.e. underlying linguistic properties), but not on the basis of frequency information (i.e. a superficial linguistic property). We therefore conclude that the former, but not the latter, guides syntactic integration during online parsing.     

Conceptual accessibility and sentence production in a free word order language (Odawa)

The study reported here was conducted in the Algonquian language of Odawa (a.k.a. Ottawa), with the goal of gaining new insight into the ways that conceptual accessibility affects human sentence production. The linguistic characteristics of Odawa are quite different from those found in the languages most often examined by psycholinguists. The data obtained from the sentence production experiment reported here are thus relevant to production in a heretofore unexamined language. Moreover, the data inform broader theoretical issues, such as the extent to which sentence production can be considered as an incremental process, and the interaction of the various factors affecting conceptual accessibility. In addition, the study stands as evidence that experimental psycholinguistic research can and should be carried out in typologically diverse languages.     

Reading and lexicalization in opaque and transparent orthographies: Word naming and word learning in English and Spanish

Do skilled readers of opaque and transparent orthographies make differential use of lexical and sublexical processes when converting words from print to sound? Two experiments are reported, which address that question, using effects of letter length on naming latencies as an index of the involvement of sublexical letter–sound conversion. Adult native speakers of English (Experiment 1) and Spanish (Experiment 2) read aloud four- and seven-letter high-frequency words, low-frequency words, and nonwords in their native language. The stimuli were interleaved and presented 10 times in a first testing session and 10 more times in a second session 28 days later. Effects of lexicality were observed in both languages, indicating the deployment of lexical representations in word naming. Naming latencies to both words and nonwords reduced across repetitions on Day 1, with those savings being retained to Day 28. Length effects were, however, greater for Spanish than English word naming. Reaction times to long and short nonwords converged with repeated presentations in both languages, but less in Spanish than in English. The results support the hypothesis that reading in opaque orthographies favours the rapid creation and use of lexical representations, while reading in transparent orthographies makes more use of a combination of lexical and sublexical processing.     

Examining the role of social cues in early word learning

Infants watched a video of an adult pointing towards two different objects while hearing novel labels. Analyses indicated that 14- and 18-month-olds looked longer at the target object, but only 18-month-olds showed word learning. The results suggest that different types of social cues are available at different ages.     

The role of inferences about referential intent in word learning: evidence from autism

Young children are readily able to use known labels to constrain hypotheses about the meanings of new words under conditions of referential ambiguity. At issue is the kind of information children use to constrain such hypotheses. According to one theory, children take into account the speaker's intention when solving a referential puzzle. In the present studies, children with autism were impaired in monitoring referential intent, but were equally successful as normally developing 24-month-old toddlers at mapping novel words to unnamed items under conditions of referential ambiguity. Therefore, constraints that lead the child to map a novel label to a previously unnamed object under these circumstances are not solely based on assessments of speakers' intentions.