In search of meaning: semantic effects on past-tense inflection

Within single-mechanism connectionist models of inflectional morphology, generating the past-tense form of a verb depends upon the interaction of semantic and phonological representations, with semantic information being particularly important for irregular or exception verbs. We assessed this hypothesis in two experiments requiring normal speakers to produce the past tense from a verb stem that takes a regular or exceptional past tense. Experiment 1 revealed significant latency advantages for high- over low-imageability words for both regular verbs (e.g., "lunged" faster than "loved") and exception items (e.g., "drank" faster than "dealt"); but critically, this effect was significantly larger for exceptions than for regulars. Experiment 2 employed a semantic priming paradigm where participants inflected verb stems (e.g., sit) preceded by related (e.g., chair) or unrelated primes (e.g., jug) and revealed a priming effect in accuracy that was confined to the exception items. Our results are consistent with predictions from single-mechanism connectionist models of inflectional morphology and converge with findings from neurological patients and studies of reading aloud.     

Neural correlates of lexicon and grammar: evidence from the production, reading, and judgment of inflection in aphasia

Are the linguistic forms that are memorized in the mental lexicon and those that are specified by the rules of grammar subserved by distinct neurocognitive systems or by a single computational system with relatively broad anatomic distribution? On a dual-system view, the productive -ed-suffixation of English regular past tense forms (e.g., look-looked) depends upon the mental grammar, whereas irregular forms (e.g., dig-dug) are retrieved from lexical memory. On a single-mechanism view, the computation of both past tense types depends on associative memory. Neurological double dissociations between regulars and irregulars strengthen the dual-system view. The computation of real and novel, regular and irregular past tense forms was investigated in 20 aphasic subjects. Aphasics with non-fluent agrammatic speech and left frontal lesions were consistently more impaired at the production, reading, and judgment of regular than irregular past tenses. Aphasics with fluent speech and word-finding difficulties, and with left temporal/temporo-parietal lesions, showed the opposite pattern. These patterns held even when measures of frequency, phonological complexity, articulatory difficulty, and other factors were held constant. The data support the view that the memorized words of the mental lexicon are subserved by a brain system involving left temporal/temporo-parietal structures, whereas aspects of the mental grammar, in particular the computation of regular morphological forms, are subserved by a distinct system involving left frontal structures.     

Imaging the past: Neural activation in frontal and temporal regions during regular and irregular past-tense processing

This article presents fMRI evidence bearing on dual-mechanism versus connectionist theories of inflectional morphology. Ten participants were scanned at 4 Tesla as they covertly generated the past tenses of real and nonce (nonword) verbs presented auditorily. Regular past tenses (e.g., walked, wugged) and irregular past tenses (e.g., took, slept) produced similar patterns of activation in the posterior temporal lobe in both hemispheres. In contrast, there was greater activation in left and right inferior frontal gyrus for regular past tenses than for irregular past tenses. Similar previous results have been taken as evidence for the dual-mechanism theory of the past tense (Pinker & Ullman, 2002). However, additional analyses indicated that irregulars that were phonologically similar to regulars (e.g., slept, fled, sold) produced the same level of activation as did regulars, and significantly more activation than did irregulars that were not phonologically similar to regulars (e.g., took, gave). Thus, activation patterns were predicted by phonological characteristics of the past tense rather than by the rule-governed versus exception distinction that is central to the dual-mechanism framework. The results are consistent with a constraint satisfaction model in which phonological, semantic, and other probabilistic constraints jointly determine the past tense, with different degrees of involvement for different verbs.     

A Behavioral Study of Regularity,Irregularity and Rules in the English Past Tense

Opposing views of storage and processing of morphologically complex words (e.g., past tense) have been suggested: the dual system, whereby regular forms are not in the lexicon but are generated by rule, while irregular forms are explicitly represented; the single system, whereby regular and irregular forms are computed by a single system, using associative connections; and a system whereby phonological rules relate both regular and irregular past to present tense forms. Two reaction time experiments investigated the production of the past tense in English in response to the auditory presentation of the present tense of the verb. The first experiment addressed the methodology of presenting regulars and irregulars in blocked form as in a previous study (Jaeger et al. in Language 72:451–497, 1996). Blocked presentation results showed longer RTs for the elicitation of irregular pasts than for regular pasts; however, there were no differences between regular and irregular elicitation when the presentation was randomized, indicating that it is rules that are being primed. The second experiment tested whether the response time advantage found for blocked regular verbs in the first experiment might also extend to irregular verb forms exhibiting the same sub-regularity (e.g., sing-sang may prime ring-rang). Results showed a trend towards slower RTs when past tense forms from different sub-regularities follow one another, suggesting interference between one sub-regularity and another.     

In search of meaning: Semantic effects on past-tense inflection

Within single-mechanism connectionist models of inflectional morphology, generating the past-tense form of a verb depends upon the interaction of semantic and phonological representations, with semantic information being particularly important for irregular or exception verbs. We assessed this hypothesis in two experiments requiring normal speakers to produce the past tense from a verb stem that takes a regular or exceptional past tense. Experiment 1 revealed significant latency advantages for high- over low-imageability words for both regular verbs (e.g., “lunged” faster than “loved”) and exception items (e.g., “drank” faster than “dealt”); but critically, this effect was significantly larger for exceptions than for regulars. Experiment 2 employed a semantic priming paradigm where participants inflected verb stems (e.g., sit) preceded by related (e.g., chair) or unrelated primes (e.g., jug) and revealed a priming effect in accuracy that was confined to the exception items. Our results are consistent with predictions from single-mechanism connectionist models of inflectional morphology and converge with findings from neurological patients and studies of reading aloud.     

The role of type and token frequency in using past tense morphemes correctly

Type and token frequency have been thought to be important in the acquisition of past tense morphology, particularly in differentiating regular and irregular forms. In this study we tested the role of frequency in two ways: (1) in bilingual children, who typically use and hear either language less often than monolingual children and (2) cross-linguistically: French and English have different patterns of frequency of regular/irregular verbs. Ten French-English bilingual children, 10 French monolingual and 10 English monolingual children between 4 and 6 years watched a cartoon and re-told the story. The results demonstrated that the bilingual children were less accurate than the monolingual children. Their accuracy in both French and English regular and irregular verbs corresponded to frequency in the input language. These results are consistent with the hypothesis that children learn past tense morphemes by analogy with other words in their vocabularies. We propose a developmental sequence based on conservative generalization across a growing set of verbs.     

The processing of English regular inflections: Phonological cues to morphological structure

Previous studies suggest that different neural and functional mechanisms are involved in the analysis of irregular (caught) and regular (filled) past tense forms in English. In particular, the comprehension and production of regular forms is argued to require processes of morpho-phonological assembly and disassembly, analysing these forms into a stem plus an inflectional affix (e.g., {fill}+{-ed}), as opposed to irregular forms, which do not have an overt stem+affix structure and must be analysed as full forms [Marslen-Wilson, W. D., & Tyler, L. K. (1997). Dissociating types of mental computation. Nature, 387, 592-594; Marslen-Wilson, W. D., & Tyler, L. K. (1998). Rules, representations, and the English past tense. Trends in Cognitive Science, 2, 428-435]. On this account, any incoming string that shows the critical diagnostic properties of an inflected form - a final coronal consonant (/t/, /d/, /s/, /z/) that agrees in voicing with the preceding segment as in filled, mild, or nilled - will automatically trigger an attempt at segmentation. We report an auditory speeded judgment experiment which explored the contribution of these critical morpho-phonological properties (labelled as the English inflectional rhyme pattern) to the processing of English regular inflections. The results show that any stimulus that can be interpreted as ending in a regular inflection, whether it is a real inflection (filled-fill), a pseudo-inflection (mild-mile) or a phonologically matched nonword (nilled-nill), is responded to more slowly than an unambiguously monomorphemic stimulus pair (e.g., belt-bell). This morpho-phonological effect was independent of phonological effects of voicing and syllabicity. The findings are interpreted as evidence for a basic morpho-phonological parsing process that applies to all items with the criterial phonological properties.     

Rules, representations, and the English past tense

The significance of the English past tense in current cognitive science is that it offers a clear contrast between a potentially rule-based system-the procedures for forming the regular past tense-and an unpredictable and idiosyncratic set of irregular forms. This contrast has become a focus for a wide-ranging debate about whether mental computation requires the use of symbols. Highly regular combinatorial phenomena, such as the regular past tense, are prime candidates for rule-based symbolic computation. Earlier research concentrated on the evidence for this during language acquisition, looking at how children learned the English regular and irregular verb systems. Over the last five years attention has shifted towards the properties of the adult system, and we review here some recent research into the neural correlates of the two types of procedure. The evidence suggests that there are divergences in the neural systems underlying the generation and perception of regular and irregular forms. Regular inflected forms seem to involve primarily combinatorial processes, while irregular forms appear to have a hybrid status, sharing their semantic properties with the regular forms but diverging in the phonological domain, where their form representations are stored as complete units. This indicates that the regular and irregular past tenses may not, after all, provide a clean contrast in the types of mental computation they implicate.     

Errors of Omission in English-Speaking Children's Production of Plurals and the Past Tense: The Effects of Frequency, Phonology, and Competition

How do English‐speaking children inflect nouns for plurality and verbs for the past tense? We assess theoretical answers to this question by considering errors of omission, which occur when children produce a stem in place of its inflected counterpart (e.g., saying “dress” to refer to 5 dresses). A total of 307 children (aged 3;11–9;9) participated in 3 inflection studies. In Study 1, we show that errors of omission occur until the age of 7 and are more likely with both sibilant regular nouns (e.g., dress) and irregular nouns (e.g., man) than regular nouns (e.g., dog). Sibilant nouns are more likely to be inflected if they are high frequency. In Studies 2 and 3, we show that similar effects apply to the inflection of verbs and that there is an advantage for “regular‐like” irregulars whose inflected form, but not stem form, ends in d/t. The results imply that (a) stems and inflected forms compete for production and (b) children generalize both product‐oriented and source‐oriented schemas when learning about inflectional morphology.     

The role of meaning in inflection: why the past tense does not require a rule

How do we produce the past tenses of verbs? For the last 20 years this question has been the focal domain for conflicting theories of language, knowledge representation, and cognitive processing. On one side of the debate have been similarity-based or single-route approaches that propose that all past tenses are formed simply through phonological analogies to existing past tenses stored in memory. On the other side of the debate are rule-based or dual-route approaches which agree that phonological analogy is important for producing irregular past tenses (e.g., think-->thought), but argue that regular past tenses (e.g., walk-->walked) are generated via a +ed rule and that a principled account of regular inflection can only be given by recourse to explicit rules. This debate has become a crucial battleground for arguments concerning the necessity and importance of abstract mental rules, embracing not only language processing, but also the of nature cognition itself. However, in centering on the roles of phonological similarity and rules, the past tense debate has largely ignored the possible role of semantics in determining inflection. This paper presents five studies that demonstrate a striking and decisive role of semantic similarity in inflection. In fact, semantic factors appear to be more important in inflection than the grammatical considerations put forward by the dual-route account. Further, these new findings provide a new way of discriminating between the claims of single-route (similarity-based) and dual-route (rule-based) approaches. It appears that inflection is carried out through analogical reminding based on semantic and phonological similarity and that a rule-based route is not necessary to account for past tense inflection.     

Variation among developmental dyslexics: evidence from a printed-word-learning task

A word-learning task was used to investigate variation among developmental dyslexics classified as phonological and surface dyslexics. Dyslexic children and chronological age (CA)- and reading level (RL)-matched normal readers were taught to pronounce novel nonsense words such as veep. Words were assigned either a regular (e.g., "veep") or an irregular (e.g., "vip") pronunciation. Phonological dyslexics learned both regular and exception words more slowly than the normal readers and, unlike the other groups, did not show a regular-word advantage. Surface dyslexics also learned regular and exception words more slowly than the CA group, consistent with a specific problem in mastering arbitrary item-specific pronunciations, but their performance resembled that of the RL group. The results parallel earlier findings from Manis, Seidenberg, Doi, McBride-Chang, & Petersen [Cognition 58 (1996) 157-195] indicating that surface dyslexics and phonological dyslexics have a different profile of reading deficits, with surface dyslexics resembling younger normal readers and phonological dyslexics showing a specific phonological deficit. Models of reading and reading disability need to account for the heterogeneity in reading processes among dyslexic children.     

The relationship between phonological and morphological deficits in Broca's aphasia: further evidence from errors in verb inflection

A previous study of 10 patients with Broca's aphasia demonstrated that the advantage for producing the past tense of irregular over regular verbs exhibited by these patients was eliminated when the two sets of past-tense forms were matched for phonological complexity (Bird, Lambon Ralph, Seidenberg, McClelland, & Patterson, 2003). The interpretation given was that a generalised phonological impairment was central to the patients' language deficits, including their poor performance on regular past tense verbs. The current paper provides further evidence in favour of this hypothesis, on the basis of a detailed analysis of the errors produced by these same 10 patients in reading, repetition, and sentence completion for a large number of regular, irregular, and nonce verbs. The patients' predominant error types in all tasks and for all verb types were close and distant phonologically related responses. The balance between close and distant errors varied along three continua: the severity of the patient (more distant errors produced by the more severely impaired patients); the difficulty of the task (more distant errors in sentence completion>reading>repetition); the difficulty of the item (more distant errors for novel word forms than real verbs). A position analysis for these phonologically related errors revealed that vowels were most likely to be preserved and that consonant onsets and offsets were equally likely to be incorrect. Critically, the patients' errors exhibited a strong tendency to simplify the phonological form of the target. These results are consistent with the notion that the patients' relatively greater difficulty with regular past tenses reflects a phonological impairment that is sensitive to the complexity of spoken forms.     

Word-learning performance in beginning readers.

This investigation examined word-learning performance in beginning readers. The children learned to read words with regular spelling-sound mappings (e.g., snake) more easily than words with irregular spelling-sound mappings (e.g., sword). In addition, there was an effect of semantics: Children learned to read concrete words (e.g., elbow) more successfully than abstract words (e.g., temper). Trial-by-trial learning indicated that children made greater use of the regularity and semantic properties at later trials as compared with early trials. The influence of cognitive skills (paired associate learning and phonological awareness) on word-learning performance was also examined. Regression analyses revealed that whereas paired associate learning skills accounted for unique variance in the children's learning of both regular and irregular words, phonological awareness accounted for unique variance only in the acquisition of regular words.     

Regularity re-revisited: modality matters

The issue of regular-irregular past tense formation was examined in a cross-modal lexical decision task in Modern Greek, a language where the orthographic and phonological overlap between present and past tense stems is the same for both regular and irregular verbs. The experiment described here is a follow-up study of previous visual lexical decision experiments (Tsapkini, Kehayia, & Harema, 2002) that also addressed the regular-irregular distinction in Greek. In the present experiment, we investigated the effect of input modality in lexical processing and compared different types of regular and irregular verbs. In contrast to our previous intra-modal (visual-visual) priming experiments, in this cross-modal (auditory-visual) priming study, we found that regular verbs with an orthographically salient morphemic aspectual marker elicited the same facilitation as those without an orthographically salient marker. However, irregular verbs did not exhibit a different priming pattern with respect to modality. We interpret these results in the framework of a two-level lexical processing approach with modality-specific access representations at a surface level and modality-independent morphemic representations at a deeper level.     

Past tense marking in the spontaneous speech of preschool children who do and do not stutter

PurposeThe aim of this study was to identify whether different patterns of errors exist in irregular past-tense verbs in children who stutter (CWS) and children who do not stutter (CWNS).MethodSpontaneous language samples of thirty-one age- and gender-matched pairs of children (total N = 62) between the ages of 24 months and 59 months were analyzed.ResultsResults indicated that children who do and do not stutter over-regularize irregular past-tense verbs (i.e., saying runned for ran) with comparable frequency. However, two nonsignificant trends which suggest possible intra-group differences were noted. First, irregular past tense verbs represented a greater portion of total verbs for CWS than for CWNS. Second, CWS appeared to double-mark (i.e., say ranned for ran) more often than CWNS. Results are discussed in light of theories about the acquisition of the irregular past-tense and about differences in language skills between CWS and CWNS.Educational objectives: After reading this article, the reader will be able to: (a) summarize previous findings about connections between stuttering and language in CWS and CWNS; (b) describe similarities and differences between irregular past-tense verb use and errors in CWS and CWNS; (c) discuss possible connections between the declarative–procedural model and stuttering.     

U-shaped learning and frequency effects in a multi-layered perceptron: implications for child language acquisition

A three-layer back-propagation network is used to implement a pattern association task in which four types of mapping are learned. These mappings, which are considered analogous to those which characterize the relationship between the stem and past tense forms of English verbs, include arbitrary mappings, identity mappings, vowel changes, and additions of a suffix. The degree of correspondence between parallel distributed processing (PDP) models which learn mappings of this sort (e.g., Rumelhart & McClelland, 1986, 1987) and children's acquisition of inflectional morphology has recently been at issue in discussions of the applicability of PDP models to the study of human cognition and language (Pinker & Mehler, 1989; Bever, in press). In this paper, we explore the capacity of a network to learn these types of mappings, focusing on three major issues. First, we compare the performance of a single-layered perceptron similar to the one used by Rumelhart and McClelland with a multi-layered perceptron. The results suggest that it is unlikely that a single-layered perceptron is capable of finding an adequate solution to the problem of mapping stems and past tense forms in input configurations that are sufficiently analogous to English. Second, we explore the input conditions which determine learning in these networks. Several factors that characterize linguistic input are investigated: (a) the nature of the mapping performed by the network (arbitrary, suffixation, identity, and vowel change); (b) the competition effects that arise when the task demands simultaneous learning of distinct mapping types; (c) the role of the type and token frequency of verb stems; and (d) the influence of phonological subregularities in the irregular verbs. Each of these factors is shown to have selective consequences on both successful and erroneous performance in the network. Third, we outline several types of systems which could result in U-shaped acquisition, and discuss the ways in which learning in multi-layered networks can be seen to capture several characteristics of U-shaped learning in children. In general, these models provide information about the role of input in determining the kinds of errors that a network will produce, including the conditions under which rule-like behavior and U-shaped learning will and will not emerge. The results from all simulations are discussed in light of behavioral data on children's acquisition of the past tense and the validity of drawing conclusions about the acquisition of language from models of this sort.     

Overtensing and the effect of regularity

Regularly inflected forms often behave differently in language production than irregular forms. These differences are often used to argue that irregular forms are listed in the lexicon but regular forms are produced by rule. Using an experimental speech production task with adults, it is shown that overtensing errors, where a tensed verb is used in place of an infinitive, predominantly involve irregular forms, but that the differences may be due to phonological confounds, not to regularity per se. Errors involve vowel‐changing irregular forms more than suffixing inflected forms, with at best a small difference between regular ‐ed and irregular ‐en. Frequency effects on overtensing errors require a model in which the past‐tense and base forms of the verb are in competition and in which activation functions are nonlinear, and rule out models with specialized subnetworks for past‐tense forms. Implications for theories of language production are discussed.     

Can word formation be understood or understanded by semantics alone?

Arguments concerning the relative role of semantic and grammatical factors in word formation have proven to be a wedge issue in current debates over the nature of linguistic representation and processing. In the present paper, we re-examine claims by Ramscar [Ramscar, M. (2002). The role of meaning in inflection: Why the past tense does not require a rule. Cognitive Psychology, 45, 45-94.] that it is semantic rather than grammatical factors that influence the choice of regular or irregular past tense forms for English verbs. In Experiment 1, we first replicated Ramscar's (2002) experiment, which showed semantic influences on choice of past tense inflection. A novel verb, splink, was introduced in a semantic context that was reminiscent of an existing regular or irregular rhyme verb: blink or drink. Participants favored the past tense form (splinked or splank) that matched that of the semantically similar verb. In Experiment 2, we introduced novel verbs in a context suggesting that they were grammatically derived from nouns (i.e., denominals). Some current symbolic processing models propose that regular past tense forms should be preferred for such forms. When Ramscar's (2002) original contexts for derivational verbs were re-tested in this condition, we replicated his failure to find a preference for regular past tense forms. However, when the contexts were modified to make the grammatical process more salient, we did find a preference for regular past tense forms, suggesting that the derivational status might have been ambiguous in the original materials. In Experiment 3, we tested whether acceptability ratings for regular or irregular past tense forms of grammatically derived verbs could be explained by semantic distance metrics or by ratings of noun-to-verb derivational status. Ratings of semantic distance and grammatical derivation were orthogonal factors in Experiment 3. Only derivational status predicted acceptability ratings for regular past tense forms. Taken together, the present results suggest that semantic factors do not explain the regularization of irregular verbs in derivational contexts, although semantic factors can affect the choice of past tense forms in certain circumstances.     

The nature of regularity and irregularity: evidence from Hebrew nominal inflection

Most evidence for the role of regular inflection as a default operation comes from languages that confound the morphological properties of regular and irregular forms with their phonological characteristics. For instance, regular plurals tend to faithfully preserve the base's phonology (e.g., rat-rats), whereas irregular nouns tend to alter it (e.g., mouse-mice). The distinction between regular and irregular inflection may thus be an epiphenomenon of phonological faithfulness. In Hebrew noun inflection, however, morphological regularity and phonological faithfulness can be distinguished: Nouns whose stems change in the plural may take either a regular or an irregular suffix, and nouns whose stems are preserved in the plural may take either a regular or an irregular suffix. We use this dissociation to examine two hallmarks of default inflection: its lack of dependence on analogies from similar regular nouns, and its application to nonroots such as names. We show that these hallmarks of regularity may be found whether or not the plural form preserves the stem faithfully: People apply the regular suffix to novel nouns that do not resemble existing nouns and to names that sound like irregular nouns, regardless of whether the stem is ordinarily preserved in the plural of that family of nouns. Moreover, when they pluralize names (e.g., the Barak-Barakim), they do not apply the stem changes that are found in their homophonous nouns (e.g., barak-brakim lightning), replicating an effect found in English and German. These findings show that the distinction between regular and irregular phenomena cannot be reduced to differences in the kinds of phonological changes associated with those phenomena in English. Instead, regularity and irregularity must be distinguished in terms of the kinds of mental computations that effect them: symbolic operations versus memorized idiosyncrasies. A corollary is that complex words are not generally dichotomizable as regular or irregular different aspects of a word may be regular or irregular depending on whether they violate the rule for that aspect and hence must be stored in memory.