Tracking the time course of word recognition with MEG

Twenty years ago it was discovered that recognition of semantically unexpected words is associated with a special ERP signature - the N400. Pinpointing the precise functional significance of the N400 has, however, been difficult. Recent MEG studies of word processing reveal that, in fact, the N400 decomposes into several functionally distinct subcomponents, allowing for more fine-grained investigation of its significance.     

Age and the allocation of attention across the time course of word recognition.

Younger and older adults performed lexical decisions on ambiguous words, unambiguous words, and pseudowords, and simultaneously responded to an auditory probe presented at stimulus onset asynchronies (SOAs) of 90, 180, or 270 ms. For both age groups, lexical decisions and probe responses were faster for ambiguous words than for unambiguous words, and slowest for pseudowords. For the older adults, but not the younger adults, lexical decisions were slower when the probe was presented (the dual-task condition), compared with a control condition in which the lexical decision was performed alone. The older participants also showed slower tone-detection responses in the dual-task condition than when the tone was presented alone. For all participants, proportional tone-detection times (compared with tones in isolation) decreased with increasing SOA, but this decrease was less pronounced in the older group. Finally, the time between responses in the dual-task condition was longer for older than for younger adults. The results indicate that word meaning influences the allocation of attention similarly for younger and older adults, but that older adults suffer a cost and become disproportionately slower in processes related to response coordination and output.     

The time course of spoken word learning and recognition: studies with artificial lexicons

The time course of spoken word recognition depends largely on the frequencies of a word and its competitors, or neighbors (similar-sounding words). However, variability in natural lexicons makes systematic analysis of frequency and neighbor similarity difficult. Artificial lexicons were used to achieve precise control over word frequency and phonological similarity. Eye tracking provided time course measures of lexical activation and competition (during spoken instructions to perform visually guided tasks) both during and after word learning, as a function of word frequency, neighbor type, and neighbor frequency. Apparent shifts from holistic to incremental competitor effects were observed in adults and neural network simulations, suggesting such shifts reflect general properties of learning rather than changes in the nature of lexical representations.     

Tracking the time course of phonetic cue integration during spoken word recognition

Speech perception requires listeners to integrate multiple cues that each contribute to judgments about a phonetic category. Classic studies of trading relations assessed the weights attached to each cue but did not explore the time course of cue integration. Here, we provide the first direct evidence that asynchronous cues to voicing (/b/ vs. /p/) and manner (/b/ vs. /w/) contrasts become available to the listener at different times during spoken word recognition. Using the visual world paradigm, we show that the probability of eye movements to pictures of target and of competitor objects diverge at different points in time after the onset of the target word. These points of divergence correspond to the availability of early (voice onset time or formant transition slope) and late (vowel length) cues to voicing and manner contrasts. These results support a model of cue integration in which phonetic cues are used for lexical access as soon as they are available.     

Examining the time course of indexical specificity effects in spoken word recognition

Variability in talker identity and speaking rate, commonly referred to as indexical variation, has demonstrable effects on the speed and accuracy of spoken word recognition. The present study examines the time course of indexical specificity effects to evaluate the hypothesis that such effects occur relatively late in the perceptual processing of spoken words. In 3 long-term repetition priming experiments, the authors examined reaction times to targets that were primed by stimuli that matched or mismatched on the indexical variable of interest (either talker identity or speaking rate). Each experiment was designed to manipulate the speed with which participants processed the stimuli. The results demonstrate that indexical variability affects participants' perception of spoken words only when processing is relatively slow and effortful.     

自我相关性影响情绪词汇加工的时间进程

在社会交往中,判断情绪刺激与自我和他人的相关程度对于情绪加工十分重要。本研究利用ERPs技术,要求被试默读相继呈现的名字(自我、朋友和陌生人)和情绪性词汇(积极、中性和消极),考察自我相关信息影响情绪词汇加工的动态时间特征及二者的整合机制。结果发现,在情绪词汇加工早期,消极词汇相比积极和中性词汇诱发了波幅更大的EPN。在加工晚期,消极词汇相比中性词汇诱发波幅更小的N400,并相对中性和积极词汇诱发更大的LPP。更为重要的是,在LPP时间窗出现情绪效价和自我相关性的交互作用:与自我名字相关的消极词汇比中性词汇诱发了波幅更大的LPP,与朋友名字相关的消极词汇比中性和积极词汇诱发了波幅更大的LPP,而与陌生名字相关的各类词汇诱发的LPP波幅无显著差异。该研究表明,个体对情绪信息非常敏感,随着加工的深入会体现出不同的认知过程,并且会根据自我相关性进行过滤,在加工晚期与自我相关信息进行整合,表现出自我和朋友相关的消极情绪的加工优势。     

The time course of recognition of novel melodies

Seven experiments explored the time course of recognition of brief novel melodies. In a continuous-running-memory task, subjects recognized melodic transpositions following delays up to 2.0 min. The delays were either empty or filled with other melodies. Test items included exact transpositions (T), same-contour lures (SC) with altered pitch intervals, and different-contour lures (DC). DCs differed from Ts in the pattern of ups and downs of pitch. With this design, we assessed subjects’ discrimination of detailed changes in pitch intervals (T/SC discrimination) as well as their discrimination of contour changes (T/DC). We used both artificial and “real” melodies. Artificial melodies differed in conformity to a musical key, being tonal or atonal. After empty delays, T/DC discrimination was superior to T/SC discrimination. Surprisingly, after filled delays, T/SC discrimination was superior to T/DC. When only filled delays were tested, T/SC discrimination did not decline over the longest delays. T/DC performance declined more than did T/SC performance across both empty and filled delays. Tonality was an important factor only for T/SC discrimination after filled delays. T/DC performance was better with rhythmically intact folk melodies than with artificial isochronous melodies. Although T/SC performance improved over filled delays, it did not overtake T/DC performance. These results suggest that (1) contour and pitch-interval information make different contributions to recognition, with contour dominating performance after brief empty delays and pitch intervals dominating after longer filled delays; (2) a coherent tonality facilitates the encoding of pitch-interval patterns of melodies; and (3) the rich melodic—rhythmic contours of real melodies facilitate T/DC discrimination. These results are discussed in terms of automatic and controlled processing of melodic information.     

The time course of object-feature retrieval in recognition

The time course of perception and retrieval of object features was investigated. Participants completed a perceptual matching task and 2 recognition tasks under time pressure. The recognition tasks imposed different retention loads. A stochastic model of feature sampling with a Bayesian decision component was used to estimate the rate of feature perception and the rate of retrieval of feature information. The results demonstrated that retrieval rates did not differ among object features if only a single object was held in memory. If 2 objects were retained in memory, differences among retrieval rates of features emerged, indicating that features that were quickly perceived were also quickly retrieved. The results from the 2-object retention condition are compatible with process reinstatement models of retrieval.     

The time course of visual influences in letter recognition

This study builds on a specific characteristic of letters of the Roman alphabet—namely, that each letter name is associated with two visual formats, corresponding to their uppercase and lowercase versions. Participants had to read aloud the names of single letters, and event-related potentials (ERPs) for six pairs of visually dissimilar upper- and lowercase letters were recorded. Assuming that the end product of processing is the same for upper- and lowercase letters sharing the same vocal response, ERPs were compared backward, starting from the onset of articulatory responses, and the first significant divergence was observed 120 ms before response onset. Given that naming responses were produced at around 414 ms, on average, these results suggest that letter processing is influenced by visual information until 294 ms after stimulus onset. This therefore provides new empirical evidence regarding the time course and interactive nature of visual letter perception processes.     

The role of letter recognition in word recognition

In a paradigm that avoids methodological problems of earlier studies, evidence was gathered addressed to the question of whether we read letter by letter. If word recognition involves letter recognition, then the difficulty of recognizing a word should vary with the difficulty of recognizing its letters. This was tested by assessing letter difficulty in two letter discrimination tasks and in a letter naming task, and then comparing 15 adult subjects' visual recognition latency to 72 easy-letter words and to 72 difficult-letter words. Word frequency and word length were also manipulated. Results indicated no effect for letter difficulty, although recognition latency reliably decreased with word frequency and monotonically increased with word length (21 msec/letter), suggesting that we do not read letter by letter, but that whatever plays a role in word recognition is smaller than the word and correlated with word length in letters.     

The time course of perception and retrieval in matching and recognition

A four-part experiment was carried out to study the relationship between the time course of object-feature perception and the time course of retrieval of object information from memory. The experiment consisted of 2 perceptual matching tasks, and 2 perceptual recognition tasks. In all 4 tasks, participants provided speeded judgments of the identity of 2 objects. A stochastic feature-sampling model was used to estimate the time needed for feature perception and the time needed for retrieval of feature information. No evidence was found for a systematic relationship between perception times and retrieval times for individual features. Indeed, the model applications indicated that retrieval times were constant for different features, whereas perception rates varied across the features.     

The recognition of reduced word forms

This article addresses the recognition of reduced word forms, which are frequent in casual speech. We describe two experiments on Dutch showing that listeners only recognize highly reduced forms well when these forms are presented in their full context and that the probability that a listener recognizes a word form in limited context is strongly correlated with the degree of reduction of the form. Moreover, we show that the effect of degree of reduction can only partly be interpreted as the effect of the intelligibility of the acoustic signal, which is negatively correlated with degree of reduction. We discuss the consequences of our findings for models of spoken word recognition and especially for the role that storage plays in these models.     

Hemispheric asymmetries in the time course of recognition memory

Hemispheric specialization has been studied extensively within subfields ranging from perception to language comprehension. However, the study of asymmetries for basic memory functions—an area that holds promise for bridging these low- and high-level cognitive domains—has been sporadic at best. We examined each hemisphere’s tendency to retain verbal information over time, using a continuous recognition memory task with lateralized study items and central test probes. We found that the ubiquitous advantage of the left hemisphere for the processing and retention of verbal information is attenuated and perhaps even reversed over long retention intervals. This result is consistent with theories that propose differences in the degree to which the hemispheres maintain veridical versus semantically transformed representations of the input they receive.     

The contribution of morphology to word recognition

Summary Evidence of morphological processing was investigated in three word recognition tasks. In the first study, phonological ambiguity of the base morpheme in morphologically complex words of Serbo-Croatian was exploited in order to evaluate the claim that the base morpheme serves as the unit by which entries in the lexicon are accessed. An interaction of base morpheme ambiguity and affix characteristics was obtained and this outcome was interpreted as evidence that all morphological constituents of a word participate in lexical access. In the second study, facilitation due to morphological relatedness of prime and target was observed with Serbo-Croatian materials in the lexical decision and naming versions of the repetition priming task and results were interpreted as evidence of a morphological principle of organization among wholeword forms in the lexicon. In the third study, morphological affixes of both English and Serbo-Croatian words were segmented from a source word and affixed to a target word more rapidly than phonemically matched controls. Results suggest that the morphological constituents of complex words are available in some word recognition tasks and that morphological knowledge is represented in the speaker's lexicon.     

Models of word recognition

Major hypotheses about the processes involved in word recognition are reviewed and then assessed through four experiments. The purpose of the first experiment was to examine some basic aspects of the processing of words, pseudowords, and nonwords, and beyond that, to discover basic differences in their processing that might underlie the word advantage. The second experiment was designed to assess the contribution of whole-word and letter cluster cues to the word advantage. Finally, Experiments III and IV were focused on the question of whether the word advantage can be wholly explained in terms of response bias or sophisticated guessing. Taken together, the results of these experiments were most compatible with criterion bias models. A version of the criterion bias model is suggested wherein the word advantage is attributed to interfacilitation among single letter and lexical units in memory.     

The gender-marking effect in spoken word recognition

In this paper we examine whether the recognition of a spoken noun is affected by the gender marking—masculine or feminine—that is carried by a preceding word. In the first of two experiments, the gating paradigm was used to study the access of French nouns that were preceded by an appropriate gender marking, carried by an article, or preceded by no gender marking. In the second experiment, subjects were asked to make a lexical decision on the same material. A very strong facilitatory effect was found in both cases. The origin of the gender-marking effect is discussed, as well as the level of processing involved—lexical or syntactic.     

Additive and interactive effects on response time distributions in visual word recognition

Across 3 different word recognition tasks, distributional analyses were used to examine the joint effects of stimulus quality and word frequency on underlying response time distributions. Consistent with the extant literature, stimulus quality and word frequency produced additive effects in lexical decision, not only in the means but also in the shape of the response time distributions, supporting an early normalization process that is separate from processes influenced by word frequency. In contrast, speeded pronunciation and semantic classification produced interactive influences of word frequency and stimulus quality, which is a fundamental prediction from interactive activation models of lexical processing. These findings suggest that stimulus normalization is specific to lexical decision and is driven by the task's emphasis on familiarity-based information.