The cascaded nature of lexical selection and integration in auditory sentence processing

An event-related brain potential experiment was carried out to investigate the temporal relationship between lexical selection and the semantic integration in auditory sentence processing. Participants were presented with spoken sentences that ended with a word that was either semantically congruent or anomalous. Information about the moment in which a sentence-final word could uniquely be identified, its isolation point (IP), was compared with the onset of the elicited N400 congruity effect, reflecting semantic integration processing. The results revealed that the onset of the N400 effect occurred prior to the IP of the sentence-final words. Moreover, the factor early or late IP did not affect the onset of the N400. These findings indicate that lexical selection and semantic integration are cascading processes, in that semantic integration processing can start before the acoustic information allows the selection of a unique candidate and seems to be attempted in parallel for multiple candidates that are still compatible with the bottom-up acoustic input.     

The effect of presemantic acoustic adaptation on semantic “satiation”

A decrement in the strength of the meaning of a word after rapid repetition of that word has been called “semantic satiation.” This study asked whether this “satiation” might be produced by presemantic acoustic adaptation. Category words were utilized to prime the meaning of target words. The adaptation or “satiation” procedure, 30 rapid repetitions of the primes, was compared with a control condition of 3 repetitions. Participants listened to a series of prime words, each repeated by either the same speaker or many speakers, and then made semantic decisions on target words. When all the repetitions of a prime word are produced by the same speaker, presemantic and semantic repetitions are confounded. When the repetitions are produced by different speakers, presemantic acoustic repetition is abolished. A semantic decrement was detected with single-speaker, but not with multiple-speaker, repetitions of prime words. This study concluded that the semantic “satiation” observed here was a decrement in the activation level of semantic representations induced by presemantic acoustic adaptation.     

语义整合的早期加工:来自ERPs的证据

本研究借助ERPs技术,通过操纵关键词与当前语境的语义合理性关系,考察在严格限定关键词词频变异性的情况下,语义整合过程能否反映在P2效应上。ERPs结果发现关键词呈现后,语义合理相比违背条件在右侧脑区诱发了更大的P2成分。该结果支持如果关键词低水平的变量信息(词频等)得到适当控制,ERPs技术可以检测到发生在250ms以前的语义整合过程。     

序列语义的类别一致性关系能否进行无意识整合？

阈下语义之间能否进行整合,最近的研究给出了不同的结果。当多个阈下语义词语同时呈现时显示出无意识语义整合效应,但是当序列呈现时没有观察到无意识整合效应。本研究在保留同时呈现方法优点（不同空间呈现位置）的情况下研究了序列呈现的不同汉字词语之间能否产生无意识语义类别关系整合。在实验1中,两个相同或不同类别的词语作为阈下启动刺激先后在两侧呈现,且第一个词语消失后第二词语马上出现,结果显示出无意识语义类别整合效应。实验2延长了两个阈下启动词语之间的时间间隔,结果未发现无意识语义类别整合效应。另外,实验3进一步排除了实验1中第一个启动词语的视觉残留,结果也未观察到显著的无意识语义类别整合效应,说明实验1中观察到的无意识整合效应是视觉残留所致。综合三个实验结果表明,两个阈下词语之间的语义类别一致性关系只有在同时呈现这种特殊条件下才能进行无意识整合加工,说明了短时间维度对于无意识语义关系整合的重要性。     

The semantics of prosody: acoustic and perceptual evidence of prosodic correlates to word meaning

This investigation examined whether speakers produce reliable prosodic correlates to meaning across semantic domains and whether listeners use these cues to derive word meaning from novel words. Speakers were asked to produce phrases in infant-directed speech in which novel words were used to convey one of two meanings from a set of antonym pairs (e.g., big/small). Acoustic analyses revealed that some acoustic features were correlated with overall valence of the meaning. However, each word meaning also displayed a unique acoustic signature, and semantically related meanings elicited similar acoustic profiles. In two perceptual tests, listeners either attempted to identify the novel words with a matching meaning dimension (picture pair) or with mismatched meaning dimensions. Listeners inferred the meaning of the novel words significantly more often when prosody matched the word meaning choices than when prosody mismatched. These findings suggest that speech contains reliable prosodic markers to word meaning and that listeners use these prosodic cues to differentiate meanings. That prosody is semantic suggests a reconceptualization of traditional distinctions between linguistic and nonlinguistic properties of spoken language.     

序列语义的类别一致性关系能否进行无意识整合？

阈下语义之间能否进行整合,最近的研究给出了不同的结果。当多个阈下语义词语同时呈现时显示出无意识语义整合效应,但是当序列呈现时没有观察到无意识整合效应。本研究在保留同时呈现方法优点（不同空间呈现位置）的情况下研究了序列呈现的不同汉字词语之间能否产生无意识语义类别关系整合。在实验1中,两个相同或不同类别的词语作为阈下启动刺激先后在两侧呈现,且第一个词语消失后第二词语马上出现,结果显示出无意识语义类别整合效应。实验2延长了两个阈下启动词语之间的时间间隔,结果未发现无意识语义类别整合效应。另外,实验3进一步排除了实验1中第一个启动词语的视觉残留,结果也未观察到显著的无意识语义类别整合效应,说明实验1中观察到的无意识整合效应是视觉残留所致。综合三个实验结果表明,两个阈下词语之间的语义类别一致性关系只有在同时呈现这种特殊条件下才能进行无意识整合加工,说明了短时间维度对于无意识语义关系整合的重要性。     

中文词汇加工过程中的无关言语效应

通过两个词汇识别任务,考察词汇加工过程中的无关言语效应。实验1采用真假词判断任务,考察有意义言语、无意义言语、白噪音和安静的背景声音对不同具体性的词汇识别的影响。结果发现,仅有意义言语干扰了词汇识别,且主要体现在对低具体性词汇判断的反应时显著增加。实验2采用了语义范畴判断任务,同样发现有意义言语条件下被试的反应时显著大于其他声音条件。结果表明,中文词汇加工过程中存在无关言语效应,且当任务强调语义加工时,干扰主要源于无关言语的语义成分,支持了语义干扰假说。     

Developmental changes in incidental memory as a function of processing level,congruity, and repetition

Second-, fifth-, and ninth-grade students (8, 11, and 14 years of age, respectively) answered acoustic and semantic questions about words which were either congruent or incongruent with the questions. Subsequently, students' free recall of the words was unexpectedly tested. For words presented once in the list, only orienting task and congruity main effects were found. For twice-presented words, grade level interacted with both variables in that older students' recall was better than younger students' only for semantically encoded, congruent words. This finding is consistant with the hypothesis that developmental increases in semantic knowledge enhance the potential for encoding elaboration, but is in apparent conflict with the results of M. F. Geis and D. M. Hall (Child Development, 1978, 49, 857–861) who found no such interaction for second- and fifth-grade children. The different age spans included in the two studies provides one resolution of the discrepancy in results. However, a second experiment tested the importance of a procedural difference between the two studies. M. F. Geis and D. M. Hall (Journal of Experimental Child Psychology, 1976, 22, 58–66; 1978) presented the question after the stimulus word while we presented the question before the word. For ninth-grade students, the question after condition resulted in an attenuation of the recall difference between semantic and acoustic questions compared to the question before condition. It was argued that the pattern of developmental differences in incidental memory that is obtained may be related to which procedure is utilized.     

Auditory context effects in picture naming investigated with event-related fMRI

Naming an object entails a number of processing stages, including retrieval of a target lexical concept and encoding of its phonological word form. We investigated these stages using the picture-word interference task in an fMRI experiment. Participants named target pictures in the presence of auditorily presented semantically related, phonologically related, or unrelated distractor words or in isolation. We observed BOLD signal changes in left-hemisphere regions associated with lexical-conceptual and phonological processing, including the midto-posterior lateral temporal cortex. However, these BOLD responses manifested as signal reductions for all distractor conditions relative to naming alone. Compared with unrelated words, phonologically related distractors showed further signal reductions, whereas only the pars orbitalis of the left inferior frontal cortex showed a selective reduction in response in the semantic condition. We interpret these findings as indicating that the word forms of lexical competitors are phonologically encoded and that competition during lexical selection is reduced by phonologically related distractors. Since the extended nature of auditory presentation requires a large portion of a word to be presented before its meaning is accessed, we attribute the BOLD signal reductions observed for semantically related and unrelated words to lateral inhibition mechanisms engaged after target name selection has occurred, as has been proposed in some production models.     

Interplay between acoustic/phonetic and semantic processes during spoken sentence comprehension: an ERP study

When listening to speech in everyday-life situations, our cognitive system must often cope with signal instabilities such as sudden breaks, mispronunciations, interfering noises or reverberations potentially causing disruptions at the acoustic/phonetic interface and preventing efficient lexical access and semantic integration. The physiological mechanisms allowing listeners to react instantaneously to such fast and unexpected perturbations in order to maintain intelligibility of the delivered message are still partly unknown. The present electroencephalography (EEG) study aimed at investigating the cortical responses to real-time detection of a sudden acoustic/phonetic change occurring in connected speech and how these mechanisms interfere with semantic integration. Participants listened to sentences in which final words could contain signal reversals along the temporal dimension (time-reversed speech) of varying durations and could have either a low- or high-cloze probability within sentence context. Results revealed that early detection of the acoustic/phonetic change elicited a fronto-central negativity shortly after the onset of the manipulation that matched the spatio-temporal features of the Mismatch Negativity (MMN) recorded in the same participants during an oddball paradigm. Time reversal also affected late event-related potentials (ERPs) reflecting semantic expectancies (N400) differently when words were predictable or not from the sentence context. These findings are discussed in the context of brain signatures to transient acoustic/phonetic variations in speech. They contribute to a better understanding of natural speech comprehension as they show that acoustic/phonetic information and semantic knowledge strongly interact under adverse conditions.     

Phonetic-semantic mediated false recognition: does activation fail to spread?

Spoken word recognition involves brief activation of candidate words. Six experiments examined whether words semantically related to phonologically activated words would be falsely recognized. Experiments 1 and 2 involved homophones as test words; Experiment 3 used strong associates for the semantic mediation link. Experiment 4 approximated lists of "strong" converging associates. Experiment 5 expanded the real time needed for word identification by using a gating procedure during study. In Experiment 6, the goal was to create a more sensitive test by requiring participants to indicate which of two lures (mediated or control) was "most likely" to be new. Recognition errors were sensitive to separate phonetic and semantic stages in the mediated chain; however, there was little evidence of mediated false recognition, despite expectations derived from common models of spreading activation.     

Adding new information to semantic memory: how much learning is enough to produce automatic priming?

A series of experiments investigated the integration of new vocabulary words into semantic memory and the creation of new associations between preexisting, but previously unrelated, words. The ability of the newly learned vocabulary words and associations to facilitate lexical decisions when serving as primes under conditions associated with automatic processing was used to index integration. The results indicate that very extensive study is necessary for such integration to occur and that it is easier to add a new word to semantic memory than to establish a link between two formerly unconnected words already in semantic memory. The implications of these results for models of semantic memory and the episodic/semantic distinction are considered.     

Gating技术与汉语听觉词汇加工

尝试对Gating技术的实施和运用,对数据进行探索性分析。被试为47名北京师范大学本科学生。实验中被试听到依次加长的单字词语音片段,每听完一个语音片段要尽快判断该语音是什么字音,并迅速写出想到的第一个符合该读音的汉字,同时在七点量表上评定作出判断的确定性等级。结果显示,Gating技术作为探讨汉语听觉词汇加工的一条途径可以提供丰富的信息,它不仅能得到词汇的语音识别点(Isolation Point,IP),也揭示出它与声调存在一定关系。对错误反应的分析还表明：声调信息可以独立于音段信息而被识别;即时影响声调识别的因素不一定局限于区别性特征;听觉词汇识别受到听觉语言特有的方向性特点的影响,这种影响不仅体现在音段信息、也体现在超音段信息的识别中。     

Novel word integration in the mental lexicon: Evidence from unmasked and masked semantic priming

We sought to establish whether novel words can become integrated into existing semantic networks by teaching participants new meaningful words and then using these new words as primes in two semantic priming experiments, in which participants carried out a lexical decision task to familiar words. Importantly, at no point in training did the novel words co-occur with the familiar words that served as targets in the primed lexical decision task, allowing us to evaluate semantic priming in the absence of direct association. We found that familiar words were primed by the newly related novel words, both when the novel word prime was unmasked (Experiment 1) and when it was masked (Experiment 2), suggesting that the new words had been integrated into semantic memory. Furthermore, this integration was strongest after a 1-week delay and was independent of explicit recall of the novel word meanings: Forgetting of meanings did not attenuate priming. We argue that even after brief training, newly learned words become an integrated part of the adult mental lexicon rather than being episodically represented separately from the lexicon.     

Dissociating semantic and phonological maintenance using fMRI

Functional magnetic resonance imaging (fMRI) distinguished regions of neural activity associated with active maintenance of semantic and phonological information. Subjects saw a single word for 2 sec, and following a 10-sec delay, made a judgment about that word. In the semantic task, subjects focused on the meaning of the word and decided whether a second word was synonymous with it. In the phonological task, subjects repeated the word silently and decided whether it shared a vowel sound with a nonsense word. Analyses allowed for isolation of neural activity during the maintenance delay. Semantic maintenance elicited greater activity in bilateral inferior frontal gyrus and left middle temporal gyrus regions of interest (ROI). In contrast, there was greater activity for phonological maintenance in the left superior parietal ROI. These results show a frontal-temporal network involved in actively maintaining the meanings of words, and they indicate that semantic and phonological maintenance processes are dissociable within working memory.     

Early use of phonetic information in spoken word recognition: Lexical stress drives eye movements immediately

For optimal word recognition listeners should use all relevant acoustic information as soon as it comes available. Using printed-word eye tracking we investigated when during word processing Dutch listeners use suprasegmental lexical stress information to recognize words. Fixations on targets such as “OCtopus” (capitals indicate stress) were more frequent than fixations on segmentally overlapping but differently stressed competitors (“okTOber”) before segmental information could disambiguate the words. Furthermore, prior to segmental disambiguation, initially stressed words were stronger lexical competitors than noninitially stressed words. Listeners recognize words by immediately using all relevant information in the speech signal.     

How does the provision of semantic information influence the lexicalization of new spoken words?

The integration of a novel spoken word with existing lexical items can proceed within 24 hours of learning its phonological form. However, previous studies have reported that lexical integration of new spoken words can be delayed if semantic information is provided during learning. One possibility is that this delay in lexical integration reflects reduced phonological processing during learning as a consequence of the need to learn the semantic associations. In the current study, adult participants learnt novel words via a phoneme monitoring task, in which half of the words were associated with a picture referent, and half were phonological forms only. Critically, participants were instructed to learn the forms of the novel words, with no explicit goal to learn the word–picture mappings. Results revealed significant lexical competition effects emerging one week after consolidation, which were equivalent for the picture-present and form-only conditions. Tests of declarative memory and shadowing showed equivalent performance for picture-present and form-only words, despite participants showing good knowledge of the picture associations immediately after learning. These data support the contention that provided phonological information is recruited sufficiently well during learning, the provision of semantic information does not slow the time-course of lexical integration.     

Semantic focus and sentence comprehension.

Reaction time to detect a phoneme target in a sentence was found to be faster when the word in which the target occurred formed part of the semantic focus of the sentence. Focus was determined by asking a question before the sentence; that part of the sentence which comprised the answer to the sentence was assumed to be focussed. This procedure made it possible to vary position of focus within the sentence while holding all acoustic aspects of the sentence itself constant. It is argued that sentence understanding is facilitated by rapid identification of focussed information. Since focussed words are usually accented, it is further argued that the active search for accented words demonstrated in previous research should be interpreted as a search for semantic focus.     

Semantic facilitation across sensory modalities in the processing of individual words and sentences

The effect of semantic priming upon lexical decisions made for words in isolation (Experiment 1) and during sentence comprehension (Experiment 2) was investigated using a cross-modal lexical decision task. In Experiment 1, subjects made lexical decisions to both auditory and visual stimuli. Processing auditorily presented words facilitated subsequent lexical decisions on semantically related visual words. In Experiment 2, subjects comprehended auditorily presented sentences while simultaneously making lexical decisions for visually presented stimuli. Lexical decisions were facilitated when a visual word appeared immediately following a related word in the sentential material. Lexical decisions were also facilitated when the visual word appeared three syllables following closure of the clause containing the related material. Arguments are made for autonomy of semantic priming during sentence comprehension.