Semantic and visual relatedness of distractors impairs episodic retrieval of pictures in a divided attention paradigm

We used a divided attention (DA) paradigm to infer the representational codes needed to support episodic retrieval of pictures, by measuring susceptibility to memory interference from different distracting tasks. Participants made recognition memory decisions to semantically categorized sets of pictures while simultaneously making size judgments to a set of visually-presented distractor pictures. Recognition accuracy was worse and response times were slower under DA conditions relative to full attention (FA), regardless of semantic relatedness of distractors to targets (Experiment 1). Similarly, we found no differential memory interference under DA relative to FA when distractor pictures were either visually (but not semantically), semantically (but not visually), or unrelated to the targets (Experiment 2). In Experiment 3, memory interference was significantly larger under DA at retrieval when distractors were both semantically and visually similar to the targets. Findings suggest episodic memory for pictures requires access to either visually- or semantically-based representations for optimal performance.     

图词间隔时间影响口语词汇产生中语义效应的机制：图词干扰范式研究

口语词汇产生过程中存在语义抑制和语义促进效应, 可能发生在概念准备和词汇选择或者后词汇水平阶段。本研究采用图画-词汇干扰实验任务, 变化图画与词汇出现点之间的时间间隔(stimulus onset asynchrony, SOA), 运用脑电技术考察口语词汇产生中语义效应发生的时间进程。结果显示, 当SOA为0 ms时表现出语义抑制效应, 语义效应发生在词汇选择阶段(344~418 ms); 当SOA为-400 ms时, 语义效应发生在概念准备阶段(0~76 ms)和词汇选择阶段(274~390 ms); 460~594 ms时间窗口内的语义效应可能表明讲话者对语义信息的自我监测。词汇产生中存在语义促进效应和抑制效应的权衡, 影响了行为结果中语义效应的方向, 上述发现支持了口语词汇产生的词汇竞争假说。     

How do valence and meaning interact? The contribution of semantic control

The hub-and-spoke model of semantic cognition proposes that conceptual representations in a heteromodal ‘hub’ interact with and emerge from modality-specific features or ‘spokes’, including valence (whether a concept is positive or negative), along with visual and auditory features. As a result, valence congruency might facilitate our ability to link words conceptually. Semantic relatedness may similarly affect explicit judgements about valence. Moreover, conflict between meaning and valence may recruit semantic control processes. Here we tested these predictions using two-alternative forced-choice tasks, in which participants matched a probe word to one of two possible target words, based on either global meaning or valence. Experiment 1 examined timed responses in healthy young adults, while Experiment 2 examined decision accuracy in semantic aphasia patients with impaired controlled semantic retrieval following left hemisphere stroke. Across both experiments, semantically related targets facilitated valence matching, while related distractors impaired performance. Valence congruency was also found to facilitate semantic decision-making. People with semantic aphasia showed impaired valence matching and had particular difficulty when semantically related distractors were presented, suggesting that the selective retrieval of valence information relies on semantic control processes. Taken together, the results are consistent with the hypothesis that automatic access to the global meaning of written words affects the processing of valence, and that the valence of words is also retrieved even when this feature is task-irrelevant, affecting the efficiency of global semantic judgements.     

Auditory context effects in picture naming investigated with event-related fMRI

Naming an object entails a number of processing stages, including retrieval of a target lexical concept and encoding of its phonological word form. We investigated these stages using the picture-word interference task in an fMRI experiment. Participants named target pictures in the presence of auditorily presented semantically related, phonologically related, or unrelated distractor words or in isolation. We observed BOLD signal changes in left-hemisphere regions associated with lexical-conceptual and phonological processing, including the midto-posterior lateral temporal cortex. However, these BOLD responses manifested as signal reductions for all distractor conditions relative to naming alone. Compared with unrelated words, phonologically related distractors showed further signal reductions, whereas only the pars orbitalis of the left inferior frontal cortex showed a selective reduction in response in the semantic condition. We interpret these findings as indicating that the word forms of lexical competitors are phonologically encoded and that competition during lexical selection is reduced by phonologically related distractors. Since the extended nature of auditory presentation requires a large portion of a word to be presented before its meaning is accessed, we attribute the BOLD signal reductions observed for semantically related and unrelated words to lateral inhibition mechanisms engaged after target name selection has occurred, as has been proposed in some production models.     

Encoding specificity revisited: the role of semantics.

Three experiments examined the effects of semantic characteristics of word pairs on memory using the encoding specificity paradigm. The paradigm involved four phases: (a) an encoding phase to relate cues and targets, (b) a phase in which words were generated to new cues, (c) a phase for recognition of generated targets, and (d) a cued-recall phase using the original encoding cues. Encoding pairs were classified a priori as either semantically similar (e.g., alluring-PRETTY), semantically contrasting (e.g., drab-PRETTY), or semantically unrelated (e.g., sore-PRETTY). Generation pairs were classified a priori as either semantically similar (e.g., beautiful-PRETTY) or semantically contrasting (e.g., ugly-PRETTY). For recall, the results showed that both the semantic relations between the encoding cue and target and the reprovision of the encoding cue at retrieval were important factors. In the case of recognition, however, both the semantic congruence between the encoding and generation contexts and the amount of semantic elaboration provided by the encoding context were important factors.     

L'effet de l'hétérogénéité sémantique dans la détection de mots

The effects of three semantic factors (semantic priming of the target, semantic distance between the word-target and distractors, and semantic heterogeneity of the target context) on the detection of a word among other words were examined by using the classical paradigm of target detection (varying the number of distractors). Results showed that these three semantic factors affect performance: a target was better detected 1) when primed by its superordinate category than when it was defined as the “odd-one-out”; 2) when the semantic context was homogeneous than heterogeneous; and 3) when it was semantically unrelated to the context than semantically related. These results help specifying the cognitive processing of each word while searching for a word among others.     

Effects of bilingualism, aging, and semantic relatedness on memory under divided attention.

We examined how encoding and retrieval processes were affected by manipulations of attention, and whether the degree of semantic relatedness between words in the memory and distracting task modulated these effects. We also considered age and bilingual status as mediating factors. Monolingual and bilingual younger and older adults studied a list of words from a single semantic category presented auditorily, and later free recalled them aloud. During either study or retrieval, participants concurrently performed a distracting task requiring size decisions to words from either the same or a different semantic category as the words in the memory task. The greatest disruptions of memory from divided attention (DA) were for encoding rather than retrieval. The effect of semantic relatedness was significant only for DA at encoding. Older age and bilingualism were associated with lower recall scores in all conditions, but these factors did not influence the magnitude of memory interference. The results suggest that encoding is more sensitive to semantic similarity in a distracting task than is retrieval. The role of attention at encoding and retrieval is discussed.     

Semantic component of a cross-modal Stroop-like task

Three experiments showed that the pattern of interference of single-modality Stroop tests also exists cross-modally. Distractors and targets were either pictures or auditory words. In a naming task (Experiment 1), word distractors from the same semantic category as picture targets interfered with picture naming more than did semantically unrelated distractors; the semantic category of picture distractors did not differentially affect word naming. In a categorization task (Experiment 2), this Stroop-like effect was reversed: Picture distractors from the same semantic category as word targets interfered less with word categorization than picture distractors that were semantically unrelated; the semantic category of word distractors did not differentially affect picture categorization. Experiment 3 replicated these effects when each subject performed both tasks; the task, naming or categorizing, determined the pattern of interference between pictures and auditory words. The results thus support the existence of a semantic component of a cross-modal Stroop-like effect.     

Memory as discrimination: What distraction reveals

Recalling information involves the process of discriminating between relevant and irrelevant information stored in memory. Not infrequently, the relevant information needs to be selected from among a series of related possibilities. This is likely to be particularly problematic when the irrelevant possibilities not only are temporally or contextually appropriate, but also overlap semantically with the target or targets. Here, we investigate the extent to which purely perceptual features that discriminate between irrelevant and target material can be used to overcome the negative impact of contextual and semantic relatedness. Adopting a distraction paradigm, it is demonstrated that when distractors are interleaved with targets presented either visually (Experiment 1) or auditorily (Experiment 2), a within-modality semantic distraction effect occurs; semantically related distractors impact upon recall more than do unrelated distractors. In the semantically related condition, the number of intrusions in recall is reduced, while the number of correctly recalled targets is simultaneously increased by the presence of perceptual cues to relevance (color features in Experiment 1 or speaker’s gender in Experiment 2). However, as is demonstrated in Experiment 3, even presenting semantically related distractors in a language and a sensory modality (spoken Welsh) distinct from that of the targets (visual English) is insufficient to eliminate false recalls completely or to restore correct recall to levels seen with unrelated distractors . Together, the study shows how semantic and nonsemantic discriminability shape patterns of both erroneous and correct recall.     

语言理解转换中非目标语言影响目标语言的时间进程

运用跨语言即时启动和延时启动范式,要求被试完成生物属性的语义判断任务,研究语言理解转换中非目标语言影响目标语言语义理解的时间进程。实验1非目标语言为英文,目标语言为中文,结果表明,无论是即时启动(t = -0.423, p = 0.676),还是延时启动(t = -0.82, p = 0.419),语义相关组与语义无关组都无显著差异。实验2非目标语言为中文,目标语言为英文,结果表明,在即时启动条件下,语义相关组显著快于语义无关组(t = -3.05, p = 0.006),但延时条件下语义相关组与语义无关组无显著差异(t = -0.63, p = 0.536)。综合两个实验结果表明,晚期熟练双语者在双语语言理解转换过程中语义的即时启动影响存在不对称性,语义相关的非目标语言中文对目标语言英文语义理解起促进作用;但是语义启动效应没有得到延时体现。     

汉语口语词汇产生中的多重音韵激活：单词翻译任务的ERP研究

口语词汇产生过程中, 非目标词是否会产生音韵激活是独立两阶段模型和交互激活模型的争论焦点之一。研究运用事件相关电位技术, 考察了被试在翻译命名任务中是否受到背景图片音韵或语义干扰词的影响。行为反应时中未发现显著的音韵效应, 而语义效应显著, 表明非目标词不会产生音韵激活。事件相关电位的结果显示在目标单词呈现后的400~600 ms时间窗口中出现了显著的语义效应, 在600~700 ms时间窗口内出现了边缘显著的语义效应和音韵效应, 均表现为相关条件比无关条件波幅更正。上述结果表明在将英语翻译成汉语的过程中, 尽管在脑电上呈现出可能存在微弱的多重音韵激活, 但行为结果并不会显示出非目标项的音韵激活。研究结果支持了汉语口语词汇产生遵循独立两阶段模式的观点。     

Tests of dual process theory: Word priming and recognition

Dual process theory postulates two representational processes: Activation of a representation makes the mental event more easily and automatically accessible. Elaboration of a mental event produces access to the representation through search and retrieval processes. We explored word priming in recognition and in a stem completion task where the primed word was one of several possible completions for a 3-letter stem. The main hypothesis was that priming has similar and parallel effects in the two tasks. The initial presentation (priming) of items was under conditions of either semantic or non-semantic processing. Priming was either direct, by the presentation of the target word, or indirect, by the presentation of phonologically related (rhyming) or semantically related (categorical) items. When priming occurred, RTs increased from direct to phonologically primed and to semantically primed items for both completion and recognition tests. One additional experiment confirmed the absence of semantic processing in the non-semantic condition, and another experiment showed that when response requirements for recognition and completion responses are equated, RTs to the two tests are comparable.     

Writing words from pictures: What representations are activated, and when?

In three experiments, the nature of the representations involved in written picture naming and the time course of their activation were investigated. French participants had to produce picture names while hearing distractors. In Experiment 1, distractors semantically related to the picture names yielded a semantic interference effect when a stimulus onset asynchrony (SOA) of--150 msec, but not when a SOA of 0 msec, was used, in both spoken and written picture naming. Experiment 2 showed that the semantic interference effect was not located at the conceptual level. In Experiment 3, participants wrote down picture names while hearing semantically related, phonologically related, both semantically and phonologically related, or unrelated distractors, presented at both SOAs. A semantic interference effect was obtained with phonologically unrelated distractors but was eliminated with phonologically related distractors. Facilitatory effects of phonologically related distractors were found at both SOAs. The implications of the findings for written picture naming are discussed.     

rTMS stimulation on left DLPFC increases the correct recognition of memories for emotional target and distractor words

According to a recent hypothesis, the prefrontal cortex has been proposed as the site of emotional memory integration, because it is sensitive to the recognition of emotional contents. In the present research, we explored the role of the dorsolateral prefrontal cortex (DLPFC) in memory recognition processes for positive versus negative emotional stimuli when old (target) and new (distractor, either semantically related or unrelated to the target) stimuli were presented. The role of the DLPFC was analysed using an rTMS (repeated transcranial magnetic stimulation) paradigm that induced increased cortical activation of the left DLPFC. The subjects were required to perform a task that consisted of two experimental phases (i.e., an encoding and a recognition phase) in which the targets and the distractors were presented and recognition performance was measured. rTMS stimulation was provided over the left DLPFC during the recognition phase. We found that the rTMS stimulation affected the memory recognition of positive emotional material. Moreover, related and unrelated distractors were discarded better when they were positively valenced, and a more significant effect (i.e., increased performance) was produced in response to related distractors. This result suggests that the activation of the left DLPFC favours the memory recognition of positive emotional information, and that such activation is able to induce a more appropriate selective process to distinguish target from distractor stimuli in the presence of more complex processes (related distractors). The valence model of emotional cue processing may explain this increased performance by demonstrating the distinct role of the left hemisphere in the retrieval of positive emotional information.     

Misrecollection prevents older adults from benefitting from semantic relatedness of the memoranda in associative memory

Memory for episodic associations declines in aging, ostensibly due to decreased recollection abilities. Accordingly, associative unitization - the encoding of associated items as one integrated entity - may potentially attenuate age-related associative deficits by enabling familiarity-based retrieval, which is relatively preserved in aging. To test this hypothesis, we induced bottom-up unitization by manipulating semantic relatedness between memoranda. Twenty-four young and 24 older adults studied pairs of object pictures that were either semantically related or unrelated. Participants subsequently discriminated between intact, recombined and new pairs. We found that semantic relatedness increased the contributions of both familiarity and recollection in young adults, but did not improve older adults' performance. Instead, they showed associative deficits, driven by increased recollection-based false recognition. This may reflect a “misrecollection” phenomenon, in which older adults make more false alarms to recombined pairs with particularly high confidence, due to poorer retrieval monitoring regarding semantically-related associative probes.     

Associative recognition processes are modulated by the semantic unitizability of memoranda

Although memory of episodic associations is generally considered to be recollective in nature, it has been suggested that when stimuli are experienced as a unit, familiarity processes might contribute to their subsequent associative recognition. To investigate the effect of semantic relatedness during episodic encoding on the processes of retrieval of associative information, we had participants interactively encode pairs of object pictures, vertically arranged so as to suggest a functional or configural relationship between them. Half the pairs were independently judged to be of related objects (e.g., a lamp over a table) and half of unrelated objects (e.g., a key-ring over an apple). At test, participants discriminated between intact, recombined, and new pairs while event related potentials (ERPs) were recorded. In an early ERP marker of retrieval success generally associated with familiarity processes, differences related to associative memory only emerged for related pairs, while differences associated with item memory emerged for both related and unrelated pairs. In contrast, in a later ERP effect associated with recollection, differences related to associative memory emerged for both related and unrelated pairs. These findings may indicate that retrieval of episodic associations formed between two semantically related visual stimuli can be supported by familiarity-related processes.     

The role of syntactic context in word recognition

This study examines the role of syntactic information in word recognition. Subjects made a word-nonword decision regarding a target string that was preceded by a syntactically appropriate word, a semantically related word, or an unrelated word. In Experiment 1, with syntactic and semantic trials assigned to separate blocks, syntactically and semantically appropriate context significantly reduced lexical decision for subsequent target words, compared with unrelated contexts. In Experiment 2, the syntactically and semantically primed trials were either blocked separately or mixed within the same block. Significant syntactic and semantic effects were both observed in the blocked condition, but only the semantic effect was obtained in the mixed condition     

Additivity of semantic and phonological effects: Evidence from speech production in Mandarin

A number of previous studies using picture–word interference (PWI) tasks conducted with speakers of Western languages have demonstrated non-additive effects of semantic and form overlap between pictures and words, which may indicate underlying non-discrete processing stages in lexical retrieval. The present study used Mandarin speakers and presented Chinese characters as distractors. In two experiments, we crossed semantic relatedness with “pure” phonological (i.e., orthographically unrelated) relatedness and found statistically additive effects. In a third experiment, semantic relatedness was crossed with orthographic overlap (phonological overlap was avoided), and once again we found an additive pattern. The results are discussed with regard to possible cross-linguistic differences between Western and non-Western languages in terms of phonological encoding, as well as concerning the locus of relatedness effects in PWI tasks.     

Semantic and Syntactic Associations During Word Search Modulate the Relationship Between Attention and Subsequent Memory

Two experiments were conducted to investigate how linguistic information influences attention allocation in visual search and memory for words. In Experiment 1, participants searched for the synonym of a cue word among five words. The distractors included one antonym and three unrelated words. In Experiment 2, participants were asked to judge whether the five words presented on the screen comprise a valid sentence. The relationships among words were sentential, semantically related or unrelated. A memory recognition task followed. Results in both experiments showed that linguistically related words produced better memory performance. We also found that there were significant interactions between linguistic relation conditions and memorization on eye-movement measures, indicating that good memory for words relied on frequent and long fixations during search in the unrelated condition but to a much lesser extent in linguistically related conditions. We conclude that semantic and syntactic associations attenuate the link between overt attention allocation and subsequent memory performance, suggesting that linguistic relatedness can somewhat compensate for a relative lack of attention during word search.