Writing words from pictures: What representations are activated, and when?

In three experiments, the nature of the representations involved in written picture naming and the time course of their activation were investigated. French participants had to produce picture names while hearing distractors. In Experiment 1, distractors semantically related to the picture names yielded a semantic interference effect when a stimulus onset asynchrony (SOA) of--150 msec, but not when a SOA of 0 msec, was used, in both spoken and written picture naming. Experiment 2 showed that the semantic interference effect was not located at the conceptual level. In Experiment 3, participants wrote down picture names while hearing semantically related, phonologically related, both semantically and phonologically related, or unrelated distractors, presented at both SOAs. A semantic interference effect was obtained with phonologically unrelated distractors but was eliminated with phonologically related distractors. Facilitatory effects of phonologically related distractors were found at both SOAs. The implications of the findings for written picture naming are discussed.     

Feature overlap slows lexical selection: Evidence from the picture–word interference paradigm

How does the presence of a categorically related word influence picture naming latencies? In order to test competitive and noncompetitive accounts of lexical selection in spoken word production, we employed the picture–word interference (PWI) paradigm to investigate how conceptual feature overlap influences naming latencies when distractors are category coordinates of the target picture. Mahon et al. (2007. Lexical selection is not by competition: A reinterpretation of semantic interference and facilitation effects in the picture-word interference paradigm. Journal of Experimental Psychology. Learning, Memory, and Cognition, 33(3), 503–535. doi:10.1037/0278-7393.33.3.503) reported that semantically close distractors (e.g., zebra) facilitated target picture naming latencies (e.g., HORSE) compared to far distractors (e.g., whale). We failed to replicate a facilitation effect for within-category close versus far target–distractor pairings using near-identical materials based on feature production norms, instead obtaining reliably larger interference effects (Experiments 1 and 2). The interference effect did not show a monotonic increase across multiple levels of within-category semantic distance, although there was evidence of a linear trend when unrelated distractors were included in analyses (Experiment 2). Our results show that semantic interference in PWI is greater for semantically close than for far category coordinate relations, reflecting the extent of conceptual feature overlap between target and distractor. These findings are consistent with the assumptions of prominent competitive lexical selection models of speech production.     

The sound of enemies and friends in the neighborhood

Previous studies (e.g., Pecher, Zeelenberg, & Wagenmakers, 2005) found that semantic classification performance is better for target words with orthographic neighbors that are mostly from the same semantic class (e.g., living) compared to target words with orthographic neighbors that are mostly from the opposite semantic class (e.g., nonliving). In the present study we investigated the contribution of phonology to orthographic neighborhood effects by comparing effects of phonologically congruent orthographic neighbors (book-hook) to phonologically incongruent orthographic neighbors (sand-wand). The prior presentation of a semantically congruent word produced larger effects on subsequent animacy decisions when the previously presented word was a phonologically congruent neighbor than when it was a phonologically incongruent neighbor. In a second experiment, performance differences between target words with versus without semantically congruent orthographic neighbors were larger if the orthographic neighbors were also phonologically congruent. These results support models of visual word recognition that assume an important role for phonology in cascaded access to meaning.     

How do associative and phonemic overlap interact to boost illusory recollection?

This project investigated the underlying mechanisms that boost false remember responses when participants receive study words that are both semantically and phonologically similar to a critical lure. Participants completed a memory task in which they were presented with a list of words all associated with a critical lure. Included within the list of semantic associates was a target that was either semantically associated (e.g., yawn) to the critical lure (e.g., sleep) or shared the initial (e.g., slam) or final (e.g., beep) phoneme(s) with the critical lure. After hearing the list, participants recalled each list item and indicated whether they just knew it was on the list or if they instead recollected specific contextual details of that item’s presentation. We found that inserting an initial phonemic overlap target boosted experiences of recollection, but only when semantically related associates were presented beforehand. The results are consistent with models of spoken word recognition and show that established semantic context plus initial phonemic overlap play important roles in boosting false recollection.     

汉语口语词汇产生中的多重音韵激活：单词翻译任务的ERP研究

口语词汇产生过程中, 非目标词是否会产生音韵激活是独立两阶段模型和交互激活模型的争论焦点之一。研究运用事件相关电位技术, 考察了被试在翻译命名任务中是否受到背景图片音韵或语义干扰词的影响。行为反应时中未发现显著的音韵效应, 而语义效应显著, 表明非目标词不会产生音韵激活。事件相关电位的结果显示在目标单词呈现后的400~600 ms时间窗口中出现了显著的语义效应, 在600~700 ms时间窗口内出现了边缘显著的语义效应和音韵效应, 均表现为相关条件比无关条件波幅更正。上述结果表明在将英语翻译成汉语的过程中, 尽管在脑电上呈现出可能存在微弱的多重音韵激活, 但行为结果并不会显示出非目标项的音韵激活。研究结果支持了汉语口语词汇产生遵循独立两阶段模式的观点。     

Horizontal information flow in spoken sentence production

In 4 experiments the authors used a variant of the picture-word interference paradigm to investigate whether there is a temporal overlap in the activation of words during sentence production and whether there is a flow of semantic and phonological information between them. Experiments 1 and 2 demonstrate that 2 semantically related nouns produce interference effects either when they are in the same or different phrases of a sentence. Experiments 3 and 4 demonstrate that 2 phonologically related nouns produce facilitation effects but only when they are within the same phrase of a sentence. The results argue against strictly serial models of multiple-word access and provide evidence of a flow of semantic and phonological information between words during sentence production.     

汉语词汇产生中词汇选择和音韵编码之间的交互作用

采取图画－词汇干扰实验范式,探索汉语单音节词汇产生中词汇选择和音韵编码之间的交互作用。实验一探测目标图画语义相关项的语音激活,观察到了非目标项的语音激活。实验二探测目标图画语义相关项的字形激活,未发现非目标项的字形激活。在改进实验条件的基础上,实验三验证实验一和二,并探测目标图画字形相关项的语音激活以及语音相关项的字形激活,结果未探测到语义相关项的字形或语音激活、语音相关项的字形激活,只发现了字形相关项的语音激活。实验一至三的结果表明汉语词汇产生中存在目标字字形相关项的语音激活,但不存在从音韵编码阶段至词汇选择阶段的激活反馈。综合上述结果,从是否存在多重的字形或语音激活,以及是否存在从音韵编码至词汇选择的反馈两个方面进行了讨论。研究结果倾向于支持词汇产生中层叠式理论的观点     

Auditory context effects in picture naming investigated with event-related fMRI

Naming an object entails a number of processing stages, including retrieval of a target lexical concept and encoding of its phonological word form. We investigated these stages using the picture-word interference task in an fMRI experiment. Participants named target pictures in the presence of auditorily presented semantically related, phonologically related, or unrelated distractor words or in isolation. We observed BOLD signal changes in left-hemisphere regions associated with lexical-conceptual and phonological processing, including the midto-posterior lateral temporal cortex. However, these BOLD responses manifested as signal reductions for all distractor conditions relative to naming alone. Compared with unrelated words, phonologically related distractors showed further signal reductions, whereas only the pars orbitalis of the left inferior frontal cortex showed a selective reduction in response in the semantic condition. We interpret these findings as indicating that the word forms of lexical competitors are phonologically encoded and that competition during lexical selection is reduced by phonologically related distractors. Since the extended nature of auditory presentation requires a large portion of a word to be presented before its meaning is accessed, we attribute the BOLD signal reductions observed for semantically related and unrelated words to lateral inhibition mechanisms engaged after target name selection has occurred, as has been proposed in some production models.     

图词间隔时间影响口语词汇产生中语义效应的机制：图词干扰范式研究

口语词汇产生过程中存在语义抑制和语义促进效应, 可能发生在概念准备和词汇选择或者后词汇水平阶段。本研究采用图画-词汇干扰实验任务, 变化图画与词汇出现点之间的时间间隔(stimulus onset asynchrony, SOA), 运用脑电技术考察口语词汇产生中语义效应发生的时间进程。结果显示, 当SOA为0 ms时表现出语义抑制效应, 语义效应发生在词汇选择阶段(344~418 ms); 当SOA为-400 ms时, 语义效应发生在概念准备阶段(0~76 ms)和词汇选择阶段(274~390 ms); 460~594 ms时间窗口内的语义效应可能表明讲话者对语义信息的自我监测。词汇产生中存在语义促进效应和抑制效应的权衡, 影响了行为结果中语义效应的方向, 上述发现支持了口语词汇产生的词汇竞争假说。     

汉语词汇产生中语义、语音层次之间的交互作用

采用3种方法考察汉语词汇产生中语义激活（词条选择）和音位编码这两个阶段之间的关系。实验一、二分别采用图片命名法和干扰字命名法,发现目标图片（“牛”）的语义相关词（“羊”）的语音信息得到了激活,说明汉语词汇产生中存在多重语音激活,音位编码在词条选择完成之前既已开始。实验三采用语义范畴判断法,考察语音信息的激活是否会向上反馈到词条和语义层次,发现目标图片（“羊”）的同音字（“阳”）不会促进对图片的语义判断。研究表明,多重语音激活与语音激活向词条和语义层次反馈是两个独立的,可以分割的问题。虽然实验一和二的结果符合相互作用理论,实验三的结果符合模块化观点,但就总体而言,本研究更加支持词汇产生中的模块化观点     

On the categorical nature of the semantic interference effect in the picture-word interference paradigm

Two picture-word interference experiments are reported in which the boundaries of the semantic interference effect are explored. In both experiments, participants named pictures (e.g., a picture of a car) that appeared with superimposed word distractors. Distractor words from the same semantic category as the word for the picture (e.g., CAR) produced semantic interference, whereas semantically related distractors from a different category (e.g.,Bumper) led to semantic facilitation. In Experiment 2, the semantic facilitation from semantically related distractors was replicated. These results indicate that a semantic relationship between picture and distractor does not necessarily lead to interference and in fact can lead to facilitation. In all but one case tested until now, a semantic relationship between picture and distractor has led to semantic facilitation. The implications of these results for the assumption that the semantic interference effect arises as a consequence of lexical competition are discussed.     

Semantic component of a cross-modal Stroop-like task

Three experiments showed that the pattern of interference of single-modality Stroop tests also exists cross-modally. Distractors and targets were either pictures or auditory words. In a naming task (Experiment 1), word distractors from the same semantic category as picture targets interfered with picture naming more than did semantically unrelated distractors; the semantic category of picture distractors did not differentially affect word naming. In a categorization task (Experiment 2), this Stroop-like effect was reversed: Picture distractors from the same semantic category as word targets interfered less with word categorization than picture distractors that were semantically unrelated; the semantic category of word distractors did not differentially affect picture categorization. Experiment 3 replicated these effects when each subject performed both tasks; the task, naming or categorizing, determined the pattern of interference between pictures and auditory words. The results thus support the existence of a semantic component of a cross-modal Stroop-like effect.     

Semantic priming is affected by real-time phonological competition: Evidence for continuous cascading systems

Lexical-semantic access is affected by the phonological structure of the lexicon. What is less clear is whether such effects are the result of continuous activation between lexical form and semantic processing or whether they arise from a more modular system in which the timing of accessing lexical form determines the timing of semantic activation. This study examined this issue using the visual world paradigm by investigating the time course of semantic priming as a function of the number of phonological competitors. Critical trials consisted of high or low density auditory targets (e.g., horse) and a visual display containing a target, a semantically related object (e.g., saddle), and two phonologically and semantically unrelated objects (e.g., chimney, bikini). Results showed greater magnitude of priming for semantically related objects of low than of high density words, and no differences for high and low density word targets in the time course of looks to the word semantically related to the target. This pattern of results is consistent with models of cascading activation, which predict that lexical activation has continuous effects on the level of semantic activation, with no delays in the onset of semantic activation for phonologically competing words.     

Are phonological influences on lexical (mis)selection the result of a monitoring bias?

A monitoring bias account is often used to explain speech error patterns that seem to be the result of an interactive language production system, like phonological influences on lexical selection errors. A biased monitor is suggested to detect and covertly correct certain errors more often than others. For instance, this account predicts that errors that are phonologically similar to intended words are harder to detect than those that are phonologically dissimilar. To test this, we tried to elicit phonological errors under the same conditions as those that show other kinds of lexical selection errors. In five experiments, we presented participants with high cloze probability sentence fragments followed by a picture that was semantically related, a homophone of a semantically related word, or phonologically related to the (implicit) last word of the sentence. All experiments elicited semantic completions or homophones of semantic completions, but none elicited phonological completions. This finding is hard to reconcile with a monitoring bias account and is better explained with an interactive production system. Additionally, this finding constrains the amount of bottom-up information flow in interactive models.     

Asymmetric aging effects on semantic and phonological processes: naming in the picture-word interference task

In 2 experiments, participants named pictures while ignoring auditory word distractors. For pictures with homophone names (e.g., ball), distractors semantically related to the nondepicted meaning (e.g., prom) facilitated naming by top-down phonological connections for young but not for older adults. Slowing from unrelated distractors and facilitation from phonologically related distractors were age invariant except in distractors that were both semantically and phonologically related. Only distractors semantically related to the picture interfered more for older than younger adults. These results ar einconsistent with age-linked deficits in inhibition of irrelevant information from either internal or external sources. Rather, aging affects priming transmission in a connectionist network with asymmetric effects on semantic and phonological connections involved in comprehension and production, respectively.     

Reading aloud: The cumulative lexical interference effect

Picture naming shows a cumulative semantic interference effect: Latency for naming a target picture increases as a function of the number of pictures semantically similar to the target that have previously been named (Howard, Nickels, Coltheart, & Cole-Virtue, Cognition 100:464-482, 2006). Howard and colleagues, and also Oppenheim, Dell, and Schwartz (Cognition 114:227-252, 2010), argued that this occurs because of the joint presence in the picture-naming system of three critical properties: shared activation, priming, and competition. They also discussed the possibility that whenever any cognitive system possesses these three properties, a cumulative similarity-based interference effect from repeated use of that cognitive system will occur. We investigated this possibility by looking for a cumulative lexical interference effect when the task is reading aloud: Will the latency of reading a target word aloud increase as a function of the number of words orthographically/phonologically similar to the target that have previously been read aloud? We found that this was so. This supports the general idea that cumulative similarity-based interference effects will arise whenever any cognitive system that possesses the three key properties of shared activation, priming, and competition is repeatedly used.     

Are phonological influences on lexical (mis)selection the result of a monitoring bias?

A monitoring bias account is often used to explain speech error patterns that seem to be the result of an interactive language production system, like phonological influences on lexical selection errors. A biased monitor is suggested to detect and covertly correct certain errors more often than others. For instance, this account predicts that errors that are phonologically similar to intended words are harder to detect than those that are phonologically dissimilar. To test this, we tried to elicit phonological errors under the same conditions as those that show other kinds of lexical selection errors. In five experiments, we presented participants with high cloze probability sentence fragments followed by a picture that was semantically related, a homophone of a semantically related word, or phonologically related to the (implicit) last word of the sentence. All experiments elicited semantic completions or homophones of semantic completions, but none elicited phonological completions. This finding is hard to reconcile with a monitoring bias account and is better explained with an interactive production system. Additionally, this finding constrains the amount of bottom-up information flow in interactive models.     

Conceptual similarity effects on working memory in sentence contexts: Testing a theory of anaphora

The degree of semantic similarity between an anaphoric noun phrase (e.g., the bird) and its antecedent (e.g., a robin) is known to affect the anaphor resolution process, but the mechanisms that underlie this effect are not known. One proposal (Almor, 1999) is that semantic similarity triggers interference effects in working memory and makes two crucial assumptions: First, semantic similarity impairs working memory just as phonological similarity does (e.g., Baddeley, 1992), and, second, this impairment interferes with processes of sentence comprehension. We tested these assumptions in two experiments that compared recall accuracy between phonologically similar, semantically similar, and control words in sentence contexts. Our results do not provide support for Almor's claims: Phonological overlap decreased recall accuracy in sentence contexts, but semantic similarity did not. These results shed doubt on the idea that semantic interference in working memory is an underlying mechanism in anaphor resolution.     

Sensory generalization and learning about novel colours by poultry chicks

Previous research has shown semantic influence from irrelevant peripheral cues on the spatial allocation of covert visual attention. The present study explored whether the task set determines the extent of such semantic influence. A spatial cueing paradigm with strict eye movement control was used, where cues were either first names (male or female) or emotionally charged words (positive or negative) followed by a face target. Participants discriminated either the gender (male or female) or the emotion (positive or negative) of the face. When there was high information overlap between cue and task set, responses were faster when the cue and target value were semantically congruent than when they were incongruent. It was concluded that the semantically related cues primed a task-influencing response independently of spatial attention allocation processes, showing that semantic influences from brief peripheral cues depend on the degree of information overlap between cue and task set.     

Locus of semantic interference in picture-word interference tasks

Picture#x2014;word interference studies typically show that semantically related distractor words embedded within a picture slow picture-naming responses, relative to unrelated ones. This semantic interference effect is commonly interpreted as arising from the competition of lexical#x2014;semantic (e.g., Schriefers, Meyer, & Levelt, 1990) or lexical#x2014;phonological (e.g., Starreveld & La Heij, 1996) codes. The experiment reported here tests a crucial assumption shared by these accounts#x2014;namely, that the effect reflects a lexical, rather than a nonverbal, conceptual conflict. Pictures were named while participants attempted to ignore embedded distractors that were in either verbal or pictorial format. The presence of both words and pictures substantially interfered with naming responses, but only words, not pictures, were found to induce semantic interference. These findings support the claim that for semantic interference to arise, both target picture and distractor have to be lexicalized. Consequently, a general conceptual locus of the effect can be excluded, and the claim that semantic interference is based on a lexical conflict is confirmed.