The activation of phonological representations by bilinguals while reading silently: evidence from interlingual homophones

These experiments investigated whether bilinguals activate phonological representations from both of their languages when reading silently in one. The critical stimuli were interlingual homophones (e.g., sank in English and cinq in French). French-English and English-French bilinguals completed an English lexical decision task. Decisions made by French-English bilinguals were significantly faster and more accurate for interlingual homophones than for matched English control words. In subsequent experiments, the homophone facilitation effect in the latency data disappeared when distractors were changed to pseudohomophones, when cognates and interlingual homographs were added to the experiment, and when the proportion of critical stimuli was decreased. However, the homophone effect in the error data remained. In contrast, English-French bilinguals revealed little evidence of an interlingual homophone effect. Several attempts were made to increase the saliency of the nontarget language, however these manipulations produced only a small effect in the error data. These results indicate that the activation of phonological representations can appear to be both language-specific and nonspecific depending on the proficiency of the bilinguals and whether they are reading in their weaker or stronger language.     

Recognition of interlingual homophones in bilingual auditory word recognition

How do bilinguals recognize interlingual homophones? In a gating study, word identification and language membership decisions by Dutch-English bilinguals were delayed for interlingual homophones relative to monolingual controls. At the same time, participant judgments were sensitive to subphonemic cues. These findings suggest that auditory lexical access is language nonselective but is sensitive to language-specific characteristics of the input. In 2 cross-modal priming experiments, visual lexical decision times were shortest for monolingual controls preceded by their auditory equivalents. Response times to interlingual homophones accompanied by their corresponding auditory English or Dutch counterparts were also shorter than in unrelated conditions. However, they were longer than in the related monolingual control conditions, providing evidence for online competition of the 2 near-homophonic representations. Experiment 3 suggested that participants used sublexical cues to differentiate the 2 versions of a homophone after language nonselective access.     

How verbs can activate things: cross-language activation across word classes

The present study explored whether language-nonselective access in bilinguals occurs across word classes in a sentence context. Dutch–English bilinguals were auditorily presented with English (L2) sentences while looking at a visual world. The sentences contained interlingual homophones from distinct lexical categories (e.g., the English verb spoke, which overlaps phonologically with the Dutch noun for ghost, spook). Eye movement recordings showed that depictions of referents of the Dutch (L1) nouns attracted more visual attention than unrelated distractor pictures in sentences containing homophones. This finding shows that native language objects are activated during second language verb processing despite the structural information provided by the sentence context.     

Time course of inhibitory processes in bilingual language processing

This study examines the time course of inhibitory processes in Spanish–English bilinguals, using the procedure described in Macizo, Bajo, and Martín. Bilingual participants were required to decide whether pairs of English words were related. Critical word pairs contained a word that shared the same orthography across languages but differed in meaning (interlingual homographs such as pie, meaning foot in Spanish). In Expts 1 and 2, participants were slower to respond to homographs presented along with words related to the Spanish meaning of the homograph as compared to control words. This result agrees with the view that bilinguals non‐selectively activate their two languages irrespective of the language they are using. In addition, bilinguals also slowed their responses when the English translation of the Spanish homograph meaning was presented 500 ms after responding to homographs (Expt 1). This result suggests that bilinguals inhibited the irrelevant homograph meaning. However, the inhibitory effect was not observed in Expt 2 when the between‐trial interval was fixed to 750 ms which suggests that inhibition decayed over time.     

The emotional Stroop task and emotionality rating of negative and neutral words in late Thai–English bilinguals

The current study investigated how emotions are represented in the lexicon of late Thai–English bilinguals and a comparison group of native English speakers. Two tasks were used. In the emotional Stroop task, which taps into an automatic early lexical level of processing, the bilingual participants did not display the same automatic level of activation in their second language (L2) as in their first language (L1). In the emotionality‐rating task, which involves a later, more in‐depth conscious level of processing than the preceding task, similar results were found in both languages spoken by the bilinguals. These findings are interpreted as indicating that late bilinguals do not automatically respond to the emotional arousal associated with the meanings of L2 words to the same extent as in the L1, and this is likely to be mediated by language proficiency and the context in which the language is learned.     

Knowledge of a second language influences auditory word recognition in the native language

Many studies in bilingual visual word recognition have demonstrated that lexical access is not language selective. However, research on bilingual word recognition in the auditory modality has been scarce, and it has yielded mixed results with regard to the degree of this language nonselectivity. In the present study, we investigated whether listening to a second language (L2) is influenced by knowledge of the native language (L1) and, more important, whether listening to the L1 is also influenced by knowledge of an L2. Additionally, we investigated whether the listener's selectivity of lexical access is influenced by the speaker's L1 (and thus his or her accent). With this aim, Dutch-English bilinguals completed an English (Experiment 1) and a Dutch (Experiment 3) auditory lexical decision task. As a control, the English auditory lexical decision task was also completed by English monolinguals (Experiment 2). Targets were pronounced by a native Dutch speaker with English as the L2 (Experiments 1A, 2A, and 3A) or by a native English speaker with Dutch as the L2 (Experiments 1B, 2B, and 3B). In all experiments, Dutch-English bilinguals recognized interlingual homophones (e.g., lief [sweet]-leaf /li:f/) significantly slower than matched control words, whereas the English monolinguals showed no effect. These results indicate that (a) lexical access in bilingual auditory word recognition is not language selective in L2, nor in L1, and (b) language-specific subphonological cues do not annul cross-lingual interactions.     

不同手指表征方式对数量表征能力的影响

采用距离启动范式,考察中国文化背景下不同手指表征方式对数量表征能力的影响。实验首先验证单手表征中不同手指数量表征方式对小数字（1～5）认知表征的影响;实验2则进一步采用中国人特有的单手手指表征,考察其对大数字（5～9）认知表征的影响。结果表明,小数字中出现了标准手指表征方式语义层面的位置编码、非标准手指表征方式知觉层面总和编码的激活;但大数字中两种手指表征方式均出现了语义层面位置编码的激活。此结果与计算模型理论一致,说明当手指数量从少到多变化时,标准手指表征方式为语义性的符号数量表征;而非标准手指表征方式由知觉性的非符号向语义性符号数量表征过渡。     

Activation of shape and semantic information during ambiguous homophone processing: eye tracking evidence from Hindi

In two visual world eye tracking studies, we examined the activation of subordinate meanings of ambiguous homophones in Hindi and particularly when the sentence context is biased towards the dominant meaning. Participants listened to sentences that were either neutral or biased towards the dominant meaning of the homophone and saw a display containing four pictures. In experiment 1, the display had a shape competitor of the subordinate meaning of the homophone in both neutral and biased conditions along with three unrelated distractors. Experiment 2 had semantic competitors of the subordinate meaning of the homophones along with three distractors. Proportion of fixations to different objects overtime suggested that participants activated the subordinate meanings and oriented their attention to the shape and semantic competitors even when the prior context was biased towards the dominant meaning. Overall, these data from Hindi provide further support to those models of lexical access that assume exhaustive access of both the meanings of an ambiguous homophone. These data suggest even a dominant bias does not eliminate the activation of perceptual and conceptual features of the subordinate meaning.     

Language lateralization in English-French bilinguals

Forty English-French bilinguals divided into equal numbers of nonfluent and fluent subjects took part in a dichotic listening test involving both intralingual and interlingual conditions. No difference in lateralization was found between primary and secondary language in either condition. In the intralingual condition, however, fluent bilinguals showed a significantly lower right ear advantage than did their nonfluent counterparts. In the interlingual condition, French-dominant subjects were found to be more ambilateral than English-dominant subjects, while both groups tended to respond preferentially to French words. These results suggest that growing bilingual proficiency does increase left ear/right hemisphere participation, but in intralingual situations only. Moreover, when both languages are contrasted, French appears to be more salient than English.     

Bilingual vocabulary size and lexical reading in Italian

In the present study we investigated how the vocabulary size of English–Italian bilinguals affects reading aloud in Italian (L2) modulating the reader's sensitivity to lexical aspects of the language. We divided adult bilinguals in two groups according to their vocabulary size (Larger — LV, and smaller — SV), and compared their naming performance to that of native Italian (NI) readers. In Experiment 1 we investigated the lexicality and word frequency effects in reading aloud. Similarly to NI, both groups of bilinguals showed these effects. In Experiment 2 we investigated stress assignment – which is not predictable by rule – to Italian words. The SV group made more stress errors in reading words with a non-dominant stress pattern compared to the LV group. The results suggest that the size of the reader's L2 lexicon affects the probability of correct reading aloud.     

Language acquisition context and language organization in bilinguals

A distinction between compound and coordinate bilingualism has been employed to conceptualize linguistic organization in bilinguals. Compound bilinguals are those who acquired their languages in a joint context and therefore are presumed to store linguistic information interdependently. Coordinates include those who acquired their languages in separate contexts and therefore are presumed to maintain independent linguistic stores. To study the usefulness of this distinction, Spanish-English and English-Spanish, compound, and coordinate bilinguals were asked to give intra-and interlingual free and restricted word associations to equivalent English and Spanish stimuli for which the responses of monolingual speakers were not equivalent. As predicted, compound bilinguals gave significantly more equivalent responses and responded significantly faster than did coordinates. However, since these differences were only modest in size, they cannot be interpreted as supporting the usefulness of the compound-coordinate distinction. None of the predictions regarding the effect of proficiency on performance were supported. Differences as a function of native language, type of association task, and association conditions were obtained and are discussed.This research was supported by USPHS Grant HD 01368 to Dr. Klaus Riegel, University of Michigan, and was included as one portion of a doctoral dissertation submitted by the author to the Horace H. Rackham School of Graduate Studies at the University of Michigan.     

Is visual lexical access based on phonological codes? Evidence from a picture-word interference task

The claim that lexical access for visual words is mandatorily mediated by their phonological codes was investigated. Ninety-six subjects performed timed naming responses to pictures while instructed to ignore printed words superimposed on the pictures. Distractor words were either semantically related to the picture label or were homophones of a word semantically related to the picture name. On the basis of the claim that homophones initially activate multiple semantic codes, we hypothesized that the homophone and semantic distractors would yield comparable interference. Picture-word stimulus onset asynchrony (SOA) was varied between subjects as 0 or +100 msec. For an SOA of 0 msec, semantic interference, but no effect from the homophones, was obtained. For an SOA of +100 msec, no effect was obtained in either condition. In combination, these findings indicate a limited role of phonological codes in visual lexical access. It is suggested that the role of phonology in written word identification may vary dependent on procedure and utility to the task.     

Do Bilinguals Automatically Activate Their Native Language When They Are Not Using It?

Most models of lexical access assume that bilingual speakers activate their two languages even when they are in a context in which only one language is used. A critical piece of evidence used to support this notion is the observation that a given word automatically activates its translation equivalent in the other language. Here, we argue that these findings are compatible with a different account, in which bilinguals “carry over” the structure of their native language to the non‐native language during learning, and where there is no activation of translation equivalents. To demonstrate this, we describe a model in which language learning involves mapping native language phonological relationships to the non‐native language, and we show how it can explain the results attributed to automatic activation of translation equivalents.     

道德概念的空间形象性：语言因素和具身因素的共同作用

采用事件相关电位(ERP)技术探讨抽象道德概念的空间形象性效应, 以及语言因素和具身因素对该效应的影响机制及其加工进程。实验1检验词对空间位置对道德词对语义判断(反义程度)所产生的影响, 结果表明不符合空间形象性呈现条件(即道德-下, 不道德-上)诱发了较大的N400, 并且词对语义判断的反应时较长; 实验2检验词对语义的反义程度对道德词对空间形象性判断所产生的影响, 结果表明语义无关词对诱发了较大的N200和N700, 并且词对空间形象性判断的反应时较长。研究结果表明, 抽象道德概念的加工能够表现出空间形象性效应, 该效应由语言因素和具身因素共同塑造, 前者在概念加工过程中优先被激活并发挥持久影响, 后者仅在概念加工的中期发挥作用。     

Perceptual simulation in developing language comprehension

We tested an embodied account of language proposing that comprehenders create perceptual simulations of the events they hear and read about. In Experiment 1, children (ages 7–13 years) performed a picture verification task. Each picture was preceded by a prerecorded spoken sentence describing an entity whose shape or orientation matched or mismatched the depicted object. Responses were faster for matching pictures, suggesting that participants had formed perceptual-like situation models of the sentences. The advantage for matching pictures did not increase with age. Experiment 2 extended these findings to the domain of written language. Participants (ages 7–10 years) of high and low word reading ability verified pictures after reading sentences aloud. The results suggest that even when reading is effortful, children construct a perceptual simulation of the described events. We propose that perceptual simulation plays a more central role in developing language comprehension than was previously thought.     

Physical similarity (and not quantity representation) drives perceptual comparison of numbers: evidence from two Indian notations

Numerical quantity seems to affect the response in any task that involves numbers, even in tasks that do not demand access to quantity (e.g., perceptual tasks). That is, readers seem to activate quantity representations upon the mere presentation of integers. One important piece of evidence in favor of this view comes from the finding of a distance effect in perceptual tasks: When one compares two numbers, response times (RTs) are a function of the numerical distance between them. However, recent studies have suggested that the physical similarity between Arabic numbers is strongly correlated with their numerical distance, and that the former could be a better predictor of RT data in perceptual tasks in which magnitude processing is not required (Cohen, 2009a). The present study explored the Persian and Arabic versions of Indian numbers (Exps. 1 and 2, respectively). Na?ve participants (speakers of Spanish) and users of these notations (Pakistanis and Jordanians) participated in a physical same–different matching task. The RTs of users of the Indian notations were regressed on perceptual similarity (estimated from the Spanish participants’ RTs) and numerical distance. The results showed that, regardless of the degree of correlation between the perceptual similarity function and the numerical distance function, the critical predictor for RTs was perceptual similarity. Thus, participants do not automatically activate Indian integers’ quantity representations, at least not when these numbers are presented in simple perceptual tasks.     

视角采择的自动性

视角采择是个体表征他人或自己所看到世界的能力。个体在判断他人的视角时总是会自动激活自己的视角，但是当个体采取自己的视角时，并不总是会自动激活他人的视角。研究表明，当采取自己的视角时，成人和儿童可以自动做一级视觉视角采择，二级视觉视角采择的过程是非自动的，且成人可以自动做空间视角采择。未来研究需要继续探讨一级视觉视角采择自动性的影响因素，实验设置和个体因素是否会影响二级视觉视角采择的自动性，空间视角采择自动性的发展趋势和影响因素，视角采择的自动性是否与被试完成任务时所使用的策略有关，以及视角采择自动性的发展机制和脑神经机制。     

The influence of motor simulations on language comprehension

This study investigates the influence of activating specific motor codes on the comprehension of passages that describe the use of an object requiring similar motor manipulations. In three experiments, participants either imagined or pantomimed performing an action involving a common object. Participants then held the action in memory while reading a brief story, which described another object that required similar or different motor behaviors. Reading times were collected on the complementary actions. Finally, participants acted out the original action. In Exp. 1 and 2, reading slowed to the verbs. Exp. 2 revealed the slowing to be true interference, which disappeared in Exp. 3 when the action did not need to be recalled. The results suggest that readers activate motor codes when reading story actions, which supports an embodied view. The results also indicate that activated codes bound to an action will, at least briefly, impair reading about a complementary action requiring the same codes, consistent with Hommel's (2009) theory of event coding.     

The role of phonology in the activation of word meanings during reading: evidence from proofreading and eye movements.

Six experiments explored the role of phonology in the activation of word meanings when words were embedded in meaningful texts. Specifically, the studies examined whether participants detected the substitution of a homophone mate for a contextually appropriate homophone. The frequency of the incorrect homophone, the frequency of the correct homophone, and the predictability of the correct homophone were manipulated. Also, the impact of reading skill was examined. When correct homophones were not predictable and participants had a range of reading abilities, the evidence indicated that phonology plays a role in activating the meanings of low-frequency words only. When the performance of good and poor readers was examined separately, the evidence indicated that good readers primarily activate the meanings of words using the direct route, whereas poor readers primarily activate the meanings of words using the phonological route.     

I see what you're saying: the integration of complex speech and scenes during language comprehension

The effect of language-driven eye movements in a visual scene with concurrent speech was examined using complex linguistic stimuli and complex scenes. The processing demands were manipulated using speech rate and the temporal distance between mentioned objects. This experiment differs from previous research by using complex photographic scenes, three-sentence utterances and mentioning four target objects. The main finding was that objects that are more slowly mentioned, more evenly placed and isolated in the speech stream are more likely to be fixated after having been mentioned and are fixated faster. Surprisingly, even objects mentioned in the most demanding conditions still show an effect of language-driven eye-movements. This supports research using concurrent speech and visual scenes, and shows that the behavior of matching visual and linguistic information is likely to generalize to language situations of high information load.