Decision-making and the framing effect in a foreign and native language

Recent research using scenarios such as the Asian disease problem has demonstrated a “foreign-language effect”, whereby the framing effect (tendency to be risk-averse in a gain frame and risk seeking in a loss frame) is not (or not as) apparent in the foreign language as the native language. The aim of the current study was to further investigate decision-making and the framing effect in a native language, Thai and a foreign language, English, using the Asian disease/Financial crisis problem (Study 1) and a novel financial decision-making task (Study 2). Results from Study 1 confirmed previous findings as a foreign-language effect emerged. In contrast, in Study 2, a framing effect emerged in both the native and foreign languages of the Thai participants. These contradictory results point to language factors as well as emotional and cognitive demands of the task contributing to the occurrence of the foreign-language effect.     

The role of auditory context in action-effect-related motor adaptation

Previous research indicates that adding auditory effects to a (silent) action can lead to substantial efficiency gains in the performance of the action, while compromising the connection between the motor and the auditory event (e.g., by removing, or by delaying the auditory effects), leads the agent to compensate for the loss of auditory feedback by executing actions in a way which increases the probability of success or enhances feedback in other modalities, thus departing from the optimal action performance. The current study explored how this motor adaptation was affected when the quality of auditory feedback was reduced by contextual factors, while keeping the physical link between the action and auditory effect intact. In two experiments, participants elicited pure tones by pinching a force sensitive resistor (FSR). In some of the conditions action-effect contingency was reduced by intermixing externally initiated tones with the self-induced ones. Pinch-force measurements indicated that action optimization was affected by contextual factors. The influence of auditory context was the most pronounced when the discrimination of self-induced and external tones was made difficult by the similarity and temporal proximity of the self-induced and external tones. In these conditions, tone eliciting actions were more forceful in comparison to conditions in which no external tones were presented, and in comparison to conditions in which the external tones were easily distinguishable from self-induced ones. This suggests that contextual factors can induce similar motor adjustments as manipulating the physical connection between the action and its sensory consequences.     

The power of the written word: Comparing word meaning inferencing from auditory and written modalities throughout grade school

Previous research indicates that word learning from auditory contexts may be more effective than written context at least through fourth grade. However, no study has examined contextual differences in word learning in older school-aged children when reading abilities are more developed. Here we examined developmental differences in children’s ability to deduce the meanings of unknown words from the surrounding linguistic context in the auditory and written modalities and sought to identify the most important predictors of success in each modality. A total of 89 children aged 8–15 years were randomly assigned to either read or listen to a narrative that included eight novel words, with five exposures to each novel word. They then completed three posttests to assess word meaning inferencing. Children across all ages performed better in the written modality. Vocabulary was the only significant predictor of success on the word inferencing task. Results indicate support for written stimuli as the most effective modality for novel word meaning deduction. Our findings suggest that the presence of orthographic information facilitates novel word learning even for early, less proficient readers.     

Ordering and reordering in the auditory and visual modalities

This study investigates the hypothesis that the modality effect (i.e., the often-found recall advantage of the last few items presented in the auditory- rather than visual-input modality) is attributable to a directional auditory trace. Such a directional trace should help performance of forward item-to-item recall, but should hurt performance if mental reordering is required. However, it was found in our Experiment 1 that mental item-to-item reordering of the materials did not affect the modality effect. In Experiment 2, strict control was exercised over the order of recall of chunks of items, as well as over the order of recall within chunks. It was found that the item-to-item reordering of the materials had little effect on the modality effect. However, the larger scale order of recall of the chunks had a large effect on the modality effect. If recall was in a forward order (i.e., first chunk, second chunk, third chunk), there was a dramatic superiority of the auditory materials on the last chunk. If the recall order was backward (third chunk, second chunk, first chunk), the modality effect was inconsequential. These results suggest that the modality effect is related to access to large memorial units rather than to item-to-item associations.     

The influence of visual information on auditory lateralization

Sætrevik, B. (2010). The influence of visual information on auditory lateralization. Scandinavian Journal of Psychology. The classic McGurk study showed that presentation of one syllable in the visual modality simultaneous with a different syllable in the auditory modality creates the perception of a third, not presented syllable. The current study presented dichotic syllable pairs (one in each ear) simultaneously with video clips of a mouth pronouncing the syllables from one of the ears, or pronouncing a syllable that was not part of the dichotic pair. When asked to report the auditory stimuli, responses were shifted towards selecting the auditory stimulus from the side that matched the visual stimulus.     

语音意识的不同成分在汉语儿童英语阅读学习中的作用

研究一测查了74名小学三、五年级儿童辨别、删除汉语和英语音节、首音-韵脚、音位等不同语音成分的能力以及英语单词阅读,考察语音意识不同成分与英语阅读学习的关系及母语语音意识的作用途径.研究二测查了83名英语阅读较差和73名英语阅读一般及以上儿童的英语语音删除和单词认读能力,考察阅读水平对于语音意识作用的调节效应.结果表明:(1)英语首音-韵脚意识对英语阅读具有显著的独立贡献;(2)汉语首音-韵脚意识和声调意识分别对英语单词认读和假词拼读具有显著的独立贡献,二者通过英语首音-韵脚意识的中介发挥作用;(3)阅读水平具有显著的调节作用.首音-韵脚意识是正常儿童阅读的有效预测变量,而音节意识是低水平儿童阅读的有效预测变量.上述结果与有关语音意识各成分在英语为母语儿童阅读学习中作用的研究结果不同,提示第二语言的学习具有特殊性,母语经验影响着个体第二语言学习的过程.     

视听刺激突显性对视觉主导效应的影响

本研究使用空间任务-转换范式,控制视、听刺激的突显性,探讨自下而上注意对视觉主导效应的影响。结果表明视、听刺激突显性显著地影响视觉主导效应,实验一中当听觉刺激为高突显性时,视觉主导效应显著减弱。实验二中当听觉刺激为高突显性并且视觉刺激为低突显性时,视觉主导效应进一步减弱但依然存在。结果支持偏向竞争理论,在跨通道视听交互过程中视觉刺激更具突显性,在多感觉整合过程中更具加工优势。     

Spatial and temporal processing in the auditory and visual modalities

Three experiments tested the idea that auditory presentation facilitates temporal recall whereas spatial recall is better if the input modality is visual. Lists of words were presented in which the temporal and spatial orders were independent, and instructions to the subjects determined whether recall would be given in a spatial or temporal order. In all three experiments, a significant interaction between the input modality and the type of recall was found, such that visual presentation resulted in superior recall over auditory presentation in the spatial conditions and auditory presentation yielded superior recall to visual in the temporal conditions. The present results contradict an earlier study by Murdock that showed that auditory presentation resulted in better performance than visual presentation in a nominally spatial task. An explanation for the discrepancies between the results of that study and the present one is presented.     

Moving to the speed of sound: context modulation of the effect of acoustic properties of speech

Suprasegmental acoustic patterns in speech can convey meaningful information and affect listeners' interpretation in various ways, including through systematic analog mapping of message-relevant information onto prosody. We examined whether the effect of analog acoustic variation is governed by the acoustic properties themselves. For example, fast speech may always prime the concept of speed or a faster response. Alternatively, the effect may be modulated by the context-dependent interpretation of those properties; the effect of rate may depend on how listeners construe its meaning in the immediate linguistic or communicative context. In two experiments, participants read short scenarios that implied, or did not imply, urgency. Scenarios were followed by recorded instructions, spoken at varying rates. The results show that speech rate had an effect on listeners' response speed; however, this effect was modulated by discourse context. Speech rate affected response speed following contexts that emphasized speed, but not without such contextual information.     

Context reinstatement and memory for intrinsic versus extrinsic context: The role of item generation at encoding or retrieval

According to many theoretical accounts, reinstating study context at the time of test creates optimal circumstances for item retrieval. The role of context reinstatement was tested in reference to context memory in several experiments. On the encoding phase, participants were presented with words printed in two different font colors (intrinsic context) or two different sides of the computer screen (extrinsic context). At test, the context was reinstated or changed and participants were asked to recognize words and recollect their study context. Moreover, a read‐generate manipulation was introduced at encoding and retrieval, which was intended to influence the relative salience of item and context information. The results showed that context reinstatement had no effect on memory for extrinsic context but affected memory for intrinsic context when the item was generated at encoding and read at test. These results supported the hypothesis that context information is reconstructed at retrieval only when context was poorly encoded at study.     

Duration judgments of naturalistic events in the auditory and visual modalities

Two experiments were performed to examine whether the same underlying mechanisms apply to the duration estimates of both auditory and visual events. In Experiment 1, it was found that the durations of visual scenes are reproduced with the same level of accuracy in prospective and retrospective situations when these display a predictable array of information, a result consistent with past research on auditory durations. Experiment 2 further revealed that when participants are asked to prospectively or retrospectively judge the durations of various naturalistic events in their auditory, visual, or audiovisual modality, no differences in either accuracy or bias are observed. These findings diverge from previous research and are argued to stem from different processing mechanisms that arise from naturalistic events.     

The effect of bilingualism on lexical learning and memory across two language modalities: some evidence for a domain-specific,but not general,advantage

ABSTRACT

The present study was conducted to replicate bilingual advantages in short-term memory for language-like material and word learning in young adults and extend this research to the sign domain, ultimately with the goal of investigating the domain specificity of bilingual advantages in cognition. Data from 112 monolingual hearing non-signers and 78 bilingual hearing non-signers were analysed for this study. Participants completed a battery of tasks assessing sign and word learning, short-term memory, working memory capacity, intelligence, and a language and demographic questionnaire. Overall, the results of this study suggested a bilingual advantage in memory for speech-like material – no other advantage (or disadvantage) was found. Results are discussed within the context of recent large-scale experimental and meta-analytic studies that have failed to find bilingual advantages in domain-general abilities such as attention control and working memory capacity in young adults.     

Effects of past language experience and present language context on the shape bias in Spanish–English bilingual children

English‐monolingual children develop a shape bias early in language acquisition, such that they more often generalize a novel label based on shape than other features. Spanish‐monolingual children, however, do not show this bias to the same extent (Hahn & Cantrell, 2012). Studying children who are simultaneously learning both Spanish and English presents a unique opportunity to further investigate how this word‐learning bias develops. Thus, we asked how Spanish–English bilingual children (M_age = 21.31 months) perform in a novel‐noun generalization (NNG) task, specifically examining how past language experience (i.e. language exposure and vocabulary size) and present language context (i.e. whether the NNG task was conducted in Spanish or English) influence the strength of the shape bias. Participants completed the NNG task either entirely in English (N = 16) or entirely in Spanish (N = 16), as well as language understanding tasks in both English and Spanish to ensure that they understood what the experimenter was asking them to do. Parents completed a language exposure survey and vocabulary checklists in Spanish and English. There was a significant interaction between condition and choice type: Bilingual children in the English condition showed a shape bias in the NNG task, but bilingual children in the Spanish condition showed no reliable biases. No measures of past language experience were related to NNG task performance. These results suggest that when learning new words, bilingual children are attuned to the regularities of the present language context, and prior language experiences may play a more secondary role.     

语言转换对非熟练双语者不同认知控制成分的即时影响

语言转换情境是否影响非熟练双语者的认知控制存在争议。实验1和实验2分别采用不同的实验范式探讨语言转换对非熟练双语者的认知控制是否会有即时的影响, 以及对不同认知控制成分的影响是否会有不同。结果表明, 语言转换情境能够即时地促进反应抑制, 阻碍干扰抑制, 但对认知灵活性没有影响, 同时说明了反应抑制、干扰抑制和认知灵活性属于3种不同的认知成分, 其内在作用机制不同。此外, 研究结果还进一步说明了双语者的认知控制优势是双语者长期双语使用的结果, 为双语优势的内在机制提供了实验支持。     

Knowledge of a second language influences auditory word recognition in the native language

Many studies in bilingual visual word recognition have demonstrated that lexical access is not language selective. However, research on bilingual word recognition in the auditory modality has been scarce, and it has yielded mixed results with regard to the degree of this language nonselectivity. In the present study, we investigated whether listening to a second language (L2) is influenced by knowledge of the native language (L1) and, more important, whether listening to the L1 is also influenced by knowledge of an L2. Additionally, we investigated whether the listener's selectivity of lexical access is influenced by the speaker's L1 (and thus his or her accent). With this aim, Dutch-English bilinguals completed an English (Experiment 1) and a Dutch (Experiment 3) auditory lexical decision task. As a control, the English auditory lexical decision task was also completed by English monolinguals (Experiment 2). Targets were pronounced by a native Dutch speaker with English as the L2 (Experiments 1A, 2A, and 3A) or by a native English speaker with Dutch as the L2 (Experiments 1B, 2B, and 3B). In all experiments, Dutch-English bilinguals recognized interlingual homophones (e.g., lief [sweet]-leaf /li:f/) significantly slower than matched control words, whereas the English monolinguals showed no effect. These results indicate that (a) lexical access in bilingual auditory word recognition is not language selective in L2, nor in L1, and (b) language-specific subphonological cues do not annul cross-lingual interactions.     

The interaction of temporal generalization gradients predicts the context effect

In a temporal double bisection task, animals learn two discriminations. In the presence of Red and Green keys, responses to Red are reinforced after 1-s samples and responses to Green are reinforced after 4-s samples; in the presence of Blue and Yellow keys, responses to Blue are reinforced after 4-s samples and responses to Yellow are reinforced after 16-s samples. Subsequently, given a choice between Green and Blue, the probability of choosing Green increases with the sample duration-the context effect. In the present study we asked whether this effect could be predicted from the stimulus generalization gradients induced by the two basic discriminations. Six pigeons learned to peck Green following 4-s samples (S(+)) but not following 1-s samples (S(-)) and to peck Red following 4-s samples (S(+)) but not following 16-s samples (S(-)). Temporal generalization gradients for Green and Red were then obtained. Finally, the pigeons were given a choice between Green and Red following sample durations ranging from 1 to 16 s. Results showed that a) the two generalization gradients had the minimum at the S(-) duration, an intermediate value between the S(-) and the S(+) durations, and the maximum at the S(+) as well as more extreme durations; b) on choice trials, preference for Green over Red increased with sample duration, the context effect; and c) the two generalization gradients predicted the average context effect well. The Learning-to-Time model accounts for the major trends in the data.     

外语焦虑、紧张情绪与认知负荷对外语说谎的影响：来自中-英双语者的证据

采用错误陈述范式探究中-英双语者用母语和外语说真话和说谎时的认知神经差异,涉及外语焦虑、认知负荷和说谎诱发的紧张情绪。对P200和CNV观察发现:(1)中-英双语者用英语说真话的P200波幅比用母语大,说明被试用英语说话时受外语焦虑情绪影响;(2)中-英双语者用英语说谎与说真话的P200波幅无显著差异,但用母语说谎和讲真话的P200波幅差异显著,说明被试用外语说谎没有用母语说谎诱发的紧张情绪大;(3)中-英双语者说谎时的CNV波幅比说真话时大,说明被试说谎比说真话的认知负荷更大;(4)中-英双语者用英语说谎时的CNV波幅比用汉语说谎时大,说明被试用外语说谎比用母语说谎产生了更大的认知负荷。相关分析表明,英语熟练程度是影响中-英双语者用母语和外语说谎时的认知神经差异的重要变量。     

The use of visual context during the production of referring expressions

Most theories of reference assume that a referent's saliency in the linguistic context determines the choice of referring expression. However, it is less clear whether cognitive factors relating to the nonlinguistic context also have an effect. We investigated whether visual context influences the choice of a pronoun over a repeated noun phrase when speakers refer back to a referent in a preceding sentence. In Experiment 1, linguistic mention as well as visual presence of a competitor with the same gender as the referent resulted in fewer pronouns for the referent, suggesting that both linguistic and visual context determined the choice of referring expression. Experiment 2 showed that even when the competitor had a different gender from the referent, its visual presence reduced pronoun use, indicating that visual context plays a role even if the use of a pronoun is unambiguous. Thus, both linguistic and nonlinguistic information affect the choice of referring expression.     

Influence of vowel context on the audio‐visual speech perception of voiced stop consonants

The work reported here investigated whether the extent of McGurk effect differs according to the vowel context, and differs when cross‐modal vowels are matched or mismatched in Japanese. Two audio‐visual experiments were conducted to examine the process of audio‐visual phonetic‐feature extraction and integration. The first experiment was designed to compare the extent of the McGurk effect in Japanese in three different vowel contexts. The results indicated that the effect was largest in the /i/ context, moderate in the /a/ context, and almost nonexistent in the /u/ context. This suggests that the occurrence of McGurk effect depends on the characteristics of vowels and the visual cues from their articulation. The second experiment measured the McGurk effect in Japanese with cross‐modal matched and mismatched vowels, and showed that, except with the /u/ sound, the effect was larger when the vowels were matched than when they were mismatched. These results showed, again, that the extent of McGurk effect depends on vowel context and that auditory information processing before phonetic judgment plays an important role in cross‐modal feature integration.