熟练粤-普双言者的双言认知控制机制——来自双任务切换范式的行为研究证据

实验采用双任务切换范式,考察熟练粤-普双言被试在简单情境和混合情境下任务切换和语码切换的代价模式。实验1在语音相似条件下,考察了粤-普双言者语码切换代价与任务切换代价;实验2在语音不相似条件下,探讨粤-普双言者语码切换代价与任务切换代价。结果发现,不同语音条件下,熟练粤语-普通话双言者出现对称的语码切换代价,切换过程受到语音相似性的影响,但是语码切换代价却没有受到影响,支持了特定语言选择假设。无论在何种语音条件下,任务切换代价模式和语码切换代价模式都是一致的,出现对称的切换代价,但两种切换代价相关不显著。从定性和定量结果来看,双言认知控制机制与一般认知控制机制有密切关系,但双言认知控制机制不完全附属于一般认知控制机制,双言认知控制机制可能存在一部分加工独立于一般认知控制。     

双言舌尖现象的产生机制：来自粤语-普通话双言者的证据

舌尖现象(Tip-of-the-Tongue phenomenon, TOT)是言语产生中的一种常见现象。国外研究发现, 双语者和单语者的舌尖现象差异很大。双言和双语既相似, 又存在差异。以粤语–普通话双言者为被试, 比较了普通话熟练和不熟练的被试在使用不同语言命名时的TOT产生率。结果发现：(1)粤语–普通话双言者的TOT率受普通话熟练程度影响。普通话不熟练的粤语–普通话双言者用普通话命名时产生更高的TOT率。(2)语言启动能够调节粤语–普通话双言者的普通话熟练程度与TOT产生的关系。在语言启动条件下, 普通话熟练的粤语–普通话双言者的TOT率更高。(3)粤语–普通话双言者的TOT产生机制符合部分激活理论的预言。     

不同熟练程度藏汉双语者言语理解中的语码切换及其代价

以母语为藏语,第二语言为汉语的熟练和非熟练藏汉双语者为被试,采用词汇判断任务,在无切换、预期切换和无预期切换三种条件下,考察藏汉两种语言之间的语码切换及其切换代价。结果表明：（1）在三种条件下,熟练和非熟练藏汉双语者对汉语词的反应时均显著短于对藏语词的反应时,汉语词的错误率也显著低于藏语词;（2）切换条件下的反应速度显著慢于无切换条件,切换条件下的错误率显著高于无切换条件,存在显著的切换代价;（3）熟练藏汉双语者对汉语词的反应时显著短于非熟练藏汉双语者,熟练藏汉双语者对汉语词反应的错误率也显著低于非熟练藏汉双语者。本研究表明,藏汉双语语码切换过程中存在切换代价,支持抑制说;熟练藏汉双语者语码切换代价更小。     

藏-汉-英双语者字词识别中的语码切换及其代价

以母语为藏语、汉语熟练、英语不熟练的藏-汉-英双语者为被试,采用词汇判断的研究范式,在无切换、预期切换和无预期切换三种条件下,考察了藏-汉-英三种语言之间的语码切换及其代价。结果表明：⑴在三种条件下,被试对汉语词和藏语词的反应时和错误率的差异不显著,藏语词和汉语词的切换代价差异不显著。⑵在无切换条件下,对藏语词和英语词的反应时和错误率的差异不显著;在切换条件下,对英语词反应时长,错误率也高;英语词的切换代价显著大于藏语词的切换代价。⑶在无切换条件下,对汉语词和英语词的反应时和错误率的差异不显著;在切换条件下,对英语词反应时长,错误率也高;英语词的切换代价显著大于藏语词的切换代价。整个研究表明,藏-汉-英双语者在字词识别中的语码切换代价主要受语言的熟练程度影响     

熟练粤语-普通话双言者听觉词的语言表征*

以熟练粤语-普通话双言者为被试, 考察粤语-普通话双言者对听觉词的语言表征。实验1呈现粤语和普通话同形异音的词, 实验2呈现粤语和普通话异形异音的词, 要求被试做语义决定。结果发现, 粤语-普通话双言者对听觉词的语言表征类似于双语者, 即普通话和粤语的语义共同表征, 词汇分别表征。所以如此, 是由粤语的特点和它与普通话的关系决定的。     

非熟练中-英双语者跨语言的错误记忆通道效应

采用DRM范式以112名非熟练中-英双语者为被试进行了跨语言的错误记忆通道效应实验。实验采用三因素混合设计,根据学习通道和测验通道的不同,把被试分为4组,用由汉语与英语单词组成的DRM词表进行学习和测验。结果发现,⑴在非熟练中-英双语被试中存在错误记忆的跨语言现象;⑵非熟练中-英双语者跨语言的错误记忆存在很强的语言特异性,表现为相同语言条件高于不同语言条件、汉语高于英语;⑶在学习与测验相同语言条件下运用校正的再认分数——敏感性指标Pr,进一步探讨错误记忆的通道效应,发现了跟西方不一致的结论：即无论汉语词表还是英语词表,非熟练中-英双语者在视觉通道上的错误记忆明显高于听觉通道     

方言与普通话并用:双言心理研究述评

由于汉语方言的复杂性和多年来的推广普通话,使得方言和普通话并用的双言现象非常普遍.在语言关联性假设的指引下,心理学家探讨了双言者的语言表征,考察了双言对于双言者的记忆、时间认知和语言加工的影响,调查了双言者的语言态度,包括两种语言的语用情况和内隐态度.未来研究要继续关注双言者的语言表征及其提取机制,探查双言现象的认知神经机制,进一步深入探讨双言对双言者心理的影响.     

信息呈现方式与学习者的个性特征对多媒体环境下学习效果的影响

采用两个实验:实验一以陈述性知识为学习内容,实验二以程序性知识为学习内容,在这两种情况下,分别用组间设计探讨信息呈现方式对不同认知风格和空间能力的学习者在多媒体环境下学习效果的影响。结果表明:(1)认知风格对陈述性知识在多媒体环境下的学习效果产生影响,而选择的多媒体信息呈现方式和被试的空间能力则对其不产生影响;(2)对于程序性知识的保持,多媒体信息呈现方式和被试认知风格都会对学习效果产生影响,被试空间能力则不会产生影响,而且被试不同的认知风格在不同的多媒体信息呈现方式上会产生不同的影响;(3)对程序性知识的迁移,多媒体信息呈现方式、被试认知风格和空间能力都会对多媒体环境下的学习效果产生影响,而且被试不同的认知风格和空间能力在不同的多媒体信息呈现方式上都会产生不同的影响。     

情感性动机网络使用者对负性情绪线索的前注意偏向

采用修改后的分离式Stroop任务,通过两个实验考察了基于人际情感性动机的网络使用者在双线索竞争条件下的前注意加工特性。研究结果表明,相对于信息获取型被试,在中性线索与负性情绪线索匹配条件下,人际情感型被试对负性情绪线索表现出显著的前注意加工偏向,但在中性线索和情感满足线索匹配条件下,该类被试对情感满足线索未表现出前注意加工偏向。该研究为解释人际情感型动机者的病理性网络使用行为的情绪机制提供了实验证据。     

熟练汉-英双语者的语码切换机制—— 来自短语水平的证据

以熟练汉-英双语者为被试, 考察了在短语水平上语码切换的机制及切换代价的来源。结果表明：(1)汉语与英语表示空间方所的短语的差异和表示量的短语的对应与否影响语码切换过程, 但对于两种语言的切换代价的影响不显著, 表明语码切换代价未受特定语言的语法特征影响; (2)熟练汉-英双语者在短语水平上表现出语码切换代价的不对称性：切换至熟练语言的代价比切换至非熟练语言的代价大; (3)熟练汉-英双语者的切换代价源于两种语言短语的激活和竞争, 支持非特定语言选择假说, 可以用抑制控制模型来解释。整个研究表明, 熟练双语者的语码切换代价源于语言表征系统之外。     

Investigating Optimal Memory Enhancement Procedures in Foreign Language Learning

We investigated the effects of learning schedule and multi‐modality stimulus presentation on foreign language vocabulary learning. In Experiment 1, participants learned German vocabulary words utilizing three learning methods that were organized either in a blocked or interleaved fashion. We found interleaving with the keyword mnemonic and rote study advantageous over blocking, but retrieval practice was better served in a blocked schedule. It is likely that the excessively delayed feedback for the retrieval practice in the interleaved practice schedule impeded learning while the spacing involved in the interleaved schedule enhanced learning in the keyword mnemonic and rote study. In Experiment 2, we examined whether a multi‐modality stimulus presentation from visual and auditory channels is better suited for aiding learning over a visual presentation condition. We found benefits of multi‐modality presentation only for the keyword mnemonic condition, presumably because the nature of the keyword mnemonic involving sound and visualization was particularly relevant with the multi‐modality presentation. The present study suggests that optimal foreign language learning environments should incorporate learning schedules and multimedia presentations based on specific learning methods and materials. Copyright © 2017 John Wiley & Sons, Ltd.     

The role of preparation and cue-modality in crossmodal task switching

The present study examined the effects of cue-based preparation and cue-target modality mapping in crossmodal task switching. In two experiments, we randomly presented lateralized visual and auditory stimuli simultaneously. Subjects were asked to make a left/right judgment for a stimulus in only one of the modalities. Prior to each trial, the relevant stimulus modality was indicated by a visual or auditory cue. The cueing interval was manipulated to examine preparation. In Experiment 1, we used a corresponding mapping of cue-modality and stimulus modality, whereas in Experiment 2 the mapping of cue and stimulus modalities was reversed. We found reduced modality-switch costs with a long cueing interval, showing that attention shifts to stimulus modalities can be prepared, irrespective of cue-target modality mapping. We conclude that perceptual processing in crossmodal switching can be biased in a preparatory way towards task-relevant stimulus modalities.     

Learning directions of objects specified by vision,spatial audition,or auditory spatial language

The modality by which object azimuths (directions) are presented affects learning of multiple locations. In Experiment 1, participants learned sets of three and five object azimuths specified by a visual virtual environment, spatial audition (3D sound), or auditory spatial language. Five azimuths were learned faster when specified by spatial modalities (vision, audition) than by language. Experiment 2 equated the modalities for proprioceptive cues and eliminated spatial cues unique to vision (optic flow) and audition (differential binaural signals). There remained a learning disadvantage for spatial language. We attribute this result to the cost of indirect processing from words to spatial representations.     

The other modality: Auditory stimuli in language switching

Language switching studies typically implement visual stimuli and visual language cues to trigger a concept and a language response, respectively. In the present study we set out to generalise this to another stimulus modality by investigating language switching with auditory stimuli next to visual stimuli. The results showed that switch costs can be obtained with both auditory and visual stimuli. Yet, switch costs were relatively larger with visual stimuli than with auditory stimuli. Both methodological and theoretical implications of these findings are discussed.     

The role of crossmodal competition and dimensional overlap in crossmodal attention switching

Crossmodal selective attention was investigated in a cued task switching paradigm using bimodal visual and auditory stimulation. A cue indicated the imperative modality. Three levels of spatial S–R associations were established following perceptual (location), structural (numerical), and conceptual (verbal) set-level compatibility. In Experiment 1, participants switched attention between the auditory and visual modality either with a spatial-location or spatial-numerical stimulus set. In the spatial-location set, participants performed a localization judgment on left vs. right presented stimuli, whereas the spatial-numerical set required a magnitude judgment about a visually or auditorily presented number word. Single-modality blocks with unimodal stimuli were included as a control condition. In Experiment 2, the spatial-numerical stimulus set was replaced by a spatial-verbal stimulus set using direction words (e.g., “left”). RT data showed modality switch costs, which were asymmetric across modalities in the spatial-numerical and spatial-verbal stimulus set (i.e., larger for auditory than for visual stimuli), and congruency effects, which were asymmetric primarily in the spatial-location stimulus set (i.e., larger for auditory than for visual stimuli). This pattern of effects suggests task-dependent visual dominance.     

Capturing spatial attention with multisensory cues

We assessed the influence of multisensory interactions on the exogenous orienting of spatial attention by comparing the ability of auditory, tactile, and audiotactile exogenous cues to capture visuospatial attention under conditions of no perceptual load versus high perceptual load. In Experiment 1, participants discriminated the elevation of visual targets preceded by either unimodal or bimodal cues under conditions of either a high perceptual load (involving the monitoring of a rapidly presented central stream of visual letters for occasionally presented target digits) or no perceptual load (when the central stream was replaced by a fixation point). All of the cues captured spatial attention in the no-load condition, whereas only the bimodal cues captured visuospatial attention in the highload condition. In Experiment 2, we ruled out the possibility that the presentation of any changing stimulus at fixation (i.e., a passively monitored stream of letters) would eliminate exogenous orienting, which instead appears to be a consequence of high perceptual load conditions (Experiment 1). These results demonstrate that multisensory cues capture spatial attention more effectively than unimodal cues under conditions of concurrent perceptual load.     

Stimulus modality and working memory performance in Greek children with reading disabilities: Additional evidence for the pictorial superiority hypothesis

This study investigated the effects of stimulus presentation modality on working memory performance in children with reading disabilities (RD) and in typically developing children (TDC), all native speakers of Greek. It was hypothesized that the visual presentation of common objects would result in improved learning and recall performance as compared to the auditory presentation of stimuli. Twenty children, ages 10–12, diagnosed with RD were matched to 20 TDC age peers. The experimental tasks implemented a multitrial verbal learning paradigm incorporating three modalities: auditory, visual, and auditory plus visual. Significant group differences were noted on language, verbal and nonverbal memory, and measures of executive abilities. A mixed-model MANOVA indicated that children with RD had a slower learning curve and recalled fewer words than TDC across experimental modalities. Both groups of participants benefited from the visual presentation of objects; however, children with RD showed the greatest gains during this condition. In conclusion, working memory for common verbal items is impaired in children with RD; however, performance can be facilitated, and learning efficiency maximized, when information is presented visually. The results provide further evidence for the pictorial superiority hypothesis and the theory that pictorial presentation of verbal stimuli is adequate for dual coding.     

Verifying different-modality properties for concepts produces switching costs

According to perceptual symbol systems, sensorimotor simulations underlie the representation of concepts. It follows that sensorimotor phenomena should arise in conceptual processing. Previous studies have shown that switching from one modality to another during perceptual processing incurs a processing cost. If perceptual simulation underlies conceptual processing, then verifying the properties of concepts should exhibit a switching cost as well. For example, verifying a property in the auditory modality (e.g., BLENDER-loud) should be slower after verifying a property in a different modality (e.g., CRANBERRIES-tart) than after verifying a property in the same modality (e.g., LEAVES-rustling). Only words were presented to subjects, and there were no instructions to use imagery. Nevertheless, switching modalities incurred a cost, analogous to the cost of switching modalities in perception. A second experiment showed that this effect was not due to associative priming between properties in the same modality. These results support the hypothesis that perceptual simulation underlies conceptual processing.     

面孔表情和声音情绪信息整合对返回抑制的影响

返回抑制(inhibition of return, IOR)与情绪刺激都具有引导注意偏向、提高搜索效率的特点, 但二者间是否存在一定的交互作用迄今为止尚不明确。研究采用“线索-目标”范式并在视听双通道呈现情绪刺激来考察情绪刺激的加工与IOR的交互作用。实验1中情绪刺激以单通道视觉面孔或一致的视听双通道呈现, 实验2通过在视听通道呈现不一致的情绪刺激进一步考察视听双通道情绪一致刺激对IOR的影响是否是由听觉通道一致的情绪刺激导致的, 即是否对听觉通道的情绪刺激进行了加工。结果发现, 视听双通道情绪一致刺激能够削弱IOR, 但情绪不一致刺激与IOR之间不存在交互作用, 并且单双通道的IOR不存在显著差异。研究结果表明仅在视听双通道呈现情绪一致刺激时, 才会影响同一阶段的IOR, 这进一步支持了IOR的知觉抑制理论。     

An Information Space for Partial Length Perception in Dynamic Touch

Two experiments evaluated change in the perception of an environmental property (object length) in each of 3 perceptual modalities (vision, audition, and haptics) when perceivers were provided with the opportunity to experience the same environmental property by means of an additional perceptual modality (e.g., haptics followed by vision, vision followed by audition, or audition followed by haptics). Experiment 1 found that (a) posttest improvements in perceptual consistency occurred in all 3 perceptual modalities, regardless of whether practice included experience in an additional perceptual modality and (b) posttest improvements in perceptual accuracy occurred in haptics and audition but only when practice included experience in an additional perceptual modality. Experiment 2 found that learning curves in each perceptual modality could be accommodated by a single function in which auditory perceptual learning occurred over short time scales, haptic perceptual learning occurred over middle time scales, and visual perceptual learning occurred over long time scales. Analysis of trial-to-trial variability revealed patterns of long-term correlations in all perceptual modalities regardless of whether practice included experience in an additional perceptual modality.