Learning a Phonological Contrast Modulates the Auditory Grouping of Rhythm

Perceptual grouping is fundamental to many auditory processes. The Iambic–Trochaic Law (ITL) is a default grouping strategy, where rhythmic alternations of duration are perceived iambically (weak‐strong), while alternations of intensity are perceived trochaically (strong‐weak). Some argue that the ITL is experience dependent. For instance, French speakers follow the ITL, but not as consistently as German speakers. We hypothesized that learning about prosodic patterns, like word stress, modulates this rhythmic grouping. We tested this idea by training French adults on a German‐like stress contrast. Individuals who showed better phonological learning had more ITL‐like grouping, particularly over duration cues. In a non‐phonological condition, French adults were trained using identical stimuli, but they learned to attend to acoustic variation that was not linguistic. Here, no learning effects were observed. Results thus suggest that phonological learning can modulate low‐level auditory grouping phenomena, but it is constrained by the ability of individuals to learn from short‐term training.     

Modeling the effects of perceived intuitiveness and urgency of various auditory warnings on driver takeover performance in automated vehicles

Existing driver models mainly account for drivers’ responses to visual cues in manually controlled vehicles. The present study is one of the few attempts to model drivers’ responses to auditory cues in automated vehicles. It developed a mathematical model to quantify the effects of characteristics of auditory cues on drivers’ response to takeover requests in automated vehicles. The current study enhanced queuing network-model human processor (QN-MHP) by modeling the effects of different auditory warnings, including speech, spearcon, and earcon. Different levels of intuitiveness and urgency of each sound were used to estimate the psychological parameters, such as perceived trust and urgency. The model predictions of takeover time were validated via an experimental study using driving simulation with resultant R squares of 0.925 and root-mean-square-error of 73 ms. The developed mathematical model can contribute to modeling the effects of auditory cues and providing design guidelines for standard takeover request warnings for automated vehicles.     

Temporal context in speech processing and attentional stream selection: a behavioral and neural perspective

The human capacity for processing speech is remarkable, especially given that information in speech unfolds over multiple time scales concurrently. Similarly notable is our ability to filter out of extraneous sounds and focus our attention on one conversation, epitomized by the ‘Cocktail Party’ effect. Yet, the neural mechanisms underlying on-line speech decoding and attentional stream selection are not well understood. We review findings from behavioral and neurophysiological investigations that underscore the importance of the temporal structure of speech for achieving these perceptual feats. We discuss the hypothesis that entrainment of ambient neuronal oscillations to speech’s temporal structure, across multiple time-scales, serves to facilitate its decoding and underlies the selection of an attended speech stream over other competing input. In this regard, speech decoding and attentional stream selection are examples of ‘Active Sensing’, emphasizing an interaction between proactive and predictive top-down modulation of neuronal dynamics and bottom-up sensory input.     

ERP correlates of language-specific processing of auditory pitch feedback during self-vocalization

The present study investigated whether the neural correlates for auditory feedback control of vocal pitch can be shaped by tone language experience. Event-related potentials (P2/N1) were recorded from adult native speakers of Mandarin and Cantonese who heard their voice auditory feedback shifted in pitch by −50, −100, −200, or −500 cents when they sustained the vowel sound /u/. Cantonese speakers produced larger P2 amplitudes to −200 or −500 cents stimuli than Mandarin speakers, but this language effect failed to reach significance in the case of −50 or −100 cents. Moreover, Mandarin speakers produced shorter N1 latencies over the left hemisphere than the right hemisphere, whereas Cantonese speakers did not. These findings demonstrate that neural processing of auditory pitch feedback in vocal motor control is subject to language-dependent neural plasticity, suggesting that cortical mechanisms of auditory-vocal integration can be shaped by tone language experience.     

The effect of gender on the N1-P2 auditory complex while listening and speaking with altered auditory feedback

The effect of gender on the N1-P2 auditory complex was examined while listening and speaking with altered auditory feedback. Fifteen normal hearing adult males and 15 females participated. N1-P2 components were evoked while listening to self-produced nonaltered and frequency shifted /a/ tokens and during production of /a/ tokens during nonaltered auditory feedback (NAF), frequency altered feedback (FAF), and delayed auditory feedback (DAF; 50 and 200 ms). During speech production, females exhibited earlier N1 latencies during 50 ms DAF and earlier P2 latencies during 50 ms DAF and FAF. There were no significant differences in N1-P2 amplitudes across all conditions. Comparing listening to active speaking, N1 and P2 latencies were earlier among females, with speaking, and under NAF. N1-P2 amplitudes were significantly reduced during speech production. These findings are consistent with the notions that speech production suppresses auditory cortex responsiveness and males and females process altered auditory feedback differently while speaking.     

The interaction between surface color and color knowledge: behavioral and electrophysiological evidence

In this study, we used event-related potentials (ERPs) to evaluate the contribution of surface color and color knowledge information in object identification. We constructed two color-object verification tasks - a surface and a knowledge verification task - using high color diagnostic objects; both typical and atypical color versions of the same object were presented. Continuous electroencephalogram was recorded from 26 subjects. A cluster randomization procedure was used to explore the differences between typical and atypical color objects in each task. In the color knowledge task, we found two significant clusters that were consistent with the N350 and late positive complex (LPC) effects. Atypical color objects elicited more negative ERPs compared to typical color objects. The color effect found in the N350 time window suggests that surface color is an important cue that facilitates the selection of a stored object representation from long-term memory. Moreover, the observed LPC effect suggests that surface color activates associated semantic knowledge about the object, including color knowledge representations. We did not find any significant differences between typical and atypical color objects in the surface color verification task, which indicates that there is little contribution of color knowledge to resolve the surface color verification. Our main results suggest that surface color is an important visual cue that triggers color knowledge, thereby facilitating object identification.     

事件提示和时间提示对新异干扰的影响—— 来自听视跨通道和听通道的证据

采用Oddball范式考察听视跨感觉通道和听感觉通道中“无关刺激”或“无关属性”的信号提示对新异干扰的影响。实验1和实验2分别比较了听视跨通道和听通道中时间事件提示、时间提示和事件提示三种条件。结果表明：(1)时间提示条件下新异干扰效应消失, 而事件提示条件下新异干扰效应仍存在。无关刺激意外变化引起的靶任务行为受损, 不仅与偏差刺激的小概率和新颖性有关, 而且与干扰刺激与靶子间提示信号关联有关, 这种提示关联中事件发生的提示功能比时间间隔的提示功能更为重要。(2)听通道下新异干扰与视听跨通道结果一致, 无关属性也会起到提示信号作用, 同样事件提示功能比时间提示功能更重要。     

汉语隐喻理解时程的ERPs研究

摘 要 本研究使用ERPs技术考察隐喻句与本义句理解时程的异同,以研究汉语隐喻的理解机制。以句尾范式向被试随机呈现本义句、熟悉隐喻句、新奇隐喻句及错误义句各50句,被试的任务为判断每句话是否有意义。结果显示：两种隐喻句诱发的N400波形与头皮分布情况和本义句无明显差异,且两种隐喻句诱发的N400波幅高于本义句。本研究结果证明汉语隐喻义和本义理解的认知机制类似,支持隐喻理解的平行加工假说,且加工隐喻义需要耗费更多的认知资源。     

A familiar pattern? Semantic memory contributes to the enhancement of visuo-spatial memories

In this study we quantify for the first time electrophysiological components associated with incorporating long-term semantic knowledge with visuo-spatial information using two variants of a traditional matrix patterns task. Results indicated that the matrix task with greater semantic content was associated with enhanced accuracy and RTs in a change-detection paradigm; this was also associated with increased P300 and N400 components as well as a sustained negative slow wave (NSW). In contrast, processing of the low semantic stimuli was associated with an increased N200 and a reduction in the P300. These findings suggest that semantic content can aid in reducing early visual processing of information and subsequent memory load by unitizing complex patterns into familiar forms. The N400/NSW may be associated with the requirements for maintaining visuo-spatial information about semantic forms such as orientation and relative location. Evidence for individual differences in semantic elaboration strategies used by participants is also discussed.     

Temporal dynamics of interference in Simon and Eriksen tasks considered within the context of a dual-process model

Behavioral and brain potential measures were employed to compare interference in Eriksen and Simon tasks. Assuming a dual-process model of interference elicited in speeded response tasks, we hypothesized that only lateralized stimuli in the Simon task induce fast S–R priming via direct unconditional processes, while Eriksen interference effects are induced later via indirect conditional processes. Delays to responses for incongruent trials were indeed larger in the Eriksen than in the Simon task. Only lateralized stimuli in the Simon task elicited early S–R priming, maximal at parietal areas. Incongruent flankers in the Eriksen task elicited interference later, visible as a lateralized N2. Eriksen interference also elicited an additional component (N350), which accounted for the larger behavioral interference effects in the Eriksen task. The findings suggest that interference and its resolution involve different processes for Simon and Eriksen tasks.