EARSHOT: A Minimal Neural Network Model of Incremental Human Speech Recognition

Despite the lack of invariance problem (the many-to-many mapping between acoustics and percepts), human listeners experience phonetic constancy and typically perceive what a speaker intends. Most models of human speech recognition (HSR) have side-stepped this problem, working with abstract, idealized inputs and deferring the challenge of working with real speech. In contrast, carefully engineered deep learning networks allow robust, real-world automatic speech recognition (ASR). However, the complexities of deep learning architectures and training regimens make it difficult to use them to provide direct insights into mechanisms that may support HSR. In this brief article, we report preliminary results from a two-layer network that borrows one element from ASR, long short-term memory nodes, which provide dynamic memory for a range of temporal spans. This allows the model to learn to map real speech from multiple talkers to semantic targets with high accuracy, with human-like timecourse of lexical access and phonological competition. Internal representations emerge that resemble phonetically organized responses in human superior temporal gyrus, suggesting that the model develops a distributed phonological code despite no explicit training on phonetic or phonemic targets. The ability to work with real speech is a major advance for cognitive models of HSR.     

‘Personality in Its Natural Habitat’ Revisited: A Pooled,Multi-sample Examination of the Relationships Between the Big Five Personality Traits and Daily Behaviour and Language Use

Past research using the Electronically Activated Recorder (EAR), an observational ambulatory assessment method for the real-world measurement of daily behaviour, has identified several behavioural manifestations of the Big Five domains in a small college sample (N = 96). With the use of a larger and more diverse sample of pooled data from N = 462 participants from a total of four community samples who wore the EAR from 2 to 6 days, the primary purpose of the present study was to obtain more precise and generalizable effect estimates of the Big Five–behaviour relationships and to re-examine the degree to which these relationships are gender specific. In an extension of the original article, the secondary purpose of the present study was to examine if the Big Five–behaviour relationships differed across two facets of each Big Five domain. Overall, while several of the behavioural manifestations of the Big Five were generally consistent with the trait definitions (replicating some findings from the original article), we found little evidence of gender differences (not replicating a basic finding from the original article). Unique to the present study, the Big Five–behaviour relationships were not always comparable across the two facets of each Big Five domain. © 2020 European Association of Personality Psychology     

语言转向和西方心理学理论和研究的深入发展

语言转向是西方哲学自我批判的产物,对西方心理学摆脱“康德式难题”具有重要意义。该文以西方哲学语言转向的内在逻辑为理论背景,分析了由此引发的西方心理学研究主题、线索和路径变迁。分析哲学、解释学和结构主义是语言转向的三种方式,共同实现了20世纪的语言转向,影响心理学理论和研究的变迁,推动心理学关注语言建构和文本陈述,激发新的心理学理论和研究。     

Statistical learning of multiple speech streams: A challenge for monolingual infants

Language acquisition depends on the ability to detect and track the distributional properties of speech. Successful acquisition also necessitates detecting changes in those properties, which can occur when the learner encounters different speakers, topics, dialects, or languages. When encountering multiple speech streams with different underlying statistics but overlapping features, how do infants keep track of the properties of each speech stream separately? In four experiments, we tested whether 8‐month‐old monolingual infants (N = 144) can track the underlying statistics of two artificial speech streams that share a portion of their syllables. We first presented each stream individually. We then presented the two speech streams in sequence, without contextual cues signaling the different speech streams, and subsequently added pitch and accent cues to help learners track each stream separately. The results reveal that monolingual infants experience difficulty tracking the statistical regularities in two speech streams presented sequentially, even when provided with contextual cues intended to facilitate separation of the speech streams. We discuss the implications of our findings for understanding how infants learn and separate the input when confronted with multiple statistical structures.     

Enhanced gaze‐following behavior in Deaf infants of Deaf parents

Gaze following plays a role in parent–infant communication and is a key mechanism by which infants acquire information about the world from social input. Gaze following in Deaf infants has been understudied. Twelve Deaf infants of Deaf parents (DoD) who had native exposure to American Sign Language (ASL) were gender‐matched and age‐matched (±7 days) to 60 spoken‐language hearing control infants. Results showed that the DoD infants had significantly higher gaze‐following scores than the hearing infants. We hypothesize that in the absence of auditory input, and with support from ASL‐fluent Deaf parents, infants become attuned to visual‐communicative signals from other people, which engenders increased gaze following. These findings underscore the need to revise the ‘deficit model’ of deafness. Deaf infants immersed in natural sign language from birth are better at understanding the signals and identifying the referential meaning of adults’ gaze behavior compared to hearing infants not exposed to sign language. Broader implications for theories of social‐cognitive development are discussed. A video abstract of this article can be viewed at https://youtu.be/QXCDK_CUmAI     

The link between maternal and child verbal abilities: An indirect effect through maternal responsiveness

Language abilities in early childhood show stability over time and play an important role in the development of other cognitive processes. Identifying modifiable environmental risk factors is important to informing prevention and early intervention efforts. Maternal verbal ability has been previously linked to child verbal ability. The current study examined whether maternal and child verbal abilities were linked indirectly through early childhood maternal responsiveness. Data come from a longitudinal birth cohort study. Participants included 133 mothers and their children recruited from maternity wards shortly after birth. Maternal verbal ability was measured using the Vocabulary subtest from the Wechsler Abbreviated Scale of Intelligence, Second Edition (child age 8 months). Child verbal ability was assessed using the Peabody Picture Vocabulary Test (36 months). A latent maternal responsiveness variable was estimated using three developmentally sensitive indicators; one during infancy (child age 8 months) and two when children were 36 months. Results of a structural equation model indicated a significant indirect effect from maternal verbal abilities to child verbal abilities through maternal responsiveness. This indirect path was significant even after inclusion of another indirect path from maternal executive functioning to child verbal ability through maternal responsiveness (which was not significant). Future studies will benefit from experimental, genetically sensitive and/or cross‐lagged designs to allow for conclusions related to directionality and causality. This body of research has implications for the study of the intergenerational transmission of verbal abilities and associated skills, behaviours and adaptive outcomes.     

Disentangling the far transfer of language comprehension gains using latent mediation models

While we know that interventions targeting oral language can be effective, little is known about what drives these effects. In this study, we examine whether gains in transfer measures are mediated through the specific words that are trained in a language intervention. Based on a large‐scale randomized controlled trial of language intervention in 4‐ to 5‐year‐old children, latent mediation models were used to disentangle oral language gains in transfer measures. The results first showed that the effects of the language intervention and the transfer effects are generated through expressive rather than receptive measures of language. Second, we found that the effects of the intervention on intermediate transfer measures of language were mediated through the ability to define the trained words. Third, and critically, for far transfer measures that did not contain any of the trained words, the effects were mediated through the trained words. The findings relate to theories of transfer and support the idea that far transfer is possible, at least within the same domain. In addition, it seems that effects on receptive language skills are difficult to obtain and that what is improved is instead the children's ability to express themselves and use procedures to explain words. Thus, to optimize intervention effects, future studies should focus on expressive language.     

统计学习的认知神经机制及其与语言的关系

统计学习是指个体在连续刺激流中发现转移概率等统计规律的过程, 在Saffran等(1996)的经典婴儿语音切分研究中首次被提出。大量研究证实了统计学习的普遍存在, 近期学界开始关注统计学习的特异性及其对认知的影响, 尤其是从学习过程及其特异性两个方面阐述统计学习的认知神经机制并揭示其和语言的交互作用。未来应从脑和行为的多模态数据视角, 丰富统计学习结果的行为和神经指标, 考察不同类型统计学习过程的动态神经活动模式, 建立统计学习行为和脑的关联, 深化对统计学习认知神经机制的认识, 在统计学习与语言交互作用的基础上, 从成人二语学习切入结合音乐统计学习训练探讨促进语言学习的统计学习干预手段。     

偏侧化颜色范畴知觉不依赖于语言?

本研究探讨了偏左脑颜色范畴知觉依赖于语言还是范畴。三组被试分别完成无干扰、语言加工干扰和范畴加工干扰视觉搜索任务。结果发现：无干扰组、语言加工干扰组和范畴加工干扰组的视觉搜索任务中分别出现了偏左脑颜色范畴知觉、左脑劣势颜色范畴知觉和无偏侧化颜色范畴知觉。此结果表明,偏左脑颜色范畴知觉可能主要是语言范畴作为一种范畴对颜色知觉的影响效应,但语言范畴的语言属性也会对颜色知觉产生影响。