计算机性别化及用户的定型反应研究

CASA（计算机作为行动者）研究在性别、声音可以引起性别定型的理论基础上,发展出了一套较为规范的研究变量和步骤,得到了在人机交互中人类会对计算机做出社会化反应,特别是性别定型反应的结论。但是这类研究存在着不足,并由此产生了一些新的研究方向,例如,合成音在体现副语言线索上的欠缺,将图像引入为线索的种类,对任务性别加以更多的关注等。文章同时对今后该领域的研究作了展望。     

汉语言语产生的语音加工机制

通过采用词图干扰范式的图形命名技术,系统控制启动词与目标词之间的语音关系,探讨汉语言语产生中语音加工的机制。实验一发现,目标语音在韵尾变化条件下具有显著的语音启动效应,表明汉语语音音节是在言语产生过程中生成的;实验二在启动语音与目标语音仅共有声母的情况下,发现了与实验一相同的模式、结果支持实验一的结论,即汉语语音音节是在言语产生过程中生成的,语音的加工过程是一个构建的过程而不是简单的音节提取过程。     

Self-reported inner speech relates to phonological retrieval ability in people with aphasia

Many individuals with aphasia report the ability to say words in their heads despite spoken naming difficulty. Here, we examined individual differences in the experience of inner speech (IS) in participants with aphasia to test the hypotheses that self-reported IS reflects intact phonological retrieval and that articulatory output processing is not essential to IS. Participants (N = 53) reported their ability to name items correctly internally during a silent picture-naming task. We compared this measure of self-reported IS to spoken picture naming and a battery of tasks measuring the underlying processes required for naming (i.e., phonological retrieval and output processing). Results from three separate analyses of these measures indicate that self-reported IS relates to phonological retrieval and that speech output processes are not a necessary component of IS. We suggest that self-reported IS may be a clinically valuable measure that could assist in clinical decision-making regarding anomia diagnosis and treatment.     

精神分裂症患者的语音感知

精神分裂症是一种常见的精神疾病, 表现为多方面的症状, 其中, 语言异常是精神分裂症患者认知损伤的核心症状之一。本文关注精神分裂症患者的语音感知, 从音段和超音段两方面简述国内外对精神分裂症患者语音感知开展的行为和神经科学实验, 指出中国应加大对中国精神分裂症患者的汉语语音感知探索。     

Valence,form, and content of self-talk predict sport type and level of performance

In this paper, we aimed to test whether we could predict sport type (badminton or running) and marathon proficiency from the valence, form, and content of the athletes’ self-reported inner speech. Additionally, we wanted to assess the difference between self-talk during high intensity and low intensity exercise. The present study corroborated existing research – we were able to predict both sport type in Study 1 and intensity level as well as marathon proficiency in Study 2 from questionnaire data using machine learning models. In Study 1, we found that badminton players engage more in worry and anxiety-control while runners are more prone to task disengagement. Interestingly, it seemed in Study 2 that the more participants engaged in condensed, positive, and repetitive self-talk when not pushing themselves, the slower their fastest marathons and half marathons were. We discuss potential explanations for these findings and make suggestions for future research.     

Beneficial effects of a music listening intervention on neural speech processing in 0–28-month-old children at risk for dyslexia

Familial risk for developmental dyslexia can compromise auditory and speech processing and subsequent language and literacy development. According to the phonological deficit theory, supporting phonological development during the sensitive infancy period could prevent or ameliorate future dyslexic symptoms. Music is an established method for supporting auditory and speech processing and even language and literacy, but no previous studies have investigated its benefits for infants at risk for developmental language and reading disorders. We pseudo-randomized N∼150 infants at risk for dyslexia to vocal or instrumental music listening interventions at 0–6 months, or to a no-intervention control group. Music listening was used as an easy-to-administer, cost-effective intervention in early infancy. Mismatch responses (MMRs) elicited by speech-sound changes were recorded with electroencephalogram (EEG) before (at birth) and after (at 6 months) the intervention and at a 28 months follow-up. We expected particularly the vocal intervention to promote phonological development, evidenced by enhanced speech-sound MMRs and their fast maturation. We found enhanced positive MMR amplitudes in the vocal music listening intervention group after but not prior to the intervention. Other music activities reported by parents did not differ between the three groups, indicating that the group effects were attributable to the intervention. The results speak for the use of vocal music in early infancy to support speech processing and subsequent language development in infants at developmental risk.

Research Highlights

• Dyslexia-risk infants were pseudo-randomly assigned to a vocal or instrumental music listening intervention at home from birth to 6 months of age.
• Neural mismatch responses (MMRs) to speech-sound changes were enhanced in the vocal music intervention group after but not prior to the intervention.
• Even passive vocal music listening in early infancy can support phonological development known to be deficient in dyslexia-risk.

     

Infants' ability to categorise on the basis of rhyme

Two experiments are described, which investigated 7 - to 13-month-old infants' abilities to categorise syllables according to their ending sounds, or rhymes. Using the Conditioned Headturn (CHT) Procedure, infants were conditioned to turn their head when one set of rhyming CVCs changed to another set of rhyming CVCs. Even the 7 -month-old infants demonstrated an ability to categorise according to rimes. The infants could be separated into three different groups: those who conditioned but did not succeed in a rhyming task; those who succeeded at one rhyming task but not a second; and those infants who succeeded on two rhyming tasks. The infants in the second group were showing an early sensitivity to rhyme. However, they appeared to be learning a very specific rule, listening only for one category of rhyme. The third group of infants was able to extend the initial rule they learned to include new rhymes. This group learned not only to highlight one particular rhyme, but were also able to abstract the previously learned rule to new rhymes, thereby demonstrating a higher level of sophistication in their categorisation of rhymes. These results are discussed in relation to the ontogeny of language learning, and work demonstrating a relationship between rhyming ability and competence in reading and writing.     

Speaker identification using multi-modal i-vector approach for varying length speech in voice interactive systems

The development in the interface of smart devices has lead to voice interactive systems. An additional step in this direction is to enable the devices to recognize the speaker. But this is a challenging task because the interaction involves short duration speech utterances. The traditional Gaussian mixture models (GMM) based systems have achieved satisfactory results for speaker recognition only when the speech lengths are sufficiently long. The current state-of-the-art method utilizes i-vector based approach using a GMM based universal background model (GMM-UBM). It prepares an i-vector speaker model from a speaker’s enrollment data and uses it to recognize any new test speech. In this work, we propose a multi-model i-vector system for short speech lengths. We use an open database THUYG-20 for the analysis and development of short speech speaker verification and identification system. By using an optimum set of mel-frequency cepstrum coefficients (MFCC) based features we are able to achieve an equal error rate (EER) of 3.21% as compared to the previous benchmark score of EER 4.01% on the THUYG-20 database. Experiments are conducted for speech lengths as short as 0.25 s and the results are presented. The proposed method shows improvement as compared to the current i-vector based approach for shorter speech lengths. We are able to achieve improvement of around 28% even for 0.25 s speech samples. We also prepared and tested the proposed approach on our own database with 2500 speech recordings in English language consisting of actual short speech commands used in any voice interactive system.     

In search of a learning model

While the four commentaries reflect a range of different perspectives on my target paper (Vihman, 2017), all basically accept the overall approach, which has been central to my research for 30 years. Each commentary proposes ways of deepening aspects of the ideas expressed or points out limitations and potential areas in which elaboration would be useful. This response takes up each commentary in turn.