Linguistic Distributional Knowledge and Sensorimotor Grounding both Contribute to Semantic Category Production

The human conceptual system comprises simulated information of sensorimotor experience and linguistic distributional information of how words are used in language. Moreover, the linguistic shortcut hypothesis predicts that people will use computationally cheaper linguistic distributional information where it is sufficient to inform a task response. In a pre-registered category production study, we asked participants to verbally name members of concrete and abstract categories and tested whether performance could be predicted by a novel measure of sensorimotor similarity (based on an 11-dimensional representation of sensorimotor strength) and linguistic proximity (based on word co-occurrence derived from a large corpus). As predicted, both measures predicted the order and frequency of category production but, critically, linguistic proximity had an effect above and beyond sensorimotor similarity. A follow-up study using typicality ratings as an additional predictor found that typicality was often the strongest predictor of category production variables, but it did not subsume sensorimotor and linguistic effects. Finally, we created a novel, fully grounded computational model of conceptual activation during category production, which best approximated typical human performance when conceptual activation was allowed to spread indirectly between concepts, and when candidate category members came from both sensorimotor and linguistic distributional representations. Critically, model performance was indistinguishable from typical human performance. Results support the linguistic shortcut hypothesis in semantic processing and provide strong evidence that both linguistic and grounded representations are inherent to the functioning of the conceptual system. All materials, data, and code are available at https://osf.io/vaq56/ .     

汉语母语者视听言语知觉发展趋势研究

6~12岁儿童、13~18岁青少年和20~30岁成人被试各30名,运用McGurk效应研究范式对汉语母语者视听言语知觉的发展趋势进行探讨。所有被试需要接受纯听和视听两种条件下的测试,其任务是出声报告自己听到的刺激。结果发现：（1）三个年龄阶段汉语母语者被试在安静听力环境下的单音节加工中都受到了视觉线索的影响,表现出了McGurk效应;（2）三个年龄阶段汉语母语者被试McGurk效应的强度存在显著差异,其受视觉言语影响的程度表现出随年龄增长而增强的发展趋势;（3）13岁以后汉语被试在视听一致下对视觉线索的依赖没有显著增强,但是在视听冲突下视觉言语的影响仍然在逐渐增强。     

Bridging ears and eyes when learning spoken words: On the effects of bilingual experience at 30 months

From the very first moments of their lives, infants selectively attend to the visible orofacial movements of their social partners and apply their exquisite speech perception skills to the service of lexical learning. Here we explore how early bilingual experience modulates children's ability to use visible speech as they form new lexical representations. Using a cross‐modal word‐learning task, bilingual children aged 30 months were tested on their ability to learn new lexical mappings in either the auditory or the visual modality. Lexical recognition was assessed either in the same modality as the one used at learning (‘same modality’ condition: auditory test after auditory learning, visual test after visual learning) or in the other modality (‘cross‐modality’ condition: visual test after auditory learning, auditory test after visual learning). The results revealed that like their monolingual peers, bilingual children successfully learn new words in either the auditory or the visual modality and show cross‐modal recognition of words following auditory learning. Interestingly, as opposed to monolinguals, they also demonstrate cross‐modal recognition of words upon visual learning. Collectively, these findings indicate a bilingual edge in visual word learning, expressed in the capacity to form a recoverable cross‐modal representation of visually learned words.     

Teaching caregivers to implement mand training using speech generating devices

Individuals with developmental disabilities often do not develop vocal repertoires, thus requiring the use of augmentative devices. Teaching caregivers to conduct communication training with their children may be one way to foster communication with their device in the natural environment. This study replicates Rosales, Stone and Rehfeldt (2009), but using an augmentative device. Behavioral skills training was used to teach caregivers to implement mand training procedures. Caregivers quickly learned to implement mand training with their children and independent mands increased from pretraining to posttraining observations for 2 out of 3 children.     

The knowledge norm of assertion in dialectical context

This paper aims to show that the Knowledge Norm of Assertion (KNA) can lead to trouble in certain dialectical contexts. Suppose a person knows that p but does not know that they know that p. They assert p in compliance with the KNA. Their interlocutor responds: ‘but do you know that p?’ It will be shown that the KNA blocks the original asserter from providing any good response to this perfectly natural follow-up question, effectively forcing them to retract p from the conversational scoreboard. This finding is not simply of theoretical interest: I will argue that the KNA would allow the retort ‘but do you know that p?’ to be weaponized in strategic communication, serving as a tool for silencing speakers without having to challenge their testimonial contributions on their own merits. Our analysis can thereby provide a new dimension to the study of epistemic injustice, as well as underscoring the importance of considering the norms governing speech acts also from the point of view of non-ideal social contexts.     

Medicalization and linguistic agency

Medicalization is the process by which conditions, for example, intellectual disability, hyperactivity in children, and posttraumatic stress disorder, become understood as medical disorders. During this process, the medical community often collectively assigns a label to a condition and consequently to those who would be said to have the disorder. We argue that there are at least two previously overlooked ways in which this linguistic practice may be wrongful, and sometimes, unjust: first, when the initial introduction of a medical label is done without the participation of those individuals who are being labelled, and second, when attempts by those individuals to renegotiate the labels are thwarted or otherwise rendered ineffective. In both cases, we argue, individuals are unfairly excluded from a linguistic practice that would be valuable for them to participate in. Furthermore, we argue that their exclusion depends in part on the authority of the medical institution to ignore their demands for participation. In making this case, we will propose the more general claim that participating in the linguistic processes of determining and renegotiating the words that will be used to describe oneself is an exercise of linguistic agency, a capacity that has both instrumental and intrinsic value.     

EARSHOT: A Minimal Neural Network Model of Incremental Human Speech Recognition

Despite the lack of invariance problem (the many-to-many mapping between acoustics and percepts), human listeners experience phonetic constancy and typically perceive what a speaker intends. Most models of human speech recognition (HSR) have side-stepped this problem, working with abstract, idealized inputs and deferring the challenge of working with real speech. In contrast, carefully engineered deep learning networks allow robust, real-world automatic speech recognition (ASR). However, the complexities of deep learning architectures and training regimens make it difficult to use them to provide direct insights into mechanisms that may support HSR. In this brief article, we report preliminary results from a two-layer network that borrows one element from ASR, long short-term memory nodes, which provide dynamic memory for a range of temporal spans. This allows the model to learn to map real speech from multiple talkers to semantic targets with high accuracy, with human-like timecourse of lexical access and phonological competition. Internal representations emerge that resemble phonetically organized responses in human superior temporal gyrus, suggesting that the model develops a distributed phonological code despite no explicit training on phonetic or phonemic targets. The ability to work with real speech is a major advance for cognitive models of HSR.     

Age-Specific Effects of Lexical–Semantic Networks on Word Production

The lexical–semantic organization of the mental lexicon is bound to change across the lifespan. Nevertheless, the effects of lexical–semantic factors on word processing are usually based on studies enrolling young adult cohorts. The current study aims to investigate to what extent age-specific semantic organization predicts performance in referential word production over the lifespan, from school-age children to older adults. In Study 1, we conducted a free semantic association task with participants from six age-groups (ranging from 10 to 80 years old) to compute measures that capture age-specific properties of the mental lexicon across the lifespan. These measures relate to lifespan changes in the Available Richness of the mental lexicon and in the lexical–semantic Network Prototypicality of concrete words. In Study 2, we used the collected data to predict performance in a picture-naming task on a new group of participants within the same age-groups as for Study 1. The results show that age-specific semantic Available Richness and Network Prototypicality affect word production speed while the semantic variables collected only in young adults do not. A richer and more prototypical semantic network across subjects from a given age-group is associated with faster word production speed. The current results indicate that age-specific semantic organization is crucial to predict lexical–semantic behaviors across the lifespan. Similarly, these results also provide cues to the understanding of the lexical–semantic properties of the mental lexicon and to lexical selection in referential tasks.