Perceptual simulations and linguistic representations have differential effects on speeded relatedness judgements and recognition memory

We examined the effect of spatial iconicity (a perceptual simulation of canonical locations of objects) and word-order frequency on language processing and episodic memory of orientation. Participants made speeded relatedness judgements to pairs of words presented in locations typical of their real-world arrangements (e.g., ceiling on top and floor on bottom). They then engaged in a surprise orientation recognition task for the word pairs. We replicated Louwerse's (2008) Louwerse, M. M. 2008. Embodied representations are encoded in language. Psychonomic Bulletin & Review, 15: 838–844. [Crossref], [PubMed], [Web of Science ®] , [Google Scholar] finding that word-order frequency has a stronger effect on semantic relatedness judgements than does spatial iconicity. This is consistent with recent suggestions that linguistic representations have a stronger impact on immediate decisions about verbal materials than do perceptual simulations. In contrast, spatial iconicity enhanced episodic memory of orientation to a greater extent than word-order frequency did. This new finding indicates that perceptual simulations have an important role in episodic memory. Results are discussed with respect to theories of perceptual representation and linguistic processing.     

The Cultural Evolution of Structured Languages in an Open‐Ended,Continuous World

Language maps signals onto meanings through the use of two distinct types of structure. First, the space of meanings is discretized into categories that are shared by all users of the language. Second, the signals employed by the language are compositional: The meaning of the whole is a function of its parts and the way in which those parts are combined. In three iterated learning experiments using a vast, continuous, open‐ended meaning space, we explore the conditions under which both structured categories and structured signals emerge ex nihilo. While previous experiments have been limited to either categorical structure in meanings or compositional structure in signals, these experiments demonstrate that when the meaning space lacks clear preexisting boundaries, more subtle morphological structure that lacks straightforward compositionality—as found in natural languages—may evolve as a solution to joint pressures from learning and communication.     

Perceptual load influences auditory space perception in the ventriloquist aftereffect

A period of exposure to trains of simultaneous but spatially offset auditory and visual stimuli can induce a temporary shift in the perception of sound location. This phenomenon, known as the ‘ventriloquist aftereffect’, reflects a realignment of auditory and visual spatial representations such that they approach perceptual alignment despite their physical spatial discordance. Such dynamic changes to sensory representations are likely to underlie the brain’s ability to accommodate inter-sensory discordance produced by sensory errors (particularly in sound localization) and variability in sensory transduction. It is currently unknown, however, whether these plastic changes induced by adaptation to spatially disparate inputs occurs automatically or whether they are dependent on selectively attending to the visual or auditory stimuli. Here, we demonstrate that robust auditory spatial aftereffects can be induced even in the presence of a competing visual stimulus. Importantly, we found that when attention is directed to the competing stimuli, the pattern of aftereffects is altered. These results indicate that attention can modulate the ventriloquist aftereffect.     

情境模型中的时间表征研究

阅读理解中情境模型的建构是当今阅读研究的热点 ,自Zwaan等人提出事件标记模型理论以来 ,很多研究者对影响情境模型建构的空间维度进行了深入的研究 ,尽管对情境模型中时间维度的研究相对缺乏 ,但仍得出了一些有价值的研究成果。本文对情境模型中时间表征的理论假设、实验研究、技术手段及主要研究结论作了介绍和评析 ,并对未来的研究方向进行了展望。     

How many fingers am I holding up? The answer depends on children's language background

Monolingual English‐speaking preschool children tend to process number gestures as unanalyzed wholes rather than use the one‐to‐one (finger‐to‐quantity) correspondence. By school age, however, children can use the one‐to‐one correspondence. The purpose of the present studies was to test whether children learn one‐to‐one correspondence through exposure to a variety of finger configurations to convey a single quantity. In Study 1, we compared children with exposure to multiple one‐to‐one configurations, that is, French‐English and German‐English bilingual children, to English monolingual children who see consistent representations. As predicted, the bilingual children performed better in interpreting unconventional number gestures. In Study 2, we compared Chinese‐English bilingual children who knew arbitrary one‐handed Chinese numbers gestures for quantities 6–10 to Chinese‐English bilingual children who did not know these gestures, as well as to monolingual English speakers. Chinese‐English bilinguals who knew the arbitrary gestures were more likely to interpret unconventional gestures arbitrarily (i.e., influenced by the written and/or Chinese gesture forms). These children did not differ from English monolinguals in the interpretation of unconventional gestures. These results are consistent with the argument that children can become sensitive to the one‐to‐one correspondence in number gestures with exposure to multiple configurations for the same quantity.     

What Is the Buzz About Iconicity? How Iconicity in Caregiver Speech Supports Children's Word Learning

One cue that may facilitate children's word learning is iconicity, or the correspondence between a word's form and meaning. Some have even proposed that iconicity in the early lexicon may serve to help children learn how to learn words, supporting the acquisition of even noniconic, or arbitrary, word–referent associations. However, this proposal remains untested. Here, we investigate the iconicity of caregivers’ speech to young children during a naturalistic free-play session with novel stimuli and ask whether the iconicity of caregivers’ speech facilitates children's learning of the noniconic novel names of those stimuli. Thirty-four 1.5-2-year-olds (19 girls; half monolingual English learners and half bilingual English-Spanish learners) participated in a naturalistic free-play task with their caregivers followed by a test of word-referent retention. We found that caregivers’ use of iconicity, particularly in utterances in which they named the novel stimuli, was associated with the likelihood that children learned that novel name. This result held even when controlling for other factors associated with word learning, such as the concreteness and frequency of words in caregiver speech. Together, the results demonstrate that iconicity not only can serve to help children identify the referent of novel words (as in previous research) but can also support their ability to retain even noniconic word-referent mappings.     

Psychological and psychophysiological effects of music intensity and lyrics on simulated urban driving

The main aim of this study was to investigate the effect of musical characteristics (i.e., presence of lyrics and loudness) in the context of simulated urban driving. Previous work has seldom isolated musical characteristics and examined these both singularly and interactively. We investigated the potentially distracting effects of processing lyrics through exposing young drivers to the same piece of music with/without lyrics and at different sound intensities (60 dBA [soft] and 75 dBA [loud]) using a counterbalanced, within-subjects design (N = 34; M_age = 22.2 years, SD = 2.0 years). Six simulator conditions were included that comprised low-intensity music with/without lyrics, high-intensity music with/without lyrics, plus two controls – ambient in-car noise and spoken lyrics. Between-subjects variables of driving style (defensive vs. assertive) and sex (women vs. men) were explored. A key finding was that the no lyrics/soft condition yielded lower affective arousal scores when compared to the other music conditions. There was no main effect of condition for HRV data (SDNN and RMSSD). Exploratory analyses showed that, for assertive drivers, NASA-TLX Performance scores were lower in the no lyrics/soft condition compared to the lyrics/loud condition. Moreover, women exhibited higher mean heart rate than men in the presence of lyrics. Although some differences emerged in subjective outcomes, these were not replicated in HRV, which was used as an objective index of emotionality. Drivers should consider the use of soft, non-lyrical music to optimise their affective state during urban driving.     

The Specificity of Sound Symbolic Correspondences in Spoken Language

Although language has long been regarded as a primarily arbitrary system, sound symbolism, or non‐arbitrary correspondences between the sound of a word and its meaning, also exists in natural language. Previous research suggests that listeners are sensitive to sound symbolism. However, little is known about the specificity of these mappings. This study investigated whether sound symbolic properties correspond to specific meanings, or whether these properties generalize across semantic dimensions. In three experiments, native English‐speaking adults heard sound symbolic foreign words for dimensional adjective pairs (big/small, round/pointy, fast/slow, moving/still) and for each foreign word, selected a translation among English antonyms that either matched or mismatched with the correct meaning dimension. Listeners agreed more reliably on the English translation for matched relative to mismatched dimensions, though reliable cross‐dimensional mappings did occur. These findings suggest that although sound symbolic properties generalize to meanings that may share overlapping semantic features, sound symbolic mappings offer semantic specificity.     

道德概念的空间形象性：语言因素和具身因素的共同作用

采用事件相关电位(ERP)技术探讨抽象道德概念的空间形象性效应, 以及语言因素和具身因素对该效应的影响机制及其加工进程。实验1检验词对空间位置对道德词对语义判断(反义程度)所产生的影响, 结果表明不符合空间形象性呈现条件(即道德-下, 不道德-上)诱发了较大的N400, 并且词对语义判断的反应时较长; 实验2检验词对语义的反义程度对道德词对空间形象性判断所产生的影响, 结果表明语义无关词对诱发了较大的N200和N700, 并且词对空间形象性判断的反应时较长。研究结果表明, 抽象道德概念的加工能够表现出空间形象性效应, 该效应由语言因素和具身因素共同塑造, 前者在概念加工过程中优先被激活并发挥持久影响, 后者仅在概念加工的中期发挥作用。