Lending a hand to signed language acquisition: Enactment and iconicity enhance sign recall in hearing adult American Sign Language learners

Abstract

Evidence over the last 15 years has suggested that dual (imagery and verbal) coding explanations of concreteness effects in memory for word lists do not generalise well to memory for sentences and paragraphs. In contrast, an alternative framework based on relative differences in relational and distinctive processing has been shown to account for the effects of imagery and concreteness in these contexts and others. This paper describes recent research on free and cued recall of word lists and evaluates it with respect to the two models. The evidence suggests that whereas dual processing systems may be involved in the encoding of verbal materials, dual memory codes are insufficient to explain concreteness effects in recall. Better memory for high-as compared to low-imagery words depends on the use of paradigms that facilitate inter-item relational processing, independent of whether or not imagery is involved.     

Extending the classical view of representation

Representation has always been a central part of models in cognitive science, but this idea has come under attack. Researchers advocating the alternative approaches of perceptual symbol systems, situated action, embodied cognition, and dynamical systems have argued against central assumptions of the classical representational approach to mind. We review the core assumptions of the representational view and these four suggested alternatives. We argue that representation should remain a core part of cognitive science, but that the insights from these alternative approaches must be incorporated into models of cognitive processing.     

Perception of auditory motion affects language processing

Previous reports have demonstrated that the comprehension of sentences describing motion in a particular direction (toward, away, up, or down) is affected by concurrently viewing a stimulus that depicts motion in the same or opposite direction. We report 3 experiments that extend our understanding of the relation between perception and language processing in 2 ways. First, whereas most previous studies of the relation between perception and language processing have focused on visual perception, our data show that sentence processing can be affected by the concurrent processing of auditory stimuli. Second, it is shown that the relation between the processing of auditory stimuli and the processing of sentences depends on whether the sentences are presented in the auditory or visual modality.     

The role of embodied intention in early lexical acquisition

We examine the influence of inferring interlocutors' referential intentions from their body movements at the early stage of lexical acquisition. By testing human participants and comparing their performances in different learning conditions, we find that those embodied intentions facilitate both word discovery and word-meaning association. In light of empirical findings, the main part of this article presents a computational model that can identify the sound patterns of individual words from continuous speech, using nonlinguistic contextual information, and employ body movements as deictic references to discover word-meaning associations. To our knowledge, this work is the first model of word learning that not only learns lexical items from raw multisensory signals to closely resemble infant language development from natural environments, but also explores the computational role of social cognitive skills in lexical acquisition.     

Singing together in the park: Older peoples’ wellbeing and the singingscape in Guangzhou,China

The importance of adapting to later life is becoming increasingly apparent to older people as their concerns about health and wellbeing grow. Based on extensive fieldwork between 2020 and 2021 in Guangzhou, China, with older people who consider “singing together in the park” as an essential and popular everyday leisure activity, this article demonstrates how subject (older people), activity (singing), and place (park) integrate into a therapeutic space, the singingscape. Singingscape is presented in three distinct aspects: on the physical level, singingscape indicates an essential embodied experience of the connection between internal body and external environment, from which the older people can relax physically and mentally and acquire a sense of wellbeing; on the social level, singingscape fosters a positive atmosphere, where older people gain a collective sense of belonging and maintain social rhythm and social interactions with their peers; and on the imagined space level, fanciful landscapes and emotional imagination are advantageous to the wellbeing of older people. In the conceptual sense we argue that singingscape is located, experienced and integrated. Lastly, we advocate that attention should be paid to the construction of urban public spaces as vital infrastructure for older people in their everyday leisure activities.     

Does Postpartum Depression Affect Parental Embodied Mentalizing in Mothers With 4-Months old Infants?

Parental Embodied Mentalizing (PEM) regards parents’ nonverbal capacity to understand the infant’s bodily manifested mental states and adjust his or her own movements accordingly. Little is known about how mothers suffering from postpartum depression (PPD) mentalize the infant on an embodied level. The aims of the present study were to investigate whether mothers meeting criteria for a PPD diagnosis differ from non-clinical mothers in regard to their PEM capacities and whether the severity of depressive symptoms was associated with PEM in mothers meeting criteria for a PPD diagnosis compared to non-clinical mothers.10-minute long lab-based face-to-face interactions were coded with the PEM coding scheme at 4-months postpartum in mother-infant dyads with mothers meeting criteria for a PPD diagnosis (n = 29) and non-clinical mothers (n = 51).Results showed that mothers with and without a PPD diagnosis differ in their capacity to mentalize on an embodied level, but only when controlling for scores on the Edinburgh Postnatal Depression Scale (EPDS). However, more depressive symptoms as measured with the EPDS was not in itself associated with lower PEM in either group. This finding may indicate the presence of a threshold effect, i.e. that maternal PEM may be affected only when a certain degree of severity and duration in depressive symptoms is beyond a certain threshold. The importance of the findings in regard to the assessment of depression as well as more clinical perspectives are discussed.     

以身化梦：意象体现的理论、方法与技术探析

“意象体现”是由罗伯特·伯尼克依据分析心理学的理论创立的一种“梦的工作”方法,主张在介于意识与无意识之间的阈限状态中采用积极想象的方式对梦中意象进行再体验,通过对不同身体感受的觉知使无意识内容意识化来达到相应的治疗效果。意象体现理论主张,梦具有真实性,应当以主客体一致性的隐喻视角来看待梦,并且对梦的工作具有治疗的意义;对梦的工作应当遵循非解析工作与体验科学、阈限状态、共验交流、心理自居与发生转换四个关键原则。其具体技术过程包括工作状态的准备、进入阈限状态、对梦进行持续性体验、心理自居与发生转换、感觉融合与离开梦境五步。其方法沿革于催眠术、自由联想与积极想象。作为分析心理学中有关梦的一套前沿的思想理论以及临床心理治疗中一种创新性的梦的工作方式,意象体现具有广阔的学术研究及实际应用前景。     

Hearing what the body feels: auditory encoding of rhythmic movement

Phillips-Silver and Trainor (Phillips-Silver, J., Trainor, L.J., (2005). Feeling the beat: movement influences infants' rhythm perception. Science, 308, 1430) demonstrated an early cross-modal interaction between body movement and auditory encoding of musical rhythm in infants. Here we show that the way adults move their bodies to music influences their auditory perception of the rhythm structure. We trained adults, while listening to an ambiguous rhythm with no accented beats, to bounce by bending their knees to interpret the rhythm either as a march or as a waltz. At test, adults identified as similar an auditory version of the rhythm pattern with accented strong beats that matched their previous bouncing experience in comparison with a version whose accents did not match. In subsequent experiments we showed that this effect does not depend on visual information, but that movement of the body is critical. Parallel results from adults and infants suggest that the movement-sound interaction develops early and is fundamental to music processing throughout life.     

Switching between sensory and affective systems incurs processing costs

Recent models of the conceptual system hold that concepts are grounded in simulations of actual experiences with instances of those concepts in sensory-motor systems (e.g., Barsalou, 1999, 2003; Solomon & Barsalou, 2001). Studies supportive of such a viewhave shown that verifying a property of a concept in one modality, and then switching to verify a property of a different concept in a different modality generates temporal processing costs similar to the cost of switching modalities in perception. In addition to non-emotional concepts, the present experiment investigated switching costs in verifying properties of positive and negative (emotional) concepts. Properties of emotional concepts were taken from vision, audition, and the affective system. Parallel to switching costs in neutral concepts, the study showed that for positive and negative concepts, verifying properties from different modalities produced processing costs such that reaction times were longer and error rates were higher. Importantly, this effect was observed when switching from the affective system to sensory modalities, and vice-versa. These results support the embodied cognition view of emotion in humans.