BOLD response to motion verbs in left posterior middle temporal gyrus during story comprehension

A primary focus within neuroimaging research on language comprehension is on the distribution of semantic knowledge in the brain. Studies have shown that the left posterior middle temporal gyrus (LPMT), a region just anterior to area MT/V5, is important for the processing of complex action knowledge. It has also been found that motion verbs cause activation in LPMT. In this experiment we investigated whether this effect could be replicated in a setting resembling real life language comprehension, i.e. without any overt behavioral task during passive listening to a story. During fMRI participants listened to a recording of the story “The Ugly Duckling”. We incorporated a nuisance elimination regression approach for factoring out known nuisance variables both in terms of physiological noise, sound intensity, linguistic variables and emotional content. Compared to the remaining text, clauses containing motion verbs were accompanied by a robust activation of LPMT with no other significant effects, consistent with the hypothesis that this brain region is important for processing motion knowledge, even during naturalistic language comprehension conditions.     

From demonstration to theory in embodied language comprehension: A review

Recent findings in psychology, psycholinguistics, and neuroscience present a challenge to current amodal theories by suggesting that cognitive states are not disembodied in language comprehension. Accumulating behavioral evidence supporting this view is reviewed from research on processing of language describing concrete and abstract concepts. The extant embodied theories that support either a strong or a moderate embodied view are then presented, as are the perspectives that define how the researchers discuss the role of sensory-motor grounding in language processing. The article concludes by discussing several lines of research that might help distinguish between various theoretical approaches and resolve some of the fundamental issues that fuel much of the debate in the field.     

Abstract concepts,compositionality, and the contextualism-invariantism debate

Invariantists argue that the notion of concept in psychology should be reserved for knowledge that is retrieved in a context-insensitive manner. Contextualists argue that concepts are to be understood in terms of context-sensitive ad hoc constructions. I review the central empirical evidence for and against both views and show that their conclusions are based on a common mischaracterization of both theories. When the difference between contextualism and invariantism is properly understood, it becomes apparent that the way the question of stability is currently investigated will not lead to a consensus. Instead of focusing directly on stability, we should turn our attention to other desiderata on a theory of concepts. In particular, I show that invariantism, but not contextualism, fails to account for compositionality and abstract concepts.     

The spatial mapping of concepts in English and Mandarin

ABSTRACT

English speakers have been shown to map abstract concepts in space, which occurs on both the vertical and horizontal dimensions. For example, words such as God are associated with up and right spatial locations, and words such as Satan with down and left. If the tendency to map concepts in space is a universal property of human cognition, then it is likely that such mappings may be at least partly culturally-specific, since many concepts are themselves language-specific and therefore cultural conventions. Here we investigated whether Mandarin speakers report spatial mapping of concepts, and how these mappings compare with English speakers (i.e. are words with the same meaning associated with the same spatial locations). Across two studies, results showed that both native English and Mandarin speakers reported spatial mapping of concepts, and that the distribution of mappings was highly similar for the two groups. Theoretical implications are discussed.     

The role of language in acquiring object kind concepts in infancy

Four experiments investigated whether 9-month-old infants could use the presence of labels to help them establish a representation of two distinct objects in a complex object individuation task. We found that the presence of two distinct labels facilitated object individuation, but the presence of one label for both objects, two distinct tones, two distinct sounds, or two distinct emotional expressions did not. These findings suggest that language may play an important role in the acquisition of sortal/object kind concepts in infancy: words may serve as "essence placeholders". Implications for the relationship between language and conceptual development are discussed.     

Unintended embodiment of concepts into percepts: Sensory activation boosts attention for same-modality concepts in the attentional blink paradigm

This study shows that sensory priming facilitates reports of same-modality concepts in an attentional blink paradigm. Participants had to detect and report two target words (T1 and T2) presented for 53 ms each among a series of nonwords distractors at a frequency of up to 19 items per second. SOA between target words was set to 53 ms or 213 ms, with reduced attention expected for T2 under the longer SOA (attentional blink) and for T1 under the shorter SOA (lag-1 sparing). These effects were found but reduced when the sensory modality of the concepts matched that of a sensory stimulation occurring prior to the detection trial. Hence, sensory activation increased report for same-modality concepts. This finding reveals that grounded cognition effects (1) are involved in conceptual processing as soon as a word has reached the point of lexical identification and (2) occur independent of intentional access to sensory properties of concepts.     

Posterior superior temporal cortex connectivity is related to social communication in toddlers

The second year of life is a time when social communication skills typically develop, but this growth may be slower in toddlers with language delay. In the current study, we examined how brain functional connectivity is related to social communication abilities in a sample of 12-24 month-old toddlers including those with typical development (TD) and those with language delays (LD). We used an a-priori, seed-based approach to identify regions forming a functional network with the left posterior superior temporal cortex (LpSTC), a region associated with language and social communication in older children and adults. Social communication and language abilities were assessed using the Communication and Symbolic Behavior Scales (CSBS) and Mullen Scales of Early Learning. We found a significant association between concurrent CSBS scores and functional connectivity between the LpSTC and the right posterior superior temporal cortex (RpSTC), with greater connectivity between these regions associated with better social communication abilities. However, functional connectivity was not related to rate of change or language outcomes at 36 months of age. These data suggest an early marker of low communication abilities may be decreased connectivity between the left and right pSTC. Future longitudinal studies should test whether this neurobiological feature is predictive of later social or communication impairments.     

Extending the classical view of representation

Representation has always been a central part of models in cognitive science, but this idea has come under attack. Researchers advocating the alternative approaches of perceptual symbol systems, situated action, embodied cognition, and dynamical systems have argued against central assumptions of the classical representational approach to mind. We review the core assumptions of the representational view and these four suggested alternatives. We argue that representation should remain a core part of cognitive science, but that the insights from these alternative approaches must be incorporated into models of cognitive processing.     

The flexibility of association between temporal concepts and physical space in the Japanese language

Previous studies have indicated that temporal concepts such as the past and future are associated with horizontal (left–right) space. This association has been interpreted as reflecting left‐to‐right writing systems. The Japanese language, however, is written both horizontally and vertically and, when texts are presented vertically, the sequence of columns runs from right to left. This study examines whether the associations between time and space are changed by the direction of the character strings using a word categorization task. Consistent with previous studies, response times and error rates indicated left‐past and right‐future associations when participants read words presented horizontally. On the other hand, response times indicated the opposite (i.e., left‐future and right‐past associations) when participants read words presented vertically. These results suggest that temporal concepts are not associated with one's body or physical space in an inflexible manner, but rather the associations can flexibly change through experience.     

The representation of category typicality in the frontal cortex and its cross-linguistic variations

When asked to judge the membership of typical (e.g., car) vs. atypical (e.g., train) pictures of a category (e.g., vehicle), native English (N = 18) and native Chinese speakers (N = 18) showed distinctive patterns of brain activity despite showing similar behavioral responses. Moreover, these differences were mainly due to the amount and pervasiveness of category information linguistically embedded in the everyday names of the items in the respective languages, with important differences across languages in how pervasive category labels are embedded in item-level terms. Nonetheless, the left inferior frontal gyrus and the bilateral medial frontal gyrus are the most consistent neural correlates of category typicality that persist across languages and linguistic cues. These data together suggest that both cross- and within-language differences in the explicitness of category information have strong effects on the nature of categorization processes performed by the brain.     

Attentional Capture in Younger and Older Adults

The present study was designed to examine age-related differences in attentional capture. In the first experiment, participants identified targets defined either by an abrupt onset or by color difference. Prior to the presentation of the targets, onset or color cues were presented. It was found that color cues, but not onset cues, captured attention for color targets for both younger and older adults. It was also found, however, that onset and color cues captured attention for onset targets for both age groups. Moreover, while both types of cues yielded equivalent attentional capture effects with the younger adults, onset cues yielded greater effects for the older adults. The second experiment, using only younger adults, replicated the pattern of results found with the younger adults in the first experiment. The findings from these two experiments provide only partial support for the contingent involuntary orienting hypothesis, which suggests that only cues that share critical features with targets will capture attention. Moreover, the results also indicate that there are age-related differences in attentionalcapture.     

The role of embodied intention in early lexical acquisition

We examine the influence of inferring interlocutors' referential intentions from their body movements at the early stage of lexical acquisition. By testing human participants and comparing their performances in different learning conditions, we find that those embodied intentions facilitate both word discovery and word-meaning association. In light of empirical findings, the main part of this article presents a computational model that can identify the sound patterns of individual words from continuous speech, using nonlinguistic contextual information, and employ body movements as deictic references to discover word-meaning associations. To our knowledge, this work is the first model of word learning that not only learns lexical items from raw multisensory signals to closely resemble infant language development from natural environments, but also explores the computational role of social cognitive skills in lexical acquisition.     

Neural evidence for the interplay between language, gesture, and action: a review

Co-speech gestures embody a form of manual action that is tightly coupled to the language system. As such, the co-occurrence of speech and co-speech gestures is an excellent example of the interplay between language and action. There are, however, other ways in which language and action can be thought of as closely related. In this paper we will give an overview of studies in cognitive neuroscience that examine the neural underpinnings of links between language and action. Topics include neurocognitive studies of motor representations of speech sounds, action-related language, sign language and co-speech gestures. It will be concluded that there is strong evidence on the interaction between speech and gestures in the brain. This interaction however shares general properties with other domains in which there is interplay between language and action.     

Role of frontal cortex in attentional capture by singleton distractors

The role of frontal cortex in selective attention to visual distractors was examined in an attentional capture task in which participants searched for a unique shape in the presence or absence of an additional colour singleton distractor. The presence of the additional singleton was associated with slower behavioural responses to the shape target, and a greater neural signal in inferior frontal gyrus. To investigate the involvement of cognitive control functions of the frontal lobes in the capture of attention by the additional singletons, we measured the effect of the additional singleton in a context of either low or high working memory load. Whereas behavioural capture was unaffected by the level of load on working memory, greater activity associated with the presence of the additional singleton was observed in inferior frontal gyrus, but only under high load. This effect was greater in participants who experienced greater capture. We argue that the role of inferior frontal gyrus in selective attention is to detect potential sources of distraction.     

Understanding action language modulates oscillatory mu and beta rhythms in the same way as observing actions

The mu rhythms (8–13 Hz) and the beta rhythms (15 up to 30 Hz) of the EEG are observed in the central electrodes (C3, Cz and C4) in resting states, and become suppressed when participants perform a manual action or when they observe another’s action. This has led researchers to consider that these rhythms are electrophysiological markers of the motor neuron activity in humans. This study tested whether the comprehension of action language, unlike abstract language, modulates mu and low beta rhythms (15–20 Hz) in a similar way as the observation of real actions. The log-ratios were calculated for each oscillatory band between each condition and baseline resting periods. The results indicated that both action language and action videos caused mu and beta suppression (negative log-ratios), whereas abstract language did not, confirming the hypothesis that understanding action language activates motor networks in the brain. In other words, the resonance of motor areas associated with action language is compatible with the embodiment approach to linguistic meaning.     

Lending a hand to signed language acquisition: Enactment and iconicity enhance sign recall in hearing adult American Sign Language learners

Abstract

Evidence over the last 15 years has suggested that dual (imagery and verbal) coding explanations of concreteness effects in memory for word lists do not generalise well to memory for sentences and paragraphs. In contrast, an alternative framework based on relative differences in relational and distinctive processing has been shown to account for the effects of imagery and concreteness in these contexts and others. This paper describes recent research on free and cued recall of word lists and evaluates it with respect to the two models. The evidence suggests that whereas dual processing systems may be involved in the encoding of verbal materials, dual memory codes are insufficient to explain concreteness effects in recall. Better memory for high-as compared to low-imagery words depends on the use of paradigms that facilitate inter-item relational processing, independent of whether or not imagery is involved.     

生成认知与具身机能主义的比较——表征的取舍

在具身认知不同的思潮中，生成认知以其激进的观点反对表征和计算主义，可以称之为是具身认知思潮中的最为激进的一部分。另一方面，由于标准认知中表征和计算的解释力和影响力，具身认知诞生出各种不同程度上的“妥协”性理论，其中，以克拉克为代表的具身的“机能主义”为目前具身认知的主流观点。表征尽管在当前阶段中表现出强大的生命力，但依然无法在所有领域中都得到运用。随着表征的改造与发展，未来的激进具身认知工作者应该将更多的精力投入到具身认知与更多学科的融合研究中。     

Distributed processing and cortical specialization for speech and environmental sounds in human temporal cortex

Using functional MRI, we investigated whether auditory processing of both speech and meaningful non-linguistic environmental sounds in superior and middle temporal cortex relies on a complex and spatially distributed neural system. We found that evidence for spatially distributed processing of speech and environmental sounds in a substantial extent of temporal cortices. Most importantly, regions previously reported as selective for speech over environmental sounds also contained distributed information. The results indicate that temporal cortices supporting complex auditory processing, including regions previously described as speech-selective, are in fact highly heterogeneous.     

Neural correlates of metonymy resolution

Metonymies are exemplary models for complex semantic association processes at the sentence level. We investigated processing of metonymies using event-related functional magnetic resonance imaging (fMRI).During an 1.5 Tesla fMRI scan, 14 healthy subjects (12 female) read 124 short German sentences with either literal (like “Africa is arid”), metonymic (“Africa is hungry”), or nonsense (“Africa is woollen”) content. Sentences were constructed so that they obey certain grammatical, semantic, and plausibility conditions and were matched for word frequency, semantic association, length and syntactic structure. We concentrated on metonymies that were not yet fossilised; we also examined a wide variety of metonymic readings.Reading metonymies relative to literal sentences revealed signal changes in a predominantly left-lateralised fronto-temporal network with maxima in the left and right inferior frontal as well as left middle temporal gyri. Left inferior frontal activation may reflect both inference processes and access to world knowledge during metonymy resolution.