A review of literature on the link between action observation and action language: advancing a shared semantic theory

Understanding each other is a core concept of social cohesion and, consequently, has immense value in human society. Importantly, shared information leading to cohesion can come from two main sources: observed action and/or language (word) processing. In this paper, we propose a theoretical framework for the link between action observation and action verb processing. Based on the activation of common semantic representations of actions through semantic resonance, this model can account for the neurophysiological, behavioral and neuropsychological domains in the link between action observation and language. Semantic resonance is hypothesized to play a role beyond that of the mere observation of others and can benefit future studies trying to connect action production and language.     

外显与内隐刻板印象的分布式表征及其激活过程——基于认知神经科学视角的探索

刻板印象是人们有关群体的行为特征与特质属性信念化的认识, 它多以语义图式形式存储于长时记忆中。依据激活过程中意识参与程度的不同, 刻板印象具有内隐和外显两种表现型。不同于双加工理论“自动激活+认知控制”的研究视角, 本项目计划从内隐/外显记忆的多重记忆系统模型出发, 试图检验内隐与外显刻板印象在表征机制和激活过程上的差异。现有的多重记忆系统模型虽能解释内隐和外显刻板印象在记忆存储与提取上的机制差别, 但却无法阐释二者语义表征带有的心理理论特性以及二者的认知控制过程。有鉴于此, 本项目拟吸收“镜像系统−心理化系统”模型和双加工理论各自在特质与信念加工以及刻板印象认知控制上的理论优势, 深入探索内隐和外显刻板印象的分布式表征机制。借助ERP技术的时间过程优势和fMRI技术的脑区动态因果建模优势, 研究结果将最终揭示刻板印象分布式语义表征的动态加工机制。     

False recognition of abstract versus common objects in older and younger adults: testing the semantic categorization account

Older adults often demonstrate higher levels of false recognition than do younger adults. However, in experiments using novel shapes without preexisting semantic representations, this age-related elevation in false recognition was found to be greatly attenuated. Two experiments tested a semantic categorization account of these findings, examining whether older adults show especially heightened false recognition if the stimuli have preexisting semantic representations, such that semantic category information attenuates or truncates the encoding or retrieval of item-specific perceptual information. In Experiment 1, ambiguous shapes were presented with or without disambiguating semantic labels. Older adults showed higher false recognition when labels were present but not when labels were never presented. In Experiment 2, older adults showed higher false recognition for concrete but not abstract objects. The semantic categorization account was supported.     

Distractor strength and selective attention in picture-naming performance

Whereas it has long been assumed that competition plays a role in lexical selection in word production (e.g., Levelt, Roelofs, & Meyer, 1999), recently Finkbeiner and Caramazza (2006) argued against the competition assumption on the basis of their observation that visible distractors yield semantic interference in picture naming, whereas masked distractors yield semantic facilitation. We examined an alternative account of these findings that preserves the competition assumption. According to this account, the interference and facilitation effects of distractor words reflect whether or not distractors are strong enough to exceed a threshold for entering the competition process. We report two experiments in which distractor strength was manipulated by means of coactivation and visibility. Naming performance was assessed in terms of mean response time (RT) and RT distributions. In Experiment 1, with low coactivation, semantic facilitation was obtained from clearly visible distractors, whereas poorly visible distractors yielded no semantic effect. In Experiment 2, with high coactivation, semantic interference was obtained from both clearly and poorly visible distractors. These findings support the competition threshold account of the polarity of semantic effects in naming.     

Semantic processing in visual word recognition: activation blocking and domain specificity

Lexical decision to a target is typically facilitated when a related prime is simply read, but is typically eliminated if subjects carry out a letter search on the prime when probe and prime appear simultaneously. Three experiments involving the addition of a task-irrelevant word to this prime search paradigm address (1) Stolz and Besner’s (1996, 1998) account in which semantic priming is eliminated because letter search on the prime instantiates an activation block between lexical and semantic levels of representation, (2) Chiappe, Smith, and Besner’s (1996) account that activation blocking is domain specific, and (3) Neely and Kahan’s (2001) claim that semantic activation is context independent and capacity free. The results are (1) consistent with the account that activation blocking is general to a level, rather than item specific, (2) consistent with the account that activation blocking is domain specific, and (3) inconsistentwith the claim that semantic activation is context independent and capacity free.     

Dynamic search and working memory in social recall

What are the mechanisms underlying search in social memory (e.g., remembering the people one knows)? Do the search mechanisms involve dynamic local-to-global transitions similar to semantic search, and are these transitions governed by the general control of attention, associated with working memory span? To find out, we asked participants to recall individuals from their personal social networks and measured each participant's working memory capacity. Additionally, participants provided social-category and contact-frequency information about the recalled individuals as well as information about the social proximity among the recalled individuals. On the basis of these data, we tested various computational models of memory search regarding their ability to account for the patterns in which participants recalled from social memory. Although recall patterns showed clustering based on social categories, models assuming dynamic transitions between representations cued by social proximity and frequency information predicted participants' recall patterns best-no additional explanatory power was gained from social-category information. Moreover, individual differences in the time between transitions were positively correlated with differences in working memory capacity. These results highlight the role of social proximity in structuring social memory and elucidate the role of working memory for maintaining search criteria during search within that structure.     

Individual and developmental differences in semantic priming: empirical and computational support for a single-mechanism account of lexical processing

Existing accounts of single-word semantic priming phenomena incorporate multiple mechanisms, such as spreading activation, expectancy-based processes, and postlexical semantic matching. The authors provide empirical and computational support for a single-mechanism distributed network account. Previous studies have found greater semantic priming for low- than for high-frequency target words as well as inhibition following unrelated primes only at long stimulus-onset asynchronies (SOAs). A series of experiments examined the modulation of these effects by individual differences in age or perceptual ability. Third-grade, 6th-grade, and college students performed a lexical-decision task on high- and low-frequency target words preceded by related, unrelated, and nonword primes. Greater priming for low-frequency targets was exhibited only by participants with high perceptual ability. Moreover, unlike the college students, the children showed no inhibition even at the long SOA. The authors provide an account of these results in terms of the properties of distributed network models and support this account with an explicit computational simulation.     

Conceptual structure and the structure of concepts: a distributed account of category-specific deficits

We present a new account of the fine-grained structure of semantic categories derived from neuropsychological, behavioral, and developmental data. The account places theoretical emphasis on the functions of the referents of concepts. We claim (i) that the distinctiveness of functional features correlated with perceptual features varies across semantic domains; and (ii) that category structure emerges from the complex interaction of these variables. The representational assumptions that follow from these claims make strong predictions about what types of semantic information are preserved in patients showing category-specific deficits following brain damage. These claims are illustrated with a connectionist simulation which, when damaged, shows patterns of preservation of distinctive and shared functional and perceptual information which varies across semantic domains. The data model both dissociations between knowledge for artifacts and for living things and recent neuropsychological evidence concerning the robustness of functional information in the representation of concepts.     

How semantic memory structure and intelligence contribute to creative thought: a network science approach

The associative theory of creativity states that creativity is associated with differences in the structure of semantic memory, whereas the executive theory of creativity emphasises the role of top-down control for creative thought. For a powerful test of these accounts, individual semantic memory structure was modelled with a novel method based on semantic relatedness judgements and different criteria for network filtering were compared. The executive account was supported by a correlation between creative ability and broad retrieval ability. The associative account was independently supported, when network filtering was based on a relatedness threshold, but not when it was based on a fixed edge number or on the analysis of weighted networks. In the former case, creative ability was associated with shorter average path lengths and higher clustering of the network, suggesting that the semantic networks of creative people show higher small-worldness.     

Semantic minimalism and the “miracle of communication”

According to semantic minimalism, context-invariant minimal semantic propositions play an essential role in linguistic communication. This claim is key to minimalists’ argument against semantic contextualism: if there were no such minimal semantic propositions, and semantic content varied widely with shifts in context, then it would be “miraculous” if communication were ever to occur. This paper offers a critical examination of the minimalist account of communication, focusing on a series of examples where communication occurs without a minimal semantic proposition shared between speaker and hearer. The only way for minimalists to respond to these examples is by restricting the scope of their account to intra-lingual communication. It can then be shown (1) that the minimalist’s notion of a language shrinks to a point, such that practically no instances of communication will fall under that account, and (2) that the retreat to intra-lingual communication is in any case self-defeating, since the only way for minimalists to account for the individuation of languages is by resort to precisely the kinds of contextual considerations they abjured in the first place. In short, if, as minimalists allege, contextualism founders because it renders communication contingent on speaker and hearer sharing a context, it can now be seen that minimalism faces a parallel problem because it renders communication contingent on speaker and hearer sharing a language. I end by arguing that the possibility of communication cannot, as minimalists assume, be grounded in shared semantic conventions; rather, successful communication must precede the establishment of any particular set of semantic conventions.     

Type-specific proactive interference in patients with semantic and phonological STM deficits

Prior neuropsychological evidence suggests that semantic and phonological components of short-term memory (STM) are functionally and neurologically distinct. The current paper examines proactive interference (PI) from semantic and phonological information in two STM-impaired patients, DS (semantic STM deficit) and AK (phonological STM deficit). In Experiment 1 probe recognition tasks with open and closed sets of stimuli were used. Phonological PI was assessed using nonword items, and semantic and phonological PI was assessed using words. In Experiment 2 phonological and semantic PI was elicited by an item recognition probe test with stimuli that bore phonological and semantic relations to the probes. The data suggested heightened phonological PI for the semantic STM patient, and exaggerated effects of semantic PI in the phonological STM case. The findings are consistent with an account of extremely rapid decay of activated type-specific representations in cases of severely impaired phonological and semantic STM.     

Neural correlates of three cognitive processes involved in theory of mind and discourse comprehension

Neuroimaging studies have found that theory of mind (ToM) and discourse comprehension involve similar brain regions. These brain regions may be associated with three cognitive components that are necessarily or frequently involved in ToM and discourse comprehension, including social concept representation and retrieval, domain-general semantic integration, and domain-specific integration of social semantic contents. Using fMRI, we investigated the neural correlates of these three cognitive components by exploring how discourse topic (social/nonsocial) and discourse processing period (ending/beginning) modulate brain activation in a discourse comprehension (and also ToM) task. Different sets of brain areas showed sensitivity to discourse topic, discourse processing period, and the interaction between them, respectively. The most novel finding was that the right temporoparietal junction and middle temporal gyrus showed sensitivity to discourse processing period only during social discourse comprehension, indicating that they selectively contribute to domain-specific semantic integration. Our finding indicates how different domains of semantic information are processed and integrated in the brain and provides new insights into the neural correlates of ToM and discourse comprehension.     

Dudman and the Plans of Mice and Men

V.H. Dudman has argued that a better semantic account of the conditional emerges from placing grammar 'in the driver's seat'. His account of their grammar identifies two main categories, which differ from those postulated by traditional theorists, and which he claims correspond to two very different and deep-rooted styles of thought. I show that it is unlikely that a perfect match exists between styles of thought and grammatical categories in the way that Dudman postulates. I consider arguments by Dale and Edgington in this context. More importantly, however, I also show that even if there were a perfect match, Dudman's account would still obscure semantic similarities between 'if'-sentences which are arguably of greater importance than the ones he highlights. This, I suggest, has implications extending far beyond Dudman's work.     

Radical quotation and real repetition

In this essay I argue for a constructivist account of the entities composing the object languages of Davidsonian truth theories and a quotational account of the reference from metalinguistic expressions to interpreted utterances. I claim that ‘radical quotation’ requires an ontology of repeatable events with strong similarities to Derrida's account of iterable events. In part one I summarise Davidson's account of interpretation and Olav Gjelsivk's arguments to the effect that the syntactic individuation of linguistic objects is only workable if interpreters make richer assumptions about semantic properties than Davidson can tolerate. In part two I show that the objectivist account of syntactic objects which Gjelsivk's arguments presuppose is incompatible with one corollary of Davidsonian semantic indeterminacy: namely, the relativity of language to interpretative scheme. In place of this an account of radical interpretation is presented in which a quotational theory of metalinguistic reference furnishes the requisite relativity. In part three I argue that this account requires that particular utterance events must be repeatable to be radically quotable and give reasons why particularity and repeatability are not incompatible.     

Semantic interference in picture naming during dual-task performance does not vary with reading ability

Previous dual-task studies examining the locus of semantic interference of distractor words in picture naming have obtained diverging results. In these studies, participants manually responded to tones and named pictures while ignoring distractor words (picture–word interference, PWI) with varying stimulus onset asynchrony (SOA) between tone and PWI stimulus. Whereas some studies observed no semantic interference at short SOAs, other studies observed effects of similar magnitude at short and long SOAs. The absence of semantic interference in some studies may perhaps be due to better reading skill of participants in these than in the other studies. According to such a reading-ability account, participants’ reading skill should be predictive of the magnitude of their interference effect at short SOAs. To test this account, we conducted a dual-task study with tone discrimination and PWI tasks and measured participants’ reading ability. The semantic interference effect was of similar magnitude at both short and long SOAs. Participants’ reading ability was predictive of their naming speed but not of their semantic interference effect, contrary to the reading ability account. We conclude that the magnitude of semantic interference in picture naming during dual-task performance does not depend on reading skill.     

Knowledge of object manipulation and object function: dissociations in apraxic and nonapraxic subjects

An influential account of selective semantic deficits posits that visual features are heavily weighted in the representations of animals, whereas information about function is central in the representations of tools (e.g., Warrington & Shallice, 1984 ). An alternative account proposes that information about all types of objects-animate and inanimate alike-is represented in a distributed semantic architecture by verbal-propositional, tactile, visual, and proprioceptive-motor nodes, reflecting the degree to which these systems were activated when the knowledge was acquired (e.g., Allport, 1985 ). We studied a group of left hemisphere chronic stroke patients, some of whom were apraxic, with measures of declarative tool and animal knowledge, body part knowledge, and function and manipulation knowledge of artifacts. Apraxic (n=7) and nonapraxic (n=6) subjects demonstrated a double dissociation of performance on tests of tool and animal knowledge, suggesting that the apraxic group was not simply more severely impaired overall. Apraxics were relatively impaired in manipulation knowledge, whereas nonapraxics tended to be relatively impaired in function knowledge. Apraxics were also more impaired with body parts than nonapraxics. The association of gestural praxis, tool knowledge, body part knowledge, and manipulation knowledge suggests a coherent basis for the organization of semantic artifact knowledge in frontoparietal cortical regions specialized for sensorimotor functions, and thus provides support for the distributed architecture account of the semantic system.     

Examining the lag effect under incidental encoding: Contributions of semantic priming and reminding

Memory is better when repeated learning events are spaced than when they are massed (spacing effect), as well as when material is processed semantically than when it is processed graphemically (levels-of-processing effect). Examination of the relationship between levels of processing and spacing for both deeply and shallowly encoded items has shown a spacing effect for items processed deeply, but not shallowly. A semantic priming account of spacing was proposed to explain the interaction between levels of processing and spacing on memory. The current study manipulated levels of processing and the amount of spacing (lag) that occurred between repetitions of items that were incidentally encoded. Results from Experiments 1A and 1B revealed lag effects in test performance when items were deeply and shallowly encoded. Although these findings are inconsistent with a semantic priming account, they can be interpreted within a reminding account, which is explored in Experiment 2. Results from the second experiment indicate that bringing reminding under conscious control benefited items that were presented at a long lag but not at a shorter lag. Together, this study provides evidence that is difficult to accommodate with a semantic priming account of spacing and instead provides additional support for a reminding account suggesting that automatic and controlled processes may both underlie the reminding process.     

Different brain mechanisms between stereotype activation and application: evidence from an ERP study

Stereotyping involves two processes in which first, social stereotypes are activated (stereotype activation), and then, stereotypes are applied to given targets (stereotype application). Previous behavioral studies have suggested that these two processes are independent of each other and may have different mechanisms. As few psychophysiological studies have given an integrated account of these stages in stereotyping so far, this study utilized a trait categorization task in which event-related potentials (ERPs) were used to explore the brain mechanisms associated with the processes of stereotype activation and its application. The behavioral (reaction time) and electrophysiological data showed that stereotype activation and application were elicited respectively in an affective valence identification subtask and in a semantic content judgment subtask. The electrophysiological results indicated that the categorization processes involved in stereotype activation to quickly identify stereotypic and nonstereotypic information were quite different from those involved in the application. During the process of stereotype activation, a P2 and N2 effect was observed, indicating that stereotype activation might be facilitated by an early attentional bias. Also, a late positive potential (LPP) was elicited, suggesting that social expectancy violation might be involved. During the process of the stereotype application, electrophysiological data showed a P2 and P3 effect, indicating that stereotype application might be related to the rapid social knowledge identification in semantic representation and thus may be associated with an updating of existing stereotypic contents or a motivation to resolve the inconsistent information. This research strongly suggested that different mechanisms are involved in the stereotype activation and application processes.     

Social Network Size and Cognitive Functioning in Middle-Aged Adults: Cross-Sectional and Longitudinal Associations

The objective of the present study was to examine relations between social network size and three cognitive abilities (episodic memory, semantic memory, visuospatial ability) in middle-aged adults. We analyzed cross-sectional data on social network size and cognitive functioning that were available for 804 participants aged 40–60 years. In addition, we examined 5- and 10-year follow-up measurements of cognitive functioning that were available for 604 and 255 participants, respectively. Cross-sectional analyses revealed a positive association between social network size and each of the three cognitive abilities. Baseline network size was positively related to 5-year changes in semantic memory, and to 10-year changes in semantic as well as episodic memory, but was unrelated to changes in visuospatial performance. A minor portion of the sample (n = 131) had 10-year follow-up data on network size. Cross-lagged panel correlations revealed that baseline network size was associated with follow-up measurement in cognitive functioning (episodic memory, semantic memory), whereas baseline cognitive performance was unrelated to future network size. Together, the results demonstrate a small but positive relation between network size and declarative memory abilities, in line with models proposing a cognitive reserve built up by factors such as the increased cognitive stimulation associated with a more extensive social network.     

Speech-associated gestures, Broca's area, and the human mirror system

Speech-associated gestures are hand and arm movements that not only convey semantic information to listeners but are themselves actions. Broca's area has been assumed to play an important role both in semantic retrieval or selection (as part of a language comprehension system) and in action recognition (as part of a "mirror" or "observation-execution matching" system). We asked whether the role that Broca's area plays in processing speech-associated gestures is consistent with the semantic retrieval/selection account (predicting relatively weak interactions between Broca's area and other cortical areas because the meaningful information that speech-associated gestures convey reduces semantic ambiguity and thus reduces the need for semantic retrieval/selection) or the action recognition account (predicting strong interactions between Broca's area and other cortical areas because speech-associated gestures are goal-direct actions that are "mirrored"). We compared the functional connectivity of Broca's area with other cortical areas when participants listened to stories while watching meaningful speech-associated gestures, speech-irrelevant self-grooming hand movements, or no hand movements. A network analysis of neuroimaging data showed that interactions involving Broca's area and other cortical areas were weakest when spoken language was accompanied by meaningful speech-associated gestures, and strongest when spoken language was accompanied by self-grooming hand movements or by no hand movements at all. Results are discussed with respect to the role that the human mirror system plays in processing speech-associated movements.