Are depictive gestures like pictures? commonalities and differences in semantic processing

Conversation is multi-modal, involving both talk and gesture. Does understanding depictive gestures engage processes similar to those recruited in the comprehension of drawings or photographs? Event-related brain potentials (ERPs) were recorded from neurotypical adults as they viewed spontaneously produced depictive gestures preceded by congruent and incongruent contexts. Gestures were presented either dynamically in short, soundless video-clips, or statically as freeze frames extracted from gesture videos. In a separate ERP experiment, the same participants viewed related or unrelated pairs of photographs depicting common real-world objects. Both object photos and gesture stimuli elicited less negative ERPs from 400 to 600 ms post-stimulus when preceded by matching versus mismatching contexts (dN450). Object photos and static gesture stills also elicited less negative ERPs between 300 and 400 ms post-stimulus (dN300). Findings demonstrate commonalities between the conceptual integration processes underlying the interpretation of iconic gestures and other types of image-based representations of the visual world.     

Integrating conceptual knowledge within and across representational modalities

Research suggests that concepts are distributed across brain regions specialized for processing information from different sensorimotor modalities. Multimodal semantic models fall into one of two broad classes differentiated by the assumed hierarchy of convergence zones over which information is integrated. In shallow models, communication within- and between-modality is accomplished using either direct connectivity, or a central semantic hub. In deep models, modalities are connected via cascading integration sites with successively wider receptive fields. Four experiments provide the first direct behavioral tests of these models using speeded tasks involving feature inference and concept activation. Shallow models predict no within-modal versus cross-modal difference in either task, whereas deep models predict a within-modal advantage for feature inference, but a cross-modal advantage for concept activation. Experiments 1 and 2 used relatedness judgments to tap participants’ knowledge of relations for within- and cross-modal feature pairs. Experiments 3 and 4 used a dual-feature verification task. The pattern of decision latencies across Experiments 1–4 is consistent with a deep integration hierarchy.     

Contribution of NIRS to the study of prefrontal cortex for verbal fluency in aging

Healthy aging is characterized by a number of changes on brain structure and function. Several neuroimaging studies have shown an age-related reduction in hemispheric asymmetry on various cognitive tasks, a phenomenon captured by Cabeza (2002) in the Hemispheric Asymmetry Reduction in Older Adults (HAROLD) model. Although this phenomenon is supported by a range of neuroimaging data on memory and inhibitory processes, there is little evidence concerning changes in hemispheric asymmetry for language processing, and particularly word retrieval, which is assessed with verbal fluency task (VFT). This study aimed to investigate the age-related changes in cerebral oxygenation in the prefrontal cortex for both letter and category VFT, varying the complexity of the criteria (i.e., degree of productivity) and using near-infrared spectroscopy (NIRS). Sixteen younger and 16 older adults participated in this study. For both VF conditions, participants were instructed to pronounce as many nouns as possible as a function of high-productivity (e.g., “animals” or “L”) or low-productivity (e.g., “flowers” or “V”) criteria. Behavioral data (i.e., accuracy responses) showed comparable performance in younger and older adults for both VF conditions. However, NIRS data showed more reduced activation (i.e., significantly reduced increase in [O₂Hb] and reduced decrease in [HHb]) in older than younger adults for both VFT. In addition, a bilateral effect was found for both groups, suggesting that VFT requires both executive and language functions. The results are discussed in the context of the current theories of aging.     

Hemispheric asymmetries in the activation and monitoring of memory errors

Previous research on the lateralization of memory errors suggests that the right hemisphere's tendency to produce more memory errors than the left hemisphere reflects hemispheric differences in semantic activation. However, all prior research that has examined the lateralization of memory errors has used self-paced recognition judgments. Because activation occurs early in memory retrieval, with more time to make a decision, other memory processes, like strategic monitoring processes, may affect memory errors. By manipulating the time subjects were given to make memory decisions, this study separated the influence of automatic memory processes (activation) from strategic memory processes (monitoring) on the production of false memories. The results indicated that when retrieval was fast, the right hemisphere produced more memory errors than the left hemisphere. However, when retrieval was slow, the left hemisphere's error-proneness increased compared to the fast retrieval condition, while the right hemisphere's error-proneness remained the same. These results suggest that the right hemisphere's errors are largely due to activation, while the left hemisphere's errors are influenced by both activation and monitoring.     

Spreading Activation in an Attractor Network With Latching Dynamics: Automatic Semantic Priming Revisited

Localist models of spreading activation (SA) and models assuming distributed representations offer very different takes on semantic priming, a widely investigated paradigm in word recognition and semantic memory research. In this study, we implemented SA in an attractor neural network model with distributed representations and created a unified framework for the two approaches. Our models assume a synaptic depression mechanism leading to autonomous transitions between encoded memory patterns (latching dynamics), which account for the major characteristics of automatic semantic priming in humans. Using computer simulations, we demonstrated how findings that challenged attractor‐based networks in the past, such as mediated and asymmetric priming, are a natural consequence of our present model’s dynamics. Puzzling results regarding backward priming were also given a straightforward explanation. In addition, the current model addresses some of the differences between semantic and associative relatedness and explains how these differences interact with stimulus onset asynchrony in priming experiments.     

Timing matters! The neural signature of intuitive judgments differs according to the way information is presented

One can conceive of intuition as the preliminary perception of coherence. Since this requires holistic perception, it is hypothesized that underlying processing strategies are dependent on the possibility to obtain all relevant information at once. The present study used magnetoencephalography (MEG) to investigate neural mechanisms underlying intuitive coherence perception when semantic concepts are presented all together (simultaneously) or one after the other (sequentially). With simultaneous presentation, absolute activation increases in the left OFC when participants recognize coherence. With sequential presentation activation increases in the right OFC when participants conclude that there is no common associate between the words presented. Behavioral performance was similar in the two experiments. These results demonstrate that the way information is revealed over time changes the processing of intuitive coherence perception. We propose that such changes must be taken into account to disentangle the neural and behavioral mechanisms underlying different accounts of intuition and related phenomena.     

Modelling the effects of semantic ambiguity in word recognition

Most words in English are ambiguous between different interpretations; words can mean different things in different contexts. We investigate the implications of different types of semantic ambiguity for connectionist models of word recognition. We present a model in which there is competition to activate distributed semantic representations. The model performs well on the task of retrieving the different meanings of ambiguous words, and is able to simulate data reported by Rodd, Gaskell, and Marslen-Wilson [J. Mem. Lang. 46 (2002) 245] on how semantic ambiguity affects lexical decision performance. In particular, the network shows a disadvantage for words with multiple unrelated meanings (e.g., bark) that coexists with a benefit for words with multiple related word senses (e.g., twist). The ambiguity disadvantage arises because of interference between the different meanings, while the sense benefit arises because of differences in the structure of the attractor basins formed during learning. Words with few senses develop deep, narrow attractor basins, while words with many senses develop shallow, broad basins. We conclude that the mental representations of word meanings can be modelled as stable states within a high-dimensional semantic space, and that variations in the meanings of words shape the landscape of this space.     

Language knowledge and event knowledge in language use

This paper examines how semantic knowledge is used in language comprehension and in making judgments about events in the world. We contrast knowledge gleaned from prior language experience (“language knowledge”) and knowledge coming from prior experience with the world (“world knowledge”). In two corpus analyses, we show that previous research linking verb aspect and event representations have confounded language and world knowledge. Then, using carefully chosen stimuli that remove this confound, we performed four experiments that manipulated the degree to which language knowledge or world knowledge should be salient and relevant to performing a task, finding in each case that participants use the type of knowledge most appropriate to the task. These results provide evidence for a highly context-sensitive and interactionist perspective on how semantic knowledge is represented and used during language processing.     

The missing link between faces and names: Evidence from Alzheimer's disease patients

Retrieval of proper names is a cause of concern and complaint among elderly adults and it is an early symptom of patients suffering from neurodegenerative diseases such as Alzheimer's disease (AD). While it is well established that AD patients have deficits of proper name retrieval, the nature of such impairment is not yet fully understood. Specifically, it is unknown whether this deficit is due to a degradation of the links between faces and proper names, or due to deficits in intentionally accessing and retrieving proper names from faces. Here, we aim to investigate the integrity of the links between famous faces and proper names in AD while minimizing the impact of the explicit retrieval. We compare the performances of AD patients and elderly controls in a face-name priming task. We assess the integrity of the link between faces and names at two different levels: identity level - the name and face belong to the same person; and semantic level - the name and face belong to the same category (e.g., politicians). Our results reveal that AD patients compared with controls show intact semantic priming but reduced priming for person identity. This suggests that the deficits in intentionally retrieving proper names in AD are the result of a partial disruption of the network at the identity level, i.e., the links between known faces and proper names.