Neural correlates of audiovisual integration of semantic category information

Previous studies have found a late frontal-central audiovisual interaction during the time period about 150-220 ms post-stimulus. However, it is unclear to which process is this audiovisual interaction related: to processing of acoustical features or to classification of stimuli? To investigate this question, event-related potentials were recorded during a words-categorization task with stimuli presented in the auditory-visual modality. In the experiment, congruency of the visual and auditory stimuli was manipulated. Results showed that within the window of about 180-210 ms post-stimulus more positive values were elicited by category-congruent audiovisual stimuli than category-incongruent audiovisual stimuli. This indicates that the late frontal-central audiovisual interaction is related to audiovisual integration of semantic category information.     

The cortical organization of lexical knowledge: a dual lexicon model of spoken language processing

Current accounts of spoken language assume the existence of a lexicon where wordforms are stored and interact during spoken language perception, understanding and production. Despite the theoretical importance of the wordform lexicon, the exact localization and function of the lexicon in the broader context of language use is not well understood. This review draws on evidence from aphasia, functional imaging, neuroanatomy, laboratory phonology and behavioral results to argue for the existence of parallel lexica that facilitate different processes in the dorsal and ventral speech pathways. The dorsal lexicon, localized in the inferior parietal region including the supramarginal gyrus, serves as an interface between phonetic and articulatory representations. The ventral lexicon, localized in the posterior superior temporal sulcus and middle temporal gyrus, serves as an interface between phonetic and semantic representations. In addition to their interface roles, the two lexica contribute to the robustness of speech processing.     

Decomposing animacy reversals between agents and experiencers: An ERP study

The present study aimed to refine current hypotheses regarding thematic reversal anomalies, which have been found to elicit either N400 or - more frequently - “semantic-P600” (sP600) effects. Our goal was to investigate whether distinct ERP profiles reflect aspectual-thematic differences between Agent-Subject Verbs (ASVs; e.g., ‘to eat’) and Experiencer-Subject Verbs (ESVs; e.g., ‘to love’) in English. Inanimate subject noun phrases created reversal anomalies on both ASV and ESV. Animacy-based prominence effects and semantic association were controlled to minimize their contribution to any ERP effects. An N400 was elicited by the target verb in the ESV but not the ASV anomalies, supporting the hypothesis of a distinctive aspectual-thematic structure between ESV and ASV. Moreover, the N400 finding for English ESV shows that, in contrast to previous claims, the presence versus absence of N400s for this kind of anomaly cannot be exclusively explained in terms of typological differences across languages.     

“Does degree of asymmetry relate to performance?” A critical review

In a recent paper, Chiarello, Welcome, Halderman, and Leonard (2009) reported positive correlations between word-related visual field asymmetries and reading performance. They argued that strong word processing lateralization represents a more optimal brain organization for reading acquisition. Their empirical results contrasted sharply with those of another such large-scale study, by Boles, Barth, and Merrill (2008). We reported negative correlations between asymmetry and performance when both were measured using the same visual lexical tasks. Most recently, within-task negative correlations were also reported by Hirnstein, Leask, Rose, and Hausmann (2010). Here two major differences between studies are explored. Task purity refers to the influence of the same mental processes on both the asymmetry and performance measures, and is arguably maximal in studies measuring both within the same task. The other difference concerns the measurement of asymmetry. Linear corrections for ceiling and floor effects were used by Chiarello et al. and Hirnstein et al., while we used a more appropriate nonlinear one. Their results are difficult to interpret for those reasons. The operation of a third variable to which both asymmetry and performance are positively correlated could also be a factor in the Chiarello et al. findings. The Boles et al. findings reflect a negative correlation between an asymmetric visual lexical process and performance measured within the same task.     

Motivated semantic control: Exploring the effects of extrinsic reward and self-reference on semantic retrieval in semantic aphasia

Recent insights show that increased motivation can benefit executive control, but this effect has not been explored in relation to semantic cognition. Patients with deficits of controlled semantic retrieval in the context of semantic aphasia (SA) after stroke may benefit from this approach since ‘semantic control’ is considered an executive process. Deficits in this domain are partially distinct from the domain-general deficits of cognitive control. We assessed the effect of both extrinsic and intrinsic motivation in healthy controls and SA patients. Experiment 1 manipulated extrinsic reward using high or low levels of points for correct responses during a semantic association task. Experiment 2 manipulated the intrinsic value of items using self-reference, allocating pictures of items to the participant (‘self’) or researcher (‘other’) in a shopping game before participants retrieved their semantic associations. These experiments revealed that patients, but not controls, showed better performance when given an extrinsic reward, consistent with the view that increased external motivation may help ameliorate patients’ semantic control deficits. However, while self-reference was associated with better episodic memory, there was no effect on semantic retrieval. We conclude that semantic control deficits can be reduced when extrinsic rewards are anticipated; this enhanced motivational state is expected to support proactive control, for example, through the maintenance of task representations. It may be possible to harness this modulatory impact of reward to combat the control demands of semantic tasks in SA patients.     

What factors underlie children’s susceptibility to semantic and phonological false memories? Investigating the roles of language skills and auditory short-term memory

Two experiments investigated the cognitive skills that underlie children’s susceptibility to semantic and phonological false memories in the Deese/Roediger–McDermott procedure ( and ). In Experiment 1, performance on the Verbal Similarities subtest of the British Ability Scales (BAS) II (Elliott, Smith, & McCulloch, 1997) predicted correct and false recall of semantic lures. In Experiment 2, performance on the Yopp–Singer Test of Phonemic Segmentation (Yopp, 1988) did not predict correct recall, but inversely predicted the false recall of phonological lures. Auditory short-term memory was a negative predictor of false recall in Experiment 1, but not in Experiment 2. The findings are discussed in terms of the formation of gist and verbatim traces as proposed by fuzzy trace theory (Reyna & Brainerd, 1998) and the increasing automaticity of associations as proposed by associative activation theory (Howe, Wimmer, Gagnon, & Plumpton, 2009).     

发展性计算障碍儿童的数量转换缺陷

本研究拟考察发展性计算障碍儿童的认知缺陷成因。实验1要求被试在三种形式(点/点,数/数,点/数)下进行数量比较,实验2仅将点集替换为汉字数字词。结果表明障碍组和正常组在数/数、点/数和汉字/汉字比较任务上的成绩存在显著差异,而在点/点和汉字/汉字比较上没有差异。据此推论,计算障碍儿童符号加工能力受到损伤,符号与非符号数量转换能力存在缺陷,但非符号加工能力和不同符号间数量转换没有缺陷,支持语义提取缺陷假设。     

Semantic classification of pictures and words

We provide new behavioural norms for semantic classification of pictures and words. The picture stimuli are 288 black and white line drawings from the International Picture Naming Project ([Székely, A., Jacobsen, T., D'Amico, S., Devescovi, A., Andonova, E., Herron, D., et al. (2004). A new on-line resource for psycholinguistic studies. Journal of Memory & Language, 51, 247–250]). We presented these pictures for classification in a living/nonliving decision, and in a separate version of the task presented the corresponding word labels for classification. We analyzed behavioural responses to a subset of the stimuli in order to explore questions about semantic processing. We found multiple semantic richness effects for both picture and word classification. Further, while lexical-level factors were related to semantic classification of words, they were not related to semantic classification of pictures. We argue that these results are consistent with privileged semantic access for pictures, and point to ways in which these data could be used to address other questions about picture processing and semantic memory.     

A matter of focus: Detailed memory in the intentional autobiographical recall of older and younger adults

The intricately interwoven role of detailed autobiographical memory in our daily lives and in our imaginative envisioning of the future is increasingly recognized. But how is the detail-rich nature of autobiographical memory best assessed and, in particular, how can possible aging-related differences in autobiographical memory specificity be most effectively evaluated? This study examined whether a modified interview, involving fewer and time-matched events for older and younger adults, yielded age-related outcomes similar to those that have been previously reported. As in earlier studies, modest age-related changes in the specificity of autobiographical recall were observed, yet the largest most robust effect for both age groups was the substantial proportion of specific details retrieved. Both age groups rated recent memories as significantly less important and as less emotional than more temporally distant events. Our findings counter conceptions of older adults’ autobiographical memories as invariably less episodically rich than those of younger adults.     

Unconscious manipulation of free choice by novel primes

The extent to which non-conscious perception can influence behaviour has been a topic of considerable controversy in psychology for decades. Although a challenging task, convincing empirical demonstrations have emerged suggesting that non-consciously perceived ‘prime’ stimuli can influence motor responses to subsequent targets. Interestingly, recent studies have shown that the influence of masked primes is not restricted to target-elicited responses, but can also bias free-choices between alternative behaviours. The present experiment extends these findings by showing that free-choices could also be biased by novel primes that never appeared as targets and therefore could not trigger acquired stimulus–response (S–R) mappings. This new evidence suggests that free-choice behaviour can be influenced by non-consciously triggered semantic representations. Furthermore, the results reported here support accounts of masked priming that posit an automatic semantic categorisation of non-consciously perceived visual stimuli.