Integrating conceptual knowledge within and across representational modalities

Research suggests that concepts are distributed across brain regions specialized for processing information from different sensorimotor modalities. Multimodal semantic models fall into one of two broad classes differentiated by the assumed hierarchy of convergence zones over which information is integrated. In shallow models, communication within- and between-modality is accomplished using either direct connectivity, or a central semantic hub. In deep models, modalities are connected via cascading integration sites with successively wider receptive fields. Four experiments provide the first direct behavioral tests of these models using speeded tasks involving feature inference and concept activation. Shallow models predict no within-modal versus cross-modal difference in either task, whereas deep models predict a within-modal advantage for feature inference, but a cross-modal advantage for concept activation. Experiments 1 and 2 used relatedness judgments to tap participants’ knowledge of relations for within- and cross-modal feature pairs. Experiments 3 and 4 used a dual-feature verification task. The pattern of decision latencies across Experiments 1–4 is consistent with a deep integration hierarchy.     

Conceptual knowledge attenuates viewpoint dependency in visual object recognition

Learning verbal semantic knowledge for objects has been shown to attenuate recognition costs incurred by changes in view from a learned viewpoint. Such findings were attributed to the semantic or meaningful nature of the learned verbal associations. However, recent findings demonstrate surprising benefits to visual perception after learning even noninformative verbal labels for stimuli. Here we test whether learning verbal information for novel objects, independent of its semantic nature, can facilitate a reduction in viewpoint-dependent recognition. To dissociate more general effects of verbal associations from those stemming from the semantic nature of the associations, participants learned to associate semantically meaningful (adjectives) or nonmeaningful (number codes) verbal information with novel objects. Consistent with a role of semantic representations in attenuating the viewpoint-dependent nature of object recognition, the costs incurred by a change in viewpoint were attenuated for stimuli with learned semantic associations relative to those associated with nonmeaningful verbal information. This finding is discussed in terms of its implications for understanding basic mechanisms of object perception as well as the classic viewpoint-dependent nature of object recognition.     

The benefits of sensorimotor knowledge: body-object interaction facilitates semantic processing

This article examined the effects of body–object interaction (BOI) on semantic processing. BOI measures perceptions of the ease with which a human body can physically interact with a word's referent. In Experiment 1, BOI effects were examined in 2 semantic categorization tasks (SCT) in which participants decided if words are easily imageable. Responses were faster and more accurate for high BOI words (e.g., mask ) than for low BOI words (e.g., ship ). In Experiment 2, BOI effects were examined in a semantic lexical decision task (SLDT), which taps both semantic feedback and semantic processing. The BOI effect was larger in the SLDT than in the SCT, suggesting that BOI facilitates both semantic feedback and semantic processing. The findings are consistent with the embodied cognition perspective (e.g., Barsalou's, 1999 , Perceptual Symbols Theory), which proposes that sensorimotor interactions with the environment are incorporated in semantic knowledge.     

Intersubjectivity in perception

The embodied, embedded, enactive, and extended approaches to cognition explicate many important details for a phenomenology of perception, and are consistent with some of the traditional phenomenological analyses. Theorists working in these areas, however, often fail to provide an account of how intersubjectivity might relate to perception. This paper suggests some ways in which intersubjectivity is important for an adequate account of perception.

Evidence for knowledge of the syntax of large numbers in preschoolers

The aim of this study was to provide evidence for knowledge of the syntax governing the verbal form of large numbers in preschoolers long before they are able to count up to these numbers. We reasoned that if such knowledge exists, it should facilitate the maintenance in short-term memory of lists of lexical primitives that constitute a number (e.g., three hundred forty five) compared with lists containing the same primitives but in a scrambled order (e.g., five three forty hundred). The two types of lists were given to 5-year-olds in an immediate serial recall task. As we predicted, the lists in syntactic order were easier to recall, suggesting that they match some knowledge of the way lexical primitives must be ordered to express large numerosities.     

Dynamic object perception by pigeons: discrimination of action in video presentations

Two experiments examined the discrimination by pigeons of relative motion using computer-generated video stimuli. Using a go/no-go procedure, pigeons were tested with video stimuli in which the camera's perspective went either "around" or "through" an approaching object in a semi-realistic context. Experiment 1 found that pigeons could learn this discrimination and transfer it to videos composed from novel objects. Experiment 2 found that the order of the video's frames was critical to the discrimination of the videos. We hypothesize that the pigeons perceived a three-dimensional representation of the objects and the camera's relative motion and used this as the primary basis for discrimination. It is proposed that the pigeons might be able to form generalized natural categories for the different kinds of motions portrayed in the videos. Accepted after revision: 23 March 2001 Electronic Publication     

Evocation of functional and volumetric gestural knowledge by objects and words

We distinguish between grasping gestures associated with using an object for its intended purpose (functional) and those used to pick up an object (volumetric) and we develop a novel experimental framework to show that both kinds of knowledge are automatically evoked by objects and by words denoting those objects. Cued gestures were carried out in the context of depicted objects or visual words. On incongruent trials, the cued gesture was not compatible with gestures typically associated with the contextual item. On congruent trials, the gesture was compatible with the item's functional or volumetric gesture. For both gesture types, response latency was longer for incongruent trials indicating that objects and words elicited both functional and volumetric manipulation knowledge. Additional evidence, however, clearly supports a distinction between these two kinds of gestural knowledge. Under certain task conditions, functional gestures can be evoked without the associated activation of volumetric gestures. We discuss the implication of these results for theories of action evoked by objects and words, and for interpretation of functional imaging results.     

Modes of knowledge acquisition and retrieval in artificial grammar learning

The aim of this study was to conceptualize artificial grammar learning (AGL) in terms of two orthogonal dimensions—the mode of knowledge acquisition and the mode of knowledge retrieval—as was done by Perlman and Tzelgov (2006) for sequence learning. Experiment 1 was carried out to validate our experimental task; Experiments 2–4 tested, respectively, performance in the intentional, incidental, and automatic retrieval modes, for each of the three modes of acquisition. Furthermore, signal detection theory (SDT) was used as an analytic tool, consistent with our assumption that the processing of legality-relevant information involves decisions along a continuous dimension of fluency. The results presented support the analysis of AGL in terms of the proposed dimensions. They also indicate that knowledge acquired during training may include many aspects of the presented stimuli (whole strings, relations among elements, etc.). The contribution of the various components to performance depends on both the specific instruction in the acquisition phase and the requirements of the retrieval task.     

The role of embodied intention in early lexical acquisition

We examine the influence of inferring interlocutors' referential intentions from their body movements at the early stage of lexical acquisition. By testing human participants and comparing their performances in different learning conditions, we find that those embodied intentions facilitate both word discovery and word-meaning association. In light of empirical findings, the main part of this article presents a computational model that can identify the sound patterns of individual words from continuous speech, using nonlinguistic contextual information, and employ body movements as deictic references to discover word-meaning associations. To our knowledge, this work is the first model of word learning that not only learns lexical items from raw multisensory signals to closely resemble infant language development from natural environments, but also explores the computational role of social cognitive skills in lexical acquisition.     

The face inhibition effect: Social contrast or motor competition?

This research examined the relative importance of encoding and retrieval contexts to the demonstration of concreteness effects in memory. Predictions from relational-distinctive and dual-code positions were evaluated. In the first two experiments, concreteness and recall task (free recall or cued recall) were manipulated following a relational semantic orienting task. The results showed an interaction between concreteness and recall type only when distinctive information could be accessed both within and between pairs. The third experiment showed that concreteness effects appeared under a relational, non-semantic orienting task. In the fourth experiment, we reexamined the magnitude of the concreteness effect following semantic versus non-semantic tasks and relational versus item-specific processing. Overall, the findings were inconsistent with both dual code theory and distinctiverelational view accounts of concreteness effects. An alternative "bidirectionality hypothesis" is suggested.     

Cognitive and movement measures reflect the transition to presence-at-hand

The phenomenological philosopher Martin Heidegger's proposed transition from readiness-to-hand to presence-at-hand and the hypothesis of extended cognition were addressed empirically in an experiment on tool use. It involved a video game of steering erratically moving objects to a target while performing a secondary cognitive task. A strong perturbation of the hand-pointer linkage in the video game induced the transition from ready-to-hand to present-at-hand. In Experiment 1, this perturbation resulted in decreased motor performance and improved recall of task-irrelevant features. Experiment 2 replicated these results and addressed additional questions. Measures of movement variability based on the multifractal formalism confirmed the hypothesized decrease in functional integration of the tool during the perturbation. Dynamical interactions allow user and tool to act as a system. The tool is properly described as ready-to-hand during normal operation but as present-at-hand during perturbation. Physiological measures showed that the ready-to-hand to present-at-hand transition does not necessarily lead to a stress response.     

Cerebellar patients demonstrate preserved implicit knowledge of association strengths in musical sequences

Recent findings suggest the involvement of the cerebellum in perceptual and cognitive tasks. Our study investigated whether cerebellar patients show musical priming based on implicit knowledge of tonal-harmonic music. Participants performed speeded phoneme identification on sung target chords, which were either related or less-related to prime contexts in terms of the tonal-harmonic system. As groups, both cerebellar patients and age-matched controls showed facilitated processing for related targets, as previously observed for healthy young adults. The outcome suggests that an intact cerebellum is not mandatory for accessing implicit knowledge stored in long-term memory and for its influence on perception. One patient showed facilitated processing for less-related targets (suggesting sensory priming). The findings suggest directions for future research on auditory perception in cerebellar patients to further our understanding of cerebellar functions.     

Getting to know you: From view-dependent to view-invariant repetition priming for unfamiliar faces

Recent research suggests that repetition priming (RP) for unfamiliar faces is highly view dependent and is eliminated when the viewpoint of target faces changes between study and test. The current research examined whether increased familiarity with novel faces from a single viewpoint at study would support RP from an alternative viewpoint at test. Participants passively viewed novel face images from a single viewpoint at study (i.e., either front or three-quarters), with half of the images seen once and half seen on five occasions. During a sex classification task at test, participants were faster to respond to face images seen from the same view as that at study than they were to previously unseen distractor faces for both single exposure faces and faces seen on five occasions (i.e., standard RP). When, however, face images at test were shown from a different viewpoint from that at study, RP only occurred for faces viewed on five occasions.     

Explicit feedback maintains implicit knowledge

The role of feedback was investigated with respect to conscious and unconscious knowledge acquired during artificial grammar learning (AGL). After incidental learning of training sequences, participants classified further sequences in terms of grammaticality and reported their decision strategy with or without explicit veridical feedback. Sequences that disobeyed the learning structure conformed to an alternative structure. Feedback led to an increase in the amount of reported conscious knowledge of structure (derived rules and recollections) but did not increase its accuracy. Conversely, feedback maintained the accuracy of unconscious knowledge of structure (intuition or familiarity-based responses) which otherwise degraded. Results support a dual-process account of AGL. They suggest that implicit learning of the to-be-rejected structure at test contaminates familiarity-based classifications whereas feedback allows competing familiarity signals to be contextualised, which is incompatible with theories that consider familiarity context-insensitive.     

Hebb learning, verbal short-term memory, and the acquisition of phonological forms in children

Recent work using the Hebb effect as a marker for implicit long-term acquisition of serial order has demonstrated a functional equivalence across verbal and visuospatial short-term memory. The current study extends this observation to a sample of five- to six-year-olds using verbal and spatial immediate serial recall and also correlates the magnitude of Hebb learning with explicit measures of word and nonword paired-associate learning. Comparable Hebb effects were observed in both domains, but only nonword learning was significantly related to the magnitude of Hebb learning. Nonword learning was also independently related to individuals' general level of verbal serial recall. This suggests that vocabulary acquisition depends on both a domain-specific short-term memory system and a domain-general process of learning through repetition.     

Receptive vocabulary and semantic knowledge in children with SLI and children with Down syndrome

Receptive vocabulary and associated semantic knowledge were compared within and between groups of children with specific language impairment (SLI), children with Down syndrome (DS), and typically developing children. To overcome the potential confounding effects of speech or language difficulties on verbal tests of semantic knowledge, a novel task was devised based on picture-based semantic association tests used to assess adult patients with semantic dementia. Receptive vocabulary, measured by word-picture matching, of children with SLI was weak relative to chronological age and to nonverbal mental age but their semantic knowledge, probed across the same lexical items, did not differ significantly from that of vocabulary-matched typically developing children. By contrast, although receptive vocabulary of children with DS was a relative strength compared to nonverbal cognitive abilities (p < .0001), DS was associated with a significant deficit in semantic knowledge (p < .0001) indicative of dissociation between word-picture matching vocabulary and depth of semantic knowledge. Overall, these data challenge the integrity of semantic-conceptual development in DS and imply that contemporary theories of semantic cognition should also seek to incorporate evidence from atypical conceptual development.     

Category specificity in normal episodic learning: applications to object recognition and category-specific agnosia

Studies of patients with category-specific agnosia (CSA) have given rise to multiple theories of object recognition, most of which assume the existence of a stable, abstract semantic memory system. We applied an episodic view of memory to questions raised by CSA in a series of studies examining normal observers' recall of newly learned attributes of familiar objects. Subjects first learned to associate arbitrarily assigned colors or textures to objects in a training phase, and then attempted to report the newly learned attribute of each object in a recall task. Our subjects' pattern of recall errors was similar both quantitatively and qualitatively to the identification deficits among patients with CSA for biological objects. Furthermore, errors tended to reflect conceptually and structurally based confusions. We suggest that object identification involves recruitment and integration of information across distributed episodic memories and that this process is susceptible to interference from objects that are structurally similar and conceptually related.     

Effects of nicotine administration via a sublingual tablet on arousal and verbal ability in non‐smokers

Tobacco smoking or nicotine administration on its own can influence cognitive task performance. This study examined the effects of acute nicotine administration on verbal task performance and a physiological index of arousal. Healthy non‐smoking participants received either a 2‐mg sublingual nicotine tablet or placebo. Participants next completed various verbal tasks while heart rate recordings were taken concurrently. Nicotine increased heart rate relative to a pre‐administration baseline period, indicating that the new method of nicotine administration increased cardiovascular arousal. Nicotine was associated with reduced accuracy in a verbal matching task and reduced accuracy and increased reaction time in an anagram task, but had no effect on performance during an analogy or verbal fluency task. The data suggest that nicotine‐naïve individuals are unlikely to gain any benefit to their verbal ability from the single acute intake of nicotine, such as that obtained from cigarette smoking or by using nicotine replacement therapy products.     

Language knowledge and event knowledge in language use

This paper examines how semantic knowledge is used in language comprehension and in making judgments about events in the world. We contrast knowledge gleaned from prior language experience (“language knowledge”) and knowledge coming from prior experience with the world (“world knowledge”). In two corpus analyses, we show that previous research linking verb aspect and event representations have confounded language and world knowledge. Then, using carefully chosen stimuli that remove this confound, we performed four experiments that manipulated the degree to which language knowledge or world knowledge should be salient and relevant to performing a task, finding in each case that participants use the type of knowledge most appropriate to the task. These results provide evidence for a highly context-sensitive and interactionist perspective on how semantic knowledge is represented and used during language processing.