Integrating structure and meaning: a distributed model of analogical mapping

In this paper we present Drama , a distributed model of analogical mapping that integrates semantic and structural constraints on constructing analogies. Specifically, Drama uses holographic reduced representations (Plate, 1994), a distributed representation scheme, to model the effects of structure and meaning on human performance of analogical mapping. Drama is compared to three symbolic models of analogy (SME, Copycat, and ACME) and one partially distributed model (LISA). We describe Drama's performance on a number of example analogies and assess the model in terms of neurological and psychological plausibility. We argue that Drama's successes are due largely to integrating structural and semantic constraints throughout the mapping process. We also claim that Drama is an existence proof of using distributed representations to model high-level cognitive phenomena.     

Representing word meaning and order information in a composite holographic lexicon

The authors present a computational model that builds a holographic lexicon representing both word meaning and word order from unsupervised experience with natural language. The model uses simple convolution and superposition mechanisms (cf. B. B. Murdock, 1982) to learn distributed holographic representations for words. The structure of the resulting lexicon can account for empirical data from classic experiments studying semantic typicality, categorization, priming, and semantic constraint in sentence completions. Furthermore, order information can be retrieved from the holographic representations, allowing the model to account for limited word transitions without the need for built-in transition rules. The model demonstrates that a broad range of psychological data can be accounted for directly from the structure of lexical representations learned in this way, without the need for complexity to be built into either the processing mechanisms or the representations. The holographic representations are an appropriate knowledge representation to be used by higher order models of language comprehension, relieving the complexity required at the higher level.     

Priming reveals differential coding of symbolic and non-symbolic quantities

Number processing is characterized by the distance and the size effect, but symbolic numbers exhibit smaller effects than non-symbolic numerosities. The difference between symbolic and non-symbolic processing can either be explained by a different kind of underlying representation or by parametric differences within the same type of underlying representation. We performed a primed naming study to investigate this issue. Prime and target format were manipulated (digits or collections of dots) as well as the numerical distance between prime and target value. Qualitatively different priming patterns were observed for the two formats, showing that the underlying representations differed in kind: Digits activated mental number representations of the place coding type, while collections of dots activated number representations of the summation coding type.     

Two spatial memories are not better than one: evidence of exclusivity in memory for object location

This paper studies the dynamics of attempting to access two spatial memories simultaneously and its implications for the accuracy of recall. Experiment 1 demonstrates in a range of conditions that two cues pointing to different experiences of the same object location produce little or no higher recall than that observed with a single cue. Experiment 2 confirms this finding in a within-subject design where both cues have previously elicited recall. Experiment 3 shows that these findings are only consistent with a model in which two representations of the same object location are mutually exclusive at both encoding and retrieval, and inconsistent with models that assume information from both representations is available. We propose that these representations quantify directionally specific judgments of location relative to specific anchor points in the stimulus; a format that precludes the parallel processing of like representations. Finally, we consider the apparent paradox of how such representations might contribute to the acquisition of spatial knowledge from multiple experiences of the same stimuli.     

The perception/cognition distincton: Challenging the representational account

A central goal for cognitive science and philosophy of mind is to distinguish between perception and cognition. The representational approach has emerged as a prominent candidate to draw such a distinction. The idea is that perception and cognition differ in the content and the format in which the information is represented —just as perceptual representations are nonconceptual in content and iconic in format, cognitive representations are conceptual in content and discursive in format. This paper argues against this view. I argue that both perception and cognition can use conceptual and nonconceptual contents and be vehiculated in iconic and discursive formats. If correct, the representational strategy to distinguish perception from cognition fails.     

Toward a scalable holographic word-form representation

Phenomena in a variety of verbal tasks—for example, masked priming, lexical decision, and word naming—are typically explained in terms of similarity between word-forms. Despite the apparent commonalities between these sets of phenomena, the representations and similarity measures used to account for them are not often related. To show how this gap might be bridged, we build on the work of Hannagan, Dupoux, and Christophe, Cognitive Science 35:79-118, (2011) to explore several methods of representing visual word-forms using holographic reduced representations and to evaluate them on their ability to account for a wide range of effects in masked form priming, as well as data from lexical decision and word naming. A representation that assumes that word-internal letter groups are encoded relative to word-terminal letter groups is found to predict qualitative patterns in masked priming, as well as lexical decision and naming latencies. We then show how this representation can be integrated with the BEAGLE model of lexical semantics (Jones & Mewhort, Psychological Review 114:1–37, 2007) to enable the model to encompass a wider range of verbal tasks.     

Calculate or wait: Is man an eager or a lazy intuitive statistician?

Research on people's ability to act as intuitive statisticians has mainly focused on the accuracy of estimates of central tendency and variability. In this paper, we investigate two hypothesised cognitive processes by which people make judgements of distribution shape. The first claims that people spontaneously induce abstract representations of distribution properties from experience, including about distribution shape. The second process claims that people construct beliefs about distribution properties post hoc by retrieval from long-term memory of small samples from the distribution, implying format dependence with accuracy that differs depending on judgement format. Results from two experiments confirm the predicted format dependence, suggesting that people are often constrained by the post hoc assessment of distribution properties by sampling from long-term memory. The results, however, also suggest that, although post hoc sampling from memory seems to be the default process, under certain predictable circumstances people do induce abstract representations of distribution shape.     

Vision and touch: multiple or multisensory representations of objects?

The relationship between visually and haptically derived representations of objects is an important question in multisensory processing and, increasingly, in mental representation. We review evidence for the format and properties of these representations, and address possible theoretical models. We explore the relevance of visual imagery processes and highlight areas for further research, including the neglected question of asymmetric performance in the visuo-haptic cross-modal memory paradigm. We conclude that the weight of evidence suggests the existence of a multisensory representation, spatial in format, and flexibly accessible by both bottom-up and top-down inputs, although efficient comparison between modality-specific representations cannot entirely be ruled out.     

Decade breaks in the mental number line? Putting the tens and units back in different bins.

Most models of number recognition agree that among other number representations there is a central semantic magnitude representation which may be conceptualized as a logarithmically compressed mental number line. Whether or not this number line is decomposed into different representations for tens and units is, however, controversial. We investigated this issue in German participants in a magnitude comparison (selection) task in which the larger of two visually presented Arabic two-digit numbers had to be selected. Most importantly, we varied unit-decade-compatibility: a number pair was defined as compatible if the decade magnitude comparison and the unit magnitude comparison of the two numbers would lead to the same response (e.g. 52 and 67) and as incompatible if this was not the case (e.g. 47 and 62). While controlling for overall numerical distance, size and other variables, we consistently found compatibility effects. A control experiment showed that this compatibility effect was not due to perceptual presentation characteristics. We conclude that the idea of one single number line representation that does not additionally assume different magnitude representations for tens and units is not sufficient to account for the data. Finally, we discuss why decade effects were not found in other experimental settings.     

Two-way interactions between music and language: Evidence from priming recognition of tune and lyrics in familiar songs

A priming technique was employed to study the relations between melody and lyrics in song memory. The procedure involved the auditory presentation of a prime and a target taken from the same song, or from unrelated but equally familiar songs. To promote access to memory representations of songs, we varied the format of primes and targets, which were either spoken or sung, using the syllable /1a/. In each of the four experiments, a prime taken from the same song as the target facilitated target recognition, independently of the format in which it occurred. The facilitation effects were also found in conditions close to masked priming because prime recognizability was very low, as assessed in Experiment 1 by d' measures. Above all, backward priming effects were observed in Experiments 2, 3, and 4, where song order was reversed in the prime-target sequence, suggesting that words and tones of songs are not connected by strict temporal contingencies. Rather, the results indicate that, in song memory, text and tune are related by tight connections that are bidirectional and automatically activated by relatively abstract information. Rhythmic similarity between linguistic stress pattern and musical meter might account for these priming effects.     

Grammaticality is inferred from global similarity: A reply to Kinder (2010)

Jamieson and Mewhort (2009b) proposed an account of performance in the artificial-grammar judgement-of-grammaticality task based on Hintzman's (1986) model of retrieval, Minerva 2. In the account, each letter is represented by a unique vector of random elements, and each exemplar is represented by concatenating its constituent letter vectors. Although successful in simulating several experiments, Kinder (2010) showed that the model fails for three selected experiments. We track the model's failure to a constraint introduced by concatenating letter vectors to construct the exemplar representation. To fix the problem, we use a holographic representation. Holographic representation not only provides the flexibility missing with the concatenation scheme but also acknowledges variability in what subjects notice when they inspect training exemplars. Armed with holographic representations, we show that the model successfully captures the three problematic data sets. We argue for retrospective accounts, like the present one, that acknowledge subjects' skill in drawing unexpected inferences based on memory of studied items against prospective accounts that require subjects to learn statistical regularities in the training set in anticipation of an undefined classification test.     

Package Graphics and Consumer Product Beliefs

In recent years, marketers' tactics to increase product sales through health claims have been scrutinized by public policy makers. The culmination of this process was the passage of the National Labeling Education Act, which highly restricts the type, amount, and format of nutritional information conveyed on the package. In this investigation, we examine an under-explored aspect of the package—its colors and pictures—to determine what, if any, impact these aspects have on consumer beliefs regarding important product characteristics. We find that even when very concrete verbal information is used, graphical representations have a significant and long-term effect on product beliefs and purchase intentions.     

Biased extensive measurement: The general case

We develop a theory of biased extensive measurement which allows us to prove the existence of a ratio-scale without transitivity of indifference and with a property of homothetic invariance weaker than independence. These representations, which cover the cases of interval orders and of semiorders, reveal a unique biasing function smaller or equal to 1 that distorts extensive measurement and explains departures from its standard axioms. We interpret this biasing function as characterizing the qualitative influence of the underlying measurement process and we show that it induces a proportional indifference threshold.     

Phonological similarity neighborhoods and children’s short-term memory: Typical development and dyslexia

In this article, we explore whether structural characteristics of the phonological lexicon affect serial recall in typically developing and dyslexic children. Recent work has emphasized the importance of long-term phonological representations in supporting short-term memory performance. This occurs via redintegration (reconstruction) processes, which show significant neighborhood density effects in adults. We assessed whether serial recall in children was affected by neighborhood density in word and nonword tasks. Furthermore, we compared dyslexic children with typically developing children of the same age or reading level. Dyslexic children are held to have impaired phonological representations of lexical items. These impaired representations may impair or prevent the use of long-term phonological representations to redintegrate short-term memory traces. We report significant rime neighborhood density effects for serial recall of both words and nonwords, for both dyslexic and typically developing children.     

Terms of the debate on the format and structure of visual memory

Our ability to actively maintain information in visual memory is strikingly limited. There is considerable debate about why this is so. As with many questions in psychology, the debate is framed dichotomously: Is visual working memory limited because it is supported by only a small handful of discrete “slots” into which visual representations are placed, or is it because there is an insufficient supply of a “resource” that is flexibly shared among visual representations? Here, we argue that this dichotomous framing obscures a set of at least eight underlying questions. Separately considering each question reveals a rich hypothesis space that will be useful for building a comprehensive model of visual working memory. The questions regard (1) an upper limit on the number of represented items, (2) the quantization of the memory commodity, (3) the relationship between how many items are stored and how well they are stored, (4) whether the number of stored items completely determines the fidelity of a representation (vs. fidelity being stochastic or variable), (5) the flexibility with which the memory commodity can be assigned or reassigned to items, (6) the format of the memory representation, (7) how working memories are formed, and (8) how memory representations are used to make responses in behavioral tasks. We reframe the debate in terms of these eight underlying questions, placing slot and resource models as poles in a more expansive theoretical space.     

An efficient coding approach to the debate on grounded cognition

The debate between the amodal and the grounded views of cognition seems to be stuck. Their only substantial disagreement is about the vehicle or format of concepts. Amodal theorists reject the grounded claim that concepts are couched in the same modality-specific format as representations in sensory systems. The problem is that there is no clear characterization of (modal or amodal) format or its neural correlate. In order to make the disagreement empirically meaningful and move forward in the discussion we need a neurocognitive criterion for representational format. I argue that efficient coding models in computational neuroscience can be used to characterize modal codes: These are codes which satisfy special informational demands imposed by sensory tasks. Additionally, I examine recent studies on neural coding and argue that although they do not provide conclusive evidence for either the grounded or the amodal views, they can be used to determine what predictions these approaches can make and what experimental and theoretical developments would be required to settle the debate.     

Teaching adults new words: the role of practice and consolidation

Semantic and orthographic learning of new words was investigated with the help of the picture-word interference (PWI) task. In this version of the Stroop task, picture naming is delayed by the simultaneous presentation of a semantically related as opposed to an unrelated distractor word (a specific PWI effect), as well as by an unrelated word compared with a nonword (a general PWI effect). This interference is taken to reflect automatic orthographic and semantic processing. The authors observed that participants showed both types of PWI effects for newly learned words following a single study session. Interestingly, specific PWI effects were not obtained immediately after testing but did emerge a week later without additional practice. This suggests that a period of consolidation is involved in the establishment of word representations. In addition, identical PWI effects were obtained when the study and test words were presented in either the same or different letter case. This provides evidence that the newly acquired orthographic representations are coded in an abstract format.     

Online measurement of mental representations of complex spatial decision problems: Comparison of CNET and hard laddering

This paper introduces the online Causal Network Elicitation Technique (CNET), as a technique for measuring components of mental representations of choice tasks and compares it with the more common technique of online ‘hard’ laddering (HL). While CNET works in basically two phases, one in open question format and one as guided linking of attributes and benefits, HL works completely structured with revealed attributes and benefits. Mental representations of two activity travel tasks were collected with both techniques among members of a nationwide Dutch household panel. The results confirm the hypothesis that the revealed format of variables in HL has an effect on the indication of variables as the elicited mental representations are almost twice as big for HL than for CNET. Furthermore, it turned out that CNET is more sensitive in measuring shifts among attributes in the mental representations for situational changes of the activity-travel task.