A simulation-based tutorial system for exploring parallel distributed processing

This article presents a simulation-based tutorial system for exploring parallel distributed processing (PDP) models of information processing. The system consists of software and an accompanying handbook. The intent of the package is to make the ideas underlying PDP accessible and to disseminate some of the main simulation programs that we have developed. This article presents excerpts from the handbook that describe the approach taken, the organization of the handbook, and the software that comes with it. An example is given that illustrates the approach we have taken to teaching PDP, which involves presentation of relevant mathematical background, together with tutorial exercises that make use of the simulation programs.     

Decision-making in robotics and psychology: A distributed account

Decision-making is usually a secondary topic in psychology, relegated to the last chapters of textbooks. The psychological study of decision-making assumes a certain conception of its nature and mechanisms that has been shown wrong by research in robotics. Robotics indicate that decision-making is not—or at least not only—an intellectual task, but also a process of dynamic behavioral control, mediated by embodied and situated sensorimotor interaction. The implications of this conception for psychology are discussed.     

An inexpensive experiment controller for stand-alone applications or distributed processing networks

An inexpensive microprocessor-based experiment controller available as a commercially produced bare printed circuit board is described. It provides for up to 8 inputs and 40 outputs. An 8K Experiment Control BASIC (ECBASIC) and a compiled Experiment Control Language (ECL) are also available. Both languages have internal structures that enable time and responses to be dealt with in a very convenient and error-free manner. Time and response count are automatically incrementing variables that need only to be tested by the user program. ECBASIC provides a 10-msec accuracy, whereas ECL provides a l-msec accuracy. ECL provides extensive support for event-driven programs. The board and software are designed to provide an orderly migration from a stand-alone controller running ECBASIC as a relay-rack replacement, to a network of ECBASIC machines on a small computer, to a true error-checking network of ECL machines on a time-sharing operating system of a large computer. Network communication is over the three wires of a single unmodified RS232 asynchronous serial communication line.     

Target similarity effects: Support for the parallel distributed processing assumptions

Recent research has begun to provide support for the assumptions that memories are stored as a composite and are accessed in parallel (Tehan & Humphreys, 1998). New predictions derived from these assumptions and from the Chappell and Humphreys (1994) implementation of these assumptions were tested. In three experiments, subjects studied relatively short lists of words. Some of the lists contained two similar targets (thief and theft) or two dissimilar targets (thief and steal) associated with the same cue (robbery). As predicted, target similarity affected performance in cued recall but not free association. Contrary to predictions, two spaced presentations of a target did not improve performance in free association. Two additional experiments confirmed and extended this finding. Several alternative explanations for the target similarity effect, which incorporate assumptions about separate representations and sequential search, are rejected. The importance of the finding that, in at least one implicit memory paradigm, repetition does not improve performance is also discussed.     

A parallel distributed processing approach to automaticity.

We consider how a particular set of information processing principles, developed within the parallel distributed processing (PDP) framework, can address issues concerning automaticity. These principles include graded, activation-based processing that is subject to attentional modulation; incremental, connection-based learning; and interactivity and competition in processing. We show how simulation models, based on these principles, can account for the major phenomena associated with automaticity, as well as many of those that have been troublesome for more traditional theories. In particular, we show how the PDP framework provides an alternative to the usual dichotomy between automatic and controlled processing and can explain the relative nature of automaticity as well as the fact that seemingly automatic processes can be influenced by attention. We also discuss how this framework can provide insight into the role that bidirectional influences play in processing: that is, how attention can influence processing at the same time that processing influences attention. Simulation models of the Stroop color-word task and the Eriksen response-competition task are described that help illustrate the application of the principles to performance in specific behavioral tasks.     

The psychology of memory,extended cognition,and socially distributed remembering

This paper introduces a new, expanded range of relevant cognitive psychological research on collaborative recall and social memory to the philosophical debate on extended and distributed cognition. We start by examining the case for extended cognition based on the complementarity of inner and outer resources, by which neural, bodily, social, and environmental resources with disparate but complementary properties are integrated into hybrid cognitive systems, transforming or augmenting the nature of remembering or decision-making. Adams and Aizawa, noting this distinctive complementarity argument, say that they agree with it completely: but they describe it as “a non-revolutionary approach” which leaves “the cognitive psychology of memory as the study of processes that take place, essentially without exception, within nervous systems.” In response, we carve out, on distinct conceptual and empirical grounds, a rich middle ground between internalist forms of cognitivism and radical anti-cognitivism. Drawing both on extended cognition literature and on Sterelny’s account of the “scaffolded mind” (this issue), we develop a multidimensional framework for understanding varying relations between agents and external resources, both technological and social. On this basis we argue that, independent of any more “revolutionary” metaphysical claims about the partial constitution of cognitive processes by external resources, a thesis of scaffolded or distributed cognition can substantially influence or transform explanatory practice in cognitive science. Critics also cite various empirical results as evidence against the idea that remembering can extend beyond skull and skin. We respond with a more principled, representative survey of the scientific psychology of memory, focussing in particular on robust recent empirical traditions for the study of collaborative recall and transactive social memory. We describe our own empirical research on socially distributed remembering, aimed at identifying conditions for mnemonic emergence in collaborative groups. Philosophical debates about extended, embedded, and distributed cognition can thus make richer, mutually beneficial contact with independently motivated research programs in the cognitive psychology of memory.     

Task unrelated thought: the role of distributed processing

Task unrelated thought (TUT) refers to thought directed away from the current situation; for example, a day dream. Encapsulated models of cognition propose that qualitative changes in consciousness, i.e., the production of TUT, can be explained in terms of changes in the quantity of resources deployed for task completion. In contrast, distributed models of cognition emphasize the importance of holistic processes in the generation and maintenance of task focus and are consistent with the effects of higher order variables such as schemata. Three experiments were conducted on healthy participants using a categorical stimulus organization to contrast distributed and encapsulated views of cognition. Experiments 1 and 2 showed that despite the increased difficulty of the alphabetical verbal fluency task fewer TUTs were produced during category fluency condition. Experiment 3 replicated the categorical suppression of TUT while encoding and recalling information in a memory task. The results of these three experiments support the predictions derived from models of cognition emphasizing the importance of stimulus organization in the generation and maintenance of task focus and have potential importance for the scientific evaluation of cognition.     

A distributed intercortical processing of binocular rivalry: psychophysical evidence

When dissimilar visual scenes are viewed dichoptically, the observer perceives several different representations of the scene over time. To reveal that a distributed intercortical network mediates this phenomenon of binocular rivalry, we used a Kanizsa square-like display consisting of four pairs of color-rivalry-inducing elements. We found that when all four dominant elements had the same color, regardless of whether they were from the same or different eyes, the visual system ably integrated them into a larger subjective surface. Once formed, the same-colored subjective surface enjoyed a relatively longer predominance than mixed-colored patterns. During rivalry alternation, this same-colored surface was more likely to be replaced by a complementary same-colored surface, rather than by mixed-colored patterns (cohesive effect). Further, surface integration, which is mainly an extrastriate cortical function, was stronger when the same eye viewed the same-colored rivalry stimuli. Since the eye-of-origin signature is explicitly represented in V1, these findings together suggest that rivalry is processed along a distributed network including V1 and the extrastriate cortices.     

A parallel distributed processing model of stimulus-stimulus and stimulus-response compatibility.

A parallel distributed processing (PDP) model is proposed to account for choice reaction time (RT) performance in diverse cognitive and perceptual tasks such as the Stroop task, the Simon task, the Eriksen flanker task, and the stimulus-response compatibility task that are interrelated in terms of stimulus-stimulus and stimulus-response overlap (Kornblum, 1992). In multilayered (input-intermediate-output) networks, neuron-like nodes that represent stimulus and response features are grouped into mutually inhibitory modules that represent stimulus and response dimensions. The stimulus-stimulus overlap is implemented by a convergence of two input modules onto a common intermediate module, and the stimulus-response overlap by direct pathways representing automatic priming of outputs. Mean RTs are simulated in various simple tasks and, furthermore, predictions are generated for complex tasks based on performance in simpler tasks. The match between simulated and experimental results lends strong support for our PDP model of compatibility.     

The development of delayed response: Parallel distributed processing lacks neural plausibility

Munakata's model of the A-not-B task provides an excellent fit to behavioral data from human infants. From a neuropsychological standpoint, however, its architecture is not very plausible. Dehaene and Changeux's (1989) neuronal model of delayed response tasks, while admittedly very simple, relies on identified features of brain architecture such as multiple hierarchical pathways, bistable clusters with sustained activity, and diffuse reward systems. Ways in which the insights provided by both models might be combined are discussed.     

Microcomputers for experimental psychology

The design and use of CPUs on a single inexpensive circuit are discussed. Necessary additional equipment is noted, and the potential for using the microcomputer in the laboratory is explored.     

The effect of observer's set on the processing of temporally distributed items1,2

Abstract: Perception of the second of two rapidly presented targets is impaired when the temporal lag between them is short (attentional blink, AB). Previous studies showed two types of AB functions. One is that the performance for the second target has been found to be most impaired at the shortest lag (Lag 1), that is, when the second target appeared directly after the ?rst target. The other is that the performance was not impaired at Lag 1 (Lag 1 sparing). The present study examined whether the task set of observers determines the occurrence of Lag 1 sparing. The experiment revealed that Lag 1 sparing occurred only when the observers were informed of the relationships of target locations. The present results extend the explanation of Lag 1 sparing by attentional gating ( Visser, Zuvic, Bischof, & Di Lollo, 1999 b) and suggest that this gating system is not stimulus‐driven but subject to goal‐directed control.     

Hypnotizability and automaticity: toward a parallel distributed processing model of hypnotic responding

We tested a hypothesis from parallel distributed processing theory that highly hypnotizable subjects have greater connection strengths along verbal pathways and would show greater Stroop effects than low hypnotizable subjects. Using Cheesman & Merikle's (1986) paradigm, which varied cue visibility and probability, we assessed automatic and strategic effects on Stroop performance. Compared with 9 low and 9 moderately hypnotizable subjects, 9 highly hypnotizable ones showed significantly greater Stroop effects for both visible- and degraded-word trials. No strategic differences emerged for the 3 hypnotizability groups. These findings support the contention that highly hypnotizable persons have stronger verbal connection strengths than their moderately and low susceptible counterparts, and they may account for highly hypnotizable persons' propensity to disregard personal attributions and label their responses in hypnosis as being involuntary.     

A neurally plausible parallel distributed processing model of event-related potential word reading data

The Parallel Distributed Processing (PDP) framework has significant potential for producing models of cognitive tasks that approximate how the brain performs the same tasks. To date, however, there has been relatively little contact between PDP modeling and data from cognitive neuroscience. In an attempt to advance the relationship between explicit, computational models and physiological data collected during the performance of cognitive tasks, we developed a PDP model of visual word recognition which simulates key results from the ERP reading literature, while simultaneously being able to successfully perform lexical decision—a benchmark task for reading models. Simulations reveal that the model’s success depends on the implementation of several neurally plausible features in its architecture which are sufficiently domain-general to be relevant to cognitive modeling more generally.     

Simulation systems for cognitive psychology

Three views of the function of computer simulation in cognitive psychology are analyzed. The strong view that computer simulations will produce more rigorously specified theories is seen to be overstating the case. Two more pragmatic views are supported. One looks at computer method as a means of exploring or validating psychological theories. The other looks to computer simulation as a source of useful concepts. Several recent simulation efforts are presented as illustrations of these latter views. After establishing some perspective on the uses of simulation, the discussion turns to psychological simulation languages and to aspects of programming environments that facilitate simulation work. A new simulation language, PRISM, is described. PRISM’s design is intended as a response to some of the issues raised in this paper.     

Some targets for mathematical psychology

Concern among mathematical psychologists regarding the present status of the discipline arises from two sources. One is the growing disparity between the rapid development of mathematical psychology as an adjunct to research and the slower and more uncertain progress toward a cumulative body of theory. The other is the problem of adjusting to the encroachment of computers and computer simulation models into the traditional province of mathematical methods. It appears that these problems might be alleviated by recognition of the complementary aspects of mathematical and computer simulation approaches to psychological theory and by a shift of emphasis from tactics to strategy in the construction and evaluation of models of both types.