The role of stimulus ambiguity and movement in spatial navigation: a multiple memory systems analysis of location discrimination

This paper reviews recent findings about how rats navigate by learning to discriminate among locations. The assumption underlying the experiments and their interpretation is that the information required to do this is learned by three independent, parallel memory systems. One system processes cognitive information (or "knowledge"), a second system processes reinforced stimulus-response associations and a third processes Pavlovian conditioned responses in the form of stimulus-affect associations. The information stored in each system produces behavior that, in some cases, results in a location discrimination. The present experiments focus on three factors that influence what each system learns and whether the resulting memory produces behavior that results in a location discrimination. One factor is whether the locations to be discriminated can be identified by unique, unambiguous stimuli or whether they are ambiguously associated with the same stimuli. The second factor is whether the stimuli are observed passively or whether the rats move among them, voluntarily or involuntarily. The third factor is whether or not the rats perform specific reinforced responses in the presence of the stimuli. Instances of co-operative behavioral outputs from memory systems that facilitate location discriminations and of competitive outputs that impede discriminations are described.     

Sequence learning in infancy: the independent contributions of conditional probability and pair frequency information

The ability to perceive sequences is fundamental to cognition. Previous studies have shown that infants can learn visual sequences as early as 2 months of age and it has been suggested that this ability is mediated by sensitivity to conditional probability information. Typically, conditional probability information has covaried with frequency information in these studies, raising the possibility that each type of information may have contributed independently to sequence learning. The current study explicitly investigated the independent contribution of each type of information. We habituated 2.5‐, 4.5‐, and 8.5‐month‐old infants to a sequence of looming visual shapes whose ordering was defined independently by specific conditional probability relations among pair elements and by the frequency of occurrence of such pairs. During test trials, we tested infants’ sensitivity to each type of information and found that both types of information independently influenced sequence learning by 4.5 months of age.     

The neural basis of human error processing: reinforcement learning,dopamine, and the error-related negativity

The authors present a unified account of 2 neural systems concerned with the development and expression of adaptive behaviors: a mesencephalic dopamine system for reinforcement learning and a "generic" error-processing system associated with the anterior cingulate cortex. The existence of the error-processing system has been inferred from the error-related negativity (ERN), a component of the event-related brain potential elicited when human participants commit errors in reaction-time tasks. The authors propose that the ERN is generated when a negative reinforcement learning signal is conveyed to the anterior cingulate cortex via the mesencephalic dopamine system and that this signal is used by the anterior cingulate cortex to modify performance on the task at hand. They provide support for this proposal using both computational modeling and psychophysiological experimentation.     

A unified framework for addiction: vulnerabilities in the decision process

The understanding of decision-making systems has come together in recent years to form a unified theory of decision-making in the mammalian brain as arising from multiple, interacting systems (a planning system, a habit system, and a situation-recognition system). This unified decision-making system has multiple potential access points through which it can be driven to make maladaptive choices, particularly choices that entail seeking of certain drugs or behaviors. We identify 10 key vulnerabilities in the system: (1) moving away from homeostasis, (2) changing allostatic set points, (3) euphorigenic "reward-like" signals, (4) overvaluation in the planning system, (5) incorrect search of situation-action-outcome relationships, (6) misclassification of situations, (7) overvaluation in the habit system, (8) a mismatch in the balance of the two decision systems, (9) over-fast discounting processes, and (10) changed learning rates. These vulnerabilities provide a taxonomy of potential problems with decision-making systems. Although each vulnerability can drive an agent to return to the addictive choice, each vulnerability also implies a characteristic symptomology. Different drugs, different behaviors, and different individuals are likely to access different vulnerabilities. This has implications for an individual's susceptibility to addiction and the transition to addiction, for the potential for relapse, and for the potential for treatment.     

READING WITH OTHERS: LEVINAS' ETHICS AND SCRIPTURAL REASONING

This essay explores different frameworks for learning, progressing from a relatively basic model of acquiring information through first linguistic models, and then through social interaction, leading to textual practices, and culminating with reading with others from other traditions. For this sequence there is a parallel one concerning kinds of reasoning (and the relevant sciences). But the essay focuses on providing the best account of ethical responsibility for each practice of learning: the greater the social complexity and the respect for otherness, the richer the account of the ethics of learning.     

Temporal control and coordination: the multiple timer model.

We consider the psychological and neurological mechanisms involved in timed behaviors, motor or perceptual tasks that emphasize the temporal relationship between successive events. Two general models for representing temporal information are described. In one model, temporal information is based on the oscillatory activity of an endogenous pacemaker; in the other model, temporal information is interval-based with distinct elements devoted to representing different intervals. We incorporate the interval hypothesis into a process model, the multiple timer model, to account for the timing and coordination of repetitive movements. The model accounts for the patterns of temporal stability observed within each effector and offers a novel account of between-effector coordination. Finally, we consider how timing and temporal coordination may be instantiated in the nervous system.     

应激条件下的双重学习系统

心理学、神经科学和行为经济学中许多研究一致认为, 人的行为由双重学习系统控制, 分别是反射性系统和反思性系统。前者是自动化的习惯系统, 反应快速, 不需要消耗认知资源, 后者是反应较为缓慢的认知系统, 需要消耗更多认知资源, 但也更加灵活, 可以有效应对外界环境的变化。这两种学习系统并行存在而又相互竞争, 共同影响人的心理和行为。究竟是哪种学习系统对人的特定行为起着主导作用, 又有哪些因素导致该系统对行为的支配, 是近年来普遍受到关注的问题。过去研究者们采用导航学习、概率分类学习或工具性学习及其计算模型, 从行为和大脑层面探讨双重学习系统在急性和慢性应激下的变化。通过回顾和分析这些研究, 我们总结出应激导致个体向习惯行为转变的生理机制, 即去甲肾上腺素和糖皮质激素在杏仁核的参与下与受体结合协同作用于双系统相关的脑区, 并从该角度出发重新梳理和解释毒品成瘾的形成。未来需要重点关注个体基因差异与应激影响学习的关系, 并采用多种研究手段以更好地揭示其背后的神经和内分泌机制。     

Introduction to the Meta-Structures Project: Prospective Applications

This research project proposes the modeling of collective behaviors such as flocks, industrial districts, and markets. Unlike many other approaches, the aim is to identify ways to recognize, change, and maintain the coherence of collective behaviors, as well as inducing their emergence in configurations of elements that only interact without acquiring properties. The basic assumption is that currently collective behavior is not adequately modeled for the purpose described above when intended as given by sequences of states adopted by the same system over time. Here the sequence of states of a collective behavior in time is considered as corresponding to sequences of different states adopted by systems made up of the same elements interacting with different structures. Sequences of structures are considered to establish meta-structures and their properties correspond to the coherence acquired. The project is based on the use of mesoscopic variables to represent such structural dynamics considered in turn to represent the continuous emergence of coherent collective behavior. Mesoscopic variables are specified and their properties considered as meta-structural properties (properties of sequences of structures). The purpose of this research project is to search for meta-structural properties within processes of computational emergence (computer simulated). I discuss the problem of prescribing meta-structural properties to non-coherent, disordered collective behaviors. I introduce possible approaches for applications to social systems.     

A general-purpose computer system for behavioral conditioning and neural recording experiments

A computer system designed to control the delivery of stimuli and data acquisition during behavioral conditioning and neural recording experiments is described. This IBM-PC-compatible system is programmed in C++ and is capable of controlling stimulus presentations to four independently operating conditioning chambers while collecting one channel of analog and two channels of digital data from each of the chambers. This system is currently being used in a variety of learning and memory experiments involving rats, rabbits, and humans.     

Brain-to-brain coupling: a mechanism for creating and sharing a social world

Cognition materializes in an interpersonal space. The emergence of complex behaviors requires the coordination of actions among individuals according to a shared set of rules. Despite the central role of other individuals in shaping one's mind, most cognitive studies focus on processes that occur within a single individual. We call for a shift from a single-brain to a multi-brain frame of reference. We argue that in many cases the neural processes in one brain are coupled to the neural processes in another brain via the transmission of a signal through the environment. Brain-to-brain coupling constrains and shapes the actions of each individual in a social network, leading to complex joint behaviors that could not have emerged in isolation.     

Side-specificity of olfactory learning in the honeybee: generalization between odors and sides

Honeybees (Apis mellifera) can be trained to associate an odor stimulus with a sucrose reward. The neural structures involved in the detection and integration of olfactory stimuli are represented bilaterally in the brain. Little is known about the respective roles of the two sides of the brain in olfactory learning. Does each side learn independently of the other, or do they communicate, and if so, to what extent and at what level of neural integration? We addressed these questions using the proboscis extension response (PER) conditioning paradigm applied in a preparation that allows the separation of the two input sides during olfactory stimulations. Bees conditioned to two odorants A and B, one being learned on each side (A+/B+ training), showed in extinction tests rather unspecific responses: They responded to both odorants on both sides. This could be attributable to either a transfer of the learned information between sides, or to a generalization between odorants on each side. By subjecting bees to conditioning on one side only (A+/0 training), we found that the learned information is indeed transferred between sides. However, when bees were trained explicitly to give opposite values to the two odorants on the two sides (A+B-/B+A- training), they showed clear side-specific response patterns to these odorants. These results are used in the elaboration of a functional model of laterality of olfactory learning and memory processing in the honeybee brain.     

情绪识别研究中被“冷落”的线索:躯体表情加工的特点、神经基础及加工机制

躯体和面孔是个体情绪表达与识别的重要线索。与面部表情相比,躯体表情加工的显著特点是补偿情绪信息,感知运动与行为信息,及产生适应性行为。情绪躯体与面孔加工的神经基础可能相邻或部分重合,但也存在分离;EBA、FBA、SPL、IPL等是与躯体表情加工相关的特异性脑区。今后应系统研究面孔、躯体及语音情绪线索加工潜在的神经基础,探讨躯体情绪加工的跨文化差异,考察情绪障碍患者的躯体表情加工特点。     

A simple computational algorithm of model-based choice preference

A broadly used computational framework posits that two learning systems operate in parallel during the learning of choice preferences—namely, the model-free and model-based reinforcement-learning systems. In this study, we examined another possibility, through which model-free learning is the basic system and model-based information is its modulator. Accordingly, we proposed several modified versions of a temporal-difference learning model to explain the choice-learning process. Using the two-stage decision task developed by Daw, Gershman, Seymour, Dayan, and Dolan (2011), we compared their original computational model, which assumes a parallel learning process, and our proposed models, which assume a sequential learning process. Choice data from 23 participants showed a better fit with the proposed models. More specifically, the proposed eligibility adjustment model, which assumes that the environmental model can weight the degree of the eligibility trace, can explain choices better under both model-free and model-based controls and has a simpler computational algorithm than the original model. In addition, the forgetting learning model and its variation, which assume changes in the values of unchosen actions, substantially improved the fits to the data. Overall, we show that a hybrid computational model best fits the data. The parameters used in this model succeed in capturing individual tendencies with respect to both model use in learning and exploration behavior. This computational model provides novel insights into learning with interacting model-free and model-based components.     

Neurological knowledge and complex behaviors

Some scholars believe thot Cognitive Science is the attempt to achieve in artificial systems what has already been achieved in the brain. Others, by contrast, argue that the study of ideal adaptive mechanisms could go on without reference to the brain. The author points out that the brain may not be the ideal cognitive device because of biological limitotions on its capacity. Although it may not be ideal, it is still of major interest to cognitive scientists because of the great interest in the human mind, and, in addition, because at this moment the brain is the most important single reservoir of odoptive mechanisms. The paper discusses several areas of neuroscience which are likely to shed light on mechanisms of adaptation. The study of simple nervous systems is likely to reveal important design principles of cognitive devices. The study of complex nervous systems will, of course, exert a major influence. The study of such systems leads to certain general principles concerning the neural circuits involved in complex odoptive behaviors: (1) There exist innate specialized systems for the learning of many specific behaviors that at first might appeor to be purely cultural. (2) There is no evidence for the existence of any all-purpose computer in the brain. (3) There are many surprising dissociations manifested by the specialized systems in the brain, e.g., a special system for recognition of faces as against other visual patterns. (4) The study of the nervous system enables one to formulate more precise mechanisms for the role of emotion in cognitive function.(5) Some human behoviors con probably be understood poorly or not at all if the neural substrate is not considered. (6) The cognitive systems designed for dealing with ottentionol processes may be among the most complex neural structures which underlie behavior. There are certain other properties of brains that should be kept in mind by the cognitive scientists who are studying human behovior: (1) Brains differ from each other in structure, and it is very likely that the strategy for the solution of certain problems differs from person to person. (2) The presence of certain innate cognitive strategies in the brain may prevent that organism from employing other strategies which might be optimal for other problems. (3) Any theory about a particular cognitive strategy will have implications as to the particular mode of breakdown that might be expected after brain lesions. The study of disordered function from brain disease may thus be a valuable way to test certain cognitive theories.     

内隐印象更新的心理机制

内隐印象更新表现出比外显印象更新更难、自动化或无意识发生和形成越快更新越快的特点。新近研究发现,相对简单的信息就能导致内隐印象的改变,其中,信息诊断性发挥了关键作用,新信息的强度、可信度、重新解释和归因以及预期刻板信息的一致性均是内隐印象更新的重要发生条件。社会认知维度和效价等因素、动机因素和不同的情绪情感等也对内隐印象更新有影响。进一步揭示内隐与外显印象更新差异的加工机制,探究不同信息要素的作用及印象更新的前因与后效,采用多样化的内隐范式及认知神经科学技术提供更多证据,加强本土化和跨文化比较研究将成为未来研究的重要方向。     

Extended spider cognition

There is a tension between the conception of cognition as a central nervous system (CNS) process and a view of cognition as extending towards the body or the contiguous environment. The centralised conception requires large or complex nervous systems to cope with complex environments. Conversely, the extended conception involves the outsourcing of information processing to the body or environment, thus making fewer demands on the processing power of the CNS. The evolution of extended cognition should be particularly favoured among small, generalist predators such as spiders, and here, we review the literature to evaluate the fit of empirical data with these contrasting models of cognition. Spiders do not seem to be cognitively limited, displaying a large diversity of learning processes, from habituation to contextual learning, including a sense of numerosity. To tease apart the central from the extended cognition, we apply the mutual manipulability criterion, testing the existence of reciprocal causal links between the putative elements of the system. We conclude that the web threads and configurations are integral parts of the cognitive systems. The extension of cognition to the web helps to explain some puzzling features of spider behaviour and seems to promote evolvability within the group, enhancing innovation through cognitive connectivity to variable habitat features. Graded changes in relative brain size could also be explained by outsourcing information processing to environmental features. More generally, niche-constructed structures emerge as prime candidates for extending animal cognition, generating the selective pressures that help to shape the evolving cognitive system.     

Social cognition and the human brain

Humans are exceedingly social animals, but the neural underpinnings of social cognition and behavior are not well understood. Studies in humans and other primates have pointed to several structures that play a key role in guiding social behaviors: the amygdala, ventromedial frontal cortices, and right somatosensory-related cortex, among others. These structures appear to mediate between perceptual representations of socially relevant stimuli, such as the sight of conspecifics, and retrieval of knowledge (or elicitation of behaviors) that such stimuli can trigger. Current debates concern the extent to which social cognition draws upon processing specialized for social information, and the relative contributions made to social cognition by innate and acquired knowledge.     

Limbic-striatal memory systems and drug addiction

Drug addiction can be understood as a pathological subversion of normal brain learning and memory processes strengthened by the motivational impact of drug-associated stimuli, leading to the establishment of compulsive drug-seeking habits. Such habits evolve through a cascade of complex associative processes with Pavlovian and instrumental components that may depend on the integration and coordination of output from several somewhat independent neural systems of learning and memory, each contributing to behavioral performance. Data are reviewed that help to define the influences of conditioned Pavlovian stimuli on goal-directed behavior via sign-tracking, motivational arousal, and conditioned reinforcement. Such influences are mediated via defined corticolimbic-striatal systems converging on the ventral striatum and driving habit-based learning that may depend on the dorsal striatum. These systems include separate and overlapping influences from the amygdala, hippocampus, and cingulate and medial prefrontal cortex on drug-seeking as well as drug-taking behavior, including the propensity to relapse.     

Development of hierarchical structures for actions and motor imagery: a constructivist view from synthetic neuro-robotics study

The current paper shows a neuro-robotics experiment on developmental learning of goal-directed actions. The robot was trained to predict visuo-proprioceptive flow of achieving a set of goal-directed behaviors through iterative tutor training processes. The learning was conducted by employing a dynamic neural network model which is characterized by their multiple time-scale dynamics. The experimental results showed that functional hierarchical structures emerge through stages of developments where behavior primitives are generated in earlier stages and their sequences of achieving goals appear in later stages. It was also observed that motor imagery is generated in earlier stages compared to actual behaviors. Our claim that manipulatable inner representation should emerge through the sensory–motor interactions is corresponded to Piaget’s constructivist view.     

The function of phenomenal states: supramodular interaction theory

Discovering the function of phenomenal states remains a formidable scientific challenge. Research on consciously penetrable conflicts (e.g., "pain-for-gain" scenarios) and impenetrable conflicts (as in the pupillary reflex, ventriloquism, and the McGurk effect [H. McGurk & J. MacDonald, 1976]) reveals that these states integrate diverse kinds of information to yield adaptive action. Supramodular interaction theory proposes that phenomenal states play an essential role in permitting interactions among supramodular response systems--agentic, independent, multimodal, information-processing structures defined by their concerns (e.g., instrumental action vs. certain bodily needs). Unlike unconscious processes (e.g., pupillary reflex), these processes may conflict with skeletal muscle plans, as described by the principle of parallel responses into skeletal muscle (PRISM). Without phenomenal states, these systems would be encapsulated and incapable of collectively influencing skeletomotor action.