Memory influences on hippocampal and striatal neural codes: effects of a shift between task rules

Interactions with neocortical memory systems may facilitate flexible information processing by hippocampus. We sought direct evidence for such memory influences by recording hippocampal neural responses to a change in cognitive strategy. Well-trained rats switched (within a single recording session) between the use of place and response strategies to solve a plus maze task. Maze and extramaze environments were constant throughout testing. Place fields demonstrated (in-field) firing rate and location-based reorganization [Leutgeb, S., Leutgeb, J. K., Barnes, C. A., Moser, E. I., McNaughton, B. L., & Moser, M. B. (2005). Independent codes for spatial and episodic memory in hippocampal neuronal ensembles. Science, 309, 619-623] after a task switch, suggesting that hippocampus encoded each phase of testing as a different context, or episode. The task switch also resulted in qualitative and quantitative changes to discharge that were correlated with an animal's velocity or acceleration of movement. Thus, the effects of a strategy switch extended beyond the spatial domain, and the movement correlates were not passive reflections of the current behavioral state. To determine whether hippocampal neural responses were unique, striatal place and movement-correlated neurons were simultaneously recorded with hippocampal neurons. Striatal place and movement cells exhibited a response profile that was similar, but not identical, to that observed for hippocampus after a strategy switch. Thus, retrieval of a different memory led both neural systems to represent a different context. However, hippocampus may play a special (though not exclusive) role in flexible spatial processing since correlated firing amongst cell pairs was highest when rats successfully switched between two spatial tasks. Correlated firing by striatal cell pairs increased following any strategy switch, supporting the view that striatum codes change in reinforcement contingencies.     

The effects of hippocampal lesions on learning, memory, and reward expectancies

The hippocampus appears to be critical for the formation of certain types of memories. Hippocampal-lesioned animals fail to exhibit some spatial, contextual, and relational associations. After aspiration lesions of the hippocampus and/or cortex, male rats were allowed to recover for three weeks before being trained on a matching-to-position task. The matching-to-position task was altered to influence the type of cognitive strategies a subject would use to solve the task. The main behavioral manipulation was the reinforcement contingency assignment: Use of a differential outcomes procedure (DOP) or a nondifferential outcomes procedure (NOP). The DOP involves correlating each to-be-remembered event with a distinct reward condition via Pavlovian trace conditioning, whereas the NOP results in random reward contingency. We found that hippocampal lesions did retard learning the matching rule, regardless of the reinforcement contingency assignment. However, when delay intervals were added to the task memory performance of subjects with hippocampal lesions was dramatically impaired--if subjects were not trained with the DOP. When subjects were trained with the DOP, the hippocampal lesion had a marginal effect on delayed memory performance. These findings demonstrate two important points regarding lesions of the hippocampus: (1) hippocampal lesions have a minimal effect on the on the ability of rats to use reward information to solve a delayed discrimination task; (2) rats with hippocampal lesions have the ability to learn about reward information using Pavlovian trace conditioning procedures.     

Implicit Learning in Aging: Extant Patterns and New Directions

Research suggests that the striatum plays an important role in implicit learning (IL). The striatum exhibits marked age-related morphological and neurochemical losses. Yet, behavioral studies suggest that IL is generally well preserved in old age, and that age-related differences emerge only when highly complex IL tasks are used. In this review, we integrate behavioral and neuroimaging evidence on IL in aging. We suggest that relative stability of IL in old age may reflect neural reorganization that compensates for age-related losses in striatal functions. Specifically, there may be an age-related increase in reliance on extrastriatal regions (e.g., medial-temporal, frontal) during IL. This reorganization of function may be beneficial under less taxing performance conditions, but not when task demands become more challenging.     

Evidence of a role for multiple memory systems in behavioral extinction

The acquisition of learned behavior involves multiple memory systems, and hippocampal system damage impairs cognitive learning while leaving stimulus-response habit learning intact. In view of evidence that extinction also involves new learning, the present experiments examined whether multiple memory systems theory may be applicable to the neural bases of extinction. Adult Long-Evans rats were trained to run in a straight-alley maze for food reward. Twenty-four hours later, rats matched for runway latencies during acquisition received extinction training. In a response extinction condition conducive to habit learning, rats performed a runway approach response to an empty food cup. In a latent extinction condition conducive to cognitive learning, rats were placed at an empty food cup without performing a runway approach response. Prior to daily extinction training, neural activity of the dorsal hippocampus was reversibly inactivated via infusion of bupivacaine (0.75%, 0.5 microl/side). Control rats receiving saline infusions displayed extinction behavior in both the response and latent training conditions. In contrast, rats receiving bupivacaine extinguished normally in the response condition, but did not display latent extinction. The findings (1) confirm that learning underlying extinction of the same overt behavior can occur with or without explicit performance of the previously acquired response, (2) indicate that extinction learning produced by response and latent training procedures can be neuroanatomically dissociated, and (3) suggest that similarly to initial task acquisition, the hippocampus may critically mediate extinction in situations requiring the use of cognitive learning, such as when performance of a previously acquired response habit is prevented.     

Differential interaction of platelet-activating factor and NMDA receptor function in hippocampal and dorsal striatal memory processes

The interaction between platelet activating factor (PAF) and NMDA receptor function in hippocampal and dorsal striatal memory processes was examined. In both a hidden and a visible platform water maze task, peripheral post-training injection of MK-801 (0.05 mg/kg) impaired memory. Post-training intrahippocampal infusions of PAF (1.0 microg/0.5 microl) enhanced memory in the hidden platform task, while intradorsal striatal infusion of PAF (1.0 microg/0.5 microl) enhanced memory in the visible platform task. The memory impairing effects of post-training injection of MK-801 was blocked by concurrent intrahippocampal infusion of PAF. In contrast, post-training injection of MK-801 blocked the memory enhancing effects of concurrent intradorsal striatal infusion of PAF. The results suggest that (1) the memory enhancing effects of intracerebral PAF infusion involve an interaction with NMDA receptor function, and (2) the nature of this interaction may represent a differential mechanism mediating the distinct roles of the hippocampus and dorsal striatum in cognitive memory and stimulus-response habit formation, respectively.     

Fluctuations in brain glucose concentration during behavioral testing: dissociations between brain areas and between brain and blood

Traditional beliefs about two aspects of glucose regulation in the brain have been challenged by recent findings. First, the absolute level of glucose in the brain's extracellular fluid appears to be lower than previously thought. Second, the level of glucose in brain extracellular fluid is less stable than previously believed. In vivo brain microdialysis was used, according to the method of zero net flux, to determine the basal concentration of glucose in the extracellular fluid of the striatum in awake, freely moving rats for comparison with recent hippocampal measurements. In addition, extracellular glucose levels in both the hippocampus and the striatum were measured before, during, and after behavioral testing in a hippocampus-dependent spontaneous alternation task. In the striatum, the resting extracellular glucose level was 0.71 mM, approximately 70% of the concentration measured previously in the hippocampus. Consistent with past findings, the hippocampal extracellular glucose level decreased by up to 30 +/- 4% during testing; no decrease, and in fact a small increase (9 +/- 3%), was seen in the striatum. Blood glucose measurements obtained during the same testing procedure and following administration of systemic glucose at a dose known to enhance memory in this task revealed a dissociation in glucose level fluctuations between the blood and both striatal and hippocampal extracellular fluid. These findings suggest, first, that glucose is compartmentalized within the brain and, second, that one mechanism by which administration of glucose enhances memory performance is via provision of increased glucose supply from the blood specifically to those brain areas involved in mediating that performance.     

The use of acute ethanol administration as a tool to investigate multiple memory systems

The discovery of multiple memory systems supported by discrete brain regions has been one of the most important advances in behavioral neuroscience. A wealth of studies have investigated the role of the hippocampus and related structures in supporting various types of memory classifications. While the exact classification that best describes hippocampal function is often debated, a specific subset of cognitive function that is focused on the use of spatial information to form hippocampal cognitive maps has received extensive investigation. These studies frequently employ a variety of experimental manipulations including brain lesions, temporary neural blockade due to cooling or discrete injections of specific drugs. While these studies have provided important insights into the function of the hippocampus, they are limited due to the invasive nature of the manipulation. Ethanol is a drug that is easily administered in a non-invasive fashion, is rapidly absorbed and produces effects only in specific brain regions. The hippocampus is one brain region affected by acute ethanol administration. The following review summarizes research from the last 20 years investigating the effects of acute ethanol administration on one specific type of hippocampal cognitive function, namely spatial memory. It is proposed that among its many effects, one specific action of acute ethanol administration is to produce similar cognitive and neurophysiological effects as lesions of the hippocampus. Based on these similarities and the ease of its use, it is concluded that acute ethanol administration is a valuable tool in studying hippocampal function and multiple memory systems.     

Blunted hippocampal, but not striatal, acetylcholine efflux parallels learning impairment in diencephalic-lesioned rats

A rodent model of diencephalic amnesia, pyrithiamine-induced thiamine deficiency (PTD), was used to investigate the dynamic role of hippocampal and striatal acetylcholine (ACh) efflux across acquisition of a nonmatching-to-position (NMTP) T-maze task. Changes in ACh efflux were measured in rats at different time points in the acquisition curve of the task (early=day 1, middle=day 5, and late=day 10). Overall, the control group had higher accuracy scores than the PTD group in the latter sessions of NMTP training. During the three microdialysis sampling points, all animals displayed significant increases in ACh efflux in both hippocampus and striatum, while performing the task. However, on day 10, the PTD group showed a significant behavioral impairment that paralleled their blunted hippocampal--but not striatal--ACh efflux during maze training. The results support selective diencephalic-hippocampal dysfunction in the PTD model. This diencephalic-hippocampal interaction appears to be critical for successful episodic and spatial learning/memory.     

Neural coding of reward magnitude in the orbitofrontal cortex of the rat during a five-odor olfactory discrimination task

The orbitofrontal cortex (OBFc) has been suggested to code the motivational value of environmental stimuli and to use this information for the flexible guidance of goal-directed behavior. To examine whether information regarding reward prediction is quantitatively represented in the rat OBFc, neural activity was recorded during an olfactory discrimination “go”/“no-go” task in which five different odor stimuli were predictive for various amounts of reward or an aversive reinforcer. Neural correlates related to both actual and expected reward magnitude were observed. Responses related to reward expectation occurred during the execution of the behavioral response toward the reward site and within a waiting period prior to reinforcement delivery. About one-half of these neurons demonstrated differential firing toward the different reward sizes. These data provide new and strong evidence that reward expectancy, regardless of reward magnitude, is coded by neurons of the rat OBFc, and are indicative for representation of quantitative information concerning expected reward. Moreover, neural correlates of reward expectancy appear to be distributed across both motor and nonmotor phases of the task.     

Learning of novel semantic relationships via sudden comprehension is associated with a hippocampus-independent network

Sudden comprehension—or insight—during problem-solving can enhance learning, but the underlying neural processes are largely unknown. We investigated neural correlates of learning from sudden comprehension using functional magnetic resonance imaging and a verbal problem-solving task. Solutions and “solutions” to solvable and unsolvable verbal problems, respectively, were presented to induce sudden comprehension or continued incomprehension. We found activations of the hippocampus, medial prefrontal cortex (mPFC), amygdala, and striatum during sudden comprehension. Notably, however, mPFC and temporo-parietal neocortical structures rather than the hippocampus were associated with later learning of suddenly comprehended solutions. Moreover, difficult compared to easy sudden comprehension elicited midbrain activations and was associated with successful learning, pointing to learning via intrinsic reward. Sudden comprehension of novel semantic associations may constitute a special case of long-term memory formation primarily mediated by the mPFC, expanding our knowledge of its role in prior-knowledge-dependent memory.     

Leverpress escape/avoidance training increases neurotrophin levels in rat brain

In addition to their well-known role in neural development, the neurotrophins BDNF and NGF help mediate the plasticity that occurs in the brain to promote learning. Exposure to learning procedures often leads to increases in neurotrophins, while exposure to stress often results in decreases. It is unclear how the neurotrophins would respond to an aversive learning task. Therefore, BDNF and NGF content in the dorsal striatum, hippocampus, and basal forebrain was measured following discrete trial lever-press escape/avoidance conditioning. Conditioning significantly increased levels of both neurotrophins in hippocampus and basal forebrain, relative to home cage controls (HCC). Contrary to expectations, the dorsal striatum did not show any significant changes. However, significant correlations were observed between dorsal striatal neurotrophins and aspects of avoidance performance. This may indicate that the dorsal striatum is involved in the performance aspects of the task. Results are discussed in terms of the role of neurotrophins in the acquisition of new information, and the neural structures involved in different types of memory.     

Leverpress Escape/Avoidance Training Increases Neurotrophin Levels in Rat Brain

In addition to their well-known role in neural development, the neurotrophins BDNF and NGF help mediate the plasticity that occurs in the brain to promote learning. Exposure to learning procedures often leads to increases in neurotrophins, while exposure to stress often results in decreases. It is unclear how the neurotrophins would respond to an aversive learning task. Therefore, BDNF and NGF content in the dorsal striatum, hippocampus, and basal forebrain was measured following discrete trial lever-press escape/avoidance conditioning. Conditioning significantly increased levels of both neurotrophins in hippocampus and basal forebrain, relative to home cage controls (HCC). Contrary to expectations, the dorsal striatum did not show any significant changes. However, significant correlations were observed between dorsal striatal neurotrophins and aspects of avoidance performance. This may indicate that the dorsal striatum is involved in the performance aspects of the task. Results are discussed in terms of the role of neurotrophins in the acquisition of new information, and the neural structures involved in different types of memory.     

GABA, glutamate, dopamine and serotonin transporters expression on memory formation and amnesia

Notwithstanding several neurotransmission systems are frequently related to memory formation, amnesia and/or therapeutic targets for memory alterations, the role of transporters γ-aminobutyric acid (GABA, GAT1), glutamate (neuronal glutamate transporter excitatory amino acid carrier; EACC1), dopamine (DAT) and serotonin (SERT) is poorly understood. Hence, in this paper Western-blot analysis was used to evaluate expression changes on them during memory formation in trained and untrained rats treated with the selective serotonin transporter inhibitor fluoxetine, the amnesic drug d-methamphetamine (METH) and fluoxetine plus METH. Transporters expression was evaluated in the hippocampus, prefrontal cortex and striatum. Data indicated that in addition of memory performance other behavioral parameters (e.g., explorative behavior, food-intake, etc.) that memory formation was recorded. Thus, memory formation in a Pavlovian/instrumental autoshaping was associated to up-regulation of prefrontal cortex GAT1 and EAAC1, striatal SERT, DAT and EACC1; while, hippocampal EACC1, GAT1 and SERT were down-regulated. METH impaired short (STM) and long-term memory (LTM), at 24 or 48h. The METH-induced amnesia down-regulated SERT, DAT, EACC1 and GAT1 in hippocampus and the GAT1 in striatum; no-changes were observed in prefrontal cortex. Post-training administration of fluoxetine improved LTM (48h), which was associated to DAT, GAT1 (prefrontal cortex) up-regulation, but GAT1 (striatum) and SERT (hippocampus) down-regulation. Fluoxetine plus METH administration was able to prevent amnesia, which was associated to DAT, EACC1 and GAT1 (prefrontal cortex), SERT and DAT (hippocampus) and EACC1 or DAT (striatal) up-regulation. Together these data show that memory formation, amnesia and anti-amnesic effects are associated to specific patters of transporters expression.     

Peers influence adolescent reward processing,but not response inhibition

Most adolescent risk taking occurs in the presence of peers. Prior research suggests that peers alter adolescents’ decision making by increasing reward sensitivity and the engagement of regions involved in the processing of rewards, primarily the striatum. However, the potential influence of peers on the capacity for impulse control, and the associated recruitment of the brain’s control circuitry, has not yet been adequately examined. In the current study, adolescents underwent functional neuroimaging while they completed interleaved rounds of risk-taking and response-inhibition tasks. Social context was manipulated such that the participants believed they were either playing alone and unobserved, or watched by an anonymous peer. Compared to those who completed the tasks alone, adolescents in the peer condition took more risks during the risk-taking task and exhibited relatively heightened activation of the striatum. Activity within this striatal region also predicted individual differences in overall risk taking. In contrast, the presence of peers had no effect on behavioral response inhibition and had minimal impact on the engagement of typical cognitive control regions. In a subregion of the anterior insula engaged mutually by both tasks, activity was again found to be sensitive to social context during the risk-taking task, but not during the response-inhibition task. These findings extend the evidence that the presence of peers biases adolescents towards risk taking by increasing reward sensitivity rather than disrupting cognitive control.     

The roles of the medial prefrontal cortex and hippocampus in a spatial paired-association task

Although the roles of both the hippocampus and the medial prefrontal cortex (mPFC) have been suggested in a spatial paired-associate memory task, both areas were investigated separately in prior studies. The current study investigated the relative contributions of the hippocampus and mPFC to spatial paired-associate learning within a single behavioral paradigm. In a novel behavioral task, a pair of different objects appeared repeatedly across trials, but in different arms in a radial maze, and different rules were associated with those arms for reward. Specifically, in an "object-in-place" arm, the rat was required to choose a particular object associated with the arm. In a "location-in-place" arm, the animal was required to choose a certain within-arm location (ignoring the object occupying the location). Compared to normal animals, rats with ibotenic acid-based lesions in the hippocampus showed an irrecoverable impairment in performance in both object-in-place and location-in-place arms. When the mPFC was inactivated by muscimol (GABA(A) receptor agonist) in the normal animals with intact hippocampi, they showed the same severe impairment as seen in the hippocampal lesioned rats only in object-in-place arms. The results confirm that the hippocampus is necessary for a biconditional paired-associate task when space is a critical component. The mPFC, however, is more selectively involved in the object-place paired-associate task than in the location-place paired-associate task. The current task powerfully demonstrates an experimental situation in which both the hippocampus and mPFC are required and may serve as a useful paradigm for investigating the neural mechanisms of object-place association.     

Remodeling of hippocampal mossy fibers is selectively induced seven days after the acquisition of a spatial but not a cued reference memory task

Relating storage of specific information to a particular neuromorphological change is difficult because behavioral performance factors are not readily disambiguated from underlying cognitive processes. This issue is addressed here by demonstrating robust reorganization of the hippocampal mossy fiber terminal field (MFTF) when adult rats learn the location of a hidden platform but not when rats learn to locate a visible platform. Because the latter task requires essentially the same behavioral performance as the former, the observed MFTF growth is seen as the consequence of specific input-dependent hippocampal activity patterns selectively generated by processing of extramaze but not intramaze cues. Successful performance on the hidden platform task requires formation of spatial memory. Increased MFTFs in hidden platform-trained rats are observed 7 d but not 2 d after training nor in swim controls. These results suggest that structural plasticity of the mossy fiber:CA3 circuit may contribute to the maintenance of long-lasting memory but not to the initial storage of the spatial context.     

Neural evidence supports a novel framework for spatial navigation

The spatial knowledge used for human navigation has traditionally been separated into three categories: landmark, route, and survey knowledge. While behavioral research has retained this framework, it has become increasingly clear from recent neuroimaging studies that such a classification system is not adequate for understanding the brain. This review proposes a new framework, with a taxonomy based on the cognitive processes and subprocesses involved in spatial navigation. The neural correlates of spatial memory can inform our understanding of the cognitive processes involved in human navigation, and conversely, the specific task demands of an experiment can inform the interpretation of neuroimaging results. This review examines the neural correlates of each cognitive process separately, to provide a closer inspection of each component of spatial navigation. While landmark, route, and survey knowledge are still important components of human navigation, the neural correlates are not neatly ascribed to these three categories. The present findings provide motivation for a more detailed examination of the cognitive processes engaged during wayfinding.     

Rats depend on habit memory for discrimination learning and retention

We explored the circumstances in which rats engage either declarative memory (and the hippocampus) or habit memory (and the dorsal striatum). Rats with damage to the hippocampus or dorsal striatum were given three different two-choice discrimination tasks (odor, object, and pattern). These tasks differed in the number of trials required for learning (~10, 60, and 220 trials). Dorsal striatum lesions impaired discrimination performance to a greater extent than hippocampal lesions. Strikingly, performance on the task learned most rapidly (the odor discrimination) was severely impaired by dorsal striatum lesions and entirely spared by hippocampal lesions. These findings suggest that discrimination learning in the rat is primarily supported by the dorsal striatum (and habit memory) and that rats engage a habit-based memory system even for a task that takes only a few trials to acquire. Considered together with related studies of humans and nonhuman primates, the findings suggest that different species will approach the same task in different ways.     

Muscarinic cholinergic influences in memory consolidation

The central cholinergic system and muscarinic cholinergic receptor (mR) activation have long been associated with cognitive function. Although mR activation is no doubt involved in many aspects of cognitive functioning, the extensive evidence that memory is influenced by cholinergic treatments given after training either systemically or intra-cranially clearly indicates that cholinergic activation via mRs is a critical component in modulation of memory consolidation. Furthermore, the evidence indicates that activation of mRs in the basolateral amygdala (BLA) plays an essential role in enabling other neuromodulatory influences on memory consolidation. Memory can also be affected by posttraining activation of mRs in the hippocampus, striatum and cortex. Evidence of increases in hippocampal and cortical acetylcholine (ACh) levels following learning experiences support the view that endogenous ACh release is involved in long-term memory consolidation. Furthermore, the findings indicating that mR drug treatments influence plasticity in the hippocampus and in sensory cortices strongly suggest that mR activation is involved in the storage of information in these brain regions.     

Differential induction of c-Jun and Fos-like proteins in rat hippocampus and dorsal striatum after training in two water maze tasks

Research examining the neuroanatomical bases of memory in mammals suggests that the hippocampus and dorsal striatum are parts of independent memory systems that mediate "cognitive" and stimulus-response "habit" memory, respectively. At the molecular level, increasing evidence indicates a role for immediate early gene (IEG) expression in memory formation. The present experiment examined whether acquisition of cognitive and habit memory result in differential patterns of IEG protein product expression in these two brain structures. Adult male Long-Evans rats were trained in either a hippocampal-dependent spatial water maze task, or a dorsal striatal-dependent cued water maze task. Ninety minutes after task acquisition, brains were removed and processed for immunocytochemical procedures, and the number of cells expressing Fos-like immunoreactivity (Fos-like-IR) and c-Jun-IR in sections from the dorsal hippocampus and the dorsal striatum were counted. In the dorsal hippocampus of rats trained in the spatial task, there were significantly more c-Jun-IR pyramidal cells in the CA1 and CA3 regions, relative to rats that had acquired the cued task, yoked controls (free-swim), or na?ve (home cage) rats. Relative to rats receiving cued task training and control conditions, increases in Fos-like IR were also observed in the CA1 region of rats trained in the spatial task. In rats that had acquired the cued task, patches of c-Jun-IR were observed in the posteroventral striatum; no such patches were evident in rats trained in the spatial task, yoked-control rats, or na?ve rats. The results demonstrate that IEG protein product expression is up-regulated in a task-dependent and brain structure-specific manner shortly after acquisition of cognitive and habit memory tasks.