Reactivation-dependent amnesia for appetitive memories is determined by the contingency of stimulus presentation

Previously acquired aversive and appetitive memories are not stable and permanent. The reactivation of such memories by re-exposure to training stimuli renders them vulnerable to disruption by amnestic agents such as the noncompetitive N-methyl-D-aspartate receptor antagonist (+)-5-methyl-10,11-dihydro-SH-dibenzo{a,d}cyclohepten-5,10-imine maleate (MK-801). However, relatively little is known about the parameters that influence the reactivation process. Here, we show that the method of stimulus presentation during memory reactivation is of great importance. Male Lister Hooded rats were trained to acquire a lever press response that delivered a sucrose reward paired with a light conditioned stimulus (CS). The CS-sucrose association was then reactivated through re-exposure to the CS, either contingently upon the lever press response, or noncontingently in the absence of instrumental responding. Systemic administration of MK-801 (0.1 mg/kg) at the time of memory reactivation resulted in amnesia, and hence a reduction in subsequent sucrose seeking induced by, and dependent upon, presentation of the CS, only when the memory was reactivated contingently. Therefore, stimuli may have to be presented in the same manner at memory reactivation as during learning in order to render a previously acquired memory vulnerable to disruption. These results have important implications for the potential translational use of glutamatergic treatments in conjunction with targeted memory reactivation.     

Post-learning infusion of anisomycin into the anterior cingulate cortex impairs instrumental acquisition through an effect on reinforcer valuation

The integrity of the rodent anterior cingulate cortex (ACC) is essential for various aspects of instrumental behavior, but it is not clear if the ACC is important for the acquisition of a simple instrumental response. Here, it was demonstrated that post-session infusions of anisomycin into the rat ACC completely prevented the acquisition of instrumental responding. The experimental use of post-session intracranial infusions of plasticity inhibitors is assumed to affect local consolidation of plasticity, but not behavioral task performance. However, in associative appetitive conditioning, post-session intracranial infusion of pharmaco-active compounds could actually interfere with subsequent task performance indirectly through retrospective effects on the valuation of ingested rewards. Thus, it was subsequently demonstrated that the intracranial infusion of anisomycin into the ACC after sucrose pellet consumption significantly reduced subsequent pellet consumption, suggesting that the infusion of anisomycin into the ACC produced conditioned taste avoidance. In the third experiment, an innovative procedure was introduced that dissociated the effects of intracranial infusions after conditioning sessions on task-learning and unconditioned stimulus valuation. With this procedure, the infusion of anisomycin into the ACC after instrumental sessions did not affect instrumental reinforcer valuation or the acquisition of instrumental responding, suggesting that plasticity in the ACC is not necessary for the acquisition of instrumental behavior.The anterior cingulate cortex (ACC) in the rodent brain is the area of association cortex that is most intimately associated with movement control, as it has direct corticospinal projections to motor neurons (Miller 1987) and is intricately connected with motor and premotor cortex (Brecht et al. 2004; Wang et al. 2008), and movement-related discharges in motivated tasks have been observed in the ACC (Jung et al. 1998; Kargo et al. 2007). On the basis of these findings, the ACC has been described as the limbic motor cortex (Craig 2003). Indeed, it has been demonstrated that neural activity in the ACC codes for performed actions and observed appetitive outcomes (Lapish et al. 2008), suggesting that the ACC could be important for instrumental conditioning. However, it is currently unclear whether the role of the ACC in instrumental conditioning is restricted to relatively complex instrumental tasks with response conflict (Lapish et al. 2008) and high response efforts (Rudebeck et al. 2006), or whether it extends generally to the acquisition of a simple appetitively motivated instrumental response as well. For example, it has been reported that the acquisition of instrumental responding under variable ratio 2 schedule of reinforcement was impaired after presession intra-ACC infusions of the N-methyl-d-aspartate (NMDA) receptor antagonist AP-5 (McKee et al. 2007).However, the practical investigation of the neural basis of learning is complicated by what can be considered as “side effects” of manipulations that are intended to interfere selectively with learning mechanisms. Both pretraining lesions and presession infusions of pharmacological agents into specific brain regions can produce interference with basic task performance in addition to impairing task-related learning. This problem can be overcome by the use of infusions of pharmacological agents after a behavioral conditioning session, specifically to target the consolidation of learning. Positive effects of post-session intracranial infusions of protein synthesis inhibitors such as anisomycin (Rosenblum et al. 1993), or NMDA, and dopamine receptor antagonists such as AP-5 or SCH 23390 (Dalley et al. 2005) on the acquisition of conditioned responses can be interpreted more confidently in terms of interference with learning, at least when combined with negative effects in delayed-infusion control groups. Certainly, positive effects of post-session infusions on learning in the absence of effects of delayed control infusions cannot be attributed to interference with task performance.Nevertheless, post-session intracranial infusions may still cause confounding effects on conditioned behavior in appetitive conditioning experiments, by changing the valuation of the unconditioned stimulus (US), or reward, in subsequent sessions. Such manipulations could reduce the valuation of rewards either through interference with consolidation or reconsolidation of the sensory or motivational properties of the US (Wang et al. 2005; Pedroza-Llinás et al. 2009), which would lead to persistent neophobia, or through retrospective devaluation of the task reward through the post-ingestion induction of an aversive state. Neither effect would be expected to be apparent in delayed-infusion control conditions. Furthermore, considering that animals typically earn far fewer rewards in conditioning sessions than they would maximally consume if rewards were freely available, such effects would not necessarily be visible in terms of consumption of earned rewards and unaffected latencies to collect rewards.In view of these considerations, the effect of the infusion of anisomycin into the rat ACC after instrumental sessions on the acquisition of conditioned responding was investigated. Based on the obtained results, it was further investigated whether the infusion of anisomycin into the ACC after free consumption of a novel reward would affect subsequent pellet consumption. Finally, a third experiment was conducted that introduced an innovative procedure that was designed to dissociate the effects of intracranial infusion of protein synthesis inhibitors after conditioning sessions on task-learning and US valuation.     

Limbic-striatal memory systems and drug addiction

Drug addiction can be understood as a pathological subversion of normal brain learning and memory processes strengthened by the motivational impact of drug-associated stimuli, leading to the establishment of compulsive drug-seeking habits. Such habits evolve through a cascade of complex associative processes with Pavlovian and instrumental components that may depend on the integration and coordination of output from several somewhat independent neural systems of learning and memory, each contributing to behavioral performance. Data are reviewed that help to define the influences of conditioned Pavlovian stimuli on goal-directed behavior via sign-tracking, motivational arousal, and conditioned reinforcement. Such influences are mediated via defined corticolimbic-striatal systems converging on the ventral striatum and driving habit-based learning that may depend on the dorsal striatum. These systems include separate and overlapping influences from the amygdala, hippocampus, and cingulate and medial prefrontal cortex on drug-seeking as well as drug-taking behavior, including the propensity to relapse.     

The basolateral amygdala and nucleus accumbens core mediate dissociable aspects of drug memory reconsolidation

A distributed limbic-corticostriatal circuitry is implicated in cue-induced drug craving and relapse. Exposure to drug-paired cues not only precipitates relapse, but also triggers the reactivation and reconsolidation of the cue-drug memory. However, the limbic cortical-striatal circuitry underlying drug memory reconsolidation is unclear. The aim of this study was to investigate the involvement of the nucleus accumbens core and the basolateral amygdala in the reconsolidation of a cocaine-conditioned stimulus-evoked memory. Antisense oligodeoxynucleotides (ASO) were infused into each structure to knock down the expression of the immediate-early gene zif268, which is known to be required for memory reconsolidation. Control infusions used missense oligodeoxynucleotides (MSO). The effects of zif268 knockdown were measured in two complementary paradigms widely used to assess the impact of drug-paired CSs upon drug seeking: the acquisition of a new instrumental response with conditioned reinforcement and conditioned place preference. The results show that both intranucleus accumbens core and intrabasolateral amygdala zif268 ASO infusions at memory reactivation impaired the reconsolidation of the memory underlying a cocaine-conditioned place preference. However, knockdown of zif268 in the nucleus accumbens at memory reactivation had no effect on the memory underlying the conditioned reinforcing properties of the cocaine-paired CS measured subsequently, and this is in contrast to the marked impairment observed previously following intrabasolateral amygdala zif268 ASO infusions. These results suggest that both the basolateral amygdala and nucleus accumbens core are key structures within limbic cortical-striatal circuitry where reconsolidation of a cue-drug memory occurs. However reconsolidation of memory representations formed during Pavlovian conditioning are differentially localized in each site.Through Pavlovian association with the effects of addictive drugs, a conditioned stimulus (CS) acquires both general motivational and sensory-specific conditioned reinforcing properties (Everitt et al. 2000). These associations contribute to the high likelihood of relapse in addicted individuals, yet the extinction of drug CSs by nonreinforced exposure has proved to be of limited therapeutic utility (Conklin and Tiffany 2002). In abstinent humans, drug CSs evoke salient and persistent memories of drug-taking experiences, inducing craving and relapse (Childress et al. 1988; O''Brien et al. 1992), while in animals they also precipitate relapse to, or reinstatement of, drug-seeking behavior (de Wit and Stewart 1981; Meil and See 1996; Fuchs et al. 1998; Weiss 2000). Thus, disrupting drug-related memories might significantly diminish relapse propensity on subsequent exposure to drug-paired CSs, and thereby promote abstinence.Exposure to a drug-associated CS also triggers a process of memory reconsolidation, which restabilizes the reactivated and labile memory (Nader 2003). While reconsolidation may adaptively update memories (Dudai 2006; Hupbach et al. 2007; Rossato et al. 2007; Lee 2009), its disruption may reduce the impact of intrusive or aberrant memories on behavior subsequently (Lee et al. 2005, 2006; Brunet et al. 2008; Kindt et al. 2009; Taubenfeld et al. 2009). The reconsolidation of CS–cocaine memories has been shown to depend upon protein synthesis and expression of the plasticity-associated immediate-early gene, zif268, in the basolateral amygdala (BLA), since zif268 knockdown at memory reactivation disrupted the acquired conditioned reinforcing properties of the CS measured in drug-seeking tasks days or weeks later (Lee et al. 2005, 2006).Although the BLA has an established role in CS-drug memory reconsolidation, it remains unclear whether other sites within limbic cortical-ventral striatal circuitry participate in this process. The nucleus accumbens core (AcbC) is a primary candidate, as zif268 is up-regulated in the AcbC as well as in the BLA following exposure to cocaine CSs (Thomas et al. 2003). Furthermore, the AcbC, which is strongly implicated in Pavlovian influences on drug seeking and relapse (Cardinal et al. 2002; Kalivas and McFarland 2003), has been shown to be a site where the reconsolidation of a drug conditioned place preference (CPP) memory can be disrupted (Miller and Marshall 2005).Given the evidence of increased zif268 expression in the AcbC following CS-drug memory reactivation, we investigated its requirement in the reconsolidation of cocaine-associated memories. To address this issue, we employed two different but complementary paradigms widely used to measure the conditioned effects of CSs associated with drugs of abuse: the acquisition of a new instrumental response with conditioned reinforcement (ANR) and CPP. These procedures have been used successfully to investigate the mechanisms underlying the reconsolidation of appetitive Pavlovian memories, but it is likely that they depend upon different associative mechanisms (Everitt et al. 1991; White and McDonald 1993) that in turn depend upon different neural loci within limbic cortical-striatal circuitry (Cardinal et al. 2002). Therefore, to enable a full comparison with the functional involvement of the BLA, we investigated the necessity for BLA zif268 expression in drug memory reconsolidation as assessed in the CPP paradigm.     

Acquisition of instrumental conditioned reinforcement is resistant to the devaluation of the unconditioned stimulus

The associative mechanisms responsible for the efficacy of Pavlovian stimuli during first- and second-order conditioning have been extensively studied, but little is known about the representations underlying instrumental conditioned reinforcement. The present study investigated the associative structure underlying conditioned reinforcement, by employing an unconditioned stimulus (US) devaluation procedure on a commonly used instrumental task: the acquisition of a new response with conditioned reinforcement. Whilst US-directed behaviour was abolished following devaluation, the conditioned stimulus acting as a conditioned reinforcer supported the acquisition of instrumental responding. In this preparation then, the conditioned reinforcer appears to be impervious to devaluation of its associated US, suggesting that the underlying representation maintaining behaviour is independent of the current value of the US and may reflect the activation of a central appetitive motivational state.