Context-dependent olfactory learning monitored by activities of salivary neurons in cockroaches

Context-dependent discrimination learning, a sophisticated form of nonelemental associative learning, has been found in many animals, including insects. The major purpose of this research is to establish a method for monitoring this form of nonelemental learning in rigidly restrained insects for investigation of underlying neural mechanisms. We report context-dependent olfactory learning (occasion-setting problem solving) of salivation, which can be monitored as activity changes of salivary neurons in immobilized cockroaches, Periplaneta americana. A group of cockroaches was trained to associate peppermint odor (conditioned stimulus, CS) with sucrose solution reward (unconditioned stimulus, US) while vanilla odor was presented alone without pairing with the US under a flickering light condition (1.0 Hz) and also trained to associate vanilla odor with sucrose reward while peppermint odor was presented alone under a steady light condition. After training, the responses of salivary neurons to the rewarded peppermint odor were significantly greater than those to the unrewarded vanilla odor under steady illumination and those to the rewarded vanilla odor was significantly greater than those to the unrewarded peppermint odor in the presence of flickering light. Similar context-dependent responses were observed in another group of cockroaches trained with the opposite stimulus arrangement. This study demonstrates context-dependent olfactory learning of salivation for the first time in any vertebrate and invertebrate species, which can be monitored by activity changes of salivary neurons in restrained cockroaches.     

Salivary conditioning with antennal gustatory unconditioned stimulus in an insect

Classical conditioning of olfactory conditioning stimulus (CS) with gustatory unconditioned stimulus (US) in insects has been used as a pertinent model for elucidation of neural mechanisms underlying learning and memory. However, a conditioning system in which stable intracellular recordings from brain neurons are feasibly obtained while monitoring the conditioning effect has remained to be established. Recently, we found classical conditioning of salivation in cockroaches Periplaneta americana, in which an odor was associated with sucrose solution applied to the mouth, and this conditioning could be monitored by activities of salivary neurons. Application of gustatory US to the mouth, however, leads to feeding movement accompanying a movement of the brain that prevents stable recordings from brain neurons. Here we investigated whether a gustatory stimulus presented to an antenna could serve as an effective US for producing salivary conditioning. Presentation of sucrose or sodium chloride solution to an antenna induced salivation and also increased activities of salivary neurons. A single pairing trial of an odor with antennal presentation of sucrose or sodium chloride solution produced conditioning of salivation or of activities of salivary neurons. Five pairing trials led to a conditioning effect that lasted for one day. Water or tactile stimulus presented to an antenna was not effective for producing conditioning. The results demonstrate that gustatory US presented to an antenna is as effective as that presented to the mouth for producing salivary conditioning. This conditioning system provides a useful model for studying the neural basis of learning at the level of singly identifiable neurons.     

Synaptic plasticity in the lateral amygdala: a cellular hypothesis of fear conditioning

Fear conditioning is a form of associative learning in which subjects come to express defense responses to a neutral conditioned stimulus (CS) that is paired with an aversive unconditioned stimulus (US). Considerable evidence suggests that critical neural changes mediating the CS-US association occur in the lateral nucleus of the amygdala (LA). Further, recent studies show that associative long-term potentiation (LTP) occurs in pathways that transmit the CS to LA, and that drugs that interfere with this LTP also disrupt behavioral fear conditioning when infused into the LA, suggesting that associative LTP in LA might be a mechanism for storing memories of the CS-US association. Here, we develop a detailed cellular hypothesis to explain how neural responses to the CS and US in LA could induce LTP-like changes that store memories during fear conditioning. Specifically, we propose that the CS evokes EPSPs at sensory input synapses onto LA pyramidal neurons, and that the US strongly depolarizes these same LA neurons. This depolarization, in turn, causes calcium influx through NMDA receptors (NMDARs) and also causes the LA neuron to fire action potentials. The action potentials then back-propagate into the dendrites, where they collide with CS-evoked EPSPs, resulting in calcium entry through voltage-gated calcium channels (VGCCs). Although calcium entry through NMDARs is sufficient to induce synaptic changes that support short-term fear memory, calcium entry through both NMDARs and VGCCs is required to initiate the molecular processes that consolidate synaptic changes into a long-term memory.     

Integrative Properties of the Pe1 Neuron, a Unique Mushroom Body Output Neuron

A mushroom body extrinsic neuron, the Pe1 neuron, connects the peduncle of the mushroom body (MB) with two areas of the protocerebrum in the honeybee brain, the lateral protocerebral lobe (LPL) and the ring neuropil around the α-lobe. Each side of the bee brain contains only one Pe1 neuron. Using a combination of intracellular recording and neuroanatomical techniques we analyzed its properties of integrative processing of the different sensory modalities. The Pe1 neuron responds to visual, mechanosensory, and olfactory stimuli. The responses are broadly tuned, consisting of a sustained increase of spike frequency to the onset and offset of light flashes, to horizontal and vertical movements of extended objects, to mechanical stimuli applied to the antennae or mouth parts, and to all olfactory stimuli tested (29 chemicals). These multisensory properties are reflected in its dendritic organization. Serial reconstructions of intracellularly stained Pe1 neurons using confocal microscopy reveal that the Pe1 neuron arborizes throughout all layers of MB peduncle with finger-like, vertically oriented dendrites. The peduncle of the MB is formed by the axons of Kenyon cells, whose dendritic inputs are organized in modality-specific subcompartments of the calyx region. The peduncular arborization indicates that the Pe1 neuron receives input from Kenyon cells of all calycal subcompartments. Because the Pe1 neuron changes its odor responses transiently as a consequence of olfactory learning, we hypothesize that the multimodal response properties might have a role in memory consolidation and help to establish contextual references in the long-term trace.     

Response rates track the history of reinforcement times

When conditioning involves a consistent temporal relationship between the conditioned stimulus (CS) and unconditioned stimulus (US), the expression of conditioned responses within a trial peaks at the usual time of the US relative to the CS. Here we examine the temporal profile of responses during conditioning with variable CS-US intervals. We conditioned stimuli with either uniformly distributed or exponentially distributed random CS-US intervals. In the former case, the frequency of each CS-US interval within a specified range is uniform but the momentary probability of the US (the hazard function) increases as time elapses during the trial; with the latter distribution, short CS-US intervals are more frequent than longer intervals, but the momentary probability of the US is constant across time within the trial. We report that, in a magazine approach paradigm, rats' response rates remained stable as time elapses during the CS when the CS-US intervals were uniformly distributed, whereas their response rates declined when the CS-US intervals were exponentially distributed. In other words, the profile of responding during the CS matched the frequency distribution of the US times, not the momentary probability of the US during the CS. These results are inconsistent with real-time associative models, which predict that associative strength tracks the momentary probability of the US, but may provide support for timing models of conditioning in which conditioned responding is tied to remembered times of reinforcement.     

Associative effects of US preexposure: modulation of conditioned responding by an excitatory training context

In two experiments we examined factors that contribute to retarded emergence of conditioned responding to a conditioned stimulus (CS) trained in a context in which unsignaled unconditioned stimuli (USs) had previously been administered. In both experiments water-deprived rats were used in a conditioned lick suppression task to measure the conditioned response elicitation potential of the CS and the training context. From Experiment 1 we determined that nonreinforced exposure to the excitatory context after US preexposure and prior to CS-US pairings in that context eliminated the conditioned response deficit observed on a subsequent test of the CS. The recovery from the US preexposure deficit was nearly as great in animals that received nonreinforced exposure to the excitatory training context after the CS-US pairings but prior to the ultimate test of the CS. From Experiment 2 we determined that the recovery induced by contextual deflation after CS training was specific to deflation of the context in which the CS was trained as opposed to another excitatory context. In total, these experiments suggest that context-US associations partially mask the expression of a learned CS-US association. These results are discussed in terms of recent models of conditioned response generation.     

Spontaneous recovery after extinction of the conditioned proboscis extension response in the honeybee

In honeybees, the proboscis extension response (PER) can be conditioned by associating an odor stimulus (CS) to a sucrose reward (US). Conditioned responses to the CS, which are acquired by most bees after a single CS-US pairing, disappear after repeated unrewarded presentations of the CS, a process called extinction. Extinction is usually thought to be based either on (1) the disruption of the stored CS-US association, or (2) the formation of an inhibitory "CS-no US" association that is better retrieved than the initial CS-US association. The observation of spontaneous recovery, i.e., the reappearance of responses to the CS after time passes following extinction, is traditionally interpreted as a proof for the formation of a transient inhibitory association. To provide a better understanding of extinction in honeybees, we examined whether time intervals during training and extinction or the number of conditioning and extinction trials have an effect on the occurrence of spontaneous recovery. We found that spontaneous recovery mostly occurs when conditioning and testing took place in a massed fashion (1-min intertrial intervals). Moreover, spontaneous recovery depended on the time elapsed since extinction, 1 h being an optimum. Increasing the number of conditioning trials improved the spontaneous recovery level, whereas increasing the number of extinction trials reduced it. Lastly, we show that after single-trial conditioning, spontaneous recovery appears only once after extinction. These elements suggest that in honeybees extinction of the PER actually reflects the impairment of the CS-US association, but that depending on training parameters different memory substrates are affected.     

Olfactory fear conditioning paradigm in rats: Effects of midazolam,propranolol or scopolamine

In rodents, fear conditioned responses are more pronounced toward olfactory stimulus, since olfaction is a dominant sense in these subjects. The present study was outlined to investigate if the association between coffee odor (CS1) and electrical footshock (US) would be an effective model for the study of fear-induced behavior and whether compounds used in humans for emotional-related disorders such as midazolam, propranolol, or scopolamine, applied during the different stages of fear conditioning (acquisition, consolidation and expression), affect the defensive responses to both, the olfactory CS1, and the context (CS2) where the CS1 had been presented (second order conditioning). The results revealed that five pairings between coffee odor (CS1) and electrical footshock (US) were able to elicit consistent defensive responses and a second order conditioning to the context (CS2). Midazolam (0.375–0.5 mg/kg; i.p.) treatment was able to interfere with the CS1–US association and with the consolidation of the aversive information. The propranolol (5–10 mg/kg; i.p.) treatment interfered with the CS1–US association, with the retention of fear memory and with the CS1–CS2 association. Propranolol also attenuated the expression of conditioned fear responses when applied before the CS1 test session. Scopolamine (0.6–1.2 mg/kg; i.p.) treatment impaired the acquisition of CS1–US and CS1–CS2 associations, and also disrupted the expression of conditioned fear responses when injected prior to the CS1 test session. These findings have pointed out the usefulness for the olfactory fear conditioning paradigm to investigate drug effects on the acquisition, consolidation and expression of fear conditioned responses.     

Timing of conditioned responses utilizing electrical stimulation in the region of the interpositus nucleus as a CS

A large body of evidence indicates that the cerebellum is essential for the acquisition, retention, and expression of the standard delay conditioned eyeblink response and that the basic memory trace appears to be established in the anterior interpositus nucleus (IP). Adaptive timing of the conditioned response (CR) is a prominent feature of classical conditioning—the CR peaks at the time of onset of the unconditioned stimulus (US) over a wide range of CS-US interstimulus intervals (ISI). A key issue is whether this timing is established by the cerebellar circuitry or prior to the cerebellum. In this study timing of conditioned eyeblink responses established via electrical stimulation of the interpositus nucleus as a conditioned stimulus (CS) was analyzed prior to and following modification of the CS-US interval in well-trained rabbits. Consistent with previous results, learning under these conditions is very rapid and robust. The CR peak eyeblink latencies are initially timed to the US onset and adjust accordingly to lengthening or shortening of the CS-US interval, just as with peripheral CSs. The acquisition of conditioned eyeblink responses by direct electrical stimulation of the IP as a CS thus retains temporal flexibility following shifts in the CS-US delay, as found in standard classical eyeblink conditioning procedures.     

Timing of Conditioned Responses Utilizing Electrical Stimulation in the Region of the Interpositus Nucleus as a CS

A large body of evidence indicates that the cerebellum is essential for the acquisition, retention, and expression of the standard delay conditioned eyeblink response and that the basic memory trace appears to be established in the anterior interpositus nucleus (IP). Adaptive timing of the conditioned response (CR) is a prominent feature of classical conditioning-the CR peaks at the time of onset of the unconditioned stimulus (US) over a wide range of CS-US interstimulus intervals (ISI). A key issue is whether this timing is established by the cerebellar circuitry or prior to the cerebellum. In this study timing of conditioned eyeblink responses established via electrical stimulation of the interpositus nucleus as a conditioned stimulus (CS) was analyzed prior to and following modification of the CS-US interval in well-trained rabbits. Consistent with previous results, learning under these conditions is very rapid and robust. The CR peak eyeblink latencies are initially timed to the US onset and adjust accordingly to lengthening or shortening of the CS-US interval, just as with peripheral CSs. The acquisition of conditioned eyeblink responses by direct electrical stimulation of the IP as a CS thus retains temporal flexibility following shifts in the CS-US delay, as found in standard classical eyeblink conditioning procedures.     

Metamorphosis of the Mushroom Bodies; Large-Scale Rearrangements of the Neural Substrates for Associative Learning and Memory in Drosophila

Paired brain centers known as mushroom bodies are key features of the circuitry for insect associative learning, especially when evoked by olfactory cues. Mushroom bodies have an embryonic origin, and unlike most other brain structures they exhibit developmental continuity, being prominent components of both the larval and the adult CNS. Here, we use cell-type-specific markers, provided by the P{GAL4} enhancer trap system, to follow specific subsets of mushroom body intrinsic and extrinsic neurons from the larval to the adult stage. We find marked structural differences between the larval and adult mushroom bodies, arising as the consequence of large-scale reorganization during metamorphosis. Extensive, though incomplete, degradation of the larval structure is followed by establishment of adult specific α and β lobes. Kenyon cells of embryonic origin, by contrast, were found to project selectively to the adult γ lobe. We propose that the γ lobe stores information of relevance to both developmental stages, whereas the α and β lobes have uniquely adult roles.     

Mushroom bodies of the honeybee brain show cell population-specific plasticity in expression of amine-receptor genes

Dopamine and octopamine released in the mushroom bodies of the insect brain play a critical role in the formation of aversive and appetitive memories, respectively. As recent evidence suggests a complex relationship between the effects of these two amines on the output of mushroom body circuits, we compared the expression of dopamine- and octopamine-receptor genes in three major subpopulations of mushroom body intrinsic neurons (Kenyon cells). Using the brain of the honeybee, Apis mellifera, we found that expression of amine-receptor genes differs markedly across Kenyon cell subpopulations. We found, in addition, that levels of expression of these genes change dramatically during the lifetime of the bee and that shifts in expression are cell population-specific. Differential expression of amine-receptor genes in mushroom body neurons and the plasticity that exists at this level are features largely ignored in current models of mushroom body function. However, our results are consistent with the growing body of evidence that short- and long-term olfactory memories form in different regions of the mushroom bodies of the brain and that there is functional compartmentalization of the modulatory inputs to this multifunctional brain center.     

Associative changes with a random CS-US relationship

Three experiments examined conditioned magazine approach in rats when a positive unconditioned stimulus (US) bore a random relation to a conditioned stimulus (CS). Experiment 1 found that over the course of conditioning the CS initially elevated responding relative to the baseline but then lost the power to do so. Transfer tests revealed that a CS-US association developed early and persisted despite the decline in magazine responding. Experiment 2 confirmed the persistence of CS-US associations and found them to be more substantial when a different US occurred during the CS than in its absence. In Experiment 3, when the situation was exposed to US-alone presentations prior to introducing the CS, there was little evidence that a subsequent random relation between the CS and US produced an association between them. These results agree with those of blocking and overshadowing experiments using discrete CSs and support an interpretation of the random procedure in terms of competition between the background and CS for conditioning.     

Fear Develops to the Conditioned Stimulus and to the Context during Classical Eyeblink Conditioning in Rats

In classical eyeblink conditioning, non-specific emotional responses to the aversive shock unconditioned stimulus (US), which are presumed to coincide with the development of fear, occur early in conditioning and precede the emergence of eyeblink responses. This two-process learning model was examined by concurrently measuring fear and eyeblink conditioning in the freely moving rat. Freezing served as an index of fear in animals and was measured during the inter-trial intervals in the training context and during a tone conditioned stimulus (CS) presented in a novel context. Animals that received CS-US pairings exhibited elevated levels of fear to the context and CS early in training that decreased over sessions, while eyeblink conditioned responses (CRs) developed gradually during acquisition and decreased during extinction. Random CS-US presentations produced a similar pattern of fear responses to the context and CS as paired presentations despite low eyeblink CR percentages, indicating that fear responding was decreased independent of high levels of learned eyeblink responding. The results of paired training were consistent with two-process models of conditioning that postulate that early emotional responding facilitates subsequent motor learning, but measures from random control animals demonstrate that partial CS-US contingencies produce decrements in fear despite low levels of eyeblink CRs. These findings suggest a relationship between CS-US contingency and fear levels during eyeblink conditioning, and may serve to clarify further the role that fear conditioning plays in this simple paradigm.     

Fear develops to the conditioned stimulus and to the context during classical eyeblink conditioning in rats

In classical eyeblink conditioning, non-specific emotional responses to the aversive shock unconditioned stimulus (US), which are presumed to coincide with the development of fear, occur early in conditioning and precede the emergence of eyeblink responses. This twoprocess learning model was examined by concurrently measuring fear and eyeblink conditioning in the freely moving rat. Freezing served as an index of fear in animals and was measured during the inter-trial intervals in the training context and during a tone conditioned stimulus (CS) presented in a novel context. Animals that received CS-US pairings exhibited elevated levels of fear to the context and CS early in training that decreased over sessions, while eyeblink conditioned responses (CRs) developed gradually during acquisition and decreased during extinction. Random CS-US presentations produced a similar pattern of fear responses to the context and CS as paired presentations despite low eyeblink CR percentages, indicating that fear responding was decreased independent of high levels of learned eyeblink responding The results of paired training were consistent with two-process models of conditioning that postulate that early emotional responding facilitates subsequent motor learning, but measures from random control animals demonstrate that partial CS-US contingencies produce decrements in fear despite low levels of eyeblink CRs. These findings suggest, a relationship between CS-US contingency and fear levels during eyeblink conditioning, and may serve to clarify further the role that fear conditioning plays in this simple paradigm.     

Postnatal development of heart rate patterns elicited by an aversive CS and US in cats

Heart rate and motor responses were recorded in cats of different ages during classical conditioning. A deceleratory-acceleratory heart rate pattern observed during the CS-US interval in one and four-week-old kittens is an alpha conditioned response, a potentiated original response to the CS. At eight weeks of age two new distinct patterns of pure acceleration or pure deceleration are acquired during conditioning and in the absence of motor learning. At 12 weeks of age and in adult subjects, heart rate patterns during the CS-US interval become more complex and conditioned motor responses can be observed. A covariance of HR acceleration and motor responses during the CS-US interval is absent in eight-week-old subjects, but quite high in 12-week-old subjects and adult cats. The data are interpreted as suggesting separate elicitatory mechanisms of HR and motor responses which may show synchrony later in ontogeny.     

The Organization of Extrinsic Neurons and Their Implications in the Functional Roles of the Mushroom Bodies in Drosophila melanogaster Meigen

Although the importance of the Drosophila mushroom body in olfactory learning and memory has been stressed, virtually nothing is known about the brain regions to which it is connected. Using Golgi and GAL4–UAS techniques, we performed the first systematic attempt to reveal the anatomy of its extrinsic neurons. A novel presynaptic reporter construct, UAS-neuronal synaptobrevin–green fluorescent protein (n-syb–GFP), was used to reveal the direction of information in the GAL4-labeled neurons. Our results showed that the main target of the output neurons from the mushroom body lobes is the anterior part of the inferior medial, superior medial, and superior lateral protocerebrum. The lobes also receive afferents from these neuropils. The lack of major output projections directly to the deutocerebrum’s premotor pathways discourages the view that the role of the mushroom body may be that of an immediate modifier of behavior. Our data, as well as a critical evaluation of the literature, suggest that the mushroom body may not by itself be a “center” for learning and memory, but that it can equally be considered as a preprocessor of olfactory signals en route to “higher” protocerebral regions.     

Hippocampal associative cellular responses: dissociation with behavioral responses revealed by a transfer-of-control technique

Multiunit activity was recorded in the CA3 field of the dorsal hippocampus in freely moving rats during classical conditioning and subsequent presentation of the CS on operant baselines for food reward as well as shock avoidance. Rats were first trained in a nonsignaled bar-pressing-dependent shock omission task and in a food-motivated lever-pressing task (60-s VI). Five sessions with presentations of a previously habituated tone as a CS paired with footshock as a US were then given. Testing was carried out by presenting the CS alone while behavioral responses were maintained by reinforcement in both instrumental tasks on alternate sessions. As expected, the CS induced a marked suppression of lever pressing for food reward and a marked enhancement of bar-pressing for shock avoidance. The analysis of the frequency of multiunit discharges to the CS revealed that the hippocampal cellular responses established during classical conditioning were maintained while two different behavioral responses were exhibited to the CS. The results showed that the associative response of hippocampal neurons may be dissociated from the Pavlovian conditioned responses the CS elicits. They support the hypothesis that hippocampal cellular responses represent a neural index of the acquired CS-US associative representation.     

Dissociated roles for the lateral and medial septum in elemental and contextual fear conditioning

Extensive evidence indicates that the septum plays a predominant role in fear learning, yet the direction of this control is still a matter of debate. Increasing data suggest that the medial (MS) and lateral septum (LS) would be differentially required in fear conditioning depending on whether a discrete conditional stimulus (CS) predicts, or not, the occurrence of an aversive unconditional stimulus (US). Here, using a tone CS-US pairing (predictive discrete CS, context in background) or unpairing (context in foreground) conditioning procedure, we show, in mice, that pretraining inactivation of the LS totally disrupted tone fear conditioning, which, otherwise, was spared by inactivation of the MS. Inactivating the LS also reduced foreground contextual fear conditioning, while sparing the higher level of conditioned freezing to the foreground (CS-US unpairing) than to the background context (CS-US pairing). In contrast, inactivation of the MS totally abolished this training-dependent level of contextual freezing. Interestingly, inactivation of the MS enhanced background contextual conditioning under the pairing condition, whereas it reduced foreground contextual conditioning under the unpairing condition. Hence, the present findings reveal a functional dissociation between the LS and the MS in Pavlovian fear conditioning depending on the predictive value of the discrete CS. While the requirement of the LS is crucial for the appropriate processing of the tone CS-US association, the MS is crucial for an appropriate processing of contextual cues as foreground or background information.     

Conditioned taste aversion is enhanced when the unconditioned stimulus is presented in a different context

Using a conditioned taste aversion procedure with rats as the subjects, two experiments examined the effect of presenting a conditioned stimulus (CS saccharin solution) in one context followed by an unconditioned stimulus (US LiCl) in a different context. Experiment 1 showed that animals which received the above-mentioned procedure (Group D) showed a more marked conditioned aversion to the CS than animals which were given both the CS and the US in the same context (Group S). Experiment 2 found that in both Group D and Group S, aversion to the CS increased when the subjects were exposed to the conditioned context after the conditioning. These findings supported the argument that the strength of the CS-US association acquired during conditioning is compared with that of the context-US to determine the magnitude of aversion revealed to the CS.