Reduction of contextual control of conditioned responses by extended Pavlovian training in an insect

The effect of repetitive training on learned behavior has been an important subject in neuroscience. In instrumental conditioning in mammals, learned action early in training is often goal-driven and controlled by outcome expectancy, but as training progresses, it becomes more habitual and insensitive to outcome devaluation. Similarly, we recently showed in Pavlovian conditioning in crickets (Gryllus bimaculatus) that a conditioned response (CR) is initially sensitive to devaluation of the unconditioned stimulus but becomes insensitive to it after extended training. It is known that habitual responses after extended instrumental training are characterized by a higher context specificity than are initial goal-directed actions in mammals. In this study, we investigated whether this is applicable to Pavlovian conditioning in crickets. In crickets that received a standard amount of training to associate an odor with water reward under illumination, CR under illumination was stronger than that in the dark. In crickets that received extended training under illumination, on the other hand, the level of CR did not differ in different light conditions. Further experiments confirmed that context specificity decreases with the development of behavioral automaticity by extended training, as opposed to findings in instrumental training in mammals. We conclude that the nature of habitual behaviors after extended training differs in different learning systems of animals.

In humans, habitual behavior often underlies dysfunctional behaviors such as drug addiction (Everitt et al. 2001) and obsessive-compulsive disorder (Gillan et al. 2011). It is for this reason that much research conducted on behavioral neuroscience and psychology has aimed to understand the effects of repetitive training on the performance of learned actions or, in other words, the development of habits (Gardner 2015; Wood and Rünger 2016). One of the most common findings in instrumental conditioning in mammals is that actions in an early stage of training are more goal-driven; i.e., they are controlled by the specific outcome (reinforcer) of their actions. However, as training proceeds, behaviors often become more automatic and independent of the actual value of the outcome, although both the goal-driven and habitual behavioral components often coexist in both early and later stages of training (Dickinson 1985; Yin and Knowlton 2006; Kosaki and Dickenson 2010; Smith and Graybiel 2014). Goal-directed actions and habitual behavior can be distinguished by using an outcome devaluation procedure in which the value of the outcome (reward) is reduced by aversive conditioning (Adams 1982; Dickinson 1985) or by outcome-specific satiation (Balleine and Dickinson 1998).We have investigated associative processes underlying Pavlovian conditioning and its possible neural substrates in the cricket Gryllus bimaculatus (Unoki et al. 2005; Mizunami et al. 2009; Mizunami and Matsumoto 2017; Mizunami et al. 2018), and we recently found that the conditioned response (CR) to an odor (conditioned stimulus, CS) diminishes when the value of water reward (unconditioned stimulus [US]) is reduced after satiation early in training but that it becomes insensitive to US devaluation after extended training in crickets (Mizunami et al. 2019). To our knowledge, these results provide the first evidence of increased automaticity of learned behavior by extended Pavlovian training in any animals. Crickets that received four-trial training to associate an odor CS with water US, which we refer to as standard training, exhibited no CR after water had been given until satiation before the test. On the other hand, crickets that received extended training (i.e., four conditioning trials per day on three consecutive days) exhibited the same level of CR regardless of whether they had been provided with water until satiation or not before the test.Notably, in instrumental conditioning in mammals, it has been documented that habitual behavior that is insensitive to outcome devaluation has features that are distinct from those of goal-directed behavior typically seen after limited training. The most notable one is its higher context specificity: Habitual responses are more likely to occur in the context in which training occurred than outside that context (in rats) (Thrailkill and Bouton 2015). Similarly, in humans, such context specificity is considered a hallmark of the habitual behavior formed by repetition of the same learned responses and it is considered a critical feature to which special attention must be paid in the therapy of mal-adaptive habits (Tricomi et al. 2009; Gardner 2015; Wood and Rünger 2016).The aim of this study was to determine whether the same context specificity that is observed in the habitual response after extended training in mammals is applicable to Pavlovian conditioning in insects. To do so, we performed standard or extended training for crickets under illumination, and their CRs were tested under illumination or in the dark. We used light and darkness as contexts since we observed that a change of background light level between training and testing influences the level of CRs in one paradigm of Pavlovian conditioning in crickets (Matsumoto and Mizunami 2004).