The effects of context change on long-term habituation of the orienting response in humans

Four experiments examined the effects of context change (Experiments 1-3) and context extinction (Experiment 4) on long-term habituation of the skin conductance response. In all experiments, subjects received 15 presentations of a target stimulus in each of two sessions. In Experiment 1 (N=60) there was a 15-min interval between training and test sessions. This interval was extended to 24 hours in Experiments 2 (N=60) and 3 (N=60). The experimental treatment in each of these studies involved a change in context between the two training sessions. None of the experiments provided evidence of context dependency in measures of long-term habituation. In Experiment 4 (N=60) experimental subjects received a period of context extinction during which they remained in the laboratory environment between two series of habituation trials. Again, however, there was no evidence that long-term habituation was contextually mediated. Thus, the results fail uniformly to support theories that argue that long-term habituation is context-dependent.     

Response-duration of lever pressing in the rat

Two aspects of the lever-holding behaviour of rats in a Skinner-box have been analysed: firstly, the changes in the duration of the responses during the acquisition and experimental extinction phase, and, secondly, the bunching of responses during the experimental extinction phase. The response-durations on the first few acquisition trials were found to be bimodally distributed, but to become stabilized at 0.42 seconds as practice increased. During experimental extinction response-durations increased. The rate of increase depended on the conditions of secondary reward. Rats who had the source of secondary reward removed, or restricted, yielded a steeper slope than those who responded under the same conditions of secondary reward as during training.

The analysis of the extinction scores revealed that unrewarded responses were emitted in groups. Response-group latencies were shown to progress as a positive function of the number of response-groups, and the average response-duration for consecutive response-groups to increase progressively. The slope of the duration curve plotted for successive response-groups increased, and this was related to an increase in the value of the time-intercept for successive response-groups.     

Reinforcing fluency in stutterers: An experimental study

Subject-specific periods of fluent reading responses of three adult stutterers were positively reinforced with the presentation of a dime. Subjects were run individually through a sequence of two base rate, two experimental, and two extinction sessions, each session lasting 45 min. Periods of fluent reading responses increased during the experimental condition for each of the three subjects. When the reinforcer was withdrawn during the extinction condition, the frequency of fluent periods showed a decrease. Concomitantly, disfluencies decreased during the experimental condition and they increased during the extinction condition. The clinical implications of fluency manipulation as against disfluency manipulation are discussed.     

Sequential contrast effects with human subjects

Institutionalized retardates were exposed to a multiple variable-interval: extinction schedule of reinforcement in which 5-min periods of variable-interval reinforcement and 5-min periods of extinction were presented in a random order. This schedule was found to generate sequential contrast effects: response rates during variable-interval reinforcement were higher when a variable-interval period followed an extinction period than when it followed another variable-interval period. The rate of responding within a variable-interval period also was affected by the number of extinction periods preceding a variable-interval period. As the number of successive extinction periods that preceded a variable-interval period increased, the rate of responding during that variable-interval period increased. The sequential contrast effects were transient, being most evident during the early sessions and generally disappearing by the tenth session.     

Additional free reinforcers increase persistence of problem behavior in a clinical context: A partial replication of laboratory findings

Behavioral momentum theory is a quantitative framework used to characterize the persistence of behavior during response disruptors as a function of baseline stimulus–reinforcer relations. Results of several investigations have shown that alternative reinforcement can increase the resistance to change of a target response during extinction. In the present study, concomitant variable‐interval fixed‐time schedules of reinforcement for problem behavior were employed to simulate naturalistic situations involving the superimposition of response‐independent reinforcers on a baseline schedule of reinforcement for problem behavior, as in the common use of noncontingent reinforcement treatments. Resistance to change of problem behavior was assessed during postsession periods of extinction by comparing response rates in extinction following sessions with and without additional reinforcer deliveries arranged by fixed‐time schedules. For 2 out of 3 participants, problem behavior tended to be more resistant to extinction following periods in which additional fixed‐time reinforcers were delivered. These results are discussed in terms of potential effects of noncontingent reinforcement on problem behavior when the intervention is discontinued or implemented without good treatment integrity.     

Glucocorticoids are required for extinction of predator stress-induced hyperarousal

Background

The role of glucocorticoids in extinction of traumatic memories has not been fully characterized despite its potential as a therapeutic target for acquired posttraumatic stress disorder (PTSD). The predator stress paradigm allows us to determine whether glucocorticoids mediate the extinction of both context-dependent and context-independent fear memories.

Methods

Male C57BL/6J mice were exposed to a predator (cat) then repeatedly exposed to the predator stress context in the absence of the cat. Context-dependent (associative) fear memory was assessed as suppression of activity during re-exposure to the predator stress context without the cat (extinction trials). Context-independent fear (non-associative) was assessed seven days after extinction trials using measures of hyperarousal and anxiety-like behaviours in environments unlike the predator stress context. To assess the role of glucocorticoids, mice were injected with metyrapone (50 mg/kg) 90 min prior to extinction trials in predator stressed mice and context-dependent and context-independent fear memories were assessed. Finally, metyrapone-treated predator stressed mice were injected with corticosterone (5 or 10 mg/kg) immediately following extinction trials and context-dependent and context-independent fear memories were assessed.

Results

Repeated re-exposure to the predator stress context without the cat present extinguished context-dependent fear memory, and also reduced hyperarousal, a generalized, chronic PTSD-like symptom. We show that extinction of context-independent predator stress-induced hyperarousal is dependent on endogenous glucocorticoids during the extinction trials. Furthermore, the inhibition of extinction by metyrapone on startle amplitude was reduced by exogenous administration of corticosterone following extinction trials. Overall, these data implicate glucocorticoids in the extinction of hyperarousal, a core symptom of PTSD.     

Shaking That Icky Feeling: Effects of Extinction and Counterconditioning on Disgust-Related Evaluative Learning

Learned disgust appears to play an important role in certain anxiety disorders, and can be explained by the process of evaluative conditioning, in which an affective evaluative reaction evoked by an unconditional stimulus (US) is transferred to a conditional stimulus (CS). Much remains unknown about how disgust-related evaluative learning can be effectively eliminated. Study 1 of the present investigation examined the effects of extinction on reducing the negative evaluation of a CS that was acquired during disgust conditioning. Participants completed acquisition trials, with a disgusting picture as US and two neutral pictures as CS (CS + was paired with the US; CS- was unpaired), followed by extinction trials ("CS only"; experimental condition) or a filler task (control condition). Extinction trials reduced acquired US expectancy to the CS +, but did not extinguish negative evaluations of the CS +. Study 2 examined the effects of counterconditioning on evaluative learned disgust. After disgust acquisition trials, counterconditioning trials followed in which the CS + was paired with a pleasant US (experimental condition) or a filler task (control condition). Counterconditioning trials reduced acquired US expectancy to the CS + and reduced evaluative conditioned disgust. Implications of the potential differential effects of extinction and counterconditioning on evaluative learning for exposure-based treatment of specific anxiety disorders are discussed.     

D-Cycloserine enhances memory consolidation of hippocampus-dependent latent extinction

Adult male Long-Evans rats were trained to run in a straight-alley maze for food reward and subsequently received hippocampus-dependent latent extinction training. Immediately following latent extinction, rats received peripheral injections of the NMDA receptor partial agonist D-cycloserine (DCS, 15 mg/kg), or saline. Twenty-four hours later, rats received four extinction "probe" trials. Relative to saline controls, latencies to reach the goal box on probe trials were significantly higher in rats that had received DCS. These findings indicate that memory consolidation underlying hippocampus-dependent latent extinction, a cognitive form of learning in which the previously rewarded response is not made during extinction training, can be enhanced by NMDA-receptor agonism.     

Devaluation of stimuli contingent on choice: evidence for conditioned reinforcement

Pigeons were presented a concurrent-chains schedule of reinforcement that had terminal links of equal duration. The initial links of the schedule were periodically interrupted by 15-s periods during which an extinction schedule was in effect. The extinction periods were presented on either a response-contingent or a noncontingent basis. Relative response rate for the left alternative decreased when the extinction periods were accompanied by the left terminal-link stimulus. Relative response rate for the right alternative decreased when the extinction periods were accompanied by the right terminal-link stimulus. Relative response rate varied inversely with the frequency of presentation of the extinction periods but was unaffected by presence versus absence of the response contingency in the schedule of extinction-period presentation. Furthermore, relative response rate was unaffected by presentation of extinction periods accompanied by a novel stimulus. When the extinction periods were presented after reinforcement in the left terminal link instead of as interruptions of the initial links, relative response rate for the left alternative was reduced if the postreinforcement extinction period was accompanied by the terminal-link stimulus for the left chain and reduced less if the extinction period was accompanied by the terminal-link stimulus for the right chain. The results demonstrate that the correlation between the terminal-link stimulus and extinction influenced the relative response rate in the initial link.     

The analysis of behavioral momentum

Learned behavior varies in its resistance to change, depending on the rate of reinforcement. Resistance to change may be characterized as behavioral momentum, which in turn may be analyzed into terms corresponding to mass and velocity in classical physics. Behavioral mass may be inferred from changes in response rate when experimental conditions are altered. Relevant data were obtained by training pigeons to peck a key on two-component multiple variable-interval, variable-interval schedules. Six pigeons were studied on three pairs of variable-interval schedules in all possible orders. When performance stabilized, resistance to change was assessed by arranging response-independent food during periods between components and by extinction. For each operation, the data for all schedule performances converged onto a single function, permitting estimation of the ratio of behavioral masses for each pair of schedules. The response-independent food data suggested that the ratio of behavioral masses is a power function of the ratio of reinforcement rates and that behavioral mass may be measured on a ratio scale.     

Expanding the Intertrial Interval During Extinction: Response Cessation and Recovery

We examined trial spacing during extinction following a human contingency learning task. Specifically, we assessed if an expanding retrieval practice schedule ( [Bjork and Bjork, 1992] and [Bjork and Bjork, 2006]), in which the spacing between extinction trials was progressively increased, would result in faster immediate extinction and less recovery from extinction than uniformly spaced extinction trials. We used an ABB vs. ABA renewal design and observed that, whereas the expanding group extinguished faster during extinction treatment, the expanding and constant groups showed the same level of extinction with an immediate test in the extinction context (ABB) and the two groups showed equivalent ABA renewal at test in the training context. We conclude that the faster extinction observed in the expanding groups could be misleading in clinical treatment, if the therapist used the absence of fear during extinction as the basis for terminating treatment.     

A behaviour modification technique for the hyperactive child

This paper describes a procedure for the conditioning of attending behaviour in a brain-injured hyperactive boy.

Observations of the behaviour of two hyperactive children were made in the classroom setting. These observations were made from an observation bootn adjoining the classroom and provided data on the frequency of occurrence of the following high rate responses: walking, talking, distraction, “wiggling”. Each child was observed for a minimum of ten minutes a day, four days a week. Following several weeks of baseline observation, the conditioning procedure was begun with the expel imental subject. The conditioning trials took place in the classroom setting. During each time interval in which one of the high rate responses did not occur, S received an auditory stimulus (secondary reinforcer). This auditory stimulus had previously been paired with the delivery of candy and pennies. The stimulus was dispensed by a radio device which activated an earphone worn by the subject. At the end of each conditioning trial, S received whatever candy or pennies he had “earned”.

The data show that the control subject showed no significant change in the frequency of occurrence of the high rate responses during the three month period. The experimental subject showed a significant decrease in non-attending behaviour. This reduction in rate was maintained over a four week extinction period.     

Duration of extinction trials as a determinant of instrumental extinction in terrestrial toads (<Emphasis Type="Italic">Rhinella arenarum</Emphasis>)

Instrumental learning guides behavior toward resources. When such resources are no longer available, approach to previously reinforced locations is reduced, a process called extinction. The present experiments are concerned with factors affecting the extinction of acquired behaviors in toads. In previous experiments, total reward magnitude in acquisition and duration of extinction trials were confounded. The present experiments were designed to test the effects of these factors in factorial designs. Experiment 1 varied reward magnitude (900, 300, or 100 s of water access per trial) and amount of acquisition training (5 or 15 daily trials). With total amount of water access equated in acquisition, extinction with large rewards was faster (longer latencies in 900/5 than 300/15), but with total amount of training equated, extinction with small rewards was faster (longer latencies in 100/15 than 300/15). Experiment 2 varied reward magnitude (1200 or 120 s of water access per trial) while holding constant the number of acquisition trials (5 daily trials) and the duration of extinction trials (300 s). Extinction performance was lower with small, rather than large reward magnitude (longer latencies in 120/300 than in 1200/300). Thus, instrumental extinction depends upon the amount of time toads are exposed to the empty goal compartment during extinction trials.     

Block of glucocorticoid synthesis during re-activation inhibits extinction of an established fear memory

BackgroundThe pharmacology of traumatic memory extinction has not been fully characterized despite its potential as a therapeutic target for established, acquired anxiety disorders, including post-traumatic stress disorder (PTSD). Here we examine the role of endogenous glucocorticoids in traumatic memory extinction.MethodsMale C57BL/6J mice were injected with corticosterone (10 mg/kg, i.p.) or metyrapone (50 mg/kg, s.c.) during re-activation of a contextual fear memory, and compared to vehicle groups (N = 10–12 per group). To ensure that metyrapone was blocking corticosterone synthesis, we measured corticosterone levels following re-activation of a fear memory in metyrapone- and vehicle-treated animals.ResultsCorticosterone administration following extinction trials caused a long-lasting inhibition of the original fear memory trace. In contrast, blockade of corticosteroid synthesis with metyrapone prior to extinction trials enhanced retrieval and prevented extinction of context-dependent fear responses in mice. Further behavioral analysis suggested that the metyrapone enhancement of retrieval and prevention of extinction were not due to non-specific alterations in locomotor or anxiety-like behavior. In addition, the inhibition of extinction by metyrapone was rescued by exogenous administration of corticosterone following extinction trials. Finally, we confirmed that the rise in corticosterone during re-activation of a contextual fear memory was blocked by metyrapone.ConclusionsWe demonstrate that extinction of a classical contextual fear memory is dependent on endogenous glucocorticoid synthesis during re-activation of a fear memory. Our data suggest that decreased glucocorticoids during fear memory re-activation may contribute to the inability to extinguish a fear memory, thus contributing to one of the core symptoms of PTSD.     

Response elimination without performance

Hungry rats were taught to press a lever in order to obtain a small quantity of food. It has been shown that the strength of the lever-pressing response can be reduced by allowing the animals to explore the box without finding food. This result conflicts with a simple reactive-inhibition theory of forgetting and response-elimination. Three possible explanations have been considered: (a) that the failure to find food changed the motivational condition of the animal; (b) that a conditioned drive, associated with the food-box, underwent extinction; (c) that a genuine response extinction occurred, and that this could be accounted for in terms of a principle of reaction-chain acquisition and extinction which differs in important respects from Skinner's (1938) and Hull's (1954) principles of conditioning.     

The Influence of Background Stimuli on Summation in Autoshaping

Five experiments examined the factors that determine whether or nor summation will occur when experimental stimuli are presented on a television screen for autoshaping with pigeons. In Experiment 1 there were periods when the television screen was illuminated white and periods when it was dark. When conditioning was conducted during the white periods, then summation was observed if the test trials were conducted with a white screen during the intertrial interval. Summation was not found when conditioning was conducted during the dark periods, no matter how testing was conducted. The remaining experiments demonstrated that summation will occur if at least some of the conditioning trials are conducted with the experimental stimuli being accompanied by white illumination in the remainder of the television screen. It was not necessary for this illumination to persist into the interval between trials. These findings indicate that summation is influenced by the similarity of the patterns of stimulation that are used for training and testing.     

Stronger renewal in human fear conditioning when tested with an acquisition retrieval cue than with an extinction retrieval cue

It was previously demonstrated in our laboratory that conditioned fear in humans can renew after extinction, when this procedure took place in a different context (ABA-renewal [Vansteenwegen et al. (2005). Return of fear in a human differential conditioning paradigm caused by a return to the original acquisition context. Behaviour Research and Therapy, 43(3), 323–336]). Using the same experimental design, we now tested the power of retrieval cues to interact with this contextual renewal phenomenon. Two groups went through acquisition and extinction (in a different context). They were then tested in the original acquisition context and in the presence of a retrieval cue. In the acquisition-cue group, this cue previously featured during the acquisition procedure; in the extinction-cue group, the cue previously featured during the extinction procedure. As expected, renewal of conditioned electro-dermal responding and retrospective expectancy ratings was strongest in the acquisition-cue group. Theoretical and clinical implications of this finding are discussed.     

Extensive extinction in multiple contexts eliminates the renewal of conditioned fear in rats

Two studies examined whether nonreinforcement of a stimulus in multiple contexts, instead of a single context, would decrease renewal of conditioned fear in rats (as assessed by conditioned suppression of lever pressing). In Experiment 1, renewal was measured after 36 nonreinforced CS trials delivered during six extinction sessions in a single context or two extinction sessions in each of three different contexts. The number of extinction contexts did not have an effect on renewal. In Experiment 2, groups received either 36 or 144 nonreinforced CS trials during six or twenty-four extinction sessions in a single context or three different contexts. Again, renewal was not influenced by the number of extinction contexts when only 36 trials were given. However, when 144 trials were used, renewal was completely eliminated when extinction was divided between 3 contexts, but was not weakened when the sessions took place in a single context. The results suggest that the use of multiple treatment settings in exposure-based therapies is only likely to reduce relapse if a sufficient number of sessions are provided in each of the treatment settings.     

Resurgence of previously taught academic responses

Resurgence is often discussed in relation to the relapse of undesirable behavior. However, resurgence may also describe the recurrence of socially appropriate behavior, including academic responding. The recurrence of academic responses following periods of extinction may aid in the solution of novel problems. The aims of this study were to evaluate the resurgence of complex, desirable behavior related to college-level instruction and to explore problem form as an aspect of environmental context. Each participant was taught 2 response chains to solve quadratic equations across experimental phases, followed by a phase in which neither chain resulted in the correct solution (extinction). During Experiment 1, the equations presented during extinction resembled those presented during reinforcement of the alternative response. Of the 8 participants in Experiment 1, 4 attempted to use the first-taught chain to solve an equation in the extinction phase. During Experiment 2, the equations presented during extinction resembled those presented during reinforcement of the target response. Of the 8 participants in Experiment 2, 6 attempted to use the first-taught chain to solve an equation in the extinction phase. Results demonstrate the resurgence of academic responses and suggest that the form of the problem may constitute a context that affects resurgence.     

Infantile handling and the extinction of responses acquired under food reward

A comparison was made of the runway behaviour of rats which had been handled from Days 1-21 and their non-handled litter mates. The training began on Day 70 after the animals were habituated to a restricted food schedule for 10 days. The subjects were given six trials each day in the runway and were rewarded with a 0.045 g. Noyes pellet. After 10 days of rewarded training trials, subjects were given 6 extinction trials a day for 10 days. Results showed that handled rats ran faster than non-handled rats during acquisition and during the first 3 days of extinction. The extinction data suggested that the relationship between emotionality and effects of frustrative non-reward should be re-evaluated.