Renewal of operant performance formerly eliminated by omission or noncontingency training upon return to the acquisition context

Renewal of operant performance formerly eliminated by omission or noncontingency training was explored in two experiments with rats. When pressing a lever was trained with food reinforcement in one context (A) and then eliminated in a second context (B), responding was renewed by returning the rats to the original context (A). This ABA renewal effect was demonstrated in Experiment 1 when the elimination training was an omission procedure (delivery of food for withholding responding) and in Experiment 2 when it was a noncontingency procedure (delivery of food irrespective of responding). Because omission training (differential reinforcement of other behavior) and noncontingency training have been used in applied settings as effective procedures to reduce undesired human behaviors, the clinical implications of our findings for the relapse of undesirable behavior were discussed.     

Examining stimuli paired with alternative reinforcement to mitigate resurgence in children diagnosed with autism spectrum disorder and pigeons

In two laboratory experiments, we examined whether stimuli paired with alternative reinforcers could mitigate resurgence of a previously reinforced target response with pigeons (Experiment 1) and children diagnosed with Autism Spectrum Disorder (Experiment 2). In Phase 1, we arranged food reinforcement according to a variable-ratio schedule for engaging in a target response. In Phase 2, we arranged extinction for target responding and differentially reinforced alternative responding according to a fixed-ratio schedule, with every alternative-reinforcer delivery paired with a change in keylight color (Experiment 1) or automated verbal (praise) statement (Experiment 2). In Phase 3, we assessed resurgence during extinction of target and alternative responding in the presence versus absence of continued presentation of the paired stimulus. Despite variation across sessions, resurgence on average was lower when continuing to present the paired stimuli in all pigeons and children while maintenance of alternative responding did not differ between assessments. These findings indicate that stimuli paired with alternative reinforcement can modestly decrease resurgence, but further examination of their efficacy and a better understanding of the underlying processes are necessary before they can be recommended for clinical use in reducing resurgence of clinically relevant problem behavior.     

Resurgence and alternative‐reinforcer magnitude

Resurgence is defined as an increase in the frequency of a previously reinforced target response when an alternative source of reinforcement is suspended. Despite an extensive body of research examining factors that affect resurgence, the effects of alternative‐reinforcer magnitude have not been examined. Thus, the present experiments aimed to fill this gap in the literature. In Experiment 1, rats pressed levers for single‐pellet reinforcers during Phase 1. In Phase 2, target‐lever pressing was extinguished, and alternative‐lever pressing produced either five‐pellet, one‐pellet, or no alternative reinforcement. In Phase 3, alternative reinforcement was suspended to test for resurgence. Five‐pellet alternative reinforcement produced faster elimination and greater resurgence of target‐lever pressing than one‐pellet alternative reinforcement. In Experiment 2, effects of decreasing alternative‐reinforcer magnitude on resurgence were examined. Rats pressed levers and pulled chains for six‐pellet reinforcers during Phases 1 and 2, respectively. In Phase 3, alternative reinforcement was decreased to three pellets for one group, one pellet for a second group, and suspended altogether for a third group. Shifting from six‐pellet to one‐pellet alternative reinforcement produced as much resurgence as suspending alternative reinforcement altogether, while shifting from six pellets to three pellets did not produce resurgence. These results suggest that alternative‐reinforcer magnitude has effects on elimination and resurgence of target behavior that are similar to those of alternative‐reinforcer rate. Thus, both suppression of target behavior during alternative reinforcement and resurgence when conditions of alternative reinforcement are altered may be related to variables that affect the value of the alternative‐reinforcement source.     

Resistance to change and relapse of observing

Four experiments examined relapse of extinguished observing behavior of pigeons using a two-component multiple schedule of observing-response procedures. In both components, unsignaled periods of variable-interval (VI) food reinforcement alternated with extinction and observing responses produced stimuli associated with the availability of the VI schedule (i.e., S+). The components differed in the rate of food arranged (Rich = VI 30 s; Lean = VI 120 s). In Experiment 1, following baseline training, extinction of observing involved removal of both food and S+ deliveries, and reinstatement was examined by presenting either response-independent food or S+ deliveries. In Experiment 2, extinction involved removal of only food deliveries while observing responses continued to produce S+. Reinstatement was examined by delivering food contingent upon the first two food-key responses occurring in the presence of the S+. Experiment 3 assessed ABA renewal of observing by extinguishing food-key and observing responses in the presence of one contextual stimulus (i.e., B) and then returning to the original training context (i.e., A) during continued extinction. Experiment 4 examined resurgence by introducing food reinforcement for an alternative response during extinction, and subsequently removing that alternative source of food. Across experiments, relative resistance to extinction and relapse of observing tended to be greater in the component previously associated with the higher rate of primary reinforcement. Relapse of observing or attending to stimuli associated with primary reinforcement appears to be impacted by frequency of primary reinforcement in a manner similar to responding maintained directly by primary reinforcement.     

Effects of thinning the rate at which the alternative behavior is reinforced on resurgence of an extinguished instrumental response

Three experiments with rats examined the effects of thinning the rate of reinforcement for the alternative behavior in the resurgence paradigm. In all experiments, pressing one lever (L1) was first reinforced and then extinguished while pressing a second alternative lever (L2) was then reinforced. When L2 responding was then extinguished, L1 responses "resurged." Resurgence was always observed when L2 was reinforced on an unchanging reinforcement schedule during Phase 2. However, other rats received systematic decreases in the rate of L2 reinforcement before extinction of L2 began. Such a "thinning" procedure was predicted to reduce final resurgence by associating L1 extinction with longer and longer periods without a reinforcer. The procedure did reduce the resurgence effect observed when L2 was put on extinction (Experiment 3). However, in each experiment, thinned groups also returned to L1 responding, and continued to make L1 responses, while the reinforcement schedule for L2 was being thinned. Fine-grained analysis of behavior in time suggested that this early resurgence was not due to adventitious reinforcement of L1, occasion setting of L1 by reinforcer presentation, or the entrainment of L1 as a schedule-induced interim behavior. The results are overall consistent with the hypothesis that resurgence is a renewal effect in which extinguished L1 responding recovers when the context provided by the L2 reinforcement schedule is changed. Challenges for this view are also discussed.     

Resurgence Following Higher or Lower Quality Alternative Reinforcement

Resurgence is a temporary increase in a previously suppressed target behavior following a worsening in reinforcement conditions. Previous studies have examined how higher rates or magnitudes of alternative reinforcement affect suppression of the target behavior and subsequent resurgence. However, there has been no investigation of the effects of higher versus lower qualities of alternative reinforcement on resurgence. Using a three-phase resurgence preparation with rats, the present experiments examined the effects of an alternative reinforcer that was of higher (Experiment 1) or lower (Experiment 2) quality than the reinforcer that had previously maintained the target behavior. The results of both experiments showed greater reductions in target behavior with a higher quality alternative reinforcer and larger increases in target responding when a higher quality alternative reinforcer was removed. Along with prior findings with higher rates and magnitudes of alternative reinforcement, these findings suggest that variations in reinforcer dimensions that increase the efficacy of alternative reinforcement also tend to increase resurgence when alternative reinforcement is removed. The results are discussed in terms of the resurgence as choice in context model and in terms of potential clinical implications.     

Behavioral momentum theory fails to account for the effects of reinforcement rate on resurgence

The behavioral‐momentum model of resurgence predicts reinforcer rates within a resurgence preparation should have three effects on target behavior. First, higher reinforcer rates in baseline (Phase 1) produce more persistent target behavior during extinction plus alternative reinforcement. Second, higher rate alternative reinforcement during Phase 2 generates greater disruption of target responding during extinction. Finally, higher rates of either reinforcement source should produce greater responding when alternative reinforcement is suspended in Phase 3. Recent empirical reports have produced mixed results in terms of these predictions. Thus, the present experiment further examined reinforcer‐rate effects on persistence and resurgence. Rats pressed target levers for high‐rate or low‐rate variable‐interval food during Phase 1. In Phase 2, target‐lever pressing was extinguished, an alternative nose‐poke became available, and nose‐poking produced either high‐rate variable‐interval, low‐rate variable‐interval, or no (an extinction control) alternative reinforcement. Alternative reinforcement was suspended in Phase 3. For groups that received no alternative reinforcement, target‐lever pressing was less persistent following high‐rate than low‐rate Phase‐1 reinforcement. Target behavior was more persistent with low‐rate alternative reinforcement than with high‐rate alternative reinforcement or extinction alone. Finally, no differences in Phase‐3 responding were observed for groups that received either high‐rate or low‐rate alternative reinforcement, and resurgence occurred only following high‐rate alternative reinforcement. These findings are inconsistent with the momentum‐based model of resurgence. We conclude this model mischaracterizes the effects of reinforcer rates on persistence and resurgence of operant behavior.     

Resurgence following differential reinforcement of alternative behavior implemented with and without extinction

In the clinic, differential reinforcement of alternative behavior (DRA) often involves programming extinction for destructive behavior while reinforcing an alternative form of communication (e.g., a functional communication response); however, implementing extinction can be unsafe or impractical under some circumstances. Quantitative theories of resurgence (i.e., Behavioral Momentum Theory and Resurgence as Choice) predict differences in the efficacy of treatments that do and do not involve extinction of target responding when reinforcement conditions maintaining alternative responding worsen. We tested these predictions by examining resurgence following two DRA conditions in which we equated rates of reinforcement. In DRA without extinction, target and alternative behavior produced reinforcement. In DRA with extinction plus noncontingent reinforcement, only alternative behavior produced reinforcement. We conducted this study in a reverse-translation sequence, first with participants who engaged in destructive behavior (Experiment 1) and then in a laboratory setting with rats (Experiment 2). Across both experiments, we observed proportionally lower levels of target responding during and following the DRA condition that arranged extinction for the target response. However, levels of resurgence were similar following both arrangements.     

Delivering alternative reinforcement in a distinct context reduces its counter‐therapeutic effects on relapse

Delivery of alternative reinforcers in the presence of stimuli previously associated with reinforcement for target behavior increases the susceptibility of target behavior to relapse. To explore contingencies that might mitigate this counter‐therapeutic effect, we trained pigeons on a procedure that entailed extinction of previously reinforced target‐key pecking, access to a distinct stimulus context contingently on refraining from target behavior (differential‐reinforcement‐of‐other‐behavior; DRO), and reinforcement of alternative‐key pecks (differential‐reinforcement of alternative behavior; DRA) in that context. This DRO‐DRA treatment was compared with standard DRA in successive conditions, counterbalanced across pigeons. Target behavior extinguished more rapidly in the Standard‐DRA condition. When alternative reinforcement was discontinued, however, there was less resurgence after DRO‐DRA than after Standard DRA. In a third condition, the DRO contingency was suspended so that the former DRA stimuli were not presented (DRO‐NAC), and resurgence was greater than in the Standard‐DRA and DRO‐DRA conditions. Reinstatement produced by response‐independent reinforcers was small and similar across conditions. Subsequent reacquisition of target‐key pecking under baseline reinforcement conditions was faster following DRO‐NAC than Standard‐DRA or DRO‐DRA. These findings suggest that DRO‐DRA might serve as a useful method in clinical settings for reducing problem behavior while minimizing the threat of posttreatment relapse.     

Resurgence and repeated within-session progressive-interval thinning of alternative reinforcement

Resurgence of a previously suppressed target behavior is common when reinforcement for a more recently reinforced alternative behavior is thinned. To better characterize such resurgence, these experiments examined repeated within-session alternative reinforcement thinning using a progressive-interval (PI) schedule with rats. In Experiment 1, a transition from a high rate of alternative reinforcement to a within-session PI schedule generated robust resurgence, but subsequent complete removal of alternative reinforcement produced no additional resurgence. Experiment 2 replicated these findings and showed similar effects with a fixed-interval (FI) schedule arranging similarly reduced session-wide rates of alternative reinforcement. Thus, the lack of additional resurgence following repeated exposure to the PI schedule was likely due to the low overall obtained rate of alternative reinforcement provided by the PI schedule, rather than to exposure to within-session reinforcement thinning per se. In both experiments, target responding increased at some point in the session during schedule thinning and continued across the rest of the session. Rats exposed to a PI schedule showed resurgence later in the session and after more cumulative alternative reinforcers than those exposed to an FI schedule. The results suggest the potential importance of further exploring how timing and change-detection mechanisms might be involved in resurgence.     

Assessing the combined effects of resurgence and reinstatement in children diagnosed with autism spectrum disorder

Resurgence and reinstatement are laboratory models of relapse following treatments for problem behavior that arrange alternative sources of reinforcement, such as differential reinforcement of alternative behavior and noncontingent reinforcement. Resurgence models the elimination or reduction of reinforcers during treatment and reinstatement models the re‐presentation of reinforcers previously maintaining problem behavior. The present study examined individual and combined effects of resurgence and reinstatement in a translational model of treatment relapse with three children diagnosed with Autism Spectrum Disorder. We first reinforced and then extinguished an arbitrary response while providing access to a preferred toy to model a version of noncontingent reinforcement with extinction. In the following phases, we examined resurgence by removing the toy, reinstatement by presenting the training reinforcer response‐independently, and a combination of resurgence and reinstatement. Overall, relapse of target responding reliably exceeded functionally similar responses never reinforced in the experimental situation. Most importantly, relapse tended to be greater when combining resurgence and reinstatement than when assessing either alone. These findings support previous studies showing that combinations of operations can increase treatment relapse. This translational model arranging simulated problem behavior with arbitrary tasks provides a platform from which to thoroughly and systematically assess methods for understanding and improving behavioral treatments.     

Resurgence of goal-directed actions and habits

This study investigated how goal-directed and habitual behaviors recover after extinction within the context of the resurgence effect, a form of relapse induced by the removal or worsening of alternative reinforcement. Rats were trained to press a target lever with one reinforcer (O1) for either minimal (4) or extended (16) sessions. An extinction test after the completion of O1 devaluation confirmed that minimal and extended training formed goal-directed and habitual behaviors, respectively. Then, pressing an alternative lever was reinforced with a second reinforcer (O2) while the target response was placed on extinction. When O2 was discontinued, the minimally trained target response resurged with goal-directed status as in the extinction test. However, the extinguished habitual behavior in the extensively trained rats did not recover as a habit but instead with goal-directed status, possibly due to the context specificity of habits or the introduction of a new response–reinforcer contingency. The critical finding that reinforcer devaluation consistently led to less resurgence regardless of the amount of acquisition training provides a clinical implication that coupling differential-reinforcement-of-alternative-behavior (DRA) treatments with the devaluation of the associated reinforcer of problematic behavior could effectively diminish its recurrence.     

Stimuli previously associated with reinforcement mitigate resurgence

Resurgence refers to the recurrence of an extinguished target behavior following subsequent suspension of alternative reinforcement. Delivery of reinforcers during extinction of alternative behavior has been shown to mitigate resurgence. The present experiment aimed to determine whether delivering stimuli associated with reinforcers during resurgence testing similarly mitigates resurgence. Three groups of rats pressed target levers for food according to variable‐interval 15‐s schedules during Phase 1. In Phase 2, lever pressing was extinguished, and an alternative nose‐poke response produced alternative reinforcement according to a variable‐interval 15‐s schedule. Food reinforcement was always associated with illumination of the food aperture and an audible click from the pellet dispenser during Phases 1 and 2. Phase 3 treatments differed between groups. For one group, nose poking continued to produce food and food‐correlated stimuli. Both of these consequences were suspended for a second group. Finally, nose poking produced food‐correlated stimuli but not food for a third group. Target‐lever pressing resurged in the group that received no consequences and in the group that received only food‐correlated stimuli for nose poking. Resurgence, however, was smaller for the group that received food‐correlated stimuli than for the group that received no consequences for nose poking. Target‐lever pressing did not increase between phases in the group that continued to receive food and associated stimuli. Thus, delivery of stimuli associated with food reinforcement after suspension of food reduced but did not eliminate resurgence of extinguished lever pressing. These findings contribute to potential methodologies for preventing relapse of extinguished problem behavior in clinical settings.     

An evaluation of resurgence following functional communication training conducted in alternative antecedent contexts via telehealth

Treatments based on differential reinforcement may inadvertently increase the recurrence of problem behavior in the face of challenges because reinforcers for appropriate behavior occur in the same context as problem behavior. The current study evaluated one potential approach to mitigating these problems with differential reinforcement treatments based on behavioral momentum theory. Specifically, appropriate behavior was trained in contexts without a history of reinforcement prior to intervening with problem behavior. Participants were 4 children with autism spectrum disorder. Treatment used telehealth to implement functional communication training (FCT) in three alternative contexts with minimal or no history of reinforcement for problem behavior before initiating FCT in the treatment context. Evaluations of the effects of treatment and tests of resurgence were conducted intermittently during treatment to evaluate maintenance. When FCT treatment was initiated in alternative contexts, initial results were comparable to more typical implementations of FCT. Resurgence was reduced to similar levels during tests of resurgence for all participants when compared to more typical previously published implementations of FCT, but clinically significant reductions in resurgence occurred more quickly in the present study. These findings support training appropriate behavior in an alternative context to mitigate the resurgence of problem behavior during differential reinforcement treatments.     

Resurgence and downshifts in alternative reinforcement rate

Resurgence refers to an increase in a previously suppressed target behavior with a relative worsening of conditions for a more recently reinforced alternative behavior. This experiment examined the relation between resurgence and the magnitude of a reduction in the rate of reinforcement for the alternative behavior. Groups of both male and female rats initially pressed a target lever for food on a variable-interval (VI) 30-s schedule. In a second phase, responding to the target lever was extinguished for all groups and pressing an alternative lever was reinforced on a VI 10-s schedule. Next, the rate of reinforcement for alternative behavior was reduced differentially across groups by arranging extinction, VI 80-s, VI 40-s, VI 20-s, or continued VI 10-s reinforcement. Target responding increased as an exponential function of the magnitude of the reduction in alternative reinforcement rates. With the exception that males appeared to show higher rates of target responding in baseline and higher rates of alternative responding in other phases, the overall pattern of responding across phases was not meaningfully different between sexes. The pattern of both target and alternative response rates across sessions and phases was well described quantitatively by the Resurgence as Choice in Context model.     

Greater reinforcement rate during training increases spontaneous recovery

Spontaneous recovery occurs when a previously reinforced and recently extinguished response reemerges over the course of time, often at the beginning of a new session of extinction. Spontaneous recovery could underlie instances of treatment relapse that threaten otherwise effective behavioral interventions for problem behavior. In two experiments, we arranged multiple schedules with pigeons and a human child to assess the effects of different training reinforcer rates on spontaneous recovery. In both experiments, responding was both more resistant to extinction and more likely to relapse following training with greater reinforcement rates upon returning to extinction after time off from extinction testing. A quantitative model based on behavioral momentum theory accounted well for the data, which suggests reexposure to the extinction context following time off during extinction resulted in (1) the failure of extinction learning to generalize, and (2) greater generalization of original learning during training. The present model attempts to quantify theories attributing spontaneous recovery to changes in temporal context.     

Punishment of an alternative behavior generates resurgence of a previously extinguished target behavior

Resurgence is often defined as the recurrence of an extinguished behavior when a more recently reinforced alternative behavior is also extinguished. Resurgence has also been observed when the alternative behavior is devalued by other means (e.g., reinforcement rate or magnitude reductions). The present study investigated whether punishment of an alternative behavior would generate resurgence. A target response was reinforced during Phase 1 and then extinguished in Phase 2 while an alternative response was reinforced. During Phase 3, response‐dependent foot shocks were superimposed on the schedule of reinforcement for the alternative response and shock intensity was escalated gradually across sessions. Resurgence of the target response was reliably observed, mostly at higher intensities. The effect was replicated in two subsequent exposures to the sequence of conditions, with resurgence tending to occur at the lowest foot shock intensity. These results suggest that devaluation of an alternative behavior via punishment can generate resurgence. Although it is difficult to reconcile the overall pattern of results with Bouton's context account, these findings are consistent with the suggestion that resurgence results from a “worsening of conditions” for the alternative behavior and with the formalization of that suggestion in terms of a choice‐based matching‐law account (i.e., Resurgence as Choice).     

Baseline reinforcement rate and resurgence of destructive behavior

Concepts from behavioral momentum theory, along with some empirical findings, suggest that the rate of baseline reinforcement may contribute to the relapse of severe destructive behavior. With seven children who engaged in destructive behavior, we tested this hypothesis in the context of functional communication training by comparing the effects of different baseline reinforcement rates on resurgence during a treatment challenge (i.e., extinction). We observed convincing resurgence of destructive behavior in four of seven participants, and we observed more resurgence in the condition associated with high‐rate baseline reinforcement (i.e., variable‐interval 2 s in Experiment 1 or fixed‐ratio 1 in Experiment 2) compared to a low‐rate baseline reinforcement condition. We discuss the implications of these results relative to schedules of reinforcement in the treatment of destructive behavior and strategies to mitigate resurgence in clinical settings.     

Examining effects of training duration on humans' resurgence and variability using a novel touchscreen procedure

Resurgence occurs when a previously reinforced and then extinguished target response increases due to reducing/eliminating an alternative source of reinforcement or punishing an alternative response. We evaluated whether duration of reinforcement history for a target response (1) affects the degree to which resurgence is observed in humans and (2) produces different gradients of response generalization around target responding during extinction testing. We arranged a novel touchscreen interface in which university students could swipe a 3D soccer ball to spin any direction. In Phase 1, the first direction swiped became the target and produced points exchangeable for money for 3 or 1 min across 2 groups. The first swipe was recorded but had no programmed consequence in a third group. In Phase 2, swipes 180-degrees from the target resulted in points for 3 min in all groups. Point deliveries ceased for 2 min to test for resurgence in Phase 3. Target responses resurged during testing to a relatively greater extent with longer Phase-1 training but gradients of response generalization did not differ among groups. These findings extend prior research on the role of training duration on resurgence. We discuss methodological and conceptual issues surrounding the assessment of response generalization in resurgence.     

A model of resurgence based on behavioral momentum theory

Resurgence is the reappearance of an extinguished behavior when an alternative behavior reinforced during extinction is subsequently placed on extinction. Resurgence is of particular interest because it may be a source of relapse to problem behavior following treatments involving alternative reinforcement. In this article we develop a quantitative model of resurgence based on the augmented model of extinction provided by behavioral momentum theory. The model suggests that alternative reinforcement during extinction of a target response acts as both an additional source of disruption during extinction and as a source of reinforcement in the context that increases the future strength of the target response. The model does a good job accounting for existing data in the resurgence literature and makes novel and testable predictions. Thus, the model appears to provide a framework for understanding resurgence and serves to integrate the phenomenon into the existing theoretical account of persistence provided by behavioral momentum theory. In addition, we discuss some potential implications of the model for further development of behavioral momentum theory.