Response patterns and cardiovascular effects during response sequence acquisition by humans.

The effects of temporal delays imposed between successive responses and of vitamin C administration were examined on the acquisition of response sequences and on cardiovascular reactivity during sequence acquisition. Thirteen adult subjects (6 female, 7 male), in good health, gave written consent prior to participating in 12 weekly 45-min sessions. Points, exchanged for money after each session, were presented when subjects completed 15-response sequences on a touch-sensitive three-response keypad. A position counter increased from 0 to 14 as subjects emitted correct responses in the sequence. Four novel 15-response sequences were presented each session. No delays were imposed between successive responses during the acquisition of one sequence; delays were imposed immediately following each response during the acquisition of a second sequence, thereby delaying response feedback; delays were imposed following feedback during acquisition of a third sequence, resulting in the removal of the stimulus correlated with sequence position; and, as a control condition, delays were imposed following feedback, but stimuli correlated with sequence position were reinstated prior to the next response during acquisition of a fourth sequence. Subjects were exposed to one of two delay durations (0.2 and 0.5 or 0.5 and 1.0 s) each session, and delay durations alternated every session. During Weeks 5 to 8, subjects received 3 grams of vitamin C per day, whereas during Weeks 1 to 4 and 9 to 12, subjects received placebo under single-blind conditions. All subjects acquired the sequences, as evidenced by decreasing percentages of incorrect responses across trials. When temporal delays were imposed between successive responses during sequence acquisition, acquisition efficiency was enhanced. Examination of response latencies suggested that the status of preceding responses (i.e., correct or incorrect) rather than the status of the position counter influenced subsequent responding. Cardiovascular effects were inversely related to the length of the temporal delay. Neither cardiovascular reactivity or sequence acquisition were related to vitamin C administration.     

Persistence and relapse of reinforced behavioral variability

The present study examined persistence and relapse of reinforced behavioral variability in pigeons. Pigeons emitted four‐response sequences across two keys. Sequences produced food according to a lag schedule, in which a response sequence was followed by food if it differed from a certain number of previous sequences. In Experiment 1, food was delivered for sequences that satisfied a lag schedule in both components of a multiple schedule. When reinforcement was removed for one component (i.e., extinction), levels of behavioral variability decreased for only that component. In Experiment 2, food was delivered for sequences satisfying a lag schedule in one component of a multiple schedule. In the other component, food was delivered at the same rate, but without the lag variability requirement (i.e., yoked). Following extinction, levels of behavioral variability returned to baseline for both components after response‐independent food delivery (i.e., reinstatement). In Experiment 3, one group of pigeons responded on a lag variability schedule, and the other group responded on a lag repetition schedule. For both groups, levels of behavioral variability increased when alternative reinforcement was suspended (i.e., resurgence). In each experiment, we observed some evidence for extinction‐induced response variability and for variability as an operant dimension of behavior.     

AN EVALUATION OF RESURGENCE DURING TREATMENT WITH FUNCTIONAL COMMUNICATION TRAINING

Extinction‐induced resurgence is the recurrence of previously reinforced behavior when another behavior is placed on extinction (Lieving, Hagopian, Long, & O'Connor, 2004). This phenomenon may account for some instances of treatment relapse when problem behavior recovers during extinction‐based treatments. The current study sought to determine whether resurgence of problem behavior would reliably occur with 5 participants who received treatment with FCT. Results showed that problem behavior reemerged for all but 1 participant when the communicative response was exposed to extinction or thin schedules of reinforcement. These findings suggest that resurgence may account for some instances of response recovery during treatment, and that the described procedure may be useful for the further study of resurgence and eventual prevention of this phenomenon.     

Acquisition,Extinction, Recovery,and Reversal of Different Response Sequences Under Conditional Control by Nicotine in Rats

Complex voluntary behaviors occur in sequence. Eight rats were trained in an operant procedure that used nicotine and non-drug (saline) states as interoceptive cues that signaled which of two behavioral sequences led to food reward. The distal and proximal responses in the chain were always maintained on variable interval 30-sec and fixed ratio-1 schedules, respectively, and rate differences between the responses were used as the dependent variable. Extinction and reversal training was conducted. Distal response rates were significantly greater than proximal response rates during training, testing, extinction, and reversal learning. These data suggest that (a) nicotine can establish interoceptive control over different response sequences, and (b) extinction of one response sequence may be state-dependent. The clinical relevance of extinction of complex behavioral repertoires such as drug-seeking and drug-taking behavior that are evoked by specific interoceptive cues is addressed in regard to drug abuse treatment and relapse.     

Hierarchical resurgence

In resurgence, conventionally a target response is trained and then extinguished while some alternative response is reinforced. In the most common procedure, when the latter is extinguished, the former resurges. The present experiments examined resurgence after two responses were trained sequentially and subsequently extinguished. In Experiments 1 and 2, keypecking to one key was trained and then extinguished as keypecking to a different key was trained then later extinguished. In both experiments, regardless of the spatial location of the different keys, the last‐trained response resurged before the first‐trained one. The results were replicated in Experiment 3 where reinforcement rate of the first‐trained response was four times that of the second‐trained response. The results in conjunction with earlier experiments suggest that resurgence occurs hierarchically, although whether more or less recently trained target responses resurge first or later may depend on both current and historical variables. The results also raise questions about the interpretation of responding on a control key that sometimes is included in resurgence experiments to isolate resurgence from extinction‐induced responding.     

Drug discrimination: stimulus control during repeated testing in extinction

Rats were trained, under a two-lever drug-discrimination procedure, to respond differentially depending upon whether lorazepam (1.0 mg/kg) or no injection had been administered before the session. Responses on the appropriate lever produced a food pellet under a modified fixed-ratio (FR) 10 schedule, in which the 10 responses had to be emitted consecutively. In reinforcement tests, completing an FR 10 on either lever produced a pellet. In extinction tests, stimulus changes paired with reinforcement occurred but no pellet was delivered. Training sessions were conducted between test sessions. Each of four extinction phases consisted of six tests preceded by one stimulus (e.g., lorazepam). Repeated exposures to extinction reduced response rates for all rats, but stimulus control, as inferred from either percentage of total responses or percentage of total FR 10s on the drug-appropriate lever, remained high. The percentage of total FR 10s measure was less subject to skewing under low-rate conditions than was the percentage of total responses measure and provided an evaluation of stimulus control in terms of meeting the consecutive response contingency. These results demonstrate a level of independence between response rate and stimulus control in drug discrimination, which has positive implications for the validity of interpreting discriminative effects of novel test conditions in well-trained animals, even when overall response rates are low.     

Sequences of spaced responses: Behavioral units and the role of contiguity

Sequences of temporally spaced responses were reinforced to investigate the effects of delay of reinforcement on the formation of functional behavioral units. In Experiment 1, rats' two- and three-response demarcated sequences of left and right lever presses were reinforced such that different response distributions would occur depending on whether the sequences themselves or individual responses were functional units. The matching law could thus be obeyed either by individual responses or by sequences, but not by both; intermediate results were possible. Both regular (nonretractable) and retractable levers were used; the retractable levers precluded the occurrence of insufficiently spaced responses. At a minimum interresponse time of 5 s for regular levers and 7 s for retractable ones, matching results were intermediate, with greater evidence of sequence conditionability in the two-response sequences than in the three-response sequences. In Experiment 2, the required minimum interresponse spacing for two-response retractable-lever sequences was varied in an attempt to locate the sequence matching threshold. This attempt was unsuccessful, but the sequences (instead of individual responses) more closely obeyed the matching law. In the shortest spaced condition, conditional probability data on Lag 1 sequence emission order showed marked, highly similar patterning for all rats, indicating sequential control of the sequences. Post hoc definition of the behavioral unit in these studies is ambiguous. Although reinforcement contiguity was important, aspects of the results could support both molar- and molecular-level interpretations.     

An evaluation of resurgence following functional communication training conducted in alternative antecedent contexts via telehealth

Treatments based on differential reinforcement may inadvertently increase the recurrence of problem behavior in the face of challenges because reinforcers for appropriate behavior occur in the same context as problem behavior. The current study evaluated one potential approach to mitigating these problems with differential reinforcement treatments based on behavioral momentum theory. Specifically, appropriate behavior was trained in contexts without a history of reinforcement prior to intervening with problem behavior. Participants were 4 children with autism spectrum disorder. Treatment used telehealth to implement functional communication training (FCT) in three alternative contexts with minimal or no history of reinforcement for problem behavior before initiating FCT in the treatment context. Evaluations of the effects of treatment and tests of resurgence were conducted intermittently during treatment to evaluate maintenance. When FCT treatment was initiated in alternative contexts, initial results were comparable to more typical implementations of FCT. Resurgence was reduced to similar levels during tests of resurgence for all participants when compared to more typical previously published implementations of FCT, but clinically significant reductions in resurgence occurred more quickly in the present study. These findings support training appropriate behavior in an alternative context to mitigate the resurgence of problem behavior during differential reinforcement treatments.     

Effects of ethanol on reinforced variations and repetitions by rats under a multiple schedule.

Response sequences emitted by five Long-Evans rats were reinforced under a two-component multiple schedule. In the REPEAT component, food pellets were contingent upon completion of a left-left-right-right (LLRR) sequence on two levers. In the VARY component, pellets were contingent upon variable sequences (i.e., a sequence was reinforced only if it differed from each of the previous five sequences). The rats learned to emit LLRR sequences in the REPEAT component and variable sequences in VARY. Intraperitoneal injections of ethanol (1.25, 1.75, and 2.25 g/kg) significantly increased sequence variability in REPEAT, thereby lowering reinforcement probability, but had little effect on sequence variability in the VARY component. These results extend previous findings that alcohol impairs the performance of reinforced repetitions but not of reinforced variations in response sequences.     

Resurgence of integrated behavioral units

Two experiments with rats examined the dynamics of well-learned response sequences when reinforcement contingencies were changed. Both experiments contained four phases, each of which reinforced a 2-response sequence of lever presses until responding was stable. The contingencies then were shifted to a new reinforced sequence until responding was again stable. Extinction-induced resurgence of previously reinforced, and then extinguished, heterogeneous response sequences was observed in all subjects in both experiments. These sequences were demonstrated to be integrated behavioral units, controlled by processes acting at the level of the entire sequence. Response-level processes were also simultaneously operative. Errors in sequence production were strongly influenced by the terminal, not the initial, response in the currently reinforced sequence, but not by the previously reinforced sequence. These studies demonstrate that sequence-level and response-level processes can operate simultaneously in integrated behavioral units. Resurgence and the development of integrated behavioral units may be dissociated; thus the observation of one does not necessarily imply the other.     

Resurgence of goal-directed actions and habits

This study investigated how goal-directed and habitual behaviors recover after extinction within the context of the resurgence effect, a form of relapse induced by the removal or worsening of alternative reinforcement. Rats were trained to press a target lever with one reinforcer (O1) for either minimal (4) or extended (16) sessions. An extinction test after the completion of O1 devaluation confirmed that minimal and extended training formed goal-directed and habitual behaviors, respectively. Then, pressing an alternative lever was reinforced with a second reinforcer (O2) while the target response was placed on extinction. When O2 was discontinued, the minimally trained target response resurged with goal-directed status as in the extinction test. However, the extinguished habitual behavior in the extensively trained rats did not recover as a habit but instead with goal-directed status, possibly due to the context specificity of habits or the introduction of a new response–reinforcer contingency. The critical finding that reinforcer devaluation consistently led to less resurgence regardless of the amount of acquisition training provides a clinical implication that coupling differential-reinforcement-of-alternative-behavior (DRA) treatments with the devaluation of the associated reinforcer of problematic behavior could effectively diminish its recurrence.     

Mitigating resurgence of destructive behavior using the discriminative stimuli of a multiple schedule

Results of several recent translational studies have suggested that correlating contextual or discriminative stimuli with the delivery and withholding of reinforcement for the functional communication response (FCR) may mitigate resurgence of destructive behavior, but few, if any, have isolated the effects of those stimuli. In the present study, we first trained the FCR, brought it under stimulus control of a multiple schedule, and thinned its reinforcement schedule in one stimulus context. Next, we conducted resurgence evaluations (i.e., baseline, functional communication training [FCT], extinction challenge) in two novel contexts to test the effects of the discriminative stimuli on resurgence. We programmed one context to include the (a) S^D during the FCT phase to signal the availability of reinforcement for the FCR and (b) S^Δ during a subsequent extinction challenge to signal the unavailability of reinforcement for the FCR. The other context did not include the S^D during the FCT phase, nor the S^Δ during the extinction challenge. We expected to see greater persistence of the FCR in the context that included the S^D during FCT and less persistence of the FCR and less resurgence of destructive behavior in the context that included the S^Δ during the extinction challenge. Obtained results confirmed this latter prediction, but we observed no reliable difference when the S^D was present or absent during the FCT phase. Our results have relevance for practitioners in that they provide further empirical support for the use of discriminative stimuli when treating destructive behavior.     

Resurgence of previously taught academic responses

Resurgence is often discussed in relation to the relapse of undesirable behavior. However, resurgence may also describe the recurrence of socially appropriate behavior, including academic responding. The recurrence of academic responses following periods of extinction may aid in the solution of novel problems. The aims of this study were to evaluate the resurgence of complex, desirable behavior related to college-level instruction and to explore problem form as an aspect of environmental context. Each participant was taught 2 response chains to solve quadratic equations across experimental phases, followed by a phase in which neither chain resulted in the correct solution (extinction). During Experiment 1, the equations presented during extinction resembled those presented during reinforcement of the alternative response. Of the 8 participants in Experiment 1, 4 attempted to use the first-taught chain to solve an equation in the extinction phase. During Experiment 2, the equations presented during extinction resembled those presented during reinforcement of the target response. Of the 8 participants in Experiment 2, 6 attempted to use the first-taught chain to solve an equation in the extinction phase. Results demonstrate the resurgence of academic responses and suggest that the form of the problem may constitute a context that affects resurgence.     

Stimulus–reinforcer relations established during training determine resistance to extinction and relapse via reinstatement

The baseline rate of a reinforced target response decreases with the availability of response‐independent sources of alternative reinforcement; however, resistance to disruption and relapse increases. Because many behavioral treatments for problem behavior include response‐dependent reinforcement of alternative behavior, the present study assessed whether response‐dependent alternative reinforcement also decreases baseline response rates but increases resistance to extinction and relapse. We reinforced target responding at equal rates across two components of a multiple schedule with pigeons. We compared resistance to extinction and relapse via reinstatement of (1) a target response trained concurrently with a reinforced alternative response in one component with (2) a target response trained either concurrently or in separate components from the alternative response across conditions. Target response rates trained alone in baseline were higher but resistance to extinction and relapse via reinstatement tests were greater after training concurrently with the alternative response. In another assessment, training target and alternative responding together, but separating them during extinction and reinstatement tests, produced equal resistance to extinction and relapse. Together, these findings are consistent with behavioral momentum theory—operant response–reinforcer relations determined baseline response rates but Pavlovian stimulus–reinforcer relations established during training determined resistance to extinction and relapse. These findings imply that reinforcing alternative behavior to treat problem behavior could initially reduce rates but increase persistence.     

Stability and variability in extinction

Some studies have found that extinction leaves response structures unaltered; others have found that response variability is increased. Responding by Long-Evans rats was extinguished after 3 schedules. In one, reinforcement depended on repetitions of a particular response sequence across 3 operanda. In another, sequences were reinforced only if they varied. In the third, reinforcement was yoked: not contingent upon repetitions or variations. In all cases, rare sequences increased during extinction--variability increased--but the ordering of sequence probabilities was generally unchanged, the most common sequences during reinforcement continuing to be most frequent in extinction. The rats' combination of generally doing what worked before but occasionally doing something very different may maximize the possibility of reinforcement from a previously bountiful source while providing necessary variations for new learning.     

Examining stimuli paired with alternative reinforcement to mitigate resurgence in children diagnosed with autism spectrum disorder and pigeons

In two laboratory experiments, we examined whether stimuli paired with alternative reinforcers could mitigate resurgence of a previously reinforced target response with pigeons (Experiment 1) and children diagnosed with Autism Spectrum Disorder (Experiment 2). In Phase 1, we arranged food reinforcement according to a variable-ratio schedule for engaging in a target response. In Phase 2, we arranged extinction for target responding and differentially reinforced alternative responding according to a fixed-ratio schedule, with every alternative-reinforcer delivery paired with a change in keylight color (Experiment 1) or automated verbal (praise) statement (Experiment 2). In Phase 3, we assessed resurgence during extinction of target and alternative responding in the presence versus absence of continued presentation of the paired stimulus. Despite variation across sessions, resurgence on average was lower when continuing to present the paired stimuli in all pigeons and children while maintenance of alternative responding did not differ between assessments. These findings indicate that stimuli paired with alternative reinforcement can modestly decrease resurgence, but further examination of their efficacy and a better understanding of the underlying processes are necessary before they can be recommended for clinical use in reducing resurgence of clinically relevant problem behavior.     

Examining effects of training duration on humans' resurgence and variability using a novel touchscreen procedure

Resurgence occurs when a previously reinforced and then extinguished target response increases due to reducing/eliminating an alternative source of reinforcement or punishing an alternative response. We evaluated whether duration of reinforcement history for a target response (1) affects the degree to which resurgence is observed in humans and (2) produces different gradients of response generalization around target responding during extinction testing. We arranged a novel touchscreen interface in which university students could swipe a 3D soccer ball to spin any direction. In Phase 1, the first direction swiped became the target and produced points exchangeable for money for 3 or 1 min across 2 groups. The first swipe was recorded but had no programmed consequence in a third group. In Phase 2, swipes 180-degrees from the target resulted in points for 3 min in all groups. Point deliveries ceased for 2 min to test for resurgence in Phase 3. Target responses resurged during testing to a relatively greater extent with longer Phase-1 training but gradients of response generalization did not differ among groups. These findings extend prior research on the role of training duration on resurgence. We discuss methodological and conceptual issues surrounding the assessment of response generalization in resurgence.     

Behavioral momentum theory fails to account for the effects of reinforcement rate on resurgence

The behavioral‐momentum model of resurgence predicts reinforcer rates within a resurgence preparation should have three effects on target behavior. First, higher reinforcer rates in baseline (Phase 1) produce more persistent target behavior during extinction plus alternative reinforcement. Second, higher rate alternative reinforcement during Phase 2 generates greater disruption of target responding during extinction. Finally, higher rates of either reinforcement source should produce greater responding when alternative reinforcement is suspended in Phase 3. Recent empirical reports have produced mixed results in terms of these predictions. Thus, the present experiment further examined reinforcer‐rate effects on persistence and resurgence. Rats pressed target levers for high‐rate or low‐rate variable‐interval food during Phase 1. In Phase 2, target‐lever pressing was extinguished, an alternative nose‐poke became available, and nose‐poking produced either high‐rate variable‐interval, low‐rate variable‐interval, or no (an extinction control) alternative reinforcement. Alternative reinforcement was suspended in Phase 3. For groups that received no alternative reinforcement, target‐lever pressing was less persistent following high‐rate than low‐rate Phase‐1 reinforcement. Target behavior was more persistent with low‐rate alternative reinforcement than with high‐rate alternative reinforcement or extinction alone. Finally, no differences in Phase‐3 responding were observed for groups that received either high‐rate or low‐rate alternative reinforcement, and resurgence occurred only following high‐rate alternative reinforcement. These findings are inconsistent with the momentum‐based model of resurgence. We conclude this model mischaracterizes the effects of reinforcer rates on persistence and resurgence of operant behavior.     

Resurgence following differential reinforcement of alternative behavior implemented with and without extinction

In the clinic, differential reinforcement of alternative behavior (DRA) often involves programming extinction for destructive behavior while reinforcing an alternative form of communication (e.g., a functional communication response); however, implementing extinction can be unsafe or impractical under some circumstances. Quantitative theories of resurgence (i.e., Behavioral Momentum Theory and Resurgence as Choice) predict differences in the efficacy of treatments that do and do not involve extinction of target responding when reinforcement conditions maintaining alternative responding worsen. We tested these predictions by examining resurgence following two DRA conditions in which we equated rates of reinforcement. In DRA without extinction, target and alternative behavior produced reinforcement. In DRA with extinction plus noncontingent reinforcement, only alternative behavior produced reinforcement. We conducted this study in a reverse-translation sequence, first with participants who engaged in destructive behavior (Experiment 1) and then in a laboratory setting with rats (Experiment 2). Across both experiments, we observed proportionally lower levels of target responding during and following the DRA condition that arranged extinction for the target response. However, levels of resurgence were similar following both arrangements.     

Serial functional communication training: Extending serial DRA to mands and problem behavior

Functional communication training (FCT) is commonly used to eliminate problem behavior. Not surprisingly, the efficacy of the intervention depends on fidelity to programmed procedures. For instance, problem behavior is likely to resurge if caregivers fail to reinforce mands during the maintenance stages of FCT. Despite this, recent translational work on arbitrary human responses suggests that incorporating multiple‐mand instruction into a serial‐training format may increase the probability of a recency effect, and a reversion of response resurgence (both desirable outcomes when mands are the most recently reinforced responses prior to extinction). Although promising, this effect has not been replicated with socially significant human behavior. Thus, we compared the relative effect of traditional FCT with that of serial FCT on the resurgence of the problem behavior, and mands, of 2 children. In contrast to previous research, we observed primacy effects for both subjects (i.e., the magnitude of the resurgence of problem behavior was greater than it was for any subsequently trained mand), and mand resurgence never occurred for one subject. Notwithstanding these limitations, the percentage of total responding allocated toward the resurgence of problem behavior was less in the serial FCT component relative to the traditional FCT component, and we observed a reversion of response resurgence for one subject.