An experimental demonstration of AAB renewal in children with autism spectrum disorder

Operant renewal is a return of extinguished behavior due to changes in contextual stimuli that control the occurrence or nonoccurrence of a response. Well‐established in classical conditioning and operant research, renewal presents itself in three forms—ABA, ABC, and AAB—and poses threats to treatment maintenance where extinction procedures are utilized. As AAB renewal may be less likely to occur than ABA or ABC renewal, the current study sought to determine if AAB renewal would occur with three participants with Autism Spectrum Disorder who were taught a simple lever pull response. Results showed that lever pulls increased for two of three participants when we introduced novel stimuli (i.e., a light and a buzzer) to alter the contextual environment after extinction. These findings suggest that AAB renewal may account for some instances of response recovery after extinction and that the procedure of this study may be beneficial to the further study of renewal and the variables that affect its occurrence within a translational model.     

Renewal of Extinguished Lever-Press Responses upon Return to the Training Context

Two experiments with rats explored renewal effects in operant conditioning preparations. When pressing a lever was trained in one context and then extinguished in a second context, the responding was renewed by returning to the original context (ABA renewal) in Experiment 1. This finding was replicated in Experiment 2 with discriminative operant performance signaled by a localized light cue. In spite of the successful demonstration of ABA renewal effect in these experiments, AAB renewal was detected in neither experiment: When the responses had been extinguished in the context of acquisition, testing the rats in a second context did not renew the responses. The demonstration of ABA renewal but no AAB renewal suggests that extinction in another context and/or a return to the original context are critical for renewal of extinguished operant performance.     

Treatments that weaken Pavlovian conditioned fear and thwart its renewal in rats: implications for treating human phobias

In experiments using a total of 144 albino rat subjects, the authors assessed the ability of fear-weakening treatments to prevent fear renewal (relapse). Conditioned suppression of operant behavior served as the measure of fear in an A-B-A (acquisition-treatment-test) renewal paradigm. In Experiment 1, 100 nonreinforced exposures to a feared cue during treatment (extinction) did not reduce fear renewal relative to 20 exposures. In Experiment 2, explicitly unpaired (EU) treatments thwarted both renewal and reacquisition. In Experiment 3, conditioned inhibition (CI) and differential conditioning (DC) treatments weakened renewal and resisted both reacquisition and a form of reinstatement. In Experiment 4, EU, DC, and CI treatments all thwarted renewal. Evidence suggested that the ability of the treatments to do so reflected the combined effects of transfer of extinction across treatment and test contexts and habituation to the unconditioned stimulus.     

Renewal during functional communication training

Functional communication training (FCT) is one of the most commonly prescribed interventions for the treatment of severe destructive behavior exhibited by individuals with intellectual disabilities. Although highly effective, FCT has been shown to fail in some cases when treatment is introduced into the child's typical environment. Basic and translational research on renewal provides a model for studying the relapse of destructive behavior following successful response to treatment in clinic settings using FCT. In the present study, we evaluated whether relapse of destructive behavior could be attributed to the discriminative control of the home context, which was historically correlated with reinforcement for destructive behavior. We implemented baseline contingencies in the home setting with caregivers acting as interventionists (i.e., Context A). We then implemented FCT in a treatment clinic with trained therapists (i.e., Context B). Finally, we introduced FCT in the home setting with caregivers implementing the treatment procedures (i.e., return to Context A). For three of four participants we observed the relapse of destructive behavior consistent with operant renewal. We discuss the implications of these findings with respect to strategies designed to promote generalization of FCT across settings during the treatment of severe destructive behavior.     

Renewal of operant performance formerly eliminated by omission or noncontingency training upon return to the acquisition context

Renewal of operant performance formerly eliminated by omission or noncontingency training was explored in two experiments with rats. When pressing a lever was trained with food reinforcement in one context (A) and then eliminated in a second context (B), responding was renewed by returning the rats to the original context (A). This ABA renewal effect was demonstrated in Experiment 1 when the elimination training was an omission procedure (delivery of food for withholding responding) and in Experiment 2 when it was a noncontingency procedure (delivery of food irrespective of responding). Because omission training (differential reinforcement of other behavior) and noncontingency training have been used in applied settings as effective procedures to reduce undesired human behaviors, the clinical implications of our findings for the relapse of undesirable behavior were discussed.     

Contextual control of human fear associations in a renewal paradigm

The original model of behavior change suggests that extinction is context dependent whereas fear acquisition is context independent [Bouton, M. E. & Ricker, S. T. (1994). Renewal of extinguished responding in a second context. Animal Learning and Behavior, 22, 317-324]. Supportive evidence stems mainly from animal studies, showing that after acquisition (conditioned stimulus-unconditioned stimulus (CS-US)) in Context A and extinction in Context B, fear is renewed by presenting the CS in acquisition Context A (ABA renewal) or in a novel Context C (ABC renewal). By implication, the model predicts equal ABA and ABC renewal. However, there is also evidence to suggest that the context dependency of extinction and the context independency of acquisition may be less stringent than originally proposed. The present study investigated renewal in humans using a differential fear conditioning paradigm with a shock US and online shock expectancy ratings and electrodermal responses as dependent variables. Experiment 1 compared an ABA condition with an AAA condition. Experiment 2 compared three conditions: ABA, ABC, and AAA. Both experiments demonstrated ABA renewal. Most importantly, Experiment 2 showed larger ABA than ABC renewal. Overall, results for expectancy ratings were more convincing than for electrodermal responses. In line with the extinction model, the present findings support the context dependency of extinction in humans. In contrast to the model, the findings suggest that in humans not only extinction learning, but also fear acquisition is controlled by its current context.     

Investigations of operant ABA renewal during differential reinforcement

Operant renewal is a form of relapse in which a previously extinguished response recurs due to a change in context. We designed two experiments to examine the impact of differential reinforcement of alternative behavior on ABA renewal in a translational model of relapse with 12 children. We compared levels of renewal in two 3-phase arrangements. In one arrangement, we reinforced target responding in Context A, extinguished responding in Context B, and returned to Context A while continuing to implement extinction. In a second arrangement, an alternative response produced reinforcement in Context B and during the return to Context A. Results across the 2 experiments indicated 3 general findings. First, extinction plus differential reinforcement disrupted target behavior more consistently in Context B relative to extinction alone. Second, renewal tended to be greater and more persistent during extinction alone relative to extinction plus differential reinforcement. Third, the renewal effect appeared to depend on whether the alternative response had a history of extinction in Context A. We discuss methodological implications for the treatment of severe destructive behavior.     

Positive and negative conditioned suppression in the pigeon: Effects of the locus and modality of the CS

In Experiment I, four pigeons were exposed to trials in which a 12-sec key light illumination was followed by free food. These trials were superimposed upon a baseline of key pecking for food reinforcement on a variable-interval schedule. When the signal for food was on the operant key, response rate was substantially higher during the signal than during the baseline procedure. When the signal was on a second, signal key, operant responding was suppressed during the signal and substantial pecking of the signal key occurred. The sum of signal key and operant key pecks far exceeded the operant baseline rate of responding. An explanation of opposite results obtained with rats and pigeons as subjects in experiments of this type was suggested in terms of the spatial relation between the signal for free food and the operant target which usually characterizes these experiments. Experiment II assessed the importance of signal location when shock rather than food was the US. Suppression of operant key pecking was unaffected by signal location. Experiment III assessed the relative effectiveness of visual and auditory stimuli (clicks) as signals for food and shock, and found that all combinations of signal and US were equally effective in suppressing operant key responding. The three experiments together suggested that the identification of important effects of species—typical behavior in one experimental situation does not imply that there will be like effects in similar situations.     

Operant conditioning of autogrooming in vervet monkeys: Cercopithecus aethiops

Vervet monkeys received food reinforcement contingent on autogrooming. Experiment 1 reinforced grooming on a schedule of increasing intermittency and grooming increased in frequency and duration; with only pauses reinforced, grooming decreased in frequency and duration. Experiment 2 demonstrated differentiation of operant autogrooming; in each session a different single form of grooming was reinforced (for example, grooming the tail only), and that form increased in frequency while other forms became less frequent. In Experiment 3 scratching was succesfully conditioned with a method that selectively reinforced variety in behavior; reinforcement was contingent on a shift in scratching form. In Experiment 4, with no contingencies on grooming, a prefood stimulus did not increase autogrooming whether or not grooming had previously resulted in contingent reinforcement. The form of conditioned autogrooming resembled the form of unconditioned autogrooming. The discussion suggests how reinforcement principles can account for changes in the topography of operant behavior.     

Stimulus contributions to operant resurgence

In two experiments, pigeons were exposed to a three‐phase resurgence procedure (train Response A; extinguish Response A and train Response B; extinguish Response B). In the first experiment, the stimuli associated with phases were different, resulting in a resurgence procedure combined with an ABC renewal procedure. Presenting the novel stimulus, C, during extinction of both responses in the third phase resulted in minimal resurgence. Subsequently, substituting the original training Stimulus A for Stimulus C resulted in resurgence with all pigeons. In the second experiment, resurgence with the same stimuli present in all three phases of the resurgence procedure (AAA) was compared concurrently with a resurgence procedure in which the ABC renewal procedure used in Experiment 1 was superimposed. Substantially more resurgence occurred with the AAA procedure compared to the ABC procedure. Although ABC renewal in combination with the resurgence procedure generated some resurgence, such recurrent responding was attenuated relative to that observed when the stimulus conditions were constant across phases. Combined with earlier research showing the enhancing effects of combining resurgence and ABA renewal procedures, the present results elaborate on how stimuli correlated with certain behavioral histories affect the course of operant resurgence.     

Use of therapy time as a reinforcer: application of operant conditioning techniques within a traditional psychotherapy context

In operant conditioning, behavior is controlled by explicitly and systematically arranging the consequences of a specified response. This preliminary report describes the use of operant conditioning techniques utilizing a novel reinforcer—time allowed in therapy—to reinstate desirable study habits in a neurotic woman undergoing individual psychotherapy.     

How pigeons estimate rates of prey encounter.

Pigeons were trained on operant schedules simulating successive encounters with prey items. When items were encountered on variable-interval schedules, birds were more likely to accept a poor item (long delay to food) the longer they had just searched, as if they were averaging prey density over a short memory window (Experiment 1). Responding as if the immediate future would be like the immediate past was reversed when a short search predicted a long search next time (Experiment 2). Experience with different degrees of environmental predictability appeared to change the length of the memory window (Experiment 3). The results may reflect linear waiting (Higa, Wynne, & Staddon, 1991), but they differ in some respects. The findings have implications for possible mechanisms of adjusting behavior to current reinforcement conditions.     

Stimulus control of respondent and operant key pecking: A single key procedure

Pigeons' responses to a uniformly illuminated response key were either reinforced on a variable-interval one-minute schedule of reinforcement or extinguished for one-minute periods. When 1.5 second signals were presented at the beginning of each component, so as to differentially predict reinforcement, the pigeons pecked at the signals, at rates higher than rates during the remainder of the component. When the brief signals were not differentially predictive of reinforcement, pecking in their presence decreased to near zero levels. Similar results were obtained with signals based upon colors and upon line orientations. Changes in rates of (unreinforced) pecking occurred during the signal whether pigeons responded differentially during the remainder of the component or not. Experiment II demonstrated that the presence of the signal correlated with extinction was not necessary for pecking to develop at the signal which preceded the component in which responding was intermittently reinforced. The experiments demonstrated a clear dissociation of respondent control from operant control of a response. In addition, operant behavior was shown to be relatively insensitive to differing rates of reinforcement, as compared to the sensitivity of respondent behavior to differing rates of reinforcement produced by the very same operant behavior.     

Stimuli, Reinforcers, and the Persistence of Behavior

This article reviews evidence from basic and translational research with pigeons and humans suggesting that the persistence of operant behavior depends on the contingency between stimuli and reinforcers, and considers some implications for clinical interventions.     

Function transfer in human operant experiments: the role of stimulus pairings

Although function transfer often has been studied in complex operant procedures (such as matching to sample), whether operant reinforcement actually produces function transfer in such settings has not been established. The present experiments, with high school students as subjects, suggest that stimulus pairings can promote function transfer in conditions that closely approximate those of matching to sample. In Experiment 1, the subjects showed transfer of operant responding from three geometric figures (C1, C2, C3) to three colored shapes (B1, B2, B3) when the latter were paired with the former. Experiment 2 involved two groups of subjects. In the matching group, subjects matched the colored shapes with the geometric figures; in the yoked group, the shapes were merely paired with the geometric figures, and the schedule of stimulus pairing was yoked to the performance of the subjects in the matching group. Both groups of subjects showed function transfer. Experiment 3 documented function transfer from C stimuli to B stimuli through indirect stimulus pairings (A-B, A-C). In Experiment 4, function transfer was obtained even though the subjects vocalized continuously during the pairing trials, presumably preventing covert verbalization that might mediate transfer effects. Our results are consistent with a Pavlovian account and raise difficulties for current operant theories of function transfer.     

Determinants of contrast in the signal-key procedure: Evidence against additivity theory

Two experiments are reported that challenge the interpretation of previous results with the signal-key procedure, in which the discriminative stimuli are located on a response key different from the key associated with the operant response requirement. Experiment 1 replicated the procedure of Keller (1974), and found that contrast effects on the operant key occurred reliably for only one of four subjects. High rates to the signal key initially occurred for only one subject, but modifications of the procedure produced substantial rates to the signal key for all subjects. In all cases, however, signal-key behavior was greatly reduced by the addition of a changeover delay which prevented reinforcement within 2 seconds of the last peck to the signal key, suggesting that signal-key pecking was maintained primarily by adventitious reinforcement. Experiment 2 modified the signal-key procedure by using three response keys, so that the discriminative stimuli on the signal key controlled different responses during all phases of training. With this modification, reliable contrast effects on the operant key occurred for all subjects, suggesting that the failure to find contrast in previous studies has been due to the confounding of changes in the discrimination requirements with changes in relative rate of reinforcement. The results challenge the additivity theory of contrast, and suggest that “elicited” behavior plays a minor role, if any, in the determination of contrast effects in multiple schedules.     

EFFECTS OF TREATMENT INTEGRITY FAILURES DURING DIFFERENTIAL REINFORCEMENT OF ALTERNATIVE BEHAVIOR: A TRANSLATIONAL MODEL

Differential reinforcement of alternative behavior (DRA) is used frequently as a treatment for problem behavior. Previous studies on treatment integrity failures during DRA suggest that the intervention is robust, but research has not yet investigated the effects of different types of integrity failures. We examined the effects of two types of integrity failures on DRA, starting with a human operant procedure and extending the results to children with disabilities in a school setting. Human operant results (Experiment 1) showed that conditions involving reinforcement for problem behavior were more detrimental than failing to reinforce appropriate behavior alone, and that condition order affected the results. Experiments 2 and 3 replicated the effects of combined errors and sequence effects during actual treatment implementation.     

Predator videos and electric shock function as punishers for zebrafish (Danio rerio)

Zebrafish (Danio rerio) are a promising animal model for studying the effects of gene–environment interactions on behavior. Two experiments were conducted to assess punishment effects of presenting predator videos (Indian leaf fish; Nandus nandus) and electric shock on operant approach responses in zebrafish. In Experiment 1, the predator video and shock stimuli were presented upon a response maintained by a single variable‐interval schedule of food reinforcement in different groups of fish. In Experiment 2, the predator video and shock stimuli were presented upon one of two response alternatives maintain by concurrently available variable‐interval schedules of food reinforcement in different groups of fish. Responding decreased when the predator video and shock stimuli were presented relative to their absence in both experiments. Moreover, responding on an unpunished alternative did not reliably decrease in Experiment 2. These results indicate that the decrease in responding resulted from the punishment contingency rather than from elicited species‐specific defense responses or conditioned avoidance. Thus, the predator video and electric shock functioned as punishers of operant behavior for zebrafish. Identifying punishers for this species could lead to research on how gene–environment interactions influence individual differences in sensitivity to punishment.     

Further evaluation of a nonsequential approach to studying operant renewal

Basic‐laboratory assessments of renewal may inform clinical efforts to maintain reduction of severe destructive behavior when clients transition between contexts. The contextual changes arranged during standard renewal procedures, however, do not necessarily align with those that clients experience during outpatient therapy. More specifically, clients transition between clinical (associated with extinction for target behavior) and home/community (associated with reinforcement for target behavior) contexts during outpatient treatment. Standard renewal assessments do not incorporate these contextual alternations during treatment. The present experiment aimed to directly compare renewal of rats' lever pressing following a standard (“sequential”) ABA renewal procedure (i.e., baseline in Context A, extinction in Context B, renewal test in Context A) and a “nonsequential” renewal assessment wherein treatment consisted of daily alternation between Context A (associated with reinforcement for lever pressing) and Context B (associated with extinction). Lever pressing renewed to a greater extent for rats in the Nonsequential group than for rats in the Sequential group, suggesting the contextual changes that clients experience during outpatient treatment for severe destructive behavior may be a variable that is important to consider in translational research on renewal. Potential implications of these findings for basic and clinical research on renewal are discussed.