Further evaluation of a nonsequential approach to studying operant renewal

Basic‐laboratory assessments of renewal may inform clinical efforts to maintain reduction of severe destructive behavior when clients transition between contexts. The contextual changes arranged during standard renewal procedures, however, do not necessarily align with those that clients experience during outpatient therapy. More specifically, clients transition between clinical (associated with extinction for target behavior) and home/community (associated with reinforcement for target behavior) contexts during outpatient treatment. Standard renewal assessments do not incorporate these contextual alternations during treatment. The present experiment aimed to directly compare renewal of rats' lever pressing following a standard (“sequential”) ABA renewal procedure (i.e., baseline in Context A, extinction in Context B, renewal test in Context A) and a “nonsequential” renewal assessment wherein treatment consisted of daily alternation between Context A (associated with reinforcement for lever pressing) and Context B (associated with extinction). Lever pressing renewed to a greater extent for rats in the Nonsequential group than for rats in the Sequential group, suggesting the contextual changes that clients experience during outpatient treatment for severe destructive behavior may be a variable that is important to consider in translational research on renewal. Potential implications of these findings for basic and clinical research on renewal are discussed.     

Basic and applied research on extinction bursts

Discontinuation of the contingency between a response and its reinforcer sometimes produces a temporary increase in the response before its rate decreases, a phenomenon called the extinction burst. Prior clinical and basic studies on the prevalence of the extinction burst provide highly disparate estimates. Existing theories on the extinction burst fail to account for the dynamic nature of this phenomenon, and the basic behavioral processes that control response bursting remain poorly understood. In this paper, we first review the basic and applied literature on the extinction burst. We then describe a recent refinement of the concatenated matching law called the temporally weighted matching law that appears to resolve the above-mentioned issues regarding the extinction burst. We present illustrative translational data based conceptually on the model. Finally, we discuss specific recommendations derived from the temporally weighted matching law regarding procedures clinicians could implement to potentially mitigate or prevent extinction bursts.     

EFFECTS OF TREATMENT INTEGRITY FAILURES DURING DIFFERENTIAL REINFORCEMENT OF ALTERNATIVE BEHAVIOR: A TRANSLATIONAL MODEL

Differential reinforcement of alternative behavior (DRA) is used frequently as a treatment for problem behavior. Previous studies on treatment integrity failures during DRA suggest that the intervention is robust, but research has not yet investigated the effects of different types of integrity failures. We examined the effects of two types of integrity failures on DRA, starting with a human operant procedure and extending the results to children with disabilities in a school setting. Human operant results (Experiment 1) showed that conditions involving reinforcement for problem behavior were more detrimental than failing to reinforce appropriate behavior alone, and that condition order affected the results. Experiments 2 and 3 replicated the effects of combined errors and sequence effects during actual treatment implementation.     

The power of one reinforcer: The effect of a single reinforcer in the context of shaping

During shaping, if the organism is engaged in behaviors other than the current approximation, the amount of time between reinforcers increases. In these situations, the shaper may resort to what is referred to as a “desperation‐driven click.” That is, after a period of no reinforcement, the shaper delivers one reinforcer for a nontarget approximation. Reports from professional animal trainers suggest that the animal may continue performing this new behavior, even if it is reinforced only once. This study attempted to model this phenomenon with college students. Results from the study demonstrated that a desperation‐driven click situation can be reliably produced in a controlled setting. When participants received one reinforcer for interacting with a new object following a period of no reinforcement, they interacted with the new object for a longer or equal amount of time as compared to an object that had a longer history of reinforcement. The results of this study have implications for the understanding of how reinforcement controls behavior.     

Stimulus–reinforcer relations established during training determine resistance to extinction and relapse via reinstatement

The baseline rate of a reinforced target response decreases with the availability of response‐independent sources of alternative reinforcement; however, resistance to disruption and relapse increases. Because many behavioral treatments for problem behavior include response‐dependent reinforcement of alternative behavior, the present study assessed whether response‐dependent alternative reinforcement also decreases baseline response rates but increases resistance to extinction and relapse. We reinforced target responding at equal rates across two components of a multiple schedule with pigeons. We compared resistance to extinction and relapse via reinstatement of (1) a target response trained concurrently with a reinforced alternative response in one component with (2) a target response trained either concurrently or in separate components from the alternative response across conditions. Target response rates trained alone in baseline were higher but resistance to extinction and relapse via reinstatement tests were greater after training concurrently with the alternative response. In another assessment, training target and alternative responding together, but separating them during extinction and reinstatement tests, produced equal resistance to extinction and relapse. Together, these findings are consistent with behavioral momentum theory—operant response–reinforcer relations determined baseline response rates but Pavlovian stimulus–reinforcer relations established during training determined resistance to extinction and relapse. These findings imply that reinforcing alternative behavior to treat problem behavior could initially reduce rates but increase persistence.     

APPLIED IMPLICATIONS OF REINFORCEMENT HISTORY EFFECTS

Although the influence of reinforcement history is a theoretical focus of behavior analysis, the specific behavioral effects of reinforcement history have received relatively little attention in applied research and practice. We examined the potential effects of reinforcement history by reviewing nonhuman, human operant, and applied research and interpreted the findings in relation to possible applied significance. The focus is on reinforcement history effects in the context of reinforcement schedules commonly used either to strengthen behavior (e.g., interval schedules) or commonly used to decrease behavior (e.g., extinction).     

Prevalence of the extinction burst and its attenuation during treatment

Although extinction has been an effective treatment for a variety of behavior disorders, its use may be associated with several adverse side effects, the most common being an initial increase in the frequency of the target response, called an "extinction burst." We attempted to determine the prevalence of the extinction burst in applied research and its possible attenuation with other operant procedures. An analysis of 113 sets of extinction data indicated that bursting may not be as common as previously assumed (it occurred in 24% of the cases) and may be less likely when extinction is implemented with alternative procedures rather than as the sole intervention (bursting was evident in 12% of the former cases and 36% of the latter).     

Response production during extinction training is not sufficient for extinction of evaluative conditioning

Two high-powered experiments examined the role of evaluative response production in the extinction of evaluative conditioning (EC) by positioning EC in the procedural and conceptual framework of classical conditioning (CC). According to Rescorla's response inhibition hypothesis, more frequent responding during extinction training results in larger extinction during testing. Experiment 1 used three extinction conditions following response acquisition in an EC procedure: evaluative responses were measured only after extinction; after acquisition and after extinction; or were continuously measured after acquisition, during extinction and after extinction. Based on Rescorla's response inhibition hypothesis, we predicted that extinction of EC would be the highest in the third condition. Experiment 2 was aimed at further facilitating extinction of EC by encouraging participants to experience that their evaluation may change over the course of the experiment. To this end, half of the participants completed pre- and post-acquisition ratings prior to practicing continuous response expression in the extinction phase. Contrary to our predictions, no extinction of EC was observed in either of these experiments. We conclude that Rescorla's inhibition response hypothesis may not apply to EC and discuss the theoretical implications of this finding.     

Drug discrimination: stimulus control during repeated testing in extinction

Rats were trained, under a two-lever drug-discrimination procedure, to respond differentially depending upon whether lorazepam (1.0 mg/kg) or no injection had been administered before the session. Responses on the appropriate lever produced a food pellet under a modified fixed-ratio (FR) 10 schedule, in which the 10 responses had to be emitted consecutively. In reinforcement tests, completing an FR 10 on either lever produced a pellet. In extinction tests, stimulus changes paired with reinforcement occurred but no pellet was delivered. Training sessions were conducted between test sessions. Each of four extinction phases consisted of six tests preceded by one stimulus (e.g., lorazepam). Repeated exposures to extinction reduced response rates for all rats, but stimulus control, as inferred from either percentage of total responses or percentage of total FR 10s on the drug-appropriate lever, remained high. The percentage of total FR 10s measure was less subject to skewing under low-rate conditions than was the percentage of total responses measure and provided an evaluation of stimulus control in terms of meeting the consecutive response contingency. These results demonstrate a level of independence between response rate and stimulus control in drug discrimination, which has positive implications for the validity of interpreting discriminative effects of novel test conditions in well-trained animals, even when overall response rates are low.     

Development and modification of a response class via positive and negative reinforcement: a translational approach

When responses function to produce the same reinforcer, a response class exists. Researchers have examined response classes in applied settings; however, the challenges associated with conducting applied research on response class development have recently necessitated the development of an analogue response class model. To date, little research has examined response classes that are strengthened by negative reinforcement. The current investigation was designed to develop a laboratory model of a response class through positive reinforcement (i.e., points exchangeable for money) and through negative reinforcement (i.e., the avoidance of scheduled point losses) with 11 college students as participants and clicks as the operant. Results of both the positive and negative reinforcement evaluations showed that participants usually selected the least effortful response that produced points or the avoidance of point losses, respectively. The applied implications of the findings are discussed, along with the relevance of the present model to the study of punishment and resurgence.     

Assessing the role of alternative response rates and reinforcer rates in resistance to extinction of target responding when combining stimuli

Studies of behavioral momentum reveal that reinforcing an alternative response in the presence of a target response reduces the rate of target responding but increases its persistence, relative to training the target response on its own. Because of the parallels between these studies and differential‐reinforcement techniques to reduce problem behavior in clinical settings, alternative techniques to reduce problem behavior without enhancing its persistence are being explored. One potential solution is to train an alternative response in a separate stimulus context from problem behavior before combining the alternative stimulus with the target stimulus. The present study assessed how differences in reinforcement contingencies and rate for alternative responding influenced resistance to extinction of target responding when combining alternative and target stimuli in pigeons. Across three experiments, alternative stimuli signaling a response–reinforcer dependency and greater reinforcer rates more effectively decreased the persistence of target responding when combining alternative and target stimuli within the same extinction tests, but not when compared across separate extinction tests. Overall, these findings reveal that differences in competition between alternative and target responding produced by contingencies of alternative reinforcement could influence the effectiveness of treating problem behavior through combining stimulus contexts.     

Greater reinforcement rate during training increases spontaneous recovery

Spontaneous recovery occurs when a previously reinforced and recently extinguished response reemerges over the course of time, often at the beginning of a new session of extinction. Spontaneous recovery could underlie instances of treatment relapse that threaten otherwise effective behavioral interventions for problem behavior. In two experiments, we arranged multiple schedules with pigeons and a human child to assess the effects of different training reinforcer rates on spontaneous recovery. In both experiments, responding was both more resistant to extinction and more likely to relapse following training with greater reinforcement rates upon returning to extinction after time off from extinction testing. A quantitative model based on behavioral momentum theory accounted well for the data, which suggests reexposure to the extinction context following time off during extinction resulted in (1) the failure of extinction learning to generalize, and (2) greater generalization of original learning during training. The present model attempts to quantify theories attributing spontaneous recovery to changes in temporal context.     

Associative learning versus fear habituation as predictors of long-term extinction retention

Violation of unconditioned stimulus (US) expectancy during extinction training may enhance associative learning and result in improved long-term extinction retention compared to within-session habituation. This experiment examines variation in US expectancy (i.e., expectancy violation) as a predictor of long-term extinction retention. It also examines within-session habituation of fear-potentiated startle (electromyography, EMG) and fear of conditioned stimuli (CS) throughout extinction training as predictors of extinction retention. Participants (n?=?63) underwent fear conditioning, extinction and retention and provided continuous ratings of US expectancy and EMG, as well as CS fear ratings before and after each phase. Variation in US expectancy throughout extinction and habituation of EMG and fear was entered into a regression as predictors of retention and reinstatement of levels of expectancy and fear. Greater variation in US expectancy throughout extinction training was significantly predictive of enhanced extinction performance measured at retention test, although not after reinstatement test. Slope of EMG and CS fear during extinction did not predict retention of extinction. Within-session habituation of EMG and self-reported fear is not sufficient for long-term retention of extinction learning, and models emphasizing expectation violation may result in enhanced outcomes.     

Side effects of extinction: prevalence of bursting and aggression during the treatment of self-injurious behavior

Findings from basic and applied research suggest that treatment with operant extinction may produce adverse side effects; two of these commonly noted are an increase in the frequency of the target response (extinction burst) and an increase in aggression (extinction-induced aggression). Although extinction is often used to treat problem behavior in clinical settings, few applied studies have examined the prevalence of these side effects or their possible attenuation with other operant procedures. An analysis of 41 data sets for individuals who received treatment for self-injurious behavior indicated that extinction bursts or increases in aggression occurred in nearly one half of the cases. The prevalence of bursting and aggression was substantially lower when extinction was implemented as part of a treatment package rather than as the sole intervention.     

The effects of antecedent interventions and extinction on toddlers' compliance during transitions

We compared the effects of two antecedent strategies commonly used in early childhood settings to increase compliance during activity transitions: a warning condition, in which children were informed of the transition 2 min before it began, and a condition in which children were allowed access to a toy during the transition. Both antecedent interventions were ineffective when implemented alone; however, when these strategies were combined with extinction, improvements in compliance were observed for all children.     

Key pecking during extinction after intermittent or continuous reinforcement as a function of the number of reinforcers delivered during training.

Key pecking by 7 pigeons was established and maintained on a multiple variable-ratio variable-ratio (VR) schedule of food presentation. The schedule in one of the components was then changed to fixed-ratio (FR) 1 for a predetermined number of reinforcers. Both components were then changed to extinction (i.e., multiple extinction, extinction). This sequence was repeated a different number of times for each pigeon to determine the relation between the number of reinforcers delivered during each component of the multiple VR FR 1 schedule and the number of responses during extinction. For most pigeons, there were fewer responses during extinction in the presence of a stimulus recently correlated with FR 1, regardless of the number of reinforcers received. The ratio of the total responses in extinction in the former VR component to the total responses in the former FR 1 component increased as the number of reinforcers delivered during each component of the multiple schedule increased. Within-subject replications of the partial-reinforcement extinction effect generally occurred, and there were no overall reductions in the number of responses in extinction with repeated exposures to extinction.     

Integrating basic and applied research and the utility of Lattal and Perone's Handbook of research methods in human operant behavior

Lattal and Perone's Handbook of methods used in human operant research on behavioral processes will be a valuable resource for researchers who want to bridge laboratory developments with applied study. As a supplemental resource, investigators are also encouraged to examine the series of papers in the Journal of Applied Behavior Analysis that discuss basic research and its potential for application. Increased knowledge of behavioral processes in laboratory research could lead to innovative solutions to practical problems addressed by applied behavior analysts in the home, classroom, clinic, and community.     

The role of adventitious reinforcement during differential reinforcement of other behavior: A systematic replication

Differential reinforcement of other behavior (DRO) is commonly used to decrease problem behavior by presenting reinforcers contingent upon the absence of a target response. Although it is well demonstrated that DROs decrease response rates, the processes producing these decreases are not well understood. The present study systematically replicated previous research assessing whether adventitious reinforcement of alternative behavior contributes to the effectiveness of DRO. We presented university students with two options on a computer and reinforced target responding on a variable-ratio schedule. Next, we compared decreases in target-response rates and any increases in alternative responding during DRO schedules versus yoked variable-time schedules or extinction probes. DRO schedules resulted in the lowest target-response rate and highest alternative-response rate. These findings generally provide some support for the adventitious reinforcement of “other” behavior.     

Examining extinction bursts in the treatment of pediatric food refusal

Escape extinction has been shown to be highly effective in the treatment of food refusal; however, unpleasant side effects such as extinction bursts may accompany extinction procedures. Bursting has been reported to occur in 24% to 39% of all cases for which extinction was used as a component during treatment of problem behavior. Although commonly used in treatments, the occurrence of extinction bursts in the treatment of pediatric food refusal has not been studied. This study measured the frequency of bursting in 10 children for whom escape extinction was used to treat food refusal. Results showed that extinction bursts were observed in 30% of the children included in the study, although they were relatively brief and resolved quickly. Considerations for using escape extinction in interventions will be discussed.