Multiple schedules of conjugate reinforcement and extinction: A translational model for assessing automatically reinforced behavior

This study evaluated the extent to which a conjugate reinforcement schedule (CONJ) involving a contingency between pedaling a stationary bike and viewing a preferred movie could serve as a translational preparation for the analysis of automatically reinforced behavior. In part, researchers examined whether providing participants with either an accurate or an inaccurate rule about the extinction (EXT) component of a multiple schedule (MULT) contributed to the development of control by the MULT (CONJ EXT) schedule. Results show schedule control emerged for four of five participants who received the accurate rule and none of the five participants who received the inaccurate rule. In addition, participants who received accurate rules typically increased pedaling during CONJ components that followed two consecutive EXT components, suggesting that they experienced deprivation for audio and visual stimulation generated by pedaling. These preliminary findings suggest that researchers could use this translational preparation to identify matched interventions for some automatically reinforced behavior.     

Individual and combined effects of noncontingent reinforcement and response blocking on automatically reinforced problem behavior

Noncontingent reinforcement (NCR) and response blocking are 2 common interventions for problem behavior maintained by automatic reinforcement. We implemented NCR and blocking with 1 boy and found this combined intervention to be effective at decreasing high rates of automatically reinforced pica. With another child, we compared the effects of blocking alone to the combined intervention. With the third child, we compared NCR alone and blocking alone to the combined intervention. Results showed that the combined intervention was effective at reducing automatically reinforced problem behavior while moderate to high levels of item engagement maintained. When evaluated individually, neither NCR nor blocking was sufficient to reduce problem behavior to clinically significant levels.     

Persistence of stereotypic behavior: examining the effects of external reinforcers

Basic research has shown that behavioral persistence is often positively related to rate of reinforcement. This relation, expressed in the metaphor of behavioral momentum, has potentially important implications for clinical application. The current study examined one prediction of the momentum metaphor for automatically reinforced behavior. Participants were 3 children who had been diagnosed with an autism spectrum disorder and who engaged in stereotypic behavior maintained by automatic reinforcement. Results suggested that stereotypic behavior was more resistant to disruption following periods of access to preferred stimuli delivered on a variable-time schedule than following periods without access to preferred stimuli. The implications of these findings for the treatment of automatically reinforced behavior are discussed.     

Further analysis of subtypes of automatically reinforced SIB: A replication and quantitative analysis of published datasets

Hagopian, Rooker, and Zarcone (2015) evaluated a model for subtyping automatically reinforced self‐injurious behavior (SIB) based on its sensitivity to changes in functional analysis conditions and the presence of self‐restraint. The current study tested the generality of the model by applying it to all datasets of automatically reinforced SIB published from 1982 to 2015. We identified 49 datasets that included sufficient data to permit subtyping. Similar to the original study, Subtype‐1 SIB was generally amenable to treatment using reinforcement alone, whereas Subtype‐2 SIB was not. Conclusions could not be drawn about Subtype‐3 SIB due to the small number of datasets. Nevertheless, the findings support the generality of the model and suggest that sensitivity of SIB to disruption by alternative reinforcement is an important dimension of automatically reinforced SIB. Findings also suggest that automatically reinforced SIB should no longer be considered a single category and that additional research is needed to better understand and treat Subtype‐2 SIB.     

EFFECTS AND SIDE EFFECTS OF DRO AS TREATMENT FOR SELF-INJURIOUS BEHAVIOR

A three-part controlled case study is presented in which severe and longstanding self-injurious behavior exhibited by a 9-year-old-boy was treated successfully with differential reinforcement of other behavior. In Phase 1, an experimental analysis demonstrated that the boy's scratching was not maintained by environmental contingencies; instead, it appeared that the self-injurious behavior was a stereotypic (automatically reinforced) response. In Phase 2, the effects of an escalating differential-reinforcement-of-other-behavior schedule mediated through token reinforcement (pennies) were evaluated in a reversal design. Results showed that differential-reinforcement-of-other-behavior eliminated self-injurious behavior very quickly and for periods of time as long as 30 min. A noteworthy side effect observed during Phase 2 was the occurrence of crying behavior following the nondelivery of reinforcement. In Phase 3, the token program was gradually extended in 30-min increments throughout the day. Additionally, results of a brief multielement manipulation showed that the effects of token reinforcement were superior to those of a more easily administered differential reinforcement of other behavior based on social reinforcement, which differed little from baseline.     

WHAT MAKES EXTINCTION WORK: AN ANALYSIS OF PROCEDURAL FORM AND FUNCTION

We examined methods for determining how extinction should be applied to different functions of self-injurious behavior (SIB). Assessment data indicated that the head banging of 3 children with developmental disabilities was maintained by different reinforcement contingencies: One subject's SIB was positively reinforced by attention from adults, the 2nd subject's SIB was negatively reinforced by escape from educational tasks, and the 3rd subject's SIB appeared to be automatically reinforced or “self-stimulatory” in nature. Three functional variations of extinction—EXT (attention), EXT (escape), and EXT (sensory)—were evaluated, and each subject was exposed to at least two of these variations in reversal or multiple baseline designs. Reductions in SIB were observed only when implementation of “extinction” involved the discontinuation of reinforcement previously shown to be responsible for maintaining the behavior. These results highlight important differences among treatment techniques based on the same behavioral principle (extinction) when applied to topographically similar but functionally dissimilar responses, and further illustrate the practical implications of a functional analysis of behavior disorders for designing, selecting, and classifying therapeutic interventions.     

TREATMENT OF PICA THROUGH MULTIPLE ANALYSES OF ITS REINFORCING FUNCTIONS

We conducted functional analyses of the pica of 3 participants. The pica of 1 participant appeared to be maintained by automatic reinforcement; that of the other 2 participants appeared to be multiply controlled by social and automatic reinforcement. Subsequent preference and treatment analyses were used to identify stimuli that would compete with the automatic function of pica for the 3 participants. These analyses also identified the specific aspect of oral stimulation that served as automatic reinforcement for 2 of the participants. In addition, functional analysis-based treatments were used to address the socially motivated components of 2 of the participants' pica. Results are discussed in terms of (a) the importance of using the results of functional analyses to develop treatments for pica and (b) the advantages of developing indirect analyses to identify specific sources of reinforcement for automatically reinforced behavior.     

Short-term memory in the pigeon: the previously reinforced response

Eighteen pigeons served in a discrete-trials short-term memory experiment in which the reinforcement probability for a peck on one of two keys depended on the response reinforced on the previous trial: either the probability of reinforcement on a trial was 0.8 for the same response reinforced on the previous trial and was 0.2 for the other response (Group A), or, it was 0 or 0.2 for the same response and 1.0 or 0.8 for the other response (Group B). A correction procedure ensured that over all trials reinforcement was distributed equally across the left and right keys. The optimal strategy was either a winstay, lose-shift strategy (Group A) or a win-shift, lose-stay strategy (Group B). The retention interval, that is the intertrial interval, was varied. The average probability of choosing the optimal alternative reinforced 80% of the time was 0.96, 0.84, and 0.74 after delays of 2.5, 4.0, and 6.0 sec, respectively for Group A, and was 0.87, 0.81, and 0.55 after delays of 2.5, 4.0, and 6.0 sec, respectively, for Group B. This outcome is consistent with the view that behavior approximated the optimal response strategy but only to an extent permitted by a subject's short-term memory for the cue correlated with reinforcement, that is, its own most-recently reinforced response. More generally, this result is consistent with “molecular” analyses of operant behavior, but is inconsistent with traditional “molar” analyses holding that fundamental controlling relations may be discovered by routinely averaging over different local reinforcement contingencies. In the present experiment, the molar results were byproducts of local reinforcement contingencies involving an organism's own recent behavior.     

Implementing a differential reinforcement of low rates schedule to alter vocal stereotypy and task engagement in two adolescents with autism spectrum disorder

Vocal stereotypy (VS) is often observed in individuals with autism spectrum disorder (ASD) which at high rates can interfere with socialization or functioning in structured settings. There are multiple effective interventions available; yet, many procedures target the complete omission of the behavior or are only assessed at short intervals, making it unclear how they will generalize in applied settings. One intervention yet to be assessed as an individual intervention for automatically reinforced VS is differential reinforcement of low rates of behavior (DRL). In the present study, a functional analysis determined that the VS of two female adolescents with ASD was maintained by automatic reinforcement. A DRL procedure was implemented which incorporated: (a) a specified interval for reinforcement; (b) the behavioral expectations; (c) the permissible instances of VS within the interval; (d) learner feedback; and (e) the reset/non-reset aspect of the schedule. As the targeted behavior decreased across sessions, the DRL interval was systematically increased in order to thin out the schedule of reinforcement. The intervention reduced VS and increased untargeted task engagement for both participants. Applied and theoretical implications of the study as well as social validity, limitations, and future research are discussed.     

Increasing item engagement and decreasing automatically reinforced problem behavior within a modified competing stimulus assessment

A competing stimulus assessment (CSA) is commonly used to identify leisure items for use in treatments designed to decrease automatically reinforced problem behavior. However, this type of assessment may not yield useful information if participants do not readily engage with leisure items. The purpose of this study was to evaluate a modified CSA that included additional treatment components (i.e., prompting, prompting plus differential reinforcement of alternative behavior). The modified CSA identified the treatment components and leisure items that were most effective for increasing leisure-item engagement and decreasing problem behavior for each participant. Modified CSA outcomes maintained during an extended treatment analysis in a natural setting and when intervention components were faded.     

A model of resurgence based on behavioral momentum theory

Resurgence is the reappearance of an extinguished behavior when an alternative behavior reinforced during extinction is subsequently placed on extinction. Resurgence is of particular interest because it may be a source of relapse to problem behavior following treatments involving alternative reinforcement. In this article we develop a quantitative model of resurgence based on the augmented model of extinction provided by behavioral momentum theory. The model suggests that alternative reinforcement during extinction of a target response acts as both an additional source of disruption during extinction and as a source of reinforcement in the context that increases the future strength of the target response. The model does a good job accounting for existing data in the resurgence literature and makes novel and testable predictions. Thus, the model appears to provide a framework for understanding resurgence and serves to integrate the phenomenon into the existing theoretical account of persistence provided by behavioral momentum theory. In addition, we discuss some potential implications of the model for further development of behavioral momentum theory.     

The efficacy of noncontingent reinforcement as treatment for automatically reinforced stereotypy

Noncontingent reinforcement (NCR), in the form of continuous access to preferred leisure items, has recently been reported as a successful treatment for automatically reinforced aberrant behavior. However, previous research has shown that the outcome of such procedures can be compromised under certain circumstances, such as when the response effort required to access leisure items is increased. The purpose of the current study was to assess the efficacy of two variations of NCR as treatment for automatically reinforced stereotypy. In the first phase of the study, functional analyses revealed that the stereotypy of three individuals with developmental disabilities was maintained independent of social consequences. A sensory class assessment was then conducted to identify the specific sensory products that appeared to maintain the behaviors. Finally, we evaluated the effects of NCR (using stimuli identified in the previous assessments) under two conditions. In the first condition, the leisure item was made freely available, by placing it on the table in front of the participant. In the other condition, an experimenter prompted the participant to interact with the leisure item at the beginning of the session. The results indicated that NCR successfully competed with stereotypy only when participants were prompted to interact with the leisure item. These findings are discussed in the context of developing NCR interventions for automatically reinforced aberrant behavior. Copyright © 2002 John Wiley & Sons, Ltd.     

Discrimination learning by macaca mulatta with option to switch between S+ and S−

Three rhesus monkeys were trained to press either of two response keys. A response on the reinforcement key during presentation of the reinforced stimulus produced a sucrose pellet followed by an intertrial interval, but during presentation of the unreinforced stimulus produced only the intertrial interval. A response on the switching key changed the discriminative stimulus from reinforced to unreinforced or from unreinforced to reinforced. The reinforced stimulus was presented automatically on half the trials, but could be produced only by a switching response on the other half. Switching tended to occur in three distinct stages during acquisition of discriminative behavior. The first stage was identified as "nondiscriminative switching"; the second as "nonswitching"; and the third as "discriminative switching".     

The analysis and treatment of vocal stereotypy in a child with autism

This study examined procedures for the assessment and treatment of automatically reinforced vocal stereotypy of a 6‐year‐old girl with autism. Stimulus assessments were conducted to identify toys that were correlated with higher rates of vocal stereotypy and toys that were not. A concurrent operants assessment identified preferred stimuli (toys that produced auditory stimulation), which were then used as reinforcers for the non‐occurrence of vocal stereotypy. A reversal design was used to compare the effects of a fixed time schedule of reinforcement (FT 1‐min) to differential reinforcement for the non‐occurrence of behavior (DRO) to reduce vocal stereotypy. Implementation of the FT schedule revealed no effect, whereas the DRO schedule led to a reduction in the target behavior during treatment sessions and across the school day. This study adds to the body of literature supporting the identification of matched stimuli to reduce non‐socially mediated problem behavior. Copyright © 2005 John Wiley & Sons, Ltd.     

A device for presenting attack opportunity as a reinforcer for operant behavior

A device is described which automatically measures barpresses reinforced by short opportunities to attack male mice. Data on barpress rates indicate rapid and reliable acquisition of preferences for reinforcer bars and rapid abolition of this preference when the reinforcement contingency is subsequently eliminated. The data are less reliable for reversal learning.     

The stability of function of automatically reinforced vocal stereotypy over time

Although prior research has suggested the function of socially reinforced problem behavior can change across time, the stability of the function of automatically reinforced behavior is largely unknown. Further, some authors have suggested automatically reinforced behavior is likely to enter into socially mediated contingencies. The present study compared 2 functional analyses conducted on the same target behavior at least 1 year apart. Participants were 6 individuals diagnosed with an intellectual or developmental disability displaying automatically reinforced vocal stereotypy. Results indicated the function of each participant's vocal stereotypy remained stable over time (i.e., no new functions were acquired); however, future research on functional stability for automatically reinforced behavior of other topographies is needed.     

Learning to vary and varying to learn

We compared two sources of behavior variability: decreased levels of reinforcement and reinforcement contingent on variability itself. In Experiment 1, four groups of rats were reinforced for different levels of response-sequence variability: one group was reinforced for low variability, two groups were reinforced for intermediate levels, and one group was reinforced for very high variability. All of the groups experienced three different reinforcement frequencies for meeting their respective variability contingencies. Results showed that reinforcement contingencies controlled response variability more than did reinforcement frequencies. Experiment 2 showed that only those animals concurrently reinforced for high variability acquired a difficult-to-learn sequence; animals reinforced for low variability learned little or not at all. Variability was therefore controlled mainly by reinforcement contingencies, and learning increased as a function of levels of baseline variability. Knowledge of these relationships may be helpful to those who attempt to condition operant responses.     

Immediate and subsequent effects of differential reinforcement of other behavior and noncontingent matched stimulation on stereotypy

A three‐component multiple‐schedule and brief reversals were used to examine the effects of differential reinforcement of other behavior (DRO) and noncontingent matched stimulation (NMS) on the automatically reinforced mouthing of a child with autism. Both DRO and NMS decreased immediate engagement in mouthing, but NMS produced larger reductions in the behavior. Furthermore, NMS produced subsequent effects (i.e., when the treatment was withdrawn) similar to those of prior access, whereas DRO marginally increased subsequent engagement in mouthing. The results suggest that NMS was a functionally matched intervention for mouthing. Implications for the assessment and treatment of stereotypy and applications for future research are discussed. Copyright © 2010 John Wiley & Sons, Ltd.     

Assessing the combined effects of resurgence and reinstatement in children diagnosed with autism spectrum disorder

Resurgence and reinstatement are laboratory models of relapse following treatments for problem behavior that arrange alternative sources of reinforcement, such as differential reinforcement of alternative behavior and noncontingent reinforcement. Resurgence models the elimination or reduction of reinforcers during treatment and reinstatement models the re‐presentation of reinforcers previously maintaining problem behavior. The present study examined individual and combined effects of resurgence and reinstatement in a translational model of treatment relapse with three children diagnosed with Autism Spectrum Disorder. We first reinforced and then extinguished an arbitrary response while providing access to a preferred toy to model a version of noncontingent reinforcement with extinction. In the following phases, we examined resurgence by removing the toy, reinstatement by presenting the training reinforcer response‐independently, and a combination of resurgence and reinstatement. Overall, relapse of target responding reliably exceeded functionally similar responses never reinforced in the experimental situation. Most importantly, relapse tended to be greater when combining resurgence and reinstatement than when assessing either alone. These findings support previous studies showing that combinations of operations can increase treatment relapse. This translational model arranging simulated problem behavior with arbitrary tasks provides a platform from which to thoroughly and systematically assess methods for understanding and improving behavioral treatments.