Applied behavior analysis: New directions from the laboratory

Applied behavior analysis began when laboratory based principles were extended to humans inorder to change socially significant behavior. Recent laboratory findings may have applied relevance; however, the majority of basic researchers have not clearly communicated the practical implications of their work. The present paper samples some of the new findings and attempts to demonstrate their applied importance. Schedule-induced behavior which occurs as a by-product of contingencies of reinforcement is discussed. Possible difficulties in treatment and management of induced behaviors are considered. Next, the correlation-based law of effect and the implications of relative reinforcement are explored in terms of applied examples. Relative rate of reinforcement is then extended to the literature dealing with concurrent operants. Concurrent operant models may describe human behavior of applied importance, and several techniques for modification of problem behavior are suggested. As a final concern, the paper discusses several new paradigms. While the practical importance of these models is not clear at the moment, it may be that new practical advantages will soon arise. Thus, it is argued that basic research continues to be of theoretical and practical importance to applied behavior analysis.     

Forgetting the lessons of history

While a great deal of behavior analytic research has focussed on studying current contingencies, the amount of work done in the area of conditioning history is spotty, at best. Weiner (1964, 1969) conducted history research with human subjects, but little has followed in either the human or the nonhuman literature. Some direction can also be found in the literature studying the effects of conditioning on drug effects (e.g., Barrett, 1977; Urbain, Poling, Millam, & Thompson, 1978). However, "behavioral history" or "conditioning history" has not been a fully-developed area within behavior analysis. It is suggested that empirical work on history effects might have implications for (a) better understanding human-nonhuman behavioral differences and similarities, (b) clinical applications, especially where clients are resistant to behavioral change, and (c) theoretical assumptions in behavior analysis in relation to both basic and applied concerns.     

TOKEN REINFORCEMENT: A REVIEW AND ANALYSIS

Token reinforcement procedures and concepts are reviewed and discussed in relation to general principles of behavior. The paper is divided into four main parts. Part I reviews and discusses previous research on token systems in relation to common behavioral functions—reinforcement, temporal organization, antecedent stimulus functions, and aversive control—emphasizing both the continuities with other contingencies and the distinctive features of token systems. Part II describes the role of token procedures in the symmetrical law of effect, the view that reinforcers (gains) and punishers (losses) can be measured in conceptually analogous terms. Part III considers the utility of token reinforcement procedures in cross‐species analysis of behavior more generally, showing how token procedures can be used to bridge the methodological gulf separating research with humans from that with other animals. Part IV discusses the relevance of token systems to the field of behavioral economics. Token systems have the potential to significantly advance research and theory in behavioral economics, permitting both a more refined analysis of the costs and benefits underlying standard economic models, and a common currency more akin to human monetary systems. Some implications for applied research and for broader theoretical integration across disciplines will also be considered.     

Violations of transitivity: Implications for a theory of contextual choice

Violations of strong stochastic transitivity in concurrent-chains choice were first reported by Navarick and Fantino. In a series of articles, Navarick and Fantino concluded that neither a unidimensional model capable of predicting exact choice probabilities nor a fixed-variable equivalence rule was possible for the concurrent-chains procedure. I show that when choice is modeled contextually (i.e., when preference for a schedule is affected by factors other than the schedule itself, e.g., aspects of the alternative schedule), a unidimensional, exact-choice probability model is possible that both predicts the intransitivities reported by Navarick and Fantino and provides a fixed-variable equivalence rule for the concurrent-chains procedure. The contextual model is an extension of the generalized matching law and violates a key assumption underlying traditional choice models—simple scalability—because of (a) schedule interdependence and (b) bias from procedural contingencies. Therefore, strong stochastic transitivity cannot be expected to hold. Contextual scalability is analyzed to reveal a hierarchy of context effects in choice. Navarick and Fantino's intransitivities can be satisfactorily explained by bias. If attribute sensitivity is context dependent, however, and if there are similarity structures among choice alternatives, the contextual model is shown to be able to predict violations of ordinal preference. Therefore, it may be possible to formulate a deterministic, general psychophysical model of choice as a behavioral alternative to probabilistic, multidimensional choice theories.     

Basic research needed for stimulating the development of behavioral technologies

The costs of disconnection between the basic and applied sectors of behavior analysis are reviewed, and some solutions to these problems are proposed. Central to these solutions are collaborations between basic and applied behavioral scientists in programmatic research that addresses the behavioral basis and solution of human behavior problems. This kind of collaboration parallels the deliberate interactions between basic and applied researchers that have proven to be so profitable in other scientific fields, such as medicine. Basic research questions of particular relevance to the development of behavioral technologies are posed in the following areas: response allocation, resistance to change, countercontrol, formation and differentiation/discrimination of stimulus and response classes, analysis of low-rate behavior, and rule-governed behavior. Three interrelated strategies to build connections between the basic and applied analysis of behavior are identified: (a) the development of nonhuman animal models of human behavior problems using operations that parallel plausible human circumstances, (b) replication of the modeled relations with human subjects in the operant laboratory, and (c) tests of the generality of the model with actual human problems in natural settings.     

What happened to analysis in applied behavior analysis?

This paper addresses the current help-oriented focus of researchers in applied behavior analysis. Evidence from a recent volume of JABA suggests that analytic behavior is at low levels in applied analysis while cure-help behavior is at high strength. This low proportion of scientific behavior is apparantly related to cure-help contingencies set by institutions and agencies of help and the editorial policies of JABA itself. These contingencies have favored the flight to real people and a concern with client gains, evaluation and outcome strategies rather than the analysis of contingencies of reinforcement controlling human behavior. In this regard, the paper documents the current separation of applied behavior analysis from the experimental analysis of behavior. There is limited use of basic principles in applied analysis today and almost no reference to the current research in the experimental analysis of behavior involving concurrent operants and adjunctive behavior. This divorce of applied behavior research and the experimental analysis of behavior will mitigate against progress toward a powerful technology of behavior. In order to encourage a return to analysis in applied research, there is a need to consider the objectives of applied behavior analysis. The original purpose of behavioral technology is examined and a re-definition of the concept of "social importance" is presented which can direct applied researchers toward an analytic focus. At the same time a change in the publication policies of applied journals such as JABA toward analytic research and the design of new educational contingencies for students will insure the survival of analysis in applied behavior analysis.     

Searching for the variables that control human rule‐governed “insensitivity”

Verbal rules or instructions often exert obvious and meaningful control over human behavior. Sometimes instructions benefit the individual by enabling faster acquisition of a skill or by obviating an aversive consequence. However, research has also suggested a clear disadvantage: “insensitivity” to changing underlying contingencies. The two experiments described here investigated the variables that control initial rule‐following behavior and rule‐following insensitivity. When the initial rule was inaccurate, behavior was consistent with the rule for approximately half of participants and all participants' behavior was mostly insensitive to changing contingencies. When the initial rule was accurate, behavior of all participants was consistent with it and behavior for nearly all participants was insensitive to changes in underlying contingencies. These findings have implications for how best to establish and maintain rule‐following behavior in applied settings when deviant behavior would be more reinforcing to the individual.     

Matching theory in natural human environments

Matching theory is a mathematical account of behavior, many aspects of which have been confirmed in laboratory experiments with nonhuman and human subjects. The theory asserts that behavior is distributed across concurrently available response alternatives in the same proportion that reinforcement is distributed across those alternatives. The theory also asserts that behavior on a single response alternative is a function not only of reinforcement contingent on that behavior, but also of reinforcement contingent on other behaviors and of reinforcement delivered independently of behavior. These assertions constitute important advances in our understanding of the effects of reinforcement on behavior. Evidence from the applied literature suggests that matching theory holds not only in laboratory environments, but also in natural human environments. In addition, the theory has important therapeutic implications. For example, it suggests four new intervention strategies, and it can be used to improve treatment planning and management. Research on matching theory illustrates the progression from laboratory experimentation with nonhuman subjects to therapeutic applications in natural human environments.     

Effects of methylphenidate on sensitivity to reinforcement in children diagnosed with attention deficit hyperactivity disorder: an application of the matching law

The behavior of children diagnosed with attention deficit hyperactivity disorder (ADHD) has been hypothesized to be the result of decreased sensitivity to consequences compared to typical children. The present study examined sensitivity to reinforcement in 2 boys diagnosed with ADHD using the matching law to provide more precise and quantitative measurement of this construct. This experiment also evaluated the effects of methylphenidate (MPH) on sensitivity to reinforcement of children with ADHD. Subjects completed math problems to earn tokens under four different variable-interval (VI) schedules of reinforcement presented in random order under both medicated and nonmedicated conditions. Results showed that, in the medicated condition, the matching functions for both subjects resulted in higher asymptotic values, indicating an overall elevation of behavior rate under these conditions. The variance accounted for by the matching law was also higher under the medicated conditions, suggesting that their behavior more closely tracked the changing rates of reinforcement while taking MPH compared to placebo. Under medicated conditions, the reinforcing efficacy of response-contingent tokens decreased. Results are discussed with respect to quantifying behavioral changes and the extent to which the drug interacts with prevailing contingencies (i.e., schedule values) to influence behavioral variability.     

Dynamic response-by-response models of matching behavior in rhesus monkeys

We studied the choice behavior of 2 monkeys in a discrete-trial task with reinforcement contingencies similar to those Herrnstein (1961) used when he described the matching law. In each session, the monkeys experienced blocks of discrete trials at different relative-reinforcer frequencies or magnitudes with unsignalled transitions between the blocks. Steady-state data following adjustment to each transition were well characterized by the generalized matching law; response ratios undermatched reinforcer frequency ratios but matched reinforcer magnitude ratios. We modelled response-by-response behavior with linear models that used past reinforcers as well as past choices to predict the monkeys' choices on each trial. We found that more recently obtained reinforcers more strongly influenced choice behavior. Perhaps surprisingly, we also found that the monkeys' actions were influenced by the pattern of their own past choices. It was necessary to incorporate both past reinforcers and past choices in order to accurately capture steady-state behavior as well as the fluctuations during block transitions and the response-by-response patterns of behavior. Our results suggest that simple reinforcement learning models must account for the effects of past choices to accurately characterize behavior in this task, and that models with these properties provide a conceptual tool for studying how both past reinforcers and past choices are integrated by the neural systems that generate behavior.     

Choice, matching, and human behavior: A review of the literature

This review concerns human performance on concurrent schedules of reinforcement. Studies indicate that humans match relative behavior to relative rate of reinforcement. Herrnstein's proportional matching equation describes human performance but most studies do not evaluate the equation at the individual level. Baum's generalized matching equation has received strong support with humans as subjects. This equation permits the investigation of sources of deviation from ideal matching and a few studies have suggested variables which control such deviations in humans. While problems with instructional control are raised, the overall findings support the matching law as a principle of human choice.     

Resurgence as Choice: Implications for promoting durable behavior change

Resurgence is an increase in a previously suppressed behavior resulting from a worsening in reinforcement conditions for current behavior. Resurgence is often observed following successful treatment of problem behavior with differential reinforcement when reinforcement for an alternative behavior is subsequently omitted or reduced. The efficacy of differential reinforcement has long been conceptualized in terms of quantitative models of choice between concurrent operants (i.e., the matching law). Here, we provide an overview of a novel quantitative model of resurgence called Resurgence as Choice (RaC), which suggests that resurgence results from these same basic choice processes. We review the failures of the only other quantitative model of resurgence (i.e., Behavioral Momentum Theory) and discuss its shortcomings with respect to the limited range of circumstances about which it makes predictions in applied settings. Finally, we describe how RaC overcomes these shortcomings and discuss implications of the model for promoting durable behavior change.     

Affirming Control by Multiple Reinforcers via Progressive Treatment Analysis

It is common to isolate reinforcement contingencies across several test conditions in functional analyses of problem behavior; however, synthesizing all reinforcement contingencies in a single test condition may also have merit and even be necessary in some cases. Following a differentiated functional analysis, which relied on an interview‐informed synthesized test condition, functional communication training (FCT) was applied across the three suspected contingencies of reinforcement, partly in an attempt to understand the relevance of each. Communication responses were acquired for all three reinforcers, and problem behavior ceased only when all contingencies were addressed via FCT, suggesting that problem behavior was controlled by multiple contingencies of reinforcement. These analyses suggest that control by multiple contingencies of reinforcement can be understood during the treatment development process following a highly efficient functional analysis. Copyright © 2015 John Wiley & Sons, Ltd.     

Self-punitive behavior in humans: Effects of a self-fulfilling prophecy

Human subjects were exposed to contingencies which programmed aversive tones (100 db). Two types of contingencies were employed: self-confirming (i.e., self-fulfilling prophecies), in which the aversive tone was occasioned by the prediction it was about to occur; and self-disconfirming, in which the tone was probable when subjects predicted it would not occur. Experiments 1 and 2 used a modified classical conditioning paradigm, and demonstrated that a self-confirming contingency maintained reliable self-punitive responding, i.e., subjects consistently predicted and therefore obtained tones on every trial. Subjects in Experiment 3 were instructed to express predictions continuously throughout four sessions to ensure adequate sampling of the various predictions. Subjects exposed to a self-disconfirming contnngency reliably evidenced awareness of the contingency in effect (judged by answers on a postexperimental questionnaire), whereas subjects exposed to a self-confirming contingency failed to show effective avoidance behavior or contingency awareness. Experiment 4 investigated free-operant self-punitive behavior, utilizing a single prediction response button, which subjects depressed repeatedly. Subjects were exposed to either periodic or aperiodic punishment schedules over as many as four sessions. In general, more persistent self-punitive responding was found in the groups receiving periodic punishment. The results from the four experiments show that self-confirming contingencies can effectively prolong self-punitive responding in human subjects. The findings are consistent with a blocking interpretation of self-punitive behavior, which asserts that when an aversive event is already predicted by stimuli in the situation (including temporal cues), the association between a response and punishment is impaired, and self-punitive responding is likely to be maintained. An integration of human and animal self-punitive research is proposed.     

Reinforcement contingencies and social reinforcement: some reciprocal relations between basic and applied research.

Reinforcement contingencies and social reinforcement are ubiquitous phenomena in applied behavior analysis. This discussion paper is divided into two sections. In the first section, reinforcement contingencies are discussed in terms of the necessary and sufficient conditions for reinforcement effects. Response‐stimulus dependencies, conditional probabilities, and contiguity are discussed as possible mechanisms of, and arrangements for, reinforcement effects. In the second section, social reinforcement is discussed in terms of its functional subtypes and reinforcement context effects. Two underlying themes run throughout the discussion: (a) Applied research would benefit from a greater understanding of existing basic research, and (b) basic research could be designed to specifically address some of the issues about reinforcement that are central to effective application.     

Contingency and choice: The implications of matching theory for classroom instruction

This paper describes a mathematical account of behavior known as matching theory. Matching theory evolved out of basic operant research and assumes that individuals can engage in a variety of behaviors at any moment, but they choose one to the exclusion of others. According to the matching equation, choices in behavior match the relative amount of reinforcement provided for each alternative. Although the principles of matching theory have proven useful in developing novel treatment strategies, few data exist validating the matching equation in natural human environments. Recent applications of matching theory to children's classroom behavior are described, and the implications of matching theory for classroom management and effective teaching are discussed.     

Choice as a function of local versus molar reinforcement contingencies.

Rats were trained on a discrete-trial probability learning task. In Experiment 1, the molar reinforcement probabilities for the two response alternatives were equal, and the local contingencies of reinforcement differentially reinforced a win-stay, lose-shift response pattern. The win-stay portion was learned substantially more easily and appeared from the outset of training, suggesting that its occurrence did not depend upon discrimination of the local contingencies but rather only upon simple strengthening effects of individual reinforcements. Control by both types of local contingencies decreased with increases in the intertrial interval, although some control remained with intertrial intervals as long as 30 s. In Experiment 2, the local contingencies always favored win-shift and lose-shift response patterns but were asymmetrical for the two responses, causing the molar reinforcement rates for the two responses to differ. Some learning of the alternation pattern occurred with short intertrial intervals, although win-stay behavior occurred for some subjects. The local reinforcement contingencies were discriminated poorly with longer intertrial intervals. In the absence of control by the local contingencies, choice proportion was determined by the molar contingencies, as indicated by high exponent values for the generalized matching law with long intertrial intervals, and lower values with short intertrial intervals. The results show that when molar contingencies of reinforcement and local contingencies are in opposition, both may have independent roles. Control by molar contingencies cannot generally be explained by local contingencies.     

Molar functional relations and clinical behavior analysis: implications for assessment and treatment

The experimental analysis of behavior has identified several molar functional relations that are highly relevant to clinical behavior analysis. These include matching, discounting, momentum, and variability. Matching provides a broader analysis of how multiple sources of reinforcement influence how individuals choose to allocate their time and offers an empirical rationale for reducing problem behavior by increasing adaptive behavior. Discounting highlights the functional relations that affect self-control. Momentum specifies the variables responsible for persistence in challenging situations. Variability characterizes a functional dimension of behavior that is essential for learning and problem solving. These concepts have important implications for clinical practice and research. A selective review of these concepts is presented, and their implications for assessment and treatment are discussed with two goals: to inform basic scientists about the relevance of their work and to invite clinical behavior analysts to broaden the conceptual basis for their work.     

IN PURSUIT OF GENERAL BEHAVIORAL RELATIONS

Efforts to develop behavioral technologies from advances in basic research assume that results from studies with nonhuman subjects can, in some instances, be applied to human behavior. The behavioral principles likely to be most useful for application are those that represent robust general behavioral relations. Basic and applied research on behavioral momentum suggests that there is a general behavioral relation between the persistence of behavior and the rate of reinforcement obtained in a given situation. Understanding the factors that affect behavioral persistence may have important implications for applied behavior analysts that justify studies aimed at establishing the generality and limits of the functional relation between reinforcement rate and behavioral persistence. Strategies for establishing the generality of behavioral relations are reviewed, followed by a brief summary of the evidence for the generality of behavioral momentum.