Using Percentile Schedules to Increase Academic Fluency

After a learner becomes accurate with a task, fluency must be shaped over time to reach the target goal. However, shaping criteria can be somewhat arbitrary; thus, an objective criteria has the potential to improve implementation consistency. One such method is through the use of percentile schedules. The purpose of the current study was to use a percentile schedule as a means of determining the reinforcement criterion to improve the fluency for three academic tasks. The participant was a 14‐year‐old boy diagnosed with developmental disabilities. The use of the percentile schedule based reinforcement criterion resulted in increased fluency with two of the three academic tasks. This study suggests that percentile schedules may provide an objective criterion for improving fluency. Copyright © 2016 John Wiley & Sons, Ltd.     

Using computers to teach behavior analysis

When it is impractical to provide behavior analysis students with extensive laboratory experience using real organisms, computers can provide effective demonstrations, simulations, and experiments. Furthermore, such computer programs can establish contingency-shaped behavior even in lecture classes, which usually are limited to establishing rule-governed behavior. We describe the development of computerized shaping simulations and the development of software that teaches students to discriminate among reinforcement schedules on the basis of cumulative records.     

Shaping academic task engagement with percentile schedules

The purpose of this study was to examine the use of percentile schedules as a method of quantifying the shaping procedure in an educational setting. We compared duration of task engagement during baseline measurements for 4 students to duration of task engagement during a percentile schedule. As a secondary purpose, we examined the influence on shaping of manipulations of the number of observations used to determine the criterion for reinforcement (the m parameter of the percentile formula). Results showed that the percentile formula was most effective when a relatively large m value (20 observations) was used.     

Effects of adjusting DRO schedules on the reduction of stereotypic vocalizations in children with autism

The reduction of stereotypic behavior is important for individuals with developmental disabilities because it may interfere with learning new skills. A common procedure used to reduce stereotypic behavior is differential reinforcement of other behavior (DRO). A DRO schedule is a procedure in which reinforcement is delivered given the absence of a target response for a period of time. Although DRO schedules have been shown to be effective in reducing a variety of stereotypic behavior, empirical studies have not yet determined the most effective way to thin the reinforcement schedule. The current study examined the extent to which the relationship between the inter‐response time (IRT) and the DRO requirement affects the reduction of stereotypic behavior. Results of the current study showed the DRO requirement that was set to the 25th percentile of the IRT distribution was more effective in reducing stereotypic behavior when compared with a DRO requirement set to the 95th percentile of the IRT distribution. Copyright © 2009 John Wiley & Sons, Ltd.     

Interaction of procedural factors in human performance on yoked schedules

The differential effects of reinforcement contingencies and contextual variables on human performance were investigated in two experiments. In Experiment 1, adult human subjects operated a joystick in a video game in which the destruction of targets was arranged according to a yoked variable-ratio variable-interval schedule of reinforcement. Three variables were examined across 12 conditions: verbal instructions, shaping, and the use of a consummatory response following reinforcement (i.e., depositing a coin into a bank). Behavior was most responsive to the reinforcement contingencies when the consummatory response was available, responding was established by shaping, and subjects received minimal verbal instructions about their task. The responsiveness of variable-interval subjects' behavior varied more than that of variable-ratio subjects when these contextual factors were altered. Experiment 2 examined resistance to instructional control under the same yoked-schedules design. Conditions varied in terms of the validity of instructions. Performance on variable-ratio schedules was more resistant to instructional control than that on variable-interval schedules.     

Bridging the gap between laboratory and applied research on response-independent schedules

In 1948, Skinner described the behavior of pigeons under response-independent schedules as “superstitious,” and proposed that the responses were reinforced by contiguous, adventitious food deliveries. Subsequently, response-independent schedules have been of interest to both basic and applied researchers, first to understand the mechanisms involved, and later, as “noncontingent reinforcement” (NCR) to reduce undesirable behavior. However, the potential superstitious effects produced by these schedules have been challenged, with some researchers arguing that antecedent variables play a significant role. This paper examines the evidence for adventitious reinforcement from both laboratory and applied research, the results of which suggest that antecedent, nonoperant functions may be important in fully understanding the effects of NCR. We propose an applied-basic research synthesis, in which attention to potential nonoperant functions could provide a more complete understanding of response-independent schedules. We conclude with a summary of the applied implications of the nonoperant functions of NCR schedules.     

An inverse relationship between baseline fixed-interval response rate and the effects of a tandem response requirement.

Previous experiments examining the effects of adding a tandem fixed-ratio response requirement on fixed-interval schedule performance have reported inconsistent results. One variable that may account for such inconsistencies is the baseline response rate in the fixed-interval condition. This possibility was investigated in the present study. Rats were given histories with either interresponse times greater than 11 s or fixed-ratio 40 schedules of reinforcement, which engendered either relatively low or high rates of responding, respectively, in the subsequent fixed-interval condition. A tandem ratio response requirement (fixed-ratio 9) was then introduced. The effects of adding this tandem response requirement were inversely related to the baseline fixed-interval response rates; low rates of responding in the fixed-interval condition were markedly increased, whereas high rates of responding were relatively unaffected. This inverse relationship appears to be similar to the rate-dependent relations observed in behavioral pharmacology. These results may provide an explanation for the inconsistent findings reported in previous studies on tandem fixed-interval fixed-ratio schedules and suggest that principles of behavioral pharmacology research may be applicable to the study of the effects of nonpharmacological variables on schedule-controlled behavior.     

Prevention of the development of problem behavior: A laboratory model

Few studies have isolated the preventive efficacy of common behavioral strategies like noncontingent reinforcement (NCR) and differential reinforcement of alternative behavior (DRA). The purpose of the current study was to develop and evaluate a laboratory model of these two problem behavior prevention strategies. Undergraduate students participated in a computer simulation, in which clicks to a designated area of the computer screen were analogous to the emergence of problem behavior. The responding of participants in a control group, who experienced a percentile schedule used to mimic the shaping of problem behavior, was compared to that of participants in two experimental groups, each with a history of either DRA or NCR. Between‐subjects group comparisons showed that both intervention strategies were equally effective in the prevention of our analog to problem behavior when compared to the control group. The strengths and limitations of a laboratory model for prevention are discussed in light of recent applied work in this area.     

Notes on fixed-ratio and fixed-interval escape responding in the pigeon

After learning to peck a key when each peck removed a slowly increasing series of electric shocks, pigeons were placed on fixed-ratio and fixed-interval escape schedules. The resulting behavior was comparable to that of other species on ratio and interval escape schedules. Thus, while the pigeon apparently requires special techniques for the initial shaping of a key-peck response with negative reinforcement, this response, once obtained, can be subjected to intermittent schedules of negative reinforcement with no great difficulty.     

Concurrent-chains schedules as a method to study choice between alcohol-associated conditioned reinforcers

An extensive body of research using concurrent-chains schedules of reinforcement has shown that choice for one of two differentially valued food-associated stimuli is dependent upon the overall temporal context in which those stimuli are embedded. The present experiments examined whether the concurrent chains procedure was useful for the study of behavior maintained by alcohol and alcohol-associated stimuli. In Experiment 1, rats responded on concurrent-chains schedules with equal variable-interval (VI) 10-s schedules in the initial links. Across conditions, fixed-interval schedules in the terminal links were varied to yield 1∶1, 9∶1, and 1∶9 ratios of alcohol delivery. Initial-link response rates reflected changes in terminal-link schedules, with greater relative responding in the rich terminal link. In Experiment 2, terminal-link schedules remained constant with a 9∶1 ratio of alcohol delivery rates while the length of two equal duration initial-link schedules was varied. Preference for the rich terminal link was less extreme when initial links were longer (i.e., the initial-link effect), as has been previously reported with food reinforcers. This result suggests that the conditioned reinforcing value of an alcohol-associated stimulus depends on the temporal context in which it is embedded. The concurrent-chains procedure and quantitative models of concurrent chains performance may provide a useful framework within which to study how contextual variables modulate preference for drug-associated conditioned reinforcers.     

Quantitative prediction and molar description of the environment

Molecular explanations of behavior, based on momentary events and variables that can be measured each time an event occurs, can be contrasted with molar explanations, based on aggregates of events and variables that can be measured only over substantial periods of time. Molecular analyses cannot suffice for quantitative accounts of behavior, because the historical variables that determine behavior are inevitably molar. When molecular explanations are attempted, they always depend on hypothetical constructs that stand as surrogates for molar environmental variables. These constructs allow no quantitative predictions when they are vague, and when they are made precise, they become superfluous, because they can be replaced with molar measures. In contrast to molecular accounts of phenomena like higher responding on ratio schedules than interval schedules and free-operant avoidance, molar accounts tend to be simple and straightforward. Molar theory incorporates the notion that behavior produces consequences that in turn affect the behavior, the notion that behavior and environment together constitute a feedback system. A feedback function specifies the dependence of consequences on behavior, thereby describing properties of the environment. Feedback functions can be derived for simple schedules, complex schedules, and natural resources. A complete theory of behavior requires describing the environment's feedback functions and the organism's functional relations. Molar thinking, both in the laboratory and in the field, can allow quantitative prediction, the mark of a mature science.     

An evaluation of delay to reinforcement and mand variability during functional communication training

Children with autism spectrum disorder and other developmental disabilities often exhibit invariant responding (i.e., restricted behavioral repertoires), deficits in communication, and challenging behavior. Approaches demonstrated in the basic and applied literature to increase response variability include extinction, lag schedules of reinforcement, and percentile schedules of reinforcement. Results of basic studies have also indicated that delays to reinforcement often produce increases in response variability. The purpose of the current study was to evaluate the effects of a delay to reinforcement on the variability of communication responses during functional communication training with individuals with developmental disabilities and histories of engaging in challenging behavior. Results indicated that delays to reinforcement increased mand variability with all four participants with variable effects on challenging behavior across participants.     

The role of adventitious reinforcement during differential reinforcement of other behavior: A systematic replication

Differential reinforcement of other behavior (DRO) is commonly used to decrease problem behavior by presenting reinforcers contingent upon the absence of a target response. Although it is well demonstrated that DROs decrease response rates, the processes producing these decreases are not well understood. The present study systematically replicated previous research assessing whether adventitious reinforcement of alternative behavior contributes to the effectiveness of DRO. We presented university students with two options on a computer and reinforced target responding on a variable-ratio schedule. Next, we compared decreases in target-response rates and any increases in alternative responding during DRO schedules versus yoked variable-time schedules or extinction probes. DRO schedules resulted in the lowest target-response rate and highest alternative-response rate. These findings generally provide some support for the adventitious reinforcement of “other” behavior.     

Response-independent Events In The Behavior Stream

The metaphor of the behavior stream provides a framework for studying the effects of response-independent food presentations intruded into an environment in which operant responding of pigeons was maintained by variable-interval schedules. In the first two experiments, response rates were reduced when response-independent food was intruded during the variable-interval schedule according to a concomitantly present fixed-time schedule. These reductions were not always an orderly function of the percentage of response-dependent food. Negatively accelerated patterns of key pecking across the fixed-time period occurred in Experiment 1 under the concomitant fixed-time variable-interval schedules. In Experiment 2, positively and negatively accelerated and linear response patterns occurred even though the schedules were similar to those used in Experiment 1. The variable findings in the first two experiments led to three subsequent experiments that were designed to further illuminate the controlling variables of the effects of intruded response-independent events. When the fixed and variable schedules were correlated with distinct operanda by employing a concurrent fixed-interval variable-interval schedule (Experiment 3) or with distinct discriminative stimuli (Experiments 4 and 5), negatively accelerated response patterns were obtained. Even in these latter cases, however, the response patterns were a joint function of the physical separation of the two schedules and the ratio of fixed-time or fixed-interval to variable-interval schedule food presentations. The results of the five experiments are discussed in terms of the contributions of both reinforcement variables and discriminative stimuli in determining the effects of intruding response-independent food into a stream of operant behavior.     

Response deprivation and reinforcement in applied settings: A preliminary analysis

First-grade children engaged in seatwork behaviors under reinforcement schedules established according to the Premack Principle and the Response Deprivation Hypothesis. Across two experiments, schedules were presented to the children in a counter-balanced fashion which fulfilled the conditions of one, both, or neither of the hypotheses. Duration of on-task math and coloring in Experiment 1 and on-task math and reading in Experiment 2 were the dependent variables. A modified ABA-type withdrawal design, including a condition to control for the noncontingent effects of a schedule, indicated an increase of on-task instrumental responding only in those schedules where the condition of response deprivation was present but not where it was absent, regardless of the probability differential between the instrumental and contingent responses. These results were consistent with laboratory findings supporting the necessity of response deprivation for producing the reinforcement effect in single response, instrumental schedules. However, the results of the control procedure were equivocal so the contribution of the contingent relationship between the responses to the increases in instrumental behavior could not be determined. Nevertheless, these results provided tentative support for the Response Deprivation Hypothesis as a new approach to establishing reinforcement schedules while indicating the need for further research in this area. The possible advantages of this technique for applied use were identified and discussed.     

The linear system theory's account of behavior maintained by variable-ratio schedules.

The mathematical theory of linear systems, which has been used successfully to describe behavior maintained by variable-interval schedules, is extended to describe behavior maintained by variable-ratio schedules. The result of the analysis is a pair of equations, one of which expresses response rate on a variable-ratio schedule as a function of the mean ratio requirement (n) that the schedule arranges. The other equation expresses response rate on a variable-ratio schedule as a function of reinforcement rate. Both equations accurately describe existing data from variable-ratio schedules. The theory accounts for two additional characteristics of behavior maintained by variable-ratio schedules; namely, the appearance of strained, two-valued (i.e., zero or very rapid) responding at large ns, and the abrupt cessation of responding at a boundary n. The theory also accounts for differences between behavior on variable-interval and variable-ratio schedules, including (a) the occurrence of strained responding on variable-ratio but not on variable-interval schedules, (b) the abrupt cessation of responding on occurrence of higher response rates on variable-ratio than on variable-interval schedules. Furthermore, given data from a series of variable-interval schedules and from a series of concurrent variable-ratio variable-interval schedules, the theory permits quantitative prediction of many properties of behavior on single-alternative variable-ratio schedules. The linear system theory's combined account of behavior on variable-interval and variable-ratio schedules is superior to existing versions of six other mathematical theories of variable-interval and variable-ratio responding.     

Handwriting as an operant

An apparatus was designed to monitor handwriting behavior. Two subjects were studied under various schedules of monetary reinforcement for handwriting. The different schedules engendered and maintained distinctive response patterns but the rates of sustained responding did not vary across schedules. The development of fixed-interval performance following continuous reinforcement resembled the same transition in lower animals. In one subject, availability of reading material interacted with the schedule to determine response pattern. It was suggested that handwriting may be a more appropriate response for the experimental analysis of human behavior than the more frequently used button-pushing or lever-pulling responses.     

FIXED-TIME SCHEDULES ATTENUATE EXTINCTION-INDUCED PHENOMENA IN THE TREATMENT OF SEVERE ABERRANT BEHAVIOR

We compared the effects of extinction (EXT) and fixed-time (FT) schedules as treatment for severe problem behavior displayed by 3 individuals with developmental disabilities. First, functional analyses identified the reinforcers maintaining aberrant behavior for all 3 individuals. Next, EXT and FT schedules were compared using a multielement design. During EXT, the reinforcer maintaining problem behavior was withheld. During FT, the reinforcers were presented response independently at preset intervals. Results showed that FT schedules were generally more effective than EXT schedules in reducing aberrant behavior. FT schedules may be used in situations when extinction-induced phenomena are problematic.     

Contiguity and contingency in the acquisition and maintenance of an operant

Three experiments compared the effects of nondifferential and differential reinforcement of response location on a circular dimension. Rats were required to operate a vertical joystick to produce food. When food was delivered immediately after responses, but independent of response location, the spatial concentration of responding was low and no progressive changes were observed. Traditional and percentile schedules of differential reinforcement for response location produced highly reliable acquisition of spatially concentrated responding. Once concentrated responding had been established, nondifferential reinforcement was sufficient to maintain it in some subjects. Since only the differential reinforcement schedules established a contingency with respect to response location, it was concluded that this relationship was necessary for acquisition, but that response-reinforcer contiguity may be sufficient for maintenance. This conclusion is consistent with the view that operant conditioning is a contiguity-based process, but that contingencies are required to produce reliable contiguity between reinforcers and particular responses.     

Responding maintained under fixed-interval and fixed-time schedules of electric shock presentation

Following initial histories under a schedule of electric shock postponement, lever pressing in squirrel monkeys was maintained under fixed-interval and fixed-time schedules of electric shock presentation. No difference in either rate or pattern of responding was obtained when these schedules were presented as components of a multiple schedule. When they were presented singly for long periods of time, the fixed-interval schedule consistently maintained a higher response rate than the fixed-time schedule. The pattern of responding under both schedules was similar, typically consisting of a pause at the beginning of each interval followed by either a steady or a positively accelerating rate of responding. The results suggest that the response-shock dependency is of critical importance in the maintenance of high rates of responding under schedules of electric shock presentation, and support the general view that such responding may be conceptualized as operant behavior under control of many of the same variables that control responding under comparable schedules of food or water reinforcement.