Variable-time reinforcement schedules in the treatment of socially maintained problem behavior

Noncontingent reinforcement (NCR) consists of delivering a reinforcer on a time-based schedule, independent of responding. Studies evaluating the effectiveness of NCR as treatment for problem behavior have used fixed-time (FT) schedules of reinforcement. In this study, the efficacy of NCR with variable-time (VT) schedules was evaluated by comparing the effects of VT and FT reinforcement schedules with 2 individuals who engaged in problem behavior maintained by positive reinforcement. Both FT and VT schedules were effective in reducing problem behavior. These findings suggest that VT schedules can be used to treat problem behavior maintained by social consequences.     

EFFECTS OF A FIXED‐TIME SCHEDULE ON ABERRANT AND ADAPTIVE BEHAVIOR

Fixed‐time (FT) schedules of reinforcement have been used to decrease destructive behavior. However, the effects of FT schedules on acquisition and maintenance of appropriate behavior remain unclear. In this study, we present a case in which an FT schedule produced an increase in adaptive behavior and resulted in a significant decrease in destructive behavior.     

The reductive effects of noncontingent reinforcement fixed-time versus variable-time schedules.

The effects of fixed‐time (FT) and variable‐time (VT) schedules on responding were evaluated with 2 adults with mental retardation. Multielement and reversal designs were used to compare the effects of FT and VT schedules in reducing responses previously maintained on variable‐ratio reinforcement schedules. The schedules were equally effective in reducing the target behavior.     

Fixed-time schedule effects in combination with response-dependent schedules

We evaluated the effects of fixed-interval (FI), fixed-time (FT), and conjoint (combined) FI FT reinforcement schedules on the responding of 3 adults who had been diagnosed with schizophrenia. Responding on vocational tasks decreased for 2 of 3 participants under FT alone relative to FI alone. Responding under FI FT resulted in response persistence for 2 of 3 participants. Results have implications for the maintenance of desirable behavior, as well as for situations in which FT treatment has been implemented for problem behavior and problem behavior is nevertheless reinforced by caregivers.     

Fixed-time teacher attention to decrease off-task behaviors of typically developing third graders

Evidence to validate the use of fixed-time (FT) reinforcer delivery (i.e., noncontingent reinforcement) with typically developing populations has been relatively rare in the behavioral literature. In those studies that have provided validation, reinforcer delivery schedules appeared to be prohibitively dense for sustained implementation of procedures. This study demonstrated the efficacy of using FT reinforcer delivery to reduce off-task behavior of 2 typically developing third graders using a teacher-selected schedule (FT 4 min). Immediate reductions in off-task behavior were observed for both children. Challenges in identifying the operative mechanism of FT schedules in natural settings are discussed.     

Response elimination in rats with schedules of omission training, including yoked and response-independent reinforcement comparisons

After rats were trained to lever press, response elimination began with factorial combinations of fixed vs variable and adjusting vs constant omission training schedules. A time interval scheduling reinforcement remained the same in a constant schedule, and its length was increased as response rate declined in the adjusting schedule. A variable time (VT) response-independent reinforcement schedule followed response elimination to test the durability of response cessation. Experiment I included groups whose reinforcement was yoked to that received by the omission schedule groups. Rate of response elimination was faster with an adjusting than a constant schedule, and slightly faster with a variable than a fixed schedule. There were no significant differences in rate of response elimination between omission schedule and yoked groups. Shorter delay of reinforcement tended to increase rate of response elimination. In the subsequent VT durability test all groups displayed near-zero response rates. In Experiment II adjusting fixed and variable omission schedules, including yoked groups, were compared with fixed time (FT) and VT reinforcement schedules. Response elimination was slower in the FT and VT groups, and they responded more in a subsequent VT durability test. It was concluded that differential reinforcement of other behavior fails to account for these omission training effects, and suggestions were made for an analysis based on the correlation between response and reinforcement rate.     

ASSESSMENT OF STEREOTYPIC AND SELF-INJURIOUS BEHAVIOR AS ADJUNCTIVE RESPONSES

Certain responses of both humans and nonhumans appear to be maintained indirectly by intermittent reinforcement schedules and have been referred to collectively as adjunctive behavior. Although basic research has examined adjunctive behavior extensively, relatively few studies have been conducted with humans, particularly those with developmental disabilities who often engage in frequent and varied stereotypic behavior. This study assessed possible adjunctive characteristics of self-injurious and stereotypic behaviors using a multielement design containing two types of control conditions. Four subjects who engaged in both self-injurious behavior and stereotypy participated after variables maintaining their self-injury were identified via functional analyses. Each day, subjects were exposed to three 15-min sessions in random order: (a) noncontingent presentation of food on a fixed-time schedule (e.g., FT 30 s), (b) a massed-reinforcement (food) control, and (c) a no-reinforcement control. A variety of fixed-time schedules were examined during different experimental phases. Results of this preliminary study suggested that self-injury was not induced by intermittent reinforcement schedules, whereas the stereotypic behavior of some individuals showed characteristics of adjunctive behavior. The importance of research on adjunctive behavior and suggestions for future studies are discussed.     

Fixed-time schedule effects as a function of baseline reinforcement rate

Using an arbitrary response, we evaluated fixed-time (FT) schedules that were either similar or dissimilar to a baseline (response-dependent) reinforcement schedule and extinction. Results suggested that both FT schedules and extinction resulted in decreased responding. However, FT schedules were more effective in reducing response rates if the FT reinforcer rate was dissimilar to baseline reinforcer rates. Possible reasons for this difference were evaluated with data analysis methods designed to identify adventitious response-reinforcer relations.     

Notes on fixed-ratio and fixed-interval escape responding in the pigeon

After learning to peck a key when each peck removed a slowly increasing series of electric shocks, pigeons were placed on fixed-ratio and fixed-interval escape schedules. The resulting behavior was comparable to that of other species on ratio and interval escape schedules. Thus, while the pigeon apparently requires special techniques for the initial shaping of a key-peck response with negative reinforcement, this response, once obtained, can be subjected to intermittent schedules of negative reinforcement with no great difficulty.     

FIXED-TIME SCHEDULES ATTENUATE EXTINCTION-INDUCED PHENOMENA IN THE TREATMENT OF SEVERE ABERRANT BEHAVIOR

We compared the effects of extinction (EXT) and fixed-time (FT) schedules as treatment for severe problem behavior displayed by 3 individuals with developmental disabilities. First, functional analyses identified the reinforcers maintaining aberrant behavior for all 3 individuals. Next, EXT and FT schedules were compared using a multielement design. During EXT, the reinforcer maintaining problem behavior was withheld. During FT, the reinforcers were presented response independently at preset intervals. Results showed that FT schedules were generally more effective than EXT schedules in reducing aberrant behavior. FT schedules may be used in situations when extinction-induced phenomena are problematic.     

USING FIXED‐TIME SCHEDULES TO MAINTAIN BEHAVIOR: A PRELIMINARY INVESTIGATION

The purpose of this study was to evaluate the potential of fixed‐time (FT) schedules to maintain behavior. Two children who had been diagnosed with autism were taught a functional task. Subsequently, three different FT schedules (i.e., yoked, thin, dense) were compared to determine their capacity to maintain task responding. Results suggested that FT schedules may be used to maintain previously acquired behavior.     

Schedule-induced kinesic and taxic behavioral stereotypy in the pigeon

Two experiments explored the functional character of 2 schedule-induced interim behaviors (pacing and retreat) and 1 terminal behavior (keypecking) that developed on fixed-time (FT) schedules of food delivery with a keylight that increased in brightness throughout the interstimulus interval. In Experiment 1, this ramp procedure was compared with a less discriminable ramp, and FT and Random Time (RT) procedures without a signal. Decreased discriminability expanded keypecking in the trial. The FT schedule eliminated only keypecking and the RT procedure eliminated keypecking and retreat while pacing remained. In Experiment 2, predictive and unpredictive ramps were added to the RT procedure. The data suggest that schedule-induced stereotypy can be divided into kinesic stereotypy (pacing), which arises from repeated reinforcer presentations, and taxic stereotypy, which is tied to an increase (keypecking) or decrease (retreat) in the momentary probability of reinforcement.     

A COLLATERAL EFFECT OF REWARD PREDICTED BY MATCHING THEORY

Matching theory describes a process by which organisms distribute their behavior between two or more concurrent schedules of reinforcement (Herrnstein, 1961). In an attempt to determine the generality of matching theory to applied settings, 2 students receiving special education were provided with academic response alternatives. Using a combined simultaneous treatments design and reversal design, unequal ratio schedules of reinforcement were varied across two academic responses. Findings indicated that both subjects allocated higher rates of responses to the richer schedule of reinforcement, although only one responded exclusively to the richer schedule. The present results lend support to a postulation that positive reinforcement may have undesirable collateral effects that are predicted by matching theory (Balsam & Bondy, 1983).     

A comparison of dense-to-lean and fixed lean schedules of alternative reinforcement and extinction

Behavior-reduction interventions typically employ dense schedules of alternative reinforcement in conjunction with operant extinction for problem behavior. After problem behavior is reduced in the initial treatment stages, schedule thinning is routinely conducted to make the intervention more practical in natural environments. In the current investigation, two methods for thinning alternative reinforcement schedules were compared for 3 clients who exhibited severe problem behavior. In the dense-to-lean (DTL) condition, reinforcement was delivered on relatively dense schedules (using noncontingent reinforcement for 1 participant and functional communication training for 2 participants), followed by systematic schedule thinning to progressively leaner schedules. During the fixed lean (FL) condition, reinforcement was delivered on lean schedules (equivalent to the terminal schedule of the DTL condition). The FL condition produced a quicker attainment of individual treatment goals for 2 of the 3 participants. The results are discussed in terms of the potential utility of using relatively lean schedules at treatment outset.     

Performances on ratio and interval schedules of reinforcement: Data and theory

Two differences between ratio and interval performance are well known: (a) Higher rates occur on ratio schedules, and (b) ratio schedules are unable to maintain responding at low rates of reinforcement (ratio “strain”). A third phenomenon, a downturn in response rate at the highest rates of reinforcement, is well documented for ratio schedules and is predicted for interval schedules. Pigeons were exposed to multiple variable-ratio variable-interval schedules in which the intervals generated in the variable-ratio component were programmed in the variable-interval component, thereby “yoking” or approximately matching reinforcement in the two components. The full range of ratio performances was studied, from strained to continuous reinforcement. In addition to the expected phenomena, a new phenomenon was observed: an upturn in variable-interval response rate in the midrange of rates of reinforcement that brought response rates on the two schedules to equality before the downturn at the highest rates of reinforcement. When the average response rate was corrected by eliminating pausing after reinforcement, the downturn in response rate vanished, leaving a strictly monotonic performance curve. This apparent functional independence of the postreinforcement pause and the qualitative shift in response implied by the upturn in variable-interval response rate suggest that theoretical accounts will require thinking of behavior as partitioned among at least three categories, and probably four: postreinforcement activity, other unprogrammed activity, ratio-typical operant behavior, and interval-typical operant behavior.     

APPLIED IMPLICATIONS OF REINFORCEMENT HISTORY EFFECTS

Although the influence of reinforcement history is a theoretical focus of behavior analysis, the specific behavioral effects of reinforcement history have received relatively little attention in applied research and practice. We examined the potential effects of reinforcement history by reviewing nonhuman, human operant, and applied research and interpreted the findings in relation to possible applied significance. The focus is on reinforcement history effects in the context of reinforcement schedules commonly used either to strengthen behavior (e.g., interval schedules) or commonly used to decrease behavior (e.g., extinction).     

Hill-climbing by pigeons

Pigeons were exposed to two types of concurrent operant-reinforcement schedules in order to determine what choice rules determine behavior on these schedules. In the first set of experiments, concurrent variable-interval, variable-interval schedules, key-peck responses to either of two alternative schedules produced food reinforcement after a random time interval. The frequency of food-reinforcement availability for the two schedules was varied over different ranges for different birds. In the second series of experiments, concurrent variable-ratio, variable-interval schedules, key-peck responses to one schedule produced food reinforcement after a random time interval, whereas food reinforcement occurred for an alternative schedule only after a random number of responses. Results from both experiments showed that pigeons consistently follow a behavioral strategy in which the alternative schedule chosen at any time is the one which offers the highest momentary reinforcement probability (momentary maximizing). The quality of momentary maximizing was somewhat higher and more consistent when both alternative reinforcement schedules were time-based than when one schedule was time-based and the alternative response-count based. Previous attempts to provide evidence for the existence of momentary maximizing were shown to be based upon faulty assumptions about the behavior implied by momentary maximizing and resultant inappropriate measures of behavior.     

Frequency versus magnitude of reinforcement: New data with a different procedure

Two pigeons, with previous exposure to concurrent schedules, were submitted to 29 sessions of 8 hours each with concurrent variable-interval variable-interval schedules in which reinforcement parameters changed from session to session. In the first nine sessions reinforcement durations were equal in both schedules while reinforcement frequencies varied; in Sessions 10 through 18, both frequency and duration of reinforcement were varied; in Sessions 19 through 29, only reinforcement duration was varied. Results with this different procedure confirm previous findings that behavior is more sensitive to changes in reinforcement frequency than to reinforcement magnitude.     

Discrimination of schedules that predict reinforcement from non-predictive ones and preference for less predictive schedules by rats

This study examined the behavior of rats on schedules that either did or did not contain information about impending reinforcement. Experiment 1 indicated that rats discriminated between schedules of reinforcement that differed only in the amount of information they contained about impending reinforcement. Experiment 2 revealed a preference for the schedule containing less information about impending reinforcement. The results suggest that predictable nonreinforcement is an important determiner of behavior in choice situations.     

DO CHILDREN PREFER CONTINGENCIES? AN EVALUATION OF THE EFFICACY OF AND PREFERENCE FOR CONTINGENT VERSUS NONCONTINGENT SOCIAL REINFORCEMENT DURING PLAY

Discovering whether children prefer reinforcement via a contingency or independent of their behavior is important considering the ubiquity of these programmed schedules of reinforcement. The current study evaluated the efficacy of and preference for social interaction within differential reinforcement of alternative behavior (DRA) and noncontingent reinforcement (NCR) schedules with typically developing children. Results showed that 7 of the 8 children preferred the DRA schedule; 1 child was indifferent. We also demonstrated a high degree of procedural fidelity, which suggested that preference is influenced by the presence of a contingency under which reinforcement can be obtained. These findings are discussed in terms of (a) the selection of reinforcement schedules in practice, (b) variables that influence children's preferences for contexts, and (c) the selection of experimental control procedures when evaluating the effects of reinforcement.