Behavior under large values of the differential-reinforcement-of-low-rate schedule

Pigeons pecked a key and rats pressed a lever for food reinforcement under large values of the differential-reinforcement-of-low-rate schedule. Each subject was tested under 10 different schedule values ranging from 1 to 45 min and was exposed to each schedule value at least twice. The mean interresponse time and mean interreinforcement time increased with the schedule value according to power functions. Response-probability functions were computed for schedule values below 20 min and showed an increase in response probability as a function of time since the last response in most cases. Mean responses per reinforcer increased as a function of schedule value for the rats, but decreased as a function of schedule value for the pigeons. The proportion of responses with interresponse times shorter than 1 sec were an increasing function of schedule value for the pigeons, but did not vary as a function of schedule value for the rats.     

A test of the effectiveness of the differential-reinforcement-of-low-rate schedule

Pigeons and rats were used in a yoked-control design that equated the reinforcement distributions of differential-reinforcement-of-low-rate and variable-interval schedules. Both a between-subjects design and a within-subjects design found response rate higher for the variable-interval schedule than for the differential-reinforcement-of-low-rate schedule, thus demonstrating the effectiveness of the differential-reinforcement-of-low-rate contingency. The interresponse-time distributions were unimodal for all subjects under the variable-interval schedule and bimodal for pigeons under the differential-reinforcement-of-low-rate schedule. The interresponse-time distributions for rats under the differential-reinforcement-of-low-rate schedule were also bimodal in three of four cases but the height of the modes at the shorter interresponse times were small in both absolute value and in relation to the height of the modes at the shorter interresponse times of the pigeons' distributions.     

The effect of restraint beliefs on alcohol-seeking behavior

Individuals who believe that they have high levels of restraint over motivated behaviors such as cigarette smoking are, paradoxically, more likely to engage in those behaviors when tempted (Nordgren, Van Harreveld, & Van Der Pligt, 2009). Our aim was to experimentally manipulate heavy drinkers' beliefs about their drinking restraint to examine the effect on drinking behavior. Sixty heavy drinkers completed an implicit association test and a stop-signal task before receiving bogus feedback on their task performance that indicated that they had either high or low levels of drinking restraint. Participants then completed a bogus taste test in which they were able to consume beer and a soft drink. Results indicated that the group falsely led to believe that they had a high level of drinking restraint subsequently consumed more beer than the group led to believe that they had a low level of drinking restraint. This study demonstrates that beliefs about drinking restraint can influence drinking behavior, in that individuals who overestimate their control over drinking are at greater risk of drinking to excess when exposed to tempting situations.     

The detrimental effects of physical restraint as a consequence for inappropriate classroom behavior.

Functional analyses produced inconclusive results regarding variables that maintained problem behavior for 2 students with developmental disabilities. Procedures were modified to include a contingent physical restraint condition based on in‐class observations. Results indicated that under conditions in which physical restraint (i.e., basket‐hold time‐out) was applied contingent on problem behavior, rates of these behaviors increased across sessions for both subjects. Implications for the use of physical restraint in the classroom are discussed.     

A comparison of the key-peck and treadle-press operants in the pigeon: differential-reinforcement-of-low-rate schedule of reinforcement

Key pecking and treadle pressing in pigeons were compared under concurrent (key-treadle) and single-operant differential-reinforcement-of-low-rate schedules of food reinforcement ranging from 5 to 60 sec (concurrent procedure) or 5 to 120 sec (single-operant procedure). Under both procedures, the two operants followed the same general law: decreasing response rate and reinforcement rate and increasing number of responses per reinforcement as a function of increasing schedule interval. High correlations were found between key pecking and treadle pressing for the measures of response rate, reinforcement rate, and responses per reinforcement. Regression equations allowed the prediction of treadle pressing from key pecking. More bursting occurred in responding to the key, and key pecking showed a more precise temporal discrimination than treadle pressing. A test for sequential dependencies between key and treadle responses showed significant dependencies not only under the concurrent procedure but also in data created artificially by merging key and treadle sequences from different pigeons under the concurrent procedure and from the same pigeon under the single-operant procedure. It seems likely that the sequential dependencies found were due to the independent action of the schedule on each operant and that behavioral dependencies did not occur with the concurrent training procedure. The key-peck operant does not appear to have any special qualities that preclude its use in discovering general laws of behavior, at least under the differential-reinforcement-of-low-rate schedule. The usefulness of the key peck in other situations requires direct experimental study.     

Operant behavior and the galvanic skin potential under DRL schedule

Motor and galvanic skin potential (GSP) activity were investigated during the conditioning, extinction, and reconditioning of motor responses under a differential reinforcement of low rate (DRL) schedule of reinforcement. Interresponse time (IRT) distributions for motor responses during conditioning and reconditioning gradually stabilized at a peak just beyond the minimal IRT required for reinforcement. Few unreinforced motor responses and "bursts" of motor responses were observed during conditioning and reconditioning. Relative to conditioning and reconditioning, extinction effected larger IRTs and smaller GSP amplitudes. GSP amplitudes were greater for unreinforced than for reinforced motor responses during conditioning and reconditioning. However, GSP amplitudes associated with the unreinforced extinction responses were smaller than either the reinforced or unreinforced responses during conditioning and reconditioning.     

The effect of shock intensity upon responding under a multiple-avoidance schedule

The effect of two shock intensities (1.00 and 2.00 mA) were studied in the acquisition, maintenance, and extinction of unsignalled avoidance by albino rats. Single and multiple avoidance schedules were employed, with shock intensity being the principal condition that differed between schedule components. The higher shock intensity was generally more effective in producing avoidance. Higher response rates and lower shock rates were observed under high-intensity shock when performance stabilized. When the multiple schedule was introduced, the six rats trained under a single shock intensity all showed poorer performance under the new shock intensity, whether it was higher or lower than the training intensity. Performance under the original shock intensity did not change substantially with the introduction of a different shock intensity in the other multiple schedule component. Performance under the new shock intensity showed gradual improvement with continued exposure to it. All of the rats showed persistent “warm-up”, receiving approximately 40% of the total session shocks in the first one-sixth of the session. The degree of warm-up was unrelated to avoidance shock intensity.     

Tolerance to effects of cocaine on behavior under a response-initiated fixed-interval schedule

Tolerance to effects of cocaine can be modulated by schedules of reinforcement. With multiple ratio schedules, research has shown an inverse relationship between ratio requirement and amount of tolerance that resulted from daily administration of the drug. In contrast, tolerance to the effects of cocaine on behavior under multiple interval schedules generally has developed regardless of interval value. Under interval schedules reinforcement depends on the animal making one response following a time interval. Thus, as time to respond increases, the time to reinforcement decreases. On the other hand, fixed ratio schedules require a specified number of responses to be made prior to reinforcement. Therefore, delaying the initiation of responding does not coincide with a significant decrease in the time to reinforcement. In the current experiment, 6 pigeons were trained to respond under a three-component multiple schedule, with a different tandem fixed-ratio 1 fixed-interval schedule in each component. The multiple schedule required one response, which was followed by one of three fixed-interval values (5, 15, or 60 s). Thus, the multiple schedule was interval-like because after the fixed-ratio 1, only one more response was required for reinforcement, but it was also ratio-like because the length of the pause at the beginning of each interreinforcer interval affected the time until the next reinforcer. Acute administration of cocaine generally resulted in dose-dependent decreases in responding. Chronic (i.e., daily) administration of a rate-decreasing dose resulted in tolerance patterns similar to those usually obtained with multiple ratio schedules. That is, the magnitude of tolerance was related inversely to schedule size. These results suggest that delay to reinforcement from the initial response may play a role in the development of schedule-parameter-related tolerance.     

Transitional and steady-state choice behavior under an adjusting-delay schedule

Twelve rats made repeated choices on an adjusting-delay schedule between a smaller reinforcer (A) that was delivered immediately after a response and a larger reinforcer (B) that was delivered after a delay which increased or decreased by 20% depending on the subject's choices in successive blocks of trials. In two phases of the experiment (100 sessions and 40 sessions), reinforcer sizes were selected which enabled theoretical parameters expressing the rate of delay discounting and sensitivity to reinforcer size to be estimated from the ratio of the indifference delays obtained in the two phases. Indifference delays, calculated from adjusting delays in the last 10 sessions of each phase, were shorter when the sizes of A and B were 14 and 25 μl of a 0.6 M sucrose solution than when they were 25 and 100 μl of the same solution. The ratio of the indifference delays was significantly smaller than that predicted on the basis of an assumed linear relation between reinforcer size and instantaneous reinforcer value, consistent with a previous proposal that this relation may be hyperbolic in form. Estimates of the rate of delay discounting based on the ratio of the two indifference delays (mean, 0.08 s(-1)) were similar to values obtained previously using different intertemporal choice protocols. Estimates of the size-sensitivity parameter (mean 113 μl) were similar to estimates recently derived from performance on progressive-ratio schedules. In both phases of the experiment, adjusting delays in successive blocks of trials were analyzed using the Fourier transform. The power spectrum obtained from individual rats had a dominant frequency that corresponded to a period of oscillation of the adjusting delay between 30 and 100 trial blocks (mean, 78). Power in the dominant frequency band was highest in the early sessions of the first phase and declined with extended training. It is suggested that this experimental protocol may have utility in neurobehavioral studies of intertemporal choice.     

Effects of reinforcer magnitude on responding under differential-reinforcement-of-low-rate schedules of rats and pigeons

Experiment I investigated the effects of reinforcer magnitude on differential-reinforcement-of-low-rate (DRL) schedule performance in three phases. In Phase 1, two groups of rats (n = 6 and 5) responded under a DRI. 72-s schedule with reinforcer magnitudes of either 30 or 300 microl of water. After acquisition, the water amounts were reversed for each rat. In Phase 2, the effects of the same reinforcer magnitudes on DRL 18-s schedule performance were examined across conditions. In Phase 3, each rat responded unider a DR1. 18-s schedule in which the water amotnts alternated between 30 and 300 microl daily. Throughout each phase of Experiment 1, the larger reinforcer magnitude resulted in higher response rates and lower reinforcement rates. The peak of the interresponse-time distributions was at a lower value tinder the larger reinforcer magnitude. In Experiment 2, 3 pigeons responded under a DRL 20-s schedule in which reinforcer magnitude (1-s or 6-s access to grain) varied iron session to session. Higher response rates and lower reinforcement rates occurred tinder the longer hopper duration. These results demonstrate that larger reinforcer magnitudes engender less efficient DRL schedule performance in both rats and pigeons, and when reinforcer magnitude was held constant between sessions or was varied daily. The present results are consistent with previous research demonstrating a decrease in efficiency as a function of increased reinforcer magnituide tinder procedures that require a period of time without a specified response. These findings also support the claim that DRI. schedule performance is not governed solely by a timing process.     

The schedule dependency of the signaled reinforcement effect

In Experiment 1, rats leverpressed for food reinforcement on either a variable ratio (VR) 30 schedule or a variable interval (VI) 15-s schedule. One group in each condition received a signal filling a 500-ms delay of reinforcement. This treatment enhanced rates on the VR schedule, and attenuated rates on the VI schedule, relative to the rate seen in an unsignaled control condition. In Experiment 2 there was no delay of reinforcement and the signal and food were presented simultaneously. Attenuated rates of responding were observed on VI schedules with a range of mean interval values (15 to 300 s). Experiment 3 used a range of VR schedules (10 to 150) with simultaneous presentations of signal and food. A signal-induced enhancement of response rate was found at all VR values. In Experiment 4, a signal elevated response rates on a tandem VI VR schedule, but depressed rates on a tandem VR VI schedule, compared to control conditions receiving unsignaled delayed reinforcement. These results are taken to show that the effect of a signal accompanying reinforcement depends upon the nature of the behavior that is reinforced during exposure to a given schedule.     

The effects of schedule history and the opportunity for adjunctive responding on behavior during a fixed-interval schedule of reinforcement.

The effects of schedule history and the availability of an adjunctive response (polydipsia) on fixed-interval schedule performance were investigated. Two rats first pressed levers under a schedule of food reinforcement with an interresponse time greater than 11 s, and 2 others responded under a fixed-ratio 40 schedule. All 4 were then exposed to a fixed-interval 15-s schedule. Water was continuously available under these conditions, but after responding became stable on the fixed-interval schedule, access was experimentally manipulated. With water freely available, subjects did not display characteristic fixed-interval response rates and patterns (i.e., scalloping or break-and-run). Instead, they exhibited predictable, stable patterns of behavior as a function of their schedule histories: Subjects with the interresponse-time history exhibited low response rates, and those with the fixed-ratio history exhibited high rates. Manipulating the amount of water available resulted in marked changes in response rates for rats with the interresponse-time history but not for those with the fixed-ratio history. The results illustrate the multiple causation of behavior by its previous and current schedules of reinforcement and other concurrent factors.     

Observing behavior in squirrel monkeys under a multiple schedule of reinforcement availability

Observing behavior of two squirrel monkeys was examined under a multiple schedule of four components. Lever (observing) responses produced either a stimulus indicating the availability of food or another stimulus indicating food was not available. Key responses in the presence of the food-available stimulus produced food on a continuous reinforcement schedule. In the absence of food-available stimuli, responding on the key had no scheduled consequences. Observing responses produced food-available stimuli according to three different random-interval schedules with mean interstimulus availability times of 1, 2, and 4 min. In the fourth component of the multiple schedule (observing extinction) food-available stimuli never occurred. Each component of the schedule was correlated with a distinctive auditory stimulus. Observing rates decreased with decreasing frequency of the food-available stimulus. Observing rates during extinction continued decreasing when the brief stimulus indicating food unavailability was no longer produced by lever pressing. When the brief stimulus was reinstated response rates increased abruptly.     

Reinforcement of mediating behavior on a spaced-responding schedule

This paper describes a procedure for gaining experimental control over mediating behavior on a spaced-responding schedule of food reinforcement. Three rats, food-deprived, were trained on a DRL 16 sec schedule of food reinforcement. Then, a concurrent schedule of food reinforcement was introduced on a second (mediating) lever, such that the first response to occur on the mediating lever, after the DRL interval had timed out, was reinforced with food, as was the next response to occur on the DRL lever. Reinforcement via the mediating lever became a discriminative stimulus for a food-reinforcement opportunity on the DRL lever. Next, food reinforcement for the mediating behavior was replaced by a conditioned reinforcer consisting of onset of a buzzer signaling timing-out of the DRL interval. Under these conditions, chaining of behavior on the two levers was strong, and timing on the DRL lever was more accurate than under ordinary DRL conditions. As the DRL requirement was lengthened from 16 sec to 24 sec to 60 sec, mediating behavior weakened slightly. When the inter-response requirement for food reinforcement on the DRL lever was made shorter than the inter-response requirement for conditioned reinforcement on the mediating lever, the mediating behavior extinguished. Performance in the experiment was analyzed into a four-component chain, and the factors contributing to the maintenance, and later extinction, of mediating behavior are discussed.     

The association for behavior analysis international position statement on restraint and seclusion

A task force authorized by the Executive Council of the Association for Behavior Analysis International (ABAI) generated the statement below concerning the techniques called restraint and seclusion. Members of the task force independently reviewed the scientific literature concerning restraint and seclusion and agreed unanimously to the content of the statement. The Executive Council accepted the statement, and it was subsequently approved by a two-thirds majority vote of the general membership. It now constitutes official ABAI policy. The position statement is posted on the ABAI Web site (www.abainternational.org/ABA/statements/RestraintSeclusion.asp). The purpose of the position statement is to provide guidance to behavior analysts and other professionals interested in the position of ABAI on these controversial topics. In extreme cases, abuses of procedures erroneously used in the name of behavior analysis are not defensible. On the other hand, behavior analysts acting ethically and in good faith are provided with guidelines for sound and acceptably safe practice. To the extent that behavior-analytic positions influence public policy and law, this statement can be presented to officials and lawmakers to guide informed decision making. At the conclusion of the document, a bibliography is provided of articles and presentations considered by one or more task force members in developing the position statement.     

The effect of the size of the test environment on behavior under two temporally defined schedules

The effect of the size of the floor area of the operant test chamber on behavior was tested using a standard-size test chamber and a test chamber with one-fourth of the floor area of the standard chamber. Two groups of pigeons were tested under a differential-reinforcement-of-low-rate 15-sec schedule or a variable-interval 60-sec schedule. Both groups of pigeons had higher response rates while in the smaller floor area. Pigeons under the differential-reinforcement-of-low-rate schedule also showed a decrease in rate of reinforcement, an increase in ratio of responses to reinforcements, and an alteration in interresponse-time-per-opportunity distributions when tested in the reduced floor-area condition. These effects are similar to those found under physical restraint, indicating that amount of floor space available for locomotion interacts with schedule behavior and that physical restraint may be regarded as the lower limiting value of amount of floor area available for locomotion.