The effects of number of responses on pause length with temporal variables controlled

A change in the size of a fixed-ratio schedule involves a simultaneous change in number of responses, in time to complete the ratio (work time), and in the interval between successive reinforcements (interreinforcement interval). Previous studies have suggested the importance of work time and the interreinforcement interval in controlling the length of the post-reinforcement pause. The present study sought to determine whether number of responses is also a significant factor. Pigeons were trained on a multiple fixed-ratio x fixed-ratio 2 plus timeout schedule in which the size of the fixed-ratio x was manipulated. When the work times (Experiment I) or interreinforcement intervals (Experiment II) were equated for the two components, the pause before the fixed-ratio x was longer than the pause before the fixed-ratio 2 plus timeout. As fixed-ratio x size increased, the relative difference in the lengths of the two types of pauses also increased. Because the fixed-ratio x component contained a larger number of responses than the fixed-ratio 2 plus timeout component, the relatively longer pause preceding the fixed-ratio x indicates that number of responses played a significant role in determining the length of the post-reinforcement pause.     

Self-imposed timeouts under increasing response requirements

Self-imposed timeouts by pigeons working under a progressive-ratio food schedule were studied under different conditions. The main findings were (1) continued production of timeouts over an extended series of sessions, (2) more frequent responding on the key with the timeout consequence than on a key having no consequence, (3) an inverse relationship between number of timeouts and level of body weight, (4) production of timeouts when the timeout duration was brief, lengthy, or controlled by the pigeon, and (5) dependence of self-imposed timeouts on variables controlling responding under the progressive-ratio schedule. Under all experimental conditions, with the exception of performances at the high body weight, timeouts were more frequent during the longer progressive-ratio steps and usually were localized in the post-reinforcement pause or the early part of the step. The timeout behavior could be interpreted as either an escape from aversive stimuli generated by the progressive-ratio schedule or as a response reinforced by the consequent stimulus change.     

Increased reinforcement when timeout from avoidance includes access to a safe place

Three experiments investigated the reinforcing value of access to a safe place during timeout from an avoidance schedule. Rats were trained on conjoint schedules in which responding both postponed shock on a free-operant avoidance schedule and produced periods of timeout on fixed-ratio schedules. In some conditions, a shelf was inserted into the operant chamber during timeout, enabling subjects to get off the grid floor. The combination of timeout and shelf maintained substantially higher response rates than the baseline avoidance schedule with ratio requirements as high as 90 (Experiment I). Adding the shelf to timeouts in one component of multiple fixed-ratio schedules of timeout resulted in higher response rates in the component where the shelf was included (Experiment II). When timeouts with and without the shelf were arranged on concurrent schedules, the shelf-timeout combination was preferred, even when of shorter duration than timeout alone (Experiment III). In all three experiments, subjects climbed on the shelf, although all shocks were cancelled during timeout periods. The results could not be accounted for solely in terms of the reinforcing properties of changes in shock rates, but required an interpretation that ascribed conditioned reinforcing value to stimuli associated with such changes.     

Timeout postponement without increased reinforcement frequency

Three experiments were conducted to examine pigeons' postponement of signaled extinction periods (timeouts) from a schedule of food reinforcement when such responding neither decreased overall timeout frequency nor increased the overall frequency of food reinforcement. A discrete-trial procedure was used in which a response during the first 5 s of a trial postponed an otherwise immediate 60-s timeout to a later part of that same trial but had no effect on whether the timeout occurred. During time-in periods, responses on a second key produced food according to a random-interval 20-s schedule. In Experiment 1, the response-timeout interval was 45 s under postponement conditions and 0 s under extinction conditions (responses were ineffective in postponing timeouts). The percentage of trials with a response was consistently high when the timeout-postponement contingency was in effect and decreased to low levels when it was discontinued under extinction conditions. In Experiment 2, the response-timeout interval was also 45 s but postponement responses increased the duration of the timeout, which varied from 60 s to 105 s across conditions. Postponement responding was maintained, generally at high levels, at all timeout durations, despite sometimes large decreases in the overall frequency of food reinforcement. In Experiment 3, timeout duration was held constant at 60 s while the response-timeout interval was varied systematically across conditions from 0 s to 45 s. Postponement responding was maintained under all conditions in which the response-timeout interval exceeded 0 s (the timeout interval in the absence of a response). In some conditions of Experiment 3, which were designed to control for the immediacy of food reinforcement and food-correlated (time-in) stimuli, responding postponed timeout but the timeout was delayed whether a response occurred or not. Responding was maintained for 2 of 3 subjects, suggesting that behavior was negatively reinforced by timeout postponement rather than positively reinforced by the more immediate presentation of food or food-correlated (time-in) stimuli.     

Stimulus-food relations and free-operant postponement of timeout from response-independent food presentation

Grain was briefly presented to food-deprived pigeons intermittently and response-independently except during signaled timeouts. During Experiment 1, key pecks postponed the next timeout for a specified interval. Rates of pecking during time in were inversely related to the length of time pecking postponed the next timeout. Response-independent presentation of temporal distributions of timeouts exactly matched to a preceding postponement condition decreased pecking rates during Experiment 2. These results indicate that key pecking of pigeons can be controlled by response-dependent postponement of timeout, but that responses elicited by stimulus-reinforcer relations inherent in timeout-postponement procedures may substantially modify rates and patterns of pecking.     

Responding under fixed-ratio and multiple fixed-interval fixed-ratio schedules of electric shock presentation

Squirrel monkeys, initially trained under a schedule of electric shock postponement and then under fixed-interval schedules of electric shock presentation, were studied under multiple fixed-interval fixed-ratio and under fixed-ratio schedules of shock presentation. Under the fixed-interval (10-min) component of the multiple schedule, a pause was followed by a gradual increase in responding to a rate maintained until shock presentation; under the fixed-ratio (3-, 10-, or 30-response) component of the multiple schedule, a brief pause was typically followed by a relatively high and uniform rate of responding until shock was presented. When the 60-sec timeout periods, which usually followed shock presentation, were eliminated from the multiple schedule for one monkey, responding was only transiently affected. In the one monkey studied, responding was maintained under a fixed-ratio schedule alone (with timeout periods), but rates of responding were lower than under the fixed-ratio component of the multiple schedule. Characteristic patterns of responding, similar to those engendered under schedules of food presentation or shock termination, can be maintained under fixed-ratio schedules of shock presentation; further, patterns of responding can be controlled by discriminative stimuli in multiple schedules.     

Effects of timeout on spaced responding in pigeons

Three pigeons were trained under a differential-reinforcement-of-low-rate schedule of 20 sec, and then exposed to a schedule under which responses terminating interresponse times less than 20 sec produced timeout and responses terminating interresponse times greater than 20 sec produced reinforcement. Response-produced timeouts selectively decreased the probability of short interresponse times and thereby produced a higher frequency of reinforcement. The suppressive effect of timeout was independent of timeout duration, with timeouts of 5, 10, or 20 sec. Similar effects were found when the minimum interresponse time that could be terminated by response-produced reinforcement was increased to 30 sec. The suppressive effects of timeout on responding maintained by these schedules were similar to previous reports in which responding was punished with electric shock.     

Behavior controlled by scheduled injections of cocaine in squirrel and rhesus monkeys.

Rates and patterns of key-press responding maintained under schedules in which responding resulted in intravenous injections of cocaine were studied in squirrel monkeys and rhesus monkeys. Each injection was followed by a 60- or 100-sec timeout period. Schedule-controlled behavior was obtained at appropriate cocaine doses in each species. Under FR 10 or FR 30 schedules, performance was characterized by high rates of responding (usually more than one response per second) in each ratio. Under FI 5-min schedules, performance was characterized by an initial pause, followed by acceleration of responding to a final rate that was maintained until the end of the interval. Under multiple fixed-ratio fixed-interval schedules, rates and patterns of responding appropriate to each schedule component were maintained. Responding seldom occurred during timeout periods under any schedule studied. At doses of cocaine above or below those that maintained characteristic schedule-controlled behavior, rates of responding were relatively low and patterns of responding were irregular. Characteristic fixed-interval responding was maintained over a wider range of cocaine doses than characteristic fixed-ratio responding. Complex patterns of responding controlled by discriminative stimuli under fixed-ratio or fixed-interval schedules can be maintained by cocaine injections in squirrel monkeys and rhesus monkeys.     

Behavioral effects of delayed timeouts from reinforcement

Timeouts are sometimes used in applied settings to reduce target responses, and in some circumstances delays are unavoidably imposed between the onset of a timeout and the offset of the response that produces it. The present study examined the effects of signaled and unsignaled timeouts in rats exposed to concurrent fixed‐ratio 1 fixed‐ratio 1 schedules of food delivery, where each response on one lever, the location of which changed across conditions, produced both food and a delayed 10‐s timeout. Delays of 0 to 38 s were examined. Delayed timeouts often, but not always, substantially reduced the number of responses emitted on the lever that produced timeouts relative to the number emitted on the lever that did not produce timeouts. In general, greater sensitivity was observed to delayed timeouts when they were signaled. These results demonstrate that delayed timeouts, like other delayed consequences, can affect behavior, albeit less strongly than immediate consequences.     

Conjunctive schedules of reinforcement: III. A fixed-interval adjusting fixed-ratio schedule

Key pecking of three pigeons was studied under a conjunctive schedule that specified both a fixed-interval and an adjusting fixed-ratio requirement. The fixed-interval schedule was 6 min for one pigeon and 3 min for the other two. The size of the ratio requirement was determined within each cycle of the fixed interval by the duration of the pause before responding began. The fixed-ratio value was at maximum at the start of each fixed interval and decreased linearly until the first response occurred (adjusting fixed-ratio schedule). A peck produced food when the number of responses remaining on the fixed-ratio schedule was completed and when the fixed interval had elapsed. If no response occurred during the interval, the fixed-ratio requirement decreased to one and a single response after the interval elapsed produced food. The initial value of the adjusting fixed-ratio schedule was studied over a range of 0 to 900. Increases in the adjusting fixed-ratio schedule to about 300 responses increased both pause duration and running response rate and also modified the pattern of responding from that obtained under the fixed-interval schedule. Higher values of the adjusting fixed ratio generally decreased pause duration and running response rate and also disrupted responding. Interreinforcement time under the conjunctive schedule was increased substantially when the adjusting fixed-ratio size exceeded 300 responses.     

The Effect of Warnings to Timeout on Child Compliance to Parental Instructions

ABSTRACT

One common component of behavioral parent training packages is the use of a warning prior to implementation of a timeout following noncompliance to parental instructions. The primary purpose of this research was to evaluate the effects of warnings on compliance. An alternating treatments design was used to evaluate compliance to warned versus unwarned timeouts with three typically developing children. All participants showed a significant increase in compliance upon implementation of the timeout package, either with or without a warning. However, compliance decreased over time in the Warning condition for two participants and increased in variability for a third. All participants had more timeouts in the No Warning condition. Results also showed preliminary evidence for parental preference of Warned timeouts. Implications are discussed.     

Response-produced timeouts under a progressive-ratio schedule with a punished reset option

Three behavioral options were available to food-deprived pigeons: (1) pecking one key resulted in food reinforcement according to a 50-response progressive-ratio schedule, (2) pecking a second key reset the progressive-ratio schedule to the initial progressive-ratio step, and (3) pecking a third key produced a 3-min timeout period. Pecks on the reset key were shocked. Under low and intermediate shock intensities, timeouts were not produced; under high shock levels, timeouts were produced regularly. Timeouts occurred during the initial period of a progressive-ratio step and were more frequent during the longer steps of the progressive-ratio schedule. Response-produced timeouts under these experimental conditions could be interpreted either as an escape from aversive behavioral options or as a low-probability behavior emerging when the food reinforcement schedule exerted weaker control.     

Schedule-induced polydipsia in rats living in an operant environment

The effect of variations in interreinforcement interval on the temporal and distributional relation between feeding and drinking was continuously monitored. Rats were housed continuously in an operant chamber in which water was freely available, but lever pressing was required to obtain food (45-mg pellets). Initially, pellets were delivered on a fixed-ratio 1 schedule of reinforcement, which was followed by testing on response-initiated fixed-interval 15-, 30-, and 60-second schedules. The total number of discrete, daily meals (a period in which several pellets were earned in succession) was slightly higher during the fixed-interval schedules than during the fixed-ratio 1, but there was no systematic effect of fixed-interval length on meal frequency. Total water consumption, in contrast, increased dramatically as the interval was lengthened: both subjects consumed two to three times as much water on the fixed-interval 60-second schedule as on the fixed-ratio 1. The increased water consumption was the result of an alteration in the distribution of drinking relative to eating. During the fixed-ratio 1 condition, drinking occurred infrequently following individual food pellets and represented the smallest percentage of total drinking; drinking occurred predominantly just before or after a meal. As the fixed interval was lengthened, however, the frequency of postpellet drinking gradually increased and eventually comprised the largest proportion of daily drinking.     

Assessment of the use of timeout in an inpatient child psychiatry treatment unit

This article describes the use of response contingent brief social isolation (i.e., timeout) with 770 children admitted to an inpatient child psychiatry treatment unit during a 2-year study period. A total of 2,256 timeouts were recorded during the study period. Preliminary normative frequency, duration, and reason for timeout information are reported for age and sex groups and for common diagnostic categories. Only a third (255) of the inpatients earned one or more timeouts during their hospitalization. The results suggest 2 trends for timeout in this inpatient setting. First, there was an inverse relationship between timeout frequency and subjects' age; i.e., frequency of timeouts tended to decrease as subjects' age increased. Second, there was a positive relationship between timeout duration and subjects' age; i.e., older subjects required longer timeouts. A third and tentative finding suggested that the frequency of timeout was differentially associated with primary diagnosis for some groups. Alternative treatment procedures are discussed.     

Avoidance of timeout from response-independent reinforcement

Responses on a lever by rats postponed scheduled timeouts, or periods during which the delivery of response-independent food was withheld. The effects of a number of experimental variables were examined and the conclusions drawn are that the functional relations describing free-operant avoidance of timeout from response-independent reinforcement are similar to those for avoidance of electric shock and that both phenomena are sensitive to the same parametric manipulations. Results suggest that high frequency of food delivery in timein maintains a higher rate of timeout avoidance than low frequency. The evidence argues against an interpretation in terms of adventitious food-reinforcement of the timeout avoidance response. Finally, the effects of scheduling timeouts independently of responding and of omitting timeouts confirm the view that timeouts can be aversive and may act as punishment for responding.     

The effects of warned loss magnitude and timeout duration on human avoidance behavior

This study experimentally investigated the determinants of avoidance behavior when participants are forewarned of aversive outcomes. The effects of 3 variables on avoidance behavior were examined: point-loss amount (5 levels, from 20 to 100 points), duration of timeout from positive reinforcement (5 levels, 20 to 100 s), and 3 predictive accuracy levels (100%, 50%, and 0%) of warning stimuli. Twelve participants completed 3 sessions, each comprising 25 discrete trials, that differed in predictive accuracy level. Throughout a session, a participant engaged in button press responses that were reinforced by points under a conjunctive fixed-ratio fixed-interval schedule. During each trial, a warning stimulus that indicated a loss amount and a timeout duration was presented. If the participant pressed the avoidance button, then the timeout started, otherwise the loss occurred. The trial ended with termination of timeout or an occurrence of the loss. Results showed that avoidance responses increased when the loss amount increased and decreased when the timeout duration increased. The frequency of avoidance responses was lowest when the predictive accuracy of warning stimuli was 0%. These findings demonstrated that this experimental procedure could be useful for investigating human avoidance behavior outside the laboratory.     

Timeout and concurrent fixed-ratio schedules with human subjects

Human subjects given choices among 10 different pairs of concurrent fixed-ratio schedules preferred the smaller ratio. After a preference had been determined, timeout of increasing duration followed the completion of the preferred schedule. The larger the fixed-ratio difference, the longer the timeout necessary to produce the shift to the previously nonpreferred ratio. Responses by two of three subjects were unaffected by changes from response-dependent to response-independent pay.     

Choice of timeout during response-independent food schedules

Rats' lever pressing terminated visual or auditory stimuli associated with fixed-time or variable-time schedules of food delivery and produced a timeout period during which food delivery could not occur. Lever pressing during a timeout period reinstated the food-associated stimuli and again permitted food delivery according to the fixed-time or variable-time schedules. The mean interfood interval ranged from 1 minute to 16 minutes (variable-time schedules) or 32 minutes (fixed-time schedules); the timer controlling schedule intervals did not stop during timeout periods. The percentage of session time spent in timeout increased when the mean interfood intervals were lengthened and decreased when the mean interfood intervals were shortened. Timeouts were initiated most frequently about half way between successive food deliveries (fixed-time schedules) or after 15 seconds or more had lapsed since the last food delivery (variable-time schedules). Elimination of food delivery increased the percentage of session time spent in timeout, and elimination of the timeout contingency decreased lever press rates. When timeout was produced only when the lever was held in the depressed position, little time was spent in timeout. The main determinants of timeout initiation and termination appeared to be the rate of food delivery, freedom of movement during timeout, and the stimulus change associated with initiation and termination of timeout.     

Redundant information in an observing-response procedure

In three observing-response experiments relevant to the information hypothesis of conditioned reinforcement, the basic procedure was one in which an observing response produced one stimulus on trials that terminated in non-contingent reinforcement and another stimulus on trials that terminated in a brief timeout. In Experiment I, the observing response consisted of a single peck or a short fixed-ratio schedule (FR 3 or FR 6), depending on the type of trial. If the single peck produced the negative stimulus and the fixed ratio produced the positive stimulus, observing responses were maintained. If the single peck produced the positive stimulus and the fixed-ratio produced the negative stimulus, observing responses were not maintained on negative trials. In the second experiment, the response key was either white or dark at the beginning of a trial, indicating whether it was a positive or negative trial. Observing responses continued to be maintained on positive trials but not on negative trials. In Experiment III, only positive or negative trials were scheduled for several sessions. Observing responses extinguished regardless of whether positive or negative trials were scheduled. The results do not support the hypothesis that making the stimuli produced by observing responses redundant will reduce observing responses.     

Time limits for completing fixed ratios

Two experiments investigated how the addition of time limits affected fixed-ratio behavior. In Exp. 1, pigeons obtained food only if they completed the ratio within a specified time after the end of the preceding ratio. In Exp. 2, they obtained food only if they took longer than a specified time. Failures to meet the time criteria produced brief timeouts. The times taken depended on the requirements in both experiments. In Exp. 1, progressively briefer time criteria resulted in faster ratios, and in Exp. 2, longer time criteria increased the time taken in each ratio. The pigeon's sensitivity to the temporal variable, a property of the entire period extending from the first opportunity to respond to the end of the ratio, indicated that performance involved a behavioral unit encompassing both the post-reinforcement pause and the responses comprising the ratio.