Effects of concurrent response-independent reinforcement on fixed-interval schedule performance

In three experiments, behavior maintained by fixed-interval schedules changed when response-independent reinforcement was delivered concurrently according to fixed- or variable-time schedules. In Experiment I, a pattern of positively accelerated responding during fixed interval was changed to a linear pattern when response-independent reinforcement occurred under a variable-time schedule. Overall response rates (total responses/total time) decreased as the frequency of response-independent reinforcement increased. Experiment II showed that the response-rate changes in the first experiment were controlled by the response-reinforcer relation, but the changes in patterns of responding were similar whether concurrently available reinforcement at varying times was response-dependent or response-independent. In the final experiment, the addition of response-independent reinforcement at fixed times to a fixed-interval schedule resulted in changes in both local and overall response rates and in the occurrence of positively accelerated responding between reinforcements. These results suggest that the temporal distribution of reinforcers determines response patterns and that both the response-reinforcement dependency and the schedule of reinforcement determine overall response rates during concurrently scheduled response-dependent and response-independent reinforcement.     

Second-order schedules: brief shock at the completion of each component

Pigeons worked on second-order schedules in which completion of fixed-interval component schedules was reinforced with food according to a variable-interval schedule of reinforcement. The completion of each fixed-interval component resulted in the presentation of a brief electric shock. In one condition (shock-paired), the completion of every fixed-interval component, including those that ended in food, resulted in the shock. In another condition (shock-nonpaired), completion resulted in shock except for those components that ended in food. Shock presentations resulted in a positively accelerated rate within fixed-interval components. This patterning within components was similar whether the shock was intermittently paired with food or not. Response rates tended to decrease as shock intensity increased. The characteristic fixed-interval response pattern within components did not occur when shock presentations were omitted at the end of each component (tandem schedule). When shocks were scheduled but food was no longer presented (extinction) response rates declined to a near-zero level. The performance under shock conditions is similar to that in other studies in which visual and auditory stimuli are presented at the completion of component schedules.     

Responding maintained under fixed-interval and fixed-time schedules of electric shock presentation

Following initial histories under a schedule of electric shock postponement, lever pressing in squirrel monkeys was maintained under fixed-interval and fixed-time schedules of electric shock presentation. No difference in either rate or pattern of responding was obtained when these schedules were presented as components of a multiple schedule. When they were presented singly for long periods of time, the fixed-interval schedule consistently maintained a higher response rate than the fixed-time schedule. The pattern of responding under both schedules was similar, typically consisting of a pause at the beginning of each interval followed by either a steady or a positively accelerating rate of responding. The results suggest that the response-shock dependency is of critical importance in the maintenance of high rates of responding under schedules of electric shock presentation, and support the general view that such responding may be conceptualized as operant behavior under control of many of the same variables that control responding under comparable schedules of food or water reinforcement.     

Effects of cycle length on performance on a temporally defined avoidance schedule

Three rats were trained on a temporally defined avoidance schedule logically similar to a fixed-interval, limited-hold positive reinforcement schedule. This avoidance schedule was composed of time periods during which responses had no scheduled consequences alternating with time periods during which a response precluded shock. As with fixed-interval length and response rate on positive reinforcement schedules, an inverse relationship was obtained between the length of the no-consequence interval and response rate during the no-consequence interval. An inverse relationship was also obtained between the length of the no-consequence interval and the per cent of shocks avoided. A rate increase within the no-consequence interval, similar to that typically produced by fixed-interval positive reinforcement procedures, was displayed by one of the rats where the no-consequence interval was at intermediate values and frequency of shock was relatively high. The introduction of a discriminative stimulus correlated with the avoidance interval produced typical discriminated avoidance behavior as well as alterations in temporal patterning of responses during the no-consequence interval in the two rats exposed to this procedure. These alterations in temporal patterning disappeared when the discriminative stimulus was removed. The results were consonant with those reported in the literature involving food reinforcement and fixed-interval, limited-hold schedules.     

Fixed-interval schedules of intravenous cocaine presentation in rats

Fixed-interval schedules of intravenous cocaine presentation were examined as a function of injection dose (0.32 to 0.64 mg/kg) and interval duration (200 to 400 sec) in two rats. Cocaine was found to exert a dose-related temporal control over the initiation of responding that was unaffected by the fixed-interval contingency. Fixed-interval pause duration was linearly related to injection dose and was the same duration as the interresponse time found on continuous reinforcement schedules of cocaine presentation. The fixed-interval pause remained constant with changes in interval duration. Characteristic fixed-interval patterns of responding were observed. However, overall response rates were inversely related to injection dose and directly related to interval duration. Running response rates varied unsystematically with both variables. These findings are at variance with results typically found in studies of fixed-interval food and electric shock presentation.     

Fixed-interval schedules of electric shock presentation: extinction and recovery of performance under different shock intensities and fixed-interval durations

In squirrel monkeys responding under a schedule in which responding postponed the delivery of electric shock, the presentation of response-dependent shock under a fixed-interval (FI) schedule increased the rate of responding. When the schedule of shock-postponement was eliminated, so that the only shocks delivered were those produced by responses under the FI schedule, a pattern of positively accelerated responding developed and was maintained over an extended period. When responses did not produce shocks (extinction), responding decreased. When shocks were again presented under the FI schedule, the previous pattern of responding quickly redeveloped. In general, response rates were directly related to the intensity of the shock presented, and inversely related to the duration of the fixed-interval. These results raise fundamental questions about the traditional classification of stimuli as reinforcers or punishers. The basic similarities among FI schedules of food presentation, shock termination, and shock presentation strengthen the conclusion that the schedule under which an event is presented and the characteristics of the behavior at the time the event is presented, are of overriding importance in determining the effect of that event on behavior.     

Preference for less frequent shock under fixed-interval schedules of electric-shock presentation.

Lever pressing by 2 squirrel monkeys was maintained under fixed-interval 6-min and fixed-interval 2-min schedules of electric-shock presentation. Preference for these schedules was assessed during three experimental phases. In all phases, responses on one lever produced shock according to one or the other fixed-interval schedule, and responses on a second, changeover, lever switched between schedules. The opportunity to change over was presented during separate choice periods (during which the fixed-interval schedules did not operate) that followed the first through fourth shocks in each schedule. If no changeover occurred during those choice periods, a changeover automatically occurred following the fifth shock. In Phase I, durations of the choice periods were fixed. In Phase II, the choice periods equaled a proportion of their respective fixed interval. During Phase III (completed with 1 monkey) a response on the changeover lever during a given choice period reinstated the most recent fixed interval, and a failure to respond resulted in a changeover. During each of these phases, distinct preferences developed for the 6-min schedule. These results suggest that the maintenance of lever pressing by fixed-interval presentation of electric shock may not be an example of positive reinforcement, and that the response-maintaining characteristics of shock presentation may derive from other properties of the schedule.     

Schedule control of the vocal behavior of Cebus monkeys

The vocal behavior of three Cebus monkeys was maintained by fixed-ratio schedules of response dependent reinforcement at values between fixed-ratio 1 and fixed-ratio 15. In one monkey that was exposed to variable-interval, fixed-interval, and conjunctive fixed-ratio fixed-interval schedules of reinforcement, vocal responding occurred at a low rate, but schedule-appropriate patterns were maintained. The rates and patterns of responding engendered indicated that the vocal operant can be brought under schedule control in the monkey by the use of response-dependent reinforcement.     

Elicited responding in chain schedules.

An omission procedure was employed to study elicited pecking in the first component of a two-component chain schedule. Both components were fixed-interval schedules correlated with colored keylights. The first response following the initial-link schedule produced a second fixed-interval schedule. We studied several fixed-interval lengths in two conditions: a standard response-dependent condition and an omission-contingent condition. The omission-contingent condition differed from the response-dependent condition in that responses during the initial fixed interval terminated the trial (omitting the terminal component and grain). If the terminal component was not omitted, a response following the terminal link's requirement produced 4-s access to grain. Pigeons responded during more than 70% of the initial links in the omission-contingent condition and responded during more than 90% of the initial links in the response-dependent condition. In general, rates of responding were consistent with the percentage data. The responding in the omission condition suggests that there may be elicited pecking, in chain schedules using pigeons, that is not the result of contingent conditioned reinforcement.     

Response-dependent and response-independent timeout from an avoidance schedule

While rats were responding in a single-lever apparatus to avoid electric shock, a signal was presented and followed by a 5-min timeout period when all shocks were omitted. For the response-dependent member of each yoked pair, the first response 60 sec after onset of the pre-timeout signal terminated the signal and initiated timeout. The other, yoked animal was exposed to the same sequence except that signal termination and timeout onset were response independent. Under the response-dependent condition, response rates in the presence of the signal increased relative to baseline rates. Rate increases also occurred when timeout was response independent, but were of lesser magnitude and reliability. Subsequent reversal of the yoking arrangement produced stable and equivalent rate increases under both conditions. Other findings were that increased rates in the presence of the signal diminished when timeout was omitted but were maintained for a time on an avoidance-extinction baseline. In general, the results supported the conclusion of previous experiments that timeout from avoidance can serve as a positive reinforcer. The finding that response-independent presentation of timeout produced rate increases, particularly after a history with response-dependent timeout, was interpreted in terms of adventitious reinforcement of previously established behavior.     

Some effects of response-dependent clock stimuli in a fixed-interval schedule

Two experiments studied the effects of brief response-dependent clock stimuli in fixed-interval schedules of reinforcement. In the first experiment, two pigeons were exposed to a fixed-interval schedule. Two conditions were compared. In both conditions each peck on the key produced a brief stimulus. In one condition, pecks produced a different stimulus in successive sixths of the interval. This was the clock condition. In the other condition, the same stimulus was produced throughout the interval. Response rates were lower and the pause after reinforcement was longer in the clock condition. In the second experiment, a two-key optional clock procedure was used. Responding on the clock key produced one of three stimuli correlated with the three successive minutes of a fixed-interval schedule. A response on the other key produced grain at the end of the 3 min. When the final stimulus was removed from the situation and pecking produced nothing during the third minute, responding to the clock key declined to a very low rate. When the first two stimuli were removed and the third one replaced, responding to the clock key was resumed.     

Effects of diazepam on schedule-controlled and schedule-induced behavior under signaled and unsignaled shock.

Schedule-controlled lever pressing and schedule-induced licking were studied in rats under a multiple fixed-interval fixed-interval schedule of food reinforcement upon which was superimposed a multiple variable-time variable-time schedule of electric-shock delivery. Shocks were signaled in one component of the multiple schedule and unsignaled in the other. The effects of diazepam upon the suppression of behavior during the signal (conditioned suppression) and during signaled and unsignaled shock (differential suppression) were studied under several shock intensities (Experiment 1) and at increased body weight (Experiment 2). In each study, diazepam led to dose-dependent increases in the rate of pressing and licking during signaled and unsignaled shock, but had little effect on conditioned suppression. the rate-enhancing effects of diazepam depended upon the intensity of shock, nature of the response, and whether or not shocks were signaled. The data was discussed in terms of (1) implications for understanding the effects of signaled and unsignaled shock on behavior, (2) the effects of diazepam on behavior suppressed by response-independent shock, and (3) comparison between operant and schedule-induced behavior.     

Punishment of autoshaped key-peck responses of pigeons

The effects of different voltages of response-dependent and response-independent electric shock on the frequency of key-peck responses engendered by an autoshaping procedure were studied. In Experiments I and II, each response produced a brief electric shock, and response frequency generally decreased more with higher-voltage shock. Preshock frequencies of responding were generally recovered across successive sessions of relatively low-voltage shock delivery but not at higher shock voltages. The effects of response-dependent and response-independent shock were compared in Experiment III by using a yoked-control procedure in which each pigeon received each type of shock delivery at different times. Response-dependent shock generally produced greater decreases in response frequency. In the final experiment, one response-independent shock per autoshaping trial was scheduled. The number of autoshaped responses per trial was related to shock voltages. These results suggest that response-dependent and response-independent electric shock effectively decrease frequency of autoshaped responses.     

Effects of signaled and unsignaled shock on schedule-controlled lever pressing and schedule-induced licking: Shock intensity and body weight

Schedule-controlled lever pressing and schedule-induced licking were studied in rats under a multiple fixed-interval fixed-interval schedule of food reinforcement. Following acquisition of stable rates of pressing and licking, a multiple variable-time variable-time schedule of electric-shock delivery was superimposed upon the baseline schedule. In only one component of the multiple schedule, a 5-sec stimulus preceded each shock (signaled shock). In the other component shock was unsignaled. Several shock intensities (Experiment 1) and body weights (Experiment 2) were studied. Lever pressing and licking were affected similarly by experimental manipulations, although with parametric differences. Depending upon shock intensity and body weight, rates of lever pressing and licking were hardly suppressed, suppressed primarily in the unsignaled shock component (differential suppression), or markedly suppressed in both components. Differential suppression during components with signaled and unsignaled shock and conditioned suppression of responding during the preshock stimulus appeared not to be functionally related. Differential suppression depended more on the discriminability of shock-free time, and on shock intensity, body weight, and the type of response than on the “preparatory” behavior preceding shock.     

Remote effects of aversive contingencies: Disruption of appetitive behavior by adjacent avoidance sessions

Disruption of ongoing appetitive behavior before and after daily avoidance sessions was examined. After baselines of appetitive responding were established under a fixed-interval 180-s schedule of food presentation, 4 rats were exposed to 40-min sessions of the appetitive schedule just prior to 100-min sessions of electric shock postponement, while another 4 rats received the 40-min appetitive sessions just following daily sessions of shock postponement. In all 8 subjects, fixed-interval response rates decreased relative to baseline levels, the effect being somewhat more pronounced when the avoidance sessions immediately followed. The disruption of fixed-interval responding was only partially reversed when avoidance sessions were discontinued. During the initial exposure to the avoidance sessions, patterns of responding under the fixed-interval schedule were differentially sensitive to disruption, with high baseline response rates generally more disturbed than low rates. These disruptions were not systematically related to changes in reinforcement frequency, which remained fairly high and invariant across all conditions of the experiment; they were also not systematically related to the response rates or to the shock rates of the adjacent avoidance sessions. The results, while qualitatively resembling patterns of conditioned suppression as typically studied, occurred on a greatly expanded time scale. As disruption of behavior extending over time, the present data suggest that some forms of conditioned suppression are perhaps best viewed within a larger temporal context.     

The effects of reinforcement frequency and response requirements on the maintenance of behavior.

Six rats responded under fixed-interval and tandem fixed-interval fixed-ratio schedules of food reinforcement. Basic fixed-interval schedules alternated over experimental conditions with tandem fixed-interval fixed-ratio schedules with the same fixed-interval value. Fixed-interval length was varied within subjects over pairs of experimental conditions; the ratio requirement of the tandem schedules was varied across subjects. For both subjects with a ratio requirement of 10, overall response rates and running response rates typically were higher under the tandem schedules than under the corresponding basic fixed-interval schedules. For all subjects with ratio requirements of 30 or 60, overall response rates and running response rates were higher under the tandem schedules than under the corresponding basic fixed-interval schedules only with relatively short fixed intervals. At longer fixed intervals, higher overall response rates and running rates were maintained by the basic fixed-interval schedules than by the tandem schedules. These findings support Zeiler and Buchman's (1979) reinforcement-theory account of response strength as an increasing monotonic function of both the response requirement and reinforcement frequency. Small response requirements added in tandem to fixed-interval schedules have little effect on reinforcement frequency and so their net effect is to enhance responding. Larger response requirements reduce reinforcement frequency more substantially; therefore their net effect depends on the length of the fixed interval, which limits overall reinforcement frequency. At the longest fixed intervals studied in the present experiment, reinforcement frequency under the tandem schedules was sufficiently low that responding weakened or ceased altogether.     

Drugs and punished responding II: d-amphetamine-induced increases in punished responding

The effects of d-amphetamine on punished responding were studied in two experiments. In Experiment I, pigeons responded under a multiple fixed-ratio 30 response fixed-interval 5-min schedule of food presentation with 60-sec limited holds in both components. Each response was punished with electric shock, the intensity of which was varied systematically. In Experiment II, another group of pigeons responded under a multiple fixed-interval 5-min fixed-interval 5-min schedule of food presentation with 40-sec limited holds. Each response was punished with shock during one component, and every thirtieth response was punished in the other component. d-Amphetamine increased overall rates of punished responding only rarely under any of the punishment conditions; however, response rates within the fixed-interval when rates were low were increased by d-amphetamine when the shock intensity was low (Experiment I), or when responses produced shock intermittently (Experiment II). The data suggest that the effects of d-amphetamine on punished responding depend on the control rate of responding, the punishment intensity, the punishment frequency, and the schedule of food presentation.     

Responding under discrete-trial fixed-interval schedules of reinforcement

A fixed-interval schedule of reinforcement was modified by dividing each interval into 4-sec trial periods. No more than one response could occur during each trial because the operandum was inactivated for the remainder of any trial in which a response occurred. For example, under a 28-sec schedule, no more than seven responses could be emitted between reinforcements. Probabilities of responding by pigeons under six values of this discrete-trial fixed-interval schedule were best described by a two-state model: responding was either absent or infrequent immediately after reinforcement; then, at some variable time after reinforcement, there was an abrupt transition to a high and constant probability of responding on each trial. Performances under the discrete-trial procedure were less affected by uncontrolled sources of variance than performances under equivalent free-operant fixed-interval schedules.     

Reinforcement probability and ordinal position of response in fixed-interval schedules

Four rats pressed levers and received food pellets under fixed-interval reinforcement schedules of 20, 60, and 180 seconds. The number of responses in each interval was recorded. From these data, the probability of reinforcement was determined as a function of response count. These functions were generally increasing. This finding is consistent with previous suggestions that increasing response rates within fixed intervals may be a function of response count in addition to or instead of elapsed or remaining time.     

Resistance to the response-decrementing effects of response-independent reinforcement produced by delay and non-delay schedules of reinforcement

In two experiments, animals were initially exposed to response-dependent schedules of food before exposure to response-independent reinforcement matched for overall rate and temporal distribution of reinforcers to the preceding condition. In Experiment I, response decrements during the response-independent phase were smaller after delayed reinforcement training than after a comparable immediate reinforcement schedule, for both doves and rats. In Experiment II variable-interval and variable-ratio schedules, both with either immediate or delayed reinforcement, were used with rats. Both the delayed reinforcement schedules produced resistance to subsequent response-independent reinforcement, but response decrements were larger after either of the immediate reinforcement conditions. It was concluded that the critical factor in response maintenance under response-independent reinforcement was the type of response-reinforcer contiguities permitted under the response-dependent schedule rather than perception of response-reinforcer “contingencies”. If the response-dependent schedule was arranged so that behaviours other than a designated operant (key pecking or lever pressing) could be contiguous with food, responding was maintained well under response-independent schedules.