Bombesin improves rats' operant responding maintained by a differential-reinforcement-of-low-rates schedule of food reinforcement

The present study examined rats' responding on a differential-reinforcement-of-low-rates schedule of food reinforcement following intraperitoneal injections of various doses of bombesin (4, 6, 8, 16, 32 micrograms/kg). Analyses indicated that only the 6 micrograms/kg dosage improved DRL responding. The findings are consistent with prior research examining bombesin's effect on operant behavior and support the notion that bombesin induces satiety rather than malaise.     

Motivational influences on performance maintained by food reinforcement

In Study 1, we examined the independent effects of reinforcer consumption during sessions and meal consumption prior to sessions on performance maintained by food reinforcement. Nine individuals with developmental disabilities participated. On alternate days, a preferred edible item was delivered during (a) seven sessions conducted before lunch (repeated-reinforcement condition) versus (b) one session each conducted before and after lunch (pre- and postmeal conditions). Results for 7 of 9 participants showed decreased response rates across sessions in the repeated-reinforcement condition; results for 3 of 9 participants showed decreased rates during postmeal relative to premeal conditions. Two participants who did not show a decrement in responding during either comparison participated in Study 2, in which reinforcer consumption during sessions, combined with meal consumption prior to sessions, also had no effect on their performance. In Study 3, we determined whether (a) choice of reinforcers, (b) increased break time between sessions, (c) varied reinforcers, or (d) intermittent reinforcement schedules mitigated the satiation effects observed for the 7 participants in Study 1. Presession choice of reinforcers resulted in maintained performance for 2 of 6 participants exposed to this condition. Varied reinforcement resulted in maintained performance for only 1 of 5 participants exposed to this condition. Neither the increased break between sessions nor the intermittent reinforcement schedule was effective in maintaining performance for the participants who were exposed to these conditions.     

Independence of concurrent responding maintained by interval schedules of reinforcement

A pigeon's responses were reinforced on a variable-interval schedule on one key; and, concurrently, either a multiple or a fixed-interval schedule of reinforcement was in effect on a second key. These concurrent schedules, conc VI 3 (mult VI 3 EXT) or conc VI 3 FI 6, were programmed with or without a changeover delay (COD). Because the COD provided that responses on one key could not be followed by reinforced responses on the other key, responding on one key was not likely to accidentally come under the control of the reinforcement schedule on the other. When the COD was used, the performances on each key were comparable to the performances maintained when these interval schedules are programmed separately. The VI schedule maintained a relatively constant rate of responding, even though the rate of responding on the second key varied in a manner appropriate to the schedule on the second key. The mult VI 3 EXT schedule maintained two separate rates of responding: a relatively high rate during the VI 3 component, and almost no responding during the EXT component. The FI schedule maintained the gradually increasing rate of responding within each interval that is characteristic of the performance maintained by this schedule. The concurrent performances, however, did include certain interactions involving the local characteristics of responding and the over-all rates of responding maintained by the various schedules. The relevance of the present findings to an inter-response time analysis of VI responding, a chaining account of FI responding, and the concept of the reflex reserve was discussed.     

A quantitative analysis of the responding maintained by interval schedules of reinforcement

Interval schedules of reinforcement maintained pigeons' key-pecking in six experiments. Each schedule was specified in terms of mean interval, which determined the maximum rate of reinforcement possible, and distribution of intervals, which ranged from many-valued (variable-interval) to single-valued (fixed-interval). In Exp. 1, the relative durations of a sequence of intervals from an arithmetic progression were held constant while the mean interval was varied. Rate of responding was a monotonically increasing, negatively accelerated function of rate of reinforcement over a range from 8.4 to 300 reinforcements per hour. The rate of responding also increased as time passed within the individual intervals of a given schedule. In Exp. 2 and 3, several variable-interval schedules made up of different sequences of intervals were examined. In each schedule, the rate of responding at a particular time within an interval was shown to depend at least in part on the local rate of reinforcement at that time, derived from a measure of the probability of reinforcement at that time and the proximity of potential reinforcements at other times. The functional relationship between rate of responding and rate of reinforcement at different times within the intervals of a single schedule was similar to that obtained across different schedules in Exp. 1. Experiments 4, 5, and 6 examined fixed-interval and two-valued (mixed fixed-interval fixed-interval) schedules, and demonstrated that reinforcement at one time in an interval had substantial effects on responding maintained at other times. It was concluded that the rate of responding maintained by a given interval schedule depends not on the overall rate of reinforcement provided but rather on the summation of different local effects of reinforcement at different times within intervals.     

Schedule-induced defecation by rats during ratio and interval schedules of food reinforcement.

Lever pressing in rats was maintained by continuous and intermittent schedules of food while defecation was monitored. In Experiment 1, reinforcement densities were matched across variable-ratio and variable-interval schedules for three pairs of rats. Defecation occurred in all 3 rats on the variable-ratio schedule and in all 3 rats on the yoked variable-interval schedule. In Experiment 2, fixed-ratio and fixed-interval schedules with similar reinforcement densities maintained lever pressing. Defecation occurred in 3 of 4 rats on the fixed-ratio schedule and in 4 of 4 rats on the fixed-interval schedule. Almost no defecation occurred during continuous reinforcement in either experiment. These results demonstrate that defecation may occur during both ratio and interval schedules and that the inter-reinforcement interval is more important than the behavioral requirements of the schedule in generating schedule-induced defecation.     

The effects of schedule history and the opportunity for adjunctive responding on behavior during a fixed-interval schedule of reinforcement.

The effects of schedule history and the availability of an adjunctive response (polydipsia) on fixed-interval schedule performance were investigated. Two rats first pressed levers under a schedule of food reinforcement with an interresponse time greater than 11 s, and 2 others responded under a fixed-ratio 40 schedule. All 4 were then exposed to a fixed-interval 15-s schedule. Water was continuously available under these conditions, but after responding became stable on the fixed-interval schedule, access was experimentally manipulated. With water freely available, subjects did not display characteristic fixed-interval response rates and patterns (i.e., scalloping or break-and-run). Instead, they exhibited predictable, stable patterns of behavior as a function of their schedule histories: Subjects with the interresponse-time history exhibited low response rates, and those with the fixed-ratio history exhibited high rates. Manipulating the amount of water available resulted in marked changes in response rates for rats with the interresponse-time history but not for those with the fixed-ratio history. The results illustrate the multiple causation of behavior by its previous and current schedules of reinforcement and other concurrent factors.     

Effects of reinforcement magnitude and ratio values on behaviour maintained by a cyclic ratio schedule of reinforcement

In Experiments 1 and 2, lever pressing by rats was reinforced on a cyclic ratio schedule of food reinforcement, comprising a repeated sequence of fixed-ratio component schedules. Reinforcement magnitude was varied, on occasional sessions in Experiment 1 and across blocks of sessions in Experiment 2, from one to two or three 45-mg food pellets. In the one-pellet condition, post-reinforcement pauses increased with component schedule value. At higher magnitudes, post-reinforcement pauses increased, and overall response rates declined. Response rate on component schedules was a decreasing linear function of the obtained rate of reinforcement in all conditions. Plotted against component schedule value, response rate increased exponentially to an asymptote that decreased when reinforcement magnitude increased. These findings are consistent with regulatory accounts of food reinforced behaviour. In Experiment 3, rats were trained under a cyclic ratio schedule comprising fixed-ratio components including higher values, and some inverted U-shaped response functions were obtained. Those rats that did not showthis relationship were trained on cyclic ratios with even higher values, and all showed inverted U-shaped response functions. This suggests that behaviour on cyclic ratio schedules can reflect activating of reinforcement as well as the satiating effects seen in Experiments 1 and 2.     

Probability of response and probability of reinforcement in a response-defined analogue of an interval schedule

Variable interval (VI) responding was hypothesized to be a function of differential reinforcement susceptibilities of various unspecified behavior chains that mediate interresponse times (IRTs). To test this hypothesis, probabilities of reinforcement were regulated for the lengths of chains of key pecking responses of pigeons, analogous to the way that VI regulates probabilities of reinforcement for IRTs. This procedure generated a number of VI-like effects, supporting the notion that VI behavior can be construed as a special case of an interaction between the organism's function relating reinforcement susceptibilities to chain length and the experimenter's function relating probabilities of reinforcement to chain length.     

Aversive aspects of a fixed-interval schedule of food reinforcement

The key pecking of pigeons was reinforced according to a fixed-interval schedule of reinforcement. The pigeons were also given the opportunity to attack a restrained target pigeon. The attack rates during the sessions of fixed-interval reinforcement were higher than during the operant level sessions in four of the five pigeons. Most attack occurred during the post-reinforcement pause in key pecking. It was suggested that a fixed-interval schedule of positive reinforcement possesses aversive properties, the most aversive of which are located during the post-reinforcement pause.     

An evaluation of antecedent exercise on behavior maintained by automatic reinforcement using a three-component multiple schedule

We evaluated antecedent exercise for treating the automatically reinforced problem behavior of 4 individuals with autism. We conducted preference assessments to identify leisure and exercise items that were associated with high levels of engagement and low levels of problem behavior. Next, we conducted three 3-component multiple-schedule sequences: an antecedent-exercise test sequence, a noncontingent leisure-item control sequence, and a social-interaction control sequence. Within each sequence, we used a 3-component multiple schedule to evaluate preintervention, intervention, and postintervention effects. Problem behavior decreased during the postintervention component relative to the preintervention component for 3 of the 4 participants during the exercise-item assessment; however, the effects could not be attributed solely to exercise for 1 of these participants.     

Fixed-interval behavior maintained by conditioned reinforcement

The key-pecking of a pigeon was reinforced with grain on an 18-min second-order schedule. During the 18 min, a key peck which completed a 3-min fixed interval produced a stimulus of 0.5-sec duration. The first 3-min fixed interval completed after 18 min resulted in primary reinforcement. Behavior characteristic of fixed-interval schedules was produced on both the 3-min components and the 18-min schedule. This performance was shown to be enhanced whenever the 0.5-sec stimulus was also presented before the presentation of grain.     

Time-dependent contrast effects in a multiple schedule of food reinforcement

Four rats were rewarded for running in a wheel under two alternating conditions of food reinforcement. These periods of frequent and infrequent reinforcement, each accompanied by a particular stimulus, were presented a number of times in each daily session. Following shifts from high to low frequency of reinforcement, responding decreased suddenly and markedly, and then recovered within the next few minutes. The magnitude of this temporary depression was an increasing function of the duration of the immediately preceding component of high-frequency reinforcement. A transient elevation in performance, which did not vary with the duration of the prior component, was noted in two subjects following shifts from low to high frequency of reinforcement. The elevation and depression effects did not appear simultaneously during the 48 experimental sessions. A possible relation between the difficulty of the discrimination and the extent of contrast effects is discussed.     

The integration of habits maintained by food and water reinforcement through stimulus compounding.

In Experiment 1, a light and a tone were correlated independently with water reinforcement of bar pressing by rats. With different naive subjects in Experiment 2, one of these stimuli was correlated with food and the other with water reinforcement (counterbalanced). In both experiments the absence of tone and light signaled extinction. Tests of stimulus-reinforcer independence in Experiment 2 indicated that tone and light controlled behavior whose rate was specifically affected by deprivation state. In the stimulus-compounding tests of both experiments, response rates were higher to tone-plus-light than to tone or light presented alone (additive summation). This is the first report of additive summation produced through compounding stimuli paired with different reinforcers. The results are discussed in the context of the effects of incentive motivation on operant performance.     

Effects of reinforcement amount on attack induced under a fixed-interval schedule in pigeons

Key pecking by pigeons was maintained on a chained fixed-interval 4-min (12-min for 1 subject) fixed-ratio 1 schedule of food presentation. Attacks toward a restrained and protected conspecific were recorded. In the first experiment, the amount of food presented per interval was manipulated across phases by varying the number of fixed ratios required in the terminal link of the chain. Measures of attack for all pigeons during the fixed-interval component increased monotonically as a function of food amount. In the second experiment, two different food amounts alternated within each experimental session under a multiple schedule. For both pigeons in this experiment, measures of attack were higher during the component that delivered the larger food amount per interval. The differences in levels of attack induced by the two food amounts in Experiment 2, however, were not as great as in Experiment 1; apparently this was because attack during the first interval of each component was controlled in part (P-5626) or entirely (P-7848) by the reinforcement amount delivered at the end of the previous component. Attack was also a function of the location of the interfood interval within the session. For both pigeons, attack tended to decrease throughout the session. The results of both experiments suggest that attack is an increasing function of reinforcement amount under fixed-interval schedules, but that this function may be influenced by the manner in which reinforcement amount is manipulated, by the duration of the interfood interval, and by the location of the interfood interval within the experimental session. In general, these results are compatible with theories of induced attack and other schedule-induced behavior that emphasize aversive after-effects of reinforcement presentation.     

Responding during reinforcement delay in a self-control paradigm.

Eight pigeons chose between a small, immediate reinforcer and a large, increasingly delayed reinforcer. Responding during the large-reinforcer delays was examined. During large-reinforcer delays, pecks on one key produced the small, immediate reinforcer; pecks on the other key had no effect. Thus, a pigeon could reverse its initial choice of the large, delayed reinforcer, or it could maintain its original choice. Pigeons that made a relatively high number of initial large-reinforcer choices tended to maintain these choices, and those pigeons that actually received a relatively high number of large reinforcers, tended to respond more frequently on the ineffective key during the delay periods. The findings suggest that some previous studies of self-control training in pigeons may have resulted in increased self-control partially due to a lack of opportunity for the pigeons to change their choices.     

Stimulus control of responding during a fixed-interval reinforcement schedule

During training sessions, pecks by pigeons on a response key illuminated by a vertical line of white light resulted in reinforcement and an ensuing blackout according to a fixed-interval schedule. Training sessions were followed by dimensional stimulus control test sessions during which the orientation of the line present throughout the fixed interval was varied. Inverted U-shaped (excitatory) gradients of responding, with maximum responding occurring in the presence of the vertical line, were observed during the terminal part of the fixed interval. U-shaped (inhibitory) gradients of responding, with minimum responding occurring in the presence of the vertical line, were observed during the early part of the fixed interval when the preceding interval had terminated with reinforcement and blackout but not when the preceding interval had terminated with blackout only. These results suggest that the dimensional control by the stimulus present throughout the fixed interval is of a conditional variety. Whether the fixed-interval stimulus exerts inhibitory or excitatory dimensional control depends upon the presence and absence, respectively, of stimuli associated with reinforcement.     

A fixed interval schedule in which the interval is initiated by a response

The fixed interval schedule described requires the animal to initiate every time interval by making a response on a bar other than the one on which it is reinforced. This response, R_A, demarcates the postreinforcement pause (S^R-R_A interval) from the fixed interval pause (R_A-R_B interval) so that these pauses may be measured separately. Twelve rats and three monkeys, working in two-bar Skinner boxes, were trained and stabilized on this schedule. The resulting performances, presented for individual animals, are analyzed in terms of (1) the relative frequencies with which the animal waits various lengths of time between consecutive responses, (2) the relative frequencies with which various rates of responding appear, (3) the change in response rate throughout the fixed interval, (4) the average length of the postreinforcement pause, (5) the relative frequencies with which the animal waits different lengths of time between the R_A and the first R_B, and (6) the average inter-response time as a function of the rank order in the fixed interval of the inter-response time. The joint interpretation of the several measures taken leads to the following conclusions: 1. The probability of an R_B increases throughout the fixed interval. 2. The increase is discontinuous at the first R_B, at which point the probability increases sharply. 3. The frequency distributions of R_A-R_B pauses exhibit three discrete types of behavior with no intermediate cases. 4. The (main) mode of R_A-R_B interval length usually occurs just below the fixed interval requirement.