SCHEDULE-INDUCED DRINKING: ELICITATION,ANTICIPATION, OR BEHAVIORAL INTERACTION?

We carried out five experiments with rats on fixed-time schedules in order to define the relation between drinking and individual food-pellet presentations. In Experiment 1, unsignaled extra food occurred at the end of occasional fixed intervals, and we compared subsequent drinking patterns with drinking before the extra food presentation. In Experiment 2 we presented signaled and unsignaled extra food and measured elicited and anticipatory drinking patterns. In Experiment 3, we observed the persistence of modified drinking patterns when several consecutive intervals ended with extra pellets. In Experiments 4 and 5, we varied the magnitude of food delivery across (rather than within) sessions to replicate published findings. Results show that schedule-induced drinking is neither elicited by food presentations nor induced by stimuli associated with a high food rate. All subjects seemed to follow a simple rule: during any stimulus signaling an increase in the local probability of food delivery within a session, engage in food-related behavior to the exclusion of drinking. Schedule-induced drinking appears to be the result of dynamic interactions among food-related behavior, drinking, and other motivated behavior, rather than a direct effect of the contingencies of food reinforcement.     

Within-session meal-size effects on induced drinking.

As a control for the effects of session duration and hunger on the relation between food magnitude and induced drinking, four food-deprived rats were exposed to a variable-time 50-s schedule of food delivery in which the size of each food delivery varied randomly within sessions. Food-related behavior and schedule-induced drinking per opportunity were examined as functions of meal size and postfood time. All rats showed an inverted-U-shaped relation between drinking per opportunity and meal size. This relation was caused by variation in the percentage of intervals that contained drinking and by variation in the number of drinking bouts per interval, rather than by bout duration or by the amount of drinking within those intervals that actually contained drinking. Head-in-feeder time increased linearly with meal size. Schedule-induced drinking was entrained by food delivery in 3 of 4 subjects; the entrainment was due to regulation of the starting time of each drinking bout rather than to regulation of bout duration.     

Sign-tracking with an interfood clock

Food was presented to pigeons, irrespective of their behavior. The fixed 60-s interfood interval was segmented into ten 6-s periods, each signaled by a distinctive stimulus color, ordered by wavelength. This “interfood clock” reliably generated and maintained successively higher rates of key pecking at stimuli successively closer to food. Under extinction, key pecking ceased. When the standard stimulus sequence was changed to a different sequence for each bird, accelerated responding again emerged and was sustained under each of the new color sequences. However, responding was neither maintained nor acquired when each successive interfood interval provided a different random sequence of the ten stimuli. Thus, the interfood clock generated and maintained sign-tracking under stimulus control, and the resulting behavior was attributable neither to stimulus generalization nor to a simple temporal gradient.     

Behavioral adaptation to fixed-interval and fixed-time food delivery in golden hamsters

Food-deprived golden hamsters in a large enclosure received food every 30 sec contingent on lever pressing, or free while their behavior was continuously recorded in terms of an exhaustive classification of motor patterns. As with other species in other situations, behavior became organized into two main classes. One (terminal behaviors) increased in probability throughout interfood intervals; the other (interim behaviors) peaked earlier in interfood intervals. Which class an activity belonged to was independent of whether food was contingent on lever pressing. When food was omitted on some of the intervals (thwarting), the terminal activities began sooner in the next interval, and different interim activities changed in different ways. The interim activities did not appear to be schedule-induced in the usual sense. Rather, the hamsters left the area of the feeder when food was not due and engaged in activities they would normally perform in the experimental environment.     

Food-deprivation effects on punished schedule-induced drinking in rats.

Food-deprived rats (at 80% of their free-feeding weights) were exposed to a fixed-time 60-s schedule of food-pellet presentation and developed schedule-induced drinking. Lick-dependent signaled delays (10 s) to food presentation led to decreased drinking, which recovered when the signaled delays were discontinued. A major effect of this punishment contingency was to increase the proportion of interpellet intervals without any licks. The drinking of yoked control rats, which received food at the same times as those exposed to the signaled delay contingency (masters), was not consistently reduced. When food-deprivation level was changed to 90%, all master and yoked control rats showed decreases in punished or unpunished schedule-induced drinking. When the body weights were reduced to 70%, most master rats increased punished behavior to levels similar to those of unpunished drinking. This effect was not observed for yoked controls. Therefore, body-weight loss increased the resistance of schedule-induced drinking to reductions by punishment. Food-deprivation effects on punished schedule-induced drinking are similar to their effects on food-maintained lever pressing. This dependency of punishment on food-deprivation level supports the view that schedule-induced drinking can be modified by the same variables that affect operant behavior in general.     

Polydipsia induced by intermittent delivery of salted liquid foods

Food-deprived rats given constant access to water were exposed to fixed-time presentations of soybean milk and diluted sweetened condensed cows' milk. In some conditions these liquid foods were adulterated with varying amounts of sodium chloride. Under a fixed-time 30-sec schedule of food delivery, little water was consumed when the food was soybean milk alone, or soybean milk with sodium chloride added in concentrations of .9, 1.8, or 3.6%. However, schedule-induced polydipsia appeared when soybean milk adulterated with 7.2 or 14.4% sodium chloride was delivered under this schedule. When soybean milk containing 7.2% sodium chloride was presented under fixed-time 15-, 30-, 60-, 120-, and 240-sec schedules, schedule-induced drinking increased with the fixed-time value from 15 to 120 seconds, and decreased at 240 seconds. Like soybean milk, diluted sweetened condensed milk delivered under fixed-time schedules of 30, 60, and 120 seconds failed to evoke schedule-induced polydipsia, but did so when adulterated with 7.2% sodium chloride. Drinking induced by salted liquid foods resembled the polydipsia engendered by spaced dry-food presentations in several ways, including temporal relation to food delivery, persistence within and across sections, sensitivity to interfood interval, and magnitude relative to intake evoked by bulk-food presentation.     

The role of the peck-food contingency on fixed-interval schedules

Pigeons were trained to peck on a fixed-interval schedule of food reinforcement and then exposed to three schedules in which there was either no, or an indirect, relation between pecking and food delivery: (a) a conjunctive schedule in which food was delivered at fixed intervals, providing at least one peck was emitted in the interval; (b) a recycling version of the conjunctive schedule that essentially eliminated occasional peck-food contiguities (recycling conjunctive); (c) delivery of food at fixed intervals independently of the birds' behavior (fixed time). The rates and patterns of pecking sustained by these procedures depended on interfood interval and relative proximity of pecks to food.     

Abdominal vagotomy disrupts food-related drinking in the rat

Rats with complete subdiaphragmatic bilateral transection of the abdominal vagus (Vgx-C) showed disordered food-related drinking when drinking water in temporal association with a meal of dry food after 5-hr food deprivation and when drinking water in association with a liquid meal after 24-hr food deprivation. The Vgx-C rats drank after significantly longer latencies and drank significantly less water in 1 hr than did sham-vagotomized (Sham) rats after eating the same size meal (solid or liquid) as Shams. Rats with incomplete vagal transection (Vgx-I) ate and drank like Shams. Water intake of Sham and Vgx-I rats correlated positively with the meal size of solid food, but the water intake of Vgx-C rats did not. The failure of Vgx-C rats to drink water normally when food was ingested was not due to failure of a food stimulus to reach the intestine, because Vgx-C and Sham rats emptied equivalent volumes of liquid food from the stomach into the intestine within 10 min of food entering the stomach. These results indicate that the abdominal vagus is an important neurological substrate for food-related drinking in the rat.     

Serial conditioning as a function of stimulus, response, and temporal dependencies

Six experiments were used to examine the effects of explicit response, stimulus, and temporal dependencies on responding in an interfood interval. The first two experiments demonstrated that 10-segment 60-s interfood clocks controlled similar distributions of key pecking in pigeons regardless of whether response–reinforcement contiguity was required, allowed, or precluded. The third and fourth experiments found that in the absence of an explicit response–reinforcement dependency, systematic explicit stimuli in an interfood interval were sufficient to establish and maintain the characteristic distribution of key pecking and that an interval without an explicit clock failed to establish or maintain key pecking. The last two experiments demonstrated that the interfood interval need not be of fixed length, and that a simple correlation of stimuli with increments from either a minimum to a maximum imminency or probability of food presentation controlled behavior in a similar manner. Successively higher rates generally occurred to successively later stimuli in the upper half of the range.     

Effects of reinforcement amount on attack induced under a fixed-interval schedule in pigeons

Key pecking by pigeons was maintained on a chained fixed-interval 4-min (12-min for 1 subject) fixed-ratio 1 schedule of food presentation. Attacks toward a restrained and protected conspecific were recorded. In the first experiment, the amount of food presented per interval was manipulated across phases by varying the number of fixed ratios required in the terminal link of the chain. Measures of attack for all pigeons during the fixed-interval component increased monotonically as a function of food amount. In the second experiment, two different food amounts alternated within each experimental session under a multiple schedule. For both pigeons in this experiment, measures of attack were higher during the component that delivered the larger food amount per interval. The differences in levels of attack induced by the two food amounts in Experiment 2, however, were not as great as in Experiment 1; apparently this was because attack during the first interval of each component was controlled in part (P-5626) or entirely (P-7848) by the reinforcement amount delivered at the end of the previous component. Attack was also a function of the location of the interfood interval within the session. For both pigeons, attack tended to decrease throughout the session. The results of both experiments suggest that attack is an increasing function of reinforcement amount under fixed-interval schedules, but that this function may be influenced by the manner in which reinforcement amount is manipulated, by the duration of the interfood interval, and by the location of the interfood interval within the experimental session. In general, these results are compatible with theories of induced attack and other schedule-induced behavior that emphasize aversive after-effects of reinforcement presentation.     

Choice of timeout during response-independent food schedules

Rats' lever pressing terminated visual or auditory stimuli associated with fixed-time or variable-time schedules of food delivery and produced a timeout period during which food delivery could not occur. Lever pressing during a timeout period reinstated the food-associated stimuli and again permitted food delivery according to the fixed-time or variable-time schedules. The mean interfood interval ranged from 1 minute to 16 minutes (variable-time schedules) or 32 minutes (fixed-time schedules); the timer controlling schedule intervals did not stop during timeout periods. The percentage of session time spent in timeout increased when the mean interfood intervals were lengthened and decreased when the mean interfood intervals were shortened. Timeouts were initiated most frequently about half way between successive food deliveries (fixed-time schedules) or after 15 seconds or more had lapsed since the last food delivery (variable-time schedules). Elimination of food delivery increased the percentage of session time spent in timeout, and elimination of the timeout contingency decreased lever press rates. When timeout was produced only when the lever was held in the depressed position, little time was spent in timeout. The main determinants of timeout initiation and termination appeared to be the rate of food delivery, freedom of movement during timeout, and the stimulus change associated with initiation and termination of timeout.     

Schedule-induced locomotor activity in humans.

In two experiments, humans received tokens either on a fixed-interval schedule for plunger pulling or various response-nondependent fixed-time schedules ranging from 16 to 140 seconds. Locomotor activity such as walking, shifting weight, or pacing was recorded in quarters of the interreinforcement interval to examine the induced characteristics of that behavior in humans. While performance was variable, several characteristics were present that have counterparts in experiments with nonhumans during periodic schedules of food reinforcement: (a) first quarter rates, and sometimes overall rates, of locomotor activity were greater during intervals that terminated in a visual stimulus and token delivery than those without: (b) overall rates of locomotor activity were greater during fixed-time 16-second schedules than during fixed-time 80- or 140-second schedules; (c) rates of locomotor activity decreased during the interreinforcement intervals; (d) locomotor activity was induced by response-dependent and response-nondependent token delivery. These results showed that the rate and temporal pattern of locomotor activity can be schedule-induced in humans.     

Stock optimizing: maximizing reinforcers per session on a variable-interval schedule.

In Experiment 1, 2 monkeys earned their daily food ration by pressing a key that delivered food according to a variable-interval 3-min schedule. In Phases 1 and 4, sessions ended after 3 hr. In Phases 2 and 3, sessions ended after a fixed number of responses that reduced food intake and body weights from levels during Phases 1 and 4. Monkeys responded at higher rates and emitted more responses per food delivery when the food earned in a session was reduced. In Experiment 2, monkeys earned their daily food ration by depositing tokens into the response panel. Deposits delivered food according to a variable-interval 3-min schedule. When the token supply was unlimited (Phases 1, 3, and 5), sessions ended after 3 hr. In Phases 2 and 4, sessions ended after 150 tokens were deposited, resulting in a decrease in food intake and body weight. Both monkeys responded at lower rates and emitted fewer responses per food delivery when the food earned in a session was reduced. Experiment 1's results are consistent with a strength account, according to which the phases that reduced body weights increased food's value and therefore increased subjects' response rates. The results of Experiment 2 are consistent with an optimizing strategy, because lowering response rates when food is restricted defends body weight on variable-interval schedules. These contrasting results may be attributed to the discriminability of the contingency between response number and the end of a session being greater in Experiment 2 than in Experiment 1. In consequence, subjects lowered their response rates in order to increase the number of reinforcers per session (stock optimizing).     

Effects of signaled and unsignaled shock on schedule-controlled lever pressing and schedule-induced licking: Shock intensity and body weight

Schedule-controlled lever pressing and schedule-induced licking were studied in rats under a multiple fixed-interval fixed-interval schedule of food reinforcement. Following acquisition of stable rates of pressing and licking, a multiple variable-time variable-time schedule of electric-shock delivery was superimposed upon the baseline schedule. In only one component of the multiple schedule, a 5-sec stimulus preceded each shock (signaled shock). In the other component shock was unsignaled. Several shock intensities (Experiment 1) and body weights (Experiment 2) were studied. Lever pressing and licking were affected similarly by experimental manipulations, although with parametric differences. Depending upon shock intensity and body weight, rates of lever pressing and licking were hardly suppressed, suppressed primarily in the unsignaled shock component (differential suppression), or markedly suppressed in both components. Differential suppression during components with signaled and unsignaled shock and conditioned suppression of responding during the preshock stimulus appeared not to be functionally related. Differential suppression depended more on the discriminability of shock-free time, and on shock intensity, body weight, and the type of response than on the “preparatory” behavior preceding shock.     

TEMPORAL CONTROL ON INTERVAL SCHEDULES: WHAT DETERMINES THE POSTREINFORCEMENT PAUSE?

On fixed-interval or response-initiated delay schedules of reinforcement, the average pause following food presentation is proportional to the interfood interval. Moreover, when a number of intervals of different durations occur in a programmed cyclic series, postreinforcement pauses track the changes in interval value. What controls the duration of postreinforcement pauses under these conditions? Staddon, Wynne, and Higa (1991), in their linear waiting model, propose control by the preceding interfood interval. Another possibility is that delay to reinforcement, signaled by a key peck and/or stimulus change, determines the subsequent pause. The experiments reported here examined the role of these two possible time markers by studying the performance of pigeons under a chained cyclic fixed-interval procedure. The data support the linear waiting model, but suggest that more than the immediately preceding interfood interval plays a role in temporal control.     

The reinforcement value of schedule-induced drinking

The effect of food reinforcement schedules on the reinforcement value of drinking water was evaluated. Food-deprived rats were exposed to concurrent, identical variable-time schedules of food presentation, the food thus being delivered independently of the rats' behavior. When the relative amount of time spent in a schedule component stabilized, an opportunity to drink water was introduced into one schedule component. The value of the variable-time schedules was varied from 60 to 90 to 270 sec. The relative amount of time spent in the schedule component associated with drinking water was a decreasing function of food frequency for two animals and remained constant for the third. Drinking rates were direct functions of food frequency, and the amount of water drunk per pellet was an inverse function of food frequency. The reinforcement value of drinking water, according to the Matching Law, was a direct function of the frequency of food presentation. It was concluded that food reinforcement schedules indirectly influence rates of drinking by altering the reinforcement value of drinking water and that certain properties of schedule-induced drinking can be accounted for in terms of the reinforcement value of drinking water, the rate of drinking, and the frequency of food presentation.     

Bipolar control in fixed interfood intervals

The ability of stimuli correlated with successive periods in a fixed interfood interval to support a response that produced or removed them was examined using pigeons. The degree to which those correlated stimuli elicited directed key pecks was also obtained. Stimuli early in the interval functioned as negative reinforcers, and stimuli late in the interval functioned as positive reinforcers. Stimuli correlated with successively later portions of the second half of the interval supported successively higher rates of elicited pecking and, with the exception of the final stimulus, supported successively higher rates of stimulus production. Stimuli in successively earlier portions of the first half of the interval supported successively higher rates of correlated-stimulus removal. This effect occurred in spite of the addition of a conjoint variable-interval dependency for food. An ogive fit to the mean normalized response distributions resulted in r²s demonstrating that most of the variance in the temporal organization of the behavior was accounted for. The findings were taken to indicate that fixed interfood intervals establish bipolar control.     

Punishment of schedule-induced drinking in rats by signaled and unsignaled delays in food presentation

Food-deprived rats were exposed to a fixed-time 60-s schedule of food-pellet presentation and developed schedule-induced drinking. Using an ABA reversal design, three experiments investigated the effects of events then made dependent on licks. In Experiment 1, lick-dependent signaled delays (10 s) in food presentation in general led to decreased drinking, which recovered when the signaled delays were discontinued. The drinking of yoked-control rats, which received food at the same times as those exposed to the signaled-delay contingency, showed much smaller changes. Experiment 2 showed that 10-s lick-dependent signals alone did not reduce drinking. In Experiment 3, when licks produced unsignaled 10-s delays in food there were less marked and more gradual changes in drinking than in Experiment 1, although these effects again were greater than with yoked-control animals. We concluded that both signaled and unsignaled delays functioned as punishers of drinking. These findings support the view that schedule-induced drinking, like operant behavior, is subject to control by its consequences.     

The effects of signalled and unsignalled lick-dependent delays on the development of schedule-induced drinking in rats

Food pellets were programmed to be delivered to rats every 60 sec (Fixed Time 60-sec schedule), and the development of schedule-induced drinking was measured in terms of the amount of water consumed and the number of licks per inter-pellet interval. For some rats (masters) 10-sec delays in food delivery were dependent on licks. Yoked-control rats received food at the same time as their masters and independently of their own behaviour. In Experiment 1, in which the delays were signalled by a blackout, the master rats began to drink, but this schedule-induced behaviour then decreased to levels lower than those shown by the yoked controls. When the signalled delays were discontinued, the drinking of the master rats recovered. In Experiment 2, in which the delays were not signalled, the master rats did not develop as much schedule-induced drinking as the yoked controls, and discontinuing the delays led to only small increases in drinking. These results support the view that schedule-induced drinking is subject to control by its consequences.     

The effects of two response-elimination procedures on reinforced and induced aggression.

Pecks against a stuffed pigeon were reinforced according to a fixed-interval schedule for one group of pigeons and a variable-interval schedule for a second group. Red and green stimulus lights were alternately illuminated. Subsequently, food deliveries no longer occurred during one color (extinction). In the presence of the other color, food was presented only when no attack occurred for 30 sec. When attack produced food, all pigeons generally exhibited characteristic fixed-interval or variable-interval response patterns. Two birds in each group frequently exhibited postreinforcement schedule-induced aggression. Attack was reduced to low levels at approximately the same rate by extinction and differential reinforcement of other behavior. For birds that had previously exhibited schedule-induced aggression the initial reduction of attack during the second experimental phase was followed by induced attack immediately after food delivery in the differential-reinforcement-of-other-behavior component and upon onset of the extinction component, Either extinction or differential reinforcement of other behavior may eliminate reinforced aggression but may be relatively ineffective for reducing induced attack.