Polydipsia induced by intermittent delivery of salted liquid foods

Food-deprived rats given constant access to water were exposed to fixed-time presentations of soybean milk and diluted sweetened condensed cows' milk. In some conditions these liquid foods were adulterated with varying amounts of sodium chloride. Under a fixed-time 30-sec schedule of food delivery, little water was consumed when the food was soybean milk alone, or soybean milk with sodium chloride added in concentrations of .9, 1.8, or 3.6%. However, schedule-induced polydipsia appeared when soybean milk adulterated with 7.2 or 14.4% sodium chloride was delivered under this schedule. When soybean milk containing 7.2% sodium chloride was presented under fixed-time 15-, 30-, 60-, 120-, and 240-sec schedules, schedule-induced drinking increased with the fixed-time value from 15 to 120 seconds, and decreased at 240 seconds. Like soybean milk, diluted sweetened condensed milk delivered under fixed-time schedules of 30, 60, and 120 seconds failed to evoke schedule-induced polydipsia, but did so when adulterated with 7.2% sodium chloride. Drinking induced by salted liquid foods resembled the polydipsia engendered by spaced dry-food presentations in several ways, including temporal relation to food delivery, persistence within and across sections, sensitivity to interfood interval, and magnitude relative to intake evoked by bulk-food presentation.     

An analysis of rats' drinking-tube contacts under tandem and fixed-interval schedules of food presentation

Rats' lever presses and drinking-tube contacts were studied under fixed-interval schedules of food presentation and under a tandem schedule composed of three fixed intervals. One group of rats was exposed first to the tandem schedule, next to fixed-interval schedules of comparable interpellet intervals, and once again to the tandem schedule; a second group of rats was exposed first to a fixed-interval and then to the tandem schedule. Under the tandem schedule, lever presses occurred at a higher rate and were more uniformly distributed in time than under the fixed-interval schedule. Tube contacts emitted by rats exposed first to a fixed-interval schedule consisted mostly of tongue contacts, which occurred at a high rate shortly after food; tube contacts emitted by rats exposed first to the tandem schedule consisted mostly of paw contacts, which occurred at a lower rate at times other than shortly after food. Changing the schedule from fixed interval to tandem decreased the frequency of tongue contacts for all rats. Under schedules of food presentation with comparable interpellet intervals, the schedule of food presentation, rather than the rate of food delivery per se, determined the topography and temporal locus of drinking-tube contacts.     

Techniques for establishing schedules with wheel running as reinforcement in rats.

In three experiments, access to wheel running was contingent on lever pressing. In each experiment, the duration of access to running was reduced gradually to 4, 5, or 6 s, and the schedule parameters were expanded gradually. The sessions lasted 2 hr. In Experiment 1, a fixed-ratio 20 schedule controlled a typical break-and-run pattern of lever pressing that was maintained throughout the session for 3 rats. In Experiment 2, a fixed-interval schedule of 6 min maintained lever pressing throughout the session for 3 rats, and for 1 rat, the rate of lever pressing was positively accelerated between reinforcements. In Experiment 3, a variable-ratio schedule of 20 or 35 was in effect and maintained lever pressing at a very stable pace throughout the session for 2 of 3 rats; for 1 rat, lever pressing was maintained at an irregular rate. When the session duration was extended to successive 24-hr periods, with food and water accessible in Experiment 3, lever pressing settled into a periodic pattern occurring at a high rate at approximately the same time each day. In each experiment, the rats that developed the highest local rates of running during wheel access also maintained the most stable and highest rates of lever pressing.     

Fixed versus variable sequences of food and stimulus presentation in second-order schedules

Three pigeons were exposed to a second-order schedule in which the behavior specified by a fixed-interval component schedule was reinforced according to a ratio overall schedule. The completion of components not followed by food was signalled by a brief stimulus never paired with food. Food and the stimulus occurred in a random sequence or in fixed alternation, but the overall schedules (variable ratio 2 or fixed ratio 2) ensured that an equal number of food and brief-stimulus presentations occurred in each session. The control exerted by the food and by the brief stimulus was measured by overall response rates, mean pauses, frequency distributions of pauses, and response patterning across components. In general, the stimulus controlled patterns of behavior more similar to those controlled by food when food and the stimulus occurred in a random sequence than when they occurred in fixed alternation.     

Second-order schedules of token reinforcement: comparisons of performance under fixed-ratio and variable-ratio exchange schedules

Rats' lever pressing produced tokens according to a 20-response fixed-ratio schedule. Sequences of token schedules were reinforced under a second-order schedule by presentation of periods when tokens could be exchanged for food pellets. When the exchange period schedule was a six-response fixed ratio, patterns of completing the component token schedules were bivalued, with relatively long and frequent pauses marking the initiation of each new sequence. Altering the exchange period schedule to a six-response variable ratio resulted in sharp reductions in the frequency and duration of these initial pauses, and increases in overall rates of lever pressing. These results are comparable to those ordinarily obtained under simple fixed-ratio and variable-ratio schedules.     

Choice of timeout during response-independent food schedules

Rats' lever pressing terminated visual or auditory stimuli associated with fixed-time or variable-time schedules of food delivery and produced a timeout period during which food delivery could not occur. Lever pressing during a timeout period reinstated the food-associated stimuli and again permitted food delivery according to the fixed-time or variable-time schedules. The mean interfood interval ranged from 1 minute to 16 minutes (variable-time schedules) or 32 minutes (fixed-time schedules); the timer controlling schedule intervals did not stop during timeout periods. The percentage of session time spent in timeout increased when the mean interfood intervals were lengthened and decreased when the mean interfood intervals were shortened. Timeouts were initiated most frequently about half way between successive food deliveries (fixed-time schedules) or after 15 seconds or more had lapsed since the last food delivery (variable-time schedules). Elimination of food delivery increased the percentage of session time spent in timeout, and elimination of the timeout contingency decreased lever press rates. When timeout was produced only when the lever was held in the depressed position, little time was spent in timeout. The main determinants of timeout initiation and termination appeared to be the rate of food delivery, freedom of movement during timeout, and the stimulus change associated with initiation and termination of timeout.     

A comparison of responding maintained under second-order schedules of intramuscular cocaine injection or food presentation in squirrel monkeys.

Key pressing by squirrel monkeys was maintained under second-order schedules of either intramuscular cocaine injection or food presentation. Under one schedule, each completion of a 10-response fixed-ratio unit produced a brief visual stimulus; the first fixed-ratio unit completed after 30 minutes elapsed produced the stimulus paired with either cocaine injection or food presentation. Generally, short pauses followed by high rates of responding were maintained within the fixed-ratio units, and responding was positively accelerated over the 30-minute interval. Under another schedule, each completion of a 3-minute fixed-interval unit produced the brief stimulus; completion of the 10th fixed-interval unit produced the stimulus paired with either cocaine injection or food presentation. Generally, short pauses followed by high rates of responding were maintained within the fixed-ratio units, and responding was positively accelerated over the 30-minute interval. Under another schedule, each completion of a 3-minute fixed-interval unit produced the brief stimulus; completion of the 10th fixed-interval unit produced the stimulus paired with either cocaine injection or food presentation. Rates of responding increased within the fixed-interval units, and to a greater extent over the entire 10 fixed-interval units. Patterns of responding depended more on the schedule of reinforcement than on whether cocaine or food maintained responding. Omitting the brief stimuli following all but the last fixed-ratio or fixed-interval units decreased average rates and altered the patterns of responding. Substituting a visual stimulus that was never paired with cocaine or food following all but the last fixed-ratio or fixed-interval units decreased response rates to a lesser extent and did not substantially alter patterns of responding. When the duration of the paired stimulus was varied from .3 to 30.0 seconds, the highest response rates occurred at intermediate durations (1.0 to 10.0 seconds). The manner in which the stimulus changes affected performances depended more on the schedule of reinforcement than on whether cocaine injection or food presentation maintained responding.     

Effects of fixed-time shocks and brief stimuli on food-maintained behavior of rats

When a fixed-time schedule of shocks was presented to rats lever pressing for food on a random-interval schedule, a pattern of behavior developed with a high rate of pressing after shock declining to near zero before the next shock was delivered. Once this pattern had stabilized, one-quarter of the shocks were replaced with brief auditory stimuli (tones) in a random sequence. Tone maintained behavior similar to shock, although tone was never paired with shock. Both tone and shocks elicited responding when presented at various times as probe stimuli, and responding was usually totally suppressed if neither stimulus occurred at the beginning of the fixed-time interval. When other stimuli were paired with tone and shock, only those paired with tone gained discriminative control and elicited responding. These findings suggest that stimuli that signal a shock-free, or safe, period will maintain the pattern of behavior generated by shock on a fixed-time schedule. There is a parallel between this phenomenon and the control of behavior on second-order schedules of positive reinforcement with nonpaired brief stimuli.     

Second-order schedules of token reinforcement: effects of varying the schedule of food presentation

In the initial link of a complex schedule, one discriminative stimulus was presented and lever pressing produced tokens on fixed-ratio schedules. In the terminal link, signalled by a second discriminative stimulus, deposits of the tokens produced food. With two rats, the terminal link was presented after each sixth component schedule of token reinforcement was completed. With the other two rats, the terminal link was presented following the first component schedule completed after a fixed interval. During the terminal link, each token deposit initially produced food. The schedule of food presentation was subsequently increased such that an increasing number of token deposits in the terminal link was required for each food presentation. Rates of lever pressing in the initial link were inversely related to the schedule of food presentation in the terminal link. These results are similar to those of experiments that have varied schedules of food presentation in chained schedules. Rates and patterns of responding controlled throughout the initial link were more similar to those ordinarily controlled by second-order brief-stimulus schedules than to those controlled by comparable extended chained schedules.     

Responding maintained under fixed-interval and fixed-time schedules of electric shock presentation

Following initial histories under a schedule of electric shock postponement, lever pressing in squirrel monkeys was maintained under fixed-interval and fixed-time schedules of electric shock presentation. No difference in either rate or pattern of responding was obtained when these schedules were presented as components of a multiple schedule. When they were presented singly for long periods of time, the fixed-interval schedule consistently maintained a higher response rate than the fixed-time schedule. The pattern of responding under both schedules was similar, typically consisting of a pause at the beginning of each interval followed by either a steady or a positively accelerating rate of responding. The results suggest that the response-shock dependency is of critical importance in the maintenance of high rates of responding under schedules of electric shock presentation, and support the general view that such responding may be conceptualized as operant behavior under control of many of the same variables that control responding under comparable schedules of food or water reinforcement.     

Concurrent second-order schedules of reinforcement

Responses on one key (the main key) of a two-key chamber produced food according to a second-order variable-interval schedule with fixed-interval schedule components. A response on a second key (the changeover key) alternated colors on the main key and provided a second independent second-order variable-interval schedule with fixed-interval components. The fixed-interval component on one variable-interval schedule was held constant at 8 sec, while the fixed interval on the other variable-interval schedule was varied from 0 to 32 sec. Under some conditions, a brief stimulus terminated each fixed interval and generated fixed-interval patterns; in other conditions, the brief stimulus was omitted. Relative response rate and relative time deviated substantially from scheduled relative reinforcement rate and, to a lesser extent, from obtained relative reinforcement rate under both brief-stimulus and no-stimulus conditions. Matching was observed with equal components on both schedules; with unequal components, increasingly greater proportions of time and responses than the matching relation would predict were spent on the variable-interval schedule containing the shorter component. Preference for the shorter fixed interval was typically more extreme under brief-stimulus than under no-stimulus schedules. The results limit the extension of the matching relation typically observed under simple concurrent variable-interval schedules to concurrent second-order variable-interval schedules.     

Spaced food but not electrical brain stimulation induces polydipsia and air licking.

An attempt was made to induce polydipsia in rats whose lever pressing was reinforced with food pellets or electrical brain stimulation. Nine food-deprived, water-sated rats drank water excessively during sessions in which food pellets were delivered. When brain stimulation was substituted for food, drinking immediately ceased. Delivering brain stimulation according to a variety of schedules, pairing brain stimulation with food reinforcement, and substituting an air stream for water, each failed to produce polydipsic licking. These results show that polydipsia is not induced by all reinforcers.     

Fixed-interval responding under second-order schedules of food presentation or cocaine injection.

Squirrel monkeys operated a key under second-order schedules in which every tenth completion of a 5-minute fixed interval resulted in either presentation of food or intravenous injection of cocaine. When a 2-second light was presented at the completion of the component fixed-interval schedules, positively accelerated responding developed and was maintained in each component. Over a tenfold range of doses of cocaine(30 to 300 microgram/kg/injection) and amounts of food (0.75 to 7.5 g/presentation); the second-order schedule of cocaine injection maintained higher average rates of responding than the second-order schedule of food presentation. Substituting saline for cocaine or eliminating food presentation decreased average rates of responding. When no stimulus change occurred at the completion of the first nine component fixed-interval schedules, but the 2-second light and food presentation or cocaine injection still occurred after the tenth component, only low and relatively constant rates of responding were maintained in each component. Patterns of responding characteristic of 5-minute fixed-interval schedules were maintained by the 2-second light paired with either cocaine injection or food presentation, though the maximum frequency of cocaine injection or food presentation was less than once per 50 minutes.     

Conditioned reinforcement versus time to reinforcement in chain schedules.

Pigeons were trained on three-component chain schedules in which the initial component was either a fixed-interval or variable-interval schedule. The middle and terminal components were varied among fixed-interval fixed-interval, variable-interval variable-interval, and an interdependent variable-interval variable-interval schedule in which the sum of the durations of the two variable-interval components was always equal to the sum of the fixed-interval fixed-interval components. At issue was whether the response rate in the initial component was controlled by its time to primary reinforcement or by the temporal parameters of the stimulus correlated with the middle terminal link. The fixed-interval initial-link schedule maintained much lower response rates than the variable-interval initial-link schedule regardless of the schedules in the middle and terminal links. Nevertheless, the intervening schedules played some role: With fixed-interval schedules in the initial links, response rates were consistently highest with independent variable-interval schedules in the middle and terminal links and intermediate with the interdependent variable-interval schedules; these initial-link differences were predicted by the response rates in the middle link of the chain. With variable-interval schedules in the initial links, response rates were lowest with the fixed-interval fixed-interval schedules following the initial link and were not systematically different for the two types of variable-interval variable-interval schedules. The results suggest that time to reinforcement itself accounts for little if any variance in initial-link responding.     

The effects of reinforcement frequency and response requirements on the maintenance of behavior.

Six rats responded under fixed-interval and tandem fixed-interval fixed-ratio schedules of food reinforcement. Basic fixed-interval schedules alternated over experimental conditions with tandem fixed-interval fixed-ratio schedules with the same fixed-interval value. Fixed-interval length was varied within subjects over pairs of experimental conditions; the ratio requirement of the tandem schedules was varied across subjects. For both subjects with a ratio requirement of 10, overall response rates and running response rates typically were higher under the tandem schedules than under the corresponding basic fixed-interval schedules. For all subjects with ratio requirements of 30 or 60, overall response rates and running response rates were higher under the tandem schedules than under the corresponding basic fixed-interval schedules only with relatively short fixed intervals. At longer fixed intervals, higher overall response rates and running rates were maintained by the basic fixed-interval schedules than by the tandem schedules. These findings support Zeiler and Buchman's (1979) reinforcement-theory account of response strength as an increasing monotonic function of both the response requirement and reinforcement frequency. Small response requirements added in tandem to fixed-interval schedules have little effect on reinforcement frequency and so their net effect is to enhance responding. Larger response requirements reduce reinforcement frequency more substantially; therefore their net effect depends on the length of the fixed interval, which limits overall reinforcement frequency. At the longest fixed intervals studied in the present experiment, reinforcement frequency under the tandem schedules was sufficiently low that responding weakened or ceased altogether.     

Unsignalled delay of reinforcement in variable-interval schedules

Three pigeons responded on several tandem variable-interval fixed-time schedules in which the value of the fixed-time component was varied to assess the effects of different unsignalled delays of reinforcement. Actual (obtained) delays between the last key peck in an interval and reinforcement were consistently shorter than the nominal (programmed) delay. When nominal delays were relatively short, response rates were higher during the delay condition than during the corresponding nondelay condition. At longer nominal delay intervals, response rates decreased monotonically with increasing delays. The results were consistent with those obtained from delay-of-reinforcement procedures that impose either a stimulus change (signal) or a no-response requirement during the delay interval.     

Effects of signaled and unsignaled shock on schedule-controlled lever pressing and schedule-induced licking: Shock intensity and body weight

Schedule-controlled lever pressing and schedule-induced licking were studied in rats under a multiple fixed-interval fixed-interval schedule of food reinforcement. Following acquisition of stable rates of pressing and licking, a multiple variable-time variable-time schedule of electric-shock delivery was superimposed upon the baseline schedule. In only one component of the multiple schedule, a 5-sec stimulus preceded each shock (signaled shock). In the other component shock was unsignaled. Several shock intensities (Experiment 1) and body weights (Experiment 2) were studied. Lever pressing and licking were affected similarly by experimental manipulations, although with parametric differences. Depending upon shock intensity and body weight, rates of lever pressing and licking were hardly suppressed, suppressed primarily in the unsignaled shock component (differential suppression), or markedly suppressed in both components. Differential suppression during components with signaled and unsignaled shock and conditioned suppression of responding during the preshock stimulus appeared not to be functionally related. Differential suppression depended more on the discriminability of shock-free time, and on shock intensity, body weight, and the type of response than on the “preparatory” behavior preceding shock.     

Effects of d-amphetamine and caffeine on schedule-controlled and schedule-induced responding.

The effects of d-amphetamine and caffeine were studied on rates and patterns of lever pressing and schedule-induced licking under fixed-interval schedules of food pellet presentation. In addition, the effects of caffeine were studied on lever pressing and licking under a multiple fixed-ratio fixed-interval schedule. Caffeine reduced mean overall rates of licking at lower doses than it reduced mean overall rates of pressing under the fixed-interval schedules, but the effects of caffeine on both licking and lever pressing depended largely on the control rate of responding. d-Amphetamine reduced mean overall rates of lever pressing and licking at about the same dose, but the effects of d-amphetamine also were a function of the control rate of responding.     

Schedule-induced biting under fixed-interval schedules of food or electric-shock presentation

Squirrel monkeys pressed a lever under fixed-interval schedules of food or of electric-shock presentation. Both schedules induced repeated biting on a latex hose. Whether lever pressing was controlled by food or by electric shock, a pattern of decreasing hose biting and increasing lever pressing occurred within fixed-interval cycles. As the fixed-interval duration was increased from 6 to 600 sec, average rates of lever pressing decreased under both schedules. Average rates of hose biting first increased with increasing parameter value, reaching a maximum at values that varied from 60 to 337 sec in different monkeys, and then declined at higher values. d-Amphetamine at appropriate doses increased overall rates of lever pressing maintained by food or by shock, but either did not affect or decreased overall rates of hose biting. When no timeout period occurred between fixed-interval cycles, the monkeys bit most frequently immediately after food or electric shock was presented. When there was a timeout period, hose biting began shortly after the start of the fixed-interval cycles, with little or no hose biting immediately after food or electric shock was presented. Most hose biting appeared to be schedule-induced rather than food- or shock-induced.