Effects of haloperidol on schedule-induced polydipsia.

In dose-related amounts, the drug haloperidol attenuated schedule-induced drinking by rats prefed with 0.01-mg drug added to 0, 25, 50, 75 or all of 100 Noyes 45-mg pellets. Drug pellets also induced less drinking than did regular Noyes pellets by rats that obtained these pellets at 1-min intervals by bar pressing. Haloperidol also reduced bar pressing and, temporarily, rate of reinforcement. The results appeared not to be due to a general sedative effect of haloperidol but to its selective power to reduce angiotensin-induced drinking. Thus, schedule-induced drinking, which is abnormal in not causing satiation, is controllable by a drug that interferes with the renin-angiotensin hormone system thought to regulate normal drinking.     

Context dependent changes in the reinforcing strength of schedule-induced drinking.

Previous experiments show that the opportunity to engage in schedule-induced responding is reinforcing. In this experiment, the reinforcing strength of schedule-induced drinking was measured. Four rats were trained on a concurrent-chain schedule. The two terminal links provided food pellets on identical fixed-time schedules. In addition, one terminal link also provided the opportunity to press a button that operated a water dipper. In this link, the rats showed polydipsic drinking. Button-pressing rate for polydipsic drinking was a bitonic function of pellet rate, and it was possible to describe the relationship with a slightly modified version of the matching equation for primary reinforcement. This equation also closely fit the data from other studies. Initial-link response rates, however, did not appear to be influenced by the availability of water in the terminal links. Control conditions suggested that the reinforcing strength of polydipsia was strongly bound to the context provided by periodic food reinforcement.     

Food-deprivation effects on punished schedule-induced drinking in rats.

Food-deprived rats (at 80% of their free-feeding weights) were exposed to a fixed-time 60-s schedule of food-pellet presentation and developed schedule-induced drinking. Lick-dependent signaled delays (10 s) to food presentation led to decreased drinking, which recovered when the signaled delays were discontinued. A major effect of this punishment contingency was to increase the proportion of interpellet intervals without any licks. The drinking of yoked control rats, which received food at the same times as those exposed to the signaled delay contingency (masters), was not consistently reduced. When food-deprivation level was changed to 90%, all master and yoked control rats showed decreases in punished or unpunished schedule-induced drinking. When the body weights were reduced to 70%, most master rats increased punished behavior to levels similar to those of unpunished drinking. This effect was not observed for yoked controls. Therefore, body-weight loss increased the resistance of schedule-induced drinking to reductions by punishment. Food-deprivation effects on punished schedule-induced drinking are similar to their effects on food-maintained lever pressing. This dependency of punishment on food-deprivation level supports the view that schedule-induced drinking can be modified by the same variables that affect operant behavior in general.     

The effects of schedule history and the opportunity for adjunctive responding on behavior during a fixed-interval schedule of reinforcement.

The effects of schedule history and the availability of an adjunctive response (polydipsia) on fixed-interval schedule performance were investigated. Two rats first pressed levers under a schedule of food reinforcement with an interresponse time greater than 11 s, and 2 others responded under a fixed-ratio 40 schedule. All 4 were then exposed to a fixed-interval 15-s schedule. Water was continuously available under these conditions, but after responding became stable on the fixed-interval schedule, access was experimentally manipulated. With water freely available, subjects did not display characteristic fixed-interval response rates and patterns (i.e., scalloping or break-and-run). Instead, they exhibited predictable, stable patterns of behavior as a function of their schedule histories: Subjects with the interresponse-time history exhibited low response rates, and those with the fixed-ratio history exhibited high rates. Manipulating the amount of water available resulted in marked changes in response rates for rats with the interresponse-time history but not for those with the fixed-ratio history. The results illustrate the multiple causation of behavior by its previous and current schedules of reinforcement and other concurrent factors.     

Response specificity in animal timing.

The stimuli that control responding in the peak procedure were investigated by training rats, in separate sessions, to make two different responses for food reinforcement. During one type of session, lever pressing was normally reinforced 32 s after the onset of a light. During the other type of session, chain pulling was normally reinforced either 8 s after the onset of one auditory cue or 128 s after the onset of a different auditory cue. For both types of sessions, only the appropriate manipulandum was available, and 20% of the trials lasted 240 s and involved no response-contingent consequences. Rats were then tested with the auditory cues in the presence of the lever and the light in the presence of the chain. If the time of reinforcement associated with each stimulus was learned, response rates should peak at these times during transfer testing. However, if a specific response pattern was learned for each stimulus, little transfer should occur. The results did not clearly support either prediction, leading to the conclusion that both a representation of the time of reinforcement and the rat's own behavior may control responding in this situation.     

Acquisition of lever-press responding in rats with delayed reinforcement: A comparison of three procedures

The present study examined the acquisition of lever pressing in rats under three procedures in which food delivery was delayed by 4, 8, and 16 seconds relative to the response. Under the nonresetting delay procedure, food followed the response selected for reinforcement after a specified interval elapsed; responses during this interval had no programmed effect. Under the resetting procedure, the response selected for reinforcement initiated an interval to food delivery that was reset by each subsequent response. Under the stacked delay procedure, every response programmed delivery of food t seconds after its occurrence. Two control groups were studied, one that received food immediately after each lever press and another that never received food. With the exception of the group that did not receive food, responding was established with every procedure at every delay value without autoshaping or shaping. Although responding was established under the resetting delay procedure, response rates were generally not as high as under the other two procedures. These findings support the results of other recent investigations in demonstrating that a response not previously reinforced can be brought to strength by delayed reinforcement in the absence of explicit training.     

Punishment of schedule-induced drinking in rats by signaled and unsignaled delays in food presentation

Food-deprived rats were exposed to a fixed-time 60-s schedule of food-pellet presentation and developed schedule-induced drinking. Using an ABA reversal design, three experiments investigated the effects of events then made dependent on licks. In Experiment 1, lick-dependent signaled delays (10 s) in food presentation in general led to decreased drinking, which recovered when the signaled delays were discontinued. The drinking of yoked-control rats, which received food at the same times as those exposed to the signaled-delay contingency, showed much smaller changes. Experiment 2 showed that 10-s lick-dependent signals alone did not reduce drinking. In Experiment 3, when licks produced unsignaled 10-s delays in food there were less marked and more gradual changes in drinking than in Experiment 1, although these effects again were greater than with yoked-control animals. We concluded that both signaled and unsignaled delays functioned as punishers of drinking. These findings support the view that schedule-induced drinking, like operant behavior, is subject to control by its consequences.     

Social reinforcement of operant behavior in rats: a methodological note.

An apparatus was developed to study social reinforcement in the rat. Four Long-Evans female rats were trained to press a lever via shaping, with the reinforcer being access to a castrated male rat. Responding under a fixed-ratio schedule and in extinction was also observed. Social access was found to be an effective reinforcer. When social reinforcement was compared with food reinforcement under similar conditions of deprivation and reinforcer duration, no significant differences were observed.     

Stimulus generalization of schedule-induced polydipsia

Five rats were exposed to an intradimensional discrimination by associating two tones of different frequency with the components of a multiple random-time 30-sec, extinction schedule of food presentation. After schedule-induced polydipsia developed and the intermittent schedule of food presentation established stable differential licking rates during the stimuli associated with the multiple schedule, a stimulus generalization test was conducted. When generalization testing was conducted by presenting stimuli that varied on the frequency dimension during the random-time 30-sec component of the multiple schedule, all five rats demonstrated moderately sloping symmetrical gradients. Thus, schedule-induced polydipsia can be brought under the control of stimuli other than the food pellet.     

Acquisition and maintenance of postshock response pattern in nondiscriminated avoidance with rats

Five experimentally naive albino rats were placed under a nondiscriminated lever-press avoidance schedule in which the delay to the next shock for responses after a shock was longer than the delay for responses after a response. Four rats acquired the postshock response pattern and maintained it for a prolonged period. The results revealed that postshock responding was under operant control and was not purely shock-elicited. It was suggested that the two kinds of response-shock interval, i.e. the shock-response-shock interval and the response-response-shock interval, could and should be independently controlled in nondiscriminated avoidance schedules.     

The control of responding by sounds: unusual effect of reinforcement.

Naive rats were trained to respond on one lever in the presence of noise bursts from one speaker and on a second lever in the presence of noise bursts from a second speaker. The speakers were mounted behind the levers. When responding on the lever adjacent to the sounding speaker was reinforced, control developed within fewer than five trials. When responding on the nonadjacent lever was selectively reinforced, responding on the lever adjacent to the sounding speaker increased in probability for several sessions. Naive rats were trained to respond on the nonadjacent lever following preexposure to the sound. Responding on the lever adjacent to the sounding speaker increased in probability, showing that novelty was not responsible for the effect. Naive rats were run on automaintenance procedures in which there was no explicit pairing of sound and magazine operation, 100% pairing of sound and magazine operation, or magazine operation following 40% of sound presentations. None of the rats acquired the response of approaching and sniffing the sounding speaker, indicating that sound-magazine pairing was not responsible for the effect.     

The effects of d-amphetamine on the temporal control of operant responding in rats during a preshock stimulus.

The operant behavior of six rats was maintained by a random-interval schedule of reinforcement. Three-minute periods of noise were superimposed on this behavior, each period ending with the delivery of an unavoidable shock. Overall rates of responding were generally lower during the periods of noise than in its absence (conditioned suppression). These suppressed response rates also exhibited temporal patterning, with responding becoming less frequent as each noise period progressed. The effects of d-amphetamine on this behavioral baseline were then assessed. In four animals the relative response rates during the noise and in its absence suggested that the drug produced a dose-related decrease in the amount of conditioned suppression. However, this effect was often due to a decrease in the rates of responding in the absence of the preshock stimulus, rather than to an increase in response rates during the stimulus. Temporal patterning in response rates during the preshock stimulus was abolished, an effect that was interpreted in terms of rate-dependent effect of d-amphetamine. This study thus extends rate-dependent analyses of the effects of amphetamines to the patterns of operant behavior that occur during a preshock stimulus, and which have been discussed in terms of the disrupting effects of anxiety on operant behavior.     

Overmatching in rats: the barrier choice paradigm

The barrier choice paradigm was used to impose a cost on rats' behavior of traveling between two levers: Pressing on two levers was reinforced with food on concurrent random-interval schedules, but rats had to climb over a barrier to move from one lever to another. The height of the barrier separating the levers was increased from 30.5 to 45.7 cm across two phases that involved various pairs of random-interval schedules. With the 30.5-cm barrier, the generalized matching law showed slopes equal to or slightly above 1.0 for response and time allocation. With the 45.7-cm barrier, the generalized matching law showed slopes above 1.2 for responses, indicating that sensitivity to reinforcement increased with increasing barrier height. For time allocation the slopes remained close to 1.0; sensitivity to reinforcement did not seem to increase with increasing barrier height. The role of locomotion effort in choice situations is discussed.     

Deprivation and satiation: The interrelations between food and wheel running

Two experiments were designed to assess whether depriving rats of food would increase the reinforcement effectiveness of wheel running (Experiment 1) and whether satiation for wheel running would decrease the reinforcement effectiveness of food (Experiment 2). In Experiment 1, a progressive-ratio schedule was used to measure the reinforcement effectiveness of wheel running when rats were deprived or not deprived of food. Completion of a fixed number of lever presses released a brake on a running wheel for 60 s, and the response requirement was systematically increased until the rat stopped pressing or until 8 hr had elapsed. The ratio value reached (and the total number of lever presses) was an inverted-U function of food deprivation (percentage body weight). In Experiment 2, when wheel running preceded test sessions, fewer food-reinforced lever presses were maintained by the progressive-ratio schedule, and responding occurred at a lower rate on a variable-interval schedule. An interpretation of these results is that deprivation or satiation with respect to one event (such as food) alters the reinforcement effectiveness of a different event (such as access to wheel running).     

Social preference in rats

Rats were given repeated choices between social and nonsocial outcomes, and between familiar and unfamiliar social outcomes. Lever presses on either of 2 levers in the middle chamber of a 3-chamber apparatus opened a door adjacent to the lever, permitting 45-s access to social interaction with the rat in the chosen side chamber. In Experiment 1, rats preferred (a) social over nonsocial options, choosing their cagemate rat over an empty chamber, and (b) an unfamiliar over a familiar rat, choosing a non-cagemate over their cagemate. These findings were replicated in Experiment 2 with 2 different non-cagemate rats. Rats preferred both non-cagemate rats to a similar degree when pitted against their cagemate, but were indifferent when the 2 non-cagemates were pitted against each other. Similar preference for social over nonsocial and non-cagemate over cagemate was seen in Experiment 3, with new non-cagemate rats introduced after every third session. Response rates (for both cagemate and non-cagemate rats) were elevated under conditions of nonsocial (isolated) housing compared to conditions of social (paired) housing, demonstrating a social deprivation effect. Together, the experiments contribute to an experimental analysis of social preference within a social reinforcement framework, drawing on methods with proven efficacy in the analysis of reinforcement more generally.     

Effects of reinforcement rate and delay on the acquisition of lever pressing by rats.

The acquisition of lever pressing by naive rats, in the absence of shaping, was studied as a function of different rates and unsignaled delays of reinforcement. Groups of 3 rats were each exposed to tandem schedules that differed in either the first or the second component. First-component schedules were either continuous reinforcement or random-interval 15, 30, 60 or 120 s; second-component schedules were fixed-time 0, 1, 3, 6, 12, or 24 s. Rate of responding was low under continuous immediate reinforcement and higher under random-interval 15 s. Random interval 30-s and 60-s schedules produced lower rates that were similar to each other. Random-interval 120 s controlled the lowest rate in the immediate-reinforcement condition. Adding a constant 12-s delay to each of the first-component schedule parameters controlled lower response rates that did not vary systematically with reinforcement rate. The continuous and random-interval 60-s schedules of immediate reinforcement controlled higher global and first-component response rates than did the same schedules combined with longer delays, and first-component rates showed some graded effects of delay duration. In addition, the same schedules controlled higher second-component response rates in combination with a 1-s delay than in combination with longer delays. These results were related to those from previous studies on acquisition with delayed reinforcement as well as to those from similar reinforcement procedures used during steady-state responding.     

Low-response-rate conditioning history and fixed-interval responding in rats.

Bar presses by one group of rats were conditioned under a differential-reinforcement-of-low-rate reinforcement schedule immediately prior to conditioning under a fixed-interval schedule. In a second group of rats, bar presses were conditioned first under a differential-reinforcement-of-low-rate schedule and then under a fixed-ratio schedule prior to conditioning under a fixed-interval schedule. Low response rates occurred under the fixed-interval schedule only when it was immediately preceded by low-rate conditioning. Otherwise, fixed-interval responding was similar to responding under the fixed-ratio schedule. This finding suggests that responses of laboratory animals are sensitive to immediate history, and, unlike human responses, are relatively insensitive to a history of low-rate conditioning when it is followed by high-rate conditioning.     

Temporal control in rats: analysis of nonlocalized effects from short interfood intervals.

The present experiment analyzed temporal control of postreinforcement pause duration during within-session changes in the criterion for reinforcement (interfood interval, IFI). Analysis of interval-by-interval changes in the pause revealed localized and nonlocalized effects from short intervals that caused specific changes in performance. In Phase 1, rats were presented with five consecutive 15-s IFIs intercalated into a series of 60-s IFIs. The 15-s set decreased the pause in adjacent and more remote 60-s intervals. In Phase 2, two sets of 15-s intervals were intercalated. The spacing between the two sets varied so that 0, 5, 10, or 15 60-s IFIs separated the sets. The postreinforcement pause tracked all changes in the IFI duration, and the localized effect from a short set extended beyond the next interval to the next few 60-s IFIs. Effects from one set, however, did not combine with a second set: Changes in the pause after two sets were the same regardless of the spacing between sets.     

Running and responding reinforced by the opportunity to run: effect of reinforcer duration.

The present study investigated the effect of reinforcer duration on running and on responding reinforced by the opportunity to run. Eleven male Wistar rats responded on levers for the opportunity to run in a running wheel. Opportunities to run were programmed to occur on a tandem fixed-ratio 1 variable-interval 30-s reinforcement schedule. Reinforcer duration varied across conditions from 30 to 120 s. As reinforcer duration increased, the rates of running and lever pressing declined, and latency to lever press increased. The increase in latency to respond was consistent with findings that unconditioned inhibitory aftereffects of reinforcement increase with reinforcer magnitude. The decrease in local lever-pressing rates, however, was inconsistent with the view that response strength increases with the duration of the reinforcer. Response rate varied inversely, not directly, with reinforcer duration. Furthermore, within-session data challenge satiation, fatigue, and response deprivation as determinants of the observed changes in running and responding. In sum, the results point to the need for further research with nonappetitive forms of reinforcement.     

Behavior of rats under fixed consecutive number schedules: effects of drugs of abuse.

Four rats responded under a simple fixed consecutive number schedule in which eight or more consecutive responses on the run lever, followed by a single response on the reinforcement lever, produced the food reinforcer. Under this simple schedule, dose-response curves were determined for diazepam, morphine, pentobarbital, and phencyclidine. The rats were then trained to respond under a multiple fixed consecutive number schedule in which a discriminative stimulus signaled when the response requirement on the run lever had been completed in one of the two fixed consecutive number component schedules. Under control conditions, the percentage of reinforced runs under the multiple-schedule component with the discriminative stimulus added was much higher than the percentage of reinforced runs under the multiple-schedule component without the discriminative stimulus. All of the drugs decreased the percentage of reinforced runs under each of the fixed consecutive number schedules by increasing the conditional probability of short run lengths. This effect was most consistently produced by morphine. The drugs produced few differences in responding between the multiple fixed consecutive number components. Responding under the simple fixed consecutive number schedule, however, was affected at lower doses of the drugs than was responding under the same fixed consecutive number schedule when it was a component of the multiple schedule. This result may be due to the difference in schedule context or, perhaps, to the order of the experiments.