Temporal control by signals of interval duration within variable-interval schedules

Rats' lever pressing produced sucrose reinforcers on a variable-interval schedule where, in different conditions, the duration of a stimulus presented immediately after reinforcement was either correlated or uncorrelated with the duration of the current interreinforcement interval. Under the baseline schedule, in which no stimulus was presented, the minimum interreinforcement interval was 8 s and the mean postreinforcement pause of each subject approximated this value. Response rates increased slowly over the first 10 to 15 s and then remained roughly constant throughout the remainder of the interval. In both the correlated and uncorrelated conditions, the added stimulus resulted in the postreinforcement pauses lengthening to values in excess of the duration of the preceding stimulus. This resulted in a poststimulus pause which was, in most cases, roughly constant irrespective of the duration of the preceding stimulus, or of the reinforcement contingencies prevailing immediately after stimulus offset. Local response-rate patterns in the uncorrelated conditions were similar to those obtained under the baseline schedule in which no stimulus was presented. However, in the correlated condition local response rates increased across the remainder of the interreinforcer interval. Further, the rate of acceleration was inversely related to the duration of the preceding stimulus. These results show that a correlation between stimulus duration and the ensuing time to reinforcement can control behavior—a type of temporal control not previously reported.     

Time reallocation in a multiresponse environment: Effects of restricting response classes

Four adult male rats were each placed for three hours daily into an apparatus that provided individual compartments for six separate location-defined responses. The available responses consisted of: (1) the opportunity to turn off room lighting, producing darkness; (2) the opportunity to view a female rat; (3) the opportunity to turn off white noise; (4) the opportunity to drink; (5) the opportunity to eat; and (6) "other," representing time in the hallway between compartments. Each subject underwent a series of conditions characterized as an A-B-A-C-A design. Manipulations consisted of the removal of a low-probability response (darkness) and of a high-probability response (escape from noise) in a counter-balanced manner across subjects. The dependent measure for all subjects was the percentage of total session time spent in each compartment. Four predictive rules concerning the redistribution of behavior after response restriction were tested, including the constant-ratio rule, equal time redistribution, the most probable alternative, and the sequential-dependency rule. The results indicate no support for any of the four predictive rules and suggest that empirical assessment of restriction effects is necessary in reinforcement studies involving temporally extended responses.     

KNOWING BEFORE DOING: DISCRIMINATION BY RATS OF A BRIEF INTERRUPTION OF A TONE

Eight rats' lever presses were reinforced after an interruption in a tone, provided the lever had not been pressed before the tone interruption. After a few sessions, long before the animals reliably refrained from lever pressing before the interruption, the latencies of postinterruption presses (time from the termination of the interruption to the moment of the lever press) dissociated into two classes: short ones for to-be-rewarded presses, and long ones for presses in the other trials, which contained no reward because one or more lever presses had occurred before the interruption. Thus discrimination of impending reinforcement in the current trial occurred before there was evidence of sensitivity to reinforcement in the reinforcement-producing aspect of behavior. This finding is related to Shimp's (1981) contention that the temporal properties of recent behavior are reinforceable, if remembered. The present finding shows that learning to discriminate whether one's behavior has met a contingency, and learning to carry out this behavior, need not go together, implying that memory of temporal properties is probably a necessary but not a sufficient condition for learning the latter.     

Schedule-induced defecation by rats during ratio and interval schedules of food reinforcement.

Lever pressing in rats was maintained by continuous and intermittent schedules of food while defecation was monitored. In Experiment 1, reinforcement densities were matched across variable-ratio and variable-interval schedules for three pairs of rats. Defecation occurred in all 3 rats on the variable-ratio schedule and in all 3 rats on the yoked variable-interval schedule. In Experiment 2, fixed-ratio and fixed-interval schedules with similar reinforcement densities maintained lever pressing. Defecation occurred in 3 of 4 rats on the fixed-ratio schedule and in 4 of 4 rats on the fixed-interval schedule. Almost no defecation occurred during continuous reinforcement in either experiment. These results demonstrate that defecation may occur during both ratio and interval schedules and that the inter-reinforcement interval is more important than the behavioral requirements of the schedule in generating schedule-induced defecation.     

Simultaneous auditory discrimination.

Stimuli in many visual stimulus control studies typically are presented simultaneously; in contrast the stimuli in auditory discrimination studies are presented successively. Many everyday auditory stimuli that control responding occur simultaneously. This suggests that simultaneous auditory discriminations should be readily acquired. The purpose of the present experiment was to train rats in a simultaneous auditory discrimination. The apparatus consisted of a cage with two response levers mounted on one wall and a speaker mounted adjacent to each lever. A feeder was mounted on the opposite wall. In a go-right/go-left procedure, two stimuli were presented on each trial, a wide-band noise burst through one speaker and a 2-kHz complex signal through the other. The stimuli alternated randomly from side to side across trials, and the stimulus correlated with reinforcement for presses varied across subjects. The rats acquired the discrimination in 400 to 700 trials, and no response position preference developed during acquisition. The ease with which the simultaneous discrimination was acquired suggests that procedures, such as matching to sample, that require simultaneous presentation of stimuli can be used with auditory stimuli in animals having poor vision.     

Comparing Locomotion With Lever-press Travel In An Operant Simulation Of Foraging

An operant model of foraging was studied. Rats searched for food by pressing on the left lever, the patch, which provided one, two, or eight reinforcers before extinction (i.e., zero reinforcers). Obtaining each reinforcer lowered the probability of receiving another reinforcer, simulating patch depletion. Rats traveled to another patch by pressing the right lever, which restored reinforcer availability to the left lever. Travel requirement changed by varying the probability of reset for presses on the right lever; in one condition, additional locomotion was required. That is, rats ran 260 cm from the left to the right lever, made one response on the right lever, and ran back to a fresh patch on the left lever. Another condition added three hurdles to the 260-cm path. The lever-pressing and simple locomotion conditions generated equivalent travel times. Adding the hurdles produced longer times in patches than did the lever-pressing and simple locomotion requirements. The results contradict some models of optimal foraging but are in keeping with McNair's (1982) optimal giving-up time model and add to the growing body of evidence that different environments may produce different foraging strategies.     

Comparisons of rats' choice behavior among three different radial-maze tasks

The present study compared rats' behavioral changes on three tasks on the radial-arm maze. In the free-choice task (0Fo/8Fr; no forced choice/eight free choices), rats performed efficiently with the simple response pattern of sequential adjacent-arm choices. In the two forced-choice tasks (3Fo/5Fr and 5Fo/3Fr), rats performed as efficiently as 0Fo/8Fr but showed no particular response patterns. The frequency of arm investigation was the highest in 5Fo/3Fr, and was higher in 3Fo/5Fr than in 0Fo/8Fr. The probability of correct rejection, avoiding re-entry to visited arms after investigation, was also higher in 3Fo/5Fr and 5Fo/3Fr than in 0Fo/8Fr. These results suggest that the rats could adjust their behavior to the task demands.     

Effects of a variable-ratio conditioning history on sensitivity to fixed-interval contingencies in rats.

We investigated the possibility that human-like fixed-interval performances would appear in rats given a variable-ratio history (Wanchisen, Tatham, & Mooney, 1989). Nine rats were trained under single or compound variable-ratio schedules and then under a fixed-interval 30-s schedule. The histories produced high fixed-interval rates that declined slowly over 90 sessions; differences as a function of the particular history were absent. Nine control animals given only fixed-interval training responded at lower levels initially, but rates increased with training. Despite differences in absolute rates, rates within the intervals and postreinforcement pauses indicated equivalent development of the accelerated response patterns suggestive of sensitivity to fixed-interval contingencies. The finding that the histories elevated rates without retarding development of differentiated patterns suggests that the effective response unit was a burst of several lever presses and that the fixed-interval contingencies acted on these units in the same way as for single responses. Regardless of history, the rats did not manifest the persistent, undifferentiated responding reported for humans under comparable schedules. We concluded that the shortcomings of animal models of human fixed-interval performances cannot be easily remedied by including a variable-ratio conditioning history within the model.     

The effects of cocaine on behavior maintained by timeout from avoidance.

Rats were trained on concurrent schedules under which responses on one lever postponed shock (avoidance) and responses on the other lever produced brief (2-min) periods of signaled timeout from avoidance. For 6 rats, timeout from avoidance was programmed on a variable-interval 45-s schedule that generally resulted in rates that were lower than those on the avoidance lever. For another 6 rats, timeout was arranged on a variable-ratio 15 schedule that produced higher baseline rates. Cocaine (3 to 40 mg/kg) produced large, dose-dependent increases in behavior maintained by timeout in both groups of rats. Avoidance responding was also generally increased by cocaine, but the increases were of lesser magnitude. Increases in response rates were seen across a broad range of doses on behavior maintained by either interval or ratio schedules, an outcome that was unexpected on the basis of most studies of cocaine on food-maintained behavior. These results were similar to those of previous studies of the effects of amphetamine on behavior maintained by timeout from avoidance and suggest that stimulant drugs affect behavior maintained under a shock-postponement schedule differently than they affect behavior maintained by timeout from avoidance.     

Food-deprivation effects on punished schedule-induced drinking in rats.

Food-deprived rats (at 80% of their free-feeding weights) were exposed to a fixed-time 60-s schedule of food-pellet presentation and developed schedule-induced drinking. Lick-dependent signaled delays (10 s) to food presentation led to decreased drinking, which recovered when the signaled delays were discontinued. A major effect of this punishment contingency was to increase the proportion of interpellet intervals without any licks. The drinking of yoked control rats, which received food at the same times as those exposed to the signaled delay contingency (masters), was not consistently reduced. When food-deprivation level was changed to 90%, all master and yoked control rats showed decreases in punished or unpunished schedule-induced drinking. When the body weights were reduced to 70%, most master rats increased punished behavior to levels similar to those of unpunished drinking. This effect was not observed for yoked controls. Therefore, body-weight loss increased the resistance of schedule-induced drinking to reductions by punishment. Food-deprivation effects on punished schedule-induced drinking are similar to their effects on food-maintained lever pressing. This dependency of punishment on food-deprivation level supports the view that schedule-induced drinking can be modified by the same variables that affect operant behavior in general.