Brief exposure to contingent reinforcement produces a sustained increment in the strength of an elicited response.

Squirrel monkeys' lever pressing produced by response-independent shock was measured before, and for an extended period following, exposure to a shock-avoidance procedure. Following avoidance training, the frequency of responding increased by multiples of 10 to 50 across subjects and evidence little or no decrement for up to 6 months of postreinforcement testing. Manual responding produced by intense environmental stimulation may be substantially strengthened by a brief history of reinforcement, such that it is sustained over long periods without reinforcement.     

Similarities in the rate-altering effects of white noise and cocaine.

The effects of white noise and cocaine on squirrel monkeys' fixed-interval responding were compared to determine whether the presentation of an exteroceptive stimulus could produce rate-altering effects of the type typically observed following drug administration. To investigate the relationship between control response rate and response rate in the presence of drug or noise, the monkeys were trained under a fixed-interval 300-s stimulus-shock termination schedule in order to generate a wide range of local response rates. A light illuminated the experimental chamber during the interval and, after 300 s elapsed, a lever press during a 3-s period terminated the light and precluded the occurrence of a harmless electrical stimulus that otherwise was delivered at the end of the 3-s period. Each interval was followed by a 30-s timeout during which the chamber was darkened and responses had no consequences. Following intramuscular administration of cocaine, different rates of responding characteristic of control performance converged toward a common rate and, at an appropriately high dose, response rate during the fixed interval became more uniform. When white noise was presented continuously during a given session, different response rates also converged toward a common rate and, at an appropriate intensity, response rate became more uniform. Interactions were obtained when cocaine and white noise were presented together, indicating the possibility of a common behavioral mechanism of action. The results suggest that rate-altering drug effects may be, in part, a result of the ability of drugs to produce nonspecific stimulus effects similar to those observed for exteroceptive stimuli.     

Reinforcement probability and ordinal position of response in fixed-interval schedules

Four rats pressed levers and received food pellets under fixed-interval reinforcement schedules of 20, 60, and 180 seconds. The number of responses in each interval was recorded. From these data, the probability of reinforcement was determined as a function of response count. These functions were generally increasing. This finding is consistent with previous suggestions that increasing response rates within fixed intervals may be a function of response count in addition to or instead of elapsed or remaining time.     

Behavioral contrast in competitive and noncompetitive environments

Three experiments examined the effects of opportunities for an alternative response (drinking) on positive behavioral contrast of rats' food-reinforced bar pressing. In both Experiments 1 and 2 the baseline multiple variable-interval schedules were rich (variable interval 10-s), and contrast was examined both with and without a water bottle present. In Experiment 1, the rats were not water deprived. When one component of the multiple schedule was changed to extinction, the rate of bar pressing increased in the constant component (positive behavioral contrast). The magnitude of contrast was larger when the bottle was absent than when it was present, as predicted by the matching law. Drinking did not shift from the constant variable-interval component to the extinction component, as might have been expected from competition theory. In Experiment 2, the rats were water deprived. Contrast was larger when the bottle was present than when it was absent, and drinking did shift to the extinction component, as predicted by competition theory. In Experiment 3, water-deprived rats responded on leaner multiple variable-interval schedules (60-s) in the presence of a water bottle. When one component was changed to extinction, contrast did not occur, and drinking did not shift to the extinction component. The present results suggest that there are at least two different sources of behavioral contrast: “competitive” contrast, observed when an alternative response occurs with high probability, and “noncompetitive” contrast, observed when an alternative response occurs with low probability. The results, in conjunction with earlier studies, also suggest that the form of the alternative response and the rate of food reinforcement provided by the multiple schedule combine to determine the amount of contrast.     

The effect of signaled reinforcement availability on concurrent performances in humans

During Phase I, three female human subjects pressed a button for monetary reinforcement in two-component concurrent variable-interval schedules. Five different reinforcement frequencies were used in component A, whereas the reinforcement frequency in component B was held constant. Absolute rates of responding conformed to equations proposed by Herrnstein to describe concurent performances, and the ratios of the response rates and the times spent in the two components conformed to the matching law. During Phase II, the availability of reinforcement in component A was signaled by the illumination of a lamp. This resulted in suppression of response rates in component A and elevation of response rates in component B, these changes being reflected in a distortion of the matching relationship which took the form of a bias in favor of component B.     

Temporal distributions of responding during discrete-trial omission training in rats

Within-session temporal distributions of responding were investigated in three experiments using rats pressing a lever in a discrete-trial omission procedure. This schedule entailed 60, one-minute trials, and a sucrose solution was made available at the end of each trial in which no lever press occurred. In Experiment I, nonnaive rats acquired and maintained responding during this training. Moreover, the probability of a response during any session showed a strong and reliable tendency to increase from the beginning to the end of the session. These results were replicated in Experiment II, using naive animals. In Experiment III, alterations were made in the training procedure, including elimination of response-contingent and noncontingent stimulus changes. Results indicate that stimulus change may be sufficient to maintain low levels of responding whether or not this change is contingent on responding.     

Chained schedules of avoidance: Reinforcement within and by avoidance situations

Four rats were exposed to chained schedules with variable-cycle avoidance in both links. Responding in the initial link cancelled shocks scheduled once per minute and, according to a conjoint fixed-ratio schedule, produced a terminal link where scheduled shock rates varied from 0 to 8 shocks per minute in different conditions of the experiment. Response rates in the terminal link increased as a function of the scheduled shock rate. Response rates in the initial link, on the other hand, decreased as a function of the shock rate actually received (rather than scheduled) in the terminal link. While consistent with other studies of aversive control, these results differ from those obtained in chained schedules of positive reinforcement in that increases in reinforcement within the terminal link of the chain did not systematically increase the reinforcing value of that link.     

Choice of timeout during response-independent food schedules

Rats' lever pressing terminated visual or auditory stimuli associated with fixed-time or variable-time schedules of food delivery and produced a timeout period during which food delivery could not occur. Lever pressing during a timeout period reinstated the food-associated stimuli and again permitted food delivery according to the fixed-time or variable-time schedules. The mean interfood interval ranged from 1 minute to 16 minutes (variable-time schedules) or 32 minutes (fixed-time schedules); the timer controlling schedule intervals did not stop during timeout periods. The percentage of session time spent in timeout increased when the mean interfood intervals were lengthened and decreased when the mean interfood intervals were shortened. Timeouts were initiated most frequently about half way between successive food deliveries (fixed-time schedules) or after 15 seconds or more had lapsed since the last food delivery (variable-time schedules). Elimination of food delivery increased the percentage of session time spent in timeout, and elimination of the timeout contingency decreased lever press rates. When timeout was produced only when the lever was held in the depressed position, little time was spent in timeout. The main determinants of timeout initiation and termination appeared to be the rate of food delivery, freedom of movement during timeout, and the stimulus change associated with initiation and termination of timeout.     

Matching, contrast, and equalizing in the concurrent lever-press responding of rats

Five rats pressed levers for food reinforces delivered by several concurrent variable-interval variable-interval schedules. The rate of reinforcement available for responding on one component schedule was held constant at 60 reinforcers per hour. The rate of reinforcement available for responding on the other schedule varied from 30 to 240 reinforcers per hour. The behavior of the rats resembled the behavior of pigeons pecking keys for food reinforcers. The ratio of the overall rates of responding emitted under, and the ratio of the time spent responding under, the two components of each concurrent schedule were approximately equal to the ratio of the overall rates of reinforcement obtained from the components. The overall rate of responding emitted under, and the time spent responding under, the variable component schedule varied directly with the overall rate of reinforcement from that schedule. The overall rate of responding emitted under, and the time spent responding under, the constant component schedule varied inversely with the overall rate of reinforcement obtained from the variable component. The local rates of responding emitted under, and the local rates of reinforcement obtained from, the two components did not differ consistently across subjects. But they were not exactly equal either.     

Schedule-induced polydipsia in rats living in an operant environment

The effect of variations in interreinforcement interval on the temporal and distributional relation between feeding and drinking was continuously monitored. Rats were housed continuously in an operant chamber in which water was freely available, but lever pressing was required to obtain food (45-mg pellets). Initially, pellets were delivered on a fixed-ratio 1 schedule of reinforcement, which was followed by testing on response-initiated fixed-interval 15-, 30-, and 60-second schedules. The total number of discrete, daily meals (a period in which several pellets were earned in succession) was slightly higher during the fixed-interval schedules than during the fixed-ratio 1, but there was no systematic effect of fixed-interval length on meal frequency. Total water consumption, in contrast, increased dramatically as the interval was lengthened: both subjects consumed two to three times as much water on the fixed-interval 60-second schedule as on the fixed-ratio 1. The increased water consumption was the result of an alteration in the distribution of drinking relative to eating. During the fixed-ratio 1 condition, drinking occurred infrequently following individual food pellets and represented the smallest percentage of total drinking; drinking occurred predominantly just before or after a meal. As the fixed interval was lengthened, however, the frequency of postpellet drinking gradually increased and eventually comprised the largest proportion of daily drinking.