The matching law in and within groups of rats

In each of the two experiments, a group of five rats lived in a complex maze containing four small single-lever operant chambers. In two of these chambers, food was available on variable-interval schedules of reinforcement. In Experiment I, nine combinations of variable intervals were used, and the aggregate lever-pressing rates (by the five rats together) were studied. The log ratio of the rates in the two chambers was linearly related to the log ratio of the reinforcement rates in them; this is an instance of Herrnstein's matching law, as generalized by Baum. Summing over the two food chambers, food consumption decreased, and response output increased, as the time required to earn each pellet increased. In Experiment II, the behavior of individual rats was observed by time-sampling on selected days, while different variable-interval schedules were arranged in the two chambers where food was available. Individual lever-pressing rates for the rats were obtained, and their median bore the same “matching” relationship to the reinforcement rates as the group aggregate in Experiment I. There were differences between the rats in their distribution of time and responses between the two food chambers; these differences were correlated with differences in the proportions of reinforcements the rats obtained from each chamber.     

Suppression of ethanol-reinforced lever pressing by delaying food availability.

When food was initially available to rats under a fixed-interval 26-second schedule and each liquid-reinforced lever press delayed food availability 8 seconds, suppression of liquid-reinforced lever pressing and liquid consumption occurred when the liquid presented was 4, 8, 16, 32, and 0% ethanol. Suppression did not occur in yoked-control animals, which received food coincidentally with experimental animals but were not directly exposed to the delay dependency. After exposure to the food schedule, each ethanol solution served as a reinforcer in the absence of food presentation. Delaying food availability for increasingly long periods (8 to 2048 seconds) suppressed ethanol-reinforced lever pressing and consumption relative to baseline levels, with the maximum decrease being below the level maintained in the absence of food. However, degree of suppression did not increase monotonically with delay length. Liquid-reinforced performance of yoked-control animals indicated that suppression did not result from changes in the sequencing of food presentation alone.     

DRL interresponse-time distributions: quantification by peak deviation analysis.

Peak deviation analysis is a quantitative technique for characterizing interresponse-time distributions that result from training on differential-reinforcement-of-low-rate schedules of reinforcement. It compares each rat's obtained interresponse-time distribution to the corresponding negative exponential distribution that would have occurred if the rat had emitted the same number of responses randomly in time, at the same rate. The comparison of the obtained distributions with corresponding negative exponential distributions provides the basis for computing three standardized metrics (burst ratio, peak location, and peak area) that quantitatively characterize the profile of the obtained interresponse-time distributions. In Experiment 1 peak deviation analysis quantitatively described the difference between the interresponse-time distributions of rats trained on variable-interval 300-s and differential-reinforcement-of-low-rate 72-s schedules of reinforcement. In Experiment 2 peak deviation analysis differentiated between the effects of the psychomotor stimulant d-amphetamine, the anxiolytic compound chlordiazepoxide, and the antidepressant desipramine. The results suggest that peak deviation analysis of interresponse-time distributions may provide a useful behavioral assay system for characterizing the effects of drugs.     

Stimulus generalization, discrimination learning, and peak shift in horses.

Using horses, we investigated three aspects of the stimulus control of lever-pressing behavior: stimulus generalization, discrimination learning, and peak shift. Nine solid black circles, ranging in size from 0.5 in. to 4.5 in. (1.3 cm to 11.4 cm) served as stimuli. Each horse was shaped, using successive approximations, to press a rat lever with its lip in the presence of a positive stimulus, the 2.5-in. (6.4-cm) circle. Shaping proceeded quickly and was comparable to that of other laboratory organisms. After responding was maintained on a variable-interval 30-s schedule, stimulus generalization gradients were collected from 2 horses prior to discrimination training. During discrimination training, grain followed lever presses in the presence of a positive stimulus (a 2.5-in circle) and never followed lever presses in the presence of a negative stimulus (a 1.5-in. [3.8-cm] circle). Three horses met a criterion of zero responses to the negative stimulus in fewer than 15 sessions. Horses given stimulus generalization testing prior to discrimination training produced symmetrical gradients; horses given discrimination training prior to generalization testing produced asymmetrical gradients. The peak of these gradients shifted away from the negative stimulus. These results are consistent with discrimination, stimulus generalization, and peak-shift phenomena observed in other organisms.     

Within-session changes in responding during concurrent schedules with different reinforcers in the components.

Rats and pigeons responded on several concurrent schedules that provided different reinforcers in the two components (food and water for rats, Experiment 1; wheat and mixed grain for pigeons, Experiment 2). The rate of responding and the time spent responding on each component usually changed within the session. The within-session changes in response rates and time spent responding usually followed different patterns for the two components of a concurrent schedule. For most subjects, the bias and sensitivity to reinforcement parameters of the generalized matching law, as well as the percentage of the variance accounted for, decreased within the session. Negative sensitivity parameters were sometimes found late in the session for the concurrent food-water schedules. These results imply that within-session changes in responding could cause problems for assessing the validity of quantitative theories of concurrent-schedule responding when the components provide different reinforcers. They question changes in a general motivational state, such as arousal, as a complete explanation for within-session changes in responding. The results are compatible with satiation for, or sensitization-habituation to, the reinforcers as explanations.     

Relationship between response rate and reinforcement frequency in variable-interval schedules: II. Effect of the volume of sucrose reinforcement

Three rats were exposed to variable-interval schedules specifying a range of different reinforcement frequencies, using three different volumes of .32 molar sucrose (.10, .05, and .02 milliliters) as the reinforcer. With each of the three volumes, the rates of responding of all three rats were increasing, negatively accelerated functions of reinforcement frequency, the data conforming closely to Herrnstein's equation. In each rat the value of the constant K_H, which expresses the reinforcement frequency needed to obtain the half-maximal response rate, increased with decreasing reinforcer volume, the values obtained with .02 milliliters being significantly greater than the values obtained with .10 milliliters. The values of the constant R_max, which expresses the theoretical maximum response rate, were not systematically related to reinforcer volume. The effect of reinforcer volume upon the relationship between response rate and reinforcement frequency is thus different from the effect of the concentration of sucrose reinforcement: In a previous experiment (Bradshaw, Szabadi, & Bevan, 1978) it was found that sucrose concentration influenced the values of both constants, R_max increasing and K_H decreasing with increasing sucrose concentration.     

Responding under sequence schedules of electric shock presentation

Lever pressing by squirrel monkeys was examined under second-order schedules of electric shock presentation in which different discriminative stimuli were associated with consecutive components (sequence schedules). Components were always two-minute fixed-interval schedules, and three different overall schedules were studied. Under an overall eight-minute fixed-interval schedule, the first component completion after at least eight minutes had elapsed produced electric shock. The number of components actually completed ranged from one to four; thus, different discriminative stimuli were occasionally associated with electric shock presentation. Under an overall “yoked” variable-ratio schedule, electric shock was presented after completion of a variable number of components; the required number and the distribution of components were matched to those obtained under the overall eight-minute fixed-interval schedule. Under an overall fixed-ratio schedule, electric shock was presented after completion of four components (chained schedule). Under all three sequence schedules, responding in early components was characterized by a pause followed by a single response after the end of the two-minute interval; responding in later components was characterized by a shorter pause followed by positively accelerated responding. Manipulation of overall schedules of shock presentation in these complex behavioral situations produced changes in responding comparable to those ordinarily obtained after similar manipulation of dependencies under both single and second-order schedules of food presentation. These experiments extend the range of conditions and levels of complexity under which responding can be maintained by presentation of electric shock.     

Effects of d-amphetamine, cocaine, and phencyclidine on the acquisition of response sequences with and without stimulus fading.

In each of three components of a multiple schedule, monkeys were required to emit a different sequence of four responses in a predetermined order on four levers. Sequence completions produced food on a fixed-ratio schedule. Errors produced a brief timeout. One component of the multiple schedule was a repeated-acquisition task where the four-response sequence changed each session (learning). The second component of the multiple schedule was also a repeated-acquisition task, but acquisition was supported through the use of a stimulus-fading procedure (faded learning). In a third component of the multiple schedule, the sequence of responses remained the same from session to session (performance). At higher doses, d-amphetamine, cocaine, and phencyclidine decreased the overall rate of responding and increased the percent errors in all three components. At lower doses, however, the three drugs produced selective effects on errors. Errors were increased in the learning component at lower doses than those required to disrupt the behavior in the faded-learning component. The performance component tended to be the least sensitive to disruptive drug effects. The data are consistent with the view that stimulus fading can modulate the effects of drugs on acquisition.     

An inverse relationship between baseline fixed-interval response rate and the effects of a tandem response requirement.

Previous experiments examining the effects of adding a tandem fixed-ratio response requirement on fixed-interval schedule performance have reported inconsistent results. One variable that may account for such inconsistencies is the baseline response rate in the fixed-interval condition. This possibility was investigated in the present study. Rats were given histories with either interresponse times greater than 11 s or fixed-ratio 40 schedules of reinforcement, which engendered either relatively low or high rates of responding, respectively, in the subsequent fixed-interval condition. A tandem ratio response requirement (fixed-ratio 9) was then introduced. The effects of adding this tandem response requirement were inversely related to the baseline fixed-interval response rates; low rates of responding in the fixed-interval condition were markedly increased, whereas high rates of responding were relatively unaffected. This inverse relationship appears to be similar to the rate-dependent relations observed in behavioral pharmacology. These results may provide an explanation for the inconsistent findings reported in previous studies on tandem fixed-interval fixed-ratio schedules and suggest that principles of behavioral pharmacology research may be applicable to the study of the effects of nonpharmacological variables on schedule-controlled behavior.     

Acquisition of lever-press responding in rats with delayed reinforcement: A comparison of three procedures

The present study examined the acquisition of lever pressing in rats under three procedures in which food delivery was delayed by 4, 8, and 16 seconds relative to the response. Under the nonresetting delay procedure, food followed the response selected for reinforcement after a specified interval elapsed; responses during this interval had no programmed effect. Under the resetting procedure, the response selected for reinforcement initiated an interval to food delivery that was reset by each subsequent response. Under the stacked delay procedure, every response programmed delivery of food t seconds after its occurrence. Two control groups were studied, one that received food immediately after each lever press and another that never received food. With the exception of the group that did not receive food, responding was established with every procedure at every delay value without autoshaping or shaping. Although responding was established under the resetting delay procedure, response rates were generally not as high as under the other two procedures. These findings support the results of other recent investigations in demonstrating that a response not previously reinforced can be brought to strength by delayed reinforcement in the absence of explicit training.