Electric shock produced drinking in the squirrel monkey.

Squirrel monkeys were periodically exposed to brief electric tail shocks in a test environment containing a rubber hose, response lever, and a water spout. Shock delivery produced preshock lever pressing and postshock hose biting. Additionally, all subjects displayed licking responses following postshock biting-attack episodes. Further experiments showed that licking was: (1) influenced by hours of water deprivation; (2) drinking behavior; (3) the direct result of shock delivery; and (4) developed spontaneously in naive subjects with or without opportunities for hose biting or lever pressing. Removing the opportunity to attack increased postshock drinking. A noxious environmental stimulus that causes aggression can also produce drinking.     

The effect of rearing environments on the contrafreeloading phenomenon in rats

Eight naive rats were reared in enriched or impoverished environments for 39 days after weaning and then lived in operant chambers, in which they could obtain food pellets freely or by lever pressing, for 25 or 30 days. The animals raised in an impoverished environment acquired the bar-press response quickly when placed in the operant chambers and maintained a preference for obtaining food via bar pressing. Animals raised in an enriched environment did not learn to lever press, as demonstrated by low levels of responding and the lack of bar pressing when free food was subsequently removed. It was concluded that restricting animals' postweaning environments facilitated learning in a choice situation, probably because of increased activity levels. The results are interpreted in relation to previous studies on rearing environments and on contrafreeloading.     

Force and rate relations in responding during variable-interval reinforcement

Four rats responded on one-minute variable-interval schedules with several variations in peak-force of response required for food reinforcement. Measures of peak force and rate were taken for the responses, which were the downward exertions of force against a static force-transducing operandum. The analysis distinguished responses, a generic class of measured behavior, from criterion responses, an operationally specified subclass required for reinforcement. Absolute rate of response showed no systematic change, but the rate of responses meeting a newly required criterion of peak-force invariably increased through changes in the absolute rate of response, the relative-frequency distributions of peak force, or some combination of both. The relative frequency of responses meeting an elevated force criterion during variable-interval reinforcement exceeded that maintained with the same criterion with continuous reinforcement. The requirement of more effortful responding for reinforcement does not necessarily reduce response rate. Conformity of the behavior to the requirement for reinforcement is the salient effect.     

Alternative response training, differential reinforcement of other behavior, and extinction in squirrel monkeys (Saimiri sciureus)

In Experiment I, (a) extinction, (b) extinction plus reinforcement of a discrete alternative response, and (c) differential reinforcement of other behavior were each correlated with a different stimulus in a three-component multiple schedule. The alternative-response procedure more rapidly and completely suppressed behavior than did differential reinforcement of other behavior. Differential reinforcement of other behavior was slightly more effective than extinction alone. In Experiment II, reinforcement of specific alternative behavior during extinction and differential reinforcement of other behavior were used in two components, while one component continued to provide reinforcement for the original response. Once again, the alternative-response procedure was most effective in reducing responding as long as it remained in effect. However, the responding partially recovered when reinforcement for competing behavior was discontinued. In general, responding was less readily reduced by differential reinforcement of other behavior than by the specific alternative-response procedure.     

Social preference in rats

Rats were given repeated choices between social and nonsocial outcomes, and between familiar and unfamiliar social outcomes. Lever presses on either of 2 levers in the middle chamber of a 3-chamber apparatus opened a door adjacent to the lever, permitting 45-s access to social interaction with the rat in the chosen side chamber. In Experiment 1, rats preferred (a) social over nonsocial options, choosing their cagemate rat over an empty chamber, and (b) an unfamiliar over a familiar rat, choosing a non-cagemate over their cagemate. These findings were replicated in Experiment 2 with 2 different non-cagemate rats. Rats preferred both non-cagemate rats to a similar degree when pitted against their cagemate, but were indifferent when the 2 non-cagemates were pitted against each other. Similar preference for social over nonsocial and non-cagemate over cagemate was seen in Experiment 3, with new non-cagemate rats introduced after every third session. Response rates (for both cagemate and non-cagemate rats) were elevated under conditions of nonsocial (isolated) housing compared to conditions of social (paired) housing, demonstrating a social deprivation effect. Together, the experiments contribute to an experimental analysis of social preference within a social reinforcement framework, drawing on methods with proven efficacy in the analysis of reinforcement more generally.     

Within-session Changes In Responding During Concurrent Variable-interval Schedules

Five rats and 4 pigeons responded for food delivered by several concurrent variable-interval schedules. The sum of the rates of reinforcement programmed for the two components varied from 15 to 480 reinforcers per hour in different conditions. Rates of responding usually changed within the experimental session in a similar manner for the two components of each concurrent schedule. The within-session changes were similar to previously reported changes during simple schedules that provided rates of reinforcement equal to the sum of all reinforcers obtained from the concurrent schedules. The number of changeovers also changed within sessions in a manner similar to the changes in instrumental responding. These results suggest that changeovers are governed by the same variables that govern instrumental responding. They also suggest that the within-session change in responding during each component of a concurrent schedule is determined by approximately the sum of the reinforcers obtained from both components when both components provide the same type of reinforcer.     

Effects of reinforcement history on response rate and response pattern in periodic reinforcement

Several researchers have suggested that conditioning history may have long-term effects on fixed-interval performances of rats. To test this idea and to identify possible factors involved in temporal control development, groups of rats initially were exposed to different reinforcement schedules: continuous, fixed-time, and random-interval. Afterwards, half of the rats in each group were studied on a fixed-interval 30-s schedule of reinforcement and the other half on a fixed-interval 90-s schedule of reinforcement. No evidence of long-term effects attributable to conditioning history on either response output or response patterning was found; history effects were transitory. Different tendencies in trajectory across sessions were observed for measures of early and late responding within the interreinforcer interval, suggesting that temporal control is the result of two separate processes: one involved in response output and the other in time allocation of responding and not responding.     

Tolerance to and residual effects of cocaine in squirrel monkeys depend on reinforcement-schedule parameter.

Lever pressing by 4 squirrel monkeys was maintained under a three-component multiple fixed-ratio schedule of food presentation; components differed with respect to ratio size. For each monkey, acute administration of cocaine (0.03 to 1.3 mg/kg, i.m.) produced dose-dependent decreases in overall response rate in each component. During repeated daily administration of 1.0 mg/kg of cocaine, tolerance developed to the rate-decreasing effects under each of the ratio contingencies, but developed to a greater extent and was evident in earlier parts of sessions for performance under the smaller ratios. Response rates of 2 monkeys increased above nondrug control levels despite the putative reinforcer not being consumed during the session. When saline or a smaller dose of cocaine was substituted for 1.0 mg/kg, response rates often were suppressed below nondrug control-level responding. This suppressive effect was observed in each monkey and was more likely to be observed and/or to be of greater magnitude in large-ratio components for 3 of the 4 monkeys. When saline was administered chronically at the end of the chronic-drug phase, response rates remained suppressed in the large-ratio component for 2 of the monkeys. There was, therefore, a schedule-dependent dissociation between behavioral tolerance and the residual effects: Tolerance was greater when small ratios were arranged, whereas the residual effects were more pronounced when larger ratios were arranged.     

EFFECT OF REINFORCER MAGNITUDE ON PERFORMANCE MAINTAINED BY PROGRESSIVE‐RATIO SCHEDULES

This experiment examined the relationship between reinforcer magnitude and quantitative measures of performance on progressive‐ratio schedules. Fifteen rats were trained under a progressive‐ratio schedule in seven phases of the experiment in which the volume of a 0.6‐M sucrose solution reinforcer was varied within the range 6–300 μl. Overall response rates in successive ratios conformed to a bitonic equation derived from Killeen's (1994) Mathematical Principles of Reinforcement. The “specific activation” parameter, a, which is presumed to reflect the incentive value of the reinforcer, was a monotonically increasing function of reinforcer volume; the “response time” parameter, δ, which defines the minimum response time, increased as a function of reinforcer volume; the “currency” parameter, b, which is presumed to reflect the coupling of responses to the reinforcer, declined as a function of volume. Running response rate (response rate calculated after exclusion of the postreinforcement pause) decayed monotonically as a function of ratio size; the index of curvature of this function increased as a function of reinforcer volume. Postreinforcement pause increased as a function of ratio size. Estimates of a derived from overall response rates and postreinforcement pauses showed a modest positive correlation across conditions and between animals. Implications of the results for the quantification of reinforcer value and for the use of progressive‐ratio schedules in behavioral neuroscience are discussed.     

The long-term effect of high- and low-rate responding histories on fixed-interval responding in rats

Tell rats were given extended lever-press training on a fixed-interval (FI) 30-s food reinforcement schedule from the outset or following exposure to one or two previous reinforcement schedules. For 4 rats the previots schedule was either fixed-ratio 20, which generated high response rates, or differential-reinforcement-of-low-rate 20 s, which produced low response rates. For 4 additional rats the extended training on FI 30 s was preceded by experience with two schedules: fixed-ratio 20 followed by differential-reinforcement-of-low-rate 20 s; or the same two schedules in the reverse order. Fixed-interval response rates were initially affected by the immediately preceding schedule, but after 80 to 100 sessions, all traces of prior schedule history had disappeared. The results also showed no long-term effect of schedule history on the interfood-interval patterns of responding on the FI 30-s schedule. These results support one of the most central tenets of the experimental analysis of behavior: control by the immediate consequences of behavior.