Tolerance to and residual effects of cocaine in squirrel monkeys depend on reinforcement-schedule parameter.

Lever pressing by 4 squirrel monkeys was maintained under a three-component multiple fixed-ratio schedule of food presentation; components differed with respect to ratio size. For each monkey, acute administration of cocaine (0.03 to 1.3 mg/kg, i.m.) produced dose-dependent decreases in overall response rate in each component. During repeated daily administration of 1.0 mg/kg of cocaine, tolerance developed to the rate-decreasing effects under each of the ratio contingencies, but developed to a greater extent and was evident in earlier parts of sessions for performance under the smaller ratios. Response rates of 2 monkeys increased above nondrug control levels despite the putative reinforcer not being consumed during the session. When saline or a smaller dose of cocaine was substituted for 1.0 mg/kg, response rates often were suppressed below nondrug control-level responding. This suppressive effect was observed in each monkey and was more likely to be observed and/or to be of greater magnitude in large-ratio components for 3 of the 4 monkeys. When saline was administered chronically at the end of the chronic-drug phase, response rates remained suppressed in the large-ratio component for 2 of the monkeys. There was, therefore, a schedule-dependent dissociation between behavioral tolerance and the residual effects: Tolerance was greater when small ratios were arranged, whereas the residual effects were more pronounced when larger ratios were arranged.     

Choice as a function of local versus molar reinforcement contingencies.

Rats were trained on a discrete-trial probability learning task. In Experiment 1, the molar reinforcement probabilities for the two response alternatives were equal, and the local contingencies of reinforcement differentially reinforced a win-stay, lose-shift response pattern. The win-stay portion was learned substantially more easily and appeared from the outset of training, suggesting that its occurrence did not depend upon discrimination of the local contingencies but rather only upon simple strengthening effects of individual reinforcements. Control by both types of local contingencies decreased with increases in the intertrial interval, although some control remained with intertrial intervals as long as 30 s. In Experiment 2, the local contingencies always favored win-shift and lose-shift response patterns but were asymmetrical for the two responses, causing the molar reinforcement rates for the two responses to differ. Some learning of the alternation pattern occurred with short intertrial intervals, although win-stay behavior occurred for some subjects. The local reinforcement contingencies were discriminated poorly with longer intertrial intervals. In the absence of control by the local contingencies, choice proportion was determined by the molar contingencies, as indicated by high exponent values for the generalized matching law with long intertrial intervals, and lower values with short intertrial intervals. The results show that when molar contingencies of reinforcement and local contingencies are in opposition, both may have independent roles. Control by molar contingencies cannot generally be explained by local contingencies.     

Economic substitutability of electrical brain stimulation, food, and water.

Concurrent variable-ratio schedules of electrical brain stimulation, food, and water were paired in various combinations as reinforcement of rats' lever presses. Relative prices of the concurrent reinforcers were varied by changing the ratio of the response requirements on the two levers. Economic substitutability, measured by the sensitivity of response ratio to changes in relative price, was highest with brain stimulation reinforcement of presses on both levers and lowest with food reinforcement of presses on one lever and water reinforcement of presses on the other. Substitutability with brain stimulation reinforcement of presses on one lever and either food or water reinforcement for presses on the other was about as high as with brain stimulation for presses on both levers. Electrical brain stimulation for rats may thus serve as an economic substitute for two reinforcers, neither of which is substitutable for the other.     

Human performance on conjunctive fixed-interval fixed-ratio schedules

Eighteen young adults performed a lever-pulling task for money. Subjects were initially exposed to a fixed-interval 80-second schedule and subsequently to one of three conjunctive schedules in which the added fixed-ratio requirement was set at either 10, 80, or 120 responses. Three fixed-interval response patterns emerged: high constant rate, intermediate rate, or low rate, with most subjects displaying the last. Conjunctive performance was related to the subjects' prior fixed-interval patterns and the conjunctive ratio requirements. Low-rate subjects tended to optimize reinforcement (maximum reinforcers for minimum responses) on conjunctive schedules. Response rate was directly related to ratio requirements. Subjects' performance closely corresponded to their verbal statements of the contingencies.     

Spaced food but not electrical brain stimulation induces polydipsia and air licking.

An attempt was made to induce polydipsia in rats whose lever pressing was reinforced with food pellets or electrical brain stimulation. Nine food-deprived, water-sated rats drank water excessively during sessions in which food pellets were delivered. When brain stimulation was substituted for food, drinking immediately ceased. Delivering brain stimulation according to a variety of schedules, pairing brain stimulation with food reinforcement, and substituting an air stream for water, each failed to produce polydipsic licking. These results show that polydipsia is not induced by all reinforcers.     

Demand for food on fixed-ratio schedules as a function of the quality of concurrently available reinforcement

Six rats lever pressed for food on concurrent fixed-ratio schedules, in a two-compartment chamber. In one compartment, mixed diet pellets were delivered on fixed-ratio schedules of 1, 6, 11, and 16; in the other, either no food was delivered, or sucrose or mixed diet pellets were delivered on fixed-ratio 8. The number of pellets obtained in the first compartment declined as a function of fixed-ratio size in that compartment in all three conditions, but the decline was greatest overall with mixed diet pellets concurrently available in the other compartment, and least with no food concurrently available. The result is discussed in terms of economic demand theory, and is consistent with the prediction that elasticity of demand for a commodity (defined in operant terms as the ratio of the proportionate change in number of reinforcements per session to the proportionate change in fixed-ratio size) is greater the more substitutable for that commodity are any concurrently available commodities.     

Effects of food deprivation and reinforcement magnitude on conditioned suppression

In Experiment I, the responding of rats lever pressing on a variable-interval schedule for sucrose solution was partially suppressed by a variable duration conditioned stimulus followed by shock. When food deprivation was increased, response rates during and before the conditioned stimulus increased monotonically. Varying the concentration of sucrose across blocks of sessions or from session to session in a semi-random sequence had little effect on response rates either before or during the conditioned stimulus. With a fixed sequence of increasing concentrations across a five-session block, increased concentration produced much more rapid increases in response rates before than during the conditioned stimulus. In Experiment II, rats were presented with the same sequence of increasing concentrations across a five-session block. When tested at 80% body weight, response rates increased rapidly as concentration increased, but at 100%, body-weight rates increased only slightly. The effect of a change in body weight in Experiment II thus mimicked the effect of the conditioned stimulus in the latter part of Experiment I. These findings support the view that the effect of a pre-aversive conditioned stimulus is similar to that of a change in food deprivation, but unlike that of a change in reinforcement magnitude.     

Electric shock produced drinking in the squirrel monkey.

Squirrel monkeys were periodically exposed to brief electric tail shocks in a test environment containing a rubber hose, response lever, and a water spout. Shock delivery produced preshock lever pressing and postshock hose biting. Additionally, all subjects displayed licking responses following postshock biting-attack episodes. Further experiments showed that licking was: (1) influenced by hours of water deprivation; (2) drinking behavior; (3) the direct result of shock delivery; and (4) developed spontaneously in naive subjects with or without opportunities for hose biting or lever pressing. Removing the opportunity to attack increased postshock drinking. A noxious environmental stimulus that causes aggression can also produce drinking.     

The effect of rearing environments on the contrafreeloading phenomenon in rats

Eight naive rats were reared in enriched or impoverished environments for 39 days after weaning and then lived in operant chambers, in which they could obtain food pellets freely or by lever pressing, for 25 or 30 days. The animals raised in an impoverished environment acquired the bar-press response quickly when placed in the operant chambers and maintained a preference for obtaining food via bar pressing. Animals raised in an enriched environment did not learn to lever press, as demonstrated by low levels of responding and the lack of bar pressing when free food was subsequently removed. It was concluded that restricting animals' postweaning environments facilitated learning in a choice situation, probably because of increased activity levels. The results are interpreted in relation to previous studies on rearing environments and on contrafreeloading.     

Force and rate relations in responding during variable-interval reinforcement

Four rats responded on one-minute variable-interval schedules with several variations in peak-force of response required for food reinforcement. Measures of peak force and rate were taken for the responses, which were the downward exertions of force against a static force-transducing operandum. The analysis distinguished responses, a generic class of measured behavior, from criterion responses, an operationally specified subclass required for reinforcement. Absolute rate of response showed no systematic change, but the rate of responses meeting a newly required criterion of peak-force invariably increased through changes in the absolute rate of response, the relative-frequency distributions of peak force, or some combination of both. The relative frequency of responses meeting an elevated force criterion during variable-interval reinforcement exceeded that maintained with the same criterion with continuous reinforcement. The requirement of more effortful responding for reinforcement does not necessarily reduce response rate. Conformity of the behavior to the requirement for reinforcement is the salient effect.