The effects of punishment intensity on squirrel monkeys

Responses of squirrel monkeys were maintained by a variable-interval schedule of food reinforcement. Concurrently, punishment consisting of a brief electric shock followed each response. As has been found for pigeons and rats, punishment did not produce extreme, all-or-none reactions. By gradually increasing the punishment intensity it was possible to produce response rates intermediate to no suppression and complete suppression. Similarly, the moment-to-moment response rate was free of extreme fluctuations. A “warm-up” effect occurred in which the punished responses were especially suppressed during the initial part of a session. The pre-punishment performance was negatively accelerated within a session, and punishment reduced the degree of negative acceleration. When punishment was discontinued, responding recovered immediately except when suppression had been complete or prolonged. When the punishment intensity was decreased gradually, more suppression resulted at a given intensity than when intensity was increased gradually. This suggests a “behavioral inertia” effect wherein behavior at a new punishment intensity is biased toward the behavior at the previous value. A corollary generalization is that the larger the change in intensity, the less the behavior at the new value will be biased toward the behavior at the previous value.     

Observing behavior in squirrel monkeys under a multiple schedule of reinforcement availability

Observing behavior of two squirrel monkeys was examined under a multiple schedule of four components. Lever (observing) responses produced either a stimulus indicating the availability of food or another stimulus indicating food was not available. Key responses in the presence of the food-available stimulus produced food on a continuous reinforcement schedule. In the absence of food-available stimuli, responding on the key had no scheduled consequences. Observing responses produced food-available stimuli according to three different random-interval schedules with mean interstimulus availability times of 1, 2, and 4 min. In the fourth component of the multiple schedule (observing extinction) food-available stimuli never occurred. Each component of the schedule was correlated with a distinctive auditory stimulus. Observing rates decreased with decreasing frequency of the food-available stimulus. Observing rates during extinction continued decreasing when the brief stimulus indicating food unavailability was no longer produced by lever pressing. When the brief stimulus was reinstated response rates increased abruptly.     

Interactions in multiple schedules: negative induction with squirrel monkeys

In Experiment I, lever pressing by squirrel monkeys was maintained under a sequence of variable-interval, multiple variable-interval variable-interval, and multiple variable-interval extinction schedules of food presentation. Negative induction (decreased responding in the unchanged component) occurred when one component of the multiple variable-interval variable-interval schedule was changed to extinction. Negative induction was transient over sessions; responding in the unchanged component usually recovered to a rate similar to that under the multiple variable-interval variable-interval schedule. Negative induction was not accompanied by consistent changes in the patterns of local responding within the unchanged component, and did not depend on whether component schedules were associated with localized (lever lights) or diffuse visual stimuli (houselights), or on whether the unchanged component was a 60- or 180-sec variable-interval schedule. In Experiment II, responding was maintained under a sequence of variable-interval and multiple variable-interval timeout schedules of food presentation. Negative induction occurred when responding declined gradually in the timeout component but not when responding declined abruptly. The nature of interactions in multiple schedules may depend on the species; negative induction was observed with squirrel monkeys under conditions similar to those that produce positive contrast with pigeons.     

Maintenance of responding by squirrel monkeys under a concurrent shock-postponement, fixed-interval shock-presentation schedule.

A chain-pulling response was initially developed under a shock-postponement (avoidance) schedule with two squirrel monkeys. Few responses occurred on a lever where responding initially had no scheduled consequence or, subsequently, when a 3-minute fixed-interval shock-presentation schedule was concurrently arranged for lever responses. Appropriate rates and patterns of lever responding developed and were later maintained under the fixed-interval 3-minute shock-presentation schedule alone when the chain and shock-postponement schedule were removed. When both the shock-postponement and shock-presentation schedules were again simultaneously in effect, steady rates of chain pulling were maintained by the shock-postponement schedule and positively accelerated rates and patterns were maintained on the lever by the shock-presentation schedule. Response rates under both schedules were directly related to shock intensity. A history of exposure to a shock-postponement schedule, even though with a topographically different response and manipulandum, was sufficient for the development and eventual maintenance of responding by the presentation of shock. Further, differential performances can be maintained simultaneously by the presentation and postponement of electric shock.     

Time-dependent contrast effects in a multiple schedule of food reinforcement

Four rats were rewarded for running in a wheel under two alternating conditions of food reinforcement. These periods of frequent and infrequent reinforcement, each accompanied by a particular stimulus, were presented a number of times in each daily session. Following shifts from high to low frequency of reinforcement, responding decreased suddenly and markedly, and then recovered within the next few minutes. The magnitude of this temporary depression was an increasing function of the duration of the immediately preceding component of high-frequency reinforcement. A transient elevation in performance, which did not vary with the duration of the prior component, was noted in two subjects following shifts from low to high frequency of reinforcement. The elevation and depression effects did not appear simultaneously during the 48 experimental sessions. A possible relation between the difficulty of the discrimination and the extent of contrast effects is discussed.     

Learning due to the response-shock contingency in signalled punishment

Three experiments examined some of the parameters that affect the degree of response-specific learning in signalled punishment. Each of the experiments used a within-subject procedure in which the shocks received in the presence of a stimulus signalling response-independent shocks (CER) were yoked to the number and distribution of shocks received in a stimulus signalling punishment. Experiments 1 and 2 used different values of variable-interval (VI) or fixed-ratio (FR) schedules of shock priming, respectively, during the punishment stimulus, and Experiment 3 varied the delay of punishment. The results of all three experiments supported the conclusion that the degree of additional suppression produced by the response contingency during the punishment stimulus compared to the CER stimulus was a function of the strength of contingency between the response and the shock.     

Effects of a DRL contingency added to a fixed-interval reinforcement schedule

Following 30 days of reinforcement for the bar press response of two white rats on 30-sec fixed-interval (FI), a DRL component was added so that a minimal interresponse time (IRT) for the reinforced response, in addition to the FI variable, was necessary for reinforcement. Marked control over response rate by the superimposed DRL requirement was demonstrated by an inverse hyperbolic function as the DRL component was increased from 1 to 24 sec within the constant 30-sec FI interval. Interresponse time and post-reinforcement (post-S^R) “break” distributions taken at one experimental point (DRL = 24 sec) suggested that a more precise temporal discrimination was initiated by an S^R than by a response, since the relative frequency of a sequence of two reinforced responses appeared greater than that of a sequence of a non-reinforced response followed by a reinforced one. This latter finding was confirmed with new animals in a follow-up experiment employing a conventional 24-sec DRL schedule.     

Delayed reinforcement in a multiple schedule

Three rats and a pigeon were first trained on a two-component multiple schedule in which reinforcement in the two components occurred immediately after a response. Later, reinforcement in one component was delayed by a few seconds. During both stages of the experiment, reinforcement was scheduled by equal variable- (pigeon) or random-interval (rats) schedules in the two components. The main effect of the delayed reinforcement was to increase the rate of responding in the unchanged (non-delay) component. This behavioral contrast effect did not appear in all cases to be dependent upon a reduction in the rate of responding or the frequency of reinforcement in the delay component. This finding suggests that a reduction in response rate and/or reinforcement frequency in one component of a multiple schedule may not be a necessary prerequisite for the occurrence of behavioral contrast. This finding is, however, consistent with an explanation that suggests that behavioral contrast results from the introduction of a less-preferred condition in one component of a multiple schedule, since it is known that animals “prefer” immediate to delayed reinforcement.     

The effects of unavoidable shocks on a multiple schedule having an avoidance component

Two dogs were maintained on a multiple schedule having both a food reinforced and an avoidance component (Mult VI 1′ S^Δ Avoid_{SS20 RS20} S^Δ). The effects of superimposing an Estes-Skinner procedure for delivering unavoidable shocks on all components of the multiple schedule were observed. The buzzer-shock pairing of the Estes-Skinner procedure produced an increased rate of responding on the avoidance component of the schedule and also on the S^Δ components. No persistent change in rate was observed on the food component during the pre-shock stimulus. Control performances on all components could be regained by either extinguishing or eliminating the buzzer-shock pairing. Extinction of the avoidance responding had little effect on the increased rates of responding produced by the Estes-Skinner procedure on the S^Δ and avoidance extinction components and did not lead to a conditioned suppression of the food reinforced responding. Rate of responding during the pre-shock stimulus was observed to be relatively independent of changes in the maintaining schedules. Responding during the pre-shock stimulus could be conditioned and maintained after an extensive history of avoidance extinction.     

Autoshaping and automaintenance of a key-press response in squirrel monkeys

Following exposure for a minimum of 500 to 600 trials, three of four naive squirrel monkeys eventually pressed a response key, illumination of which always preceded delivery of a food pellet. Three other naive monkeys did not press the key when the pellets were delivered randomly with respect to key illumination. Despite some similarities to autoshaping using pigeons, the data indicate many points of difference when squirrel monkeys are used as subjects. Although key-food pairings were shown to be important in the acquisition of the key-press response, they were ineffective in maintaining the response when either a negative response-reinforcer dependency was introduced, or when there was no scheduled response-reinforcer dependency (fixed trial). Not all demonstrations of autoshaping can be considered to be under the control of those processes that are primarily responsible for the phenomena obtained in pigeons.     

Tolerance to and residual effects of cocaine in squirrel monkeys depend on reinforcement-schedule parameter.

Lever pressing by 4 squirrel monkeys was maintained under a three-component multiple fixed-ratio schedule of food presentation; components differed with respect to ratio size. For each monkey, acute administration of cocaine (0.03 to 1.3 mg/kg, i.m.) produced dose-dependent decreases in overall response rate in each component. During repeated daily administration of 1.0 mg/kg of cocaine, tolerance developed to the rate-decreasing effects under each of the ratio contingencies, but developed to a greater extent and was evident in earlier parts of sessions for performance under the smaller ratios. Response rates of 2 monkeys increased above nondrug control levels despite the putative reinforcer not being consumed during the session. When saline or a smaller dose of cocaine was substituted for 1.0 mg/kg, response rates often were suppressed below nondrug control-level responding. This suppressive effect was observed in each monkey and was more likely to be observed and/or to be of greater magnitude in large-ratio components for 3 of the 4 monkeys. When saline was administered chronically at the end of the chronic-drug phase, response rates remained suppressed in the large-ratio component for 2 of the monkeys. There was, therefore, a schedule-dependent dissociation between behavioral tolerance and the residual effects: Tolerance was greater when small ratios were arranged, whereas the residual effects were more pronounced when larger ratios were arranged.     

Measurement of social dominance in squirrel monkeys

Several laboratory methods for measuring social dominance in squirrel monkeys are described.     

Hunger and contrast in a multiple schedule

Pigeons working for food on a multiple variable-interval 1-min-variable-interval 4-min schedule were subjected to variations in body weight, presumably causing changes in hunger. The proportion of responses in each component approached and eventually reached the proportion of reinforcements as body weight increased. This effect follows from the matching-law interpretation of contrast in multiple schedules.     

Drug discrimination under a concurrent schedule.

Three pigeons were trained to discriminate a 5.0 mg/kg dose of pentobarbital from saline under a two-key concurrent schedule with responding on the key associated with the presession injection, under both stimulus conditions, producing four times as many reinforcers as responding on the other key. This concurrent schedule resulted in approximately 70% responding to the higher reinforcement key under the pentobarbital stimulus and approximately 30% responding to that key under the saline stimulus. During testing, then, the pigeons were able to dose-dependently emit higher (>70%) or lower (<30%) values than were established under the control conditions. Dose-response curves were determined for pentobarbital (twice), methamphetamine, phencyclidine, chlordiazepoxide, and the combination of pentobarbital and the barbiturate antagonist bemegride. The results obtained with pentobarbital and chlordiazepoxide showed that, as the dose increased, pentobarbital-appropriate responding also increased. Methamphetamine produced relatively flat dose--response curves, whereas phencyclidine administration produced inconsistent effects on responding. The combination of the training dose of pentobarbital with increasing doses of bemegride produced a decrease in pentobarbital-appropriate responding. The results also showed that the dose-response curves for pentobarbital and chlordiazepoxide, instead of being all or none, were graded functions of the drug dose.