Responding in the squirrel monkey under fixed-ratio schedules of stimulus termination

Key pressing was maintained under a fixed-ratio schedule in which electric shock was scheduled for delivery at a fixed time (t seconds) after each stimulus onset, and every n^th response terminated the stimulus and initiated a timeout from shock. Under this procedure, the higher the rate of responding, the briefer the duration of the stimulus presentation and the lower the frequency of shock delivery. The effects of several schedule parameters were studied to determine whether the maintenance of responding was dependent on an inverse relation between response rate and shock frequency. Shock rate and shock frequency were made independent of response rate by decreasing the value of t to 0.5 second and delivering shock only during the first presentation of the stimulus after a fixed time, including stimulus and timeout durations, had elapsed since the previous shock. The experiments showed that shock frequency and response rate are inversely related when t is of relatively long duration compared to the value of the fixed-ratio parameter, but that a decrease in shock rate or frequency due to a high rate of responding is not necessary for the maintenance of responding under a fixed-ratio schedule of stimulus termination.     

Brief exposure to contingent reinforcement produces a sustained increment in the strength of an elicited response.

Squirrel monkeys' lever pressing produced by response-independent shock was measured before, and for an extended period following, exposure to a shock-avoidance procedure. Following avoidance training, the frequency of responding increased by multiples of 10 to 50 across subjects and evidence little or no decrement for up to 6 months of postreinforcement testing. Manual responding produced by intense environmental stimulation may be substantially strengthened by a brief history of reinforcement, such that it is sustained over long periods without reinforcement.     

Avoidance based on shock intensity reduction with no change in shock probability

Rats were trained on a free-operant avoidance procedure in which shock intensity was controlled by interresponse time. Shocks were random at a density of about 10 shocks per minute. Shock probability was response independent. As long as interresponse times remained less than the limit in effect, any shocks received were at the lower of two intensities (0.75 mA). Whenever interresponse times exceeded the limit, any shocks received were at the higher intensity (1.6 mA). The initial limit of 15 seconds was decreased in 3-second steps to either 6 or 3 seconds. All animals lever pressed to avoid higher intensity shock. As the interresponse time limit was reduced, the response rate during the lower intensity shock and the proportion of brief interresponse times increased. Substantial warmup effects were evident, particularly at the shorter interresponse-time limits. Shock intensity reduction without change in shock probability was effective in the acquisition and maintenance of avoidance responding, as well as in differentiation of interresponse times. This research suggests limitations on the generality of a safety signal interpretation of avoidance conditioning.     

Tolerance to and residual effects of cocaine in squirrel monkeys depend on reinforcement-schedule parameter.

Lever pressing by 4 squirrel monkeys was maintained under a three-component multiple fixed-ratio schedule of food presentation; components differed with respect to ratio size. For each monkey, acute administration of cocaine (0.03 to 1.3 mg/kg, i.m.) produced dose-dependent decreases in overall response rate in each component. During repeated daily administration of 1.0 mg/kg of cocaine, tolerance developed to the rate-decreasing effects under each of the ratio contingencies, but developed to a greater extent and was evident in earlier parts of sessions for performance under the smaller ratios. Response rates of 2 monkeys increased above nondrug control levels despite the putative reinforcer not being consumed during the session. When saline or a smaller dose of cocaine was substituted for 1.0 mg/kg, response rates often were suppressed below nondrug control-level responding. This suppressive effect was observed in each monkey and was more likely to be observed and/or to be of greater magnitude in large-ratio components for 3 of the 4 monkeys. When saline was administered chronically at the end of the chronic-drug phase, response rates remained suppressed in the large-ratio component for 2 of the monkeys. There was, therefore, a schedule-dependent dissociation between behavioral tolerance and the residual effects: Tolerance was greater when small ratios were arranged, whereas the residual effects were more pronounced when larger ratios were arranged.     

Alternative response training, differential reinforcement of other behavior, and extinction in squirrel monkeys (Saimiri sciureus)

In Experiment I, (a) extinction, (b) extinction plus reinforcement of a discrete alternative response, and (c) differential reinforcement of other behavior were each correlated with a different stimulus in a three-component multiple schedule. The alternative-response procedure more rapidly and completely suppressed behavior than did differential reinforcement of other behavior. Differential reinforcement of other behavior was slightly more effective than extinction alone. In Experiment II, reinforcement of specific alternative behavior during extinction and differential reinforcement of other behavior were used in two components, while one component continued to provide reinforcement for the original response. Once again, the alternative-response procedure was most effective in reducing responding as long as it remained in effect. However, the responding partially recovered when reinforcement for competing behavior was discontinued. In general, responding was less readily reduced by differential reinforcement of other behavior than by the specific alternative-response procedure.     

Tolerance to cocaine's rate-increasing effects upon repeated administration.

Four squirrel monkeys responded daily under a fixed-interval 5-min or 8-min schedule of food-pellet delivery. Cocaine (0.03 to 1.7 mg/kg) and saline were injected before occasional daily sessions (acute administration). Some doses of cocaine produced substantial overall increases in response rate for 3 of the subjects; effects were less substantial for the remaining subject, who exhibited modest increases in response rate early in the session and during the middle portion of the intervals. A dose that increased response rate when administered acutely was then administered before each session (chronic administration). Chronic administration resulted in a reduction in the increases in response rate seen under acute administration for all subjects.     

Responding maintained under fixed-interval and fixed-time schedules of electric shock presentation

Following initial histories under a schedule of electric shock postponement, lever pressing in squirrel monkeys was maintained under fixed-interval and fixed-time schedules of electric shock presentation. No difference in either rate or pattern of responding was obtained when these schedules were presented as components of a multiple schedule. When they were presented singly for long periods of time, the fixed-interval schedule consistently maintained a higher response rate than the fixed-time schedule. The pattern of responding under both schedules was similar, typically consisting of a pause at the beginning of each interval followed by either a steady or a positively accelerating rate of responding. The results suggest that the response-shock dependency is of critical importance in the maintenance of high rates of responding under schedules of electric shock presentation, and support the general view that such responding may be conceptualized as operant behavior under control of many of the same variables that control responding under comparable schedules of food or water reinforcement.     

Effects of diazepam on schedule-controlled and schedule-induced behavior under signaled and unsignaled shock.

Schedule-controlled lever pressing and schedule-induced licking were studied in rats under a multiple fixed-interval fixed-interval schedule of food reinforcement upon which was superimposed a multiple variable-time variable-time schedule of electric-shock delivery. Shocks were signaled in one component of the multiple schedule and unsignaled in the other. The effects of diazepam upon the suppression of behavior during the signal (conditioned suppression) and during signaled and unsignaled shock (differential suppression) were studied under several shock intensities (Experiment 1) and at increased body weight (Experiment 2). In each study, diazepam led to dose-dependent increases in the rate of pressing and licking during signaled and unsignaled shock, but had little effect on conditioned suppression. the rate-enhancing effects of diazepam depended upon the intensity of shock, nature of the response, and whether or not shocks were signaled. The data was discussed in terms of (1) implications for understanding the effects of signaled and unsignaled shock on behavior, (2) the effects of diazepam on behavior suppressed by response-independent shock, and (3) comparison between operant and schedule-induced behavior.     

Effects of morphine, clonidine, and intensity change on electric-shock discrimination.

The effects of morphine, clonidine, and changes in stimulus intensity were examined in squirrel monkeys responding on one of two levers following brief presentations of one of two electric-shock intensities (0.1 and 0.5 mA). Responses were designated as correct or incorrect depending on which shock intensity had been presented and which lever was pressed. Morphine (0.42 to 1.80 mg/kg) and clonidine (0.075 to 0.18 mg/kg) decreased percentage correct responding. Morphine and clonidine also increased response latency and the number of shock presentations that were not followed by responses. Changes in shock intensity also decreased percentage correct responding but had no effect on response latency or on the number of shock presentations not followed by responses.     

Schedule-induced biting under fixed-interval schedules of food or electric-shock presentation

Squirrel monkeys pressed a lever under fixed-interval schedules of food or of electric-shock presentation. Both schedules induced repeated biting on a latex hose. Whether lever pressing was controlled by food or by electric shock, a pattern of decreasing hose biting and increasing lever pressing occurred within fixed-interval cycles. As the fixed-interval duration was increased from 6 to 600 sec, average rates of lever pressing decreased under both schedules. Average rates of hose biting first increased with increasing parameter value, reaching a maximum at values that varied from 60 to 337 sec in different monkeys, and then declined at higher values. d-Amphetamine at appropriate doses increased overall rates of lever pressing maintained by food or by shock, but either did not affect or decreased overall rates of hose biting. When no timeout period occurred between fixed-interval cycles, the monkeys bit most frequently immediately after food or electric shock was presented. When there was a timeout period, hose biting began shortly after the start of the fixed-interval cycles, with little or no hose biting immediately after food or electric shock was presented. Most hose biting appeared to be schedule-induced rather than food- or shock-induced.     

Context dependent changes in the reinforcing strength of schedule-induced drinking.

Previous experiments show that the opportunity to engage in schedule-induced responding is reinforcing. In this experiment, the reinforcing strength of schedule-induced drinking was measured. Four rats were trained on a concurrent-chain schedule. The two terminal links provided food pellets on identical fixed-time schedules. In addition, one terminal link also provided the opportunity to press a button that operated a water dipper. In this link, the rats showed polydipsic drinking. Button-pressing rate for polydipsic drinking was a bitonic function of pellet rate, and it was possible to describe the relationship with a slightly modified version of the matching equation for primary reinforcement. This equation also closely fit the data from other studies. Initial-link response rates, however, did not appear to be influenced by the availability of water in the terminal links. Control conditions suggested that the reinforcing strength of polydipsia was strongly bound to the context provided by periodic food reinforcement.     

Similarities in the rate-altering effects of white noise and cocaine.

The effects of white noise and cocaine on squirrel monkeys' fixed-interval responding were compared to determine whether the presentation of an exteroceptive stimulus could produce rate-altering effects of the type typically observed following drug administration. To investigate the relationship between control response rate and response rate in the presence of drug or noise, the monkeys were trained under a fixed-interval 300-s stimulus-shock termination schedule in order to generate a wide range of local response rates. A light illuminated the experimental chamber during the interval and, after 300 s elapsed, a lever press during a 3-s period terminated the light and precluded the occurrence of a harmless electrical stimulus that otherwise was delivered at the end of the 3-s period. Each interval was followed by a 30-s timeout during which the chamber was darkened and responses had no consequences. Following intramuscular administration of cocaine, different rates of responding characteristic of control performance converged toward a common rate and, at an appropriately high dose, response rate during the fixed interval became more uniform. When white noise was presented continuously during a given session, different response rates also converged toward a common rate and, at an appropriate intensity, response rate became more uniform. Interactions were obtained when cocaine and white noise were presented together, indicating the possibility of a common behavioral mechanism of action. The results suggest that rate-altering drug effects may be, in part, a result of the ability of drugs to produce nonspecific stimulus effects similar to those observed for exteroceptive stimuli.     

Punishment of responding under schedules of stimulus-shock termination: effects of d-amphetamine and pentobarbital.

Responding maintained in squirrel monkeys under 5-min fixes-interval schedules of either food presentation or termination of a visual stimulus associated with electric-shock delivery was suppressed by presenting an electric shock for every thirtieth response (punishment). In monkeys responding under the schedule of food presentation, d-amphetamine sulfate only further decreased punished responding, and pentobarbital sodium markedly increased punished responding, as expected from previous reports. In monkeys responding under the schedule of stimulus-shock termination, however, the effects of the two drugs were opposite: d-amphetamine markedly increased punished responding, whereas pentobarbital only decreased responding. Thus, the effects of these drugs on punished responding were different depending on the type of event maintaining responding. These and previous results indicate that it may be misleading and inaccurate to speak of the effects of drugs on "punished responding" as though punishment were a unitary phenomenon. As with any behavior, the effects of drugs and other interventions on punished responding cannot be accurately characterized independently of the precise conditions under which the behavior occurs.     

The puzzle of responding maintained by response-contingent shock.

Four squirrel monkeys were first exposed to a sequence of procedures that reliably generate responding maintained by brief response-contingent electric shocks arranged according to a fixed-interval schedule. After responding had become stable on the fixed-interval schedule, additional contingencies were added in tandem, whereby after completion of the interval, the spacing of responses affected shock delivery. In one procedure, responses had to be spaced more widely than their previous median value if shock were to be delivered. In the other procedure, responses had to be spaced more closely to produce shock. On the first of these procedures, decreased but stable responses rates would indicate that shock functioned as a positive reinforcer; on the second, increased response rates would indicate the positively reinforcing function. Instead, response rates accelerated on the procedure that targeted more widely spaced responses for shock delivery, and decelerated or ceased on the procedure that arranged for shocks to be produced by more closely spaced responses. Consistent with other recent findings, these results question the interpretation of performances maintained by response-contingent shock as engendered by positive reinforcement and are consistent with aversive-control interpretations. The details of that aversive control are not entirely clear, however, and these same procedures would be informative if applied to shock-maintained behavior that is generated in other ways.     

Eye contact and vocal responsiveness in squirrel monkey infants and their caregivers

Seventeen newborn squirrel monkeys, housed socially with their mothers and other adult females, were observed during their first 10 days of life. As early as day 1, infants began responding, vocally as well as by eye contact, to vocalizations and gaze directed to them by mothers and allomothers (aunts). Visual contact appeared always to be initiated by the adults. Infants spent less than 4% of awake time in eye contact with adults, but most infant-directed vocalizing occurred during these episodes, when both mothers and allomothers greatly increased their rate of calling. Infants were more likely to respond to vocalizations directed to them while in eye contact; 72% of infants' responsive vocalizing occurred then. These data are compared to those for human mothers and infants, where eye contact has also been shown to stimulate vocal exchange. A functional explanation of the involvement of allomothers, based on the infant's clinging position, is discussed.     

Interactions in multiple schedules: negative induction with squirrel monkeys

In Experiment I, lever pressing by squirrel monkeys was maintained under a sequence of variable-interval, multiple variable-interval variable-interval, and multiple variable-interval extinction schedules of food presentation. Negative induction (decreased responding in the unchanged component) occurred when one component of the multiple variable-interval variable-interval schedule was changed to extinction. Negative induction was transient over sessions; responding in the unchanged component usually recovered to a rate similar to that under the multiple variable-interval variable-interval schedule. Negative induction was not accompanied by consistent changes in the patterns of local responding within the unchanged component, and did not depend on whether component schedules were associated with localized (lever lights) or diffuse visual stimuli (houselights), or on whether the unchanged component was a 60- or 180-sec variable-interval schedule. In Experiment II, responding was maintained under a sequence of variable-interval and multiple variable-interval timeout schedules of food presentation. Negative induction occurred when responding declined gradually in the timeout component but not when responding declined abruptly. The nature of interactions in multiple schedules may depend on the species; negative induction was observed with squirrel monkeys under conditions similar to those that produce positive contrast with pigeons.     

Varying the temporal placement of a drinking opportunity in a fixed-interval schedule.

Three rats, lever pressing for food delivered on a fixed-interval 128-s schedule, were presented with a 16-s opportunity to drink from a retractable water source. The temporal placement of the water probe within the reinforcement cycle was varied sequentially, in steps of 16 s. Although the lever-pressing pattern was modulated by the intercalated water probe, water consumption during the probe itself was a decreasing function of time from the following reinforcer. These results were interpreted as evidence against the notion that schedule-induced drinking is a "ubiquitous" phenomenon and are congruent with results from other "intruded stimulus" experiments.     

Preference for less frequent shock under fixed-interval schedules of electric-shock presentation.

Lever pressing by 2 squirrel monkeys was maintained under fixed-interval 6-min and fixed-interval 2-min schedules of electric-shock presentation. Preference for these schedules was assessed during three experimental phases. In all phases, responses on one lever produced shock according to one or the other fixed-interval schedule, and responses on a second, changeover, lever switched between schedules. The opportunity to change over was presented during separate choice periods (during which the fixed-interval schedules did not operate) that followed the first through fourth shocks in each schedule. If no changeover occurred during those choice periods, a changeover automatically occurred following the fifth shock. In Phase I, durations of the choice periods were fixed. In Phase II, the choice periods equaled a proportion of their respective fixed interval. During Phase III (completed with 1 monkey) a response on the changeover lever during a given choice period reinstated the most recent fixed interval, and a failure to respond resulted in a changeover. During each of these phases, distinct preferences developed for the 6-min schedule. These results suggest that the maintenance of lever pressing by fixed-interval presentation of electric shock may not be an example of positive reinforcement, and that the response-maintaining characteristics of shock presentation may derive from other properties of the schedule.     

Assessment of attack and drinking in White King pigeons on response-independent food schedules.

Four White King pigeons in Experiment I were exposed to a fixed-time 90-second food schedule with successive access to water and a conspecific target. Drinking per session was sporadic and minimal, while attack per session occurred during most interfood intervals for all animals. Analysis of the temporal distribution of attack showed that the typical postreinforcement pattern of attack developed over the course of the experiment. In Experiment II, the same animals were exposed to a series of fixed-time schedules ranging from 30 to 360 seconds with successive access to water and target. Time engaged in drinking and the number of interfood intervals with drinking were less than that of attack. Food and no-food baselines, which have been typically used to assess schedules-induced drinking and attack, respectively, were used to evaluate the effect of the schedule on attack and water ingestion. Relative to the no-food baseline, both attack and drinking were enhanced by the schedule in all birds. Relative to the food baseline, drinking was slightly suppressed in three birds and attack was enhanced in all. For all animals, the food baseline resulted in more attack and drinking than the no-food baseline.     

Behavior controlled by scheduled injections of cocaine in squirrel and rhesus monkeys.

Rates and patterns of key-press responding maintained under schedules in which responding resulted in intravenous injections of cocaine were studied in squirrel monkeys and rhesus monkeys. Each injection was followed by a 60- or 100-sec timeout period. Schedule-controlled behavior was obtained at appropriate cocaine doses in each species. Under FR 10 or FR 30 schedules, performance was characterized by high rates of responding (usually more than one response per second) in each ratio. Under FI 5-min schedules, performance was characterized by an initial pause, followed by acceleration of responding to a final rate that was maintained until the end of the interval. Under multiple fixed-ratio fixed-interval schedules, rates and patterns of responding appropriate to each schedule component were maintained. Responding seldom occurred during timeout periods under any schedule studied. At doses of cocaine above or below those that maintained characteristic schedule-controlled behavior, rates of responding were relatively low and patterns of responding were irregular. Characteristic fixed-interval responding was maintained over a wider range of cocaine doses than characteristic fixed-ratio responding. Complex patterns of responding controlled by discriminative stimuli under fixed-ratio or fixed-interval schedules can be maintained by cocaine injections in squirrel monkeys and rhesus monkeys.