Fixed-ratio escape and avoidance-escape from naloxone in morphine-dependent monkeys: effects of naloxone dose and morphine pretreatment.

Lever pressing by rhesus monkeys was maintained by morphine injections during four equally spaced sessions each day. During other periods, lever pressing was maintained by timeout from a continuous naloxone infusion (escape), or by timeout from a stimulus that preceded naloxone injections, or termination of the injections (avoidance-escape). As naloxone dose increased in the escape procedure, response rate increased to a maximum and then decreased. In the avoidance-escape procedure, response rate generally increased as naloxone dose increased, but the changes in rate were small compared to the excape procedure. Substitution of saline for naloxone in the escape procedure led to a very low response rates within three sessions. In the avoidance-escape procedure, rate decrements produced by saline substitution appeared to be related to the behavioral history of the monkey. Previous escape experience led to more rapid decreases in responding when saline was introduced, whereas responding was maintained for 15 sessions in a monkey without prior escape conditioning. Morphine pretreatment produced comparable, dose-dependent decreases in response rates in both procedures. The rate-decreasing effects of morphine were exacerbated when no naloxone was delivered in the escape procedure.     

Autoshaping in the rat: Effects of omission on the form of the response

Two experiments were conducted to investigate the effect of an omission contingency on behavior related to and characterizing autoshaped lever contacts in the rat. In Experiment I an omission contingency imposed on autoshaped lever contacts forceful enough to produce a press (.078N) resulted in a significant decrease in lever presses, but had no effect on frequency of lever touches (contacts of insufficient force to produce a press) or rate of food tray entry during lever presentation. In contrast, rats which received a similar number of lever-food pairings, but whose behavior had no programmed consequences (yoked control subjects), showed an increase in lever press rate, a significant decrease in rate of food tray entry, and no change in rate of lever-touches. In Experiment II, the effect of a similar omission contingency on the topography of lever contact responses was investigated. Prior to omission training subjects contacted the lever primarily by pawing it. Following omission training this behavior was suppressed, with a subsequent increase in lever contacts characterized as nosing. Yoked control subjects showed no significant changes in lever contact topography. The results indicate that (1) an omission contingency does not simply eliminate wholesale those topographies which incur the contingency but produces subtle adaptive changes in lever contact topography; and (2) the nature of the autoshaped response in the rat does not appear to be rigid enough to depend solely upon the nature of the unconditioned stimulus or the conditioned stimulus, but can also be determined by the relationships existing between the animal's behavior and these stimuli.     

Aversive functions of response effort: Fact or artifact?

Historically, effort has been viewed as aversive. Most supporting evidence comes from studies demonstrating increased force/effort requirements reduce operant responding. Changes in force/effort requirements, however, are often accompanied by changes in response definition when mechanical devices are used to define the response. As a consequence, responses measured at one point in a study may go unmeasured at other points. In an alternative approach, we used a continuous measurement strategy that provided a means to fix the threshold force defining the response class and simultaneously allowed independent manipulation of the force criteria required to produce reinforcement. Rats pressed a force transducer according to a fixed‐ratio 5 schedule of food delivery. The criterion force was systematically increased and decreased; the threshold for response detection was constant. When response rates included only criterion responses, overall rate decreased when force requirements increased. By contrast, when all responses, both those meeting force criteria and those that did not (above the threshold but below the criteria for reinforcement) were included in the rate calculation, increases in force increased response rate. Increases in force criteria also increased the maximum force (g) and time‐integral of force (g‐s) of operant behavior. Control conditions showed increases in responding could be explained by the emergence of subcriterion responses, irrespective of force. We conclude that prior results showing effort decreases response rates are due to an artifact arising from inadvertent changes in response definitions. Increases in effort may better be understood as changes in the response:reinforcer payoff owing to the emergence of a subcriterion response class.     

Experimental self-punishment and superstitious escape behavior

Rats were trained to escape from shock by pressing a bar. Bar holding was subsequently punished with very brief shocks. This treatment failed to depress bar-holding behavior. In some cases, although the escape shocks were delivered very infrequently, bar holding was maintained and resulted in the delivery of several thousand punishments per session. These and other effects of the punishment treatment were investigated. Finally, some of the possibilities of superstitious escape responding were explored by presenting inescapable shocks to rats that had been trained to escape shock by lever pressing. Although responding during these shocks had no programmed consequences, responding was sustained.     

Effects of punishing elements of a simple instrumental-consummatory response chain

Rats were trained to press a lever, with every response reinforced with water. After responding was established, nine rats were administered a brief shock after each lever press, and nine others were shocked after drinking. The two procedures resulted in similar suppression of responding, and examination of the latency data when responding was partially suppressed indicated that under both conditions response suppression was due primarily to an increase in the latency of the instrumental response, rather than to pausing between the instrumental and consummatory responses. Thus, punishment following either the instrumental or consummatory component of the simple response sequence reduced the number of sequences initiated, rather than selectively suppressing the punished behavior.     

Interreinforcement time, work time, and the postreinforcement pause

Six rats were trained with food deliveries contingent upon their pressing a lever and holding it down for fixed, cumulative durations. Hold requirements were varied from 7.5 seconds to 120 seconds. Lever holding was maintained reliably at hold requirements as long as 30 seconds to 105 seconds for different rats. At longer hold requirements, lever holding was erratic and tended to occur only early in sessions. At shorter and intermediate requirements, the patterns of lever holding resembled those of responding under fixed-ratio schedules for discrete responses, with breaks in responding immediately after reinforcement alternating with relatively continuous lever holding until the next reinforcement. At longer hold requirements, postpause lever holding frequently was interrupted with additional pauses. The duration of postreinforcement pauses increased linearly with the scheduled hold requirement. However, for five of six rats, the hold requirement, which represents the actual time spent lever holding per reinforcer, accounted for somewhat less variance in pause duration than did interreinforcement time.     

Response duration is sensitive to both immediate and delayed reinforcement

We investigated the duration of lever pressing by rats when the delivery of appetitive reinforcers was contingent upon response duration. In the first experiment, response durations increased when duration requirements were imposed, and they decreased when duration requirements were removed. This effect occurred whether reinforcers were immediate or delayed by 8 s. In order to maintain the integrity of the delay intervals, reinforcer delivery was dependent upon both lever depression and release. In a second experiment, lever depression only and a response duration of at least 4 s were required for reinforcer delivery. Compared to immediate reinforcement conditions, delayed reinforcers increased both variability and the length of the maximum response durations. In a third experiment, immediate reinforcers were delivered contingent upon lever depression and release under a variety of duration requirements. Median lever‐press durations tracked the contingencies rapidly. Across all three experiments, rats emitted numerous response durations that were too short to satisfy the reinforcer requirements, and bimodal distributions similar to those produced by differential reinforcement of low rate schedules were evident for most rats. In many aspects, response duration responds to reinforcement parameters in a fashion similar to rate of discrete responding, but an examination of this continuous dimension of behavior may provide additional information about environment–behavior relationships.     

Concurrent performances: a baseline for the study of conditioned anxiety

Three rats were trained to lever press on concurrent random interval 2-min random interval 2-min schedules of milk reinforcement. With a 5-sec changeover delay, relative response rate matched the relative reinforcement duration associated with each lever. A stimulus, during which unavoidable shocks occurred at random intervals, was superimposed on this concurrent baseline, and shifts in preference were found. However, data from this procedure were ambiguous, apparently confounded by shock-elicited response bursts. Termination of the shocks during the stimulus resulted in a rapid recovery of matching, which was preceded by a brief facilitation of responding on the less-preferred lever. The procedure was then changed to a conventional conditioned anxiety paradigm with a variable duration pre-shock stimulus. A marked shift in relative response rate towards the preferred lever was found in all three rats; that is, responding on the preferred lever was far less suppressed during the pre-shock stimulus than responding on the less-preferred lever.     

Effect of drugs on response-duration differentiation VII: response-force requirements

Rats were trained to press a lever for at least 1 s but for less than 1.3 s. The force required to press the lever was then increased or decreased by 10, 15, or 20 g. Increases in the force requirements for lever pressing decreased timing accuracy, but decreases in the force requirement had the opposite effect. Accuracy decreases at increasing force requirements were characterized by an increase in the relative frequency of responses that were too short to meet the reinforcement criterion. In contrast, increases in accuracy when the force requirements were decreased were characterized by increases in response durations that met the reinforcement criterion and decreases in the relative frequency of responses that were too short to produce the reinforcer. Phencyclidine (PCP) and methamphetamine produced dose-dependent decreases in accuracy that were associated primarily with increases in the relative frequency of short response durations, although methamphetamine also produced increases in long response durations at some doses. When the effects of PCP were determined with the force requirement increased by 10 g or decreased by 15 g, the cumulative response-duration distribution shifted toward even shorter response durations. When the effects of methamphetamine were determined with the force requirement on the lever increased by 10 g, the cumulative frequency distribution was shifted toward shorter response durations to about the same extent as it had been before force requirements increased; however, when the force required to press the lever was decreased by 15 g, these shifts toward shorter response durations almost completely disappeared. These results show that increases and decreases in the force requirements for lever pressing have different effects on the accuracy of temporal response differentiation.     

Measurement of acoustic startle response in mice

Apparatus for measurement of acoustic startle response in mice is described. The technique utilizes a spring suspended lever, commercially available strain-gauge transducer, and polygraph. Individual startle responses are recorded as upward (flexion) and downward (extension) pen deflections, the force of either component being linearly related to the amplitude of the vertical pen deflections. The apparatus, with minor modifications, may be used to measure startle responses in larger rodents.     

Escape from an effortful situation

This experiment investigated the tendency to escape from a situation requiring effortful responding. Five human subjects responded in a situation where the response mechanism required 20-lb force to operate; responses were reinforced according to a variable-interval schedule. A subject escaped from this situation by emitting a vocal response which produced a 60-sec “easy period”. During the easy period the reinforcement contingency was switched to a response mechanism requiring 1 lb to operate. It was found that: (1) Escape responding could be conditioned and maintained by producing the easy period; the easy period did not maintain escape responding when the force requirement in the normal situation was equated with it. (2) The rate of escape responding was a function of the magnitude of the force normally required. (3) When easy periods were scheduled after fixed ratios, pausing from the end of the previous easy period to the first escape response was noted. It was concluded that a situation requiring high-force responding is a negative reinforcer. The pattern of fixed-ratio responding suggests that this reinforcer produces typical schedule control in human subjects.     

The relative aversiveness of signalled vs unsignalled escapable and inescapable shock

In the first study, subjects escaped shock by pressing on a lever under an unsignalled condition. By pressing a different lever they changed the condition to signalled escape for three minute periods. The second study used the changeover procedure to study inescapable-unavoidable shock. Seven rats were used in each study. All subjects in both studies changed over from unsignalled to signalled conditions. Once contact with the signal condition was made, subjects responded to remain in that condition. The three different extinction conditions showed that the correlated stimulus without the signal had greater control over responding than the signal without the correlated stimulus. An analysis based upon shock and shock-free periods was presented.     

Some punishing effects of response-force

The present experiment explored the punishing effect of different response-force requirements by means of a two-operant design analogous to a two-component chain schedule. The first component of the chain required a lever pull through 0.25 in. (0.64 cm) at 1 lb (4.45 N) of force. The second component required a lever pull through an additional 0.75 in. (1.90 cm) with the force varied between sessions from 1 lb to 50 lb (4.45 N to 223 N). Completion of the second component of the chain was reinforced after variable intervals averaging 1 min. The average rate of first-component response decreased as the force requirement for second-component responses was increased. This rate reduction did not appear to be due to increased response duration, “fatigue”, or differing rates of reinforcement. If the force requirement for the second-component response is viewed as a consequence for the first-component response, then the results of the experiment show that a high force requirement is a punisher.     

Perception of causal relations in humans: Factors affecting judgments of response-outcome contingencies under free-operant procedures

In three experiments, college studients responded to and rated a range of positive, random, and negative response-outcome contingencies presented in free-operant formats. These experiments sought a paradigm that would yield sensitive and unbiased judgments of response-outcome relations and explored the role of time in the judgment of response-outcome covariation. In Experiment 1, the effects of making continuous and discrete responses on subjects' contingency judgments were compared. In Experiment 2, the effects of changing the temporal definition of discrete responses were examined as were the effects of the amount of exposure to contingency problems. In Experiment 3, the effects of temporal regularity in defining response occurrence and nonoccurrence were investigated. In all three experiments, subjects' judgments were strong linear functions of the programmed contingencies between telegraph key operation and the illumination of a brief light. This result shows free-operant scheduling of response-outcome contingencies to be a highly sensitive and unbiased method of investigating causal perception. Additionally, judgment accuracy was found to be higher for males than for females and to improve as the probability of the subject's making a recorded response rose from .00 toward .50. Finally, a correlational analysis of several possible judgment rules supported the conclusion that subjects rated response-outcome relations on the basis of the difference in the probability of an outcome given their having recently made or not made a response.     

Signaled reinforcement effects on fixed-interval performance of rats with lever depressing or releasing as a target response

The effect of a diffuse auditory signal filling a brief delay between a response and reinforcement depends upon the nature of the trained target response. Rats in a signaled condition responded slower than rats in an unsignaled condition if the target response was lever release. If the target response was lever depression, however, rats in the signaled condition responded faster than rats in the unsignaled condition at the end of training     

The effects of escape conditioning and shock intensity on responding during inescapable shock

Eight albino rats, conditioned to press a lever to escape shock, continued to lever press during short inescapable shocks presented subsequently. The rate of this behavior was found to be higher for higher shock intensities regardless of the order in which shock values were presented. Relative to the immediately preceding escape rate, responding during inescapable shock was higher following conditioning at higher fixed-ratio escape requirements. Four subjects not conditioned to escape shock pressed the lever very infrequently during inescapable shock and showed little change with changes in shock intensity. The escape conditioning effects suggest that responding during inescapable shock is superstitious escape behavior. The effects of shock intensity on this behavior appear to be similar to reported effects of shock intensity on escape behavior.     

Intercurrent and reinforced behavior under multiple spaced-responding schedules

Lever pressing in rats was reinforced with food under a multiple spaced-responding schedule. A lever, food cup, and drinking tube were mounted in a running wheel so that lever pressing, running, and licking could be recorded. Running and licking had no scheduled consequences. Lever pressing was reinforced under a multiple schedule with three spaced-responding components and an extinction component. Each component was associated with a different auditory stimulus. Spaced-responding components reinforced only lever presses terminating interresponse times equal to or greater than 10, 20, or 60 sec, respectively. Rates of lever pressing, reinforcement, and licking all decreased as schedule parameter increased. Efficiency of spaced responding, as measured by reinforcements per response, also decreased. Rate of wheel running either increased or increased and then decreased with increasing schedule parameter. Individual running rates differed substantially. Neither licking nor running rate correlated with individual differences in efficiency. Analysis of conditional probabilities among the several response classes showed that, as the schedule requirement increased, the probability of running after a lever press increased and the probability of licking after a lever press decreased. After reinforcement, one subject always pressed the lever next. In the other subjects, the conditional probability of lever pressing, given reinforcement, increased while the probability of licking, given reinforcement, decreased with increasing schedule requirement. Results are discussed in relation to the concepts of schedule-induced and mediating behavior.     

The effects of differing response-force requirements on fixed-ratio responding of rats.

Rats were exposed to two-component multiple schedules of food delivery. In the first experiment, 15 responses were required to produce food in both components. A downward force of 0.25 N (25 g) was always required to operate the response lever in one component. In the other, the required force was 0.25, 0.50, 1.00, or 2.00 N (25, 50, 100, or 200 g). In the second experiment, 0.25 N of force operated the lever in one component, but in the other, the force requirement for five consecutive responses at the beginning, middle, or end of each ratio was increased from 0.25 to 2.00 N. In the third experiment, the number of responses required to produce food was reduced from 15 to 5, and then to 1. Again, the effects of altering response force from 0.25 to 2.00 N were examined. In general, as response force increased in all experiments, mean response rates decreased and mean interresponse times increased.     

Schedule-induced drinking as a function of percentage reinforcement

Drinking was recorded in rats while lever pressing was maintained on a series of percentage reinforcement schedules in which the per cent of 1-min fixed intervals terminating with food was 100, 90, 30, 70, 10, 50, and 100%. Intervals in which a pellet was omitted were terminated by brief light flash and click stimuli that were also correlated with food presentations. Drinking failed to develop in five of six subjects following intervals in which the brief stimuli were presented regardless of percentage reinforcement. Postpellet drinking, which followed intervals terminated with pellet delivery, however, increased in both duration and amount ingested per interval as percentage reinforcement was systematically decreased. The increase in postpellet drinking above that produced by 100% reinforcement was interpreted as an analogue of the positive-contrast effect observed with food-reinforced operants.