Punishment of autoshaped key-peck responses of pigeons

The effects of different voltages of response-dependent and response-independent electric shock on the frequency of key-peck responses engendered by an autoshaping procedure were studied. In Experiments I and II, each response produced a brief electric shock, and response frequency generally decreased more with higher-voltage shock. Preshock frequencies of responding were generally recovered across successive sessions of relatively low-voltage shock delivery but not at higher shock voltages. The effects of response-dependent and response-independent shock were compared in Experiment III by using a yoked-control procedure in which each pigeon received each type of shock delivery at different times. Response-dependent shock generally produced greater decreases in response frequency. In the final experiment, one response-independent shock per autoshaping trial was scheduled. The number of autoshaped responses per trial was related to shock voltages. These results suggest that response-dependent and response-independent electric shock effectively decrease frequency of autoshaped responses.     

Remote effects of aversive contingencies: Disruption of appetitive behavior by adjacent avoidance sessions

Disruption of ongoing appetitive behavior before and after daily avoidance sessions was examined. After baselines of appetitive responding were established under a fixed-interval 180-s schedule of food presentation, 4 rats were exposed to 40-min sessions of the appetitive schedule just prior to 100-min sessions of electric shock postponement, while another 4 rats received the 40-min appetitive sessions just following daily sessions of shock postponement. In all 8 subjects, fixed-interval response rates decreased relative to baseline levels, the effect being somewhat more pronounced when the avoidance sessions immediately followed. The disruption of fixed-interval responding was only partially reversed when avoidance sessions were discontinued. During the initial exposure to the avoidance sessions, patterns of responding under the fixed-interval schedule were differentially sensitive to disruption, with high baseline response rates generally more disturbed than low rates. These disruptions were not systematically related to changes in reinforcement frequency, which remained fairly high and invariant across all conditions of the experiment; they were also not systematically related to the response rates or to the shock rates of the adjacent avoidance sessions. The results, while qualitatively resembling patterns of conditioned suppression as typically studied, occurred on a greatly expanded time scale. As disruption of behavior extending over time, the present data suggest that some forms of conditioned suppression are perhaps best viewed within a larger temporal context.     

Intermittent punishment of human responding maintained by intermittent reinforcement

To determine the effects of variable-interval shock punishment on behavior maintained by variable-interval and variable-ratio reinforcement, human subjects' key-pressing behavior was reinforced with money on a four-component multiple schedule. Components 1 and 2 were variable-interval 30-sec, and Components 3 and 4 were variable-ratio 210. After responding was stabilized, response-contingent electric shock was scheduled on a variable-interval 10-sec schedule during the second and fourth components of each cycle. Subjects instructed as to the reinforcement contingencies showed gradually increasing suppression of variable-interval responding at increasing shock intensities and either very high or very low rates of variable-ratio responding at higher intensities. Minimally instructed subjects showed suppression at higher shock intensities, but no clear differential suppression as a function of reinforcement schedule. Recovery from initial suppression was observed within sessions.     

Punishment shock intensity and basal skin resistance

The relationship between punishment shock intensity and basal skin resistance (BSR) was investigated in two sessions with human females selected for their ability to maintain a fairly substantial operant rate under a wide range of shock intensities. In both sessions each button-pressing response was reinforced with a counter tally. Subjects were paid one cent for each 20 counts. In session 1, punishment followed each response during alternate 4-min periods; in session 2 punishment was programmed in all 4-min periods. Shock intensities were presented randomly among the 4-min shock periods, with the restriction that the first three presentations occurred in ascending order. Operant responding showed some suppression at higher shock intensities in session 1, with substantial recovery in most subjects during session 2. Respondent behavior was characterized by greater activity at successively higher intensities, with recovery at all shock levels, especially the lowest levels, apparent during the second session.     

Ratio responding as a function of concurrent avoidance schedules, yoked shocks, and ratio value

Fixed-ratio food-reinforced responding in rats was studied alone and with concurrent shock avoidance or with concurrent response-independent shocks matched to those that occurred in the avoidance condition. Under each condition, fixed-ratio size was increased over successive daily sessions. Fixed-ratio response rate generally passed through a maximum as a function of fixed-ratio size. Decreased fixed-ratio responding at values beyond the maximum occurred when (1) the time to complete a fixed ratio approximated the response-shock interval of the avoidance schedule, (2) the shock rate increased, and/or (3) the ratio requirements were so high that ratio strain occurred. Avoidance rates decreased slightly as fixed-ratio size increased.     

Punishment of shock-induced aggression

Squirrel monkeys were restrained in a chair equipped with a tail-shock apparatus and a pneumatic bite hose located in front of the subject's face. An aggressive response was recorded when the monkey bit the hose. Initial sessions in which no shocks were delivered produced some biting. When biting during these sessions stabilized at a near-zero level, regularly scheduled shocks were delivered to the monkey's tail, causing a consistently higher rate of biting. After several sessions under these conditions, a punishment phase was introduced in which the previous shock conditions were maintained, and every bite was followed immediately by another, more intense shock. Biting under these conditions was suppressed to a near-zero level. When the punishment contingency was removed, biting increased. With one subject, two additional bite-contingent stimuli were examined: (1) a milder shock that, when made contingent upon hose biting, also suppressed that response, and (2) a contingent tone that had no obvious suppressing or facilitating effect. Individual differences among subjects were extreme, but the effect of bite-contingent shock was consistent. Observations of the subjects during the punishment sessions indicated the existence of certain side effects that resulted from the use of punishment to suppress shock-induced aggression.     

Biting attack by rats in response to aversive shock

Paired rats are known to behave aggressively when given painful electric shocks. The present study developed a procedure whereby individual rats given shocks might bite an inanimate target object. Unavoidable shock was delivered to the rat while it was restrained in a position close to, and facing a target object. Biting of the target was recorded automatically. Shock caused the rat to bite metal, wood, or rubber targets. Biting was most frequent immediately after shock and decreased as a direct function of time since the shock. Almost every shock produced biting and the behavior continued as long as the shocks were delivered. Biting ceased within and between sessions when shocks were discontinued. These results show how the pain-aggression relation can be studied objectively with rats.     

Some effects of punishment shock intensity upon discriminative responding

Three pigeons received visual discrimination training under both multiple variable-ratio extinction and variable-interval extinction schedules. All birds developed nearly perfect discrimination. When punishment for every tenth response during food reinforcement was presented, responding decreased as shock intensity increased. At the same time, responding during extinction, which was not punished, increased at intermediate punishment intensities, but returned to low levels under severe punishment. A second procedure, in which punishment and no-punishment sessions alternated unsystematically, was employed with two of the birds. The results under this procedure essentially replicated the data obtained as punishment shock intensity increased gradually.     

Conditioned suppression or facilitation as a function of the behavioral baseline

Rats were exposed to a multiple schedule of reinforcement. During one component, a bar-press was followed by reinforcement only if it occurred between 15 and 20 sec after the previous response. This differential-reinforcement-of-low-rate (DRL) schedule produced a typical slow rate of responding. During the other component, reinforcement followed the first response to be emitted during limited periods of time which occurred at fixed intervals. These fixed-interval schedules with a limited hold produced higher response rates, described as `interval' or `ratio-like' behavior. Responding during the DRL component increased in frequency during a tone which ended with an unavoidable shock of low intensity, but decreased during the tone when the shock intensity was raised. The `interval' and `ratio-like' responding decreased in frequency during the tone at all shock intensities. Initial acceleration of the DRL responding appeared to be due to adventitious punishment of collateral behavior which was observed between the bar-presses. The more severe conditioned suppression during the fixed-interval components might be the result of the lower probability of reinforcement after any single response.     

The effects of escape conditioning and shock intensity on responding during inescapable shock

Eight albino rats, conditioned to press a lever to escape shock, continued to lever press during short inescapable shocks presented subsequently. The rate of this behavior was found to be higher for higher shock intensities regardless of the order in which shock values were presented. Relative to the immediately preceding escape rate, responding during inescapable shock was higher following conditioning at higher fixed-ratio escape requirements. Four subjects not conditioned to escape shock pressed the lever very infrequently during inescapable shock and showed little change with changes in shock intensity. The escape conditioning effects suggest that responding during inescapable shock is superstitious escape behavior. The effects of shock intensity on this behavior appear to be similar to reported effects of shock intensity on escape behavior.     

The effect of punishment shock intensity upon responding under multiple schedules

In the first of two experiments, responses of two pigeons were maintained by multiple variable-interval, variable-ratio schedules of food reinforcement. Concurrent punishment was introduced, which consisted of a brief electric shock after each tenth response. The initial punishment intensities had no lasting effect upon responding. Then, as shock intensity increased, variable-ratio response rates were suppressed more quickly than variable-interval response rates. When shock intensity decreased, variable-interval responding recovered more quickly, but the rates under both schedules eventually returned to their pre-punishment levels. In the second experiment, the following conditions were studied in three additional pigeons: (1) With each shock intensity in effect for a number of sessions, punishment shock intensity was gradually increased and decreased and responding was maintained by multiple variable-ratio, fixed-ratio schedules of food reinforcement; (2) Changes in punishment shock intensity as described above with responding maintained by either a variable-ratio or a fixed-ratio schedule, which were presented on alternate days; (3) Session-to-session changes in shock intensity with responding maintained by multiple variable-ratio, fixed-ratio schedules. Responding under the two schedules was suppressed to approximately the same extent by a particular shock intensity. Also, post-reinforcement pauses under the fixed-ratio schedule increased as response suppression increased.     

SUPPRESSIVE AND FACILITATIVE EFFECTS OF SHOCK INTENSITY AND INTERRESPONSE TIMES FOLLOWED BY SHOCK

Although response‐dependent shock often suppresses responding, response facilitation can occur. In two experiments, we examined the suppressive and facilitative effects of shock by manipulating shock intensity and the interresponse times that produced shock. Rats' lever presses were reinforced on a variable‐interval 40‐s schedule of food presentation. Shock followed either long or short interresponse times. Shock intensity was raised from 0.05 mA to 0.4 mA or 0.8 mA. Overall, shock contingent on long interresponse times punished long interresponse times and increased response rates. Shock contingent on short interresponse times punished short interresponse times and decreased response rates. In Experiment 1, raising the range of interresponse times that produced shock enhanced these effects. In Experiment 2, the effects of shock intensity depended on the interresponse times that produced shock. When long interresponse times produced shock, low intensities increased response rates. High intensities decreased response rates. When short interresponse times produced shock, high shock intensities punished short interresponse times and decreased response rates more than low intensities. The results may explain why punishment procedures occasionally facilitate responding and establish parameters for future studies of punishment.     

The effect of shock intensity on concurrent and single-key responding in concurrent-chain schedules

Pigeons were trained to respond in a two-link, concurrent-chain schedule. Pecks on each key during the concurrent initial links occasionally produced a 5-min terminal link, during which only that key was operative. Food reinforcement and various intensities of shock were scheduled during the terminal links. When shock was contingent on response, the effect of shock was greater on terminal-link responding than on initial-link responding. When shock was independent of response, the effect was reversed, with larger changes in initial-link responding than terminal-link responding. In general, shock was found to affect behavior most drastically when behavior could, in turn, affect the rate of shock.     

Avoidance extinction in goldfish

Independent groups of goldfish trained to avoid shock in a shuttlebox situation were presented with several extinction procedures in which the relationships between the conditioned stimulus and shock were altered and/or response contingencies removed. Random shock presentations, equivalent to the number of shocks received during avoidance acquisition, resulted in response decrements similar to those obtained when the conditioned stimulus was presented alone. Pairing the conditioned stimulus with shock on every trial, however, served to maintain response levels. When response-contingent punishment was superimposed upon these Pavlovian pairings, performance was facilitated slightly although punishment alone resulted in somewhat faster response reduction than that produced by exposure only to the conditioned stimulus. Extinction of avoidance responding produced by exposure to the conditioned stimulus alone was dependent on the total duration of exposure and independent of both number of stimulus onsets and response prevention. These experiments demonstrated that, in general, the procedures used to reduce avoidance responding in rats were equally effective for goldfish, with one exception: the introduction of a Pavlovian contingency following avoidance acquisition, making the previously avoidable shock unavoidable, maintained response probabilities near previously established levels.     

Absence of shock-elicited aggression in pigeons

Two pigeons that attacked a taxidermically prepared target pigeon during a schedule of positive reinforcement for key pecking, and two that did not, were shocked through implanted electrodes in the presence of the target. Shock intensities of 2 and 4 mA, durations of 0.1 and 1.3 sec, and frequencies of 2, 6, 20, and 35 per minute were delivered across 16 sessions with 180 shocks per session. No pigeon attacked the target; one pecked the shockplug on its back. The two pigeons that had not attacked during the positive reinforcement schedules were conditioned to peck the target for food reinforcement before another 16 sessions of shock. No attack was observed in these shock sessions. During subsequent positive reinforcement of key pecking, the target was attacked by the two pigeons that had originally attacked and by one that had not. Absence of shock-elicited attack in these pigeons may be related to the parameters of the experiment or may be yet another instance of the absence of shock-elicited attack in the class Aves. At least under the present conditions, it was not possible to predict the level of attack during electric shock from the level of attack during schedules of positive reinforcement for key pecking.     

Characteristics and response-displacement effects of shock-generated responding during negative reinforcement procedures: pre-shock responding and post-shock aggressive responding

Bar-pressing (Experiment I) or key-pressing (Experiments II and III) responses of monkeys were reinforced according to a fixed-interval schedule of negative reinforcement: the first response after a fixed interval of time terminated regularly spaced shocks for a fixed time designated as the reinforcement period. During extinction, shocks continued during the reinforcement period. That there were two types of responding generated by shock alone was indicated by (1) the level of responding maintained during extinction relative to conditions without shock, (2) the stability of two between-shock response patterns across reinforcement and extinction conditions, and (3) the development of these two between-shock patterns without a history of reinforcement. Subjects developed either a pre-shock or a post-shock response pattern when only the bar was available. However, when both a bite tube, an operandum requiring an aggressive topography, and a recessed key, an operandum that did not require an aggressive topography, were provided, the post-shock pattern was observed in tube biting and the pre-shock pattern was observed in key pressing. Removal of the bite tube produced post-shock key responding similar to that observed when only the bar was available. The displacement of post-shock, aggression-motivated responding confirmed the confounding effect of shock-generated responding in negative reinforcement procedures, and suggests that the use of concurrent response alternatives would reduce such confounding.     

Combining stimuli signalling response-dependent food and shock

Three rats were exposed to a multiple schedule in which separate presentations of light and tone alternated with periods during which light and tone were absent. In Phase 1, light and tone each signalled identical variable-interval schedules of food delivery. In Phase 2, light and tone signalled separate but concurrent variable-interval schedules of food and shock delivery. In both phases, the absence of light and tone was associated with the differential reinforcement of other behavior. Test presentations of light, tone, and a light-plus-tone combination indicated that in both phases, light-plus-tone controlled higher response rates than either light or tone alone. The combination continued to control enhanced responding even when the test stimuli signalled variable-interval schedules of food and fixed-ratio schedules of shock. In these latter sessions, enhanced control by the combination increased shock frequency with no corresponding change in food frequency. Apparently, the level of behavior controlled by the absence of two single stimuli may be more important than the consequences of responding in determining the effects of combined-stimulus presentations.     

Patterns of responding within sessions.

Rates of responding changed systematically across sessions for rats pressing levers and keys and for pigeons pressing treadles and pecking keys. A bitonic function in which response rates increased and then decreased across sessions was the most common finding, although an increase in responding also occurred alone. The change in response rate was usually large. The function relating responding to time in session had the following general characteristics: It appeared early in training, and further experience moved and reduced its peak; it was flatter for longer sessions; and it was flatter, more symmetrical, and peaked later for lower than for higher rates of reinforcement. Factors related to reinforcement exerted more control over the location of the peak rate of responding and the steepness of the decline in response rates than did factors related to responding. These within-session changes in response rates have fundamental theoretical and methodological implications.     

Conditioned suppression as a sensitive baseline for social facilitation

The key pecking of pigeons maintained on a variable-interval schedule of food reinforcement was suppressed during occasional presentations of a warning stimulus paired with electric shock. On alternate sessions, a co-actor pigeon was visible in an adjoining chamber where it emitted the same food-reinforced key peck during the warning stimulus that signalled shock for the subject. With no shock and at low shock intensities, where the subject's responding was not suppressed or suppressed only slightly, the co-actor had little effect. At the higher shock intensities, where the subject's responding was reduced by at least 40%, the response rate during the warning stimulus was consistently higher when the co-actor was present. One explanation of these results assumes a special relationship between social stimuli and aversive stimuli in which the presence of another animal reduces emotional reactions and thereby allows operant responses to increase. This was not the case here because the mere presence of the co-actor did not maintain social facilitation. Rather, the present results, taken in conjunction with previous findings, suggest that changes in social and non-social variables which affect the rate of food-reinforced responding may produce proportionately larger changes in responding when that responding is suppressed by aversive stimulation than when it is not.     

SOME RELATIONS BETWEEN CLASSICALLY CONDITIONED AGGRESSION AND CONDITIONED SUPPRESSION IN SQUIRREL MONKEYS

During three experiments with squirrel monkeys, stimulus and shock pairings were given in the presence of a bite tube. Experiments 1 and 2 used a conditioned-suppression procedure in which bar pressing was reinforced with food. A transparent shield prevented biting of the bar. When the stimulus was paired with shock, bar pressing decreased (conditioned suppression) and tube biting increased during the stimulus (classically conditioned aggression). When the bite tube was removed on alternate sessions in Experiment 2, there was more suppression when the tube was present, thus suggesting that biting competed with bar pressing. However, this simple competing-response interpretation was complicated by the findings of Experiment 3 where, with naive monkeys, bar pressing was never reinforced with food, yet bar pressing was induced during the stimulus and was highest when the bite tube was absent. The fact that stimulus-induced bar pressing developed indicates that bar pressing in conditioned-suppression procedures, suppressed or not, may be maintained by two types of control—the food reinforcer and induced CS control. The higher rate of induced bar pressing during the stimulus with the bite tube absent confounds a simple competing response interpretation of conditioned suppression. It suggests that shock-induced responses during conditioned suppression could be both contributing to and competing with responding maintained by food, with the net effect depending on specific but ill-defined features of the situation.