Persistent behavior maintained by unavoidable shocks

Squirrel monkeys were trained on a multiple schedule in which 10-min periods on a continuous shock avoidance schedule, indicated by a yellow light, alternated with 10-min periods on a 1.5-min variable interval schedule of food reinforcement (VI 1.5). A white light indicated that VI 1.5 was in effect, except for the middle 2 min of the period on VI 1.5, in which a blue light appeared and terminated with the delivery of a 0.5-sec unavoidable shock. Stable response rates developed in the avoidance and VI 1.5 components. However, the highest response rates occurred in the blue, preshock stimulus. A series of experiments showed that responding in the blue stimulus persisted even when responding had been extinguished on both the VI schedule of food reinforcement and the shock avoidance schedule. Responding in the blue stimulus ceased when the blue stimulus terminated without shock or when it terminated with a response-contingent shock. Each time responding ceased, it was restored by terminating the blue stimulus with an unavoidable shock. When the blue stimulus was on throughout each session and unavoidable shocks were delivered at regular 10-min intervals, responding was well maintained. These results show that in monkeys that have been trained on a continuous avoidance schedule, unavoidable shocks can maintain responding even under conditions where responses have no programmed consequences.     

The effects of unavoidable shocks on a multiple schedule having an avoidance component

Two dogs were maintained on a multiple schedule having both a food reinforced and an avoidance component (Mult VI 1′ S^Δ Avoid_{SS20 RS20} S^Δ). The effects of superimposing an Estes-Skinner procedure for delivering unavoidable shocks on all components of the multiple schedule were observed. The buzzer-shock pairing of the Estes-Skinner procedure produced an increased rate of responding on the avoidance component of the schedule and also on the S^Δ components. No persistent change in rate was observed on the food component during the pre-shock stimulus. Control performances on all components could be regained by either extinguishing or eliminating the buzzer-shock pairing. Extinction of the avoidance responding had little effect on the increased rates of responding produced by the Estes-Skinner procedure on the S^Δ and avoidance extinction components and did not lead to a conditioned suppression of the food reinforced responding. Rate of responding during the pre-shock stimulus was observed to be relatively independent of changes in the maintaining schedules. Responding during the pre-shock stimulus could be conditioned and maintained after an extensive history of avoidance extinction.     

Facilitation of discriminated lever-press avoidance by noncontingent shocks

Two experiments investigated the effect of presenting a brief noncontingent, unsignaled shock prior to warning-signal onset on discriminated lever-press avoidance behavior in rats. The main finding was that noncontingent shock delivered 2 sec but not 16 sec prior to warning-signal onset facilitated avoidance performance and learning. These results were predicted on the basis of shock-elicited response bursting which was expected to increase the operant level of the lever-press response at short shock-warning signal intervals. It was suggested that species-specific limitations on rats' lever-press avoidance are not unconditional, but rather can be overcome with environmental manipulations.     

Concurrent avoidance of shocks by pigeons pecking a key

Three pigeons were studied on concurrent, unsignaled, avoidance schedules in a two-key procedure. Shock-shock intervals were two seconds in both schedules. The response-shock interval on one key was always 22 seconds, while the response-shock interval associated with the other key was varied from 7 to 52 seconds in different experimental conditions. Response rates on the key associated with the varied schedule tended to decrease when the response-shock interval length was increased. Responding on the key associated with the constant schedule was not systematically affected.     

Effects of unavoidable electric shocks on voluntary alcohol consumption in the rat

The purpose of this experiment was to study the effects of electric shocks on voluntary alcohol intake in rats. Alcohol intake was measured using individually determined alcohol concentrations. Contrary to many previous studies, alcohol intake was reduced during the stressful treatment. It is concluded that accounting for individual differences in alcohol intake is important when studying the effect of stress on alcohol consumption.     

Some effects of response-independent shocks after unsignaled avoidance conditioning in rats

After extended unsignaled avoidance training, the majority of rats continued frequent responding during long periods when only response-independent shocks were presented. Most responses were shock elicited, i.e., followed immediately after shock. Response rates were directly related to both the frequency and the intensity of response-independent shocks. Responding continued to approximately the same extent, whether shocks were presented at fixed or variable intervals. Few responses were directed toward a second lever in the test chamber, even when the lever previously associated with avoidance was removed. When avoidance was scheduled on the second lever, the rats learned to avoid by operating it. Meanwhile, responding on the first lever became infrequent. Subsequently, when only response-independent shocks were presented, almost all responses occurred upon the lever initially associated with avoidance. Responding that was elicited by response-independent shocks was suppressed by response-dependent (punishment)_shocks of the same intensity. When punishment was withdrawn, recovery of responding occurred. An explanation of the results based upon shock-elicited behaviors is preferred to one stressing unextinguished avoidance responding.     

Extinction of Sidman avoidance behavior

Extinction of Sidman avoidance behavior by eliminating the noxious stimulus was studied in Sprague-Dawley rats with bar-pressing as the response. Each of three subjects was trained and extinguished on each of the following schedules in a different order: nondiscriminated, response-shock interval = 20 sec, shock-shock interval = 5 sec; nondiscriminated, response-shock interval = 40 sec, shock-shock interval = 5 sec; discriminated, response-white noise interval = 15 sec, noise-shock interval = 5 sec, shock-shock interval = 5 sec. Less than one 4-hr session was required for extinction for all procedures. When a warning stimulus was present, resistance to extinction increased. Subjects did not, however, respond to avoid the signal. Only small differences in extinction were found after training on different schedules with no warning signal.     

Stimulus control of avoidance behavior

The introduction of a warning signal preceding shocks greatly increased the effectiveness of avoidance responding. Periods of “warm-up” at the beginning of the session were eliminated, and the number of shocks received by the subjects was greatly reduced. With response-shock interval constant, response rate increased as the interval between the response and the onset of the warning signal was shortened. The response tended to occur shortly after the onset of the warning signal regardless of the duration of these “safe” periods. A greatly elevated response rate was maintained even when the duration of the safe period was reduced to 0.3 sec. Thus, the pre-shock signal obtained nearly exclusive control of the responding and overrode the usual “temporal discrimination” of the response-shock interval.     

Shock-induced aggression as a function of prior experience with avoidance, fighting, or unavoidable shock

Rats were trained in shock-induced aggression, free operant avoidance, or were presented with unavoidable shocks. Fighting in response to shock was subsequently measured by intermatching individual animals that had received the three training procedures. The fighting probabilities of animals with histories of avoidance and dominant animals with histories of fighting were higher than the fighting probabilities of non-dominant fighting rats or rats with a history of unavoidable shocks. Animals with higher fighting probabilities disrupted avoidance baselines more than animals with lower fighting probabilities. Control experiments suggested that fighting decrements produced by administration of prior grid-shock were due to the acquisition of behaviors incompatible with aggression.     

The effect of rate of delivery of response-independent shocks upon avoidance responding

Two hooded rats were trained to bar-press to avoid electric shock on a continuous avoidance schedule with response-shock and shock-shock intervals equal. The rate of delivery of response-independent shocks superimposed on this schedule was varied. The response-independent shocks led to generally higher response rates but, with responses during shock omitted, the rates decreased as the response-independent shock rate was increased. The actual shock rate received by the subjects was linearly related to the maximum potential shock rate. There was an increasing, negatively accelerated function between percentage avoidance and response rate, but there was no consistent relation between the number of shocks avoided and response rate. Response rate decreased as the potential shock rate increased, but responding was maintained even when as few as 15% of the shocks could be avoided.     

Second-order avoidance behavior in monkeys

Two monkeys were trained on a three-component multiple schedule using discrete trials. In one component (food), a response terminated a red stimulus and produced food and S(Delta). In the second component (avoidance), a response terminated a green stimulus and avoided shock. In the third component (optional), a response terminated a blue stimulus and produced S(Delta). The consequence of not responding in the blue stimulus, however, was the production of either a food or an avoidance trial. Manipulation of these consequences showed that when food trials were available only a small percent of the time after optional trials, the subjects tended not to respond in the blue, even though this led to an increase in the total number of avoidance trials per day. If only avoidance trials followed as a consequence of not responding in the optional component, the animals terminated the blue stimulus and avoided the avoidance trials. Throughout the experiment both subjects maintained consistently low shock rates (about 10 per day) and these were not affected by the various manipulations. The data suggest that a stimulus associated with avoidance can be a conditioned aversive stimulus and will maintain a more remote avoidance response under certain conditions.     

Behavioral variability as avoidance behavior

This study aimed to investigate whether variable patterns of responses can be acquired and maintained by negative reinforcement under an avoidance contingency. Six male Wistar rats were exposed to sessions in which behavioral variability was reinforced according to a Lag contingency: Sequences of three responses on two levers had to differ from one, two or three previous sequences for shocks to be avoided (Lag 1, Lag 2 and Lag 3, respectively). Performance under the Lag conditions was compared with performance on a Yoke condition in which the animals received the same reinforcement frequency and distribution as in the Lag condition but behavioral variability was not required. The results showed that most of the subjects varied their sequences under the Lag contingencies, avoiding shocks with relatively high probability (≥ 0.7). Under the Yoke procedure, responding continued to occur with high probability, but the behavioral variability decreased. These results suggest that behavioral variability can be negatively reinforced.