Some effects of response-independent shocks after unsignaled avoidance conditioning in rats

After extended unsignaled avoidance training, the majority of rats continued frequent responding during long periods when only response-independent shocks were presented. Most responses were shock elicited, i.e., followed immediately after shock. Response rates were directly related to both the frequency and the intensity of response-independent shocks. Responding continued to approximately the same extent, whether shocks were presented at fixed or variable intervals. Few responses were directed toward a second lever in the test chamber, even when the lever previously associated with avoidance was removed. When avoidance was scheduled on the second lever, the rats learned to avoid by operating it. Meanwhile, responding on the first lever became infrequent. Subsequently, when only response-independent shocks were presented, almost all responses occurred upon the lever initially associated with avoidance. Responding that was elicited by response-independent shocks was suppressed by response-dependent (punishment)_shocks of the same intensity. When punishment was withdrawn, recovery of responding occurred. An explanation of the results based upon shock-elicited behaviors is preferred to one stressing unextinguished avoidance responding.     

ASSESSING THE ROLE OF EFFORT REDUCTION IN THE REINFORCING EFFICACY OF TIMEOUT FROM AVOIDANCE

Rats responded on concurrent schedules of shock‐postponement or deletion (avoidance) and timeout from avoidance. In Experiment 1, 3 rats' responses on one lever postponed shocks for 20 s and responses on a second lever produced a 1‐min timeout according to a variable‐interval 45‐s schedule. Across conditions, a warning signal (white noise) was presented 19.5 s, 16 s, 12 s, 8 s, or 4 s before an impending shock. Raising the duration of the warning signal increased both avoidance and timeout response rates. Timeout responding, although positively correlated with avoidance responding, was not correlated with the prevailing shock rate. In Experiment 2, 3 rats' responses on one lever deleted scheduled shocks according to a variable‐cycle 30‐s schedule and responses on a second lever produced a 2‐min timeout as described above. After this baseline condition, the avoidance lever was removed and noncontingent shocks were delivered at intervals yoked to the receipt of shocks in the baseline sessions. Timeout responding decreased when the avoidance lever was removed, even though the shock‐frequency reduction afforded by the timeout remained constant. These results suggest that a key factor in the reinforcing efficacy of timeout is suspension of the requirement to work to avoid shock, rather than the reduction in shock frequency associated with timeout.     

The use of strategies and messages to alter aggressive interactions

Male and female college students were instigated to aggression by a confederate's shocks during a preliminary task. The confederate informed half of the treatment subjects of the response strategy which he intended to adopt. The other half received an irrelevant message. All subjects then competed against the confederate, who employed one of the following five response consequence strategies: a) set a maximum shock on all trials; b) set a minimum shock on all trials; c) set shocks identical to the subject's response on the preceding trial; d) set shocks two settings below the subject's response; or e) set shocks two settings above the subject's. The subject's latency to setting a shock, the intensities of the shocks set, the durations of the shock settings, and the subject's reaction times were recorded. When an irrelevant message was delivered, passive responses, well below those of the opponent, resulted in the lowest level of retaliation. In the presence of a relevant message, the match-same strategy emerged as an effective deterrent to aggressive behavior. The results were found to be consistent with predictions derived from an application of the norm of reciprocity and research demonstrating the enhancing effects achieved through the communication of existing contingencies.     

Two types of pigeon key pecking: suppression of long- but not short-duration key pecks by duration-dependent shock

The key pecking of eight pigeons was maintained on a variable-interval 1-minute schedule of food reinforcement. Sometimes, all responses between 35 and 50 milliseconds in duration produced a shock; sometimes, all responses between 10 and 25 milliseconds produced a shock; sometimes, shocks were produced by pecks without regard to duration (nondifferential punishment), and sometimes shocks were delivered independently of responding. Punishment of 35- to 50-millisecond responses selectively suppressed those responses, while punishment of 10- to 25-millisecond responses and nondifferential punishment suppressed responding overall but did not suppress responses of particular duration. Punishment of 35- to 50-millisecond responses suppressed key pecking slightly less than did nondifferential punishment. Punishment of 10- to 25-millisecond responses and response-independent shock produced roughly equal amounts of suppression, substantially less than the other punishment procedures. The data support the view that there are at least two kinds of key peck, identifiable on the basis of duration, one of which (short duration) is insensitive to its consequences.     

Persistent shock-elicited responding engendered by a negative-reinforcement procedure

A procedure in which responses reduced intermittently presented electric shocks to one quarter of their originally scheduled intensity, effectively engendered and maintained lever pressing in hooded rats. This contingency also markedly increased the response rates of rats initially trained under an unsignaled avoidance procedure. The responding of all animals extinguished rapidly when shock was withdrawn. Subsequently, it was discovered that high response rates could be maintained solely through presentation of shocks that were not affected by responses. Variations in the interval between shocks and changes in shock intensity over a wide range did not attenuate responding. Terminal performance was characterized by a consistent pattern of shock-elicited responses. Responses were also elicited by a tone following repeated tone-shock pairings. Finally, responding that was maintained by response-independent shocks was quickly suppressed by response-contingent shocks of the same intensity.     

Continuous punishment of free-operant avoidance in the rat

Three groups of albino rats were trained under a free-operant avoidance (Sidman) procedure with equal shock-shock and response-shock intervals. After stable performance was achieved, the animals were concurrently exposed to a brief electric shock after each response. The procedures were as follows: Punishment Schedule I: punishment shock was introduced at an intensity approximately one quarter that of avoidance shock; increments of nearly this same size were made as stable performance was achieved at succeeding punishment shock intensities. Punishment Schedule II: punishment shock was introduced at approximately one-half the intensity of avoidance shock; after stable performance, punishment shock was increased to the same intensity as avoidance shock. Punishment Schedule III: punishment shock was introduced and maintained at the same intensity as avoidance shock. Punishment was continued for all groups until one of two suppression criteria was attained. All animals made fewer responses and received more avoidance shocks as a function of increasing punishment shock. Half of the animals under Punishment Schedule I required punishment shock higher than avoidance shock to meet their assigned suppression criterion. A comparison of all procedures showed that suppression was greater when punishment shock was initially at high intensity.     

Free operant avoidance as a function of the response-shock=shock-shock interval

Two temporal parameters of free operant or Sidman avoidance behavior are the interval by which responses postpone shocks (Response-Shock interval) and the interval between shocks when no responses occur (Shock-Shock interval). Avoidance behavior was examined in three white rats under conditions where the Response-Shock and Shock-Shock intervals were always equal. With intervals from 10 to 60 sec response rates and shock rates were similar, decreasing, negatively accelerated functions of increasing Response-Shock=Shock-Shock interval. Over this range, response and shock rates were linearly related to the reciprocal of the Response-Shock=Shock-Shock interval. It was shown, however, that this relation cannot hold at extremely long intervals. Both the ratio of responses emitted to shocks received and the percentage of shocks possible which were avoided increased at long Response-Shock=Shock-Shock intervals. These findings may be related to the fact that long intervals provide optimal conditions for conditioning avoidance behavior in the rat.     

Preconditioning exposure to the unconditined stimulus affects the acquisition of a conditioned emotional response

Four experiments examined the UCS preexposure phenomenon using conditioned suppression of food-reinforced responding as a measure of excitatory conditioning, and electric shock as a UCS. In Experiment 1, groups of rats were preexposed to unsignaled 0.8-mA electric shocks for 0, 1, 3, 5, or 10 days, and then conditioned with a 0.8-mA electric shock. Preexposure to electric shock 1 day prior to conditioning enhanced the acquisition of a CER, whereas preexposure to electric shock for 3, 5, or 10 days prior to conditioning attenuated the acquisition of a CER as a direct function of the number of days of preexposure. In Experiments 2 and 2A, groups of rats were preexposed to unsignaled electric shocks of 0.3, 0.5, 0.8, or 1.3 mA for 10 days, and then conditioned with a 0.8-mA electric shocl. All groups preexposed to electric shock acquired the CER at a slower rate than a group not preexposed to electric shock. The greatest attenuation of CER conditioning occurred when the same intensity electric shock was used during both the preexposure and conditioning phases. In Experiment 3, groups of rats were preexposed to signaled electric shocks of either 0.5, 0.8, or 1.3 mA, and then conditioned with a 0.8-mA electric shock. All groups preexposed to electric shock acquired the CER at a slower rate than a group not preexposed to electric shock. As in Experiments 2 and 2A, the greatest attenuation of CER conditioning occurred when the same intensity electric shock was used during both the preexposure and conditioning phases. In Experiment 4, groups of rats were preexposed to series of 0.5, 0.8, or 1.3-mA electric shocks which they could escape by performing a chain-pull response. Rats in each of these groups had yoked partners which received the same number, intensity, and temporal pattern of electric shocks, but could not perform a response to escape shock. All groups were then conditioned with a 0.8-mA electric shock. Rats preexposed to escapable electric shocks showed equal or greater attenuation of CER conditioning than rats which could not escape shock during the preexposure phase. These results are discussed in terms of nonassociative and associative explanations of the UCS preexposure phenomenon.     

Fixed-interval schedules of electric shock presentation: extinction and recovery of performance under different shock intensities and fixed-interval durations

In squirrel monkeys responding under a schedule in which responding postponed the delivery of electric shock, the presentation of response-dependent shock under a fixed-interval (FI) schedule increased the rate of responding. When the schedule of shock-postponement was eliminated, so that the only shocks delivered were those produced by responses under the FI schedule, a pattern of positively accelerated responding developed and was maintained over an extended period. When responses did not produce shocks (extinction), responding decreased. When shocks were again presented under the FI schedule, the previous pattern of responding quickly redeveloped. In general, response rates were directly related to the intensity of the shock presented, and inversely related to the duration of the fixed-interval. These results raise fundamental questions about the traditional classification of stimuli as reinforcers or punishers. The basic similarities among FI schedules of food presentation, shock termination, and shock presentation strengthen the conclusion that the schedule under which an event is presented and the characteristics of the behavior at the time the event is presented, are of overriding importance in determining the effect of that event on behavior.     

Reduction of shock duration as negative reinforcement in free-operant avoidance

Rats were trained on a free-operant procedure in which shock duration was controlled by responses within a limited range of interresponse times. Shocks of 1.6-mA intensity occurred randomly with average density of 10 shocks per minute. As long as interresponse times were 15 seconds or less, any shocks received were at the briefer of two durations (.3 second). Whenever interresponse times exceeded 15 seconds, any shocks received were at the longer duration (1.0 second). For six of eight animals, avoidance responding developed quickly and reached levels of better than 90%. Four yoked animals stopped responding within the first few sessions. Shock duration reduction without change in shock probability or intensity was sufficient for the acquisition and maintenance of avoidance responding.     

Verbal instruction abolishes fear conditioned to racial out-group faces

Previous research has shown resistance to extinction of fear conditioned to racial out-group faces, suggesting that these stimuli may be subject to prepared fear learning. The current study replicated and extended previous research by using a different racial out-group, and testing the prediction that prepared fear learning is unaffected by verbal instructions. Four groups of Caucasian participants were trained with male in-group (Caucasian) or out-group (Chinese) faces as conditional stimuli; one paired with an electro-tactile shock (CS+) and one presented alone (CS−). Before extinction, half the participants were instructed that no more shocks would be presented. Fear conditioning, indexed by larger electrodermal responses to, and blink startle modulation during the CS+, occurred during acquisition in all groups. Resistance to extinction of fear learning was found only in the racial out-group, no instruction condition. Fear conditioned to a racial out-group face was reduced following verbal instructions, contrary to predictions for the nature of prepared fear learning.     

Effect of CS-US pairings on shock-elicited aggression as a function of US intensity

In two experiments with paired rats, the effect of superimposing CS-US pairings on a baseline of shock-elicited aggression was studied. Baseline shocks (3.0 mA, 0.125-sec duration) occurred at a rate of 20 shocks per min throughout each session. In Experiment I, each independent group of two pairs of subjects received (in addition to baseline shocks) US shocks of 1.0, 3.0, or 5.0 mA and 5-sec duration, each shock signalled by a 1-min CS. At all three US intensities, aggression increased during the CS. In Experiment II, pairs of subjects received each unconditioned stimulus intensity in a within-subjects design. This procedure revealed a direct relationship between rate of responding and unconditioned shock intensity.     

Learned fear of "unseen" faces after Pavlovian, observational, and instructed fear

This study compared fear learning acquired through direct experience (Pavlovian conditioning) and fear learning acquired without direct experience via either observation or verbal instruction. We examined whether these three types of learning yielded differential responses to conditioned stimuli (CS+) that were presented unmasked (available to explicit awareness) or masked (not available to explicit awareness). In the Pavlovian group, the CS+ was paired with a mild shock, whereas the observational-learning group learned through observing the emotional expression of a confederate receiving shocks paired with the CS+. The instructed-learning group was told that the CS+ predicted a shock. The three groups demonstrated similar levels of learning as measured by the skin conductance response to unmasked stimuli. As in previous studies, participants also displayed a significant learning response to masked stimuli following Pavlovian conditioning. However, whereas the observational-learning group also showed this effect, the instructed-learning group did not.     

The effect of rate of delivery of response-independent shocks upon avoidance responding

Two hooded rats were trained to bar-press to avoid electric shock on a continuous avoidance schedule with response-shock and shock-shock intervals equal. The rate of delivery of response-independent shocks superimposed on this schedule was varied. The response-independent shocks led to generally higher response rates but, with responses during shock omitted, the rates decreased as the response-independent shock rate was increased. The actual shock rate received by the subjects was linearly related to the maximum potential shock rate. There was an increasing, negatively accelerated function between percentage avoidance and response rate, but there was no consistent relation between the number of shocks avoided and response rate. Response rate decreased as the potential shock rate increased, but responding was maintained even when as few as 15% of the shocks could be avoided.     

The puzzle of responding maintained by response-contingent shock.

Four squirrel monkeys were first exposed to a sequence of procedures that reliably generate responding maintained by brief response-contingent electric shocks arranged according to a fixed-interval schedule. After responding had become stable on the fixed-interval schedule, additional contingencies were added in tandem, whereby after completion of the interval, the spacing of responses affected shock delivery. In one procedure, responses had to be spaced more widely than their previous median value if shock were to be delivered. In the other procedure, responses had to be spaced more closely to produce shock. On the first of these procedures, decreased but stable responses rates would indicate that shock functioned as a positive reinforcer; on the second, increased response rates would indicate the positively reinforcing function. Instead, response rates accelerated on the procedure that targeted more widely spaced responses for shock delivery, and decelerated or ceased on the procedure that arranged for shocks to be produced by more closely spaced responses. Consistent with other recent findings, these results question the interpretation of performances maintained by response-contingent shock as engendered by positive reinforcement and are consistent with aversive-control interpretations. The details of that aversive control are not entirely clear, however, and these same procedures would be informative if applied to shock-maintained behavior that is generated in other ways.     

Adrenocortical influences on free-operant avoidance behavior

Rats were conditioned to avoid shock on a free-operant avoidance schedule in which no exteroceptive stimulus signaled impending shock. Injections of adrenocorticotropic hormone (ACTH) or dexamethasone raised blood levels of glucocorticoids. These increases were accompanied by changes in avoidance performance: there was a higher frequency of long-duration interresponse times, a greater stability among them, and fewer short interresponse times, total responses, and shocks.     

Electric shock produced drinking in the squirrel monkey.

Squirrel monkeys were periodically exposed to brief electric tail shocks in a test environment containing a rubber hose, response lever, and a water spout. Shock delivery produced preshock lever pressing and postshock hose biting. Additionally, all subjects displayed licking responses following postshock biting-attack episodes. Further experiments showed that licking was: (1) influenced by hours of water deprivation; (2) drinking behavior; (3) the direct result of shock delivery; and (4) developed spontaneously in naive subjects with or without opportunities for hose biting or lever pressing. Removing the opportunity to attack increased postshock drinking. A noxious environmental stimulus that causes aggression can also produce drinking.     

Choice and the dependability of stimuli that predict shock and safety

This study assessed whether choosing a signalled shock condition over an unsignalled one is controlled by a stimulus that predicts the presence of shock (Experiment I), or by a stimulus that predicts the absence of shock (Experiment II). The dependability of these stimuli as predictors of either the presence or the absence of shock was parametrically varied over a wide range, and subjects (rats) were given an option to change from an unsignalled to a signalled condition. In the first experiment, all shocks were preceded by signals; however, the probability of a signal being followed by shock varied from 1.0 to 0.02. The data obtained indicate that the dependability of the signal as a predictor of shock is unimportant. Rats changed to the signalled condition when the signal was completely dependable (all signals followed by shock) and when the dependability of the signal was systematically degraded. In the second experiment, all signals were followed by shock; however, some shocks were not preceded by a signal. The data show that the dependability of a stimulus predicting the absence of shock is important in that, as dependability decreases, changing to the signalled condition also decreases.     

Schedules using noxious stimuli. III. Responding maintained with response-produced electric shocks

Responding was maintained in two squirrel monkeys under several variations of a 10-min fixed-interval schedule of electric shock presentation. The monkeys were first trained under a 2-min variable-interval schedule of food presentation, and then under a concurrent schedule of food presentation and shock presentation. In one monkey, when shocks (12.6 ma) followed each response during the last minute of an 11-min cycle ending with a timeout period, responding was increased during the first 10 min and suppressed during the last minute of each cycle. When the shock schedule was eliminated, both the enhancement and suppression disappeared, and a steady rate of responding was maintained under the variable-interval schedule. When the food schedule was eliminated, the shock schedule maintained a characteristic fixed-interval pattern of responding during the first 10 min, but suppressed responding during the last minute of each cycle. The fixed-interval pattern of responding was maintained when the timeout period was eliminated and when only one shock could occur at the end of the cycle. In the second monkey, responding under the concurrent food and shock schedule was suppressed when responses produced shocks after 3-min. Under an 11-min cycle, responding continued to be maintained at increasing shock intensities. When the food schedule was eliminated, a fixed-interval pattern of responding was maintained under a 10-min schedule of shock presentation (12.6 ma). Whether response-produced electric shocks suppressed responding or maintained responding depended on the schedule of shock presentation.