The effects of overtraining on flooding of jump-up and shuttlebox avoidance responses

Two experiments are reported which test the effects of overtraining (2, 4 or 6 days) on the efficacy of flooding (response-prevention) in hastening the extinction of jump-up and two-way shuttlebox avoidance responses. In the jump-up box, overtraining reduces the effectiveness of flooding in two ways: Rats trained for 6 days and given a flooding treatment are more resistant to extinction than rats trained for only 2 or 4 days and given a flooding treatment. By contrast, rats trained for 6 days and given a control treatment are less resistant to extinction than control rats trained for 2 or 4 days. In the shuttlebox, overtraining neither reduces the effectiveness of flooding in hastening avoidance response extinction, nor reduces the resistance to extinction of control animals. Implications of these different effects of overtraining on jump-up and two-way shuttlebox responses are discussed.     

Effects of naloxone on acquisition and extinction of jump-up avoidance behavior in rats

Two experiments were carried out to assess the effects of the opioid antagonist, naloxone, on the acquisition and extinction of shock avoidance by rats in the jump-up apparatus. In Experiment 1 naloxone pretreatment facilitated acquisition but had no effect on extinction of avoidance behavior. In the second experiment the effect of naloxone on acquisition was replicated and in addition, it was shown that naloxone enhanced freezing when a response prevention or flooding procedure was introduced. Again naloxone failed to alter the course of extinction, nor did it interact with the effects of flooding which, by itself, facilitated extinction. The results suggest that naloxone's effects are limited to increasing the functional intensity of the US, and provide further support for the dissociation between extinction of avoidance behavior and other indices of fear.     

Determinants of fear over the course of avoidance learning

Most theorists have explained attenuation of fear over the course of avoidance learning by assuming that fear extinguishes with repeated nonreinforced avoidance trials. Experiment 1 replicates the finding that rats trained to a criterion of 27 consecutive avoidance responses (CARs) show less fear during the CS than rats trained to a criterion of 3 or 9 CARs. This attenuation of fear cannot, however, be accounted for by simple Pavlovian fear extinction, because yoked partners receiving the exact same pattern of CSs and USs did not show this attenuation and did not differ from yoked partners receiving only reinforced CS presentations. Experiment 2 found that feedback from the master avoidance learner's response is sufficient to produce this attenuation in yoked animals; “control” per se is not necessary. Several possible explanations are discussed regarding the mechanism underlying this role of feedback in diminishing fear of the CS in the avoidance learning context.     

Backchaining of relaxation in the extinction of avoidance

After rats were trained in one-way avoidance, two types of nonshock treatment were given to assess the degree to which fear of the shock area is affected by (a) nonshock responding (regular extinction trials) apart from (b) repeated exposure to the shock area in the absence of shock (response prevention). Different groups of regular extinction rats received 1 or 27 trials; response prevention control rats were equated with regular extinction rats on amount of nonshock exposure to the shock area and other variables. Fear of the shock area was measured on a posttreatment passive avoidance test. Regular extinction trials led to less fear of the shock side than response prevention trials when 27 nonshock trials were given. The results (a) suggest that relaxation back-chains from the safe to the shock area over repeated avoidance extinction trials, and (b) clarify existing problems of maintained fear with the response prevention technique.     

Dissociation between conditioned emotional response and extended avoidance performance

The present experiments examined the dissociation between the strength of a shuttlebox avoidance response (AR) and one index of fear of the avoidance CS. Avoidance response strength was indexed by resistance to extinction of the AR and by changes in response latency, and fear of the CS was indexed by the conditioned emotional response (CER) technique. Experiments 1, 2A, and 3A all found that rats trained to a criterion of 27 consecutive avoidance responses (CARs) showed response strength comparable or superior to rats trained to a criterion of 9 CARs. Experiments 2B and 3A demonstrated that rats trained to 27 CARs showed less suppression of bar pressing during the avoidance CS (less CER) than rats trained to 9 CARs. Experiment 3A also found that, when extinguished in the shuttlebox to a moderate criterion (5 consecutive trials without a response) before CER testing, rats trained to 9 CARs showed some, although not complete, loss of CER, whereas rats trained to 27 CARs showed no loss of CER. In Experiment 3B rats that took 1 vs 2 days to reach a criterion of 27 CARs were compared for their AR strength and for their CER. Although rats taking 2 days to reach criterion showed somewhat greater resistance to extinction of the AR than rats reaching criterion in 1 day, this variable had no apparent effect on the CER. Implications of the present results for current theories of avoidance learning are discussed.     

Some further tests of the brief confinement effect and the SSDR account of flooding

Although brief confinement in novel or fearful places may occasionally produce flooding-like effects with regard to hastening avoidance response extinction, the results of the three experiments reported here indicate that this is not as robust a phenomenon as is flooding. Experiments 1 and 2 found that any tendency for a brief confinement effect to occur is likely to result from the use of a procedure where extinction is started on the grid floor as opposed to on the ledge of a jump-up box. Experiment 3 found no evidence at all that confinement in either a novel or a fearful place can hasten the extinction of a more well-learned jump-up response than that studied in previous experiments, even when the grids extinction procedure was used. Overall these results do not support the SSDR account of flooding, which has derived its chief support from experiments demonstrating a brief confinement effect.     

Extinction of responding maintained by timeout from avoidance

The resistance to extinction of lever pressing maintained by timeout from avoidance was examined. Rats were trained under a concurrent schedule in which responses on one lever postponed shock on a free-operant avoidance (Sidman) schedule (response-shock interval = 30 s) and responses on another lever produced 2 min of signaled timeout from avoidance on a variable-ratio 15 schedule. Following extended training (106 to 363 2-hr sessions), two experiments were conducted. In Experiment 1 two different methods of extinction were compared. In one session, all shocks were omitted, and there was some weakening of avoidance but little change in timeout responding. In another session, responding on the timeout lever was ineffective, and under these conditions timeout responding showed rapid extinction. The within-session patterns produced by extinction manipulations were different than the effects of drugs such as morphine, which also reduces timeout responding. In Experiment 2 shock was omitted for many consecutive sessions. Response rates on the avoidance lever declined relatively rapidly, with noticeable reductions within 5 to 10 sessions. Extinction of the timeout lever response was much slower than extinction of avoidance in all 4 rats, and 2 rats continued responding at baseline levels for more than 20 extinction sessions. These results show that lever pressing maintained by negative reinforcement can be highly resistant to extinction. The persistence of responding on the timeout lever after avoidance extinction is not readily explained by current theories.     

Dissociative effects of flooding on a multivariate assessment of fear reduction and on jump-up avoidance extinction

Two experiments examined the effectiveness of three different amounts of flooding on hastening extinction of a jump-up avoidance response and on reducing fear as assessed by the multivariate fear assessment techniques of D. P. Corriveau and N. F. Smith (Journal of Experimental Psychology: General, 1978, 107, 145–158). In Experiment 1, a 40-min flooding treatment significantly hastened jump-up avoidance extinction, 10 min of flooding had a marginal effect, and 5 min had no effect. In Experiment 2, flooding treatments of 5, 10, and 40 min duration were all effective in reducing fear of the grid floor as indexed by seven of our nine dependent measures, including approach latency, safety test latency, and amount of time spent on the grids. Flooded subjects that were dumped onto the grid floor once at the start of the fear observation phase were found to show somewhat more fear reduction than were flooded subjects that were simply placed on the ledge at the outset of the fear observation phase and never dumped. These results, i.e., less flooding is required to reduce fear than to hasten avoidance extinction, are contrasted with those of previous experiments indicating that more flooding may be required to reduce fear than to hasten shuttlebox avoidance extinction. Such differences are discussed in the context of SSDR theory.     

Relative persistence of avoidance and positively reinforced behavior

In one experiment with rats, and a second with pigeons, subjects were trained on a schedule in which identical response dependencies applied to intermittent receipt of positive reinforcement (PR) for one group and avoidance (AV) of shock for a second group. After obtaining comparable stable training performance for groups PR and AV, persistence tests were conducted with a traditional extinction (EXT) procedure vs. response-independent (FREE) delivery of positive reinforcers or shocks. In both experiments, response elimination was rapid in EXT for groups PR and AV, and responding tended to be maintained in groups PR and AV in the FREE persistence test. These results contradict the widely held assumption that avoidance behavior is unusually resistant to extinction, and they call for a re-examination of elimination of avoidance responding.     

Avoidance extinction in goldfish

Independent groups of goldfish trained to avoid shock in a shuttlebox situation were presented with several extinction procedures in which the relationships between the conditioned stimulus and shock were altered and/or response contingencies removed. Random shock presentations, equivalent to the number of shocks received during avoidance acquisition, resulted in response decrements similar to those obtained when the conditioned stimulus was presented alone. Pairing the conditioned stimulus with shock on every trial, however, served to maintain response levels. When response-contingent punishment was superimposed upon these Pavlovian pairings, performance was facilitated slightly although punishment alone resulted in somewhat faster response reduction than that produced by exposure only to the conditioned stimulus. Extinction of avoidance responding produced by exposure to the conditioned stimulus alone was dependent on the total duration of exposure and independent of both number of stimulus onsets and response prevention. These experiments demonstrated that, in general, the procedures used to reduce avoidance responding in rats were equally effective for goldfish, with one exception: the introduction of a Pavlovian contingency following avoidance acquisition, making the previously avoidable shock unavoidable, maintained response probabilities near previously established levels.     

Dissociative effects of different types and amounts of nonreinforced CS exposure on avoidance extinction and the CER

Two experiments examined the effectiveness of two amounts of flooding or response-prevention on hastening avoidance response extinction and on reducing CS-produced suppression of bar-pressing for food. In Experiment 1, 20 and 30 flooding trials were both shown to be effective in hastening the extinction of a well-learned shuttlebox avoidance response. In Experiment 2, rats trained under comparable conditions to those in Experiment 1 were tested following flooding for the CER in a different apparatus. The results indicated that 30, but not 20, flooding trials were sufficient to reduce the CER. In each experiment the results of additional control groups equated with the flooded groups for nonreinforced CS exposure also revealed a dissociation between the effectiveness of this CS time control procedure in hastening avoidance response extinction and in reducing the CER. Further comparisons showed that although 30 flooding trials did reduce the CER, the same total duration of nonreinforced CS Exposure in the form of avoidance extinction trials did not. Thus the context in which CS exposure occurs may affect the dynamics of extinction of the CER. The experiments are discussed in the broader context of dissociation of various indices of fear in humans.     

Acquisition and extinction of signaled avoidance as a function of intermittent reinforcement

Signaled, shuttle-box avoidance responding in female rats of the Fischer₃₄₄ strain was examined as a function of four separate contingencies of intermittent reinforcement. In Experiment 1, when avoidance responses during acquisition were reinforced 25% of the time with prompt CS termination, animals responded equally often during acquisition and significantly more often during extinction than animals who received such reinforcement on a 100% schedule. Similar results were found under a trace procedure in Experiment 2 when avoidance responses were reinforced 25% of the time with informational feedback stimuli. In contrast, during Experiment 3, when animals were shocked on only 25% of the trials on which they failed to respond, the level of avoidance responding during both acquisition and extinction was significantly less than it was when animals were shocked on a 100% schedule. Comparable results were found in Experiment 4 when avoidance responses during acquisition averted shock on only 25% of the trials. Thus, intermittent reinforcement contingencies involving response-contingent feedback stimuli and shock have differential effects on avoidance responding during both acquisition and extinction trials under the signaled avoidance procedure.     

Lever attacking and pressing as a function of conditioning and extinguishing a lever-press avoidance response in rats

Six experimental rats were conditioned to press one of two available levers to avoid shock. The levers registered bites as well as presses. For four of these rats, shock was contingent on lever bites when a specified time period had elapsed after the previous shock. An extinction period, in which only periodic noncontingent shocks were presented, followed avoidance training. Six yoked-control rats received the same sequence of shocks as did the corresponding experimental rats in both the conditioning and extinction phases. All six experimental rats repeatedly bit the avoidance lever. Four bit it more than the nonavoidance lever during conditioning, and five bit it more during extinction. Five of the six experimental rats consistently bit the levers many more times during each session than did their respective control rats, suggesting that avoidance conditioning facilitated lever biting. Rates of lever biting and pressing by all of the experimental rats and by some of the control rats were highest immediately following shock throughout both phases. During later portions of the intervals following shock, characteristic effects of conditioning and extinction were observed. This finding suggests that extinction of avoidance behavior by unavoidable shock presentations can be demonstrated more readily when shock-elicited responding is extricated from the data.     

Extinction of Sidman avoidance behavior

Extinction of Sidman avoidance behavior by eliminating the noxious stimulus was studied in Sprague-Dawley rats with bar-pressing as the response. Each of three subjects was trained and extinguished on each of the following schedules in a different order: nondiscriminated, response-shock interval = 20 sec, shock-shock interval = 5 sec; nondiscriminated, response-shock interval = 40 sec, shock-shock interval = 5 sec; discriminated, response-white noise interval = 15 sec, noise-shock interval = 5 sec, shock-shock interval = 5 sec. Less than one 4-hr session was required for extinction for all procedures. When a warning stimulus was present, resistance to extinction increased. Subjects did not, however, respond to avoid the signal. Only small differences in extinction were found after training on different schedules with no warning signal.     

Learned suppression of photopositive tendencies in Drosophila melanogaster

A task was designed to teach individual flies to avoid a lighted area after they had displayed an initial preference for it. The flies walked in a T-maze and chose between a lighted and a darkened alley leading, respectively, to a lighted and a darkened vial. Flies that were photopositive on a first trial were subjected to an aversive stimulus (a filter paper inserted into the lighted vial and wetted with a quinine solution), and they performed 16 training trials; they learned to avoid the lighted vial. The flies trained with water instead of quinine in the lighted vial still display avoidance of the lighted vial, but to a lesser extent. The flies trained with a dry filter paper in the lighted vial did not show any increase in avoidance during training. Like the flies trained with no quinine at all, those trained to avoid the lighted vial under a partial reinforcement condition (one half of the trials with quinine, the other half with a dry vial) did not master the task. Finally, removal of the quinine after an avoidance acquisition criterion was reached resulted in an extinction process.     

The influence of positive and negative reinforcement on selective attention in the rat

In Experiments 1 and 2 rats were trained under two multiple schedules of reinforcement. In one, bar pressing during a tone-light compound stimulus was reinforced under a variable-interval food reinforcement schedule. In the other multiple schedule, bar pressing avoided grid shock on a free-operant schedule. In both multiple schedules, a discrimination was maintained by an extinction schedule that was operative during the absence of the tone-light compound. In Experiments 1 and 2 the intensity of the tone-light compound was manipulated over three levels. Subsequent extinction tests revealed that light was attended to, almost exclusively of the tone, when food reinforcement had maintained bar pressing. On the other hand, the tone gained considerable attentional control under the shock avoidance schedule. This stimulus-reinforcer interaction was maintained for all three levels of the compound intensity. In Experiment 3 it was investigated whether this interaction was associative by presenting shock during the absence of the tone-light compound when food reinforcement maintained responding, and food during the absence of the compound when shock avoidance maintained responding. Since both food and shock were presented during a single session for both schedules, nonassociative effects of the reinforcing stimuli were equivalent across the schedules. Nevertheless, the stimulus-reinforcer interaction was maintained, indicating that the interaction was an associative effect.     

Gustatory,salivary, and oral thermal responses to solutions of sodium chloride at four temperatures

Using eight highly trained Ss, sensitivity to near threshold levels of NaCl was significantly greater at solution temperatures of 22° and 37°C than at 0° or 55°C. Perceived intensity increased linearly with concentration (0.04%–0.64% NaCl) at all four solution temperatures, with the two lower considered slightly more intense than the two higher temperatures. Biomodal distributions were obtained for hedonic judgments at all temperatures, with three Ss showing greater liking and five Ss showing greater disliking of increasing concentrations. Parotid salivary flow was inversely related to the taste sensitivity, i.e., significantly lower flow rates were obtained for the intermediate than for the hot or cold solutions, independent of salt content. When solution temperature was O°C, the minimum temperature of the oral cavity was 9°–20°C; when solution temperature was 55°C, the maximum temperature of the oral cavity was46°–49°C.     

High ambient temperature reduces rate of body-weight loss produced by wheel running

This study examined the effect of ambient temperature (AT) on the relationship between activity and weight loss. Compared with a neutral AT of 21°C, high ATs of 27–29°C produced a slower rate of weight loss in rats given 1.5-hr food access and 22.5-hr running-wheel access in a standard activity-based anorexia (ABA) procedure (Experiments 1 and 2). The high AT did not affect food intake or wheel running in Experiment 1, but did reduce running in Experiment 2. Switching from neutral to high AT had only a transient effect on weight loss when wheel access was maintained (Experiment 2) but resulted in less weight loss when wheel access was prevented (Experiment 3). Giving rats only 3 hr of wheel access each day at a neutral AT also produced substantial weight loss, but less if for the rest of each day they were maintained at a high AT (Experiment 4).     

Motivational control of instrumental performance following a shift from thirst to hunger

Thirsty rats were trained to press a lever for either a sucrose solution or saline before performance was tested in extinction while the animals were either hungry alone or experiencing both hunger and a sodium appetite. Reinforcer-specific motivational control was observed in that the animals trained with the sucrose solution pressed more than those trained with the saline when they were tested hungry, but not when they were tested under combined hunger and sodium appetite. In order to assess the role of a Pavlovian incentive process in this effect, thirsty animals received non-contingent pairings of one stimulus with the sucrose solution and another with saline in the second experiment. In an extinction test the sucrose stimulus augmented lever pressing relative to the saline stimulus when the animals were hungry, but not when they were thirsty. In the subsequent experiments the contribution of the Pavlovian process was equated by giving concurrent training with both incentives. Lever pressing and chain pulling were reinforced concurrently, one with the sucrose solution and the other with saline, while the animals were thirsty. Once again, the animals pressed more in extinction if this action had been trained with the sucrose solution rather than the saline, but only if they were hungry rather than thirsty. Thus, instrumental performance across a thirst-to-hunger shift can also be controlled by an instrumental incentive process. The direct engagement of the instrumental process by this motivational shift contrasts to the absence of such control following a hunger-to-thirst transition (Dickinson & Dawson, 1987a), a fact attributed to the asymmetrical motivational interactions produced by water and food deprivation.     

Freezing as an avoidance response: Another look at the operant-respondent distinction

Groups of rats were trained with shock either contingent on freezing (punishment procedure) or contingent on not freezing (avoidance procedure). Although the different contingencies produced different levels of freezing behavior, these levels were attained immediately rather than over a number of trials. This result, together with the results of control rats, suggest that while freezing can be controlled by both punishment and avoidance procedures, in both cases the effects on freezing are due to elicitation rather than learning.