Reciprocal inhibition or extinction?

Since reciprocal inhibition therapy techniques involve the procedure for classical extinction, it is reasonable to consider the possibility that it is extinction, rather than counterconditioning, that is responsible for their efficacy. Certain experiments increase the plausibility of this possibility by suggesting that a certain feature of the extinction procedure involved in the reciprocal inhibition techniques makes it more effective than free response avoidance extinction. This feature is the fact that the subject's escape from the anxiety stimuli is delayed by the therapist's instructions. Only one experiment clearly indicates any feature of any reciprocal inhibition technique which could not be attributed to extinction, this characteristic being a superiority of a reciprocal inhibition procedure to extinction in eliminating fear in rats. Thus for explaining reciprocal inhibition therapy, it is still essentially an open question as to whether the concept of reciprocal inhibition is better than extinction.     

Alternative response training, differential reinforcement of other behavior, and extinction in squirrel monkeys (Saimiri sciureus)

In Experiment I, (a) extinction, (b) extinction plus reinforcement of a discrete alternative response, and (c) differential reinforcement of other behavior were each correlated with a different stimulus in a three-component multiple schedule. The alternative-response procedure more rapidly and completely suppressed behavior than did differential reinforcement of other behavior. Differential reinforcement of other behavior was slightly more effective than extinction alone. In Experiment II, reinforcement of specific alternative behavior during extinction and differential reinforcement of other behavior were used in two components, while one component continued to provide reinforcement for the original response. Once again, the alternative-response procedure was most effective in reducing responding as long as it remained in effect. However, the responding partially recovered when reinforcement for competing behavior was discontinued. In general, responding was less readily reduced by differential reinforcement of other behavior than by the specific alternative-response procedure.     

Counterconditioning reduces cue-induced craving and actual cue-elicited consumption

Cue-induced craving is not easily reduced by an extinction or exposure procedure and may constitute an important route toward relapse in addictive behavior after treatment. In the present study, we investigated the effectiveness of counterconditioning as an alternative procedure to reduce cue-induced craving, in a nonclinical population. We found that a cue, initially paired with chocolate consumption, did not cease to elicit craving for chocolate after extinction (repeated presentation of the cue without chocolate consumption), but did so after counterconditioning (repeated pairing of the cue with consumption of a highly disliked liquid, Polysorbate 20). This effect persisted after 1 week. Counterconditioning moreover was more effective than extinction in disrupting reported expectancy to get to eat chocolate, and also appeared to be more effective in reducing actual cue-elicited chocolate consumption. These results suggest that counterconditioning may be more promising than cue exposure for the prevention of relapse in addictive behavior.     

The discriminative control of free-operant avoidance despite exposure to shock during the stimulus correlated with nonreinforcement

Four rats were trained in darkness on a free-operant avoidance procedure in which shocks occurred randomly, but lever presses could reduce their frequency. Discrimination training followed, during which responses in light continued to reduce shock frequency, but responses in darkness had no effect. During each cycle, the light period was 4 min, while darkness lasted only until a 20-sec interval had elapsed without a response. This no-response requirement was increased to 40 sec for three animals and eventually to 60 sec for two of them. Discriminative control developed, despite a greater shock density in the dark, with response rate and number of responses per shock maintained or increasing during light and decreasing to very low values in darkness. Two animals were later exposed to a procedure in which shock density was unaffected by responding either in light or darkness. A 60-sec no-response requirement was continued in the dark. Discriminative control persisted through 42 sessions for one animal and required 45 sessions to approach extinction for the other animal. The role of the light as a potential conditioned reinforcer of other behavior in the dark was implicated in the development and persistence of discriminative control. These data support shock-frequency reduction as reinforcement for avoidance behavior.     

Acquisition and extinction of signaled avoidance as a function of intermittent reinforcement

Signaled, shuttle-box avoidance responding in female rats of the Fischer₃₄₄ strain was examined as a function of four separate contingencies of intermittent reinforcement. In Experiment 1, when avoidance responses during acquisition were reinforced 25% of the time with prompt CS termination, animals responded equally often during acquisition and significantly more often during extinction than animals who received such reinforcement on a 100% schedule. Similar results were found under a trace procedure in Experiment 2 when avoidance responses were reinforced 25% of the time with informational feedback stimuli. In contrast, during Experiment 3, when animals were shocked on only 25% of the trials on which they failed to respond, the level of avoidance responding during both acquisition and extinction was significantly less than it was when animals were shocked on a 100% schedule. Comparable results were found in Experiment 4 when avoidance responses during acquisition averted shock on only 25% of the trials. Thus, intermittent reinforcement contingencies involving response-contingent feedback stimuli and shock have differential effects on avoidance responding during both acquisition and extinction trials under the signaled avoidance procedure.     

Negative reinforcement as shock-frequency reduction

Is a conditioned aversive stimulus necessary in avoidance conditioning? Or is a reduction in the rate of aversive stimulation alone sufficient to generate and maintain an avoidance response? Rats were subjected to an avoidance procedure in which shocks occurred randomly in time, but a response could reduce the overall rate of shock. Fifteen acquisition curves, obtained from 16 animals, showed both immediate and delayed, rapid and gradual increases in response rate; there was no representative acquisition curve. Response rates were directly related to the amount by which the response reduced shock frequency. In extinction, when shock rates were not affected by responding, the response total was inversely related to the amount by which the response had reduced shock frequency during prior conditioning, with as many as 20,000 extinction responses when the shock frequency reduction had been relatively small. Responding on this procedure shows that avoidance conditioning can occur without benefit of either classical exteroceptive stimuli or covert stimuli inferred from the temporal constancies of a procedure. It also shows that reduction in shock rate is alone sufficient to maintain avoidance.     

Extinction of responding maintained by timeout from avoidance

The resistance to extinction of lever pressing maintained by timeout from avoidance was examined. Rats were trained under a concurrent schedule in which responses on one lever postponed shock on a free-operant avoidance (Sidman) schedule (response-shock interval = 30 s) and responses on another lever produced 2 min of signaled timeout from avoidance on a variable-ratio 15 schedule. Following extended training (106 to 363 2-hr sessions), two experiments were conducted. In Experiment 1 two different methods of extinction were compared. In one session, all shocks were omitted, and there was some weakening of avoidance but little change in timeout responding. In another session, responding on the timeout lever was ineffective, and under these conditions timeout responding showed rapid extinction. The within-session patterns produced by extinction manipulations were different than the effects of drugs such as morphine, which also reduces timeout responding. In Experiment 2 shock was omitted for many consecutive sessions. Response rates on the avoidance lever declined relatively rapidly, with noticeable reductions within 5 to 10 sessions. Extinction of the timeout lever response was much slower than extinction of avoidance in all 4 rats, and 2 rats continued responding at baseline levels for more than 20 extinction sessions. These results show that lever pressing maintained by negative reinforcement can be highly resistant to extinction. The persistence of responding on the timeout lever after avoidance extinction is not readily explained by current theories.     

Pavlovian processes and response competition as determinants of avoidance response-prevention effects

Two experiments investigated the facilitation of avoidance extinction by exposure to lengthy (5-sec) shock during avoidance response prevention. In Experiment 1, animals exposed to light only or to light-shock pairings during response prevention showed equal facilitation of extinction relative to shock-only animals or to animals receiving no response prevention. Preshock rearing, directly antagonistic to the avoidance response, developed for shocked animals during response prevention and persisted during extinction for light-shock animals. Immediately before extinction, half of each group was permitted a single escape from a light-shock compound by means of the response previously required for avoidance. The only effect was upon the extinction performance of light-shock animals. Rearing was eliminated and extinction responding increased to a level far above that for any of the other animals. Experiment 2 demonstrated that the shock-only treatment affected the extinction performance and rearing of nonescape and escape animals in a manner entirely equivalent to the effects of the light-shock treatment of Experiment 1, provided stimulus conditions (light absent) were the same for all experimental phases. Thus, lengthy shock during avoidance response prevention simultaneously leads to the acquisition of competing behavior and enhances control by a warning signal or contextual stimuli over the avoidance response. Implications for the CS-only response-prevention treatment and the transfer of aversive control are discussed.     

Adventitious reinforcement during long-duration DRO exposure

Differential reinforcement of other behavior (DRO) is a procedure often used to decrease problem behavior, but the processes responsible for behavior reduction are not well understood. This study assessed whether adventitious reinforcement of other behavior contributes to DRO effectiveness when, relative to previous research, DRO exposure is prolonged. Two response options were presented on a computer and target responding was reinforced on a variable-ratio schedule. Response rates were then compared during DRO versus yoked variable-time or extinction probes. Across 2 experiments, DRO decreased target responding and increased other responding more than control conditions. However, increases in other responding did not usually maintain despite target responding remaining at low levels. DRO might adventitiously reinforce other responses transiently but the decreases in target behavior could not be entirely explained by adventitious reinforcement of the other response. Instead, reductions in target responding likely depend on the discriminability of the DRO contingency.     

Relative persistence of avoidance and positively reinforced behavior

In one experiment with rats, and a second with pigeons, subjects were trained on a schedule in which identical response dependencies applied to intermittent receipt of positive reinforcement (PR) for one group and avoidance (AV) of shock for a second group. After obtaining comparable stable training performance for groups PR and AV, persistence tests were conducted with a traditional extinction (EXT) procedure vs. response-independent (FREE) delivery of positive reinforcers or shocks. In both experiments, response elimination was rapid in EXT for groups PR and AV, and responding tended to be maintained in groups PR and AV in the FREE persistence test. These results contradict the widely held assumption that avoidance behavior is unusually resistant to extinction, and they call for a re-examination of elimination of avoidance responding.     

The Effect of Counterconditioning on Evaluative Responses and Harm Expectancy in a Fear Conditioning Paradigm

In fear conditioning, extinction targets harm expectancy as well as the fear response, but it often fails to eradicate the negative affective value that is associated with the conditioned stimulus. In the present study, we examined whether counterconditioning can serve to reduce evaluative responses within fear conditioning. The sample consisted of 70 nonselected students, 12 of whom were men. All participants received acquisition with human face stimuli as the conditioned stimuli and an unpleasant white noise as the unconditioned stimulus. After acquisition, one third of the sample was allocated to an extinction procedure. The other participants received counterconditioning with either a neutral stimulus (neutral tone) or a positive stimulus (baby laugh). Results showed that counterconditioning (with both neutral and positive stimuli), in contrast to extinction, successfully reduced evaluative responses. This effect was found on an indirect measure (affective priming task), but not on self-report. Counterconditioning with a positive stimulus also tended to enhance the reduction of conditioned skin conductance reactivity. The present data suggest that counterconditioning procedures might be a promising approach in diminishing evaluative learning and even expectancy learning in the context of fear conditioning.     

Punishment and the potential for negative reinforcement with histamine injection

The present study examined punishment of responding with histamine injection, and its potential to generate avoidance of punishment. Sprague–Dawley rats were trained under concurrent schedules in which responses on one lever (the punishment lever) produced food under a variable‐interval schedule, and under some conditions intermittent injections of histamine, which suppressed behavior. Responses on a second (avoidance) lever prevented histamine injections scheduled on the punishment lever. After stabilization of punished responding, a variable‐interval 15‐s schedule of cancellation of histamine (avoidance) was added for responding on the second/avoidance lever, without subsequent acquisition of responding on that lever. Progressive decreases in the length of the punishment variable‐interval schedule increased suppression on the punishment lever without increases in response rates on the avoidance lever. Exchanging contingencies on the levers ensured that response rates on the avoidance lever were sufficiently high to decrease the histamine injection frequency; nonetheless response rates on the avoidance lever decreased over subsequent sessions. Under no condition was responding maintained on the avoidance lever despite continued punishing effectiveness of histamine throughout. The present results suggest that avoidance conditioning is not a necessary condition for effective punishment, and confirm the importance of empirical rather than presumed categorization of behavioral effects of stimulus events.     

Acquired affective-evaluative value: conservative but not unchangeable

In a previous study on Evaluative Conditioning it was found that unlike signal-learning, evaluative learning is resistant to extinction. In the present experiment we tried to replicate and corroborate this finding. In addition, we investigated the effectiveness of a counterconditioning procedure to alter acquired evaluative value. On a within-subject base (n = 30), it was found that the mere contingent presentation of neutral with (dis)liked pictures of human faces was sufficient to change the affective-evaluative tone of the originally neutral stimuli in (negative) positive direction. Next, we replicated the finding that an extinction procedure does not have any influence on the acquired evaluative value of the originally neutral stimuli, and this even in subjects fully aware of the extinction presentations. We demonstrated the effectiveness of a counterconditioning procedure to alter acquired evaluative value, and in addition, found some evidence that awareness of the counterconditioning manipulations is not a prerequisite for its effectiveness. The theoretical consequences of these findings are phrased in terms of a fundamental distinction between signal-learning and evaluative learning, and some important implications for the behavioral treatment of affective-emotional disorders are suggested.     

Lever attacking by rats during free-operant avoidance

Rats pressed a lever to avoid shock on a free-operant avoidance schedule. Some subjects were also exposed to extinction in which the response-shock contingency was eliminated while the shock-shock contingency remained in effect. A specially constructed lever was used that registered not only presses, but also biting attacks on the lever. Throughout various phases of the study, shocks often elicited lever biting as well as post-shock responding. The results suggested that shock-elicited attacks that are forceful enough to activate the operandum might account for some of the responding that occurs in experiments on free-operant avoidance behavior. In particular, shock-elicited operandum attacking might account for post-shock response bursting during free-operant avoidance and the extreme persistence of responding sometimes noted when shocks are delivered during the extinction of avoidance behavior. To the extent that this is true, these phenomena should not be characterized as operant behavior in interpreting the results of experiments on free operant avoidance.     

Safety training: the elimination of avoidance-motivated aggression in dogs

This study sought to identify the behavioral characteristics and appropriate treatment of a form of instrumental aggression in companion dogs, herein recognized as avoidance-motivated aggression. In Experiment 1, retrospective data on 92 cases of dangerously aggressive dogs demonstrated the avoidance nature of the aggressive response and its intractability to established counterconditioning treatments. In Experiment 2, safety training, a modified avoidance-learning procedure, resulted in complete and permanent elimination of aggression in all of the 36 dogs tested. In addition, it produced extremely extinction-resistant prosocial avoidance responses, significant increases in the dogs' emotional stability, an avoidance-learning and safety acquisition response set, and improvements in measures of the dog's "carriage." Experiment 3 showed how effective safety training is when compared with other behavior modification techniques that, in theory, should have an impact on avoidance-motivated aggression. Experiment 4 demonstrated the critical importance of using the conditioned safety cue as a positive reinforcement. The relationship of avoidance-motivated aggression to other forms of aggression is discussed. The success of safety training compared with the failure of electrical aversion therapy is analyzed. The theoretical concepts of behavioral balance and an avoidance-learning set are presented. Suggestions to improve the effectiveness of counterconditioning for human avoidance-motivated pathologies are offered. All in all, the data seem to suggest that safety training may create in dogs a sense of control over environmental stressors. By teaching the dogs a behaviorally balanced battery of prosocial "coping" responses, they may be developing the canine counterpart of "self-efficacy" or "courage." It is suggested that this cognitive modification may provide the antithesis of "learned helplessness" and may be of prime importance to the success and stability of the results.     

A direct comparison of four methods for eliminating a response

Thirty-two rats pressed one lever (lever A) on a VI 30-sec schedule of food reinforcement and were then shifted to one of four procedures for eliminating the lever A response: extinction, differential reinforcement of other behavior, reinforcement of a different response (pole pushing), and reinforcement of a similar response (pressing lever B). Effectiveness of a response-elimination procedure was measured by (1) how quickly lever A response rate fell to a low level when the procedure was in effect, (2) how much lever A responding recovered when the procedure was discontinued, and (3) how resistant lever A responding was to reinstatement when the VI reinforcement schedule was reimposed. No one method was superior by all three measures. Extinction produced the most variable behavior, while differential reinforcement of other behavior produced the least. Reinforcing alternative behavior produced the greatest recovery in the original lever A response when the response-elimination procedure was discontinued.     

The restoration of extinguished avoidance responses

Following extensive signaled shuttlebox avoidance training, Fischer 344 rats were given extinction trials until they reliably stopped responding and, thereafter, they received occasional classical CS-UCS pairings during the course of restoration test trials in which shock was absent. Experiment I demonstrated that the classical contingency was both necessary and sufficient for the complete recovery of such behavior. Experiment II revealed that the degree of recovery was not differentially affected by the frequency of such CS-UCS pairings. However, in Experiment III recovery in the presence of this contingency was shown to depend on the number of previous extinction trials, although even after a large number of such trials, a considerable degree of recovery occurred. These findings demonstrated the central role of the classical CS-UCS contingency in restoring a previously extinguished avoidance response.     

The effects of unavoidable shocks on a multiple schedule having an avoidance component

Two dogs were maintained on a multiple schedule having both a food reinforced and an avoidance component (Mult VI 1′ S^Δ Avoid_{SS20 RS20} S^Δ). The effects of superimposing an Estes-Skinner procedure for delivering unavoidable shocks on all components of the multiple schedule were observed. The buzzer-shock pairing of the Estes-Skinner procedure produced an increased rate of responding on the avoidance component of the schedule and also on the S^Δ components. No persistent change in rate was observed on the food component during the pre-shock stimulus. Control performances on all components could be regained by either extinguishing or eliminating the buzzer-shock pairing. Extinction of the avoidance responding had little effect on the increased rates of responding produced by the Estes-Skinner procedure on the S^Δ and avoidance extinction components and did not lead to a conditioned suppression of the food reinforced responding. Rate of responding during the pre-shock stimulus was observed to be relatively independent of changes in the maintaining schedules. Responding during the pre-shock stimulus could be conditioned and maintained after an extensive history of avoidance extinction.     

Effects of naloxone on acquisition and extinction of jump-up avoidance behavior in rats

Two experiments were carried out to assess the effects of the opioid antagonist, naloxone, on the acquisition and extinction of shock avoidance by rats in the jump-up apparatus. In Experiment 1 naloxone pretreatment facilitated acquisition but had no effect on extinction of avoidance behavior. In the second experiment the effect of naloxone on acquisition was replicated and in addition, it was shown that naloxone enhanced freezing when a response prevention or flooding procedure was introduced. Again naloxone failed to alter the course of extinction, nor did it interact with the effects of flooding which, by itself, facilitated extinction. The results suggest that naloxone's effects are limited to increasing the functional intensity of the US, and provide further support for the dissociation between extinction of avoidance behavior and other indices of fear.     

RESISTANCE TO EXTINCTION AND RELAPSE IN COMBINED STIMULUS CONTEXTS

Reinforcing an alternative response in the same context as a target response reduces the rate of occurrence but increases the persistence of that target response. Applied researchers who use such techniques to decrease the rate of a target problem behavior risk inadvertently increasing the persistence of the same problem behavior. Behavioral momentum theory asserts that the increased persistence is a function of the alternative reinforcement enhancing the Pavlovian relation between the target stimulus context and reinforcement. A method showing promise for reducing the persistence‐enhancing effects of alternative reinforcement is to train the alternative response in a separate stimulus context before combining with the target stimulus in extinction. The present study replicated previous findings using pigeons by showing that combining an “alternative” richer VI schedule (96 reinforcers/ hr) with a “target” leaner VI schedule (24 reinforcers/hr) reduced resistance to extinction of target responding compared with concurrent training of the alternative and target responses (totaling 120 reinforcers/hr). We also found less relapse with a reinstatement procedure following extinction with separate‐context training, supporting previous findings that training conditions similarly influence both resistance to extinction and relapse. Finally, combining the alternative stimulus context was less disruptive to target responding previously trained in the concurrent schedule, relative to combining with the target response trained alone. Overall, the present findings suggest the technique of combining stimulus contexts associated with alternative responses with those associated with target responses disrupts target responding. Furthermore, the effectiveness of this disruption is a function of training context of reinforcement for target responding, consistent with assertions of behavioral momentum theory.