The law of effect and avoidance: a quantitative relationship between response rate and shock-frequency reduction

Two experiments were conducted to investigate the quantitative relationship between response rate and reinforcement frequency in single and multiple variable-interval avoidance schedules. Responses cancelled delivery of shocks that were scheduled by variable-interval schedules. When shock-frequency reduction was taken as the measure of reinforcement, the relationship between response rate and reinforcement frequency on single variable-interval avoidance schedules was accurately described by Herrnstein's (1970) equation for responding on single variable-interval schedules of positive reinforcement. On multiple variable-interval avoidance schedules with brief components, asymptotic relative response rate matched relative shock-frequency reduction. The results suggest that many interactions between response rates and shock-frequency reduction in avoidance can be understood within the framework of the generalized matching relation, as applied by Herrnstein (1970) to positive reinforcement.     

The effect of a pre-shock signal on a free-operant avoidance response

After 25 free-operant avoidance training sessions, a 1-min signal followed by a brief shock was presented on the average of once every 4 min. During the signal, the avoidance schedule was suspended (20 sessions). Response rates during the signal were markedly reduced. Shock rates during non-signalled periods increased. Fifteen additional sessions were given during which the signal was presented without shock. Response rates during signalled periods were greater than previously observed during signalled periods, indicating that signalled shock had suppressive control over a previously acquired avoidance response rate.     

The effect of informative events on response rate

A single group of pigeons received two different training conditions presented on different response keys. Responding during the first component of each condition was reinforced, according to a fixed interval schedule, by gaining access to the second component. In the uninformative condition the second component consisted on every trial of the illumination of the response key for 10 sec, the key was then darkened and food presented with a probability of 0.5. In the informative condition half of the trials at the conclusion of the first component resulted in the key being darkened and no additional events were presented. On the remaining trials the second component was similar to that for the uninformative condition. The results from the first two stages revealed that responding during the first component was faster in the informative than uninformative condition when trials were presented separately. In the final stage, when the trials were presented simultaneously, the rate of responding during the first component was eventually similar in the two conditions, but subjects preferred the second component of the informative condition. These results suggest that events which are informative, or perhaps unpredictable, can support a higher response rate than those which are uninformative, or predictable.     

Individual differences in approach and avoidance movements: how the avoidance motive influences response force

The present research is based on the assumption that people differ in their responsiveness to incentives and threats. In two experiments we examined whether the trait corresponding to the responsiveness to threats (avoidance motive) and the trait corresponding to the responsiveness to incentives (approach motive) influence voluntary motor behavior toward or away from stimuli. In Experiment 1, stimuli consisted of positive and negative words within a lexical decision task. Participants moved their arms backward in order to withdraw from the stimuli or forward in order to approach them. In Experiment 2, participants responded with forward or backward arm movements to neutral sounds coming from behind or in front of them. The main dependent variable was the strength of the approach and avoidance movements. In both experiments this variable was related to participants' avoidance-motive disposition but not to their approach-motive disposition. Avoidance-motivated individuals generally showed more forceful avoidance movements than approach movements. There was no effect of stimulus valence on the strength of the movements in Experiment 1. Furthermore, the results of Experiment 2 suggest that it is not the physical direction (forward or backward) but rather the movement's effect of distance reduction (approach) or distance increase (avoidance) in regard to the stimulus that defines a movement as an approach or an avoidance movement.     

The effect of rate of delivery of response-independent shocks upon avoidance responding

Two hooded rats were trained to bar-press to avoid electric shock on a continuous avoidance schedule with response-shock and shock-shock intervals equal. The rate of delivery of response-independent shocks superimposed on this schedule was varied. The response-independent shocks led to generally higher response rates but, with responses during shock omitted, the rates decreased as the response-independent shock rate was increased. The actual shock rate received by the subjects was linearly related to the maximum potential shock rate. There was an increasing, negatively accelerated function between percentage avoidance and response rate, but there was no consistent relation between the number of shocks avoided and response rate. Response rate decreased as the potential shock rate increased, but responding was maintained even when as few as 15% of the shocks could be avoided.     

Reinforcement and response rate interaction in multiple random-interval avoidance schedules

Two experiments were conducted to investigate the interaction between response rate and reinforcement frequency in multiple random-interval avoidance schedules. Responses cancelled delivery of shocks that could be scheduled at different random intervals in each component. When shock-frequency reduction was taken as the measure of reinforcement, the relationship between response rate and frequency of reinforcement was described by the same equations used by Herrnstein (1970) to describe responding with positive reinforcement.     

Independence of response force and reinforcement rate on concurrent variable-interval schedule performance

Five pigeons were trained over 43 experimental conditions on a variety of concurrent variable-interval schedules on which the forces required on the response keys were varied. The results were well described by the generalized matching law with log reinforcement ratios and log force ratios exerting independent (noninteractive) effects on preference. A further analysis using the Akaike criterion, an information-theoretic measure of the efficiency of a model, showed that overall reinforcement rate and overall force requirement did not affect preference. Unlike reinforcement rate changes, force requirement increases did not change the response rate on the alternate key, and an extension of Herrnstein's absolute response rate function for force variation on a single variable-interval schedule is suggested.     

Using drugs to modify the effect of response prevention on avoidance extinction

Amobarbital and chlordiazepoxide were administered during avoidance response prevention and the effect evaluated in the nondrugged state in a subsequent test for avoidance extinction. It was found that Ss administered 15 mg/kg and 30 mg/kg amobarbital, and 30 mg/kg chlordiazepoxide during response prevention differed significantly from the control Ss in extinction performance. Rather than showing either reduced avoidance performance or no difference with the nondrugged Ss, the Ss drugged during response prevention showed increased avoidance performance in the subsequent test of avoidance extinction. That is, preventing avoidance responding under a drugged (versus nondrugged) state produced increased resistance to extinction of the avoidance response.     

The effect of bulbocapnine administration on avoidance behavior

The Psychological Record -     

Stimulus control of free-operant avoidance: The contribution of response rate and incentive relations between multiple-schedule components

The associations formed in the components of a multiple schedule can be classified as (1) stimulus-response (S-R) associations and (2) stimulus-reinforcer (S-S^R) associations. The present experiments sought to determine the individual contribution of these S-R and S-S^R associations to stimulus control by manipulating them independently. Responses postponed shocks by 25 sec in the presence of a tone alone and a light alone in all experiments. The contingencies programmed in the absence of both tone and light established a reference for the S-R and S-S^R associations in tone and in light. All four possible combinations of signalling response increase or decrease together with incentive increase or decrease were studied. Although the influence of the contingencies operating in the absence of tone and light was difficult to detect from response rates in tone or light, presenting tone and light together revealed clear effects. Response rates in tone and light together relative to those in either alone depended upon the contingency operating in the absence of tone and light. Stimulus-response and stimulus-reinforcer associations appeared to counteract each other when in opposition and combine together to enhance each other when in agreement. This suggested that the associations of a stimulus to response and to incentive combine algebraically in determining stimulus control. An algebraic analysis in terms of the S-R and S-S^R associations conditioned to the stimulus elements comprising the training and test stimuli accounted for the observed patterns of data.     

The effect of punishment and reinforcement procedures on a stutterer's factor II avoidance response

The purpose of this clinical experiment was to investigate the manipulability of a Factor II avoidance response (arm movement). The substantive hypothesis under test was that its suppression would be enhanced by repeated punishment sessions. During the first of nine therapy sessions response-contingent negative stimulation was not delivered. In the next five, after a base-rate period, “wrong” was made consequent upon the target response. In each of these sessions the suppression of arm movement was apparent. However, the magnitude of the suppression decreased from session to session. Evidently, the continued use of punishment did not enhance suppression. Because of this finding procedural changes were introduced in the next three therapy sessions. Verbal praise was added as a consequence of increasingly stringent omission criteria and three consecutive units of praise led to time-out from the reportedly fatiguing task of continuous speech. A marked reduction and then complete extinction resulted. Moreover, learning was evidenced since the frequency of arm movement lessened in the base-rate period of each session.     

The effect of a conditioned fear inhibitor (CS-) during response prevention upon extinction of an avoidance response

Pairing a Pavlovian safety signal (CS—) with a response prevention period was contrasted with other response prevention procedures to determine relative effectiveness for the elimination of learned avoidance behavior. After acquiring a one-way avoidance response, five groups of ten rats received various blocking or control treatments and were then compared on extinction performance. The four blocking treatments included blocking paired with a safety signal; blocking only; blocking paired with a novel stimulus; and blocking paired with a preexposed noncontingent tone. The fifth group served as a handling control. Compared to the handling control, all four blocking groups reached extinction criterion in fewer trials. Further, the safety signal group extinguished faster than the blocking only group or the blocking with noncontingent tone group. Results were viewed as an indication of the potential efficacy of pairing-conditioned fear-inhibiting cues with response prevention procedures for the elimination of fear-motivated behavior. Implications for behavioral therapy techniques were discussed.     

The effect of different hypertension models on active avoidance learning

This study tested the effects of different hypertension models on active avoidance learning in rats. Three-month-old male Wistar rats were divided randomly into six groups as follows: control (C), sham operated (sham), two kidney-one clip (2K-1C), one kidney-one clip (1K-1C), deoxycorticosterone-salt (DOCA), and N-omega-nitro-L-arginine-methyl ester (L-NAME) groups. Mean arterial blood pressures were significantly higher in four hypertensive groups compared with control and sham groups. The active avoidance training results indicated that hypertension state is associated with learning impairment. Thiobarbituric acid-reactive substances (TBARS) were determined as an indicator of lipid peroxidation in brain and hippocampus. Additionally, brain and hippocampus nitrite levels were studied.