The effects of unavoidable shocks on a multiple schedule having an avoidance component

Two dogs were maintained on a multiple schedule having both a food reinforced and an avoidance component (Mult VI 1′ S^Δ Avoid_{SS20 RS20} S^Δ). The effects of superimposing an Estes-Skinner procedure for delivering unavoidable shocks on all components of the multiple schedule were observed. The buzzer-shock pairing of the Estes-Skinner procedure produced an increased rate of responding on the avoidance component of the schedule and also on the S^Δ components. No persistent change in rate was observed on the food component during the pre-shock stimulus. Control performances on all components could be regained by either extinguishing or eliminating the buzzer-shock pairing. Extinction of the avoidance responding had little effect on the increased rates of responding produced by the Estes-Skinner procedure on the S^Δ and avoidance extinction components and did not lead to a conditioned suppression of the food reinforced responding. Rate of responding during the pre-shock stimulus was observed to be relatively independent of changes in the maintaining schedules. Responding during the pre-shock stimulus could be conditioned and maintained after an extensive history of avoidance extinction.     

The influence of positive and negative reinforcement on selective attention in the rat

In Experiments 1 and 2 rats were trained under two multiple schedules of reinforcement. In one, bar pressing during a tone-light compound stimulus was reinforced under a variable-interval food reinforcement schedule. In the other multiple schedule, bar pressing avoided grid shock on a free-operant schedule. In both multiple schedules, a discrimination was maintained by an extinction schedule that was operative during the absence of the tone-light compound. In Experiments 1 and 2 the intensity of the tone-light compound was manipulated over three levels. Subsequent extinction tests revealed that light was attended to, almost exclusively of the tone, when food reinforcement had maintained bar pressing. On the other hand, the tone gained considerable attentional control under the shock avoidance schedule. This stimulus-reinforcer interaction was maintained for all three levels of the compound intensity. In Experiment 3 it was investigated whether this interaction was associative by presenting shock during the absence of the tone-light compound when food reinforcement maintained responding, and food during the absence of the compound when shock avoidance maintained responding. Since both food and shock were presented during a single session for both schedules, nonassociative effects of the reinforcing stimuli were equivalent across the schedules. Nevertheless, the stimulus-reinforcer interaction was maintained, indicating that the interaction was an associative effect.     

Stimulus control and compounding with ambient odor as a discriminative stimulus on a free-operant baseline

Previous experiments have demonstrated that the simultaneous presentation of independently established discriminative stimuli can control rates of operant responding substantially higher than the rates occasioned by the individual stimuli. This "additive summation" phenomenon has been shown with a variety of different reinforcers (e.g., food, water, shock avoidance, cocaine, and heroin). Discriminative stimuli previously used in such studies have been limited to the visual and auditory sensory modalities. The present experiment sought to (1) establish stimulus control on a free-operant baseline with an ambient olfactory discriminative stimulus, (2) compare olfactory control to that produced with an auditory discriminative stimulus, and (3) determine whether compounding independently established olfactory and auditory discriminative stimuli produces additive summation. Rats lever pressed for food on a variable-interval schedule in the presence of either a tone or an odor, with comparable control developed to each stimulus. In the absence of these stimuli responding was not reinforced. During stimulus compounding tests, the tone-plus-odor compound occasioned more than double the responses occasioned by either the tone or odor presented individually. Thus, the current study (1) established stimulus control with an ambient olfactory discriminative stimulus in a traditional free-operant setting and (2) extended the generality of stimulus-compounding effects by demonstrating additive summation when olfactory and auditory discriminative stimuli were presented simultaneously.     

The role of instrumental responding and contiguity of stimuli in the development of infant secondary reinforcement

Ten-month-old infants received contingent pairings of a tone (T+) and food reinforcer. Groups S^r and S^D received the food on an FI 23-sec schedule for target touching, the former group receiving T+ immediately after the response and 1.5 sec prior to food and the latter group receiving T+ at the end of the intertrial interval. Group SC received food reinforcers 1.5 sec after T+ with no response required. A second tone (Tⁿ) was heard by all groups once during each intertrial interval, at randomly determined points. All groups subsequently were given a spatial discrimination task, receiving T+ for one alternative and Tⁿ for the other. Group S^r gave significantly more responses for T+ than for Tⁿ, but neither of the other two groups produced a superiority for T+. Thus, both contiguity with a primary reinforcer and the presence of an operant during training appear to be necessary for a neutral signal to acquire the ability to enhance responding.     

Compounding discriminative stimuli controlling free-operant avoidance

The performances of three rats were stabilized on a multiple schedule that maintained responding by a free-operant avoidance schedule during independent presentations of tone and light. The simultaneous absence of these stimuli signalled shock-free periods and controlled response cessation. Subsequently, test sessions were administered consisting of independent presentations of each stimulus and these stimuli compounded (tone-plus-light). During an extinction test, additive summation was observed to the compounded stimuli, i.e., more responses were emitted to the compound than to either tone or light. During a series of 28 maintenance-test sessions in which the shock schedule remained operative, the compounded stimuli produced a generally enhanced response rate and fewer pauses terminating with shock than either single stimulus condition. These results extend the generality of free-operant additive summation to responding maintained by aversive control. In addition, a comparison of the present study with previous experiments reporting additive summation of positively reinforced responding indicates that similar variables—rate and aversive differences between training stimulus conditions—should be considered in accounting for response distributions during stimulus compounding when responding is controlled by either positive or negative contingencies.     

On insirumental response interaction as explaining the influences of Pavlovian CSs upon avoidance behavior

The finding that Pavlovian signals for food or shock influence avoidance responding might be explained either by interaction of conditioned central mediational states or interaction of learned instrumental responses. Using three groups of dogs, the two hypotheses were pited one against the other in a three-stage transfer-of-control experiment. In the initial conditioning phase, tones were established as signals for food, shock, or neither; additionally the tones also cued a common instrumental response. Following avoidance training, the tone was tested for its influence upon avoidance. If the lone had signaled food, avoidance was suppressed; if shock, avoidance was facilitated; if neither, avoidance was unaffected. This was interpreted as supporting the hypothesis that interaction of central states mediates the transfer-of-control.     

On unpredictability as a causal factor in “learned helplessness”

In two replications, two groups of dogs were exposed to a series of uncontrollable, electric shocks. For one group the shocks were preceded by a tone (i.e., Paired). For the other group the shocks were randomly related to the tones and hence unpredictable (i.e., Random). Each replication also included a third group; in the first it was exposed only to the series of tones (CS-only), while in the second, it was exposed only to a series of shocks (Shocks-only). Then, all dogs were required to learn a discriminative choice escape/avoidance task in which the required response was to lift the correct paw in the presence of each of two visual S^Ds to escape or avoid the shocks [($\text{S}{}_1{}^{\mathrm{D}}\text{?R}{}_1\text{)}\text{(S}{}_2{}^{\mathrm{D}}\text{?R}{}_2$)]. Dogs preexposed to random tones and shocks were least successful in learning the task relative to those groups which experienced either predicted shocks, only the tones, or only the shocks, which in turn did not differ from each other. These results permitted the inference that the proactive interference with choice behavior following random tone CSs and shocks was attributable to a learned irrelevance generalized with respect to CSs.     

Fear as a discriminative stimulus for an appetitive instrumental response

Two experiments tested the hypothesis that anticipation of shock could be established as a discriminative stimulus for an appetitive instrumental response. In multiphase experiments, bar pressing for food was brought under the discriminative control of intermittent and gradually increasing electric shock. In a second phase, tones were estalished as either a CS+, or CS? for shock. Subsequently, the CSs were introduced on to the operant baseline. Animals trained with shock as the S^D showed an increase in responding to the CS+ and a slight decrease to the CS?. Conversely, animals trained with shock as the S^Δ showed decreased responding to the CS+ and slight increase to the CS?. These findings are seen as supportive of the Discriminative Stimulus hypothesis of learned resistance to punishment.     

Differential effects of a food-based conditioned inhibitor on food- or cocaine-seeking behavior

The present experiment compared the effects of a food-based conditioned inhibitor on food seeking vs. cocaine seeking behavior. In two groups of rats, the A+/AB− Pavlovian conditioned inhibition procedure was used to create a conditioned inhibitor for food. Then, for one group of rats (Food-Food Group), a click stimulus was established as an operant discriminative stimulus (S^D) for food-reinforced lever pressing. In the other group (Food-Cocaine Group), the click was established as an S^D for cocaine self-administration. In testing, the putative inhibitor for food was simultaneously presented with the click for the first time in both groups. In the Food-Food Group, the food-based inhibitor suppressed responding occasioned by the click significantly more than did a neutral control stimulus. In contrast, in the Food-Cocaine Group, there was no difference in the amount of suppression produced by the food-based inhibitor and the control stimulus. These results suggest that the effects of food-based Pavlovian conditioned inhibitors are specific for food-motivated behavior and do not easily transfer to cocaine-motivated behavior.     

Effects of response-shock interval and shock intensity on free-operant avoidance responding in the pigeon

Two experiments investigated free-operant avoidance responding with pigeons using a treadle-pressing response. In Experiment I, pigeons were initially trained on a free-operant avoidance schedule with a response-shock interval of 32 sec and a shock-shock interval of 10 sec, and were subsequently exposed to 10 values of the response-shock parameter ranging from 2.5 to 150 sec. The functions relating response rate to response-shock interval were similar to the ones reported by Sidman in his 1953 studies employing rats, and were independent of the order of presentation of the response-shock values. Shock rates decreased as response-shock duration increased. In Experiment II, a free-operant avoidance schedule with a response-shock interval of 20 sec and a shock-shock interval of 5 sec was used, and shock intensities were varied over five values ranging from 2 to 32 mA. Response rates increased markedly as shock intensity increased from 2 to 8 mA, but rates changed little with further increases in shock intensity. Shock rates decreased as intensity increased from 2 to 8 mA, and showed little change as intensity increased from 8 to 32 mA.     

Generalization and discrimination as a function of the SD — SΔ intensity difference

Three groups of four rats were trained on an auditory-intensity discrimination for 21 days. The S^D-S^Δ intensity difference for Group I was 10 db; for Group II, 20 db; and for Group III, 30 db. Following the initial discrimination training, the animals were tested for generalization of the bar-press response to seven novel S^Δ's which were presented intermingled with the original S^D and S^Δ values. Conclusions: (1.) The amount of simple discrimination training required to obtain fairly stable differences in S^D and S^Δ responding is an inverse function of the magnitude of the stimulus difference between S^D and S^Δ. (2.) Generalization gradients obtained immediately following simple discrimination training exhibit a maximum displaced from S^D in a direction also away from S^Δ. (3.) Gradients obtained following continued exposure to the multivalued S^Δ situation show a fairly stable maximum at the S^D value. (4.) Although the gradients tend to fall off systematically on either side of the continuum as distance from S^D is increased, they decrease most rapidly on the S^Δ limb of the gradient.     

Some notes on time out from reinforcement

Pigeons produced food on a fixed-ratio schedule by pecking at one key, and an S^Δ period by pecking at a second (switching) key. Switching behavior was examined as a function of (a) size of the fixed ratio, (b) whether the S^Δ was of fixed duration or could be determined by the bird, (c) the introduction of a novel food S^D, (d) extinction of food responding, and (e) the stimuli associated with the S^D and S^Δ conditions. No monotonic relationship was obtained between ratio size and switching behavior. Switching behavior was, however, influenced by many variables. The results suggest that an interpretation of switching behavior in terms of its being reinforced by the removal of aversive conditions, is open to considerable question.     

On the independence of stimulus evocation of fear and fear evocation of responses

Dogs in an experimental group were first trained in a shuttlebox on a free-operant avoidance response; then a second, discriminative avoidance response was trained in a second apparatus to a tone. Following criterion, the second avoidance response was “extinguished” through unsignaled. response-independent US presentations. Finally, the tone was presented in the shuttlebox as a test for residual fear. The tone produced as much facilitation of the free-operant avoidance responding as it did in two control groups; one control had not had the second avoidance response extinguished, while the other had received only Pavlovian conditioning in the second apparatus. Thus, the elimination of a discriminative avoidance response to a CS does not impair the CS's ability to control a second independent avoidance response. This result reflects and confirms the separability and independence of the CS-fear and fearavoidance response links hypothesized by two-process theories.     

Punishment of an extinguishing shock-avoidance response by time-out from positive reinforcement

Two experiments were conducted to determine the effects of punishment by time-out from positive reinforcement on the extinction of discriminated shock-avoidance responding. Subjects were trained initially to bar press for food on an intermittent schedule of reinforcement and, concurrently, to avoid shock at the onset of a warning signal. Experiment I compared avoidance extinction performance under no punishment and when avoidance responding resulted in a 30-sec TO from reinforced appetitive responding. In Exp II, the contingent use of TO punishment was compared with its random, or noncontingent use. The results of both experiments showed that in the absence of punishment, avoidance extinction was characterized by short latencies and nearly 100% avoidance responding. Avoidance responding in extinction was little affected by noncontingent TO punishment. When TO was made contingent upon avoidance responding, however, avoidance latencies immediately increased and the frequency of avoidance responses subsequently decreased to zero.     

Shock intensity and signaled avoidance responding

Five rats were submitted to a signaled free-operant avoidance contingency. Throughout the experiment, shock intensity was varied from 0.1 to 8.0 mA, with shock duration constant at 200 milleseconds. Results indicate: (a) an all-or-none effect of shock intensity on response and shock rates, on percentage of shocks avoided, and on frequency of occurrence of responding during the preshock stimulus; and (b) no systematic effect of shock intensity on stimulus control, measured either by the percentage of stimulus presentations accompanied by a response or by the percentage of responses that occurred during those preshock stimuli. Such results indicate that for each subject there is a minimum shock intensity necessary to establish and maintain avoidance responding; intensities higher than this minimum value have little or no effect on responding (with an upper limit for those strong intensities with a general disruptive effect on behavior).     

Pavlovian conditioned stimulus effects upon instrumental choice behavior are reinforcer specific

In a transfer-of-control experiment with rats, Pavlovian CSs were tested for the specificity of their effects. The instrumental behavior consisted of a discriminative, conditional two-lever choice task in which qualitatively different appetitive reinforcers were contingent upon the two correct choices. In a Pavlovian phase, subjects experienced conditioning to establish either a CS⁺ or CS^? for one reinforcer or a CS⁺ or CS^? for the other reinforcer. Finally, in a test, these CSs were presented when there was the opportunity to make choice responses. The CS⁺s evoked choices of the lever which had eventuated in the reinforcer that had served as the Pavlovian US, while the CS^?s showed only a slight tendency to evoke the other choice responses. When the CSs were compounded with the original S^Ds, the CS⁺s had little effect upon the vigor of responding while the CS^?s reduced the vigor of responding to the S^D for the reinforcer that was the same as the US used in establishing the CS^?. The results are discussed in terms of associative mediational theory and the reinforcer specificity of Pavlovian conditioned excitation and inhibition.     

Discriminative functions based on a delay in the reinforcement relation

Pigeons were shown to come under discrimination control when the S^D and S^Δ were temporally separated from reinforcement and non-reinforcement. S^D and S^Δ consisted of distinctive key illuminations presented separately. Responding on an FR 5 in the presence of S^D or S^Δ produced a third stimulus containing a schedule requirement. If this third (or interpolated) stimulus was preceded by S^D, responding in its presence produced reinforcement followed by a time-out (TO). If, on the other hand, the third stimulus was preceded by S^Δ, responding produced TO alone. In this fashion, the same stimulus and the same response requirement were imposed between S^D and the reinforcement as between S^Δ and the TO. In Experiment I, the schedule employed during the interpolated stimulus was FR; in Experiment II, FI. Discrimination reversal was accomplished in both experiments.     

On the failure of transfer of control from separately conducted Pavlovian conditioning to free-operant avoidance conditioning in rats

In Experiment 1, presentation of a tone previously correlated with foot shock produced an increase in the rate of rats' foot-shock avoidance responding, while presentation of a tone previously correlated with tail shock had no reliable effect on the rate of foot-shock avoidance responding. In Experiment 2, a tone correlated with tail shock elicited heart-rate conditioned responses, but had no reliable effect on the rate of subsequent foot-shock avoidance responding. In Experiment 3, presentation of a tone previously correlated with foot shock, and a tone previously correlated with tail shock in separate groups produced increases in the rate of tail-shock avoidance responding. In Experiment 4, a tone correlated with tail shock in one setting accelerated tail-shock avoidance responding in a second setting. Interaction between US and negative reinforcer modifiability by skeletal responding may contribute to the pattern of results obtained.     

Parameters affecting the acquisition of Sidman avoidance

Four studies were conducted to investigate the source of reinforcement of Sidman avoidance. First it was found that the acquisition of avoidance was seriously impaired if there was no immediate stimulus consequence of responding, i.e., proprioceptive and auditory feedback. The second study showed that if the shock-shock interval was split so that only responses occurring in one half of the interval were effective in postponing shock, then learning was impaired. It made little difference which half of the interval was used. The third study demonstrated that Ss learn Sidman avoidance more quickly with a variable shock-shock interval than with the usual fixed-interval procedure. The results of the second and third experiments argue against the view that avoidance is reinforced by the decrease in conditioned aversiveness that occurs at long post-shock times. The final experiment indicated that Ss do not learn Sidman avoidance if the response-produced delay of shock is preceded by a shock, hence it seems unlikely that the crucial source of reinforcement is merely an overall reduction in shock density. All of the findings are consistent with the hypothesis that the avoidance response is reinforced by the decrease in conditioned aversiveness of stimuli at short post-response times. This seems to be the case even at the beginning of acquisition.     

Transfer of conditioned fear and avoidance: Concurrent measurement of arousal and operant responding

A reversal design was employed for the analysis of transfer of fear and avoidance through equivalence classes. Two 5-member equivalence classes (A1-B1-C1-D1-E1 and A2-B2-C2-D2-E2) were established. Then B1 and C1 were paired with shock (CS+) and served as S^Ds in avoidance training (B2 and C2 were trained as CS-/S^∆s for avoidance). Further avoidance training followed with D1 and E1 (as S^Ds) and D2 and E2 (as S^∆s), with the first presentation of each of these stimuli serving as the first transfer test. Afterwards, aversive conditioning contingencies were reversed: B2 and D2 were paired with shock and trained as S^Ds for avoidance, B1 and D1 were presented without shock (CS-/S^∆s). Transfer was tested again with C1, E1, C2 and E2. This reversal was implemented to allow for the within-subject replication of transfer effects upon changes in the function of only a subset of each class's elements. Avoidance (key presses) and conditioned fear (skin conductance and heart rate) were simultaneously measured. Results show a clear transfer effect for avoidance, with between- and within-subject replications. For physiological measures, transfer effects in the first test could only be imputed on the basis of group-based inferential statistical analysis. Evidence for between-subject replication was weaker, with only a limited proportion of participants meeting the individual criterion for transfer.