Maintained generalization testing of conditioned suppression

This study concerns the use of a multiple stimulus discrimination procedure for producing data on the generalization of conditioned suppression. Four rats were maintained on a variable interval schedule of milk reinforcement in the presence of five stimuli varying in auditory click rate. When response rates were stable, electric shock was regularly paired with the termination of one of the click stimuli. For two rats the shock was paired with the slowest click rate, and for two rats shock was paired with the fastest click rate. The VI schedule remained in effect. Plots of the relative rates of response to each of the five stimuli yielded concave gradients for both animals suppressed at the slowest click rate, and flat gradients with a sharp drop at the warning stimulus for both animals suppressed at the fastest click rate. When the warning stimuli were reversed for both pairs of subjects, both gradient forms were reproduced. The present procedure was contrasted with procedures used by other investigators.     

Conditioned acceleration and conditioned suppression in pigeons

Two experiments were performed to investigate the effects on pigeons' keypecking behavior of stimuli that signal different kinds of aversive events: time-out from positive reinforcement, electric shock, loud noise, and loud tone. Behavior maintained by a variable-interval schedule of reinforcement was suppressed by a stimulus before shock, was accelerated by a stimulus before time-out from positive reinforcement, and was unchanged by a stimulus before loud noise or a stimulus before loud tone. Conditioned acceleration with time-out from positive reinforcement and conditioned suppression with shock were obtained regardless of whether a response contingent or response-independent procedure was employed.     

Signalled free-operant avoidance of shock by pigeons pecking a key

Two pigeons were trained to peck a key under a free-operant avoidance schedule. Then, changes in key color signalled the beginning (safe period) and the end (warning period) of the response-shock interval, with a response required to change the key color. Finally, a change in key color signalled the warning period and either a response or a shock reinstated the safe stimulus. During signalled avoidance, response rate was higher during the warning stimulus than during the safe stimulus. More responding tended to occur in the warning stimulus when it was terminated by either a response or a shock than by only a response. In either procedure, response latency during the warning stimulus was a function of the duration of the warning stimulus. In general, response and shock rate were higher during unsignalled than during signalled avoidance. When the warning stimulus was brief, the results were similar to those of unsignalled avoidance. These results confirm previous findings with pigeons, are in general agreement with data provided by other species in studies of signalled avoidance, and thereby indicate the transituationality of the key-pecking operant.     

Conditioned suppression, punishment, and aversion

Three experiments were conducted to assess the aversive properties of a visual stimulus in the presence of which one group of birds received response-contingent shock (discriminated punishment) while a yoked group of birds received non-contingent shocks (conditioned suppression). In Experiment 1, presentation of the visual stimulus contingent on key pecking reduced the response rate (conditioned punishment effect) for birds under the conditioned suppression procedure but did not reduce the response rate of birds under the discriminative punishment procedure. Non-contingent shocks also produced greater suppression of responding maintained by positive reinforcement in the presence of a visual stimulus than did response-contingent shocks. In Experiment 2, a greater shock intensity (2 mA) was used. All the differences between the two groups found in Experiment 1 were also found in Experiment 2. Experiment 3 demonstrated that response-contingent shock did not result in a conditioned punishment effect even when positive reinforcers were unavailable during the discriminative punishment schedule. The exteroceptive stimulus that was paired with shock in the conditioned suppression procedure acquired the ability to punish behavior. The exteroceptive stimulus in the discriminative punishment schedule did not acquire this ability.     

The effect of intertrial conditioned stimuli in autoshaping

Three autoshaping experiments, using pigeon subjects, examined the effect of presenting an S+ or an S- on acquisition to a different conditioned stimulus (CS). Experiment 1 found that signalling intertrial food with an S+ or an S- allowed acquisition of responding to the target-CS; however, that acquisition was slower when the signal was the S+. Experiment 2 found that even when the S+ or S- were presented without food in the intertrial interval, acquisition was slower in the group receiving the S+. Experiment 3 found that a similar, but weaker effect occurred when the S+ or S- stimuli were presented in the session prior to target-CS training, rather than intermixed. These results have implications for the interpretation of experiments that use a signalling manipulation to assess the interaction of CS and context in Pavlovian conditioning; they suggest that signalling unconditioned stimuli (USs) may have consequences other than that of modulating context-US learning.     

Operant discrimination of an interoceptive stimulus in rhesus monkeys

Five rhesus macaques monkeys surgically prepared with Thiry small intestinal (jejunum) loops and implanted brain electrodes were restrained in primate chairs and kept on 23-hr deprivation-feeding cycle. After being trained to press a lever for sugar pills on an FR 25 schedule of reinforcement, a discrimination training procedure was established. Lever presses were reinforced during the S(D)-a non-aversive mechanical stimulus applied to the internal walls of the Thiry loop by rhythmic inflation-deflation of a small latex balloon by air at the rate of one cycle per sec at 100 mm Hg pressure. The S(Delta) was the absence of the visceral stimulation. The monkeys successfully discriminated between presence and absence of the internal stimulus. A discrimination reversal was attempted and completed on one monkey. The results clearly show operant discrimination based on an interoceptive stimulus. Cortical and subcortical EEG records reflected the onset but not termination of the visceral stimulation.     

Modulation of the effective salience of a stimulus by direct and associative activation of its representation

In 2 experiments, rats received exposure to presentations of a footshock preceded by a given cue. In the PRf (partial reinforcement) condition, this cue also occurred in the absence of the shock; in the CRf (continuous reinforcement) condition, it did not. Subsequent testing in which a new stimulus was used to signal the shock (Experiment 1) showed that the shock was more effective as a reinforcer for the PRf than for the CRf group. In Experiment 2, the shock was used as a conditioned stimulus signaling food delivery, and it was found that conditioning occurred more readily in the PRf than in the CRf group. These results accord with the hypothesis that preexposure to the shock results in a decline in its effective salience but that experience of a cue that signals shock in the absence of the shock itself attenuates this effect and helps maintain stimulus salience.     

Behavioral contrast produced by a signaled decrease in local rate of reinforcement

Pigeons' key pecking in the presence of one stimulus (S1) was reinforced according to a response-dependent variable-interval schedule. Pecking rate during S1 increased (behavioral contrast) when a second stimulus (S2) [associated with either a response-dependent fixed-interval schedule (Experiment I) or a response-independent reinforcement schedule in which reinforcement availability was signaled by visual (Experiment II) or temporal (Experiment III) stimuli] alternated with S1. These experiments suggest that a discriminable, signaled decrease in local reinforcement rate during S2 is an antecedent of the behavioral contrast response rate increases during S1.     

Brief escape from a dangerous place: The role of reinforcement in the rat's one-way avoidance acquisition

Five experiments are reported which attempt to eliminate two possible sources of reinforcement in one-way avoidance learning: a period of escape from aversive apparatus cues and the termination of the warning signal (WS). A “brief escape”/one-way avoidance procedure was developed to minimize the time rats spent away from the shock box. It was found that, although prolonged escape from shock box cues contributes to the acquisition rate of one-way avoidance, it is not essential for relatively rapid acquisition to occur. It was also found, in agreement with earlier evidence, that WS termination makes no discernible contribution to learning in the one-way situation. Thus, neither source of reinforcement appears to be necessary for acquisition. At this point, one may argue either that reinforcement is not necessary for rapid one-way avoidance acquisition [e.g., Bolles' 1972 species-specific defense reaction hypothesis (In G. H. Bower (Ed.), The psychology of learning and motivation: Advances in research and theory (Vol. 6). New York: Academic Press, 1972)] or that there are other sources of reinforcement. As an example of the latter approach, a consummatory stimulus reward hypothesis is advanced.     

Conditioned suppression as a sensitive baseline for social facilitation

The key pecking of pigeons maintained on a variable-interval schedule of food reinforcement was suppressed during occasional presentations of a warning stimulus paired with electric shock. On alternate sessions, a co-actor pigeon was visible in an adjoining chamber where it emitted the same food-reinforced key peck during the warning stimulus that signalled shock for the subject. With no shock and at low shock intensities, where the subject's responding was not suppressed or suppressed only slightly, the co-actor had little effect. At the higher shock intensities, where the subject's responding was reduced by at least 40%, the response rate during the warning stimulus was consistently higher when the co-actor was present. One explanation of these results assumes a special relationship between social stimuli and aversive stimuli in which the presence of another animal reduces emotional reactions and thereby allows operant responses to increase. This was not the case here because the mere presence of the co-actor did not maintain social facilitation. Rather, the present results, taken in conjunction with previous findings, suggest that changes in social and non-social variables which affect the rate of food-reinforced responding may produce proportionately larger changes in responding when that responding is suppressed by aversive stimulation than when it is not.     

Periodic shock with added clock

Rats were shocked every 6 min while responding was maintained on a variable-interval schedule of reinforcement. With some rats, shocks were interspersed with a sequence of three different stimulus conditions (S3→S2→S1), or clock cues, each lasting 2 min. For other rats, a single stimulus condition prevailed between shocks at the beginning of the experiment and clock cues were introduced later. Response rate decreased from S3 to S1. Response rate in S3, S2, and S1 was inversely related to shock intensity. When clock cues were added, response rate increased in all 2-min intershock periods. During clock cues, an index of curvature, indicating the degree of negative acceleration of response rate, was greatest for S1 and least for S3, and was directly related to shock intensity. The response-facilitating effect of shock and its relation to a possible discriminative function of shock and to behavioral contrast is discussed.     

Simultaneous temporal processing

Seven experiments assessed the ability of rats to process temporal information from two internal clocks simultaneously and independently. In the first six experiments a light stimulus signalled an overall interval between the beginning of a trial and the availability of food reinforcement (e.g., a 50-s fixed interval). During the overall interval a sound stimulus was used to signal shorter intervals that divided the overall interval into equal segments. When there was a fixed temporal relation between the final segment signal and the availability of reinforcement, there was a double-scallop pattern of responding throughout the segmented overall interval; the function relating response rate to time during segment intervals was similar to the function relating response rate to time in unsegmented overall intervals; a change in response rate occurred at the time that a normally presented segment signal was omitted. Taken together, the results indicate that rats timed the overall interval and the segment intervals simultaneously and independently without interference. In Experiment 7 a light stimulus was used on some trials, and a sound stimulus was used on other trials to signal a discrete-trial 50-s peak procedure. When these two signals were presented in compound, there was a leftward shift of the response function, which suggests that rats timed both signals simultaneously. For all of the experiments a scalar timing model with specific stimulus integration rules is used to explain the results. The stimulus integration rule used in the first six experiments, in which there were two signals for the same reinforcement, was to respond if both the segment and the overall interval had exceeded a response threshold. The stimulus integration rule used in Experiment 7, in which there were two signals for different reinforcements, was to respond if the response threshold for either interval had been exceeded.     

Signal detection methods for measurement of utility in animals

Analytic methods of signal detection theory were employed to assess the utility of reinforcers. Four pigeons were trained to detect the presence or absence of a stimulus by pecking one of two side keys in a trial-by-trial choice paradigm. The relative rate of positive reinforcement for correct choices was varied to offset the biasing effects of electric shock for incorrect right side-key choices. The effects of relative rate of reinforcement on bias were similar at all shock intensities even though the subjects' sensitivity changed during the course of the experiment. The relative rate of reinforcement required to produce equal bias was calculated and plotted against shock intensity to generate utility functions. The relative rate of reinforcement necessary to offset the bias induced by shock was an increasing function of shock intensity.     

Learning due to the response-shock contingency in signalled punishment

Three experiments examined some of the parameters that affect the degree of response-specific learning in signalled punishment. Each of the experiments used a within-subject procedure in which the shocks received in the presence of a stimulus signalling response-independent shocks (CER) were yoked to the number and distribution of shocks received in a stimulus signalling punishment. Experiments 1 and 2 used different values of variable-interval (VI) or fixed-ratio (FR) schedules of shock priming, respectively, during the punishment stimulus, and Experiment 3 varied the delay of punishment. The results of all three experiments supported the conclusion that the degree of additional suppression produced by the response contingency during the punishment stimulus compared to the CER stimulus was a function of the strength of contingency between the response and the shock.     

Some effects of methylphenidate on stimulus control of ratio avoidance behavior in the rat

After exposure to an avoidance schedule which included a warning signal, a rat was placed on a multiple schedule in which the first component was the same as before, i.e., a single response reset the response-shock interval, delaying shock, and the second component differed only in that four bar-presses were required to postpone shock. A fixed ratio requirement of four responses (FR 4) generated behavior resembling a fixed ratio requirement of one response (FR 1) since responding was controlled by the warning signal but more shocks were received. At a dosage of 2 mg/kg, methylphenidate given intraperitoneally decreased shock frequency during FR 4 periods while FR 1 behavior was not affected; at 4 mg/kg, stimulus control of avoidance responding was impaired during both components. Results at 4 mg/kg were partially confirmed by two animals exposed to an FR 4 avoidance schedule which included a warning signal but with different parameters. Response distributions showed that methylphenidate increased response rates in the absence of the warning signal, i.e., stimulus control of ratio-avoidance behavior was impaired although the increased response rates reduced shock frequency. One hour later responses again occurred more frequently during the signal than in its absence but shocks were less frequent than during control (non-drug) periods.     

Time allocation in concurrent schedules: the effect of signalled reinforcement

The responses of five pigeons were reinforced on concurrent variable-interval variable-interval reinforcement schedules in which changeover key responses changed the stimulus and reinforcement schedules associated with the food key. While the reinforcement availability in one component remained unchanged throughout the experiment, the reinforcement availability in the other component was, during several conditions, signalled by the onset of an additional discriminative stimulus. During unsignalled conditions, both the relative frequency of responding and the relative time spent in each component approximated the obtained relative reinforcement frequency in each component. The effect of signalling reinforcer availability in one component was to (1) reduce responding in the signalled component to near-zero levels, and (2) increase the relative time in the unsignalled component, without a corresponding increase in the obtained relative reinforcement frequency. The magnitude of the increase in relative time in the unsignalled component decreased as the overall frequency of reinforcement increased. This deviation in the matching relation between relative time and the obtained relative reinforcement frequency was eliminated if the overall reinforcement frequency was increased before the signal was introduced and then, without removing the signal, gradually reduced.     

Conditioned punishment

Responses of pigeons were maintained by a VI schedule of food reinforcement. Conditioned punishment was programmed by having these responses concurrently produce an originally neutral stimulus. The effectiveness of this response-contingent stimulus was maintained by infrequent and prearranged stimulus-shock pairings delivered independently of responses. This conditioned punishment procedure reduced the overall response rate as long as the procedure was in effect. The extent and durability of the reduction was a function of the intensity of the shock that was paired with the stimulus. Analysis of the reduction in the overall response rate revealed: (1) a reduction of responses occurring in the absence of the response-contingent stimulus, which was designated as a “punishing” effect, and (2) a reduction of responses during the response-contingent stimulus, which was designated as a “suppressive” effect.     

The effect of signaled reinforcement on rats' fixed-interval responding

Four experiments examined the effect on rats' response rate of presenting a brief (500 ms) stimulus simultaneously with the delivery of food on fixed-interval (FI) schedules. In Experiment 1, reinforcement signals that were spatially diffuse (both tones and lights) elevated rates of responding, but responding was attenuated by localized visual stimuli. The remaining experiments examined the signal-induced potentiation of responding. In Experiment 2, a tone reinforcement signal potentiated response rates on an FI schedule, but attenuated response rates on a variable-interval (VI) schedule. This difference was obtained even though the overall rate of responding was equated on the two schedules before the introduction of the signal. Signal-induced potentiation of responding occurred over a range of FI values employed in Experiment 3. In Experiment 4, presenting a reinforcement signal when high local rates of response had occurred immediately before reinforcement resulted in potentiated rates of responding on an FI schedule. The opposite effect on response rate occurred when the reinforcement signal followed only low local rates of response. These results indicate that a variety of factors influence the effects of a reinforcement signal. They imply, however, that the local rate of response at the time of reinforcement is a key factor in establishing the nature of the signaling effect.     

The effects of electroconvulsive shock on the action of a reinforcing stimulus

Three experiments sought to evaluate the effect of electroconvulsive shock on the action of a reinforcing stimulus. In all experiments behavior was maintained on a 2 min variable interval schedule for food reinforcement. Foot shock at the termination of a buzzer stimulus served as the reinforcing stimulus for conditioned suppression during the ensuing buzzer interval. Omission of foot shock at the termination of the buzzer stimulus was followed by normal responding (no conditioned suppression) during the next buzzer interval. In Exp I electroconvulsive shock followed foot shock at varying time intervals. In the first subsidiary experiment electroconvulsive shock followed an unreinforced buzzer stimulus at varying time intervals. In the second subsidiary experiment electroconvulsive shock followed foot shock at varying time intervals and an additional buzzer stimulus was sounded between the termination of foot shock and the onset of electroconvulsive shock. These three experiments demonstrated that electroconvulsive shock invariably abolished the effects of the reinforcing stimulus if it followed conditioning by no more than 10.0 sec and never had an effect if it followed conditioning by 12.5 sec or more; electroconvulsive shock was not acting as a reinforcing stimulus in this situation.     

Effects of cycle length on performance on a temporally defined avoidance schedule

Three rats were trained on a temporally defined avoidance schedule logically similar to a fixed-interval, limited-hold positive reinforcement schedule. This avoidance schedule was composed of time periods during which responses had no scheduled consequences alternating with time periods during which a response precluded shock. As with fixed-interval length and response rate on positive reinforcement schedules, an inverse relationship was obtained between the length of the no-consequence interval and response rate during the no-consequence interval. An inverse relationship was also obtained between the length of the no-consequence interval and the per cent of shocks avoided. A rate increase within the no-consequence interval, similar to that typically produced by fixed-interval positive reinforcement procedures, was displayed by one of the rats where the no-consequence interval was at intermediate values and frequency of shock was relatively high. The introduction of a discriminative stimulus correlated with the avoidance interval produced typical discriminated avoidance behavior as well as alterations in temporal patterning of responses during the no-consequence interval in the two rats exposed to this procedure. These alterations in temporal patterning disappeared when the discriminative stimulus was removed. The results were consonant with those reported in the literature involving food reinforcement and fixed-interval, limited-hold schedules.