Antecedent reinforcement contingencies in the stimulus control of an auditory discrimination

In order to assess possible confounding of discriminative stimulus effects with those produced by the reinforcing stimulus, three groups of four rats each were trained for 45 hr on a variable-interval 1-min reinforcement program. Two groups were run on a multiple variable-interval extinction schedule in which the reinforcement stimulus (S^D) and the nonreinforcement stimulus (S^Δ) were two intensities of a 4-kHz (cps) tone separated by 40 or 10 db. The third group was run on a mixed schedule with a single intensity constantly present. The mixed-schedule animals showed no discrimination of the reinforcement program. Under the multiple schedule, the highest S^Δ rates were obtained after S^D intervals, regardless of the reinforcement availability in the S^D interval. These local rate variations in S^Δ were small in proportion to those produced by the S^D versus S^Δ intensities.     

Stress-induced breakdown of an appetitive discrimination

Rats trained to discriminate between S^D and S^Δ for food reinforcement showed marked impairments in this discrimination when strong, unavoidable shocks occurred at the termination of a third stimulus. The predominant feature of this impairment was a supernormal rate of unreinforced (S^Δ) behavior. Shocks delivered without exteroceptive warning also led to a discriminative breakdown. The effect was a direct function of shock intensity. When behavior was strongly suppressed in the third stimulus by response-correlated shock (“punishment”), instead of unavoidable shock, breakdowns were only temporary; as soon as responding recovered from its overall suppression, discriminative performance returned to normal. The discriminative deterioration may be interpreted as an emotional by-product of frequent aversive stimulation, but accidental contingencies could also have played a role.     

Behavioral effects of pairing an SD with a decreasing limited-hold reinforcement schedule

Four pigeons were trained on a multiple reinforcement schedule consisting of two limited-hold schedules, one in which a discriminative stimulus (S^D) accompanied the periodic reinforcement contingency, and one in which the discriminative stimulus was omitted. The duration of the limited-hold in each component of the multiple schedule was reduced in parallel steps. It was shown that behavioral differences between the two schedules were attenuated by this manipulation of temporal parameters. When S^D was reduced in duration, three out of four pigeons responded with extremely high S^Δ rates, despite the regular pairing of S^Δ with the reinforcement contingency. These high rates qualitatively resembled the rapid rates emitted on the analogous no-S^D component.     

Discriminative functions based on a delay in the reinforcement relation

Pigeons were shown to come under discrimination control when the S^D and S^Δ were temporally separated from reinforcement and non-reinforcement. S^D and S^Δ consisted of distinctive key illuminations presented separately. Responding on an FR 5 in the presence of S^D or S^Δ produced a third stimulus containing a schedule requirement. If this third (or interpolated) stimulus was preceded by S^D, responding in its presence produced reinforcement followed by a time-out (TO). If, on the other hand, the third stimulus was preceded by S^Δ, responding produced TO alone. In this fashion, the same stimulus and the same response requirement were imposed between S^D and the reinforcement as between S^Δ and the TO. In Experiment I, the schedule employed during the interpolated stimulus was FR; in Experiment II, FI. Discrimination reversal was accomplished in both experiments.     

Discrimination learning as a function of stimulus location along an auditory intensity continuum

Eight groups of rats were trained on an auditory intensity discrimination in which the discriminative stimuli were separated by 10 decibels (db). Four pairs of stimuli were selected from different regions along a 60–100 db (SPL) intensity continuum. Counterpart groups were trained on each stimulus pair, with the relative intensity positions of the reinforced stimulus (S^D) and the non-reinforced stimulus (S^Δ) reversed for the two groups. Discrimination acquisition curves were compared to determine whether stimuli separated by equal logarithmic units were of comparable “difficulty”, and to determine the relative effectiveness of an S^D serving as the more versus less intense member of a stimulus pair. It was concluded that: (1) When S^D is the more intense, auditory intensities of constant logarithmic separation are graded in “difficulty” along the intensity continuum; high intensity discriminative stimuli are most readily discriminated. When S^Δ is the more intense, this graded effect is not evident. (2) For a given continuum location, discrimination is inferior when S^Δ is the more intense. This effect is most pronounced at the high intensity end of the continuum and is chiefly attributable to differences in the rate of S^Δ responding.     

Mitigating resurgence of destructive behavior using the discriminative stimuli of a multiple schedule

Results of several recent translational studies have suggested that correlating contextual or discriminative stimuli with the delivery and withholding of reinforcement for the functional communication response (FCR) may mitigate resurgence of destructive behavior, but few, if any, have isolated the effects of those stimuli. In the present study, we first trained the FCR, brought it under stimulus control of a multiple schedule, and thinned its reinforcement schedule in one stimulus context. Next, we conducted resurgence evaluations (i.e., baseline, functional communication training [FCT], extinction challenge) in two novel contexts to test the effects of the discriminative stimuli on resurgence. We programmed one context to include the (a) S^D during the FCT phase to signal the availability of reinforcement for the FCR and (b) S^Δ during a subsequent extinction challenge to signal the unavailability of reinforcement for the FCR. The other context did not include the S^D during the FCT phase, nor the S^Δ during the extinction challenge. We expected to see greater persistence of the FCR in the context that included the S^D during FCT and less persistence of the FCR and less resurgence of destructive behavior in the context that included the S^Δ during the extinction challenge. Obtained results confirmed this latter prediction, but we observed no reliable difference when the S^D was present or absent during the FCT phase. Our results have relevance for practitioners in that they provide further empirical support for the use of discriminative stimuli when treating destructive behavior.     

Choice of extinction-signalling stimuli by rats

Rats in a two-lever situation were exposed to alternating periods of intermittent reinforcement and extinction. Extinction periods were either unsignalled or were signalled by a response-produced stimulus. The signal was sometimes a stimulus paired with food delivery in the reinforcement periods and sometimes a stimulus that occurred only in extinction periods. Both kinds of signal accelerated extinction relative to the unsignalled condition. When the signal was the stimulus paired with food in reinforcement periods, the rats tended to prefer the lever that gave that signal even though the signal accelerated extinction. There was no comparable effect for the stimulus that occurred only in extinction periods; when this signal was contingent on only one of the two levers, the rats either avoided it (Experiment 3) or were indifferent (Experiment 4). It is concluded that a stimulus can be a “secondary reinforcer” as measured by preference, even though it decreases resistance to extinction; the implications are discussed with reference to formal theories of choice behavior.     

The effects of unavoidable shocks on a multiple schedule having an avoidance component

Two dogs were maintained on a multiple schedule having both a food reinforced and an avoidance component (Mult VI 1′ S^Δ Avoid_{SS20 RS20} S^Δ). The effects of superimposing an Estes-Skinner procedure for delivering unavoidable shocks on all components of the multiple schedule were observed. The buzzer-shock pairing of the Estes-Skinner procedure produced an increased rate of responding on the avoidance component of the schedule and also on the S^Δ components. No persistent change in rate was observed on the food component during the pre-shock stimulus. Control performances on all components could be regained by either extinguishing or eliminating the buzzer-shock pairing. Extinction of the avoidance responding had little effect on the increased rates of responding produced by the Estes-Skinner procedure on the S^Δ and avoidance extinction components and did not lead to a conditioned suppression of the food reinforced responding. Rate of responding during the pre-shock stimulus was observed to be relatively independent of changes in the maintaining schedules. Responding during the pre-shock stimulus could be conditioned and maintained after an extensive history of avoidance extinction.     

The effect of multiple SΔ periods on responding on a fixed-interval schedule: III. Effect of changes in pattern of interruptions, parameters and stimuli

Pigeons responding under fixed-interval schedules of reinforcement were interrupted by S^Δ periods during the course of the intervals. Whether intervals were interrupted by 1, 2, or 5 S^Δ periods, the general scalloped pattern of FI responding persisted. Parameter values up to 27¾ hr for the FI and 2¾ hr for the individual S^Δ interruptions were studied. The results further weaken the hypothesis that the FI pattern of responding depends crucially on control of responding by continuously chained mediating behavior.     

OBSERVING RESPONSES AND SERIAL STIMULI: SEARCHING FOR THE REINFORCING PROPERTIES OF THE S−

The control exerted by a stimulus associated with an extinction component (S−) on observing responses was determined as a function of its temporal relation with the onset of the reinforcement component. Lever pressing by rats was reinforced on a mixed random-interval extinction schedule. Each press on a second lever produced stimuli associated with the component of the schedule in effect. In Experiment 1 a response-dependent clock procedure that incorporated different stimuli associated with an extinction component of a variable duration was used. When a single S− was presented throughout the extinction component, the rate of observing remained relatively constant across this component. In the response-dependent clock procedure, observing responses increased from the beginning to the end of the extinction component. This result was replicated in Experiment 2, using a similar clock procedure but keeping the number of stimuli per extinction component constant. We conclude that the S− can function as a conditioned reinforcer, a neutral stimulus or as an aversive stimulus, depending on its temporal location within the extinction component.     

Discriminative effects of massed extincttion

Prior studies have reported that generalization gradients are not steepened if periods of non-reinforcement in S− follow and are not interspersed with periods of reinforcement in S+. Sharper gradients are produced by this massed-extinction procedure if it is preceded by prior discriminative training on a dimension orthogonal to the S+, S− dimension. The present study, using pigeons, found that generalization gradients along the wavelength dimension were steepened by massed-extinction sessions in 570 nm that had been preceded by: (1) discriminative training in which the S+ was a 550-nm light and the S− was a black vertical line superimposed on the 550-nm light; (2) non-differential reinforcement training with a 550-nm light and a black vertical line superimposed on the 550-nm light; (3) reinforcement training with only the 550-nm light. Massed-extinction sessions were administered until the response rate in the presence of the 570-nm stimulus was one-tenth of the mean response rate in the presence of the 550-nm stimulus during prior reinforcement training. Prior studies have used a time-dependent criterion, rather than a response-rate criterion of extinction, and this difference may be responsible for the differences in the effects of massed extinction on stimulus control.     

Operant control of vocal behavior in the cat

Evidence of operant control of vocal behavior in the cat is presented: (1) On mult FR 12 S^Δ schedule, cats miaowed rapidly during periods of S^D and much less or not at all during S^Δ. (2) This control was re-established following reversal of stimuli. (3) The frequency distribution of response durations was shifted to both shorter and longer values by the differential reinforcement of shorter or longer response durations respectively. Since both the frequency and duration of vocal responses were shown to be under the control of the schedule of reinforcement, it is concluded that at least some of the vocal behavior of the cat is susceptible to operant control.     

Some notes on time out from reinforcement

Pigeons produced food on a fixed-ratio schedule by pecking at one key, and an S^Δ period by pecking at a second (switching) key. Switching behavior was examined as a function of (a) size of the fixed ratio, (b) whether the S^Δ was of fixed duration or could be determined by the bird, (c) the introduction of a novel food S^D, (d) extinction of food responding, and (e) the stimuli associated with the S^D and S^Δ conditions. No monotonic relationship was obtained between ratio size and switching behavior. Switching behavior was, however, influenced by many variables. The results suggest that an interpretation of switching behavior in terms of its being reinforced by the removal of aversive conditions, is open to considerable question.     

Conditioned suppression, punishment, and aversion

Three experiments were conducted to assess the aversive properties of a visual stimulus in the presence of which one group of birds received response-contingent shock (discriminated punishment) while a yoked group of birds received non-contingent shocks (conditioned suppression). In Experiment 1, presentation of the visual stimulus contingent on key pecking reduced the response rate (conditioned punishment effect) for birds under the conditioned suppression procedure but did not reduce the response rate of birds under the discriminative punishment procedure. Non-contingent shocks also produced greater suppression of responding maintained by positive reinforcement in the presence of a visual stimulus than did response-contingent shocks. In Experiment 2, a greater shock intensity (2 mA) was used. All the differences between the two groups found in Experiment 1 were also found in Experiment 2. Experiment 3 demonstrated that response-contingent shock did not result in a conditioned punishment effect even when positive reinforcers were unavailable during the discriminative punishment schedule. The exteroceptive stimulus that was paired with shock in the conditioned suppression procedure acquired the ability to punish behavior. The exteroceptive stimulus in the discriminative punishment schedule did not acquire this ability.     

Interresponse-time analysis of stimulus control in multiple schedules

Interresponse-time distributions were recorded in two components of multiple variable-interval schedules that were varied over several conditions. Values of the exponent for power functions relating ratios of interresponse times emitted per opportunity to ratios of reinforcers obtained in the two components varied with interresponse-time class interval. The exponent (sensitivity to reinforcement) afforded a measure of stimulus control exerted by the discriminative stimuli. Exponents were near zero for short interresponse times, consistent with previous conclusions that responses following short interresponse times are controlled by response-produced or proprioceptive stimuli. Values of exponents increased with longer interresponse times, indicating strong control by exteroceptive stimuli over responses following interresponse times of approximately one second or longer.     

Discriminative responding on associated mixed and multiple schedules as a function of food and ICS reinforcement

Performance on associated mixed and multiple variable-interval-extinction schedules was studied as a function of food versus intracranial stimulation (ICS) reinforcement. For the mixed schedule, differential responding was greater for an ICS reinforcement group than for a food reinforcement group, demonstrating that conditions affecting resistance to extinction help to determine the control exerted by a mixed schedule. Performance on the multiple schedule demonstrated greater differential responding for an ICS group than for a food reinforcement group during the early training sessions, indicating that the control exerted by mixed schedules interacts with that exerted by the exteroceptive discriminative stimuli. The results suggest that the influence of the associated mixed schedule on discriminative responding would be greater, the greater the difficulty of the stimulus discrimination.     

Schedules using noxious stimuli. II: low intensity electric shock as a discriminative stimulus

The presence or absence of pulses of low intensity electric shock was used as a discriminative stimulus to control responding under fixed ratio reinforcement in the squirrel monkey. Initially brief periods of nonreinforcement were lengthened only when discriminative control was evident. Discriminative control was studied by (1) varying the duration of nonreinforcement periods; (2) reversing the stimulus conditions correlated with reinforcement and nonreinforcement periods; and (3) determining the minimum shock intensity necessary to maintain discriminative control. Stimulus control was not reliably affected by d-amphetamine, chlorpromazine, or morphine. The discriminative control by pulses of low intensity electric shock was similar to that by other discriminative stimuli, except that the control developed slowly and was better when the pulsing shock was correlated with reinforcement than when correlated with nonreinforcement.     

Transfer across drives of the discriminative effect of a Pavlovian conditioned stimulus

Previous results suggest that a stimulus paired in Pavlovian fashion with reward should exert some discriminative control over an unrelated operant response acquired under a different drive-reward system. In the following experiment, a stimulus was first paired with food reinforcement for a hungry rat. Subsequently, the animal learned to lever-press for water reinforcements when thirsty but not hungry. Finally, the control over lever-pressing of the food-paired stimulus was tested by presenting it at various times during extinction of the lever-pressing response. All animals in the experiment showed the expected effect; each emitted more lever-presses during periods of the food-paired stimulus than during alternate control periods.     

ESTABLISHING DISCRIMINATIVE CONTROL OF RESPONDING USING FUNCTIONAL AND ALTERNATIVE REINFORCERS DURING FUNCTIONAL COMMUNICATION TRAINING

Functional communication training (FCT) is a popular treatment for problem behaviors, but its effectiveness may be compromised when the client emits the target communication response and reinforcement is either delayed or denied. In the current investigation, we trained 2 individuals to emit different communication responses to request (a) the reinforcer for destructive behavior in a given situation (e.g., contingent attention in the attention condition of a functional analysis) and (b) an alternative reinforcer (e.g., toys in the attention condition of a functional analysis). Next, we taught the participants to request each reinforcer in the presence of a different discriminative stimulus (S^D). Then, we evaluated the effects of differential reinforcement of communication (DRC) using the functional and alternative reinforcers and correlated S^Ds, with and without extinction of destructive behavior. During all applications, DRC (in combination with S^Ds that signaled available reinforcers) rapidly reduced destructive behavior to low levels regardless of whether the functional reinforcer or an alternative reinforcer was available or whether reinforcement for destructive behavior was discontinued (i.e., extinction).     

Airflow as a discriminative stimulus

In one experiment, pigeons were taught to discriminate airflow by having availability of reinforcement signalled by its presence and extinction signalled by its absence. After they reached criterion, some were trained on a discrimination reversal. Others were trained on an intradimensional discrimination with a low airflow velocity associated with reinforcement and a higher airflow velocity associated with extinction. All discriminations were learned rapidly, indicating that airflow velocity can function as a discriminative stimulus. In the second and third experiments, naive pigeons were trained to discriminate the presence of a compound stimulus (one of three tonal intensities paired with one of three airflow velocities) from its absence. These pigeons were subsequently given a component stimulus test during extinction on four stimulus values; the two training values, the tone alone, and the airflow alone. High or moderate velocity airflow controlled more responding than any of the three tone intensities. However, low velocity airflow controlled more responding only when a low intensity tone was employed.