Antecedent reinforcement contingencies in the stimulus control of an auditory discrimination

In order to assess possible confounding of discriminative stimulus effects with those produced by the reinforcing stimulus, three groups of four rats each were trained for 45 hr on a variable-interval 1-min reinforcement program. Two groups were run on a multiple variable-interval extinction schedule in which the reinforcement stimulus (S^D) and the nonreinforcement stimulus (S^Δ) were two intensities of a 4-kHz (cps) tone separated by 40 or 10 db. The third group was run on a mixed schedule with a single intensity constantly present. The mixed-schedule animals showed no discrimination of the reinforcement program. Under the multiple schedule, the highest S^Δ rates were obtained after S^D intervals, regardless of the reinforcement availability in the S^D interval. These local rate variations in S^Δ were small in proportion to those produced by the S^D versus S^Δ intensities.     

Generalization and discrimination as a function of the SD — SΔ intensity difference

Three groups of four rats were trained on an auditory-intensity discrimination for 21 days. The S^D-S^Δ intensity difference for Group I was 10 db; for Group II, 20 db; and for Group III, 30 db. Following the initial discrimination training, the animals were tested for generalization of the bar-press response to seven novel S^Δ's which were presented intermingled with the original S^D and S^Δ values. Conclusions: (1.) The amount of simple discrimination training required to obtain fairly stable differences in S^D and S^Δ responding is an inverse function of the magnitude of the stimulus difference between S^D and S^Δ. (2.) Generalization gradients obtained immediately following simple discrimination training exhibit a maximum displaced from S^D in a direction also away from S^Δ. (3.) Gradients obtained following continued exposure to the multivalued S^Δ situation show a fairly stable maximum at the S^D value. (4.) Although the gradients tend to fall off systematically on either side of the continuum as distance from S^D is increased, they decrease most rapidly on the S^Δ limb of the gradient.     

Stress-induced breakdown of an appetitive discrimination

Rats trained to discriminate between S^D and S^Δ for food reinforcement showed marked impairments in this discrimination when strong, unavoidable shocks occurred at the termination of a third stimulus. The predominant feature of this impairment was a supernormal rate of unreinforced (S^Δ) behavior. Shocks delivered without exteroceptive warning also led to a discriminative breakdown. The effect was a direct function of shock intensity. When behavior was strongly suppressed in the third stimulus by response-correlated shock (“punishment”), instead of unavoidable shock, breakdowns were only temporary; as soon as responding recovered from its overall suppression, discriminative performance returned to normal. The discriminative deterioration may be interpreted as an emotional by-product of frequent aversive stimulation, but accidental contingencies could also have played a role.     

Behavioral effects of pairing an SD with a decreasing limited-hold reinforcement schedule

Four pigeons were trained on a multiple reinforcement schedule consisting of two limited-hold schedules, one in which a discriminative stimulus (S^D) accompanied the periodic reinforcement contingency, and one in which the discriminative stimulus was omitted. The duration of the limited-hold in each component of the multiple schedule was reduced in parallel steps. It was shown that behavioral differences between the two schedules were attenuated by this manipulation of temporal parameters. When S^D was reduced in duration, three out of four pigeons responded with extremely high S^Δ rates, despite the regular pairing of S^Δ with the reinforcement contingency. These high rates qualitatively resembled the rapid rates emitted on the analogous no-S^D component.     

Discriminative functions based on a delay in the reinforcement relation

Pigeons were shown to come under discrimination control when the S^D and S^Δ were temporally separated from reinforcement and non-reinforcement. S^D and S^Δ consisted of distinctive key illuminations presented separately. Responding on an FR 5 in the presence of S^D or S^Δ produced a third stimulus containing a schedule requirement. If this third (or interpolated) stimulus was preceded by S^D, responding in its presence produced reinforcement followed by a time-out (TO). If, on the other hand, the third stimulus was preceded by S^Δ, responding produced TO alone. In this fashion, the same stimulus and the same response requirement were imposed between S^D and the reinforcement as between S^Δ and the TO. In Experiment I, the schedule employed during the interpolated stimulus was FR; in Experiment II, FI. Discrimination reversal was accomplished in both experiments.     

Interactions between the discriminative and aversive properties of punishment

Punishment acquires a discriminative property when it is selectively paired with either reinforcement or extinction. At the milder punishment intensities, the discriminative control exerted by punishment is similar to the discriminative control exerted by a response-produced neutral (nonaversive) stimulus. However, the effect of the aversive property is apparent as the intensity of the punishment is increased. The aversive property of the punishment acts to enhance the discriminative control when the punishment is selectively applied during extinction periods, and to attenuate the discriminative control when the punishment is selectively applied during reinforcement periods. One major difference was found between the control exerted by the punishment and the response-produced neutral simulus: Responding greatly increased after the S^Δ punishment but not after the S^Δ neutral stimulus; this increase in responding was independent of the punishment intensities studied.     

Some notes on time out from reinforcement

Pigeons produced food on a fixed-ratio schedule by pecking at one key, and an S^Δ period by pecking at a second (switching) key. Switching behavior was examined as a function of (a) size of the fixed ratio, (b) whether the S^Δ was of fixed duration or could be determined by the bird, (c) the introduction of a novel food S^D, (d) extinction of food responding, and (e) the stimuli associated with the S^D and S^Δ conditions. No monotonic relationship was obtained between ratio size and switching behavior. Switching behavior was, however, influenced by many variables. The results suggest that an interpretation of switching behavior in terms of its being reinforced by the removal of aversive conditions, is open to considerable question.     

Effect of prior Pavlovian discrimination training upon learning an operant discrimination

The effect of Pavlovian discrimination training with two stimuli upon subsequent learning of an operant discrimination involving those stimuli was studied. After preliminary lever press training, the lever was removed and thirsty rats received noncontingent pairings between S₁ (a tone or a clicker) and water reinforcements, whereas S₂ (a clicker or a tone) occurred always without reinforcement. This procedure presumably established S₁ as a positive CS for respondent behavior, whereas S₂ was established as an inhibitory CS. Following this training, the lever was reintroduced and the rats were trained on an operant (lever pressing) discrimination involving S₁ and S₂. For the Consistent Ss, S₁ was the S^D and S₂ the S^Δ in the operant discrimination; for the Reversed Ss, S₂ served as S^D and S₁ as S^Δ. The Consistent Ss learned the operant discrimination significantly faster than did the Reversed Ss. The result emphasizes the importance of respondents, conditioned to S^D and S^Δ, which modulate operant performance to these stimuli.     

On the discriminative control of concurrent responses: the relations among response frequency, latency, and topography in auditory generalization

Human subjects were used in a study of auditory generalization following multiple-response discrimination training. The relations observed among stimulus intensity, response probability, and response latency were invariant with respect to whether the two vocal responses conditioned were topographically discrete, as in one experiment, or topographically continuous, as in another. The major findings were:

1. The probabilities associated with a specific response were maximal over several stimulus values at the extreme ends of the continuum, then dropped sharply at stimuli intermediate to the initial S^D's as the probability of the alternative response increased.

2. Overall response latency was inversely related to the relative frequency of the two responses at each stimulus value. When the two responses were most nearly equal in probability, latencies were maximal; when one response had close to unit or zero probability, latencies were minimal.

3. Analysis of the latencies of the two responses, taken separately, revealed: (a) an increase in latency as the difference between the test stimulus and the initial S^D increased; (b) a sharp discontinuity in the latency gradient and reversal in trend at intermediate stimulus intensities; and (c) at a given stimulus value, latencies associated with the stochastically dominant response were consistently shorter than those of the nondominant response.

4. No changes in response topography (fundamental frequency) were correlated with the characteristic changes in probability and latency during stimulus generalization.

     

Mitigating resurgence of destructive behavior using the discriminative stimuli of a multiple schedule

Results of several recent translational studies have suggested that correlating contextual or discriminative stimuli with the delivery and withholding of reinforcement for the functional communication response (FCR) may mitigate resurgence of destructive behavior, but few, if any, have isolated the effects of those stimuli. In the present study, we first trained the FCR, brought it under stimulus control of a multiple schedule, and thinned its reinforcement schedule in one stimulus context. Next, we conducted resurgence evaluations (i.e., baseline, functional communication training [FCT], extinction challenge) in two novel contexts to test the effects of the discriminative stimuli on resurgence. We programmed one context to include the (a) S^D during the FCT phase to signal the availability of reinforcement for the FCR and (b) S^Δ during a subsequent extinction challenge to signal the unavailability of reinforcement for the FCR. The other context did not include the S^D during the FCT phase, nor the S^Δ during the extinction challenge. We expected to see greater persistence of the FCR in the context that included the S^D during FCT and less persistence of the FCR and less resurgence of destructive behavior in the context that included the S^Δ during the extinction challenge. Obtained results confirmed this latter prediction, but we observed no reliable difference when the S^D was present or absent during the FCT phase. Our results have relevance for practitioners in that they provide further empirical support for the use of discriminative stimuli when treating destructive behavior.     

Operant control of vocal behavior in the cat

Evidence of operant control of vocal behavior in the cat is presented: (1) On mult FR 12 S^Δ schedule, cats miaowed rapidly during periods of S^D and much less or not at all during S^Δ. (2) This control was re-established following reversal of stimuli. (3) The frequency distribution of response durations was shifted to both shorter and longer values by the differential reinforcement of shorter or longer response durations respectively. Since both the frequency and duration of vocal responses were shown to be under the control of the schedule of reinforcement, it is concluded that at least some of the vocal behavior of the cat is susceptible to operant control.     

The effect of multiple S periods on responding on a fixed-interval schedule: IV. Effect of continuous S with only short S probes

Pigeons were studied under FI 500 sec in which an S^Δ was present throughout the interval except during the terminal 50-sec segment and one earlier 50-sec segment. Very little responding occurred during the presence of S^Δ. The rate of responding in the earlier 50-sec S^D segments was lower than in the terminal S^D segment. There was a clear trend for the rate of responding in the earlier S^D segment to be progressively higher the later it occurred in the course of the FI 500 sec. This trend was shown roughly to parallel the increasing rate of responding in a conventional FI 500 sec with no interruption by S^Δ. Since the changing tendency to respond through the FI survives massive disruption by S^Δ, it is concluded that the control of responding through the FI does not require continuous mediating behavior. It is suggested that it is the decaying retroactive influence of the reinforcer on responses that occurred longer and longer before the reinforcer occurred which produces the familiar scalloped pattern of responding under FI schedules.     

WITHIN‐SUBJECT REVERSIBILITY OF DISCRIMINATIVE FUNCTION IN THE COMPOSITE‐STIMULUS CONTROL OF BEHAVIOR

According to the composite-stimulus control model (Weiss, 1969, 1972b), an individual discriminative stimulus (S^D) is composed of that S^D''s on-state plus the off-states of all other relevant S^Ds. The present experiment investigated the reversibility of composite-stimulus control. Separate groups of rats were trained to lever-press for food whenever a tone or a light S^D was present. For one group, the nonreinforced S^Δ condition was tone-and-light absence ($\bar{T}$+$\bar{L}$). Tone-plus-light (T+L) was S^Δ in the other group. On a “stimulus compounding” test that recombined composite elements, maximum responding occurred to that composite consisting only of elements occasioning response increase. That was T+L for the group trained with $\bar{T}$+$\bar{L}$ as S^Δ and $\bar{T}$+$\bar{L}$ for the group trained with T+L as S^Δ. The S^Δ composite was next reversed over groups in Phase 2. In Phase 2 tests, maximum responding that was comparable in magnitude to that of Phase 1 was again controlled by the composite consisting only of elements most recently occasioning response increase—whether T+L or $\bar{T}$+$\bar{L}$. The inhibitory conditioning history of both composite-elements currently occasioning responding did not weaken the summative effect. These results confirm and extend Weiss''s composite-stimulus control model, and demonstrate that such control is fully reversible. We discuss how translating conditions of the stimulus-compounding paradigm to a composite continuum creates a functional and logical connection to intradimensional control measured through stimulus generalization, reducing the number of different behavioral phenomena requiring unique explanations.     

General attentiveness effects of discriminative training

Using a design that permitted the simultaneous assessment of intra-, inter-, and extradimensional effects of discriminative training, the generality of discriminative effects that have been said to reflect increases in “general attentiveness” was assessed. Pigeons received either discriminative training with two stimuli correlated with reinforcement and one stimulus correlated with nonreinforcement, or nondifferential reinforcement (control) training. One positive stimulus was part of an intradimensional task and the other was not. After training, generalization tests were conducted to assess stimulus control along several dimensions. Discriminative training resulted in increased control along dimensions of the positive stimulus involved in the intradimensional task, but not along any dimensions of the other positive stimulus. The results suggested that discriminative training leads to increases in attention that are neither so general as suggested by the “general attentiveness” view nor so specific as to be revealed solely by intradimensional effects.     

The effects of unavoidable shocks on a multiple schedule having an avoidance component

Two dogs were maintained on a multiple schedule having both a food reinforced and an avoidance component (Mult VI 1′ S^Δ Avoid_{SS20 RS20} S^Δ). The effects of superimposing an Estes-Skinner procedure for delivering unavoidable shocks on all components of the multiple schedule were observed. The buzzer-shock pairing of the Estes-Skinner procedure produced an increased rate of responding on the avoidance component of the schedule and also on the S^Δ components. No persistent change in rate was observed on the food component during the pre-shock stimulus. Control performances on all components could be regained by either extinguishing or eliminating the buzzer-shock pairing. Extinction of the avoidance responding had little effect on the increased rates of responding produced by the Estes-Skinner procedure on the S^Δ and avoidance extinction components and did not lead to a conditioned suppression of the food reinforced responding. Rate of responding during the pre-shock stimulus was observed to be relatively independent of changes in the maintaining schedules. Responding during the pre-shock stimulus could be conditioned and maintained after an extensive history of avoidance extinction.     

Complex learning and information processing by pigeons: a critical analysis

Three models of conditional discrimination learning by pigeons are described: stimulus configuration learning, the multiple-rule model, and concept learning. A review of the literature reveals that true concept learning is not characteristic of the behavior of pigeons in matching-to-sample, oddity-from-sample, or symbolic matching studies. Instead, pigeons learn a set of sample-specific S^D rules. Transfer of the discrimination to novel stimuli, at least along the hue dimension, is predicted by a “coding hypothesis”, which holds that pigeons make a unique, but usually unobserved response, R₁, to each sample, and that the comparison stimulus chosen depends on which R₁ was emitted in the presence of the sample. Convincing evidence is found that pigeons do code sample hues, but there is little evidence that allows one to infer that the “coding event” must have behavioral properties. Parameters of the conditional discrimination paradigm are identified, and it is shown that by appropriate parametric manipulation, a variety of analogous tasks may be generated for both human and animal subjects. The tasks make possible the comparative study of complex learning, attention, memory, and information processing, with the added advantage that behavior processes may be compared systematically across tasks.     

Transfer of training following discrimination learning with two reinforced responses

Pigeons were given errorless discrimination training between chromatic stimuli with a specific reinforced response associated with each discriminative stimulus. These Ss subsequently acquired a successive go/no-go auditory discrimination (utilizing one response class) faster than Ss given single stimulus training. These results are more compatible with an explanation of transfer of training in successive operant discrimination learning based on general attention than one based on withholding responses.     

Stimulus properties of conspecific behavior

Two experiments identified the conditions in which the behavior of one bird acquired discriminative control of the behavior of a second bird. The schedule-controlled behaviors of the “stimulus” bird were differentially correlated with the components of a multiple schedule according to which the pecking of an “experimental” bird produced food. In Experiment 1, three pairs of pigeons acquired a successive discrimination and two reversals with the conspecific stimuli. Experiment 2 included a control condition in which no systematic relationship existed between the conspecific stimuli and the component schedules. While differential responding during the components of the multiple schedule was again found when the conspecific stimuli were available, differential responding did not occur in the control condition. Test conditions included in the experiments indicated that (a) the differential responding was not dependent on the discriminative properties of reinforcement, (b) the pecking of the stimulus and experimental birds was temporally interrelated, (c) the visual conspecific stimuli were critical to the maintenance of the discrimination, and (d) the observed stimulus control immediately generalized to an unfamiliar conspecific.     

Analysis of discriminative control by social behavioral stimuli

Visual discriminative control of the behavior of one rat by the behavior of another was studied in a two-compartment chamber. Each rat's compartment had a food cup and two response keys arranged vertically next to the clear partition that separated the two rats. Illumination of the leader's key lights signaled a “search” period when a response by the leader on the unsignaled and randomly selected correct key for that trial illuminated the follower's keys. Then, a response by the follower on the corresponding key was reinforced, or a response on the incorrect key terminated the trial without reinforcement. Accuracy of following the leader increased to 85% within 15 sessions. Blocking the view of the leader reduced accuracy but not to chance levels. Apparent control by visual behavioral stimuli was also affected by auditory stimuli and a correction procedure. When white noise eliminated auditory cues, social learning was not acquired as fast nor as completely. A reductionistic position holds that behavioral stimuli are the same as nonsocial stimuli; however, that does not mean that they do not require any separate treatment. Behavioral stimuli are usually more variable than nonsocial stimuli, and further study is required to disentangle behavioral and nonsocial contributions to the stimulus control of social interactions.     

Associations in human instrumental conditioning

Four experiments were conducted to study the contents of human instrumental conditioning. Experiment 1 found positive transfer between a discriminative stimulus (S^D) and an instrumental response (R) that shared the outcome (O) with the response that was originally trained with the S^D, showing the formation of an S^D → O association. Experiment 2 found that post-acquisition devaluation of an outcome selectively reduced the response trained with that outcome, showing the formation of a R → O association. In Experiment 3, changing the outcome did not prevent participants from giving the response learned with each S^D, even though none of the responses was appropriate for the new outcome, showing evidence of the formation of S^D → R associations in instrumental learning. The three binary associations were shown within the same basic experimental situation. Finally, Experiment 4 found evidence of the formation of the higher order association S^D(R → O) in human instrumental conditioning.