Discrimination learning as a function of stimulus location along an auditory intensity continuum

Eight groups of rats were trained on an auditory intensity discrimination in which the discriminative stimuli were separated by 10 decibels (db). Four pairs of stimuli were selected from different regions along a 60–100 db (SPL) intensity continuum. Counterpart groups were trained on each stimulus pair, with the relative intensity positions of the reinforced stimulus (S^D) and the non-reinforced stimulus (S^Δ) reversed for the two groups. Discrimination acquisition curves were compared to determine whether stimuli separated by equal logarithmic units were of comparable “difficulty”, and to determine the relative effectiveness of an S^D serving as the more versus less intense member of a stimulus pair. It was concluded that: (1) When S^D is the more intense, auditory intensities of constant logarithmic separation are graded in “difficulty” along the intensity continuum; high intensity discriminative stimuli are most readily discriminated. When S^Δ is the more intense, this graded effect is not evident. (2) For a given continuum location, discrimination is inferior when S^Δ is the more intense. This effect is most pronounced at the high intensity end of the continuum and is chiefly attributable to differences in the rate of S^Δ responding.     

Antecedent reinforcement contingencies in the stimulus control of an auditory discrimination

In order to assess possible confounding of discriminative stimulus effects with those produced by the reinforcing stimulus, three groups of four rats each were trained for 45 hr on a variable-interval 1-min reinforcement program. Two groups were run on a multiple variable-interval extinction schedule in which the reinforcement stimulus (S^D) and the nonreinforcement stimulus (S^Δ) were two intensities of a 4-kHz (cps) tone separated by 40 or 10 db. The third group was run on a mixed schedule with a single intensity constantly present. The mixed-schedule animals showed no discrimination of the reinforcement program. Under the multiple schedule, the highest S^Δ rates were obtained after S^D intervals, regardless of the reinforcement availability in the S^D interval. These local rate variations in S^Δ were small in proportion to those produced by the S^D versus S^Δ intensities.     

Discriminative functions based on a delay in the reinforcement relation

Pigeons were shown to come under discrimination control when the S^D and S^Δ were temporally separated from reinforcement and non-reinforcement. S^D and S^Δ consisted of distinctive key illuminations presented separately. Responding on an FR 5 in the presence of S^D or S^Δ produced a third stimulus containing a schedule requirement. If this third (or interpolated) stimulus was preceded by S^D, responding in its presence produced reinforcement followed by a time-out (TO). If, on the other hand, the third stimulus was preceded by S^Δ, responding produced TO alone. In this fashion, the same stimulus and the same response requirement were imposed between S^D and the reinforcement as between S^Δ and the TO. In Experiment I, the schedule employed during the interpolated stimulus was FR; in Experiment II, FI. Discrimination reversal was accomplished in both experiments.     

Behavioral effects of pairing an SD with a decreasing limited-hold reinforcement schedule

Four pigeons were trained on a multiple reinforcement schedule consisting of two limited-hold schedules, one in which a discriminative stimulus (S^D) accompanied the periodic reinforcement contingency, and one in which the discriminative stimulus was omitted. The duration of the limited-hold in each component of the multiple schedule was reduced in parallel steps. It was shown that behavioral differences between the two schedules were attenuated by this manipulation of temporal parameters. When S^D was reduced in duration, three out of four pigeons responded with extremely high S^Δ rates, despite the regular pairing of S^Δ with the reinforcement contingency. These high rates qualitatively resembled the rapid rates emitted on the analogous no-S^D component.     

Interactions between the discriminative and aversive properties of punishment

Punishment acquires a discriminative property when it is selectively paired with either reinforcement or extinction. At the milder punishment intensities, the discriminative control exerted by punishment is similar to the discriminative control exerted by a response-produced neutral (nonaversive) stimulus. However, the effect of the aversive property is apparent as the intensity of the punishment is increased. The aversive property of the punishment acts to enhance the discriminative control when the punishment is selectively applied during extinction periods, and to attenuate the discriminative control when the punishment is selectively applied during reinforcement periods. One major difference was found between the control exerted by the punishment and the response-produced neutral simulus: Responding greatly increased after the S^Δ punishment but not after the S^Δ neutral stimulus; this increase in responding was independent of the punishment intensities studied.     

The effects of unavoidable shocks on a multiple schedule having an avoidance component

Two dogs were maintained on a multiple schedule having both a food reinforced and an avoidance component (Mult VI 1′ S^Δ Avoid_{SS20 RS20} S^Δ). The effects of superimposing an Estes-Skinner procedure for delivering unavoidable shocks on all components of the multiple schedule were observed. The buzzer-shock pairing of the Estes-Skinner procedure produced an increased rate of responding on the avoidance component of the schedule and also on the S^Δ components. No persistent change in rate was observed on the food component during the pre-shock stimulus. Control performances on all components could be regained by either extinguishing or eliminating the buzzer-shock pairing. Extinction of the avoidance responding had little effect on the increased rates of responding produced by the Estes-Skinner procedure on the S^Δ and avoidance extinction components and did not lead to a conditioned suppression of the food reinforced responding. Rate of responding during the pre-shock stimulus was observed to be relatively independent of changes in the maintaining schedules. Responding during the pre-shock stimulus could be conditioned and maintained after an extensive history of avoidance extinction.     

Generalization and discrimination as a function of the SD — SΔ intensity difference

Three groups of four rats were trained on an auditory-intensity discrimination for 21 days. The S^D-S^Δ intensity difference for Group I was 10 db; for Group II, 20 db; and for Group III, 30 db. Following the initial discrimination training, the animals were tested for generalization of the bar-press response to seven novel S^Δ's which were presented intermingled with the original S^D and S^Δ values. Conclusions: (1.) The amount of simple discrimination training required to obtain fairly stable differences in S^D and S^Δ responding is an inverse function of the magnitude of the stimulus difference between S^D and S^Δ. (2.) Generalization gradients obtained immediately following simple discrimination training exhibit a maximum displaced from S^D in a direction also away from S^Δ. (3.) Gradients obtained following continued exposure to the multivalued S^Δ situation show a fairly stable maximum at the S^D value. (4.) Although the gradients tend to fall off systematically on either side of the continuum as distance from S^D is increased, they decrease most rapidly on the S^Δ limb of the gradient.     

Some notes on time out from reinforcement

Pigeons produced food on a fixed-ratio schedule by pecking at one key, and an S^Δ period by pecking at a second (switching) key. Switching behavior was examined as a function of (a) size of the fixed ratio, (b) whether the S^Δ was of fixed duration or could be determined by the bird, (c) the introduction of a novel food S^D, (d) extinction of food responding, and (e) the stimuli associated with the S^D and S^Δ conditions. No monotonic relationship was obtained between ratio size and switching behavior. Switching behavior was, however, influenced by many variables. The results suggest that an interpretation of switching behavior in terms of its being reinforced by the removal of aversive conditions, is open to considerable question.     

The effect of multiple SΔ periods on responding on a fixed-interval schedule: III. Effect of changes in pattern of interruptions, parameters and stimuli

Pigeons responding under fixed-interval schedules of reinforcement were interrupted by S^Δ periods during the course of the intervals. Whether intervals were interrupted by 1, 2, or 5 S^Δ periods, the general scalloped pattern of FI responding persisted. Parameter values up to 27¾ hr for the FI and 2¾ hr for the individual S^Δ interruptions were studied. The results further weaken the hypothesis that the FI pattern of responding depends crucially on control of responding by continuously chained mediating behavior.     

The effect of multiple S periods on responding on a fixed-interval schedule: IV. Effect of continuous S with only short S probes

Pigeons were studied under FI 500 sec in which an S^Δ was present throughout the interval except during the terminal 50-sec segment and one earlier 50-sec segment. Very little responding occurred during the presence of S^Δ. The rate of responding in the earlier 50-sec S^D segments was lower than in the terminal S^D segment. There was a clear trend for the rate of responding in the earlier S^D segment to be progressively higher the later it occurred in the course of the FI 500 sec. This trend was shown roughly to parallel the increasing rate of responding in a conventional FI 500 sec with no interruption by S^Δ. Since the changing tendency to respond through the FI survives massive disruption by S^Δ, it is concluded that the control of responding through the FI does not require continuous mediating behavior. It is suggested that it is the decaying retroactive influence of the reinforcer on responses that occurred longer and longer before the reinforcer occurred which produces the familiar scalloped pattern of responding under FI schedules.     

Effect of prior Pavlovian discrimination training upon learning an operant discrimination

The effect of Pavlovian discrimination training with two stimuli upon subsequent learning of an operant discrimination involving those stimuli was studied. After preliminary lever press training, the lever was removed and thirsty rats received noncontingent pairings between S₁ (a tone or a clicker) and water reinforcements, whereas S₂ (a clicker or a tone) occurred always without reinforcement. This procedure presumably established S₁ as a positive CS for respondent behavior, whereas S₂ was established as an inhibitory CS. Following this training, the lever was reintroduced and the rats were trained on an operant (lever pressing) discrimination involving S₁ and S₂. For the Consistent Ss, S₁ was the S^D and S₂ the S^Δ in the operant discrimination; for the Reversed Ss, S₂ served as S^D and S₁ as S^Δ. The Consistent Ss learned the operant discrimination significantly faster than did the Reversed Ss. The result emphasizes the importance of respondents, conditioned to S^D and S^Δ, which modulate operant performance to these stimuli.     

Escape from SD associated with fixed-ratio reinforcement

Throughout ascending and descending fixed-ratio (FR) sequences, rats were allowed to terminate the FR stimulus control by pressing a time-out (TO) lever. To minimize chance or accidental responses on this second lever, three presses were required to produce the 30-sec S^Δ period. As FR performance became more “strained,” there was an increased predisposition to escape from the time-in stimulus complex. The generality of this finding was extended by obtaining recoverability (independent of the direction of stimulus change) of the FR-TO function in the descending series. Typically, escapes were produced only during the post-reinforcement pause; however, under a mixed FR FR schedule, their occurrence shifted to a point within the inter-reinforcement interval corresponding to the unreinforced completion of the lower ratio component. It appears that the point where the rat can discriminate the size of the ratio requirement will be the place where TOs are imposed. This inference was supported by a substantial increase in TO frequency accompanying a shift from CRF to extinction on the FR lever. Finally, the escape lever was placed on a progressively increasing FR schedule and later extinguished to demonstrate that the TO condition was in fact reinforcing.     

Fear as a discriminative stimulus for an appetitive instrumental response

Two experiments tested the hypothesis that anticipation of shock could be established as a discriminative stimulus for an appetitive instrumental response. In multiphase experiments, bar pressing for food was brought under the discriminative control of intermittent and gradually increasing electric shock. In a second phase, tones were estalished as either a CS+, or CS? for shock. Subsequently, the CSs were introduced on to the operant baseline. Animals trained with shock as the S^D showed an increase in responding to the CS+ and a slight decrease to the CS?. Conversely, animals trained with shock as the S^Δ showed decreased responding to the CS+ and slight increase to the CS?. These findings are seen as supportive of the Discriminative Stimulus hypothesis of learned resistance to punishment.     

General attentiveness effects of discriminative training

Using a design that permitted the simultaneous assessment of intra-, inter-, and extradimensional effects of discriminative training, the generality of discriminative effects that have been said to reflect increases in “general attentiveness” was assessed. Pigeons received either discriminative training with two stimuli correlated with reinforcement and one stimulus correlated with nonreinforcement, or nondifferential reinforcement (control) training. One positive stimulus was part of an intradimensional task and the other was not. After training, generalization tests were conducted to assess stimulus control along several dimensions. Discriminative training resulted in increased control along dimensions of the positive stimulus involved in the intradimensional task, but not along any dimensions of the other positive stimulus. The results suggested that discriminative training leads to increases in attention that are neither so general as suggested by the “general attentiveness” view nor so specific as to be revealed solely by intradimensional effects.     

Operant control of vocal behavior in the cat

Evidence of operant control of vocal behavior in the cat is presented: (1) On mult FR 12 S^Δ schedule, cats miaowed rapidly during periods of S^D and much less or not at all during S^Δ. (2) This control was re-established following reversal of stimuli. (3) The frequency distribution of response durations was shifted to both shorter and longer values by the differential reinforcement of shorter or longer response durations respectively. Since both the frequency and duration of vocal responses were shown to be under the control of the schedule of reinforcement, it is concluded that at least some of the vocal behavior of the cat is susceptible to operant control.     

WITHIN‐SUBJECT REVERSIBILITY OF DISCRIMINATIVE FUNCTION IN THE COMPOSITE‐STIMULUS CONTROL OF BEHAVIOR

According to the composite-stimulus control model (Weiss, 1969, 1972b), an individual discriminative stimulus (S^D) is composed of that S^D''s on-state plus the off-states of all other relevant S^Ds. The present experiment investigated the reversibility of composite-stimulus control. Separate groups of rats were trained to lever-press for food whenever a tone or a light S^D was present. For one group, the nonreinforced S^Δ condition was tone-and-light absence ($\bar{T}$+$\bar{L}$). Tone-plus-light (T+L) was S^Δ in the other group. On a “stimulus compounding” test that recombined composite elements, maximum responding occurred to that composite consisting only of elements occasioning response increase. That was T+L for the group trained with $\bar{T}$+$\bar{L}$ as S^Δ and $\bar{T}$+$\bar{L}$ for the group trained with T+L as S^Δ. The S^Δ composite was next reversed over groups in Phase 2. In Phase 2 tests, maximum responding that was comparable in magnitude to that of Phase 1 was again controlled by the composite consisting only of elements most recently occasioning response increase—whether T+L or $\bar{T}$+$\bar{L}$. The inhibitory conditioning history of both composite-elements currently occasioning responding did not weaken the summative effect. These results confirm and extend Weiss''s composite-stimulus control model, and demonstrate that such control is fully reversible. We discuss how translating conditions of the stimulus-compounding paradigm to a composite continuum creates a functional and logical connection to intradimensional control measured through stimulus generalization, reducing the number of different behavioral phenomena requiring unique explanations.     

Mitigating resurgence of destructive behavior using the discriminative stimuli of a multiple schedule

Results of several recent translational studies have suggested that correlating contextual or discriminative stimuli with the delivery and withholding of reinforcement for the functional communication response (FCR) may mitigate resurgence of destructive behavior, but few, if any, have isolated the effects of those stimuli. In the present study, we first trained the FCR, brought it under stimulus control of a multiple schedule, and thinned its reinforcement schedule in one stimulus context. Next, we conducted resurgence evaluations (i.e., baseline, functional communication training [FCT], extinction challenge) in two novel contexts to test the effects of the discriminative stimuli on resurgence. We programmed one context to include the (a) S^D during the FCT phase to signal the availability of reinforcement for the FCR and (b) S^Δ during a subsequent extinction challenge to signal the unavailability of reinforcement for the FCR. The other context did not include the S^D during the FCT phase, nor the S^Δ during the extinction challenge. We expected to see greater persistence of the FCR in the context that included the S^D during FCT and less persistence of the FCR and less resurgence of destructive behavior in the context that included the S^Δ during the extinction challenge. Obtained results confirmed this latter prediction, but we observed no reliable difference when the S^D was present or absent during the FCT phase. Our results have relevance for practitioners in that they provide further empirical support for the use of discriminative stimuli when treating destructive behavior.     

Complex learning and information processing by pigeons: a critical analysis

Three models of conditional discrimination learning by pigeons are described: stimulus configuration learning, the multiple-rule model, and concept learning. A review of the literature reveals that true concept learning is not characteristic of the behavior of pigeons in matching-to-sample, oddity-from-sample, or symbolic matching studies. Instead, pigeons learn a set of sample-specific S^D rules. Transfer of the discrimination to novel stimuli, at least along the hue dimension, is predicted by a “coding hypothesis”, which holds that pigeons make a unique, but usually unobserved response, R₁, to each sample, and that the comparison stimulus chosen depends on which R₁ was emitted in the presence of the sample. Convincing evidence is found that pigeons do code sample hues, but there is little evidence that allows one to infer that the “coding event” must have behavioral properties. Parameters of the conditional discrimination paradigm are identified, and it is shown that by appropriate parametric manipulation, a variety of analogous tasks may be generated for both human and animal subjects. The tasks make possible the comparative study of complex learning, attention, memory, and information processing, with the added advantage that behavior processes may be compared systematically across tasks.     

The effect of multiple SΔ periods on responding on fixed-interval schedule: II. in a primate

A squirrel monkey was subjected to a fixed-interval pattern of reinforcement. During the course of each interval a bright white light was repeatedly presented. In the presence of the white light, a response was never immediately followed by food; the white light thus functioned as S^Δ. Responding was interrupted during the S^Δ periods, but in the squirrel monkey as in the pigeon, these interruptions did not destroy the characteristic scalloped pattern of the cumulatively recorded responding through each interval.     

RESPONDING MAINTAINED UNDER INTERMITTENT SCHEDULES OF ELECTRIC-SHOCK PRESENTATION: “SAFETY” OR SCHEDULE EFFCTS?

Four experiments were conducted in which lever pressing by squirrel monkeys was maintained under multiple, mixed, or chained schedules of electric-shock presentation. In the first two experiments, a multiple schedule was employed in which a fixed-interval schedule of shock presentation alternated with a signaled two-minute component. Initially, no events were scheduled during the two-minute component (a safety period). In the first experiment, the safety period was “degraded” by introducing and systematically increasing the frequency of periodic shocks presented during that component. In the second experiment, the proportion of overall safe time to unsafe time was decreased by decreasing the value of the fixed-interval schedule while holding constant shock frequency during the two-minute component. In the third experiment, the overall arrangement was changed from a multiple to a mixed schedule in an attempt to determine whether fixed-interval responding would be maintained when a single exteroceptive stimulus was associated with both components. In the fourth experiment, the overall arrangement was changed from a multiple to a chained schedule in an effort to determine whether fixed-interval responding would be maintained when its consequence was presentation of a signaled “unsafe” period. Fixed-interval responding was well maintained under all experimental conditions; the varied relationships obtained lend more support to conceptualizations of shock-maintained behavior as exemplifying schedule-controlled behavior than to suggestions that such behavior may be readily accounted for by “safety theory.”