Peak shift as a function of multiple schedules of reinforcement

Pigeons were trained to respond to two stimuli on the wavelength continuum, 550 nm and 570 nm, each correlated with an independent schedule of reinforcement. The multiple schedule component in effect during 550 nm (S1) was always a variable-interval 1-min. During the 570-nm stimulus (S2) the second component of the schedule was either variable-interval 30-sec, 1-min, 2-min, 5-min, or extinction for different groups of birds. Generalization gradients were obtained after this training, with the following results: (1) response rate to S1 during training was related to the reinforcement frequency associated with S2; the distribution of responding during generalization testing was a function of the schedules of reinforcement used during training and the response rates they produced. Decreases in the relative frequency of reinforcement correlated with S2 resulted in increases in the distribution shift of responses away from S2 during generalization testing.     

Stimulus generalization of the effects of punishment

Three pigeons were trained to respond to seven spectral stimulus values ranging from 490 to 610 mμ and displayed in random order on a response key. After response rates had equalized to these values, a brief electric shock was administered when the subject (S) responded to the central value (550 mμ) while positive reinforcement for all values was maintained. Initially, there was broad generalization of the resulting depression in response rate, but the gradients grew steeper in the course of testing. When punishment was discontinued, the rates to all values recovered, and equal responding to all stimuli was reattained by two of the Ss. Stimulus control over the effects of punishment was clearly demonstrated in the form of a generalization gradient; this probably resulted from the combined effects of generalization of the depression associated with punishment and discrimination between the punished value and neutral stimuli.     

Some effects of discriminative training with equated frequency of reinforcement

Pigeons were exposed to a multiple schedule which provided equally frequent reinforcement in the presence of two stimuli but which produced markedly different rates of key-pecking. Generalization gradients were displaced away from the stimulus associated with the lower rate of key-pecking. Another group of pigeons had similar training, except that a low rate of key-pecking was established in a stimulus with a much higher frequency of food reinforcement. In this case, the generalization gradients were not affected by the training on the schedule producing a low response rate.     

A further study of stimulus generalization following three-stimulus discrimination training

A group of pigeons was trained in a Skinner box to peck for VI reinforcement when the key was illuminated by a monochromatic light of 540 or 580 mμ but were non-reinforced for responding to 560 mμ. Two control groups, differing in amount of training, received only the two positive stimuli. At the completion of training all Ss received generalization tests under extinction. Both control groups produced bi-modal generalization gradients with the peaks of responding at the S+ values. The post-discrimination gradient revealed peaks displaced from the S+ values in the direction away from the S−, low responding and increased steepness in the region of S− and a general elevation of the gradient.     

Stimulus generalization of behavioral history: Interspecies generality and persistence of generalization gradients

Four pigeons were exposed to a tandem variable-interval (VI) fixed-ratio (FR) schedule in the presence of a 50-pixel (about 15 mm) square or an 80-pixel (about 24 mm) square and to a tandem VI differential-reinforcement-of-low-rate (DRL) schedule when a second 80-pixel or 50-pixel square was present. The values of the VI and FR schedules were adjusted to equate reinforcement rates in the two tandem schedules. Following this, a square-size continuum generalization test was administered under a fixed-interval (FI) schedule or extinction. In the first testing session, response frequency was a graded function of the similarity of the test stimuli to the training stimuli for all pigeons. These systematic generalization gradients persisted longer under the FI schedule than under extinction.     

Effects of variable-interval value and amount of training on stimulus generalization.

In Experiment 1 pigeons pecked a key that was illuminated with a 501-nm light and obtained food by doing so according to a variable-interval (VI) schedule of reinforcement, the mean value of which differed across groups: either 30 s, 120 s, or 240 s. The pigeons in all three groups were trained for 10 50-min sessions. Generalization testing was conducted in extinction with different wavelengths of light. Absolute and relative generalization gradients were similar in shape for the three groups. Experiment 2 was a systematic replication of Experiment 1 using line orientation as the stimulus dimension and a mean VI value of either 30 s or 240 s. Again, gradients of generalization were similar for the two groups. In Experiment 3 pigeons pecked a key that was illuminated with a 501-nm light and obtained food reinforcers according to either a VI 30-s or a 240-s schedule. Training continued until response rates stabilized (> 30 sessions). For subjects trained with the 30-s schedule, generalization gradients were virtually identical regardless of whether training was for 10 sessions (Experiment 1) or until response rates stabilized. For subjects trained with the VI 240-s schedule, absolute generalization gradients for subjects trained to stability were displaced upward relative to gradients for subjects trained for only 10 sessions (Experiment 1), and relative generalization gradients were slightly flatter. These results indicate that the shape of a generalization gradient does not necessarily depend on the rate of reinforcement during 10-session single-stimulus training but that the effects of prolonged training on stimulus generalization may be schedule dependent.     

Discrimination learning, the peak shift, and behavioral contrast

A discrimination between two successively alternating stimuli was trained under conditions that maintained equal frequencies of reinforcement in the presence of each of the discriminative stimuli (S1 and S2) but that also reduced the rate of responding to S2. These conditions included a multiple variable-interval differential-reinforcement-of-low-rate schedule and a multiple variable-interval variable-interval schedule in which responses to S2 were punished. Whenever the rate of responding to S2 was reduced, rate of responding to S1 (behavioral contrast) increased, and the peak of a subsequently obtained generalization gradient did not occur at the expected location (between S1 and S2) but was displaced away from S2, below S1. Discrimination training in which the frequencies of reinforcement earned in S1 and S2 were not equal (variable-interval 1-min variable-interval 5-min training) produced contrast and the peak shift only if the rate of responding to S2 had been reduced, as after non-differential reinforcement in which variable-interval 1-min schedules were correlated with S1 and with S2. It was concluded that a sufficient condition for the occurrence of behavioral contrast and the peak shift was reduction of the rate of responding to one of two alternating discriminative stimuli and that a peak shift will occur only if contrast had occurred during discrimination training.     

Contrast and stimulus generalization following prolonged discrimination training

Different groups of pigeons received discrimination training in which the reinforcement-associated and extinction-associated stimuli were respectively either (a) a line tilt vs a blank key, (b) a blank key vs a line tilt, or (c) two different line tilts. The high response rates that developed to the positive stimulus in all groups during discrimination learning were maintained over 64 sessions of training. After these sessions, all subjects were tested for stimulus generalization along the line-tilt dimension. Gradients of relative (per cent) generalization around the stimulus associated with reinforcement (so-called excitatory gradients) and around the stimulus associated with extinction (so-called inhibitory gradients) were as steep as they typically are after much briefer training periods. These results do not support several of Terrace's predictions on the basis of the hypothesis that emotional responses develop to the stimulus associated with extinction during discrimination learning with errors, but eventually dissipate after extended training.     

Contrast effects in maintained generalization gradients

In Experiment I, pigeons were given equal reinforcement (variable-interval 1-min) for responding during randomized presentations of eight line-orientation stimuli. Then, only responding in the vertical orientation was reinforced. Stable generalization gradients soon formed and persistent behavioral and local (transient) contrast effects appeared. Local contrast effects were not a function of relative reinforcement frequency or of any other variable known to produce contrast. Instead, they were related to average response rates associated with each stimulus. Experiment II showed that local contrast effects represent increases and decreases in response rates relative to baseline responding, and that these effects are relative; a given stimulus might enhance responding during a subsequent presentation of one stimulus, but depress responding when followed by another. These data indicate that discrimination learning is not adequately described as the acquisition of excitatory properties by some stimuli and inhibitory properties by others. A more adequate account implies that stimuli exert both excitatory and inhibitory effects related to their value.     

Stimulus duration as a measure of stimulus generalization

Four pigeons in the line-positive group were trained with a vertical line on a green background that signalled intermittent reinforcement while a plain green field signalled extinction. Four pigeons in the line-negative group were trained with the opposite discrimination. Response to a control key terminated any trial and initiated the next trial. The birds also used the control key during generalization tests to control the durations of trials in which various line orientations were presented. These durations were summed to provide generalization gradients of stimulus duration that were positive or negative in accordance with the trained discriminations. In Experiment 2, birds from the line-positive group were tested with a procedure in which the control key was not available on some trials. This provided an independent assessment of response rates to the test stimuli. These rates were used to predict the stimulus durations obtained when the control key was available. The findings supported a general model for the prediction of response distributions among concurrent stimuli from rates observed with single stimuli.     

Stimulus-specific contrast effects during operant discrimination learning

In two experiments, pigeons' responding was equally reinforced in the presence of four line-orientation stimuli. Responding was then reinforced when only two of the four orientation stimuli were present; the remaining two orientations appeared during extinction. Response rates were often highest in the stimulus adjacent to the orientations presented during extinction and often lowest in that orientation adjacent to the orientations presented with reinforcement. These effects were stronger and more persistent when the stimuli were separated by a smaller angle, rendering the discrimination more difficult. These and other data suggest that discrimination training may not be accurately explained in terms of the simple effects of reinforcement and nonreinforcement associated with isolated stimuli, nor by accounts that depend upon stimulus generalization. Recent accounts of contrast that depend upon “emotionality” produced by nonreinforced responding or upon reinforcement-elicited responses are also difficult to apply to these data.     

On Stimulus Generalization and Stimulus Classes

Stimulus generalization has been defined as the spread of effect of reinforcement for responses emitted in the presence of one stimulus to different stimuli presented under extinction conditions. As a result of stimulus generalization, novel stimuli come to exert stimulus control over members of the response class. Studies in the applied behavior analysis literature, however, have reported experimental preparations that included prompting and reinforcement procedures during what were claimed to be stimulus generalization conditions. These studies violated the procedural requirement that stimulus generalization be tested under extinction conditions. Responses that come under the control of a class of stimuli may do so by direct training or by stimulus generalization. It is desirable for organisms to respond in the presence of members of an appropriately constructed stimulus class, but we should understand the mechanism of entry into the class by its members. If inaccurate claims of stimulus generalization are made when training procedures are used in the ostensible generalization conditions, the robustness of the original training procedures will be over estimated. By adhering to the operational requirements of behavioral definitions, we could better understand the power and limits of our educational and training procedures.     

A comparison of different measures of response strength in the study of stimulus generalization

In Experiment 1, three pigeons were given variable interval training to peck at a light of 550 mmu and then were tested for stimulus generalization in extinction to several different wavelengths. A gradient was obtained for latency of the first response in each test period, for the number of test periods in which responding occurred, and for the measure of response rate. When the response rate gradient was corrected for differences in initial latency and in number of responded trials, the change was minimal, indicating that the major component of response rate as usually measured is rate of responding having once responded. In Experiment 2, three other pigeons were trained to respond to 550 mmu (for variable interval reinforcement) and not to 570 mmu (extinguished). Analysis of generalization gradients dictated the same conclusion as that reported for generalization following single stimulus training.     

Local contrast and maintained generalization.

Pigeons received variable-interval reinforcement for key pecking during presentations of horizontal and vertical line-orientation stimuli, while pecks during five intermediate orientations were extinguished. Lowest peck rates were observed during presentations of negative stimuli adjacent to the positive orientations while peck rate during 45 degrees (the intermediate negative orientation) was relatively high, i.e., there were negative contrast shoulders. When peck rates were manipulated in the positive orientations, peck rate in neithboring orientations changed in the opposite direction. Contrast shoulders faded after prolonged training. A second type of contrast, local contrast, was correlated with similarity of preceding stimulus and different average peck rates during different stages of the discrimination process. The data suggest that sequential local contrast accompanying the formation of a discrimination contributes to the form of generalization gradients. Blough's model of stimulus control predicts the changes in gradient form described here, but may not accurately depict the underlying process responsible for gradient form.     

Stimulus generalization along a light flicker rate continuum after discrimination training with several S−'s

Four pigeons were trained with VI reinforcement to peck a key which was briefly illuminated by a flickering light. Generalization gradients were then obtained with nine different rates of flicker, four faster than S+ and four slower. Two birds were then trained to discriminate between S+ and the fastest stimulus (S−). These birds were then trained to discriminate between S+ and the two fastest stimuli, alternated as S−'s. This procedure was continued, adding one new S− at a time, until all four stimuli faster than S+ were S−'s. The remaining two birds were trained on this latter discrimination without intervening training. In a final stage, using the first two birds, the slowest stimulus was added as a fifth S−. Generalization gradients in extinction were obtained from each bird after each stage of training. As more stimuli from one end of the continuum served as S−'s, responding increased in the presence of stimuli from the other end of the continuum, and the gradient tended to become flattened at this end.     

Maintained generalization testing of conditioned suppression

This study concerns the use of a multiple stimulus discrimination procedure for producing data on the generalization of conditioned suppression. Four rats were maintained on a variable interval schedule of milk reinforcement in the presence of five stimuli varying in auditory click rate. When response rates were stable, electric shock was regularly paired with the termination of one of the click stimuli. For two rats the shock was paired with the slowest click rate, and for two rats shock was paired with the fastest click rate. The VI schedule remained in effect. Plots of the relative rates of response to each of the five stimuli yielded concave gradients for both animals suppressed at the slowest click rate, and flat gradients with a sharp drop at the warning stimulus for both animals suppressed at the fastest click rate. When the warning stimuli were reversed for both pairs of subjects, both gradient forms were reproduced. The present procedure was contrasted with procedures used by other investigators.     

Interaction of frequency and magnitude of reinforcement on concurrent performances

Frequency and magnitude of reinforcement were varied in concurrent variable-interval variable-interval schedules of reinforcement. The relative response rate to the two stimuli did not support the notion that choice approximately matches relative total access to food (the product of frequency and magnitude of reinforcement in one schedule divided by the sum of products of frequency and magnitude in both schedules). Relative response rates matched relative reinforcement value when that measure was adjusted to give more emphasis to reinforcement frequency than to reinforcement duration.     

Category discrimination by pigeons using five polymorphous features

Eight pigeons were trained to discriminate between sets of color photographs of natural scenes. The scenes differed along five two-valued dimensions (site, weather, camera distance, camera orientation, and camera height), and all combinations of the feature values were used. One value of each dimension was designated as positive, and slides containing three or more positive feature values were members of the positive stimulus set. Thus, each feature had an equal, low, correlation with reinforcement, and all features had zero correlations with each other. Seven of the 8 pigeons learned this discrimination, and their responding came under the control of all five features. Within the positive and negative stimulus sets, response rates were higher to stimuli that contained more positive feature values. Once discrimination had been achieved, reversal training was given using a subset of the slides. In this subset, only a single feature was correlated with reinforcement. All pigeons learned this reversal successfully and generalized it to additional photographs with the same feature content. After reversal, the original reinforcement contingencies were reinstated, and training was continued using all the slides except those that had been used in reversal. Reversal generalized to these slides to some extent. Analysis of the response rates to individual slides showed that, compared with prereversal training, only the feature that had been subjected to reversal contingencies showed a reversed correlation with response rate. The remaining features showed the same correlation with response rate as they had before reversal training. Thus, reversal on some members of a category following category discrimination training led to generalization to stimuli within the category that were not involved in the reversal, but not to features that were not reversed. It is therefore inappropriate to refer to the pigeons as learning a concept.     

Appetitive and aversive olfactory learning induce similar generalization rates in the honey bee

Appetitive and aversive learning drive an animal toward or away from stimuli predicting reinforcement, respectively. The specificity of these memories may vary due to differences in cost–benefit relationships associated with appetitive and aversive contexts. As a consequence, generalization performances may differ after appetitive and aversive training. Here, we determined whether honey bees show different rates of olfactory generalization following appetitive olfactory conditioning of the proboscis extension response, or aversive olfactory conditioning of the sting extension response. In both cases, we performed differential conditioning, which improves discrimination learning between a reinforced odor (CS+) and a non-reinforced odor (CS?) and evaluated generalization to two novel odors whose similarity to the CS+ and the CS? was different. We show, given the same level of discriminatory performance, that rates of generalization are similar between the two conditioning protocols and discuss the possible causes for this phenomenon.     

Free-operant compounding of variable-interval and low-rate discriminative stimuli

Four rats were trained on a schedule containing stimuli associated with variable-interval 30-sec and differential-reinforcement-of-low-rate 20-sec schedules of reinforcement. Subsequently, a stimulus compounding test was administered that included individual presentations of two intensities of each stimulus plus compounds of these stimuli. In training, extremely high rates were emitted to the variable-interval stimulus, and very low rates to the differential-reinforcement-of-low-rate stimulus. Compounding the two training stimuli always produced an overall response rate intermediate between the rates controlled by the two stimuli separately presented. Essentially the same relationship held with different stimulus intensities. These results resolve the confounding of response and reinforcement variables present in previous conditioning studies reporting response averaging. They are discussed in terms of the incompatibility of the response chains associated with the individual stimuli compounded.