An investigation of peak shift and behavioral contrast for autoshaped and operant behavior.

Instrumental treadle press and nonreinforced key peck responses were monitored during discrimination training and generalization testing in pigeons on positive and negative reinforcement schedules. In Experiment 1, six pigeons pressed a treadle for food on a multiple variable-interval extinction schedule. In Experiment 2, three pigeons pressed a treadle to avoid shock on a multiple free-operant avoidance extinction schedule. Different color keylights signaled S+ and S- components. Some positive behavioral contrast occurred during discrimination training, but the effect was small. Pecking occurred to the S+ keylight in Experiment 1 but not in Experiment 2. On stimulus generalization tests, all subjects displayed a positive peak shift when pressing the treadle for food or to avoid shock. However, peak shift was not found for nonreinforced "autopecks" on the stimulus key, although an area shift was observed in Experiment 1. This is the first demonstration of peak shift for pigeons pressing treadles and the only reliable demonstration of peak shift when negative reinforcement maintained responding. These results, in combination with previous demonstrations of peak shift for rats pressing levers and pigeons pecking keys, indicate that peak shift is a general by-product of operant discrimination learning, since it occurs across a variety of the organisms, responses, and reinforcers.     

Inhibitory stimulus control following errorless discrimination learning

Three generalization procedures were used to investigate inhibitory stimulus control following discrimination learning with few errors. Three groups of pigeons acquired a discrimination between a green stimulus (the positive stimulus) and a vertical or horizontal line (the negative stimulus) through differential autoshaping followed by multiple schedule presentation of the two stimuli with gradually increasing stimulus durations. Genereralization testing was along a line-tilt continuum. For one group, the test involved a resistance-to-reinforcement procedure in which responses to all line tilts were reinforced on a variable-interval schedule. For a second group, also tested with the resistance-to-reinforcement procedure, the lines were superimposed on the green field that formerly served as the positive stimulus. A third group was tested in extinction with the combined stimuli. Control groups had no discrimination training but responding to green was nondifferentially reinforced. The control subjects responded more to all line tilts during testing than did the comparable experimental subjects, indicating that the negative stimulus had become an inhibitory stimulus. Both resistance-to-reinforcement groups revealed inhibitory gradients around the negative stimulus, but the gradient for the extinction group was relatively flat. These data are consistent with others that modify Terrace's early conclusion concerning the failure of inhibition to develop during errorless training.     

Generalization gradients following differential intradimensional autoshaping.

Three pigeons were trained on a differential, intradimensional autoshaped discrimination. A 45 degrees line tilt was always paired with food whereas a 15 degrees line tilt was never paired with food. All subjects learned the discrimination within 17 sessions. The pigeons were then given generalization tests in extinction over seven line tilts (0 degrees, 15 degrees, 30 degrees, 45 degrees, 60 degrees, 75 degrees and 90 degrees). The subjects yielded generalization gradients with maxima at 45 degrees and minima at 15 degrees. An area shift, but no peak shift, was found for each subject.     

Stimulus generalization, discrimination learning, and peak shift in horses.

Using horses, we investigated three aspects of the stimulus control of lever-pressing behavior: stimulus generalization, discrimination learning, and peak shift. Nine solid black circles, ranging in size from 0.5 in. to 4.5 in. (1.3 cm to 11.4 cm) served as stimuli. Each horse was shaped, using successive approximations, to press a rat lever with its lip in the presence of a positive stimulus, the 2.5-in. (6.4-cm) circle. Shaping proceeded quickly and was comparable to that of other laboratory organisms. After responding was maintained on a variable-interval 30-s schedule, stimulus generalization gradients were collected from 2 horses prior to discrimination training. During discrimination training, grain followed lever presses in the presence of a positive stimulus (a 2.5-in circle) and never followed lever presses in the presence of a negative stimulus (a 1.5-in. [3.8-cm] circle). Three horses met a criterion of zero responses to the negative stimulus in fewer than 15 sessions. Horses given stimulus generalization testing prior to discrimination training produced symmetrical gradients; horses given discrimination training prior to generalization testing produced asymmetrical gradients. The peak of these gradients shifted away from the negative stimulus. These results are consistent with discrimination, stimulus generalization, and peak-shift phenomena observed in other organisms.     

The effect of the blackout method on acquisition and generalization

In discrimination training with the Lyons' blackout method, pecks to the negative stimulus are prevented by darkening the chamber each time the subject approaches the negative stimulus. Stimulus generalization along a stimulus dimension was measured after training with this method. For comparison, generalization was also measured after reinforced responding to the positive stimulus without discrimination training, and after discrimination training by extinction of pecks to the negative stimulus. The blackout procedure and the extinction of pecks to the negative stimulus both produced a peak shift in the generalization gradients. The results suggest that after discrimination training in which the positive and negative stimulus are on the same continuum, the blackout method produces extinction-like effects on generalization tests.     

The effect of overtraining on behavioral contrast and the peak-shift

Following initial discrimination training between two wavelength stimuli and a subsequent generalization test to the wavelength dimension, Group 1 was “overtrained” for 105 days on the original discrimination. Group 2 was “overtrained” with the original positive stimulus and a new negative stimulus, a white line. Group 3 was “overtrained” with the original negative stimulus and a new positive stimulus, the white line. Each 15 days of extended training were followed by a wavelength generalization test similar to the first test. The results suggest that there is no consistent relationship between the response rate in positive stimulus immediately before the generalization test and whether or not a peak shift occurs during the test.     

On the form of stimulus generalization curves for visual intensity

Twelve pigeons were given successive discrimination training involving variable-interval reinforcement for key pecking in the presence of one intensity of monochromatic light randomly alternated with extinction for pecking during another intensity. All of the pigeons were then tested in extinction for generalization along the intensity dimension, and all showed a displacement of maximal responding from the positive stimulus in the direction opposite the negative stimulus. For six of the pigeons, for which the test included only three values beyond the positive stimulus, four showed peaked gradients but two did not, showing monotonic gradients with maximal responding to the most extreme test value. For another six pigeons tested over a wider range, all showed peaked gradients. Thus, when a sufficiently wide range of test values is employed, generalization gradients for visual intensity have the same peaked form as do gradients for qualitative visual dimensions such as wavelength or line angle.     

Effects of stimulus similarity in discrimination training upon wavelength generalization in pigeons.

Thirty pigeons were given variable interval training to peck a 555-nm. light and then were tested for wavelength generalization. The subjects were later assigned to 1 of 3 groups, matched for both relative generalization slope and response rate. One group then received successive discrimination training between the 555-nm. stimulus (S+) and a vertical white line on a 555-nm. background (S minus); another group experienced the same S+ but a vertical white line on a black background as S minus. A third group received a comparable amount of single stimulus training with the 555-nm. value. On a second wavelength generalization test, the first group yielded greater sharpening of generalization than the second group, whereas the third group showed no change from Test 1. These results indicate that the sharpening of generalization gradients by discrimination training is directly related to the similarity of the discrimination training stimuli.     

Generalization gradients of inhibition after different amounts of training

Five groups of pigeons received seven sessions of variable-interval reinforcement for pecking a blank white key, followed by either 1, 2, 4, 8, or 16 sessions of training on a successive discrimination in which the positive stimulus was the blank white key and the negative stimulus was a black vertical line on the white key. After training, a generalization test was administered along the line-tilt continuum. Relative gradients of inhibition became steeper with increased amounts of training, and reliably nonhorizontal absolute gradients were obtained only from groups of subjects with at least four days of training. Therefore, inhibitory stimulus control improves with added training. Several problems with the concept of “inhibition” are examined and some implications of the results for theoretical analyses of operant discrimination learning are discussed.     

Contrast and stimulus generalization following prolonged discrimination training

Different groups of pigeons received discrimination training in which the reinforcement-associated and extinction-associated stimuli were respectively either (a) a line tilt vs a blank key, (b) a blank key vs a line tilt, or (c) two different line tilts. The high response rates that developed to the positive stimulus in all groups during discrimination learning were maintained over 64 sessions of training. After these sessions, all subjects were tested for stimulus generalization along the line-tilt dimension. Gradients of relative (per cent) generalization around the stimulus associated with reinforcement (so-called excitatory gradients) and around the stimulus associated with extinction (so-called inhibitory gradients) were as steep as they typically are after much briefer training periods. These results do not support several of Terrace's predictions on the basis of the hypothesis that emotional responses develop to the stimulus associated with extinction during discrimination learning with errors, but eventually dissipate after extended training.     

The peak shift in stimulus generalization: equivalent effects of errors and noncontingent shock

Terrace suggested that the peak shift in stimulus generalization occurs because the training stimulus not correlated with reinforcement has become aversive. This hypothesis is plausible in the light of instances where the peak shift is obtained compared with those where it fails to appear. The present experiment attempted to test implications of this hypothesis. Two groups of pigeons learned the same two-stimulus discrimination between colors by different training methods in a free-operant situation. When the discrimination was trained with many errors, a large peak shift was obtained in a subsequent generalization test of wavelength; after discrimination training with few errors, a negligible shift was observed. Half of each group then received noncontingent aversive shock during presentations of the stimulus not correlated with reinforcement in continued discrimination training. After this treatment, the errorless-shock subgroup showed a large peak shift and the error-shock subgroup tended to show a larger shift than before. Nonshocked control groups showed little change in the peak shift. It was concluded that pairing aversive shock with a stimulus not correlated with reinforcement is sufficient to produce or enhance a peak shift. In their effect on the peak shift, aversive shock and large amounts of nonreinforced responding appear to be equivalent.     

Probability of reinforcement and the development of stimulus control

Pigeons were trained with a successive discrimination procedure in which responding during the negative stimulus was never reinforced and responding during the positive stimulus was reinforced according to one of four probability values. This discrimination training followed extensive training with a single, neutral stimulus and the same temporal distribution of reinforcements. The development of stimulus control was studied by tracing the difference in rate of responding between the positive and negative stimuli over the course of discrimination training. Response rate during the positive stimulus remained constant, while that during the negative stimulus decreased to zero. The probability of reinforcement associated with the positive stimulus affected both the total number of responses emitted during the negative stimulus and the number of negative stimulus presentations during which responding occurred. However, the number of reinforcements during the positive stimulus preceding the attainment of various degrees of stimulus control was similar for all probability values.     

Absolute and relative measures of dimensional contrast.

Two sets of experiments examined the discriminative performance of pigeons on a visual flicker-rate continuum using a maintained generalization procedure. In the first experiment, responses during the intermediate stimulus value were not reinforced, whereas responses during all other stimuli were reinforced periodically. In the second experiment, training was similar to the first, with the exception of one condition in which stimuli adjacent to the negative stimulus border were eliminated from the discrimination set. Results from both experiments show that positive dimensional contrast seems to represent a relative enhancement of discrimination gradient form, rather than an absolute increase in responding with respect to prior baseline. Further, the form and magnitude of positive dimensional contrast are not predictable from the form and magnitude of baseline response rates. Results from the second experiment indicate that eliminating border stimuli increased response-rate differences between positive and negative stimuli, but did not necessarily diminish the magnitude of positive dimensional contrast.     

Effects of extradimensional discrimination training upon previously acquired stimulus control

In Experiment 1, three groups of pigeons were taught to discriminate vertical lines (positive) from horizontal (negative). One group was then given true-discrimination training between two colors, a second group was equally reinforced for responding to the colors (pseudodiscrimination), while the third group was not run. The pseudodiscrimination group then provided a flatter gradient on the dimension of line orientation than either of the others, which did not differ. A second experiment demonstrated that this flattening effect could be completely counteracted when pseudodiscrimination was followed by true discrimination before the generalization test. The results are discussed within the framework of current research on attentional factors governing generalization gradients; pseudodiscrimination affects tests of stimulus control rather than its acquisition. When it intervenes between acquisition and testing, it appears to produce a “lapse” rather than a “loss” of the memory of the first-trained stimuli.     

Line-orientation generalization following signalled-reinforcer training

Three naive and three nonnaive pigeons key pecked for food on a multiple variable-interval 1-minute variable-interval 1-minute schedule with a black zero-degree vertical line on a white surround associated with one component and a black line shifted 30 degrees to the right (+30 degree) associated with the other component. Subsequently, a signalled-reinforcer procedure was introduced in the +30 degree component, i.e., whenever the reinforcer was available for the next response, the key changed to blank white. Following this training, the original unsignalled-reinforcer condition was re-instated. Line orientation generalization tests were given at the end of signalled-reinforcer training and after the second unsignalled-reinforcer condition. The signalled-reinforcer procedure reduced response rate in the +30-degree component in all subjects but facilitated responding during the zero-degree component (behavioral contrast) for two of the naive subjects only. However, average generalization gradients following signalled-reinforcer training indicated peak shift in two subjects and area shift in all five subjects that completed the experiment. There was no apparent relation between contrast and peak shift or degree of area shift. The data were interpreted as supporting the notion that the signalled-reinforcer procedure segments a variable-interval schedule into extinction and fixed ratio 1 segments.     

Stimulus control of differential-reinforcement-of-low-rate responding

Five pigeons were given single-stimulus training on an 8-sec differential-reinforcement-of-low-rate schedule followed by steady-state generalization training using 12 wavelength stimuli. Three birds had a high percentage of reinforced responses on the training schedule and flat generalization gradients of total responses. The birds with fewer reinforced responses had much steeper generalization gradients. Generalization gradients plotted as a function of both stimulus wavelength and interresponse time showed that for most birds, stimulus control was restricted to responses with long interresponse times. Responses with very short interresponse times were not under stimulus control and there was some evidence of inhibitory control of short interresponse times. Interresponse-times-per-opportunity functions, plotted as a function of stimulus wavelength, showed that stimulus wavelength controlled the temporal distribution of responses, rather than the overall rate of response. The data indicate that the differential-reinforcement-of-low-rate schedule generates several response categories that are controlled in different ways by wavelength and time-correlated stimuli, and that averaging responses regardless of interresponse-time length obscures this control.     

Errorless learning of a conditional temporal discrimination

In the present study we extended errorless learning to a conditional temporal discrimination. Pigeons' responses to a left-red key after a 2-s sample and to a right-green key after a 10-s sample were reinforced. There were two groups: One learned the discrimination through trial and error and the other through an errorless learning procedure. Then, both groups were presented with three types of tests. First, they were exposed to intermediate durations between 2 s and 10 s, and given a choice between both keys (stimulus generalization test). Second, a delay from 1 s to 16 s was included between the offset of the sample and the onset of the choice keys (delay test). Finally, pigeons learned a new discrimination in which the stimuli were switched (reversal test). Results showed that pigeons from the Errorless group made significantly fewer errors than those in the Trial-and-Error group. Both groups performed similarly during the stimulus generalization test and the reversal test, but results of the delay test suggested that, on long stimulus trials, responding in the errorless training group was less disrupted by delays.     

Transfer of serial reversal learning in the pigeon

Pigeons were trained on a series of reversals of a simultaneous visual discrimination and were then shifted to a second series of reversals with different visual discriminanda. Pigeons that were given discrimination reversals with one pair of colours (Group Colour) and then shifted to a second pair of colours made fewer errors with the second pair than the first. In contrast, pigeons that were initially given reversals with a pair of orientations (Group Orientation) and then shifted to colours made as many errors during colour reversals as Group Colour had during initial colour training. When birds in Group Colour were subsequently shifted to orientation discrimination reversals, they performed no better than Group Orientation had during initial orientation training. The present results suggest that positive transfer from one series of discrimination reversals to a second, independent series may be constrained by the nature of the stimulus shift.     

Transfer of training following discrimination learning with two reinforced responses

Pigeons were given errorless discrimination training between chromatic stimuli with a specific reinforced response associated with each discriminative stimulus. These Ss subsequently acquired a successive go/no-go auditory discrimination (utilizing one response class) faster than Ss given single stimulus training. These results are more compatible with an explanation of transfer of training in successive operant discrimination learning based on general attention than one based on withholding responses.     

Stimulus generalization following extra-dimensional training in educationally subnormal (severely) children.

The use of discrimination learning paradigms in the study of attentional transfer is discussed. The technique of go/no-go discrimination learning followed by stimulus generalization testing is contrasted with the more familiar simultaneous learning paradigm followed by a shift in the relevant cues. In the former paradigm the effect of training a discrimination on one dimension on the slope of the stimulus generalization gradient on an independent gradient dimension (extra-dimensional training) is assessed. A steepening of the gradient relative to appropriate control procedures is taken as evidence of positive attentional transfer. The relevance of the technique to the detailed study of attentional transfer in educationally subnormal (severely) (ESN(S)) children is considered. In Expt. I nine ESN(S) children were trained in a go/no-go discrimination involving stimuli differing in orientation, and were generalization tested on a dimension that was orthogonal, namely hue. Of the six subjects who learnt the discrimination five showed clear decremental gradients on the hue dimension. In contrast a Pseudo-Discrimination group (PD) of eight subjects matched to those in the TD group showed no gradients. These subjects were not trained in the orientation discrimination, but were reinforced for responding on 50 per cent of each of the S+ and S- stimulus presentations. They thus received equal exposure to, but no differential training on, the orientation dimension. An S+ only group of four subjects who received no exposure to the orientation stimuli showed no gradients when stimulus generalization testing on the hue continuum was carried out. The result is discussed in terms of transfer deriving from stimulus control by relational aspects of the stimuli; in terms of control by constant irrelevant stimuli; and in terms of the study of stimulus control in ESN(S) children. In Expt. II the influence of the codability of the colours on the location of the peak of the stimulus generalization gradients in the TD group is investigated.