Generalization gradients of inhibition after different amounts of training

Five groups of pigeons received seven sessions of variable-interval reinforcement for pecking a blank white key, followed by either 1, 2, 4, 8, or 16 sessions of training on a successive discrimination in which the positive stimulus was the blank white key and the negative stimulus was a black vertical line on the white key. After training, a generalization test was administered along the line-tilt continuum. Relative gradients of inhibition became steeper with increased amounts of training, and reliably nonhorizontal absolute gradients were obtained only from groups of subjects with at least four days of training. Therefore, inhibitory stimulus control improves with added training. Several problems with the concept of “inhibition” are examined and some implications of the results for theoretical analyses of operant discrimination learning are discussed.     

Factors influencing inhibitory stimulus control: discrimination training and prior non-differential reinforcement

In Exp. I, shallow U-shaped gradients of inhibition in the line-orientation dimension were obtained from birds that had a vertical (0°) line on a green surround correlated with extinction and a blank green surround correlated with reinforcement. Birds that had massed extinction in the presence of the 0° line showed flat gradients. Thus, discrimination training, but not massed extinction, appears to generate inhibitory control. In Exp. II, as in studies of control by a stimulus correlated with punishment, non-differential training across the line-orientation dimension preceded further sessions. Steep inverted gradients about the 0° line were obtained after discrimination training with the 0° line correlated with extinction. Gradients obtained after massed extinction tended to be flat. Again, discrimination training was critical in obtaining negative gradients of stimulus control.     

Inhibitory stimulus control following errorless discrimination learning

Three generalization procedures were used to investigate inhibitory stimulus control following discrimination learning with few errors. Three groups of pigeons acquired a discrimination between a green stimulus (the positive stimulus) and a vertical or horizontal line (the negative stimulus) through differential autoshaping followed by multiple schedule presentation of the two stimuli with gradually increasing stimulus durations. Genereralization testing was along a line-tilt continuum. For one group, the test involved a resistance-to-reinforcement procedure in which responses to all line tilts were reinforced on a variable-interval schedule. For a second group, also tested with the resistance-to-reinforcement procedure, the lines were superimposed on the green field that formerly served as the positive stimulus. A third group was tested in extinction with the combined stimuli. Control groups had no discrimination training but responding to green was nondifferentially reinforced. The control subjects responded more to all line tilts during testing than did the comparable experimental subjects, indicating that the negative stimulus had become an inhibitory stimulus. Both resistance-to-reinforcement groups revealed inhibitory gradients around the negative stimulus, but the gradient for the extinction group was relatively flat. These data are consistent with others that modify Terrace's early conclusion concerning the failure of inhibition to develop during errorless training.     

Generalization gradients following differential intradimensional autoshaping.

Three pigeons were trained on a differential, intradimensional autoshaped discrimination. A 45 degrees line tilt was always paired with food whereas a 15 degrees line tilt was never paired with food. All subjects learned the discrimination within 17 sessions. The pigeons were then given generalization tests in extinction over seven line tilts (0 degrees, 15 degrees, 30 degrees, 45 degrees, 60 degrees, 75 degrees and 90 degrees). The subjects yielded generalization gradients with maxima at 45 degrees and minima at 15 degrees. An area shift, but no peak shift, was found for each subject.     

Effects of variable-interval value and amount of training on stimulus generalization.

In Experiment 1 pigeons pecked a key that was illuminated with a 501-nm light and obtained food by doing so according to a variable-interval (VI) schedule of reinforcement, the mean value of which differed across groups: either 30 s, 120 s, or 240 s. The pigeons in all three groups were trained for 10 50-min sessions. Generalization testing was conducted in extinction with different wavelengths of light. Absolute and relative generalization gradients were similar in shape for the three groups. Experiment 2 was a systematic replication of Experiment 1 using line orientation as the stimulus dimension and a mean VI value of either 30 s or 240 s. Again, gradients of generalization were similar for the two groups. In Experiment 3 pigeons pecked a key that was illuminated with a 501-nm light and obtained food reinforcers according to either a VI 30-s or a 240-s schedule. Training continued until response rates stabilized (> 30 sessions). For subjects trained with the 30-s schedule, generalization gradients were virtually identical regardless of whether training was for 10 sessions (Experiment 1) or until response rates stabilized. For subjects trained with the VI 240-s schedule, absolute generalization gradients for subjects trained to stability were displaced upward relative to gradients for subjects trained for only 10 sessions (Experiment 1), and relative generalization gradients were slightly flatter. These results indicate that the shape of a generalization gradient does not necessarily depend on the rate of reinforcement during 10-session single-stimulus training but that the effects of prolonged training on stimulus generalization may be schedule dependent.     

Stimulus generalization, discrimination learning, and peak shift in horses.

Using horses, we investigated three aspects of the stimulus control of lever-pressing behavior: stimulus generalization, discrimination learning, and peak shift. Nine solid black circles, ranging in size from 0.5 in. to 4.5 in. (1.3 cm to 11.4 cm) served as stimuli. Each horse was shaped, using successive approximations, to press a rat lever with its lip in the presence of a positive stimulus, the 2.5-in. (6.4-cm) circle. Shaping proceeded quickly and was comparable to that of other laboratory organisms. After responding was maintained on a variable-interval 30-s schedule, stimulus generalization gradients were collected from 2 horses prior to discrimination training. During discrimination training, grain followed lever presses in the presence of a positive stimulus (a 2.5-in circle) and never followed lever presses in the presence of a negative stimulus (a 1.5-in. [3.8-cm] circle). Three horses met a criterion of zero responses to the negative stimulus in fewer than 15 sessions. Horses given stimulus generalization testing prior to discrimination training produced symmetrical gradients; horses given discrimination training prior to generalization testing produced asymmetrical gradients. The peak of these gradients shifted away from the negative stimulus. These results are consistent with discrimination, stimulus generalization, and peak-shift phenomena observed in other organisms.     

Stimulus control and delayed reinforcement

Pigeons were tested for generalization along the line-orientation dimension, after being trained on various two-component multiple schedules. The first component contained either a variable-interval 1-min schedule of immediate reinforcement or an extinction schedule and was associated with a plain white key (S1). The second component contained a variable-interval 1-min schedule of delayed reinforcement and was associated with a black line on a white background (S2). The major results showed that (a) decremental gradients were obtained around the stimulus associated with the delayed reinforcement component when S1 was associated with extinction, but that incremental gradients were obtained when S1 was associated with immediate reinforcement, (b) the subjects' pretraining did not affect the generalization gradients if sufficient training on the terminal multiple schedule was provided, and (c) changing the S1 schedule from immediate reinforcement to extinction produced behavioral contrast if reinforcement was delayed for 10 sec during S2, but not if it was delayed for 20 sec.     

Discriminative effects of massed extincttion

Prior studies have reported that generalization gradients are not steepened if periods of non-reinforcement in S− follow and are not interspersed with periods of reinforcement in S+. Sharper gradients are produced by this massed-extinction procedure if it is preceded by prior discriminative training on a dimension orthogonal to the S+, S− dimension. The present study, using pigeons, found that generalization gradients along the wavelength dimension were steepened by massed-extinction sessions in 570 nm that had been preceded by: (1) discriminative training in which the S+ was a 550-nm light and the S− was a black vertical line superimposed on the 550-nm light; (2) non-differential reinforcement training with a 550-nm light and a black vertical line superimposed on the 550-nm light; (3) reinforcement training with only the 550-nm light. Massed-extinction sessions were administered until the response rate in the presence of the 570-nm stimulus was one-tenth of the mean response rate in the presence of the 550-nm stimulus during prior reinforcement training. Prior studies have used a time-dependent criterion, rather than a response-rate criterion of extinction, and this difference may be responsible for the differences in the effects of massed extinction on stimulus control.     

On the form of stimulus generalization curves for visual intensity

Twelve pigeons were given successive discrimination training involving variable-interval reinforcement for key pecking in the presence of one intensity of monochromatic light randomly alternated with extinction for pecking during another intensity. All of the pigeons were then tested in extinction for generalization along the intensity dimension, and all showed a displacement of maximal responding from the positive stimulus in the direction opposite the negative stimulus. For six of the pigeons, for which the test included only three values beyond the positive stimulus, four showed peaked gradients but two did not, showing monotonic gradients with maximal responding to the most extreme test value. For another six pigeons tested over a wider range, all showed peaked gradients. Thus, when a sufficiently wide range of test values is employed, generalization gradients for visual intensity have the same peaked form as do gradients for qualitative visual dimensions such as wavelength or line angle.     

The effect of the blackout method on acquisition and generalization

In discrimination training with the Lyons' blackout method, pecks to the negative stimulus are prevented by darkening the chamber each time the subject approaches the negative stimulus. Stimulus generalization along a stimulus dimension was measured after training with this method. For comparison, generalization was also measured after reinforced responding to the positive stimulus without discrimination training, and after discrimination training by extinction of pecks to the negative stimulus. The blackout procedure and the extinction of pecks to the negative stimulus both produced a peak shift in the generalization gradients. The results suggest that after discrimination training in which the positive and negative stimulus are on the same continuum, the blackout method produces extinction-like effects on generalization tests.     

Generalization and discrimination of shape orientation in the pigeon

Pigeons learned to peck a green key on which parallelogram-shapes were projected; they then received generalization tests in which the orientation of the parallelogram was varied. Nondifferential training produced very little eventual stimulus control along the orientation dimension, but when training included S- trials (absence of the parallelogram) subjects responded consistently more to certain orientations than to others. Unlike typical results for visual generalization (e.g., line-tilt), the tilt gradients obtained for this complex stimulus were bimodal, supporting predictions on the basis of human perceptual data. However, unimodal gradients could be produced by specific discrimination training along the orientation dimension. Other forms of intradimensional training also produced relatively steep gradients, often characterized by unexpected but consistent secondary peaks. An attempt to obtain inhibitory gradients (S+: green key; S-: parallelogram on a green background) resulted in virtually zero responding all along the shape-orientation dimension; therefore, specific inhibitory control could not be evaluated. All these experiments suggest that definition of this complex stimulus dimension in terms of mere "angular orientation" is inappropriate, and alternative interpretations are discussed.     

Behavioral contrast and inhibitory stimulus control as related to extended training

Pigeons received discrimination training in which the presence of a white field was correlated with variable-interval reinforcement and the presence of a monochromatic field was correlated with extinction. Responses during the negative stimulus prolonged its duration. Five experimental groups each received a different number of discrimination sessions up to 70 sessions. The last session was followed by a wavelength generalization test. The control group was tested both before and after four discrimination sessions. Responding to the positive training stimulus was enhanced in all groups by the discrimination procedures. This enhancement tended to decrease over sessions in some animals but it never disappeared in others. Responding to the test stimuli preceding discrimination training was minimal around the negative stimulus and increased in either direction away from that wavelength. Responding to the test stimuli was not systematically related to the amount of discrimination training.     

Discrimination of a response-independent component in a multiple schedule

Pigeons were trained to respond in non-differential reinforcement pre-discrimination training, with a multiple variable-interval 1-min variable-interval 1-min schedule. Each bird then received discrimination training with a multiple variable-interval 1-min variable-time 1-min schedule. Thus, discrimination training was between response-dependent (variable-interval) and response-independent (variable-time) schedules with the rate of reinforcement equated. In Experiment I, only three sessions of non-differential reinforcement preceded discrimination training and for half the birds, a 0° line was correlated with the response-dependent schedule; for the remaining birds the 0° line was correlated with the response-independent schedule. Post-discrimination gradients of excitatory stimulus control were obtained from the former group, while the latter group showed little evidence of post-discrimination stimulus control by the 0° line. Differential responding to the variable-time schedule was not accompanied by behavioral contrast to the variable-interval schedule. In Experiment II, 20 sessions of non-differential reinforcement preceded discrimination training and the 0° line was correlated with variable-time reinforcement for each bird. Differential responding to the 0° line was accompanied by negative induction to the variable-interval schedule and by inhibitory stimulus control about the 0° line during a post-discrimination generalization test.     

Line-orientation generalization following signalled-reinforcer training

Three naive and three nonnaive pigeons key pecked for food on a multiple variable-interval 1-minute variable-interval 1-minute schedule with a black zero-degree vertical line on a white surround associated with one component and a black line shifted 30 degrees to the right (+30 degree) associated with the other component. Subsequently, a signalled-reinforcer procedure was introduced in the +30 degree component, i.e., whenever the reinforcer was available for the next response, the key changed to blank white. Following this training, the original unsignalled-reinforcer condition was re-instated. Line orientation generalization tests were given at the end of signalled-reinforcer training and after the second unsignalled-reinforcer condition. The signalled-reinforcer procedure reduced response rate in the +30-degree component in all subjects but facilitated responding during the zero-degree component (behavioral contrast) for two of the naive subjects only. However, average generalization gradients following signalled-reinforcer training indicated peak shift in two subjects and area shift in all five subjects that completed the experiment. There was no apparent relation between contrast and peak shift or degree of area shift. The data were interpreted as supporting the notion that the signalled-reinforcer procedure segments a variable-interval schedule into extinction and fixed ratio 1 segments.     

Stimulus generalization following extra-dimensional training in educationally subnormal (severely) children.

The use of discrimination learning paradigms in the study of attentional transfer is discussed. The technique of go/no-go discrimination learning followed by stimulus generalization testing is contrasted with the more familiar simultaneous learning paradigm followed by a shift in the relevant cues. In the former paradigm the effect of training a discrimination on one dimension on the slope of the stimulus generalization gradient on an independent gradient dimension (extra-dimensional training) is assessed. A steepening of the gradient relative to appropriate control procedures is taken as evidence of positive attentional transfer. The relevance of the technique to the detailed study of attentional transfer in educationally subnormal (severely) (ESN(S)) children is considered. In Expt. I nine ESN(S) children were trained in a go/no-go discrimination involving stimuli differing in orientation, and were generalization tested on a dimension that was orthogonal, namely hue. Of the six subjects who learnt the discrimination five showed clear decremental gradients on the hue dimension. In contrast a Pseudo-Discrimination group (PD) of eight subjects matched to those in the TD group showed no gradients. These subjects were not trained in the orientation discrimination, but were reinforced for responding on 50 per cent of each of the S+ and S- stimulus presentations. They thus received equal exposure to, but no differential training on, the orientation dimension. An S+ only group of four subjects who received no exposure to the orientation stimuli showed no gradients when stimulus generalization testing on the hue continuum was carried out. The result is discussed in terms of transfer deriving from stimulus control by relational aspects of the stimuli; in terms of control by constant irrelevant stimuli; and in terms of the study of stimulus control in ESN(S) children. In Expt. II the influence of the codability of the colours on the location of the peak of the stimulus generalization gradients in the TD group is investigated.     

Generalization during acquisition, extinction, and transfer of matching with an adjustable comparison

Three groups of pigeons were given conditional discrimination training in which the number of standard stimuli was varied across groups. In the presence of each standard, a pigeon adjusted the comparison stimulus on a second key until the two keys matched. A report of this match (response on the first key) was reinforced. Transfer of the matching performance was investigated by adding new standards to the ones already available. All pigeons were exposed to two extinction sessions after 155 sessions of training. Rapidity of acquisition was inversely related to the number of standards presented. Generalization gradients derived from the several comparison stimuli showed that all pigeons reached a high level of accuracy in the presence of at least one standard, and some pigeons did so in the presence of as many as four of the six standards. There was no evidence of a systematic effect of extinction upon overall accuracy, or the individual generalization gradients. When a new standard was added, a given pigeon's performance (in terms of responding to the comparisons) was similar to performance in the presence of one of the old standards. However, the pigeons did not show evidence of confusion among the comparisons.     

The effectiveness of fading in programming a simultaneous form discrimination for retarded children

A non-verbal teaching program, combined with reinforcement and extinction (Program Group), was compared with reinforcement and extinction alone (Test Group) in teaching retarded children to discriminate circles from ellipses. In the Program Group, fading techniques were used to transfer stimulus control from “bright vs. dark” to “form vs. no-form” and then to “circle vs. ellipse”. The Test Group had the task of learning the circle-ellipse discrimination with no prior teaching program. With the program, seven of 10 children learned the circle-ellipse discrimination. Without the program, one of nine learned. The eight Test-Group children who failed to learn circle vs. ellipse were then given the opportunity to learn the form no-form discrimination by reinforcement and extinction alone, without fading. Six of the eight learned, but only three of these six then learned circle vs. ellipse on a second test. All seven Program-Group children who had learned form vs. no-form also learned the circle-ellipse discrimination by means of fading; each of the seven made fewer errors than any of the three who succeeded on the second test. Children who failed to learn circle vs. ellipse adopted response patterns incompatible with the development of appropriate stimulus control.     

Stimulus selection with duration as a relevant cue

To date, research has not explicitly examined how duration competes with other stimulus dimensions for control over responding. The present study investigated some familiar selective mechanisms of stimulus control over key pecking in pigeons, with duration and line tilt as discriminative stimuli in successive discrimination procedures. Specifically, pigeon's key pecking was reinforced with food or extinguished following compound stimuli comprising one of two line orientation stimuli presented for one of two different durations. Traditional experimental designs explored stimulus additivity, overshadowing, blocking, and learned irrelevance. Although stimulus additivity was observed, control by duration was masked by line tilt in extinction testing that followed facilitated acquisition with redundant, relevant cues. In addition, although prior training with duration relevant partially blocked subsequent acquisition of control by line tilt when both stimulus dimensions were relevant, there was a tendency for control by duration to decrease with continued compound training. It was suggested that the greater time required to distinguish duration on a trial—compared to more commonly studied stimulus dimensions, which can be distinguished almost immediately—puts duration at a competitive disadvantage in situations where other relevant dimensions are also available.     

The course of acquisition of a line-tilt discrimination by rhesus monkeys

Each of four groups of monkeys were trained on a different simultaneous discrimination procedure involving a vertical line as the correct choice. Each group, after acquiring the discrimination, was tested for generalization along the dimension of line tilt. Monkeys that learned to select the vertical line when the alternative choices were distinguished from the correct choice by two aspects (brightness and absence of line) showed almost complete tilt generalization (flat gradient). Monkeys that learned to select the line when the alternatives were distinguished only by the absence of the line showed poor tilt discrimination (generalization gradient slightly peaked at vertical). Monkeys developed a good tilt discrimination when nonvertical lines were gradually introduced by progressively darkening them on the previously blank alternatives. Monkeys developed a tilt discrimination with the lowest error rate when only horizontal alternatives were gradually introduced and then pairs of alternatives progressively closer to vertical were made available.     

Wavelength generalization and discrimination in the pigeon

This three-part study describes wavelength generalization gradients around a series of training wavelengths ranging from 480 to 645 om. Luminance was controlled for the pigeon’s spectral sensitivity. The response measure was probability of keypecking during a 2-sec stimulus presentation. Both an extinction procedure, where stimulus wavelengths occurred in 15-nm steps, and a maintained discrimination procedure, where step size was 2 to 4 nm, were used to obtain gradients. During a portion of the maintained discrimination procedure, new luminances were introduced, so that the effect of luminance level on gradient slope could be examined. Comparison of the resulting functions across training wavelengths revealed: (1) consistent differences in gradient slope in different spectral regions and (2) an increase in slope with luminance increase. The findings are related to recent electroretinographic wavelength contrast data and to psychophysical measures of wavelength discriminability.