Some effects of response-independent reinforcement on auditory generalization gradients.

Two groups of six rats received discrimination training with two auditory stimuli differing in intensity. During one stimulus, the schedule was variable interval; during the other, it was either variable time or extinction. Both the variable time and extinction schedules resulted in differential rates of responding in the presence of the two stimuli. Extinction resulted in an earlier and more stable difference. Stimulus generalization gradients obtained along the noise-intensity dimension revealed peak shift with both procedures. In addition, a secondary peak to stimuli in between the two training stimuli occurred with the variable-time schedule.     

Peak shift in concurrent schedules

Pigeons were exposed to two keys, a main key and a changeover key. Initially non-differential training was given in which pecking the main key was reinforced on a variable-interval 2-min schedule when the key displayed the first stimulus, a black line on a blue background, and was reinforced on an identical but independent variable-interval 2-min schedule when the key displayed a plain blue stimulus. Later, differential training was given in which pecking the main key was reinforced on a variable-interval 2-min schedule when the first stimulus was displayed; and was reinforced on a variable-interval 10-min schedule when a second stimulus, a black line of another orientation on a blue background, was displayed. During non-differential and differential training, each peck on the changeover key changed the stimulus on the main key. Generalization tests were given before and after the differential training. These consisted of presentations on the main key of seven orientations of the black line on the blue background, including the first and second stimuli, with no reinforcements being given. Changeover-key pecks changed the stimuli on the main key. Generalization gradients were obtained using three measures: time spent, responses, and response rate in the presence of each test stimulus. Typically, maximum values on these measures occurred to stimuli away from the first in a direction opposite the second stimulus, and minimum values occurred to stimuli away from the second in a direction opposite the first.     

A comparison of generalization functions and frame of reference effects in different training paradigms

Six experiments were carried out to compare go/no-go and choice paradigms for studying the effects of intradimensional discrimination training on subsequent measures of stimulus generalization in human subjects. Specifically, the purpose was to compare the two paradigms as means of investigating generalization gradient forms and frame of reference effects. In Experiment 1, the stimulus dimension was visual intensity (brightness); in Experiment 2, it was line orientation (line-angle stimuli). After learning to respond (or to respond “right”) to stimulus value (SV) 4 and not to respond (or to respond “left”) to SV2 (in Experiment 1) or SV1 (in Experiment 2), the subjects were tested for generalization (recognition) with an asymmetrical set of values ranging from SV1 to SV11. Go/no-go training produced peaked gradients, whereas choice training produced sigmoid gradients. The asymmetrical testing resulted in a gradual shift of the peak of responding (go/no-go group) or in the point of subjective indifference (PSI; choice group) toward. the central value of the test series; thus, both paradigms revealed a frame of reference effect. The results were comparable for the quantitative (intensity) and the qualitative (line-angle) stimulus dimensions. Experiment 3 compared the go/no-go procedure with a yes/no procedure in which subjects responded “right” to SV4 and “left” to all other intensities and found no differences between these procedures. Thus the difference in gradient forms in go/no as opposed to (traditional) choice paradigms depends on whether one or two target stimuli are used in training. In Experiment 4, in which visual intensity was used, the shift in the PSI following choice training varied positively with the range of asymmetrical test stimuli employed. In Experiment 5, also with visual intensity, the magnitude of the peak shift following go/no-go training varied as a function of over representing a high or a low stimulus value during generalization testing. Experiment 6, with line angles, showed that the PSI following choice training varies in a similar way. The frame of reference effects obtained in these experiments are consistent with an adaptation-level model.     

A comparison of generalization functions and frame of reference effects in different training paradigms.

Six experiments were carried out to compare go/no-go and choice paradigms for studying the effects of intradimensional discrimination training on subsequent measures of stimulus generalization in human subjects. Specifically, the purpose was to compare the two paradigms as means of investigating generalization gradient forms and frame of reference effects. In Experiment 1, the stimulus dimension was visual intensity (brightness); in Experiment 2, it was line orientation (line-angle stimuli). After learning to respond (or to respond "right") to stimulus value (SV) 4 and not to respond (or to respond "left") to SV2 (in Experiment 1) or SV1 (in Experiment 2), the subjects were tested for generalization (recognition) with an asymmetrical set of values ranging from SV1 to SV11. Go/no-go training produced peaked gradients, whereas choice training produced sigmoid gradients. The asymmetrical testing resulted in a gradual shift of the peak of responding (go/no-go group) or in the point of subjective indifference (PSI; choice group) toward the central value of the test series; thus, both paradigms revealed a frame of reference effect. The results were comparable for the quantitative (intensity) and the qualitative (line-angle) stimulus dimensions. Experiment 3 compared the go/no-go procedure with a yes/no procedure in which subjects responded "right" to SV4 and "left" to all other intensities and found no differences between these procedures. Thus the difference in gradient forms in go/no as opposed to (traditional) choice paradigms depends on whether one or two target stimuli are used in training. In Experiment 4, in which visual intensity was used, the shift in the PSI following choice training varied positively with the range of asymmetrical test stimuli employed. In Experiment 5, also with visual intensity, the magnitude of the peak shift following go/no-go training varied as a function of overrepresenting a high or a low stimulus value during generalization testing. Experiment 6, with line angles, showed that the PSI following choice training varies in a similar way. The frame of reference effects obtained in these experiments are consistent with an adaptation-level model.     

Reinforcer frequency and restricted stimulus control.

Stimulus control was evaluated in 3 individuals with moderate to severe mental retardation by delayed identity matching-to-sample procedures that presented either one or two discrete forms as sample stimuli on each trial. On pretests, accuracy scores on one-sample trials were uniformly high. On two-sample trials, the correct stimulus (i.e., the one that subsequently appeared in the comparison array) varied unpredictably, and accuracy scores were substantially lower, suggesting that both sample stimuli did not exert stimulus control on every trial. Subjects were then given training sessions with the one-sample task and with a new set of four stimuli. For two of the stimuli, correct matching responses were followed by reinforcers on a variable-ratio schedule that led to a high reinforcer rate. For the other two stimuli, correct responses were followed by reinforcers on a variable-ratio schedule that led to a substantially lower reinforcer rate. Results on two-sample tests that followed showed that (a) on trials in which comparison arrays consisted of one high reinforcer-rate and one low reinforcer-rate stimulus, subjects most often selected the high-rate stimulus; and (b) on trials in which the comparison arrays were either two high reinforcer-rate stimuli or two low reinforcer-rate stimuli and the samples were one high reinforcer- and one low reinforcer-rate stimulus, accuracy was higher on trials with the high-rate comparisons. These results indicate that the frequency of stimulus control by high reinforcer-rate samples was greater than that by low reinforcer-rate samples. Following more training with the one-sample task and reversed reinforcement schedules for all stimuli, the differences in stimulus control frequencies on two-sample tests also reversed. These results demonstrate experimental control by reinforcement contingencies of which of two sample stimuli controlled selections in the two-sample task. The procedures and results may prove to be relevant for understanding restricted stimulus control and stimulus overselectivity.     

Further evidence of a sensory-tonic interaction in pigeons

The five pigeons in Group 1 were given successive intradimensional discrimination training in which responses to a line of 49 degrees were reinforced on a variable-interval schedule and responses to a line of 33 degrees were not reinforced. Subsequent generalization testing with other line orientations revealed a peak shift from the positive stimulus in the direction away from the negative stimulus in all subjects. The four pigeons in Group 2 received successive discrimination training with the 49 degrees value on the key during both stimuli. During the negative stimulus, however, the floor was tilted 16 degrees counterclockwise. When tested (with the floor flat) these subjects showed peak shifts similar to those observed with Group 1. A third group of three pigeons, given successive interdimensional discrimination training with the 49 degrees line as the positive stimulus and the absence of the line as the negative, showed no peak shift in a subsequent generalization test. It was concluded that tilting the floor on which the pigeon stood systematically distorted the bird's visual perception of the orientation of the line in a manner consistent with the results of other studies in this laboratory.     

Transfer of matching performance in pigeons.

Three pigeons were given extensive training on three-key simultaneous matching problems using geometric-form and hue stimuli. After acquisition of matching, the birds were tested with pairs of stimuli involving one or both novel members. Matching during the test stimuli occurred less often than during the later stages of the acquisition phase, but more often than would occur if no transfer had taken place. Greater positive transfer was observed for problems that involved one, rather than two, novel stimuli. In the second phase of the experiment, previously trained birds were shifted to problems that required symbolic matching, i.e., the pigeons had to associate a particular center-key stimulus with a particular side-key stimulus. On each trial, one of two simuli was presented on the center key, and two other stimuli, different from those used on the center key, were displayed on the side keys. When the problem shift was introduced, correct responding was impaired, but remained considerably above chance level and quickly recovered in following sessions. The results were interpreted as favoring a stimulus-response-chaining account of matching behavior.     

Reinforcement of human observing behavior by a stimulue correlated with extinction or increased effort

Young men pulled a plunger on mixed and multiple schedules in which periods of variable-interval monetary reinforcement alternated irregularly with periods of extinction (Experiment 1), or in which reinforcement was contingent on different degrees of effort in the two alternating components (Experiment 2). In the baseline conditions, the pair of stimuli correlated with the schedule components could be obtained intermittently by pressing either of two observing keys. In the main conditions, pressing one of the keys continued to produce both discriminative stimuli as appropriate. Pressing the other key produced only the stimulus correlated with variable-interval reinforcement or reduced effort; presses on this key were ineffective during periods of extinction or increased effort. In both experiments, key presses producing both stimuli occurred at higher rates than key presses producing only one, demonstrating enhancement of observing behavior by a stimulus correlated with the less favorable of two contingencies. A control experiment showed that stimulus change alone was not an important factor in the maintenance of the behavior. These findings suggest that negative as well as positive stimuli may play a role in the conditioned reinforcement of human behavior.     

Some determinants of inhibitory stimulus control

Interspersed reinforcement and extinction during discrimination learning generate a U-shaped gradient of inhibition about the stimulus correlated with extinction. The present work showed that extinction is not a necessary determinant of inhibitory stimulus control. In Exp. I, a reduction in the rate of reinforcement, through a shift from a multiple variable-interval 1-min variable-interval 1-min schedule to a multiple variable-interval 1-min variable-interval 5-min schedule, resulted in a post-discrimination line orientation gradient of inhibition about the stimulus correlated with the variable-interval 5-min schedule. In Exp. II, the rates of reinforcement, correlated with a pair of stimuli, were held constant during a shift from a multiple variable-interval 1-min variable-interval 1-min schedule to a multiple variable-interval 1-min differential-reinforcement-of-low-rate schedule. Inhibitory stimulus control about the stimulus correlated with the differential reinforcement of low rate was obtained. In both experiments, a reduction in the rate of responding during one stimulus and behavioral contrast during the other stimulus preceded the observation of inhibitory stimulus control.     

Shifts in postdiscrimination gradients within a stimulus dimension based on bilateral facial symmetry

A shift in generalization gradients away from S+ and towards stimuli on the opposite end of the stimulus dimension from S- is a well established phenomenon in the laboratory, occurring with humans and nonhumans and with a wide range of stimuli. The phenomenon of gradient shifts has also been observed to have an analogous relationship to a variety of apparent biases in preference observed in the natural environment. One way to examine the validity of such analogies is by examining whether gradient shifts can be observed with complex and naturalistic stimuli. In the present experiment, undergraduates were trained to discriminate between faces that varied in terms of relative bilateral facial symmetry (a stimulus dimension correlated with health and attractiveness). Comparisons were made within subjects, using two sets of images. For both sets, the faces varied from naturally asymmetrical to symmetrical, and S+ was a face equidistant to the two extremes. With one set, S- was the naturally asymmetrical face, and with the other, S- was the symmetrical face. A peak shift was obtained in both conditions, although the effect was clearer in the aggregate than on the level of the individual. Overall, the results are consistent with the view that the processes responsible for gradient shifts in the lab are relevant to judgments made in the natural environment.     

Discriminative functions of schedule stimuli and memory: a combination of schedule and choice procedures

Pigeons responded under a combination brief-stimulus schedule and choice procedure. Normally, a fixed-interval schedule was in effect, where completion randomly produced either a brief stimulus or food. Intermittently, this schedule was interrupted by a choice arrangement. Two choice keys were lit, either a short or a long time since a prior event (food or stimulus). One choice response produced food if the time had been short, and the alternate response produced food if the time had been long. Across conditions, the duration of the fixed-interval schedule was varied, the stimuli that comprised the brief-stimulus operation were changed, and the stimuli were presented as paired and nonpaired with food. The focus of the study was the control of both schedule performance and choice responding across conditions. The results showed that choice accuracy was correlated with the degree of fixed-interval curvature, the response pattern of a pause followed by a gradually accelerated rate. As fixed-interval schedule duration was increased, both the degree of fixed-interval curvature and choice accuracy decreased. The particular brief stimulus used affected schedule and choice performance, with a more salient stimulus producing a greater degree of curvature and higher accuracy. Pairing and nonpairing operations produced striking differences in performance with the less salient brief stimulus, but not with the more salient stimulus. The results suggest that brief-stimulus schedule performance may be conceptualized in the context of memory research.     

An investigation of peak shift and behavioral contrast for autoshaped and operant behavior.

Instrumental treadle press and nonreinforced key peck responses were monitored during discrimination training and generalization testing in pigeons on positive and negative reinforcement schedules. In Experiment 1, six pigeons pressed a treadle for food on a multiple variable-interval extinction schedule. In Experiment 2, three pigeons pressed a treadle to avoid shock on a multiple free-operant avoidance extinction schedule. Different color keylights signaled S+ and S- components. Some positive behavioral contrast occurred during discrimination training, but the effect was small. Pecking occurred to the S+ keylight in Experiment 1 but not in Experiment 2. On stimulus generalization tests, all subjects displayed a positive peak shift when pressing the treadle for food or to avoid shock. However, peak shift was not found for nonreinforced "autopecks" on the stimulus key, although an area shift was observed in Experiment 1. This is the first demonstration of peak shift for pigeons pressing treadles and the only reliable demonstration of peak shift when negative reinforcement maintained responding. These results, in combination with previous demonstrations of peak shift for rats pressing levers and pigeons pecking keys, indicate that peak shift is a general by-product of operant discrimination learning, since it occurs across a variety of the organisms, responses, and reinforcers.     

A clarification of continuous repertoire development

The key-peck response of five pigeons was reinforced on a schedule whenever the interval between pecks at two response keys was between 1.0 and 2.33 seconds in the presence of a 2,500-Hertz tone or between 4.66 and 6.0 seconds in the presence of a 1250-Hertz tone. There was no tendency for responses of intermediate duration to occur when test tones of intermediate frequency were presented. This result clarifies a previous finding using a similar procedure but with a visual intensity stimulus dimension.     

Generalization of excitation and inhibition after different amounts of training of an avoidance baseline

After acquisition of a treadle-pressing response maintained by an avoidance contingency, four groups of pigeons received interdimensional discrimination training. For two groups, the positive stimulus was a 1000-Hertz tone correlated with the avoidance schedule and the negative stimulus was noise correlated with extinction. The discriminative stimuli were reversed for the other two groups. For two groups, the test stimuli were presented during extinction without any shocks during the test stimuli, for the other two groups, an unavoidable shock was presented during each test stimulus. Generalization was measured daily during discrimination training by randomly substituting each of six test frequencies for the 1000-Hertz tone. When the 1000-Hertz tone was correlated with the avoidance schedule, the number of responses to it increased and the excitatory gradient became steeper as a function of the amount of training. When the 1000-Hertz tone was associated with extinction, the number of responses to it decreased as a function of days of training and the inhibitory gradient became slightly steeper, provided that responding to the test stimulus was elevated by unavoidable shock. The training effects parallel those obtained with positive reinforcement.     

The effects of intradimensional and extradimensional shifts on visual discrimination learning in humans and non-human primates

Human subjects and non-human primates (the common marmoset) were trained on a series of reversals of both a simple (stimuli varying along one dimension) and compound (stimuli varying along two different dimensions) visual discrimination, using computer-generated stimuli. They were then shifted to a third series of reversals using completely novel compound stimuli. Those humans and marmosets for which the previously relevant dimension remained relevant, following the shift (shapes to shapes or lines to lines; intradimensional shift) made fewer errors than those for which the previously irrelevant dimension became relevant (shapes to lines or lines to shapes; extradimensional shift). These findings suggest that both humans and marmosets can learn to attend to the specific attributes or dimensions of a stimulus and use this information in visual discrimination learning.     

Stimulus generalization of schedule-induced polydipsia

Five rats were exposed to an intradimensional discrimination by associating two tones of different frequency with the components of a multiple random-time 30-sec, extinction schedule of food presentation. After schedule-induced polydipsia developed and the intermittent schedule of food presentation established stable differential licking rates during the stimuli associated with the multiple schedule, a stimulus generalization test was conducted. When generalization testing was conducted by presenting stimuli that varied on the frequency dimension during the random-time 30-sec component of the multiple schedule, all five rats demonstrated moderately sloping symmetrical gradients. Thus, schedule-induced polydipsia can be brought under the control of stimuli other than the food pellet.     

Stimulus control acquired by components of two color-form compound stimuli

Four pigeons were trained to respond on one of two keys in the presence of one color-form display, and on the other key when a second color-form display was present. Both responses were maintained on a 2-min variable-internal schedule of reinforcement. Subsequently, stimulus control acquired by components of the compound stimuli was determined by brief test probes in which the colors and forms separately, and in novel combinations, appeared on the display screen. When either color component was present, both choice of response key and response rate were like responding to the training compound display containing that color. When the forms were presented separate from the colors, generally low and comparable rates of responding occurred on both keys.     

Attention,instruction, and response representation

A two-dimensional Simon-type task was devised to investigate the impact of task requirements and explicit instructions on spatial action coding. Subjects performed actions that were defined on two spatial dimensions: horizontal (left-right) or vertical (top-bottom). The relevant stimulus feature was nonspatial but the stimuli varied on the horizontal and the vertical dimension, so that horizontal and vertical S-R compatibility effects could be measured separately. Implicit task requirements were manipulated by having the subjects perform an unrelated task before the Simon task—a task in which only one of the two spatial dimensions was relevant. Instructions were varied by describing the responses in the unrelated priming task and/or in the Simon task in spatial terms or by referring to nonspatial features of the response keys. Priming a particular dimension increased the Simon effect on that dimension, whereas instructions had no differential effect. These findings suggest that, first, drawing attention to a particular dimension leads to a stronger contribution to event representation of those features defined on that dimension (intentional weighting) and, second, that instructions do not affect action coding if the manipulation does not change the task goal.     

Effects of food-pellet size on rate,latency, and topography of autoshaped key pecks and gapes in pigeons.

Four pigeons responded under autoshaping contingencies in which different conditional stimuli (red or green keylights) were associated with unconditional stimuli of different magnitudes (large or small food pellets) over successive trials within a session. Both topography (beak opening or gape) and strength (rates and latencies of key pecks and gapes) of responding during the conditional stimuli depended on the magnitude of the correlated unconditional stimulus. Key-peck and gape rates were higher and latencies were shorter in large-pellet trials than in small-pellet trials. Gape amplitudes varied directly with pellet size, although conditional and unconditional gapes were larger than either pellet. These findings were replicated when the key colors were presented either on one or two keys and after reversals of the color-size correlations. Because the unconditional stimulus was varied through pellet size, magnitude was not confounded with food-access duration or quality. These results demonstrate the effects of the magnitude of the unconditional stimulus, in that rates and latencies of both key pecks (which are directed movements toward the key) and gapes (which are independent of the bird''s position and key properties) varied with pellet size. Gape measures were unique in that two dimensions (response strength and topography) of a single response class varied simultaneously with magnitude.