Stimulus generalization and discrimination along the click-frequency (flutter) continuum in pigeons

Before tests for click-frequency generalization, pigeons had been reinforced for keypecks during one click frequency (S+). Some Ss received S+ training only, whereas other Ss also received unreinforced (S?) trials, during which the clicks were either absent (Experiments 1-3) or presented at some other frequency (faster or slower than S+: Experiment 4). When training included S+ trials only, birds responded approximately equally to all generalization test frequencies (0.0 to 53.5 pulses/sec, pps). Most Ss that had received both S+ and S? training trials responded fastest not during S+ but during click frequencies even further away from S? along the click-frequency dimension (peak shift). Complex bimodal gradients were obtained after training with S+ (1.6 pps) vs S? (0.0 pps); maximal responding generally occurred near S+ and at approximately 14.2 pps. Among other factors, the “nonorthogonality” of click absence (0.0 pps) to the click dimension seems crucially involved in producing these complex effects.     

Successive negative contrast in one-way avoidance learning in rats

In three experiments, successive negative contrast was examined in one-way avoidance learning. Reward magnitude in first (pre-shift) and second (post-shift) phases was manipulated by time spent in the safe compartment. Experiment 1 demonstrated that when time in the danger compartment was held constant, a group shifted from a large reward--30 sec spent in the safe compartment--to a small reward--1 sec--showed poor performance and longer response latency than a group conditioned with the small reward in both phases. Experiment 2 replicated this effect with a less intense shock and also demonstrated that a group shifted from large to small reward performed more poorly than a group exposed to large reward--30 sec--in both phases. Finally, Experiment 3 showed that changes in intertrial interval, defined as total time spent in the safe compartment and the danger compartment before the onset of the warning signal, were not responsible for this contrast effect. These results suggest that time spent in a safe place can act as appetitive incentive during one-way avoidance learning.     

Stimulus control of avoidance behavior

The introduction of a warning signal preceding shocks greatly increased the effectiveness of avoidance responding. Periods of “warm-up” at the beginning of the session were eliminated, and the number of shocks received by the subjects was greatly reduced. With response-shock interval constant, response rate increased as the interval between the response and the onset of the warning signal was shortened. The response tended to occur shortly after the onset of the warning signal regardless of the duration of these “safe” periods. A greatly elevated response rate was maintained even when the duration of the safe period was reduced to 0.3 sec. Thus, the pre-shock signal obtained nearly exclusive control of the responding and overrode the usual “temporal discrimination” of the response-shock interval.     

Incentive processes and the peak shift

Intradimensional operant discrimination schedules were employed, which eliminated the covariation of response and reinforcement rates that are found on most operant baselines. In Phase 1, one keylight (S(1)) controlled an increase in pigeons' treadle pressing, relative to another keylight (S(2)), while being correlated with a decrease in frequency of reinforcement. In Phase 2 both treadle pressing and reinforcement increased in the presence of one keylight, relative to the second. In Phase 1 the relatively flat treadle-press generalization gradients peaked at S(1), whereas the peaks of those in Phase 2 were shifted from S(1) in a direction away from S(2). It was postulated that these positive and negative stimulus-reinforcement contingencies influence the likelihood of obtaining peak shift through the operation of a classically conditioned "central motive state." How response-reinforcement and stimulus-reinforcement contingencies might contribute to the development of inhibitory effects of S(2) is discussed. Autoshaped key pecking also was produced by these procedures. During manipulations of stimuli, the gradients obtained for autoshaped key pecking were narrow and sharply peaked at the food-correlated stimulus (S(2)) in Phase 1. This failure to obtain peak shift for an elicited response suggests a difference in discriminative processes operating in classical and instrumental learning.     

Some effects of methylphenidate on stimulus control of ratio avoidance behavior in the rat

After exposure to an avoidance schedule which included a warning signal, a rat was placed on a multiple schedule in which the first component was the same as before, i.e., a single response reset the response-shock interval, delaying shock, and the second component differed only in that four bar-presses were required to postpone shock. A fixed ratio requirement of four responses (FR 4) generated behavior resembling a fixed ratio requirement of one response (FR 1) since responding was controlled by the warning signal but more shocks were received. At a dosage of 2 mg/kg, methylphenidate given intraperitoneally decreased shock frequency during FR 4 periods while FR 1 behavior was not affected; at 4 mg/kg, stimulus control of avoidance responding was impaired during both components. Results at 4 mg/kg were partially confirmed by two animals exposed to an FR 4 avoidance schedule which included a warning signal but with different parameters. Response distributions showed that methylphenidate increased response rates in the absence of the warning signal, i.e., stimulus control of ratio-avoidance behavior was impaired although the increased response rates reduced shock frequency. One hour later responses again occurred more frequently during the signal than in its absence but shocks were less frequent than during control (non-drug) periods.     

A peak shift on a line-tilt continuum

Pigeons were trained to discriminate the presence or absence of a vertical line, and their performance on a subsequent generalization test was compared with that of other pigeons trained to discriminate a vertical from a 45° line. On the generalization gradient after discrimination training, the presence/absence discrimination group showed a peak at 0° (vertical) while the peak for the 0°/45° discrimination group shifted from 0° in a direction away from the 45° line. The results, discussed in connection with a recent suggestion about the role of color in the peak-shift effect, are interpreted as supporting the generality of the phenomenon.     

Behavioral contrast during multiple avoidance schedules

Changes were observed in the rate of avoidance responding in both components of a multiple schedule of Sidman-avoidance after the shock frequency was changed in only one component. The rate change in each component was positively correlated, in direction and magnitude, with the change in the relative rate of reinforcement (percentage of total shocks) in that component.     

ASSESSING THE ROLE OF EFFORT REDUCTION IN THE REINFORCING EFFICACY OF TIMEOUT FROM AVOIDANCE

Rats responded on concurrent schedules of shock‐postponement or deletion (avoidance) and timeout from avoidance. In Experiment 1, 3 rats' responses on one lever postponed shocks for 20 s and responses on a second lever produced a 1‐min timeout according to a variable‐interval 45‐s schedule. Across conditions, a warning signal (white noise) was presented 19.5 s, 16 s, 12 s, 8 s, or 4 s before an impending shock. Raising the duration of the warning signal increased both avoidance and timeout response rates. Timeout responding, although positively correlated with avoidance responding, was not correlated with the prevailing shock rate. In Experiment 2, 3 rats' responses on one lever deleted scheduled shocks according to a variable‐cycle 30‐s schedule and responses on a second lever produced a 2‐min timeout as described above. After this baseline condition, the avoidance lever was removed and noncontingent shocks were delivered at intervals yoked to the receipt of shocks in the baseline sessions. Timeout responding decreased when the avoidance lever was removed, even though the shock‐frequency reduction afforded by the timeout remained constant. These results suggest that a key factor in the reinforcing efficacy of timeout is suspension of the requirement to work to avoid shock, rather than the reduction in shock frequency associated with timeout.     

Stimulus generalization of gravity

In two experiments, squirrel monkeys were exposed to centrifugally generated, artificial gravity and trained to respond for food reinforcement at selected gravity (g) levels. Experiment I involved a single g value; in Exp. II, subjects were trained to discriminate among two or three g values. After training, generalization tests were administered over a 1.1-g to 2.1-g range. The major findings were as follows: (a) single-stimulus training yielded a linear relationship between percentage of responding and magnitude of gravity. (b) Two-valued discrimination training produced gradient peaks which were shifted from S(D) in a direction away from S(Delta). This effect was cancelled when S(D) was located equidistant between two S(Delta) stimuli. (c) Gradient form was independent of the S(D)-S(Delta) difference, but related to continuum location and/or intensity of discriminative stimuli.     

Peak shift as a function of multiple schedules of reinforcement

Pigeons were trained to respond to two stimuli on the wavelength continuum, 550 nm and 570 nm, each correlated with an independent schedule of reinforcement. The multiple schedule component in effect during 550 nm (S1) was always a variable-interval 1-min. During the 570-nm stimulus (S2) the second component of the schedule was either variable-interval 30-sec, 1-min, 2-min, 5-min, or extinction for different groups of birds. Generalization gradients were obtained after this training, with the following results: (1) response rate to S1 during training was related to the reinforcement frequency associated with S2; the distribution of responding during generalization testing was a function of the schedules of reinforcement used during training and the response rates they produced. Decreases in the relative frequency of reinforcement correlated with S2 resulted in increases in the distribution shift of responses away from S2 during generalization testing.     

Contrast and induction in multiple schedules of discrete-trial concurrent reinforcement

Three pigeons were exposed to two-key discrete-trial concurrent schedules of reinforcement. Red and white key colors alternated irregularly and the assignment of reinforcers depended on key color. The red-key schedules were held constant, with the scheduled relative frequency of reinforcement for left-key pecks set at 0.75, while the white-key schedules varied. When the location of white-key reinforcement was changed from one side to the other, while its overall frequency was constant, red-key choices shifted in the same direction as white-key choices, an induction effect. When the overall frequency of white-key reinforcement was changed while its location remained constant, red key choices shifted in a direction opposite to white-key choices, a contrast effect. Both induction and contrast effects were clearer when the overall frequency of red-key reinforcement was reduced. These data demonstrate that the allocation of responding may exhibit schedule interaction effects similar to those commonly reported for response rate.     

Line-orientation generalization following signalled-reinforcer training

Three naive and three nonnaive pigeons key pecked for food on a multiple variable-interval 1-minute variable-interval 1-minute schedule with a black zero-degree vertical line on a white surround associated with one component and a black line shifted 30 degrees to the right (+30 degree) associated with the other component. Subsequently, a signalled-reinforcer procedure was introduced in the +30 degree component, i.e., whenever the reinforcer was available for the next response, the key changed to blank white. Following this training, the original unsignalled-reinforcer condition was re-instated. Line orientation generalization tests were given at the end of signalled-reinforcer training and after the second unsignalled-reinforcer condition. The signalled-reinforcer procedure reduced response rate in the +30-degree component in all subjects but facilitated responding during the zero-degree component (behavioral contrast) for two of the naive subjects only. However, average generalization gradients following signalled-reinforcer training indicated peak shift in two subjects and area shift in all five subjects that completed the experiment. There was no apparent relation between contrast and peak shift or degree of area shift. The data were interpreted as supporting the notion that the signalled-reinforcer procedure segments a variable-interval schedule into extinction and fixed ratio 1 segments.     

Conditional and unconditional components of post-shock freezing

Rats received shocks in one apparatus, and post-shock “freezing” was then assessed in that apparatus or in a different one. The assessment of freezing was made immediately after shock or after a 24-hour delay. Post-shock freezing was reduced when the animals were tested in a different apparatus from that in which shocks had been administered. No reduction in freezing was caused by the 24-hour delay. All the post-shock freezing was therefore attributable to contextual cues and to generalization between contexts. This pattern of results suggests that post-shock freezing is entirely produced by conditioned fear elicited by cues associated with shock and that no part of post-shock freezing is an unconditional response (UR) directly elicited by shock.     

Relative durations of conditioned stimulus and intertrial interval in conditioned suppression.

The effects of the relative durations of the conditional stimulus and the intertrial interval on bar pressing during a conditioned-suppression procedure were examined as a function of two additional variables--type of operant baseline schedule and rate of shock presentation. In Experiment 1, response suppression was compared across components of a multiple fixed-ratio, random-ratio, fixed-interval, random-interval schedule, at relative conditioned-stimulus/intertrial-interval durations of 1/1, 1/4, and 1/9. In Experiment 2, relative conditioned-stimulus/intertrial-interval duration (1/5, 3/3, or 5/1) was manipulated across groups, while shock frequency (2, 6, or 10 shocks/hr) was manipulated within groups. In both experiments, suppression during the signal was virtually complete at all relative durations. Responding was also suppressed during the intertrial interval, but that suppression varied as a function of experimental manipulations. In Experiment 1, intertrial-interval response rates were higher when relative signal duration was 1/9 than when it was 1/1, although both relative signal duration and shock frequency, which covaried, could have contributed to the difference. In Experiment 2, the patterning of response rates between successive shocks was affected by relative duration, absolute rates during the intertrial interval varied as a function of shock frequency, and differences between suppression during the signal and suppression during the intertrial interval were affected by both relative duration and shock frequency. The data support an analysis based upon relationships between shock-correlated and intertrial-interval stimuli and, as assessed by the relative-delay-to-reinforcement metric, are comparable to results that have been reported from experiments using similar manipulations under the autoshaping paradigm.     

Some effects of discriminative training with equated frequency of reinforcement

Pigeons were exposed to a multiple schedule which provided equally frequent reinforcement in the presence of two stimuli but which produced markedly different rates of key-pecking. Generalization gradients were displaced away from the stimulus associated with the lower rate of key-pecking. Another group of pigeons had similar training, except that a low rate of key-pecking was established in a stimulus with a much higher frequency of food reinforcement. In this case, the generalization gradients were not affected by the training on the schedule producing a low response rate.     

Successive positive contrast in one-way avoidance learning

The main finding of these experiments was a positive contrast effect in one-way avoidance learning. Experiment 1 showed that increasing safety time during one-way avoidance training led to improved performance, surpassing that of a control group that had received the high reward (safe time) from the beginning of training. Experiment 2 showed that a similar positive contrast effect occurred when the time spent in the danger compartment before the onset of the warning signal was shortened. These results suggest that time spent in a safe context acts as a reinforcer of the avoidance response; however, its incentive value depends not only on its duration, but also on the length of the time spent in the danger compartment before the onset of the signal. Overall, results also suggest that the avoidance response is a mixture of flight (motivated by fear) and approach (to a safe place) behaviour. The specific weight of the flight or approach component may be a function of the time and the amount of activation of each emotional state (fear or relief) due to opponent homeostatic compensatory processes that occur in the danger and safe compartments during one-way avoidance learning.     

Methylphenidate and stimulus control of avoidance behavior

The introduction of a warning signal that preceded a scheduled shock modified the temporal distribution of free-operant avoidance responses. With response-shock and shock-shock intervals held constant, response rates increased only slightly when the response-signal interval was reduced. The result is consistent with Sidman's (1955) findings under different conditions, but at variance with Ulrich, Holz, and Azrin's (1964) findings under similar conditions. Methylphenidate in graded doses increased response rates, modifying frequency distributions of interresponse times. Drug treatment may have disrupted a "temporal discrimination" formed within the signal-shock interval. More simply, methylphenidate influenced response rates by increasing short response latencies after signal onset; this effect was more prominent than the drug's tendency to increase the frequency of pre-signal responses. When signal-onset preceded shock by 2 sec, individual differences in performance were marked; methylphenidate suppressed responding in one rat as a function of increasing dose levels to a greater degree than in a second animal, but both subjects received more shocks than under control conditions.     

Generalization of free-operant avoidance behavior in pigeons

Three groups of four pigeons, trained to press a treadle on a free-operant avoidance schedule, were given auditory discrimination training. Alternating 2-min components of avoidance and no shock were paired with either a tone or white noise. The pigeons were subsequently given two types of generalization tests, with and without avoidable shocks scheduled. Two of the groups, trained interdimensionally, produced excitatory and inhibitory generalization gradients along the tone frequency dimension. A predicted post-discrimination gradient was computed from the algebraic summation of these gradients of excitation and inhibition. The predicted gradient was compared with the actual post-discrimination gradient obtained from the third group of pigeons that had been given intradimensional discrimination training on the tone frequency dimension. The predicted postdiscrimination gradient agreed in shape with the empirical postdiscrimination gradient. The results in general support Spence's (1937) gradient interaction theory.     

A further study of stimulus generalization following three-stimulus discrimination training

A group of pigeons was trained in a Skinner box to peck for VI reinforcement when the key was illuminated by a monochromatic light of 540 or 580 mμ but were non-reinforced for responding to 560 mμ. Two control groups, differing in amount of training, received only the two positive stimuli. At the completion of training all Ss received generalization tests under extinction. Both control groups produced bi-modal generalization gradients with the peaks of responding at the S+ values. The post-discrimination gradient revealed peaks displaced from the S+ values in the direction away from the S−, low responding and increased steepness in the region of S− and a general elevation of the gradient.     

Eccentric head positions bias random generation of leftward and rightward handle-bar rotations

We explored the effects of eccentric head positions on rapid rotations of a handle-bar in a modified randomization task. Subjects had to generate a random sequence of leftward and rightward handle-bar rotations; each pre-selected rotation was produced in response to a visual signal as rapidly as possible. Eccentric head positions induced a bias in that handle-bar rotations in the direction of the eccentric head position were chosen more frequently than handle-bar rotations in the opposite direction. This is consistent with previous evidence on a spatial coupling. In contrast to response selection, response initiation was not affected by eccentric head positions. The kinematic characteristics, however, differed: rotations in the direction of the eccentric head position were of larger amplitude and longer duration than rotations in the opposite direction. This difference may have been secondary to a difference in the start positions of the handle-bar, which were shifted in the direction opposite to the eccentric head position.