Effects of barbiturates and other sedative hypnotics in pigeons trained to discriminate phencyclidine from saline.

Pigeons were trained to peck the center key (lighted white) of three response keys to turn off the center keylight and to light one of the side keys with a red keylight and the other side key with a green keylight. Five responses (fixed-ratio component) on either side key relighted the center key. Food was delivered following 10 fixed-ratio components on the red key if 1.5 mg/kg phencyclidine had been given before the session. The position of the red and green keylights on the side keys varied randomly each time they were lighted by a peck on the center key. Subsequently, increasing doses of phencyclidine, barbital, amobarbital, phenobarbital, methaqualone, methyprylon, diazepam, oxazepam, and d-amphetamine were substituted for the training dose of phencyclidine, using a cumulative dosing procedure. At low doses of the sedative hypnotics, birds pecked the keylight color associated with saline. At higher doses, birds pecked both key colors. At the highest doses of pentobarbital and amobarbital, some birds responded almost exclusively On he color associated with phencyclidine. When responding on keys of both colors occurred following administration of phencyclidine or other sedative hypnotics, this responding was controlled by key position rather than by key color.     

Conditional discrimination learning in the pigeon

Four pigeons received conditional discrimination training in which reinforcement contingencies were related to specific combinations of color and form, but were unrelated to either color or form considered separately. During discrete-trial training, each response in the presence of two of four color-form displays produced reinforcement and terminated the trial; responding to the other two displays was never reinforced, and each such response prolonged the particular trial on which it occurred. Subsequently, the subjects received multiple-schedule training in which responding to either of the displays previously associated with reinforcement was now reinforced on a variable-interval schedule, and extinction was the schedule again correlated with the other two displays. After differential responding to the stimuli was clearly evident, intensity of the combination displays was changed in subsequent training sessions. Complex stimulus control was generally maintained across variation in intensity, although there were temporary disruptions in performance associated with onset of some of the intensity changes. Finally, a component-stimulus test revealed considerably more responding to the forms than to the colors.     

Choice based on separately established response tendencies: The effect of recency of reinforcement

The responding of pigeons was studied in a chamber with two adjacent keys that could each be lit with either a red or a green dot. Fixed-length trials were used, with pecking on positive trials reinforced by presenting food at the end of the trial. In each session the first 40 trials were one-key trials with one key lit on each trial, either red or green, and the next four trials were choice trials with both keys lit, one red and the other green. When blocks of sessions were presented in which all one-key trials were positive trials of a single color, choice responding gradually shifted to the color presented most recently during one-key trials. When all one-key trials were nonreinforced trials of a single color, responding on choice trials shifted toward the other color. When positive one-key trials of one color were intermingled with negative one-key trials of the other color, choice responding shifted exclusively to the reinforced color. These shifts in choice responding occurred even when responding on choice trials was never reinforced, and were viewed as based on separate response tendencies for pecking red and pecking green built up during one-key trials.     

Conditional discrimination with ambiguous stimuli.

Five pigeons learned a two-key conditional discrimination. When background color on both keys was red, pecks on the key with a horizontal line produced food. When the color was green, pecks on the key with a vertical line produced food. During part of the experiment, color was presented on only one of the keys. It was found that accuracy was higher when color was combined with the line stimulus correlated with nonreinforcement. In another part of the experiment, color was presented on both keys but a line was present only on one. Accuracy was higher when the line accompanied the nonreinforced option than when the line accompanied the reinforced option. Superior performance when the combined stimuli were displayed on the nonfood key may be explained by the association of different components of the compound stimuli with reinforcement or as the result of rules pigeons follow in solving conditional discriminations.     

Selective punishment of concurrent progressive ratio behavior

Key pecking of pigeons was reinforced with grain on a progressive ratio schedule during the presence of either of two key colors. Under one color, all responses were shocked; under the other color, responses were not shocked. A single response on a second key switched the key color and reset the progressive ratio, provided that the first step of the progressive ratio had been completed. A preference developed for the longer ratios of the progressive ratio under the non-shock key color. When the severity of punishment suppressed responding under the key color correlated with shock, the subjects continued to switch to the shock condition after a moderate degree of responding under the non-shock condition. Severe punishment also resulted in frequent, ineffective responses on the switching key and extended pausing under the key color associated with shock.     

Choice between concurrent schedules

Six pigeons pecked for food in a three-key experiment. A subject at any time could choose the left or right key and receive reinforcement according to one two-key concurrent variable-interval variable-interval schedule of reinforcement, or it could peck the center key. A peck on the center key arranged the complementary two-key concurrent variable-interval variable-interval schedule on the left and right keys. The two different two-key concurrent schedules arranged reinforcements concurrently and were signalled by two different colors of key lights. Choice behavior in the presence of a given color conformed to the usual relationship in two-key concurrent schedules: the relative frequency of responding on a key approximately equalled the relative frequency of reinforcement on that key. Preference for a two-key concurrent schedule, which was equivalent to preference for a color, was measured by the percentage of all responses on the left and right keys in the presence of that color: this percentage approximately equalled the percentage of all reinforcements that were delivered in the presence of that color. Thus, choice between concurrent schedules conforms approximately to the same relationship as does choice between alternatives in a single concurrent schedule.     

Autoshaped responding: A baseline for studying stimulus preference

In an autoshaping procedure with pigeons, trials consisted of the illumination of two keys, each with a different color, and then a response-independent feeder operation. Over successive conditions, all key-color pairs were arranged from the set of amber, red, green, and blue lamps. During sessions with a given pair, the left-right configuration of the colors varied irregularly, and the two colors alternated in illuminating the feeder. With one red and one green key, for example, red appeared sometimes on the left and sometimes on the right, and the feeder was alternately lit red or green on successive trials. Both total pecks and proportion of trials with at least one peck on a key of a given color were generally greater for red and amber than for green and blue, and relations among preferences were generally transitive across different color pairs. Repeating the procedure with decreased red and amber intensities and increased green and blue intensities reduced red and amber pecking relative to green and blue pecking, implying that differences in responding were determined more strongly by intensive than by chromatic properties of the stimuli.     

Concurrent performances: rate constancies without changeover delays

Pigeons' pecks on two keys were maintained, without changeover delays, by independent variable-interval schedules of food reinforcement. Four regularly cycling 2-min components scheduled reinforcement respectively for both keys, left key only, both keys, and right key only. Initially, reinforcement scheduled for one key alone produced more responding on that key than reinforcement scheduled concurrently for both keys. Continued sessions reduced this difference; response rate on a given key approached constancy, or invariance with respect to the performance on and schedule for the other key. When extinction replaced the reinforcement schedule on either key, responding on that key decreased more during components that scheduled reinforcement for the other key than during those that did not. This demonstration that responses on one key were not supported by reinforcers on the other key suggested that the alternation of concurrent responding and either-key-alone responding prevented concurrent superstitions from developing.     

Fading and errorless transfer in successive discriminations

A successive discrimination between red positive and green negative stimuli was established with pigeon subjects. Then, lines with different angular orientations were superimposed on one of the colors to form compound stimuli. Finally, either the colored element of the positive compound, the colored element of the negative compound, or both colored elements together, were gradually attenuated. Before each attenuation, the line elements were presented alone against dark backgrounds as probes to assess the degree to which they had acquired control of responding. When the positive color was attenuated alone or in conjunction with the negative color, angular orientation acquired control of responding in an errorless fashion. Lines, however, did not acquire control when only the negative component was attenuated. These results were interpreted in terms of changes in the predictability of reinforcement by color and line elements during stimulus attenuation. Finally, attenuation of the negative stimulus influenced the number of “dimensions” of the new line stimuli that acquired control of responding. When the positive stimulus was attenuated with the negative, only one dimension of the lines acquired control. When the positive stimulus was attenuated without the negative, however, more than one dimension of the lines acquired control of responding. These results were interpreted in terms of how errorless performance can be maintained while an organism attends to different dimensions of the new stimuli.     

Punishment of observing by a stimulus associated with the lower of two reinforcement frequencies

Three pigeons were used to investigate the effects of a stimulus associated with the lower of two reinforcement frequencies on the response producing it. In a three-key chamber, pecking the center key produced grain on alternating variable-interval schedules with mean durations of 2 min or 30 sec. Initially, green illumination of the keys accompanied the more favorable (30-sec) schedule and red accompanied the less favorable (2-min) schedule. Then the keys remained yellow unless the bird pecked one of the side (observing) keys to produce the discriminative stimuli for a 30-sec period. Subsequently, when red was withheld as a possible consequence of pecking a particular side key, the rate on that key increased; when red was restored, the observing rate decreased. Thus the stimulus associated with less frequent reinforcement had a punishing effect on the behavior producing it. When green was withheld on one of the side keys and the other key produced both colors, observing behavior was not maintained on the red-only key, but was maintained on the key that produced both colors.     

Preference for fixed-interval schedules of reinforcement

Pigeons were trained on a two-link concurrent chain schedule in which responding on either of two keys in the initial link occasionally produced a terminal link, signaled by a change in the color of that key and a darkening of the other. Further responding on the lighted key was reinforced with food according to a fixed-interval schedule. For one of the keys, this fixed interval was always 20 sec, while for the other it was held at values of 5, 14, 30, or 60 sec for several weeks. In the initial link, all pigeons responded relatively more often on the key with the shorter fixed interval than was predicted by the matching hypothesis. Responding in the initial link showed a large negative recency effect: pigeons responded less frequently on the key that provided their last reinforcement than predicted from the overall response rates.     

Responding in the pigeon under chained schedules of food presentation: the repetition of a stimulus during alternate components

Key pecking in the pigeon was maintained under chained schedules in which the completion of one schedule component initiated the next component, and food was presented upon completion of a sequence of components. Under the chained schedules studied, a particular key color appeared during more than one component, and different key colors appeared during the other components. When seven 1-min fixed-interval components comprised a chained schedule and the response key was the same color during the first, third, fifth, and terminal components, patterns of positively accelerated responding were maintained during all but the first two components of each sequence. In general, response rates were always lowest during the first one or two components and highest during the terminal component when as few as three and as many as eight components comprised a schedule. Increasing the number of components from three to eight showed that response rate during a component increased when it was no longer one of the initial two components of the schedule, even though its temporal relation to food presentation had not changed. Finally, when seven components comprised a schedule and the response key was one color during the first, third, and fifth and a different color during the last component, response rates were low during the first five components and high during the last two components preceding food presentation.     

Conditional relations by monkeys: Reflexivity, symmetry, and transitivity

Two cynomolgous macaques categorized six colors into two groups of three after conditional discrimination training (zero-delay symbolic match-to-sample). The procedures resulted in the establishment of relations among the elements of each set-relations that were not specifically trained and that can be characterized by the properties of reflexivity, symmetry, and transitivity. Each set of colors was related to a characteristic pattern of responding: One response pattern involved temporal duration (press and hold the response keys); the second response pattern entailed repeated pressing and releasing of the response keys (fixed ratio 8). Six combinations of two colors were trained, three combinations from each set. After discriminative performance stabilized for each monkey, they were tested with 10 additional color combinations, all of which differed from the training combinations. The conditional relations established between test combinations can be characterized as stimulus equivalence. The training procedures were analogous to the procedure of using category names, and have implications for understanding the function of language in the formation of equivalence classes.     

All-or-none-acquisition in matching-to-sample and a test of two models

Three pigeons learned to match three colors in a matching-to-sample procedure. The sample hue was presented on the center one of three keys, and the comparison hues were presented on the side keys. Forty responses on the center key produced the stimuli on the side keys and left the sample on the center key. A single response on the correct side key produced 3-sec access to grain, which was followed by a 25-sec intertrial interval. A correction procedure was employed when an error was committed. Before attaining asymptotic levels, there was no evidence of learning, responses were independent of the preceding response, and distributions of errors in four-trial blocks were binomial. Distributions of error runs, runs of various lengths, autocorrelations of errors of several lags, alternations of correct responses and errors, etc., were shown to fit Bower's (1961) all-or-none model better than a gradual learning model of Bush and Sternberg (1959). A transfer test employing a novel color showed only transitory degradation of performance.     

Performance on variable-interval schedules arranged singly and concurrently

Extensive parametric data were obtained from pigeons responding on variable-interval schedules arranged on three, two, and one response keys. Number of responses on the keys, the time spent responding on the keys, and the number of reinforcements obtained on the keys were measured. Response rates on each key were an increasing function of the reinforcement rate on that key, and an inverse function of the reinforcement rate on the other keys. In terms of preference, both response and time-allocation ratios undermatched ratios of obtained reinforcements, and the degree of undermatching was consistent both within, and between, two- and three-schedule data. When absolute response-rate data were analyzed according to Herrnstein's (1970) quantitative account, obtained values of assumed constants were not consistent either within or between conditions. However, a power-function modification of Herrnstein's account fitted the data well and provided similar exponent values to those obtained for the undermatching of preference ratios.     

Why pigeons say what they do: reinforcer magnitude and response requirement effects on say responding in say-do correspondence

The effects of reinforcer magnitude and response requirement on pigeons' say choices in an experimental homologue of human say-do correspondence were assessed in two experiments. The procedure was similar to a conditional discrimination procedure except the pigeons chose both a sample stimulus (the say component) and a comparison stimulus that corresponded to it (the do component). Correspondence was trained on red, green, and white key colors before the duration of food presentations following correspondence on each key color (Experiment 1) and the number of key pecks required as the say response on each key color (Experiment 2) were manipulated in an attempt to influence the initial say response. The frequency of say responses on each key color coincided with programmed changes in the duration of food presentations and the key-peck requirements assigned to each key color. Correspondence accuracy remained stable in all conditions, even those in which the say responding occurred primarily on two of the three key colors. Implications for human behavior are discussed.     

Autoshaping: further study of "negative automaintenance"

The key pecking of pigeons was autoshaped to three key colors paired with food in discrete trials. Then, the effects of three different color-correlated contingencies were compared: reward (presentation of food contingent on pecking), omission (presentation of food prevented by pecking), and extinction (no food). Two measures of performance were used: initial response (the number of trials with each color on which at least one peck was made) and multiple response (the total number of pecks per trial). In general, the reward color produced more pecking than the omission color, the omission color more than the extinction color, and the extinction color more than on blank trials with an unlighted key, although (relative to reward) omission produced a higher level of initial than of multiple responding. These results point clearly to the importance of stimulus-reinforcer continguity in the control of pecking.     

Contrast and induction in multiple schedules of discrete-trial concurrent reinforcement

Three pigeons were exposed to two-key discrete-trial concurrent schedules of reinforcement. Red and white key colors alternated irregularly and the assignment of reinforcers depended on key color. The red-key schedules were held constant, with the scheduled relative frequency of reinforcement for left-key pecks set at 0.75, while the white-key schedules varied. When the location of white-key reinforcement was changed from one side to the other, while its overall frequency was constant, red-key choices shifted in the same direction as white-key choices, an induction effect. When the overall frequency of white-key reinforcement was changed while its location remained constant, red key choices shifted in a direction opposite to white-key choices, a contrast effect. Both induction and contrast effects were clearer when the overall frequency of red-key reinforcement was reduced. These data demonstrate that the allocation of responding may exhibit schedule interaction effects similar to those commonly reported for response rate.     

Punishment of observing by the negative discriminative stimulus

To determine the effect of a negative discriminative stimulus on the response producing it, two pigeons were each studied in a three-key conditioning chamber. During alternating periods of unpredictable duration, pecking the center (food) key either was reinforced with grain on a variable-interval schedule or was never reinforced. On equal but independent variable-interval schedules, pecking either of the side (observing) keys changed the color of all keys for 30 sec from yellow to either green or red. When the schedule on the center key was variable-interval reinforcement, the color was green (positive discriminative stimulus); when no reinforcements were scheduled, the color was red (negative discriminative stimulus). Since pecking the side keys did not affect grain deliveries, changes in the rate of pecking could not be ascribed to changes in the frequency of primary reinforcement. In subsequent sessions, red was withheld as one of the possible consequences of pecking a given side key. When red was omitted, the rate on that key increased, and when red was restored, the rate decreased. It was concluded that red illumination of the keys, the negative discriminative stimulus, had a suppressive effect on the response that produced it.     

Effects Of Histories Of Differential Reinforcement Of Response Rate On Variable-interval Responding

Three pigeons were exposed first to multiple differential-reinforcement-of-high-rate and differential-reinforcement-of-low-rate schedules that were correlated with green and red keys, respectively, and then were shifted to a variable-interval schedule arranged on a white key. In subsequent test sessions, the variable-interval schedule continued to operate, but green and red keys replaced the white key in alternate sessions. In Part 1 of the experiment, the variable-interval schedule correlated with the white key was introduced immediately after the multiple-schedule condition, and the test condition began 15 days later. This sequence was repeated twice, with a reversal of the correlation of the key colors with the components of the multiple schedule at the start of each new cycle. Part 2 added a 6-month break between the multiple-schedule history and the white-key variable-interval schedule followed by test sessions. The procedure was then repeated with a reversal of the correlation between key colors and multiple-schedule components. In the test sessions of Part 1, all pigeons consistently responded faster in the presence of the key color most recently correlated with the differential-reinforcement-of-high-rate contingency than during the color most recently correlated with the differential-reinforcement-of-low-rate contingency. Similar but smaller effects were observed in Part 2. The effects of the reversals in these two parts of the experiment showed that only the most recent contingency exerted an influence on subsequent responding. The data suggest that this effect of the most recent history continues to operate on behavior under current contingencies even after a long lapse of time.