Peak shift in concurrent schedules

Pigeons were exposed to two keys, a main key and a changeover key. Initially non-differential training was given in which pecking the main key was reinforced on a variable-interval 2-min schedule when the key displayed the first stimulus, a black line on a blue background, and was reinforced on an identical but independent variable-interval 2-min schedule when the key displayed a plain blue stimulus. Later, differential training was given in which pecking the main key was reinforced on a variable-interval 2-min schedule when the first stimulus was displayed; and was reinforced on a variable-interval 10-min schedule when a second stimulus, a black line of another orientation on a blue background, was displayed. During non-differential and differential training, each peck on the changeover key changed the stimulus on the main key. Generalization tests were given before and after the differential training. These consisted of presentations on the main key of seven orientations of the black line on the blue background, including the first and second stimuli, with no reinforcements being given. Changeover-key pecks changed the stimuli on the main key. Generalization gradients were obtained using three measures: time spent, responses, and response rate in the presence of each test stimulus. Typically, maximum values on these measures occurred to stimuli away from the first in a direction opposite the second stimulus, and minimum values occurred to stimuli away from the second in a direction opposite the first.     

Concurrent performances: stimulus-control gradients during schedules of signalled and unsignalled concurrent reinforcement

On one key, pigeons' pecks were reinforced according to a variable-interval schedule in the presence of vertical lines, and were not reinforced in the presence of oblique lines. On a second key, pecks were reinforced according to a variable-interval schedule in the presence of blue, according to a signalled variable-interval schedule in the presence of red, and were not reinforced in the presence of white. Subsequently, during extinction, stimulus-control gradients were obtained by presenting eight different line orientations on the first key concurrent with each of the three colors on the second key. On the first key, line-orientation gradients tended to be lower, narrower, and less shifted in peak or area when the second-key stimulus was blue or red, the stimuli respectively correlated with unsignalled and signalled reinforcement, than when it was white, the stimulus correlated with extinction. Thus, the effect on first-key line-orientation gradients depended on second-key stimuli correlated with concurrent reinforcement, whether or not these stimuli were also correlated with concurrent responding. As a function of first-key line orientation, an inverted gradient was obtained on the second key during blue; during both red and white, rates of pecking on the second key were near zero.     

Stimulus generalization and delay of reinforcement during one component of a multiple schedule

The key pecking of six pigeons was reinforced according to a variable-interval 1-min schedule during each of two successively presented stimuli. When the key was illuminated by a black line on a white background, reinforcement was delayed for 10 sec. When the key was illuminated by a plain white light, reinforcement was not delayed. All subjects responded at a lower rate during the presentation of the black line. A subsequent generalization test along the line-orientation dimension produced a U-shaped gradient, with the nadir located at or near the training stimulus, for each subject. These gradients suggested that the lower rate of response during the stimulus associated with delayed reinforcement may have been due to an inhibition of responding.     

Discriminative stimulus control and the effects of concurrent operants.

Discriminative-stimulus-control functions were investigated in a concurrent operant context. Variable-interval reinforcement schedules were arranged for pigeons on two response keys. One key, illuminated with a white vertical line on green background (position irrelevant), was programmed with a given schedule value across groups. For different groups of pigeons, the alternative key, illuminated with green alone, was programmed with twice, the same, or half the reinforcement frequency of the other key. Stimulus-control gradients were collected from both keys as line orientation was varied. On the green-plus-line alternative, flattest gradients were observed when twice the reinforcement frequency was concurrently programmed and the steepest were observed when equal values were concurrently programmed. Also examined were the effects of a programmed changeover delay, important in maintaining the independence of concurrent operants. The changeover delay was found to have relatively minor effects upon stimulus control, despite its typical and marked effects upon steady-state responding.     

Conditional discrimination with ambiguous stimuli.

Five pigeons learned a two-key conditional discrimination. When background color on both keys was red, pecks on the key with a horizontal line produced food. When the color was green, pecks on the key with a vertical line produced food. During part of the experiment, color was presented on only one of the keys. It was found that accuracy was higher when color was combined with the line stimulus correlated with nonreinforcement. In another part of the experiment, color was presented on both keys but a line was present only on one. Accuracy was higher when the line accompanied the nonreinforced option than when the line accompanied the reinforced option. Superior performance when the combined stimuli were displayed on the nonfood key may be explained by the association of different components of the compound stimuli with reinforcement or as the result of rules pigeons follow in solving conditional discriminations.     

Stimulus duration as a measure of stimulus generalization

Four pigeons in the line-positive group were trained with a vertical line on a green background that signalled intermittent reinforcement while a plain green field signalled extinction. Four pigeons in the line-negative group were trained with the opposite discrimination. Response to a control key terminated any trial and initiated the next trial. The birds also used the control key during generalization tests to control the durations of trials in which various line orientations were presented. These durations were summed to provide generalization gradients of stimulus duration that were positive or negative in accordance with the trained discriminations. In Experiment 2, birds from the line-positive group were tested with a procedure in which the control key was not available on some trials. This provided an independent assessment of response rates to the test stimuli. These rates were used to predict the stimulus durations obtained when the control key was available. The findings supported a general model for the prediction of response distributions among concurrent stimuli from rates observed with single stimuli.     

The role of discriminative stimuli in concurrent performances

Key pecking in pigeons was examined under concurrent and parallel arrangements of two independent and simultaneously available variable-interval schedules. Pecks on the changeover key alternated the schedule of reinforcement for responses on the main key. Under concurrent schedules, discriminative stimuli were paired with the reinforcement schedule arranged in each component and changeover responses also alternated these stimuli. Under parallel schedules, changeover responses alternated the effective reinforcement schedule, but did not change the discriminative stimulus. On concurrent procedures, changeover response rate was inversely related to the difference in reinforcement rate between the two components, whereas on parallel schedules no consistent relationship was found. With both schedules, absolute response and reinforcement rates were positively related, although for a given set of reinforcement frequencies, rates were often higher on the concurrent schedules. On concurrent schedules, relative response rates and relative times were equal to relative reinforcement rates. On parallel schedules these ratios were positively related, but response and time ratios were much smaller than were obtained with comparable concurrent schedules. This inequality was most pronounced when absolute reinforcement frequencies were lowest.     

On the form of stimulus generalization curves for visual intensity

Twelve pigeons were given successive discrimination training involving variable-interval reinforcement for key pecking in the presence of one intensity of monochromatic light randomly alternated with extinction for pecking during another intensity. All of the pigeons were then tested in extinction for generalization along the intensity dimension, and all showed a displacement of maximal responding from the positive stimulus in the direction opposite the negative stimulus. For six of the pigeons, for which the test included only three values beyond the positive stimulus, four showed peaked gradients but two did not, showing monotonic gradients with maximal responding to the most extreme test value. For another six pigeons tested over a wider range, all showed peaked gradients. Thus, when a sufficiently wide range of test values is employed, generalization gradients for visual intensity have the same peaked form as do gradients for qualitative visual dimensions such as wavelength or line angle.     

Delayed temporal discrimination in pigeons: A comparison of two procedures

A within-subjects comparison was made of pigeons' performance on two temporal discrimination procedures that were signaled by differently colored keylight samples. During stimulus trials, a peck on the key displaying a slanted line was reinforced following short keylight samples, and a peck on the key displaying a horizontal line was reinforced following long keylight samples, regardless of the location of the stimuli on those two choice keys. During position trials, a peck on the left key was reinforced following short keylight samples and a peck on the right key was reinforced following long keylight samples, regardless of which line stimulus appeared on the correct key. Thus, on stimulus trials, the correct choice key could not be discriminated prior to the presentation of the test stimuli, whereas on position trials, the correct choice key could be discriminated during the presentation of the sample stimulus. During Phase 1, with a 0-s delay between sample and choice stimuli, discrimination learning was faster on position trials than on stimulus trials for all 4 birds. During Phase 2, 0-, 0.5-, and 1.0-s delays produced differential loss of stimulus control under the two tasks for 2 birds. Response patterns during the delay intervals provided some evidence for differential mediation of the two delayed discriminations. These between-task differences suggest that the same processes may not mediate performance in each.     

Transfer of a response controlling stimulus duration across discrimination problems

In the acquisition phase, pigeons learned to peck at a changeover key to shorten the duration of S? but not of S+ presented on the food key in a discrimination problem. In the transfer phase, the significance of S+ and S? was changed through extinction of both, equal reinforcement, or discrimination reversal, while the changeover key was not available. Transfer tests then showed appropriate modification of the changeover response. Similar transfer was demonstrated across orthogonal stimulus dimensions. Further analytic studies showed that this transfer of the changeover response did not depend upon mediation due to differential response rates to the food key. This research strategy enriches the study of the “second learning process” by providing an indicator of stimulus control in all phases of the procedure. Direct transfer between different problems also indicates that discriminative stimuli, although physically dissimilar, have the same “psychological value” for the subject.     

Stimulus control of the pigeon's ability to peck a moving target.

Two pigeons were trained to peck whichever of eight keys displayed a white field (SD). The other seven keys displayed a white "X" on a black background (S delta). Each peck to SD produced three-second access to grain, a three-second intertrial interval (ITI), and the next trial. Pecks to S delta produced a three-second timeout (TO) and the same trial. During later sessions the key displaying SD changed every t seconds (t = 3, 2, 1, .5, and .25 sec), requiring the birds to track the position of the SD. Pecks on a ninth key increased t. Several sessions employed novel stimuli to ascertain the controlling stimulus dimensions. Both birds made few errors acquiring the original discrimination. During the tracking sessions, both birds made few errors when t = .5 sec. Only one reliably lengthened t. Data from sessions with novel stimuli indicate that color and form were important aspects of SD and S delta respectively; movement contributed to the final performance.     

Further evidence of a sensory-tonic interaction in pigeons

The five pigeons in Group 1 were given successive intradimensional discrimination training in which responses to a line of 49 degrees were reinforced on a variable-interval schedule and responses to a line of 33 degrees were not reinforced. Subsequent generalization testing with other line orientations revealed a peak shift from the positive stimulus in the direction away from the negative stimulus in all subjects. The four pigeons in Group 2 received successive discrimination training with the 49 degrees value on the key during both stimuli. During the negative stimulus, however, the floor was tilted 16 degrees counterclockwise. When tested (with the floor flat) these subjects showed peak shifts similar to those observed with Group 1. A third group of three pigeons, given successive interdimensional discrimination training with the 49 degrees line as the positive stimulus and the absence of the line as the negative, showed no peak shift in a subsequent generalization test. It was concluded that tilting the floor on which the pigeon stood systematically distorted the bird's visual perception of the orientation of the line in a manner consistent with the results of other studies in this laboratory.     

Stimulus control of differential-reinforcement-of-low-rate responding

Five pigeons were given single-stimulus training on an 8-sec differential-reinforcement-of-low-rate schedule followed by steady-state generalization training using 12 wavelength stimuli. Three birds had a high percentage of reinforced responses on the training schedule and flat generalization gradients of total responses. The birds with fewer reinforced responses had much steeper generalization gradients. Generalization gradients plotted as a function of both stimulus wavelength and interresponse time showed that for most birds, stimulus control was restricted to responses with long interresponse times. Responses with very short interresponse times were not under stimulus control and there was some evidence of inhibitory control of short interresponse times. Interresponse-times-per-opportunity functions, plotted as a function of stimulus wavelength, showed that stimulus wavelength controlled the temporal distribution of responses, rather than the overall rate of response. The data indicate that the differential-reinforcement-of-low-rate schedule generates several response categories that are controlled in different ways by wavelength and time-correlated stimuli, and that averaging responses regardless of interresponse-time length obscures this control.     

Effects of extradimensional discrimination training upon previously acquired stimulus control

In Experiment 1, three groups of pigeons were taught to discriminate vertical lines (positive) from horizontal (negative). One group was then given true-discrimination training between two colors, a second group was equally reinforced for responding to the colors (pseudodiscrimination), while the third group was not run. The pseudodiscrimination group then provided a flatter gradient on the dimension of line orientation than either of the others, which did not differ. A second experiment demonstrated that this flattening effect could be completely counteracted when pseudodiscrimination was followed by true discrimination before the generalization test. The results are discussed within the framework of current research on attentional factors governing generalization gradients; pseudodiscrimination affects tests of stimulus control rather than its acquisition. When it intervenes between acquisition and testing, it appears to produce a “lapse” rather than a “loss” of the memory of the first-trained stimuli.     

Generalization during acquisition, extinction, and transfer of matching with an adjustable comparison

Three groups of pigeons were given conditional discrimination training in which the number of standard stimuli was varied across groups. In the presence of each standard, a pigeon adjusted the comparison stimulus on a second key until the two keys matched. A report of this match (response on the first key) was reinforced. Transfer of the matching performance was investigated by adding new standards to the ones already available. All pigeons were exposed to two extinction sessions after 155 sessions of training. Rapidity of acquisition was inversely related to the number of standards presented. Generalization gradients derived from the several comparison stimuli showed that all pigeons reached a high level of accuracy in the presence of at least one standard, and some pigeons did so in the presence of as many as four of the six standards. There was no evidence of a systematic effect of extinction upon overall accuracy, or the individual generalization gradients. When a new standard was added, a given pigeon's performance (in terms of responding to the comparisons) was similar to performance in the presence of one of the old standards. However, the pigeons did not show evidence of confusion among the comparisons.     

Discrimination of compound stimuli involving the presence or absence of a distinctive visual feature

Pigeons learned a free operant, go/no-go discrimination between stimuli produced by rapid alternation of different features on the response key. The 0 degrees -B compound consisted of a vertical black line on a white background (the 0 degrees feature) alternated with a blank white field (the B feature), with successive 0.75-sec feature on periods separated by 0.20-sec dark periods. Pecks at the alternating 0 degrees and B features were recorded separately. When pecks at the 0 degrees -B compound were reinforced and pecks at the B-B stimulus (repeated brief presentations of the B feature) were extinguished, the birds pecked more at the 0 degrees feature than at the B feature in the 0 degrees -B compound; subsequently, decremental line-tilt generalization gradients were obtained. When pecks at B-B were reinforced and pecks at 0 degrees -B were extinguished, the rate of pecking at the 0 degrees feature decreased to a low level much more rapidly than did the rate of pecking at the B feature in the 0 degrees -B compound; incremental line-tilt gradients were obtained. Following training with pecks at 0 degrees -B reinforced and pecks at 0 degrees -0 degrees extinguished, incremental line-tilt gradients were obtained, whereas the gradients were decremental following training with 0 degrees -0 degrees reinforced and 0 degrees -B extinguished.     

Stimulus control of responding during a fixed-interval reinforcement schedule

During training sessions, pecks by pigeons on a response key illuminated by a vertical line of white light resulted in reinforcement and an ensuing blackout according to a fixed-interval schedule. Training sessions were followed by dimensional stimulus control test sessions during which the orientation of the line present throughout the fixed interval was varied. Inverted U-shaped (excitatory) gradients of responding, with maximum responding occurring in the presence of the vertical line, were observed during the terminal part of the fixed interval. U-shaped (inhibitory) gradients of responding, with minimum responding occurring in the presence of the vertical line, were observed during the early part of the fixed interval when the preceding interval had terminated with reinforcement and blackout but not when the preceding interval had terminated with blackout only. These results suggest that the dimensional control by the stimulus present throughout the fixed interval is of a conditional variety. Whether the fixed-interval stimulus exerts inhibitory or excitatory dimensional control depends upon the presence and absence, respectively, of stimuli associated with reinforcement.     

Stimulus control during conditional discrimination

Pigeons were used to assess stimulus control during the development of a conditional discrimination. The training consisted of three stages. In Stage 1, key pecks were reinforced in the presence of a white line tilted 40 degrees to the right of vertical on a green background and non-reinforced when the same line appeared on a red background. In Stage 2, key pecks were reinforced when a white vertical line appeared on a red background and were non-reinforced in the presence of a 40 degrees slanted line on a red background. In Stage 3, key pecks were reinforced in the presence of the green background regardless of the line tilt, but were differentially reinforced in the presence of the red background (as in Stage 2). Generalization tests were conducted after each stage of training and consisted of five white lines on backgrounds that were green, red, or dark. The effects of the differential reinforcement contingencies on control by line orientation were restricted to the condition in which the red light appeared and resulted in behavioral control that could be characterized as: if red, pay closer attention to line tilt than if not red.     

Effects of stimulus similarity in discrimination training upon wavelength generalization in pigeons.

Thirty pigeons were given variable interval training to peck a 555-nm. light and then were tested for wavelength generalization. The subjects were later assigned to 1 of 3 groups, matched for both relative generalization slope and response rate. One group then received successive discrimination training between the 555-nm. stimulus (S+) and a vertical white line on a 555-nm. background (S minus); another group experienced the same S+ but a vertical white line on a black background as S minus. A third group received a comparable amount of single stimulus training with the 555-nm. value. On a second wavelength generalization test, the first group yielded greater sharpening of generalization than the second group, whereas the third group showed no change from Test 1. These results indicate that the sharpening of generalization gradients by discrimination training is directly related to the similarity of the discrimination training stimuli.