Key pecking during extinction after intermittent or continuous reinforcement as a function of the number of reinforcers delivered during training.

Key pecking by 7 pigeons was established and maintained on a multiple variable-ratio variable-ratio (VR) schedule of food presentation. The schedule in one of the components was then changed to fixed-ratio (FR) 1 for a predetermined number of reinforcers. Both components were then changed to extinction (i.e., multiple extinction, extinction). This sequence was repeated a different number of times for each pigeon to determine the relation between the number of reinforcers delivered during each component of the multiple VR FR 1 schedule and the number of responses during extinction. For most pigeons, there were fewer responses during extinction in the presence of a stimulus recently correlated with FR 1, regardless of the number of reinforcers received. The ratio of the total responses in extinction in the former VR component to the total responses in the former FR 1 component increased as the number of reinforcers delivered during each component of the multiple schedule increased. Within-subject replications of the partial-reinforcement extinction effect generally occurred, and there were no overall reductions in the number of responses in extinction with repeated exposures to extinction.     

Transfer tests of stimulus value in concurrent chains

We report two experiments that use transfer tests to investigate whether in concurrent chains the value of a terminal-link stimulus is affected by the alternate terminal link. In Experiment 1, two groups of pigeons were trained on multiple concurrent-chains schedules in which switching between the schedules was via pecking a changeover key. For one group, the terminal links were fixed-interval 8 s versus fixed-interval 16 s in one component and fixed-interval 16 s versus fixed-interval 32 s in the other component. For a second group, the terminal links were variable-interval 10 s versus variable-interval 20 s in one component and variable-interval 20 s versus variable-interval 40 s in the other. After sufficient baseline training had been given so that performances had stabilized, transfer tests were conducted in which the two chains with equal terminal-link schedules were presented together as a new concurrent pair. For 6 of the 7 subjects, initial-link responding changed fairly rapidly during the test in the manner predicted if the values of the terminal links were equal. In Experiment 2, pigeons were trained on multiple concurrent chains using a two-key procedure, and the terminal links were the same variable-interval schedules as in Experiment 1. After baseline training, transfer tests were conducted that assessed (a) the relative reinforcing strength of the terminal-link stimuli in a novel initial-link situation and (b) the relative ability of those stimuli to evoke responding. The data from the reinforcing strength test were consistent with those from Experiment 1, but those from the evocation strength test were not. Although this discrepancy shows that responding in transfer tests is not solely a function of stimulus value, the results from both experiments suggest, overall, that value is determined by the stimulus—reinforcer relation independently of the alternative terminal link.     

Nonstable concurrent choice in pigeons

Six pigeons were trained on concurrent variable-interval schedules in which the arranged reinforcer ratios changed from session to session according to a 31-step pseudorandom binary sequence. This procedure allows a quantitative analysis of the degree to which performance in an experimental session is affected by conditions in previous sessions. Two experiments were carried out. In each, the size of the reinforcer ratios arranged between the two concurrent schedules was varied between 31-step conditions. In Experiment 1, the concurrent schedules were arranged independently, and in Experiment 2 they were arranged nonindependently. An extended form of the generalized matching law described the relative contribution of past and present events to present-session behavior. Total performance in sessions was mostly determined by the reinforcer ratio in that session and partially by reinforcers that had been obtained in previous sessions. However, the initial exposure to the random sequence produced a lower sensitivity to current-session reinforcers but no difference in overall sensitivity to reinforcement. There was no evidence that the size of the reinforcer ratios available on the concurrent schedules affected either overall sensitivity to reinforcement or the sensitivity to reinforcement in the current session. There was also no evidence of any different performance between independent and nonindependent scheduling. Because of these invariances, this experiment validates the use of the pseudorandom sequence for the fast determination of sensitivity to reinforcement.     

Food delivery as a conditional stimulus: Feature-learning and memory in pigeons

Three experiments investigated the learning and memory of discriminations based on presence versus absence of a pre-trial food delivery. In Experiment 1 half the illuminations of a response key were followed by food regardless of the subject's behavior. In one group an extra food delivery preceded only reinforced trials (feature-positive condition), whereas in a second group it preceded only nonreinforced trials (feature-negative condition). Key pecks and approaches revealed more rapid and superior discrimination learning in the first group. Experiment 2 replicated the results of Experiment 1 but yielded no evidence that greater “unexpectedness” of pretrial food conditions facilitates discriminative performance. In Experiment 3, individual pigeons trained on a conditional discrimination exhibited a within-subject feature-positive superiority. Delay between pretrial and trial stimuli interacted with feature-positive versus feature-negative training in both the between-group (Experiment 2) and within-subject (Experiment 3) procedures: performance was decremented at both short and long delays in the feature-positive condition but was decremented only at longer delays in the feature-negative condition. The feature-positive superiority obtained here is incompatible with explanations based on either the general concept of “perceptual organization” or on the conditional nature of feature-negative discriminations.     

Conditioning of two-response patterns of key pecking in pigeons

On discrete trials, two response keys were made available to hungry pigeons and food reinforcement depended on the order in which the required two key pecks occurred. In different phases, only one of the four possible two-peck sequences (left-left, left-right, right-left, and right-right) produced food reinforcement. In each case, the pigeons learned to perform the correct two-peck sequence more often than the incorrect sequences. Furthermore, the course of differentiation mastery indicated that both reinforcement history and response-reinforcer contiguity influenced performance. These results reveal that response patterns comprising two instances of the same response left-left and right-right) or instances of two different responses (left-right and right-left) may function as operants, thereby extending the generality of conditioning principles from discrete responses to structured sequences of behavior. These and other results are discussed in terms of contiguity-based and memory-based models of learning.     

Acquisition of stimulus control while introducing new stimuli in fading.

After establishing discrimination between a red positive stimulus and a green negative stimulus, the lowest intensity colors that restricted all responding to the positive stimulus were determined. Then, two new white lines differing in terms of line orientation were each superimposed on one of the colors and were increased in intensity. Thereafter, the intensity of the colors was decreased and eventually eliminated. Probe stimuli consisting of the lines presented against dark backgrounds were presented before each change of stimulus intensity, and probe responding was used to assess the control acquired by various dimension of the new stimuli during the course of fading. The lines acquired control of responding while they were being introduced, and control was strengthened as the colors were attenuated. Such a locus of acquisition was attributed to the starting intensity of the original controlling stimuli and was explained in terms of stimulus blocking. Finally, using probes while introducing the new stimuli enhanced the acquisition of control by the new stimuli.     

The effects of the stimulus-reinforcer correlation in a discrete-trials IRT>t procedure

The correlation between a keylight and food in a discrete-trials, interresponse-time-greater-than 6-sec (IRT>6-sec) procedure was varied by manipulating the rate of response-independent food presentation in the intertrial interval. When the correlation was positive, the rates of pecking in the IRT>6-sec condition were high and food was obtained on only about 5% of the trials. Likewise, responding was maintained at a high rate in yoked birds that received the same presentations of the light and food as the birds in the IRT>6-sec condition. When the rate of reinforcement between trials was equated to or made greater than the rate of reinforcement within trials, the response rate decreased for all birds, and those decreases were considerably larger for the yoked birds. However, the percentage of trials in which reinforced responses occurred under the IRT>6-sec procedure did not increase substantially when the light and food were either uncorrelated or negatively correlated. The percentage of trials in which a reinforcer was obtained increased when the keylight was left on continuously and the discriminative stimulus was not presented on the key. The results show that the stimulus-reinforcer correlation affects responding in the discrete-trials IRT>6-sec procedure, but that the effects of the stimulus-reinforcer correlation vary as a function of whether reinforcement is response-dependent or response-independent. The differences between the effects of response-independent and response-dependent pairings and nonpairings of the light and food are best accounted for in terms of differences in the control of responding by background stimuli.     

Time allocation in concurrent schedules: the effect of signalled reinforcement

The responses of five pigeons were reinforced on concurrent variable-interval variable-interval reinforcement schedules in which changeover key responses changed the stimulus and reinforcement schedules associated with the food key. While the reinforcement availability in one component remained unchanged throughout the experiment, the reinforcement availability in the other component was, during several conditions, signalled by the onset of an additional discriminative stimulus. During unsignalled conditions, both the relative frequency of responding and the relative time spent in each component approximated the obtained relative reinforcement frequency in each component. The effect of signalling reinforcer availability in one component was to (1) reduce responding in the signalled component to near-zero levels, and (2) increase the relative time in the unsignalled component, without a corresponding increase in the obtained relative reinforcement frequency. The magnitude of the increase in relative time in the unsignalled component decreased as the overall frequency of reinforcement increased. This deviation in the matching relation between relative time and the obtained relative reinforcement frequency was eliminated if the overall reinforcement frequency was increased before the signal was introduced and then, without removing the signal, gradually reduced.     

The role of physical identity of the sample and correct comparison stimulus in matching-to-sample paradigms

Pigeons were trained in a higher-order conditional discrimination paradigm to assess the role of physical identity in a within-subjects design. A line orientation which was super-imposed on all response keys signalled whether a response to the matching color or a response to the nonmatching color was correct. Following training under this paradigm, stimulus control gradients were obtained by varying the angularity of the lines. Orderly gradients of stimulus control were obtained and no bias toward or away from the physically identical comparison stimulus was observed. The data were interpreted as indicating that the pigeons acquired a discrimination for each specific stimulus configuration or a set of specific stimulus-response chains based on compound stimuli in which physical identity played no special role.     

Same/different concept learning in the pigeon: the effect of negative instances and prior adaptation to transfer stimuli

Pigeons were trained on a matching-to-sample or oddity-from-sample task with shapes (circle and plus). Half of each group was exposed to “negative instance” trials i.e., for matching birds, neither comparison key matched the sample, and for oddity birds both comparison keys matched the sample. When all birds were transferred to a new task involving colors (red and green), nonshifted birds (transferred from matching to matching, or oddity to oddity) performed significantly better than shifted birds (transferred from matching to oddity, or oddity to matching), but only if they had experienced negative instances of the training concept. When all birds were exposed to negative instances of the transfer task and then transferred to a new color task (yellow and blue), dramatic transfer effects were observed. The effect of pre-exposure to the yellow and blue colors, in order to reduce transfer-stimulus novelty, had a minor effect on transfer.