Typical delay determines waiting time on periodic-food schedules: Static and dynamic tests

Pigeons and other animals soon learn to wait (pause) after food delivery on periodic-food schedules before resuming the food-rewarded response. Under most conditions the steady-state duration of the average waiting time, t, is a linear function of the typical interfood interval. We describe three experiments designed to explore the limits of this process. In all experiments, t was associated with one key color and the subsequent food delay, T, with another. In the first experiment, we compared the relation between t (waiting time) and T (food delay) under two conditions: when T was held constant, and when T was an inverse function of t. The pigeons could maximize the rate of food delivery under the first condition by setting t to a consistently short value; optimal behavior under the second condition required a linear relation with unit slope between t and T. Despite this difference in optimal policy, the pigeons in both cases showed the same linear relation, with slope less than one, between t and T. This result was confirmed in a second parametric experiment that added a third condition, in which T + t was held constant. Linear waiting appears to be an obligatory rule for pigeons. In a third experiment we arranged for a multiplicative relation between t and T (positive feedback), and produced either very short or very long waiting times as predicted by a quasi-dynamic model in which waiting time is strongly determined by the just-preceding food delay.     

Discrimination learning in a foraging situation

Rats were allowed to forage in a simulated natural environment made up of eight food sources (patches) each containing a fixed number of pellets. Two of the eight contained an extra supply of peanuts. The peanut patches were signaled by an olfactory/visual cue located at the bottom of the ladder leading to the patch. In successive phases the number of sessions per day, height of the patches, and availability of peanuts were manipulated. Subjects showed evidence of discrimination learning under these conditions, although the degree of discriminatory behavior varied as a function of environmental manipulations. Assessment of behavior within foraging sessions showed that subjects systematically changed their patterns of utilization of patches across time. Sampling or exploration, as well as food reinforcement, seem implicated in these results.     

Pigeons can discriminate locations presented in pictures

The present experiments were designed to teach pigeons to discriminate two locations represented by color photographs. Two sets of photographs were taken at two distinctive locations on a university campus. These sets represented several standpoints at each location. For the true-discrimination group, pictures from the two locations were differentially associated with reward; for the pseudodiscrimination group, half of the views from each location were arbitrarily but consistently associated with reward. The former group acquired the discrimination much more rapidly. These birds also showed good transfer to new views from the standpoints used in training and to a new standpoint at each location not used in training. In a second experiment, another group of pigeons could terminate any training trial by pecking an “advance” key. Three of 4 subjects used this option to reduce the duration of trials in which pictures from the negative location were presented. These data suggest that pigeons can integrate views shown in pictures into a “concept” of a location. The method used here may be the experimental analogue of a common, natural process by which animals learn to identify locations.     

Stimulus effects on concurrent performance in transition

Six experimentally naive pigeons were exposed to concurrent variable-interval variable-interval schedules in a three-key procedure in which food reinforcement followed pecks on the side keys and pecks on the center key served as changeover responses. In Phase 1, 3 birds were exposed to 20 combinations of five variable-interval values, with each variable-interval value consistently associated with a different color on the side keys. Another 3 pigeons were exposed to the same 20 conditions, but with a more standard procedure that used a nondifferential discriminative stimulus on the two side keys throughout all conditions. In Phase 2, the differential and nondifferential stimulus conditions were reversed for each pigeon. Each condition lasted for one 5-hr session and one subsequent 1-hr session. In the last 14 conditions of each phase, the presence of differential discriminative stimuli decreased the time necessary for differential responding to develop and increased the sensitivity of behavior to reinforcement distribution in the 1st hr of training; during the last hours of training in each condition, however, the effects of the differential discriminative stimuli could not be distinguished from the effects of reinforcement distribution per se. These results show the importance of studying transitions in behavior as well as final performance. They may also be relevant to discrepancies in the results of previous experiments that have used nonhuman and human subjects.     

Functional classes and equivalence relations

Three adult subjects were taught a set of two-choice simultaneous discriminations, with three positive and three negative stimuli; all possible combinations of positive and negative stimuli yielded nine different pairs. The discriminations were repeatedly reversed and rereversed, the former positive stimuli becoming negative and the former negative stimuli becoming positive. With all subjects, a reversal of the contingencies for one pair of stimuli became sufficient to change their responses to all of the other pairs. The reversals had produced functional stimulus classes. Then, all subjects showed conditional discriminations emerging between members of a functional class; given a sample from one class and comparisons from both classes, they selected the comparison that was in the same class as the sample. Next, 2 of the subjects showed that the within-class conditional relations possessed the symmetric and transitive properties of equivalence relations; after having been taught to relate new stimuli to existing class members, the subjects then matched other class members to the new stimuli. Subsequent tests of two-choice discriminations showed that the conditional discriminations had transferred functional class membership to the new stimuli. The 3rd subject, who did not show equivalence relations among functional class members, was also found to have lost the within-class conditional relations after the equivalence tests.     

The role of observing and attention in establishing stimulus control.

Early theorists (Skinner, Spence) interpreted discrimination learning in terms of the strengthening of the response to one stimulus and its weakening to the other. But this analysis does not account for the increasing independence of the two performances as training continues or for increases in control by dimensions of a stimulus other than the one used in training. Correlation of stimuli with different densities of reinforcement produces an increase in the behavior necessary to observe them, and greater observing of and attending to the relevant stimuli may account for the increase in control by these stimuli. The observing analysis also encompasses errorless training, and the selective nature of observing explains the feature-positive effect and the relatively shallow gradients of generalization generated by negative discriminative stimuli. The effectiveness of the observing analysis in handling these special cases adds to the converging lines of evidence supporting its integrative power and thus its validity.     

Effects of ratio reinforcement schedules on discrimination performance by Japanese monkeys

In Experiment 1, Japanese monkeys were trained on three conditional position-discrimination problems with colors as the conditional cues. Within each session, each problem was presented for two blocks of ten reinforcements; correct responses were reinforced under continuous-reinforcement, fixed-ratio 5, and variable-ratio 5 schedules, each assigned to one of the three problems. The assignment of schedules to problems was rotated a total of three times (15 sessions per assignment) after 30 sessions of acquisition training. Accuracy of discrimination increased to a moderate level with fewer trials under CRF than under ratio schedules. In contrast, the two ratio schedules, fixed and variable, were more effective in maintaining accurate discrimination than was CRF. With further training, as asymptotes were reached, accuracy was less affected by the schedule differences. These results demonstrated an interaction between the effects of reinforcement schedules and the level of acquisition. In Experiment 2, ratio sizes were gradually increased to 30. Discrimination accuracy was maintained until the ratio reached 20; ratio 30 strained the performance. Under FR conditions, accuracy increased as correct choice responses cumulated after reinforcement.     

Stimulus class membership established via stimulus-reinforcer relations

In an arbitrary matching-to-sample procedure, two mentally retarded subjects learned conditional discriminations with two sets of stimuli. Each set included a spoken name (N1 or N2), an object (O1 or O2), and a printed symbol (S1 or S2). One subject selected conditionally (a) O1 upon N1, and O2 upon N2, and (b) S1 upon O1, and S2 upon O2. The other subject selected conditionally (a) S1 upon N1, and S2 upon N2, and (b) O1 upon S1, and O2 upon S2. For both subjects, selections of O1 and S1 produced one type of food, F1; selections of O2 and S2 produced a different type of food, F2. Both subjects also learned identity-matching performances, selecting O1, O2, S1, S2, F1, and F2 conditionally upon those stimuli as samples; F1 followed selections of O1, S1, and F1; F2 followed selections of O2, S2, and F2. Matching performances consistent with stimulus class formation involving the names, objects, symbols, and foods were demonstrated on probe trials, even though these performances had not been taught explicitly. Next, new objects, X1 and X2, were presented on identity-matching trials, producing F1 and F2, respectively. Without further training, X1 was selected conditionally upon N1, S1, and O1, and X2 was selected upon N2, S2, and O2. When the contingencies were changed so that selections of X1 and X2 were now followed by F2 and F1, respectively, X2 was selected conditionally upon N1, S1, and O1, and X1 was selected upon N2, S2, and O2. Class membership of X1 and X2 had apparently changed. This study provides evidence that reinforcers may become members of stimulus classes, and that new stimuli may become class members through relations with reinforcers.     

Observing responses maintained by conditional discriminative stimuli.

In a conditional discrimination procedure, pigeons' observing responses were analyzed to examine whether two color stimuli (blue or red), conditionally related to whether each of two line stimuli (vertical or horizontal) accompanied reinforcement or nonreinforcement, functioned as conditioned reinforcers. If a variable-interval (VI) 10-s requirement was fulfilled, an observing response produced onset of a color stimulus. A little later, a line stimulus was presented independently of responding, added to the color stimulus to form a compound stimulus. If 55 s elapsed with a response not having occurred either through 55 s or after the variable-interval 10-s had timed out, one of the color-line compound stimuli was presented independently of responding. To control for sensory reinforcement effects and for earlier entrance to the later link, a simple discrimination procedure also was conducted in which reinforcement was not correlated with the color stimuli but with the line stimuli only. As in the conditional discrimination, the observing response also could produce earlier presentation of blue or red. The observing response occurred more frequently during the conditional discrimination than during the simple discrimination. The results were related to different theoretical accounts of conditioned reinforcement, particularly the information hypothesis.     

Delayed temporal discrimination in pigeons: A comparison of two procedures

A within-subjects comparison was made of pigeons' performance on two temporal discrimination procedures that were signaled by differently colored keylight samples. During stimulus trials, a peck on the key displaying a slanted line was reinforced following short keylight samples, and a peck on the key displaying a horizontal line was reinforced following long keylight samples, regardless of the location of the stimuli on those two choice keys. During position trials, a peck on the left key was reinforced following short keylight samples and a peck on the right key was reinforced following long keylight samples, regardless of which line stimulus appeared on the correct key. Thus, on stimulus trials, the correct choice key could not be discriminated prior to the presentation of the test stimuli, whereas on position trials, the correct choice key could be discriminated during the presentation of the sample stimulus. During Phase 1, with a 0-s delay between sample and choice stimuli, discrimination learning was faster on position trials than on stimulus trials for all 4 birds. During Phase 2, 0-, 0.5-, and 1.0-s delays produced differential loss of stimulus control under the two tasks for 2 birds. Response patterns during the delay intervals provided some evidence for differential mediation of the two delayed discriminations. These between-task differences suggest that the same processes may not mediate performance in each.