Typical delay determines waiting time on periodic-food schedules: Static and dynamic tests

Pigeons and other animals soon learn to wait (pause) after food delivery on periodic-food schedules before resuming the food-rewarded response. Under most conditions the steady-state duration of the average waiting time, t, is a linear function of the typical interfood interval. We describe three experiments designed to explore the limits of this process. In all experiments, t was associated with one key color and the subsequent food delay, T, with another. In the first experiment, we compared the relation between t (waiting time) and T (food delay) under two conditions: when T was held constant, and when T was an inverse function of t. The pigeons could maximize the rate of food delivery under the first condition by setting t to a consistently short value; optimal behavior under the second condition required a linear relation with unit slope between t and T. Despite this difference in optimal policy, the pigeons in both cases showed the same linear relation, with slope less than one, between t and T. This result was confirmed in a second parametric experiment that added a third condition, in which T + t was held constant. Linear waiting appears to be an obligatory rule for pigeons. In a third experiment we arranged for a multiplicative relation between t and T (positive feedback), and produced either very short or very long waiting times as predicted by a quasi-dynamic model in which waiting time is strongly determined by the just-preceding food delay.     

Discrimination learning in a foraging situation

Rats were allowed to forage in a simulated natural environment made up of eight food sources (patches) each containing a fixed number of pellets. Two of the eight contained an extra supply of peanuts. The peanut patches were signaled by an olfactory/visual cue located at the bottom of the ladder leading to the patch. In successive phases the number of sessions per day, height of the patches, and availability of peanuts were manipulated. Subjects showed evidence of discrimination learning under these conditions, although the degree of discriminatory behavior varied as a function of environmental manipulations. Assessment of behavior within foraging sessions showed that subjects systematically changed their patterns of utilization of patches across time. Sampling or exploration, as well as food reinforcement, seem implicated in these results.     

Pigeons can discriminate locations presented in pictures

The present experiments were designed to teach pigeons to discriminate two locations represented by color photographs. Two sets of photographs were taken at two distinctive locations on a university campus. These sets represented several standpoints at each location. For the true-discrimination group, pictures from the two locations were differentially associated with reward; for the pseudodiscrimination group, half of the views from each location were arbitrarily but consistently associated with reward. The former group acquired the discrimination much more rapidly. These birds also showed good transfer to new views from the standpoints used in training and to a new standpoint at each location not used in training. In a second experiment, another group of pigeons could terminate any training trial by pecking an “advance” key. Three of 4 subjects used this option to reduce the duration of trials in which pictures from the negative location were presented. These data suggest that pigeons can integrate views shown in pictures into a “concept” of a location. The method used here may be the experimental analogue of a common, natural process by which animals learn to identify locations.     

Stimulus effects on concurrent performance in transition

Six experimentally naive pigeons were exposed to concurrent variable-interval variable-interval schedules in a three-key procedure in which food reinforcement followed pecks on the side keys and pecks on the center key served as changeover responses. In Phase 1, 3 birds were exposed to 20 combinations of five variable-interval values, with each variable-interval value consistently associated with a different color on the side keys. Another 3 pigeons were exposed to the same 20 conditions, but with a more standard procedure that used a nondifferential discriminative stimulus on the two side keys throughout all conditions. In Phase 2, the differential and nondifferential stimulus conditions were reversed for each pigeon. Each condition lasted for one 5-hr session and one subsequent 1-hr session. In the last 14 conditions of each phase, the presence of differential discriminative stimuli decreased the time necessary for differential responding to develop and increased the sensitivity of behavior to reinforcement distribution in the 1st hr of training; during the last hours of training in each condition, however, the effects of the differential discriminative stimuli could not be distinguished from the effects of reinforcement distribution per se. These results show the importance of studying transitions in behavior as well as final performance. They may also be relevant to discrepancies in the results of previous experiments that have used nonhuman and human subjects.     

Criterion-related construct validity

Established results on latent variable models are applied to the study of the validity of a psychological test. When the test predicts a criterion by measuring a unidimensional latent construct, not only must the total score predict the criterion, but the joint distribution of criterion scores and item responses must exhibit a certain pattern. The presence of this population pattern may be tested with sample data using the stratified Wilcoxon rank sum test. Often, criterion information is available only for selected examinees, for instance, those who are admitted or hired. Three cases are discussed: (i) selection at random, (ii) selection based on the current test, and (iii) selection based on other measures of the latent construct. Discriminant validity is also discussed.This work was supported in part by Grant SES-87-01890 from the Measurement Methods and Data Improvement Program of the U.S. National Science Foundation.     

Functional classes and equivalence relations

Three adult subjects were taught a set of two-choice simultaneous discriminations, with three positive and three negative stimuli; all possible combinations of positive and negative stimuli yielded nine different pairs. The discriminations were repeatedly reversed and rereversed, the former positive stimuli becoming negative and the former negative stimuli becoming positive. With all subjects, a reversal of the contingencies for one pair of stimuli became sufficient to change their responses to all of the other pairs. The reversals had produced functional stimulus classes. Then, all subjects showed conditional discriminations emerging between members of a functional class; given a sample from one class and comparisons from both classes, they selected the comparison that was in the same class as the sample. Next, 2 of the subjects showed that the within-class conditional relations possessed the symmetric and transitive properties of equivalence relations; after having been taught to relate new stimuli to existing class members, the subjects then matched other class members to the new stimuli. Subsequent tests of two-choice discriminations showed that the conditional discriminations had transferred functional class membership to the new stimuli. The 3rd subject, who did not show equivalence relations among functional class members, was also found to have lost the within-class conditional relations after the equivalence tests.     

The role of observing and attention in establishing stimulus control.

Early theorists (Skinner, Spence) interpreted discrimination learning in terms of the strengthening of the response to one stimulus and its weakening to the other. But this analysis does not account for the increasing independence of the two performances as training continues or for increases in control by dimensions of a stimulus other than the one used in training. Correlation of stimuli with different densities of reinforcement produces an increase in the behavior necessary to observe them, and greater observing of and attending to the relevant stimuli may account for the increase in control by these stimuli. The observing analysis also encompasses errorless training, and the selective nature of observing explains the feature-positive effect and the relatively shallow gradients of generalization generated by negative discriminative stimuli. The effectiveness of the observing analysis in handling these special cases adds to the converging lines of evidence supporting its integrative power and thus its validity.     

Effects of ratio reinforcement schedules on discrimination performance by Japanese monkeys

In Experiment 1, Japanese monkeys were trained on three conditional position-discrimination problems with colors as the conditional cues. Within each session, each problem was presented for two blocks of ten reinforcements; correct responses were reinforced under continuous-reinforcement, fixed-ratio 5, and variable-ratio 5 schedules, each assigned to one of the three problems. The assignment of schedules to problems was rotated a total of three times (15 sessions per assignment) after 30 sessions of acquisition training. Accuracy of discrimination increased to a moderate level with fewer trials under CRF than under ratio schedules. In contrast, the two ratio schedules, fixed and variable, were more effective in maintaining accurate discrimination than was CRF. With further training, as asymptotes were reached, accuracy was less affected by the schedule differences. These results demonstrated an interaction between the effects of reinforcement schedules and the level of acquisition. In Experiment 2, ratio sizes were gradually increased to 30. Discrimination accuracy was maintained until the ratio reached 20; ratio 30 strained the performance. Under FR conditions, accuracy increased as correct choice responses cumulated after reinforcement.     

Symmetry and transitivity of conditional relations in monkeys (Cebus apella) and pigeons (Columba livia)

In Experiment 1 six monkeys were tested with discriminative relations that were backward relative to their training in a 0-second conditional (“symbolic”) matching procedure. Although there was some indication of backward associations, the evidence was generally weak, and statistical evaluations did not reach conventional significance levels. Unlike children, who show backward associations to the point of symmetry, monkeys and pigeons display at best only weak and transient backward associations. In Experiment 2 associative transitivity was assessed across two sets of conditional matching tasks. All four monkeys tested demonstrated strong transitivity. In contrast, in Experiment 3 there was no evidence of transitivity in three pigeons tested under conditions closely comparable to those of Experiment 2. These results may identify some key features of interspecies differences and contribute to analyses of serial learning in animals.     

Stimulus class membership established via stimulus-reinforcer relations

In an arbitrary matching-to-sample procedure, two mentally retarded subjects learned conditional discriminations with two sets of stimuli. Each set included a spoken name (N1 or N2), an object (O1 or O2), and a printed symbol (S1 or S2). One subject selected conditionally (a) O1 upon N1, and O2 upon N2, and (b) S1 upon O1, and S2 upon O2. The other subject selected conditionally (a) S1 upon N1, and S2 upon N2, and (b) O1 upon S1, and O2 upon S2. For both subjects, selections of O1 and S1 produced one type of food, F1; selections of O2 and S2 produced a different type of food, F2. Both subjects also learned identity-matching performances, selecting O1, O2, S1, S2, F1, and F2 conditionally upon those stimuli as samples; F1 followed selections of O1, S1, and F1; F2 followed selections of O2, S2, and F2. Matching performances consistent with stimulus class formation involving the names, objects, symbols, and foods were demonstrated on probe trials, even though these performances had not been taught explicitly. Next, new objects, X1 and X2, were presented on identity-matching trials, producing F1 and F2, respectively. Without further training, X1 was selected conditionally upon N1, S1, and O1, and X2 was selected upon N2, S2, and O2. When the contingencies were changed so that selections of X1 and X2 were now followed by F2 and F1, respectively, X2 was selected conditionally upon N1, S1, and O1, and X1 was selected upon N2, S2, and O2. Class membership of X1 and X2 had apparently changed. This study provides evidence that reinforcers may become members of stimulus classes, and that new stimuli may become class members through relations with reinforcers.