BEHAVIORAL MOMENTUM IN THE TREATMENT OF NONCOMPLIANCE

Behavioral momentum refers to the tendency for behavior to persist following a change in environmental conditions. The greater the rate of reinforcement, the greater the behavioral momentum. The intervention for noncompliance consisted of issuing a sequence of commands with which the subject was very likely to comply (i.e., high-probability commands) immediately prior to issuing a low-probability command. In each of five experiments, the high-probability command sequence resulted in a “momentum” of compliant responding that persisted when a low-probability request was issued. Results showed the antecedent high-probability command sequence increased compliance and decreased compliance latency and task duration. “Momentum-like” effects were shown to be distinct from experimenter attention and to depend on the contiguity between the high-probability command sequence and the low-probability command.     

Typical delay determines waiting time on periodic-food schedules: Static and dynamic tests

Pigeons and other animals soon learn to wait (pause) after food delivery on periodic-food schedules before resuming the food-rewarded response. Under most conditions the steady-state duration of the average waiting time, t, is a linear function of the typical interfood interval. We describe three experiments designed to explore the limits of this process. In all experiments, t was associated with one key color and the subsequent food delay, T, with another. In the first experiment, we compared the relation between t (waiting time) and T (food delay) under two conditions: when T was held constant, and when T was an inverse function of t. The pigeons could maximize the rate of food delivery under the first condition by setting t to a consistently short value; optimal behavior under the second condition required a linear relation with unit slope between t and T. Despite this difference in optimal policy, the pigeons in both cases showed the same linear relation, with slope less than one, between t and T. This result was confirmed in a second parametric experiment that added a third condition, in which T + t was held constant. Linear waiting appears to be an obligatory rule for pigeons. In a third experiment we arranged for a multiplicative relation between t and T (positive feedback), and produced either very short or very long waiting times as predicted by a quasi-dynamic model in which waiting time is strongly determined by the just-preceding food delay.     

Discrimination learning in a foraging situation

Rats were allowed to forage in a simulated natural environment made up of eight food sources (patches) each containing a fixed number of pellets. Two of the eight contained an extra supply of peanuts. The peanut patches were signaled by an olfactory/visual cue located at the bottom of the ladder leading to the patch. In successive phases the number of sessions per day, height of the patches, and availability of peanuts were manipulated. Subjects showed evidence of discrimination learning under these conditions, although the degree of discriminatory behavior varied as a function of environmental manipulations. Assessment of behavior within foraging sessions showed that subjects systematically changed their patterns of utilization of patches across time. Sampling or exploration, as well as food reinforcement, seem implicated in these results.     

Pigeons can discriminate locations presented in pictures

The present experiments were designed to teach pigeons to discriminate two locations represented by color photographs. Two sets of photographs were taken at two distinctive locations on a university campus. These sets represented several standpoints at each location. For the true-discrimination group, pictures from the two locations were differentially associated with reward; for the pseudodiscrimination group, half of the views from each location were arbitrarily but consistently associated with reward. The former group acquired the discrimination much more rapidly. These birds also showed good transfer to new views from the standpoints used in training and to a new standpoint at each location not used in training. In a second experiment, another group of pigeons could terminate any training trial by pecking an “advance” key. Three of 4 subjects used this option to reduce the duration of trials in which pictures from the negative location were presented. These data suggest that pigeons can integrate views shown in pictures into a “concept” of a location. The method used here may be the experimental analogue of a common, natural process by which animals learn to identify locations.     

Stimulus effects on concurrent performance in transition

Six experimentally naive pigeons were exposed to concurrent variable-interval variable-interval schedules in a three-key procedure in which food reinforcement followed pecks on the side keys and pecks on the center key served as changeover responses. In Phase 1, 3 birds were exposed to 20 combinations of five variable-interval values, with each variable-interval value consistently associated with a different color on the side keys. Another 3 pigeons were exposed to the same 20 conditions, but with a more standard procedure that used a nondifferential discriminative stimulus on the two side keys throughout all conditions. In Phase 2, the differential and nondifferential stimulus conditions were reversed for each pigeon. Each condition lasted for one 5-hr session and one subsequent 1-hr session. In the last 14 conditions of each phase, the presence of differential discriminative stimuli decreased the time necessary for differential responding to develop and increased the sensitivity of behavior to reinforcement distribution in the 1st hr of training; during the last hours of training in each condition, however, the effects of the differential discriminative stimuli could not be distinguished from the effects of reinforcement distribution per se. These results show the importance of studying transitions in behavior as well as final performance. They may also be relevant to discrepancies in the results of previous experiments that have used nonhuman and human subjects.     

Differential predictability of preferences and choices

A combined multi-attribute utility and expectancy-value model has repeatedly been found to yield a worse fit to choices than to preference ratings. The present study investigated two possible explanations for this finding. First, people's belief-value structures may change in the choice task as they try to find the best alternative. Second, a difficult choice task may cause the decision maker to use simplifying heuristics. In the first of two experiments, subjective belief-value structures were measured on two occasions separated by about one week. Immediately before the second measurement, different groups of subjects performed a choice task, gave preference ratings, or performed a control task. The results did not support an interpretation of the greater difficulty of predicting choices in terms of changes in belief-value structures. However, the notion of simplifying heuristics received support by the finding that adopting simpler versions of the original model improved the predictions of the choices. In the second experiment, beliefs were measured immediately before or after each of a series of choices or preference ratings. The results indicated that although temporary changes in beliefs may occur, they can hardly provide a full account of the differential predictability of preferences and choices.     

Functional classes and equivalence relations

Three adult subjects were taught a set of two-choice simultaneous discriminations, with three positive and three negative stimuli; all possible combinations of positive and negative stimuli yielded nine different pairs. The discriminations were repeatedly reversed and rereversed, the former positive stimuli becoming negative and the former negative stimuli becoming positive. With all subjects, a reversal of the contingencies for one pair of stimuli became sufficient to change their responses to all of the other pairs. The reversals had produced functional stimulus classes. Then, all subjects showed conditional discriminations emerging between members of a functional class; given a sample from one class and comparisons from both classes, they selected the comparison that was in the same class as the sample. Next, 2 of the subjects showed that the within-class conditional relations possessed the symmetric and transitive properties of equivalence relations; after having been taught to relate new stimuli to existing class members, the subjects then matched other class members to the new stimuli. Subsequent tests of two-choice discriminations showed that the conditional discriminations had transferred functional class membership to the new stimuli. The 3rd subject, who did not show equivalence relations among functional class members, was also found to have lost the within-class conditional relations after the equivalence tests.     

The role of observing and attention in establishing stimulus control.

Early theorists (Skinner, Spence) interpreted discrimination learning in terms of the strengthening of the response to one stimulus and its weakening to the other. But this analysis does not account for the increasing independence of the two performances as training continues or for increases in control by dimensions of a stimulus other than the one used in training. Correlation of stimuli with different densities of reinforcement produces an increase in the behavior necessary to observe them, and greater observing of and attending to the relevant stimuli may account for the increase in control by these stimuli. The observing analysis also encompasses errorless training, and the selective nature of observing explains the feature-positive effect and the relatively shallow gradients of generalization generated by negative discriminative stimuli. The effectiveness of the observing analysis in handling these special cases adds to the converging lines of evidence supporting its integrative power and thus its validity.     

Effects of ratio reinforcement schedules on discrimination performance by Japanese monkeys

In Experiment 1, Japanese monkeys were trained on three conditional position-discrimination problems with colors as the conditional cues. Within each session, each problem was presented for two blocks of ten reinforcements; correct responses were reinforced under continuous-reinforcement, fixed-ratio 5, and variable-ratio 5 schedules, each assigned to one of the three problems. The assignment of schedules to problems was rotated a total of three times (15 sessions per assignment) after 30 sessions of acquisition training. Accuracy of discrimination increased to a moderate level with fewer trials under CRF than under ratio schedules. In contrast, the two ratio schedules, fixed and variable, were more effective in maintaining accurate discrimination than was CRF. With further training, as asymptotes were reached, accuracy was less affected by the schedule differences. These results demonstrated an interaction between the effects of reinforcement schedules and the level of acquisition. In Experiment 2, ratio sizes were gradually increased to 30. Discrimination accuracy was maintained until the ratio reached 20; ratio 30 strained the performance. Under FR conditions, accuracy increased as correct choice responses cumulated after reinforcement.     

Stimulus class membership established via stimulus-reinforcer relations

In an arbitrary matching-to-sample procedure, two mentally retarded subjects learned conditional discriminations with two sets of stimuli. Each set included a spoken name (N1 or N2), an object (O1 or O2), and a printed symbol (S1 or S2). One subject selected conditionally (a) O1 upon N1, and O2 upon N2, and (b) S1 upon O1, and S2 upon O2. The other subject selected conditionally (a) S1 upon N1, and S2 upon N2, and (b) O1 upon S1, and O2 upon S2. For both subjects, selections of O1 and S1 produced one type of food, F1; selections of O2 and S2 produced a different type of food, F2. Both subjects also learned identity-matching performances, selecting O1, O2, S1, S2, F1, and F2 conditionally upon those stimuli as samples; F1 followed selections of O1, S1, and F1; F2 followed selections of O2, S2, and F2. Matching performances consistent with stimulus class formation involving the names, objects, symbols, and foods were demonstrated on probe trials, even though these performances had not been taught explicitly. Next, new objects, X1 and X2, were presented on identity-matching trials, producing F1 and F2, respectively. Without further training, X1 was selected conditionally upon N1, S1, and O1, and X2 was selected upon N2, S2, and O2. When the contingencies were changed so that selections of X1 and X2 were now followed by F2 and F1, respectively, X2 was selected conditionally upon N1, S1, and O1, and X1 was selected upon N2, S2, and O2. Class membership of X1 and X2 had apparently changed. This study provides evidence that reinforcers may become members of stimulus classes, and that new stimuli may become class members through relations with reinforcers.