Probability and delay of reinforcement as factors in discrete-trial choice.

Pigeons chose between two alternatives that differed in the probability of reinforcement and the delay to reinforcement. A peck on the red key always produced a delay of 5 s and then a possible reinforcer. The probability of reinforcement for responding on this key varied from .05 to 1.0 in different conditions. A response on the green key produced a delay of adjustable duration and then a possible reinforcer, with the probability of reinforcement ranging from .25 to 1.0 in different conditions. The green-key delay was increased or decreased many times per session, depending on a subject's previous choices. The purpose of these adjustments was to estimate an indifference point, or a delay that resulted in a subject's choosing each alternative about equally often. In conditions where the probability of reinforcement was five times higher on the green key, the green-key delay averaged about 12 s at the indifference point. In conditions where the probability of reinforcement was twice as high on the green key, the green-key delay at the indifference point was about 8 s with high probabilities and about 6 s with low probabilities. An analysis based on these results and those from studies on delay of reinforcement suggests that pigeons' choices are relatively insensitive to variations in the probability of reinforcement between .2 and 1.0, but quite sensitive to variations in probability between .2 and 0.     

Handling time and choice in pigeons

According to optimal foraging theory, animals should prefer food items with the highest ratios of energy intake to handling time. When single items have negligible handling times, one large item should be preferred to a collection of small ones of equivalent total weight. However, when pigeons were offered such a choice on equal concurrent variable-interval schedules in a shuttlebox, they preferred the side offering many small items per reinforcement to that offering one or a few relatively large items. This preference was still evident on concurrent fixed-cumulative-duration schedules in which choosing the alternative with longer handling time substantially lowered the rate of food intake.     

CORRESPONDENCE TRAINING: AN EXAMPLE OF RULE-GOVERNED BEHAVIOR?

Two groups of six mentally retarded adults were exposed to either a “say/do” correspondence training program or a “do only” reinforcement procedure to evaluate the suggestion of Rogers-Warren and Baer (1976) that reinforcement of the nonverbal target behavior in the absence of the relevant verbal behavior may account for the behavior changes seen in correspondence training. The participants worked in an experimental setting on a variety of manipulatory responses leading to various auditory and visual consequences. Analysis of individual patterns of responding indicated no apparent differences between the groups during training; four individuals in each group appeared to develop generalized correspondence skills. We conclude that the outcome of correspondence training may not necessarily be verbal regulation of behavior as is assumed. Rather, we suggest that the notion of rule-governed behavior can best account for the type of behavior changes seen in correspondence studies.     

Choice between reliable and unreliable outcomes: mixed percentage-reinforcement in concurrent chains.

Pigeons' choices between alternatives that provided different percentages of reinforcement in mixed schedules were studied using the concurrent-chains procedure. In Experiment 1, the alternatives were terminal-link schedules that were equal in delay and magnitude of reinforcement, but that provided different percentages of reinforcement, with one schedule providing, reinforcement twice as reliably as the other. All pigeons preferred the more reliable schedule, and their level of preference was not systematically affected by variation in the absolute percentage values, or in the magnitude of reinforcement. In Experiment 2, preference for a schedule providing 100% reinforcement over one providing 33% reinforcement increased systematically with increases in the duration of the terminal links. In contrast, preference decreased systematically with increases in the duration of the initial links. Experiment 3 examined choice with equal percentages of reinforcement but unequal delays to reinforcement. Preference for the shorter delay to reinforcement was not systematically affected by variation in the absolute percentage of reinforcement. The overall pattern of results supported predictions based on an extension of the delay-reduction hypothesis to choice procedures involving mixed schedules of percentage reinforcement.     

Effects of delayed conditioned reinforcement in chain schedules.

The contingency between responding and stimulus change on a chain variable-interval 33-s, variable-interval 33-s, variable-interval 33-s schedule was weakened by interposing 3-s delays between either the first and second or the second and third links. No stimulus change signaled the delay interval and responses could occur during it, so the obtained delays were often shorter than the scheduled delay. When the delay occurred after the initial link, initial-link response rates decreased by an average of 77% with no systematic change in response rates in the second or third links. Response rates in the second link decreased an average of 59% when the delay followed that link, again with little effect on response rates in the first or third links. Because the effect of delaying stimulus change was comparable to the effect of delaying primary reinforcement in a simple variable-interval schedule, and the effect of the unsignaled delay was specific to the link in which the delay occurred, the results provide strong evidence for the concept of conditioned reinforcement.     

Conditional relations by monkeys: Reflexivity, symmetry, and transitivity

Two cynomolgous macaques categorized six colors into two groups of three after conditional discrimination training (zero-delay symbolic match-to-sample). The procedures resulted in the establishment of relations among the elements of each set-relations that were not specifically trained and that can be characterized by the properties of reflexivity, symmetry, and transitivity. Each set of colors was related to a characteristic pattern of responding: One response pattern involved temporal duration (press and hold the response keys); the second response pattern entailed repeated pressing and releasing of the response keys (fixed ratio 8). Six combinations of two colors were trained, three combinations from each set. After discriminative performance stabilized for each monkey, they were tested with 10 additional color combinations, all of which differed from the training combinations. The conditional relations established between test combinations can be characterized as stimulus equivalence. The training procedures were analogous to the procedure of using category names, and have implications for understanding the function of language in the formation of equivalence classes.     

Programming maintenance after correspondence training interventions with children

Interventions were employed to program maintenance following correspondence training. The use of reinforcement of verbalization and a mixed sequence of procedures designed to establish indiscriminable contingencies was evaluated in multiple-baseline designs across subjects and behaviors. The results indicated that target behaviors were maintained under less intrusive interventions and in the absence of programmed contingencies during extended follow-up conditions. The results are discussed in terms of changes in reinforcement schedules established in maintenance interventions.     

GENERALIZATION OF OBJECT NAMING AFTER TRAINING WITH PICTURE CARDS AND WITH OBJECTS

Generalization of four retarded children's object naming responses to stimuli in the natural environment was assessed after training with either objects or pictures of the objects. Generalization was typically greater after training with objects. In a second experiment, half of the stimuli that showed little generalization were retrained by alternating the original training object with an object that belonged to the same stimulus class as the training stimulus. The other half were simply retrained using the object. The alternating procedure resulted in substantial increases in generalization to untrained objects.     

USING REINFORCEMENT AND CUEING TO INCREASE HEALTHY SNACK FOOD CHOICES IN PRESCHOOLERS

We examined the effects of behavioral procedures to modify the food choices of preschoolers during a snack period at school (training setting) and at home (generalization setting). In the first experiment, we evaluated the usefulness of nutrition training and a generalization programming strategy of cueing to improve healthy snacking; in the second experiment we investigated the effect of nutrition training alone. In addition, three cases are presented that illustrate individualized procedures to facilitate generalization of healthy snacking to home. Results indicated that children's healthy snack choices increased in the preschool training setting, that generalization to home was achieved only when procedures to program it were implemented, and that the best results were found when the generalization procedures were tailored to the individual child.     

Social and solipsistic observer training: Effects on agreement with a criterion

The need to train accurate, not necessarily agreeing, observers is discussed. Intraobserver consistency as an intermediate criterion in such training is proposed and contrasted with the more familiar criterion of interobserver agreement. Videotaped observations of social interactions between handicapped and nonhandicapped preschoolers provided the medium for examining the criterion agreement of four observers trained against each type of standard. Observers generally failed to show high levels of criterion agreement whether trained to a within- or to a between-observer agreement standard. The results varied somewhat with the frequency of behaviors, however. Correlations between interobserver agreement and intraobserver consistency were variable but somewhat higher when interobserver agreement was the training criterion than when intraobserver consistency was the criterion. Correlations between interobserver agreement and criterion agreement ranged from — .16 to .89 during interobserver agreement training. Correlations between intraobserver consistency and criterion agreement ranged from — .23 to .99 during intraobserver consistency training.