Self-control in adult humans: variation in positive reinforcer amount and delay.

In five experiments, choice responding of female human adults was examined, as a function of variations in reinforcer amount and reinforcer delay. Experiment 1 used a discrete-trials procedure, and Experiments 2, 3, 4, and 5 used a concurrent variable-interval variable-interval schedule. Reinforcer amount and reinforcer delay were varied both separately and together. In contrast to results previously reported with pigeons, the subjects in the present experiments usually chose the larger reinforcers even when those reinforcers were delayed. Together, the results from all the experiments suggest that the subjects followed a maximization strategy in choosing reinforcers. Such behavior makes it easy to observe self-control and difficult to observe impulsiveness in traditional laboratory experiments that use adult human subjects.     

INCREASING AUTISTIC CHILDREN'S SPONTANEOUS VERBALIZATIONS OF AFFECTION: AN ASSESSMENT OF TIME DELAY AND PEER MODELING PROCEDURES

We assessed the efficacy of time delay and peer modeling procedures in increasing autistic children's spontaneous verbalizations of affection. Four autistic children were taught to spontaneously say “I like (love) you” in response to a hug from a familiar person and their mother. Generalization from a free play training setting to free play outdoors and at home was assessed. Ancillary social and affection behaviors were also observed. Results indicated that the time delay was a quick and effective procedure for all the children. Peer modeling was unsuccessful in teaching the target behavior.     

Diminishing marginal value as delay discounting.

The fundamental law underlying economic demand and exchange is the tendency for value of marginal units to diminish with increasing amounts of a commodity. The present paper demonstrates that this law follows from three still-more-basic psychological assumptions: (a) limited consumption rate, (b) delay discounting, and (c) choice of highest valued alternative. Cases of diminishing marginal value apparently due to pure intensity of reward may plausibly be attributed to the above three factors. The further assumption that maximum consumption rate may vary within and across individuals implies that some substances may be unusually addictive and that some individual animals may be unusually susceptible to addiction.     

Key pecking of pigeons under variable-interval schedules of briefly signaled delayed reinforcement: effects of variable-interval value.

Key pecking of 4 pigeons was maintained under a multiple variable-interval 20-s variable-interval 120-s schedule of food reinforcement. When rates of key pecking were stable, a 5-s unsignaled, nonresetting delay to reinforcement separated the first peck after an interval elapsed from reinforcement in both components. Rates of pecking decreased substantially in both components. When rates were stable, the situation was changed such that the peck that began the 5-s delay also changed the color of the keylight for 0.5 s (i.e., the delay was briefly signaled). Rates increased to near-immediate reinforcement levels. In subsequent conditions, delays of 10 and 20 s, still briefly signaled, were tested. Although rates of key pecking during the component with the variable-interval 120-s schedule did not change appreciably across conditions, rates during the variable-interval 20-s component decreased greatly in 1 pigeon at the 10-s delay and decreased in all pigeons at the 20-s delay. In a control condition, the variable-interval 20-s schedule with 20-s delays was changed to a variable-interval 35-s schedule with 5-s delays, thus equating nominal rates of reinforcement. Rates of pecking increased to baseline levels. Rates of pecking, then, depended on the value of the briefly signaled delay relative to the programmed interfood times, rather than on the absolute delay value. These results are discussed in terms of similar findings in the literature on conditioned reinforcement, delayed matching to sample, and classical conditioning.     

Waiting in pigeons: the effects of daily intercalation on temporal discrimination.

Pigeons trained on cyclic-interval schedules adjust their postfood pause from interval to interval within each experimental session. But on regular fixed-interval schedules, many sessions at a given parameter value are usually necessary before the typical fixed-interval "scallop" appears. In the first case, temporal control appears to act from one interfood interval to the next; in the second, it appears to act over hundreds of interfood intervals. The present experiments look at the intermediate case: daily variation in schedule parameters. In Experiments 1 and 2 we show that pauses proportional to interfood interval develop on short-valued response-initiated-delay schedules when parameters are changed daily, that additional experience under this regimen leads to little further improvement, and that pauses usually change as soon as the schedule parameter is changed. Experiment 3 demonstrates identical waiting behavior on fixed-interval and response-initiated-delay schedules when the food delays are short (less than 20 s) and conditions are changed daily. In Experiment 4 we show that daily intercalation prevents temporal control when interfood intervals are longer (25 to 60 s). The results of Experiment 5 suggest that downshifts in interfood interval produce more rapid waiting-time adjustments than upshifts. These and other results suggest that the effects of short interfood intervals seem to be more persistent than those of long intervals.     

Prompt-aided instruction of mirror-image discriminations: Abrupt prompt removal,time delay,and self-evaluation

This study compared three types of prompt-elimination procedures for helping children respond to left-right mirror-image stimuli. Three populations participated: normally developing preschoolers, students with mild mental retardation, and students with moderate mental retardation. All subjects were first trained to discriminate the stimuli in the presence of multiple pictorial prompts. These prompts required the subjects to discriminate the compounds on the basis of orientation. Then the prompts were eliminated, abruptly, with a time-delay procedure, or with a procedure requiring subjects to use the prompts to self-evaluate the accuracy of their responses. The results showed the following. First, most subjects rapidly discriminated the compound stimuli. Second, about 50% of the subjects of each population discriminated the task stimuli even when the prompts were abruptly removed. Time delay was highly effective with the normally developing preschoolers and students with mild mental retardation, but not with students with moderate mental retardation. The self-evaluation procedure was effective with all three populations.     

Choice As A Function Of Reinforcement Ratios In Delayed Matching-to-sample

Pigeons were studied in two experiments using a delayed matching-to-sample task. In Experiment 1, 4 subjects were exposed to a task in which the proportion of reinforcement associated with matching and nonmatching, and the overall proportion of reinforcement associated with selecting each choice, regardless of the sample stimulus, were varied. Choice was sensitive to both proportions. A least squares regression analysis showed that Wixted's (1989) proportions of reinforcement model closely fit the data from Experiment 1; however, the model failed to make accurate qualitative predictions for some test conditions. In Experiment 2, 4 subjects were exposed to a delayed matching-to-sample task in which the retention intervals and the reduction in delay to reinforcement signaled by the onset of the sample stimulus were independently varied. When the retention interval was short and when the delay-reduction value of the sample stimulus was high, the sample exerted greater control over choice; the control by the overall proportion of reinforcements for selecting each choice stimulus was correspondingly low. Conversely, when the retention interval was long and the delay-reduction value of the sample stimulus was low, the sample exerted relatively less control over choice; control by the overall proportion of reinforcements obtained for selecting each choice stimulus was correspondingly high. A signal detection analysis found that sensitivity to reinforcement varied directly with retention interval. Data were also consistent with misallocation models. No evidence was found to suggest that pigeons ignore the rate at which selecting individual choice stimuli is reinforced, as has been reported in studies with human subjects.     

Procrastination by pigeons: preference for larger, more delayed work requirements.

In three experiments, pigeons chose between alternatives that required the completion of a small ratio schedule early in the trial or a larger ratio schedule later in the trial. Completion of the ratio requirement did not lead to an immediate reinforcer, but simply allowed the events of the trial to continue. In Experiment 1, the ratio requirements interrupted periods in which food was delivered on a variable-time schedule. In Experiments 2 and 3, each ratio requirement was preceded and followed by a delay, and only one reinforcer was delivered, at the end of each trial. Two of the experiments used an adjusting-ratio procedure in which the ratio requirement was increased and decreased over trials so as to estimate an indifference point--a ratio size at which the two alternatives were chosen about equally often. These experiments found clear evidence for "procrastination"--the choice of a larger but more delayed response requirement. In some cases, subjects chose the more delayed ratio schedule even when it was larger than the more immediate alternative by a factor of four or more. The results suggest that as the delay to the start of a ratio requirement is increased, it has progressively less effect on choice behavior, in much the same way that delaying a positive reinforcer reduces it effect on choice.     

Delay and number of food reinforcers: Effects on choice and latencies

Pigeons were given a choice between two identical-duration situations (terminal links of chain schedules). One terminal link of the choice pair provided two food deliveries, and the other provided five. The exact times of these food deliveries differed between the terminal links and were varied over conditions. A single response during the initial link gave immediate access to the corresponding terminal link. Forced trials, during which only one of the initial-link keys was lighted, were interspersed with choice trials during which both initial-link keys were lighted. Choice tended to favor whichever terminal link was correlated with the higher sum of the immediacies (i.e., the sum of the reciprocals of the delays to each of the reinforcers following the choice, with all delays measured from the choice). Latencies on forced trials and on choice trials also were related (negatively) to the sum of the immediacies. This correlation among response measures (choice and latencies) suggests that both measures are manifestations of the effect of conditioned reinforcement on response tendencies.     

Correspondence between saying and doing: teaching children to share and praise

Five small groups of preschool children were taught to share and praise by the modelling of these behaviors and reinforcement of their reports of sharing and praising. Experiment I demonstrated that modelling and reinforcement of any (true or untrue) reports of sharing, and then of praising, promptly increased reports of the corresponding behaviors. Modelling and reinforcement for true reports of each behavior increased both reporting and actual behavior. Experiment II showed that both reported and actual sharing and praising may be increased by modelling and reinforcement for true reports of the target behavior, without previous reinforcement for any (true or untrue) reports of those behaviors. Sharing, but not praising, generalized to a second setting. Experiment III replicated the results of Experiment II for sharing and praising, and demonstrated similar success in increasing a third behavior, specific praising. In general, these experiments show that developing correspondence between children's reports of behavior and actual behavior may be an efficient means of increasing prosocial responses.