Waiting in pigeons: the effects of daily intercalation on temporal discrimination.

Pigeons trained on cyclic-interval schedules adjust their postfood pause from interval to interval within each experimental session. But on regular fixed-interval schedules, many sessions at a given parameter value are usually necessary before the typical fixed-interval "scallop" appears. In the first case, temporal control appears to act from one interfood interval to the next; in the second, it appears to act over hundreds of interfood intervals. The present experiments look at the intermediate case: daily variation in schedule parameters. In Experiments 1 and 2 we show that pauses proportional to interfood interval develop on short-valued response-initiated-delay schedules when parameters are changed daily, that additional experience under this regimen leads to little further improvement, and that pauses usually change as soon as the schedule parameter is changed. Experiment 3 demonstrates identical waiting behavior on fixed-interval and response-initiated-delay schedules when the food delays are short (less than 20 s) and conditions are changed daily. In Experiment 4 we show that daily intercalation prevents temporal control when interfood intervals are longer (25 to 60 s). The results of Experiment 5 suggest that downshifts in interfood interval produce more rapid waiting-time adjustments than upshifts. These and other results suggest that the effects of short interfood intervals seem to be more persistent than those of long intervals.     

Prompt-aided instruction of mirror-image discriminations: Abrupt prompt removal,time delay,and self-evaluation

This study compared three types of prompt-elimination procedures for helping children respond to left-right mirror-image stimuli. Three populations participated: normally developing preschoolers, students with mild mental retardation, and students with moderate mental retardation. All subjects were first trained to discriminate the stimuli in the presence of multiple pictorial prompts. These prompts required the subjects to discriminate the compounds on the basis of orientation. Then the prompts were eliminated, abruptly, with a time-delay procedure, or with a procedure requiring subjects to use the prompts to self-evaluate the accuracy of their responses. The results showed the following. First, most subjects rapidly discriminated the compound stimuli. Second, about 50% of the subjects of each population discriminated the task stimuli even when the prompts were abruptly removed. Time delay was highly effective with the normally developing preschoolers and students with mild mental retardation, but not with students with moderate mental retardation. The self-evaluation procedure was effective with all three populations.     

Choice As A Function Of Reinforcement Ratios In Delayed Matching-to-sample

Pigeons were studied in two experiments using a delayed matching-to-sample task. In Experiment 1, 4 subjects were exposed to a task in which the proportion of reinforcement associated with matching and nonmatching, and the overall proportion of reinforcement associated with selecting each choice, regardless of the sample stimulus, were varied. Choice was sensitive to both proportions. A least squares regression analysis showed that Wixted's (1989) proportions of reinforcement model closely fit the data from Experiment 1; however, the model failed to make accurate qualitative predictions for some test conditions. In Experiment 2, 4 subjects were exposed to a delayed matching-to-sample task in which the retention intervals and the reduction in delay to reinforcement signaled by the onset of the sample stimulus were independently varied. When the retention interval was short and when the delay-reduction value of the sample stimulus was high, the sample exerted greater control over choice; the control by the overall proportion of reinforcements for selecting each choice stimulus was correspondingly low. Conversely, when the retention interval was long and the delay-reduction value of the sample stimulus was low, the sample exerted relatively less control over choice; control by the overall proportion of reinforcements obtained for selecting each choice stimulus was correspondingly high. A signal detection analysis found that sensitivity to reinforcement varied directly with retention interval. Data were also consistent with misallocation models. No evidence was found to suggest that pigeons ignore the rate at which selecting individual choice stimuli is reinforced, as has been reported in studies with human subjects.     

Procrastination by pigeons: preference for larger, more delayed work requirements.

In three experiments, pigeons chose between alternatives that required the completion of a small ratio schedule early in the trial or a larger ratio schedule later in the trial. Completion of the ratio requirement did not lead to an immediate reinforcer, but simply allowed the events of the trial to continue. In Experiment 1, the ratio requirements interrupted periods in which food was delivered on a variable-time schedule. In Experiments 2 and 3, each ratio requirement was preceded and followed by a delay, and only one reinforcer was delivered, at the end of each trial. Two of the experiments used an adjusting-ratio procedure in which the ratio requirement was increased and decreased over trials so as to estimate an indifference point--a ratio size at which the two alternatives were chosen about equally often. These experiments found clear evidence for "procrastination"--the choice of a larger but more delayed response requirement. In some cases, subjects chose the more delayed ratio schedule even when it was larger than the more immediate alternative by a factor of four or more. The results suggest that as the delay to the start of a ratio requirement is increased, it has progressively less effect on choice behavior, in much the same way that delaying a positive reinforcer reduces it effect on choice.     

Delay and number of food reinforcers: Effects on choice and latencies

Pigeons were given a choice between two identical-duration situations (terminal links of chain schedules). One terminal link of the choice pair provided two food deliveries, and the other provided five. The exact times of these food deliveries differed between the terminal links and were varied over conditions. A single response during the initial link gave immediate access to the corresponding terminal link. Forced trials, during which only one of the initial-link keys was lighted, were interspersed with choice trials during which both initial-link keys were lighted. Choice tended to favor whichever terminal link was correlated with the higher sum of the immediacies (i.e., the sum of the reciprocals of the delays to each of the reinforcers following the choice, with all delays measured from the choice). Latencies on forced trials and on choice trials also were related (negatively) to the sum of the immediacies. This correlation among response measures (choice and latencies) suggests that both measures are manifestations of the effect of conditioned reinforcement on response tendencies.     

Correspondence between saying and doing: teaching children to share and praise

Five small groups of preschool children were taught to share and praise by the modelling of these behaviors and reinforcement of their reports of sharing and praising. Experiment I demonstrated that modelling and reinforcement of any (true or untrue) reports of sharing, and then of praising, promptly increased reports of the corresponding behaviors. Modelling and reinforcement for true reports of each behavior increased both reporting and actual behavior. Experiment II showed that both reported and actual sharing and praising may be increased by modelling and reinforcement for true reports of the target behavior, without previous reinforcement for any (true or untrue) reports of those behaviors. Sharing, but not praising, generalized to a second setting. Experiment III replicated the results of Experiment II for sharing and praising, and demonstrated similar success in increasing a third behavior, specific praising. In general, these experiments show that developing correspondence between children's reports of behavior and actual behavior may be an efficient means of increasing prosocial responses.     

Concurrent performances: rate constancies without changeover delays

Pigeons' pecks on two keys were maintained, without changeover delays, by independent variable-interval schedules of food reinforcement. Four regularly cycling 2-min components scheduled reinforcement respectively for both keys, left key only, both keys, and right key only. Initially, reinforcement scheduled for one key alone produced more responding on that key than reinforcement scheduled concurrently for both keys. Continued sessions reduced this difference; response rate on a given key approached constancy, or invariance with respect to the performance on and schedule for the other key. When extinction replaced the reinforcement schedule on either key, responding on that key decreased more during components that scheduled reinforcement for the other key than during those that did not. This demonstration that responses on one key were not supported by reinforcers on the other key suggested that the alternation of concurrent responding and either-key-alone responding prevented concurrent superstitions from developing.     

Behavioral contrast of time allocation

Pigeons' standing on a platform produced food reinforcement according to two-component multiple schedules in which either both components consisted of the same variable-interval schedule or one of these was replaced with a component without reinforcement (extinction). The components of the multiple schedule alternated every 30 sec, and were signalled by changes in the color of diffuse overhead illumination. Changing the schedule of one of the components to extinction increased the percentage of time spent on the platform during the unchanged component (behavioral contrast). This result casts doubt on accounts that attribute behavioral contrast to variations in the rate of noninstrumental elicited responses.     

A comparison of pecking generated by serial, delay, and trace autoshaping procedures

Pigeons were exposed to serial, delay, and trace autoshaping procedures. In Experiment I, all conditioned stimuli (CSs) were changes in illumination of the response key. The number of trials to acquisition of the keypeck increased from serial, to 4-sec delay, 8-sec delay, and 8-sec trace procedures, in that order. In Experiment II, which used a longer intertrial interval, trials to criterion increased from 8-sec delay, to 28-sec delay, 8-sec trace, and 28-sec trace procedures, in that order. In Experiment III, two groups received serial procedures in which the first CS was either a tone or a houselight, and the second was a keylight. The tone group acquired the key peck more rapidly than the houselight group. Early in conditioning in these experiments, and when the conditioned stimulus was a change in the keylight, there was a short latency to the onset of pecking and pecking was directed at the CS. After extensive conditioning, or when the CS was relatively diffuse, pecking still occurred, but had a longer latency and was not reliably directed toward the conditioned stimulus.     

Probability and delay in commitment

In the first stage of a two-stage choice, human subjects chose between probabilistic access to a second choice (between a small high-probability reward and a large low-probability reward) and commitment to the large low-probability reward. When confronted with the second-stage choice, subjects strongly preferred the small high-probability reward. When the first-stage probability (of access to the second stage) was high, subjects strongly preferred the path leading to the choice in the second stage. But when the first-stage probability was low, subjects committed themselves to the large low-probability reward. These results parallel those obtained by Rachlin and Green (1972) with pigeons and constitute some evidence that probabilities may be interpreted as delays.