An eight-alternative concurrent schedule: foraging in a radial maze.

In two experiments conducted in an eight-arm radial maze, food pellets were delivered when a photocell beam was broken at the end of each arm via a nose poke, according to either fixed-interval or random-interval schedules of reinforcement, with each arm providing a different frequency of reinforcement. The behavior of rats exposed to these procedures was well described by the generalized matching law; that is, the relationships between log behavior ratios and log pellet ratios were approximated by linear functions. The slopes of these log-log functions, an index of sensitivity to reinforcement frequency, were greatest for nose pokes, intermediate for time spent in an arm, and least for arm entries. Similar results were obtained with both fixed-interval and random-interval schedules. Addition of a 10-s changeover delay in both experiments eliminated the slope differentials between nose pokes and time spent in an arm by reducing the slopes of the nose-poke functions. These results suggest that different aspects of foraging may be differentially sensitive to reinforcement frequency. With concurrent fixed-interval schedules, the degree of temporal control exerted by individual fixed-interval schedules was directly related to reinforcement frequency.     

Effects of two levels of procedural fidelity with constant time delay on children's learning

The purpose of this study was to compare the effects of constant time delay delivered with high procedural fidelity to constant time delay with high procedural fidelity on all variables except delivery of the controlling prompt (i.e., on a mean of 44% of the trials, the controlling prompt was not delivered when it should have been provided). Six preschool children with disabilities were taught to identify photographs in two alternating conditions (e.g., high procedural fidelity and low procedural fidelity). An adapted alternating treatments design was used to evaluate the instructional conditions on the effectiveness and efficiency of instruction. In addition, daily measures were taken of the teacher's implementation of each step of the constant time delay procedures which indicated that the two conditions were implemented as planned. The results indicate that both conditions were effective for four children; for three of these, the high procedural fidelity condition resulted in more efficient learning. For the fifth child, the high-fidelity condition resulted in criterion level responding, but the low fidelity condition did not. However, when the high fidelity procedure and trial-by-trial reinforcement were used for the low-fidelity stimuli, these also were acquired. For the sixth child, neither procedure was effective; thus, the high fidelity condition was used alone and resulted in learning. The results are discussed in terms of using the constant time delay procedure and studying the procedural fidelity of other strategies.     

Efficacy of constant time delay implemented by peer tutors in general education classrooms

We evaluated the effects of teaching 13 typically developing children to use constant time delay when tutoring three of their peers who had substantial disabilities. We measured the extent to which the tutors used the constant time delay procedure correctly and the tutees' correct performance on the skills being taught. A multiple probe design across behaviors was used. The results indicated that (a) the tutors used each step of the constant time delay with a high degree of procedural fidelity; (b) the students with disabilities acquired the skills that were taught during peer tutoring; and (c) modifications of the procedure were required for 2 of the 3 students with disabilities, and the peers tutors were able to implement the modifications. Implications for practice and future research are described.     

Delayed signal detection, differential reinforcement, and short-term memory in the pigeon.

In two discrete-trial delayed-detection experiments, six pigeons were trained on dependent concurrent variable-interval schedules. Pecking a red side key was reinforced when the brighter of two white lights (S1) had been presented on the center key, and pecking a green side key was reinforced when the duller of two white lights (S2) had been presented on the center key. Incorrect responses were red side-key pecks following S2 presentations and green side-key pecks following S1 presentations; these resulted in three-second blackouts. In Experiment 1, the time between presentation of S1 or S2 on the center key and the onset of the red and green side keys was varied nonsystematically from 0.06 seconds to 19.69 seconds across experimental conditions. Stimulus discriminability decreased as the stimulus-choice delay increased. A rectangular-hyperbolic function better described this decrease in discriminability over time than did a negative-exponential function. In Experiment 2, at each of three stimulus-choice delays (0.06, 3.85, and 10.36 seconds), relative reinforcer frequency for correct responses to the red and green side keys was varied by changing the values of the dependent concurrent variable-interval schedules. The sensitivity of choice to relative reinforcer frequency was independent of the decrease in stimulus discriminability with increasing stimulus-choice delay.     

Memory for two stimulus-response items in pigeons

Six pigeons served in a discrete-trial experiment on short-term memory. Combinations of three key positions and two ordinal positions, yielding six possible sequences of stimulus-response pairs, were used as lists of items. A retention interval separated list presentation from the test phase in which two (for Group 1) or three (for Group 2) keys were illuminated with either red or green light. A reinforcer was delivered if a subject pecked the key of the first item on a red trial and the key of the second item on a green trial. When the retention interval was lengthened from one to five or nine seconds, a systematic loss of stimulus control resulted. Lengthening the interval between items from one to eight seconds had a much smaller effect for the birds in Group 1, whereas a systematic loss of stimulus control was found in red trials for the birds in Group 2. The functional relations between choice accuracy and delay provided an empirical basis for analysis of what relations among temporal events can become discriminative stimuli.     

Choice and the relative immediacy of reinforcement

The relative immediacy of reinforcement in concurrent-chain schedules was varied while the relative reduction in the overall average time to reinforcement associated with terminal-link entry was held constant. For each of four pigeons, choice did not vary with relative immediacy of reinforcement. Subsequently, choice by the same subjects was shown to be sensitive to relative reduction in average time to reinforcement.     

Delay and amount of reward in a concurrent chain

Eight pigeons responded under a concurrent-chain schedule for rewards differing in both delay and amount, the larger reward being associated with the longer delay. Preference was examined as the absolute durations of the terminal-link delays were increased at four different delay ratios. Difficulties with other experiments of this type were controlled for by the use of (a) a single-tape initial link to equalize terminal-link entries, (b) a blackout following the more immediate reward to equalize terminal-link length, and (c) a photocell to measure reinforcer duration more accurately. Preference for the larger reward changed systematically as delays increased in all conditions, decreasing for the 6:1, 3:1, and 3:2 ratios, and increasing for the 1:1 ratio. These results were similar to, but significantly different from, those of previous investigations. The implications of these results for various models of concurrent-chain behavior are discussed.     

Reinforcement of inhibition

A differential-reinforcement-of-other-behavior (DRO) schedule with trials and delayed reinforcement was investigated. Periodically a wheel was briefly available to rats, followed six seconds later by brief availability of a bar. Variable-ratio food reinforcement of wheel turns was adjusted to give 95% turns. After variable-ratio-five reinforcement of bar presses produced 100% pressing, then separate ratio schedules were used for presses following turns (turn presses) and presses following nonturns (nonturn presses). Increasing nonturn-press reinforcements decreased turns, even though total reinforcements increased. Reversal by decreasing nonturn-press reinforcements raised turns, though with hysteresis. Thus food reinforcement increased nonturns even though delayed six to ten seconds after nonturns, a delay that greatly reduces response reinforcement. Those and other results indicate that the turn decrease was not due to reinforcement of competing responses. Evidence against other alternatives, and the reduction of responding by increased reinforcement, indicate that the term inhibition is appropriate for the phenomenon reinforced. Response-specific inhibition appears appropriate for this particular kind, since its effects are more specific to particular responses than Pavlovian conditioned-inhibition. Response-specific inhibition seems best considered a behavioral output comparable to responses (e.g., both reinforcible) but with important properties different from responses (e.g., different reinforcement-delay gradients).     

Bias and sensitivity to reinforcement in a concurrent-chain schedule

Six pigeons were trained on concurrent-chain schedules in which the initial links were either dependent (Experiment 1) or independent (Experiment 2) concurrent variable-interval schedules and the terminal links were fixed-duration delays to reinforcement in blackout. A changeover delay of three seconds operated in the initial links. Both the initial- and terminal-link schedule values were varied over 61 experimental conditions. An analysis of the data using the generalized matching law showed that the sensitivity of initial-link response allocation to the frequency of terminal-link production was independent of both the duration of the terminal-link delays and, though less clearly, of the duration of the initial-link schedules. Sensitivity of initial-link response allocation to terminal-link reinforcer-rate ratios was a joint function of the terminal-link durations and the smaller average initial-link duration. The results showed that the generalized matching law is useful in analyzing concurrent-chain schedule performance and that a changeover delay in the initial links eliminates some terminal- to initial-link interactions that have made quantitative predictions for concurrent-chain performances difficult.     

Preference for signaled versus unsignaled reinforcement delay in concurrent-chain schedules

A concurrent-chain schedule was employed to examine pigeons' preferences for signaled versus unsignaled delay of reinforcement in which the delay durations ranged from zero to ten seconds. In general, pigeons preferred signaled delay over unsignaled delay especially when a variable-interval 30-second schedule operated in each initial link; when a variable-interval 90-second schedule operated in each initial link, these preferences tended toward indifference or were attenuated. In addition, prior training seemed to exert partial control over behavior. Responding in the terminal link was higher under signaled delay than unsignaled delay in a majority of the cases. Moreover, response rates under signaled delay remained fairly constant whereas responding under unsignaled delay was initially high, but decreased systematically with delay durations as short as 2.5 seconds. These results are consistent with a number of other studies demonstrating the significant role of a signal for impending positive stimuli.