Additional-delay schedules: A continuum of temporal contingencies by varying food delay

Pigeons performed on discrete-trial, temporally defined schedules in which the food delay (D) was adjusted according to the latency of the key peck (X) and two schedule parameters (t and A). The schedule function was D = A(t − X), where D is the experienced delay between a response and a reinforcer. The schedule parameter t is the maximum value below which the present contingencies occur. A is the additional delay to reinforcement for each second the response latency is shorter than the t value. When A = 0 s, the schedule is a continuous reinforcement schedule with immediate reinforcement. When A = 1 s, the schedule is a conjunctive fixed-ratio 1 fixed-time t-s schedule. When A approaches infinity, the schedule becomes a differential reinforcement of long latency schedule. The latencies for subjects with t = 10 s and t = 30 s were observed with the present schedules having seven values for A between 0 s and 11 s. In addition, the latencies for subjects for which t = 30 s were observed at an A value of 31 s to 41 s. As the A value increased, the latencies approached the t value for subjects for which t = 10 s. The latencies for 30-s-t subjects did not approach t, even when the A value was 41 s. The latencies for 10-s-t subjects at 11-s A value were longer than those under yoked conditions having exactly the same delays/interreinforcement intervals. These results demonstrated a continuum of latency related to the schedule continuum (value of A) at a small t value.     

Dynamic equilibrium on a cyclic-interval schedule with a ramp

Five human subjects pressed a panel for money on a cyclic-interval schedule that arranged recurring periods of linearly increasing reinforcement rates (ramps). Response rate versus time functions for all subjects showed recurring periods of linearly increasing response rates. The responding of four of the five subjects was in phase with the reinforcement input. The remaining subject showed a two-minute phase shift. These results suggest that organisms may act like simple amplifiers on cyclic-interval schedules, that is, the form of the input signal is not changed by the organism, but is returned with amplification. By analogy with the variable-interval case, the controlling variable on cyclic-interval schedules with rate ramps may be the constant reinforcement acceleration that is arranged by the schedule.     

Concurrent fixed-interval variable-ratio schedules and the matching relation

Five rats responded under concurrent fixed-interval variable-ratio schedules of food reinforcement. Fixed-interval values ranged from 50-seconds to 300-seconds and variable-ratio values ranged from 30 to 360; a five-second changeover delay was in effect throughout the experiment. The relations between reinforcement ratios obtained from the two schedules and the ratios of responses and time spent on the schedules were described by Baum's (1974) generalized matching equation. All subjects undermatched both response and time ratios to reinforcement ratios, and all subjects displayed systematic bias in favor of the variable-ratio schedules. Response ratios undermatched reinforcement ratios less than did time ratios, but response ratios produced greater bias than did time ratios for every subject and for the group as a whole. Local rates of responding were generally higher on the variable-ratio than on the fixed-interval schedules. When responding was maintained by both schedules, a period of no responding on either schedule immediately after fixed-interval reinforcement typically was followed by high-rate responding on the variable-ratio schedule. At short fixed-interval values, when a changeover to the fixed-interval schedule was made, responding usually continued until fixed-interval reinforcement was obtained; at longer values, a changeover back to the variable-ratio schedule usually occurred when fixed-interval reinforcement was not forthcoming within a few seconds, and responding then alternated between the two schedules every few seconds until fixed-interval reinforcement finally was obtained.     

FUNCTIONAL COMMUNICATION TRAINING WITH AND WITHOUT EXTINCTION AND PUNISHMENT

Functional communication training has been reported to be a promising treatment for severe behavior problems. In this study, functional communication training alone and combined with extinction and/or punishment was evaluated for 4 clients with severe retardation, behavior problems, and communication deficits. The participants were inpatients on a hospital unit for treatment of severe behavior disorders. They received individualized interventions based on functional assessment that included reinforcement of a communication response with the same function as their destructive behavior. Results showed that for some patients, functional communication training was not sufficient to produce clinically significant reductions in destructive behavior, and the combination of training plus punishment produced the largest and most consistent reductions.     

Delay reduction: current status.

Delay-reduction theory states that the effectiveness of a stimulus as a conditioned reinforcer may be predicted most accurately by the reduction in time to primary reinforcement correlated with its onset. We review support for the theory and then discuss two new types of experiments that assess it. One compares models of choice in situations wherein the less preferred outcome is made more accessible; the other investigates whether frequency of conditioned reinforcement affects choice beyond the effect exerted by frequency of primary reinforcement.     

Momentary maximizing in concurrent schedules with a minimum interchangeover interval

Eight pigeons were trained on concurrent variable-interval variable-interval schedules with a minimum interchangeover time programmed as a consequence of changeovers. In Experiment 1 the reinforcement schedules remained constant while the minimum interchangeover time varied from 0 to 200 s. Relative response rates and relative time deviated from relative reinforcement rates toward indifference with long minimum interchangeover times. In Experiment 2 different reinforcement ratios were scheduled in successive experimental conditions with the minimum interchangeover time constant at 0, 2, 10, or 120 s. The exponent of the generalized matching equation was close to 1.0 when the minimum interchangeover time was 0 s (the typical procedure for concurrent schedules without a changeover delay) and decreased as that duration was increased. The data support the momentary maximizing theory and contradict molar maximizing theories and the melioration theory.     

Temporal discrimination learning of operant feeding in goldfish (Carassius auratus)

Operant temporal discrimination learning was investigated in goldfish. In the first experiment, there was a fixed daily change in illumination. Eight subjects were trained to operate a lever that reinforced each press with food. The period during which responses were reinforced was then progressively reduced until it was 1 hr in every 24. The final 1-hr feeding schedule was maintained over 4 weeks. The feeding period commenced at the same time each day throughout. The food dispensers were then made inactive, and a period of extinction ensued for 6 days. The pattern of responding suggested that the fish were able to exhibit temporal discrimination in anticipation of feeding time. This pattern of responding persisted for a limited number of days during the extinction procedure. The second experiment produced evidence that operant temporal discrimination could develop under continuous illumination.     

Social reinforcement of operant behavior in rats: a methodological note.

An apparatus was developed to study social reinforcement in the rat. Four Long-Evans female rats were trained to press a lever via shaping, with the reinforcer being access to a castrated male rat. Responding under a fixed-ratio schedule and in extinction was also observed. Social access was found to be an effective reinforcer. When social reinforcement was compared with food reinforcement under similar conditions of deprivation and reinforcer duration, no significant differences were observed.     

Determination of a behavioral transfer function: White-noise analysis of session-to-session response-ratio dynamics on concurrent VI VI schedules

Six pigeons were exposed to concurrent variable-interval schedules in which the programmed reinforcer ratios changed from session to session according to a pseudorandom binary sequence. This procedure corresponded to the stochastic identification paradigm (“white-noise experiment”) of systems theory and enabled the relation between log response ratios in the current session and log reinforcer ratios in all previous sessions to be determined. Such dynamic relations are called linear transfer functions. Both nonparametric and parametric representations of these, in the form of “impulse-response functions,” were determined for each bird. The session-to-session response ratios resulting from the session-to-session pseudorandom binary variations in reinforcer ratios were well predicted by the impulse-response functions identified for each pigeon. The impulse-response functions were well fitted by a second-order dynamic model involving only two parameters: a time constant and a gain. The mean time constant was 0.67 sessions, implying that the effects of abrupt changes in log reinforcer ratios should be 96% complete within about five sessions. The mean gain was 0.53, which was surprisingly low inasmuch as it should equal the sensitivity to reinforcement ratio observed under steady-state conditions. The same six pigeons were subjected to a similar experiment 10 months following the first. Despite individual differences in impulse-response functions between birds within each experiment, the impulse-response functions determined from the two experiments were essentially the same.     

Effects of ratio reinforcement schedules on discrimination performance by Japanese monkeys

In Experiment 1, Japanese monkeys were trained on three conditional position-discrimination problems with colors as the conditional cues. Within each session, each problem was presented for two blocks of ten reinforcements; correct responses were reinforced under continuous-reinforcement, fixed-ratio 5, and variable-ratio 5 schedules, each assigned to one of the three problems. The assignment of schedules to problems was rotated a total of three times (15 sessions per assignment) after 30 sessions of acquisition training. Accuracy of discrimination increased to a moderate level with fewer trials under CRF than under ratio schedules. In contrast, the two ratio schedules, fixed and variable, were more effective in maintaining accurate discrimination than was CRF. With further training, as asymptotes were reached, accuracy was less affected by the schedule differences. These results demonstrated an interaction between the effects of reinforcement schedules and the level of acquisition. In Experiment 2, ratio sizes were gradually increased to 30. Discrimination accuracy was maintained until the ratio reached 20; ratio 30 strained the performance. Under FR conditions, accuracy increased as correct choice responses cumulated after reinforcement.