Performance in multiple fixed-interval schedules

The performances of five pigeons were studied under a variety of multiple fixed-interval schedules in which both component duration and reinforcement rate were varied. The three series of experimental conditions were: (a) when the ratio of component durations equalled the reciprocal of the ratio of component reinforcement rates; (b) when the component durations were equal; and (c) when the ratio of component durations equalled the ratio of component reinforcement rates. Relative response rates were related to relative reinforcement rates in the same manner as in multiple variable-interval schedules, but no effect of component duration was found.     

Concurrent schedules: Interaction of reinforcer frequency and reinforcer duration

Six pigeons were trained on concurrent variable-interval schedules with unequal reinforcer durations for the two responses. The schedules arranged on the two keys were kept equal while they were varied in absolute size. As the overall reinforcer rate was increased, both response-allocation and time-allocation measures of choice showed a trend toward indifference, and measures of sensitivity to reinforcer-duration ratios significantly decreased. Recent reports have shown that the generalized matching law cannot describe the changes in behavior allocation under constant delay-, duration-, or rate-ratios when changes are made in the absolute levels of each of these variables. The present results complement these findings by demonstrating that the concatenated generalized matching law cannot describe the interactions of two reinforcer variables on behavior allocation.     

Independence of stimulus discriminability from absolute rate of reinforcement in a signal-detection procedure.

Three experiments are reported in which two pigeons were trained to detect differences in stimulus duration under varying levels of absolute rate of reinforcement. Two red stimuli, differing in duration, were arranged probabilistically on the center key of a three-key chamber. On completion of the center-key duration, the center keylight was extinguished and the two side keys were illuminated white. Correct responses were left-key pecks following the shorter duration and right-key pecks following the longer duration. In Experiment 1, relative rate of reinforcement for correct responses was held constant and absolute rate of reinforcement was varied in seven conditions from continuous reinforcement to a variable-interval 90-second schedule. In Experiment 2, relative rate of reinforcement was manipulated across three different absolute rates of reinforcement (continuous reinforcement, variable-interval 15-second, and variable-interval 45-second). Stimulus discriminability was unaffected by changes in absolute or relative rates of reinforcement. Experiment 3 showed that discriminability was also unaffected by arranging the same consequences (three-second blackout) for unreinforced correct responses and errors.     

Independence of sensitivity to relative reinforcement rate and discriminability in signal detection.

Six pigeons were trained to detect differences between two white stimuli, S1 and S2, differing in duration and arranged probabilistically on the center key of a three-key chamber. Detection performance was measured at two levels of discriminability. At one level, S1 was five seconds and S2 was thirty seconds. At the other level, S1 was twenty seconds and S2 was thirty seconds. The procedure was a standard signal-detection yes-no design in which stimulus-presentation probability was varied from .1 to .9 at both discriminability levels. On completion of the center-key stimulus, a peck on the center key darkened the center-key light and turned on the two red side keys. A left-key response was "correct" on S1 trials, and a right-key response was "correct" on S2 trials. Correct responses produced food reinforcement on a variable-ratio 1.3 schedule. Incorrect responses produced three second blackout. Discriminability was higher for the five-second versus thirty-second conditions than for the twenty-second versus thirty-second conditions, but there were no differences in sensitivity of behavior to reinforcement variation for the two stimulus pairs. Response bias was a function of the relative reinforcement rate for correct choice responses.     

Successive interresponse times in fixed-ratio and second-order fixed-ratio performance

Three rats were trained on a schedule in which every sixth response produced a timeout of 5 sec minimum duration, and food was delivered at the onset of timeout. Successive interresponse times were measured under these conditions, and also when behavior was maintained by second-order fixed-ratio and fixed-interval schedules. Under the second-order schedules, each six-response fixed-ratio component was followed by a timeout, and occasionally food was delivered at the onset of a timeout. In the fixed-ratio schedule, the successive interresponse times showed a decrease followed by an increase before food delivery, but this systematic variation in interresponse times was not found when the performance was under second-order reinforcement. Under both second-order schedules the latencies of successive components, and the successive interresponse times within each component, showed a decrease as food delivery was approached.     

Choice in a variable environment: effects of unequal reinforcer distributions

Six pigeons were trained in a procedure in which sessions included seven unsignaled components, each offering two pecking keys, and each providing a potentially different reinforcer ratio between the two keys. Across conditions, various combinations of reinforcer ratios and reinforcer-magnitude ratios were used to create unequal reinforcer distributions between the two alternatives when averaged across a session. The results extended previous research using the same basic procedure that had included only reinforcer distributions symmetrical around 1:1. Data analyses suggested that the variables controlling choice operated at a number of levels: First, individual reinforcers had local effects on choice; second, sequences of successive reinforcers obtained at the same alternative (continuations) had cumulative effects; and, third, when these sequences themselves occurred with greater frequency, their effects further cumulated. A reinforcer obtained at the other alternative following a sequence of continuations (a discontinuation) had a large effect and apparently reset choice to levels approximating the sessional reinforcer ratio.