Concurrent schedules: Interaction of reinforcer frequency and reinforcer duration

Six pigeons were trained on concurrent variable-interval schedules with unequal reinforcer durations for the two responses. The schedules arranged on the two keys were kept equal while they were varied in absolute size. As the overall reinforcer rate was increased, both response-allocation and time-allocation measures of choice showed a trend toward indifference, and measures of sensitivity to reinforcer-duration ratios significantly decreased. Recent reports have shown that the generalized matching law cannot describe the changes in behavior allocation under constant delay-, duration-, or rate-ratios when changes are made in the absolute levels of each of these variables. The present results complement these findings by demonstrating that the concatenated generalized matching law cannot describe the interactions of two reinforcer variables on behavior allocation.     

Some effects of response-correlated increases in reinforcer magnitude on human behavior

After training under short or long fixed-interval schedules, humans responded under a modified fixed-interval schedule in which magnitude of reinforcement (X or 2X) was minimally correlated with response frequency. Response frequencies that equaled or exceeded a minimum response criterion were followed by the larger reinforcer at the end of the interval; otherwise, the smaller reinforcer was delivered. The modified schedule alternated with the baseline schedule across conditions. In a control condition, the reinforcer magnitudes produced by control subjects were yoked to those of experimental subjects. Experimental subjects, but not control subjects, showed increased responding. In addition to the baseline and modified fixed-interval schedules used in Experiment 1, subjects in Experiment 2 also responded under a second modified fixed-interval contingency in which increases in reinforcer magnitude were more highly correlated with response frequency. Experimental subjects, but not control subjects, showed increased responding under both procedures. Direct comparison of these two procedures showed that the high-correlation procedure produced greater increases in responding than did the low-correlation procedure.     

Determinants of pausing under variable-ratio schedules: Reinforcer magnitude, ratio size, and schedule configuration

Pigeons pecked a key under two-component multiple variable-ratio schedules that offered 8-s or 2-s access to grain. Phase 1 assessed the effects of differences in reinforcer magnitude on postreinforcement pausing, as a function of ratio size. In Phase 2, postreinforcement pausing and the first five interresponse times in each ratio were measured as a function of differences in reinforcer magnitude under equal variable-ratio schedules consisting of different configurations of individual ratios. Rates were also calculated exclusive of postreinforcement pause times in both phases. The results from Phase 1 showed that as ratio size increased, the differences in pausing educed by unequal reinforcer magnitudes also increased. The results of Phase 2 showed that the effects of reinforcer magnitude on pausing and IRT durations were a function of schedule configuration. Under one configuration, in which the smallest ratio was a fixed-ratio 1, pauses were unaffected by magnitude but the first five interresponse times were affected. Under the other configuration, in which the smallest ratio was a fixed-ratio 7, pauses were affected by reinforcer magnitude but the first five interresponse times were not. The effect of each configuration seemed to be determined by the value of the smallest individual ratio. Rates calculated exclusive of postreinforcement pause times were, in general, directly related to reinforcer magnitude, and the relation was shown to be a function of schedule configuration.     

Within-session meal-size effects on induced drinking.

As a control for the effects of session duration and hunger on the relation between food magnitude and induced drinking, four food-deprived rats were exposed to a variable-time 50-s schedule of food delivery in which the size of each food delivery varied randomly within sessions. Food-related behavior and schedule-induced drinking per opportunity were examined as functions of meal size and postfood time. All rats showed an inverted-U-shaped relation between drinking per opportunity and meal size. This relation was caused by variation in the percentage of intervals that contained drinking and by variation in the number of drinking bouts per interval, rather than by bout duration or by the amount of drinking within those intervals that actually contained drinking. Head-in-feeder time increased linearly with meal size. Schedule-induced drinking was entrained by food delivery in 3 of 4 subjects; the entrainment was due to regulation of the starting time of each drinking bout rather than to regulation of bout duration.     

Sensitivity to reinforcer duration in a self-control procedure

In a concurrent-chains procedure, pigeons' responses on left and right keys were followed by reinforcers of different durations at different delays following the choice responses. Three pairs of reinforcer delays were arranged in each session, and reinforcer durations were varied over conditions. In Experiment 1 reinforcer delays were unequal, and in Experiment 2 reinforcer delays were equal. In Experiment 1 preference reversal was demonstrated in that an immediate short reinforcer was chosen more frequently than a longer reinforcer delayed 6 s from the choice, whereas the longer reinforcer was chosen more frequently when delays to both reinforcers were lengthened. In both experiments, choice responding was more sensitive to variations in reinforcer duration at overall longer reinforcer delays than at overall shorter reinforcer delays, independently of whether fixed-interval or variable-interval schedules were arranged in the choice phase. We concluded that preference reversal results from a change in sensitivity of choice responding to ratios of reinforcer duration as the delays to both reinforcers are lengthened.     

DOES CONTINGENT REINFORCEMENT STRENGTHEN OPERANT BEHAVIOR?

In Experiment 1, pigeons were trained to peck keys with equal food-reinforcement schedules in components that ended with either noncontingent or contingent transitions to a third component with a five-fold richer schedule. Response rates were higher in the initial component with contingent transitions, but resistance to prefeeding or extinction was not consistently greater. Experiment 2 also included noncontingent or contingent transitions to a signaled period of nonreinforcement. There was no effect of the contingency on transitions to nonreinforcement, but the difference in response rates maintained by contingent versus noncontingent transitions to the richer schedule was replicated. In addition, response rates were higher in components that preceded nonreinforcement than in components that preceded the richer schedule. However, resistance to extinction was greater for noncontingent transitions to the richer schedule than to nonreinforcement, implicating stimulus–reinforcer relations in the determination of resistance to change. Resistance to change was also somewhat greater for noncontingent than for contingent transitions to the richer schedule. The latter result, together with the results of Experiment 1 and related research, suggests that response-contingent reinforcement does not increase resistance to change.     

On the distinction between open and closed economies.

Open and closed economies have been assumed to produce opposite relations between responding and the programmed density of reward (the amount of reward divided by its cost). Experimental procedures that are treated as open economies typically dissociate responding and total reward by providing supplemental income outside the experimental session; procedures construed as closed economies do not. In an open economy responding is assumed to be directly related to reward density, whereas in a closed economy responding is assumed to be inversely related to reward density. In contrast to this predicted correlation between response-reward relations and type of economy, behavior regulation theory predicts both direct and inverse relations in both open and closed economies. Specifically, responding should be a bitonic function of reward density regardless of the type of economy and is dependent only on the ratio of the schedule terms rather than on their absolute size. These predictions were tested by four experiments in which pigeons' key pecking produced food on fixed-ratio and variable-interval schedules over a range of reward magnitudes and under several open- and closed-economy procedures. The results better supported the behavior regulation view by showing a general bitonic function between key pecking and food density in all conditions. In most cases, the absolute size of the schedule requirement and the magnitude of reward had no effect; equal ratios of these terms produced approximately equal responding.     

Choice, relative reinforcer duration, and the changeover ratio

Relative reinforcer duration was varied in concurrent schedules with a fixed-ratio four changeover requirement. The schedule in effect after each reinforcer was randomly chosen. For all three pigeons, relative response rates overmatched relative reinforcer durations. Time allocation was less extreme and, on the average, matched relative reinforcer duration. In a subsequent manipulation, the level of preference was shown to depend on the size of the changeover requirement. These results are similar to those from related unequal reinforcement-frequency procedures.     

Autoshaped key pecking maintained by access to a social space.

When four experimentally naive pigeons were exposed to occasional forward pairings of a keylight followed by a doorlight (that signaled access to a large social space), all subjects began to peck the lit key. In a second experiment, where the keylight either preceded the presentation of the doorlight or was presented independently of it, key pecking was maintained only in the former circumstance. The unconditioned stimulus in these experiments--arrival in the social space--did not elicit pecking. Hence, the conditioned response of key pecking and the unconditioned response of entering the social space differed. This demonstration of autoshaping with a social-space unconditioned stimulus argues against a stimulus-substitution account of the findings.     

Confirmation of linear system theory prediction: Rate of change of Herrnstein's kappa as a function of response-force requirement

Four human subjects worked on all combinations of five variable-interval schedules and five reinforcer magnitudes (¢/reinforcer) in each of two phases of the experiment. In one phase the force requirement on the operandum was low (1 or 11 N) and in the other it was high (25 or 146 N). Estimates of Herrnstein's κ were obtained at each reinforcer magnitude. The results were: (1) response rate was more sensitive to changes in reinforcement rate at the high than at the low force requirement, (2) κ increased from the beginning to the end of the magnitude range for all subjects at both force requirements, (3) the reciprocal of κ was a linear function of the reciprocal of reinforcer magnitude for seven of the eight data sets, and (4) the rate of change of κ was greater at the high than at the low force requirement by an order of magnitude or more. The second and third findings confirm predictions made by linear system theory, and replicate the results of an earlier experiment (McDowell & Wood, 1984). The fourth finding confirms a further prediction of the theory and supports the theory's interpretation of conflicting data on the constancy of Herrnstein's κ.