Conjoint schedules of timeout deletion in pigeons.

This experiment attempted to bring behavior under joint control of two distinct contingencies, one that provided food and a second that extended the periods during which that food was available. Pigeons' responses on each of two keys were reinforced according to a single random-interval schedule of food presentation except during signaled timeout periods during which the schedule was temporarily disabled. By means of a conjoint schedule, responses on the initially less preferred key not only produced food but also canceled impending timeouts. When behavior came to predominate on this conjoint alternative, the consequences of responding on the two keys were reversed. Responding in 3 of 4 pigeons proved sensitive to the conjoint scheduled consequences, as evidenced by systematic shifts in response rates favoring the conjoint key. In 2 of these 3 pigeons, sensitivity to the conjoint contingency was evident under time-in:timeout ratios of 2:1 (time-in = 120 s, timeout = 60 s) and 1:5 (time-in = 30 s, timeout = 150 s), whereas for the other pigeon preference for the conjoint key was observed only under the latter sequence of conditions. There was only weak evidence of control by the conjoint scheduled consequences in the 4th subject, despite extended training and forced exposure to the conjoint alternative. The overall pattern of results is consistent with studies of timeout avoidance but also shares features in common with positively reinforced behavior.     

A COLLATERAL EFFECT OF REWARD PREDICTED BY MATCHING THEORY

Matching theory describes a process by which organisms distribute their behavior between two or more concurrent schedules of reinforcement (Herrnstein, 1961). In an attempt to determine the generality of matching theory to applied settings, 2 students receiving special education were provided with academic response alternatives. Using a combined simultaneous treatments design and reversal design, unequal ratio schedules of reinforcement were varied across two academic responses. Findings indicated that both subjects allocated higher rates of responses to the richer schedule of reinforcement, although only one responded exclusively to the richer schedule. The present results lend support to a postulation that positive reinforcement may have undesirable collateral effects that are predicted by matching theory (Balsam & Bondy, 1983).     

Choice, experience, and the generalized matching law

Five pigeons were exposed to different pairs of concurrent variable-interval, variable-interval schedules on nine experimental conditions of 30 sessions each. For every session, the parameters of the generalized matching equation were computed for the first five, six, seven, eight, and nine experimental conditions. The exponent a, both for response and time distribution, tended to decrease with increases in number of experimental conditions and to increase with number of sessions per condition, but values of k (bias) varied unsystematically. When the subjects were exposed to five new pairs of schedules, with 55 sessions per condition, the findings were confirmed. Data from the literature on the generalized matching law suggest that the variability of exponent values may be explained in part by the use of naive or experienced subjects in different investigations and by the variability in number of experimental conditions and in number of sessions per condition.     

Ratio responding as a function of concurrent avoidance schedules, yoked shocks, and ratio value

Fixed-ratio food-reinforced responding in rats was studied alone and with concurrent shock avoidance or with concurrent response-independent shocks matched to those that occurred in the avoidance condition. Under each condition, fixed-ratio size was increased over successive daily sessions. Fixed-ratio response rate generally passed through a maximum as a function of fixed-ratio size. Decreased fixed-ratio responding at values beyond the maximum occurred when (1) the time to complete a fixed ratio approximated the response-shock interval of the avoidance schedule, (2) the shock rate increased, and/or (3) the ratio requirements were so high that ratio strain occurred. Avoidance rates decreased slightly as fixed-ratio size increased.     

Quantification of rats' behavior during reinforcement periods

What is treated as a single unit of reinforcement often involves what could be called a reinforcement period during which two or more acts of ingestion may occur, and each of these may have associated with it a series of responses, some reflexive, some learned, that lead up to ingestion. Food-tray presentation to a pigeon is an example of such a “reinforcement period.” In order to quantify this behavior, a continuous-reinforcement schedule was used as the reinforcement period and was chained to a fixed-ratio schedule. Both fixed-ratio size and reinforcement-period duration were manipulated. Rats were used as subjects, food as reinforcement, and a lever press as the operant. Major findings included (a) a rapid decline in response rates during the first 15 to 20 seconds of the reinforcement periods, and (b) a strong positive relationship between these response rates and the size of the fixed ratio. Also revealed was a short scallop not normally found in fixed-ratio response patterns, whose length was a function of fixed-ratio size and reinforcement-period duration. It is suggested that rapidly fluctuating excitatory processes can account for many of these findings and that such processes are functionally significant in terms of behavioral compensation.     

SOME EFFECTS OF REINFORCEMENT SCHEDULES IN TEACHING PICTURE NAMES TO RETARDED CHILDREN1

The effects of several different schedules of primary reinforcement were compared in a picture-naming task with retarded children. In Experiment I, number of correct responses and learning rate were higher under fixed-ratio schedules than under continuous reinforcement. In Experiment II, number of correct responses and learning rate tended to be greater under intermediate than under low or high fixed-ratio schedules. In Experiment III, number of correct responses was higher under interlocking schedules, in which the response requirement increased with time following the previous reinforcement, than under comparable fixed-ratio schedules. Learning rates were generally low and, perhaps because of this, not very different under the two types of schedules in this experiment. Accuracy (i.e., proportion of trials on which correct responses occurred) was typically high and insensitive to variations in schedule and schedule parameter throughout each experiment.     

Short-component multiple schedules: effects of relative reinforcement duration

Pigeons were exposed to multiple variable-interval 2-min variable-interval 2-min schedules of food presentation in which relative duration of food presentation was manipulated. When components alternated every 5 sec and were scheduled on separate response keys, relative response rates closely matched relative reinforcement duration in three of four pigeons. On the other hand, relative response rates were insensitive to relative reinforcement duration when components scheduled on a single response key alternated every 5 sec, and when components scheduled on separate response keys alternated every 2 min. Thus, both rapid alternation and spatial separation of components were necessary to produce approximate matching of relative responding to relative reinforcement duration. This finding contrasts with previous findings that only rapid component alternation is necessary for matching when relative rate of reinforcement is manipulated.     

An analysis of rats' drinking-tube contacts under tandem and fixed-interval schedules of food presentation

Rats' lever presses and drinking-tube contacts were studied under fixed-interval schedules of food presentation and under a tandem schedule composed of three fixed intervals. One group of rats was exposed first to the tandem schedule, next to fixed-interval schedules of comparable interpellet intervals, and once again to the tandem schedule; a second group of rats was exposed first to a fixed-interval and then to the tandem schedule. Under the tandem schedule, lever presses occurred at a higher rate and were more uniformly distributed in time than under the fixed-interval schedule. Tube contacts emitted by rats exposed first to a fixed-interval schedule consisted mostly of tongue contacts, which occurred at a high rate shortly after food; tube contacts emitted by rats exposed first to the tandem schedule consisted mostly of paw contacts, which occurred at a lower rate at times other than shortly after food. Changing the schedule from fixed interval to tandem decreased the frequency of tongue contacts for all rats. Under schedules of food presentation with comparable interpellet intervals, the schedule of food presentation, rather than the rate of food delivery per se, determined the topography and temporal locus of drinking-tube contacts.     

Concurrent performances: rate constancies without changeover delays

Pigeons' pecks on two keys were maintained, without changeover delays, by independent variable-interval schedules of food reinforcement. Four regularly cycling 2-min components scheduled reinforcement respectively for both keys, left key only, both keys, and right key only. Initially, reinforcement scheduled for one key alone produced more responding on that key than reinforcement scheduled concurrently for both keys. Continued sessions reduced this difference; response rate on a given key approached constancy, or invariance with respect to the performance on and schedule for the other key. When extinction replaced the reinforcement schedule on either key, responding on that key decreased more during components that scheduled reinforcement for the other key than during those that did not. This demonstration that responses on one key were not supported by reinforcers on the other key suggested that the alternation of concurrent responding and either-key-alone responding prevented concurrent superstitions from developing.     

Effects of variations in the temporal distribution of reinforcements on interval schedule performance

Pigeons were exposed to variable-interval and fixed-interval schedules and schedules approximating variable-interval and fixed-interval schedules. The probabilities of the variable-interval and fixed-interval components in a mixed fixed-interval variable-interval schedule in Experiment I and the minimum and maximum interreinforcement intervals in Experiment II in a variable-interval schedule were manipulated to create intermediate schedule contingencies and contingencies approximating simple variable-interval or fixed-interval contingencies. Maximal control by time as defined by quantitative indices of the temporal pattern of response occurred as fixed-interval contingencies were approximated and minimal control occurred as variable-interval contingencies were approximated. Changes in the temporal pattern of response were systematically related to changes in the temporal distribution of reinforcements with both procedural definitions for manipulating the temporal distribution of reinforcements.