A COLLATERAL EFFECT OF REWARD PREDICTED BY MATCHING THEORY

Matching theory describes a process by which organisms distribute their behavior between two or more concurrent schedules of reinforcement (Herrnstein, 1961). In an attempt to determine the generality of matching theory to applied settings, 2 students receiving special education were provided with academic response alternatives. Using a combined simultaneous treatments design and reversal design, unequal ratio schedules of reinforcement were varied across two academic responses. Findings indicated that both subjects allocated higher rates of responses to the richer schedule of reinforcement, although only one responded exclusively to the richer schedule. The present results lend support to a postulation that positive reinforcement may have undesirable collateral effects that are predicted by matching theory (Balsam & Bondy, 1983).     

Choice, experience, and the generalized matching law

Five pigeons were exposed to different pairs of concurrent variable-interval, variable-interval schedules on nine experimental conditions of 30 sessions each. For every session, the parameters of the generalized matching equation were computed for the first five, six, seven, eight, and nine experimental conditions. The exponent a, both for response and time distribution, tended to decrease with increases in number of experimental conditions and to increase with number of sessions per condition, but values of k (bias) varied unsystematically. When the subjects were exposed to five new pairs of schedules, with 55 sessions per condition, the findings were confirmed. Data from the literature on the generalized matching law suggest that the variability of exponent values may be explained in part by the use of naive or experienced subjects in different investigations and by the variability in number of experimental conditions and in number of sessions per condition.     

Quantification of rats' behavior during reinforcement periods

What is treated as a single unit of reinforcement often involves what could be called a reinforcement period during which two or more acts of ingestion may occur, and each of these may have associated with it a series of responses, some reflexive, some learned, that lead up to ingestion. Food-tray presentation to a pigeon is an example of such a “reinforcement period.” In order to quantify this behavior, a continuous-reinforcement schedule was used as the reinforcement period and was chained to a fixed-ratio schedule. Both fixed-ratio size and reinforcement-period duration were manipulated. Rats were used as subjects, food as reinforcement, and a lever press as the operant. Major findings included (a) a rapid decline in response rates during the first 15 to 20 seconds of the reinforcement periods, and (b) a strong positive relationship between these response rates and the size of the fixed ratio. Also revealed was a short scallop not normally found in fixed-ratio response patterns, whose length was a function of fixed-ratio size and reinforcement-period duration. It is suggested that rapidly fluctuating excitatory processes can account for many of these findings and that such processes are functionally significant in terms of behavioral compensation.     

SOME EFFECTS OF REINFORCEMENT SCHEDULES IN TEACHING PICTURE NAMES TO RETARDED CHILDREN1

The effects of several different schedules of primary reinforcement were compared in a picture-naming task with retarded children. In Experiment I, number of correct responses and learning rate were higher under fixed-ratio schedules than under continuous reinforcement. In Experiment II, number of correct responses and learning rate tended to be greater under intermediate than under low or high fixed-ratio schedules. In Experiment III, number of correct responses was higher under interlocking schedules, in which the response requirement increased with time following the previous reinforcement, than under comparable fixed-ratio schedules. Learning rates were generally low and, perhaps because of this, not very different under the two types of schedules in this experiment. Accuracy (i.e., proportion of trials on which correct responses occurred) was typically high and insensitive to variations in schedule and schedule parameter throughout each experiment.     

Short-component multiple schedules: effects of relative reinforcement duration

Pigeons were exposed to multiple variable-interval 2-min variable-interval 2-min schedules of food presentation in which relative duration of food presentation was manipulated. When components alternated every 5 sec and were scheduled on separate response keys, relative response rates closely matched relative reinforcement duration in three of four pigeons. On the other hand, relative response rates were insensitive to relative reinforcement duration when components scheduled on a single response key alternated every 5 sec, and when components scheduled on separate response keys alternated every 2 min. Thus, both rapid alternation and spatial separation of components were necessary to produce approximate matching of relative responding to relative reinforcement duration. This finding contrasts with previous findings that only rapid component alternation is necessary for matching when relative rate of reinforcement is manipulated.     

Concurrent performances: rate constancies without changeover delays

Pigeons' pecks on two keys were maintained, without changeover delays, by independent variable-interval schedules of food reinforcement. Four regularly cycling 2-min components scheduled reinforcement respectively for both keys, left key only, both keys, and right key only. Initially, reinforcement scheduled for one key alone produced more responding on that key than reinforcement scheduled concurrently for both keys. Continued sessions reduced this difference; response rate on a given key approached constancy, or invariance with respect to the performance on and schedule for the other key. When extinction replaced the reinforcement schedule on either key, responding on that key decreased more during components that scheduled reinforcement for the other key than during those that did not. This demonstration that responses on one key were not supported by reinforcers on the other key suggested that the alternation of concurrent responding and either-key-alone responding prevented concurrent superstitions from developing.     

Effects of variations in the temporal distribution of reinforcements on interval schedule performance

Pigeons were exposed to variable-interval and fixed-interval schedules and schedules approximating variable-interval and fixed-interval schedules. The probabilities of the variable-interval and fixed-interval components in a mixed fixed-interval variable-interval schedule in Experiment I and the minimum and maximum interreinforcement intervals in Experiment II in a variable-interval schedule were manipulated to create intermediate schedule contingencies and contingencies approximating simple variable-interval or fixed-interval contingencies. Maximal control by time as defined by quantitative indices of the temporal pattern of response occurred as fixed-interval contingencies were approximated and minimal control occurred as variable-interval contingencies were approximated. Changes in the temporal pattern of response were systematically related to changes in the temporal distribution of reinforcements with both procedural definitions for manipulating the temporal distribution of reinforcements.     

Matching with a trio of concurrent variable-interval schedules of reinforcement

A trio of concurrent variable-interval schedules of reinforcement was arranged according to a changeover-key procedure, including a changeover delay of 1.5 sec. The three schedules provided a combined maximum reinforcement rate of 45 reinforcements per hour. With that restriction, the nine experimental conditions included several combinations of variable-interval schedules, sometimes including extinction. The pigeons matched relative response rate and relative time to relative reinforcement rate. Relative time appeared to match some-what better than relative response rate. Performance adjusted rapidly from one experimental condition to the next, whether the change involved two or all three schedules of the concurrent trio.     

RESPONSE REDUCTION THROUGH THE SUPERIMPOSITION OF CONTINUOUS REINFORCEMENT: A SYSTEMATIC REPLICATION

Prior clinical research suggests that superimposition and subsequent removal of a schedule of continuous reinforcement (CRF) may be a viable rate-decreasing procedure in that an extinction-like condition is arranged. The arrangement of similar conditions in the laboratory, however, resulted in the quick recovery of baseline rates. Lever-pressing patterns of eight male rats maintained by different schedules of variable-ratio and variable-interval food reinforcement were examined in an A-B-A experimental design of CRF food superimposition and removal. Responding was substantially reduced during the superimposition of CRF. Upon removal of the superimposed schedule, responding quickly approached presuperimposition baseline rates.     

Psychological distance to reward: A human replication

Choice behavior in college students was examined in two experiments using the concurrent-chains procedure. In both experiments, the concurrent chains were presented on a microcomputer in the form of an air-defense game in which subjects used two radar systems to detect and subsequently destroy enemy aircraft. Access to one of two radar systems was controlled by a pair of independent concurrent variable-interval 60-s schedules with a 4-s changeover delay always in effect. In the terminal link, the appearance of an enemy aircraft was determined by a pair of differentially segmented fixed-time schedules (Experiment 1) or fixed-interval schedules (Experiment 2) of equal overall duration. In Experiment 1, the terminal-link duration was either 20 s or 40 s, and subjects preferred the unsegmented to the segmented intervals. In Experiment 2, the duration was either 10 s or 60 s, and the reinforcement contingencies required responding during the terminal link. Prior to the reinstatement of the initial link, subjects estimated the duration of the terminal-link schedule. Segmentation affected choice in the 60-s conditions but not in the 10-s ones. Preference for the unsegmented schedule was correlated with an overestimation of the durations for the segmented schedules. These results replicated those found in animal experiments and support the notion of increasing the psychological distance to reward by segmenting a time-based schedule of reinforcement.