Choice: Effects of changeover schedules on concurrent performance

The components of concurrent schedules were separated temporally by placing interval schedules on the changeover key. The rates of responding on both the main and changeover keys were examined as a function of the reinforcement rates. In the first experiment, the sensitivity of main-key performance to changing reinforcement rates was inversely related to the temporal separation of components, and changeover performance was monotonically related to the ratio of the reinforcement rates. In the second experiment, when the ratio of the reinforcement rates was scheduled to remain constant while the frequency of reinforcement was varied, changeover performance did not remain constant. A “sampling” interpretation of changeover responding was proposed and subsequently tested in a third experiment where extinction was always scheduled in one component and the frequency of reinforcement was varied in the second component. It was concluded that changeover performance can be interpreted using molar measures of reinforcement and that animals sample activities available to them at rates which are controlled by relative reinforcement rates.     

Transfer of matching performance in pigeons.

Three pigeons were given extensive training on three-key simultaneous matching problems using geometric-form and hue stimuli. After acquisition of matching, the birds were tested with pairs of stimuli involving one or both novel members. Matching during the test stimuli occurred less often than during the later stages of the acquisition phase, but more often than would occur if no transfer had taken place. Greater positive transfer was observed for problems that involved one, rather than two, novel stimuli. In the second phase of the experiment, previously trained birds were shifted to problems that required symbolic matching, i.e., the pigeons had to associate a particular center-key stimulus with a particular side-key stimulus. On each trial, one of two simuli was presented on the center key, and two other stimuli, different from those used on the center key, were displayed on the side keys. When the problem shift was introduced, correct responding was impaired, but remained considerably above chance level and quickly recovered in following sessions. The results were interpreted as favoring a stimulus-response-chaining account of matching behavior.     

IMPROVING THE GENERALIZED MNEMONIC PERFORMANCE OF A DOWN'S SYNDROME CHILD1

A training program was conducted to improve the generalized mnemonic performance, or memory, of a Down's Syndrome child. Training was directed at digit-span performance with generalization from training determined by responses to untrained mnemonic performance probes. The digit-span items varied in length from three to five digits. Each length constituted an item class, with each class trained within the framework of a multiple-baseline design. Probes consisted of untrained digit-span items, grammatical sentences, nongrammatical sentences, and match-to-sample items. A training procedure, in which 15 items from each class varied continually from trial to trial and from day to day, resulted in the percentage of correct responses to both training and probe items increasing to levels substantially above baseline. The results demonstrate the effectiveness of the training procedure in improving the generalized mnemonic performance of a Down's Syndrome child.     

Delay-interval illumination changes interfere with pigeon short-term memory.

Pigeons acquired a successive depayed matching-to-sample task at delay intervals ranging from 2.5 to 7 seconds. Test sessions were conducted during which delay-interval illumination conditions were changed from those illumination conditions that prevailed during the baselines. Compared to baseline delayed matching performance, changing delay-interval illumination disrupted matching. This disruption occurred whether the change in delay-interval illumination represented an increase or a decrease, relative to the baseline, and whether there was or was not a change in illumination during the test session. It was concluded that illumination per se introduced during delay intervals of delayed matching tasks does not interfere with pigeon short-term memory. Rather, a change in delay-interval illumination, relative to the baseline, appears to retroactively interfere in pigeon short-term memory.     

Economic concepts for the analysis of behavior

A review of the relationship between schedule of reinforcement, response rate, and choice suggests that certain unifying concepts from economics can contribute to a more complete science of behavior. Four points are made: 1) a behavioral experiment is an economic system and its characteristics—open or closed—can strongly determine the results; 2) reinforcers can be distinguished by a functional property called elasticity; 3) reinforcers may interact as complements as well as substitutes; 4) no simple choice rule, such as strict matching, can account for all choice behavior.     

Matching, contrast, and equalizing in the concurrent lever-press responding of rats

Five rats pressed levers for food reinforces delivered by several concurrent variable-interval variable-interval schedules. The rate of reinforcement available for responding on one component schedule was held constant at 60 reinforcers per hour. The rate of reinforcement available for responding on the other schedule varied from 30 to 240 reinforcers per hour. The behavior of the rats resembled the behavior of pigeons pecking keys for food reinforcers. The ratio of the overall rates of responding emitted under, and the ratio of the time spent responding under, the two components of each concurrent schedule were approximately equal to the ratio of the overall rates of reinforcement obtained from the components. The overall rate of responding emitted under, and the time spent responding under, the variable component schedule varied directly with the overall rate of reinforcement from that schedule. The overall rate of responding emitted under, and the time spent responding under, the constant component schedule varied inversely with the overall rate of reinforcement obtained from the variable component. The local rates of responding emitted under, and the local rates of reinforcement obtained from, the two components did not differ consistently across subjects. But they were not exactly equal either.     

Avoidance based on shock intensity reduction with no change in shock probability

Rats were trained on a free-operant avoidance procedure in which shock intensity was controlled by interresponse time. Shocks were random at a density of about 10 shocks per minute. Shock probability was response independent. As long as interresponse times remained less than the limit in effect, any shocks received were at the lower of two intensities (0.75 mA). Whenever interresponse times exceeded the limit, any shocks received were at the higher intensity (1.6 mA). The initial limit of 15 seconds was decreased in 3-second steps to either 6 or 3 seconds. All animals lever pressed to avoid higher intensity shock. As the interresponse time limit was reduced, the response rate during the lower intensity shock and the proportion of brief interresponse times increased. Substantial warmup effects were evident, particularly at the shorter interresponse-time limits. Shock intensity reduction without change in shock probability was effective in the acquisition and maintenance of avoidance responding, as well as in differentiation of interresponse times. This research suggests limitations on the generality of a safety signal interpretation of avoidance conditioning.     

Concurrent random-interval schedules and the matching law

In Experiment I, a group of eight pigeons performed on concurrent random-interval schedules constructed by holding probability equal and varying cycle time to produce ratios of reinforcer densities of 1:1, 3:1, and 5:1 for key pecking. Schedules for a second group of seven were constructed with equal cycle times and unequal probabilities. Both groups deviated from simple matching, but the two forms of the schedules appeared to produce no consistent patterns of deviation. The data were found to be consistent with those obtained in concurrent variable-interval situations. The parameters of the matching equation in the form of Y=k X^a were estimated; the value of k was unity and a was 0.84. In Experiment II, six pigeons were exposed to two conc RI RI schedules in which one component increasingly approximated an FI schedule. The value of k was not 1.0. Concurrent RI RI schedules were shown to represent a continuum from conc FI VI to conc VI VI schedules. The use of the exponential equation in testing “matching laws” suggests that a<1 will continue to be observed, and this will set limits on the form of new laws and the assumed or rational values of the component variables in these laws.     

Matching in concurrent variable-interval avoidance schedules

After pretraining with multiple variable-interval avoidance schedules, two rats were exposed to a series of concurrent variable-interval avoidance schedules. Responses on two levers cancelled delivery of electric shocks arranged according to two independent variable-interval schedules. The ratio of responses and time spent on the two levers approximately matched the ratio of shocks avoided on each. Matching to the number of shocks received was not obtained. Concurrent variable-interval avoidance can therefore be added to the group of positive and negative reinforcement schedules that can be expressed in the quantitative framework of the matching law.     

Multiple schedule component duration: a reanalysis of Shimp and Wheatley (1971) and Todorov (1972)

The tendency for relative response rate to approach matching as multiple schedule component duration decreases has been interpreted as confirming a prediction of Herrnstein's multiple schedule equation. However, the equation predicts that absolute response rate will decrease in both multiple schedule components as component duration decreases. The absolute response-rate data of two studies of component duration do not support this prediction; absolute rate either increased or remained relatively constant.