The conditioned reinforcement of repeated acquisition

Three monkeys were trained to emit a chain of three responses on three separate levers in a set of six levers to obtain food. The chain producing food (correct chain) was changed each day. During a trial, a press on any lever produced a feedback stimulus; a press on a correct lever produced an additional distinctive stimulus; the third correct press produced a food pellet. Test sessions in which either the food or the distinctive stimuli were removed were interspersed with baseline sessions. In tests without food presentations, the subjects acquired the correct chain rapidly, with a level of accuracy comparable to baseline. Removing the distintive stimuli for either the first or second member of the correct chain greatly retarded acquisition of that member of the chain. Removing all distinctive stimuli often reduced accuracy throughout the chain to chance level, even though food was presented following each correct chain. These results were interpreted as evidence that the distinctive stimuli presented after correct responses functioned as conditioned reinforcers. Reductions in accuracy following an omitted distinctive stimulus indicated that they were also discriminative stimuli for correct responding in their presence.     

The effect of reinforcement differences on choice and response distribution during stimulus compounding

In Experiments I and II, rats were trained to respond on one lever during light and another during tone. The absence of tone and light controlled response cessation. In the multiple schedule of Experiment I, all reinforcements were received for responding in tone or light; in the chain schedule of Experiment II, all reinforcements were received in no tone + no light for not responding. Experiment I subjects, for which tone and light were associated with response and reinforcement increase, responded significantly more to tone-plus-light than to tone or light alone (additive summation). Experiment II subjects, for which tone and light were associated with response increase and reinforcement decrease, responded comparably to tone, light, and tone + light. Thus, additive summation was observed when stimulus-response and stimulus-reinforcer associations in tone and light were both positive, but not when they were conflicting. All subjects in both experiments responded predominantly on the light-correlated lever during tone + light, even when light intensity was reduced in testing. Furthermore, when a light was presented to a subject engaged in tone-associated responding, all subjects immediately switched the locus of responding to the light-correlated lever. No change in locus occurred when a tone was presented to a subject engaged in light-associated responding, irrespective of the stimulus-reinforcer association conditioned to tone. The light-lever preference in tone + light indicates that the heightened responding observed in Experiment I was not the summation of tone-associated behavior with light-associated behavior. Rather, it appears to be the result of a facilitation of one operant (light-associated responding) by the reinforcement-associated cue for the other.     

Schedules of food postponement: II. Maintenance of behavior by food postponement and effects of the schedule parameter

In Experiment I, food-deprived, feeder-trained squirrel monkeys pressed a lever to postpone brief electric shocks (Response-Shock=Shock-Shock interval=30 seconds). Forty-one three-hour sessions of shock postponement were followed by 120 sessions of concurrent shock and food postponement. The shock schedule was unchanged and the food schedule was Response-food interval–20 seconds, Food-food interval 10 seconds. After concurrent shock and food postponement, the shock schedule was discontinued and 40 sessions of food postponement ensued, followed by 53 sessions of extinction. After extinction, food postponement was resumed for 11 sessions. Stable responding with low food rates was maintained under food-postponement after the concurrent schedule. Responding decreased to low levels under extinction and recovered immediately to previous levels when the food-postponement schedule was re-instated. In Experiment II, a parameter of the food-postponement schedule was studied sequentially. Using the same subjects, the Response-food–Food-food interval was manipulated from four seconds to 80 seconds with several orders of presentation. Relations of response rates and food rates to the parameter were similar to those seen under shock postponement. Exposure to very short postponement times (four seconds), resulting in very high food rates, decreased but did not abolish subsequent responding at longer postponement times. Results are discussed from the point of view that reinforcing functions of stimuli consequent on responding depend on a prior history of scheduled contact with those stimuli.     

Time limits for completing fixed ratios. IV. Components of the ratio

Pigeons received food after completing a fixed ratio if the temporal properties of responding exceeded minimum duration requirements. In one set of conditions, a minimum time had to elapse before the first response of the ratio (the initial pause). In another set, the minimum duration was the time between the first and last response of the ratio. Obtained times increased as a power function of required times in both conditions. The power function resembled that occurring in experiments involving temporal differentiation of individual responses, interresponse times, latencies, and entire fixed-ratio sequences. Moreover, in all of these experiments individual performances could be described as a function of the base duration (the duration occurring in the absence of temporal requirements) and the specific time requirement. Control conditions indicated that the effects resulted from temporal requirements and not from reinforcer intermittency.     

Contrast, induction, facilitation, suppression, and conservation

Ten rats received all of their water in daily 1-hr sessions. Following a baseline phase in which lever and water spout were freely available throughout each session, subjects were trained to press the lever for water on mixed schedules composed of two alternating components. Each component gave access to water for a fixed cumulation of drinking time every time the rat cumulated a fixed amount of lever-pressing time. Changes in one component produced contrast and induction effects, both positive and negative, with respect to both lever pressing and drinking in the unchanged component. All schedules facilitated lever pressing relative to baseline. All schedules suppressed drinking relative to baseline, even though contingency sessions allowed ample time to perform the baseline amount of drinking. The entire pattern of results was predicted in quantitative detail by assuming that the total amount of a dimension apportioned to lever pressing and drinking is conserved between baseline and contingency sessions. Conservation theory was shown to predict several effects produced by simple fixed-ratio schedules, and was compared favorably with probability-differential (Premack, 1971) and response-deprivation (Timberlake and Allison, 1974) theory.     

Local contrast and Pavlovian induction

Two experiments examined the effects of number and similarity of stimuli on local contrast. In the first experiment, local contrast effects differed in magnitude as a function of the similarity among stimuli; greater positive local contrast appeared when stimuli were less similar, though this effect sometimes reversed for very dissimilar stimuli. In the second experiment, both positive and negative local contrast appeared transiently during the course of training a discrimination including two quite dissimilar stimuli. When two new stimuli were added, both effects reappeared in several cases. The effects remained when the discrimination was rendered more difficult by substituting a new stimulus very similar to one of the original pair. These and other data suggest that local contrast depends on the same factors that produce Pavlovian induction; in the absence of an alternative account, Pavlov's interpretation may be useful in suggesting further research that will help identify the mechanisms involved in both classical and operant discrimination learning.     

Comparison of drug effects on fixed-ratio performance and chain performance maintained under a second-order fixed-ratio schedule.

In one component of a multiple schedule, pigeons were required to complete the same four-response chain each session by responding sequentially on three identically lighted keys in the presence of four successively presented colors (chain performance). Food presentation occurred after five completions of the chain (i.e., after 20 correct responses). Errors, such as responding on the center or right key when the left was designated correct, produced a brief timeout but did not reset the chain. In the other component, responding on a single key (lighted white) was maintained by food presentation under a fixed-ratio 20 schedule. In general, phencyclidine and d-amphetamine produced dose-dependent decreases in the overall response rates in both components. With pentobarbital, overall rate in each component generally increased at intermediate doses and decreased at higher doses. All three drugs produced dose-dependent disruptive effects on chain-performance accuracy. Phencyclidine and pentobarbital increased percent errors at doses that had little or no rate-decreasing effects, whereas d-amphetamine generally increased percent errors only at doses that substantially decreased overall rate. At high doses, all three drugs produced greater disruption of chain performance than of fixed-ratio performance, as indicated by a slower return to control responding, although the effects of d-amphetamine were less selective than those of phencyclidine or pentobarbital.     

Positive and negative contrast as a function of component duration for key pecking and treadle pressing

Pigeons responded on several multiple schedules for food reinforcers. The duration of the components varied from four seconds to 16 minutes. The absolute size of positive (Experiment 1) and negative (Experiment 2) behavioral contrast varied inversely with component duration when key pecks produced the reinforcers. The absolute size of negative contrast varied directly with component duration, when treadle presses produced the reinforcers (Experiment 3). These results conform to theories that suggest that positive and negative contrast are symmetrical when pigeons peck keys. They also conform to theories that suggest that the same principles do not govern contrast when pigeons peck keys as when they press treadles. Finally, the results support the measurement of behavioral contrast by the differences between baseline rates of responding and the rates emitted when contrast is present.     

An invariant relation between changing over and reinforcement

Although concurrent schedules may arrange reinforcers irregularly, relatively large numbers of reinforcers are obtained when an animal changes from one schedule to the other. This paper proposes a quantitative relation that predicts the proportion of reinforcers obtained when an animal is working on a schedule and the proportion when the animal changes over to a schedule. Basically the relation states that the number of reinforcers obtained while an animal works on a schedule varies directly with the relative amount of time spent working on that schedule; and the number of reinforcers obtained when an animal changes to a schedule varies directly with the relative amount of time spent on the alternate schedule. An important aspect of this relation is that when relative reinforcement rates are less than .50, more reinforcers are obtained just after an animal changes to a schedule than at all other times when this schedule is engaged. Data obtained both from a stat-bird and a live pigeon were in close agreement with the quantitative predictions. The relation between changing over and reinforcement held across several procedural changes that included changes in relative reinforcement rate, changes from independent to interdependent scheduling procedures, and changes in the variable-interval reinforcement distributions. The results are discussed in terms of the effects of the local distribution of reinforcement on responding. The local reinforcement distribution can affect local response rates and affects the resulting matching relation. This arrangement has implications for explanations of choice.     

Selective antagonism of the error-increasing effect of morphine by naloxone in a repeated-acquisition task.

Pigeons acquired a different four-response chain each session by responding sequentially on three keys in the presence of four colors. The response chain was maintained by food presentation under a fixed-ratio schedule. Errors produced a brief timeout but did not reset the chain. When either morphine or naloxone was administered alone, the overall response rate decreased with increasing doses. The rate-decreasing effect was accompanied by an increase in percent errors with morphine but not with naloxone. Both effects of morphine were antagonized by doses of naloxone that were ineffective when given alone. The antagonism was selective in that naloxone (3 mg/kg) completely blocked the error-increasing effect but not the rate-decreasing effect of the higher doses of morphine. The view that naloxone is a specific narcotic antagonist was supported by the finding that naloxone failed to antagonize the rate-decreasing and error-increasing effects of d-amphetamine, pentobarbital, and phencyclidine.