Partial Reinforcement in Appetitive Pavlovian Conditioning with Rats

Four experiments examined the effects of a partial reinforcement schedule on extinction using appetitive Pavlovian conditioning. Extinction was slower after partial than after continuous reinforcement when the schedules were administered to different groups (Experiment 1). The opposite result was found in Experiments 2 and 3 when both schedules were presented to the same group in the same context. When the schedules were presented to the same group in different contexts, then extinction was again slower after partial reinforcement (Experiment 3). Experiment 4 demonstrated that a change of context facilitates extinction to a greater extent after conditioning with a partial reinforcement schedule than with a continuous one. The results are explained by assuming that the nonreinforced trials of a partial reinforcement schedule create an internal state that serves as a contextual cue.     

Extinction of a runway response following runway or goal box partial reinforcement

Rats were trained on a consistent reinforcement schedule in a straight runway. They were then switched to one of two partial reinforcement procedures. One group continued to run the full length of the runway, another was placed directly in the goal box. When extinguished in the full length of the runway both groups were more resistant to extinction than groups trained only on consistent reinforcement. An attempt was made to delineate the conditions for a demonstration of the partial reinforcement extinction effect. The results were discussed in relation to frustration theory.     

Partial reinforcement effects in classical aversive conditioning in rabbits and human beings.

The partial reinforcement extinction effect (the PREE) in classical aversive conditioning was investigated in 2 experiments. In the first, the nictitating membrane responses of 120 rabbits were conditioned at a 250-msec. interstimulus interval (ISI) under continuous reinforcement, partial reinforcement with the unconditioned stimulus (US) omitted (Group PO), or partial reinforcement with the US delayed to 1,500 msec. (Group PD). These 3 groups were factorially extinguished under US-Omitted, US-Unpaired, or US-Delayed extinction regimens. A significant PREE was obtained, but only for PO training and US-Omitted extinction. The second experiment, employing human subjects in a masked eye blink conditioning task, produced parallel results. A general discrimination view of the classical PREE seems applicable, but one in which neither cognitive factors nor intertrial conditioning of reinforcement aftereffects play a significant role.     

Does delay of reinforcement produce durable persistence?

In a foru-phase experiment, phase I was runway training under four different reinforcement conditions: partial reinforcement (PRF), partial delayed reinforcement (PDR), constant delayed reinforcement (CDR), and consistent reinforcement (CRF). During phase 2 extinction, PRF and PDR groups did not differ; both groups were more persistent than group CDR, which was in turn superior to the CRF control. Phase 3 was CRF reacquisition for all groups. During phase 4 extinction, PRF group was more presistent than the other three groups which did not differ. A Pavlovian counter-conditioning hypothesis was proposed to account for the absence of durable persistence following PDR training.     

A further study of partial reinforcement in the turtle

Two matched groups of mature painted turtles, Chrysemys picta picta, were trained in a simple runway, one with partial and the other with consistent reinforcement, following which both groups were extinguished. The partially reinforced animals ran more slowly in acquisition, but showed somewhat greater resistance to extinction. The results are compared with those obtained in analogous experiments with other animals.     

Sequential effects of non-reward in a skinner box

The partial reinforcement extinction effect was examined within subjects in a simultaneous discrimination in a two bar Skinner box. Discrete trials were used, rats being required to press the bar under the illuminated cue light; one bar was correlated with 100% the other with 50% reinforcement. The three groups differed in the probability of a change in the cue light between trials during acquisition. When this probability was low, the 50% bar was preferred in extinction, while when it was higher (0.433 or 0.875) the 100% bar was preferred. These results confirm Capaldi's (1966) hypothesis of the partial reinforcement extinction effect, and support a suggested explanation of some conflicting results on partial reinforcement effects in a Skinner box.     

Partial reinforcement and partial delay of reinforcement effects with 72-hour intertrial intervals and interpolated continuous reinforcement

Three groups of rats ran 108 trials in a straight runway, one trial every 3 days. On the first 44 trials, one group received continuous (and immediate) reinforcement (CRF), a second group 50 per cent partial reinforcement (PRF), and the third group a 50 per cent schedule of partial delay of reinforcement (PDR). All groups received CRF on the next 20 trials, and extinction on the last 44 trials. The PRF and PDR groups extinguished at approximately the same rate, and significantly more slowly than the CRF group.     

Persistent behaviour in extinction after partial deprivation in training

Four groups of rats were trained to run an alleyway with one trial per day. Two groups were always deprived when trained while the other two received a partial deprivation schedule. One group of each pair received a continuous reward in the goal box while the other received partial reward. A partial reinforcement effect was found during extinction. The partially deprived groups also showed persistence in extinction. This result extends parallels between the effects of satiation and nonreward upon behaviour.     

Partial reinforcement and extinction in vasomotor conditioning

In order to investigate cognitive versus traditional accounts of responding in extinction and the discrimination hypothesis for the partial reinforcement effect, 40 human subjects were randomly divided into two groups and were treated according to thermal vasomotor conditioning procedures using either 25 trials of continuous reinforcement or 100 trials of 25% partial reinforcement. At the onset of extinction, half of each group was given traditional noninformed extinction, while the other (informed) half had the thermal stimulator removed. The usual greater resistance to extinction was obtained after partial reinforcement than after continuous reinforcement in the two noninformed groups; however, immediate extinction of responding was obtained from the first extinction trial in the two informed groups. These results are consistent both with the discrimination hypothesis for the partial reinforcement extinction effect and with cognitive explanations of responding in extinction. Consequences for the behavioral therapies are discussed.     

The partial punishment effect following minimal acquisition training: Sodium amobarbital and the stimulus properties of early punished trials

In a runway investigation, six groups of rats received limited runway training such that partial punishment, partial reinforcement, or continuous reinforcement was accompanied by sodium amobarbital or saline. Following an interpolated phase of continuous reinforcement without injections, all groups were given punished extinction. The entire experiment was conducted under widely spaced conditions (ITI = 24 hr). It was found that partial punishment increased resistance to punished extinction relative to partially and continuously reinforced controls when acquisition was given under saline. When partial punishment training was accompanied by amobarbital this effect was eliminated. The drug was observed to have no effect on the punished extinction performance of the partial reinforcement and continuous groups, respectively. Moreover, the partial reinforcement effect (PRE) did not generalize to punished extinction. These data provide information concerning the difference between the stimuli associated with the early trials of punishment and nonreward and indicate that the former but not the latter contain emotional elements.     

Partial reinforcement effects in instrumental escape conditioning

In Experiment I acquisition and extinction of instrumental escape conditioning with rats (N = 64) were studied as a function of reinforcement magnitude under conditions of partial and continuous reinforcement. In Experiment II the effects of partial and continuous reinforcement were studied in rats (N = 96) during acquisition followed by small, medium, and large reductions in reinforcement magnitude. A water-tank escape apparatus was used with temperature as the relevant variable. It was found that (1) with large reinforcement magnitude a continuously reinforced group was superior in acquisition to one that was partially reinforced; there were no differences with small reinforcement; (2) disruptive effects of a nonreinforced trial (a) appear early in learning, (b) are quite strong after each nonreinforced trial, and (c) persist through several succeeding reinforced trials; (3) major competing behaviors persist throughout acquisition for small reinforcement magnitude regardless of schedule, decline with large reinforcement (more so with continuous than with partial), and return to a high level in extinction for all conditions; (4) the partial reinforcement extinction effect occurs after large reinforcement but not after small, and it appears only with large reductions in reinforcement magnitude which approach extinction conditions. Only the first part of the last finding appears to be consistent with the appetitive conditioning literature.     

Differential effects of omission contingencies on various components of Pavlovian appetitive conditioned responding in rats

Five experiments with rat subjects investigated the effects of omission and partial reinforcement contingencies on five individual behaviors evoked by visual and auditory conditioned stimuli paired with a food unconditioned stimulus. The effects of omission depended on the behavior on which that contingency was placed: One behavior was eliminated, one was unaffected, and three were reduced relative to the performance of yoked controls. Partial reinforcement resulted in lower frequencies of three behaviors and higher frequencies of two behaviors, compared with performance under consistent reinforcement. A partial reinforcement extinction effect was noted with one behavior but not with the others. These results are related to the possible role of instrumental conditioning contingencies in generating conditioned behavior in this appetitive conditioning preparation and to the independence of individual components of a complex conditioned response.     

A partial reinforcement extinction effect despite equal rates of reinforcement during Pavlovian conditioning

In 4 experiments rats received appetitive Pavlovian conditioning followed by extinction. Food accompanied every trial with the conditioned stimulus (CS) for the continuously reinforced groups and only half of the trials for the partially reinforced groups. In contrast to previous experiments that have compared the effects of partial and continuous reinforcement, the rate at which food was delivered during the CS was the same for both groups. The strength of the conditioned response during extinction weakened more rapidly in the continuously than in the partially reinforced groups. The results demonstrate that the partial reinforcement extinction effect is a consequence of the nonreinforced trials with the CS, rather than the rate at which the unconditioned stimulus is delivered during the CS.     

Punishment persistence and sequence: Some effects of P-length and N-length in the rat

In a runway investigation, two groups of rats received partial punishment training with P-lengths of 1, 2, and 3 (Group P123) and P-lengths of 1 (Group P1), respectively. Two additional groups received partial reinforcement with N-lengths of 1, 2, and 3 (Group N123) and N-length of 1 (Group N1). An additional group was given unpunished continuous reinforcement in the runway, but received control shocks in a separate apparatus. Following training all subjects received punished extinction (shock plus nonreward). The results indicated that P-length increased resistance to punished extinction, however N-length did not have the corresponding effect. In addition, partial reinforcement did not increase resistance to punished extinction relative to continuous reinforcement. These results were interpreted within a sequential-theoretical framework.     

Contextual control of appetitive conditioning: Influence of a contextual stimulus generated by a partial reinforcement procedure

Three experiments with rat subjects examined the effects of a context switch after conditioning treatments in which the conditioned stimulus (CS) was either paired with food on every presentation (continuous reinforcement) or on some of its presentations (partial reinforcement). In each experiment, a target CS was given one of these treatments in Context A, and another CS was given a treatment during sessions that were intermixed in Context B. Final tests of the target CS in Context A and Context B often revealed no loss of responding with the switch to B. However, a loss was observed when partial reinforcement had been associated with Context A and continuous reinforcement had been associated with Context B. Those conditions caused equal decrements in responding to partially reinforced and continuously reinforced targets. The results suggest that under the present conditions partial reinforcement can generate a contextual stimulus that becomes associated with the physical context and controls responding to the CS.     

Changes Accompanying Practice upon Successive Samples of Verbal Material

Three groups of rats received either continuous, partial, or zero reinforcement in a first acquisition phase which was followed by an extended extinction phase. Then all Ss were given a reacquisition phase under continuous reinforcement conditions followed by a second extinction phase. While the usual partial reinforcement extinction effect (PREE) was found during the major part of the first extinction phase, it disappeared during the last few trials of that phase. No PREE was obtained during the second extinction phase in any of the three sections of the runway. The abolition of the PREE was attributed to the extinction of the r_F-s_F mechanism in the partial reinforcement group.     

Determinants of instrumental extinction in terrestrial toads (Bufo arenarum)

Previous research in a water-reinforced instrumental training situation with toads (Bufo arenarum) has shown that performance in both acquisition and extinction is poorer after partial, rather than continuous reinforcement training. In Experiment 1, the performance of a group receiving 24 trials on a 50% partial reinforcement schedule was poorer in acquisition and extinction than that of continuously reinforced groups matched for trials or reinforcements. However, partially reinforced toads extinguished at the same rapid rate as a continuously reinforced group that received training only on the days in which the partial toads received water reinforcement. In Experiment 2, extinction was faster after 10 reinforced acquisition trials than after 30 trials. This evidence suggests that the deleterious effects of partial reinforcement in toads can be explained by a combination of two factors, namely, the distribution of reinforced trials across days and the total number of reinforcements.     

Conditioned suppression of the proboscis-extension response in young, middle-aged, and old Drosophila melanogaster flies: acquisition and extinction

Young (7 days old), middle-aged (30 days old), and old (50 days old) Drosophila melanogaster males were used in an inhibitory conditioning of the proboscis-extension response. Two reinforcement schedules were applied, constant vs. partial. Partial reinforcement increased the number of trials needed to reach the learning criterion to the same extent in all age groups. Young flies needed fewer trials to reach the criterion than both middle-aged and old flies, which did not differ from each other. Extinction was delayed in the partial reinforcement groups by the same amount in all age groups. The slowest rate of extinction was observed in the old group and the fastest for the middle-aged flies. The results are discussed in connection with hypotheses that consider extinction an index either of behavioral rigidity or of strength of the initial learning.     

Partial reinforcement (acquisition) effects within subjects

Acquisition performance of 22 rats in a straight alley runway was examined. The animals were subjected to partial reinforcement when the alley was black (B±) and continuous reinforcement when it was white (W+). The results indicated (a) higher terminal performance, for partial as against continuous reinforcement conditions, for starting-time and running-time measures, and (b) lower terminal performance under partial conditions for a goal-entry-time measure. These results confirm within subjects an effect previously demonstrated, in the runway, only in between-groups tests, where one group is run under partial reinforcement and a separate group is run under continuous reinforcement in the presence of the same external stimuli. Differences between the runway situation, employing a discrete-trial procedure and performance measures at three points in the response chain, and the Skinner box situation, used in its free-operant mode with a single performance measure, are discussed in relation to the present findings.     

Appetitive conditioning in Octopus cyanea

The performance of Octopus cyanea was studied in 3 appetitive conditioning situations. In Experiment 1, 2 groups were trained in a runway; a large reward produced faster acquisition when reinforcement was consistent and better subsequent performance on a partial schedule than did a small reward. In Experiment 2, activity in the vicinity of a feeder was measured, and in Experiment 3, latency and probability of response were measured in an automated version of a traditional conditioned attack situation (Boycott & Young, 1950). There was evidence of acquisition with continuous reinforcement in both experiments but in neither with partial reinforcement. All of the results can be understood in terms of growth and decline in the strength of stimulus-reinforcer associations with reinforcement and nonreinforcement.