A further study of partial reinforcement in the turtle

Two matched groups of mature painted turtles, Chrysemys picta picta, were trained in a simple runway, one with partial and the other with consistent reinforcement, following which both groups were extinguished. The partially reinforced animals ran more slowly in acquisition, but showed somewhat greater resistance to extinction. The results are compared with those obtained in analogous experiments with other animals.     

Partial reinforcement effects in instrumental escape conditioning

In Experiment I acquisition and extinction of instrumental escape conditioning with rats (N = 64) were studied as a function of reinforcement magnitude under conditions of partial and continuous reinforcement. In Experiment II the effects of partial and continuous reinforcement were studied in rats (N = 96) during acquisition followed by small, medium, and large reductions in reinforcement magnitude. A water-tank escape apparatus was used with temperature as the relevant variable. It was found that (1) with large reinforcement magnitude a continuously reinforced group was superior in acquisition to one that was partially reinforced; there were no differences with small reinforcement; (2) disruptive effects of a nonreinforced trial (a) appear early in learning, (b) are quite strong after each nonreinforced trial, and (c) persist through several succeeding reinforced trials; (3) major competing behaviors persist throughout acquisition for small reinforcement magnitude regardless of schedule, decline with large reinforcement (more so with continuous than with partial), and return to a high level in extinction for all conditions; (4) the partial reinforcement extinction effect occurs after large reinforcement but not after small, and it appears only with large reductions in reinforcement magnitude which approach extinction conditions. Only the first part of the last finding appears to be consistent with the appetitive conditioning literature.     

Partial reinforcement and extinction in vasomotor conditioning

In order to investigate cognitive versus traditional accounts of responding in extinction and the discrimination hypothesis for the partial reinforcement effect, 40 human subjects were randomly divided into two groups and were treated according to thermal vasomotor conditioning procedures using either 25 trials of continuous reinforcement or 100 trials of 25% partial reinforcement. At the onset of extinction, half of each group was given traditional noninformed extinction, while the other (informed) half had the thermal stimulator removed. The usual greater resistance to extinction was obtained after partial reinforcement than after continuous reinforcement in the two noninformed groups; however, immediate extinction of responding was obtained from the first extinction trial in the two informed groups. These results are consistent both with the discrimination hypothesis for the partial reinforcement extinction effect and with cognitive explanations of responding in extinction. Consequences for the behavioral therapies are discussed.     

Partial reinforcement and breadth of learning

Two experiments on partial reinforcement were undertaken to test predictions made by a two process model of discrimination learning. In the first experiment rats were trained on a discrimination involving two relevant cues: one group (C) was trained on a 100: o schedule, the other (P) on a 50:0 schedule. Both groups were then given transfer tests with the two cues presented individually; finally all animals were extinguished on the original training stimuli and on the single cue stimuli. During extinction there was a negative correlation between the number of correct responses made by individual subjects of Group C to each single cue; whereas the correlation was positive for subjects of Group P. The second experiment employed basically the same design, but subjects were trained with seven relevant cues. The results of transfer tests showed that subjects of Group P learned to attach the correct response to many more cues than subjects of Group C. This suggests that the breadth of learning is greater under partial than under consistent reinforcement. The results were predicted by the model of discrimination learning under test.     

Partial negative reinforcement: fixed-ratio escape

Rats were unable to sustain performance when eight bar-presses turned off shock (−FR 8). In a second experiment, thirsty rats were able to maintain a moderate response rate when performance on −FR 8 was also reinforced with water. Some rats continued to bar-press on −FR 8 after withdrawal of positive reinforcement, but at a much lower rate. A possible explanation of the results is that during intermittent escape conditioning in a free-responding situation the absence of shock itself acquires aversive properties.     

Partial reinforcement effects and type of reward

In two experiments 68 rats were trained to bar press or run down a straight runway for food or for water under conditions of either continuous reinforcement or partial reinforcement. In both experiments, there was greater persistence of behavior which had been reinforced with food than with water. In Expt 2, the partial reinforcement extinction effect (PREE) was observed with food reward, but not with water.Within the context of the experimental procedures used, it can be concluded that the rat has mechanisms for developing persistence which are dependent on the specific motivational system involved. This conclusion is related to theories of partial reinforcement effects and to possible biological origins of the mechanisms.     

Partial reinforcement and partial delay of reinforcement effects with 72-hour intertrial intervals and interpolated continuous reinforcement

Three groups of rats ran 108 trials in a straight runway, one trial every 3 days. On the first 44 trials, one group received continuous (and immediate) reinforcement (CRF), a second group 50 per cent partial reinforcement (PRF), and the third group a 50 per cent schedule of partial delay of reinforcement (PDR). All groups received CRF on the next 20 trials, and extinction on the last 44 trials. The PRF and PDR groups extinguished at approximately the same rate, and significantly more slowly than the CRF group.     

Partial reinforcement (acquisition) effects within subjects

Acquisition performance of 22 rats in a straight alley runway was examined. The animals were subjected to partial reinforcement when the alley was black (B±) and continuous reinforcement when it was white (W+). The results indicated (a) higher terminal performance, for partial as against continuous reinforcement conditions, for starting-time and running-time measures, and (b) lower terminal performance under partial conditions for a goal-entry-time measure. These results confirm within subjects an effect previously demonstrated, in the runway, only in between-groups tests, where one group is run under partial reinforcement and a separate group is run under continuous reinforcement in the presence of the same external stimuli. Differences between the runway situation, employing a discrete-trial procedure and performance measures at three points in the response chain, and the Skinner box situation, used in its free-operant mode with a single performance measure, are discussed in relation to the present findings.     

Partial reinforcement and context switch effects in human predictive learning

Human participants were trained in a trial-by-trial contingency judgements task in which they had to predict the probability of an outcome (diarrhoea) following different cues (food names) in different contexts (restaurants). Cue P was paired with the outcome on half of the trials (partial reinforcement), while cue C was paired with the outcome on all the trials (continuous reinforcement), both cues in Context A. Test was conducted in both Context A and a different but equally familiar context (B). Context change decreased judgements to C, but not to P (Experiment 1). This effect was found only in the cue trained in the context where a different cue was partially reinforced (Experiment 2). Context switch effects disappeared when different cues received partial reinforcement in both contexts of training (Experiment 3). The implications of these results for an explanation of context switch effects in terms of ambiguity in the meaning of the cues prompting attention to the context (e.g., Bouton, 1997) are discussed.     

Partial reinforcement and context switch effects in human predictive learning

Human participants were trained in a trial-by-trial contingency judgements task in which they had to predict the probability of an outcome (diarrhoea) following different cues (food names) in different contexts (restaurants). Cue P was paired with the outcome on half of the trials (partial reinforcement), while cue C was paired with the outcome on all the trials (continuous reinforcement), both cues in Context A. Test was conducted in both Context A and a different but equally familiar context (B). Context change decreased judgements to C, but not to P (Experiment 1). This effect was found only in the cue trained in the context where a different cue was partially reinforced (Experiment 2). Context switch effects disappeared when different cues received partial reinforcement in both contexts of training (Experiment 3). The implications of these results for an explanation of context switch effects in terms of ambiguity in the meaning of the cues prompting attention to the context (e.g., Bouton, 1997) are discussed.     

Partial reinforcement and autoshaping of the pigeon's key-peck behavior

Pigeons were exposed to continuous and partial reinforcement (25%) schedules in an autoshaping procedure. The number of trials and/or pairings per session were equated across two factorial group sets and all groups were trained for a fixed total number of acquisition trials (192). When acquisition was analyzed as a function of reinforcements delivered, the groups receiving fewer number of trials per session acquired the response faster, independently of the percentage of reinforced trials. Moreover, the number of reinforcements to satisfy an acquisition criterion was a monotonic function of the number of trials per session but not of the schedule. The results are discussed in relation to the neocontinuity and the scalar expectancy theories.