Acquisition of a simple running response as a function of partial and continuous schedules of reinforcement

The Psychological Record -     

Partial reinforcement and partial delay of reinforcement effects with 72-hour intertrial intervals and interpolated continuous reinforcement

Three groups of rats ran 108 trials in a straight runway, one trial every 3 days. On the first 44 trials, one group received continuous (and immediate) reinforcement (CRF), a second group 50 per cent partial reinforcement (PRF), and the third group a 50 per cent schedule of partial delay of reinforcement (PDR). All groups received CRF on the next 20 trials, and extinction on the last 44 trials. The PRF and PDR groups extinguished at approximately the same rate, and significantly more slowly than the CRF group.     

Durable partial reinforcement effects and social dominance in the rat

Following partial reinforcement (PRF) or consistent reinforcement (CRF) of an approach response in a straight runway and experimental extinction, rats were given the arena food-dominance test in Experiment 1 and both the arena test and the tunnel-dominance test in Experiment 2. PRF subjects were dominant in the tunnel test, but subordinate in the arena test, regardless of which dominance test was given first. These durable and pervasive effects of partial reinforcement training can be interpreted in terms of frustration theory.     

Resistance to continuous delay of reinforcement or extinction following partial delay or partial reinforcement in acquisition: A direct comparison

Rats received either partial reward (PR) or partial delay (PD) in acquisition with one, two, or three delay or nonreward trials followed by an immediately rewarded trial or one delay or nonreward trial followed by an immediately rewarded trial. These four groups were then split in half and given either continuous delay or continuous nonreward (extinction) in a “response persistence” phase. In addition, two continuously reinforced groups, one experiencing continuous delay, and the other experiencing extinction were included. The results showed that response persistence was greater when PD groups were given continuous delay rather than extinction, but the opposite was true for PR groups. The “length” (1, 2, or 3 versus 1 nonreward or delay trial) also transferred to the response persistence phase with the length 1, 2, and 3 conditions being more persistent than the 1 length conditions. The results were discussed with respect to theoretical notions of response persistence.     

Perseveration of the partial reinforcement effect in extinction with rats over two phases of extinction and two stages of continuous reinforcement

One group of 10 male albino rats was given partial reinforcement while the other 10 rats received continuous reinforcement in a straight alley. Subjects then experienced five consecutive stages of Extinction 1, Continuous Reinforcement 1, Extinction 2, Continuous Reinforcement 2, and finally, Extinction 3. Analysis showed the partial reinforcement effect in extinction was sustained over two stages of extinction and two stages of continuous reinforcement, since subjects receiving partial reinforcement ran faster than rats given continuous reinforcement throughout all three of the extinction periods. The results seem to support those of Amsel's (1967) and Cabpaldi's (1967) theoretical formulations of the partial reinforcement effect in extinction.     

Fixed-ratio punishment with continuous reinforcement

Rats were reinforced with water for every bar-press and concurrently punished for every 10th or 20th bar-press. Punishment produced an initial suppression of responding followed by recovery. A slight change in the method of delivering punishment eventually led to a high response rate just after punishment, a low response rate just before punishment, and frequent intermediate pauses. The results are interpreted as showing that punishment became a safe signal and that the high rate of responding it released came to act as a conditioned aversive stimulus. The effects of amphetamine were consistent with this interpretation. Alcohol had the paradoxical effect of increasing pauses and depressing the low rate before punishment.     

Two-alternative learning situations with partial reinforcement

The comparative effects of reward and nonreward on learning are considered in connection with a two-alternative learning situation. Conditions are more general in nature than those discussed in an earlier article. In the statistical model proposed, the question of whether reward and nonreward are equivalent in their effects on learning reduces to testing a composite hypothesis on a multivariate probability distribution. An asymptotic test of this hypothesis is described, and its use is illustrated with data from psychological experiments.This paper was prepared with the partial support of the Office of Naval Research, and may be reproduced in whole or in part for any purpose of the United States government.I wish to express my gratitude to Professors J. Neyman and E. L. Scott of the University of California, Department of Statistics, for their constant assistance and encouragement throughout the research that led to this paper and during its preparation, and to Professor F. W. Irwin of the University of Pennsylvania Department of Psychology for his many helpful suggestions and comments.     

Effects of US-Presentation and CS-termination contingencies on avoidance extinction following partial and continuous reinforcement

The present study assessed the role of both the US-presentation (punishment) and CS-termination contingencies on the maintenance of the shuttlebox avoidance responding in gerbils following acquisition under either partial reinforcement (PR) or continuous reinforcement (AV). Following PR, a stronger relationship obtained between delay of CS termination CR frequency than was found between delay of punishment and extinction performance. Following AV training, however, delay of CS termination and delay of punishment were equally effective determinants of avoidance extinction. These results were interpreted in terms of both the enhanced efficacy of the CS-termination contingency, possibly due to its increased informational value, and the attenuation of punishment suppression in PR-trained Ss.     

Transfer of approach responding between punishment and frustrative nonreward sustained through continuous reinforcement

A block of continuously reinforced nonpunished trials was interpolated between acquisition of a runway response with either partial reinforcement or intermittent punishment and subsequent tests for resistance of that response to the suppressive effects of either extinction or continuous punishment. As previous investigations have shown, both the partial reinforcement effect (PRE) and the intermittent punishment effect (IPE) were sustained through the block of continuously reinforced nonpunished trials. Furthermore, the increased resistance to extinction following intermittent punishment and the increased resistance to punishment following partial reinforcement were also sustained through the interpolated continuous reinforcement. These results support a hypothesized similarity of punishment and frustrative nonreward and were interpreted in an extension of Amsel's conditioning model theory of the role of nonreinforcement in the PRE.