Survival of the partial reinforcement extinction effect after contextual shifts

The effects of contextual shifts on the partial reinforcement extinction effect (PREE) were studied in autoshaping with rats. Experiment 1 established that the two contexts used subsequently were easily discriminable and equally salient. In Experiment 2, independent groups of rats received acquisition training under partial reinforcement (PRF) or continuous reinforcement (CRF). Significant PREEs were observed whether extinction occurred in the same or in a different context. In Experiment 3, after PRF or CRF acquisition training, each group received extinction of the same conditioned stimulus in both the same and different contexts. PREEs were observed under both conditions, although extinction was accelerated after a contextual shift. These results were discussed in relation to the role of mediational states in the PREE.     

Extinction of a runway response following runway or goal box partial reinforcement

Rats were trained on a consistent reinforcement schedule in a straight runway. They were then switched to one of two partial reinforcement procedures. One group continued to run the full length of the runway, another was placed directly in the goal box. When extinguished in the full length of the runway both groups were more resistant to extinction than groups trained only on consistent reinforcement. An attempt was made to delineate the conditions for a demonstration of the partial reinforcement extinction effect. The results were discussed in relation to frustration theory.     

The role of contextual associations in producing the partial reinforcement acquisition deficit

Three conditioned suppression experiments with rats as subjects assessed the contributions of the conditioned stimulus (CS)-context and context-unconditioned stimulus (US) associations to the degraded stimulus control by the CS that is observed following partial reinforcement relative to continuous reinforcement training. In Experiment 1, posttraining associative deflation (i.e., extinction) of the training context after partial reinforcement restored responding to a level comparable to the one produced by continuous reinforcement. In Experiment 2, posttraining associative inflation of the context (achieved by administering unsignaled outcome presentations in the context) enhanced the detrimental effect of partial reinforcement. Experiment 3 found that the training context must be an effective competitor to produce the partial reinforcement acquisition deficit. When the context was down-modulated, the target regained behavioral control thereby demonstrating higher-order retrospective revaluation. The results are discussed in terms of retrospective revaluation, and are used to contrast the predictions of a performance-focused model with those of an acquisition-focused model.     

The partial punishment effect following minimal acquisition training: Sodium amobarbital and the stimulus properties of early punished trials

In a runway investigation, six groups of rats received limited runway training such that partial punishment, partial reinforcement, or continuous reinforcement was accompanied by sodium amobarbital or saline. Following an interpolated phase of continuous reinforcement without injections, all groups were given punished extinction. The entire experiment was conducted under widely spaced conditions (ITI = 24 hr). It was found that partial punishment increased resistance to punished extinction relative to partially and continuously reinforced controls when acquisition was given under saline. When partial punishment training was accompanied by amobarbital this effect was eliminated. The drug was observed to have no effect on the punished extinction performance of the partial reinforcement and continuous groups, respectively. Moreover, the partial reinforcement effect (PRE) did not generalize to punished extinction. These data provide information concerning the difference between the stimuli associated with the early trials of punishment and nonreward and indicate that the former but not the latter contain emotional elements.     

Transfer of the partial reinforcement extinction effect between escape (shock) and appetitive (food) conditioning

In the first experiment rats were given partial reinforcement or continuous reinforcement in either an escape or an appetitive paradigm. Subsequently, the rats received continuous reinforcement training under motivational conditions opposite those experienced earlier. Finally, responses were extinguished according to the motivational conditions experienced in the second phase. The results indicated that partial reinforcement in the initial phase operated to increase resistance to extinction in the last. In a second experiment this intermotivational partial reinforcement extinction effect was shown to survive interpolated experiences with extinction, a 1-week rest period, and continuous reinforcement reacquisition. A third experiment examined the influence of intramodal versus intermodal nonreinforcement-reinforcement sequences on the intermotivational partial reinforcement extinction effect. Interactive effects between similarity of aversive outcome (escape nonreinforcement, appetitive nonreinforcement) and reinforcement type (negative, positive) were found. The theoretical implications of the data from all three experiments are discussed.     

Resistance to continuous delay of reinforcement or extinction following partial delay or partial reinforcement in acquisition: A direct comparison

Rats received either partial reward (PR) or partial delay (PD) in acquisition with one, two, or three delay or nonreward trials followed by an immediately rewarded trial or one delay or nonreward trial followed by an immediately rewarded trial. These four groups were then split in half and given either continuous delay or continuous nonreward (extinction) in a “response persistence” phase. In addition, two continuously reinforced groups, one experiencing continuous delay, and the other experiencing extinction were included. The results showed that response persistence was greater when PD groups were given continuous delay rather than extinction, but the opposite was true for PR groups. The “length” (1, 2, or 3 versus 1 nonreward or delay trial) also transferred to the response persistence phase with the length 1, 2, and 3 conditions being more persistent than the 1 length conditions. The results were discussed with respect to theoretical notions of response persistence.     

A partial reinforcement extinction effect despite equal rates of reinforcement during Pavlovian conditioning

In 4 experiments rats received appetitive Pavlovian conditioning followed by extinction. Food accompanied every trial with the conditioned stimulus (CS) for the continuously reinforced groups and only half of the trials for the partially reinforced groups. In contrast to previous experiments that have compared the effects of partial and continuous reinforcement, the rate at which food was delivered during the CS was the same for both groups. The strength of the conditioned response during extinction weakened more rapidly in the continuously than in the partially reinforced groups. The results demonstrate that the partial reinforcement extinction effect is a consequence of the nonreinforced trials with the CS, rather than the rate at which the unconditioned stimulus is delivered during the CS.     

The effects of early handling on the partial reinforcement extinction effect and the partial punishment effect in male and female rats

Handled (Day 1-22) and non-handled infantile Wistar rats were tested in maturity for the partial reinforcement extinction effect (PREE) and the partial punishment effect (PPE). In Experiments 1 and 2, mature male and female rats were trained to run in an alley for food reward on a 1-trial/day schedule. In the PREE paradigm (Experiment 1), the partially reinforced group (PRF) received reinforcement on a quasi-random 50% schedule, while the continuously reinforced group (CRF) received reinforcement on every trial. In the test stage, both groups were given extinction training. In the PPE paradigm (Experiment 2), the partially punished (PP) group received, together with continuous reinforcement, shocks on a quasirandom 50% schedule, while the continuously reinforced group was reinforced on every trial. In test, all animals were given both reinforcement and shock on every trial. In Experiment 1, PREE—i.e. increased resistance to extinction in the PRF as compared to the CRF group—was more pronounced in the handled animals. More specifically, no PREE was obtained in the non-handled males, and in the non-handled females the PREE was reduced compared to the handled females. The results of Experiment 2 revealed no effect of handling or sex on PPE, that is, increased resistance to punishment in the PP group as compared to the CRF group was evident in all four conditions. In Experiment 3, handled and non-handled male rats were tested for the PREE using a multi-trial procedure in an operant chamber. PREE was obtained in the handled but not in the non-handled animals. The implications of these results for the differential effects of handling on male and female rats and the distinction between the PREE and PPE paradigms are discussed.