Response cost effects during extinction following fixed-interval reinforcement in humans

This study examined the effects of response-produced cost upon human observer responses during extinction following FI reinforcement. Relative to a no-cost condition, cost produced marked and rapid response attenuation.     

Variable-interval punishment during variable-interval reinforcement

Variable-interval punishment was superimposed on a variable-interval food reinforcement baseline for three groups of rats. The value for the variable-interval punishment schedule was the same as that for the variable-interval food reinforcement schedule, although the two schedules were programmed independently. The three groups were Variable Intervals 0.5, 1, and 3 min. Little or no suppression occurred in the three groups at mild (0.2 and 0.4 ma) intensities of punishment, but at 0.6 ma, complete suppression occurred almost uniformly. During continued punishment, there was no consistent recovery toward the pre-punishment baseline at suppressing intensities of punishment. After punishment was discontinued, recovery from suppression was more rapid the lower the punishment intensity, and the lower the value of the variable-interval schedules of reinforcement and punishment.     

Recovery of responses during mild punishment

Pigeons were punished with mild shock for pecking during one of two components of a multiple schedule. They eventually recovered so that they pecked at the same rate during both components. In one experiment they were extinguished after recovering. When punishment was maintained during extinction, they extinguished faster during the punished, than during the unpunished component. When punishment was stopped during extinction, they extinguished faster during the unpunished than during the previously punished component. In another experiment, punishment was programmed first during neither of the two components, then during one, then during both, and finally during the other component. The extent of recovery decreased with each successive cycle. It is concluded that, if transient emotional states are ignored, reward and punishment are symmetrical in their effects.     

The effects of early handling on the partial reinforcement extinction effect and the partial punishment effect in male and female rats

Handled (Day 1-22) and non-handled infantile Wistar rats were tested in maturity for the partial reinforcement extinction effect (PREE) and the partial punishment effect (PPE). In Experiments 1 and 2, mature male and female rats were trained to run in an alley for food reward on a 1-trial/day schedule. In the PREE paradigm (Experiment 1), the partially reinforced group (PRF) received reinforcement on a quasi-random 50% schedule, while the continuously reinforced group (CRF) received reinforcement on every trial. In the test stage, both groups were given extinction training. In the PPE paradigm (Experiment 2), the partially punished (PP) group received, together with continuous reinforcement, shocks on a quasirandom 50% schedule, while the continuously reinforced group was reinforced on every trial. In test, all animals were given both reinforcement and shock on every trial. In Experiment 1, PREE—i.e. increased resistance to extinction in the PRF as compared to the CRF group—was more pronounced in the handled animals. More specifically, no PREE was obtained in the non-handled males, and in the non-handled females the PREE was reduced compared to the handled females. The results of Experiment 2 revealed no effect of handling or sex on PPE, that is, increased resistance to punishment in the PP group as compared to the CRF group was evident in all four conditions. In Experiment 3, handled and non-handled male rats were tested for the PREE using a multi-trial procedure in an operant chamber. PREE was obtained in the handled but not in the non-handled animals. The implications of these results for the differential effects of handling on male and female rats and the distinction between the PREE and PPE paradigms are discussed.     

Stimulus generalization of the effects of punishment

Three pigeons were trained to respond to seven spectral stimulus values ranging from 490 to 610 mμ and displayed in random order on a response key. After response rates had equalized to these values, a brief electric shock was administered when the subject (S) responded to the central value (550 mμ) while positive reinforcement for all values was maintained. Initially, there was broad generalization of the resulting depression in response rate, but the gradients grew steeper in the course of testing. When punishment was discontinued, the rates to all values recovered, and equal responding to all stimuli was reattained by two of the Ss. Stimulus control over the effects of punishment was clearly demonstrated in the form of a generalization gradient; this probably resulted from the combined effects of generalization of the depression associated with punishment and discrimination between the punished value and neutral stimuli.     

Some effects of punishment on pain-elicited aggression

Painful mechanical tail-pinch elicited aggressive responses in paired rats; response-contingent electric shock to either forepaws or hindpaws suppressed fighting and stereotyped aggressive postures, including those in which dominance was expressed. There was no evidence that aggression was facilitated by shock that was contingent on pain-elicited aggressive responses. Aggressive responding recovered when shock was discontinued.     

Some effects of punishment upon unpunished responding

Animals permitted free access to a running wheel and drinking tube increased the amount of running when drinking was punished with electric shock. Additional experiments demonstrated that the simple presence or absence of a drinking tube (or running wheel) was a sufficient condition to observe a decrease or an increase in the alternative response. A quantitative analysis of these interactions observed between the incompatible running and drinking responses suggested that each response occupied a constant proportion of the time available for it. These results question an interpretation of the increase in unpunished alternative responding based upon its avoidance properties.     

Abortive responding during punishment of bar holding

A continuous chain of homogeneous responding was established in rats by training animals to hold a lever down for 10 sec or longer before releasing it for food reinforcement. When criterion releases were subsequently punished, completed holding chains were greatly suppressed, aborted chains increased markedly, while the rate of chain initiations remained unchanged.     

The effects of punishment intensity on squirrel monkeys

Responses of squirrel monkeys were maintained by a variable-interval schedule of food reinforcement. Concurrently, punishment consisting of a brief electric shock followed each response. As has been found for pigeons and rats, punishment did not produce extreme, all-or-none reactions. By gradually increasing the punishment intensity it was possible to produce response rates intermediate to no suppression and complete suppression. Similarly, the moment-to-moment response rate was free of extreme fluctuations. A “warm-up” effect occurred in which the punished responses were especially suppressed during the initial part of a session. The pre-punishment performance was negatively accelerated within a session, and punishment reduced the degree of negative acceleration. When punishment was discontinued, responding recovered immediately except when suppression had been complete or prolonged. When the punishment intensity was decreased gradually, more suppression resulted at a given intensity than when intensity was increased gradually. This suggests a “behavioral inertia” effect wherein behavior at a new punishment intensity is biased toward the behavior at the previous value. A corollary generalization is that the larger the change in intensity, the less the behavior at the new value will be biased toward the behavior at the previous value.     

Early-life stress affects extinction during critical periods of development: An analysis of the effects of maternal separation on extinction in adolescent rats

Adolescence is a period of heightened susceptibility to anxiety disorders, yet we have little experimental evidence on what factors may lead to psychopathology in adolescence. Preclinical models of extinction are commonly used to study the treatment of anxiety symptoms. Interestingly, recent research has shown that there are fundamental changes in the process of extinction across development, which may have implications for our understanding of psychopathology across the lifespan. Specifically, this research shows that the process of extinction parallels the nonlinear function of prefrontal cortex development, such that extinction behaviour is similar in juvenile and adult rats, but involves different processes in infancy and adolescence (periods of rapid growth and pruning, respectively). Our previous studies have shown that early-life stress accelerates the transition between infant and juvenile extinction systems. In the current series of experiments, we examined whether the same early-life stress, maternal separation (MS), would lead to an earlier transition between the juvenile and adolescent extinction systems, and between the adolescent and adult extinction systems. We show that MS adolescent rats exhibit more adult-like extinction behaviour, and that adolescent-like extinction emerges earlier in development (i.e. in pre-adolescent rats). These results may have important implications for the understanding and treatment of anxiety symptoms in adolescent populations.     

Some effects of punishment shock intensity upon discriminative responding

Three pigeons received visual discrimination training under both multiple variable-ratio extinction and variable-interval extinction schedules. All birds developed nearly perfect discrimination. When punishment for every tenth response during food reinforcement was presented, responding decreased as shock intensity increased. At the same time, responding during extinction, which was not punished, increased at intermediate punishment intensities, but returned to low levels under severe punishment. A second procedure, in which punishment and no-punishment sessions alternated unsystematically, was employed with two of the birds. The results under this procedure essentially replicated the data obtained as punishment shock intensity increased gradually.     

Resistance to extinction and punishment following training with shock and non-reinforcement: Failure to obtain cross-tolerance

Two experiments investigated the phenomenon of cross-tolerance between the partial reinforcement extinction effect (PREE) and the partial punishment effect (PPE). Three groups of rats were trained in acquisition to run in a straight alley. The continuously reinforced (CRF) group received a reward on every trial. The partially reinforced (PRF) group was rewarded on a quasi-random 50% schedule. The partially punished (PP) group received food reward on every trial but, in addition, received foot shocks of gradually increasing intensity in the goal box on a random 50% of the trials. In the test stage, half of the animals in each training condition were tested in extinction, where no reward was given on any of the trials, and the other half were tested in punishment, with both food and shock presented on each trial. Experiment 1 used a 1-trial/day procedure; Experiment 2 used a multi-trial procedure. In both procedures, clear PREE and PPE were obtained. In the 1-trial/day procedure, no cross-tolerance was evident: animals trained on a PRF or PP schedule did not show increased resistance to punishment and extinction, respectively. In the multi-trial procedure, only weak cross-tolerance was obtained in animals trained on partial reinforcement and tested in punishment.