Extinction of responding maintained by timeout from avoidance

The resistance to extinction of lever pressing maintained by timeout from avoidance was examined. Rats were trained under a concurrent schedule in which responses on one lever postponed shock on a free-operant avoidance (Sidman) schedule (response-shock interval = 30 s) and responses on another lever produced 2 min of signaled timeout from avoidance on a variable-ratio 15 schedule. Following extended training (106 to 363 2-hr sessions), two experiments were conducted. In Experiment 1 two different methods of extinction were compared. In one session, all shocks were omitted, and there was some weakening of avoidance but little change in timeout responding. In another session, responding on the timeout lever was ineffective, and under these conditions timeout responding showed rapid extinction. The within-session patterns produced by extinction manipulations were different than the effects of drugs such as morphine, which also reduces timeout responding. In Experiment 2 shock was omitted for many consecutive sessions. Response rates on the avoidance lever declined relatively rapidly, with noticeable reductions within 5 to 10 sessions. Extinction of the timeout lever response was much slower than extinction of avoidance in all 4 rats, and 2 rats continued responding at baseline levels for more than 20 extinction sessions. These results show that lever pressing maintained by negative reinforcement can be highly resistant to extinction. The persistence of responding on the timeout lever after avoidance extinction is not readily explained by current theories.     

Effects of US-Presentation and CS-termination contingencies on avoidance extinction following partial and continuous reinforcement

The present study assessed the role of both the US-presentation (punishment) and CS-termination contingencies on the maintenance of the shuttlebox avoidance responding in gerbils following acquisition under either partial reinforcement (PR) or continuous reinforcement (AV). Following PR, a stronger relationship obtained between delay of CS termination CR frequency than was found between delay of punishment and extinction performance. Following AV training, however, delay of CS termination and delay of punishment were equally effective determinants of avoidance extinction. These results were interpreted in terms of both the enhanced efficacy of the CS-termination contingency, possibly due to its increased informational value, and the attenuation of punishment suppression in PR-trained Ss.     

Avoidance of 20% carbon dioxide-enriched air with humans.

Four college students were exposed to a Sidman avoidance procedure to determine if an avoidance contingency involving 20% carbon dioxide-enriched air (CO2) would produce and maintain responding. In Phase 1, two conditions (contingent and noncontingent) were conducted each day. These conditions were distinguished by the presence or absence of a blue or green box on a computer screen. In the contingent condition, CO2 presentation were delivered every 3 s unless a subject pulled a plunger. Each plunger pull postponed CO2 presentations for 10 s. In the noncontingent condition, CO2 presentations occurred on the average of every 5 min independent of responding. Following stable responding in Phase 1, condition-correlated stimuli were reversed. In both conditions, plunger response rate was high during the contingent condition and low or zero during the noncontingent condition. Furthermore, subjects avoided most CO2 presentations. However, CO2 presentations did not increase verbal reports of fear. Overall, the results from the present study suggest that CO2 can be used effectively in basic studies of aversive control and in laboratory analogues of response patterns commonly referred to as anxiety.     

Signaled Delay of Reinforcement: Effects of Postconditioning Manipulation of Context Associative Strength on Instrumental Performance

Two experiments examined the influence of postconditioning treatments of contextual cues on instrumental responding acquired with a signaled delay of reinforcement schedule. In Experiment 1, mere exposure to the conditioning context after instrumental training resulted in an attenuated response rate during an extinction test. In the second experiment, responding was decreased by exposure to the contextual cues or sessions in which signaled noncontingent reinforcements occurred. The greatest response decrement, however, occurred following unsignaled noncontingent food presentations. The results are discussed with respect to the different roles of contextual cues on operant responding.     

DOES CONTINGENT REINFORCEMENT STRENGTHEN OPERANT BEHAVIOR?

In Experiment 1, pigeons were trained to peck keys with equal food-reinforcement schedules in components that ended with either noncontingent or contingent transitions to a third component with a five-fold richer schedule. Response rates were higher in the initial component with contingent transitions, but resistance to prefeeding or extinction was not consistently greater. Experiment 2 also included noncontingent or contingent transitions to a signaled period of nonreinforcement. There was no effect of the contingency on transitions to nonreinforcement, but the difference in response rates maintained by contingent versus noncontingent transitions to the richer schedule was replicated. In addition, response rates were higher in components that preceded nonreinforcement than in components that preceded the richer schedule. However, resistance to extinction was greater for noncontingent transitions to the richer schedule than to nonreinforcement, implicating stimulus–reinforcer relations in the determination of resistance to change. Resistance to change was also somewhat greater for noncontingent than for contingent transitions to the richer schedule. The latter result, together with the results of Experiment 1 and related research, suggests that response-contingent reinforcement does not increase resistance to change.     

NONCONTINGENT ESCAPE AS TREATMENT FOR SELF-INJURIOUS BEHAVIOR MAINTAINED BY NEGATIVE REINFORCEMENT

We extended research on the role of noncontingent positive reinforcement following a functional analysis of attention-maintained self-injurious behavior to self-injury maintained by negative reinforcement in 2 young males with developmental disabilities. During a pretreatment functional analysis, each participant's self-injury was shown to be differentially sensitive to escape from instructional activities as negative reinforcement. During noncontingent escape, escape from learning activities was provided on a fixed-time schedule that was not influenced by the participant's behavior. One participant was also exposed to differential negative reinforcement of other behavior. During this condition, escape from instructional activities was provided contingent on the omission of self-injury for prespecified intervals. Results showed that the provision of escape, even when noncontingent, resulted in significant reductions in self-injury. These results are particularly interesting in light of the experimental history of noncontingent reinforcement as a control rather than as a therapeutic procedure. Noncontingent escape is discussed as a form of extinction that may be less likely than other forms of extinction to produce severe side effects.     

Suppressive and enhancing effects of footshock on food-reinforced operant responding following septal lesions in rats.

Effect of septal lesions on suppression of an intermittently food-reinforced lever press by contingent and noncontingent footshock was measured. Rats with septal damage maintained higher response rates than did intact animals under both contingent and noncontingent shock. Furthermore, the difference in suppression produced by the contingent and noncontingent conditions was approximately the same for the experimental and control groups. In a second experiment, performance was measured during counter-conditioning in which the correlation between contingent shock and positive reinforcement was varied. Rats with septal lesions responded at higher rates than did controls. When only reinforced responses were punished, this lesion-induced elevation represented an increase above baseline performance without punishment. This finding suggests that the effect of septal damage on appetitive instrumental performance cannot be due solely to a deficit in response inhibition.     

Lever attacking and pressing as a function of conditioning and extinguishing a lever-press avoidance response in rats

Six experimental rats were conditioned to press one of two available levers to avoid shock. The levers registered bites as well as presses. For four of these rats, shock was contingent on lever bites when a specified time period had elapsed after the previous shock. An extinction period, in which only periodic noncontingent shocks were presented, followed avoidance training. Six yoked-control rats received the same sequence of shocks as did the corresponding experimental rats in both the conditioning and extinction phases. All six experimental rats repeatedly bit the avoidance lever. Four bit it more than the nonavoidance lever during conditioning, and five bit it more during extinction. Five of the six experimental rats consistently bit the levers many more times during each session than did their respective control rats, suggesting that avoidance conditioning facilitated lever biting. Rates of lever biting and pressing by all of the experimental rats and by some of the control rats were highest immediately following shock throughout both phases. During later portions of the intervals following shock, characteristic effects of conditioning and extinction were observed. This finding suggests that extinction of avoidance behavior by unavoidable shock presentations can be demonstrated more readily when shock-elicited responding is extricated from the data.     

Patterning of infant vocal behavior

Three-month-old infants received two consecutive 5-minute periods of adult social stimulation. In both periods the adult talked, smiled, and touched the infant and in a natural manner tried to elicit vocalizations from the infant. In the first period the adult became unresponsive for 5 sec contingent upon each infant vocalization (time-out, negative reinforcement). In the second period the infant received the same number of time-out periods at the same intervals but independently of vocal responding (yoked, noncontingent control). Negative reinforcement did not suppress infant vocal rate, but the contingent withdrawal of social stimulation did cause the infant to pause more frequently between vocal responses. These pauses generally occurred immediately after the contingently, as compared with the noncontingently, delivered time-out period. The infant appears to recognize the difference between contingent and noncontingent stimulation and pauses after the occurrence of the former. Adult social reinforcement changes the pattern and not the rate of infant vocal responding.     

HUMAN RESPONDING ON RANDOM‐INTERVAL SCHEDULES OF RESPONSE‐COST PUNISHMENT: THE ROLE OF REDUCED REINFORCEMENT DENSITY

An experiment with adult humans investigated the effects of response‐contingent money loss (response‐cost punishment) on monetary‐reinforced responding. A yoked‐control procedure was used to separate the effects on responding of the response‐cost contingency from the effects of reduced reinforcement density. Eight adults pressed buttons for money on a three‐component multiple reinforcement schedule. During baseline, responding in all components produced money gains according to a random‐interval 20‐s schedule. During punishment conditions, responding during the punishment component conjointly produced money losses according to a random‐interval schedule. The value of the response‐cost schedule was manipulated across conditions to systematically evaluate the effects on responding of response‐cost frequency. Participants were assigned to one of two yoked‐control conditions. For participants in the Yoked Punishment group, during punishment conditions money losses were delivered in the yoked component response independently at the same intervals that money losses were produced in the punishment component. For participants in the Yoked Reinforcement group, responding in the yoked component produced the same net earnings as produced in the punishment component. In 6 of 8 participants, contingent response cost selectively decreased response rates in the punishment component and the magnitude of the decrease was directly related to the punishment schedule value. Under punishment conditions, for participants in the Yoked Punishment group response rates in the yoked component also decreased, but the decrease was less than that observed in the punishment component, whereas for participants in the Yoked Reinforcement group response rates in the yoked component remained similar to rates in the no‐punishment component. These results provide further evidence that contingent response cost functions similarly to noxious punishers in that it appears to suppress responding apart from its effects on reinforcement density.     

Resurgence following differential reinforcement of alternative behavior implemented with and without extinction

In the clinic, differential reinforcement of alternative behavior (DRA) often involves programming extinction for destructive behavior while reinforcing an alternative form of communication (e.g., a functional communication response); however, implementing extinction can be unsafe or impractical under some circumstances. Quantitative theories of resurgence (i.e., Behavioral Momentum Theory and Resurgence as Choice) predict differences in the efficacy of treatments that do and do not involve extinction of target responding when reinforcement conditions maintaining alternative responding worsen. We tested these predictions by examining resurgence following two DRA conditions in which we equated rates of reinforcement. In DRA without extinction, target and alternative behavior produced reinforcement. In DRA with extinction plus noncontingent reinforcement, only alternative behavior produced reinforcement. We conducted this study in a reverse-translation sequence, first with participants who engaged in destructive behavior (Experiment 1) and then in a laboratory setting with rats (Experiment 2). Across both experiments, we observed proportionally lower levels of target responding during and following the DRA condition that arranged extinction for the target response. However, levels of resurgence were similar following both arrangements.     

A COMPARISON OF DIFFERENTIAL REINFORCEMENT AND NONCONTINGENT REINFORCEMENT TO TREAT FOOD SELECTIVITY IN A CHILD WITH AUTISM

We compared differential reinforcement plus escape extinction to noncontingent reinforcement plus escape extinction to treat food selectivity exhibited by a young child with autism. The interventions were equally effective for increasing bite acceptance and decreasing problem behaviors. However, a social validity measure suggested that noncontingent reinforcement was preferred by the child's caregiver.     

Suppression of behavior by timeout punishment when suppression results in loss of positive reinforcement

This investigation, using rats as subjects and punishment by timeout for responses maintained on a ratio schedule, sought to determine whether behavior would be suppressed by timeout punishment when such suppression also reduced reinforcement density or frequency. A series of experiments indicated that timeout punishment suppressed responding, with the degree of suppression increasing as a function of the duration of the timeout period. Suppressive effects were found to decrease as a function of increases in deprivation (body weight) and were eliminated when the punished response also was reinforced. It was concluded that timeout can produce aversive effects even when loss of reinforcement results. An alternative interpretation of the findings, based on the effects of extinction periods and delay of reinforcement on chained behavior, was discussed.     

Noncontingent and differential reinforcement in the treatment of pediatric feeding problems

We conducted functional analyses of the inappropriate mealtime behavior of 5 children diagnosed with feeding problems. Then, we compared the effects of differential and noncontingent reinforcement, and the relative effects of escape extinction with and without differential or noncontingent reinforcement, when escape extinction appeared necessary. Both reinforcement procedures were effective without escape extinction to treat food refusal for 1 child, but only differential reinforcement was effective without escape extinction to treat the child's liquid refusal. Escape extinction was necessary for 4 of 5 children. The addition of positive reinforcement resulted in beneficial effects (i.e., more stable acceptance, decreased inappropriate mealtime behavior or negative vocalizations) with 3 of 4 children. With escape extinction, differential reinforcement was more effective to treat food refusal for 2 children and noncontingent reinforcement was more effective for 1 child.     

Generalized imitative affection: Relationship to prior kinds of imitation training

Two experiments utilizing first- and second-grade Canadian children showed that generalized imitative physical affection was most facilitated by prior imitative physical contact training (as opposed to verbal contact training) when the object of the affection was either a toy teddy bear, Experiment I, or an adult human, Experiment II.Additional findings from Experiment I showed that generalized imitative physical aggression was equally facilitated by imitative physical contact training and that punishment, as well as extinction operations applied to training imitations, resulted in suppression of all generalized imitations with no differential effect of punishment on affection or aggression being noted.The lack of any persisting imitations in a control group in Experiment II, which received noncontingent reinforcement but instructional prompting for training imitations, suggested that instructional control of imitation responses was initially weak and that the contingency between reinforcement and training imitations was critical for continued occurrence of training imitations and any occurrence of generalized physical affection imitations.     

Acquisition and extinction of signaled avoidance as a function of intermittent reinforcement

Signaled, shuttle-box avoidance responding in female rats of the Fischer₃₄₄ strain was examined as a function of four separate contingencies of intermittent reinforcement. In Experiment 1, when avoidance responses during acquisition were reinforced 25% of the time with prompt CS termination, animals responded equally often during acquisition and significantly more often during extinction than animals who received such reinforcement on a 100% schedule. Similar results were found under a trace procedure in Experiment 2 when avoidance responses were reinforced 25% of the time with informational feedback stimuli. In contrast, during Experiment 3, when animals were shocked on only 25% of the trials on which they failed to respond, the level of avoidance responding during both acquisition and extinction was significantly less than it was when animals were shocked on a 100% schedule. Comparable results were found in Experiment 4 when avoidance responses during acquisition averted shock on only 25% of the trials. Thus, intermittent reinforcement contingencies involving response-contingent feedback stimuli and shock have differential effects on avoidance responding during both acquisition and extinction trials under the signaled avoidance procedure.     

A facilitative effect of punishment on unpunished behavior

The key pecking of two pigeons was reinforced on a variable-interval schedule of reinforcement during the presentation of each of two stimuli. In various phases of the experiment, punishment followed every response emitted in the presence of one of the stimuli. In general, when the rate of punished responding changed during the presentation of one stimulus, the rate of unpunished responding during the other stimulus changed in the opposite direction. This sort of change in rate is an example of behavioral contrast. When punishment was introduced, the rate of punished responding decreased and the rate of unpunished responding increased as functions of shock intensity. When the rate of previously punished responding increased after the termination of the shock, the rate of the always unpunished responding decreased. When the procedure correlated with a red key was changed from variable-interval reinforcement and punishment for each response to extinction and no punishment, the rate of reinforced responding during presentations of a green key decreased and then increased while the rate of the previously punished responding during red first increased and then decreased during extinction.     

EFFECTS OF WARNING STIMULI FOR REINFORCER WITHDRAWAL AND TASK ONSET ON SELF-INJURY

Results of a functional analysis of self-injurious behavior (SIB) in a child with autism showed that her SIB was maintained by access to preferred objects and escape or avoidance of task demands. Extinction and noncontingent reinforcement treatments were supplemented by presenting a statement combined with a picture cue at 30-s intervals indicating that a preferred object would be removed or a task would be presented. Warning stimuli in combination with extinction and noncontingent reinforcement reduced SIB to acceptable levels. SIB rates remained comparatively high in a control condition consisting of a 2-min delay to onset of reinforcer removal or task demands.     

Enhancing the effects of extinction on attention-maintained behavior through noncontingent delivery of attention or stimuli identified via a competing stimulus assessment

Recent research has shown that the noncontingent delivery of competing stimuli can effectively reduce rates of destructive behavior maintained by social-positive reinforcement, even when the contingency for destructive behavior remains intact. It may be useful, therefore, to have a systematic means for predicting which reinforcers do and do not compete successfully with the reinforcer that is maintaining destructive behavior. In the present study, we conducted a brief competing stimulus assessment in which noncontingent access to a variety of tangible stimuli (one toy per trial) was superimposed on a fixed-ratio 1 schedule of attention for destructive behavior for individuals whose behavior was found to be reinforced by attention during a functional analysis. Tangible stimuli that resulted in the lowest rates of destructive behavior and highest percentages of engagement during the competing stimulus assessment were subsequently used in a noncontingent tangible items plus extinction treatment package and were compared to noncontingent attention plus extinction and extinction alone. Results indicated that both treatments resulted in greater reductions in the target behavior than did extinction alone and suggested that the competing stimulus assessment may be helpful in predicting stimuli that can enhance the effects of extinction when noncontingent attention is unavailable. DESCRIPTORS: Attention-maintained problem behavior, competing stimuli, extinction, functional analysis, noncontingent reinforcement     

A method for identifying satiation versus extinction effects under noncontingent reinforcement schedules

We evaluated one method for determining whether response suppression under noncontingent reinforcement (NCR) is a function of satiation or extinction. Three individuals with developmental disabilities who engaged in self-injurious behavior (SIB) or aggression participated. Results of functional analyses indicated that their problem behavior was maintained by social-positive reinforcement. NCR procedures, individualized for each participant, were implemented in a multiple baseline across subjects design and were associated with decreases in all participants' problem behavior. Identification of the mechanism by which NCR produced these effects was based on examination of cumulative records showing response patterns during and immediately following each NCR session. Satiation during NCR should lead to a temporary increase in responding during the post-NCR (extinction) period due to a transition from the availability to the unavailability of reinforcement (satiation to deprivation). Alternatively, extinction during NCR should reveal no increase in responding during the extinction period because the contingency for the problem behavior would remain unchanged and the transition from satiation to deprivation conditions would be irrelevant. Results suggested that the operative mechanisms of NCR were idiosyncratic across the 3 participants and appeared to change during treatment for 1 of the participants.