THE INFLUENCE OF BEHAVIOR PRECEDING A REINFORCED RESPONSE ON BEHAVIOR CHANGE IN THE CLASSROOM1

The influence of behavior that immediately precedes a reinforced target response on the effectiveness of a reinforcement contingency was examined in two experiments with mentally retarded children in a special-education classroom. Two reinforcement schedules were examined in each experiment. For each schedule, a prespecified period of attentive behavior served as the target response. The schedules differed in whether inattentive or attentive behavior was required immediately to precede the target response. These schedules were examined with one child in a simultaneous treatment design using praise as the reinforcer (Experiment I), and with two children in separate reversal designs using tokens as the reinforcer (Experiment II). While attentive behavior increased under each schedule, the increase was greater when attentive rather than inattentive behavior preceded the reinforced response. The results indicated that the effect of a contingency may be determined not only by the specific response reinforced but also by the behavior that immediately precedes that response.     

The effects of response cost in the treatment of aberrant behavior maintained by negative reinforcement

Positive reinforcement contingencies can sometimes be used to decrease problem behavior maintained by negative reinforcement (e.g., escape). In the current study, we evaluated the extent to which response cost (i.e., contingent removal of a preferred stimulus) would compete with the negative reinforcer maintaining destructive behavior. The response cost contingency reduced destructive behavior by 87% from baseline levels even though the negative reinforcement contingency (i.e., escape) remained in place.     

AGGRESSION AS POSITIVE REINFORCEMENT IN MICE UNDER VARIOUS RATIO‐ AND TIME‐BASED REINFORCEMENT SCHEDULES

There is evidence suggesting aggression may be a positive reinforcer in many species. However, only a few studies have examined the characteristics of aggression as a positive reinforcer in mice. Four types of reinforcement schedules were examined in the current experiment using male Swiss CFW albino mice in a resident—intruder model of aggression as a positive reinforcer. A nose poke response on an operant conditioning panel was reinforced under fixed‐ratio (FR 8), fixed‐interval (FI 5‐min), progressive ratio (PR 2), or differential reinforcement of low rate behavior reinforcement schedules (DRL 40‐s and DRL 80‐s). In the FR conditions, nose pokes were maintained by aggression and extinguished when the aggression contingency was removed. There were long postreinforcement pauses followed by bursts of responses with short interresponse times (IRTs). In the FI conditions, nose pokes were maintained by aggression, occurred more frequently as the interval elapsed, and extinguished when the contingency was removed. In the PR conditions, nose pokes were maintained by aggression, postreinforcement pauses increased as the ratio requirement increased, and responding was extinguished when the aggression contingency was removed. In the DRL conditions, the nose poke rate decreased, while the proportional distributions of IRTs and postreinforcement pauses shifted toward longer durations as the DRL interval increased. However, most responses occurred before the minimum IRT interval elapsed, suggesting weak temporal control of behavior. Overall, the findings suggest aggression can be a positive reinforcer for nose poke responses in mice on ratio‐ and time‐based reinforcement schedules.     

An Analysis of Group-Oriented Contingencies and Associated Side Effects in Preschool Children

Group-oriented contingencies are arranged to target the behavior of a group of people simultaneously. Overall, group-oriented contingencies have been shown to be effective in both decreasing problem behavior and increasing appropriate behavior. However, results are mixed regarding which type(s) of group-oriented contingency is most effective for changing behavior. In addition, although there are anecdotal reports of positive and negative side effects when using group-oriented contingencies, little research has involved direct measurement of these potential side effects. The purposes of the current study were to (a) compare the effects of three types of group-oriented contingencies for increasing on-task behavior and decreasing problem behavior, (b) determine whether implementing a group-oriented contingency for one behavior resulted in changes in a non-targeted behavior, and (c) determine how often and under what conditions side effects occurred within group-oriented contingencies conditions for two groups of preschool children. The results of the study were mixed. The results suggested that group-oriented contingencies were effective in decreasing problem behavior and increasing on-task behavior, but varied across groups as to which contingencies were the most effective at changing both behaviors. Secondary data suggested that side effects were associated with group-oriented contingencies, as well as the occurrence of problem behavior and reinforcer delivery.     

Escape from an effortful situation

This experiment investigated the tendency to escape from a situation requiring effortful responding. Five human subjects responded in a situation where the response mechanism required 20-lb force to operate; responses were reinforced according to a variable-interval schedule. A subject escaped from this situation by emitting a vocal response which produced a 60-sec “easy period”. During the easy period the reinforcement contingency was switched to a response mechanism requiring 1 lb to operate. It was found that: (1) Escape responding could be conditioned and maintained by producing the easy period; the easy period did not maintain escape responding when the force requirement in the normal situation was equated with it. (2) The rate of escape responding was a function of the magnitude of the force normally required. (3) When easy periods were scheduled after fixed ratios, pausing from the end of the previous easy period to the first escape response was noted. It was concluded that a situation requiring high-force responding is a negative reinforcer. The pattern of fixed-ratio responding suggests that this reinforcer produces typical schedule control in human subjects.     

"Turning back the clock" on serial-stimulus sign tracking.

Two experiments examined the effects of a negative (setback) response contingency on key pecking engendered by a changing light-intensity stimulus clock (ramp stimulus) signaling fixed-time 30-s food deliveries. The response contingency specified that responses would immediately decrease the light-intensity value, and, because food was delivered only after the highest intensity value was presented, would delay food delivery by 1 s for each response. The first experiment examined the acquisition and maintenance of responding for a group trained with the contingency in effect and for a group trained on a response-independent schedule with the ramp stimulus prior to introduction of the contingency. The first group acquired low rates of key pecking, and, after considerable exposure to the contingency, those rates were reduced to low levels. The rates of responding for the second group were reduced very rapidly (within four to five trials) after introduction of the setback contingency. For both groups, rates of responding increased for all but 1 bird when the contingency was removed. A second experiment compared the separate effects of each part of the response contingency. One group was exposed only to the stimulus setback (stimulus only), and a second group was exposed only to the delay of the reinforcer (delay only). The stimulus-only group's rates of responding were immediately reduced to moderate levels, but for most of the birds, these rates recovered quickly when the contingency was removed. The delay-only groups's rates decreased after several trials, to very low levels, and recovery of responding took several sessions once the contingency was removed. The results suggest that (a) sign-tracking behavior elicited by an added clock stimulus may be reduced rapidly and persistently when a setback contingency is imposed, and (b) the success of the contingency is due both to response-dependent stimulus change and response-dependent alterations in the frequency of food delivery. The operation of the contingency is compared with the effects of secondary reinforcement and punishment procedures.     

The effect of contingency upon the appetitive conditioning of free-operant behavior

The problem of maintaining independence between response rates and reinforcement probabilities when determining the effect of varying the response-reinforcement contingency upon free-operant behavior was solved by programming local reinforcement probabilities for response and no response on a second-by-second basis. Fifty-seven rats were trained to lever-press on schedules of water reinforcement involving different values of contingency. All rats were first trained on a high positive contingency and then shifted to less positive, zero, or negative contingencies. Under these conditions, rate of lever-pressing declined appropriately when the contingency between response and reinforcement decreased or was made negative. The decline in rate produced by a zero contingency cannot be attributed to extinction, since the probability of reinforcement given the occurrence of a response was the same as for the positive contingency from which the shift to zero was made. That is, there was no change in the opportunity for response-reinforcement contiguity. It was concluded that the technique of programming local reinforcement probabilities offers promise for more critical examinations of the effects of contingency upon free-operant behavior.     

Response acquisition under direct and indirect contingencies of reinforcement

We compared the effects of direct and indirect reinforcement contingencies on the performance of 6 individuals with profound developmental disabilities. Under both contingencies, completion of identical tasks (opening one of several types of containers) produced access to identical reinforcers. Under the direct contingency, the reinforcer was placed inside the container to be opened; under the indirect contingency, the therapist held the reinforcer and delivered it to the participant upon task completion. One participant immediately performed the task at 100% accuracy under both contingencies. Three participants showed either more immediate or larger improvements in performance under the direct contingency. The remaining 2 participants showed improved performance only under the direct reinforcement contingency. Data taken on the occurrence of "irrelevant" behaviors under the indirect contingency (e.g., reaching for the reinforcer instead of performing the task) provided some evidence that these behaviors may have interfered with task performance and that their occurrence was a function of differential stimulus control.     

Resurgence of goal-directed actions and habits

This study investigated how goal-directed and habitual behaviors recover after extinction within the context of the resurgence effect, a form of relapse induced by the removal or worsening of alternative reinforcement. Rats were trained to press a target lever with one reinforcer (O1) for either minimal (4) or extended (16) sessions. An extinction test after the completion of O1 devaluation confirmed that minimal and extended training formed goal-directed and habitual behaviors, respectively. Then, pressing an alternative lever was reinforced with a second reinforcer (O2) while the target response was placed on extinction. When O2 was discontinued, the minimally trained target response resurged with goal-directed status as in the extinction test. However, the extinguished habitual behavior in the extensively trained rats did not recover as a habit but instead with goal-directed status, possibly due to the context specificity of habits or the introduction of a new response–reinforcer contingency. The critical finding that reinforcer devaluation consistently led to less resurgence regardless of the amount of acquisition training provides a clinical implication that coupling differential-reinforcement-of-alternative-behavior (DRA) treatments with the devaluation of the associated reinforcer of problematic behavior could effectively diminish its recurrence.     

The role of the response-reinforcer contingency in negative automaintenance

When a response key is briefly illuminated before a grain reinforcer is presented, key pecking is reliably developed and maintained in pigeons, even if pecking prevents reinforcement (negative automaintenance). This experiment demonstrated that pigeons are sensitive to a negative response-reinforcer contingency, even though it does not eliminate responding. Within individual pigeons, two kinds of trials were compared: red key trials, in which reinforcement was negatively contingent on responding, and white key trials, in which reinforcement was unrelated to responding. Reinforcement frequency in non-contingent trials was yoked to the obtained reinforcement frequency in negatively contingent trials. All eight pigeons pecked substantially more on the non-contingent key than on the negative key, and preferred the non-contingent key to the negative key on occasional “choice” trials where both were presented together. When the stimuli correlated with the two conditions were reversed, the pigeons' behavior also shifted. These response differences are taken as evidence that pigeons are sensitive to the negative response-reinforcer contingency.     

ATTENTION AS AN ESTABLISHING OPERATION AND AS REINFORCEMENT DURING FUNCTIONAL ANALYSES

Results of functional analyses for 36 individuals whose self-injurious behavior (SIB) was maintained by attention indicated that SIB was highest during a condition in which the individual was deprived of attention (establishing operation) except as a consequence (reinforcer). Deprivation in the absence of reinforcement produced marginal increases in SIB in 5 individuals, and a relatively rich schedule of noncontingent attention produced the lowest levels of SIB. These results suggest that clearer functional analysis outcomes are likely to be obtained when test conditions contain both an establishing operation to evoke behavior as well as a reinforcement contingency to maintain it.     

Transfer of the signaling properties of aversive CSs to an instrumental appetitive discrimination

Rats received Pavlovian conditioning in which, based on a shock US, white noise was established for different groups as an aversive CS+, CSo, or CS?. Then, half of each group received the CS contingent upon either the food-reinforced or nonreinforced response in an easy, choice discrimination. Correct responses, i.e., number of reinforcements, to criterion showed that a CS+ for the reinforced response facilitated learning, whereas a CS? retarded learning; conversely, a CS+ for the nonreinforced response retarded learning, whereas a CS? facilitated learning. The same contingency difference occurred with errors to criterion for CS? subjects but was obscured for CS+ subjects apparently by an avoidance-producing effect of the CS+. In support of the generality of the transfer effect, Z-score transforms of the correct-response data showed that the magnitude of transfer was comparable to that obtained in more difficult discriminations. Collectively, the findings indicate that an aversive CS can function as a transformed signal for the presence (CS+) or absence (CS?) of an appetitive reinforcer and that the signal's control of behavior is via a within-chain mediational process.     

Human Sensitivity To Concurrent Schedules Of Reinforcement: Effects Of Observing Schedule-correlated Stimuli

The determinants of human sensitivity to concurrent variable-interval variable-interval schedules of reinforcement have been difficult to identify, in part because of procedural differences separating published experiments. This experiment investigated vigilance to stimuli correlated with concurrent schedules. Across phases, 3 college students were provided with either no schedule-correlated stimuli, an observing response that provided brief access to the stimuli, or a contingency that required the subject to identify the stimulus correlated with the source of each obtained reinforcer. Sensitivity, as quantified by the generalized matching equation, was low when no stimuli were available. When the stimuli were response contingent, 1 subject observed them, and her behavior became more sensitive to the distribution of reinforcers across the concurrent schedules. When the procedure required discrimination of the stimulus correlated with each reinforcer, the other 2 subjects also observed the stimuli, and their schedule sensitivity was increased as well. These results implicate procedural differences, rather than inherent behavioral differences, as the source of differences in sensitivity to schedules of reinforcement between humans and nonhumans.     

Dynamical concurrent schedules

Previous work on the matching law has predominantly focused on the molar effects of the contingency by examining only one reinforcer ratio for extended periods. Responses are distributed as a function of reinforcer ratios under these static conditions. But the outcome under a dynamic condition in which reinforcer ratios change continuously has not been determined. The present study implemented concurrent variable-interval schedules that changed continuously across a fixed 5-min trial. The schedules were reciprocally interlocked. The variable interval for one key changed continuously from a variable-interval 15-s to a variable-interval 480-s, while the schedule for the other key changed from a variable-interval 480-s to a variable-interval 15-s. This dynamical concurrent schedule shifted behavior in the direction of matching response ratios to reinforcer ratios. Sensitivities derived from the generalized matching law were approximately 0.62, the mean absolute bias was approximately 0.11, and r2s were approximately 0.86. It was concluded that choice behavior can come to adapt to reinforcer ratios that change continuously over a relatively short time and that this change does not require extensive experience with a fixed reinforcer ratio. The results were seen as supportive of the view that all behavior constitutes choice.     

The effect of CS-US contingency variation on GSR and on subjective CS-US relational awareness

Ninety subjects were tested in a single-cue Pavlovian conditioning paradigm involving three groups which differed with regard to the contingency relationship between CS and US (negative contingency, zero contingency, positive contingency). To examine the relationship between conditioned GSR performance and subject’s cognitive beliefs regarding the CS-US relationship, both GSR and CS-US relational learning were constantly measured on a continuous scale over the entire experimental session. The data suggest the independence of autonomic and cognitive responding in the single-cue Pavlovian paradigm.     

THE EFFECTS OF CONTINGENT AND NONCONTINGENT ATTENTION ON SELF-INJURY AND SELF-RESTRAINT

Self-restraint and self-injurious behavior (SIB) are two responses that can sometimes be members of the same functional response class (i.e., maintained by the same contingency). In such cases, a single treatment should be effective for both responses. In this investigation, we examined the effects of providing attention (the presumed reinforcer) both noncontingently and contingent upon either SIB or self-restraint. Results were consistent with our hypothesis that both responses were maintained by attention and suggested that noncontingent reinforcement was a potentially effective treatment.     

Superstitious behavior in humans

Twenty undergraduate students were exposed to single response-independent schedules of reinforcer presentation, fixed-time or variable-time, each with values of 30 and 60 s. The reinforcer was a point on a counter accompanied by a red lamp and a brief buzzer. Three color signals were presented, without consistent relation to reinforcer or to the subjects' behavior. Three large levers were available, but the subjects were not asked to perform any particular behavior. Three of the 20 subjects developed persistent superstitious behavior. One engaged in a pattern of lever-pulling responses that consisted of long pulls after a few short pulls; the second touched many things in the experimental booth; the third showed biased responding called sensory superstition. However, most subjects did not show consistent superstitious behavior. Reinforcers can operate effectively on human behavior even in the absence of a response-reinforcer contingency and can, in some cases, shape stable superstitious patterns. However, superstitious behavior is not a consistent outcome of exposure of human subjects to response-independent reinforcer deliveries.     

Self-control in mentally retarded adolescents: choice as a function of amount and delay of reinforcement.

Three severely mentally retarded adolescents were studied under discrete-trial procedures in which a choice was arranged between edible reinforcers that differed in magnitude and, in some conditions, delay. In the absence of delays the larger reinforcer was consistently chosen. Under conditions in which the smaller reinforcer was not delayed, increasing the delay to delivery of the larger reinforcer decreased the percentage of trials in which that reinforcer was chosen. All subjects directed the majority of choice responses to the smaller reinforcer when the larger reinforcer was sufficiently delayed, although the value at which this occurred differed across subjects. Under conditions in which the larger reinforcer initially was sufficiently delayed to result in preference for the smaller one, progressively increasing in 5-s increments the delay to both reinforcers increased percentage of trials with the larger reinforcer chosen. At sufficiently long delays, 2 of the subjects consistently chose the larger, but more delayed, reinforcer, and the 3rd subject chose that reinforcer on half of the trials. These results are consistent with the findings of prior studies in which adult humans responded to terminate noise and pigeons responded to produce food.     

The blocking of reinforcement control

Two experiments were conducted to extend the blocking effect to the reinforcement of a response. A delayed reinforcement contingency was presented to subjects with or without a previously pretrained response available during the delay interval. The interpolated response had no scheduled effect on delivery of the reinforcer, but its availability reduced strengthening of the initial response, which completely extinguished for some subjects. The results were interpreted as support for blocking as a fundamental principle of behavior, and as evidence against the principle of reinforcement being stated solely in terms of temporal proximity between response and reinforcer.     

Toxicosis affects instrumental behaviour in rats

Three experiments examined the effect of toxicosis on instrumental responding. These studies were prompted by Morrison and Collyer's (1974, Experiment 1) finding that the induction of toxicosis after an instrumental conditioning session produces greater response suppression if the response is reinforced by a novel saccharin solution rather than familiar water during conditioning. Experiments 1 and 2 investigated whether this suppression was mediated by the Pavlovian contingency between the contextual cues and the saccharin solution or the instrumental relationship between the response and the reward. A role for the instrumental contingency was indicated by the greater suppression of the response producing novel saccharin rather than water when the context of both responses was equally associated with the saccharin and illness. Experiment 3 found that extinction of the aversion to a novel reinforcer following aversive conditioning would re-establish an action previously associated with that reinforcer, in contrast to an action whose reinforcer remained aversive. This result was a further indication that the instrumental contingency between the response and reward contributes to response suppression.