TREATMENT OF MULTIPLY CONTROLLED PROBLEM BEHAVIOR

The aggressive behavior of a young boy with developmental delays occurred most frequently following a request to pick up his toys. The request ended a period of play and social interaction. This suggested the presence of multiple establishing operations. The initial treatment consisted of praise, a break, and access to the toys contingent on compliance. Results showed that aggression decreased only when we added social interaction to the break. Findings are discussed regarding treating multiply controlled problem behavior without extinction.     

Reinforcement and substitution in humans: a multiple-response analysis

Three adult human subjects engaged in activities such as reading, sewing, artwork, and candlemaking while living alone in a laboratory apartment 24 hours per day for several weeks. After a baseline period in which the activities were fully available, access to a particular activity (contingent response) was made dependent on engaging in another less-preferred activity (instrumental response). The contingencies produced substantial increases in instrumental responding, and responding decreased toward baseline levels when the dependency was removed. Under the contingent conditions, time earned for the concurrent activity was always less than the baseline level. To determine the contribution of this reduction to the instrumental increase, access to the contingent activity was restricted in the absence of any dependency. The results indicated that increases among responses that filled the newly available time could be selective, e.g., artwork increased when reading was restricted but candlemaking did not. It was concluded that the reductions in the contingent response that accompany contingencies usually do not exclusively determine instrumental increases, but selective increases can contribute to the increase in time devoted to the instrumental response.     

A study of misbehavior: token reinforcement in the rat

The purpose of this research was to investigate the phenomenon of misbehavior described by Breland and Breland (1961). Rats were trained to obtain ball-bearings and drop them in a hole for food or water reinforcers. In confirmation of the Brelands' observation, many subjects were slow to deliver the balls, and frequently attempted to chew them before they were dropped. A series of four experiments, in which the same rats were used throughout, showed that delivery times tended to be longer with food than with water, and that these times increased when nylon balls were substituted. The effect of motivational level was investigated by varying both deprivation and amount of prefeeding; no effect on delivery time was detected, although other measures of performance were affected by motivational factors. Similar results were obtained in a final experiment that employed a new set of naive subjects. The studies demonstrated that misbehavior can be studied in an experimental situation, and the results supported an analysis in terms of competition between stimulus-reinforcer and response-reinforcer contingencies. The question of why such effects have not been reported in previous token reinforcer studies was unanswered.     

Species differences in temporal control of behavior II: human performance

Human subjects responded on two panels. A differential-reinforcement-of-low-rate schedule with a limited-hold contingency operated on Panel A. In Condition 1, responses on Panel B produced a stimulus on the panel that signalled whether reinforcement was available on Panel A. In Condition 2, responses on Panel B briefly illuminated a digital clock. In both conditions, performance on Panel A was very efficient; with few exceptions, Panel A was pressed only when reinforcement was available. Thus, in effect, a fixed-interval schedule operated on Panel B. In Condition 1, a “break-and-run” response pattern occurred on Panel B; with increasing temporal parameters, the duration of the postreinforcement pause on Panel B increased linearly while overall response rate and running rate (calculated by excluding the postreinforcement pauses) remained approximately constant. In Condition 2, the response pattern on Panel B was scalloped; the postreinforcement pause was a negatively accelerated increasing function of schedule value, while overall response rate and running rate were negatively accelerated decreasing functions of schedule value. The performance of subjects in Condition 2, but not in Condition 1, was highly sensitive to the contingencies in operation, and resembled that of other species on the fixed-interval schedule.     

Behavior simultaneously maintained by both presentation and termination of noxious stimuli

Lever pressing by two squirrel monkeys was maintained under a 3-minute variable-interval schedule of response-produced electric-shock presentation. At the same time, responding on a second lever was maintained under a 3-minute fixed-interval schedule of termination of the shock-presentation schedule and shock-correlated stimuli. Under the termination schedule, the first response after a 3-minute period produced a 1-minute timeout, during which no events occurred and responding had no scheduled consequence. Relatively high and constant rates of responding were maintained on the lever where responding produced shock. Lower rates and positively accelerated patterns of responding occurred on the lever where responding terminated the shock schedule. Thus, responding was simultaneously maintained by presentation of an event and by termination of a stimulus associated with that event. Rates and patterns of responding on each lever were reversed when the schedules arranged on each lever were reversed on two occasions. When shock intensity was increased from 0 to 10 mA, responding maintained both by presentation of shock and by termination of the shock schedule increased, but responding maintained by shock presentation increased to a greater extent. Positive and negative reinforcement, usually regarded as separate behavioral processes involving different events, can coexist when behavior is controlled by different contingencies involving the same event.     

THE TOKEN ECONOMY: A DECADE LATER

In the last decade, the token economy has been extended widely across populations and behaviors in treatment, rehabilitation, educational, and community settings. Outcome research has expanded as well to include large-scale program evaluations and comparative and combined treatment studies of the token economy. In a previous review (Kazdin & Bootzin, 1972), several obstacles were identified for the effective application of the token economy. These included identifying procedures to enhance program efficacy, to train staff, to overcome client resistance, and to promote long-term maintenance and transfer of training. The present paper discusses recent advances in research and reviews progress on the major issues identified previously. New issues have become salient in the last decade that pertain to the extension of the token economy to institutional settings. The demands for maintaining the integrity of treatment, the ability to integrate token economies within existing institutional constraints, and the disseminability of the procedures on a large scale are major issues that may dictate the future of the token economy.     

TOKEN REINFORCEMENT DURING THE INSTATEMENT AND SHAPING OF FLUENCY IN THE TREATMENT OF STUTTERING

The value of token reinforcement in the instatement and shaping of fluency was examined in an intensive treatment program for adult stutterers. Experiment 1 examined the effect of removing the tangible back-up reinforcers for the token system and found that clients' performance in the program was equally good with or without these back-up reinforcers, suggesting that a strict token economy may not be crucial to rapid progress through treatment. Experiment 2 compared contingent and noncontingent token reinforcement, while controlling for some variables that may have confounded the results of earlier research, and found no difference in clients' performance. Experiment 3 examined the effect of the entire removal of token reinforcement. Performance was found to be no worse under a “no tokens” system than under a system of tokens with back-up reinforcers. It is argued that in a highly structured treatment program where many other reinforcers are operating, token reinforcement may be largely redundant. Clinical and theoretical implications of the findings are discussed.     

Reinforcement contingencies and signal detection.

Pigeons were trained to discriminate temporal stimuli in a discrete-trial signal-detection procedure. Pecks to one side key were reinforced intermittently after exposure to one duration, and pecks to the other side key were reinforced intermittently after exposure to a different duration. In Experiment I, the allocation of reinforcers was varied systematically for correct responses and for errors, using a procedure that controlled the obtained numbers of reinforcers. When reinforcers were allocated symmetrically, the level of discrimination decreased as the proportion of reinforcers for errors increased. When reinforcers were allocated asymmetrically, the decrease in discrimination was less systematic. Bias toward one or the other side key roughly matched the ratio of reinforcers obtained by pecks at those keys, independent of the level of discrimination. In Experiment II, the overall rate of reinforcement for correct responses was varied both within and between experimental conditions. The level of discrimination was positively related to the overall rate of reinforcement. The discrimination data of both experiments were interpreted in relation to the contingencies of reinforcement and nonreinforcement, characterized by the average difference in reinforcement probability for correct responses and errors.     

Conditional acceleration and external disinhibition of operant lever pressing by prereward, neutral, and reinforcing stimuli

Rats responding under a differential-reinforcement-of-low-rate schedule increased their rates of lever pressing during a 20-second click/flash stimulus that preceded the delivery of a response-independent food pellet. The increase could not be attributed to suppression of collateral behavior that has been said to mediate temporally-spaced responding. We propose that the prereward stimulus functioned as an external disinhibitor of lever pressing that had been inhibited by the constraints of the operant schedule. Support is derived from the observed disinhibitory effects of a 10-second unpaired click/flash stimulus and of unsignaled, response-independent pellets that were presented while the animals were responding under the same schedule.     

INCREASING APPROPRIATE SPEECH IN A CHRONIC SCHIZOPHRENIC

In a severely withdrawn schizophrenic, a combination of instructions, modeling, informational feedback, and noncontingent reinforcement was associated with a low rate of appropriate verbalizations. However, an increase in speech output was obtained using a combination of instructions, modeling, informational feedback, and contingent reinforcement. The design of this study thus permitted the conclusion that contingent reinforcement was crucial in bringing about the increase in appropriate verbalizations. The three verbal behaviors that increased in frequency were: (a) the number of socially appropriate words emitted, (b) declarative statements, and (c) appropriate replies to questions. The verbal behaviors of conversational questions and positive conversational feedback failed to be significantly affected by the experimental procedures. An attempt was also made to establish whether having the subject engage in the observable, information-gathering response of reading aloud would result in increased speech output during a subsequent conversation period. Having the subject read aloud failed to have any discernible positive effect on his speech output. A withdrawal design was used to evaluate the effectiveness of the experimental procedures. The importance of assessing changes in verbal output with a variety of verbal response measures, stereotyped verbal behaviors, and carryover effects are discussed.