Concurrent schedules: Spatial separation of response alternatives

Four pigeons were exposed to independent concurrent variable-interval 20-second variable-interval 60-second schedules of reinforcement. A transparent partition was inserted midway between the two response keys. The length of the partition was systematically manipulated. Increasing partition length produced a decrease in changeover rate in Experiment 1. Over-matching was observed with a partition length of 20 centimeters. In Experiment 2 a four-second limited hold was added to the schedules. Increasing partition length produced a decrease in changeover rate that exceeded the decrease observed in Experiment 1. This manipulation produced nearly exclusive choice of the variable-interval 20-second component. The present results, together with results obtained in related research, suggest that deviation from matching is a function of procedural variables that determine the consequences of a changeover response.     

FUNCTIONAL COMMUNICATION TRAINING TO REDUCE CHALLENGING BEHAVIOR: MAINTENANCE AND APPLICATION IN NEW SETTINGS

We evaluated the initial effectiveness, maintenance, and transferability of the results of functional communication training as an intervention for the challenging behaviors exhibited by 3 students. Assessment indicated that escape from academic demands was involved in the maintenance of the challenging behaviors. Social attention was also implicated as controlling the behavior of 1 student. The intervention involved teaching alternative assistance-seeking and attention-getting phrases to the students in an effort to replace challenging behavior with these verbal equivalents. Multiple baseline data collected across the 3 students indicated that not only did the intervention substantially reduce challenging behavior but also that these results transferred across new tasks, environments, and teachers, and were generally maintained from 18 to 24 months following the introduction of functional communication training. These results are discussed in light of recent efforts to develop effective interventions for severe challenging behavior and to understand the processes underlying transfer and maintenance of intervention effects.     

Subjective probability and delay.

Human subjects indicated their preference between a hypothetical $1,000 reward available with various probabilities or delays and a certain reward of variable amount available immediately. The function relating the amount of the certain-immediate reward subjectively equivalent to the delayed $1,000 reward had the same general shape (hyperbolic) as the function found by Mazur (1987) to describe pigeons' delay discounting. The function relating the certain-immediate amount of money subjectively equivalent to the probabilistic $1,000 reward was also hyperbolic, provided that the stated probability was transformed to odds against winning. In a second experiment, when human subjects chose between a delayed $1,000 reward and a probabilistic $1,000 reward, delay was proportional to the same odds-against transformation of the probability to which it was subjectively equivalent.     

Violations of stochastic transitivity on concurrent chains: Implications for theories of choice

The concurrent-chains procedure has been used to measure how choice depends on various aspects of reinforcement, such as its delay and its magnitude. Navarick and Fantino (1972, 1974, 1975) have found that choice in this procedure can violate the condition of stochastic transitivity that is required if a unidimensional scale for reinforcements is to be possible. It is shown in this paper that two simple unidimensional models of choice on concurrent chains can produce violations of stochastic transitivity. It is argued that such violations may result from the complex contingencies of the concurrent-chains procedure.     

The interaction between stimulus and reinforcer control on remembering.

In a symbolic matching-to-sample task, 6 pigeons obtained food by pecking a red side key when the brighter of two white lights had been presented on the center key and by pecking a green side key when the dimmer of two white lights had been presented on the center key. Across Part 1 and Parts 6 to 10, the delay between sample-stimulus presentation and the availability of the choice keys was varied between 0 s and 25 s. Across Parts 1 to 5, the delay between the emission of a correct choice and the delivery of a reinforcer was varied between 0 s and 30 s. Although increasing both types of delay decreased stimulus discriminability, lengthening the stimulus-choice delay produced a greater decrement in choice accuracy than did lengthening the choice-reinforcer delay. Additionally, the relative reinforcer rate for correct choice was varied across both types of delay. The sensitivity of behavior to the distribution of reinforcers decreased as discriminability decreased under both procedures. These data are consistent with the view, based on the generalized matching law, that sample stimuli and reinforcers interact in their control over remembering.     

Performance of humans in concurrent avoidance/positive-reinforcement schedules

Performance maintained under concurrent schedules consisting of a variable-interval avoidance component and a variable-interval positive-reinforcement component was studied in three human subjects using points exchangeable for money as the reinforcer. The rate of responding in the avoidance component increased, and the rate of responding in the positive-reinforcement component declined, as a function of the frequency of point-losses avoided in the avoidance component. The performance of all three subjects conformed to equations proposed by Herrnstein to describe behavior in concurrent schedules. The logarithms of the ratios of the response rates in the two components, and the logarithms of the ratios of the times spent in the two components, were linearly related to the logarithms of the ratios of the frequency of loss avoidance in the avoidance component to the frequency of reinforcement in the positive-reinforcement component. When a changeover delay of 5.0 sec was imposed, the slopes of the linear functions were close to 1.0 in the case of two subjects, whereas the third subject exhibited significant undermatching. For two subjects the changeover delay was then reduced to 2.0 sec; in both cases the slopes of the linear functions were lower than under the 5.0-sec condition. One subject participated in a third phase, in which no changeover delay was imposed; there was a further reduction in the slopes of the linear functions.     

COLLATERAL GAINS AND SHORT-TERM MAINTENANCE IN READING AND ON-TASK RESPONSES BY INNER-CITY ADOLESCENTS AS A FUNCTION OF THEIR USE OF SOCIAL REINFORCEMENT WHILE TUTORING

Two experiments are reported concerning the effects of the differential use of verbal approval by problematic adolescents serving as tutors in a remedial reading program for an inner-city school. The experiments, each with 3 tutors and 15 tutees, used a combined multiple baseline and ABCBC design. Data showed that tutors' approvals as well as tutors' and tutees' on-task and reading responses were low and stable during baseline. Tutors were trained to use verbal approval for tutees' on-task behavior. Tokens were presented and withdrawn to control the tutors' use of approval. During phases in which tutors' approvals were raised via token dispensation, tutor reading and on-task scores increased in a nonexperimental setting. Tutee reading scores also increased as a function of tutor approvals. The second experiment replicated these findings and, in addition, (a) tested the validity of changes in reading responses via standardized tests, (b) isolated and compared the covariance between variables in all phases, and (c) provided data on tutee attention to tutors as a possible natural reinforcer for the short-term maintenance found in both studies. Data are discussed as evidence that tutors had acquired the ability to recruit reinforcement from the classroom for appropriate behavior.     

NORMAL CHILDREN AS TUTORS TO TEACH SOCIAL RESPONSES TO WITHDRAWN MENTALLY RETARDED SCHOOLMATES: TRAINING,MAINTENANCE, AND GENERALIZATION

The findings of the three experiments reported herein indicate that normal children can successfully teach social responses (i.e., delayed imitation, cooperative play, and verbalization of positive comments) to withdrawn mentally retarded peers. The effects of the intervention generalized across stimulus and response conditions, while the trained and generalized levels of responding were maintained after the end of the intervention. Moreover, the subjects developed social responding within their classrooms and play areas parallel to the intervention and continued to increase such responding after the interruption of the intervention. Direct edible reinforcement appeared to be necessary at least during the initial period of the intervention. Vicarious edible reinforcement seemed useful to prompt the appearance of responding. Vicarious social reinforcement was ineffective at the beginning of the intervention, but apparently acquired prompting power at a later stage of training. Generalization results indicated that the similarity between the response occasions used for training and those used for testing generalization played an important role. Yet, the extensiveness of training and the development of responding within the classrooms and play areas may also have had a relevant effect. The development of social responding within the classrooms and play areas appeared to be mainly the effect of new learning. This was perhaps due to vicarious and direct social reinforcement.     

OVERJUSTIFICATION EFFECTS IN TOKEN ECONOMIES

This study tested the relevance to clinical token economies of the overjustification hypothesis that tangible reward interferes with intrinsic interest in target behaviors and causes such behaviors to be less probable following a period of reinforcement than preceding such a period. The study was carried out in an ongoing token economy for chronic psychiatric patients. Alternated over an 8-week period were weeks of token and no-token reward for one of the program's target behaviors, toothbrushing. Two different amounts of token reward were employed in order to examine whether reward magnitude might influence the presence or extent of overjustification effects. Little evidence was found for the presence of overjustification effects in token economies. However, maintenance of toothbrushing was greater in no-token weeks following weeks of low amounts of token reward than in no-token weeks following weeks of higher amounts of reward. The importance of such complex functional relationships is discussed.     

Concurrent schedules: a quantitative relation between changeover behavior and its consequences

Data from several published experiments on concurrent variable-interval schedules were analyzed with respect to the effects of changeover delay on the time spent responding on a schedule before changing to an alternate schedule: i.e., the interchangeover time. Interchangeover time increases as the duration of the changeover delay increases, and the present analysis shows that a power function describes the relation. The power relation applied in spite of numerous differences in the experiments: different variable-interval schedules for the concurrent pairs; equal or unequal reinforcement rates for the schedules of the concurrent pairs; different durations of the changeover delay; response-dependent or response-independent reinforcers; pigeons or rats as subjects; different reinforcers. A power function also described the data in experiments where the changeover incurred a timeout, where a fixed ratio was required to changeover, and also when asymmetrical changeover delays were used.