Second-order schedules of token reinforcement with pigeons: effects of fixed- and variable-ratio exchange schedules

Pigeons' key pecks produced food under second-order schedules of token reinforcement, with light-emitting diodes serving as token reinforcers. In Experiment 1, tokens were earned according to a fixed-ratio 50 schedule and were exchanged for food according to either fixed-ratio or variable-ratio exchange schedules, with schedule type varied across conditions. In Experiment 2, schedule type was varied within sessions using a multiple schedule. In one component, tokens were earned according to a fixed-ratio 50 schedule and exchanged according to a variable-ratio schedule. In the other component, tokens were earned according to a variable-ratio 50 schedule and exchanged according to a fixed-ratio schedule. In both experiments, the number of responses per exchange was varied parametrically across conditions, ranging from 50 to 400 responses. Response rates decreased systematically with increases in the fixed-ratio exchange schedules, but were much less affected by changes in the variable-ratio exchange schedules. Response rates were consistently higher under variable-ratio exchange schedules than tinder comparable fixed-ratio exchange schedules, especially at higher exchange ratios. These response-rate differences were due both to greater pre-ratio pausing and to lower local rates tinder the fixed-ratio exchange schedules. Local response rates increased with proximity to food under the higher fixed-ratio exchange schedules, indicative of discriminative control by the tokens.     

A local model of concurrent performance

Concurrent procedures may be conceptualized as consisting of two pairs of schedules with only one pair operating at a time. One schedule of each pair arranges reinforcers for staying in the current alternative, and the other schedule arranges reinforcers for switching to the other alternative. These pairs alternate operation as the animal switches between choices. This analysis of the contingencies suggests that variables operating within an alternative produce behavior that conforms to the generalized matching law. Rats were exposed to one pair of stay and switch schedules in each condition, and the probabilities of reinforcement varied across conditions. Both run length and visit duration were power functions of the ratio of the probabilities of reinforcement for staying and switching. The local model, a model of performance on concurrent procedures, was derived from this power function. Performance on concurrent schedules was synthesized from the performances on the separate pairs. Both the generalized matching law and the local model fitted the synthesized concurrent performances. These results are consistent with the view that the contingencies in the alternative, the probability of stay and switch reinforcement, are responsible for performance consistent with the generalized matching law. These results are compatible with momentary maximizing and molar maximizing accounts of concurrent performance. Models of concurrent performance that posit comparisons among the alternatives are not easily applied to these results.     

COMPETITION BETWEEN POSITIVE AND NEGATIVE REINFORCEMENT IN THE TREATMENT OF ESCAPE BEHAVIOR

We compared the effects of reinforcing compliance with either positive reinforcement (edible items) or negative reinforcement (a break) on 5 participants' escape-maintained problem behavior. Both procedures were assessed with or without extinction. Results showed that compliance was higher and problem behavior was lower for all participants when compliance produced an edible item rather than a break. Treatment gains were achieved without the use of extinction. Results are discussed regarding the use of positive reinforcement to treat escape behavior.     

AUGMENTING SIMPLIFIED HABIT REVERSAL IN THE TREATMENT OF ORAL-DIGITAL HABITS EXHIBITED BY INDIVIDUALS WITH MENTAL RETARDATION

We investigated whether a simplified habit reversal treatment eliminates fingernail biting and related oral-digital habits exhibited by individuals with mild to moderate mental retardation. Although simplified habit reversal did little to decrease the target behaviors for 3 of 4 participants, simplified habit reversal plus additional treatment procedures decreased the behavior to near-zero levels for all participants. These procedures included remote prompting, remote contingencies involving differential reinforcement plus response cost, and differential reinforcement of nail growth. Limitations of habit reversal for individuals with mental retardation along with directions for future research involving therapist-mediated treatment procedures, particularly those involving remote prompting and remote contingencies, are discussed.     

THE EFFECT OF TOKEN REWARDS ON “INTRINSIC” MOTIVATION FOR DOING MATH

This study used a multielement baseline design to analyze the effects of token rewards delivered contingent upon completion of math problems by 2 middle-school boys. Time spent on math and number of work pages completed increased (with high accuracy) during reward conditions and were maintained during fading and withdrawal. At follow-up, time spent and work pages completed remained well above baseline for 1 boy and fell below for the other, while accuracy remained high and ratings of liking math were the highest possible for both boys. Overall, the results are inconsistent with warnings about use of token rewards to motivate children.     

On the relation between object manipulation and stereotypic self-injurious behavior

Results from a number of studies have shown an inverse relationship between stereotypic behavior and object manipulation. The purposes of this study were to determine whether techniques similar to those used previously (prompting and reinforcement) would be effective in increasing object manipulation under both prompted and unprompted conditions, and to ascertain whether increases in object manipulation would result in decreases in stereotypic self-injurious behavior (SIB). Two individuals with developmental disabilities who engaged in SIB maintained by automatic reinforcement participated. Results showed that object manipulation increased from baseline levels when experimenters prompted participants to manipulate leisure items, but that object manipulation was not maintained under unprompted conditions, and rates of SIB stayed within baseline levels. We then attempted to increase object manipulation further by (a) reinforcing object manipulation, (b) blocking SIB while reinforcing manipulation, and (c) preventing SIB by applying protective equipment while reinforcing object manipulation. Reinforcing object manipulation alone did not affect levels of object manipulation. Blocking effectively reduced attempts to engage in SIB for 1 participant but produced no increase in object manipulation. When the 2nd participant was prevented from engaging in SIB through the use of protective equipment, rates of object manipulation increased dramatically but were not maintained when the equipment was removed. These results suggest that stimulation derived from object manipulation, even when supplemented with arbitrary reinforcement, may not compete with stimulation produced by stereotypic SIB; therefore, direct interventions to reduce SIB are required.     

An evaluation of response cost in the treatment of inappropriate vocalizations maintained by automatic reinforcement

In the current study, we examined the utility of a procedure consisting of noncontingent reinforcement with and without response cost in the treatment of inappropriate vocalizations maintained by automatic reinforcement. Results are discussed in terms of examining the variables that contribute to the effectiveness of response cost as treatment for problem behavior maintained by automatic reinforcement.     

Teaching peer reinforcement and grocery words: An investigation of observational learning and instructive feedback

A multiple probe across behaviors design, replicated across participants, assessed the effectiveness of constant time delay in teaching appropriate peer reinforcement and grocery words to 3 elementary students with moderate intellectual disabilities. Additionally, pretests and posttests assessed the acquisition of the participants' observational learning (acquisition of peers' grocery words) and instructive feedback (related information supplied by the teacher in the consequent event). Results indicate that the participants learned (a) how to appropriately reinforce peers, (b) to read their grocery words, (c) some of the targeted stimuli of their peers, and (d) much of the instructive feedback that was associated with each of the grocery words. Maintenance data indicate that the participants maintained their target grocery words at high levels of accuracy.     

SINGLE‐SAMPLE DISCRIMINATION OF DIFFERENT SCHEDULES' REINFORCED INTERRESPONSE TIMES

Food‐deprived rats in Experiment 1 responded to one of two tandem schedules that were, with equal probability, associated with a sample lever. The tandem schedules' initial links were different random‐interval schedules. Their values were adjusted to approximate equality in time to completing each tandem schedule's response requirements. The tandem schedules differed in their terminal links: One reinforced short interresponse times; the other reinforced long ones. Tandem‐schedule completion presented two comparison levers, one of which was associated with each tandem schedule. Pressing the lever associated with the sample‐lever tandem schedule produced a food pellet. Pressing the other produced a blackout. The difference between terminal‐link reinforced interresponse times varied across 10‐trial blocks within a session. Conditional‐discrimination accuracy increased with the size of the temporal difference between terminal‐link reinforced interresponse times. In Experiment 2, one tandem schedule was replaced by a random ratio, while the comparison schedule was either a tandem schedule that only reinforced long interresponse times or a random‐interval schedule. Again, conditional‐discrimination accuracy increased with the temporal difference between the two schedules' reinforced interresponse times. Most rats mastered the discrimination between random ratio and random interval, showing that the interresponse times reinforced by these schedules can serve to discriminate between these schedules.