Superimposition of response-independent reinforcement

Studies that have superimposed response-independent reinforcement (or reinforcers scheduled by contingencies placed on the absence of responding) upon conventional response-dependent schedules are reviewed. In general, providing alternative sources of reinforcement reduced response rates below the levels observed when alternative reinforcement was absent. However, response-rate elevation was sometimes found, particularly when rates of superimposed response-independent reinforcement were low. Superimposition of schedules providing reinforcers contingent on the absence of responding usually produced more severe response-rate decrements than superimposition of response-independent reinforcement. A variant of Herrnstein's equation, which assumes that some of the alternative reinforcers function as if they were delivered by baseline response-dependent source of reinforcement, is in qualitative agreement with the overall body of results obtained, and can predict both increases and decreases in response rate as resulting from superimposed reinforcers.     

More on concurrent interval-ratio schedules: a replication and review.

It has been suggested that the failure to maximize reinforcement on concurrent variable-interval, variable-ratio schedules may be misleading. Inasmuch as response costs are not directly measured, it is possible that subjects are optimally balancing the benefits of reinforcement against the costs of responding. To evaluate this hypothesis, pigeons were tested in a procedure in which interval and ratio schedules had equal response costs. On a concurrent variable time (VT), variable ratio-time (VRT) schedule, the VT schedule runs throughout the session and the VRT schedule is controlled by responses to a changeover key that switches from one schedule to the other. Reinforcement is presented independent of response. This schedule retains the essential features of concurrent VI VR, but eliminates differential response costs for the two alternatives. It therefore also eliminates at least one significant ambiguity about the reinforcement maximizing performance. Pigeons did not maximize rate of reinforcement on this procedure. Instead, their times spent on the alternative schedules matched the relative rates of reinforcement, even when schedule parameters were such that matching earned the lowest possible overall rate of reinforcement. It was further shown that the observed matching was not a procedural artifact arising from the constraints built into the schedule.     

The effect of negative stimulus presentations on observing-response rates

Theories of observing differ in predicting whether or not a signal for absence of reinforcement (S−) is capable of reinforcing observing responses. Experiments in which S− was first removed from and then restored to the procedure have yielded mixed results. The present experiments suggest that failure to control for the direct effect of presenting S− may have been responsible. Pigeons and operant procedures were used. Experiment 1 showed that presentations of S−, even when not contingent on observing, can raise the rate of an observing response that was reinforced only by presentations of a signal (S+) that accompanied a schedule of food delivery. Experiment 2 showed that this effect resulted from bursts of responding that followed offsets of S−. Experiment 3 showed that, when the presence of S− was held constant, lower rates occurred when S− was dependent on, rather than independent of, observing. These results support theories that characterize S− as incapable of reinforcing observing responses.     

Preference for less segmented fixed-time components in concurrent-chain schedules of reinforcement

A concurrent-chain procedure was used to examine choice between segmented and less segmented response-independent schedules of reinforcement. A pair of independent, concurrent variable-interval 60-s schedules were presented in the initial link, along with a 1.5-s changeover delay. A chained fixed-interval fixed-time and its corresponding tandem schedule constituted the terminal links. The length of the fixed-interval schedule in the terminal link was varied between 5 s and 30 s while that of the fixed-time schedule was kept at 5 s over conditions. The first components of both terminal-link schedules were accompanied by the same stimulus. Except in the baseline condition, the onset of the second component of the terminal-link chained schedule was accompanied by either a localized (key color) or a nonlocalized (dark houselight) stimulus change. Stimulus conditions were constant during the terminal-link tandem schedule. With three exceptions, pigeons demonstrated a slight preference for the tandem over the chained schedule in the terminal link. Furthermore, this preference varied inversely with the length of the first component. In general, these results are consistent with previous studies that reported an adverse effect on choice by segmenting an interval schedule into two or more components, but they are inconsistent with studies that reported preference for signaled over unsignaled delay of reinforcement.     

Deprivation and satiation: The interrelations between food and wheel running

Two experiments were designed to assess whether depriving rats of food would increase the reinforcement effectiveness of wheel running (Experiment 1) and whether satiation for wheel running would decrease the reinforcement effectiveness of food (Experiment 2). In Experiment 1, a progressive-ratio schedule was used to measure the reinforcement effectiveness of wheel running when rats were deprived or not deprived of food. Completion of a fixed number of lever presses released a brake on a running wheel for 60 s, and the response requirement was systematically increased until the rat stopped pressing or until 8 hr had elapsed. The ratio value reached (and the total number of lever presses) was an inverted-U function of food deprivation (percentage body weight). In Experiment 2, when wheel running preceded test sessions, fewer food-reinforced lever presses were maintained by the progressive-ratio schedule, and responding occurred at a lower rate on a variable-interval schedule. An interpretation of these results is that deprivation or satiation with respect to one event (such as food) alters the reinforcement effectiveness of a different event (such as access to wheel running).     

CONTINGENT REINFORCEMENT FOR CARBON MONOXIDE REDUCTION: WITHIN-SUBJECT EFFECTS OF PAY AMOUNT

The relationship between reinforcer amount and daytime smoking reduction in smokers offered money for reduced afternoon breath carbon monoxide (CO) levels was examined. Twenty-three hired regular smokers with average baseline CO levels of about 30 ppm were exposed in random order to five sliding scale payment schedules that changed daily or weekly. Money was available for afternoon CO readings between 0 and 21 ppm with pay amount inversely related to the absolute CO reading obtained. Maximum pay amount for readings below 7 ppm varied among $0, $1.50, $3, $6, and $12 per day. Contingent reinforcement promoted CO and daytime cigarette reduction within individuals with the amount of behavior change related to the amount of payment available. Average CO levels decreased from 30 to 15 ppm as a function of pay amount whereas self-reported daytime cigarettes decreased from 12 to 5 per day. Average minutes of cigarette abstinence prior to the afternoon study contact increased from 62 to 319 minutes as a function of pay amount, whereas the percentage of available money earned increased from 22% to 48%. Nontargeted evening cigarette use also decreased during periods of daytime smoking reduction. The orderly effects of this contingent reinforcement intervention on daytime smoking of regular smoker volunteers suggest that this is a sensitive model for continued evaluation of factors that influence smoking reduction and cessation.     

REDUCING SELF-INJURY AND CORRESPONDING SELF-RESTRAINT THROUGH THE STRATEGIC USE OF PROTECTIVE CLOTHING

We examined the use of protective clothing to reduce a retarded male's face-punching and leg-kicking and two corresponding forms of self-restraint—arm and leg self-restraint. The resident was observed each day in three sessions of randomly ordered conditions (one condition per session): without any protective clothing, with a padded helmet, and with a padded helmet and padded slippers. Use of the padded helmet substantially reduced face-punching and arm self-restraint. The addition of padded slippers reduced leg-kicking and leg self-restraint. These results suggest a practical and effective means of controlling self-injury and self-restraint. They are also consistent with the possibility that the resident's arm restraint was maintained in part by escape or avoidance of face-punching and that his leg restraint was maintained in part by escape or avoidance of leg-kicking.     

Delayed reinforcement as an indiscriminable contingency in verbal/nonverbal correspondence training

We investigated the programming of generalization and maintenance of correspondence between verbal and nonverbal behavior in a preschool setting. Four children participated in a series of multiple-baseline designs. In Experiment 1, delayed reinforcement of verbal behavior effectively controlled maintenance of correspondence with previously trained responses and also resulted in generalization of correspondence to one untrained response. As the latter effect was limited, Experiment 2 was a further assessment of the effects of delayed reinforcement of generalization of correspondence to untrained responses, and consistent generalization was shown. Experiment 2 also showed that generalization, if lost, could be recovered through use of "booster training," in which the original contingencies were reinstated for a brief period. Experiment 3 provided replications, with two additional children, of the effects of delayed reinforcement on maintenance of correspondence. Results are discussed in terms of using delayed reinforcement as an indiscriminable contingency.