Varying response-reinforcer contiguity in a recycling conjunctive schedule

Three experiments describe the effects of manipulating the frequency of response-reinforcer contiguity in a recycling conjunctive schedule. The schedule arranged that a reinforcer was delivered after 30 s provided at least one response had occurred; otherwise the next cycle started immediately. In Experiment 1, this schedule produced the typical pause–respond–pause pattern, with most responses at mid-interval; and, when a limited number of contiguities between responses and food delivery were added, the pattern became more like the monotonic scallop seen on fixed-interval schedules. In Experiment 2, the schedule was initially presented with an additional contingency that allowed contiguity on every trial. Fixed-interval-like behavior occurred and tended to persist as contiguities were gradually eliminated. In Experiment 3, the recycling conjunctive schedule alternated with a condition in which a large number of contiguities occurred. The pause–respond–pause pattern and fixed-interval-like performance occurred with few or many contiguities, respectively. The results of all three experiments illustrate how contiguity interacts with a small number of other variables to determine performance on interval schedules and illuminate previous findings with fixed-interval and fixed-time schedules.     

More on concurrent interval-ratio schedules: a replication and review.

It has been suggested that the failure to maximize reinforcement on concurrent variable-interval, variable-ratio schedules may be misleading. Inasmuch as response costs are not directly measured, it is possible that subjects are optimally balancing the benefits of reinforcement against the costs of responding. To evaluate this hypothesis, pigeons were tested in a procedure in which interval and ratio schedules had equal response costs. On a concurrent variable time (VT), variable ratio-time (VRT) schedule, the VT schedule runs throughout the session and the VRT schedule is controlled by responses to a changeover key that switches from one schedule to the other. Reinforcement is presented independent of response. This schedule retains the essential features of concurrent VI VR, but eliminates differential response costs for the two alternatives. It therefore also eliminates at least one significant ambiguity about the reinforcement maximizing performance. Pigeons did not maximize rate of reinforcement on this procedure. Instead, their times spent on the alternative schedules matched the relative rates of reinforcement, even when schedule parameters were such that matching earned the lowest possible overall rate of reinforcement. It was further shown that the observed matching was not a procedural artifact arising from the constraints built into the schedule.     

The effect of negative stimulus presentations on observing-response rates

Theories of observing differ in predicting whether or not a signal for absence of reinforcement (S−) is capable of reinforcing observing responses. Experiments in which S− was first removed from and then restored to the procedure have yielded mixed results. The present experiments suggest that failure to control for the direct effect of presenting S− may have been responsible. Pigeons and operant procedures were used. Experiment 1 showed that presentations of S−, even when not contingent on observing, can raise the rate of an observing response that was reinforced only by presentations of a signal (S+) that accompanied a schedule of food delivery. Experiment 2 showed that this effect resulted from bursts of responding that followed offsets of S−. Experiment 3 showed that, when the presence of S− was held constant, lower rates occurred when S− was dependent on, rather than independent of, observing. These results support theories that characterize S− as incapable of reinforcing observing responses.     

Preference for less segmented fixed-time components in concurrent-chain schedules of reinforcement

A concurrent-chain procedure was used to examine choice between segmented and less segmented response-independent schedules of reinforcement. A pair of independent, concurrent variable-interval 60-s schedules were presented in the initial link, along with a 1.5-s changeover delay. A chained fixed-interval fixed-time and its corresponding tandem schedule constituted the terminal links. The length of the fixed-interval schedule in the terminal link was varied between 5 s and 30 s while that of the fixed-time schedule was kept at 5 s over conditions. The first components of both terminal-link schedules were accompanied by the same stimulus. Except in the baseline condition, the onset of the second component of the terminal-link chained schedule was accompanied by either a localized (key color) or a nonlocalized (dark houselight) stimulus change. Stimulus conditions were constant during the terminal-link tandem schedule. With three exceptions, pigeons demonstrated a slight preference for the tandem over the chained schedule in the terminal link. Furthermore, this preference varied inversely with the length of the first component. In general, these results are consistent with previous studies that reported an adverse effect on choice by segmenting an interval schedule into two or more components, but they are inconsistent with studies that reported preference for signaled over unsignaled delay of reinforcement.     

Deprivation and satiation: The interrelations between food and wheel running

Two experiments were designed to assess whether depriving rats of food would increase the reinforcement effectiveness of wheel running (Experiment 1) and whether satiation for wheel running would decrease the reinforcement effectiveness of food (Experiment 2). In Experiment 1, a progressive-ratio schedule was used to measure the reinforcement effectiveness of wheel running when rats were deprived or not deprived of food. Completion of a fixed number of lever presses released a brake on a running wheel for 60 s, and the response requirement was systematically increased until the rat stopped pressing or until 8 hr had elapsed. The ratio value reached (and the total number of lever presses) was an inverted-U function of food deprivation (percentage body weight). In Experiment 2, when wheel running preceded test sessions, fewer food-reinforced lever presses were maintained by the progressive-ratio schedule, and responding occurred at a lower rate on a variable-interval schedule. An interpretation of these results is that deprivation or satiation with respect to one event (such as food) alters the reinforcement effectiveness of a different event (such as access to wheel running).     

Units of analysis and kinetic structure of behavioral repertoires

It is suggested that molar streams of behavior are constructed of various arrangements of three elementary constituents (elicited, evoked, and emitted response classes). An eight-cell taxonomy is elaborated as a framework for analyzing and synthesizing complex behavioral repertoires based on these functional units. It is proposed that the local force binding functional units into a smoothly articulated kinetic sequence arises from temporally arranged relative response probability relationships. Behavioral integration is thought to reflect the joint influence of the organism's hierarchy of relative response probabilities, fluctuating biological states, and the arrangement of environmental and behavioral events in time.     

A taxonomy of item response models

A number of models for categorical item response data have been proposed in recent years. The models appear to be quite different. However, they may usefully be organized as members of only three distinct classes, within which the models are distinguished only by assumptions and constraints on their parameters. “Difference models” are appropriate for ordered responses, “divide-by-total” models may be used for either ordered or nominal responses, and “left-side added” models are used for multiple-choice responses with guessing. The details of the taxonomy and the models are described in this paper. The present study was supported in part by two postdoctoral fellowships awarded to Lynne Steinberg: an Educational Testing Service Postdoctoral Fellowship at ETS, Princeton, NJ and an NIMH Individual National Research Service Award at Stanford University, Stanford, CA. Helpful comments by the editor and three anonymous reviewers are gratefully acknowledged.     

Behavior regulation and learned performance: Some misapprehensions and disagreements

The behavior-regulation approach to learned performance has been the subject of misapprehension and disagreement concerning: (1) the nature and importance of behavior regulation, (2) the definition and role of behavioral set-points, (3) the relation of optimal schedule performance to behavioral set-points, and (4) the question of whether deviations from total responding or from response patterns are the primary determinant of molar responding under schedule constraint. After clarifying the nature and role of behavior regulation and set-points, this paper shows that the data used to question optimal schedule performance (Allison, 1981a) actually strongly support the general behavior-regulation approach. These data also indicate a role for response-pattern set-points in determining schedule behavior, but contradict the hypothesis that deviations from response-pattern characteristics are the primary determinant of molar schedule effects.     

CONTINGENT REINFORCEMENT FOR CARBON MONOXIDE REDUCTION: WITHIN-SUBJECT EFFECTS OF PAY AMOUNT

The relationship between reinforcer amount and daytime smoking reduction in smokers offered money for reduced afternoon breath carbon monoxide (CO) levels was examined. Twenty-three hired regular smokers with average baseline CO levels of about 30 ppm were exposed in random order to five sliding scale payment schedules that changed daily or weekly. Money was available for afternoon CO readings between 0 and 21 ppm with pay amount inversely related to the absolute CO reading obtained. Maximum pay amount for readings below 7 ppm varied among $0, $1.50, $3, $6, and $12 per day. Contingent reinforcement promoted CO and daytime cigarette reduction within individuals with the amount of behavior change related to the amount of payment available. Average CO levels decreased from 30 to 15 ppm as a function of pay amount whereas self-reported daytime cigarettes decreased from 12 to 5 per day. Average minutes of cigarette abstinence prior to the afternoon study contact increased from 62 to 319 minutes as a function of pay amount, whereas the percentage of available money earned increased from 22% to 48%. Nontargeted evening cigarette use also decreased during periods of daytime smoking reduction. The orderly effects of this contingent reinforcement intervention on daytime smoking of regular smoker volunteers suggest that this is a sensitive model for continued evaluation of factors that influence smoking reduction and cessation.     

REDUCING SELF-INJURY AND CORRESPONDING SELF-RESTRAINT THROUGH THE STRATEGIC USE OF PROTECTIVE CLOTHING

We examined the use of protective clothing to reduce a retarded male's face-punching and leg-kicking and two corresponding forms of self-restraint—arm and leg self-restraint. The resident was observed each day in three sessions of randomly ordered conditions (one condition per session): without any protective clothing, with a padded helmet, and with a padded helmet and padded slippers. Use of the padded helmet substantially reduced face-punching and arm self-restraint. The addition of padded slippers reduced leg-kicking and leg self-restraint. These results suggest a practical and effective means of controlling self-injury and self-restraint. They are also consistent with the possibility that the resident's arm restraint was maintained in part by escape or avoidance of face-punching and that his leg restraint was maintained in part by escape or avoidance of leg-kicking.