Shaping in the 21st century: Moving percentile schedules into applied settings

The present paper provides a primer on percentile reinforcement schedules, which have been used for two decades to study response differentiation and shaping in the laboratory. Arranged in applied settings, percentile procedures could be used to specify response criteria, standardizing treatment across subjects, trainers, and times to provide a more consistent training environment while maintaining the sensitivity to the individual's repertoire that is the hallmark of shaping. Percentile schedules are also valuable tools in analyzing the variables of which responding is a function, both inside and outside the laboratory. Finally, by formalizing the rules of shaping, percentile schedules provide a useful heuristic of the processes involved in shaping behavior, even for those situations that may not easily permit their implementation. As such, they may help further sensitize trainers and researchers alike to variables of critical importance in behavior change.     

TEACHING YOUNG CHILDREN TO USE CONTACT LENSES

Young children with surgically removed lenses and extreme nearsightedness can benefit from contact lenses, but their parents may need instruction to teach their children to accept lenses. In this study, 4 children under the age of 5 years were taught contact lens wear using a shaping procedure. Compliance was rewarded with praise and tangibles, and noncompliance was followed with brief time-out for 3 of the children and restraint for the 4th. Three children showed high compliance during an initial shaping procedure, with a decrease in compliance during initial insertion of the lenses. At 3- to 10-month follow-up, levels of compliance were high. Insertion and removal of lenses were accomplished in substantially less time, with little crying and no need for time-out. All 3 children continue to use the lenses daily, and 2 have shown improved visual acuity. The 4th child, who has Down syndrome, showed low levels of compliance with need for physical restraint throughout. Although his parents reported high compliance when he first went home, fitting difficulties and an infection resulted in plummeting of compliance, and contact lens use was discontinued. This procedure has been used successfully at the same hospital with 11 of 13 other children between the ages of 14 months and 7 years 4 months. Implications for selection of suitable candidates for this intervention and ways to decrease costs are discussed.     

Uninstructed human responding: Sensitivity of low-rate performance to schedule contingencies

College students' presses on a telegraph key occasionally turned on a light in the presence of which button presses produced points later exchangeable for money. Initially, responding was maintained by low-rate contingencies superimposed on either random-interval or random-ratio schedules. Later, the low-rate contingencies were relaxed. Low-rate key pressing had been established for some students by shaping and for others by demonstration and written instructions. After the low-rate contingencies were relaxed, higher response rates generally did not increase point earnings with random-interval scheduling, but did so with random-ratio scheduling. In both cases, shaped responding usually increased, and instructed responding usually continued at an unchanged low rate. The insensitivity of instructed responding typically occurred despite contact with the contingencies. The differential sensitivity to schedule contingencies of shaped responding relative to instructed responding is consistent with the different properties of contingency-governed and rule-governed behavior and is not rate-dependent.     

Multiple determinants of the effects of reinforcement magnitude on free-operant response rates

Four experiments examined the effects of increasing the number of food pellets given to hungry rats for a lever-press response. On a simple variable-interval 60-s schedule, increased number of pellets depressed response rates (Experiment 1). In Experiment 2, the decrease in response rate as a function of increased reinforcement magnitude was demonstrated on a variable-interval 30-s schedule, but enhanced rates of response were obtained with the same increase in reinforcement magnitude on a variable-ratio 30 schedule. In Experiment 3, higher rates of responding were maintained by the component of a concurrent variable-interval 60-s variable-interval 60-s schedule associated with a higher reinforcement magnitude. In Experiment 4, higher rates of response were produced in the component of a multiple variable-interval 60-s variable-interval 60-s schedule associated with the higher reinforcement magnitude. It is suggested that on simple schedules greater reinforcer magnitudes shape the reinforced pattern of responding more effectively than do smaller reinforcement magnitudes. This effect is, however, overridden by another process, such a contrast, when two magnitudes are presented within a single session on two-component schedules.     

Reinforcement rate and interresponse time differentiation

Reinforcement rate and differential reinforcement of IRTs were independently manipulated to assess their relative contribution to the control of interresponse times (IRTs). Modified percentile reinforcement schedules (Platt, 1973) allowed control of reinforcement rate while longest or shortest IRTs were selectively reinforced. In the absence of differential IRT reinforcement, mean IRT decreased with increasing reinforcement rate. Compared to this small effect of reinforcement rate, reinforcement of long IRTs produced large changes in mean IRT at constant reinforcement rates. No interaction of reinforcement rate and IRT reinforcement was detected. The demonstration of large IRT changes in the absence of reinforcement-rate changes indicates the precedence of IRT reinforcement over molar reinforcement-rate correlations in the determination of IRTs in these procedures.     

Yoked variable-ratio and variable-interval responding in pigeons

Pigeons' key pecks were maintained by variable-ratio or variable-interval schedules of food reinforcement. For pairs of pigeons in one group, variable-ratio reinforcement was arranged for one pigeon's pecks; for the second pigeon, reinforcement was arranged according to a variable-interval schedule yoked to the interreinforcement times produced by the first pigeon. For pairs of pigeons in another group, variable-interval reinforcement was arranged for one pigeon's pecks; for the second pigeon, reinforcement was arranged according to a variable-ratio schedule yoked to the interreinforcement responses produced by the first pigeon. For each pair, the yoking procedure was maintained for four or five consecutive sessions of 50 reinforcements each. In more than three-quarters of the pairs, variable-ratio response rates were higher than variable-interval rates within two sessions; in all cases, the rate difference developed within four sessions.     

Effects of magnitude of food reinforcement on free-operant response rates

In Experiment 1 rats were trained to press a lever on a variable-ratio schedule of food presentation and were then exposed to progressively increasing magnitudes of food reinforcement. Response running rates (rates exclusive of the postreinforcement pause) were found to increase as a function of increasing reinforcement magnitudes. The effect of reinforcement magnitude on response rates inclusive of the postreinforcement pause, however, was less pronounced. Increases in the magnitude of reinforcement were also found to increase the length of the postreinforcement pause. Rats in Experiment 2 were trained to respond on a chained differential-reinforcement-of-low-rate variable-ratio schedule, and were exposed to increasing magnitudes of reinforcement as in Experiment 1. Response running rates increased in the variable-ratio component but decreased in the other component of the schedule. The results are discussed with reference to incentive accounts of reinforcement and the action of reinforcement on the response units generated by the operative contingencies.     

Variable-ratio schedules as variable-interval schedules with linear feedback loops.

The mathematical theory of linear systems has been used successfully to describe responding on variable-interval (VI) schedules. In the simplest extension of the theory to the variable-ratio (VR) case, VR schedules are treated as if they were VI schedules with linear feedback loops. The assumption entailed by this approach, namely, that VR and VI-plus-linear-feedback schedules are equivalent, was tested by comparing responding on the two types of schedule. Four human subjects' lever pressing produced monetary reinforcers on five VR schedules, and on five VI schedules with linear feedback loops that reproduced the feedback properties of the VR schedules. Pressing was initiated by instructions in 2 subjects, and was shaped by successive approximation in the other 2. The different methods of response initiation did not have differential effects on behavior. For each of the 4 subjects, the VR and the comparable VI-plus-linear-feedback schedules generated similar average response rates and similar response patterns. The subjects' behavior on both types of schedule was similar to that of avian and rodent species on VR schedules. These results indicate that the assumption entailed by the VI-plus-linear-feedback approach to the VR case is valid and, consequently, that the approach is worth pursuing. The results also confute interresponse-time theories of schedule performance, which require interval and ratio contingencies to produce different response rates.     

Sample stimulus control shaping and restricted stimulus control in capuchin monkeys: a methodological note

This paper reports use of sample stimulus control shaping procedures to teach arbitrary matching-to-sample to 2 capuchin monkeys (Cebus apella). The procedures started with identity matching-to-sample. During shaping, stimulus features of the sample were altered gradually, rendering samples and comparisons increasingly physically dissimilar. The objective was to transform identity matching into arbitrary matching (i.e., matching not based on common physical features of the sample and comparison stimuli). Experiment 1 used a two-comparison procedure. The shaping procedure was ultimately effective, but occasional high error rates at certain program steps inspired a follow-up study. Experiment 2 used the same basic approach, but with a three-comparison matching task. During shaping, the monkey performed accurately until the final steps of the program. Subsequent experimentation tested the hypothesis that the decrease in accuracy was due to restricted stimulus control by sample stimulus features that had not yet been changed in the shaping program. Results were consistent with this hypothesis, thus suggesting a new approach that may transform the sample stimulus control shaping procedure from a sometimes useful laboratory tool to a more general approach to teaching the first instance of arbitrary matching performances to participants who show protracted difficulties in learning such performances.     

Interaction of procedural factors in human performance on yoked schedules

The differential effects of reinforcement contingencies and contextual variables on human performance were investigated in two experiments. In Experiment 1, adult human subjects operated a joystick in a video game in which the destruction of targets was arranged according to a yoked variable-ratio variable-interval schedule of reinforcement. Three variables were examined across 12 conditions: verbal instructions, shaping, and the use of a consummatory response following reinforcement (i.e., depositing a coin into a bank). Behavior was most responsive to the reinforcement contingencies when the consummatory response was available, responding was established by shaping, and subjects received minimal verbal instructions about their task. The responsiveness of variable-interval subjects' behavior varied more than that of variable-ratio subjects when these contextual factors were altered. Experiment 2 examined resistance to instructional control under the same yoked-schedules design. Conditions varied in terms of the validity of instructions. Performance on variable-ratio schedules was more resistant to instructional control than that on variable-interval schedules.