An auto-adjusting shaping procedure

A variable interval (VI) schedule is described that automatically adjusts the programmed rates of reinforcement in accordance with the rates of responding of subjects during the two immediately preceding 30-sec time intervals. The schedule prescribes that as rate of responding decreases, programmed reinforcement rate increases, and that when rate of responding increases, reinforcement rate decreases. Thus, programmed reinforcement rate is adjusted continuously until some target value is reached. Ten rats were exposed to this procedure five times a day at 1-h intervals. The target, set at VI 120 sec, was reached by most subjects within 4 days of training. Subsequently, all subjects responded consistently during five daily 1-h sessions with VI 120 sec. This procedure speeds up the training of subjects on long VI schedules and substantially reduces the time and effort spent observing the subjects and adjusting the schedule parameter value during the early development of responding.