Experimental control of superstitious responding in humans

Superstitions were demonstrated with human subjects when presses on one button were reinforced on a VI 30-sec schedule while presses on a second were never reinforced. Superstitious responding, on the second button, was often maintained because presses on that button were frequently followed by reinforcement for a subsequent press on the first button. The introduction of a changeover delay (COD), which separated in time presses on the second button and subsequent reinforced presses on the first button, reduced or eliminated the superstitious responding of these subjects. Some complex superstitions were also demonstrated with other subjects for which the COD was in effect from the beginning of the session.     

Increased eating in rats deprived of running

Daily food intake in rats was temporarily reduced by the introduction of an activity wheel and temporarily increased by the subsequent removal of the wheel. When this outcome is coupled with the positive relation between food deprivation and running—and food deprivation is seen as a loss of eating rather than as a physiological state—there is the suggestion that the total behavior output of the organism may be regulated as such. Specifically, when the rat is deprived of a behavior that recurrently comprises a large part of its total daily activity, an increase may occur in some other behavior.     

Generalization of auditory intensity as a function of small amounts of discrimination training

Rats were trained on a two-valued auditory-intensity discrimination for 5, 2, 1 or 0 days. Then, the bar-press response rate was sampled in the presence of seven added discrimination stimuli (generalization) for seven days. Daily training sessions were 4 hr in length throughout the experiment. Only the five-day group exhibited a marked superiority on the multi-valued discrimination when contrasted with the group having had no prior simple discrimination training.     

An adjusting avoidance procedure with multiple auditory and visual warning stimuli

Male albino rats were trained on an adjusting avoidance schedule in which each lever press accumulated a given amount of shock-free time. Multiple auditory and visual stimuli were programmed for each discrete temporal distance from the shock in an effort to place the avoidance behavior under the control of the shock proximity. The effects of the stimuli were further examined by presenting part of them and then by removing them altogether. With the combined auditory and visual stimuli, the rat spent most of the time relatively close to the shock and usually started to respond only when the shock was near. With the visual stimuli only, the rat kept the shock at intermediate temporal distances and responded more variably. The behavior with the auditory stimuli alone was quite similar to that produced by the combined stimuli, thus indicating that the auditory stimuli exercised the greater control. When all stimuli were removed, the animal usually kept the shock as far away as the procedure permitted. When only a single pre-shock stimulus was presented, the rat remained quite close to the shock and started to respond predominantly in the pre-shock step.     

Punishment of SΔ responding of humans in conditional matching to sample by time-out

Human subjects were intermittently reinforced with money for performing correctly on a conditional matching-to-sample task. The matching performance was examined as a function of a) the duration of Time-Outs (TOs) which followed every incorrect response and b) the frequency (FR value) with which TOs followed incorrect responses. The matching accuracy increased with longer TOs and decreased with less frequent presentation of TOs.     

Persistent behavior maintained by unavoidable shocks

Squirrel monkeys were trained on a multiple schedule in which 10-min periods on a continuous shock avoidance schedule, indicated by a yellow light, alternated with 10-min periods on a 1.5-min variable interval schedule of food reinforcement (VI 1.5). A white light indicated that VI 1.5 was in effect, except for the middle 2 min of the period on VI 1.5, in which a blue light appeared and terminated with the delivery of a 0.5-sec unavoidable shock. Stable response rates developed in the avoidance and VI 1.5 components. However, the highest response rates occurred in the blue, preshock stimulus. A series of experiments showed that responding in the blue stimulus persisted even when responding had been extinguished on both the VI schedule of food reinforcement and the shock avoidance schedule. Responding in the blue stimulus ceased when the blue stimulus terminated without shock or when it terminated with a response-contingent shock. Each time responding ceased, it was restored by terminating the blue stimulus with an unavoidable shock. When the blue stimulus was on throughout each session and unavoidable shocks were delivered at regular 10-min intervals, responding was well maintained. These results show that in monkeys that have been trained on a continuous avoidance schedule, unavoidable shocks can maintain responding even under conditions where responses have no programmed consequences.     

Effects of increment size and reinforcer volume on progressive ratio performance

The progressive ratio schedule requires the subject to emit an increasing number of responses for each successive reinforcement. Eventually, the response requirement becomes so large that the subject fails to respond for a period of 15 min and thereby terminates the session. This point is arbitrarily defined as the “breaking point” of the subject's performance. The measure is quantified in terms of the number of responses in the final completed (i.e., reinforced) ratio run of the session. Previous work has shown that this measure varies as a function of several motivational variables and may thus be useful as an index of reinforcement strength. The present study is an extension of that work. The subjects were four rats. In the first experiment, the effects of the size of the increment by which each ratio run increased were studied. In two additional experiments, the volume of a liquid reinforcer was varied using both large and small ratio increments. The results indicate that the number of responses in the final completed ratio run increases as a function of the size of the ratio increment. However, the number of reinforcements obtained by the animals per session declines sharply. When large ratio increments are used, the number of responses in the final ratio increases as a function of the volume of the reinforcer, but when small increments are used, progressive satiation results in a decline in performance with the larger volumes of liquid.