Experimental control of superstitious responding in humans

Superstitions were demonstrated with human subjects when presses on one button were reinforced on a VI 30-sec schedule while presses on a second were never reinforced. Superstitious responding, on the second button, was often maintained because presses on that button were frequently followed by reinforcement for a subsequent press on the first button. The introduction of a changeover delay (COD), which separated in time presses on the second button and subsequent reinforced presses on the first button, reduced or eliminated the superstitious responding of these subjects. Some complex superstitions were also demonstrated with other subjects for which the COD was in effect from the beginning of the session.     

Increased eating in rats deprived of running

Daily food intake in rats was temporarily reduced by the introduction of an activity wheel and temporarily increased by the subsequent removal of the wheel. When this outcome is coupled with the positive relation between food deprivation and running—and food deprivation is seen as a loss of eating rather than as a physiological state—there is the suggestion that the total behavior output of the organism may be regulated as such. Specifically, when the rat is deprived of a behavior that recurrently comprises a large part of its total daily activity, an increase may occur in some other behavior.     

Generalization of auditory intensity as a function of small amounts of discrimination training

Rats were trained on a two-valued auditory-intensity discrimination for 5, 2, 1 or 0 days. Then, the bar-press response rate was sampled in the presence of seven added discrimination stimuli (generalization) for seven days. Daily training sessions were 4 hr in length throughout the experiment. Only the five-day group exhibited a marked superiority on the multi-valued discrimination when contrasted with the group having had no prior simple discrimination training.     

An adjusting avoidance procedure with multiple auditory and visual warning stimuli

Male albino rats were trained on an adjusting avoidance schedule in which each lever press accumulated a given amount of shock-free time. Multiple auditory and visual stimuli were programmed for each discrete temporal distance from the shock in an effort to place the avoidance behavior under the control of the shock proximity. The effects of the stimuli were further examined by presenting part of them and then by removing them altogether. With the combined auditory and visual stimuli, the rat spent most of the time relatively close to the shock and usually started to respond only when the shock was near. With the visual stimuli only, the rat kept the shock at intermediate temporal distances and responded more variably. The behavior with the auditory stimuli alone was quite similar to that produced by the combined stimuli, thus indicating that the auditory stimuli exercised the greater control. When all stimuli were removed, the animal usually kept the shock as far away as the procedure permitted. When only a single pre-shock stimulus was presented, the rat remained quite close to the shock and started to respond predominantly in the pre-shock step.     

Punishment of SΔ responding of humans in conditional matching to sample by time-out

Human subjects were intermittently reinforced with money for performing correctly on a conditional matching-to-sample task. The matching performance was examined as a function of a) the duration of Time-Outs (TOs) which followed every incorrect response and b) the frequency (FR value) with which TOs followed incorrect responses. The matching accuracy increased with longer TOs and decreased with less frequent presentation of TOs.     

Effects of increment size and reinforcer volume on progressive ratio performance

The progressive ratio schedule requires the subject to emit an increasing number of responses for each successive reinforcement. Eventually, the response requirement becomes so large that the subject fails to respond for a period of 15 min and thereby terminates the session. This point is arbitrarily defined as the “breaking point” of the subject's performance. The measure is quantified in terms of the number of responses in the final completed (i.e., reinforced) ratio run of the session. Previous work has shown that this measure varies as a function of several motivational variables and may thus be useful as an index of reinforcement strength. The present study is an extension of that work. The subjects were four rats. In the first experiment, the effects of the size of the increment by which each ratio run increased were studied. In two additional experiments, the volume of a liquid reinforcer was varied using both large and small ratio increments. The results indicate that the number of responses in the final completed ratio run increases as a function of the size of the ratio increment. However, the number of reinforcements obtained by the animals per session declines sharply. When large ratio increments are used, the number of responses in the final ratio increases as a function of the volume of the reinforcer, but when small increments are used, progressive satiation results in a decline in performance with the larger volumes of liquid.     

Effects of deprivation upon counting and timing in rats

Two procedures were used in an investigation of the effects of deprivation upon counting and timing. Under the first procedure, fixed minimum interval (FMI), the rat received liquid reinforcement every time it pressed bar B after having waited a minimum of 5 sec following a press on bar A. Under the second procedure, fixed consecutive number (FCN), reinforcement was delivered every time the rat pressed bar B following a run of at least four consecutive responses on bar A.

Water deprivation was varied over a set of values ranging from 4 to 56 hr. Deprivation had almost no effect on the waiting time in the FMI procedure, or on the number of responses per run in the FCN procedure. With both procedures, increasing deprivation shortened the pause between reinforcement and the next response. In the FCN procedure, the speed with which the runs were executed increased with increasing deprivation, although the number of responses in these runs was relatively unaffected.