A note on chaining and temporal discrimination

Four pigeons were exposed to a two-key DRL procedure. At the start of a trial, key A was illuminated. A response to the lighted key turned it off and simultaneously illuminated key B. Reinforcement was available for responses on key B which followed the initial key A response by more than 2 sec. In the course of exposure to these conditions, all birds acquired superstitious response chains on key A. The distribution of the number of responses on key A preceding a key B response and the distribution of intervals elapsing from the initial key A response to the key B response were of the same form. The suggestion is made that the superstitious responding on key A served to mediate the required delay interval. However, when intervals between successive key A responses were recorded for one subject, they were found to be regularly spaced in time. Thus, the problem remains of how this behavior is itself timed.     

The effects of unavoidable shocks on a multiple schedule having an avoidance component

Two dogs were maintained on a multiple schedule having both a food reinforced and an avoidance component (Mult VI 1′ S^Δ Avoid_{SS20 RS20} S^Δ). The effects of superimposing an Estes-Skinner procedure for delivering unavoidable shocks on all components of the multiple schedule were observed. The buzzer-shock pairing of the Estes-Skinner procedure produced an increased rate of responding on the avoidance component of the schedule and also on the S^Δ components. No persistent change in rate was observed on the food component during the pre-shock stimulus. Control performances on all components could be regained by either extinguishing or eliminating the buzzer-shock pairing. Extinction of the avoidance responding had little effect on the increased rates of responding produced by the Estes-Skinner procedure on the S^Δ and avoidance extinction components and did not lead to a conditioned suppression of the food reinforced responding. Rate of responding during the pre-shock stimulus was observed to be relatively independent of changes in the maintaining schedules. Responding during the pre-shock stimulus could be conditioned and maintained after an extensive history of avoidance extinction.     

Experimental control of superstitious responding in humans

Superstitions were demonstrated with human subjects when presses on one button were reinforced on a VI 30-sec schedule while presses on a second were never reinforced. Superstitious responding, on the second button, was often maintained because presses on that button were frequently followed by reinforcement for a subsequent press on the first button. The introduction of a changeover delay (COD), which separated in time presses on the second button and subsequent reinforced presses on the first button, reduced or eliminated the superstitious responding of these subjects. Some complex superstitions were also demonstrated with other subjects for which the COD was in effect from the beginning of the session.     

Increased eating in rats deprived of running

Daily food intake in rats was temporarily reduced by the introduction of an activity wheel and temporarily increased by the subsequent removal of the wheel. When this outcome is coupled with the positive relation between food deprivation and running—and food deprivation is seen as a loss of eating rather than as a physiological state—there is the suggestion that the total behavior output of the organism may be regulated as such. Specifically, when the rat is deprived of a behavior that recurrently comprises a large part of its total daily activity, an increase may occur in some other behavior.     

Generalization of auditory intensity as a function of small amounts of discrimination training

Rats were trained on a two-valued auditory-intensity discrimination for 5, 2, 1 or 0 days. Then, the bar-press response rate was sampled in the presence of seven added discrimination stimuli (generalization) for seven days. Daily training sessions were 4 hr in length throughout the experiment. Only the five-day group exhibited a marked superiority on the multi-valued discrimination when contrasted with the group having had no prior simple discrimination training.     

An adjusting avoidance procedure with multiple auditory and visual warning stimuli

Male albino rats were trained on an adjusting avoidance schedule in which each lever press accumulated a given amount of shock-free time. Multiple auditory and visual stimuli were programmed for each discrete temporal distance from the shock in an effort to place the avoidance behavior under the control of the shock proximity. The effects of the stimuli were further examined by presenting part of them and then by removing them altogether. With the combined auditory and visual stimuli, the rat spent most of the time relatively close to the shock and usually started to respond only when the shock was near. With the visual stimuli only, the rat kept the shock at intermediate temporal distances and responded more variably. The behavior with the auditory stimuli alone was quite similar to that produced by the combined stimuli, thus indicating that the auditory stimuli exercised the greater control. When all stimuli were removed, the animal usually kept the shock as far away as the procedure permitted. When only a single pre-shock stimulus was presented, the rat remained quite close to the shock and started to respond predominantly in the pre-shock step.     

Punishment of SΔ responding of humans in conditional matching to sample by time-out

Human subjects were intermittently reinforced with money for performing correctly on a conditional matching-to-sample task. The matching performance was examined as a function of a) the duration of Time-Outs (TOs) which followed every incorrect response and b) the frequency (FR value) with which TOs followed incorrect responses. The matching accuracy increased with longer TOs and decreased with less frequent presentation of TOs.     

Effects of increment size and reinforcer volume on progressive ratio performance

The progressive ratio schedule requires the subject to emit an increasing number of responses for each successive reinforcement. Eventually, the response requirement becomes so large that the subject fails to respond for a period of 15 min and thereby terminates the session. This point is arbitrarily defined as the “breaking point” of the subject's performance. The measure is quantified in terms of the number of responses in the final completed (i.e., reinforced) ratio run of the session. Previous work has shown that this measure varies as a function of several motivational variables and may thus be useful as an index of reinforcement strength. The present study is an extension of that work. The subjects were four rats. In the first experiment, the effects of the size of the increment by which each ratio run increased were studied. In two additional experiments, the volume of a liquid reinforcer was varied using both large and small ratio increments. The results indicate that the number of responses in the final completed ratio run increases as a function of the size of the ratio increment. However, the number of reinforcements obtained by the animals per session declines sharply. When large ratio increments are used, the number of responses in the final ratio increases as a function of the volume of the reinforcer, but when small increments are used, progressive satiation results in a decline in performance with the larger volumes of liquid.