Effects of delayed reinforcement in a concurrent situation

Pigeons were trained to peck either of two response keys for food reinforcement on equated aperiodic schedules. Delays of reinforcement for pecks at one key reduced the relative frequency of pecking exponentially as a function of the delay interval. Similar functions were obtained when other dependent variables were plotted against the delay interval.     

The reinforcement of four interresponse times in a two-alternative situation

Pigeons pecked for food in a two-key procedure. A concurrent variable-interval variable-interval schedule of reinforcement for two classes of interresponse times was arranged on each key. A visual stimulus set the occasion for potential reinforcement of the four operant classes: shorter and longer interresponse times on left and right keys. In Exp. I, the relative frequency of respones on a key equalled the relative frequency of reinforcement on that key. In Exp. II, the relative frequency of an interresponse time equalled the relative reciprocal of its length. In Exp. III, the relative frequency of an interresponse time was a monotonically increasing function of its relative frequency of reinforcement. These functions relating the relative frequency of an interresponse time to its relative length and to its relative frequency of reinforcement were the same as if there had been no second key. Also, the distribution of responses between keys was independent of the relative frequency of an interresponse time on either key. Experiment IV replicated Exp. I except that choices between keys were controlled by a stimulus that signalled the availability of reinforcement on the right key. A comparison of Exp. I and IV suggested that the relative frequency of an interresponse time on one key generally was independent of behavior on the other key, but that the number of responses per minute on a key did depend on behavior on the other key.     

Partial reinforcement and extinction in vasomotor conditioning

In order to investigate cognitive versus traditional accounts of responding in extinction and the discrimination hypothesis for the partial reinforcement effect, 40 human subjects were randomly divided into two groups and were treated according to thermal vasomotor conditioning procedures using either 25 trials of continuous reinforcement or 100 trials of 25% partial reinforcement. At the onset of extinction, half of each group was given traditional noninformed extinction, while the other (informed) half had the thermal stimulator removed. The usual greater resistance to extinction was obtained after partial reinforcement than after continuous reinforcement in the two noninformed groups; however, immediate extinction of responding was obtained from the first extinction trial in the two informed groups. These results are consistent both with the discrimination hypothesis for the partial reinforcement extinction effect and with cognitive explanations of responding in extinction. Consequences for the behavioral therapies are discussed.     

Partial reinforcement effects in instrumental escape conditioning

In Experiment I acquisition and extinction of instrumental escape conditioning with rats (N = 64) were studied as a function of reinforcement magnitude under conditions of partial and continuous reinforcement. In Experiment II the effects of partial and continuous reinforcement were studied in rats (N = 96) during acquisition followed by small, medium, and large reductions in reinforcement magnitude. A water-tank escape apparatus was used with temperature as the relevant variable. It was found that (1) with large reinforcement magnitude a continuously reinforced group was superior in acquisition to one that was partially reinforced; there were no differences with small reinforcement; (2) disruptive effects of a nonreinforced trial (a) appear early in learning, (b) are quite strong after each nonreinforced trial, and (c) persist through several succeeding reinforced trials; (3) major competing behaviors persist throughout acquisition for small reinforcement magnitude regardless of schedule, decline with large reinforcement (more so with continuous than with partial), and return to a high level in extinction for all conditions; (4) the partial reinforcement extinction effect occurs after large reinforcement but not after small, and it appears only with large reductions in reinforcement magnitude which approach extinction conditions. Only the first part of the last finding appears to be consistent with the appetitive conditioning literature.     

Partial negative reinforcement: fixed-ratio escape

Rats were unable to sustain performance when eight bar-presses turned off shock (−FR 8). In a second experiment, thirsty rats were able to maintain a moderate response rate when performance on −FR 8 was also reinforced with water. Some rats continued to bar-press on −FR 8 after withdrawal of positive reinforcement, but at a much lower rate. A possible explanation of the results is that during intermittent escape conditioning in a free-responding situation the absence of shock itself acquires aversive properties.     

Partial reinforcement and breadth of learning

Two experiments on partial reinforcement were undertaken to test predictions made by a two process model of discrimination learning. In the first experiment rats were trained on a discrimination involving two relevant cues: one group (C) was trained on a 100: o schedule, the other (P) on a 50:0 schedule. Both groups were then given transfer tests with the two cues presented individually; finally all animals were extinguished on the original training stimuli and on the single cue stimuli. During extinction there was a negative correlation between the number of correct responses made by individual subjects of Group C to each single cue; whereas the correlation was positive for subjects of Group P. The second experiment employed basically the same design, but subjects were trained with seven relevant cues. The results of transfer tests showed that subjects of Group P learned to attach the correct response to many more cues than subjects of Group C. This suggests that the breadth of learning is greater under partial than under consistent reinforcement. The results were predicted by the model of discrimination learning under test.     

Modification of verbal behavior through variable interval reinforcement in a quasi-therapy situation

Principles from the operant conditioning laboratory were applied to the verbal behavior of female college students. An experimental setting was designed to replicate a psychotherapist's office, and subjects were seen daily in a study using a functional research design. Variable interval reinforcement was employed to modify the rate of emission of positive self-reference statements. Results demonstrated that the verbal, scheduled reinforcement exerted a definite, marked effect on the verbal behavior of the subjects. All subjects conditioned to the schedules. Sequence of scheduling did not appear to be a significant variable. The feasibility of employing such techniques in actual psychotherapy is discussed.