Persistent behavior maintained by unavoidable shocks

Squirrel monkeys were trained on a multiple schedule in which 10-min periods on a continuous shock avoidance schedule, indicated by a yellow light, alternated with 10-min periods on a 1.5-min variable interval schedule of food reinforcement (VI 1.5). A white light indicated that VI 1.5 was in effect, except for the middle 2 min of the period on VI 1.5, in which a blue light appeared and terminated with the delivery of a 0.5-sec unavoidable shock. Stable response rates developed in the avoidance and VI 1.5 components. However, the highest response rates occurred in the blue, preshock stimulus. A series of experiments showed that responding in the blue stimulus persisted even when responding had been extinguished on both the VI schedule of food reinforcement and the shock avoidance schedule. Responding in the blue stimulus ceased when the blue stimulus terminated without shock or when it terminated with a response-contingent shock. Each time responding ceased, it was restored by terminating the blue stimulus with an unavoidable shock. When the blue stimulus was on throughout each session and unavoidable shocks were delivered at regular 10-min intervals, responding was well maintained. These results show that in monkeys that have been trained on a continuous avoidance schedule, unavoidable shocks can maintain responding even under conditions where responses have no programmed consequences.     

Effects of increment size and reinforcer volume on progressive ratio performance

The progressive ratio schedule requires the subject to emit an increasing number of responses for each successive reinforcement. Eventually, the response requirement becomes so large that the subject fails to respond for a period of 15 min and thereby terminates the session. This point is arbitrarily defined as the “breaking point” of the subject's performance. The measure is quantified in terms of the number of responses in the final completed (i.e., reinforced) ratio run of the session. Previous work has shown that this measure varies as a function of several motivational variables and may thus be useful as an index of reinforcement strength. The present study is an extension of that work. The subjects were four rats. In the first experiment, the effects of the size of the increment by which each ratio run increased were studied. In two additional experiments, the volume of a liquid reinforcer was varied using both large and small ratio increments. The results indicate that the number of responses in the final completed ratio run increases as a function of the size of the ratio increment. However, the number of reinforcements obtained by the animals per session declines sharply. When large ratio increments are used, the number of responses in the final ratio increases as a function of the volume of the reinforcer, but when small increments are used, progressive satiation results in a decline in performance with the larger volumes of liquid.     

Effects of deprivation upon counting and timing in rats

Two procedures were used in an investigation of the effects of deprivation upon counting and timing. Under the first procedure, fixed minimum interval (FMI), the rat received liquid reinforcement every time it pressed bar B after having waited a minimum of 5 sec following a press on bar A. Under the second procedure, fixed consecutive number (FCN), reinforcement was delivered every time the rat pressed bar B following a run of at least four consecutive responses on bar A.

Water deprivation was varied over a set of values ranging from 4 to 56 hr. Deprivation had almost no effect on the waiting time in the FMI procedure, or on the number of responses per run in the FCN procedure. With both procedures, increasing deprivation shortened the pause between reinforcement and the next response. In the FCN procedure, the speed with which the runs were executed increased with increasing deprivation, although the number of responses in these runs was relatively unaffected.

     

The effect of two schedules of primary and conditioned reinforcement

Of 23 pigeons, 11 received continuous reinforcement for key pecking, and 12 received an FR 10 schedule of reinforcement. The birds were then tested without food, but with potential conditioned reinforcers presented either on the same schedule as in training, on the other schedule, or not at all. Each bird in the subgroup trained on CRF and tested with S^r's at FR 10 not only gave more responses in testing than did each bird in both subgroups receiving no S^r's, but also gave more responses than did each bird in the S^r subgroup receiving CRF training and S^r's at CRF. Cumulative records are presented to show the effects of different schedules of conditioned reinforcers.     

Generalization gradients of inhibition following auditory discrimination learning

A more direct method than the usual ones for obtaining inhibitory gradients requires that the dimension of the nonreinforced stimulus selected for testing be orthogonal to the dimensions of the reinforced stimulus. In that case, the test points along the inhibitory gradient are equally distant from the reinforced stimulus. An attempt was made to realize this condition by obtaining inhibitory gradients along the frequency dimension of a pure tone after discrimination training in which the nonreinforced stimulus was a pure tone (or tones), and the reinforced stimulus was either white noise or the absence of a tone. The results showed that some degree of specific inhibitory control was exerted by the frequency of the tone, although the gradients were broad and shallow in slope.

A further experiment was conducted to see whether the modification of an excitatory gradient resulting from training to discriminate neighboring tones could arise from a simple interaction of inhibitory and excitatory gradients. The results indicated that it could not, since discrimination training produced a concentration of responding in the vicinity of the reinforced stimulus which cannot be derived from any plausible gradient of inhibition.

     

Changeover delay and concurrent schedules: some effects on relative performance measures

The pigeon and the rat partition total response output between both schedules of a concurrent variable-interval pair. The quantitative nature of a partition seems critically dependent on the relative rates with which the two schedules provide reinforcements for responding, in addition to the changeover delay. The manner in which the changeover delay controls the partition was studied by varying the duration of the changeover delay from 0 to 20 sec with each of two pairs of concurrent variable-interval schedules, viz., Conc VI 1.5-min VI 1.5-min and Conc VI 1-min VI 3-min. Rats served as the subjects and brain stimulation was employed as the reinforcer. When the schedules were Conc VI 1.5-min VI 1.5-min, relative response rate approximated 0.50 at all values of the changeover delay. When the schedules were Conc VI 1-min VI 3-min, relative response rate, computed with respect to the VI 1-min schedule, increased when the duration of the changeover delay increased. Changeover rate decreased when the duration of the changeover delay increased. The decrease was the same for both VI schedules of the Conc VI 1.5-min VI 1.5-min pair but was more rapid for the VI 3-min schedule of the Conc VI 1-min VI 3-min pair.     

Drug effects in squirrel monkeys trained on a multiple schedule with a punishment contingency

The behavior of four monkeys trained on a multiple schedule was differentially sensitive to selected pharmacological agents. The three components of the multiple schedule were: (1) a variable-interval schedule in which responses were reinforced on the average of once per minute; (2) a concurrent schedule in which every tenth response was reinforced and every fifteenth response, on the average, was shocked; and, (3) a neutral stimulus in the presence of which responses were neither reinforced nor shocked. Pentobarbital, chlordiazepoxide, and meprobamate increased responding during each of the components. Scopolamine and d-amphetamine decreased variable-interval performance, had minimal effects on performance during the concurrent-schedule component, and increased responding in the presence of the neutral stimulus. Chlorpromazine decreased variable-interval responding and had slight effects on the responding during the other two components.     

A simple histological technique for localizing electrode tracks and lesions within the brain.

Histological procedures are necessary in brain stimulation or lesion work to determine the neural area which has been stimulated or damaged. Preparation of brain tissue often involves embedding and staining techniques that require specialized training, and the expense of a technician and a large assortment of special apparatus and supplies. In addition, the results of such techniques are unavailable for at least several days. A photographic method, which requires little special skill and a minimal amount of apparatus, is described here. Results can be available within minutes after the subject is sacrificed. This method has been shown to be adequate for the gross determination of lesion boundaries and electrode or cannula tip loci in brains of rats, cats, and squirrel monkeys.