Towards an empirical calculus of reinforcement value

Only one of two keys reinforces the subject with food. This key can assume one of two colors, each associated with a different fixed-ratio schedule for obtaining reinforcement. The function of the second key is to permit the animal to switch from the long schedule to the short schedule. If the difference between the ratio schedules is large enough, a preference for the shorter schedule is demonstrable. A quantitative index of preference is obtained as follows: each time the animal switches to the shorter schedule, the number of pecks required to produce the next switch is increased. As the “ante” on the switching key increases, the effective difference between the two ratio schedules decreases. After each food reinforcement, when the bird is exposed to the choice-situation, it takes longer before the bird switches again. This is used to “titrate” the bird's preference. If it does not switch within x sec, the progressively increasing ratio schedule of the switching key is decreased. A specific value, in terms of a rather specific number of responses the bird settles at on the choice key, is obtained. This equilibrium is employed as a dependent variable. Several variables of which it is a function are explored.     

The effect of bulbocapnine administration on avoidance behavior

The Psychological Record -     

The effects of nodality on the formation of equivalence classes

A four-member equivalence class (A → B → C → D) can be formed by training AB, BC, and CD. The nodal stimuli, B and C, mediate all of the derivative (transitive and equivalence) relations in the class. The derivative relations AC, CA, BD, and DB are separated by one node, whereas AD and DA are separated by two nodes. How do the number of nodes that separate the stimuli in a derivative relation influence the induction of stimulus control exerted by that relation? Seven college students learned two four-member classes made up of nonsense syllables. After training, all derivative relations were presented repeatedly without informative feedback. Stimulus control exerted by each derivative relation was assessed concurrently. For the 7 subjects, control exerted by the derivative relations increased gradually with repeated presentations. With 6 of the 7 subjects, the one-node relations exerted more control than the two-node relations during the process. However, the disparity between the one- and two-node relations decreased with repeated presentations. Eventually, all derivative relations exerted complete control. The control exerted by derivative relations during induction was inversely related to the number of nodes separating the terms in the derivative relations. These results demonstrate that nodal distance is a determinant of the relatedness of stimuli in equivalence classes. The findings are discussed in terms of remote association, semantic memory networks, and the study of transitive inference.     

The functional properties of a time out from an avoidance schedule

Investigations are reported of some of the discriminative (cue) and reinforcing properties of stimuli (TO_av) correlated with the discontinuation of a free-operant avoidance schedule. After several unsuccessful initial attempts to demonstrate the positively reinforcing effect of TO_av, a special technique was developed. The subjects were trained by means of a free-operant avoidance procedure to press a lever and postpone electric shock; by pressing a second lever, they could produce a cue correlated with the TO_av period. The importance of a distinct cue correlated with TO_av was demonstrated in experiments in which this signal was eliminated from the procedure. The reinforcing function of the TO_av period was explored by showing its effectiveness under various schedules of reinforcement.

Other observations were made concerning the course of extinction of both TO_av-producing responses and avoidance behavior.

In further experiments in which TO_av was used as a reinforcer, the TO_av behavior was also brought under separate stimulus control. The development of the various discriminations involved in the resulting performance were described.

     

STIMULUS GENERALIZATION AND EQUIVALENCE CLASSES: A MODEL FOR NATURAL CATEGORIES

Two three-member classes were formed by training AB and BC using a conditional discrimination procedure. The A and B stimuli were nonsense syllables, and the C stimuli were sets of “short” or “long” lines. To test for equivalence, C1 or C2 was presented as a sample with A1 and A2 as comparisons. Once the class-related comparison was chosen consistently, different line lengths were substituted for the training lines in the CA tests. In general, the likelihood of choosing a given comparison was an inverse function of the difference in the length of the test line from the training line. Stimuli in an equivalence class became functionally related not only to each other but also to novel stimuli that resembled a member of the equivalence class. The combination of primary generalization and equivalence class formation, then, can serve as a model to account for the development of naturally occurring categories.