Choice as a function of local versus molar reinforcement contingencies.

Rats were trained on a discrete-trial probability learning task. In Experiment 1, the molar reinforcement probabilities for the two response alternatives were equal, and the local contingencies of reinforcement differentially reinforced a win-stay, lose-shift response pattern. The win-stay portion was learned substantially more easily and appeared from the outset of training, suggesting that its occurrence did not depend upon discrimination of the local contingencies but rather only upon simple strengthening effects of individual reinforcements. Control by both types of local contingencies decreased with increases in the intertrial interval, although some control remained with intertrial intervals as long as 30 s. In Experiment 2, the local contingencies always favored win-shift and lose-shift response patterns but were asymmetrical for the two responses, causing the molar reinforcement rates for the two responses to differ. Some learning of the alternation pattern occurred with short intertrial intervals, although win-stay behavior occurred for some subjects. The local reinforcement contingencies were discriminated poorly with longer intertrial intervals. In the absence of control by the local contingencies, choice proportion was determined by the molar contingencies, as indicated by high exponent values for the generalized matching law with long intertrial intervals, and lower values with short intertrial intervals. The results show that when molar contingencies of reinforcement and local contingencies are in opposition, both may have independent roles. Control by molar contingencies cannot generally be explained by local contingencies.     

The second offspring of General Process Learning Theory: Overt behavior as the ambassador of the mind

Wasserman suggested in a recent book review that the study of intervening cognitive processes represents a current focus of interest in animal learning and that this has led to a revitalization of comparative psychology. An examination of the volume reviewed suggests that he may have overstated the case. Most of the authors to whom he refers expressed dissatisfaction with traditional stimulus-response associationism but few argued for the extreme (information processing) sort of cognitive approach described by Wasserman.     

The acquisition of observing.

Pigeons were exposed to stimuli correlated with the presence or absence of a variable-interval 60-second schedule of reinforcement only while they depressed a crossbar or "perch." In the first experiment, the stimuli were different tilts of a line displayed on the key. When the difference in brightness between the line and the background (salience) was maximal, seven of eight birds acquired the discrimination, but when the difference was reduced by 50%, only one succeeded. In the second experiment, wavelength of chamber illumination served as the relevant dimension. Neither experiment showed a large effect attributable to the magnitude of the difference (disparity) between the positive and the negative stimulus. Individual differences in time spent observing were positively correlated with level of discrimination in the presence of the stimuli. All birds produced the positive stimulus for a greater proportion of the available time than they did the negative stimulus. This may be the mechanism that provides selective reinforcement of observing. Finally, the formation of a discrimination was analyzed in terms of changes in the proportion of time spent in contact with the discriminative stimuli.     

Serial learning in the pigeon.

Three pigeons learned to peck four colors in a particular sequence, regardless of how these colors were positioned on four response keys and without feedback following each response. This demonstrates that serial learning is possible in subprimate animals.     

SELF-STIMULATION AND LEARNING IN AUTISTIC CHILDREN: PHYSICAL OR FUNCTIONAL INCOMPATIBILITY?1

This study investigated whether an observed inverse relationship between self-stimulation and learning in autistic children is due to a physical inability of the subject to use the same body part for self-stimulation and task responding, or whether self-stimulation “distracts” the subject from task responding. Four actively self-stimulating autistic children were taught two discrimination tasks; one required a response that physically interferred with their self-stimulation; the other did not. Results were: (a) all subjects responded similarly across both tasks; (b) the three subjects with higher mental age scores learned both tasks without external suppression of self-stimulation; and (c) none of the subjects showed an inverse relationship between self-stimulation and learning. The study demonstrated that elimination of self-stimulation is not a necessary prerequisite for the acquisition of a new behavior in all autistic children.     

THE ROLE OF FEEDBACK IN VOLUNTARY CONTROL OF BLOOD PRESSURE IN INSTRUCTED SUBJECTS1

Forty normal male volunteers were randomly assigned to one of four experimental conditions and instructed to raise and lower their systolic blood pressure. Subjects received either beat-to-beat feedback contingent on pressure changes, noncontingent beat-to-beat feedback, noncontingent feedback presented randomly with respect to the occurrence of each heart beat, or instructions alone. The order of increase and decrease trial blocks was counterbalanced across groups. Subjects receiving contingent feedback were monetarily rewarded for appropriate pressure changes. Subjects receiving noncontingent feedback received rewards and feedback equal to the mean received by the contingent group. Subjects in the instructions-only condition were also paid this bonus but were informed of their earnings only at the conclusion of the experiment. Results indicated that in the presence of instructions, feedback, whether contingent or noncontingent, added little to subjects' ability to control pressure during a single session. Theoretical and clinical implications are discussed.     

Concurrent schedules: a quantitative relation between changeover behavior and its consequences

Data from several published experiments on concurrent variable-interval schedules were analyzed with respect to the effects of changeover delay on the time spent responding on a schedule before changing to an alternate schedule: i.e., the interchangeover time. Interchangeover time increases as the duration of the changeover delay increases, and the present analysis shows that a power function describes the relation. The power relation applied in spite of numerous differences in the experiments: different variable-interval schedules for the concurrent pairs; equal or unequal reinforcement rates for the schedules of the concurrent pairs; different durations of the changeover delay; response-dependent or response-independent reinforcers; pigeons or rats as subjects; different reinforcers. A power function also described the data in experiments where the changeover incurred a timeout, where a fixed ratio was required to changeover, and also when asymmetrical changeover delays were used.     

Demand for food on fixed-ratio schedules as a function of the quality of concurrently available reinforcement

Six rats lever pressed for food on concurrent fixed-ratio schedules, in a two-compartment chamber. In one compartment, mixed diet pellets were delivered on fixed-ratio schedules of 1, 6, 11, and 16; in the other, either no food was delivered, or sucrose or mixed diet pellets were delivered on fixed-ratio 8. The number of pellets obtained in the first compartment declined as a function of fixed-ratio size in that compartment in all three conditions, but the decline was greatest overall with mixed diet pellets concurrently available in the other compartment, and least with no food concurrently available. The result is discussed in terms of economic demand theory, and is consistent with the prediction that elasticity of demand for a commodity (defined in operant terms as the ratio of the proportionate change in number of reinforcements per session to the proportionate change in fixed-ratio size) is greater the more substitutable for that commodity are any concurrently available commodities.     

On Herrnstein's equation and related forms

In 1970, Herrnstein proposed a simple equation to describe the relation between response and reinforcement rates on interval schedules. Its empirical basis is firm, but its theoretical foundation is still uncertain. Two approaches to the derivation of Herrnstein's equation are discussed. It can be derived as the equilibrium solution to a process model equivalent to familiar linear-operator learning models. Modifications of this approach yield competing power-function formulations. The equation can also be derived from the assumption that response strength is proportional to reinforcement rate, given that there is a ceiling on response rate. The proportional relation can, in turn, be derived from a threshold assumption equivalent to Shimp's “momentary maximizing”. This derivation implies that the two parameters of Herrnstein's equation should be correlated, and may explain its special utility in application to internal schedules.     

Precriterion stationarity in markovian learning models

Two forms of stationarity prior to criterion in absorbing Markov chains are examined. Both forms require that the probability of a particular response on a particular trial before absorption be independent of trial number. The stronger of these forms holds that this is true independent of starting state; the weaker, only for a specified set of starting probabilities. Simple, necessary and sufficient conditions for both forms are developed and applied to several examples.The author would like to thank Charles Lewis for his help in developing this article, and Peter Polson of the University of Colorado and an anonymous referee for several fruitful suggestions made in reviews of earlier versions.