A general theory of learning and conditioning: Part II

The second of two parts of this article extends a mathematical theory of non-symbolic learning and conditioning to cases where reward and punishment are involved. The preceding results are generalized to the case where stimuli and responses are related psychophysically, thus constituting a theory of transfer, generalization, and discrimination.     

Psychophysiological and behavioral differences as a function of age and Parkinson’s disease

Differences related to age and to specific neurological (Parkinsonian) damage were studied by contrasting, respectively, old (mean age 64 years) and young (27 years) subjects (N=15), and old-normal (N=15) and old-Parkinsonian (N=15) subjects. Both behavioral as well as psychophysiological dependent variables were employed. The behavioral measure was performance on a discrimination learning task, while the psychophysiological measures were based on habituation to a repeated tone stimulus and on a Pavlovian differential conditioning preparation. The behavioral task showed predominantly age-related differences, with the young learning faster. Another age-related difference was interpreted as showing a more insight-like learning process in the young. Response-bias (beta) values did not differ between groups. Age-related differences also emerged more clearly than specific-neurological-damage differences in the psychophysiological data. The older subjects manifested markedly less autonomic conditioning, which was probably due to a lowering of reactivity, as well as the emergence of habituation to the (loud-noise) unconditional stimulus. A correlational analysis of discrimination conditioning also yielded age-related differences. Most notably, reactivity played a greater role in conditioning in the old than in the young subjects. The results illustrated how psychophysiological measures can provide information that complements those provided by behavioral measures.     

Second-order conditioning of human causal learning

This article provides the first demonstration of a reliable second-order conditioning (SOC) effect in human causal learning tasks. It demonstrates the human ability to infer relationships between a cause and an effect that were never paired together during training. Experiments 1a and 1b showed a clear and reliable SOC effect, while Experiments 2a and 2b demonstrated that first-order extinction did not affect SOC. These results were similar to those found in animal and human conditioning and suggested that a similar associative mechanism could explain these effects. However, they can also be used to look into the underlying causal mental model people build and store while they are learning this task. From a cognitive view, overall results suggest that an independent rather than a chain causal mental model is stored after second-order learning in human causal tasks.     

The effect of task difficulty and criteria of learning on a subsequent reversal

Two experiments using rats were carried out in which it was shown that a quadratic function can best describe the relation between amount of initial discrimination training and speed of reversal learning for both a difficult visual and an easy spatial task. The results are used to explain the rarity of the over learning reversal effect (ORE) using easy tasks such as position discriminations. Implications for the attention theory are also discussed.     

Creating Computer-Mediated Communities of Practice in Special Education

Summary

The convergence of theory and research on socially shared cognition represents a promising new direction for understanding how to enhance the intellectual growth of individuals. In this article, we draw upon the metaphor of “apprenticeship” to explain how individual cognitive development of children and adults alike can be enhanced by mentoring relationships within a particular educational “culture.” The view advanced here is that computers and related technologies can be instrumental in creating socially interactive and reflective learning communities. Within these communities there is active transmission of knowledge between individuals as they are guided from the periphery through to the center of the learning enterprise. Examples of communities of learners are provided to illustrate the process of socially shared cognition and development of knowledge networks. Principles for the creation of sustainable learning communities apply equally to traditional educational settings and on-line communities. The concept of the “collective zone of proximal development” is advanced here to explain how cognitive growth progressively occurs for community members who are operating within a socially interactive and reflective learning environment. Finally, principles and recommendations are offered on how to design communities so that all individuals can achieve their optimal functioning level through guided social participation.     

Overtraining in classical conditioning: A comparison of motor and cardiac systems in dogs

Data from the analysis of the Overlearning Reversal Effect (ORE) noted in a simultaneous, visual discrimination task, and the lack of this effect in a position habit discrimination, led to the prediction that the ORE would not be noted in classical conditioning. It was further noted that very little work on discrimination learning had been reported in Pavlovian conditioning. The idea of schizokinesis, as observed by Gantt and others in classical conditioning, has been elaborated using the simple conditioning paradigm, and no data were available to test whether this same split would occur on a more complex level of conditioning, such as a discrimination task. To test these ideas, nine dogs were trained to a criterion of minimum discrimination, and then divided into three groups and given varying amounts of overtraining (OT). The discrimination task given the animal was to flex its paw during the CS+ signalling the onset of a brief shock. After the varying amounts of OT all groups were placed in extinction, followed by reversal training until each dog reached a criterion of minimum reversal. The results indicated 1) that the cardiac discrimination did not form before the motor discrimination; 2) extinction of differentiation was not significantly affected by the amount of OT given; 3) the mean level of responding in the motor system during extinction was highly correlated with the mean level of responding during the initial discrimination training; 4) OT had no effect on the speed of reversal of either the motor or the cardiac systems; 5) the speed of reversal learning in the motor system was highly correlated with the speed of initial discrimination.     

Generalization gradients in human predictive learning: Effects of discrimination training and within-subjects testing

Generalization gradients have been investigated widely in animal conditioning experiments, but much less so in human predictive learning tasks. Here, we apply the experimental design of a recent study on conditioned fear generalization in humans (Lissek et al., 2008) to a predictive learning task, and examine the effects of a number of relevant procedural parameters drawn from the generalization literature in animal conditioning. Experiment 1 shows that prior discrimination learning and steady-state testing procedures sharpen the gradient; Experiment 2 shows that within-subjects testing of the range of generalization stimuli also sharpens the gradient. In addition, Experiment 2 shows that, in case of very flat initial generalization, an orderly gradient can reveal itself through differential rates of extinction learning. Finally, Experiment 2 also evidenced an orderly gradient of generalization-of-extinction. These results suggest that discrimination processes have an important effect on the generalization of predictive learning in humans, and highlight behavioral analogies between animal conditioning and human predictive learning.     

Integrating incremental learning and episodic memory models of the hippocampal region

By integrating previous computational models of corticohippocampal function, the authors develop and test a unified theory of the neural substrates of familiarity, recollection, and classical conditioning. This approach integrates models from 2 traditions of hippocampal modeling, those of episodic memory and incremental learning, by drawing on an earlier mathematical model of conditioning, SOP (A. Wagner, 1981). The model describes how a familiarity signal may arise from parahippocampal cortices, giving a novel explanation for the finding that the neural response to a stimulus in these regions decreases with increasing stimulus familiarity. Recollection is ascribed to the hippocampus proper. It is shown how the properties of episodic representations in the neocortex, parahippocampal gyrus, and hippocampus proper may explain phenomena in classical conditioning. The model reproduces the effects of hippocampal, septal, and broad hippocampal region lesions on contextual modulation of classical conditioning, blocking, learned irrelevance, and latent inhibition.     

Similarity and Discrimination Learning

The role played by similarity in discrimination learning was examined in four experiments using compound stimuli. In Experiment 1, pigeons received training in which food was presented after stimulus A, compound AB, but not compound ABC—A+ BC+ ABCo. The A+ ABCo discrimination was acquired more readily than was the BC+ ABCo discrimination. In the remaining experiments, training was of the form, A+ B+ C+ AB+ AC+ BC+ ABCo. The discrimination between the single stimuli A+ B+ C+ and ABCo consistently developed more readily than between the pairs of stimuli AB+ AC+ BC+, and ABCo. The results are shown to be more consistent with a configural than with an elemental theory of conditioning.     

The nature of sexual reinforcement.

Sexual reinforcers are not part of a regulatory system involved in the maintenance of critical metabolic processes, they differ for males and females, they differ as a function of species and mating system, and they show ontogenetic and seasonal changes related to endocrine conditions. Exposure to a member of the opposite sex without copulation can be sufficient for sexual reinforcement. However, copulatory access is a stronger reinforcer, and copulatory opportunity can serve to enhance the reinforcing efficacy of stimulus features of a sexual partner. Conversely, under certain conditions, noncopulatory exposure serves to decrease reinforcer efficacy. Many common learning phenomena such as acquisition, extinction, discrimination learning, second-order conditioning, and latent inhibition have been demonstrated in sexual conditioning. These observations extend the generality of findings obtained with more conventional reinforcers, but the mechanisms of these effects and their gender and species specificity remain to be explored.     

Challenges of organizational learning: perpetuation of discrimination against employees with disabilities

This article examines why organizations struggle with learning how to prevent discrimination against their employees with disabilities. To explore this issue, qualitative archival data were collected and analyzed from 53 Americans with Disabilities Act (ADA) lawsuits filed against 44 organizations. Theoretical analysis of the qualitative data suggests that several organizationally based learning theories explain the difficulty organizations have with creating a disability-friendly work environment. These barriers to learning are embedded in complex defense mechanisms and discriminatory organizational routines. Furthermore, organizations have difficulties engaging in higher-order and vicarious learning. We conclude the article with examples of successful learning practices as they relate to barriers identified in the qualitative analysis.     

Human temporal behavior and discrimination-reversal learning

The present study demonstrates that a relationship exists between individual differences in temporal behavior and individual differences in human discrimination-reversal learning behavior. When the results of performance on a time-estimation task employing the method of reproduction are compared with the results of acquisition performance on a complex form of discrimination-reversal learning task is can be demonstrated that underestimation of time is associated with faster learning and overestimation of time is associated with slower learning of the discrimination task. The experimental design was based on the historical fact that the Sechenov-Pavlov and Spence-Hull formulations assigned a primary role in learning to excitation and inhibition as intervening variables between the input of stimulation and output of response. The present study also used the tasks of time estimation and discrimination learning as dependent variables; and the concept that underestimation of time is associated with and underlying predominance of excitatory processes as a hypothetical construct. The conclusion was reached that one of the many theoretical processes which may be used to explain discrimination learning is the concept that acquisition of the correct response may be viewed as a function of the individual rates at which excitatory processes come to be conditioned to a predominance over existing inhibitory processes.     

LEARNING THEORY APPROACHES TO PERSUASION

This review synthesizes relevant research dealing with the processes of learning and suggests its applications to compliance gaining. The two major issues addressed are: (1) to what degree can learning theories explain the acquisition of new attitudes and behaviors, and (2) to what degree are attitudinal and behavioral changes governed by learning theory principles? The learning theories discussed are grouped into three categories: stimulus-response or connectionist approaches; cognitive approaches; and stochastic, mathematical, and cybernetic approaches. The stimulus-response models, which encompass most of the research examined in this paper, are further broken down into four types: (1) classical conditioning, (2) contiguity models, (3) instrumental (or operant) conditioning and (4) models including drive and drive reduction. Principles and major research evidence from numerous learning theories are reviewed and analyzed, and suggestions are made as to how this evidence may aid in the construction of more complete theories of persuasion and attitude change.     

How the challenge of explaining learning influenced the origins and development of John B. Watson's behaviorism

Before he invented behaviorism, John B. Watson considered learning one of the most important topics in psychology. Watson conducted excellent empirical research on animal learning. He developed behaviorism in part to promote research and elevate the status of learning in psychology. Watson was much less successful in the adequacy and originality of the mechanisms he proposed to explain learning. By assimilating the method of classical conditioning and adopting Pavlov's theory of stimulus substitution, Watson linked behaviorism with a new method that could compete with both Titchener's method of introspection and Freud's methods of psychoanalysis. Watson's interest in explaining psychopathology led to the discovery of conditioned emotional responses and a behavioristic explanation for the learning of phobic behavior. Watson established learning as a central topic for basic research and application in American psychology.     

Conditioned reinforcement: Experimental and theoretical issues

The concept of conditioned reinforcement has received decreased attention in learning textbooks over the past decade, in part because of criticisms of its validity by major behavior theorists and in part because its explanatory function in a variety of different conditioning procedures has become uncertain. Critical data from the major procedures that have been used to investigate the concept (second-order schedules, chain schedules, concurrent chains, observing responses, delay-of-reinforcement procedures) are reviewed, along with the major issues of interpretation. Although the role played by conditioned reinforcement in some procedures remains unresolved, the results taken together leave little doubt that the underlying idea of conditioned value is a critical component of behavior theory that is necessary to explain many different types of data. Other processes (marking, bridging) may also operate to produce effects similar to those of conditioned reinforcement, but these clearly cannot explain the full domain of experimental effects ascribed to conditioned reinforcement and should be regarded as complements to the concept rather than theoretical competitors. Examples of practical and theoretical applications of the concept of conditioned reinforcement are also considered.     

Redundant amodal properties facilitate operant learning in 3-month-old infants

The current study examined the role redundant amodal properties play in an operant learning task in 3-month-old human infants. Prior studies have suggested that the presence of redundant amodal information facilitates detection and discrimination of amodal properties and potentially functions to influence general learning processes such as associative conditioning. The current study examined how human infants use redundant amodal information (visual and haptic) about the shape of an object to influence learning of an operant response. Infants learned to kick to move a mobile of cylinders while either holding a cylinder, a rectangular cube, or no object. Kick rate served as the dependent measure. The results showed that infants given matching redundant amodal properties (e.g., viewed cylinders while holding a cylinder) showed facilitated operant learning whereas infants given mismatching redundant amodal properties showed inhibited operant learning. These results support and extend the Intersensory Redundancy Hypothesis by demonstrating that amodal redundancy influences complex learning processes such as operant conditioning.     

A probabilistic model of theory formation

Concept learning is challenging in part because the meanings of many concepts depend on their relationships to other concepts. Learning these concepts in isolation can be difficult, but we present a model that discovers entire systems of related concepts. These systems can be viewed as simple theories that specify the concepts that exist in a domain, and the laws or principles that relate these concepts. We apply our model to several real-world problems, including learning the structure of kinship systems and learning ontologies. We also compare its predictions to data collected in two behavioral experiments. Experiment 1 shows that our model helps to explain how simple theories are acquired and used for inductive inference. Experiment 2 suggests that our model provides a better account of theory discovery than a more traditional alternative that focuses on features rather than relations.     

Elemental and Configural Processes in Patterning Discrimination Learning

Three experiments used appetitive conditioning with rats to examine the involvement of elemental and configural processes in positive and negative patterning discriminations. The first experiment demonstrated that negative and, to some extent, positive patterning discriminations were learned more rapidly when these discriminations consisted of stimulus elements that had previously been the reinforced as opposed to the non-reinforced elements of a simple discrimination. Experiment 2 revealed an excitatory summation effect during the early phase of negative patterning learning that depended upon discrimination pretraining. The final experiment demonstrated faster discrimination learning between the compound and the less salient, rather than the more salient, element of an instrumental patterning task. The present set of results were interpreted as reflecting the possibility, consistent with connectionist theory, that internal representations of the conditioned stimuli change over the course of a patterning discrimination.     

A theory of learning and transfer: II

The theory of discrimination learning developed in Part I of this paper is extended to more complex learning situations such as those used for differentiating relative from absolute habits. The greater difficulty of learning an absolute discrimination than of learning a relative discrimination is predicted. The theory is also extended to cover cases of transfer. It predicts that under the ordinary training conditions transfer to new stimulus situations will be on a relative basis, and it predicts the type of transfer to be expected under other training conditions. A number of additional established facts of learning and transfer can be deduced from the theory. Methods of testing the adequacy of the theory by new and more crucial experiments are suggested.     

Pavlovian feed-forward mechanisms in the control of social behavior

The conceptual and investigative tools for the analysis of social behavior can be expanded by integrating biological theory, control systems theory, and Pavlovian conditioning. Biological theory has focused on the costs and benefits of social behavior from ecological and evolutionary perspectives. In contrast, control systems theory is concerned with how machines achieve a particular goal or purpose. The accurate operation of a system often requires feed-forward mechanisms that adjust system performance in anticipation of future inputs. Pavlovian conditioning is ideally suited to subserve this function in behavioral systems. Pavlovian mechanisms have been demonstrated in various aspects of sexual behavior, maternal lactation, and infant suckling. Pavlovian conditioning of agonistic behavior has been also reported, and Pavlovian processes may likewise be involved in social play and social grooming. Several further lines of evidence indicate that Pavlovian conditioning can increase the efficiency and effectiveness of social interactions, thereby improving their cost/benefit ratio. We extend Pavlovian concepts beyond the traditional domain of discrete secretory and other physiological reflexes to complex real-world behavioral interactions and apply abstract laboratory analyses of the mechanisms of associative learning to the daily challenges animals face as they interact with one another in their natural environments.