Concerning the Madrid Lecture: the equivocal character of Pavlov's reflexological objectivism and its influence on the distorted concept of the physiology-psychology relationship

The aim of this study is to bring to light and make clear the characteristic equivoque Pavlov made when he conceived the neurophysiological circuit involved in conditioned behavior as if this circuit contained or reduced, in its own terms, such behavior. I also wish to point out how this interpretation implies a distorted concept of the relationships between neurophysiology and behavior. As an alternative, it is proposed that behavior, which is always operant behavior, is not at all reducible to its neurophysiological ingredients, but instead acts like an arrow-head for adaptation that, in turn, confers a subordinate function to the neurophysiological ingredients involved. To make this evident, behavior is considered an operant organic activity that takes place in an environment of "remote co-present" texture, and different from its neurophysiological ingredients, which take place within the context of spatial contiguity relationships.     

Functions of the environment in behavioral evolution

This paper explores some of the ways in which the environment functions with respect to behavior within an explanatory framework analogous to that of evolutionary biology. In both the behavioral and organic domains, the environment functions differently with respect to individual occurrences and evolutionary units. Within the behavioral domain, the problem of accounting for an occurrence of an operant instance differs from that of accounting for the existence of the operant unit of which the instance is a part. Maintaining these distinctions in levels of analysis within the behavioral domain, we focus first on operant units and operant instances as products of evolutionary processes occurring in the behavioral domain and second upon the causal role of the environment with respect to the existence of operant units and the occurrence of operant instances. The environment's function is selective with respect to origin, maintenance, suppression, and extinction of behavioral populations. At the level of operant instances, the environment has instantiating functions-evocative or alterative. Evocative functions are exemplified by discriminative relations, and alterative functions include both conditional and motivative relations. Implications are considered regarding extension of the analogy to more complex behavior-environment relations.     

The behavioral origins of phylogenic responses and ontogenic habits

An examination of innate behavior and its possible origins suggests parallels with the formation of habitual behavior. Inflexible but adaptive responses—innate reflexive behavior, Pavlovian conditioned responses, and operant habits—may have evolved from variable behavior in phylogeny and ontogeny. This form of “plasticity-first” scientific narrative was unpopular post-Darwin but has recently gained credibility in evolutionary biology. The present article seeks to identify originating events and contingencies contributing to such inflexible but adaptive behavior at both phylogenic and ontogenic levels of selection. In ontogeny, the development of inflexible performance (i.e., habit) from variable operant behavior is reminiscent of the genetic accommodation of initially variable phylogenic traits. The effects characteristic of habit (e.g., unresponsiveness to reinforcer devaluation) are explicable as the result of a conflict between behaviors at distinct levels of selection. The present interpretation validates the practice of seeking hard analogies between evolutionary biology and operant behavior. Finding such parallels implies the validity of a claim that organismal behavior, both innate and learned, is a product of selection by consequences. A complete and coherent account of organismal behavior may ultimately focus on functional selective histories in much the same way evolutionary biology does with its subject matter.     

The place of the human subject in the operant laboratory

Although laboratory study of human behavior seems an obvious vehicle for strengthening the scientific base of behavior analysis, the place of the human subject within the operant laboratory remains problematic. The prevailing research strategy has been to link principles developed with animals to human affairs, either through interpretation of naturally occurring human behaviors or through application of the principles to the solution of human problems. The paucity of laboratory research on human operant behavior derives from several misconceptions: the possibility that experimental demand characteristics and pre-experimental behavioral dispositions of human subjects contaminate the results; that ethical considerations place undue constraint on research topics and experimental designs; and that uncontrollable variation in subjects' histories and other relevant personal characteristics prevents observation of reliable functional relations. We argue that these problems do not pose insurmountable obstacles to the experimental analysis of human behavior; that adequate methods of control and analysis are available; and that operant techniques, by emphasizing experimentally imposed contingencies, are well suited for the laboratory study of human behavior.     

Behavior analysis and revaluation

Revaluation refers to phenomena in which the strength of an operant is altered by reinforcer-related manipulations that take place outside the conditioning situation in which the operant was selected. As an example, if lever pressing is acquired using food as a reinforcer and food is later paired with an aversive stimulus, the frequency of lever pressing decreases when subsequently tested. Associationist psychology infers from such findings that conditioning produces a response-outcome (i.e., reinforcer) association and that the operant decreased in strength because pairing the reinforcer with the aversive stimulus changed the value of the outcome. Here, we present an approach to the interpretation of these and related findings that employs neural network simulations grounded in the experimental analysis of behavior and neuroscience. In so doing, we address some general issues regarding the relations among behavior analysis, neuroscience, and associationism.     

Verbal behavior

The recent history and current status of the area of verbal behavior are considered in terms of three major thematic lines: the operant conditioning of adult verbal behavior, learning to be an effective speaker and listener, and developments directly related to Skinner's Verbal Behavior. Other topics not directly related to the main themes are also considered: the work of Kurt Salzinger, ape-language research, and human operant research related to rule-governed behavior.     

Studies in Binocular Interdependence: III. an Active Principle

Explanations of the nature of thought and the methods of study underlying such explanations were explored from the viewpoints of introspective psychology, methodological behaviorism, and radical behaviorism. Empirical support for the radical behaviorists' interpretation of thought as covert operant behavior was examined. An experimental method was developed which attempted to analyze the functional properties of responsereinforcement connections in the environment inside our skins. Verbal reports of the thought behaviors of a group of graduate students in educational psychology were examined and coded in terms of B. F. Skinner's verbal operant categories. The reported thought units were coded in relation to the environmental contexts in which they were reported, and in relation to the environmental contexts in which the thoughts had actually occurred. Major differences in the verbal operant codings, and in the interrater reliabilities of such codings were discovered depending upon the particular environmental context utilized. Results obtained by scoring the reported thought units in relation to the environments in which the thoughts actually occurred were congruent with the paradigm of operant behavior.     

The operant and the classical in conditioned orientation of Drosophila melanogaster at the flight simulator

Ever since learning and memory have been studied experimentally, the relationship between operant and classical conditioning has been controversial. Operant conditioning is any form of conditioning that essentially depends on the animal's behavior. It relies on operant behavior. A motor output is called operant if it controls a sensory variable. The Drosophila flight simulator, in which the relevant behavior is a single motor variable (yaw torque), fully separates the operant and classical components of a complex conditioning task. In this paradigm a tethered fly learns, operantly or classically, to prefer and avoid certain flight orientations in relation to the surrounding panorama. Yaw torque is recorded and, in the operant mode, controls the panorama. Using a yoked control, we show that classical pattern learning necessitates more extensive training than operant pattern learning. We compare in detail the microstructure of yaw torque after classical and operant training but find no evidence for acquired behavioral traits after operant conditioning that might explain this difference. We therefore conclude that the operant behavior has a facilitating effect on the classical training. In addition, we show that an operantly learned stimulus is successfully transferred from the behavior of the training to a different behavior. This result unequivocally demonstrates that during operant conditioning classical associations can be formed.     

Operant techniques used in stuttering therapy: A review

This article reviews research concerning the use of operant conditioning in stuttering therapy, and discusses the clinical implications of this literature. In order to be considered for this review, a report had to treat the findings of research specifically designed to use operant conditioning in the manipulation of speech disfluency. This body of experimental literature clearly indicates that operant management techniques can effectively reduce stuttering with punishment of disfluencies producing more notable results than reinforcement of fluent responses. Operant conditioning is an effective means of modifying stuttering behavior and should be more visible in terms of procedures used by speech therapists.     

A selectionist approach to reinforcement.

We describe a principle of reinforcement that draws upon experimental analyses of both behavior and the neurosciences. Some of the implications of this principle for the interpretation of behavior are explored using computer simulations of adaptive neural networks. The simulations indicate that a single reinforcement principle, implemented in a biologically plausible neural network, is competent to produce as its cumulative product networks that can mediate a substantial number of the phenomena generated by respondent and operant contingencies. These include acquisition, extinction, reacquisition, conditioned reinforcement, and stimulus-control phenomena such as blocking and stimulus discrimination. The characteristics of the environment-behavior relations selected by the action of reinforcement on the connectivity of the network are consistent with behavior-analytic formulations: Operants are not elicited but, instead, the network permits them to be guided by the environment. Moreover, the guidance of behavior is context dependent, with the pathways activated by a stimulus determined in part by what other stimuli are acting on the network at that moment. In keeping with a selectionist approach to complexity, the cumulative effects of relatively simple reinforcement processes give promise of simulating the complex behavior of living organisms when acting upon adaptive neural networks.     

Individual behavior, culture, and social change

The principle of operant selection is examined as a prototype of cultural selection, and the role of the social environment is suggested as the critical element in the emergence of cultural phenomena. Operant contingencies are compared to cultural selection contingencies, designated as metacontingencies. Both of these types of contingency relations result in evolving lineages of recurrences that can become increasingly complex in the number and organization of their elements. In addition to its role in the recurring interlocking behavioral contingencies that constitute cultural organization, operant behavior plays another role in cultures. Although the operants of individuals are functionally independent of one another, the behavior of each person may contribute to a cumulative effect that is relevant to the well-being of many people. Similarly, the outcomes of metacontingencies may also contribute to a cumulative effect. The relation between independently evolving operant lineages, or between independently evolving cultural lineages, and their cumulative effect is identified as a macrocontingency. Macrocontingencies do not involve cultural-level selection per se. Effective cultural engineering requires identifying the macrocontingencies that produce less than desirable effects and altering the relevant operant contingencies or metacontingencies to produce change in the cumulative effects.     

Operant Variability: A Conceptual Analysis

Some researchers claim that variability is an operant dimension of behavior. The present paper reviews the concept of operant behavior and emphasizes that differentiation is the behavioral process that demonstrates an operant relation. Differentiation is conceived as change in the overlap between two probability distributions: the distribution of reinforcement probability as a function of some response property (S distribution) and the probability distribution of the response property itself (R distribution). This concept implies that the differentiation process can be measured only if S distribution and R distribution are both established on the same response property. To determine whether the differentially reinforced behavioral variability fits the proposed concept of operant behavior, I examine the main procedures (lag n and threshold procedures) and the main dependent variable (U value) employed in the studies of operant variability. Because lag n and threshold procedures establish their S distributions on properties distinct from U value, differentiation cannot be measured over the change in U value. I conclude that studies of operant variability have failed to provide a direct demonstration that variability is an operant dimension of behavior. Hence, studies in which measures of variability provide a basis to measure differentiation can better support the claim that variability is an operant dimension of behavior.     

Determinants of contrast in the signal-key procedure: Evidence against additivity theory

Two experiments are reported that challenge the interpretation of previous results with the signal-key procedure, in which the discriminative stimuli are located on a response key different from the key associated with the operant response requirement. Experiment 1 replicated the procedure of Keller (1974), and found that contrast effects on the operant key occurred reliably for only one of four subjects. High rates to the signal key initially occurred for only one subject, but modifications of the procedure produced substantial rates to the signal key for all subjects. In all cases, however, signal-key behavior was greatly reduced by the addition of a changeover delay which prevented reinforcement within 2 seconds of the last peck to the signal key, suggesting that signal-key pecking was maintained primarily by adventitious reinforcement. Experiment 2 modified the signal-key procedure by using three response keys, so that the discriminative stimuli on the signal key controlled different responses during all phases of training. With this modification, reliable contrast effects on the operant key occurred for all subjects, suggesting that the failure to find contrast in previous studies has been due to the confounding of changes in the discrimination requirements with changes in relative rate of reinforcement. The results challenge the additivity theory of contrast, and suggest that “elicited” behavior plays a minor role, if any, in the determination of contrast effects in multiple schedules.     

The basic-applied continuum and the possible evolution of human operant social and verbal research

Human operant research is typically viewed as fitting somewhere between the end points of a basic-to-applied continuum. Viewed in this way, the major role of human operant research is to determine the conditions under which principles discovered with animals also hold with humans. Relative to the basic and applied end points, which have defined the major journals and graduate training programs in Behavior Analysis, the human operant area has not been strong since the late 1950's when a scientifically based application was only an exciting possibility. However, application quickly became a reality and to some extent it replaced the major role of human operant research. After about 15 years of focusing on the basic and applied end points, an increasing number of behavior analysts are concerned about the large content of psychology (e.g., social and verbal behavior) between the end points and the continued growth of Behavior Analysis. Basic research in social and verbal behavior should ordinarily begin with the human instead of a lower animal, because the human is the most qualified and prepared subject in the sense that most complex social and verbal behaviors are more accessible in humans. This new role for basic human research of initiating rather than only replicating, could result in a rebuilding of the "bridge" between basic and applied, and contribute to the growth of Behavior Analysis in terms of extensions to new content areas, methods, and the followers it would reach in these areas.     

Auditory hallucinations and delusional thinking: A review and critique of outcome studies

This paper reviews the literature in which behavioral interventions were applied in an attempt to reduce hallucinatory and delusional verbalizations in psychiatric patients. Subject characteristics, dependent variables and treatment variations, as well as generalization of effects, are considered. It is concluded that even though operant procedures, such as extinction, aversive stimulation, and token reinforcement, have been successful in decreasing hallucinatory-delusional verbalizations, further research examining generalization is needed. Methodological issues influencing interpretation are discussed and suggestions for further research are offered.     

Rats place greater value on rewards produced by high effort: An animal analogue of the “effort justification” effect

The effort justification phenomenon, in which greater value is given to rewards that require more effort to obtain, is frequently explained in terms of cognitive dissonance (Festinger & Carlsmith, 1959). Here, we employed a novel combination of operant and lick analysis techniques to show that rats place more value on a sucrose reward when it follows high effort than when the same reward follows low effort. This is the first demonstration of a direct analogue of the effort justification phenomenon in nonhuman animals. As the behavior of rats is normally considered in terms of relatively simple mechanisms, the current results question the need for complex cognitive accounts for the effort justification phenomenon (in rats or humans). As an alternative, we examine the possibility that high effort produces an aversive state that enhances reward value by a process of contrast.     

An Analysis of Feedback from a Behavior Analytic Perspective

The present paper presents a systematic analysis from a behavior analytic perspective of procedures termed feedback. Although feedback procedures are widely reported in the discipline of psychology, including in the field of behavior analysis, feedback is neither consistently defined nor analyzed. Feedback is frequently treated as a principle of behavior; however, its effects are rarely analyzed in terms of well-established principles of learning and behavior analysis. On the assumption that effectiveness of feedback procedures would be enhanced when their use is informed by these principles, we sought to provide a conceptually systematic account of feedback effects in terms of operant conditioning principles. In the first comprehensive review of this type, we compare feedback procedures with those of well-defined operant procedures. We also compare the functional relations that have been observed between parameters of consequence delivery and behavior under both feedback and operant procedures. The similarities observed in the preceding analyses suggest that processes revealed in operant conditioning procedures are sufficient to explain the phenomena observed in studies on feedback.     

Elicited versus emitted behavior: Time to abandon the distinction

The concept of emitted behavior was formulated as a part of the original argument for the validity of a new kind of learning called operant conditioning. The rationale for operant conditioning contrasted it with Pavlovian or classical conditioning, which was (and remains) fundamentally based on responses to conditioned and unconditioned stimuli. Classical conditioned responses were said to be elicited. In contrast, operant behavior was viewed as emitted and controlled primarily by response consequences rather than antecedents. I argue that the distinction between emitted and elicited behavior is no longer warranted for three major reasons. First, the distinction was based on a view of Pavlovian conditioning that is no longer viable. Second, the distinction is incompatible with both empirical data and contemporary conceptualizations of operant behavior. Third, the only way to overcome these problems is to define emitted and elicited in terms of the type of conditioning (operant and classical) that produces these behaviors, but that approach makes the definitions circular and does not avoid implications of the terms that are misleading and counterproductive in light of contemporary research and thinking.     

Arbitrarily applicable comparative relations: experimental evidence for a relational operant

Arbitrarily applicable derived relational responding has been argued by relational frame theorists to be a form of operant behavior. The present study examined this idea with 4 female participants, ages 4 to 5 years old, who could not perform a series of problem-solving tasks involving arbitrary more than and less than relations. In a combined multiple baseline (across responses and participants) and multiple probe design (with trained and untrained stimuli), it was shown that reinforced multiple-exemplar training facilitated the development of arbitrary comparative relations, and that these skills generalized not just across stimuli but also across trial types. The sequence of training identified potential prerequisites in the development of comparative relations (e.g., nonarbitrary comparative relations). Taken as a whole, the present data, along with previous work by others in this area, suggest that relating arbitrary events comparatively is an operant. The implications of this conclusion for the analysis of complex behavior are discussed.