A COMPUTATIONAL THEORY OF SELECTION BY CONSEQUENCES APPLIED TO CONCURRENT SCHEDULES

Virtual organisms animated by a computational theory of selection by consequences responded on symmetrical and asymmetrical concurrent schedules of reinforcement. The theory instantiated Darwinian principles of selection, reproduction, and mutation such that a population of potential behaviors evolved under the selection pressure exerted by reinforcement from the environment. The virtual organisms' steady‐state behavior was well described by the power function matching equation, and the parameters of the equation behaved in ways that were consistent with findings from experiments with live organisms. Together with previous research on single‐alternative schedules (McDowell, 2004; McDowell & Caron, 2007) these results indicate that the equations of matching theory are emergent properties of the evolutionary dynamics of selection by consequences.     

On the current status of the evolutionary theory of behavior dynamics

The evolutionary theory of behavior dynamics is a complexity theory that instantiates the Darwinian principles of selection, reproduction, and mutation in a genetic algorithm. The algorithm is used to animate artificial organisms that behave continuously in time and can be placed in any experimental environment. The present paper is an update on the status of the theory. It includes a summary of the evidence supporting the theory, a list of the theory's untested predictions, and a discussion of how the algorithmic operations of the theory may correspond to material reality. Based on the evidence reviewed here, the evolutionary theory appears to be a strong candidate for a comprehensive theory of adaptive behavior.     

Behavioral variability in an evolutionary theory of behavior dynamics

McDowell’s evolutionary theory of behavior dynamics (McDowell, 2004) instantiates populations of behaviors (abstractly represented by integers) that evolve under the selection pressure of the environment in the form of positive reinforcement. Each generation gives rise to the next via low‐level Darwinian processes of selection, recombination, and mutation. The emergent patterns can be analyzed and compared to those produced by biological organisms. The purpose of this project was to explore the effects of high mutation rates on behavioral variability in environments that arranged different reinforcer rates and magnitudes. Behavioral variability increased with the rate of mutation. High reinforcer rates and magnitudes reduced these effects; low reinforcer rates and magnitudes augmented them. These results are in agreement with live‐organism research on behavioral variability. Various combinations of mutation rates, reinforcer rates, and reinforcer magnitudes produced similar high‐level outcomes (equifinality). These findings suggest that the independent variables that describe an experimental condition interact; that is, they do not influence behavior independently. These conclusions have implications for the interpretation of high levels of variability, mathematical undermatching, and the matching theory. The last part of the discussion centers on a potential biological counterpart for the rate of mutation, namely spontaneous fluctuations in the brain's default mode network.     

What Counts as Behavior? The Molar Multiscale View

Because the definition of behavior changes as our understanding of behavior changes, giving a final definition is impossible. One can, however, rule out some possibilities and propose some others based on what we currently know. Behavior is not simply movement, but must be defined by its function. Also, our understanding of behavior must agree with evolutionary theory. I suggest 4 basic principles: (a) only whole organisms behave; (b) behavior is purposive; (c) behavior takes time; and (d) behavior is choice. Saying that parts of an organism behave is nonsense, and, moreover, evolutionary theory explains the existence of organisms mainly through their adaptive behavior. Behavior is purposive in that behavior is shaped by its consequences, through an organism''s lifetime or through interactions with the environment across many generations of natural selection. Behavior takes time in that behavior is interaction with the environment that cannot take place at a moment. Moreover, at a moment in time, one cannot definitely identify the function of behavior. Identification of an activity requires a span of time. Behavior is choice in the sense that a suitable span of time always includes time spent in more than 1 activity. Activities include parts that are themselves activities on a smaller time scale and compete for time. Thus, behavior constitutes time allocation. An accounting problem arises whenever any behavior is attributed to multiple consequences. In the molar multiscale view, this raises the question of whether 2 activities can occur at the same time. The question remains open.     

THE EXPLORATION OF ECOSPACE: EXTENDING OR SUPPLEMENTING THE NEO‐DARWINIAN PARADIGM?

The neo‐Darwinian paradigm, focusing on natural selection of genes responsible for differential adaption, provides the foundation for explaining evolutionary processes. The modern synthesis is broader, however, focusing on organisms rather than on gene transmissions per se. Yet, strands of current biology argue for further supplementation of Darwinian theory, pointing to nonbiotic drivers of evolutionary development, for example, self‐organization of physical structures, and the interaction between individual organisms, groups of organisms, and their nonbiotic environments. According to niche construction theory, when organisms and groups develop, they not only adapt to their environments but modify their environments, creating new habitats for later generations. Insofar as ecological niches persist beyond the lifecycle of individual organisms, an ecological inheritance system exists alongside genetic inheritance. Such ecological structures may even facilitate the development of a cultural inheritance system, as we see in humans. The article discusses theological perspectives of such new developments within holistic biology.     

Matching in an undisturbed natural human environment

Data from the Oregon Youth Study, consisting of the verbal behavior of 210 adolescent boys determined to be at risk for delinquency (targets) and 210 of their friends (peers), were analyzed for their conformance to the complete family of matching theory equations in light of recent findings from the basic science, and using recently developed analytic techniques. Equations of the classic and modern theories of matching were fitted as ensembles to rates and time allocations of the boys' rule-break and normative talk obtained from conversations between pairs of boys. The verbal behavior of each boy in a conversation was presumed to be reinforced by positive social responses from the other boy. Consistent with recent findings from the basic science, the boys' verbal behavior was accurately described by the modern but not the classic theory of matching. These findings also add support to the assertion that basic principles and processes that are known to govern behavior in laboratory experiments also govern human social behavior in undisturbed natural environments.     

Evolution and the nonlegal equivalent of aggressive criminal behavior

Within the framework of modern evolutionary theory, arguments are reviewed that the nonlegal equivalent of aggressive criminal behavior may have evolved by natural selection among mammals, particularly primates, as part of their overall approach to reproduction. If so, the commission of aggressive crimes (or their nonlegal equivalent) by humans, and even efforts to prevent fellow social group members from being victimized by aggressive crimes, may also be partially explainable in natural selection terms. The plausibility of this deduction was explored, first, by specifying the three elements that a human act must have to be regarded as an aggressive crime. Summarily, these were that (1) injury to a victim must be a likely result of the act, (2) the act must be intended, and (3) the act must elicit negative responses from those witnessing it. The primate behavior literature was examined for evidence that some behavior of nonhumans met all three conditions. Affirmative results were obtained. Therefore, while further research is in order, human aggressive criminal behavior, as well as human efforts to control it, seem to have close parallels in other primates. This would be consistent with the notion that aggressive criminal behavior (along with its condemnation by fellow group members) is part of a social system produced and sustained by natural selection.     

Representations of Complexity: How Nature Appears in Our Theories

In science we study processes in the material world. The way these processes operate can be discovered by conducting experiments that activate them, and findings from such experiments can lead to functional complexity theories of how the material processes work. The results of a good functional theory will agree with experimental measurements, but the theory may not incorporate in its algorithmic workings a representation of the material processes themselves. Nevertheless, the algorithmic operation of a good functional theory may be said to make contact with material reality by incorporating the emergent computations the material processes carry out. These points are illustrated in the experimental analysis of behavior by considering an evolutionary theory of behavior dynamics, the algorithmic operation of which does not correspond to material features of the physical world, but the functional output of which agrees quantitatively and qualitatively with findings from a large body of research with live organisms.     

Creating a strategy for progress: a contextual behavioral science approach

Behavior analysis is a field dedicated to the development and application of behavioral principles to the understanding and modification of the psychological actions of organisms. As such, behavior analysis was committed from the beginning to a comprehensive account of behavior, stretching from animal learning to complex human behavior. Despite that lofty goal, basic behavior analysis is having a generally harder time finding academic support, and applied behavior analysis has narrowed its focus. In the present paper we argue that both of these trends relate to the challenge of human language and cognition, and that developments within clinical behavior analysis and the analysis of derived relational responding are providing a way forward. To take full advantage of these developments, however, we argue that behavior analysts need to articulate their unique approach to theory, to develop more flexible language systems for applied workers, and to expand their methodological flexibility. This approach, which we term contextual behavioral science, is meant as an evolutionary step that will allow behavior analysis to better capture the center of modern psychological concerns in both the basic and applied areas. Clinical behavior analysis is showing a way forward for behavior analysis to regain its vision as a comprehensive approach to behavior.     

When do adaptive developmental mechanisms yield maladaptive outcomes?

This article discusses 3 ways in which adaptive developmental mechanisms may produce maladaptive outcomes. First, natural selection may favor risky strategies that enhance fitness on average but which have detrimental consequences for a subset of individuals. Second, mismatch may result when organisms experience environmental change during ontogeny, for instance, because they move from one environment to another. Third, organisms may learn about their environment in order to develop an appropriate phenotype; when cues indicate the environmental state probabilistically, as opposed to deterministically, sampling processes may produce mismatch. For each source of maladaptation, we present a selection of the relevant empirical research and illustrate how models from evolutionary biology can be used to make predictions about maladaptation. We also discuss what data can be collected to test these models in humans. Our goal is to show that evolutionary approaches not only yield insights into adaptive outcomes but can also illuminate the conditions leading to maladaptation. This perspective provides additional nuance to the dialectic between the developmental psychopathology model and evolutionary developmental psychology.     

Niche construction, biological evolution, and cultural change

We propose a conceptual model that maps the causal pathways relating biological evolution to cultural change. It builds on conventional evolutionary theory by placing emphasis on the capacity of organisms to modify sources of natural selection in their environment (niche construction) and by broadening the evolutionary dynamic to incorporate ontogenetic and cultural processes. In this model, phenotypes have a much more active role in evolution than generally conceived. This sheds light on hominid evolution, on the evolution of culture, and on altruism and cooperation. Culture amplifies the capacity of human beings to modify sources of natural selection in their environments to the point where that capacity raises some new questions about the processes of human adaptation.     

A COLLATERAL EFFECT OF REWARD PREDICTED BY MATCHING THEORY

Matching theory describes a process by which organisms distribute their behavior between two or more concurrent schedules of reinforcement (Herrnstein, 1961). In an attempt to determine the generality of matching theory to applied settings, 2 students receiving special education were provided with academic response alternatives. Using a combined simultaneous treatments design and reversal design, unequal ratio schedules of reinforcement were varied across two academic responses. Findings indicated that both subjects allocated higher rates of responses to the richer schedule of reinforcement, although only one responded exclusively to the richer schedule. The present results lend support to a postulation that positive reinforcement may have undesirable collateral effects that are predicted by matching theory (Balsam & Bondy, 1983).     

Erotomanic stalking in evolutionary perspective

Erotomania, the delusion of being loved by another person, comprises marked sex differences concerning prevalence rates and behavior. Whereas traditional psychiatry has considered erotomania to be almost entirely restricted to women, recent studies have revealed that criminal offenses associated with the condition occur much more frequently in men. The main hypothesis of this article is that these findings may be explained in terms of evolutionary theory. Erotomania, accordingly, may be viewed as a pathological variant of a specific sexual strategy that evolved under selection pressures of the human environment of evolutionary adaptedness. The overt behavior is related to the pursuit of long-term mating, its potentially beneficial effect on inclusive fitness of the individual, and disparate strategies of the sexes to ensure sexual fidelity of the potential partner. Therefore, the evolutionary approach provides a plausible explanation as to why forensically relevant erotomania prevails in men. The pathological process of delusional misinterpretation of perceived signals from the social environment itself may result from poor reality testing due to a failure of social meta-cognition. The evolutionary perspective may provide additional insights into the nature of sex-specific behaviors and may improve our understanding of forensically relevant behaviors.     

All Behavior is choice: Revisiting an evolutionary theory's account of behavior on single schedules

The axiomatic principle that all behavior is choice was incorporated into a revised implementation of an evolutionary theory's account of behavior on single schedules. According to this implementation, target responding occurs in the context of background responding and reinforcement. In Phase 1 of the research, the target responding of artificial organisms (AOs) animated by the revised theory was found to be well described by an exponentiated hyperbola, the parameters of which varied as a function of the background reinforcement rate. In Phase 2, the effect of reinforcer magnitude on the target behavior of the AOs was studied. As in Phase 1, the AOs' behavior was well described by an exponentiated hyperbola, the parameters of which varied with both the target reinforcer magnitude and the background reinforcement rate. Evidence from experiments with live organisms was found to be consistent with the Phase-1 predictions of the revised theory. The Phase-2 predictions have not been tested. The revised implementation of the theory can be used to study the effects of superimposing punishment on single-schedule responding, and it may lead to the discovery of a function that relates response rate to both the rate and magnitude of reinforcement on single schedules.     

Reports of My Death Anxiety Have Been Greatly Exaggerated: A Critique of Terror Management Theory from an Evolutionary Perspective

Although terror management theory's proponents claim that it is an evolutionary theory of human behavior, its major tenets are implausible when examined carefully from a modern evolutionary perspective. We explain why it is unlikely that natural selection would have designed a “survival instinct” or innate “fear of death,” nor an anxiety-reduction system in general, or worldview-defense system in particular, to ameliorate such fears. We argue that results of mortality-salience experiments are better explained as by-products of a psychological system of coalitional computation that evolved for a variety of functions, including defense against other humans, that is activated by certain kinds of death-related thoughts.     

Behaviorism, private events, and the molar view of behavior

Viewing the science of behavior (behavior analysis) to be a natural science, radical behaviorism rejects any form of dualism, including subjective-objective or inner-outer dualism. Yet radical behaviorists often claim that treating private events as covert behavior and internal stimuli is necessary and important to behavior analysis. To the contrary, this paper argues that, compared with the rejection of dualism, private events constitute a trivial idea and are irrelevant to accounts of behavior. Viewed in the framework of evolutionary theory or for any practical purpose, behavior is commerce with the environment. By its very nature, behavior is extended in time. The temptation to posit private events arises when an activity is viewed in too small a time frame, obscuring what the activity does. When activities are viewed in an appropriately extended time frame, private events become irrelevant to the account. This insight provides the answer to many philosophical questions about thinking, sensing, and feeling. Confusion about private events arises in large part from failure to appreciate fully the radical implications of replacing mentalistic ideas about language with the concept of verbal behavior. Like other operant behavior, verbal behavior involves no agent and no hidden causes; like all natural events, it is caused by other natural events. In a science of behavior grounded in evolutionary theory, the same set of principles applies to verbal and nonverbal behavior and to human and nonhuman organisms.     

Guilt by association?

Recent evolutionary perspectives on guilt tend to focus on how guilt functions as a means for the individual to self-regulate behavior and as a mechanism for reinforcing cooperative tendencies. While these accounts highlight important dimensions of guilt and provide important insights into its evolutionary emergence, they pay scant attention to the large empirical literature on its maladaptive effects on individuals. This paper considers the nature of guilt, explores its biological function, and provides an evolutionary perspective on whether it is an individual-level or group selected trait. After surveying philosophical and psychological analyses of guilt, we consider which psychological mechanisms underlie the capacity to experience and act from guilt and whether they point to an emergence of guilt in early humans or to guilt having a longer phylogenetic history. Because guilt is a characteristically social emotion, we then examine its contemporary role in social and legal contexts, which may provide clues to its original biological function. Finally, we provide the outlines of two evolutionary explanations for guilt. We argue that group selection may have promoted the capacity to experience guilt, but that under certain conditions there may have been a positive individual selection force as well.