Behavior,process, and scale: Comments on Shimp (2020), “Molecular (moment-to-moment) and molar (aggregate) analyses of behavior”

If we study the behavior of organisms, we must understand the ontological status of both “organism” and “behavior.” A living organism maintains itself alive by constantly interacting with the environment, taking in energy and discarding waste. Ontologically, an organism is a process. Its interactions with the environment, which constitute its behavior, are processes also, because the parts of any process are themselves processes. Processes serve functions, and the function of a process must be part of its identity. A process, by definition, extends in time. Time is the fundamental and universal measure of behavior. All processes have the property of scale. Activities of an organism have parts that are themselves activities on a smaller time scale. Scale varies continuously, and behavior may be studied on as large or as small a time scale as seems necessary. When researchers refer to the “structure” of behavior, they refer to smaller-scale activities. Attaching a switch to a lever or key is convenient, but one should never confuse operation of a switch with a unit of behavior. Shimp's (2020) “molecular” measures are small-scale measures. The molecular view based on discrete events has outlived its usefulness and should be replaced by a multiscale molar paradigm.     

Choice behavior on discrete trials: a demonstration of the occurrence of a response strategy

Three pairs of pigeons were trained to peck at two keys presented simultaneoulsy in discrete trials with intertrial intervals of 1, 22, or 120 sec. Left-key responses incremented the probability of reinforcement for the first right-key response and, conversely, right-key responses incremented the probability of reinforcement for the first left-key response. In terms of relative response rates, it was found that all birds' choices were described by a momentary maximizing strategy, but this fact was not reflected in the detailed sequential statistics for birds with the longer (22 or 120 sec) intertrial intervals. It was hypothesized that choice behavior, in general, may be accurately described by a momentary maximizing sequence, but that prior failures to demonstrate this were due to “errors” in executing the momentary maximizing sequence. These misappropriated responses, which are hypothesized to be randomly distributed among the responses defining the momentary maximizing sequence, caused successive choices to appear to be statistically independent when, in fact, they were not.     

Levels of aggregation and the generalized matching law.

Concurrent operant behavior is often described using molar response tendencies measured over many sessions. In contrast, other models relate the allocation of behavior to momentary or molecular processes that operate over shorter periods. In this article, a formal model of the statistical properties of molecular behavioral matching is developed. Molar matching is the result when many individual bouts of responding are aggregated. However, behavioral allocation at the molecular level will differ from the molar result. The model indicates that aggregation effects should be controlled in analyses of matching and that the comparison of molecular theories of concurrent operant behavior with molecular models of matching performance affords ideographic analyses of choice behavior.     

Momentary affective response to bouts of moderate-to-vigorous physical activity predicts changes in physical activity and sedentary behavior during behavioral weight loss

BackgroundAffective responses are posited to be key predictors of the uptake and maintenance of health behaviors. However, few studies have examined how individuals’ affective response to physical activity, as well as the degree to which their affect response changes, may predict changes in physical activity and sedentary time during behavioral weight loss treatment.PurposeThe current study examined how baseline momentary affective response (i.e., stress and anxiety) to moderate-to-vigorous physical activity (MVPA) and the degree of pre--post intervention change in this response predicted change in daily sedentary, light, and MVPA time during a three-month internet-based weight loss program.MethodsWomen with overweight/obesity (final N = 37) completed 14-day ecological momentary assessment (EMA) protocols with objective measurement of physical activity (i.e., bout-related MVPA time) before and after the intervention.ResultsWomen who had more reinforcing responses to MVPA (i.e., greater reductions in anxiety and stress response following MVPA bouts) at baseline had greater increases in overall MVPA at the end of the intervention. Those who had greater anxiety reductions after MVPA bouts at baseline also evidenced less sedentary time at the end of the intervention. Changes in affective responses across the intervention were not related to changes in physical activity levels.ConclusionsFindings suggest initial levels of affective reinforcement from MVPA bouts predict future change in MVPA and sedentary time during behavioral weight loss. Future work is needed to examine the utility of more precisely targeting affective responses to physical activity to optimize intervention approaches.     

Response–reinforcer contiguity versus response-rate–reinforcer-rate covariance in rats' lever pressing: Support for a multiscale view

The multiscale molar view sees behavior as a flow, like a river, extended in time. Matching theory expresses the way activities compete for time. Relative time taken by any activity depends on relative induction. The present experiment tested matching theory applied to concurrent contingent and noncontingent food. As adjunctive activities that compete with operant activity, we recorded hopper head entries and presses on a lever near the food hopper that had no programmed consequences. Eight naïve rats were first exposed to a variable-time 60 s schedule, which across conditions was gradually transformed into a variable-interval 60 s schedule by increasing the proportion of food that was delivered contingent on pressing a lever far from the hopper. Another group of 4 rats that had been trained to press a lever near a food hopper were introduced in the second condition, in which one food delivery was contingent on far-lever pressing. We found induction following a power function to describe pressing on the far lever (operant activity). Matching theory combined with power-function induction also accounted for adjunctive activity. Results with single contingent food deliveries provided little support for the molecular view that behavior consists of discrete responses “strengthened” by immediately following reinforcers.     

Hill-climbing by pigeons

Pigeons were exposed to two types of concurrent operant-reinforcement schedules in order to determine what choice rules determine behavior on these schedules. In the first set of experiments, concurrent variable-interval, variable-interval schedules, key-peck responses to either of two alternative schedules produced food reinforcement after a random time interval. The frequency of food-reinforcement availability for the two schedules was varied over different ranges for different birds. In the second series of experiments, concurrent variable-ratio, variable-interval schedules, key-peck responses to one schedule produced food reinforcement after a random time interval, whereas food reinforcement occurred for an alternative schedule only after a random number of responses. Results from both experiments showed that pigeons consistently follow a behavioral strategy in which the alternative schedule chosen at any time is the one which offers the highest momentary reinforcement probability (momentary maximizing). The quality of momentary maximizing was somewhat higher and more consistent when both alternative reinforcement schedules were time-based than when one schedule was time-based and the alternative response-count based. Previous attempts to provide evidence for the existence of momentary maximizing were shown to be based upon faulty assumptions about the behavior implied by momentary maximizing and resultant inappropriate measures of behavior.     

Tactical contingencies in the experimental analysis of reinforcement and operant classes

In his “Tactics of Scientific Research” (1960), his work on avoidance, his discovery of equivalence classes and his cautions on applications of coercion, Murray Sidman created high standards for behavior analytic research. I illustrate his influence in the context of three examples he might have characterized as pilot studies. Each examined trial N+1 response probabilities depending on whether trial N responding had produced a reinforcer. Differentially reinforced interresponse times, keys pecked in arbitrary matching, and two-key response sequences provided no robust evidence that reinforcing some response property on trial N raises the probability of responding with that property on trial N+1. These negative findings shed light on the nature of operant classes and on the relation of reinforcers to the responses that produced them. Through selection, reinforcers create operant classes and engender variations of the responses within those classes; operant classes are held together by common contingencies. Sidman extended our understanding of operant classes by expanding them to include equivalence relations.     

Adolescents' prosocial responses to ostracism: an experimental study

Ostracism can lead to strong behavioral responses, including diminished prosocial behavior. To date, experimental research examining this effect has only been conducted with adults. The current study consisted of 40 adolescents, half of whom were experimentally ostracized using the Cyberball paradigm. Participants' subsequent levels of pronounced prosocial behavior were measured, and personality traits were examined as possible moderators in participant behavioral responses. Results revealed that, compared to controls, ostracized adolescents showed less prosocial behavior, and this was moderated by having an "open" personality.     

Choice in a variable environment: visit patterns in the dynamics of choice

Molar and molecular views of behavior imply different approaches to data analysis. The molecular view privileges moment-to-moment analyses, whereas the molar view supports analysis of more and less extended activities. In concurrent performance, the molar view supports study of both extended patterns of choice and more local patterns of visiting the choice alternatives. Analysis of the present data illustrated the usefulness of investigating order at various levels of extendedness. Seven different reinforcer ratios were presented within each session, without cues to identify them, and pigeons pecked at two response keys that delivered food on variable-interval schedules. Choice changed rapidly within components as reinforcers were delivered and, following each reinforcer, shifted toward the alternative that produced it. If several reinforcers were delivered consecutively by one alternative, choice favored that alternative, but shifted more slowly with each new reinforcer. A discontinuation of such a series of reinforcers by the delivery of a reinforcer by the other alternative resulted in a large shift of choice toward that alternative. These effects were illuminated by analysis of visits to the two alternatives. Changes in visit length occurred primarily in the first postreinforcer visit to the repeatedly reinforced alternative. All other visits tended to be brief and equal. Performance showed multiple signs of moving in the direction of a fix-and-sample pattern that characterized steady-state performance in earlier experiments with many sessions of maintaining each schedule pair. The analyses of extended and local patterns illustrate the flexibility of a molar view of behavior.     

Conditioning of two-response patterns of key pecking in pigeons

On discrete trials, two response keys were made available to hungry pigeons and food reinforcement depended on the order in which the required two key pecks occurred. In different phases, only one of the four possible two-peck sequences (left-left, left-right, right-left, and right-right) produced food reinforcement. In each case, the pigeons learned to perform the correct two-peck sequence more often than the incorrect sequences. Furthermore, the course of differentiation mastery indicated that both reinforcement history and response-reinforcer contiguity influenced performance. These results reveal that response patterns comprising two instances of the same response left-left and right-right) or instances of two different responses (left-right and right-left) may function as operants, thereby extending the generality of conditioning principles from discrete responses to structured sequences of behavior. These and other results are discussed in terms of contiguity-based and memory-based models of learning.     

Units of analysis and kinetic structure of behavioral repertoires

It is suggested that molar streams of behavior are constructed of various arrangements of three elementary constituents (elicited, evoked, and emitted response classes). An eight-cell taxonomy is elaborated as a framework for analyzing and synthesizing complex behavioral repertoires based on these functional units. It is proposed that the local force binding functional units into a smoothly articulated kinetic sequence arises from temporally arranged relative response probability relationships. Behavioral integration is thought to reflect the joint influence of the organism's hierarchy of relative response probabilities, fluctuating biological states, and the arrangement of environmental and behavioral events in time.     

空气污染对个体直接和溢出行为的影响

空气污染对行为影响的研究日渐丰富, 且大致分为两个方向:一是与环境健康有关的直接行为, 二是与之无直接相关的社会行为(溢出行为)。基于此, 在回顾空气污染对两种行为影响研究的同时, 进一步综述了用于解释直接行为产生机制的计划行为理论和健康行动过程取向模型, 以及用于解释社会行为机制的焦虑与自我损耗。而更全面的探究现象背后的机制有助于发现更多有效应对空气污染的举措, 未来的研究可以采用更多纵向的研究范式、增加对行为机制的探究, 从而改善人们的风险应对行为。     

In vitro reinforcement of hippocampal bursting: a search for Skinner's atoms of behavior.

A novel "in vitro reinforcement" paradigm was used to investigate Skinner's (1953) hypotheses (a) that operant behavior is made up of infinitesimal "response elements" or "behavioral atoms" and (b) that these very small units, and not whole responses, are the functional units of reinforcement. Our tests are based on the assumption that behavioral atoms may plausibly be represented at the neural level by individual cellular responses. As a first approach, we attempted to reinforce the bursting responses of hippocampal units in a highly reduced brain-slice preparation with local micropressure applications of behaviorally reinforcing dopaminergic drugs. The same injections were administered independently of bursting to provide a "noncontingent" control for nonspecific stimulation or facilitation of firing. It was found that the bursting responses of individual CA1 pyramidal neurons may be progressively facilitated in a dose-related manner by response-contingent (but not noncontingent) injections of dopamine itself, the dopamine D1-preferring agonist SKF 82958, the D3-preferring agonist quinpirole, and the D2-like selective agonist (+)-4-propyl-9 hydroxynapthoxazine. These findings support the conclusion that unit bursting responses can be reinforced in vitro in hippocampal slices, and they further suggest that the same dopamine receptor subtypes are involved in both cellular and behavioral operant conditioning. The results thus provide indirect support for Skinner's atoms-of-behavior hypothesis.     

Quantitative prediction and molar description of the environment

Molecular explanations of behavior, based on momentary events and variables that can be measured each time an event occurs, can be contrasted with molar explanations, based on aggregates of events and variables that can be measured only over substantial periods of time. Molecular analyses cannot suffice for quantitative accounts of behavior, because the historical variables that determine behavior are inevitably molar. When molecular explanations are attempted, they always depend on hypothetical constructs that stand as surrogates for molar environmental variables. These constructs allow no quantitative predictions when they are vague, and when they are made precise, they become superfluous, because they can be replaced with molar measures. In contrast to molecular accounts of phenomena like higher responding on ratio schedules than interval schedules and free-operant avoidance, molar accounts tend to be simple and straightforward. Molar theory incorporates the notion that behavior produces consequences that in turn affect the behavior, the notion that behavior and environment together constitute a feedback system. A feedback function specifies the dependence of consequences on behavior, thereby describing properties of the environment. Feedback functions can be derived for simple schedules, complex schedules, and natural resources. A complete theory of behavior requires describing the environment's feedback functions and the organism's functional relations. Molar thinking, both in the laboratory and in the field, can allow quantitative prediction, the mark of a mature science.     

Chimpanzee minds: suspiciously human?

Chimpanzees undoubtedly form concepts related to the statistical regularities in behavior. But do they also construe such abstractions in terms of mental states - that is, do they possess a 'theory of mind'? Although both anecdotal and experimental data have been marshaled to support this idea, we show that no explanatory power or economy of expression is gained by such an assumption. We suggest that additional experiments will be unhelpful as long as they continue to rely upon determining whether subjects interpret behavioral invariances in terms of mental states. We propose a paradigm shift to overcome this limitation.     

Programming time as a function of response duration: a replication of "dit-dah" without possible guessing artifacts

Reaction time was longer prior to longer-lasting pressing responses for low probability, unanticipated movements. By contrast, reaction time was independent of response duration for high probability, anticipated movements. This replicates and extends previous findings for choice and simple reaction time in the "dit-dah" paradigm. The present results (unanticipated responses) cannot be given a selective anticipation interpretation because the comparison is between responses which are never anticipated. The previous paradigm was open to an alternative interpretation in which selective anticipation of dit rather than dah could have produced the differences in choice reaction time. Confirmation of the finding that variations in required response duration lead to differences in reaction time supports the view that the underlying parameter of "complexity" in the "memory drum theory" may be response duration.     

A molar view of goal direction and habit

When we treat behavior within an evolutionary framework and as temporally extended flow, two fundamental questions arise: (a) What is an organism? and (b) What is behavior? An organism is a process that stays intact by constantly exchanging energy with the environment. It takes in resources and puts out waste. The behavior of an organism consists of those process parts of the organism process that make up the exchange. These activities serve the function of reproducing, which generally depends on surviving. Surviving and reproducing depend on responding to phylogenetically important events (PIEs). A PIE induces activities that enhance or mitigate the PIE. Organisms respond not only to a PIE but also to events that covary with the PIE. Both activities and environmental features may covary with a PIE. When either type of covariance is introduced to an organism, behavior adapts over time. The early stages of adaptation constitute what researchers call “goal direction,” and the later stages constitute what researchers call “habit.” Behavior and environment constitute a dynamic system, and manipulations of the covariances and environmental features of the system allow many experimental interventions. This molar approach allows experiments on goal direction and habit to be understood without appeal to everyday mentalistic terms.     

Molecular (moment-to-moment) and molar (aggregate) analyses of behavior

Ten meanings or usages of the terms molecular and molar analyses are based on (1) numbers of responses, (2) durations of activities, (3) levels, (4) scales, (5) contiguity versus correlation, (6) behavioral standards, (7) function with or without structure, (8) local versus global phenomena, and (9) control by shaping of sequential moment-to-moment behavior. These usages reveal divisive viewpoints along with ambiguities in the Law of Effect, the definition of an operant, response strength, response probability, random behavior, time allocation, shaping, controlled versus uncontrolled operants, and roles for ordinary language. Usage 10 is less divisive and combines, and in that sense unifies, molecular behavior, defined as shaped moment-to-moment sequential behaving, and molar, defined as averages of aggregates of those shaped responses. It combines shaping, that establishes and changes operant behaviors, and strengthening that changes the amounts of those shaped behaviors. I conclude that general behavioral theory will combine strengthening with such methods as parametric, hybrid, or nonparametric shaping, and will use computational methods to simulate moment-to-moment behavior streams from which any aggregates of theoretical interest may be computed. Such a synthesis may not require different levels, scales, or new scientific paradigms.     

Acquisition and discrimination of appetitively and aversively conditioned heart rate responses in rhesus monkeys

This report describes the acquisition of a conditional heart rate response to both classical aversive and appetitive conditioning in eight rhesus monkeys(Macaca mulatta). The behavioral paradigm consisted of two discrete one minute tones followed by the corresponding unconditional stimuli,i.e., electric shock or Purina monkey chow. A third tone followed by neither food nor shock served as a discriminative stimulus (DS). The conditional heart rate responses developed in two phases. The first phase was characterized by similar responses to both conditional stimuli and the DS. Control heart rate rose during this period. During the second phase, control heart rate decreased (five animals), the DS response disappeared, and different conditional heart rate patterns to food and shock emerged. The existence of distinct conditional response patterns indicates probable differences in the autonomic nervous regulation of the heart during aversive and appetitive conditioning.     

Agency and observation in knowledge of one's own thinking

This essay addresses the question how we know our conscious thinking. Conscious thinking typically takes the form of a series of discrete episodes that constitute a complex cognitive activity. We must distinguish the discrete episodes of thinking in which a particular content is represented in phenomenal consciousness and is present “before the mind's eye” from the extended activities of which these episodes form a part. The extended activities are themselves contentful and we have first‐person access to them. But because their content is not represented in phenomenal consciousness, this access cannot be broadly observational. Instead, I argue, it is agential. Furthermore, that extended activities are intentional explains the possibility of a nonobservational form of introspective access to the discrete episodes in consciousness.