Operant psychology goes to the fair: Marian and Keller Breland in the popular press, 1947-1966

Marian and Keller Breland pioneered the application of operant psychology to commercial animal training during the 1940s and 1950s. The Brelands' story is relatively unknown in the history of behavior analysis. Using information from the Breland-Bailey papers, this paper describes the development and activities of Animal Behavior Enterprises (ABE), the Brelands' animal training business. We also review popular press coverage of the Brelands between 1947 and 1966 to investigate the level of public exposure to ABE-trained animals and to the principles and methods of operant psychology. An examination of 308 popular print articles featuring the Brelands indicates that there was public exposure of behavior analysis through the popular press coverage of ABE-trained animals. Furthermore, the expansion of operant methods to the marine mammal and bird training industries can be linked to the Brelands' mass media exposure.     

A computer touch-screen apparatus for training visual discriminations in rats.

We describe an operant conditioning apparatus that uses computerized touch-screen technology and is designed for the versatile and highly controlled testing of rats in a potentially wide variety of behavioral paradigms. Although computer-controlled touch-screen systems have been developed for use with pigeons, monkeys, and humans, analogous technologies and methods have not yet been developed for rats. The development of a touch-screen system for rats could enhance the efficiency of behavioral research with rats, and may offer a unique tool for studying animal learning. In the first test of the utility of the apparatus, 3 Sprague-Dawley rats learned to activate the touch screen only after the touch-screen panel was made slightly movable. These animals then learned to discriminate visual stimuli presented on the computer monitor, but only after the food magazine and pellet dispenser were moved to the rear of the chamber opposite the stimulus display and response window. In a test of the utility of the modified apparatus, 6 Long-Evans rats learned to activate the touch screen and learned one of three different simple discriminations using computer-generated, visually presented stimuli. A basic method for training rats to activate the computer touch screen and for visual discrimination training is described. Results show that rats learned to activate the touch screen and discriminate visual stimuli presented on a computer monitor. Potential applications and advantages of the touch-screen-equipped rat operant conditioning chamber are discussed.     

Effects of reinforcement schedule on facilitation of operant extinction by chlordiazepoxide

Learning and memory are central topics in behavioral neuroscience, and inbred mice strains are widely investigated. However, operant conditioning techniques are not as extensively used in this field as they should be, given the effectiveness of the methodology of the experimental analysis of behavior. In the present study, male C57B1/6 mice, widely used as background for transgenic studies, were trained to lever press on discrete-trial fixed-ratio 5 or fixed-interval (11 s or 31 s) schedules of food reinforcement and then exposed to 15 extinction sessions following vehicle or chlordiazepoxide injections (15 mg/kg i.p., administered either prior to all extinction sessions, or prior to the final 10 extinction sessions). Extinction of operant behavior was facilitated by drug administration following training on either schedule, but this facilitation only occurred once a number of extinction sessions had taken place. The extinction process proceeded more rapidly following fixed-interval training. Resistance to extinction was equally high following training with either schedule type, and was reduced by drug administration in both cases. These phenomena were evident in individual cumulative records and in analyses of group data. Results are interpreted in terms of phenomena of operant extinction identified in Skinner's (1938) Behavior of Organisms, and by behavioral momentum theory. These procedures could be used to extend the contribution of operant conditioning to contemporary behavioral neuroscience.     

Functions of the environment in behavioral evolution

This paper explores some of the ways in which the environment functions with respect to behavior within an explanatory framework analogous to that of evolutionary biology. In both the behavioral and organic domains, the environment functions differently with respect to individual occurrences and evolutionary units. Within the behavioral domain, the problem of accounting for an occurrence of an operant instance differs from that of accounting for the existence of the operant unit of which the instance is a part. Maintaining these distinctions in levels of analysis within the behavioral domain, we focus first on operant units and operant instances as products of evolutionary processes occurring in the behavioral domain and second upon the causal role of the environment with respect to the existence of operant units and the occurrence of operant instances. The environment's function is selective with respect to origin, maintenance, suppression, and extinction of behavioral populations. At the level of operant instances, the environment has instantiating functions-evocative or alterative. Evocative functions are exemplified by discriminative relations, and alterative functions include both conditional and motivative relations. Implications are considered regarding extension of the analogy to more complex behavior-environment relations.     

Psychological and educational characteristics of instruction for people with severe disabilities: Interacting systems of responding

This paper presents a behavioral model which proposes that operants are organized and regulated into systems of responding. Multi-operant theory proposes that operants are organized into response systems that interact to adapt behavior to the complexities of the environment. The operant is the interaction between behavior and the environment which includes the conditions under which responses may occur, the class of behavior that is likely to be effective in producing outcomes, and the antecedent conditions that define the context of behavior. A central feature of this theory is that operants within a repertoire are organized into regulated systems of responding. The mechanisms of regulation are themselves operants that are learned and controlled by processes that are the same as those that govern more overt behavior. Operants stand in relationship to each other in coordinated response systems with some operants directly affecting and organizing the performance of other operants. An important implication of the systemic nature of behavioral repertoires is that bringing some aspect of a behavior class under control of new variables may demonstrate a spread throughout the entire operant system depending on past histories linking the classes.deceased     

Comparing choices and variations in people and rats: Two teaching experiments

Two pairs of experiments enabled students to compare their own operant behaviors with those of rats. The students played computer games for points, and the rats pressed levers for food. The first pair of experiments showed that, under concurrent schedules of reinforcement, relative frequencies of choices between two alternatives increased linearly in rats and people as functions of relative frequencies of reinforcement, with similar biases and undermatching observed in both species. The second pair of experiments showed that behavioral variability was controlled by reinforcers contingent on variability, this again true for both species. These experiments helped demonstrate the relevance of animal operant research to an explanation of human operant behavior.     

Towards mouse models of perseveration: a heritable component in extinction of operant behavior in fourteen standard and recombinant inbred mouse lines

Extinction of instrumental responses is an essential skill for adaptive behavior such as foraging. So far, only few studies have focused on extinction following appetitive conditioning in mice. We studied extinction of appetitive operant lever-press behavior in six standard inbred mouse strains (A/J, C3H/HeJ, C57BL/6J, DBA/2J, BALB/cByJ and NOD/Ltj) and eight recombinant inbred mouse lines. From the response rates at the end of operant and extinction training we computed an extinction index, with higher values indicating better capability to omit behavioral responding in absence of reward. This index varied highly across the mouse lines tested, and the variability was partially due to a significant heritable component of 12.6%.To further characterize the relationship between operant learning and extinction, we calculated the slope of the time course of extinction across sessions. While many strains showed a considerable capacity to omit responding when lever pressing was no longer rewarded, we found a few lines showing an abnormally high perseveration in lever press behavior, showing no decay in response scores over extinction sessions.No correlation was found between operant and extinction response scores, suggesting that appetitive operant learning and extinction learning are dissociable, a finding in line with previous studies indicating that these forms of learning are dependent on different brain areas. These data shed light on the heritable basis of extinction learning and may help develop animal models of addictive habits and other perseverative disorders, such as compulsive food seeking and eating.     

Two open source designs for a low‐cost operant chamber using Raspberry Pi™

After almost a century of use and development, operant chambers remain a significant financial investment for scientists. Small powerful single‐board computers such as the Raspberry Pi? offer researchers a low‐cost alternative to expensive operant chambers. In this paper, we describe two new operant chambers, one using nose‐poke ports as operanda and another using a touchscreen. To validate the chamber designs, rats learned to perform both visual discrimination and delayed alternation tasks in each chamber. Designs and codes are open source and serve as a starting point for researchers to develop behavioral experiments or educational demonstrations.     

Autoshaping of abnormal children

Three experimentally naive abnormal children were exposed to a terminal operant contingency, i.e., reinforcement was delivered only if the children pressed a panel during intervals when it was lighted. Despite the absence of both successive approximation and manual shaping, it was found that each child began to respond discriminatively within a small number of trials. These data replicated previous animal studies concerned with the phenomena of autoshaping and signal-controlled responding. It was also found, however, that one type of autoshaping, the classical conditioning procedure, had a powerful suppressive effect on discriminative responding. An experimental analysis that consisted of a combination of intrasubject reversal and multiple baseline designs established the internal validity of the findings. The finding of rapid acquisiton of signalcontrolled responding obtained with the initial procedure is suggested to have practical significance. The disruptive effects of the classical form of autoshaping are discussed in terms of negative behavioral contrast.Funding for this study and for the development of the computer-operated laboratory was provided by the USOE, Bureau of Education for the Handicapped, as a portion of Grant Number G007604305, sensory discrimination, generalization, and language training of autistic children, awarded to R. L. Blanton and C. W. Deckner. The authors would like to express their appreciation to John Halsell for his assistance in computer operations and data collection.     

Transfer from “edible” categorization training to feeding behavior in pigeons (Columba livia)1

Abstract: We investigated a transfer from an operant experimental situation to a feeding situation in pigeons using real objects as stimuli. Four pigeons were trained in an operant box to categorize familiar edible items as positives and inedible items as negatives with a go/no‐go procedure. Next, two pairs of unfamiliar edible items were added as stimuli. One of the paired stimuli was arbitrarily assigned as positive and the other as negative. We tested the subjects in their home cages to see whether they would feed on the items they were trained to categorize as positives. In three of the six cases in which categorization training was successful, they continued to peck the positive items. This result suggests that the pigeons transfer what they learned in the operant training situation to the feeding situation.     

Behavioral contrast and the automaintained key peck

In two experiments behavioral contrast was demonstrated during discrimination training in a positive automaintenance procedure. During the baseline condition in each experiment, a key was transilluminated for eight seconds by one of two colors (CS) following a variable intertrial interval signaled by a dark key. Keylight transillumination terminated with a response-independent food presentation. In the first experiment, food was eliminated during one CS for up to fifty sessions. After reinstatement of food following each CS, the discrimination was reversed. Six of the eight subjects showed positive behavioral contrast, i.e., response rates increased during the CS associated with food as they decreased during the CS associated with no food. The effect was replicated in Experiment II, but it did not occur when both the food and its associated CS were eliminated. These results were comparable to those obtained with operant discrimination training procedures (behavioral contrast) and with Pavlovian discrimination training. The results suggest that additivity theories of behavioral contrast may be insufficient to account for these data.     

Operant Reward Learning in Aplysia

Anticipating the future has a decided evolutionary advantage, and researchers have found many evolutionarily conserved mechanisms by which humans and animals learn to predict future events. Researchers often study such learned behavior using conditioning experiments. The marine snail Aplysia has been at the forefront of research into the cellular and molecular mechanisms of classical conditioning. Recently, Aplysia has also gained a reputation as a valuable model system for operant reward learning. Its feeding behavior can be operantly conditioned in the intact animal as well as in reduced preparations of the nervous system. The reward signal relies on dopamine transmission and acts in conjunction with activity in an identified neuron (B51) to bring about operant memory.     

Technologies to reliably transduce the topographical details of pigeons’ pecks

Pigeons’ pecking has long been a subject of interest in behavioral research, with the response typically being viewed as unitary. Recent experiments done with computer-controlled devices have revealed that this response is at least bipartite in character, with beak opening and response location (head transport) as its components. In addition, experimental work has demonstrated that these response components may be separately influenced and controlled by respondent and operant conditioning procedures. The detailed topographic analysis and technology that have emerged may provide a background for similar work with other behavioral systems.     

Computer control for operant oriented laboratories

A process control procedure using base rate polling within interrupt driven routines, segmentation of time dependent events, and a branch table execution structure was developed for an operant oriented behavioral pharmacology laboratory. Efficient independent control and analysis for eight experimental chambers was obtained utilizing the similarities between various operant techniques.     

ELOPTA: A novel microcontroller-based operant device

Operant devices have been used for many years in animal behavior research, yet such devices a regenerally highly specialized and quite expensive. Although commercial models are somewhat adaptable and resilient, they are also extremely expensive and are controlled by difficult to learn proprietary software. As an alternative to commercial devices, we have designed and produced a fully functional, programmable operant device, using a PICmicro microcontroller (Microchip Technology, Inc.). The electronic operant testing apparatus (ELOPTA) is designed to deliver food when a study animal, in this case a bird, successfully depresses the correct sequence of illuminated keys. The device logs each keypress and can detect and log whenever a test animal i spositioned at the device. Data can be easily transferred to a computer and imported into any statistical analysis software. At about 3% the cost of a commercial device, ELOPTA will advance behavioral sciences, including behavioral ecology, animal learning and cognition, and ethology.     

Melioration and self-experimentation

Operant researchers rarely use the arena of applied psychology to motivate or to judge their research. Absence of tests by application weakens the field of basic operant research. Early in their development, the physical and biological sciences emphasized meliorative aspects of research. Improvement of human life was a major goal of these young sciences. This paper argues that if basic operant researchers analogously invoked a melioration criterion, the operant field might avoid its tendency toward ingrowth and instead generate a broadly influential science. Operant researchers could incorporate melioration by (a) creating animal models to study applied problems; (b) confronting questions raised by applied analysts and testing hypotheses in applied settings; or (c) performing self-experiments—that is, using experimental methods and behavioral techniques to study and change the experimenter's behavior.     

A multiplexed vectored interface logic system for control of behavioral experiments

An interface was constructed which enabled a minicomputer to control operant conditioning experiments with a minimal amount of software recognition and input/output instructions. The hardware consisted of a real-time clock, logic to input a unique number with each change of state of digital input, and logic and solid state drivers to control standard, commercial 24 V behavioral stimuli.     

The operant and the classical in conditioned orientation of Drosophila melanogaster at the flight simulator

Ever since learning and memory have been studied experimentally, the relationship between operant and classical conditioning has been controversial. Operant conditioning is any form of conditioning that essentially depends on the animal's behavior. It relies on operant behavior. A motor output is called operant if it controls a sensory variable. The Drosophila flight simulator, in which the relevant behavior is a single motor variable (yaw torque), fully separates the operant and classical components of a complex conditioning task. In this paradigm a tethered fly learns, operantly or classically, to prefer and avoid certain flight orientations in relation to the surrounding panorama. Yaw torque is recorded and, in the operant mode, controls the panorama. Using a yoked control, we show that classical pattern learning necessitates more extensive training than operant pattern learning. We compare in detail the microstructure of yaw torque after classical and operant training but find no evidence for acquired behavioral traits after operant conditioning that might explain this difference. We therefore conclude that the operant behavior has a facilitating effect on the classical training. In addition, we show that an operantly learned stimulus is successfully transferred from the behavior of the training to a different behavior. This result unequivocally demonstrates that during operant conditioning classical associations can be formed.     

Acquisition,Extinction, Recovery,and Reversal of Different Response Sequences Under Conditional Control by Nicotine in Rats

Complex voluntary behaviors occur in sequence. Eight rats were trained in an operant procedure that used nicotine and non-drug (saline) states as interoceptive cues that signaled which of two behavioral sequences led to food reward. The distal and proximal responses in the chain were always maintained on variable interval 30-sec and fixed ratio-1 schedules, respectively, and rate differences between the responses were used as the dependent variable. Extinction and reversal training was conducted. Distal response rates were significantly greater than proximal response rates during training, testing, extinction, and reversal learning. These data suggest that (a) nicotine can establish interoceptive control over different response sequences, and (b) extinction of one response sequence may be state-dependent. The clinical relevance of extinction of complex behavioral repertoires such as drug-seeking and drug-taking behavior that are evoked by specific interoceptive cues is addressed in regard to drug abuse treatment and relapse.