Defining reinforcess — A problem in communication for consultation in behavior modification

This paper reviews the respondent (Hull-Spence) and operant (Skinnerian) conditioning definitions of reinforcers and reinforcement and demonstrates the need to keep the systems separate when consulting about behavior modification. The two systems are shown to lead to different modification procedures.One important distinction between the systems is whether a reinforcer is simply associated with a response (respondent) or whether it must follow the response (operant). A second important distinction is the definition of negative reinforcement. In respondent conditioning, negative reinforcement entails presenting an aversive stimulus in association with the response and results in a decrease in response rate. In operant conditioning, negative reinforcement entails the removal of an aversive stimulus following a correct response, which results in an increase in response rate.     

Psychopharmacologic facilitation of operant conditioning of genetically nervous catahoula and Pointer dogs

Previous work has demonstrated that a genetic factor underlies much of the disturbed behavior in one strain of short haired pointer bird dogs (E line) maintained for several years in our laboratory. In some dogs the behavior is seemingly permanent and is characterized by human avoidance, excessive startle, reduced exploratory activity, and “freezing” or catatonic posturing. Another strain of dogs, catahoulas, with a high incidence of disturbed behavior similar to that above but with much less catatonic posturing, was made available for study also. In both of these strains defensive reaction and gross avoidance behavior often prevents the acquisition and later performance of operant conditioning (bar pressing for food reward) unless supportive tranquilizing chemotherapy is given. The chief interest in this study is, (1) the nearly permanent disharmony in the animal which seems to be an example of Gantt’s concept of schizokinesis, and (2) a comparison of 12 psychoactive compounds widely used in psychiatry for their effectiveness in restoring integrated adaptive functioning even in the most disturbed of the animals in our colony. The results show that: 1. even dogs with the most severe schizokinetic disabilities of many years duration have learned the operant conditioning (bar pressing); 2. however, it was and has remained necessary to facilitate both behavior shaping and nearly all later performances throughout the following year with benzodiazepine tranquilizers and these were far superior to any of the several other drugs tested; 3. neither gradual or rapid withdrawal nor sudden stopping of benzodiazepines allowed the dogs to continue the bar pressing. In fact, during withdrawal of the drug, performance seemed to parallel blood levels as reported in the literature.     

REVIEW OF THE BOOK SNIFFY THE VIRTUAL RAT PRO VERSION 2.0

Sniffy the Virtual Rat Pro Version 2.0 is the most recent update to the Sniffy the Rat program modules. It has an extensive set of simulations related to Pavlovian and operant conditioning. Many of the standard conditioning paradigms and phenomena are contained within this program. Pavlovian effects such as blocking, overshadowing, and stimulus competition are demonstrated in the data output. Operant manipulations allow shaping the behavior of the virtual rat, observing cumulative records of interval and ratio schedules, as well as conducting operant discrimination procedures. In both Pavlovian and operant paradigms, one can generate histograms that predict the degree to which various stimuli control the virtual rat's behavior. On‐screen presentations may keep most users interested, but working with the generated data files sometimes can prove difficult. Overall, this program has a strong potential for facilitating the instruction in undergraduate conditioning courses, serving as an addendum to traditional undergraduate conditioning laboratories and as a supplement to the use of live animals.     

The effects of lesions in the central nucleus of the amygdala on appetitive classical conditioning in rats

Abstract: Lesions in the central nucleus of the amygdala (cAMY) have been known to interfere with the acquisition of fear classical conditioning when footshock is used as an unconditioned stimulus (US). The present study examined whether or not a similar interference would occur with an appetitive US. Five rats with lesions in the cAMY (the cAMY group), and eight unoperated control rats were trained in an appetitive classical conditioning paradigm, which did not include elements of operant learning, using a visual conditioned stimulus (CS) (5 W of light for 10 s duration) paired with a food pellet US (45 mg, cheese flavor). The behavioral index of appetitive conditioning was an increase in rearing approach behavior to the CS after CS and US pairings. During CS and US pairings, the movement of the rat was limited so that this approach behavior could not occur. As a result, all control rats showed an increase in rearing, but the cAMY group did not. These results suggest that the cAMY is critical for appetitive as well as fear classical conditioning.     

Evaluation of infant vocal conditioning.

The use of the operant conditioning paradigm, as it has been applied to infant social, vocal behavior, reflects a failure to take into account the social nature of human infants over and above the rigid theoretical rationale of the paradigm. It is argued that: (1) the baseline procedure used in operant conditioning studies is methodologically and conceptually invalid; (2) the reinforcing stimulus used in social conditioning studies elicits the very response that it is assigned to reinforce; and (3) the effect of the response-reinforcer relationship is not the reinforcement (strengthening) of vocal response rate.     

An Analysis of Feedback from a Behavior Analytic Perspective

The present paper presents a systematic analysis from a behavior analytic perspective of procedures termed feedback. Although feedback procedures are widely reported in the discipline of psychology, including in the field of behavior analysis, feedback is neither consistently defined nor analyzed. Feedback is frequently treated as a principle of behavior; however, its effects are rarely analyzed in terms of well-established principles of learning and behavior analysis. On the assumption that effectiveness of feedback procedures would be enhanced when their use is informed by these principles, we sought to provide a conceptually systematic account of feedback effects in terms of operant conditioning principles. In the first comprehensive review of this type, we compare feedback procedures with those of well-defined operant procedures. We also compare the functional relations that have been observed between parameters of consequence delivery and behavior under both feedback and operant procedures. The similarities observed in the preceding analyses suggest that processes revealed in operant conditioning procedures are sufficient to explain the phenomena observed in studies on feedback.     

A comparison of systematic desensitization and reinforced practice procedures in fear reduction

At least two strategies of behavior modification seem possible in the treatment of neurotic disorders. In the first, systematic desensitization is used to reduce the anxiety associated with the avoidance behavior, thus reducing avoidance of the feared stimulus. In the second, anxiety is ignored and approach behavior is shaped by direct reinforcement according to operant conditioning principles. Each procedure enjoys a literature of successful application in both laboratory and clinical settings. Systematic desensitization has been effective in treating fears of small animals (Lang and Lazovik, 1963) interpersonal anxieties (Paul, 1966), and classic phobias (Lazarus, 1961). Operant approaches involving reinforced practice have proved successful in treating agoraphobia (Agras et al., 1968), anorexia nervosa (Bachrach et al., 1965), and various types of behavior of psychotic patients (Risley and Wolf, 1967; Ayllon and Azrin, 1968).The present study was designed to examine the relative therapeutic effectiveness of systematic desenzitization and reinforced practice in the treatment of snake phobia. Although Barlow et al. (1970) have suggested that “shaping” is more effective than systematic desensitization in the reduction of avoidance behavior, Ss in their “shaping” condition were given more experience with the aversive stimulus than desensitization Ss. The present study avoids such confounding.     

The operant control of vocalization in the dog

Control over the vocal responses of three dogs was established using operant-conditioning procedures. Several points of interest were observed in the data. First, fixed-ratio schedules of reinforcement generated a vocal response topography which was similar in detail to that of a “motor” bar-nosing response. Second, vocal responding was brought under the control of external visual stimuli as a result of differential reinforcement. Third, good stimulus control was maintained on a multiple schedule containing a vocal-response component and a bar-response component. Fourth, the stimulus control on the multiple schedule transferred with minimal disruption to a chain schedule requiring a sequence of 10 bar responses followed by 10 vocal responses. Fifth, because vocal and bar responses are not mutually exclusive, concurrent responding tended to develop on the chain schedule.

These results were discussed with reference to the advisability of applying the terms operant and respondent to unconditioned behavior, and, particularly, to unconditioned verbal behavior.

     

Acquisition and transfer of occasion setting in operant feature positive and feature negative discriminations

The acquisition and transfer of stimulus control in discrete-trial operant feature positive and feature negative discriminations was examined in two experiments with rats. When the feature and target cues were presented simultaneously on compound training trials, the feature appeared to acquire simple excitatory or inhibitory control, which readily transferred to other target cues and which was substantially reduced by post-training counterconditioning. Conversely, when the feature preceded the target during training, the feature's control was relatively more specific to responding in the presence of its original target and less influenced counterconditioning. These results are comparable to outcomes of analogous experiments (previously reported) that used Pavlovian conditioning procedures.     

Schizokinesis: Fragmentation of performance in two strains of pointer dogs

During the behavior shaping toward bar jumping to avoid shock at the termination of a tone, ten genetically nervous (“E”) and ten stable (“A”) dogs showed different performances in the acquisition of the adaptive motor response. When tested two months later and with concurrent monitoring of their electrocardiograms, these animals also showed differences in (1) baseline heart rate, (2) direction and degree of heart rate change to the conditioned tone stimulus (more often deceleration in the E dogs), and (3) response to the unconditioned shock stimulus. After having performed in an almost satisfactory manner for a few trials, thenervous animals often would suddenly freeze in rigid postures. These animals could frequently be made to emit the adaptive behavior by “breaking the frozen posture” through pushing, jumping, or pulling manipulation. Sometimes a forced righting reflex dramatically encouraged an integrated performance of varying duration. Thestable strain of dogs showed little or none of the rigidity and usually learned the smooth adaptive response. The stable A dogs showed retention of the cardiac Cr, but not of the motor Cr (which they re-formed after one or two reenforcements); the nervous E dogs also retained the cardiac Cr, but persisted in the maladaptive motor performance. The fragmented disorganized behavior in acquiring the adaptive motor act and thedifferential retention of the autonomic and motor responses are considered examples ofschizokinesis as conceptualized by Gantt. This schism is seen in clearer form in behavioral acquisition than in the usual frequency measure of the well-practiced act.     

Biological vs experiential factors in phobic conditioning

The present study was performed as a test of phobic conditioning being a case of prepared learning (Seligman, 1971). Skin conductance responses were conditioned in three groups of subjects to either slides of snakes and spiders; electric outlets; or geometric shapes, as conditioned stimuli (CSs) with shock to the forearm as the unconditioned stimulus (UCS). The purpose of the experiment was to compare electrodermal conditioning to potentially phobic CSs, i.e. snakes and spiders, with conditioning to fear-relevant, but non-phobic, CSs, i.e. electric outlets.Each subject saw two pictures, either a snake or a spider; or two different slides of electric outlets; or two different geometric shapes. Only one of the two cues (the CS + ) was immediately followed by the shock-UCS during the acquisition phase. Thus, a differential paradigm was used. There were 4 habituation, 12 acquisition, and 16 extinction trials. The duration of the pictures was 8 sec with an intertrial interval of between 35–45 sec.The results showed reliable effects of conditioning in all three groups during the acquisition phase. Furthermore, a significant interaction during extinction is reported, indicating responses to potentially phobic CSs to be more resistant to extinction than responses to the other two classes of stimuli. It is concluded that the present results favor an interpretation of phobic conditioning in terms of biologically prepared learning.     

Conditioned suppression of an avoidance response by a stimulus paired with food

Three food-deprived Long-Evans rats were exposed to a non-discriminated shock avoidance procedure. Superimposed upon this operant avoidance baseline were periodic presentations of a conditioned stimulus that was paired with food, the unconditioned stimulus. These pairings resulted in increases in the rate of shock over that recorded when the conditioned stimulus was not present. A traditional suppression ratio failed to reveal any differential effect of the conditioned stimulus on the overall rate of avoidance responding, although all subjects showed a consistent pattern of pausing and postshock response bursts during presentations of the conditioned stimulus. When food was withheld during a final extinction phase, the conditioned stimulus ceased to occasion increases in shock rates and disruptive postshock response bursts were eliminated. An analysis of conditioned suppression procedures is proposed that stresses not only operant-Pavlovian or appetitive-aversive incompatibility, but also the manner in which the baseline schedule of reinforcement affects operant behavior changes that are elicited by the superimposed Pavlovian procedure.     

Elicited versus emitted behavior: Time to abandon the distinction

The concept of emitted behavior was formulated as a part of the original argument for the validity of a new kind of learning called operant conditioning. The rationale for operant conditioning contrasted it with Pavlovian or classical conditioning, which was (and remains) fundamentally based on responses to conditioned and unconditioned stimuli. Classical conditioned responses were said to be elicited. In contrast, operant behavior was viewed as emitted and controlled primarily by response consequences rather than antecedents. I argue that the distinction between emitted and elicited behavior is no longer warranted for three major reasons. First, the distinction was based on a view of Pavlovian conditioning that is no longer viable. Second, the distinction is incompatible with both empirical data and contemporary conceptualizations of operant behavior. Third, the only way to overcome these problems is to define emitted and elicited in terms of the type of conditioning (operant and classical) that produces these behaviors, but that approach makes the definitions circular and does not avoid implications of the terms that are misleading and counterproductive in light of contemporary research and thinking.     

The operant and the classical in conditioned orientation of Drosophila melanogaster at the flight simulator

Ever since learning and memory have been studied experimentally, the relationship between operant and classical conditioning has been controversial. Operant conditioning is any form of conditioning that essentially depends on the animal's behavior. It relies on operant behavior. A motor output is called operant if it controls a sensory variable. The Drosophila flight simulator, in which the relevant behavior is a single motor variable (yaw torque), fully separates the operant and classical components of a complex conditioning task. In this paradigm a tethered fly learns, operantly or classically, to prefer and avoid certain flight orientations in relation to the surrounding panorama. Yaw torque is recorded and, in the operant mode, controls the panorama. Using a yoked control, we show that classical pattern learning necessitates more extensive training than operant pattern learning. We compare in detail the microstructure of yaw torque after classical and operant training but find no evidence for acquired behavioral traits after operant conditioning that might explain this difference. We therefore conclude that the operant behavior has a facilitating effect on the classical training. In addition, we show that an operantly learned stimulus is successfully transferred from the behavior of the training to a different behavior. This result unequivocally demonstrates that during operant conditioning classical associations can be formed.     

Instrumental conditioning of blood pressure elevations in the baboon

Two adult male baboons were surgically prepared with arterial catheters which provided a continuous measure of blood pressure and heart rate. Environmental consequences (food and electric shock) were made contingent upon prespecified increases in diastolic blood pressure levels. Continued exposure to these contingencies resulted in substantial increases in both diastolic and systolic pressures. The results demonstrated that blood pressure changes are highly susceptible to both operant“shaping” and stimulus control procedures and extend the range of instrumental conditioning effects upon the cardiovascular system.     

Operant techniques used in stuttering therapy: A review

This article reviews research concerning the use of operant conditioning in stuttering therapy, and discusses the clinical implications of this literature. In order to be considered for this review, a report had to treat the findings of research specifically designed to use operant conditioning in the manipulation of speech disfluency. This body of experimental literature clearly indicates that operant management techniques can effectively reduce stuttering with punishment of disfluencies producing more notable results than reinforcement of fluent responses. Operant conditioning is an effective means of modifying stuttering behavior and should be more visible in terms of procedures used by speech therapists.     

Stimulus control: part I

In his effort to distinguish operant from respondent conditioning, Skinner stressed the lack of an eliciting stimulus and rejected the prevailing stereotype of Pavlovian "stimulus-response" psychology. But control by antecedent stimuli, whether classified as conditional or discriminative, is ubiquitous in the natural setting. With both respondent and operant behavior, symmetrical gradients of generalization along unrelated dimensions may be obtained following differential reinforcement in the presence and the absence of the stimulus. The slopes of these gradients serve as measures of stimulus control, and they can be steepened without applying differential reinforcement to any two points along the test dimension. Increases and decreases in stimulus control occur under the same conditions as those leading to increases and decreases in observing responses, indicating that it is the increasing frequency and duration of observation (and perhaps also of attention) that produces the separation in performances during discrimination learning.     

Effects of reinforcement schedule on facilitation of operant extinction by chlordiazepoxide

Learning and memory are central topics in behavioral neuroscience, and inbred mice strains are widely investigated. However, operant conditioning techniques are not as extensively used in this field as they should be, given the effectiveness of the methodology of the experimental analysis of behavior. In the present study, male C57B1/6 mice, widely used as background for transgenic studies, were trained to lever press on discrete-trial fixed-ratio 5 or fixed-interval (11 s or 31 s) schedules of food reinforcement and then exposed to 15 extinction sessions following vehicle or chlordiazepoxide injections (15 mg/kg i.p., administered either prior to all extinction sessions, or prior to the final 10 extinction sessions). Extinction of operant behavior was facilitated by drug administration following training on either schedule, but this facilitation only occurred once a number of extinction sessions had taken place. The extinction process proceeded more rapidly following fixed-interval training. Resistance to extinction was equally high following training with either schedule type, and was reduced by drug administration in both cases. These phenomena were evident in individual cumulative records and in analyses of group data. Results are interpreted in terms of phenomena of operant extinction identified in Skinner's (1938) Behavior of Organisms, and by behavioral momentum theory. These procedures could be used to extend the contribution of operant conditioning to contemporary behavioral neuroscience.     

Non-differential return of fear in humans after a reinstatement procedure

The present experiment investigated reinstatement of fear in humans using a differential fear conditioning preparation. In this experiment, one neutral stimulus (conditioned stimulus; CS+) was paired with an aversive stimulus (unconditioned stimulus; US) during the acquisition phase, while another neutral stimulus was not (CS−). This procedure led to a difference in responding between the CS+ and the CS− (i.e., differential conditioning). After this acquisition phase, an extinction phase followed, during which both CSs were presented without the US, resulting in a decrease in differential conditioned responding. Reinstatement refers to the return of extinguished conditioned responses due to the experience of US-only trials after the extinction phase. This phenomenon was investigated by presenting half of the participants (reinstatement group) with unpredictable USs after the extinction phase. The control group did not receive these USs after the extinction procedure. The results show that return of fear was clearly apparent after the reinstating USs. This return of fear was, however, not limited to the CS+. An increase in ‘conditioned’ responding was also observed for the control stimulus. This interesting observation will be discussed against the background of a number of recent theoretical conceptualizations of reinstatement.     

The effects of value confrontation and reinforcement counseling on the career planning attitudes and behavior of adolescent males

An experiment was conducted to compare the relative effectiveness of a value confrontation procedure and a procedure based on verbal operant conditioning in enhancing career development attitudes and increasing the frequency of information-seeking behavior in rural adolescent males. Ninety subjects were identified as internally controlled or externally controlled based on their locus of control scores and then randomly assigned to one of the two experimental treatment groups or a control group. The value confrontation procedure involved developing an awareness of self-dissatisfaction about one's career planning and relating this self-dissatisfaction to the importance one gave to the values logical and responsible. These values had been identified empirically in this study as having a relationship to career planning. The reinforcement counseling treatment involved the interpretation of individual career maturity data followed by the verbal operant conditioning of responses indicative of career maturity. Post tests administered 7 weeks after the treatments showed that the value confrontation procedure resulted in significantly greater frequency of information seeking for internally controlled subjects when compared to the reinforcement counseling and control procedures. No treatment was significant in increasing the maturity level of career development attitudes.