The opportunity for aggression as an operant reinforcer during aversive stimulation

Squirrel monkeys were provided with a chain-pulling response which produced an inanimate object that could be attacked. In the absence of pain-shock, little or no chain-pulling occurred. When pain-shocks were delivered, chain-pulling responses increased. The chain-pulling response was successively reinforced, extinguished, reinforced, and again extinguished by presenting or withdrawing the opportunity to attack as the reinforcing event. Aggression appears to be a distinctive motivational state which is produced by aversive stimulation and which can be used to condition and maintain new behavior.     

Aggression as a reinforcer: operant behavior in the mouse-killing rat

Two experiments examined mouse killing as a reinforcer of key pressing by rats that killed mice. In Experiment I, mouse-killing rats performed the key-pressing response when each press was reinforced with presentation of a mouse. Offered a choice between a key that yielded presentation of mice and one that did not, the rats preferred the key that yielded mice. When the contingency was reversed, the rats preferred the other key and continued to kill mice. In Experiment II, mouse-killing rats that did not kill rat pups performed a key-pressing response reinforced with presentation of mice on a variable-interval schedule. In tests for responding reinforced on that schedule with presentation of normal mice, anesthetized mice, dead mice, or rat pups, these rats that killed mice but not rat pups exhibited a decline in response rate when rat pups were the reinforcer. Altering the condition of the mice did not significantly affect performance.     

Feedback to attendants as a reinforcer for applying operant techniques

After varying lengths of baseline, initiation of a feedback system increased the daily use of operant training methods by non-professional hall personnel in a state institution for retarded children.     

Response-shock delay as a reinforcer in avoidance behavior

After rats received preliminary training to avoid shock on a discrete-trial retractable-bar avoidance procedure, the procedure was changed such that responses retracted the lever but did not affect the rate of shock. Responses only delayed the onset of shock. About half of the animals under these procedures responded consistently on almost 100% of the discrete-trial cycles over days. When short latencies maximized the response-shock delay, animals tended to make short-latency responses. When long latencies maximized the response-shock delay, animals tended to make long-latency responses. When all response latencies produced the same response-shock delay, animals made differing average-latency responses. And, when responses did not delay shock, most of the animals primarily engaged in shock-elicited responding while the other animals engaged in preshock responding.     

A brief opportunity to run does not function as a reinforcer for mice selected for high daily wheel-running rates

Mice from replicate lines, selectively bred based on high daily wheel-running rates, run more total revolutions and at higher average speeds than do mice from nonselected control lines. Based on this difference it was assumed that selected mice would find the opportunity to run in a wheel a more efficacious consequence. To assess this assumption within an operant paradigm, mice must be trained to make a response to produce the opportunity to run as a consequence. In the present study an autoshaping procedure was used to compare the acquisition of lever pressing reinforced by the opportunity to run for a brief opportunity (i.e., 90 s) between selected and control mice and then, using an operant procedure, the effect of the duration of the opportunity to run on lever pressing was assessed by varying reinforcer duration over values of 90 s, 30 min, and 90 s. The reinforcement schedule was a ratio schedule (FR 1 or VR 3). Results from the autoshaping phase showed that more control mice met a criterion of responses on 50% of trials. During the operant phase, when reinforcer duration was 90 s, almost all control, but few selected mice completed a session of 20 reinforcers; however, when reinforcer duration was increased to 30 min almost all selected and control mice completed a session of 20 reinforcers. Taken together, these results suggest that selective breeding based on wheel-running rates over 24 hr may have altered the motivational system in a way that reduces the reinforcing value of shorter running durations. The implications of this finding for these mice as a model for attention deficit hyperactivity disorder (ADHD) are discussed. It also is proposed that there may be an inherent trade-off in the motivational system for activities of short versus long duration.     

Free-time as a reinforcer in the management of classroom behavior

Six subjects, comprising one class at a school for the deaf, were given reinforcement consisting of time free from school work for remaining seated in the classroom. As a result, the frequency of leaving their chairs was sharply reduced. A second procedure presented free-time not contingent on remaining seated. Little change was seen in the already lowered response rate. An extension of the time required to be seated with corresponding reduction in the number of daily free-time periods did not reduce the effectiveness of the procedure. A one-day observation after six weeks indicated that the procedure was still effective. A one-day contingency reversal, requiring subjects to leave their chairs at least once during each seated period in order to receive free-time, substantially raised the frequency of out-of-seat responses.     

Use of therapy time as a reinforcer: application of operant conditioning techniques within a traditional psychotherapy context

In operant conditioning, behavior is controlled by explicitly and systematically arranging the consequences of a specified response. This preliminary report describes the use of operant conditioning techniques utilizing a novel reinforcer—time allowed in therapy—to reinstate desirable study habits in a neurotic woman undergoing individual psychotherapy.     

The lickometer: A simple device for the analysis of licking as an operant

A lickometer for recording dry (unreinforced) tube licking in rats is described. As opposed to the conventional drinkometer, where each lick produces fluid, the lickometer provides the possibility for automatically programmed intermittent reinforcement of (dry) licking, and it does not involve electrical connections through the chamber floor. Comparison of licking and leverpressing with equivalent reinforcers and under equivalent schedules of reinforcement is thus feasible.     

Derived relational responding as generalized operant behavior

The major aim of the present study was to demonstrate that derived relational responding may be viewed as a form of generalized operant behavior. In Experiment 1, 4 subjects were divided into two conditions (2 in each condition). Using a two-comparison matching-to-sample procedure, all subjects were trained and tested for the formation of two combinatorially entailed relations. Subjects were trained and tested across multiple stimulus sets. Each set was composed of novel stimuli. Both Conditions 1 and 2 involved explicit performance-contingent feedback presented at the end of each block of test trials (i.e., delayed feedback). In Condition 1, feedback was accurate (consistent with the experimenter-designated relations) following exposure to the initial stimulus sets. When subjects' responding reached a predefined mastery criterion, the feedback then switched to inaccurate (not consistent with the experimenter-designated relations) until responding once again reached a predefined criterion. Condition 2 was similar to Condition 1, except that exposure to the initial stimulus sets was followed by inaccurate feedback and once the criterion was reached feedback switched to accurate. Once relational responding emerged and stabilized, response patterns on novel stimulus sets were controlled by the feedback delivered for previous stimulus sets. Experiment 2 replicated Experiment 1, except that during Conditions 3 and 4 four comparison stimuli were employed during training and testing. Experiment 3 was similar to Condition 1 of Experiment 1, except that after the mastery criterion was reached for class-consistent responding, feedback alternated from accurate to inaccurate across each successive stimulus set. Experiment 4 involved two types of feedback, one type following tests for mutual entailment and the other type following tests for combinatorial entailment. Results from this experiment demonstrated that mutual and combinatorial entailment may be controlled independently by accurate and inaccurate feedback. Overall, the data support the suggestion, made by relational frame theory, that derived relational responding is a form of generalized operant behavior.     

ELOPTA: A novel microcontroller-based operant device

Operant devices have been used for many years in animal behavior research, yet such devices a regenerally highly specialized and quite expensive. Although commercial models are somewhat adaptable and resilient, they are also extremely expensive and are controlled by difficult to learn proprietary software. As an alternative to commercial devices, we have designed and produced a fully functional, programmable operant device, using a PICmicro microcontroller (Microchip Technology, Inc.). The electronic operant testing apparatus (ELOPTA) is designed to deliver food when a study animal, in this case a bird, successfully depresses the correct sequence of illuminated keys. The device logs each keypress and can detect and log whenever a test animal i spositioned at the device. Data can be easily transferred to a computer and imported into any statistical analysis software. At about 3% the cost of a commercial device, ELOPTA will advance behavioral sciences, including behavioral ecology, animal learning and cognition, and ethology.     

Behavioral similarity as a reinforcer for preschool children

Three experiments evaluated whether behavioral similarity provided by an adult could serve as a reinforcer for the modelling behavior of four preschoolers. In each experiment, sessions consisted of two kinds of trials: (1) experimenter-modelled trials, when the child's imitation of modelled motor responses was reinforced with praise and tokens, and (2) child-modelled trials when experimenter imitation of child-modelled responses was contingent upon the child's modelling one of three alternative responses: operation of a ball, horn, or clicker. Experiment I showed that the children consistently modelled whichever responses the experimenter imitated. Experiment II determined whether that performance was due to differences in the amount of experimenter behavior following imitated versus nonimitated child models or to experimenter imitation. Neither reducing nor increasing the amount of experimenter behavior following the children's nonimitated models altered their modelling of imitated responses. Experiment III evaluated whether experimenter imitation of child models was a reinforcer because the child's imitative responses were reinforced on experimenter-modelled trials. In Experiment III, the children's nonimitation of experimenter-models was reinforced with praise and tokens on a schedule of differential reinforcement of other behavior, yet they continued to model experimenter-imitated responses on child-modelled trials. These results indicate behavioral similarity was reinforcing, though no conditioning history through which it acquired that function was demonstrated.     

A computer-oriented system for high-speed recording of operant behavior

A method is described by which large quantities of data, generated at high and variable rates from a large number of test boxes, are recorded on a single eight-channel punched paper tape. The data, which include a record of the occurrence time of each event in 1/10-sec units, are in a compact form, suitable for conversion to standard Hollerith punched card codes and for decoding and summarizing by a large digital computer. Experience with the system has demonstrated a high degree of accuracy and reliability, and low operating cost.