Signaled alternative reinforcement and the persistence of operant behavior

Differential reinforcement of alternative behavior (DRA) is a treatment designed to eliminate problem behavior by reinforcing an alternative behavior at a higher rate. Availability of alternative reinforcement may be signaled, as with Functional Communication Training, or unsignaled. Whether or not alternative reinforcement is signaled could influence both the rate and persistence of problem behavior. The present study investigated whether signaling the availability of alternative reinforcement affects the rate and persistence of a concurrently available target response with pigeons. Three components of a multiple concurrent schedule arranged equal reinforcement rates for target responding. Two of the components also arranged equal reinforcement rates for an alternative response. In one DRA component, a discrete stimulus signaled the availability of response‐contingent alternative reinforcement by changing the keylight color upon reinforcement availability. In the other DRA component, availability of alternative reinforcement was not signaled. Target responding was most persistent in the unsignaled DRA component when disrupted by satiation, free food presented between components, and extinction, relative to the signaled DRA and control components. These findings suggest the discrete stimulus functionally separated the availability of alternative reinforcement from the discriminative stimuli governing target responding. These findings provide a novel avenue to explore in translational research assessing whether signaling the availability of alternative reinforcement with DRA treatments reduces the persistence of problem behavior.     

Social reinforcement of operant behavior in rats: a methodological note.

An apparatus was developed to study social reinforcement in the rat. Four Long-Evans female rats were trained to press a lever via shaping, with the reinforcer being access to a castrated male rat. Responding under a fixed-ratio schedule and in extinction was also observed. Social access was found to be an effective reinforcer. When social reinforcement was compared with food reinforcement under similar conditions of deprivation and reinforcer duration, no significant differences were observed.     

CORE: Computer-controlled operant reinforcement

A Pascal-based system and software is described for computer reinforcement of operant responding (CORE). CORE allows a single microcomputer to control up to eight different work stations simultaneously, on one of several schedules. The user need not be familiar with Pascal, although modifications of the programs require a good working knowledge. The system is menu-driven and interacts with the user in a question-and-answer format. The user can select a variety of experimental parameters, for example, session and reinforcement duration, delay, and type of reinforcement schedule. During run-time, CORE provides frequently updated on-screen graphics (Cumulative Records or Interresponse Time Distributions) and counter display. Permanently stored data and information from other counters may also be displayed or printed from the disk. Presently, three programs are implemented for a variety of related reinforcement schedules (e.g., fixed ratio, variable ratio, fixed interval, variable interval, alternation).     

Effects of instructions and reinforcement-feedback on human operant behavior maintained by fixed-interval reinforcement

In three experiments, human subjects were trained on a five-component multiple schedule with different fixed intervals of monetary reinforcement scheduled in the different components. Subjects uninstructed about the fixed-interval schedules manifested high and generally equivalent rates regardless of the particular component. By comparison, subjects given instructions about the schedules showed orderly progressions of rates and temporal patterning as a function of the interreinforcement intervals, particularly when feedback about reinforcement was delivered but also when reinforcement-feedback was withheld. Administration of the instructions-reinforcement combination to subjects who had already developed poorly differentiated behavior, however, did not make their behavior substantially better differentiated. When cost was imposed for responding, both instructed and uninstructed subjects showed low and differentiated rates regardless of their prior histories. It was concluded that instructions can have major influences on the establishment and maintenance of human operant behavior.     

Intermittent reinforcement in behaviour therapy

It is suggested that intermittent reinforcement may be of value in retarding the tendency towards relapse in aversion therapy. An experiment with rats was conducted to examine the effects of intermittent shocks in approach-avoidance conflict learning. Intermittent reinforcement was shown to produce marked resistance to extinction in this type of avoidance learning. In a field-investigation of conditioning treatment of enuresis, intermittent reinforcement was found not to retard acquisition unduly and to give promise of reducing the relapse rate. A longer follow-up period is required to permit a final evaluation of the procedure.     

Up or down: the influence of upcoming reinforcement on consummatory and operant behavior

Research has shown that animal subjects that are given a chance to consume a low-valued substance will consume less of it if a high-valued substance will soon be available than they would if the low-valued substance were to remain available (negative consummatory contrast). Research has also shown that subjects that lever press for a low-valued reinforcer will press the lever more often for that reinforcer if they will soon be able to lever press for a high-valued reinforcer than they would if they continue to press for the low-valued reinforcer (positive induction). The present study investigated these different changes in behavior across 3 experiments. The results suggest that the occurrence of contrast or induction does not depend on the type of substances that are used. We argue that further investigation of the contrast vs. induction issue is warranted because it has empirical, theoretical, and applied implications.     

Extraversion and reinforcement in verbal operant conditioning.

The present investigation was designed to study the relationship between extraversion and modes of reinforcement in verbal operant conditioning. A 4 X 3 randomized block design was replicated ten times. Eighty graduate and post-graduate male students were individually subjected to the standard Taffel conditioning procedure. When the numbers of conditioned responses produced by introverts and extraverts were compared, it was found that: (1) under negative reinforcement ('bad' and electric shock), with both the female and male experimenters, and under positive reinforcement ('good') with the male experimenter, the introverts' score was the higher of the two; (2) under positive reinforcement ('good') with the female experimenter, the extraverts' score was higher than that of the introverts.     

Discriminative properties of shock-correlated reinforcement in an operant context

A two-choice discrete operant procedure was devised for the study of shock-correlated reinforcement effects in rats. In the presence of one auditory stimulus, responding on one response lever was reinforced with food; with another auditory stimulus, responding on a second lever was reinforced. It was found that discrimination performance of one group, relative to appropriate control groups, was facilitated when electric shock was correlated with reinforcement on one lever and not on the other. Further, relative discrimination levels were found to be higher on the lever correlated with the shock than on the alternate lever. The significance of the results for operant within-S studies and for a mediational theory of shock-correlated reinforcement was discussed.     

Intermittent reinforcement of a continuous response

Konorski showed that when a go/no-go procedure was used, sound quality discriminations were rapidly acquired and sound location discriminations were slowly acquired. These findings have been interpreted as a general constraint on the acquisition of auditory discriminations (quality-location effect). However, experiments carried out within an evolutionary framework (Harrison, 1984) have shown that the rate of acquisition of sound location discriminations varies widely as a function of the inclusion or exclusion of naturalistic features. These data suggest that Konorski's findings were a function of the special conditions of the experiments. The first purpose of the present experiments was to assess whether rats showed the effects noted by Konorski when studied under similar conditions. The second purpose was to study the effect of manipulating two natural features (novelty and stimulus-response adjacency) to assess whether the acquisition rates of quality and location discriminations could be greatly modified or made approximately equal, or both. When a go/no-go procedure was used and the other conditions were similar to those of Konorski, rats acquired a quality discrimination but did not acquire a location discrimination. However, when the S+ or S- were presented through a closely adjacent speaker, the sound location discrimination was acquired as rapidly as the quality discrimination. Finally, preexposing the animal to either S+ or S- retarded the rate of or prevented the acquisition of the quality discrimination. The experiments showed that the quality-location effect was determined primarily by the conditions used in Konorski's experiments, and that the effect is not a general constraint on learning.     

Investigations of operant ABA renewal during differential reinforcement

Operant renewal is a form of relapse in which a previously extinguished response recurs due to a change in context. We designed two experiments to examine the impact of differential reinforcement of alternative behavior on ABA renewal in a translational model of relapse with 12 children. We compared levels of renewal in two 3-phase arrangements. In one arrangement, we reinforced target responding in Context A, extinguished responding in Context B, and returned to Context A while continuing to implement extinction. In a second arrangement, an alternative response produced reinforcement in Context B and during the return to Context A. Results across the 2 experiments indicated 3 general findings. First, extinction plus differential reinforcement disrupted target behavior more consistently in Context B relative to extinction alone. Second, renewal tended to be greater and more persistent during extinction alone relative to extinction plus differential reinforcement. Third, the renewal effect appeared to depend on whether the alternative response had a history of extinction in Context A. We discuss methodological implications for the treatment of severe destructive behavior.     

Intermittent reinforcement of an interresponse time

Rats were exposed to schedules in which reinforcement was contingent upon the emission of a 1.0- to 2.0-sec interresponse time. The rate of emission and the temporal distribution of this interresponse time was recorded. Several different contingencies between the emission of the interresponse time and reinforcement were examined. Both the rate of emission and the temporal distribution of the 1.0- to 2.0-sec interresponse time varied as a function of the schedule on which it was reinforced. This finding, which suggests that an interresponse time behaves as other operants, has implications for the analysis of conventional reinforcement schedules in terms of the differential reinforcement of interresponse times.     

Impulsivity/sociability and reinforcement in verbal operant conditioning

The present investigation was designed to study the relationship between impulsivity/sociability and modes of reinforcement in verbal operant conditioning. Two 2x3 randomized block designs, one each for impulsivity and sociability, were replicated ten times. One hundred and twenty undergraduate female students (60 for impulsivity and 60 for sociability) were individually subjected to Taffel's verbal conditioning procedure. When the conditioning scores of high and low scorers on the impulsivity and sociability scales were compared, it was found that under rewarding conditions ('good' and 'buzzer' in respect of sociability and 'good' in respect of impulsivity) the high scorers' score and under punishing conditions ('electric shock') the low scorers' score was the higher of the two. The study also revealed that the high scorers (on the impulsivity scale) conditioned more under rewarding conditions while the low scorers (both on the impulsivity and sociability scales) conditioned more under punishing ones.     

Instructions and reinforcement in the observing behavior of adults and children

Observing responses of college students and children of different ages (4 to 5, 9 to 10, and 13 to 14 years) were studied using two-component schedules of reinforcement. Different frequencies or numbers of points were given in the components and points were backed by either money or instructions about getting points (e.g., “points are for the experimenter's information only”). Stimuli that were either correlated or uncorrelated with the components were contingent on presses on either of two concurrently available levers (observing responses). In each of three experiments, preferences for stimuli were consistent with the conditioned-reinforcement hypothesis of observing but inconsistent with the uncertainty-reduction hypothesis. Stimulus preferences were established, eliminated, or reversed by instructions about the significance of getting points not backed with money. Instructions to in effect ignore points with no monetary value eliminated stimulus preference provided that money was not associated with points in other conditions for the same subjects. Stimulus preferences were otherwise independent of monetary point value. Instructions that described reinforcement contingencies promoted more rapid adjustment to the contingencies than occurred without them, and preferences were less variable across sessions within subjects and were on the average more extreme. Although some results involving absolute rates of observing depended upon the age of subjects, stimulus preferences did not. The data suggest that the conditioned-reinforcement hypothesis of observing has considerable generality for humans in choice procedures in the laboratory. That monetary value of points did not affect preferences in a graded fashion is consistent with versions of the conditioned-reinforcement hypothesis which emphasize reduction in delay to reinforcement over other reinforcement parameters.     

Human operant learning under concurrent reinforcement of response variability

This study asked whether the concurrent reinforcement of behavioral variability facilitates learning to emit a difficult target response. Sixty students repeatedly pressed sequences of keys, with an originally infrequently occurring target sequence consistently being followed by positive feedback. Three conditions differed in the feedback given to non-target sequences: concurrent positive feedback presented contingent on response variability, positive feedback presented non-contingently, or no reinforcement for any non-target responses (control condition). Contrary to the result of analogous rat studies, if anything, the participants in the control condition more readily learned to emit the target sequence than did the subjects in each of the other two conditions. It is argued that these contradictory findings are primarily caused by procedural differences, such as differences in the density of the reinforcement schedule applied to non-target behavior, rather than reflecting a true species difference.