Alternative response training, differential reinforcement of other behavior, and extinction in squirrel monkeys (Saimiri sciureus)

In Experiment I, (a) extinction, (b) extinction plus reinforcement of a discrete alternative response, and (c) differential reinforcement of other behavior were each correlated with a different stimulus in a three-component multiple schedule. The alternative-response procedure more rapidly and completely suppressed behavior than did differential reinforcement of other behavior. Differential reinforcement of other behavior was slightly more effective than extinction alone. In Experiment II, reinforcement of specific alternative behavior during extinction and differential reinforcement of other behavior were used in two components, while one component continued to provide reinforcement for the original response. Once again, the alternative-response procedure was most effective in reducing responding as long as it remained in effect. However, the responding partially recovered when reinforcement for competing behavior was discontinued. In general, responding was less readily reduced by differential reinforcement of other behavior than by the specific alternative-response procedure.     

Reinforcement and instructions with mental patients

An attempt was made to modify a socially desirable response of mental patients. It was found that instructions to the patients had no enduring effect unless accompanied by reinforcement. Also, it was found that reinforcement was not effective unless the reinforcement procedure was accompanied by instructions that specified the basis for the reinforcement. Maximum change in behavior was obtained when the reinforcement procedure took advantage of the existing verbal repertoire of the patients. A significant methodological finding was that substantial modification of the behavior of psychotics could be achieved by briefly delaying, rather than withholding, food reinforcement.     

The instrumental overshadowing effect in pigeons: The role of response bursts

Experiment 1 showed that, when reinforcement is delayed by 0.5 sec for pigeons responding on a variable interval schedule, bursts of responses tend to occur during the delay interval. Such bursts are not seen when a signal (illumination of the houselight) fills the delay interval. The higher overall response rate seen with the unsignalled procedure may, therefore, be a consequence of the differential reinforcement of response bursts. Experiment 2 found, however, that the difference between the signalled and unsignalled conditions remained when the signal used was one that was relatively ineffective in suppressing bursts. Experiment 3 found that in some conditions the unsignalled procedure will generate a higher response rate than the signalled procedure even when there is no delay of reinforcement and thus little opportunity for differential reinforcement of response bursts. It is argued that, in addition to any contribution from the differential reinforcement of bursts, these effects also reflect the overshadowing of a response—reinforcer association by the signal that is a more valid predictor of the reinforcer.     

Frequency versus magnitude of reinforcement: New data with a different procedure

Two pigeons, with previous exposure to concurrent schedules, were submitted to 29 sessions of 8 hours each with concurrent variable-interval variable-interval schedules in which reinforcement parameters changed from session to session. In the first nine sessions reinforcement durations were equal in both schedules while reinforcement frequencies varied; in Sessions 10 through 18, both frequency and duration of reinforcement were varied; in Sessions 19 through 29, only reinforcement duration was varied. Results with this different procedure confirm previous findings that behavior is more sensitive to changes in reinforcement frequency than to reinforcement magnitude.     

Continuous, fixed-ratio, and fixed-interval reinforcement in honey bees

Bees learned to enter a Plexiglas tube and to suck small portions of sugar solution; every entry or every fifth entry was reinforced. During an extinction phase, the bees on the fixed-ratio schedule emitted twice as many responses as did those given continuous reinforcement. Bees on a fixed-interval schedule of reinforcement emitted lower response rates than did those given fixed-ratio reinforcement. By extending the conditioning procedure for several days, it was possible to maintain responding with fixed-ratio schedules requiring 30 responses per reinforcement and with fixed-interval values up to 90 sec. Under fixed-interval schedules, response rates did not increase toward the end of the reinforcement intervals.     

Control over response number by a targeted percentile schedule: reinforcement loss and the acute effects of d-amphetamine.

Two fixed-consecutive-number-like procedures were used to examine effects of acute d-amphetamine administration on control over response number. In both procedures, rats were required to press the left lever at least once and then press the right lever to complete a trial. The consecutive left-lever presses on each trial comprised a "run." Under the targeted percentile schedule, reinforcement was provided if the current run length was closer to the target length (16) than half of the most recent 24 runs. This differentially reinforced run length while holding reinforcement probability constant at .5. A second group acquired the differentiation under the targeted percentile schedule, but were then shifted to a procedure that yoked reinforcement probability by subject and run length to that obtained under the targeted percentile schedule. The two procedures generated practically identical control run lengths, response rates, reinforcement probabilities, and reinforcement rates. Administration of d-amphetamine disrupted percentile responding to a greater degree than yoked control responding. This disruption decreased reinforcement frequency less in the former than the latter procedure. The similar baseline responding under these two procedures suggests that this difference in sensitivity was due to behavioral adjustments to drug prompted by reduction of reinforcement density in the yoked control but not the percentile schedule. These adjustments attenuate the drug's effects under the former, but not the latter, procedure.     

Within-session delay-of-reinforcement gradients

Within-session delay-of-reinforcement gradients were generated with pigeons by progressively increasing delays to reinforcement within each session. In Experiment 1, the effects of imposing progressive delays on variable-interval and fixed-interval schedules were investigated while controlling for simultaneous decreases in reinforcer rate across the session via a within-subject yoked-control procedure. Rate of key pecking decreased as a negatively decelerated function of delay of reinforcement within a session. These rate decreases were greater than those during a yoked-interval session in which the rate of immediate reinforcement decreased at the same rate as it did under the progressive-delay procedure. In Experiment 2, delay-of-reinforcement gradients were shallower when the progressive delay intervals were signaled by a blackout than when they were unsignaled. The delay gradients obtained in each experiment were similar to those generated under conditions in which different delays of reinforcement are imposed across blocks of sessions. The present procedure offers a technique for rapidly generating delay-of-reinforcement gradients that might serve as baselines for assessing the effects of other behavioral and pharmacological variables.     

The role of information in the emission of observing responses: a test of two hypotheses

Pigeons were trained on a trial procedure in a Skinner box. Each trial began with a fixed-interval schedule. Responding on this schedule produced a stimulus and a delayed trial outcome. The stimulus signalled whether the forthcoming outcome was reinforcement or nonreinforcement. Thus, the response was an observing response. When reinforcement was the outcome on 20% of the trials, response rates in the fixed interval were higher than when reinforcement was the outcome on 80% of the trials. This result is consistent with the hypothesis that observing responses are reinforced by the information associated with the stimulus signalling reinforcement. The result seems inconsistent with the hypothesis that observing responses are also reinforced by the information associated with the stimulus signalling nonreinforcement.     

The effects of unsignalled delayed reinforcement

Pigeons' pecks were reinforced according to a variable-interval schedule. A delay-of-reinforcement procedure was then added to the schedule, or a yoked-control procedure was arranged where the reinforcers occurred independently of responding according to the same variable-interval schedule. During the delay-of-reinforcement procedure, the first peck after a reinforcer was scheduled began a delay timer and the reinforcer was delivered at the end of the interval. No stimulus change signalled the delay interval and responses could occur during it, so that the obtained delays were often shorter than those scheduled. Responding under this procedure was highly variable but, in general, behavior was substantially reduced even with the shortest delay used, 3 sec. In addition, the rates maintained by delayed reinforcement were only slightly greater than those maintained by the yoked-control procedure, suggesting that adventitious pairings of response and reinforcer were responsible for some of the maintenance of behavior that did occur. The results challenge recent conceptions of reinforcement as involving response-reinforcer correlations and re-emphasize the role of temporal proximity between response and reinforcer.     

INCREASING SPELLING ACHIEVEMENT: AN ANALYSIS OF TREATMENT PROCEDURES UTILIZING AN ALTERNATING TREATMENTS DESIGN

Two studies which examine the effectiveness of spelling remediation procedures are reported. In both studies, an alternating treatment design was employed. In the first study, positive practice overcorrection plus positive reinforcement was compared to positive practice alone and a no-remediation control condition. In the second study, positive practice plus positive reinforcement was compared to a traditional corrective procedure plus positive reinforcement and a traditional procedure when used alone. Results of both studies indicated that the combined positive practice plus positive reinforcement procedure was more efficient and that it was preferred by the children. Following brief training under this combined procedure, all children demonstrated 100% spelling accuracy.     

A direct comparison of four methods for eliminating a response

Thirty-two rats pressed one lever (lever A) on a VI 30-sec schedule of food reinforcement and were then shifted to one of four procedures for eliminating the lever A response: extinction, differential reinforcement of other behavior, reinforcement of a different response (pole pushing), and reinforcement of a similar response (pressing lever B). Effectiveness of a response-elimination procedure was measured by (1) how quickly lever A response rate fell to a low level when the procedure was in effect, (2) how much lever A responding recovered when the procedure was discontinued, and (3) how resistant lever A responding was to reinstatement when the VI reinforcement schedule was reimposed. No one method was superior by all three measures. Extinction produced the most variable behavior, while differential reinforcement of other behavior produced the least. Reinforcing alternative behavior produced the greatest recovery in the original lever A response when the response-elimination procedure was discontinued.     

Further analysis of modifications to the three-step guided compliance procedure to enhance compliance among children with autism

Three-step guided compliance (vocal prompt, vocal plus model prompt, vocal prompt plus physical guidance) is a commonly used procedure to increase compliance among children with intellectual disabilities. Previous research has suggested that under some conditions, slight modifications to the three-step procedure may enhance its effectiveness. These modifications include omitting the model prompt and decreasing the interprompt interval. In the current study, we evaluated another modification to the procedure: the delivery of a high-preference item contingent upon compliance with the first vocal prompt (i.e., differential reinforcement). For 2 participants with autism, compliance remained low when we implemented differential reinforcement and the guided compliance procedure in isolation. However, compliance improved when we combined differential reinforcement and the three-step guided procedure, suggesting that for at least some children, the combination of contingent access to a high-preference item and the guided compliance procedure is more effective than either intervention alone.     

Reinforcement omission on temporal go-no-go schedules

Either a partial blackout, or the blackout plus a “feeder flash”, occurred in lieu of reinforcement on two procedures that produced opposite patterns of responding after reinforcement. Response rate was elevated after reinforcement omission on the procedure that produced a “pause-and-respond” pattern following reinforcement, but depressed after reinforcement omission on the procedure that produced a “respond-and-pause” pattern. The effect of blackout plus feeder flash was generally intermediate between the effects of blackout and the effects of reinforcement. These results are consistent with an interpretation of reinforcement omission effects in terms of the discriminative temporal control exerted by reinforcement and stimuli similar to it.     

The effects of reinforcement and social approval on conforming behaviour

The effects of reinforcement, social approval and sex on conformity were studied. Seventy-two male and 72 female college Ss were divided into equal high and low need for social approval groups. Each group was assigned to 1 of 3 experimental conformity conditions: (a) True-agree; (b) neutral; and (c) true-disagree. The groups were tested via a social conformity apparatus. It was found that: (a) Reinforcement for agreeing with a contrived group consensus (true-agree group) elicited more conformity than social pressure without reinforcement (neutral group), which in turn elicted more conformity than reinforcement for disagreeing with the consensus (trueA- disagree group); (b) females conformed more than males; (c) there was a slight tendency for high social approval Ss to conform more than low social approval Ss. Conformity was explained in terms of social learning, and it was suggested that the situational factor of reinforcement was a more important determinant of conformity than the motivational factor of social approval. The modified conformity scoring procedure used focuses on the conformity process.     

Yoked variable-ratio and variable-interval responding in pigeons

Pigeons' key pecks were maintained by variable-ratio or variable-interval schedules of food reinforcement. For pairs of pigeons in one group, variable-ratio reinforcement was arranged for one pigeon's pecks; for the second pigeon, reinforcement was arranged according to a variable-interval schedule yoked to the interreinforcement times produced by the first pigeon. For pairs of pigeons in another group, variable-interval reinforcement was arranged for one pigeon's pecks; for the second pigeon, reinforcement was arranged according to a variable-ratio schedule yoked to the interreinforcement responses produced by the first pigeon. For each pair, the yoking procedure was maintained for four or five consecutive sessions of 50 reinforcements each. In more than three-quarters of the pairs, variable-ratio response rates were higher than variable-interval rates within two sessions; in all cases, the rate difference developed within four sessions.     

Stimulus control and response bias in an analogue prey-detection procedure

The present study compared the performance of 6 pigeons trained to detect luminance differences in two different signal-detection procedures. Exposed to a three-key array, the pigeons were trained to peck the left key when the brighter of two light intensities had been presented on the center key and to peck the right key when the dimmer of two light intensities had been presented on the center key. Procedure A was a standard signal-detection procedure in which left/bright and right/dim responses produced food reinforcement and left/dim and right/bright responses produced periods of timeout. Procedure B was designed to simulate some of the contingencies operating in a prey-detection situation. Left-key responses produced reinforcement following the brighter center-key stimulus and a period of timeout following the dimmer center-key stimulus. Right-key responses always produced a short period of timeout irrespective of the stimulus. Within each procedure, the duration of timeout arranged for false alarms (left/dim responses) was varied between 3 s and 120 s. Measures of accuracy and response bias were compared between the two procedures. The timeout manipulation produced systematic, but relatively small, changes in these measures when right/dim responses (i.e., correct rejections) produced reinforcement (Procedure A). Arranging timeout for right/dim responses in Procedure B produced greater variability in accuracy and response bias than did arranging reinforcement, but this variability was not related to timeout duration. Overall, discrimination accuracy was considerably higher when right/dim responses produced timeout than when they resulted in reinforcement, and accuracy was accompanied by a large bias toward the response associated with reinforcement. These results are consistent with a recently proposed model of signal detection.     

Discriminative properties of shock-correlated reinforcement in an operant context

A two-choice discrete operant procedure was devised for the study of shock-correlated reinforcement effects in rats. In the presence of one auditory stimulus, responding on one response lever was reinforced with food; with another auditory stimulus, responding on a second lever was reinforced. It was found that discrimination performance of one group, relative to appropriate control groups, was facilitated when electric shock was correlated with reinforcement on one lever and not on the other. Further, relative discrimination levels were found to be higher on the lever correlated with the shock than on the alternate lever. The significance of the results for operant within-S studies and for a mediational theory of shock-correlated reinforcement was discussed.     

Increased communications of chronic mental patients by reinforcement and by response priming

An attempt was made to increase the frequency with which chronic schizophrenic patients suggested feasible improvements in their treatment. A response priming procedure was devised that was comparable to a previously developed reinforcer exposure procedure. The patients were required to attend a structured meeting during which they were prompted to make suggestions. This priming procedure was compared with the more usual procedure of "welcoming" attendance and suggestions. It was found that more suggestions were made when attendance was required, rather than optional. This increase occurred during a group as well as a private meeting. An attempt was then made to analyze the probable reinforcer for the suggestions by experimentally varying the percentage of suggestions followed. Different staff members served as the discriminative stimuli within a multiple schedule. It was found that the number of suggestions was a direct function of the percentage followed. These results demonstrate the effectiveness of the priming procedure as an adjunct to reinforcement procedures for increasing desired behaviors of mental patients. Few suggestions were made when reinforcement or priming were used alone.     

A titration procedure for generating escape behavior

In a grid-shock escape paradigm using time-out as reinforcement, both fixed-ratio and variable-interval performances were established directly from a continuous reinforcement schedule with rats and guinea pigs. A procedure was developed that employed a stepwise decrease in reinforcement time for all responses except the terminal response. Acquisition and long-term maintenance data were obtained from Ss trained on this titrated negative-reinforcement procedure.     

The delay-reduction hypothesis: Effects of informative events on response rates and choice

The present study replicated a prior one by Pearce and Collins (1985) in which informative events displayed greater reinforcing strength than did uninformative ones despite higher rates of reinforcement on the uninformative alternative, both in a choice test and in a test that presented the events successively. The delay-reduction hypothesis of choice and conditioned reinforcement is consistent with results from the successive test but cannot account for the choice results. As the original study conducted the choice test following the successive test for all subjects, and as no reversals of the choice procedure were carried out, the present study replicated Pearce and Collins (1985) while controlling for order effects. Pigeons' relative rate of responding on the informative side was significantly greater in the successive procedure than in the choice procedure (as in the prior study); however, the uninformative side was significantly preferred to the informative side in the choice procedure when order of exposure to the two types of procedures was controlled. Both findings are consistent with the delay-reduction hypothesis.