Sustained responding under intermittent reinforcement in psychotic children

A procedure is described that classifies abnormal children with respect to their capacity to sustain adaptive responding without consistent, extrinsic reinforcement. The procedure was used to assess individual differences in tolerance for intermittent reinforcement among a group of 21 psychotic children. The procedure was found to correlate with three variables established by previous research to be important prognostically-i.e., measures of intelligence, social competence, and language functioning. Findings are discussed with respect to the construct of motivation as distinguished from the construct of ability. It is suggested that whether or not the experimental measure is regarded as relevant to the global construct of motivation, it has clear relevance to potential deficits in the important capacity to sustain adaptive responding.Funding for this study and for the development of the computer-operated laboratory was provided by the USOE, Bureau of Education for the Handicapped, as a portion of Grant Number C007604305, Sensory discrimination, Generalization and Language Training of Autistic Children, awarded to R. L. Blanton and C. W. Deckner. Appreciation is expressed to S. A. Soraci, Jr., and A. A. Baumeister for valuable suggestions regarding this study.     

Variability of response location on fixed-ratio and fixed-interval schedules of reinforcement

Variability of response location was studied in monkeys performing in a six-lever chamber. Fixed-ratio schedules, ranging from FR 1 to FR 300, generated a high degree of stereotypy of response location. In contrast, fixed-interval schedules of comparable reinforcement frequencies (0.06 to 4 minutes) generated much greater variability. These results failed to confirm any simple relationship between response variability and intermittence of reinforcement. Rather, variability seems to be determined by the particular characteristics of the reinforcement schedule.     

Early extinction effects following intermittent reinforcement: Little evidence of extinction bursts

The occurrence of extinction bursts—transient increases in response rate in excess of those observed in baseline during the period immediately following discontinuation of reinforcement of a response—was examined. In Experiment 1, key pecking of pigeons was reinforced according to a multiple schedule in which a variable-ratio schedule alternated with an interval schedule in which the reinforcers were yoked to the preceding variable-ratio component. In Experiments 2 and 3, rats were screened such that the lever-press response rates of different rats maintained by variable-interval schedules were either relatively high or relatively low. Following these baseline conditions, in Experiments 1 and 2 responding was extinguished by eliminating the food reinforcer and in Experiment 3 by removing the response–reinforcer dependency. Responses immediately following extinction implementation were examined. Response increases relative to baseline during the first 20 min of a 324.75-min extinction session (Experiment 1) or during the first 30-min extinction session (Experiments 2 and 3) were rare and unsystematic. The results (a) reinforce earlier meta-analyses concluding that extinction bursts may be a less ubiquitous early effect of extinction than has been suggested and (b) invite further experimentation to establish their generality as a function of preceding reinforcement conditions.     

Intermittent punishment of human responding maintained by intermittent reinforcement

To determine the effects of variable-interval shock punishment on behavior maintained by variable-interval and variable-ratio reinforcement, human subjects' key-pressing behavior was reinforced with money on a four-component multiple schedule. Components 1 and 2 were variable-interval 30-sec, and Components 3 and 4 were variable-ratio 210. After responding was stabilized, response-contingent electric shock was scheduled on a variable-interval 10-sec schedule during the second and fourth components of each cycle. Subjects instructed as to the reinforcement contingencies showed gradually increasing suppression of variable-interval responding at increasing shock intensities and either very high or very low rates of variable-ratio responding at higher intensities. Minimally instructed subjects showed suppression at higher shock intensities, but no clear differential suppression as a function of reinforcement schedule. Recovery from initial suppression was observed within sessions.     

Temporally spaced responding by pigeons: development and effects of deprivation and extinction

In the first five or six sessions on a DRL 20-sec schedule of reinforcement there developed a stable performance characterized by a relatively constant conditional probability of occurrence (IRTs/op) of interresponse times (IRTs) of durations greater than 5 or 6 sec. Extinction and the level of deprivation changed both the overall rate of responding and the form of the function relating the duration of an IRT to its value of IRTs/op. The value of IRTs/op decreased more rapidly for short than for longer IRTs, resulting in the emergence of a finer discrimination of IRT duration.     

Effects of a brief stimulus accompanying reinforcement on instrumental responding in pigeons

The responding of pigeons on a variable interval schedule of reinforcement was investigated in four experiments. In some conditions in each experiment reinforced keypecks were accompanied by a brief (0.5-sec) flash of the houselight. This procedure resulted in a low rate of response in comparison with that found in conditions when response-contingent light flashes occurred uncorrelated with reinforcement (Experiments 1 and 2) or when no light flash was presented (Experiment 3). Experiment 4 allowed a comparison between the effects of a signal accompanying the reinforced response and one accompanying the delivery of “free” food. Signaling the delivery of earned food produced a lower rate of response than did signaling the delivery of free food. The role of stimulus-reinforcer and response-reinforcer associations in producing these effects is discussed.     

Acquisition and extinction of signaled avoidance as a function of intermittent reinforcement

Signaled, shuttle-box avoidance responding in female rats of the Fischer₃₄₄ strain was examined as a function of four separate contingencies of intermittent reinforcement. In Experiment 1, when avoidance responses during acquisition were reinforced 25% of the time with prompt CS termination, animals responded equally often during acquisition and significantly more often during extinction than animals who received such reinforcement on a 100% schedule. Similar results were found under a trace procedure in Experiment 2 when avoidance responses were reinforced 25% of the time with informational feedback stimuli. In contrast, during Experiment 3, when animals were shocked on only 25% of the trials on which they failed to respond, the level of avoidance responding during both acquisition and extinction was significantly less than it was when animals were shocked on a 100% schedule. Comparable results were found in Experiment 4 when avoidance responses during acquisition averted shock on only 25% of the trials. Thus, intermittent reinforcement contingencies involving response-contingent feedback stimuli and shock have differential effects on avoidance responding during both acquisition and extinction trials under the signaled avoidance procedure.     

Effect of intermittent reinforcement on acquisition and retention in delayed matching-to-sample in pigeons

Experiments 1 and 2 involved independent groups that received primary reinforcement after a correct match with a probability of 1.0, .50 or .25. Correct matches that did not produce primary reinforcement produced a conditioned reinforcer. Both experiments revealed little evidence that acquisition or retention was adversely affected by use of intermittent reinforcement. Experiment 3 involved a group that received 100% reinforcement and two others that received 25% reinforcement, one of which received conditioned reinforcement and the other did not. Following acquisition and retention testing, birds in group 100% and group 25% with conditioned reinforcement were exposed to 25% reinforcement and no conditioned reinforcement. Results revealed that conditioned reinforcement was important in promoting acquisition but was irrelevant in maintaining performance. It was concluded that intermittent reinforcement, especially when combined with conditioned reinforcement during acquisition, supports levels of acquisition and retention comparable to that of continuous reinforcement. Theoretically, the findings are consistent with an extension of Blough's instance-based theory of discrimination performance and, practically, they suggest that use of intermittent reinforcement could result in increased efficiency and economy in labs using delayed matching.     

Perseveration of the partial reinforcement effect in extinction with rats over two phases of extinction and two stages of continuous reinforcement

One group of 10 male albino rats was given partial reinforcement while the other 10 rats received continuous reinforcement in a straight alley. Subjects then experienced five consecutive stages of Extinction 1, Continuous Reinforcement 1, Extinction 2, Continuous Reinforcement 2, and finally, Extinction 3. Analysis showed the partial reinforcement effect in extinction was sustained over two stages of extinction and two stages of continuous reinforcement, since subjects receiving partial reinforcement ran faster than rats given continuous reinforcement throughout all three of the extinction periods. The results seem to support those of Amsel's (1967) and Cabpaldi's (1967) theoretical formulations of the partial reinforcement effect in extinction.     

Effects of continuous and intermittent reinforcement for problem behavior during functional communication training

We evaluated the effectiveness of functional communication training (FCT) in reducing problem behavior and in strengthening alternative behavior when FCT was implemented without extinction. Following the completion of functional analyses in which social-positive reinforcement was identified as the maintaining variable for 5 participants' self-injurious behavior (SIB) and aggression, the participants were first exposed to FCT in which both problem behavior and alternative behavior were reinforced continuously (i.e., on fixed-ratio [FR] 1 schedules). During subsequent FCT conditions, the schedule of reinforcement for problem behavior was made more intermittent (e.g., FR 2, FR 3, FR 5, etc.), whereas alternative behavior was always reinforced according to an FR 1 schedule. Results showed that 1 participant's problem behavior decreased and alternative behavior increased during FCT when both behaviors were reinforced on FR 1 schedules. The remaining 4 participants shifted response allocation from problem to alternative behavior as the schedule of reinforcement for problem behavior became more intermittent. These results suggest that individuals might acquire alternative responses during FCT in spite of inconsistencies in the application of extinction, although even small errors in reinforcement may compromise treatment effects.     

Intermittent reinforcement of a continuous response

Konorski showed that when a go/no-go procedure was used, sound quality discriminations were rapidly acquired and sound location discriminations were slowly acquired. These findings have been interpreted as a general constraint on the acquisition of auditory discriminations (quality-location effect). However, experiments carried out within an evolutionary framework (Harrison, 1984) have shown that the rate of acquisition of sound location discriminations varies widely as a function of the inclusion or exclusion of naturalistic features. These data suggest that Konorski's findings were a function of the special conditions of the experiments. The first purpose of the present experiments was to assess whether rats showed the effects noted by Konorski when studied under similar conditions. The second purpose was to study the effect of manipulating two natural features (novelty and stimulus-response adjacency) to assess whether the acquisition rates of quality and location discriminations could be greatly modified or made approximately equal, or both. When a go/no-go procedure was used and the other conditions were similar to those of Konorski, rats acquired a quality discrimination but did not acquire a location discrimination. However, when the S+ or S- were presented through a closely adjacent speaker, the sound location discrimination was acquired as rapidly as the quality discrimination. Finally, preexposing the animal to either S+ or S- retarded the rate of or prevented the acquisition of the quality discrimination. The experiments showed that the quality-location effect was determined primarily by the conditions used in Konorski's experiments, and that the effect is not a general constraint on learning.     

Effects of reinforcement history on responding under progressive-ratio schedules of reinforcement.

The effects of experimental history on responding under a progressive-ratio schedule of reinforcement were examined. Sixteen pigeons were divided into four equal groups. Groups 1 to 3 were trained to peck a key for food under a fixed-ratio, variable-ratio, or differential-reinforcement-of-low-rate schedule of reinforcement. After training, these pigeons were shifted to a progressive-ratio schedule, later were shifted back to their original schedule (with decreased rates of reinforcement), and finally were returned to the progressive-ratio schedule. Pigeons in Group 4 (control) were maintained on the progressive-ratio schedule for the entire experiment. To test for potential "latent history" effects, pigeons responding under the progressive-ratio schedule were injected with d-amphetamine and given behavioral-momentum tests of prefeeding and extinction. Experimental histories affected responding in the immediate transition to the progressive-ratio schedule; response rates of pigeons with variable-ratio and fixed-ratio histories were higher than rates of pigeons with differential-reinforcement-of-low-rate and progressive-ratio-only histories. Pigeons with differential-reinforcement-of-low-rate histories, and to a lesser degree pigeons with variable-ratio and fixed-ratio histories, also had shorter postreinforcement pauses than pigeons with only a progressive-ratio history. No consistent long-term effects of prior contingencies on responding under the progressive-ratio schedule were evident. d-Amphetamine and resistance-to-change tests failed to reveal consistent latent history effects. The data suggest that history effects are sometimes transitory and not susceptible to latent influences.     

Key pecking during extinction after intermittent or continuous reinforcement as a function of the number of reinforcers delivered during training.

Key pecking by 7 pigeons was established and maintained on a multiple variable-ratio variable-ratio (VR) schedule of food presentation. The schedule in one of the components was then changed to fixed-ratio (FR) 1 for a predetermined number of reinforcers. Both components were then changed to extinction (i.e., multiple extinction, extinction). This sequence was repeated a different number of times for each pigeon to determine the relation between the number of reinforcers delivered during each component of the multiple VR FR 1 schedule and the number of responses during extinction. For most pigeons, there were fewer responses during extinction in the presence of a stimulus recently correlated with FR 1, regardless of the number of reinforcers received. The ratio of the total responses in extinction in the former VR component to the total responses in the former FR 1 component increased as the number of reinforcers delivered during each component of the multiple schedule increased. Within-subject replications of the partial-reinforcement extinction effect generally occurred, and there were no overall reductions in the number of responses in extinction with repeated exposures to extinction.