Control of responding by the location of an auditory stimulus: role of rise time of the stimulus

The control of responding by the location of tone bursts of 0.2- or 50-msec rise time was investigated in three albino rats. The apparatus consisted of an enclosure with two levers, two loudspeakers (in different locations), and a dipper feeder. The animal was exposed to tone bursts from either one or the other of the two speakers, and the speaker through which the tone bursts were delivered on any particular trial alternated in an irregular manner. Responses on one lever were reinforced with food in the presence of tone bursts from one speaker; responses on the second lever were reinforced with food in the presence of tone bursts from the second speaker. Responding came under the control of the location of 4-kHz tone bursts of 0.2-msec rise time within the first session. At this rise time, animals maintained a stable level of correct responding of greater than 95%. When the rise time was increased to 50 msec the percentage of correct responding fell to an average of 80 to 85%. It was concluded that location of an auditory stimulus is a powerful controller of responding in rats and that the degree of control is dependent upon rise time.     

The instrumental overshadowing effect in pigeons: The role of response bursts

Experiment 1 showed that, when reinforcement is delayed by 0.5 sec for pigeons responding on a variable interval schedule, bursts of responses tend to occur during the delay interval. Such bursts are not seen when a signal (illumination of the houselight) fills the delay interval. The higher overall response rate seen with the unsignalled procedure may, therefore, be a consequence of the differential reinforcement of response bursts. Experiment 2 found, however, that the difference between the signalled and unsignalled conditions remained when the signal used was one that was relatively ineffective in suppressing bursts. Experiment 3 found that in some conditions the unsignalled procedure will generate a higher response rate than the signalled procedure even when there is no delay of reinforcement and thus little opportunity for differential reinforcement of response bursts. It is argued that, in addition to any contribution from the differential reinforcement of bursts, these effects also reflect the overshadowing of a response—reinforcer association by the signal that is a more valid predictor of the reinforcer.     

Descriptive characteristics of extinction bursts: A record review

Procedural extinction is sometimes associated with a temporary increase in responding known as an extinction burst. Extinction bursts present unique challenges in the context of treating behavior targeted for reduction. The present study updates the prevalence of extinction bursts using a clinical sample (N = 108) receiving treatment for targeted behavior. The prevalence of extinction bursts in our sample (24%) was consistent with that in prior literature. The extinction-burst magnitude decreased across sessions after extinction was contacted during treatment, but this sample did not demonstrate decreased persistence or magnitude of extinction bursts across successive transitions from baseline to treatment. We also examined the prevalence and magnitude of extinction bursts based on the function and topography of targeted behavior and treatment components and found no consistent relation among these variables. These findings should lead clinicians to prepare for transient extinction bursts when implementing extinction-based treatment for challenging behavior.     

Concurrent performances: a baseline for the study of conditioned anxiety

Three rats were trained to lever press on concurrent random interval 2-min random interval 2-min schedules of milk reinforcement. With a 5-sec changeover delay, relative response rate matched the relative reinforcement duration associated with each lever. A stimulus, during which unavoidable shocks occurred at random intervals, was superimposed on this concurrent baseline, and shifts in preference were found. However, data from this procedure were ambiguous, apparently confounded by shock-elicited response bursts. Termination of the shocks during the stimulus resulted in a rapid recovery of matching, which was preceded by a brief facilitation of responding on the less-preferred lever. The procedure was then changed to a conventional conditioned anxiety paradigm with a variable duration pre-shock stimulus. A marked shift in relative response rate towards the preferred lever was found in all three rats; that is, responding on the preferred lever was far less suppressed during the pre-shock stimulus than responding on the less-preferred lever.     

Fixed-interval punishment

The average rate of bar-pressing maintained by a variable-interval schedule of milk reinforcement in 33 rats was found to be a decreasing function of intensity of concurrent punishment and, over a wide range of shock intensities, was inversely related to punishment frequency. Cumulative records were, however, negatively accelerated during 30-min punishment sessions with complete suppression occurring earlier and earlier (after fewer and fewer shocks) as intensity increased. In addition, acceleration was often observed between successive fixed-interval shock presentations and, at low and moderate intensities, bursts of responding occurred after each shock. The time to recover between punishment sessions (post-punishment recovery) was an increasing monotonic function of punishment intensity.     

Conditioned suppression of an avoidance response by a stimulus paired with food

Three food-deprived Long-Evans rats were exposed to a non-discriminated shock avoidance procedure. Superimposed upon this operant avoidance baseline were periodic presentations of a conditioned stimulus that was paired with food, the unconditioned stimulus. These pairings resulted in increases in the rate of shock over that recorded when the conditioned stimulus was not present. A traditional suppression ratio failed to reveal any differential effect of the conditioned stimulus on the overall rate of avoidance responding, although all subjects showed a consistent pattern of pausing and postshock response bursts during presentations of the conditioned stimulus. When food was withheld during a final extinction phase, the conditioned stimulus ceased to occasion increases in shock rates and disruptive postshock response bursts were eliminated. An analysis of conditioned suppression procedures is proposed that stresses not only operant-Pavlovian or appetitive-aversive incompatibility, but also the manner in which the baseline schedule of reinforcement affects operant behavior changes that are elicited by the superimposed Pavlovian procedure.     

Undermatching and overmatching as deviations from the matching law

A model of performance under concurrent variable-interval reinforcement schedules that takes as its starting point the hypothetical “burst” structure of operant responding is presented. Undermatching and overmatching are derived from two separate, and opposing, tendencies. The first is a tendency to allocate a certain proportion of response bursts randomly to a response alternative without regard for the rate of reinforcement it provides, others being allocated according to the simple matching law. This produces undermatching. The second is a tendency to prolong response bursts that have a high probability of initiation relative to those for which initiation probability is lower. This process produces overmatching. A model embodying both tendencies predicts (1) that undermatching will be more common than overmatching, (2) that overmatching, when it occurs, will tend to be of limited extent. Both predictions are consistent with available data. The model thus accounts for undermatching and overmatching deviations from the matching law in terms of additional processes added on to behavior allocation obeying the simple matching relation. Such a model thus enables processes that have been hypothesized to underlie matching, such as some type of reinforcement rate or probability optimization, to remain as explanatory mechanisms even though the simple matching law may not generally be obeyed.     

BEHAVIORAL PERSISTENCE AND VARIABILITY DURING EXTINCTION OF SELF-INJURY MAINTAINED BY ESCAPE

The self-injurious escape behavior of a developmentally disabled adult was treated with extinction. Results of a reversal design showed substantial bursts of responding when extinction was introduced and reintroduced: self-injury remained at a variable and elevated rate for some time before stable, low rates were observed. Data on aggression, a nontarget behavior during both baseline and treatment, showed a pattern similar to that seen for self-injury during the extinction conditions.     

The use of a token system in project Head Start

The present experiment sought to develop a practical and effective method for teaching the beginning elements of hand-writing in a Head Start program. The method consisted of reinforcing responses to a writing program by giving the children access to a variety of activities normally available in the pre-school classroom. Tokens were presented for correct responses. The children then used the tokens to select reinforcers, such as snacks and access to a variety of play activities. In an experimental evaluation of the token system, it was found that responding was maintained as long as access to the reinforcing activities was contingent upon responding. When reinforcement was no longer contingent upon responding, virtually no responding occurred. Informal observations suggested that the token system had several unanticipated effects: the children's vocabulary and ability to understand instructions improved; a favorable attitude toward school developed; and their ability to play cooperatively with other children increased. It was concluded that the token system is a practical and effective method for teaching beginning writing skills and that it has other desirable, if unanticipated, effects.     

Acceleration and suppression of rats' responding to avoid foot shock and tail shock

Signalled response-independent shocks were superimposed on rats' wheel-turn responding to avoid shock administered to their feet through a grid floor or to their tails through fixed electrodes. In Experiment I, a tone paired with response-independent foot shock increased responding in three of four rats; a tone paired with tail shock increased responding in only one of four rats and suppressed responding in two rats. In Experiment II, a tone presented randomly with respect to response-independent shock had no reliable effect on responding to avoid foot shock or tail shock. In Experiment III, tail shock and foot shock were compared in a within-subject design while the temporal pattern of responding during conditioned stimuli was recorded. Responding during the conditioned stimulus preceding foot shock was characterized by initial suppression of responding at tone onset, followed by increased responding just before response-independent shock. Responding was suppressed throughout the conditioned stimulus preceding tail shock. Foot shock elicited bursts of responding, but tail shock did not.     

DIFFERENTIALLY REINFORCING LOW RATES OF MISBEHAVIOR WITH NORMAL ELEMENTARY SCHOOL CHILDREN1

Effective nonpunitive procedures for reducing counterproductive classroom behaviors are of potential benefit to both students and teachers. A recent strategy for dealing with this class of problem behaviors involves the reinforcement of acceptably low levels of such behavior. The laboratory version of this procedure, called differential reinforcement of low rates of responding (or DRL), provides for a reinforcer to be delivered contingent upon a response that is separated from the last preceding response by a minimum amount of time. To make this procedure more amenable to classroom use, the present authors have modified it so that a reinforcer is delivered if fewer than a specified number of responses occur within a preset time interval (Deitz and Repp, Journal of Applied Behavior Analysis, 1973, 6 , 457–463). Previous studies using this procedure have found it effective in reducing and maintaining low rates of targeted behaviors. However, these effects have been demonstrated with groups of subjects and/or individuals from dependent populations. The present study investigated use of this modified DRL procedure with individual students in normal elementary classrooms. In the first of three studies, “talk-outs” of an 11-yr-old fifth-grade male were reduced when nonexchangeable gold stars were made contingent on two or fewer responses per session. During baseline sessions, an average of 4.45 talkouts were observed per 45-min session. Average responding subsequently fell to 1.83 when the modified DRL contingency was applied, increased to 7.60 during a reversal phase, and dropped again to an average of 1.20 when the contingency was reapplied. In the second study, out-of-seat behavior of a 12-yr-old sixth-grade female was reduced when gold stars were made contingent on two or fewer responses per 45-min class period. Baseline responding averaged 6.10 responses per session. When the contingency was applied, average responding fell to 0.16. During the reversal period, responding increased to an average of 6.00 and fell again, after the contingency was re-introduced to an average of 0.40. In the third study, a reduction in both talking-out and out-of-seat behaviors of another 11-yr-old fifth-grade male was demonstrated with a multiple-baseline design. Using different lengths of baselines, gold stars were made contingent first on a low rate of out-of-seat behavior, and then on a low rate of talk-outs. Out-of-seat responding fell from a baseline average of 7.50 to a treatment average of 1.14. Talk-outs went from a baseline average of 4.66 to a treatment average of 1.14. In all three studies, the modified DRL procedure proved effective with the children and was manageable by the classroom teacher. For the students, nonexchangeable conditioned reinforcers (stars) were sufficient to maintain lowered rates of inappropriate behavior with the modified DRL schedule; there was no need for an elaborate token economy, a process that in many cases may be only a form of behavioral “overkill”. As in other studies investigating DRL schedules, students were not informed of their accumulation of responses; the differential effects of providing or withholding this feedback need to be investigated. Overall, these studies add single-subject replication with normal children to the literature on modified DRL procedures.     

Changing the response unit from a single peck to a fixed number of pecks in fixed-interval schedules

Each of three pigeons was studied first under a standard fixed-interval schedule. With the fixed interval held constant, the schedule was changed to a second-order schedule in which the response unit was the behavior on a small fixed-ratio schedule (first a fixed-ratio 10 and then a fixed-ratio 20 schedule). That is, every completion of the fixed-ratio schedule produced a 0.7-sec darkening of the key and reset the response count to zero for the next ratio. The first fixed-ratio completed after the fixed-interval schedule elapsed produced the 0.7-sec blackout followed immediately by food. These manipulations were carried out under two different fixed-interval durations for each bird ranging from 3 min to 12 min. The standard fixed-interval schedules produced the typical pause after reinforcement followed by responding at a moderate rate until the next reinforcement. The second-order schedules also engendered a pause after reinforcement, but responding occurred in bursts separated by brief pauses after each blackout. For a particular fixed-interval duration, post-reinforcement pauses increased slightly as the number of pecks in the response unit increased despite large differences in the rate and pattern of key pecking. Post-reinforcement pause increased with the fixed-interval duration under all response units. These data confirm that the allocation of time between pausing and responding is relatively independent of the rate and topography of responding after the pause.     

Temporal properties of responding during stimuli that precede response-independent food

Pigeons' keypecks were reinforced with grain on the average of once per minute by schedules that maintained low response rates and by schedules that maintained high response rates. During these schedules, a fixed-duration conditioned stimulus (CS) ranging from 7.5 to 120 sec in duration across conditions terminated with response-independent food. Response rates during the CS were inversely related to CS duration. The rates and the temporal patterns of responding during the shortest CS were similar whether the ongoing schedule maintained high response rates or low response rates. As CS duration increased, the rate and pattern of responding during the CS converged on the rate and pattern of responding maintained by the baseline schedule. These data indicate that changes in responding during stimuli that signal response-independent reinforcement are not homogeneous throughout the CS; that response measures, such as “suppression ratios”, which presume homogeneity may mislead us; and that conditioned suppression and conditioned enhancement may be better talked about in terms of species-specific approach and avoidance than in terms of emotional states.     

Studies on responding under fixed-interval schedules of reinforcement: II. The scalloped pattern of the cumulative record

Responding under fixed-interval schedules usually generates either scalloped or break-and-run cumulative records. Earlier, it was generally accepted that the characteristic pattern was the scallop, but in recent years there has been an increasing emphasis on the break-and-run pattern. The break-and-run pattern has been shown quantitatively to provide a good fit of certain fixed-interval patterns. In the present work, responding during fixed-interval 1000-second components of a multiple fixed-interval 1000-second fixed-ratio 50 responses schedule was examined in two rhesus monkeys. Even after responding had started in an interval, there was a high tendency for responding to accelerate over subsequent 100-second segments of the interval. In segments with responding, the rate increased from one segment to the next in 303 of 389 segments in one monkey and in 310 of 419 segments in the other. The size of the increase was substantial, the rate in the fifth segment after responding started being an average of 4.5 times higher than the rate in the first segment after responding started. Hence, the usual pattern of responding in individual intervals was of sustained and substantial acceleration, vindicating numerically the conclusion derived from inspection of the scalloped patterns of the cumulative records.     

Response uncertainty and perceptual difficulty of auditory temporal patterns

Two qualitatively different sounds were used to generate256 different sequences of length8, and these sequences were presented to Ss at a rate of two stimuli per second. These sequences, when repeatedcontinuously,canbe grouped into20 fundame ntally different patterns, each having either2, 4, or8 distinguishably different starting points. Ss were required to listen and to be gin responding (with telegraph keys) in synchrony to the patterns when they were able. The point at which they began responding, the delay before responding, and errors after beginning responding were measured. The response uncertainty (variability of point of response for a given pattern), average delay, and average errors are all highly correlated, indicating that patterns which are easily organized are those which have few alternative modes of organization, and thus can be considered as simple, or good in the Gestalt sense.     

Neonates' heart rate,sucking rhythm,and sucking amplitude as a function of the sweet taste

In previous studies of human newborn sucking, the effects of increasing fluid sweetness and/or volume included a decrease in sucking rate within sucking bursts and, paradoxically, an increase in heart rate. To determine whether the heart rate increase can be attributed to increased sucking amplitude for sweeter fluids, sucking and heart rates of 20 full-term infants were studied. Half sucked for three consecutive 2-min periods, first receiving small drops of water for each suck, then no fluid, then 15% sucrose. The other half experienced the reverse order. The results for sucking and heart rate were consistent with previous studies; sucking rates within bursts were slowest for sucrose and fastest for no fluid. Heart rate was higher for sucrose than for the other fluid conditions, however, only in the water-first group. The heart rate increase was significant on statistical tests which controlled for sucking amplitude as well as for several other motor variables. Sucking amplitude itself varied with fluid sweetness in the water-first group only, in which it was highest for water. There were more total sucks, longer sucking bursts, and less time between successive bursts under the sucrose condition. Multivariate statistics helped establish a set of dependent variables—sucking rate within bursts, total number of sucks, and heart rate—which most parsimoniously describes the effects of fluid sweetness. A hedonic explanation of the response of newborns to sweetness is thus reiterated.     

Rate of response as a visual social stimulus

In Exp. 1, a high rate of responding (chain pulling) of a stimulus monkey was established as a visual positive discriminative stimulus for the operant behavior (bar pressing) of an observer monkey. The terminal performance of the observer under conditions in which a high rate of response of the stimulus monkey alternated in a variable temporal arrangement with a zero rate of response of the stimulus monkey (negative discriminative stimulus) was essentially the same as when nonbehavioral stimuli are correlated with the availability of reinforcement. By manipulating the schedule of reinforcement to change the rate of responding of the stimulus subject without changing its rate of reinforcement, Exp. 2 showed that the effective behavioral stimulus for the observer was the rate of chain pulling by the stimulus subject. A novel intermediate rate of responding by the stimulus monkey resulted in an intermediate rate (generalization) on the part of the observer during an extinction test. These experiments demonstrated that the rate of responding of one organism can function as a discriminative stimulus to control the rate of responding of another organism; and that the rate of responding is similar to other physical stimuli in terms of discrimination and generalization.     

Control of responding by sounds of different quality: an evolutionary analysis.

Two experiments investigated the acquisition of discriminations between two acoustic stimuli of different quality (noise bursts vs. a 2-kHz pulsed signal) when features of the everyday environment were incorporated into the experiments. In Experiment 1, rats were trained, using food, to press a lever. Throughout all sessions, 5-s trials of noise bursts (the random stimulus) were presented, after variable intertrial intervals, through a remote speaker mounted outside the experimental enclosure. The noise burst occurred randomly with respect to reinforcement of lever pressing and had no programmed relationship to the animal's behavior. When lever pressing was established, the 2-kHz signal was presented through a speaker adjacent to the response lever according to a different set of variable intertrial intervals. A response in the presence of the 2-kHz signal terminated the trial and was reinforced. The 2-kHz signal acquired control of responding within the first few trials, whereas the random stimulus exerted no control of responding. In Experiment 2, rats were trained to press the lever in the presence of the 2-kHz signal presented through the adjacent speaker on a variable intertrial interval. After 14 sessions, 5-s trials of noise bursts (random stimulus) were presented through the remote speaker on the second variable intertrial interval. The random stimulus initially elicited exploratory behavior, which then rapidly declined. Subsequently, the random stimulus exerted no or weak control of responding. The introduction of the random stimulus had no effect on responding in the presence of the adjacent stimulus. In Experiments 3 and 4 the random stimulus was presented through the adjacent speaker, and the stimulus correlated with reinforcement was presented through the remote speaker. In both experiments, there was persistent control of responding by the random stimulus and slow development of control by the stimulus correlated with reinforcement. In Experiment 5, both stimuli were presented through the adjacent speaker. There was persistent control of responding by the random stimulus.     

The control of responding by sounds: unusual effect of reinforcement.

Naive rats were trained to respond on one lever in the presence of noise bursts from one speaker and on a second lever in the presence of noise bursts from a second speaker. The speakers were mounted behind the levers. When responding on the lever adjacent to the sounding speaker was reinforced, control developed within fewer than five trials. When responding on the nonadjacent lever was selectively reinforced, responding on the lever adjacent to the sounding speaker increased in probability for several sessions. Naive rats were trained to respond on the nonadjacent lever following preexposure to the sound. Responding on the lever adjacent to the sounding speaker increased in probability, showing that novelty was not responsible for the effect. Naive rats were run on automaintenance procedures in which there was no explicit pairing of sound and magazine operation, 100% pairing of sound and magazine operation, or magazine operation following 40% of sound presentations. None of the rats acquired the response of approaching and sniffing the sounding speaker, indicating that sound-magazine pairing was not responsible for the effect.