Bouts of responding: the relation between bout rate and the rate of variable-interval reinforcement

By nose poking a lighted key, rats obtained food pellets on either a variable-interval schedule of reinforcement or a schedule that required an average of four additional responses after the end of tile variable-interval component (a tandem variable-interval variable-ratio 4 schedule). With both schedule types, the mean variable interval was varied between blocks of sessions from 16 min to 0.25 min. Total rate of key poking increased similarly as a function of the reinforcer rate for the two schedule types, but response rate was higher with than without the four-response requirement. Analysis of log survivor plots of interresponse times showed that key poking occurred in bouts. The rate of initiating bouts increased as a function of reinforcer rate but was either unaffected or was decreased by adding the four-response requirement. Within-bout response rate was insensitive to reinforcer rate and only inconsistently affected by the four-response requirement. For both kinds of schedule, the ratio of bout time to between-bout pause time was approximately a power function of reinforcer rate, with exponents above and below 1.0.     

The effects of delayed reinforcement on variability and repetition of response sequences

Four experiments examined the effects of delays to reinforcement on key peck sequences of pigeons maintained under multiple schedules of contingencies that produced variable or repetitive behavior. In Experiments 1, 2, and 4, in the repeat component only the sequence right-right-left-left earned food, and in the vary component four-response sequences different from the previous 10 earned food. Experiments 1 and 2 examined the effects of nonresetting and resetting delays to reinforcement, respectively. In Experiment 3, in the repeat component sequences had to be the same as one of the previous three, whereas in the vary component sequences had to be different from each of the previous three for food. Experiment 4 compared postreinforcer delays to prereinforcement delays. With immediate reinforcement sequences occurred at a similar rate in the two components, but were less variable in the repeat component. Delays to reinforcement decreased the rate of sequences similarly in both components, but affected variability differently. Variability increased in the repeat component, but was unaffected in the vary component. These effects occurred regardless of the manner in which the delay to reinforcement was programmed or the contingency used to generate repetitive behavior. Furthermore, the effects were unique to prereinforcement delays.     

An architect of the golden years

William H. Morse has played a major role in the experimental analysis of behavior. His view of operant behavior as the outcome of differential reinforcement provides an invaluable lesson in scientific research and theory. He studied schedules of reinforcement to generate an in-depth analysis of the complex interactions existing when contingencies exert their control over behavior. He has been instrumental in showing how behavior is determined by the dynamic interaction of factors brought into play by the imposition of any schedule, and he has a remarkably intuitive understanding of the nature of these determining variables. Some of these causal events are imposed directly by the schedule, but others arise in a more indirect manner through necessary constraints. In Morse's view, schedules can be more fundamental in determining behavior than are the scheduled events themselves. Behavior is the shaped product of an organism's history in combination with present environmental conditions. His impact deserves to be more than historical: A study of his work continues to reward the reader with exciting insights into the nature of behavioral control.     

Rats' performance on variable-interval schedules with a linear feedback loop between response rate and reinforcement rate

Three experiments investigated whether rats are sensitive to the molar properties of a variable-interval (VI) schedule with a positive relation between response rate and reinforcement rate (i.e., a VI+ schedule). In Experiment 1, rats responded faster on a variable ratio (VR) schedule than on a VI+ schedule with an equivalent feedback function. Reinforced interresponse times (IRTs) were shorter on the VR as compared to the VI+ schedule. In Experiments 2 and 3, there was no systematic difference in response rates maintained by a VI+ schedule and a VI schedule yoked in terms of reinforcement rate. This was found both when the yoking procedure was between-subject (Experiment 2) and within-subject (Experiment 3). Mean reinforced IRTs were similar on both the VI+ and yoked VI schedules, but these values were more variable on the VI+ schedule. These results provided no evidence that rats are sensitive to the feedback function relating response rate to reinforcement rate on a VI+ schedule.     

Associative symmetry in the pigeon after successive matching-to-sample training

If an organism is explicitly taught an A→B association, then might it also spontaneously learn the symmetrical B→A association? Little evidence attests to such “associative symmetry” in nonhuman animals. We report for the first time a clear case of associative symmetry in the pigeon. Experiment 1 used a successive go/no go matching‐to‐sample procedure, which showed all of the training and testing stimuli in one location and intermixed arbitrary and identity matching trials. We found symmetrical responding that was as robust during testing (B→A) as during training (A→B). In Experiment 2, we trained different pigeons using only arbitrary matching trials before symmetry testing. No symmetrical responding was found. In Experiment 3, we trained other pigeons with only arbitrary matching trials and then tested for symmetry. When these pigeons, too, did not exhibit symmetrical responding, we retrained them with intermixed identity and arbitrary matching trials. Less robust symmetrical responding was obtained here than in Experiment 1. Collectively, these results suggest that identity matching may have to be learned concurrently with arbitrary matching from the outset of training for symmetry to emerge.     

The effect of test schedules on the formation of linked perceptual classes

After training conditional discriminations among selected stimuli from two perceptual classes, the emergence of novel relations involving other members of both classes was assessed using cross-class probes. The cross-class probes were presented using one of four different testing schedules. In the 2/9 test, nine different probes were presented in each of two test blocks. In the 6/3 test, three different probes were presented in each of six test blocks. In the 18/1-RND test, each of the 18 cross-class probes was presented in separate test blocks. In the 2/9 and 6/3 tests, the cross-class probes were presented in a randomized order within test block. In the 18/1-RND test, the cross-class probes were presented in a randomized sequence. In the 18/1-PRGM test, however, the cross-class probes were presented in a programmed order (i.e., the values of the stimuli in each cross-class probe were changed systematically in the succession of probe presentations). About 55% of the linked perceptual classes emerged during the 2/9, 6/3, and 18/1-RND tests. Thus the number of different probes in a test block did not influence the emergence of classes as long as the probes were presented in a random order. Virtually all classes emerged during the 18/1-PRGM test. Thus at least one ordered introduction of different cross probes resulted in the reliable emergence of linked perceptual classes. Mechanisms responsible for linked perceptual class formation are discussed along with the relation of these classes to other complex categories.     

Effects of cocaine on fixed-interval responding reinforced by the opportunity to run

Rate-dependent drug effects have been observed for operant responding maintained by food, water, heat, light onset, electrical brain stimulation, shock-stimulus termination, and shock presentation. The present study sought to determine if the effects of cocaine on lever pressing maintained by the opportunity to run could also be described as rate dependent. Seven male Wistar rats were trained to respond on levers for the opportunity to run in a wheel. The schedule of reinforcement was fixed-interval 60 s, and the reinforcing consequence was the opportunity to run for 60 s. On this schedule, overall rates of responding were low, usually below six presses per minute, and pauses frequently exceeded the 60-s interval. Despite these differences, an overall scalloped pattern of lever pressing was evident for each rat. Doses of 1, 2, 4, 8, and 16 mg/kg cocaine were administered 10 min prior to a session. Only at the 16 mg/kg dose did the responding of the majority of rats change in a manner suggestive of a rate-dependent drug effect. Specifically, lower response rates at the beginning of the intervals increased and higher rates at the end of the intervals decreased, as indicated by the fact that slopes from the regression of drug rates on control rates decreased. These data provide tentative support for the generalization of rate-dependent effects to operant responding maintained by wheel running. Differences in the baseline performance maintained by wheel running compared to those for food and water point to the need for further experimentation before this effect can be firmly established.     

Multiple schedules with response interruption and redirection to reduce stereotypy in children with autism spectrum disorder: Generalization and social validity

Although response interruption and redirection (RIRD) and multiple schedule arrangements have sometimes been shown to be effective in reducing stereotypy for individuals with autism spectrum disorder (ASD), important questions remain about optimal methods for facilitating generalization and social validity. In the current study, we sought to extend the literature on stereotypy treatment and MSAs in several ways. First, we programmed for generalization by conducting sessions with two exemplars of two different categories of activities (i.e., school work, toy play) and assessing generalization with novel exemplars and activities and during the participant's typical instructional program. Second, we used RIRD instructions that were contextual models of appropriate behavior relevant to each activity. Third, during the free access component of the multiple schedule, we used a child's play tent as a first step toward teaching participants to engage in stereotypy during private free time. For all three participants with ASD, stereotypy decreased quickly and substantially, with reductions generalizing to novel activities and contexts. An extensive social validity assessment with board-certified behavior analysts indicated high social acceptability of the goals, procedures, and outcomes.     

Synthesizing concurrent interval performances

Concurrent schedules may be viewed as consisting of two pairs of stay and switch schedules, each pair associated with one of the alternatives. A stay schedule arranges reinforcers for staying and responding at one alternative, whereas the associated switch schedule arranges reinforcers for switching to the other alternative. In standard concurrent schedules, the stay schedule at each alternative is equivalent to the switch schedule at the other alternative. MacDonall (1999) exposed rats to one pair of stay and switch variable-ratio schedules and varied the response requirements across conditions. Combining results from symmetric pairs produced composite performances that were described by the generalized matching law. This outcome was noteworthy because the data were obtained from performances at two alternatives with contingencies that were functionally unrelated to each other. This result suggests that concurrent performances may consist of two unrelated performances that alternate as behavior moves between alternatives. The purpose of the present experiment was to extend those results to interval schedules. Rats were exposed to pairs of random-interval schedules, and across conditions their mean intervals were varied. When data from appropriately paired conditions were combined, the composite performances were consistent with the generalized matching law. In addition, the results supported two models of concurrent performances that were based on local variables at an alternative (behavior, and stay and switch reinforcers): a modified version of the contingency discrimination model (Davison & Jenkins, 1985) and the local model (MacDonall, 1999).     

Effect of signaled reinforcement on response variability

Three experiments examined the effect of signaling reinforcement on rats' lever pressing on contingencies that reinforced variable responding to extend the exploration of signaled reinforcement to a schedule that has previously not been examined in this respect. In Experiment 1, rats responding on a lag-8 variability schedule with signaled reinforcement displayed greater levels of variability (U values) than rats on the same schedule lacking a reinforcement signal. In Experiment 2, rats responding on a differential reinforcement of least frequent responses schedule also displayed greater operant variability with a signal for reinforcement compared with rats without a reinforcement signal. In Experiment 3, a reinforcement signal decreased the variability of a response sequence when there was no variability requirement. These results offer empirical corroboration that operant variability responds to manipulations in the same manner as do other forms of operant response and that a reinforcement signal facilitates the emission of the required operant.