Stimulus generalization of behavioral history

Undergraduates responded under a variable-ratio 30 schedule in the presence of a 25-mm long line and on a differential-reinforcement-of-low-rate 6-s schedule when a 13-mm long line was present. Following this, a line-length continuum generalization test was administered under a fixed-interval 6-s schedule (Experiment 1) or extinction (Experiment 2). In both experiments, obtained generalization gradients conformed to typical postdiscrimination gradients. Responses were frequent under stimuli physically similar to the 25-mm line and infrequent under stimuli physically similar to the 13-mm line. The generalization gradients were generally asymmetric with peak response rates occurring at line lengths greater than 25 mm.     

Effects of differences in interreinforcer intervals between past and current schedules on fixed-interval responding

Undergraduates were exposed to a mixed fixed-ratio differential-reinforcement-of-low-rate schedule. Values of the schedule components were adjusted so that interreinforcer intervals in one component were longer than those in another component. Following this, a mixed fixed-interval 5-s fixed-interval 20-s schedule (Experiment 1) or six fixed-interval schedules in which the values ranged from 5 to 40 s (Experiment 2) were in effect. In both experiments, response rates under the fixed-interval schedules were higher when the interreinforcer intervals approximated those produced under the fixed-ratio schedule, whereas the rates were lower when the interreinforcer intervals approximated those produced under the different-reinforcement-of-low-rate schedule. The present results demonstrate that the effects of behavioral history were under control of the interreinforcer intervals as discriminative stimuli.     

Extended pausing by humans on multiple fixed-ratio schedules with varied reinforcer magnitude and response requirements

We conducted three experiments to reproduce and extend Perone and Courtney's (1992) study of pausing at the beginning of fixed-ratio schedules. In a multiple schedule with unequal amounts of food across two components, they found that pigeons paused longest in the component associated with the smaller amount of food (the lean component), but only when it was preceded by the rich component. In our studies, adults with mild intellectual disabilities responded on a touch-sensitive computer monitor to produce money. In Experiment 1, the multiple-schedule components differed in both response requirement and reinforcer magnitude (i.e., the rich component required fewer responses and produced more money than the lean component). Effects shown with pigeons were reproduced in all 7 participants. In Experiment 2, we removed the stimuli that signaled the two schedule components, and participants' extended pausing was eliminated. In Experiment 3, to assess sensitivity to reinforcer magnitude versus fixed-ratio size, we presented conditions with equal ratio sizes but disparate magnitudes and conditions with equal magnitudes but disparate ratio sizes. Sensitivity to these manipulations was idiosyncratic. The present experiments obtained schedule control in verbally competent human participants and, despite procedural differences, we reproduced findings with animal participants. We showed that pausing is jointly determined by past conditions of reinforcement and stimuli correlated with upcoming conditions.     

Stimulus control of behavioral history.

Pigeons were exposed to two different reinforcement schedules under different stimulus conditions in each of two daily sessions separated by 6 hr (Experiments 1 and 2) or in a single session (Experiment 3). Following this, either a fixed-interval (Experiment 1) or a variable-interval schedule (Experiments 2 and 3) was effected in both stimulus conditions. In the first two experiments, exposure to fixed-ratio or differential-reinforcement-of-low-rate schedules led to response-rate, but not pattern, differences in subsequent performance on fixed- or variable-interval schedules that persisted for up to 60 sessions. The effects of reinforcement-schedule history on fixed-interval schedule performance generally were more persistent. In Experiment 3, a history of high and low response rates in different components of a multiple schedule resulted in subsequent response-rate differences under identical variable-interval schedules. Higher response rates initially occurred in the component previously correlated with high response rates. For 3 of 4 subjects, the differences persisted for 20 or more sessions. Previous demonstrations of behavioral history effects have been confined largely to between-subject comparisons. By contrast, the present results demonstrate strong behavioral effects of schedule histories under stimulus control within individual subjects.     

An analysis of reinforcement history effects

Four pigeons were exposed to two tandem variable-interval differential-reinforcement-of-low-rate schedules under different stimulus conditions. The values of the tandem schedules were adjusted so that reinforcement rates in one stimulus condition were higher than those in the other, even though response rates in the two conditions were nearly identical. Following this, a fixed-interval schedule of either shorter or longer values than, or equal to the baseline schedule, was introduced in the two stimulus conditions respectively. Response rates during those fixed-interval schedules typically were higher in the presence of the stimuli previously correlated with the lower reinforcement rates than were those in the presence of the stimuli previously correlated with the higher reinforcement rates. Such effects of the reinforcement history were most prominent when the value of the fixed-interval schedule was shorter. The results are consistent with both incentive contrast and response strength conceptualizations of related effects. They also suggest methods for disentangling the effects of reinforcement rate on subsequent responding, from the response rate with which it is confounded in many conventional schedules of reinforcement.     

Instructions as discriminative stimuli

Four undergraduates were exposed to a fixed-ratio schedule under an instruction to respond slowly and to a differential-reinforcement-of-low-rate 5-s schedule under an instruction to respond rapidly. Following this, a fixed-interval schedule was in effect under those same two sets of instructions. For 3 of 4 subjects, response rates were higher with the instruction to respond slowly than with the instruction to respond rapidly during the fixed-interval schedule. For the remaining subject, low-rate responding with the instruction to respond rapidly continued during the first 17 reinforcements of the fixed-interval schedule. Such control by instructions was not observed for other subjects exposed only to a fixed-interval schedule, with or without instructions. The results demonstrate that the effect of instructions can be altered by contingencies and suggest that instructions can function as discriminative stimuli.     

Stimulus generalization of behavioral history: Interspecies generality and persistence of generalization gradients

Four pigeons were exposed to a tandem variable-interval (VI) fixed-ratio (FR) schedule in the presence of a 50-pixel (about 15 mm) square or an 80-pixel (about 24 mm) square and to a tandem VI differential-reinforcement-of-low-rate (DRL) schedule when a second 80-pixel or 50-pixel square was present. The values of the VI and FR schedules were adjusted to equate reinforcement rates in the two tandem schedules. Following this, a square-size continuum generalization test was administered under a fixed-interval (FI) schedule or extinction. In the first testing session, response frequency was a graded function of the similarity of the test stimuli to the training stimuli for all pigeons. These systematic generalization gradients persisted longer under the FI schedule than under extinction.     

Instructions as discriminative stimuli (2): A within‐subject examination of the effect of differential reinforcement on establishing novel instructional control1

Abstract: Six undergraduates were exposed to a fixed‐ratio schedule with an instruction to respond slowly and to a differential‐reinforcement‐of‐low‐rate schedule with an instruction to respond rapidly when a white circle was presented on a display monitor. When a yellow circle was presented, however, the subjects were exposed to the fixed‐ratio schedule with the instruction to respond rapidly and to the differential‐reinforcement‐of‐low‐rate schedule with the instruction to respond slowly. Following this, a fixed‐interval schedule was in effect during those stimuli and instructions. Under the white circle, response rates were higher with the instruction to respond slowly than with the instruction to respond rapidly during the fixed‐interval schedule. Such control by instructions was not observed under the yellow circle. A previous study examined establishment of novel instructional control by between‐subject comparisons and found that for three of four subjects ( Okouchi, 1999 ). In contrast, the present results demonstrate the instructional control through within‐subject comparisons for all six subjects.     

Behavioral momentum in computer-presented discriminations in individuals with severe mental retardation

Behavioral momentum was examined in 2 individuals with severe mental retardation via within-subject manipulations of obtained reinforcer rates. Subjects performed self-paced discrimination problems presented on a touch screen computer monitor. Two different problems, Tasks A and B, alternated in blocks of 15 trials on a multiple schedule. Reinforcers were snack foods. The reinforcement schedule for Task A was continuous (fixed-ratio 1) and the schedule for Task B was continuous in some conditions and variable ratio in other conditions. Behavioral momentum was assessed in test sessions by prefeeding, presenting response-independent food, and making available alternatives to the tasks. When the obtained reinforcer rate for Task A was at least twice that for Task B, resistance to change was greater for Task A. When both reinforcer rates and response rates were a pproximately equal for the two tasks, resistance to change was approximately equal. These results are consistent with behavioral momentum effects. They extend previous findings with humans by examining momentum in self-initiated discrete-trial discrimination tasks with ratio schedules, and by isolating relative reinforcer rates as a controlling variable via within-subject manipulations.     

Behavioral determinants of drug action. The contributions of Peter B. Dews

Peter B. Dews played a significant role in shaping the distinctive characteristics and defining the underlying principles of the discipline of behavioral pharmacology. His early and sophisticated use of schedules of reinforcement in the 1950s, incorporated from research in the experimental analysis of behavior and integrated into the discipline of pharmacology, provided tremendous insight, inspiration, and impetus to the newly emerging field of behavioral pharmacology. The experimental findings generated by Dews' research, blending the sophisticated use of behavior and pharmacological principles together with the elegant manner of their presentation and far-reaching implications, provided the force and momentum to establish and direct behavioral pharmacology for several decades. This article attempts to capture some of Dews' research that integrated and inspired the blending of sophisticated behavioral work with that of pharmacology.     

The effects of fixed-time reinforcement schedules on problem behavior of children with emotional and behavioral disorders in a day-treatment classroom setting

The current study assessed the effects of fixed-time reinforcement schedules on problem behavior of students with emotional-behavioral disorders in a clinical day-treatment classroom setting. Three elementary-aged students with a variety of emotional and behavioral problems participated in the study. Initial functional assessments indicated that social attention was the maintaining reinforcer for their verbally disruptive behavior. Baseline phases were alternated with phases in which attention was provided on fixed-time schedules in the context of an ABAB design. The results indicated that the provision of attention on fixed-time schedules substantially reduced the participants' rate of verbal disruptions. These decreases were maintained during initial thinning of the schedules. The results provide one of the first examples that such an intervention can be successfully implemented in a classroom setting.     

Intertrial sources of stimulus control and delayed matching-to-sample performance in humans

Two experiments compared delayed matching-to-sample (DMTS) accuracy under 2 procedures in adults with mental retardation. In the trial-unique procedure, every trial in a session contained different stimuli. Thus, comparison stimuli that were correct on one trial were never incorrect on other trials in that session (or vice versa). In the 2-sample DMTS procedure, the same 2 comparison stimuli were presented on each trial, and their function changed quasi-randomly across trials conditional upon the sample stimulus. Across 2 experiments, 7 of 8 subjects showed the highest overall accuracy under the trial-unique procedure, and no subject showed consistently higher accuracy under the 2-sample procedure. Negative, exponential decay functions fit to logit p values showed that this difference was due largely to the steeper delay-mediated decline in sample control for the 2-sample procedure. Stimulus-control analyses indicated that, under the 2-sample procedure, the selection of the comparison stimulus on Trial N was often controlled by the comparison stimulus selection on Trial N-1 rather than the Trial-N sample stimulus. This source of competing stimulus control is not present in trial-unique procedures. Experiment 2 manipulated intertrial interval duration. There was a small but consistent increase in accuracy as a function of intertrial interval duration under the 2-sample procedure, but not under the trial-unique procedure.     

Putative behavioral history effects and aggression maintained by escape from therapists

Differentially higher rates of aggression in treatment sessions occurred in the presence of two staff members who had previously worked with the participant at another facility. Adding an edible reinforcer for compliance and the absence of aggression in sessions conducted by these two staff members decreased aggression to rates similar to those obtained with less familiar therapists. Results suggest that embedding positive reinforcement within a demand context may reduce the aversiveness of therapists correlated with a history of demand situations.     

Effects of response disparity on stimulus and reinforcer control in human detection tasks

In two detection experiments, university students reported whether the second of two sequentially presented tones was longer or shorter than the first by responding to stimuli presented on a touch screen. Stimulus disparity and response disparity were manipulated to compare their effects on measures of discrimination and response bias when the reinforcement ratio for correct responses was asymmetric. Choice stimuli consisted of squares filled with different pixel densities. Response disparity was manipulated by varying the difference in density between the two choice stimuli. In both experiments, decreasing stimulus disparity reduced discrimination but had no consistent effect on bias. Decreasing response disparity also reduced discrimination in both experiments, and often reduced estimates of bias. The effects of response disparity on bias were most clear in Experiment 2, in which a greater overall level of response disparity was arranged. The data show that, like corresponding research with pigeons, detection performance of human subjects can be conceptualized as discriminated operants.     

Drug-behavior interaction history: modification of the effects of morphine on punished behavior.

Squirrel monkeys were trained to respond under a multiple fixed-interval, fixed-interval schedule in which the first response after 5 min terminated a visual stimulus in the presence of which electric shocks could occur. During one component of the schedule, correlated with one color of stimulus lights, every 30th response also produced electric shock; responding was suppressed during this component to approximately 10 to 12% of that occurring in the alternate component in which responding was not punished. In contrast to previous research, morphine (0.03 to 1.0 mg/kg) increased punished responding. Unpunished responding, however, was either not affected or decreased at doses of morphine that increased punished responding. Increases in rate of punished responding also occurred when the single-schedule punishment condition was studied alone in these animals. Subsequent experimentation, which systematically analyzed the development of the rate-enhancing effects of morphine on punished responding, involved the study of drug effects in additional monkeys trained initially under a single-schedule punishment condition. The effects of morphine on punished responding were studied before, after, and then during exposure to the multiple schedule that included a component in which responding was not punished. Increases in response rate with morphine did not occur until it was administered during exposure to the multiple schedule that included a component in which responding was not punished. As with the other monkeys, once the rate increases in punished responding occurred under the multiple schedule, these effects of morphine persisted, even when the multiple schedule was removed.(ABSTRACT TRUNCATED AT 250 WORDS)     

Second-order schedules of token reinforcement with pigeons: effects of fixed- and variable-ratio exchange schedules

Pigeons' key pecks produced food under second-order schedules of token reinforcement, with light-emitting diodes serving as token reinforcers. In Experiment 1, tokens were earned according to a fixed-ratio 50 schedule and were exchanged for food according to either fixed-ratio or variable-ratio exchange schedules, with schedule type varied across conditions. In Experiment 2, schedule type was varied within sessions using a multiple schedule. In one component, tokens were earned according to a fixed-ratio 50 schedule and exchanged according to a variable-ratio schedule. In the other component, tokens were earned according to a variable-ratio 50 schedule and exchanged according to a fixed-ratio schedule. In both experiments, the number of responses per exchange was varied parametrically across conditions, ranging from 50 to 400 responses. Response rates decreased systematically with increases in the fixed-ratio exchange schedules, but were much less affected by changes in the variable-ratio exchange schedules. Response rates were consistently higher under variable-ratio exchange schedules than tinder comparable fixed-ratio exchange schedules, especially at higher exchange ratios. These response-rate differences were due both to greater pre-ratio pausing and to lower local rates tinder the fixed-ratio exchange schedules. Local response rates increased with proximity to food under the higher fixed-ratio exchange schedules, indicative of discriminative control by the tokens.     

Evaluating the effects of discriminability on behavioral persistence during and following time‐based reinforcement

With four children with autism we evaluated a refinement to time‐based reinforcement designed to reduce response persistence when we simultaneously introduced time‐based reinforcement and extinction. We further evaluated whether this refinement mitigated response recurrence when all reinforcer deliveries ceased during an extinction‐only disruptor phase. The refinement involved increasing the saliency of the contingency change from contingent reinforcement (during baseline) to time‐based reinforcement by delivering different colored reinforcers during time‐based reinforcement. Behavioral momentum theory predicts that increasing the discriminability of the change from variable‐interval to variable‐time reinforcement should lead to faster reductions in responding. We present data on four participants, three of whom displayed response patterns consistent with the predictions of behavioral momentum theory during time‐based reinforcement. However, the participants showed more varied patterns of recurrent behavior during extinction. We discuss these results within a translational research framework focusing on strategies used to mitigate treatment relapse for severe destructive behavior, as time‐based reinforcement is one of the most commonly prescribed interventions for destructive behavior displayed by individuals with intellectual and developmental disabilities.     

The effects of behavioral history on response acquisition with immediate and delayed reinforcement

Effects of prior exposure to the experimental chamber with levers present or absent and variable-time (VT) 60-s water deliveries arranged during one, five, or no 1-hr sessions were examined in rats during a 6-hr response-acquisition session in which presses on one lever produced water delivery immediately or after a 15-s resetting delay, and presses on the other lever canceled scheduled water deliveries. Response acquisition was (a) slower to occur when water deliveries were delayed, (b) most consistent in groups that had received five VT sessions, and (c) impaired by the presence of levers only when there had been five VT sessions and water deliveries were delayed during the acquisition session.