Stimulus control of behavioral history.

Pigeons were exposed to two different reinforcement schedules under different stimulus conditions in each of two daily sessions separated by 6 hr (Experiments 1 and 2) or in a single session (Experiment 3). Following this, either a fixed-interval (Experiment 1) or a variable-interval schedule (Experiments 2 and 3) was effected in both stimulus conditions. In the first two experiments, exposure to fixed-ratio or differential-reinforcement-of-low-rate schedules led to response-rate, but not pattern, differences in subsequent performance on fixed- or variable-interval schedules that persisted for up to 60 sessions. The effects of reinforcement-schedule history on fixed-interval schedule performance generally were more persistent. In Experiment 3, a history of high and low response rates in different components of a multiple schedule resulted in subsequent response-rate differences under identical variable-interval schedules. Higher response rates initially occurred in the component previously correlated with high response rates. For 3 of 4 subjects, the differences persisted for 20 or more sessions. Previous demonstrations of behavioral history effects have been confined largely to between-subject comparisons. By contrast, the present results demonstrate strong behavioral effects of schedule histories under stimulus control within individual subjects.     

Schedule control of the vocal behavior of Cebus monkeys

The vocal behavior of three Cebus monkeys was maintained by fixed-ratio schedules of response dependent reinforcement at values between fixed-ratio 1 and fixed-ratio 15. In one monkey that was exposed to variable-interval, fixed-interval, and conjunctive fixed-ratio fixed-interval schedules of reinforcement, vocal responding occurred at a low rate, but schedule-appropriate patterns were maintained. The rates and patterns of responding engendered indicated that the vocal operant can be brought under schedule control in the monkey by the use of response-dependent reinforcement.     

Effects of methadone on alternative fixed-ratio fixed-interval performance: latent influences on schedule-controlled responding.

Effects of methadone on pigeons' key pecking were examined under four conditions selected to analyze the control of behavior under alternative fixed-ratio fixed-interval schedules. In Condition 1, pigeons pecked under one of three different alternative schedules (alternative fixed-ratio 50 fixed-interval 90 s, alternative fixed-ratio 75 fixed-interval 90 s and alternative fixed-ratio 200 fixed-interval 90 s) each week. In Condition 2, fixed-ratio 50 or fixed-ratio 75 schedules were in effect during baseline sessions, and alternative fixed-ratio 50 fixed-interval 90-s or alternative fixed-ratio 75 fixed-interval 90-s schedules were in effect during sessions in which methadone was administered. In Condition 3, effects of methadone on key pecking maintained under fixed-ratio 50 and fixed-ratio 75 schedules were examined, whereas in Condition 4 the effects of methadone on key pecking under a fixed-interval 90-s schedule as well as fixed-ratio 50 and fixed-ratio 75 schedules were investigated. Control by the fixed-interval contingency was assessed by computing the proportion of total session reinforcers delivered under the fixed-interval schedule. Methadone administration (0.5-4.0 mg/kg) shifted the predominant source of schedule control under the alternative schedule from the fixed-ratio schedule to the fixed-interval contingency. This shift was dependent on methadone dose and fixed-ratio size. Control by the fixed-interval contingency was greatest following extensive exposure to the interval component embedded within the alternative schedule (Condition 1), but was apparent to a lesser degree with even very limited exposure to the alternative fixed-ratio fixed-interval schedule (Condition 2). Interreinforcement intervals comparable to those under fixed-interval schedule were not observed under the fixed-ratio schedules presented alone (Condition 3). Repeated exposure to the fixed-interval contingency outside the context of the alternative fixed-ratio fixed-interval schedule did not engender performance changes under a fixed-ratio schedule which would mimic those of increased fixed-interval contingency control (Condition 4). These data suggest that drug administration can be used to unmask the influence of contingencies that are latent under baseline conditions and reveal influences of both past and present environmental variables.     

Conditioned reinforcement versus time to reinforcement in chain schedules.

Pigeons were trained on three-component chain schedules in which the initial component was either a fixed-interval or variable-interval schedule. The middle and terminal components were varied among fixed-interval fixed-interval, variable-interval variable-interval, and an interdependent variable-interval variable-interval schedule in which the sum of the durations of the two variable-interval components was always equal to the sum of the fixed-interval fixed-interval components. At issue was whether the response rate in the initial component was controlled by its time to primary reinforcement or by the temporal parameters of the stimulus correlated with the middle terminal link. The fixed-interval initial-link schedule maintained much lower response rates than the variable-interval initial-link schedule regardless of the schedules in the middle and terminal links. Nevertheless, the intervening schedules played some role: With fixed-interval schedules in the initial links, response rates were consistently highest with independent variable-interval schedules in the middle and terminal links and intermediate with the interdependent variable-interval schedules; these initial-link differences were predicted by the response rates in the middle link of the chain. With variable-interval schedules in the initial links, response rates were lowest with the fixed-interval fixed-interval schedules following the initial link and were not systematically different for the two types of variable-interval variable-interval schedules. The results suggest that time to reinforcement itself accounts for little if any variance in initial-link responding.     

Schedule-induced defecation by rats during ratio and interval schedules of food reinforcement.

Lever pressing in rats was maintained by continuous and intermittent schedules of food while defecation was monitored. In Experiment 1, reinforcement densities were matched across variable-ratio and variable-interval schedules for three pairs of rats. Defecation occurred in all 3 rats on the variable-ratio schedule and in all 3 rats on the yoked variable-interval schedule. In Experiment 2, fixed-ratio and fixed-interval schedules with similar reinforcement densities maintained lever pressing. Defecation occurred in 3 of 4 rats on the fixed-ratio schedule and in 4 of 4 rats on the fixed-interval schedule. Almost no defecation occurred during continuous reinforcement in either experiment. These results demonstrate that defecation may occur during both ratio and interval schedules and that the inter-reinforcement interval is more important than the behavioral requirements of the schedule in generating schedule-induced defecation.     

Conjunctive schedules of reinforcement II: response requirements and stimulus effects

Responding of three pigeons was maintained under conjunctive fixed-ratio, fixed-interval schedules where a key peck produced food after both schedule requirements were completed. The individual schedule requirements were then successively removed and reinstated with responding maintained under the following conditions: conjunctive fixed-ratio, fixed-time; fixed-time; and fixed-interval schedules. Patterns of responding changed in accord with the successive removal of the schedule requirements. Compared to the conjunctive fixed-ratio, fixed-interval schedule, pause duration increased and response rate decreased under conjunctive fixed-ratio, fixed-time schedules and under fixed-time schedules alone. Overall mean rates of responding were highest and pause duration lowest under fixed-interval schedules. When changes in the keylight colors were correlated with completion of the fixed-ratio, the end of the fixed-interval, or both of these conditions, the pattern of responding was modified and indicated a greater degree of control by the individual schedules. Although two birds showed large increases in interreinforcement time when they were initially exposed to the conjunctive schedule, when responding stabilized this measure was largely invariant for all birds across most schedule conditions.     

Interlocking schedules: the relationship between response and time requirements.

Rats were exposed to an interlocking fixed-ratio 150 fixed-interval 5-minute schedule of food reinforcement and then to yoked variable-ratio schedules in which individual ratios corresponded exactly to the ratios of responses to reinforcement obtained on the interlocking schedule. After additional training with the interlocking schedule, the rats were exposed to yoked variable-interval schedules in which intervals corresponded to the intervals between successive reinforcements obtained on the second interlocking schedule. Response rates were highest in the yoked VR condition and lowest in the yoked VI, while intermediate rates characterized the interlocking schedule. Break-run patterns of responding were generated by the interlocking schedule for all subjects, while both the yoked VR and VI schedules produced comparatively stable local rates of responding. These results indicate that responding is sensitive to the interlocking schedule's inverse relationship between reinforcement frequency and responses per reinforcement.     

Preference for unsegmented interreinforcement intervals in concurrent chains

Five pigeons were trained under concurrent-chain schedules in which a pair of independent, concurrent variable-interval 60-s schedules were presented in the initial link and either both variable-interval or both fixed-interval schedules were presented in the terminal link. Except for the baseline, one of the terminal-link schedules was always a two-component chained schedule and the other was either a simple or a tandem schedule of equal mean interreinforcement interval. The values of the fixed-interval schedules were either 15 s or 60 s; that of the variable-interval schedules was always 60 s. A 1.5-s changeover delay operated during the initial link in some conditions. The pigeons preferred a simple or a tandem schedule to a chain. For the fixed-interval schedules, this preference was greater when the fixed interval was 60 s than when it was 15 s. For the variable-interval schedules, the preferences were less pronounced and occurred only when the changeover delay was in effect. For a given type of schedule and interreinforcement interval, similar preferences were obtained whether the nonchained schedule was a tandem or simple schedule. The changeover delay generally inflated preference and lowered the changeover rate, especially when the terminal-link schedules were either short (15 s) or aperiodic (variable-interval). The results were consistent with the notion that segmenting the interreinforcement interval of a schedule into a chain lowers the preference for it.     

Pentobarbital and d-amphetamine effects on concurrent performances.

The effects of pentobarbital and d-amphetamine were studied in pigeons responding under several concurrent fixed-ratio variable-interval and concurrent fixed-ratio fixed-interval schedules of food presentation. Drug effects were compared with different fixed ratios, fixed and variable intervals, changeover delays, and with the schedules operating singly. Doses of d-amphetamine that increased or did not affect responding under the interval schedules decreased responding under the fixed-ratio schedule, whereas doses of pentobarbital that increased responding under the fixed-ratio schedule decreased or eliminated responding under the interval schedules. These effects depended both on the schedule of food delivery and the parameters of schedules arranged concurrently. Pentobarbital increased responding under the fixed-ratio schedule with 4-minute and 10-minute interval schedules arranged concurrently, but not with 1.5-minute schedules. d-Amphetamine decreased concurrent ratio and interval responding with the 1.5-minute interval schedules, but either increased or did not affect responding with the longer intervals. Changes in the parameter of one schedule altered responding controlled by that schedule and also other concurrent performances. As a consequence, the effects of drugs on each behavior were altered.     

Tests of behavior momentum in simple and multiple schedules with rats and pigeons.

Four experiments examined the relationship between rate of reinforcement and resistance to change in rats' and pigeons' responses under simple and multiple schedules of reinforcement. In Experiment 1, 28 rats responded under either simple fixed-ratio, variable-ratio, fixed-interval, or variable-interval schedules; in Experiment 2, 3 pigeons responded under simple fixed-ratio schedules. Under each schedule, rate of reinforcement varied across four successive conditions. In Experiment 3, 14 rats responded under either a multiple fixed-ratio schedule or a multiple fixed-interval schedule, each with two components that differed in rate of reinforcement. In Experiment 4, 7 pigeons responded under either a multiple fixed-ratio or a multiple fixed-interval schedule, each with three components that also differed in rate of reinforcement. Under each condition of each experiment, resistance to change was studied by measuring schedule-controlled performance under conditions with prefeeding, response-independent food during the schedule or during timeouts that separated components of the multiple schedules, and by measuring behavior under extinction. There were no consistent differences between rats and pigeons. There was no direct relationship between rates of reinforcement and resistance to change when rates of reinforcement varied across successive conditions in the simple schedules. By comparison, in the multiple schedules there was a direct relationship between rates of reinforcement and resistance to change during most tests of resistance to change. The major exception was delivering response-independent food during the schedule; this disrupted responding, but there was no direct relationship between rates of reinforcement and resistance to change in simple- or multiple-schedule contexts. The data suggest that rate of reinforcement determines resistance to change in multiple schedules, but that this relationship does not hold under simple schedules.     

A comparison of ratio and interval reinforcement schedules with comparable interreinforcement times

Pigeons were trained to peck keys on fixed-ratio and fixed-interval schedules of food reinforcement. Both schedules produced a pattern of behavior characterized as pause and run, but the relation of pausing to time between reinforcers differed for the two schedules even when mean time between reinforcers was the same. Pausing in the fixed ratio occupied less of the time between reinforcers for shorter interreinforcer times. For two of three birds, the relation was reversed at longer interreinforcer times. As an interreinforcer time elapsed, there was an increasing tendency to return to responding for the fixed interval, but a roughly constant tendency to return to responding for the fixed-ratio schedule. In Experiment 1 these observations were made for both single-reinforcement schedules and multiple schedules of fixed-ratio and fixed-interval reinforcement. In Experiment 2 the observations were extended to a comparison of fixed-ratio versus variable-interval reinforcement schedules, where the distribution of interreinforcement times in the variable interval approximated that for the fixed ratio.     

Effects of variations in the temporal distribution of reinforcements on interval schedule performance

Pigeons were exposed to variable-interval and fixed-interval schedules and schedules approximating variable-interval and fixed-interval schedules. The probabilities of the variable-interval and fixed-interval components in a mixed fixed-interval variable-interval schedule in Experiment I and the minimum and maximum interreinforcement intervals in Experiment II in a variable-interval schedule were manipulated to create intermediate schedule contingencies and contingencies approximating simple variable-interval or fixed-interval contingencies. Maximal control by time as defined by quantitative indices of the temporal pattern of response occurred as fixed-interval contingencies were approximated and minimal control occurred as variable-interval contingencies were approximated. Changes in the temporal pattern of response were systematically related to changes in the temporal distribution of reinforcements with both procedural definitions for manipulating the temporal distribution of reinforcements.     

Neurochemical changes correlated with behavior maintained under fixed-interval and fixed-ratio schedules of reinforcement.

Key pecking of 4 pigeons was maintained under a multiple 3-min fixed-interval, 30-response fixed-ratio schedule of food presentation. Only one schedule was in effect during an experimental session, and each was correlated with a different keylight stimulus and location (left vs. right). The different schedule components alternated across days or weeks. Cerebrospinal fluid was collected from chronically implanted intracerebroventricular cannulae following sessions with the different schedules, as well as following sessions in which reinforcement was withheld (extinction), when response-independent food was delivered, and when the experimental chamber was dark and there were no scheduled events. Metabolites of the neurotransmitters serotonin, norepinephrine, and dopamine were assayed in cerebrospinal fluid using high-performance liquid chromatography with electrochemical detection. Compared to the fixed-ratio condition, responding maintained under the fixed-interval schedule resulted in consistently higher levels of the serotonin metabolite 5-hydroxyindoleacetic acid and of the dopamine metabolite homovanillic acid in all pigeons. Levels of 3-methoxy-4-hydroxyphenylethylene glycol, a metabolite of norepinephrine, and dihydroxyphenylacetic acid, another dopamine metabolite, were also higher in 3 of the 4 pigeons following exposure to the fixed-interval schedules when compared to levels of these metabolites after exposure to the fixed-ratio schedule. Extinction of fixed-ratio responding resulted in large increases in 5-hydroxyindoleacetic acid compared to levels of this metabolite under the fixed-ratio schedule, whereas this serotonin metabolite decreased during extinction of responding under the fixed-interval schedule. Control procedures suggested that the neurochemical changes were not related to the rate of responding but were a function of the specific experimental conditions. Distinctive neurochemical changes that accompany schedule-controlled responding show the sensitivity of the neurochemical environment to behavioral contingencies and demonstrate further the profound impact that such contingencies have on biobehavioral processes.     

Interaction of methadone, reinforcement history, and variable-interval performance.

In the present study, we examined how a reinforcement schedule history that generated high or low rates of responding influenced the effects of acute (Experiment 1) and chronic (Experiment 2) methadone administration. Initially, key-peck responses of pigeons were maintained under a variable-interval 90-s schedule of food presentation, and a methadone dose-response curve was determined with doses of 0.6, 1.2, and 2.4 mg/kg. The pigeons were then exposed, for at least 40 sessions, to either a fixed-ratio 50 schedule or a differential-reinforcement-of-low-rate 10-s schedule, or were given continued exposure to the variable-interval schedule. The methadone dose-response curve was redetermined after all pigeons again were responding under the variable-interval schedule. The effects of two different daily methadone doses (9.0 and 12.0 mg/kg/day) and withdrawal precipitated by naloxone also were assessed. Experience with a fixed-ratio or differential reinforcement of low rate schedule did not result in significantly different response rates under the variable-interval schedule and, in general, the acute effects of methadone did not have differential effects correlated with schedule history. However, for 2 of 4 subjects the rate-decreasing effects of methadone on rates of key pecking were greater following a history of low-rate responding, suggesting a possible interaction between schedule history and effects of methadone. Daily methadone administration under the variable-interval schedule revealed that pigeons with experience under the differential reinforcement of low rate schedule developed more rapid and complete tolerance to the rate-decreasing effects of methadone. Three of the 4 subjects in this group showed rate increases above drug-free baselines during chronic methadone dosing. Pigeons with a history of fixed-ratio responding also developed tolerance to the rate-decreasing effects of methadone but without the subsequent rate increases seen by subjects with low-rate histories. No subjects with variable-interval histories showed complete recovery of drug-free baselines, suggesting that interpolated training under other schedules may attenuate the rate-altering effects of chronically administered drugs. Naloxone (1.0 mg/kg), administered during the chronic methadone phase, resulted in greater disruption of responding by pigeons with a history of low-rate responding, as compared to subjects in the other two groups.(ABSTRACT TRUNCATED AT 400 WORDS)     

Performance in concurrent interval schedules

Four pigeons were trained under concurrent variable-interval variable-interval and fixed-interval variable-interval schedules in a two-key situation. Both response allocation and time allocation to the two schedules were measured when various reinforcement rates were arranged on each key. All animals showed an approximately constant proportional preference for the variable-interval schedule over the fixed-interval schedule. These results support Schneider's (1969) analysis of fixed-interval schedule performance.     

Transitivity as a property of choice

Pigeons' pecks in the presence of two concurrently available initial-link stimuli occasionally produced one of two stimuli associated with mutually exclusive terminal links. Pecks during either terminal link produced food according to aperiodic (variable-interval and variable-ratio) or periodic (fixed-interval and fixed-ratio) schedules of reinforcement. Aperiodic and periodic schedules to which the pigeons were indifferent, in the sense that these schedules maintained equal responding in the initial links, often yielded different preferences in separate choice tests with a third schedule. Conversely, aperiodic and periodic schedules that were equally preferred to a third schedule often failed to generate indifference. These intransitivities imply that (1) aperiodic and periodic schedules are not functionally equivalent in their effects upon choice, and (2) efforts to find a simple method for transforming aperiodic schedules into their periodic equivalents will fail.     

Combining stimuli signalling response-dependent food and shock

Three rats were exposed to a multiple schedule in which separate presentations of light and tone alternated with periods during which light and tone were absent. In Phase 1, light and tone each signalled identical variable-interval schedules of food delivery. In Phase 2, light and tone signalled separate but concurrent variable-interval schedules of food and shock delivery. In both phases, the absence of light and tone was associated with the differential reinforcement of other behavior. Test presentations of light, tone, and a light-plus-tone combination indicated that in both phases, light-plus-tone controlled higher response rates than either light or tone alone. The combination continued to control enhanced responding even when the test stimuli signalled variable-interval schedules of food and fixed-ratio schedules of shock. In these latter sessions, enhanced control by the combination increased shock frequency with no corresponding change in food frequency. Apparently, the level of behavior controlled by the absence of two single stimuli may be more important than the consequences of responding in determining the effects of combined-stimulus presentations.     

The effect of punishment shock intensity upon responding under multiple schedules

In the first of two experiments, responses of two pigeons were maintained by multiple variable-interval, variable-ratio schedules of food reinforcement. Concurrent punishment was introduced, which consisted of a brief electric shock after each tenth response. The initial punishment intensities had no lasting effect upon responding. Then, as shock intensity increased, variable-ratio response rates were suppressed more quickly than variable-interval response rates. When shock intensity decreased, variable-interval responding recovered more quickly, but the rates under both schedules eventually returned to their pre-punishment levels. In the second experiment, the following conditions were studied in three additional pigeons: (1) With each shock intensity in effect for a number of sessions, punishment shock intensity was gradually increased and decreased and responding was maintained by multiple variable-ratio, fixed-ratio schedules of food reinforcement; (2) Changes in punishment shock intensity as described above with responding maintained by either a variable-ratio or a fixed-ratio schedule, which were presented on alternate days; (3) Session-to-session changes in shock intensity with responding maintained by multiple variable-ratio, fixed-ratio schedules. Responding under the two schedules was suppressed to approximately the same extent by a particular shock intensity. Also, post-reinforcement pauses under the fixed-ratio schedule increased as response suppression increased.     

The effects of terminal-link fixed-interval and variable-interval schedules on responding under concurrent chained schedules

Previous work using variable-interval schedules in the terminal links of concurrent chained schedules suggested that relative choice proportion in the initial links equalled relative rate of reinforcement in the terminal links. With fixed-interval terminal-link schedules, however, matching was not obtained. The present study held pairs of fixed-interval terminal-link schedules in a constant ratio but varied absolute sizes. Relative choice for the smaller terminal-link fixed-interval schedule was a negatively accelerated, increasing function of absolute size of the fixed-interval pairs. Matching was found only with the fixed-interval pair of 5 and 10 sec. When pairs of variable-interval schedules were arranged so that the harmonic mean of the intervals equalled the fixed-interval parameter values, relative choice functions were like those for fixed-interval schedules.     

Continuous, fixed-ratio, and fixed-interval reinforcement in honey bees

Bees learned to enter a Plexiglas tube and to suck small portions of sugar solution; every entry or every fifth entry was reinforced. During an extinction phase, the bees on the fixed-ratio schedule emitted twice as many responses as did those given continuous reinforcement. Bees on a fixed-interval schedule of reinforcement emitted lower response rates than did those given fixed-ratio reinforcement. By extending the conditioning procedure for several days, it was possible to maintain responding with fixed-ratio schedules requiring 30 responses per reinforcement and with fixed-interval values up to 90 sec. Under fixed-interval schedules, response rates did not increase toward the end of the reinforcement intervals.