Intertrial-interval effects on sensitivity (A') and response bias (B") in a temporal discrimination by rats.

Killeen and Fetterman's (1988) behavioral theory of animal timing predicts that decreases in the rate of reinforcement should produce decreases in the sensitivity (A') of temporal discriminations and a decrease in miss and correct rejection rates (decrease in bias toward "long" responses). Eight rats were trained on a 10- versus 0.1-s temporal discrimination with an intertrial interval of 5 s and were subsequently tested on probe days on the same discrimination with intertrial intervals of 1, 2.5, 5, 10, or 20 s. The rate of reinforcement declined for all animals as intertrial interval increased. Although sensitivity (A') decreased with increasing intertrial interval, all rats showed an increase in bias to make long responses.     

Relative sensitivity to reinforcer amount and delay in a self-control choice situation.

Rats were exposed to concurrent-chains schedules in which a single variable-interval schedule arranged entry into one of two terminal-link delay periods (fixed-interval schedules). The shorter delay ended with the delivery of a single food pellet; the longer day ended with a larger number of food pellets (two under some conditions and six under others). In Experiment 1, the terminal-link delays were selected so that under all conditions the ratio of delays would exactly equal the ratio of the number of pellets. But the absolute duration of the delays differed across conditions. In one condition, for example, rats chose between one pellet delayed 5 s and six pellets delayed 30 s; in another condition rats chose between one pellet delayed 10 s and six pellets delayed 60 s. The generalized matching law predicts indifference between the two alternatives, assuming that the sensitivity parameters for amount and delay of reinforcement are equal. The rats' choices were, in fact, close to indifference except when the choice was between one pellet delayed 5 s and six pellets delayed 30 s. That deviation from indifference suggests that the sensitivities to amount and delay differ from each other depending on the durations of the delays. In Experiment 2, rats chose between one pellet following a 5-s delay and six pellets following a delay that was systematically increased over sessions to find a point of indifference. Indifference was achieved when the delay to the six pellets was approximately 55 s. These results are consistent with the possibility that the relative sensitivities to amount and delay differ as a function of the delays.     

Behavioral contrast in rats with different reinforcers and different response topographies

Experiment I demonstrated positive behavioral contrast in rats when one of two qualitatively different reinforcers (milk and pellets) was removed from a component of a multiple schedule. The contrast effect was larger and more enduring when milk was removed. Experiment II showed that the rats spent more time on the side of a shuttle-box on which milk was freely available than on the side on which pellets were freely available. Experiment III, a partial replication of Experiment I, failed to demonstrate the contrast effect of Experiment I. Experiment IV demonstrated contrast when two topographically distinct responses, nose-key poking and lever pressing, were required in different components of a multiple schedule. These results extend the conditions that generate behavioral contrast in rats.     

Relative reinforcer magnitude under a nonindependent concurrent schedule of cocaine reinforcement in rhesus monkeys.

Lever pressing by three rhesus monkeys was maintained under a two-lever concurrent schedule of cocaine reinforcement. Responding on one lever (constant-dose lever) produced a constant dose of 0.05 or 0.1 mg/kg/injection arranged according to a variable-interval 1-min schedule. Responding on the other lever (variable-dose lever) produced a comparison dose of cocaine (0.013 to 0.8 mg/kg/injection), also under a variable-interval 1-min schedule. The two variable-interval schedules were made nonindependent by arranging that the assignment of a reinforcer by one schedule inactivated the second schedule until the assigned reinforcer had been obtained. This modification ensured that the two cocaine doses were obtained with approximately equal frequency, regardless of the distribution of the subject's responding. Preference, indicated by relative response frequency on the variable-dose lever, was almost always for the larger of the doses and was a monotonic function of the comparison dose, except at the highest doses. Preferences at the highest comparison doses may have resulted from the low overall response rates exhibited at these doses. Relative response frequencies on the variable-dose lever roughly matched relative reinforcer magnitude (mg/kg/injection available on the variable-dose lever divided by the sum of mg/kg/injections available on each lever).     

Steady-state performance on fixed-, mixed-, and random-ratio schedules

Three groups of rats pressed a lever for milk reinforcers on various simple reinforcement schedules (one schedule per condition). In Group M, each pair of conditions included a mixed-ratio schedule and a fixed-ratio schedule with equal average response:reinforcer ratios. On mixed-ratio schedules, reinforcement occurred with equal probability after a small or a large response requirement was met. In Group R, fixed-ratio and random-ratio schedules were compared in each pair of conditions. For all subjects in these two groups, the frequency distributions of interresponse times of less than one second were very similar on all ratio schedules, exhibiting a peak at about .2 seconds. For comparison, subjects in Group V responded on variable-interval schedules, and few interresponse times as short as .2 seconds were recorded. The results suggest that the rate of continuous responding is the same on all ratio schedules, and what varies among ratio schedules is the frequency, location, and duration of pauses. Preratio pauses were longer on fixed-ratio schedules than on mixed-ratio or random-ratio schedules, but there was more within-ratio pausing on mixed-ratio and random-ratio schedules. Across a single trial, the probability of an interruption in responding decreased on fixed-ratio schedules, was roughly constant on random-ratio schedules, and often increased and then decreased on mixed-ratio schedules. These response patterns provided partial support for Mazur's (1982) theory that the probability of instrumental responding is directly related to the probability of reinforcement and the proximity of reinforcement.     

Choice for aperiodic versus periodic ratio schedules: A comparison of concurrent and concurrent-chain procedures

Choice between mixed-ratio schedules, consisting of equiprobable ratios of 1 and 99 responses per reinforcement, and fixed-ratio schedules of food reinforcement was assessed by two commonly used procedures: concurrent schedules and concurrent-chains schedules. Rats were trained under concurrent fixed-ratio mixed-ratio schedules, in which both ratio schedules were simultaneously available, and under a concurrent-chains schedule, in which access to one of the mutually exclusive ratio schedules comprising the terminal links was contingent on a single “choice” response. The distribution of responses between the two ratio schedules was taken as the choice proportion under the concurrent procedure, and the distribution of “choice” responses was taken as the choice proportion under the concurrent-chains procedure. Seven of eight rats displayed systematic choice; of those, each displayed nearly exclusive choice for fixed-ratio 35 to the mixed-ratio schedule under the concurrent procedure, but each displayed nearly exclusive choice for the mixed-ratio schedule to fixed-ratio 35 under the concurrent-chains procedure. Thus, preference for a fixed or a mixed schedule of reinforcement depended on the procedure used to assess preference.     

Behavioral and dimensional contrast in rats.

Rats pressed a nose key for brain stimulation reinforcement presented on a fixed-interval schedule. Stimuli were drawn at random from a continuum of 12 white noise intensities in the range 62-95 decibels, spaced in 3 decibel steps. Experiment 1 varied the number of stimuli and the reinforcement contingencies associated with them. In Condition I (baseline) all stimuli signaled reinforcement; in Conditions II and III stimuli from one half of the continuum signaled reinforcement and those from the other half, extinction. However, in Condition II the 6 stimuli from the middle of the continuum were omitted. Experiment 2 held constant the number of stimuli and varied their spacing. In Condition I, each of 6 sounds signaled reinforcement. In Conditions II and II, three stimuli from one half of the continuum signaled reinforcement and three from the other half, extinction. However, in Condition II the stimuli were near the extremes of the continuum (Stimuli 1, 3, 4, 9, 10, 12). Condition III replaced Stimulus 3 with Stimulus 6 and Stimulus 10 with Stimulus 7. Behavioral contrast was seen in an increase over baseline in response rate to the stimuli associated with the constant schedule component when the variable component was changed to extinction. Dimensional contrast was seen in a further elevation of rate to intermediate positive stimulus values when stimuli were added to the border region between positive and negative values.     

Relationship between response rate and reinforcement frequency in variable-interval schedules: the effect of the concentration of sucrose reinforcement

Four rats were exposed to variable-interval schedules specifying a range of different reinforcement frequencies, using sucrose of two different concentrations and distilled water as the reinforcer. With sucrose, the rates of responding of all four rats were increasing negatively accelerated functions of reinforcement frequency, the data conforming closely to Herrnstein's equation; this was also true of the data from three of the four rats when distilled water was used as the reinforcer. The values of both constants in Herrnstein's equation were related to the sucrose concentration: the asymptotic response rate decreased, and the reinforcement frequency corresponding to the half-maximal response rate increased, with decreasing sucrose concentration.     

d-amphetamine and fixed-interval performance: effects of operant history.

Sixteen rats were initially exposed for 50 sessions to either a fixed-ratio 40 or an interresponse-time-greater-than-11-second food reinforcement schedule, then shifted to a fixed-interval 15-second food reinforcement schedule. Animals with fixed-ratio 40 histories lever pressed at much higher rates under the fixed-interval schedule than did animals with inter-response-time-greater-than-11-second histories. This difference persisted across 93 sessions of fixed-interval exposure. The effects of d=amphetamine were assessed after 15 and 59 sessions of fixed-interval exposure. On both occasions, the low-rate responding of animals with interresponse-time-greater-than-11-second histories was typically increased by all doses of the drug, while the high-rate responding of animals with fixed-ratio 40 histories was typically decreased by all doses of the drug. These results suggest that control response rate under the fixed-interval schedule, which may be affected by a history of responding under another schedule, is the primary determinant of the relative effects of d-amphetamine.     

Paired baseline performance as a behavioral ideal

Several recent theories view performance under the constraints of a schedule as an attempt to approach the basepoint, the total amount of the instrumental response and the total amount of the contingent response seen in the absence of schedule constraint. Some new analyses of experiments on concurrent ratio schedules, and simple ratio schedules offering an optional magnitude of contingent reward, tested this view directly. In each of the five experiments examined the organism rejected the chance of a closer approach to the basepoint, and thereby failed in addition to maximize the rate of reinforcement.