Dynamic effects of food magnitude on interim-terminal interaction

We tested the assumption of a facilitatory relation between periodic food presentation and schedule-induced drinking by examination of (a) elicited drinking, (b) drinking in anticipation of food delivery, and (c) possible indirect effects of food delivery on drinking. We exposed rats to a fixed-time 60-second schedule in which interfood intervals ended in either one or four food pellets with equal probability. In Phases 1 and 3, a stimulus signaled the magnitude of upcoming food presentation. In Phase 2, the stimulus was eliminated. Changes in drinking and “head-in-feeder” distributions within interfood intervals demonstrated that head-in-feeder was controlled directly by food presentation, but drinking was not. Head-in-feeder increased and drinking was reduced when large meals began or ended an interval. In Phases 4 to 6, meal size was manipulated across sessions yielding a positive relation between meal size and schedule-induced drinking. We conclude: (1) Schedule-induced drinking is determined by distributions of food-related behavior and results from indirect effects of food delivery; and (2) the amount of schedule-induced drinking and the form of the drinking distributions in this experiment can be accurately explained by two assumptions: (a) Food presentation facilitates food-related behavior through elicitation and anticipation; and (b) food-related behavior and drinking are reciprocally, linearly related.     

Choice: Some quantitative relations

Six pigeons responded in fifty-six conditions on a concurrent-chains procedure. Conditions included several with equal initial links and unequal terminal links, several with unequal initial links and equal terminal links, and several with both unequal initial and terminal links. Although the delay-reduction hypothesis accounted well for choice when the initial links were equal (mean deviation of .04), it fit the data poorly when the initial links were unequal (mean deviation of .18). A modification of the delay-reduction hypothesis, replacing the rates of reinforcement with the square roots of these rates, fit the data better than either the unmodified delay-reduction equation or Killeen's (1982) model. The modified delay-reduction equation was also consistent with data from prior studies using concurrent chains. The absolute rates of responding in each terminal link were well described by the same hyperbola (Herrnstein, 1970) that describes response rates on simple interval schedules.     

Choice for aperiodic versus periodic ratio schedules: A comparison of concurrent and concurrent-chain procedures

Choice between mixed-ratio schedules, consisting of equiprobable ratios of 1 and 99 responses per reinforcement, and fixed-ratio schedules of food reinforcement was assessed by two commonly used procedures: concurrent schedules and concurrent-chains schedules. Rats were trained under concurrent fixed-ratio mixed-ratio schedules, in which both ratio schedules were simultaneously available, and under a concurrent-chains schedule, in which access to one of the mutually exclusive ratio schedules comprising the terminal links was contingent on a single “choice” response. The distribution of responses between the two ratio schedules was taken as the choice proportion under the concurrent procedure, and the distribution of “choice” responses was taken as the choice proportion under the concurrent-chains procedure. Seven of eight rats displayed systematic choice; of those, each displayed nearly exclusive choice for fixed-ratio 35 to the mixed-ratio schedule under the concurrent procedure, but each displayed nearly exclusive choice for the mixed-ratio schedule to fixed-ratio 35 under the concurrent-chains procedure. Thus, preference for a fixed or a mixed schedule of reinforcement depended on the procedure used to assess preference.     

Polydipsia induced by intermittent delivery of salted liquid foods

Food-deprived rats given constant access to water were exposed to fixed-time presentations of soybean milk and diluted sweetened condensed cows' milk. In some conditions these liquid foods were adulterated with varying amounts of sodium chloride. Under a fixed-time 30-sec schedule of food delivery, little water was consumed when the food was soybean milk alone, or soybean milk with sodium chloride added in concentrations of .9, 1.8, or 3.6%. However, schedule-induced polydipsia appeared when soybean milk adulterated with 7.2 or 14.4% sodium chloride was delivered under this schedule. When soybean milk containing 7.2% sodium chloride was presented under fixed-time 15-, 30-, 60-, 120-, and 240-sec schedules, schedule-induced drinking increased with the fixed-time value from 15 to 120 seconds, and decreased at 240 seconds. Like soybean milk, diluted sweetened condensed milk delivered under fixed-time schedules of 30, 60, and 120 seconds failed to evoke schedule-induced polydipsia, but did so when adulterated with 7.2% sodium chloride. Drinking induced by salted liquid foods resembled the polydipsia engendered by spaced dry-food presentations in several ways, including temporal relation to food delivery, persistence within and across sections, sensitivity to interfood interval, and magnitude relative to intake evoked by bulk-food presentation.     

Effects of ethanol on multiple fixed-interval fixed-ratio schedule performances: dynamic interactions at different fixed-ratio values.

Key pecking by three pigeons was maintained under a multiple fixed-interval fixed-ratio schedule of food presentation. The fixed-interval value remained at 3 minutes, while the fixed-ratio size was increased systematically in 30-response increments from 30 to either 120 (two pigeons) or 150 (one pigeon). At least two lower fixed-ratio values were also redetermined. The effects of ethanol (5 to 2.5 g/kg) were assessed at each of the different schedule parameters. Both overall and running response rates under the fixed-ratio schedule decreased with increases in the size of the fixed-ratio schedule; pause duration under the fixed-ratio schedule was directly related to increases in fixed-ratio size. Overall and running rates of responding under the fixed-interval schedule changed little with increases in the size of the fixed-ratio schedule. Despite the relative invariance of fixed-interval responding across the different fixed-ratio values, the effects of ethanol on responding under the fixed-interval schedule differed depending on the size of the fixed-ratio schedule. Greater increases occurred in both overall and in lower local rates of responding under the fixed-interval schedule when the fixed-ratio value was 120 or 150. The effects of ethanol on responding under the fixed-ratio schedule also depended on the size of the fixed ratio. Increases in responding under the fixed-ratio schedule were typically greater at the higher fixed-ratio values where response rates were lower. When the effects of ethanol were redetermined at the lower fixed-ratio parameter values, rates and patterns of responding were comparable to those obtained initially. However, the dose-effect curves for responding under both fixed-ratio and fixed-interval schedules were shifted up and to the right of those determined during the ascending series. The effects of ethanol can depend on rate or responding, behavioral history, and the context in which behavior occurs.     

Contingency and stimulus change in chained schedules of reinforcement

Higher rates of pecking were maintained by pigeons in the middle component of three-component chained fixed-interval schedules than in that component of corresponding multiple schedules (two extinction components followed by a fixed-interval component). This rate difference did not occur in equivalent tandem and mixed schedules, in which a single stimulus was correlated with the three components. The higher rates in components of chained schedules demonstrate a reinforcing effect of the stimulus correlated with the next component; the acquired functions of this stimulus make the vocabulary of conditioned reinforcement appropriate. Problems in defining conditioned reinforcement arise not from difficulties in demonstrating reinforcing effects but from disagreements about which experimental operations allow such reinforcing effects to be called conditioned.     

Toward a quantitative theory of punishment

In two experiments, pigeons' key pecking for food on concurrent variable-interval schedules was punished with electric shock according to concurrent variable-interval punishment schedules. With unequal frequencies of food but equal rates of punishment associated with the two keys and at several intensities of shock, the response and time allocation of all six pigeons overmatched the obtained relative frequency of food. The overmatching was predicted by a subtractive model of the interaction between punishment and positive reinforcement but not by two alternative models. Increases in the k and r_e parameters of the generalized matching law could not account for the observed shifts in preference.     

Fixed-interval matching-to-sample: intermatching time and intermatching error runs

Four pigeons were trained on a matching-to-sample task in which reinforcers followed either the first matching response (fixed interval) or the fifth matching response (tandem fixed-interval fixed-ratio) that occurred 80 seconds or longer after the last reinforcement. Relative frequency distributions of the matching-to-sample responses that concluded intermatching times and runs of mismatches (intermatching error runs) were computed for the final matching responses directly followed by grain access and also for the three matching responses immediately preceding the final match. Comparison of these two distributions showed that the fixed-interval schedule arranged for the preferential reinforcement of matches concluding relatively extended intermatching times and runs of mismatches. Differences in matching accuracy and rate during the fixed interval, compared to the tandem fixed-interval fixed-ratio, suggested that reinforcers following matches concluding various intermatching times and runs of mismatches influenced the rate and accuracy of the last few matches before grain access, but did not control rate and accuracy throughout the entire fixed-interval period.     

d-amphetamine and fixed-interval performance: effects of operant history.

Sixteen rats were initially exposed for 50 sessions to either a fixed-ratio 40 or an interresponse-time-greater-than-11-second food reinforcement schedule, then shifted to a fixed-interval 15-second food reinforcement schedule. Animals with fixed-ratio 40 histories lever pressed at much higher rates under the fixed-interval schedule than did animals with inter-response-time-greater-than-11-second histories. This difference persisted across 93 sessions of fixed-interval exposure. The effects of d=amphetamine were assessed after 15 and 59 sessions of fixed-interval exposure. On both occasions, the low-rate responding of animals with interresponse-time-greater-than-11-second histories was typically increased by all doses of the drug, while the high-rate responding of animals with fixed-ratio 40 histories was typically decreased by all doses of the drug. These results suggest that control response rate under the fixed-interval schedule, which may be affected by a history of responding under another schedule, is the primary determinant of the relative effects of d-amphetamine.     

Paired baseline performance as a behavioral ideal

Several recent theories view performance under the constraints of a schedule as an attempt to approach the basepoint, the total amount of the instrumental response and the total amount of the contingent response seen in the absence of schedule constraint. Some new analyses of experiments on concurrent ratio schedules, and simple ratio schedules offering an optional magnitude of contingent reward, tested this view directly. In each of the five experiments examined the organism rejected the chance of a closer approach to the basepoint, and thereby failed in addition to maximize the rate of reinforcement.