Effects of shifts in food reinforcement context on rats’ consumption of concurrently available water or sucrose solution

The purpose of this study was to investigate the effects of signaled transitions from relatively rich to lean conditions of food reinforcement on drinking concurrently available water or sucrose‐sweetened water in rats. Past research demonstrated that these negative incentive shifts produce behavioral disruption in the form of extended pausing on fixed‐ratio schedules. Four male Long‐Evans rats operated on a two‐component multiple fixed‐ratio fixed‐ratio schedule. In one manipulation, the ratio was held constant and the components arranged either a large six‐pellet reinforcer (rich) or small one‐pellet reinforcer (lean). In a second manipulation, the components both produced a one‐pellet reinforcer but differed in terms of the ratio requirement, with the rich and lean conditions corresponding to relatively small and large ratios. In both manipulations, components were pseudorandomly presented to arrange four transitions signaled by retractable levers: lean‐to‐lean, lean‐to‐rich, rich‐to‐rich, and rich‐to‐lean (the negative incentive shift). During experimental conditions, a bottle with lickometer was inserted in the chamber, providing concurrent access either to tap water or a 10% sucrose solution. The negative incentive shift produced considerably more drinking than the other transitions in all rats during both manipulations. The level of drinking was not polydipsic; rather, it appears that the negative incentive shift enhanced the value of concurrently available reinforcers relative to food reinforcement.     

Reinforcement value and fixed‐interval performance

The concept of reinforcement value summarizes the effect of different variables, such as reinforcement delay, reinforcement magnitude, and deprivation level, on behavior. In the present set of experiments, we evaluated the effect of reinforcement devaluation on performance under FI schedules. The literature on timing and reinforcement value suggests that devaluation generates longer expected times to reinforcement than the same intervals trained under control conditions. We devalued reinforcement with delay in Experiments 1A, 1B, and 2, and diminished deprivation in Experiments 3A and 3B. Devaluation reduced response rates, increased the number of one‐response intervals, and lengthened postreinforcement pauses, but had inconsistent effects on other timing measures such as quarter life and breakpoint. The results of delayed reinforcement and diminished deprivation manipulations are well summarized as reinforcement devaluation effects. These results suggest that devaluation may reduce stimulus control. In addition, we argue that the process by which delayed reinforcement affects behavior might also explain some effects observed in other devaluation procedures through the concept of reinforcement value.     

Avoidance of timeout from response-independent food: effects of delivery rate and quality

In three experiments, a rat's lever presses could postpone timeouts from food pellets delivered on response-independent schedules. In Experiment 1, the pellets were delivered at variable-time (VT) rates ranging from VT 0.5 to VT 8 min. Experiment 2 replicated the VT 1 min and VT 8 min conditions of Experiment 1 with new subjects. Finally, subjects in Experiment 3 could postpone timeouts from delivery of pellets that differed in quality rather than quantity (unsweetened versus sweetened pellets). In general, response rates and success in avoiding increased as a function of the rate and quality of the pellets. Also, performance efficiency increased as the experiments progressed, that is, the avoidance response occurred later and later in the response-timeout interval. The results support the conclusion that timeout from reinforcement has functional properties similar to those of more commonly studied aversive stimuli (e.g., shock).     

The effects of reinforcer magnitude on timing in rats

The relation between reinforcer magnitude and timing behavior was studied using a peak procedure. Four rats received multiple consecutive sessions with both low and high levels of brain stimulation reward (BSR). Rats paused longer and had later start times during sessions when their responses were reinforced with low-magnitude BSR. When estimated by a symmetric Gaussian function, peak times also were earlier; when estimated by a better-fitting asymmetric Gaussian function or by analyzing individual trials, however, these peak-time changes were determined to reflect a mixture of large effects of BSR on start times and no effect on stop times. These results pose a significant dilemma for three major theories of timing (SET, MTS, and BeT), which all predict no effects for chronic manipulations of reinforcer magnitude. We conclude that increased reinforcer magnitude influences timing in two ways: through larger immediate after-effects that delay responding and through anticipatory effects that elicit earlier responding.     

EFFECT OF REINFORCER MAGNITUDE ON PERFORMANCE MAINTAINED BY PROGRESSIVE‐RATIO SCHEDULES

This experiment examined the relationship between reinforcer magnitude and quantitative measures of performance on progressive‐ratio schedules. Fifteen rats were trained under a progressive‐ratio schedule in seven phases of the experiment in which the volume of a 0.6‐M sucrose solution reinforcer was varied within the range 6–300 μl. Overall response rates in successive ratios conformed to a bitonic equation derived from Killeen's (1994) Mathematical Principles of Reinforcement. The “specific activation” parameter, a, which is presumed to reflect the incentive value of the reinforcer, was a monotonically increasing function of reinforcer volume; the “response time” parameter, δ, which defines the minimum response time, increased as a function of reinforcer volume; the “currency” parameter, b, which is presumed to reflect the coupling of responses to the reinforcer, declined as a function of volume. Running response rate (response rate calculated after exclusion of the postreinforcement pause) decayed monotonically as a function of ratio size; the index of curvature of this function increased as a function of reinforcer volume. Postreinforcement pause increased as a function of ratio size. Estimates of a derived from overall response rates and postreinforcement pauses showed a modest positive correlation across conditions and between animals. Implications of the results for the quantification of reinforcer value and for the use of progressive‐ratio schedules in behavioral neuroscience are discussed.     

SINGLE‐SAMPLE DISCRIMINATION OF DIFFERENT SCHEDULES' REINFORCED INTERRESPONSE TIMES

Food‐deprived rats in Experiment 1 responded to one of two tandem schedules that were, with equal probability, associated with a sample lever. The tandem schedules' initial links were different random‐interval schedules. Their values were adjusted to approximate equality in time to completing each tandem schedule's response requirements. The tandem schedules differed in their terminal links: One reinforced short interresponse times; the other reinforced long ones. Tandem‐schedule completion presented two comparison levers, one of which was associated with each tandem schedule. Pressing the lever associated with the sample‐lever tandem schedule produced a food pellet. Pressing the other produced a blackout. The difference between terminal‐link reinforced interresponse times varied across 10‐trial blocks within a session. Conditional‐discrimination accuracy increased with the size of the temporal difference between terminal‐link reinforced interresponse times. In Experiment 2, one tandem schedule was replaced by a random ratio, while the comparison schedule was either a tandem schedule that only reinforced long interresponse times or a random‐interval schedule. Again, conditional‐discrimination accuracy increased with the temporal difference between the two schedules' reinforced interresponse times. Most rats mastered the discrimination between random ratio and random interval, showing that the interresponse times reinforced by these schedules can serve to discriminate between these schedules.     

Determinants of reinforcer accumulation during an operant task.

Responses by rats on an earn lever made available food pellets that were delivered to a food cup by responses on a second, collect, lever. The rats could either collect and immediately consume or accumulate (defined as the percentage of multiple earn responses and as the number of pellets earned before a collect response) earned pellets. In Experiment 1, accumulation varied as a function of variations in the earn or collect response requirements and whether the earn and collect levers were proximal (31 cm) or distal (248 cm) to one another. Some accumulation occurred under all but one of the conditions, but generally was higher when the earn and collect levers were distal to one another, particularly when the earn response requirement was fixed-ratio (FR) 1. In Experiment 2, the contributions of responses and time to accumulation were assessed by comparing an FR 20 earn response requirement to a condition in which only a single earn response was required at the end of a time interval nominally yoked to the FR interval. When 248 cm separated the earn and collect levers, accumulation was always greater in the FR condition, and it was not systematically related to reinforcement rate. In Experiment 3, increasing the earn response requirement with a progressive-ratio schedule that reset only with a collect response increased the likelihood of accumulation when the collect and earn levers were 248 cm apart, even though such accumulation increased the next earn response requirement. Reinforcer accumulation is an understudied dimension of operant behavior that relates to the analysis of such phenomena as hoarding and self-control, in that they too involve accumulating versus immediately collecting or consuming reinforcers.     

A pharmacological examination of the resistance-to-change hypothesis of response strength.

The effects of d-amphetamine sulfate, sodium pentobarbital, haloperidol, and cholecystokinin-octapeptide were examined within the context of Nevin's (1974, 1979) resistance-to-change hypothesis of response strength. In three experiments, rats' responding was reinforced by delivery of food under chained random-interval 30-s random-interval 30-s, multiple fixed-interval 30-s fixed-interval 120-s, or multiple random-interval 30-s random-interval 120-s schedules. Each rat received several doses of each drug and changes in response rate were measured. The resistance-to-change hypothesis predicts greater disruption of response rate relative to baseline in the initial component of the chained schedule and in the 120-s component of the multiple schedules. In the chained schedule cholecystokinin-octapeptide produced greater reductions in response rate relative to baseline in the initial component. However, no differences between components were observed with haloperidol or sodium pentobarbital, and high doses of d-amphetamine reduced response rate in the terminal component relatively more than in the initial component. In the multiple schedules either no differences were observed between components or response rate was reduced more relative to baseline in the 30-s component. The data fail to support the notion that drugs may be viewed within the same context as other response disruptors such as extinction, satiation, and the presentation of alternative reinforcement.     

Acquisition of lever-press responding in rats with delayed reinforcement: A comparison of three procedures

The present study examined the acquisition of lever pressing in rats under three procedures in which food delivery was delayed by 4, 8, and 16 seconds relative to the response. Under the nonresetting delay procedure, food followed the response selected for reinforcement after a specified interval elapsed; responses during this interval had no programmed effect. Under the resetting procedure, the response selected for reinforcement initiated an interval to food delivery that was reset by each subsequent response. Under the stacked delay procedure, every response programmed delivery of food t seconds after its occurrence. Two control groups were studied, one that received food immediately after each lever press and another that never received food. With the exception of the group that did not receive food, responding was established with every procedure at every delay value without autoshaping or shaping. Although responding was established under the resetting delay procedure, response rates were generally not as high as under the other two procedures. These findings support the results of other recent investigations in demonstrating that a response not previously reinforced can be brought to strength by delayed reinforcement in the absence of explicit training.