ISOLATING BEHAVIORAL MECHANISMS OF INTERTEMPORAL CHOICE: NICOTINE EFFECT ON DELAY DISCOUNTING AND AMOUNT SENSITIVITY

Many drugs of abuse produce changes in impulsive choice, that is, choice for a smaller—sooner reinforcer over a larger—later reinforcer. Because the alternatives differ in both delay and amount, it is not clear whether these drug effects are due to the differences in reinforcer delay or amount. To isolate the effects of delay, we used a titrating delay procedure. In phase 1, 9 rats made discrete choices between variable delays (1 or 19 s, equal probability of each) and a delay to a single food pellet. The computer titrated the delay to a single food pellet until the rats were indifferent between the two options. This indifference delay was used as the starting value for the titrating delay for all future sessions. We next evaluated the acute effects of nicotine (subcutaneous 1.0, 0.3, 0.1, and 0.03 mg/kg) on choice. If nicotine increases delay discounting, it should have increased preference for the variable delay. Instead, nicotine had very little effect on choice. In a second phase, the titrated delay alternative produced three food pellets instead of one, which was again produced by the variable delay (1 s or 19 s) alternative. Under this procedure, nicotine increased preference for the one pellet alternative. Nicotine‐induced changes in impulsive choice are therefore likely due to differences in reinforcer amount rather than differences in reinforcer delay. In addition, it may be necessary to include an amount sensitivity parameter in any mathematical model of choice when the alternatives differ in reinforcer amount.     

OBSERVING RESPONSES AND SERIAL STIMULI: SEARCHING FOR THE REINFORCING PROPERTIES OF THE S−

The control exerted by a stimulus associated with an extinction component (S−) on observing responses was determined as a function of its temporal relation with the onset of the reinforcement component. Lever pressing by rats was reinforced on a mixed random-interval extinction schedule. Each press on a second lever produced stimuli associated with the component of the schedule in effect. In Experiment 1 a response-dependent clock procedure that incorporated different stimuli associated with an extinction component of a variable duration was used. When a single S− was presented throughout the extinction component, the rate of observing remained relatively constant across this component. In the response-dependent clock procedure, observing responses increased from the beginning to the end of the extinction component. This result was replicated in Experiment 2, using a similar clock procedure but keeping the number of stimuli per extinction component constant. We conclude that the S− can function as a conditioned reinforcer, a neutral stimulus or as an aversive stimulus, depending on its temporal location within the extinction component.     

Effects of qualitatively different reinforcers on the parameters of the response-strength equation.

This experiment examined the relationship between two qualitatively different reinforcers and the parameters of a quantitative model of reinforced responding, referred to as the response-strength equation or the Herrnstein equation. A group of rats was first food deprived and later water deprived. An 11.5% sucrose solution served as the reinforcer in the food-deprivation condition, and water was the reinforcer in the water-deprivation condition. Each experimental session consisted of a series of seven variable-interval schedules, providing reinforcement rates that varied between 20 and 1,200 reinforcers per hour. The response rates increased in a negatively accelerating function in a manner consistent with the response-strength equation. This equation has two fitted parameters, k and Re. According to one theory, the k parameter is a measure of motor performance, and Re is indicative of the relative reinforcement efficacy of the background uncontrollable sources of reinforcement in relation to the experimentally arranged reinforcer. In this study, k did not change as a result of the different reinforcers, but Re was significantly larger in the sucrose-reinforcement condition. These results are consistent with the interpretation that k and Re measure two independent and experimentally distinguishable parameters and provide further evidence that absolute response rate is a function of relative reinforcement rate, as implied by the derivation of the response-strength equation based on the matching law.     

Effects of mesolimbic dopamine depletion on responding maintained by cocaine and food.

The hypothesis that mesolimbic dopamine is selectively involved in cocaine reinforcement was investigated in the rat. Animals were trained under a multiple schedule in which responding was reinforced by intravenous cocaine (0.75 mg/kg/injection) or food (45-mg pellets) under fixed-ratio 15 schedule requirements in alternate 30-min components of a 2-hr daily session. Infusion of the catecholaminergic neurotoxin 6-hydroxydopamine, but not the vehicle solution, into the region of the nucleus accumbens and olfactory tubercle produced selective reductions in cocaine self-administration without significantly altering responding maintained by food within the same sessions. This effect was reproduced in intact animals by substituting saline for cocaine in the self-administration component. These results support the hypothesis that the reinforcing effects of cocaine are dependent upon mesolimbic dopamine and demonstrate that cocaine self-administration can be disrupted in animals without altering behavior maintained by a nondrug reinforcer.     

Reinforcer magnitude (sucrose concentration) and the matching law theory of response strength

This experiment investigated the relationship between reinforcer magnitude (sucrose concentration) and response rate. The purpose was to evaluate the behavior of two parameters of an equation that predicts absolute response rate as a function of reinforcement rate and two free parameters. According to Herrnstein's (1970) theory of reinforced behavior, one parameter of this "response-strength equation" measures the efficacy of the reinforcer maintaining responding and the other parameter measures motoric components of response rate, such as response duration. Seven rats served as subjects. Experimental sessions consisted of a series of five different variable-interval schedules of reinforcement, each in effect for 5 minutes. Within each session, obtained reinforcement rates varied over more than a 30-fold range, from about 20 per hour to 700 per hour. The reinforcer was sucrose solution, and, between sessions, its concentration was varied from 0.0 to 0.64 molar (0 to 21.9%). For sucrose concentrations of 0.16 to 0.64 m, response rate was a negatively accelerated function of reinforcement rate. Increases in sucrose concentration increased response rates maintained by low but not high reinforcement rates. This pattern of changes corresponds to a change in the reinforcement-efficacy parameter of the response-strength equation. In contrast, the motor-performance parameter did not change as a function of sucrose concentration. These findings are inconsistent with the results of a similar study (Bradshaw, Szabadi, & Bevan, 1978) but support Herrnstein's theory of reinforced behavior.     

Effects of cocaine on simple reaction times and sensory thresholds in baboons.

The effects of chronic, daily administration of cocaine on auditory and visual reaction times and thresholds were studied in baboons. Single intramuscular injections of cocaine hydrochloride (0.1 to 5.6 mg/kg) were given once daily for periods of 10 to 25 days, and were followed immediately by psychophysical tests designed to assess cocaine's effects on simple reaction times as on auditory and visual threshold functions. Consistent reductions in reaction times were frequently observed over the cocaine dose range of 0.32 to 1.0 mg/kg; at higher doses, either decreases or increases in reaction times were observed, depending upon the animal. Lowered reaction times generally occurred immediately following the 1st day's cocaine injection, and continued through all subsequent days during the dose administration period, suggesting little development of tolerance or sensitivity to these reaction-time effects. Reaction-time decreases showed a U-shaped dose-effect function. The greatest decreases in reaction times occurred from 0.32 to 1.0 mg/kg, and produced an average reaction-time decrease of 10 to 12%. Concurrently measured auditory and visual thresholds showed no systematic changes as a function of cocaine dose. Pausing was observed during performance of the psychophysical tasks, with the length of total session pause times being directly related to cocaine dose.     

Body weight and response acquisition with delayed reinforcement.

The relation between body weight and responding established with unsignaled delayed reinforcement was investigated. In three experiments, naive rats were deprived to either 70%, 80%, or 90% of ad libitum weight and were then exposed to tandem variable-interval 15-s differential-reinforcement-of-other-behavior 30-s schedules. The tandem schedule defined a resetting unsignaled delay-of-reinforcement procedure. In the first experiment, speed of magazine training, acquisition of lever pressing, and final rate of lever pressing were related to body weight. In the next experiment, lever pressing was established and maintained in rats that were magazine trained at 70% of ad libitum weight but that were then exposed to the delay procedure at 90% of ad libitum weight. Responding did not change consistently either across or within subjects in subsequent conditions in which body weight was manipulated. In the final experiment, lever pressing was established and maintained with delayed reinforcement in the absence of magazine training for each of 2 rats at 70% and for 1 of 2 rats at 90% of ad libitum weight. The results further illuminate the conditions under which responding can be established in the absence of training and when such responses are reinforced only following an unsignaled delay period.     

Preference for signaled over unsignaled shock schedules: Ruling out asymmetry and response fixation as factors

Experiment 1 tested whether a “symmetrical” choice procedure yields results different from those previously reported using the “unidirectional” standard changeover procedure (e.g., Badia & Culbertson, 1972). Subjects could change at any time from unsignaled to signaled shock by pressing a lever and from signaled to unsignaled shock by pressing a second lever. Results were identical to those of the standard procedure and showed that the standard procedure is fully adequate. Experiment 2 tested whether choice of high density signaled shock over low-density unsignaled shock (Badia, Coker, & Harsh, 1973) resulted from initial training with equal-density schedules. Subjects were trained and tested with signaled shock twice as dense as unsignaled shock. Three of four subjects strongly preferred the signaled condition, thus ruling out carry-over and “response fixation” as alternative explanations.     

Signal modality and choice between signaled and unsignaled food

Choice between signaled and unsignaled response-independent food schedules was assessed in three experiments using a commitment procedure. In Experiment 1, subjects tested with a 5-s visual signal consistently changed from the signaled to the unsignaled schedule. Changing from the unsignaled to the signaled schedule was observed only occasionally and only at low levels. The same outcome was observed in Experiment 2 with different types of visual signals and with different stimulus combinations identifying the signal period, the signal-absent period, and the unsignaled schedule. In Experiment 3 the visual signal was replaced with an auditory signal for four of the subjects tested in Experiment 2. The subjects then changed from the unsignaled to the signaled schedule or showed a substantial reduction in choice for the unsignaled schedule. The data were assessed using a conditioned-reinforcement interpretation of choice.     

The magnitude-of-reinforcement function in closed and open economies.

It has been hypothesized that the magnitude-of-reinforcement effect may differ in closed and open experimental economies. We determined the relationship between magnitude of reinforcement and response rate in three feeding conditions: a closed economy in which total intake was unrestricted, a closed economy in which total intake was restricted so as to maintain body weight at 85% of free-feeding weight, and a traditional open economy in which subjects received food outside the experimental session. In the closed economies, regardless of body weight, the rats responded faster for smaller pellets and when the fixed ratio for pellets was higher. In the open economy, there was no reliable effect of pellet size or pellet cost on response rate. It is concluded that although there are circumstances in which response rate is an immediate function of the parameters of reinforcement, rate is not necessarily a measure of response strength. Response rate may instead, or additionally, contribute to a strategy of reducing the costs associated with resource utilization.