Secondary reinforcement and rate of primary reinforcement

Four pigeons were trained to peck at either of two response-keys. Pecking at either key occasionally produced a secondary reinforcer. Then, in the presence of the secondary reinforcer, further pecking occasionally produced the primary reinforcer, food. The relative rate at which each pigeon pecked to obtain a secondary reinforcer equalled the relative rate of primary reinforcement in its presence.     

Secondary reinforcement and number of primary reinforcements

Pigeons' pecks on either of two concurrently available response keys produced secondary reinforcers according to independent one-minute variable-interval schedules. Different secondary reinforcers, in the presence of which the rates of primary reinforcement were equal, were associated with each key. The rate of pecking maintained by each secondary reinforcer varied directly, but nonproportionally, with the number of primary reinforcements given in the presence of the secondary reinforcer.     

Synergistic effects of ethanol and cocaine on brain stimulation reward.

The effects of two widely abused drugs, ethanol and cocaine, were examined alone and in combination on intracranial reward processes. In agreement with previous research, higher doses of both cocaine and ethanol alone produced facilitation of behavior maintained by brain stimulation reward. Low intraperitoneal doses of ethanol and cocaine, which alone did not affect performance, were found to reduce stimulation reward threshold and modestly increase response rate. The enhancement of brain stimulation reward by the combination of ethanol and cocaine suggests that both drugs may produce their rewarding effects through common neuronal substrates and that they may potentiate the abuse of each other.     

Neuroleptic-induced attenuation of brain stimulation reward in rats.

In 30-min free-operant tests, the dopamine receptor blockers pimozide (.125, .25, and .50 mg/kg) and (+)-butaclamol (.1, .2, and .4 mg/kg) attenuated lever pressing for lateral hypothalamic brain stimulation. When discrete self-stimulation trials were offered in a straight alleyway, pimozide increased start box latencies, slowed running speeds, and reduced lever-pressing rates. However, performance early in both lever-pressing and runway sessions was normal; performance deteriorated as testing progressed, following patterns that paralleled those seen when animals were tested with reductions in the amplitude of stimulating current. Spontaneous recovery was obtained in both situations; experimenter-imposed 10-min time-outs caused renewed lever pressing and running. In contrast, alpha-noradrenergic receptor blockade by phenoxybenzamine (5, 10, and 20 mg/kg) failed to produce extinction-like response patterns. These data support the view that central dopaminergic systems are important components of the neural mechanisms mediating reward.     

On-line brain stimulation: Measurement of threshold of reinforcement

This program and interface for a small computer (PDP8/e) performs the following operations: generates and delivers constant current stimulation to the brain of an animal, monitors electrical resistance at the stimulating electrode, and calculates the threshold of reinforcement based upon the frequency of characteristic pauses in the animal’s responding.     

Polydipsia induced by a schedule of brain stimulation reinforcement

Rats pressed a lever for a signaled brain stimulation reinforcement on either fixed-interval or fixed-ratio schedules. Both schedules induced polydipsia, with a median water intake of 22.5 ml (about four times the control level) in 3-hr sessions. The stimulation did not directly elicit drinking or other behaviors. In a second experiment, two out of four rats became polydipsic during extinction following a continuous schedule of brain stimulation reinforcement. The results were compared with previous attempts to induce polydipsia with a schedule of brain stimulation reinforcement and were discussed in terms of polydipsia as a model of human “compulsive” behaviors.     

Partial reinforcement effects and type of reward

In two experiments 68 rats were trained to bar press or run down a straight runway for food or for water under conditions of either continuous reinforcement or partial reinforcement. In both experiments, there was greater persistence of behavior which had been reinforced with food than with water. In Expt 2, the partial reinforcement extinction effect (PREE) was observed with food reward, but not with water.Within the context of the experimental procedures used, it can be concluded that the rat has mechanisms for developing persistence which are dependent on the specific motivational system involved. This conclusion is related to theories of partial reinforcement effects and to possible biological origins of the mechanisms.     

Measuring threshold shifts for brain stimulation reward using the method of limits.

Thresholds determined from the frequency of pulses and the current for rewarding brain stimulation were obtained from rats with lateral hypothalamic electrodes. The threshold, defined as the frequency or current corresponding to one-half the maximum response rate, was interpolated from reward summation functions. Daily trials of both ascending and descending sequences of frequency and current yielded no significant difference between order of presentation. While there was more variability in the maximum response rates across the sessions, neither frequency- nor current-based threshold evaluations yielded significant rate effects. Our findings suggest that the threshold procedure is generally not influenced by the sequence of delivery of stimulus values and, thus, may be regarded as a reliable measure of the reinforcing properties of brain-stimulation reward.