Delay and amount of reward in a concurrent chain

Eight pigeons responded under a concurrent-chain schedule for rewards differing in both delay and amount, the larger reward being associated with the longer delay. Preference was examined as the absolute durations of the terminal-link delays were increased at four different delay ratios. Difficulties with other experiments of this type were controlled for by the use of (a) a single-tape initial link to equalize terminal-link entries, (b) a blackout following the more immediate reward to equalize terminal-link length, and (c) a photocell to measure reinforcer duration more accurately. Preference for the larger reward changed systematically as delays increased in all conditions, decreasing for the 6:1, 3:1, and 3:2 ratios, and increasing for the 1:1 ratio. These results were similar to, but significantly different from, those of previous investigations. The implications of these results for various models of concurrent-chain behavior are discussed.     

Influences of delay and rate of reinforcement on discrete-trial choice

An adjusting procedure was used to measure pigeons' preferences among alternatives that differed in the duration of a delay before reinforcement and of an intertrial interval (ITI) after reinforcement. In most conditions, a peck at a red key led to a fixed delay, followed by reinforcement, a fixed ITI, and then the beginning of the next trial. A peck at a green key led to an adjustable delay, reinforcement, and then the next trial began without an ITI. The purpose of the adjusting delay was to estimate an indifference point, or a delay that made a subject approximately indifferent between the two alternatives. As the ITI for the red key increased from 0 s to 60 s, the green-key delay at the indifference point increased systematically but only slightly. The fact that there was some increase showed that pigeons' choices were controlled by more than simply the delay to the next reinforcer. One interpretation of these results is that besides delay of reinforcement, rate of reinforcement also influenced choice. However, an analysis that ignored reinforcement rate, but considered the delays between a choice response and the reinforcers on subsequent trials, was able to account for most of the obtained increases in green-key delays. It was concluded that in this type of discrete-trial situation, rate of reinforcement exerts little control over choice behavior, and perhaps none at all.     

Choice between rewards differing in amount and delay: Toward a choice model of self control

A concurrent-chain procedure was used to study pigeons' choices between rewards differing in both amount and delay. The shorter delay terminated with a 2-second access to grain whereas the longer delay terminated with a 6-second access to grain. The ratio of the delays was constant within a given condition while their absolute values were varied. Over conditions, ratios of 6:1, 3:1, and 3:2 were studied. As the absolute values of the delays to reinforcement increased, preference for the longer-delayed but larger reward decreased under both the 6:1 and 3:1 ratios, but increased under the 3:2 ratio. These results are inconsistent with choice models predicting no change in preference when the ratios of delays and amounts are held constant. In addition, the change in preference under the 3:1 ratio is inconsistent with a simple multiplicative interaction of the trade off between reinforcer amount and delay, and suggests that delay is a more potent determinant of choice than is amount. These results have implications for models that view choice between small immediate rewards and large but delayed rewards as underlying the behavior commonly called self control.     

Neurotoxicity of Kainate to the Hippocampus is not Accrued by Aging, Stress and Exogenous Corticosterone in Wistar Kyoto and Spontaneously Hypertensive Rats

It has been reported that a high corticosterone milieu can exacerbate various experimental insults to the nervous system, in particular to the hippocampus. However, in many of these studies the above milieu was attained by injecting corticosterone in doses (e.g. 10 mg/rat) producing supraphysiological concentrations. In the present study we have investigated whether high plasma corticosterone levels, such as those associated with aging or stress, potentiate a hippocampal excitotoxic insult. Male Wistar Kyoto (WKY) and Spontaneously Hypertensive Rats (SHR) at the age of 6, 12, 18 and 24 months (only WKY for the oldest age) were used. As in other strains, aging in these rats was marked by an increase in basal plasma corticosterone levels. Rats were infused in the dorsal hippocampus with kainic acid (0.035 μg/hippocampus) and the neuronal injury was evaluated within the areas CA3 and CA4. Results indicated that neither aging nor the hypertensive condition affected kainic acid neurotoxicity. In order to study the effect of stress, rats were stressed twice a day, with alternate types of stressors to avoid possible habituation, 3 days prior to and 3 days following the kainic acid infusion. Using this experimental paradigm the hippocampal damage in stressed rats was of the same degree as in non-stressed controls. In a complementary set of experiments, 6 month old WKY and SHR rats were injected with corticosterone (10 mg/rat s.c.). Four hours after administration plasma corticosterone levels in the range of 60-70 μg/100 ml were found. Moreover, a time-course study showed a plasma corticosterone peak in the range of 240 μg/100 ml. Daily corticosterone administration for 3 days before and 3 days after kainic acid infusion potentiated the hippocampal damage in 6 months old SHR but not in the WKY. These results demonstrate that elevation of corticosterone levels within physiological range does not exacerbate hippocampal kainate neurotoxicity and that pharmacological doses of glucocorticoid hormone, which produces plasma levels well above those observable in any physiopathological condition, might, with some strain dependency, potentiate a hippocampal neurotoxic insult.