STEADY-STATE ASSESSMENT OF IMPULSIVE CHOICE IN LEWIS AND FISCHER 344 RATS: BETWEEN-CONDITION DELAY MANIPULATIONS

Previous research has shown that Lewis rats make more impulsive choices than Fischer 344 rats. Such strain-related differences in choice are important as they may provide an avenue for exploring genetic and neurochemical contributions to impulsive choice. The present systematic replication was designed to determine if these findings could be reproduced using a procedure less susceptible to within- or between-session carry-over effects that may have affected previous findings. Specifically, delays to the larger–later food reinforcer were manipulated between conditions following steady-state assessments of choice, and the order of delays across conditions was mixed. The results confirmed previous findings that Lewis rats made significantly more impulsive choices than Fischer 344 rats. Fischer 344 rats' preference for the larger–later reinforcer, on the other hand, was less extreme than reported in prior research, which may be due to carry-over effects inherent to the commonly used technique of systematically increasing delays within session. Previously reported across-strain motor differences were reproduced as Lewis rats had shorter latencies than Fischer 344 rats, although these latencies were not correlated with impulsive choice. Parallels between reduced dopamine function in Lewis rats and clinical reports of impulse-control disorders following treatment of Parkinson patients with selective D2/D3 dopamine agonists are discussed.     

DELAY‐AMOUNT TRADEOFFS IN CHOICES BY PIGEONS AND RATS: HYPERBOLIC VERSUS EXPONENTIAL DISCOUNTING

An adjusting‐delay procedure was used to study the choices of pigeons and rats when both delay and amount of reinforcement were varied. In different conditions, the choice alternatives included one versus two reinforcers, one versus three reinforcers, and three versus two reinforcers. The delay to one alternative (the standard alternative) was kept constant in a condition, and the delay to the other (the adjusting alternative) was increased or decreased many times a session so as to estimate an indifference point—a delay at which the two alternatives were chosen about equally often. Indifference functions were constructed by plotting the adjusting delay as a function of the standard delay for each pair of reinforcer amounts. The experiments were designed to test the prediction of a hyperbolic decay equation that the slopes of the indifference functions should increase as the ratio of the two reinforcer amounts increased. Consistent with the hyperbolic equation, the slopes of the indifference functions depended on the ratios of the two reinforcer amounts for both pigeons and rats. These results were not compatible with an exponential decay equation, which predicts slopes of 1 regardless of the reinforcer amounts. Combined with other data, these findings provide further evidence that delay discounting is well described by a hyperbolic equation for both species, but not by an exponential equation. Quantitative differences in the y‐intercepts of the indifference functions from the two species suggested that the rate at which reinforcer strength decreases with increasing delay may be four or five times slower for rats than for pigeons.     

A brief opportunity to run does not function as a reinforcer for mice selected for high daily wheel-running rates

Mice from replicate lines, selectively bred based on high daily wheel-running rates, run more total revolutions and at higher average speeds than do mice from nonselected control lines. Based on this difference it was assumed that selected mice would find the opportunity to run in a wheel a more efficacious consequence. To assess this assumption within an operant paradigm, mice must be trained to make a response to produce the opportunity to run as a consequence. In the present study an autoshaping procedure was used to compare the acquisition of lever pressing reinforced by the opportunity to run for a brief opportunity (i.e., 90 s) between selected and control mice and then, using an operant procedure, the effect of the duration of the opportunity to run on lever pressing was assessed by varying reinforcer duration over values of 90 s, 30 min, and 90 s. The reinforcement schedule was a ratio schedule (FR 1 or VR 3). Results from the autoshaping phase showed that more control mice met a criterion of responses on 50% of trials. During the operant phase, when reinforcer duration was 90 s, almost all control, but few selected mice completed a session of 20 reinforcers; however, when reinforcer duration was increased to 30 min almost all selected and control mice completed a session of 20 reinforcers. Taken together, these results suggest that selective breeding based on wheel-running rates over 24 hr may have altered the motivational system in a way that reduces the reinforcing value of shorter running durations. The implications of this finding for these mice as a model for attention deficit hyperactivity disorder (ADHD) are discussed. It also is proposed that there may be an inherent trade-off in the motivational system for activities of short versus long duration.     

Tests of behavioral-economic assessments of relative reinforcer efficacy II: economic complements

This experiment was conducted to test the predictions of two behavioral-economic approaches to quantifying relative reinforcer efficacy. The normalized demand analysis suggests that characteristics of averaged normalized demand curves may be used to predict progressive-ratio breakpoints and peak responding. By contrast, the demand analysis holds that traditional measures of relative reinforcer efficacy (breakpoint, peak response rate, and choice) correspond to specific characteristics of non-normalized demand curves. The accuracy of these predictions was evaluated in rats' responding for food or water: two reinforcers known to function as complements. Consistent with the first approach, predicted peak normalized response output values obtained under single-schedule conditions ordinally predicted progressive-ratio breakpoints and peak response rates obtained in a separate condition. Combining the minimum-needs hypothesis with the normalized demand analysis helped to interpret prior findings, but was less useful in predicting choice between food and water--two strongly complementary reinforcers. Predictions of the demand analysis had mixed success. Peak response outputs predicted from the non-normalized water demand curves were significantly correlated with obtained peak responding for water in a separate condition, but none of the remaining three predicted correlations was statistically significant. The demand analysis fared better in predicting choice--relative consumption of food and water under single schedules of reinforcement predicted preference under concurrent schedules significantly better than chance.     

Resurgence and downshifts in alternative reinforcement rate

Resurgence refers to an increase in a previously suppressed target behavior with a relative worsening of conditions for a more recently reinforced alternative behavior. This experiment examined the relation between resurgence and the magnitude of a reduction in the rate of reinforcement for the alternative behavior. Groups of both male and female rats initially pressed a target lever for food on a variable-interval (VI) 30-s schedule. In a second phase, responding to the target lever was extinguished for all groups and pressing an alternative lever was reinforced on a VI 10-s schedule. Next, the rate of reinforcement for alternative behavior was reduced differentially across groups by arranging extinction, VI 80-s, VI 40-s, VI 20-s, or continued VI 10-s reinforcement. Target responding increased as an exponential function of the magnitude of the reduction in alternative reinforcement rates. With the exception that males appeared to show higher rates of target responding in baseline and higher rates of alternative responding in other phases, the overall pattern of responding across phases was not meaningfully different between sexes. The pattern of both target and alternative response rates across sessions and phases was well described quantitatively by the Resurgence as Choice in Context model.     

Equal channel angular pressing of magnesium at room temperature: the effect of processing route on microstructure and texture

Various processing routes were applied to as-cast magnesium during equal channel angular pressing with back-pressure (BP) at room temperature (RT). Multiple passes with BP resulted in crack-free microstructures independent of the processing route. Microstructure and texture examination by electron backscatter diffraction and X-ray diffraction techniques after four passes revealed largely recrystallised grains. The most profound finding was the formation of special grain boundaries Σ13a and {10-12} twin boundaries during recrystallisation at RT.     

Human responding with mutual reinforcement: Baseline and effects of an intervention1

Pressing a key by one undergraduate provided another undergraduate with points exchangeable for money, and vice versa. Four types of response patterns were found. Points were often delivered with a delay from the last response or with no response. When a contingency that responses lost points (punishment) was added to participants who had emitted more responses than the partner had, their response rates decreased while the rates of their partners increased. These results demonstrate that, under the contingency of mutual reinforcement: (a) response patterns that had occurred between monkeys were replicated between humans; (b) obtained response‐reinforcer relations were different from those generally programmed in the basic reinforcement schedules; and (c) the behavior of the participant was controlled by changing the behavior of the partner.     

COMPARING PLEASURE AND PAIN: THE FUNDAMENTAL MATHEMATICAL EQUIVALENCE OF REWARD GAIN AND SHOCK REDUCTION UNDER VARIABLE INTERVAL SCHEDULES

The relationship between positive and negative reinforcement and the symmetry of Thorndike's law of effect are unresolved issues in operant psychology. Here we show that, for a given pattern of responding on variable interval (VI) schedules with the same programmed rate of food rewards (positive reinforcement VI) or electric shocks (negative reinforcement VI), there is a fundamental mathematical equivalence between reward gain and shock reduction. We also provide the first normative account of how animals should respond on a negative VI schedule, showing that it is better to space responses evenly than to respond with a variable interresponse time (IRT). Published data from rats, however, indicate that these animals respond irregularly, often with a burst of activity immediately following a shock. While this is irrational in the experimental setting, it may represent an appropriate response to the heterogeneity of stimuli commonly encountered in natural environments. We discuss the broader implications of our analysis for understanding how animals evaluate appetitive and aversive stimuli.