Impulsive choice and pre‐exposure to delays: iv. effects of delay‐ and immediacy‐exposure training relative to maturational changes in impulsivity

Impulsive choice describes preference for smaller, sooner rewards over larger, later rewards. Excessive delay discounting (i.e., rapid devaluation of delayed rewards) underlies some impulsive choices, and is observed in many maladaptive behaviors (e.g., substance abuse, gambling). Interventions designed to reduce delay discounting may provide therapeutic gains. One such intervention provides rats with extended training with delayed reinforcers. When compared to a group given extended training with immediate reinforcers, delay‐exposed rats make significantly fewer impulsive choices. To what extent is this difference due to delay‐exposure training shifting preference toward self‐control or immediacy‐exposure training (the putative control group) shifting preference toward impulsivity? The current study compared the effects of delay‐ and immediacy‐exposure training to a no‐training control group and evaluated within‐subject changes in impulsive choice across 51 male Wistar rats. Delay‐exposed rats made significantly fewer impulsive choices than immediacy‐exposed and control rats. Between‐group differences in impulsive choice were not observed in the latter two groups. While delay‐exposed rats showed large, significant pre‐ to posttraining reductions in impulsive choice, immediacy‐exposed and control rats showed small reductions in impulsive choice. These results suggest that extended training with delayed reinforcers reduces impulsive choice, and that extended training with immediate reinforcers does not increase impulsive choice.     

Reinforcement value and substitutability of sucrose and wheel running: implications for activity anorexia

Choice between sucrose and wheel-running reinforcement was assessed in two experiments. In the first experiment, ten male Wistar rats were exposed to concurrent VI 30 s VI 30 s schedules of wheel-running and sucrose reinforcement. Sucrose concentration varied across concentrations of 2.5, 7.5, and 12.5%. As concentration increased, more behavior was allocated to sucrose and more reinforcements were obtained from that alternative. Allocation of behavior to wheel running decreased, but obtained wheel-running reinforcement did not change. Overall, the results suggested that food-deprived rats were sensitive to qualitative changes in food supply (sucrose concentration) while continuing to defend a level of physical activity (wheel running). In the second study, 15 female Long Evans rats were exposed to concurrent variable ratio schedules of sucrose and wheel-running, wheel-running and wheel-running, and sucrose and sucrose reinforcement. For each pair of reinforcers, substitutability was assessed by the effect of income-compensated price changes on consumption of the two reinforcers. Results showed that, as expected, sucrose substituted for sucrose and wheel running substituted for wheel running. Wheel running, however, did not substitute for sucrose; but sucrose partially substituted for wheel running. We address the implications of the interrelationships of sucrose and wheel running for an understanding of activity anorexia.     

Fix and sample with rats in the dynamics of choice

The generality of the molar view of behavior was extended to the study of choice with rats, showing the usefulness of studying order at various levels of extendedness. Rats' presses on two levers produced food according to concurrent variable-interval variable-interval schedules. Seven different reinforcer ratios were arranged within each session, without cues identifying them, and separated by blackouts. To alternate between levers, rats pressed on a third changeover lever. Choice changed rapidly with changes in component reinforcer ratio, and more presses occurred on the lever with the higher reinforcer rate. With continuing reinforcers, choice shifted progressively in the direction of the reinforced lever, but shifted more slowly with each new reinforcer. Sensitivity to reinforcer ratio, as estimated by the generalized matching law, reached an average of 0.9 and exceeded that documented in previous studies with pigeons. Visits to the more-reinforced lever preceded by a reinforcer from that lever increased in duration, while all visits to the less-reinforced lever decreased in duration. Thus, the rats' performances moved faster toward fix and sample than did pigeons' performances in previous studies. Analysis of the effects of sequences of reinforcer sources indicated that sequences of five to seven reinforcers might have sufficed for studying local effects of reinforcers with rats. This study supports the idea that reinforcer sequences control choice between reinforcers, pulses in preference, and visits following reinforcers.     

Response acquisition and fixed-ratio escalation based on interresponse times in rats

The effectiveness of a fixed‐ratio (FR) escalation procedure, developed by Pinkston and Branch (2004) and based on interresponse times (IRTs), was assessed during lever‐press acquisition. Forty‐nine experimentally naïve adult male Long Evans rats were deprived of food for 24 hr prior to an extended acquisition session. Before the start of the session, three food pellets were placed in the magazine. Otherwise, no magazine training, shaping, nor autoshaping procedure was employed. The first 20 presses each resulted in the delivery of a 45‐mg food pellet. Then, the FR increased (2, 4, 8, 11, 16, 20, 25, 30) when each IRT in the ratio was less than 2 s during three consecutive ratios. Sessions lasted 13 hr or until 500 pellets were earned. On average, rats reached a terminal ratio of 11 (mean) or 16 (median) during the first session. Seven rats reached the maximum value of FR 30 and only one rat did not acquire the response. In most rats, a break‐and‐run pattern of responding characteristic of FR schedules began to develop in this acquisition session. Subsequently, the ratio‐escalation procedure continued during daily 2‐hr sessions. In these sessions, the starting ratio requirement was set at the terminal ratio reached in the previous session. Using this procedure, over half (26) of the rats reached the FR 30 requirement by the fourth session. These data demonstrate that a ratio‐escalation procedure based on IRTs provides a time‐efficient way of establishing ratio responding.     

Developmental Study of the Reversed Stroop Effect in Chinese-English Bilinguals

Chinese-English bilinguals in Grades 2, 4, 8, 10, and in college read Chinese and English color words in black or in colored print in the corresponding language. Subjects were more efficient in reading Chinese than English. This superiority effect of reading Chinese gradually decreased as subjects' familiarity with English increased. Furthermore, skilled readers were less susceptible than less skilled readers to the introduction of conflicting colors of ink. This result indicates that the pattern of the reversed Stroop (1935; Dunbar & MacLeod, 1984) effect is related to the proficiency of word processing.     

Response persistence under ratio and interval reinforcement schedules

In Experiment 1, rats were exposed to progressive-ratio schedules of food reinforcement while other rats were exposed simultaneously to yoked-interval schedules that arranged equivalent interreinforcer intervals but required only a single response at the end of the interval for food delivery. In Experiment 2, a within-subject yoked-control procedure was employed in which pigeons were exposed to alternating sessions (one per day) of progressive-ratio schedules and yoked-interval schedules as described above. In both experiments, responding under the yoked-interval schedule persisted beyond the point at which responding under the progressive-ratio schedule had ceased. The progressive-ratio schedules controlled break-and-run distributions, and the yoked-interval schedules controlled more even distributions of responses in time. Response rates decreased and postreinforcement pauses increased over time within individual sessions under both schedules. The results suggest that responding maintained by interval schedules is more persistent than that maintained by ratio schedules. The limitations and implications of this conclusion are discussed in the context of other investigations of response strength and behavioral momentum.     

Temporal control in rats: analysis of nonlocalized effects from short interfood intervals.

The present experiment analyzed temporal control of postreinforcement pause duration during within-session changes in the criterion for reinforcement (interfood interval, IFI). Analysis of interval-by-interval changes in the pause revealed localized and nonlocalized effects from short intervals that caused specific changes in performance. In Phase 1, rats were presented with five consecutive 15-s IFIs intercalated into a series of 60-s IFIs. The 15-s set decreased the pause in adjacent and more remote 60-s intervals. In Phase 2, two sets of 15-s intervals were intercalated. The spacing between the two sets varied so that 0, 5, 10, or 15 60-s IFIs separated the sets. The postreinforcement pause tracked all changes in the IFI duration, and the localized effect from a short set extended beyond the next interval to the next few 60-s IFIs. Effects from one set, however, did not combine with a second set: Changes in the pause after two sets were the same regardless of the spacing between sets.     

Second-order schedules of token reinforcement: effects of varying the schedule of food presentation

In the initial link of a complex schedule, one discriminative stimulus was presented and lever pressing produced tokens on fixed-ratio schedules. In the terminal link, signalled by a second discriminative stimulus, deposits of the tokens produced food. With two rats, the terminal link was presented after each sixth component schedule of token reinforcement was completed. With the other two rats, the terminal link was presented following the first component schedule completed after a fixed interval. During the terminal link, each token deposit initially produced food. The schedule of food presentation was subsequently increased such that an increasing number of token deposits in the terminal link was required for each food presentation. Rates of lever pressing in the initial link were inversely related to the schedule of food presentation in the terminal link. These results are similar to those of experiments that have varied schedules of food presentation in chained schedules. Rates and patterns of responding controlled throughout the initial link were more similar to those ordinarily controlled by second-order brief-stimulus schedules than to those controlled by comparable extended chained schedules.     

Effects of negative incentive shifts in food reward on rats' consumption of concurrent ethanol solutions

Frustration stress, typically operationalized as the unexpected loss of reinforcement, has been shown to engender substance use. Abrupt reductions in reinforcer magnitude likely also function as frustration stressors. These negative incentive shifts were previously shown to produce tap‐ and sweetened‐water drinking in rats. The purpose of this study was to investigate whether these shifts in food reward would occasion oral ethanol self‐administration. Nine male Long‐Evans rats operated on a two‐component multiple fixed‐ratio schedule with signaled components producing either a large (4 pellets) or small (1pellet) reinforcer. Components were pseudorandomly arranged to present 4 transitions between past and upcoming reinforcer magnitudes: small‐to‐large, small‐to‐small, large‐to‐large, and large‐to‐small (negative incentive shift). Experiment 1 investigated the effects of negative incentive shifts on consumption of concurrent, freely available 10% sucrose, 10% sucrose plus 10% ethanol, and following sucrose fading, 10% ethanol. Experiment 2 entailed continuation of schedule contingencies with a dose manipulation of 4 ethanol concentrations (0, 5, 10, and 20%) to assess dose‐dependent differences in transition‐type control and consumption. A lever‐press extinction condition was then conducted with 10% ethanol availability. In this novel model of frustration stress, negative incentive shifts prompted ethanol self‐administration at each dose investigated, whereas the other transitions did not.