Some effects of response-correlated increases in reinforcer magnitude on human behavior

After training under short or long fixed-interval schedules, humans responded under a modified fixed-interval schedule in which magnitude of reinforcement (X or 2X) was minimally correlated with response frequency. Response frequencies that equaled or exceeded a minimum response criterion were followed by the larger reinforcer at the end of the interval; otherwise, the smaller reinforcer was delivered. The modified schedule alternated with the baseline schedule across conditions. In a control condition, the reinforcer magnitudes produced by control subjects were yoked to those of experimental subjects. Experimental subjects, but not control subjects, showed increased responding. In addition to the baseline and modified fixed-interval schedules used in Experiment 1, subjects in Experiment 2 also responded under a second modified fixed-interval contingency in which increases in reinforcer magnitude were more highly correlated with response frequency. Experimental subjects, but not control subjects, showed increased responding under both procedures. Direct comparison of these two procedures showed that the high-correlation procedure produced greater increases in responding than did the low-correlation procedure.     

Response specificity in animal timing.

The stimuli that control responding in the peak procedure were investigated by training rats, in separate sessions, to make two different responses for food reinforcement. During one type of session, lever pressing was normally reinforced 32 s after the onset of a light. During the other type of session, chain pulling was normally reinforced either 8 s after the onset of one auditory cue or 128 s after the onset of a different auditory cue. For both types of sessions, only the appropriate manipulandum was available, and 20% of the trials lasted 240 s and involved no response-contingent consequences. Rats were then tested with the auditory cues in the presence of the lever and the light in the presence of the chain. If the time of reinforcement associated with each stimulus was learned, response rates should peak at these times during transfer testing. However, if a specific response pattern was learned for each stimulus, little transfer should occur. The results did not clearly support either prediction, leading to the conclusion that both a representation of the time of reinforcement and the rat's own behavior may control responding in this situation.     

Synergistic effects of ethanol and cocaine on brain stimulation reward.

The effects of two widely abused drugs, ethanol and cocaine, were examined alone and in combination on intracranial reward processes. In agreement with previous research, higher doses of both cocaine and ethanol alone produced facilitation of behavior maintained by brain stimulation reward. Low intraperitoneal doses of ethanol and cocaine, which alone did not affect performance, were found to reduce stimulation reward threshold and modestly increase response rate. The enhancement of brain stimulation reward by the combination of ethanol and cocaine suggests that both drugs may produce their rewarding effects through common neuronal substrates and that they may potentiate the abuse of each other.     

Effects of reinforcer magnitude on responding under differential-reinforcement-of-low-rate schedules of rats and pigeons

Experiment I investigated the effects of reinforcer magnitude on differential-reinforcement-of-low-rate (DRL) schedule performance in three phases. In Phase 1, two groups of rats (n = 6 and 5) responded under a DRI. 72-s schedule with reinforcer magnitudes of either 30 or 300 microl of water. After acquisition, the water amounts were reversed for each rat. In Phase 2, the effects of the same reinforcer magnitudes on DRL 18-s schedule performance were examined across conditions. In Phase 3, each rat responded unider a DR1. 18-s schedule in which the water amotnts alternated between 30 and 300 microl daily. Throughout each phase of Experiment 1, the larger reinforcer magnitude resulted in higher response rates and lower reinforcement rates. The peak of the interresponse-time distributions was at a lower value tinder the larger reinforcer magnitude. In Experiment 2, 3 pigeons responded under a DRL 20-s schedule in which reinforcer magnitude (1-s or 6-s access to grain) varied iron session to session. Higher response rates and lower reinforcement rates occurred tinder the longer hopper duration. These results demonstrate that larger reinforcer magnitudes engender less efficient DRL schedule performance in both rats and pigeons, and when reinforcer magnitude was held constant between sessions or was varied daily. The present results are consistent with previous research demonstrating a decrease in efficiency as a function of increased reinforcer magnituide tinder procedures that require a period of time without a specified response. These findings also support the claim that DRI. schedule performance is not governed solely by a timing process.     

Multiple determinants of the effects of reinforcement magnitude on free-operant response rates

Four experiments examined the effects of increasing the number of food pellets given to hungry rats for a lever-press response. On a simple variable-interval 60-s schedule, increased number of pellets depressed response rates (Experiment 1). In Experiment 2, the decrease in response rate as a function of increased reinforcement magnitude was demonstrated on a variable-interval 30-s schedule, but enhanced rates of response were obtained with the same increase in reinforcement magnitude on a variable-ratio 30 schedule. In Experiment 3, higher rates of responding were maintained by the component of a concurrent variable-interval 60-s variable-interval 60-s schedule associated with a higher reinforcement magnitude. In Experiment 4, higher rates of response were produced in the component of a multiple variable-interval 60-s variable-interval 60-s schedule associated with the higher reinforcement magnitude. It is suggested that on simple schedules greater reinforcer magnitudes shape the reinforced pattern of responding more effectively than do smaller reinforcement magnitudes. This effect is, however, overridden by another process, such a contrast, when two magnitudes are presented within a single session on two-component schedules.     

Further evaluation of reinforcer magnitude effects in noncontingent schedules

We closely replicated the procedures of a previous study that showed a positive relationship between reinforcer magnitude and the response-rate-reducing effects of noncontingent schedules (NCS). NCS reduced response rates, as expected, but the NCS-magnitude effect was not reproduced, illuminating possible weaknesses of current arbitrary-response procedures and suggesting avenues for future research.     

Observing behavior: effects of rate and magnitude of primary reinforcement

Four experiments examined the free-operant observing behavior of rats. In Experiment 1, observing was a bitonic function of random-ratio schedule requirements for the primary reinforcer. In Experiment 2, decreases in the magnitude of the primary reinforcer decreased observing. Experiment 3 examined observing when a random-ratio schedule or a yoked random-time schedule of primary reinforcement was in effect across conditions. Removing the response requirement for the primary reinforcer increased observing, suggesting that the effects of the random-ratio schedule in Experiment 1 likely were due to an interaction between observing and responding for the primary reinforcer. In Experiment 4, decreasing the rate of primary reinforcement by increasing the duration of a random-time schedule decreased observing monotonically. Overall, these results suggest that observing decreases with decreases in the rate or magnitude of the primary reinforcer, but that behavior related to the primary reinforcer can affect observing and potentially affect measurement of conditioned reinforcing value.     

Effects of food deprivation and reinforcement magnitude on conditioned suppression

In Experiment I, the responding of rats lever pressing on a variable-interval schedule for sucrose solution was partially suppressed by a variable duration conditioned stimulus followed by shock. When food deprivation was increased, response rates during and before the conditioned stimulus increased monotonically. Varying the concentration of sucrose across blocks of sessions or from session to session in a semi-random sequence had little effect on response rates either before or during the conditioned stimulus. With a fixed sequence of increasing concentrations across a five-session block, increased concentration produced much more rapid increases in response rates before than during the conditioned stimulus. In Experiment II, rats were presented with the same sequence of increasing concentrations across a five-session block. When tested at 80% body weight, response rates increased rapidly as concentration increased, but at 100%, body-weight rates increased only slightly. The effect of a change in body weight in Experiment II thus mimicked the effect of the conditioned stimulus in the latter part of Experiment I. These findings support the view that the effect of a pre-aversive conditioned stimulus is similar to that of a change in food deprivation, but unlike that of a change in reinforcement magnitude.     

Effects of negative incentive shifts in food reward on rats' consumption of concurrent ethanol solutions

Frustration stress, typically operationalized as the unexpected loss of reinforcement, has been shown to engender substance use. Abrupt reductions in reinforcer magnitude likely also function as frustration stressors. These negative incentive shifts were previously shown to produce tap‐ and sweetened‐water drinking in rats. The purpose of this study was to investigate whether these shifts in food reward would occasion oral ethanol self‐administration. Nine male Long‐Evans rats operated on a two‐component multiple fixed‐ratio schedule with signaled components producing either a large (4 pellets) or small (1pellet) reinforcer. Components were pseudorandomly arranged to present 4 transitions between past and upcoming reinforcer magnitudes: small‐to‐large, small‐to‐small, large‐to‐large, and large‐to‐small (negative incentive shift). Experiment 1 investigated the effects of negative incentive shifts on consumption of concurrent, freely available 10% sucrose, 10% sucrose plus 10% ethanol, and following sucrose fading, 10% ethanol. Experiment 2 entailed continuation of schedule contingencies with a dose manipulation of 4 ethanol concentrations (0, 5, 10, and 20%) to assess dose‐dependent differences in transition‐type control and consumption. A lever‐press extinction condition was then conducted with 10% ethanol availability. In this novel model of frustration stress, negative incentive shifts prompted ethanol self‐administration at each dose investigated, whereas the other transitions did not.     

Response acquisition and fixed-ratio escalation based on interresponse times in rats

The effectiveness of a fixed‐ratio (FR) escalation procedure, developed by Pinkston and Branch (2004) and based on interresponse times (IRTs), was assessed during lever‐press acquisition. Forty‐nine experimentally naïve adult male Long Evans rats were deprived of food for 24 hr prior to an extended acquisition session. Before the start of the session, three food pellets were placed in the magazine. Otherwise, no magazine training, shaping, nor autoshaping procedure was employed. The first 20 presses each resulted in the delivery of a 45‐mg food pellet. Then, the FR increased (2, 4, 8, 11, 16, 20, 25, 30) when each IRT in the ratio was less than 2 s during three consecutive ratios. Sessions lasted 13 hr or until 500 pellets were earned. On average, rats reached a terminal ratio of 11 (mean) or 16 (median) during the first session. Seven rats reached the maximum value of FR 30 and only one rat did not acquire the response. In most rats, a break‐and‐run pattern of responding characteristic of FR schedules began to develop in this acquisition session. Subsequently, the ratio‐escalation procedure continued during daily 2‐hr sessions. In these sessions, the starting ratio requirement was set at the terminal ratio reached in the previous session. Using this procedure, over half (26) of the rats reached the FR 30 requirement by the fourth session. These data demonstrate that a ratio‐escalation procedure based on IRTs provides a time‐efficient way of establishing ratio responding.     

Relative reinforcer magnitude under a nonindependent concurrent schedule of cocaine reinforcement in rhesus monkeys.

Lever pressing by three rhesus monkeys was maintained under a two-lever concurrent schedule of cocaine reinforcement. Responding on one lever (constant-dose lever) produced a constant dose of 0.05 or 0.1 mg/kg/injection arranged according to a variable-interval 1-min schedule. Responding on the other lever (variable-dose lever) produced a comparison dose of cocaine (0.013 to 0.8 mg/kg/injection), also under a variable-interval 1-min schedule. The two variable-interval schedules were made nonindependent by arranging that the assignment of a reinforcer by one schedule inactivated the second schedule until the assigned reinforcer had been obtained. This modification ensured that the two cocaine doses were obtained with approximately equal frequency, regardless of the distribution of the subject's responding. Preference, indicated by relative response frequency on the variable-dose lever, was almost always for the larger of the doses and was a monotonic function of the comparison dose, except at the highest doses. Preferences at the highest comparison doses may have resulted from the low overall response rates exhibited at these doses. Relative response frequencies on the variable-dose lever roughly matched relative reinforcer magnitude (mg/kg/injection available on the variable-dose lever divided by the sum of mg/kg/injections available on each lever).     

Confirmation of linear system theory prediction: Changes in Herrnstein's k as a function of changes in reinforcer magnitude

Eight human subjects pressed a lever on a range of variable-interval schedules for 0.25¢ to 35.0¢ per reinforcement. Herrnstein's hyperbola described seven of the eight subjects' response-rate data well. For all subjects, the y-asymptote of the hyperbola increased with increasing reinforcer magnitude and its reciprocal was a linear function of the reciprocal of reinforcer magnitude. These results confirm predictions made by linear system theory; they contradict formal properties of Herrnstein's account and of six other mathematical accounts of single-alternative responding.     

Effects of reinforcer probability, delay, and response requirements on the choices of rats and pigeons: possible species differences

In Experiment 1 with rats, a left lever press led to a 5-s delay and then a possible reinforcer. A right lever press led to an adjusting delay and then a certain reinforcer. This delay was adjusted over trials to estimate an indifference point, or a delay at which the two alternatives were chosen about equally often. Indifference points increased as the probability of reinforcement for the left lever decreased. In some conditions with a 20% chance of food, a light above the left lever was lit during the 5-s delay on all trials, but in other conditions, the light was only lit on those trials that ended with food. Unlike previous results with pigeons, the presence or absence of the delay light on no-food trials had no effect on the rats' indifference points. In other conditions, the rats showed less preference for the 20% alternative when the time between trials was longer. In Experiment 2 with rats, fixed-interval schedules were used instead of simple delays, and the presence or absence of the fixed-interval requirement on no-food trials had no effect on the indifference points. In Experiment 3 with rats and Experiment 4 with pigeons, the animals chose between a fixed-ratio 8 schedule that led to food on 33% of the trials and an adjusting-ratio schedule with food on 100% of the trials. Surprisingly, the rats showed less preference for the 33% alternative in conditions in which the ratio requirement was omitted on no-food trials. For the pigeons, the presence or absence of the ratio requirement on no-food trials had little effect. The results suggest that there may be differences between rats and pigeons in how they respond in choice situations involving delayed and probabilistic reinforcers.     

Characterization of the discriminative stimulus effects of lorcaserin in rats

Lorcaserin is approved by the Food and Drug Administration for treating obesity and is under consideration for treating substance use disorders; it has agonist properties at serotonin (5‐HT)_2C receptors and might also have agonist properties at other 5‐HT receptor subtypes. This study used drug discrimination to investigate the mechanism(s) of action of lorcaserin. Male Sprague–Dawley rats discriminated 0.56 mg/kg i.p. lorcaserin from saline while responding under a fixed‐ratio 5 schedule for food. Lorcaserin (0.178‐1.0 mg/kg) dose‐dependently increased lorcaserin‐lever responding. The 5‐HT_2C receptor agonist mCPP and the 5‐HT_2A receptor agonist DOM each occasioned greater than 90% lorcaserin‐lever responding in seven of eight rats. The 5‐HT_1A receptor agonist 8‐OH‐DPAT occasioned greater than 90% lorcaserin‐lever responding in four of seven rats. The 5‐HT_2C receptor selective antagonist SB 242084 attenuated lorcaserin‐lever responding in all eight rats and the 5‐HT_2A receptor selective antagonist MDL 100907 attenuated lorcaserin‐lever responding in six of seven rats. These results suggest that, in addition to agonist properties at 5‐HT_2C receptors, lorcaserin also has agonist properties at 5‐HT_2A and 5‐HT_1A receptors. Because some drugs with 5‐HT_2A receptor agonist properties are abused, it is important to fully characterize the behavioral effects of lorcaserin while considering its potential for treating substance use disorders.     

Effects of shifts in food reinforcement context on rats’ consumption of concurrently available water or sucrose solution

The purpose of this study was to investigate the effects of signaled transitions from relatively rich to lean conditions of food reinforcement on drinking concurrently available water or sucrose‐sweetened water in rats. Past research demonstrated that these negative incentive shifts produce behavioral disruption in the form of extended pausing on fixed‐ratio schedules. Four male Long‐Evans rats operated on a two‐component multiple fixed‐ratio fixed‐ratio schedule. In one manipulation, the ratio was held constant and the components arranged either a large six‐pellet reinforcer (rich) or small one‐pellet reinforcer (lean). In a second manipulation, the components both produced a one‐pellet reinforcer but differed in terms of the ratio requirement, with the rich and lean conditions corresponding to relatively small and large ratios. In both manipulations, components were pseudorandomly presented to arrange four transitions signaled by retractable levers: lean‐to‐lean, lean‐to‐rich, rich‐to‐rich, and rich‐to‐lean (the negative incentive shift). During experimental conditions, a bottle with lickometer was inserted in the chamber, providing concurrent access either to tap water or a 10% sucrose solution. The negative incentive shift produced considerably more drinking than the other transitions in all rats during both manipulations. The level of drinking was not polydipsic; rather, it appears that the negative incentive shift enhanced the value of concurrently available reinforcers relative to food reinforcement.     

Effects of social context, reinforcer probability, and reinforcer magnitude on humans' choices to compete or not to compete.

In the first two experiments, subjects' choices to earn points (exchangeable for money) either by competing with a fictitious opponent or by not competing were studied. Buskist, Barry, Morgan, and Rossi's (1984) competitive fixed-interval schedule was modified to include a second response option, a noncompetitive fixed-interval schedule. After choosing to enter either option, the opportunity for reinforcers became available after the fixed-interval's duration had elapsed. Under the no-competition condition, points were always available after the interval had elapsed. Under the competition condition, points were available based on a predetermined probability of delivery. Experiments 1 and 2 examined how reinforcer probabilities and reinforcer magnitudes affected subjects' choices to compete. Several general conclusions can be made about the results: (a) Strong preferences to compete were observed at high and moderate reinforcer probabilities; (b) competing was observed even at very low reinforcer probabilities; (c) response rates were always higher in the competition component than in the no-competition component; and (d) response rates and choices to compete were insensitive to reinforcer-magnitude manipulations. In Experiment 3, the social context of this choice schedule was removed to determine whether the high levels of competing observed in the first two experiments were due to a response preference engendered by the social context provided by the experimenters through instructions. In contrast to the first two experiments, these subjects preferred the 60-s fixed-interval schedule (formerly the no-competition option), indicating that the instructions themselves were responsible for the preference to compete. This choice paradigm may be useful to future researchers interested in the effects of other independent variables (e.g., drugs, social context, instructions) on competitive behavior.     

Cocaine and food as reinforcers: effects of reinforcer magnitude and response requirement under second-order fixed-ratio and progressive-ratio schedules.

Reinforcer magnitude and fixed-ratio requirement were varied under two second-order schedules. Under one, the first sequence of a fixed number of responses completed after the lapse of a 10-min fixed interval produced reinforcement. Under the second, a second-order progressive-ratio schedule, the fixed number of responses increased after each reinforcement. Either cocaine (0 to 300 micrograms/kg/inj) or food (0 to 5,700 mg/delivery) reinforcers were delivered. Under some conditions, a 2-s illumination of stimulus lights occurred on completion of each ratio sequence. Under the second-order schedule, as cocaine dose or amount of food increased, rates of responding increased; at the highest values, rates of responding decreased. Increases in the ratio requirement from 10 to 170 responses minimally decreased overall response rates. Under the second-order progressive-ratio schedule, increases in dose of cocaine or amount of food increased rates of responding; at the highest amounts of food, rates of responding decreased but response rates at the highest dose of cocaine remained relatively high. The highest ratio requirement that was completed (breaking point) depended on the dose of cocaine but was less dependent on the amount of food. Removing brief-stimulus presentations had a greater effect on completion of ratio requirements with cocaine compared to food.     

The effects of reinforcer magnitude in the preceding and upcoming ratios on between‐ratio pausing in multiple,mixed, and single fixed‐ratio schedules

Hens responded under multiple fixed‐ratio schedules with equal response requirements and either a 1‐s or a 6‐s reinforcer. Upcoming reinforcer size was indicated by key color. Components were presented in a quasirandom series so that all four component transitions occurred. Postreinforcement pauses were affected by the upcoming and preceding reinforcer size, with longer pauses after large reinforcers followed by small reinforcers than when followed by large ones, and longer pauses after small reinforcers that were followed by small reinforcers rather than large ones. Pauses increased with fixed‐ratio size and the effects of reinforcer size were larger the larger the ratio. When reinforcer size was not signaled—mixed fixed‐ratio schedules—pauses were shorter after small than after large reinforcers. Signalling the upcoming reinforcer attenuated the effect of the previous reinforcer size on pause duration when small was followed by small and when either small or large by large, but enhanced the effect when large was followed by small. There was no effect of reinforcer size on pause duration when single fixed‐ratio schedules were arranged. The effects of reinforcer size on pauses depends on the size and range of the fixed ratios as well as the exact procedures used in the study.     

Tests of behavioral-economic assessments of relative reinforcer efficacy II: economic complements

This experiment was conducted to test the predictions of two behavioral-economic approaches to quantifying relative reinforcer efficacy. The normalized demand analysis suggests that characteristics of averaged normalized demand curves may be used to predict progressive-ratio breakpoints and peak responding. By contrast, the demand analysis holds that traditional measures of relative reinforcer efficacy (breakpoint, peak response rate, and choice) correspond to specific characteristics of non-normalized demand curves. The accuracy of these predictions was evaluated in rats' responding for food or water: two reinforcers known to function as complements. Consistent with the first approach, predicted peak normalized response output values obtained under single-schedule conditions ordinally predicted progressive-ratio breakpoints and peak response rates obtained in a separate condition. Combining the minimum-needs hypothesis with the normalized demand analysis helped to interpret prior findings, but was less useful in predicting choice between food and water--two strongly complementary reinforcers. Predictions of the demand analysis had mixed success. Peak response outputs predicted from the non-normalized water demand curves were significantly correlated with obtained peak responding for water in a separate condition, but none of the remaining three predicted correlations was statistically significant. The demand analysis fared better in predicting choice--relative consumption of food and water under single schedules of reinforcement predicted preference under concurrent schedules significantly better than chance.