Tests of behavioral-economic assessments of relative reinforcer efficacy II: economic complements

This experiment was conducted to test the predictions of two behavioral-economic approaches to quantifying relative reinforcer efficacy. The normalized demand analysis suggests that characteristics of averaged normalized demand curves may be used to predict progressive-ratio breakpoints and peak responding. By contrast, the demand analysis holds that traditional measures of relative reinforcer efficacy (breakpoint, peak response rate, and choice) correspond to specific characteristics of non-normalized demand curves. The accuracy of these predictions was evaluated in rats' responding for food or water: two reinforcers known to function as complements. Consistent with the first approach, predicted peak normalized response output values obtained under single-schedule conditions ordinally predicted progressive-ratio breakpoints and peak response rates obtained in a separate condition. Combining the minimum-needs hypothesis with the normalized demand analysis helped to interpret prior findings, but was less useful in predicting choice between food and water--two strongly complementary reinforcers. Predictions of the demand analysis had mixed success. Peak response outputs predicted from the non-normalized water demand curves were significantly correlated with obtained peak responding for water in a separate condition, but none of the remaining three predicted correlations was statistically significant. The demand analysis fared better in predicting choice--relative consumption of food and water under single schedules of reinforcement predicted preference under concurrent schedules significantly better than chance.     

A Multiple Baseline Study of the Marriage Contract Game's Effect on Problem Solving and Affective Behavior

In a multiple-baseline design, four relatively untroubled couples were guided by the Marriage Contract Game and related instructions as they negotiated contracts. The results demonstrated generalization from clinic to home, and suggested that problem solving and affection are independent behavior domains. When problem-solving behavior was the target of intervention, the rate of problem-solving behavior increased significantly over baseline during generalization probes. When affective behavior was added as a target of training, the rate of affective behavior increased significantly over previous phases and the rate of problem solving continued to increase. Evidence about the interdependence of marital attitudes and behaviors also emerged. Subjective ratings of problems improved along with the increase in problem-solving behavior; mood ratings improved along with increases in problem-solving and in affective behavior. Training had no effect on ratings of marital happiness.     

COMPARING PLEASURE AND PAIN: THE FUNDAMENTAL MATHEMATICAL EQUIVALENCE OF REWARD GAIN AND SHOCK REDUCTION UNDER VARIABLE INTERVAL SCHEDULES

The relationship between positive and negative reinforcement and the symmetry of Thorndike's law of effect are unresolved issues in operant psychology. Here we show that, for a given pattern of responding on variable interval (VI) schedules with the same programmed rate of food rewards (positive reinforcement VI) or electric shocks (negative reinforcement VI), there is a fundamental mathematical equivalence between reward gain and shock reduction. We also provide the first normative account of how animals should respond on a negative VI schedule, showing that it is better to space responses evenly than to respond with a variable interresponse time (IRT). Published data from rats, however, indicate that these animals respond irregularly, often with a burst of activity immediately following a shock. While this is irrational in the experimental setting, it may represent an appropriate response to the heterogeneity of stimuli commonly encountered in natural environments. We discuss the broader implications of our analysis for understanding how animals evaluate appetitive and aversive stimuli.     

Effects of economy type and nicotine on the essential value of food in rats

The exponential demand equation proposed by Hursh and Silberberg (2008) provides an estimate of the essential value of a good as a function of price. The model predicts that essential value should remain constant across changes in the magnitude of a reinforcer, but may change as a function of motivational operations. In Experiment 1, rats' demand for food across a sequence of fixed-ratio schedules was assessed during open and closed economy conditions and across one- and two-pellet per reinforcer delivery conditions. The exponential equation was fitted to the relation between fixed-ratio size and the logarithm of the absolute number of reinforcers. Estimates of the rate of change in elasticity of food, the proposed measure of essential value, were compared across conditions. Essential value was equivalent across magnitudes during the closed economy, but showed a slight decrease across magnitudes during the open economy. Experiment 2 explored the behavioral mechanisms of nicotine's effects on consumption with the results from Experiment 1 serving as a within-subject frame of reference. The same subjects were administered nicotine via subcutaneously implanted osmotic minipumps at a dose of 3 mg/kg/day and exposed to both the one- and two-pellet conditions under a closed economy. Although nicotine produced large decreases in demand, essential value was not significantly changed. The data from the present experiments provide further evidence for the adequacy of the exponential demand equation as a tool for quantifying the rate of change in elasticity of a good and for assessing behavioral mechanisms of drug action.     

Effects of pre-trial response requirements on self-control choices by rats and pigeons

Parallel experiments with rats and pigeons examined whether the size of a pre-trial ratio requirement would affect choices in a self-control situation. In different conditions, either 1 response or 40 responses were required before each trial. In the first half of each experiment, an adjusting-ratio schedule was used, in which subjects could choose a fixed-ratio schedule leading to a small reinforcer, or an adjusting-ratio schedule leading to a larger reinforcer. The size of the adjusting ratio requirement was increased and decreased over trials based on the subject's responses, in order to estimate an indifference point-a ratio at which the two alternatives were chosen about equally often. The second half of each experiment used an adjusting-delay procedure-fixed and adjusting delays to the small and large reinforcers were used instead of ratio requirements. In some conditions, particularly with the reinforcer delays, the rats had consistently longer adjusting delays with the larger pre-trial ratios, reflecting a greater tendency to choose the larger, delayed reinforcer when more responding was required to reach the choice point. No consistent effects of the pre-trial ratio were found for the pigeons in any of the conditions. These results may indicate that rats are more sensitive to the long-term reinforcement rates of the two alternatives, or they may result from a shallower temporal discounting rate for rats than for pigeons, a difference that has been observed in previous studies.     

Drug discrimination: stimulus control during repeated testing in extinction

Rats were trained, under a two-lever drug-discrimination procedure, to respond differentially depending upon whether lorazepam (1.0 mg/kg) or no injection had been administered before the session. Responses on the appropriate lever produced a food pellet under a modified fixed-ratio (FR) 10 schedule, in which the 10 responses had to be emitted consecutively. In reinforcement tests, completing an FR 10 on either lever produced a pellet. In extinction tests, stimulus changes paired with reinforcement occurred but no pellet was delivered. Training sessions were conducted between test sessions. Each of four extinction phases consisted of six tests preceded by one stimulus (e.g., lorazepam). Repeated exposures to extinction reduced response rates for all rats, but stimulus control, as inferred from either percentage of total responses or percentage of total FR 10s on the drug-appropriate lever, remained high. The percentage of total FR 10s measure was less subject to skewing under low-rate conditions than was the percentage of total responses measure and provided an evaluation of stimulus control in terms of meeting the consecutive response contingency. These results demonstrate a level of independence between response rate and stimulus control in drug discrimination, which has positive implications for the validity of interpreting discriminative effects of novel test conditions in well-trained animals, even when overall response rates are low.     

Response acquisition under targeted percentile schedules: a continuing quandary for molar models of operant behavior.

The number of responses rats made in a "run" of consecutive left-lever presses, prior to a trial-ending right-lever press, was differentiated using a targeted percentile procedure. Under the nondifferential baseline, reinforcement was provided with a probability of .33 at the end of a trial, irrespective of the run on that trial. Most of the 30 subjects made short runs under these conditions, with the mean for the group around three. A targeted percentile schedule was next used to differentiate run length around the target value of 12. The current run was reinforced if it was nearer the target than 67% of those runs in the last 24 trials that were on the same side of the target as the current run. Programming reinforcement in this way held overall reinforcement probability per trial constant at .33 while providing reinforcement differentially with respect to runs more closely approximating the target of 12. The mean run for the group under this procedure increased to approximately 10. Runs approaching the target length were acquired even though differentiated responding produced the same probability of reinforcement per trial, decreased the probability of reinforcement per response, did not increase overall reinforcement rate, and generally substantially reduced it (i.e., in only a few instances did response rate increase sufficiently to compensate for the increase in the number of responses per trial). Models of behavior predicated solely on molar reinforcement contingencies all predict that runs should remain short throughout this experiment, because such runs promote both the most frequent reinforcement and the greatest reinforcement per press. To the contrary, 29 of 30 subjects emitted runs in the vicinity of the target, driving down reinforcement rate while greatly increasing the number of presses per pellet. These results illustrate the powerful effects of local reinforcement contingencies in changing behavior, and in doing so underscore a need for more dynamic quantitative formulations of operant behavior to supplement or supplant the currently prevalent static ones.