Molar versus local reinforcement probability as determinants of stimulus value.

During one component of a multiple schedule, pigeons were trained on a discrete-trial concurrent variable-interval variable-interval schedule in which one alternative had a high scheduled rate of reinforcement and the other a low scheduled rate of reinforcement. When the choice proportion between the alternatives matched their respective relative reinforcement frequencies, the obtained probabilities of reinforcement (reinforcer per peck) were approximately equal. In alternate components of the multiple schedule, a single response alternative was presented with an intermediate scheduled rate of reinforcement. During probe trials, each alternative of the concurrent schedule was paired with the constant alternative. The stimulus correlated with the high reinforcement rate was preferred over that with the intermediate rate, whereas the stimulus correlated with the intermediate rate of reinforcement was preferred over that correlated with the low rate of reinforcement. Preference on probe tests was thus determined by the scheduled rate of reinforcement. Other subjects were presented all three alternatives individually, but with a distribution of trial frequency and reinforcement probability similar to that produced by the choice patterns of the original subjects. Here, preferences on probe tests were determined by the obtained probabilities of reinforcement. Comparison of the two sets of results indicates that the availability of a choice alternative, even when not responded to, affects the preference for that alternative. The results imply that models of choice that invoke only obtained probability of reinforcement as the controlling variable (e.g., melioration) are inadequate.     

Successive negative contrast after partial reinforcement in the consummatory behavior of rats

Rats given access to a 32% sucrose solution later reject a 4% solution significantly more than controls that have only received the 4% solution. In Experiment 1, this consummatory successive negative contrast (cSNC) effect was attenuated by previous exposure to 50% partial reinforcement. Furthermore, recovery from cSNC was also facilitated by partial reinforcement. In Experiment 2, the attenuating effects of partial reinforcement on cSNC were eliminated by administration of the benzodiazepine anxiolytic chlordiazepoxide (5 mg/kg) before nonreinforced trials. In Experiment 3, the attenuating effect of partial reinforcement was greater after a shift from 32 to 6% solution, than after a shift from 32 to 2% solution. The parallels between the effects of partial reinforcement on consummatory and instrumental behavior are discussed.     

Weight reduction as a function of negative covert reinforcement (sensitization) versus positive covert reinforcement

The use of covert or imaginal procedures for weight reduction was evaluated using both positive covert reinforcement and negative (covert sensitization) in group treatment. The results indicate that both of these groups had significantly greater weight losses than a minimal treatment control group. Although the covert, positive reinforcement group did not significantly differ from the negative, its mean weight loss (in lbs) was greater at the end of the four week program. Both groups showed a further weight loss at a three month follow-up, although the changes in mean loss were not statistically significant. The control group, on the other hand, lost a significant amount of weight between the end of treatment and follow-up. However, at follow-up both positive and negative groups still had significantly greater weight losses than the control.     

Up or down: the influence of upcoming reinforcement on consummatory and operant behavior

Research has shown that animal subjects that are given a chance to consume a low-valued substance will consume less of it if a high-valued substance will soon be available than they would if the low-valued substance were to remain available (negative consummatory contrast). Research has also shown that subjects that lever press for a low-valued reinforcer will press the lever more often for that reinforcer if they will soon be able to lever press for a high-valued reinforcer than they would if they continue to press for the low-valued reinforcer (positive induction). The present study investigated these different changes in behavior across 3 experiments. The results suggest that the occurrence of contrast or induction does not depend on the type of substances that are used. We argue that further investigation of the contrast vs. induction issue is warranted because it has empirical, theoretical, and applied implications.     

Negative reinforcement as shock-frequency reduction

Is a conditioned aversive stimulus necessary in avoidance conditioning? Or is a reduction in the rate of aversive stimulation alone sufficient to generate and maintain an avoidance response? Rats were subjected to an avoidance procedure in which shocks occurred randomly in time, but a response could reduce the overall rate of shock. Fifteen acquisition curves, obtained from 16 animals, showed both immediate and delayed, rapid and gradual increases in response rate; there was no representative acquisition curve. Response rates were directly related to the amount by which the response reduced shock frequency. In extinction, when shock rates were not affected by responding, the response total was inversely related to the amount by which the response had reduced shock frequency during prior conditioning, with as many as 20,000 extinction responses when the shock frequency reduction had been relatively small. Responding on this procedure shows that avoidance conditioning can occur without benefit of either classical exteroceptive stimuli or covert stimuli inferred from the temporal constancies of a procedure. It also shows that reduction in shock rate is alone sufficient to maintain avoidance.     

Suppression of operant vs consummatory behavior

The magnitude and variability of conditioned suppression of bar pressing and dipper licking were compared. In two steady-state experiments, suppression of bar pressing was more profound and more stable from day to day. The two measures of suppression were uncorrelated as indexed by Pearson product-moment correlation coefficients computed for adjacent trials. Correlations within measures (internal consistency) were somewhat higher for the bar-press system except when a high proportion of rats completely suppressed on one of the correlated trials. In a transient state experiment in which possible adventitious punishment of both response systems was eliminated, suppression of bar pressing was again more profound and considerably slower to extinguish.     

Spontaneous recovery of consummatory behavior, but not of consummatory successive negative contrast

Five experiments were designed to study spontaneous recovery (SR) in two situations involving consummatory behavior: consummatory successive negative contrast (cSNC) and consummatory extinction (cE). SR of consummatory suppression should occur if incentive downshift induces an egocentric memory encoding information about the emotional reaction to the downshift that is counterconditioned or extinguished during exposure to the downshifted reward. SR of cSNC failed to occur after resting periods of 24, 96, or 336 h interpolated following complete (Experiment 1) and incomplete (Experiment 2) recuperation of consummatory behavior, and was not induced by the opioid-receptor antagonist naloxone (2 mg/kg), known to enhance cSNC (Experiment 3). However, SR of consummatory behavior occurred across sessions in cSNC (Experiment 3) and cE (Experiments 4-5). Furthermore, naloxone facilitated cE without affecting SR (Experiments 4-5). These results are discussed in relation to evidence for the development of an egocentric memory of the aversive downshift experience in consummatory situations.     

Measurement of consummatory behavior in honey bees

Consummatory behavior in honey bees can be measured by recording contact of the proboscis with sucrose solution in the food cup of an automatic feeder, and the behavior can be instrumentalized by arranging for contact of the proboscis with the food cup to activate the feeder. Illustrative free-operant and discrete-trials data are presented.     

Duration and rate of reinforcement as determinants of concurrent responding

The duration and frequency of food presentation were varied in concurrent variable-interval variable-interval schedules of reinforcement. In the first experiment, in which pigeons were exposed to a succession of eight different schedules, neither relative duration nor relative frequency of reinforcement had as great an effect on response distribution as they have when they are manipulated separately. These results supported those previously reported by Todorov (1973) and Schneider (1973). In a second experiment, each of seven pigeons was exposed to only one concurrent schedule in which the frequency and/or duration of reinforcement differed on the two keys. Under these conditions, each pigeon's relative rate of response closely matched the relative total access to food that each schedule provided. This result suggests that previous failures to obtain matching may be due to factors such as an insufficient length of exposure to each schedule or to the pigeons' repeated exposure to different concurrent schedules.     

Scaling relative incentive value in consummatory behavior

Surprising downshifts from more preferred (training incentive) to less preferred incentives (test incentive) are usually accompanied by emotional activation and suppression of conditioned behavior in rats. Two experiments were designed to determine whether consummatory behavior is similarly affected by downshifts of equal proportions. Within limits, the degree of consummatory responding during incentive downshift was similar with equal ratios of test concentration to training concentration. Thus, 32–4% and 16–2% downshifts (1:8 test/training ratios) caused similar levels of consummatory behavior, despite differences in the absolute concentrations of the solutions involved in the downshift. An interpretation based on sensory contrast was discarded because of the long intervals between training and test solutions (40 min and 24 h in Experiments 1 and 2, respectively). It is suggested that Weber’s law regulates behavioral suppression after reward downshifts. A theoretical framework for the interpretation of these data is presented.     

Matching as a multivariate power law: Frequency of behavior versus frequency and magnitude of reinforcement

Two groups of food-deprived rats responded for access to liquid reinforcers on a wide range of concurrent variable-interval schedules. During the first part of the experiment, one group chose between two different sucrose solutions; for a second group, the choice involved a sucrose solution and a solution of condensed milk. In the latter part of the experiment, the two groups chose between identical sucrose solutions. A variety of multivariate equations were applied to data obtained from both conditions. The best-fitting equation proved to be a multivariate power function, which is an extension of Herrnstein's basic matching law.