Delay discounting of qualitatively different reinforcers in rats

Humans discount larger delayed rewards less steeply than smaller rewards, whereas no such magnitude effect has been observed in rats (and pigeons). It remains possible that rats' discounting is sensitive to differences in the quality of the delayed reinforcer even though it is not sensitive to amount. To evaluate this possibility, Experiment 1 examined discounting of qualitatively different food reinforcers: highly preferred versus nonpreferred food pellets. Similarly, Experiment 2 examined discounting of highly preferred versus nonpreferred liquid reinforcers. In both experiments, an adjusting-amount procedure was used to determine the amount of immediate reinforcer that was judged to be of equal subjective value to the delayed reinforcer. The amount and quality of the delayed reinforcer were varied across conditions. Discounting was well described by a hyperbolic function, but no systematic effects of the quantity or the quality of the delayed reinforcer were observed.     

Summation of response rates to discriminative stimuli associated with qualitatively different reinforcers

In Experiment I, a four-ply multiple schedule was used to study the effects on rate of responding in rats of food, water, and food and/or water reinforcement under different deprivation conditions. Food and water were associated separately with different stimuli, the combination of which was associated with food and water together, or with food or water randomly. Rates in the presence of the combined stimuli were consistently intermediate to the rates generated by the separate stimuli, a result seemingly incompatible with a "summation" hypothesis. Experiment II was a simplified systematic replication of Experiment I, verifying the major findings.     

Effects of qualitatively different reinforcers on the parameters of the response-strength equation.

This experiment examined the relationship between two qualitatively different reinforcers and the parameters of a quantitative model of reinforced responding, referred to as the response-strength equation or the Herrnstein equation. A group of rats was first food deprived and later water deprived. An 11.5% sucrose solution served as the reinforcer in the food-deprivation condition, and water was the reinforcer in the water-deprivation condition. Each experimental session consisted of a series of seven variable-interval schedules, providing reinforcement rates that varied between 20 and 1,200 reinforcers per hour. The response rates increased in a negatively accelerating function in a manner consistent with the response-strength equation. This equation has two fitted parameters, k and Re. According to one theory, the k parameter is a measure of motor performance, and Re is indicative of the relative reinforcement efficacy of the background uncontrollable sources of reinforcement in relation to the experimentally arranged reinforcer. In this study, k did not change as a result of the different reinforcers, but Re was significantly larger in the sucrose-reinforcement condition. These results are consistent with the interpretation that k and Re measure two independent and experimentally distinguishable parameters and provide further evidence that absolute response rate is a function of relative reinforcement rate, as implied by the derivation of the response-strength equation based on the matching law.     

Preference reversals with food and water reinforcers in rats

Rats were given a choice between a smaller, immediately available reward and a larger reward available after a delay. In one phase, the reward was food and in another phase, the reward was water. Constant delays were added between the choice presentation and the delivery of the reward alternatives. As the time between choice and reward delivery increased from 0 to 25 s, all rats (except one in the water phase) reversed their preference from the smaller, sooner alternative to the larger, later alternative. These findings extend the generality of the preference-reversal animal model to qualitatively different reinforcers. Furthermore, the presence of both impulsive and self-control choices within the same animal is consistent with the view that self-control may be understood as choice behavior, and that species differences in self-control may be differences in degree, not kind.     

Preference for reinforcers under varying schedule arrangements: A behavioral economic analysis

The field of behavioral economics combines concepts from economics and operant conditioning to examine the influence of schedules or price on preference for reinforcers. Three case studies are reported in which behavioral economic analyses were used to assess relative preference for reinforcers shown by people with intellectual disabilities when schedule requirements varied. The studies examined (a) preference for different reinforcers, (b) substitutability of reinforcers, and (c) changes in preference as a function of schedule requirements.     

Preference for reinforcers under progressive- and fixed-ratio schedules: a comparison of single and concurrent arrangements

Progressive-ratio (PR) schedules were used to identify the break point (i.e., the last schedule value completed) for 2 reinforcers under single and concurrent schedules. After the respective break points were established, the same reinforcers were presented under concurrent fixed-ratio (FR) schedules that were yoked to the break points obtained with the PR schedules. Results suggested that the participants responded more for the high-preference item than for the low-preference item, regardless of the presentation arrangement (single or concurrent presentations). This pattern of responding was maintained when the reinforcers were presented under dissimilar FR schedules. The results suggest that responding for differentially preferred stimuli may vary as a function of differences in schedule requirements.     

Assessment of role-play generalization across qualitatively different situations

Role-play generalization of newly acquired assertive behavior was assessed across different response situations in a clinical outpatient sample. Prior to assertive training, subjects completed two paper-and-pencil inventories and a series of role-play situations. Behavioral role-play scenes included four response forms: making requests, expressing affection, standing up for rights, and expressing displeasure. Subjects were randomly assigned to treatment or test-retest conditions and the treatment subjects received six 2-hr sessions of assertion training using modeling, behavior rehearsal, instruction, positive reinforcement, assignedin vivo homework, bibliotherapy, and daily recordings of assertive behavior. Posttreatment, subjects completed the paper-and-pencil measures, trained role-play scenes, and a set of dissimilar untrained scenes requiring different response forms (giving compliments, receiving compliments; refusing unreasonable requests and expressing justified anger). Videotapes were rated blindly and in random order at the conclusion of the study by trained judges. Treatment and test-retest subjects were equivalent prior to training. Posttreatment for the two groups differed in self-report, role-play behavior in trained situations, and role-play behavior in untrained dissimilar situations (allp<.001). MANOVA with repeated measures confirmed that trained and generalization role-play scenes were quantitatively, as well as qualitatively, different, confirmed that treatment and test-retest subjects exhibited different performance levels posttreatment on both trained and generalization scenes, and revealed four significant interactions (allp<.001). Implications of the interactions are discussed. Canonical correlation revealed that subjects displayed significant commonality in their behavioral profiles across different response forms. The findings indicate that complex training resulted in generalization from trained situations to untrained and dissimilar generalization scenes for the clinical outpatient sample.     

Behavioral contrast in rats with different reinforcers and different response topographies

Experiment I demonstrated positive behavioral contrast in rats when one of two qualitatively different reinforcers (milk and pellets) was removed from a component of a multiple schedule. The contrast effect was larger and more enduring when milk was removed. Experiment II showed that the rats spent more time on the side of a shuttle-box on which milk was freely available than on the side on which pellets were freely available. Experiment III, a partial replication of Experiment I, failed to demonstrate the contrast effect of Experiment I. Experiment IV demonstrated contrast when two topographically distinct responses, nose-key poking and lever pressing, were required in different components of a multiple schedule. These results extend the conditions that generate behavioral contrast in rats.     

Transfer of conditioned inhibition across different aversive reinforcers in the rat

Three experiments using a conditioned suppression procedure in rats assessed transfer of conditioned inhibition across different aversive reinforcers. Experiment 1, using shock and car horn blast as reinforcers, showed that a noise negatively correlated with 0.7-mA shock between sessions attenuated suppression of lever pressing elicited by the signals for 0.7-mA shock and 110-db horn blast. Similarly, when the noise signaled the omission of horn blast, it attenuated suppression elicited by the signals for horn blast and shock. Experiment 2, using the same procedure, replicated transfer of conditioned inhibition from shock to horn found in Experiment 1, and indicated that such effects should be attributed to associative factors. Experiment 3, using the conditioned inhibition paradigm and different chambers during training and testing, replicated transfer from horn to shock and indicated that transfer cannot be attributed to multiple-background-reinforcer associations established during inhibitory training. The results of these experiments have implications for theories of conditioned inhibition.     

The effects of presession attention on problem behavior maintained by different reinforcers

The effect of presession attention on the later occurrence of problem behavior was examined with elementary-school children with a range of disabilities. Results of analogue functional analyses suggested an escape function, an attention function, or both. Following the analogue functional analyses, the effects of two antecedent conditions (10-min ignore vs. 10-min attention) were compared on problem behavior in subsequent test conditions. For participants who displayed attention-maintained problem behavior, the test condition involved contingent attention for problem behavior. For participants who displayed escape-maintained problem behavior, the test condition involved contingent escape for problem behavior. Results indicated that participants who displayed attention-maintained problem behavior displayed less problem behavior following presession exposure to attention than when ignored. No such effect was found for presession attention on escape-maintained problem behavior. We discuss matching antecedent-based interventions to the results of functional analysis.     

Mechanical restraints as positive reinforcers for aggression

Research suggests that, in some cases, mechanical restraints may function as positive reinforcers. In this study, we conducted a functional analysis of severe aggression exhibited by an individual with a history of wearing arm splints. The results of this functional analysis demonstrated that his aggression was maintained by access to the arm splints. Copyright © 2008 John Wiley & Sons, Ltd.     

Pigeons prefer to invest early for future reinforcers

Five pigeons were trained in a series of conditions in which food was delivered after 25 responses, but only when a different (Investing) response had been made before the 25 responses had been completed. If an Investing response was not made, the 25 responses ended in blackout. In various conditions, effective Investing responses either had to be made before the first of the 25 responses, or anywhere within the 25 responses; and effective Investing responses either resulted in a stimulus change or did not. Pigeons Invested even when the consequences were temporally and spatially distant, but Investing was most likely when it produced an immediate stimulus change. When given the choice, pigeons preferred to make Investing responses at the beginning of a trial. These findings again demonstrate that behavior may be maintained by events that are separated in time and space from the present.     

Relative preference for distinct reinforcers maintaining destructive behavior

The literature offers few recommendations for sequencing exposure to treatment conditions with individuals with multiply maintained destructive behavior. Identifying relative preference for the functional reinforcers maintaining destructive behavior may be one means of guiding that decision. The present study presents a preliminary attempt at developing a robust relative preference and reinforcer assessment for individuals with multiply maintained destructive behavior. Guided and free-choice trials were implemented in which participants chose between two multiple-schedule arrangements, each of which programmed signaled periods of isolated reinforcer availability and unavailability. Consistent participant choice and responding during free-choice trials was then used to thin the corresponding schedule of reinforcement. The results demonstrated a strong preference for one of the two functional reinforcers for all four participants, yet preferences differed across participants and were not well predicted by responding in prior analyses.     

Within-session changes in responding during concurrent schedules with different reinforcers in the components.

Rats and pigeons responded on several concurrent schedules that provided different reinforcers in the two components (food and water for rats, Experiment 1; wheat and mixed grain for pigeons, Experiment 2). The rate of responding and the time spent responding on each component usually changed within the session. The within-session changes in response rates and time spent responding usually followed different patterns for the two components of a concurrent schedule. For most subjects, the bias and sensitivity to reinforcement parameters of the generalized matching law, as well as the percentage of the variance accounted for, decreased within the session. Negative sensitivity parameters were sometimes found late in the session for the concurrent food-water schedules. These results imply that within-session changes in responding could cause problems for assessing the validity of quantitative theories of concurrent-schedule responding when the components provide different reinforcers. They question changes in a general motivational state, such as arousal, as a complete explanation for within-session changes in responding. The results are compatible with satiation for, or sensitization-habituation to, the reinforcers as explanations.     

Evaluation of the rate of problem behavior maintained by different reinforcers across preference assessments

The rates of problem behavior maintained by different reinforcers were evaluated across 3 preference assessment formats (i.e., paired stimulus, multiple-stimulus without replacement, and free operant). The experimenter administered each assessment format 5 times in a random order for 7 children with developmental disabilities whose problem behavior was maintained by attention, tangible items, or escape. Results demonstrated different effects related to the occurrence of problem behavior, suggesting an interaction between function of problem behavior and assessment format. Implications for practitioners are discussed with respect to assessing preferences of individuals with developmental disabilities who exhibit problem behavior.     

The substitutability of reinforcers

Substitutability is a construct borrowed from microeconomics that describes a continuum of possible interactions among the reinforcers in a given situation. Highly substitutable reinforcers, which occupy one end of the continuum, are readily traded for each other due to their functional similarity. Complementary reinforcers, at the other end of the continuum, tend to be consumed jointly in fairly rigid proportion, and therefore cannot be traded for one another except to achieve that proportion. At the center of the continuum are reinforcers that are independent with respect to each other; consumption of one has no influence on consumption of another. Psychological research and analyses in terms of substitutability employ standard operant conditioning paradigms in which humans and nonhumans choose between alternative reinforcers. The range of reinforcer interactions found in these studies is more readily accommodated and predicted when behavior-analytic models of choice consider issues of substitutability. New insights are gained into such areas as eating and drinking, electrical brain stimulation, temporal separation of choice alternatives, behavior therapy, drug use, and addictions. Moreover, the generalized matching law (Baum, 1974) gains greater explanatory power and comprehensiveness when measures of substitutability are included.     

Choice and multiple reinforcers

Pigeons chose between equivalent two-component mixed and multiple terminal-link schedules of reinforcement in the concurrent-chains procedure. The pigeons preferred the multiple schedule over the mixed when the components of the compound schedules were differentiated in terms of density of reinforcement, but the pigeons were indifferent when the components were differentiated in terms of number of reinforcers per cycle. Taken together, these results indicate that a local variable, the interval to the first reinforcer, but not a molar variable, the number of reinforcers, was sufficient to differentiate the components and thereby evoke preference.