The substitutability of reinforcers

Substitutability is a construct borrowed from microeconomics that describes a continuum of possible interactions among the reinforcers in a given situation. Highly substitutable reinforcers, which occupy one end of the continuum, are readily traded for each other due to their functional similarity. Complementary reinforcers, at the other end of the continuum, tend to be consumed jointly in fairly rigid proportion, and therefore cannot be traded for one another except to achieve that proportion. At the center of the continuum are reinforcers that are independent with respect to each other; consumption of one has no influence on consumption of another. Psychological research and analyses in terms of substitutability employ standard operant conditioning paradigms in which humans and nonhumans choose between alternative reinforcers. The range of reinforcer interactions found in these studies is more readily accommodated and predicted when behavior-analytic models of choice consider issues of substitutability. New insights are gained into such areas as eating and drinking, electrical brain stimulation, temporal separation of choice alternatives, behavior therapy, drug use, and addictions. Moreover, the generalized matching law (Baum, 1974) gains greater explanatory power and comprehensiveness when measures of substitutability are included.     

Delay reduction: current status.

Delay-reduction theory states that the effectiveness of a stimulus as a conditioned reinforcer may be predicted most accurately by the reduction in time to primary reinforcement correlated with its onset. We review support for the theory and then discuss two new types of experiments that assess it. One compares models of choice in situations wherein the less preferred outcome is made more accessible; the other investigates whether frequency of conditioned reinforcement affects choice beyond the effect exerted by frequency of primary reinforcement.     

Violations of transitivity: Implications for a theory of contextual choice

Violations of strong stochastic transitivity in concurrent-chains choice were first reported by Navarick and Fantino. In a series of articles, Navarick and Fantino concluded that neither a unidimensional model capable of predicting exact choice probabilities nor a fixed-variable equivalence rule was possible for the concurrent-chains procedure. I show that when choice is modeled contextually (i.e., when preference for a schedule is affected by factors other than the schedule itself, e.g., aspects of the alternative schedule), a unidimensional, exact-choice probability model is possible that both predicts the intransitivities reported by Navarick and Fantino and provides a fixed-variable equivalence rule for the concurrent-chains procedure. The contextual model is an extension of the generalized matching law and violates a key assumption underlying traditional choice models—simple scalability—because of (a) schedule interdependence and (b) bias from procedural contingencies. Therefore, strong stochastic transitivity cannot be expected to hold. Contextual scalability is analyzed to reveal a hierarchy of context effects in choice. Navarick and Fantino's intransitivities can be satisfactorily explained by bias. If attribute sensitivity is context dependent, however, and if there are similarity structures among choice alternatives, the contextual model is shown to be able to predict violations of ordinal preference. Therefore, it may be possible to formulate a deterministic, general psychophysical model of choice as a behavioral alternative to probabilistic, multidimensional choice theories.     

ASSESSING FOOD PREFERENCES AMONG PERSONS WITH PROFOUND MENTAL RETARDATION: PROVIDING OPPORTUNITIES TO MAKE CHOICES

Increased attention has been directed recently to assisting persons with severe handicaps to express preferences concerning events in their lives. We evaluated a program for assessing choice-making skills to provide opportunities for persons with profound mental retardation to express food and drink preferences. In Experiment 1, the assessment procedure involving repeated, paired-item presentations resulted in active choice making and the identification of preferences for all 5 participants. Results also indicated that caregiver opinion was not predictive of participant food and drink preferences. A survey of service providers supported the importance of meal-related choices in this population. In Experiment 2, the practicality of the assessment procedure was supported by demonstrating that (a) routine caregivers could apply the procedure with appropriate supervision to provide choice opportunities, and (b) results of the procedure were predictive of participant choices when a less structured and more normal opportunity to express a preference was provided during regular mealtimes. Results are discussed in terms of extending the developing technology of preference and reinforcer identification to other important areas for persons with severe disabilities.     

EFFECTS OF CHOSEN VERSUS ASSIGNED JOBS ON THE WORK PERFORMANCE OF PERSONS WITH SEVERE HANDICAPS

We evaluated the effects of several choice-related variables on the work performance of adults with severe handicaps. After assessing client work preferences, three choice-related situations were presented: (a) providing clients with the opportunity to choose a work task, (b) assigning a preferred task, and (c) assigning a nonpreferred task. Results indicated that clients attended to work tasks almost twice as much when they chose their tasks and when assigned to work on preferred tasks versus when assigned to work on nonpreferred tasks. Results are discussed regarding the need to assess systematically the effects of choice-related variables.     

Unification of models for choice between delayed reinforcers.

Two models for choice between delayed reinforcers, Fantino's delay-reduction theory and Killeen's incentive theory, are reviewed. Incentive theory is amended to incorporate the effects of arousal on alternate types of behavior that might block the reinforcement of the target behavior. This amended version is shown to differ from the delay-reduction theory in a term that is an exponential in incentive theory and a difference in delay-reduction theory. A power series approximation to the exponential generates a model that is formally identical with delay-reduction theory. Correlations between delay-reduction theory and the amended incentive theory show excellent congruence over a range of experimental conditions. Although the assumptions that gave rise to delay-reduction theory and incentive theory remain different and testable, the models deriving from the theories are unlikely to be discriminable by parametric experimental tests. This congruence of the models is recognized by naming the common model the delayed reinforcement model, which is then compared with other models of choice such as Killeen and Fetterman's (1988) behavioral theory of timing, Mazur's (1984) equivalence rule, and Vaughan's (1985) melioration theory.     

Response-independent Events In The Behavior Stream

The metaphor of the behavior stream provides a framework for studying the effects of response-independent food presentations intruded into an environment in which operant responding of pigeons was maintained by variable-interval schedules. In the first two experiments, response rates were reduced when response-independent food was intruded during the variable-interval schedule according to a concomitantly present fixed-time schedule. These reductions were not always an orderly function of the percentage of response-dependent food. Negatively accelerated patterns of key pecking across the fixed-time period occurred in Experiment 1 under the concomitant fixed-time variable-interval schedules. In Experiment 2, positively and negatively accelerated and linear response patterns occurred even though the schedules were similar to those used in Experiment 1. The variable findings in the first two experiments led to three subsequent experiments that were designed to further illuminate the controlling variables of the effects of intruded response-independent events. When the fixed and variable schedules were correlated with distinct operanda by employing a concurrent fixed-interval variable-interval schedule (Experiment 3) or with distinct discriminative stimuli (Experiments 4 and 5), negatively accelerated response patterns were obtained. Even in these latter cases, however, the response patterns were a joint function of the physical separation of the two schedules and the ratio of fixed-time or fixed-interval to variable-interval schedule food presentations. The results of the five experiments are discussed in terms of the contributions of both reinforcement variables and discriminative stimuli in determining the effects of intruding response-independent food into a stream of operant behavior.     

Comparisons of rats' choice behavior among three different radial-maze tasks

The present study compared rats' behavioral changes on three tasks on the radial-arm maze. In the free-choice task (0Fo/8Fr; no forced choice/eight free choices), rats performed efficiently with the simple response pattern of sequential adjacent-arm choices. In the two forced-choice tasks (3Fo/5Fr and 5Fo/3Fr), rats performed as efficiently as 0Fo/8Fr but showed no particular response patterns. The frequency of arm investigation was the highest in 5Fo/3Fr, and was higher in 3Fo/5Fr than in 0Fo/8Fr. The probability of correct rejection, avoiding re-entry to visited arms after investigation, was also higher in 3Fo/5Fr and 5Fo/3Fr than in 0Fo/8Fr. These results suggest that the rats could adjust their behavior to the task demands.     

THE EFFECTS OF CHOICE AND TASK PREFERENCE ON THE WORK PERFORMANCE OF ADULTS WITH SEVERE DISABILITIES

We evaluated the effects of choice versus the assignment of tasks of varying preferences on the work engagement of adults with severe disabilities. The combined results of two experiments suggest that the relative preference for a task may be an important variable in the effectiveness of choice for some individuals.