Utility maximization and melioration: Internalities in individual choice

How do people go about choosing between alternatives in relatively simple settings? This study explores some of the variables that past work suggests may be relevant. Volunteer subjects worked for money in six procedures in which the probability of a payment from either of two alternatives was 1.0, but the rate of pay (i.e. the speed with which a payment was delivered or the size of the payment) interacted with the subjects recent allocation of choices, which we define as the ‘internalities’. Because of the internalities, choosing the currently more profitable alternative did not maximize total earnings. Subjects were more likely to fail to maximize when the interaction between present pay and past choices was spread over longer sequences of choices, or when the reward variable was the speed, rather than the value, of each payment. Subjects often disregarded the internalities and were instead guided by the current yields of the two alternatives, which is a frequently observed tendency, called ‘melioration’, in experiments on choices by animals. The tendency toward melioration was only partially counteracted by explicit instructions on how to maximize earnings. We discuss a theoretical framework for melioration that postulates both motivational and cognitive sources.     

EXPERIMENTAL ANALYSIS AND TREATMENT OF MULTIPLY CONTROLLED SELF-INJURY

A functional analysis of the self-injurious behavior (SIB) of 3 adults with profound developmental disabilities showed that each engaged in SIB in more than one assessment condition. Such outcomes may result from a failure to isolate the variable maintaining SIB, or they may reflect multiple sources of control over SIB. In order to identify more clearly the determinants of SIB, each subject was exposed to a series of treatments appropriate to one or both of the apparent functions of SIB. These treatments, applied sequentially on baselines appropriate to each behavioral function, identified the maintaining variables for SIB through differential outcomes across baselines. Results indicated that the SIB of 2 subjects was multiply controlled, confirming the outcomes of the functional analysis. However, the SIB of the 3rd subject was eliminated using a treatment designed for a single function, suggesting spurious results of the original assessment. Alternative interpretations of undifferentiated assessment data are discussed, as are analysis and treatment issues related to multiply determined behavior disorders.     

VALIDATING PREDICTED ACTIVITY PREFERENCES OF INDIVIDUALS WITH SEVERE DISABILITIES

We examined the accuracy of 24 staff members' predictions of activities preferred by 14 individuals with severe disabilities. For each of 144 activities, staff members assigned a client preference rating of “likes a lot,” “likes,” or “dislikes.” Two activities from each category were randomly selected for each individual with disabilities. Pairs of selected activities were presented to the individuals, who were prompted to choose an activity. Staff members' activity preference ratings correctly predicted the choices made by the individuals with disabilities for 78% of the trials. The more divergent the preference ratings of the paired activities, the more likely staff members were to predict correctly the activity selected by a participant.     

The substitutability of reinforcers

Substitutability is a construct borrowed from microeconomics that describes a continuum of possible interactions among the reinforcers in a given situation. Highly substitutable reinforcers, which occupy one end of the continuum, are readily traded for each other due to their functional similarity. Complementary reinforcers, at the other end of the continuum, tend to be consumed jointly in fairly rigid proportion, and therefore cannot be traded for one another except to achieve that proportion. At the center of the continuum are reinforcers that are independent with respect to each other; consumption of one has no influence on consumption of another. Psychological research and analyses in terms of substitutability employ standard operant conditioning paradigms in which humans and nonhumans choose between alternative reinforcers. The range of reinforcer interactions found in these studies is more readily accommodated and predicted when behavior-analytic models of choice consider issues of substitutability. New insights are gained into such areas as eating and drinking, electrical brain stimulation, temporal separation of choice alternatives, behavior therapy, drug use, and addictions. Moreover, the generalized matching law (Baum, 1974) gains greater explanatory power and comprehensiveness when measures of substitutability are included.     

Delay reduction: current status.

Delay-reduction theory states that the effectiveness of a stimulus as a conditioned reinforcer may be predicted most accurately by the reduction in time to primary reinforcement correlated with its onset. We review support for the theory and then discuss two new types of experiments that assess it. One compares models of choice in situations wherein the less preferred outcome is made more accessible; the other investigates whether frequency of conditioned reinforcement affects choice beyond the effect exerted by frequency of primary reinforcement.     

Violations of transitivity: Implications for a theory of contextual choice

Violations of strong stochastic transitivity in concurrent-chains choice were first reported by Navarick and Fantino. In a series of articles, Navarick and Fantino concluded that neither a unidimensional model capable of predicting exact choice probabilities nor a fixed-variable equivalence rule was possible for the concurrent-chains procedure. I show that when choice is modeled contextually (i.e., when preference for a schedule is affected by factors other than the schedule itself, e.g., aspects of the alternative schedule), a unidimensional, exact-choice probability model is possible that both predicts the intransitivities reported by Navarick and Fantino and provides a fixed-variable equivalence rule for the concurrent-chains procedure. The contextual model is an extension of the generalized matching law and violates a key assumption underlying traditional choice models—simple scalability—because of (a) schedule interdependence and (b) bias from procedural contingencies. Therefore, strong stochastic transitivity cannot be expected to hold. Contextual scalability is analyzed to reveal a hierarchy of context effects in choice. Navarick and Fantino's intransitivities can be satisfactorily explained by bias. If attribute sensitivity is context dependent, however, and if there are similarity structures among choice alternatives, the contextual model is shown to be able to predict violations of ordinal preference. Therefore, it may be possible to formulate a deterministic, general psychophysical model of choice as a behavioral alternative to probabilistic, multidimensional choice theories.     

Momentary maximizing in concurrent schedules with a minimum interchangeover interval

Eight pigeons were trained on concurrent variable-interval variable-interval schedules with a minimum interchangeover time programmed as a consequence of changeovers. In Experiment 1 the reinforcement schedules remained constant while the minimum interchangeover time varied from 0 to 200 s. Relative response rates and relative time deviated from relative reinforcement rates toward indifference with long minimum interchangeover times. In Experiment 2 different reinforcement ratios were scheduled in successive experimental conditions with the minimum interchangeover time constant at 0, 2, 10, or 120 s. The exponent of the generalized matching equation was close to 1.0 when the minimum interchangeover time was 0 s (the typical procedure for concurrent schedules without a changeover delay) and decreased as that duration was increased. The data support the momentary maximizing theory and contradict molar maximizing theories and the melioration theory.     

ASSESSING FOOD PREFERENCES AMONG PERSONS WITH PROFOUND MENTAL RETARDATION: PROVIDING OPPORTUNITIES TO MAKE CHOICES

Increased attention has been directed recently to assisting persons with severe handicaps to express preferences concerning events in their lives. We evaluated a program for assessing choice-making skills to provide opportunities for persons with profound mental retardation to express food and drink preferences. In Experiment 1, the assessment procedure involving repeated, paired-item presentations resulted in active choice making and the identification of preferences for all 5 participants. Results also indicated that caregiver opinion was not predictive of participant food and drink preferences. A survey of service providers supported the importance of meal-related choices in this population. In Experiment 2, the practicality of the assessment procedure was supported by demonstrating that (a) routine caregivers could apply the procedure with appropriate supervision to provide choice opportunities, and (b) results of the procedure were predictive of participant choices when a less structured and more normal opportunity to express a preference was provided during regular mealtimes. Results are discussed in terms of extending the developing technology of preference and reinforcer identification to other important areas for persons with severe disabilities.     

EFFECTS OF CHOSEN VERSUS ASSIGNED JOBS ON THE WORK PERFORMANCE OF PERSONS WITH SEVERE HANDICAPS

We evaluated the effects of several choice-related variables on the work performance of adults with severe handicaps. After assessing client work preferences, three choice-related situations were presented: (a) providing clients with the opportunity to choose a work task, (b) assigning a preferred task, and (c) assigning a nonpreferred task. Results indicated that clients attended to work tasks almost twice as much when they chose their tasks and when assigned to work on preferred tasks versus when assigned to work on nonpreferred tasks. Results are discussed regarding the need to assess systematically the effects of choice-related variables.