Unification of models for choice between delayed reinforcers.

Two models for choice between delayed reinforcers, Fantino's delay-reduction theory and Killeen's incentive theory, are reviewed. Incentive theory is amended to incorporate the effects of arousal on alternate types of behavior that might block the reinforcement of the target behavior. This amended version is shown to differ from the delay-reduction theory in a term that is an exponential in incentive theory and a difference in delay-reduction theory. A power series approximation to the exponential generates a model that is formally identical with delay-reduction theory. Correlations between delay-reduction theory and the amended incentive theory show excellent congruence over a range of experimental conditions. Although the assumptions that gave rise to delay-reduction theory and incentive theory remain different and testable, the models deriving from the theories are unlikely to be discriminable by parametric experimental tests. This congruence of the models is recognized by naming the common model the delayed reinforcement model, which is then compared with other models of choice such as Killeen and Fetterman's (1988) behavioral theory of timing, Mazur's (1984) equivalence rule, and Vaughan's (1985) melioration theory.     

Response-independent Events In The Behavior Stream

The metaphor of the behavior stream provides a framework for studying the effects of response-independent food presentations intruded into an environment in which operant responding of pigeons was maintained by variable-interval schedules. In the first two experiments, response rates were reduced when response-independent food was intruded during the variable-interval schedule according to a concomitantly present fixed-time schedule. These reductions were not always an orderly function of the percentage of response-dependent food. Negatively accelerated patterns of key pecking across the fixed-time period occurred in Experiment 1 under the concomitant fixed-time variable-interval schedules. In Experiment 2, positively and negatively accelerated and linear response patterns occurred even though the schedules were similar to those used in Experiment 1. The variable findings in the first two experiments led to three subsequent experiments that were designed to further illuminate the controlling variables of the effects of intruded response-independent events. When the fixed and variable schedules were correlated with distinct operanda by employing a concurrent fixed-interval variable-interval schedule (Experiment 3) or with distinct discriminative stimuli (Experiments 4 and 5), negatively accelerated response patterns were obtained. Even in these latter cases, however, the response patterns were a joint function of the physical separation of the two schedules and the ratio of fixed-time or fixed-interval to variable-interval schedule food presentations. The results of the five experiments are discussed in terms of the contributions of both reinforcement variables and discriminative stimuli in determining the effects of intruding response-independent food into a stream of operant behavior.     

Comparisons of rats' choice behavior among three different radial-maze tasks

The present study compared rats' behavioral changes on three tasks on the radial-arm maze. In the free-choice task (0Fo/8Fr; no forced choice/eight free choices), rats performed efficiently with the simple response pattern of sequential adjacent-arm choices. In the two forced-choice tasks (3Fo/5Fr and 5Fo/3Fr), rats performed as efficiently as 0Fo/8Fr but showed no particular response patterns. The frequency of arm investigation was the highest in 5Fo/3Fr, and was higher in 3Fo/5Fr than in 0Fo/8Fr. The probability of correct rejection, avoiding re-entry to visited arms after investigation, was also higher in 3Fo/5Fr and 5Fo/3Fr than in 0Fo/8Fr. These results suggest that the rats could adjust their behavior to the task demands.     

THE EFFECTS OF CHOICE AND TASK PREFERENCE ON THE WORK PERFORMANCE OF ADULTS WITH SEVERE DISABILITIES

We evaluated the effects of choice versus the assignment of tasks of varying preferences on the work engagement of adults with severe disabilities. The combined results of two experiments suggest that the relative preference for a task may be an important variable in the effectiveness of choice for some individuals.     

A PRELIMINARY COMPARISON OF REINFORCER ASSESSMENT METHODS FOR CHILDREN WITH ATTENTION DEFICIT HYPERACTIVITY DISORDER

We evaluated the relative treatment utility of a verbal forced-choice questionnaire, child nomination, and direct observation for identifying the most potent reinforcers for children with attention deficit hyperactivity disorder. Results demonstrated that all three methods were more likely to disagree than to agree, that a forced-choice format may enhance verbal reinforcer assessment, and that further development and evaluation of verbal reinforcer-assessment methods are needed.     

Self-control and impulsiveness in children and adults: Effects of food preferences

Experiment 1 used 6 preschool boys and Experiment 2 used 6 adult women to explore the effects of food preference on humans' choice in self-control paradigms. The boys showed a higher proportion of responses for more delayed, larger reinforcers (a measure of self-control) when those choices resulted in receipt of the most preferred food compared to when those choices resulted in the least preferred food. Further, the boys chose the less delayed, smaller reinforcers significantly more often when only those choices, as opposed to both choices, resulted in the most preferred food. Conversely, they chose the more delayed, larger reinforcers significantly more often when only those choices, as opposed to both choices, resulted in the most preferred food. Finally, the women demonstrated significantly less sensitivity to reinforcer amount relative to sensitivity to reinforcer delay (another measure of self-control) when they had a higher preference for the juice received as the less delayed, smaller reinforcer than for the juice received as the more delayed, larger reinforcer. Together, the results show that subjects' food preferences can influence self-control for food reinforcers.     

Exchange delays and impulsive choice in adult humans.

Choice responding by adult humans in a discrete-trial task was examined as a function of conditions that manipulated either the delay to point delivery or the delay between points and their exchange for money. In point-delay conditions, subjects chose between an "impulsive" alternative that provided a small amount of points immediately and a "self-control" alternative that provided a larger amount of points delayed by 15, 30, or 60 s. Points were exchanged for money immediately following the session. Subjects preferred the self-control alternative. In exchange-delay conditions, subjects chose between a small amount of points exchangeable for money immediately following the session and a larger amount of points exchangeable for money after 1 day, 3 weeks, or 6 weeks. A self-control preference observed for all subjects in the 1-day exchange-delay condition reversed to exclusive impulsive preference for 4 of the 6 subjects when choice conditions involved exchange delays of 3 or 6 weeks. These results show that human choice is sensitive to the manipulation of exchange delays and that impulsive preference can be obtained with exchange delays on the order of weeks.     

Human choice in concurrent ratio-interval schedules of reinforcement.

Seven undergraduates participated in a concurrent-choice experiment with monetary reinforcers. Response-independent analogues of variable-interval and variable-ratio schedules were used to assess whether subjects would maximize reinforcement rate. The optimal pattern of behavior, in terms of maximizing reinforcement rate, involved a large bias toward the ratio alternative, with only occasional sampling of the interval schedule. Most experiments with pigeons, however, demonstrate matching of response rates to reinforcement rates, with only slight biases for the ratio schedule. Although subjects in the present experiment allocated more time to the ratio alternative than required by matching, the magnitude of the bias did not approximate that predicted by a maximizing account. After exposure to clock stimuli correlated with the operation of each schedule, 1 subject's behavior did show a substantial level of bias, increasing the total number of reinforcers obtained, and lay at a point between the predictions of matching and maximizing. The other subjects, however, continued to respond less optimally. The present results can be accounted for by a view of matching that incorporates the effects of delayed reinforcement.     

Psychological determinants of decision attitude

Decision attitude — an analog of risk attitude — is the propensity to make (or avoid making) a decision: in decision aversion, a person finds it more desirable to receive through fiat the better of two options than to have a choice between them; in decision seeking, the choice is more desirable, even though it can lead to nothing better than the best option. Both decision aversion and decision seeking were found in hypothetical scenarios. Experimental manipulations and subjects' justifications point to anticipated regret, fear of blame for poor outcomes, and desire for equitable distributions as sources of decision aversion. One source of decision seeking (for self) and decision aversion (when deciding for others) appears to be the desire for the self-determination of the affected parties. We consider the implications of our results for personal choice and public policy decisions.