Self-control in mentally retarded adolescents: choice as a function of amount and delay of reinforcement.

Three severely mentally retarded adolescents were studied under discrete-trial procedures in which a choice was arranged between edible reinforcers that differed in magnitude and, in some conditions, delay. In the absence of delays the larger reinforcer was consistently chosen. Under conditions in which the smaller reinforcer was not delayed, increasing the delay to delivery of the larger reinforcer decreased the percentage of trials in which that reinforcer was chosen. All subjects directed the majority of choice responses to the smaller reinforcer when the larger reinforcer was sufficiently delayed, although the value at which this occurred differed across subjects. Under conditions in which the larger reinforcer initially was sufficiently delayed to result in preference for the smaller one, progressively increasing in 5-s increments the delay to both reinforcers increased percentage of trials with the larger reinforcer chosen. At sufficiently long delays, 2 of the subjects consistently chose the larger, but more delayed, reinforcer, and the 3rd subject chose that reinforcer on half of the trials. These results are consistent with the findings of prior studies in which adult humans responded to terminate noise and pigeons responded to produce food.     

Effects of reinforcement context on choice

Two experiments investigated the effects of successive reinforcement contexts on choice. In the first, concurrent variable-interval schedules of primary reinforcement operated during the initial links of concurrent chains. The rate of this reinforcement arranged by the concurrent schedules was decreased across conditions: When it was higher than the terminal-link rate, preference for the higher frequency initial-link schedule increased relative to baseline. (During baseline, a standard concurrent-schedule procedure was in effect). When the initial-link reinforcement rate was lower than the terminal-link rate, preference converged toward indifference. In the second experiment, a chain schedule was available on a third key while a concurrent schedule was in effect on the side keys. When the terminal link of the chain schedule was produced, the side keys became inoperative. Availability of the chain schedule did not affect choice between the concurrent schedules. These results show that only when successive reinforcement contexts are produced by choice responding do those successive contexts affect choice in concurrent schedules.     

Discrimination learning in a foraging situation

Rats were allowed to forage in a simulated natural environment made up of eight food sources (patches) each containing a fixed number of pellets. Two of the eight contained an extra supply of peanuts. The peanut patches were signaled by an olfactory/visual cue located at the bottom of the ladder leading to the patch. In successive phases the number of sessions per day, height of the patches, and availability of peanuts were manipulated. Subjects showed evidence of discrimination learning under these conditions, although the degree of discriminatory behavior varied as a function of environmental manipulations. Assessment of behavior within foraging sessions showed that subjects systematically changed their patterns of utilization of patches across time. Sampling or exploration, as well as food reinforcement, seem implicated in these results.     

Confidence in judgments based on incomplete information: An investigation using both hypothetical and real gambles

This study assessed how confidence in judgments is affected by the need to make inferences about missing information. Subjects indicated their likelihood of taking each of a series of gambles based on both probability and payoff information or only one of these sources of information. They also rated their confidence in each likelihood judgment. Subjects in the Explicit Inference condition were asked to explicitly estimate the values of missing information before making their responses while subjects in the Implicit Inference condition were not. The manner in which probability information was framed was also manipulated. Experiment 1 employed hypothetical gambles and Experiment 2 employed gambles with real money. Expressed likelihood of taking gambles was higher when probability was phrased in terms of '% chance of winning' rather than '% chance of losing', but this difference was somewhat less with real gambles than with hypothetical gambles. Confidence ratings in each experiment were actually higher on incomplete information trials than on complete information trials in the Explicit Inference condition. Results were related to the general issue of confidence in judgments.     

Effectiveness of the GOFER course in decision making for high school students

The paper describes and evaluates the GOFER course in decision making for high school students (Mann, Harmoni and Power, 1988). The course was based on principles from the conflict theory of decision making (Janis and Mann, 1977) and was designed to provide adolescents with an understanding of factors that produce good and poor decision making as well as knowledge and practice of sound decision skills. Two evaluation studies were conducted to examine effectiveness of the course. Study 1 was conducted with young adolescents (12 year olds). It found a significant difference between students trained in the course and a control group on measures of self-esteem as a decision maker, self reported decision habits and knowledge of decision strategy. Study 2 was conducted with mid-adolescents (15 year olds). It, too, found a significant difference between students who took the course and a control group on measures of self esteem as a decision maker and self-reported decision habits. It is concluded that while the evaluation study fell short of an ideal test, the GOFER course met the criteria of improving student knowledge, raising confidence in decision making and changing self reported decision habits.     

Choice with delayed and probabilistic reinforcers: effects of variability, time between trials, and conditioned reinforcers.

In a discrete-trials procedure with pigeons, a response on a green key led to a 4-s delay (during which green houselights were lit) and then a reinforcer might or might not be delivered. A response on a red key led to a delay of adjustable duration (during which red houselights were lit) and then a certain reinforcer. The delay was adjusted so as to estimate an indifference point--a duration for which the two alternatives were equally preferred. Once the green key was chosen, a subject had to continue to respond on the green key until a reinforcer was delivered. Each response on the green key, plus the 4-s delay that followed every response, was called one "link" of the green-key schedule. Subjects showed much greater preference for the green key when the number of links before reinforcement was variable (averaging four) than when it was fixed (always exactly four). These findings are consistent with the view that probabilistic reinforcers are analogous to reinforcers delivered after variable delays. When successive links were separated by 4-s or 8-s "interlink intervals" with white houselights, preference for the probabilistic alternative decreased somewhat for 2 subjects but was unaffected for the other 2 subjects. When the interlink intervals had the same green houselights that were present during the 4-s delays, preference for the green key decreased substantially for all subjects. These results provided mixed support for the view that preference for a probabilistic reinforcer is inversely related to the duration of conditioned reinforcers that precede the delivery of food.     

Maximizing versus matching on concurrent variable-interval schedules

Maximization and matching predictions were examined for a time-based analogue of the concurrent variable-interval variable-ratio schedule. One alternative was a variable interval whose time base operated relatively independent of the schedule chosen, and the other was a discontinuous variable interval for which timing progressed only when selected. Pigeons switched between schedules by pecking a changeover key. The maximization hypothesis predicts that subjects will show a bias toward the discontinuous variable interval and undermatching; however the obtained results conformed closely to the predictions of the matching law. Finally, a quantitative comparison was made of the bias and sensitivity estimates obtained in published concurrent variable-interval variable-ratio analogue studies. Results indicated that only the ratio-based analogue of the concurrent variable interval variable ratio studied by Green, Rachlin, and Hanson (1983) produced significant bias toward the variable-ratio alternative and undermatching, as predicted by reinforcement maximization.     

Stimulus effects on concurrent performance in transition

Six experimentally naive pigeons were exposed to concurrent variable-interval variable-interval schedules in a three-key procedure in which food reinforcement followed pecks on the side keys and pecks on the center key served as changeover responses. In Phase 1, 3 birds were exposed to 20 combinations of five variable-interval values, with each variable-interval value consistently associated with a different color on the side keys. Another 3 pigeons were exposed to the same 20 conditions, but with a more standard procedure that used a nondifferential discriminative stimulus on the two side keys throughout all conditions. In Phase 2, the differential and nondifferential stimulus conditions were reversed for each pigeon. Each condition lasted for one 5-hr session and one subsequent 1-hr session. In the last 14 conditions of each phase, the presence of differential discriminative stimuli decreased the time necessary for differential responding to develop and increased the sensitivity of behavior to reinforcement distribution in the 1st hr of training; during the last hours of training in each condition, however, the effects of the differential discriminative stimuli could not be distinguished from the effects of reinforcement distribution per se. These results show the importance of studying transitions in behavior as well as final performance. They may also be relevant to discrepancies in the results of previous experiments that have used nonhuman and human subjects.     

Choice between repleting/depleting patches: A concurrent-schedule procedure

Six pigeons responded on two concurrently available keys that defined patches with the following characteristics. Reinforcer stores repleted on a patch as a linear function of time when the bird had last responded to the other patch, or else did not replete. Repletion schedules thus timed only when the bird was absent from the patch. Reinforcer stores on a patch could be depleted and reinforcers obtained, again as a linear function of time, when the bird responded on a key. Depletion schedules thus timed only when the birds were present at a patch. Experiment 1 investigated changing relative depletion rates when repletion rates were constant and equal (Part 1) and changing relative repletion rates when the depletion rates were constant and equal (Part 2). Response- and time-allocation ratios conformed to a generalized matching relation with obtained reinforcer ratios, and there appeared to be no control by the size of the reinforcer stores. In Experiment 2, absolute depletion rates were varied with a pair of unequal repletion rates (Part 3), and absolute repletion rates were varied with a pair of unequal depletion rates (Part 4). Dwell times in the patches were not affected by either variation. Melioration theory predicted the results of Experiment 1 quite closely but erroneously predicted changing dwell times in Experiment 2. Molar maximization theory did not accurately predict the results of either experiment.     

Computational behavior dynamics: an alternative description of Nevin (1969).

A computational processing behavior-dynamic model was instantiated in the form of a computer program that "behaved" on the task developed by Nevin (1969). In this classic discrete-trials experiment, the relative frequency of choosing a response alternative matched the relative frequency of reinforcement for that alternative, the local structure of responding was opposite that predicted by momentary maximizing (i.e., the probability of a changeover decreased with run length), and absolute and relative response rates varied independently. The behavior-dynamic model developed here qualitatively reproduced these three results (but not in quantitative and specific detail) and also generated some interesting, as-yet-untested predictions about performance in Nevin's task. The model was discussed as an example of a stochastic behavior-dynamic alternative to algebraic behavior theory.