Self-control in pigeons under the Mischel paradigm

Walter Mischel studied self-control in preschool children in the following manner: if the child waited for an interval to end, he or she received the more preferred of two reinforcers; if the child responded to terminate the interval by ringing a bell, the less preferred reinforcer was given. We used an analogous procedure to study self-control in pigeons: if the bird waited for a trial to end, it received the more preferred reinforcer; if the bird terminated the trial by pecking a key, the less preferred reinforcer was given. We explored the effects on self-control of a number of variables analogous to those studied by Mischel and co-workers, e.g., presence versus absence of reinforcers, of alternative responses, and of stimuli during the wait interval; prior experience of the subjects; and test paradigm. The results obtained with pigeons paralleled the results obtained by Mischel with human children.     

Choice and multiple reinforcers

Pigeons chose between equivalent two-component mixed and multiple terminal-link schedules of reinforcement in the concurrent-chains procedure. The pigeons preferred the multiple schedule over the mixed when the components of the compound schedules were differentiated in terms of density of reinforcement, but the pigeons were indifferent when the components were differentiated in terms of number of reinforcers per cycle. Taken together, these results indicate that a local variable, the interval to the first reinforcer, but not a molar variable, the number of reinforcers, was sufficient to differentiate the components and thereby evoke preference.     

A comparison of responding maintained under second-order schedules of intramuscular cocaine injection or food presentation in squirrel monkeys.

Key pressing by squirrel monkeys was maintained under second-order schedules of either intramuscular cocaine injection or food presentation. Under one schedule, each completion of a 10-response fixed-ratio unit produced a brief visual stimulus; the first fixed-ratio unit completed after 30 minutes elapsed produced the stimulus paired with either cocaine injection or food presentation. Generally, short pauses followed by high rates of responding were maintained within the fixed-ratio units, and responding was positively accelerated over the 30-minute interval. Under another schedule, each completion of a 3-minute fixed-interval unit produced the brief stimulus; completion of the 10th fixed-interval unit produced the stimulus paired with either cocaine injection or food presentation. Generally, short pauses followed by high rates of responding were maintained within the fixed-ratio units, and responding was positively accelerated over the 30-minute interval. Under another schedule, each completion of a 3-minute fixed-interval unit produced the brief stimulus; completion of the 10th fixed-interval unit produced the stimulus paired with either cocaine injection or food presentation. Rates of responding increased within the fixed-interval units, and to a greater extent over the entire 10 fixed-interval units. Patterns of responding depended more on the schedule of reinforcement than on whether cocaine or food maintained responding. Omitting the brief stimuli following all but the last fixed-ratio or fixed-interval units decreased average rates and altered the patterns of responding. Substituting a visual stimulus that was never paired with cocaine or food following all but the last fixed-ratio or fixed-interval units decreased response rates to a lesser extent and did not substantially alter patterns of responding. When the duration of the paired stimulus was varied from .3 to 30.0 seconds, the highest response rates occurred at intermediate durations (1.0 to 10.0 seconds). The manner in which the stimulus changes affected performances depended more on the schedule of reinforcement than on whether cocaine injection or food presentation maintained responding.     

Concurrent schedule assessment of food preference in cows

Six dairy cows (Bos taurus) were trained on several pairs of concurrent variable-interval schedules with different types of food available on each alternative. The required response was a plate press made by the animal's muzzle. Performance generally replicated that found with other species. The generalized matching law accounted for the preference data, showing that food preference could be quantitatively analyzed as a special case of response bias. The preference functions showed that the response- and time-allocation ratios were not as extreme as obtained reinforcement rate ratios (undermatching).     

Effects of a token reinforcement system on journal reshelving

A token reinforcement program involving two levels of token value and backup reinforcers to increase journal reshelving behavior in a large university library was experimentally evaluated. Results showed that instructions (in which signs asked users to reshelve journals) had no impact. By contrast, token reinforcement contingent on reshelving behavior led to a marked increase in journals reshelved. A return to instructions-only conditions, when data were corrected for library usage, showed an increase in unreshelved journals over the token reinforcement period, though the increase was not to baseline levels. For the next 11 months, library staff maintained a modified token program. Follow-up data collected after that interval showed that number of unreshelved journals remained markedly lower than levels at baseline and the first instructions-only period, though they were slightly higher than at the token reinforcement period. Token reinforcement of the variety employed in this study constitutes an efficient, economical means of changing the behavior of library users who fail to reshelve books and journals.     

Reducing residential electrical energy use: payments, information, and feedback

Monetary payments, energy information, and daily feedback on consumption were employed to reduce electricity use in four units of a university student housing complex. A combined multiple-baseline and withdrawal design permitted both within- and between-unit comparisons. Payments produced immediate and substantial reductions in consumption in all units, even when the magnitude of the payments was reduced considerably. Feedback also produced reductions, but information about ways to conserve and about the cost of using various appliances did not. It was also found that, in general, payments combined with either information or feedback produced no greater effect than payments alone.     

THE ROLE OF FEEDBACK IN VOLUNTARY CONTROL OF BLOOD PRESSURE IN INSTRUCTED SUBJECTS1

Forty normal male volunteers were randomly assigned to one of four experimental conditions and instructed to raise and lower their systolic blood pressure. Subjects received either beat-to-beat feedback contingent on pressure changes, noncontingent beat-to-beat feedback, noncontingent feedback presented randomly with respect to the occurrence of each heart beat, or instructions alone. The order of increase and decrease trial blocks was counterbalanced across groups. Subjects receiving contingent feedback were monetarily rewarded for appropriate pressure changes. Subjects receiving noncontingent feedback received rewards and feedback equal to the mean received by the contingent group. Subjects in the instructions-only condition were also paid this bonus but were informed of their earnings only at the conclusion of the experiment. Results indicated that in the presence of instructions, feedback, whether contingent or noncontingent, added little to subjects' ability to control pressure during a single session. Theoretical and clinical implications are discussed.     

Spaced food but not electrical brain stimulation induces polydipsia and air licking.

An attempt was made to induce polydipsia in rats whose lever pressing was reinforced with food pellets or electrical brain stimulation. Nine food-deprived, water-sated rats drank water excessively during sessions in which food pellets were delivered. When brain stimulation was substituted for food, drinking immediately ceased. Delivering brain stimulation according to a variety of schedules, pairing brain stimulation with food reinforcement, and substituting an air stream for water, each failed to produce polydipsic licking. These results show that polydipsia is not induced by all reinforcers.     

Demand for food on fixed-ratio schedules as a function of the quality of concurrently available reinforcement

Six rats lever pressed for food on concurrent fixed-ratio schedules, in a two-compartment chamber. In one compartment, mixed diet pellets were delivered on fixed-ratio schedules of 1, 6, 11, and 16; in the other, either no food was delivered, or sucrose or mixed diet pellets were delivered on fixed-ratio 8. The number of pellets obtained in the first compartment declined as a function of fixed-ratio size in that compartment in all three conditions, but the decline was greatest overall with mixed diet pellets concurrently available in the other compartment, and least with no food concurrently available. The result is discussed in terms of economic demand theory, and is consistent with the prediction that elasticity of demand for a commodity (defined in operant terms as the ratio of the proportionate change in number of reinforcements per session to the proportionate change in fixed-ratio size) is greater the more substitutable for that commodity are any concurrently available commodities.     

INTERACTIONS BETWEEN TEACHER GUIDANCE AND CONTINGENT ACCESS TO PLAY IN DEVELOPING PREACADEMIC SKILLS OF DEVIANT PRESCHOOL CHILDREN1

Token-mediated access to play and snacks was made contingent on completion of academic tasks in the Baseline Experiment. This contingency produced stable completion rates that were subsequently doubled, and then tripled, for four deviant children in a special preschool. A reversal design demonstrated that the contingency was functional in maintaining the children's rates of task completion. The Guidance Experiment examined the role of a social event, teacher guidance, in the acquisition of task-completion skills, in a multiple-baseline-across-tasks design (with reversals). The analysis demonstrated that teacher guidance was an important supplement to the token-mediated contingency in establishing significant increases in task completions for a second group of three deviant children in the special class. The importance of teacher guidance was related to the difficulty level of the children's tasks.