Self-control in children with autism: response allocation during delays to reinforcement.

This study examined the use of a progressive‐delay schedule of reinforcement to increase self‐control and decrease disruptive behavior in children with autism. When initially given the choice between an immediate smaller reinforcer and a larger delayed reinforcer, all participants chose the smaller reinforcer. When access to the larger reinforcer required either no activity or engaging in a concurrent task during the delay, all participants demonstrated both self‐control and preference for a response requirement. Disruptive behavior decreased during delays that required a concurrent task compared to sessions without an activity requirement.     

Teaching self-control to small groups of dually diagnosed adults

The present study examined the use of a progressive delay procedure to teach self-control to two groups of dually diagnosed adults. When given a choice between an immediate smaller reinforcer and a larger delayed reinforcer, both groups chose the smaller reinforcer during baseline. During treatment, progressive increases in work requirements for gaining access to a larger reinforcer resulted in both groups selecting larger delayed reinforcers. The results are discussed with respect to increasing cooperative work behavior and self-control.     

A procedure to teach self-control to children with attention deficit hyperactivity disorder

This study examined the use of a progressive delay procedure combined with verbal mediation to teach self-control to children with attention deficit disorder. Results showed that when participants were initially given the choice between an immediate smaller reinforcer and a larger delayed reinforcer, all participants chose the smaller reinforcer. When slight delays to obtain a larger reinforcer were instated in conjunction with intervening verbal activity, all participants demonstrated self-control regardless of the content of the verbal activity.     

USING A SELF-CONTROL TRAINING PROCEDURE TO INCREASE APPROPRIATE BEHAVIOR

The present study evaluated a technique for teaching self-control and increasing desirable behaviors among adults with developmental disabilities. Results showed that when participants were initially given the choice between an immediate smaller reinforcer and a larger delayed reinforcer, all participants repeatedly chose the smaller reinforcer. Concurrent fixed-duration/progressive-duration reinforcement schedules then were introduced in which initially both the smaller and larger reinforcers were available immediately. Thereafter, progressively increasing delays were introduced for the schedule associated with the larger reinforcer only. When initial short-duration requirements for access to the larger reinforcer were gradually increased, participants repeatedly selected the larger reinforcer, thereby demonstrating increased self-control.     

Self-control and the preference for delayed reinforcement an example in brain injury

We investigated the effects of a concurrent physical therapy activity (keeping the hand open) during delays to reinforcement in an adult man with acquired brain injuries. Once a relatively stable level of hand-open behavior was obtained, the participant was asked to choose between a small immediate reinforcer and a larger delayed reinforcer contingent on keeping the hand open at greater-than-baseline duration. Afterwards, the participant was asked to select between a larger delayed reinforcer with no hand-open requirement and the identical larger delayed reinforcer with a progressively increasing hand-open requirement. Results suggest a shift in preference to larger delayed reinforcers and an eventual preference for the hand-open requirement option.     

Procrastination by pigeons with fixed-interval response requirements.

Two experiments studied the phenomenon of procrastination, in which pigeons chose a larger, more delayed response requirement over a smaller, more immediate response requirement. The response requirements were fixed-interval schedules that did not lead to an immediate food reinforcer, but that interrupted a 55-s period in which food was delivered at random times. The experiments used an adjusting-delay procedure in which the delay to the start of one fixed-interval requirement was varied over trials to estimate an indifference point--a delay at which the two alternatives were chosen about equally often. Experiment 1 found that as the delay to a shorter fixed-interval requirement was increased, the adjusting delay to a longer fixed-interval requirement also increased, and the rate of increase depended on the duration of the longer fixed-interval requirement. Experiment 2 found a strong preference for a fixed delay of 10 s to the start of a fixed-interval requirement compared to a mixed delay of either 0 or 20 s. The results help to distinguish among different equations that might describe the decreasing effectiveness of a response requirement with increasing delay, and they suggest that delayed reinforcers and delayed response requirements have symmetrical but opposite effects on choice.     

Fixed-interval performance and self-control in children.

Operant responses of 16 children (mean age 6 years and 1 month) were reinforced according to different fixed-interval schedules (with interreinforcer intervals of 20, 30, or 40 s) in which the reinforcers were either 20-s or 40-s presentations of a cartoon. In another procedure, they received training on a self-control paradigm in which both reinforcer delay (0.5 s or 40 s) and reinforcer duration (20 s or 40 s of cartoons) varied, and subjects were offered a choice between various combinations of delay and duration. Individual differences in behavior under the self-control procedure were precisely mirrored by individual differences under the fixed-interval schedule. Children who chose the smaller immediate reinforcer on the self-control procedure (impulsive) produced short postreinforcement pauses and high response rates in the fixed-interval conditions, and both measures changed little with changes in fixed-interval value. Conversely, children who chose the larger delayed reinforcer in the self-control condition (the self-controlled subjects) exhibited lower response rates and long postreinforcement pauses, which changed systematically with changes in the interval, in their fixed-interval performances.     

Enhancing tolerance to delayed reinforcers: the role of intervening activities

Three participants with moderate to profound mental retardation were exposed to choices between an immediate small amount and a delayed larger amount of a preferred reinforcer. All participants initially showed a relatively high preference for the smaller reinforcer, suggesting impulsive choice making. However this preference reversed, suggesting self-control, when the larger reinforcer was available immediately and, over time, its delay was gradually increased. Results highlight the potential utility of incorporating concurrent activities into self-control training paradigms.     

Procrastination by pigeons: preference for larger, more delayed work requirements.

In three experiments, pigeons chose between alternatives that required the completion of a small ratio schedule early in the trial or a larger ratio schedule later in the trial. Completion of the ratio requirement did not lead to an immediate reinforcer, but simply allowed the events of the trial to continue. In Experiment 1, the ratio requirements interrupted periods in which food was delivered on a variable-time schedule. In Experiments 2 and 3, each ratio requirement was preceded and followed by a delay, and only one reinforcer was delivered, at the end of each trial. Two of the experiments used an adjusting-ratio procedure in which the ratio requirement was increased and decreased over trials so as to estimate an indifference point--a ratio size at which the two alternatives were chosen about equally often. These experiments found clear evidence for "procrastination"--the choice of a larger but more delayed response requirement. In some cases, subjects chose the more delayed ratio schedule even when it was larger than the more immediate alternative by a factor of four or more. The results suggest that as the delay to the start of a ratio requirement is increased, it has progressively less effect on choice behavior, in much the same way that delaying a positive reinforcer reduces it effect on choice.     

Self‐control as generalized operant behavior by adults with autism spectrum disorder

The present investigation attempted to teach self‐control to 3 adults who had been diagnosed with autism spectrum disorder. Using a self‐control training procedure that coupled a gradual fading of delay to access a large delayed reinforcer with a concurrent work requirement, each participant was exposed to conditions in which baseline levels of choices for large delayed reinforcers and task engagement increased 10‐fold. Furthermore, generalization effects were partially demonstrated in a novel context.     

Self‐Control Moderates Decision‐Making Behavior When Minimizing Losses versus Maximizing Gains

We examined (1) whether people would be more responsive to the delayed consequences of their decisions when attempting to minimize losses than when attempting to maximize gains in a history‐dependent decision‐making task and (2) how trait self‐control would moderate such an effect. In two experiments, participants performed a dynamic decision‐making task where they chose one of two options on each trial. The increasing option always gave a smaller immediate reward but caused future rewards for both options to increase. The decreasing option always gave a larger immediate reward but caused future rewards for both options to decrease. In Experiment 1 where the two options had equivalent expected value in the long run, participants were more prone to select the increasing option, which yielded larger benefits on future trials, in the loss‐minimization condition than in the gain‐maximization condition. Trait self‐control moderated the effect of losses by enhancing the effect for low self‐control participants while attenuating it for high self‐control participants. In Experiment 2 where selecting the increasing option was suboptimal, low self‐control participants still attempted to reduce losses on future trials by selecting the increasing option more often than high self‐control participants. These results suggest that decision makers value delayed consequences of their actions more in a losses domain relative to a gains domain and low self‐control individuals are more susceptible to such an effect. Copyright © 2014 John Wiley & Sons, Ltd.     

EFFECTS OF A SIGNALED DELAY TO REINFORCEMENT IN THE PREVIOUS AND UPCOMING RATIOS ON BETWEEN-RATIO PAUSING IN FIXED-RATIO SCHEDULES

Domestic hens responded under multiple fixed‐ratio fixed‐ratio schedules with equal fixed ratios. One component provided immediate reinforcement and the other provided reinforcement after a delay, signaled by the offset of the key light. The components were presented quasirandomly so that all four possible transitions occurred in each session. The delay was varied over 0, 4, 8, 16, and 32 s with fixed‐ratio 5 schedules, and over 0, 8 and 32 s with fixed‐ratio 1, 15 and 40 schedules. Main effects of fixed‐ratio value and delay duration were detected on between‐ratio pauses. Pauses were longer when the multiple‐schedule stimulus correlated with a delayed‐reinforcer component was presented, with the longest pauses occurring at the transition from a component with an immediate reinforcer to one with a delayed reinforcer. Pause durations were shortest during immediate components. Overall, both the presence or absence of a delay in the upcoming component, and the presence or absence of a delay in the preceding component affected pause length, but the upcoming delay had the larger effect. Thus changes in delay had similar effects to past reports of the effects of changes in response force, response requirement, and reinforcer magnitude in multiple fixed‐ratio fixed‐ratio schedules.     

A COMPARISON OF THE EFFECTS OF BRIEF RULES, A TIMER, AND PREFERRED TOYS ON SELF-CONTROL

Some children make impulsive choices (i.e., choose a small but immediate reinforcer over a large but delayed reinforcer). Previous research has shown that delay fading, providing an alternative activity during the delay, teaching participants to repeat a rule during the delay, combining delay fading with an alternative activity, and combining delay fading with a countdown timer are effective for increasing self‐control (i.e., choosing the large but delayed reinforcer over the small but immediate reinforcer). The purpose of the current study was to compare the effects of various interventions in the absence of delay fading (i.e., providing brief rules, providing a countdown timer during the delay, or providing preferred toys during the delay) on self‐control. Results suggested that providing brief rules or a countdown timer during the delay was ineffective for enhancing self‐control. However, providing preferred toys during the delay effectively enhanced self‐control.     

Self-control and impulsiveness in children and adults: Effects of food preferences

Experiment 1 used 6 preschool boys and Experiment 2 used 6 adult women to explore the effects of food preference on humans' choice in self-control paradigms. The boys showed a higher proportion of responses for more delayed, larger reinforcers (a measure of self-control) when those choices resulted in receipt of the most preferred food compared to when those choices resulted in the least preferred food. Further, the boys chose the less delayed, smaller reinforcers significantly more often when only those choices, as opposed to both choices, resulted in the most preferred food. Conversely, they chose the more delayed, larger reinforcers significantly more often when only those choices, as opposed to both choices, resulted in the most preferred food. Finally, the women demonstrated significantly less sensitivity to reinforcer amount relative to sensitivity to reinforcer delay (another measure of self-control) when they had a higher preference for the juice received as the less delayed, smaller reinforcer than for the juice received as the more delayed, larger reinforcer. Together, the results show that subjects' food preferences can influence self-control for food reinforcers.     

Self-control in mentally retarded adolescents: choice as a function of amount and delay of reinforcement.

Three severely mentally retarded adolescents were studied under discrete-trial procedures in which a choice was arranged between edible reinforcers that differed in magnitude and, in some conditions, delay. In the absence of delays the larger reinforcer was consistently chosen. Under conditions in which the smaller reinforcer was not delayed, increasing the delay to delivery of the larger reinforcer decreased the percentage of trials in which that reinforcer was chosen. All subjects directed the majority of choice responses to the smaller reinforcer when the larger reinforcer was sufficiently delayed, although the value at which this occurred differed across subjects. Under conditions in which the larger reinforcer initially was sufficiently delayed to result in preference for the smaller one, progressively increasing in 5-s increments the delay to both reinforcers increased percentage of trials with the larger reinforcer chosen. At sufficiently long delays, 2 of the subjects consistently chose the larger, but more delayed, reinforcer, and the 3rd subject chose that reinforcer on half of the trials. These results are consistent with the findings of prior studies in which adult humans responded to terminate noise and pigeons responded to produce food.     

Gambling and Delay Discounting in Japanese Students

The present study examined the relationship between gambling behavior and delay discounting with Japanese residents. Japanese university students were selected into pathological gambler and non‐gambling control groups using a Japanese version of the South Oaks Gambling Screen. In a discounting task, participants chose individually between a large delayed reward and a smaller immediate reward with varied delays. The discounting rate (k‐value) and the area under the curve were significantly higher and smaller, respectively, for the gambler group than for the control group. These findings show that Japanese gamblers discount delayed rewards more steeply than non‐gambling controls, as has been found in U.S. residents.     

Choice in a "self-control" paradigm: effects of a fading procedure

Pigeons chose between an immediate 2-second reinforcer (access to grain) and a 6-second reinforcer delayed 6 seconds. The four pigeons in the control group were exposed to this condition initially. The four experimental subjects first received a condition where both reinforcers were delayed 6 seconds. The small reinforcer delay was then gradually reduced to zero over more than 11,000 trials. Control subjects almost never chose the large delayed reinforcer. Experimental subjects chose the large delayed reinforcer significantly more often. Two experimental subjects showed preference for the large reinforcer even when the consequences for pecking the two keys were switched. The results indicate that fading procedures can lead to increased “self-control” in pigeons in a choice between a large delayed reinforcer and a small immediate reinforcer.     

Substance use disinhibition associated with economically rational decisions to quit a boring task

Preferences for smaller immediate rewards over larger delayed rewards have been associated with a range of negative outcomes, including substance use problems. The present research investigated a potential association between substance use disinhibition and preferences for an immediate reward in a situation where the delayed reward was not the largest. Participants recruited from Amazon Mechanical Turk were required to perform a boring, repetitive task for 25 min in order to earn a $3 bonus. Alternatively, they could quit at any time to receive half the bonus. However, when one fourth the task remained, participants were offered the choice between (a) quitting the boring task for a $3 bonus, and (b) continuing the boring task for a $3 bonus. Participants who chose the economically superior option of quitting the task scored higher on a measure of substance use disinhibition and on the Disinhibition facet of Zuckerman’s Sensation Seeking Scale.     

TEACHING SELF‐CONTROL WITH QUALITATIVELY DIFFERENT REINFORCERS

This study examined the effectiveness of using qualitatively different reinforcers to teach self‐control to an adolescent boy who had been diagnosed with an intellectual disability. First, he was instructed to engage in an activity without programmed reinforcement. Next, he was instructed to engage in the activity under a two‐choice fixed‐duration schedule of reinforcement. Finally, he was exposed to self‐control training, during which the delay to a more preferred reinforcer was initially short and then increased incrementally relative to the delay to a less preferred reinforcer. Self‐control training effectively increased time on task to earn the delayed reinforcer.