A preliminary analysis of self-control with aversive events: the effects of task magnitude and delay on the choices of children with autism

When faced with a choice between two aversive events, a person exhibits self-control by choosing a smaller, more immediate aversive event over a larger, delayed aversive event. Task demands are often aversive to children with autism and other developmental disabilities. The purpose of this study was to evaluate behavioral sensitivity to differences in the amount and delay of tasks as part of a preliminary study on self-control. Participants were 2 children with autism who engaged in problem behavior maintained by escape. Results indicated a lack of self-control with respect to choosing between two aversive tasks and suggested potential strategies for increasing self-control (i.e., choosing a small immediate task over a large delayed task).     

Assessment and treatment of self-control with aversive events

Self-control can be defined as choosing a smaller, immediate aversive event over a larger, delayed aversive event (e.g., flossing daily instead of risking major dental problems later). Children with developmental disabilities have been found to respond impulsively when given the choice between aversive events that differ based on magnitude and difficulty. However, qualitative differences between events may also impact aversiveness. This study attempted to replicate and extend prior research by (i) empirically identifying a hierarchy of qualitatively different aversive tasks for three individuals with developmental disabilities by evaluating their average latency to escape responses when presented with each task, (ii) assessing baseline levels of self-control (i.e., selection of immediate, low-aversive tasks over delayed, high-aversive tasks), and (iii) implementing an empirically validated treatment (i.e., adding a delay to both tasks). Each participant initially made impulsive choices, but self-control increased following treatment.     

An analysis of aversive stimuli in classroom demand contexts

Although recent research has identified numerous variables that can affect behavior maintained by negative reinforcement, questions remain concerning the potential aspects of the demand context that evoke problem behavior. To date, few studies have examined these questions within general education classrooms. The current study assessed the influence of social and task-difficulty variables on problem behavior maintained by negative reinforcement. Teachers in general education classrooms implemented three analyses to determine the influence of these variables on the problem behavior of 4 boys. Results are discussed in terms of response covariation within the demand context.     

Assessment of impulsivity and the development of self-control in students with attention deficit hyperactivity disorder.

We examined a combined approach of manipulating reinforcer dimensions and delay fading to promote the development of self‐control with 3 students diagnosed with attention deficit hyperactivity disorder. First, we administered a brief computer‐based assessment to determine the relative influence of reinforcer rate (R), reinforcer quality (Q), reinforcer immediacy (I), and effort (E) on the students' choices between concurrently presented math problems. During each session, one of these dimensions was placed in direct competition with another dimension (e.g., RvI involving math problem alternatives associated with high‐rate delayed reinforcement vs. low‐rate immediate reinforcement), with all possible pairs of dimensions presented across the six assessment conditions (RvQ, RvI, RvE, QvI, QvE, IvE). The assessment revealed that the choices of all 3 students were most influenced by immediacy of reinforcement, reflecting impulsivity. We then implemented a self‐control training procedure in which reinforcer immediacy competed with another influential dimension (RvI or QvI), and the delay associated with the higher rate or quality reinforcer alternative was progressively increased. The students allocated the majority of their time to the math problem alternatives yielding more frequent (high‐rate) or preferred (high‐quality) reinforcement despite delays of up to 24 hr. Subsequent readministration of portions of the assessment showed that self‐control transferred across untrained dimensions of reinforcement.     

Effects of self-control training for elementary students with emotional and behavioral disorders

Progressive delay training (PDT) has been used to promote self-controlled choices (i.e., selecting a larger, later reward over a smaller, immediate reward) for people with a variety of developmental characteristics. However, the efficacy of PDT has not been evaluated in children with emotional and behavioral disorders (EBD), who often have co-occurring symptoms of impulsivity. The purpose of this study was to evaluate the effects of PDT with a rule-following requirement on the impulsive choices of 6 elementary students with EBD using a modified changing criterion design. Results indicated that PDT alone did not improve self-control, but a modified version of PDT with a rationale and rule for selecting the delayed reward promoted self-control for 3 participants. The remaining 3 participants continued to make impulsive choices despite further modifications to the PDT protocol. We discuss implications of our results and directions for future research on treating impulsivity in children with EBD.     

Effects of pre-trial response requirements on self-control choices by rats and pigeons

Parallel experiments with rats and pigeons examined whether the size of a pre-trial ratio requirement would affect choices in a self-control situation. In different conditions, either 1 response or 40 responses were required before each trial. In the first half of each experiment, an adjusting-ratio schedule was used, in which subjects could choose a fixed-ratio schedule leading to a small reinforcer, or an adjusting-ratio schedule leading to a larger reinforcer. The size of the adjusting ratio requirement was increased and decreased over trials based on the subject's responses, in order to estimate an indifference point-a ratio at which the two alternatives were chosen about equally often. The second half of each experiment used an adjusting-delay procedure-fixed and adjusting delays to the small and large reinforcers were used instead of ratio requirements. In some conditions, particularly with the reinforcer delays, the rats had consistently longer adjusting delays with the larger pre-trial ratios, reflecting a greater tendency to choose the larger, delayed reinforcer when more responding was required to reach the choice point. No consistent effects of the pre-trial ratio were found for the pigeons in any of the conditions. These results may indicate that rats are more sensitive to the long-term reinforcement rates of the two alternatives, or they may result from a shallower temporal discounting rate for rats than for pigeons, a difference that has been observed in previous studies.     

A procedure to teach self-control to children with attention deficit hyperactivity disorder

This study examined the use of a progressive delay procedure combined with verbal mediation to teach self-control to children with attention deficit disorder. Results showed that when participants were initially given the choice between an immediate smaller reinforcer and a larger delayed reinforcer, all participants chose the smaller reinforcer. When slight delays to obtain a larger reinforcer were instated in conjunction with intervening verbal activity, all participants demonstrated self-control regardless of the content of the verbal activity.     

Determinants of pigeons' choices in token-based self-control procedures

Four pigeons were exposed to a token-based self-control procedure with stimulus lights serving as token reinforcers. Smaller-reinforcer choices produced one token immediately; larger-reinforcer choices produced three tokens following a delay. Each token could be exchanged for 2-s access to food during a signaled exchange period each trial. The main variables of interest were the exchange delays (delays from the choice to the exchange stimulus) and the food delays (also timed from the choice), which were varied separately and together across blocks of sessions. When exchange delays and food delays were shorter following smaller-reinforcer choices, strong preference for the smaller reinforcer was observed. When exchange delays and food delays were equal for both options, strong preference for the larger reinforcer was observed. When food delays were equal for both options but exchange delays were shorter for smaller-reinforcer choices, preference for the larger reinforcer generally was less extreme than under conditions in which both exchange and food delays were equal. When exchange delays were equal for both options but food delays were shorter for smaller-reinforcer choices, preference for the smaller reinforcer generally was less extreme than under conditions in which both exchange and food delays favored smaller-reinforcer choices. On the whole, the results were consistent with prior research on token-based self-control procedures in showing that choices are governed by reinforcer immediacy when exchange and food delays are unequal and by reinforcer amount when exchange and food delays are equal. Further, by decoupling the exchange delays from food delays, the results tentatively support a role for the exchange stimulus as a conditioned reinforcer.     

The absence of numbers to express the amount may affect delay discounting with humans

Human delay discounting is usually studied with experimental protocols that use symbols to express delay and amount. In order to further understand discounting, we evaluated whether the absence of numbers to represent reward amounts affects discount rate in general, and whether the magnitude effect is generalized to nonsymbolic situations in particular. In Experiment 1, human participants were exposed to a delay‐discounting task in which rewards were presented using dots to represent monetary rewards (nonsymbolic); under this condition the magnitude effect did not occur. Nevertheless, the magnitude effect was observed when equivalent reward amounts were presented using numbers (symbolic). Moreover, in estimation tasks, magnitude increments produced underestimation of large amounts. In Experiment 2, participants were exposed only to the nonsymbolic discounting task and were required to estimate reward amounts in each trial. Consistent with Experiment 1, the absence of numbers representing reward amounts produced similar discount rates of small and large rewards. These results suggest that value of nonsymbolic rewards is a nonlinear function of amount and that value attribution depends on perceived difference between the immediate and the delayed nonsymbolic rewards.     

Building blocks of self-control: increased tolerance for delay with bundled rewards

Impulsive choice can be defined as temporary preference for a smaller-sooner reward (SS) over a larger-later reward (LL). Hyperbolic discounting implies that impulsive choices will occur less when organisms choose between a series of SSs versus LLs all at once than when they choose between single SS versus LL pairs. Eight rats were exposed to two conditions of an intertemporal choice paradigm using sucrose solution as reward. In both conditions, the LL was 150 microl delayed by 3 s, while the SS was an immediate reward that ranged from 25-150 microl across sessions. Preference for the LL was greater when the chosen reward was automatically delivered three times in succession (bundled) than when it was chosen singly and delivered after each choice. For each of the 8 rats, the estimated SS amount that produced indifference was higher in the bundled condition than in the single condition. Because bundling in humans may be based on the perception that one's current choice is predictive of future choices, the data presented here may demonstrate an important building block of self-control.     

Teaching self-control to small groups of dually diagnosed adults

The present study examined the use of a progressive delay procedure to teach self-control to two groups of dually diagnosed adults. When given a choice between an immediate smaller reinforcer and a larger delayed reinforcer, both groups chose the smaller reinforcer during baseline. During treatment, progressive increases in work requirements for gaining access to a larger reinforcer resulted in both groups selecting larger delayed reinforcers. The results are discussed with respect to increasing cooperative work behavior and self-control.     

A computerized test of self-control predicts classroom behavior

We assessed choices on a computerized test of self-control (CTSC) for a group of children with features of attention deficit hyperactivity disorder (ADHD) and a group of controls. Thirty boys participated in the study. Fifteen of the children had been rated by their parents as hyperactive and inattentive, and 15 were age- and gender-matched controls in the same classroom. The children were observed in the classroom for three consecutive mornings, and data were collected on their activity levels and attention. The CTSC consisted of two tasks. In the delay condition, children chose to receive three rewards after a delay of 60 s or one reward immediately. In the task-difficulty condition, the children chose to complete a difficult math problem and receive three rewards or complete an easier problem for one reward. The children with ADHD features made more impulsive choices than their peers during both conditions, and these choices correlated with measures of their activity and attention in the classroom.     

An analysis of procedures that affect response variability

Response variability is sensitive to antecedent and consequent manipulations. Researchers have investigated inducement, direct production through reinforcement, and stimulus control of response variability. Recently, researchers have shown that lag reinforcement schedules reliably increase variability but may also produce higher‐order stereotypy. There has been limited investigation of appropriate variability levels and alternation between repetition and variation. In a three‐part study, we evaluated levels of variability across a group of children, the effects of various procedures on producing response variability and novelty, and the use of schedule‐correlated stimuli for producing rapid alternation between repetition and variation. In Study 1, there was a nearly bimodal distribution of children emitting either low or high variability. In Study 2, for most children, fixed lag 4 and variable lag 4 schedules produced the highest levels of variability and novelty. In Study 3, responding was brought under control of schedule‐correlated stimuli, allowing for rapid alternation between repetition and variation.     

Effects of delay fading and signals on self‐control choices by children

The current study is a systematic replication and extension of work by Schweitzer & Sulzer‐Azaroff (1988). The effects of delay fading alone and in combination with signals on choices between larger, delayed reinforcers and smaller, immediate reinforcers by four children with language deficits were examined. For one of the two children exposed to delay fading alone, larger reinforcers were selected at longer delays relative to the initial self‐control assessment. For all four children, the delay‐fading‐plus‐signal condition resulted in selection of larger reinforcers at considerably longer delays relative to the self‐control assessment.     

Further analysis of subtypes of automatically reinforced SIB: A replication and quantitative analysis of published datasets

Hagopian, Rooker, and Zarcone (2015) evaluated a model for subtyping automatically reinforced self‐injurious behavior (SIB) based on its sensitivity to changes in functional analysis conditions and the presence of self‐restraint. The current study tested the generality of the model by applying it to all datasets of automatically reinforced SIB published from 1982 to 2015. We identified 49 datasets that included sufficient data to permit subtyping. Similar to the original study, Subtype‐1 SIB was generally amenable to treatment using reinforcement alone, whereas Subtype‐2 SIB was not. Conclusions could not be drawn about Subtype‐3 SIB due to the small number of datasets. Nevertheless, the findings support the generality of the model and suggest that sensitivity of SIB to disruption by alternative reinforcement is an important dimension of automatically reinforced SIB. Findings also suggest that automatically reinforced SIB should no longer be considered a single category and that additional research is needed to better understand and treat Subtype‐2 SIB.     

Response rate correlates with indifference points in a delay‐discounting procedure

To study how effort affects reward value, we replicated Fortes, Vasconcelos and Machado's (2015) study using an adjusting‐delay task. Nine pigeons chose between a standard alternative that gave access to 4 s of food, after a 10 s delay, and an adjusting‐delay alternative that gave access to 12 s of food after a delay that changed dynamically with the pigeons' choices, decreasing when they preferred the standard alternative, and increasing when they preferred the adjusting alternative. The delay value at which preference stabilized defined the indifference point, a measure of reward value. To manipulate effort across phases, we varied the response rate required during the delay of the standard alternative. Results showed that a) the indifference point increased in the higher‐response‐rate phases, suggesting that reward value decreased with effort, and b) in the higher‐response‐rate phases, response rate in the standard alternative was linearly related to the indifference point. We advance several conceptions of how effort may change perceived delay or amount and thereby affect reward value.     

Further evaluation of the role of protective equipment in the functional analysis of self-injurious behavior

Using a procedure similar to the one described by Le and Smith (in press), we evaluated the effects of protective equipment during a functional analysis for 2 individuals who engaged in severe self-injurious behavior (SIB). Results of our analyses revealed that the use of protective equipment during functional analyses of SIB suppressed levels of responding such that a behavioral function could not be identified.     

Preference reversals with food and water reinforcers in rats

Rats were given a choice between a smaller, immediately available reward and a larger reward available after a delay. In one phase, the reward was food and in another phase, the reward was water. Constant delays were added between the choice presentation and the delivery of the reward alternatives. As the time between choice and reward delivery increased from 0 to 25 s, all rats (except one in the water phase) reversed their preference from the smaller, sooner alternative to the larger, later alternative. These findings extend the generality of the preference-reversal animal model to qualitatively different reinforcers. Furthermore, the presence of both impulsive and self-control choices within the same animal is consistent with the view that self-control may be understood as choice behavior, and that species differences in self-control may be differences in degree, not kind.