Self-control and choice in humans: Effects of video game playing as a positive reinforcer

Participants chose between reinforcement schedules differing in delay of reinforcement (interval between a choice response and onset of a video game) and/or amount of reinforcement (duration of access to the game). Experiment 1 showed that immediate reinforcement was preferred to delayed reinforcement with amount of reinforcement held constant, and a large reinforcer was preferred to a small reinforcer when both were obtainable immediately. Imposing a delay before the large reinforcer produced a preference for the immediate, small reinforcer in 40% of participants. This suggested a limited degree of “impulsivity.” In Experiment 2, unequal delays were extended by equal intervals, the amounts being kept equal. Preference for the shorter delay decreased, an effect that presumably makes possible the “preference reversal” phenomenon in studies of self-control. Overall, the results demonstrate that video game playing can produce useful, systematic data when used as a positive reinforcer for choice behavior in humans.     

Multiple‐stimulus preference assessments: a comparison of free‐operant and restricted‐operant formats

We compared free‐operant and restricted‐operant multiple‐stimulus preference assessments with three children diagnosed with mental retardation. The methods produced comparable results, although the free‐operant assessment identified fewer potential reinforcers than the restricted‐operant assessment. The highest‐ and lowest‐ranked stimuli from both methods were subsequently evaluated in a concurrent‐operants reinforcer assessment. All participants engaged in behavior that resulted in access to the highest‐ranked stimuli the majority of the time, thus validating both preference assessment methods as effective in identifying reinforcers. Copyright © 2000 John Wiley & Sons, Ltd.     

Reinforcement Probability and Delay as Determinants of Human Impulsiveness

In behavior theory, “impulsiveness” refers to the choice of an immediate, small reinforcer over a delayed, large reinforcer. Such behavior generally is attributed to a reduction in the value of the large reinforcer as a function of the duration of delay. In contrast, social learning theorists have suggested that human impulsiveness can result from a lowered “expectancy” (subjective probability) of reinforcement. Effects of probability and delay were assessed by asking adults to make repeated choices between reinforcement schedules in which the reinforcers were slides of entertainment figures. An immediate, 5-s reinforcer was consistently chosen over an immediate, 40-s reinforcer if the probability of receiving the large reinforcer had previously been low (.20), implying that impulsiveness can occur without time-based discounting. However, reinforcement delay was also influential: Choice between a certain, small reinforcer and an uncertain, large reinforcer varied according to which reinforcer was immediate and which delayed.

     

A comparison of preference‐assessment methods

In Study 1, we evaluated preference stability across 4 preference‐assessment methods for 6 individuals, 5 of whom had autism spectrum disorder and 1 of whom had traumatic brain injury. We also measured participants’ problem behavior as a corollary measure during all assessment methods. The highest mean correlation coefficients and Kendall rank coefficients of concordance across administrations were observed for the paired‐stimulus and multiple‐stimulus‐without‐replacement methods. Lower correspondence across administrations was observed for the free‐operant and response‐restriction methods. Although differentially higher levels of problem behavior did not occur with a single method, lower levels were consistently observed with the free‐operant method. During Study 2, we evaluated the implications of lower coefficients on reinforcer efficacy by comparing an initially identified and an immediately identified high‐preference stimulus in a reinforcer assessment. Initially identified and immediately identified high‐preference stimuli were equally effective reinforcers, suggesting that fluctuations in preference do not necessarily affect reinforcer efficacy in practice.     

Enhancing tolerance to delayed reinforcers: the role of intervening activities

Three participants with moderate to profound mental retardation were exposed to choices between an immediate small amount and a delayed larger amount of a preferred reinforcer. All participants initially showed a relatively high preference for the smaller reinforcer, suggesting impulsive choice making. However this preference reversed, suggesting self-control, when the larger reinforcer was available immediately and, over time, its delay was gradually increased. Results highlight the potential utility of incorporating concurrent activities into self-control training paradigms.     

Interval timing predicts impulsivity in intertemporal choice: combined behavioral and drift-diffusion model evidence

ABSTRACT

This study investigated the relationship between interval timing and impulsivity in intertemporal choice in a healthy population. A duration production task was used to assess interval timing. Choice impulsivity was assessed using a hypothetical money choice task. Results from 134 participants indicated that faster internal clock significantly predicted lower choice impulsivity. A subsequent drift-diffusion model analysis of the behavioural data revealed that in the sub-group of relatively farsighted participants, faster internal clock predicted consideration of more information before making a choice, which in turn was associated with lower choice impulsivity. In the sub-group of relatively impatient participants too, faster internal clock predicted consideration of more information, but which in turn was associated with higher choice impulsivity. It is concluded that among relatively farsighted individuals in a normal population, faster internal clock favours a more deliberate processing of the options at hand, thus eliciting less impulsive choices.     

Negative reinforcement and choice in humans

Participants chose between reinforcement schedules differing in delay and/or duration of noise offset. In Experiment 1 it was found that (1) immediate reinforcement was preferred to delayed reinforcement when amounts (durations) of reinforcement were equal; (2) a relatively large reinforcer was preferred to a smaller one when both reinforcers were obtained immediately; and (3) preference for an immediate, small reinforcer versus a delayed, large reinforcer increased as the delay preceding the large reinforcer increased, a sign of “impulsivity”. In Experiment 2, the schedules differed in amount or delay and equal intervals were added either to the constant parameter or the varied parameter. A shift from virtually exclusive preference to indifference occurred in the latter case but not the former, a result supporting a model of self-control that assumes that the value of a schedule depends on the ratio of amount and delay, and that choice between schedules depends on the ratio of these values.     

Self-control in children with autism: response allocation during delays to reinforcement.

This study examined the use of a progressive‐delay schedule of reinforcement to increase self‐control and decrease disruptive behavior in children with autism. When initially given the choice between an immediate smaller reinforcer and a larger delayed reinforcer, all participants chose the smaller reinforcer. When access to the larger reinforcer required either no activity or engaging in a concurrent task during the delay, all participants demonstrated both self‐control and preference for a response requirement. Disruptive behavior decreased during delays that required a concurrent task compared to sessions without an activity requirement.     

A Brief Experimental Analysis of Reinforcer and Response Dimensions Related to Self-Control in an Outpatient Clinic

We conducted an assessment of self-control and impulsivity with 9 children referred to an outpatient clinic for impulsive, inattentive, and hyperactive behaviors. Each condition of the assessment consisted of a choice between 2 concurrently presented math or writing tasks, with 1 alternative reflecting impulsive responding and 1 alternative reflecting self-control. For the participants who demonstrated impulsive responding in 1 of 2 baseline conditions, we systematically varied reinforcer quality, delay to reinforcement, and response effort to evaluate the effects of these dimensions on the participants’ choices. Results of the assessment revealed that 3 participants displayed self-control responding, and 6 participants displayed impulsive responding during baseline conditions. Of the participants who displayed initial impulsivity, all showed self-control when 1 or more response or reinforcement dimensions were modified to bias responding within a brief multielement design. Results provide a unique application of concurrent schedules for conducting a brief assessment of impulsive responding in an outpatient clinical setting.     

CORRESPONDENCE BETWEEN SINGLE VERSUS DAILY PREFERENCE ASSESSMENT OUTCOMES AND REINFORCER EFFICACY UNDER PROGRESSIVE‐RATIO SCHEDULES

Research has suggested that a daily multiple‐stimulus‐without‐replacement (MSWO) preference assessment may be more sensitive to changes in preference than other assessment formats, thereby resulting in greater correspondence with reinforcer efficacy over time ( DeLeon et al., 2001 ). However, most prior studies have measured reinforcer efficacy using rate of responding under single‐operant arrangements and dense schedules or under concurrent‐operants arrangements. An alternative measure of reinforcer efficacy involves the evaluation of responding under progressive‐ratio (PR) schedules. In the present study, 7 participants were given a single paired‐stimulus (PS) preference assessment followed by daily MSWO preference assessments. After each daily MSWO, participants responded for each stimulus on a PR schedule. The correspondence between break points and preferences, as assessed by the 2 assessment formats, was examined. Results demonstrated that both preference assessments did equally well at predicting reinforcer efficacy, although the PS more consistently identified the most effective reinforcer.     

The Modulation of Operant Variation by the Probability, Magnitude, and Delay of Reinforcement

Recent studies have demonstrated that the expectation of reward delivery has an inverse relationship with operant behavioral variation (e.g., Stahlman, Roberts, & Blaisdell, 2010). Research thus far has largely focused on one aspect of reinforcement – the likelihood of food delivery. In two experiments with pigeons, we examined the effect of two other aspects of reinforcement: the magnitude of the reward and the temporal delay between the operant response and outcome delivery. In the first experiment, we found that a large reward magnitude resulted in reduced spatiotemporal variation in pigeons’ pecking behavior. In the second experiment, we found that a 4-s delay between response-dependent trial termination and reward delivery increased variation in behavior. These results indicate that multiple dimensions of the reinforcer modulate operant response variation.     

EFFECTIVENESS OF FUNCTIONAL COMMUNICATION TRAINING WITH AND WITHOUT EXTINCTION AND PUNISHMENT: A SUMMARY OF 21 INPATIENT CASES

Functional communication training (FCT) is a frequently used treatment for reducing problem behavior exhibited by individuals with developmental disabilities. Once the operant function of problem behavior is identified by a functional analysis, the client is taught to emit an appropriate communicative response to obtain the reinforcer that is responsible for behavioral maintenance. Studies on FCT have typically used small numbers of participants, have reported primarily on clients for whom FCT was successful, and have varied with respect to their use of other treatment components. The main purposes of the present study were to evaluate the efficacy of FCT for treating severe problem behavior in a relatively large sample of individuals with mental retardation (N = 21) and to determine the contribution of extinction and punishment components to FCT treatment packages. FCT with extinction was effective in reducing problem behavior for the majority of clients and resulted in at least a 90% reduction in problem behavior in nearly half the applications. However, when demand or delay-to-reinforcement fading was added to FCT with extinction, treatment efficacy was reduced in about one half of the applications. FCT with punishment (both with and without fading) resulted in at least a 90% reduction in problem behavior for every case in which it was applied.     

Experience with dynamic reinforcement rates decreases resistance to extinction

The ability of organisms to detect reinforcer‐rate changes in choice preparations is positively related to two factors: the magnitude of the change in rate and the frequency with which rates change. Gallistel (2012) suggested similar rate‐detection processes are responsible for decreases in responding during operant extinction. Although effects of magnitude of change in reinforcer rate on resistance to extinction are well known (e.g., the partial‐reinforcement‐extinction effect), effects of frequency of changes in rate prior to extinction are unknown. Thus, the present experiments examined whether frequency of changes in baseline reinforcer rates impacts resistance to extinction. Pigeons pecked keys for variable‐interval food under conditions where reinforcer rates were stable and where they changed within and between sessions. Overall reinforcer rates between conditions were controlled. In Experiment 1, resistance to extinction was lower following exposure to dynamic reinforcement schedules than to static schedules. Experiment 2 showed that resistance to presession feeding, a disruptor that should not involve change‐detection processes, was unaffected by baseline‐schedule dynamics. These findings are consistent with the suggestion that change detection contributes to extinction. We discuss implications of change‐detection processes for extinction of simple and discriminated operant behavior and relate these processes to the behavioral‐momentum based approach to understanding extinction.     

Stimulus Equivalence: Effects Of A Default-response Option On Emergence Of Untrained Stimulus Relations

Human subjects were exposed to a concurrent-chains schedule in which reinforcer amounts, delays, or both were varied in the terminal links, and consummatory responses were required to receive points that were later exchangeable for money. Two independent variable-interval 30-s schedules were in effect during the initial links, and delay periods were defined by fixed-time schedules. In Experiment 1, subjects were exposed to three different pairs of reinforcer amounts and delays, and sensitivity to reinforcer amount and delay was determined based on the generalized matching law. The relative responding (choice) of most subjects was more sensitive to reinforcer amount than to reinforcer delay. In Experiment 2, subjects chose between immediate smaller reinforcers and delayed larger reinforcers in five conditions with and without timeout periods that followed a shorter delay, in which reinforcer amounts and delays were combined to make different predictions based on local reinforcement density (i.e., points per delay) or overall reinforcement density (i.e., points per total time). In most conditions, subjects' choices were qualitatively in accord with the predictions from the overall reinforcement density calculated by the ratio of reinforcer amount and total time. Therefore, the overall reinforcement density appears to influence the preference of humans in the present self-control choice situation.     

Preference for progressive delays and concurrent physical therapy exercise in an adult with acquired brain injury

The purpose of this study was to increase self-control and engagement in a physical therapy task (head holding) for a man with acquired traumatic brain injury. Once impulsivity was observed (i.e., repeated impulsive choices), an experimental condition was introduced that consisted of choices between a small immediate reinforcer, a large fixed-delay reinforcer, and a large progressive-delay reinforcer. The participant showed a preference for the progressive-delay option, even when the duration of the delay exceeded that of the fixed delay. The results have implications for establishing optimal choice making and teaching life-enhancing skills.     

Web‐based stimulus preference assessment and reinforcer assessment for videos

This study replicated and extended the use of a web‐based multiple‐stimulus‐without‐replacement preference assessment (Curiel, Curiel, Li, Deochand, & Poling, 2018) by adding a web‐based single‐operant reinforcer assessment. Five adults diagnosed with autism spectrum disorder participated in this study. The web‐based program identified preference hierarchies for 4 of the 5 participants, and the single‐operant reinforcer assessment confirmed that the highly preferred videos functioned as reinforcers. Advantages of computer‐based stimulus preference and reinforcer assessments are discussed.     

The Effects of a Daily Behavior Report Card Intervention: Inclusion of a Peer Mediator

Daily Behavior Report Cards (DBRCs) have been found to decrease disruptive behaviors of children with attention-deficit/hyperactivity disorder, intellectual and developmental disorders, and typically developing students. However, although previous studies indicate that peers can assist with the implementation of a variety of interventions (e.g., Check in check out), teachers are often the implementer of DBRCs. In addition, it appears that no studies evaluating DBRCs have included a functional assessment. Thus, the purposes of this study were to assess the effects of a peer-mediated DBRC on disruptive classroom behaviors, determine whether peers could implement their portion of the intervention procedures with high integrity, and assess whether DBRC was effective independent of the functional reinforcer for disruptive behavior. In this study, peer-mediated DBRC led to a decrease in disruptive behavior and an increase in on-task behavior for all three target students who were at risk for EBD. The peer mediators also implemented the DBRC procedures with high integrity. Furthermore, DBRC was effective at suppressing disruptive behavior independent of their presumed functional reinforcer. However, it does appear that different portions of the intervention likely addressed the hypothesized functions of problem behaviors of all three participants.

     

Low temporal precision for high impulsive individuals

Previous studies have shown that impulsive people perceive time differently from non-impulsive people. However, these studies either recruited participants from the clinical population or used impulsive behavior (rather than impulsivity trait itself) as the index of impulsivity. We investigated the relationship between time perception and self-report impulsivity trait (measured by the Barratt Impulsiveness Scale; BIS-11) in non-patient participants. We used the oddball paradigm to measure subjective duration and discrimination precision in high- and low-impulsive groups. Results show that high impulsive participants’ discrimination precision was lower than low impulsive participants (Experiment 1). The possibility that this is due to high impulsive participants having weaker attentional maintenance of the task was excluded (Experiment 2). By removing potentially confounding factors that existed in previous studies, our results demonstrate a more convincing relationship between temporal precision and the impulsivity trait in healthy participants.     

Assessing preference for types of social interaction

To date, few researchers have evaluated methods for assessing preference for social interactions. Due to concerns that commonly used stimulus preference assessment methods may be inappropriate, or at least cumbersome, for the assessment of social reinforcers, we developed and evaluated a new method of assessing preference for social interactions. A social interaction preference assessment (SIPA) and a concurrent operant reinforcer assessment were conducted with five participants diagnosed with autism spectrum disorder. A differentially preferred and reinforcing social interaction was identified for all five participants. The SIPA procedures, results, and the implications of these results are discussed.     

The roles of impulsivity,self-regulation,and emotion regulation in the experience of self-disgust

Self-disgust is a distinct self-conscious emotion schema that is characterized by disgust appraisals directed towards the self. Recent studies have demonstrated the negative effects of self-disgust on physical and mental health, but little is known about the psychological characteristics that are associated with self-disgust experiences. The present study assessed the direct and indirect effects of impulsivity, self-regulation, and emotion regulation on self-disgust. Overall, 294 participants (M age?=?21.84 years, SD?=?4.56) completed structured and anonymous measures of trait impulsivity, self-regulation, emotion regulation strategies, and self-disgust. Path analysis showed that non-planning impulsivity and expressive suppression (positively) and cognitive reappraisal and self-regulation (negatively) predicted self-disgust. Intervening variable analysis showed that attentional and non-planning impulsivity had significant indirect effects on self-disgust via emotional regulation strategies and self-regulation. Our findings provide, for the first time, evidence about the association between self-disgust and individual differences in impulsivity, self-regulation, and emotion regulation, and have implications for the psychological phenomena that may lead to self-disgust experiences in non-clinical populations.