Self-control and impulsiveness in children and adults: Effects of food preferences

Experiment 1 used 6 preschool boys and Experiment 2 used 6 adult women to explore the effects of food preference on humans' choice in self-control paradigms. The boys showed a higher proportion of responses for more delayed, larger reinforcers (a measure of self-control) when those choices resulted in receipt of the most preferred food compared to when those choices resulted in the least preferred food. Further, the boys chose the less delayed, smaller reinforcers significantly more often when only those choices, as opposed to both choices, resulted in the most preferred food. Conversely, they chose the more delayed, larger reinforcers significantly more often when only those choices, as opposed to both choices, resulted in the most preferred food. Finally, the women demonstrated significantly less sensitivity to reinforcer amount relative to sensitivity to reinforcer delay (another measure of self-control) when they had a higher preference for the juice received as the less delayed, smaller reinforcer than for the juice received as the more delayed, larger reinforcer. Together, the results show that subjects' food preferences can influence self-control for food reinforcers.     

Chimpanzees (Pan troglodytes) can wait,when they choose to: a study with the hybrid delay task

Self-control has been studied in nonhuman animals using a variety of tasks. The inter-temporal choice (ITC) task presents choices between smaller–sooner (SS) and larger–later (LL) options. Using food amounts as rewards, this presents two problems: (a) choices of the LL option could either reflect self-control or instead result from animals’ difficulty with pointing to smaller amounts of food; (b) there is no way to verify whether the subjects would not revert their choice for the LL option, if given the opportunity to do so during the ensuing delay. To address these problems, we have recently introduced a new protocol, the hybrid delay task, which combines an initial ITC with a subsequent accumulation phase in which selection of the SS option leads to its immediate delivery, but choice of the LL option then leads to one-by-one presentation of those items that continues only as long as the subject does not eat any of the accumulated items. The choice of the LL option therefore only reflects self-control when the number of items obtained from LL choices during the accumulation phase is higher than what could be received in the SS option. Previous research with capuchin monkeys demonstrated that their apparent self-control responses in the ITC task may have overestimated their general self-control abilities, given their poor performance in the hybrid delay task. Here, chimpanzees instead demonstrated that their choices for the LL option in the ITC phase of the hybrid delay task were confirmed by their ability to sustain long delays during accumulation of LL rewards.     

Impulsive choice and pre‐exposure to delays: iv. effects of delay‐ and immediacy‐exposure training relative to maturational changes in impulsivity

Impulsive choice describes preference for smaller, sooner rewards over larger, later rewards. Excessive delay discounting (i.e., rapid devaluation of delayed rewards) underlies some impulsive choices, and is observed in many maladaptive behaviors (e.g., substance abuse, gambling). Interventions designed to reduce delay discounting may provide therapeutic gains. One such intervention provides rats with extended training with delayed reinforcers. When compared to a group given extended training with immediate reinforcers, delay‐exposed rats make significantly fewer impulsive choices. To what extent is this difference due to delay‐exposure training shifting preference toward self‐control or immediacy‐exposure training (the putative control group) shifting preference toward impulsivity? The current study compared the effects of delay‐ and immediacy‐exposure training to a no‐training control group and evaluated within‐subject changes in impulsive choice across 51 male Wistar rats. Delay‐exposed rats made significantly fewer impulsive choices than immediacy‐exposed and control rats. Between‐group differences in impulsive choice were not observed in the latter two groups. While delay‐exposed rats showed large, significant pre‐ to posttraining reductions in impulsive choice, immediacy‐exposed and control rats showed small reductions in impulsive choice. These results suggest that extended training with delayed reinforcers reduces impulsive choice, and that extended training with immediate reinforcers does not increase impulsive choice.     

The Effect of Symbolic Distancing on Delay Tolerance across the Preschool Period

ABSTRACT

We aimed to longitudinally examine how symbolic distancing affects preschool children’s delay tolerance in a delay choice task. We presented children with choices between a smaller immediate reward and a larger delayed reward in conditions with either symbolic stimuli or edible rewards. Overall, symbolic distancing modulated children’s delay tolerance. In particular, whereas in the first phase (T1: 3- and 4-year-olds) children presented with edible rewards chose the larger option more often than children presented with symbolic stimuli, in the second phase (T2: 5- and 6-year-olds), there was no significant difference between children presented with symbolic stimuli and those presented with edible rewards. These results are discussed by examining how children’s delay tolerance changes during the development and comparing children to adult humans in a similar task.     

Under what conditions do young children have difficulty inhibiting manual actions?

Understanding how responses become prepotent is essential for understanding when inhibitory control is needed in everyday behavior. The authors investigated the conditions under which manual actions became prepotent in a go/no-go task. Children had to open boxes that contained stickers on go trials and leave shut boxes that were empty on no-go trials. In Experiment 1 (n = 40, mean age = 3.6 years), the authors obtained evidence consistent with this task requiring inhibitory control. Results of Experiment 2 (n = 40, mean age = 3.7 years) suggested that box opening was prepotent because (a) opening is the habitual action associated with boxes and (b) children planned to open boxes on go trials of the task. Experiment 3 (n = 96, mean age = 3.5 years) showed that even empty boxes elicited the same errors and that delaying responding reduced errors even though the delay occurred before the cue that indicated the correct response (contrary to a rule reflection account). Because the delay occurred after box presentation, performance was consistent with a transient activation account. Delay training might benefit children with weak inhibition.     

Determinants of pigeons' choices in token-based self-control procedures

Four pigeons were exposed to a token-based self-control procedure with stimulus lights serving as token reinforcers. Smaller-reinforcer choices produced one token immediately; larger-reinforcer choices produced three tokens following a delay. Each token could be exchanged for 2-s access to food during a signaled exchange period each trial. The main variables of interest were the exchange delays (delays from the choice to the exchange stimulus) and the food delays (also timed from the choice), which were varied separately and together across blocks of sessions. When exchange delays and food delays were shorter following smaller-reinforcer choices, strong preference for the smaller reinforcer was observed. When exchange delays and food delays were equal for both options, strong preference for the larger reinforcer was observed. When food delays were equal for both options but exchange delays were shorter for smaller-reinforcer choices, preference for the larger reinforcer generally was less extreme than under conditions in which both exchange and food delays were equal. When exchange delays were equal for both options but food delays were shorter for smaller-reinforcer choices, preference for the smaller reinforcer generally was less extreme than under conditions in which both exchange and food delays favored smaller-reinforcer choices. On the whole, the results were consistent with prior research on token-based self-control procedures in showing that choices are governed by reinforcer immediacy when exchange and food delays are unequal and by reinforcer amount when exchange and food delays are equal. Further, by decoupling the exchange delays from food delays, the results tentatively support a role for the exchange stimulus as a conditioned reinforcer.     

Inhibitory control and response selection in problem solving: how cotton-top tamarins (Saguinus oedipus) overcome a bias for selecting the larger quantity of food

When presented with a choice between 1 and 3 pieces of food in a type of reversed contingency task, 4 cotton-top tamarins (Saguinus oedipus) consistently chose the 3 pieces of food and received nothing, even though the choice of 1 piece would have yielded 3. However, in a task in which the tamarins received the 1 piece of food when they chose it, all subjects learned to select 1 over 3. Thus, the tamarins' prior failure on the reversed contingency task did not result entirely from an inherent inability to suppress the prepotent response of reaching to the larger of 2 quantities of food. After the experience of selecting the smaller quantity and receiving it, all of the tamarins solved the version of the reversed contingency task that they failed initially. These results suggest that the tamarins' initial failure may have reflected a difficulty with selecting an alternative response option.     

RISKY CHOICE IN PIGEONS: PREFERENCE FOR AMOUNT VARIABILITY USING A TOKEN-REINFORCEMENT SYSTEM

Pigeons were given repeated choices between variable and fixed numbers of token reinforcers (stimulus lamps arrayed above the response keys), with each earned token exchangeable for food. The number of tokens provided by the fixed‐amount option remained constant within blocks of sessions, but varied parametrically across phases, assuming values of 2, 4, 6, or 8 tokens per choice. The number of tokens provided by the variable‐amount option varied between 0 and 12 tokens per choice, arranged according to an exponential or rectangular distribution. In general, the pigeons strongly preferred the variable option when the fixed option provided equal or greater numbers of tokens than the variable amount. Preference for the variable amount decreased only when the alternatives provided widely disparate amounts favoring the fixed amount. When tokens were removed from the experimental context, preference for the variable option was reduced or eliminated, suggesting that the token presentation played a key role in maintaining risk‐prone choice patterns. Choice latencies varied inversely with preferences, suggesting that local analyses may provide useful ancillary measures of reinforcer value. Overall, the results indicate that systematic risk sensitivity can be attained with respect to reinforcer amount, and that tokens may be critical in the development of such preferences.     

Control your cravings: Self-controlled food choice varies by eating attitudes,sex, and food type among Division I collegiate athletes

Eating attitudes are predictive of disordered eating, which can be quite prevalent among collegiate athletes. The present study tested if disordered eating attitudes and the sex of collegiate athletes are related to “self-controlled food choice” for four food types: a dessert, fried food, fruit, and vegetable. In total, 102 athletes completed a disordered eating attitudes assessment and a delay discounting task. For the delay discounting task, athletes chose between one large delayed reward and one successively smaller immediate reward for four food types, and indifference points were computed with lower indifference points indicating greater self-controlled food choice. In this study female athletes showed greater self-controlled food choice for all three tempting food types (dessert, fried food, and fruit), but not the control food type (vegetable). For males, results were moderated by their level of disordered eating attitudes. Overall, these data show that “self-controlled food choice,” measured using a delay discounting task, is a key factor related to sex differences in disordered eating attitudes among college athletes.     

Left Hemispheric Lateral Preference and High Neuroticism Predict Disinhibition in Two Go/No‐Go Experiments

Although disinhibition is widely implicated in impulse‐control‐related psychopathologies, debate remains regarding the underlying approach and avoidance processes of this construct. In two studies, we simultaneously tested three competing models in which varying levels of extraversion, neuroticism, and hemispheric lateral preference are associated with disinhibition. In both studies (Study 1, N = 92; Study 2, N = 124), undergraduate students were randomly allocated to one of two versions of the go/no‐go task: one where participants were primed through reward to make more “go” responses and another where no such priming occurred. Neuroticism, extraversion, and hemispheric lateral preference measures were also collected. Across both studies, disinhibition was greatest in individuals who reported both a left hemispheric lateral preference and high neuroticism. This pattern was only found for those who were primed through reward to make more “go” responses. There was no association with extraversion. Contrary to previous research, our results suggest that left hemispheric asymmetry and neuroticism and not extraversion drive disinhibited approach, following the establishment of a prepotent approach response set. This has salient implications for the theoretical understanding of disinhibited behavior, as well as for the study of continued maladaptive approach behavior.     

Rhesus macaques (Macaca mulatta) spontaneously generalize to novel quantities in a reverse-reward contingency task

Abstracting generalities from concrete experience allows the application of acquired knowledge to novel situations, a hallmark of primate cognition. Abstraction may also enable some animals to overcome prepotent biases, by allowing them to treat prepotent stimuli and responses more flexibly. The aim of the current study was to determine whether rhesus macaques (Macaca mulatta) could generalize successful performance on an executive control task with one training exemplar to novel exemplars. Three monkeys learned a reverse-reward task in which they chose between one and four food items. They had to select the smaller quantity to receive the larger one, and so had to inhibit the prepotent selection of the larger quantity. After they learned the task, a transfer test assessed whether they had learned only about the quantities experienced or whether they could generalize to novel quantities. All three rhesus monkeys spontaneously generalized to novel quantities, showing that this species has the ability to generalize significantly beyond the immediate perceptual experience and use this ability to control lower-level, prepotent responses.     

Capuchin monkeys (Cebus apella) let lesser rewards pass them by to get better rewards

Self-control is defined as foregoing an immediate reward to gain a larger delayed reward. Methods used to test self-control comparatively include inter-temporal choice tasks, delay of gratification tasks, and accumulation tasks. To date, capuchin monkeys have shown different levels of self-control across tasks. This study introduced a new task that could be used comparatively to measure self-control in an intuitive context that involved responses that required no explicit training. Capuchin monkeys (Cebus apella) were given a choice between two food items that were presented on a mechanized, revolving tray that moved those foods sequentially toward the monkeys. A monkey could grab the first item or wait for the second, but was only allowed one item. Most monkeys in the study waited for a more highly preferred food item or a larger amount of the same food item when those came later, and they inhibited the prepotent response to grab food by not reaching out to take less-preferred foods or smaller amounts of food that passed directly in front of them first. These data confirm that the mechanisms necessary for self-control are present in capuchin monkeys and indicate that the methodology can be useful for broader comparative assessments of self-control.     

Token reinforcement, choice, and self-control in pigeons.

Pigeons were exposed to self-control procedures that involved illumination of light-emitting diodes (LEDs) as a form of token reinforcement. In a discrete-trials arrangement, subjects chose between one and three LEDs; each LED was exchangeable for 2-s access to food during distinct posttrial exchange periods. In Experiment 1, subjects generally preferred the immediate presentation of a single LED over the delayed presentation of three LEDs, but differences in the delay to the exchange period between the two options prevented a clear assessment of the relative influence of LED delay and exchange-period delay as determinants of choice. In Experiment 2, in which delays to the exchange period from either alternative were equal in most conditions, all subjects preferred the delayed three LEDs more often than in Experiment-1. In Experiment 3, subjects preferred the option that resulted in a greater amount of food more often if the choices also produced LEDs than if they did not. In Experiment 4, preference for the delayed three LEDs was obtained when delays to the exchange period were equal, but reversed in favor of an immediate single LED when the latter choice also resulted in quicker access to exchange periods. The overall pattern of results suggests that (a) delay to the exchange period is a more critical determinant of choice than is delay to token presentation; (b) tokens may function as conditioned reinforcers, although their discriminative properties may be responsible for the self-control that occurs under token reinforcer arrangements; and (c) previously reported differences in the self-control choices of humans and pigeons may have resulted at least in part from the procedural conventions of using token reinforcers with human subjects and food reinforcers with pigeon subjects.     

The development of prudence in the face of varying future rewards

The choice to delay gratification, opting for a greater reward later instead of a smaller reward now, has been used as a measure of preschoolers' ability to make future-oriented decisions. The present studies investigated to what extent these choice tasks reflect children's ability to make choices in favour of their future self. In Experiment 1, preschoolers were presented with choices between a smaller immediate reward of one sticker and larger delayed rewards varying in amount from two to five stickers. Whereas 3-year-olds showed no increased tendency to choose the delayed option as quantity increased from two to five, 4-year-olds' future-oriented choices reflected the value of the delayed reward. In Experiment 2, preschoolers chose between immediate and delayed rewards that were equal in amount and varied between one and four stickers. Three-year-olds reliably chose the immediate reward and showed no differentiation among rewards, whereas 4-year-olds chose in a manner that suggested they were trying to satisfy both immediate and future desires. Together these results support the notion that future-oriented prudence reflects growth in concern for the future self.     

IMPULSIVITY AND INHIBITORY CONTROL

Abstract— We report an experiment testing the hypothesis that impulsive behavior reflects a deficit in the ability to inhibit prepotent responses Specifically, we examined whether impulsive people respond more slowly to signals to inhibit (stop signals) than non-impulsive people In this experiment, 136 undergraduate students completed an impulsivity questionnaire and then participated in a stop-signal experiment, in which they performed a choice reaction time (go) task and were asked to inhibit their responses to the go task when they heard a stop signal The delay between the go signal and the stop signal was determined by a tracking procedure designed to allow subjects to inhibit on 50% of the stop-signal trials. Reaction time to the go signal did not vary with impulsivity, but estimated stop-signal reaction time was longer in more impulsive subjects, consistent with the hypothesis and consistent with results from populations with pathological problems with impulse control.     

Altering Impulsive Decision Making With an Acceptance-Based Procedure

Delay discounting is one facet of impulsive decision making and involves subjectively devaluing a delayed outcome. Steeply discounting delayed rewards is correlated with substance abuse and other problematic behaviors. To the extent that steep delay discounting underlies these clinical disorders, it would be advantageous to find psychosocial avenues for reducing delay discounting. Acceptance-based interventions may prove useful as they may help to decrease the distress that arises while waiting for a delayed outcome. The current study was conducted to determine if a 60–90 minute acceptance-based training would change delay discounting rates among 30 undergraduate university students in comparison to a waitlist control. Measures given at pre- and posttraining included a hypothetical monetary delay discounting task, the Acceptance and Action Questionnaire-II (AAQ-II), and the Distress Tolerance Scale. Those assigned to the treatment group decreased their discounting of delayed money, but not distress intolerance or psychological inflexibility when compared to the waitlist control group. After the waiting period, the control group received the intervention. Combining all participants’ pre- to posttreatment data, the acceptance-based treatment significantly decreased discounting of monetary rewards and increased distress tolerance. The difference in AAQ-II approached significance. Acceptance-based treatments may be a worthwhile option for decreasing delay discounting rates and, consequently, affecting the choices that underlie addiction and other problematic behaviors.     

得失不对称：跨期选择中自我-他人决策差异

采用跨期选择任务范式,考察得失情境下自我–他人决策差异。结果发现：（1）为自己决策比为他人决策更偏好于选择即刻选项;（2）损失情境比获益情境下更偏好于选择即刻选项;（3）获益情境下为自己决策与为他人决策在选择即刻选项上不存在显著差异,而损失情境下为自己决策比为他人决策更偏好于选择即刻选项,表明得失情境下自我–他人决策差异存在不对称性。     

Self-control in mentally retarded adolescents: choice as a function of amount and delay of reinforcement.

Three severely mentally retarded adolescents were studied under discrete-trial procedures in which a choice was arranged between edible reinforcers that differed in magnitude and, in some conditions, delay. In the absence of delays the larger reinforcer was consistently chosen. Under conditions in which the smaller reinforcer was not delayed, increasing the delay to delivery of the larger reinforcer decreased the percentage of trials in which that reinforcer was chosen. All subjects directed the majority of choice responses to the smaller reinforcer when the larger reinforcer was sufficiently delayed, although the value at which this occurred differed across subjects. Under conditions in which the larger reinforcer initially was sufficiently delayed to result in preference for the smaller one, progressively increasing in 5-s increments the delay to both reinforcers increased percentage of trials with the larger reinforcer chosen. At sufficiently long delays, 2 of the subjects consistently chose the larger, but more delayed, reinforcer, and the 3rd subject chose that reinforcer on half of the trials. These results are consistent with the findings of prior studies in which adult humans responded to terminate noise and pigeons responded to produce food.     

Frequency and value both matter in the suboptimal choice procedure

Pigeons chose between two options on a concurrent‐chains task with a single response requirement in the initial link. The suboptimal option ended with food 20% of the time whereas the optimal option ended with food 80% of the time. During a Sig‐Both condition, terminal‐link stimuli on both options signaled whether or not food would occur. During a Sig‐Sub condition, terminal‐link stimuli on the suboptimal option provided differential signals, but stimuli on the optimal option did not differentially signal the food and no food outcomes. Initial‐link choices revealed a clear preference for the optimal option in the Sig‐Both condition, but preference shifted toward suboptimality in the Sig‐Sub condition. These findings show that pigeon suboptimal choice is not singularly driven by signal value, as has been suggested, but also by reinforcer frequency.     

Preference for progressive delays and concurrent physical therapy exercise in an adult with acquired brain injury

The purpose of this study was to increase self-control and engagement in a physical therapy task (head holding) for a man with acquired traumatic brain injury. Once impulsivity was observed (i.e., repeated impulsive choices), an experimental condition was introduced that consisted of choices between a small immediate reinforcer, a large fixed-delay reinforcer, and a large progressive-delay reinforcer. The participant showed a preference for the progressive-delay option, even when the duration of the delay exceeded that of the fixed delay. The results have implications for establishing optimal choice making and teaching life-enhancing skills.