Use of a lag differential reinforcement contingency to increase varied selections of classroom activities

The present study evaluated the effects of a lag differential reinforcement contingency on 2 students' activity selections using reversal designs. Results showed that the lag contingency was responsible for promoting increased novel selections, engagement in diverse activities, and greater progress with respect to programmed academic activities.     

Within-session delay-of-reinforcement gradients

Within-session delay-of-reinforcement gradients were generated with pigeons by progressively increasing delays to reinforcement within each session. In Experiment 1, the effects of imposing progressive delays on variable-interval and fixed-interval schedules were investigated while controlling for simultaneous decreases in reinforcer rate across the session via a within-subject yoked-control procedure. Rate of key pecking decreased as a negatively decelerated function of delay of reinforcement within a session. These rate decreases were greater than those during a yoked-interval session in which the rate of immediate reinforcement decreased at the same rate as it did under the progressive-delay procedure. In Experiment 2, delay-of-reinforcement gradients were shallower when the progressive delay intervals were signaled by a blackout than when they were unsignaled. The delay gradients obtained in each experiment were similar to those generated under conditions in which different delays of reinforcement are imposed across blocks of sessions. The present procedure offers a technique for rapidly generating delay-of-reinforcement gradients that might serve as baselines for assessing the effects of other behavioral and pharmacological variables.     

Neural correlates of intertemporal choice in aggressive behavior

People often have to make decisions between immediate rewards and more long-term goals. Such intertemporal judgments are often investigated in the context of monetary choice or drug use, yet not in regard to aggressive behavior. We combined a novel intertemporal aggression paradigm with functional neuroimaging to examine the role of temporal delay in aggressive behavior and the neural correlates thereof. Sixty-one participants (aged 18–22 years; 37 females) exhibited substantial variability in the extent to which they selected immediate acts of lesser aggression versus delayed acts of greater aggression against a same-sex opponent. Choosing delayed-yet-more-severe aggression was increased by provocation and associated with greater self-control. Preferences for delayed aggression were associated with greater activity in the ventromedial prefrontal cortex (VMPFC) during such choices, and reduced functional connectivity between the VMPFC and brain regions implicated in motor impulsivity. Preferences for immediate aggression were associated with reduced functional connectivity between the VMPFC and the frontoparietal control network. Dispositionally aggressive participants exhibited reduced VMPFC activity, which partially explained and suppressed their preferences for delayed aggression. Blunted VMPFC activity may thus be a neural mechanism that promotes reactive aggression towards provocateurs among dispositionally aggressive individuals. These findings demonstrate the utility of an intertemporal framework for investigating aggression and provide further evidence for the similar underlying neurobiology between aggression and other rewarding behaviors.     

Longitudinal study of striatal activation to reward and loss anticipation from mid-adolescence into late adolescence/early adulthood

Adolescent risk-taking behavior has been associated with age-related changes in striatal activation to incentives. Previous cross-sectional studies have shown both increased and decreased striatal activation to incentives for adolescents compared to adults. The monetary incentive delay (MID) task, designed to assess functional brain activation in anticipation of reward, has been used extensively to examine striatal activation in both adult and adolescent populations. The current study used this task with a longitudinal approach across mid-adolescence and late adolescence/early adulthood. Twenty-two participants (13 male) were studied using the MID task at two time-points, once in mid-adolescence (mean age = 16.11; SD = 1.44) and a second time in late adolescence/early adulthood (mean age = 20.14; SD = .67). Results revealed greater striatal activation with increased age in high- compared to low-incentive contexts (incentive magnitude), for gain as well as for loss trials (incentive valence). Results extend cross-sectional findings and show reduced striatal engagement in adolescence compared to adulthood during preparation for action in an incentive context.     

Control by reinforcers across time and space: A review of recent choice research

Reinforcers affect behavior. A fundamental assumption has been that reinforcers strengthen the behavior they follow, and that this strengthening may be context‐specific (stimulus control). Less frequently discussed, but just as evident, is the observation that reinforcers have discriminative properties that also guide behavior. We review findings from recent research that approaches choice using nontraditional procedures, with a particular focus on how choice is affected by reinforcers, by time since reinforcers, and by recent sequences of reinforcers. We also discuss how conclusions about these results are impacted by the choice of measurement level and display. Clearly, reinforcers as traditionally considered are conditionally phylogenetically important to animals. However, their effects on behavior may be solely discriminative, and contingent reinforcers may not strengthen behavior. Rather, phylogenetically important stimuli constitute a part of a correlated compound stimulus context consisting of stimuli arising from the organism, from behavior, and from physiologically detected environmental stimuli. Thus, the three‐term contingency may be seen, along with organismic state, as a correlation of stimuli. We suggest that organisms may be seen as natural stimulus‐correlation detectors so that behavioral change affects the overall correlation and directs the organism toward currently appetitive goals and away from potential aversive goals. As a general conclusion, both historical and recent choice research supports the idea that stimulus control, not reinforcer control, may be fundamental.     

A COMPARISON OF THE EFFECTS OF BRIEF RULES, A TIMER, AND PREFERRED TOYS ON SELF-CONTROL

Some children make impulsive choices (i.e., choose a small but immediate reinforcer over a large but delayed reinforcer). Previous research has shown that delay fading, providing an alternative activity during the delay, teaching participants to repeat a rule during the delay, combining delay fading with an alternative activity, and combining delay fading with a countdown timer are effective for increasing self‐control (i.e., choosing the large but delayed reinforcer over the small but immediate reinforcer). The purpose of the current study was to compare the effects of various interventions in the absence of delay fading (i.e., providing brief rules, providing a countdown timer during the delay, or providing preferred toys during the delay) on self‐control. Results suggested that providing brief rules or a countdown timer during the delay was ineffective for enhancing self‐control. However, providing preferred toys during the delay effectively enhanced self‐control.     

Further analysis of variables that affect self-control with aversive events

The purpose of this study was to examine variables that affect self-control in the context of academic task completion by elementary school children with autism. In the baseline assessment of Study 1, mathematics problem completion was shown to be an aversive event, and sensitivity to task magnitude, task difficulty, and delay to task completion were measured. The effects of manipulating values of those parameters on self-control then were assessed. For all participants, self-control increased as a function of one or more changes in task parameter values. In Study 2, the effects of a commitment response on self-control was assessed. Results indicated that for all participants, levels of self-control were higher when the opportunity to commit to the immediate aversive event was available.     

SAVING THE BEST FOR LAST? A CROSS-SPECIES ANALYSIS OF CHOICES BETWEEN REINFORCER SEQUENCES

Two experiments were conducted to compare choices between sequences of reinforcers in pigeon (Experiment 1) and human (Experiment 2) subjects, using functionally analogous procedures. The subjects made pairwise choices among 3 sequence types, all of which provided the same overall reinforcerment rate, but differed in their temporal patterning. Token reinforcement schedules were used in both experiments and the type of exchange schedule varied across blocks of sessions. Some conditions permitted immediate exchange of tokens for consumable reinforcers (food for pigeons, video access for humans); in other conditions, tokens accumulated and were exchanged for consumable reinforcers only at the end of the sequence. Choice patterns in the immediate-exchange conditions were generally similar across species, with both pigeons and humans preferring sequences with the shortest delay to the initial reinforcer in the series. The results are broadly consistent with models of temporal discounting expanded to include the impact of sequences of delayed reinforcers acting in parallel from the time of the choice. Preferences were less consistent with discounting models in the delayed exchange conditions. Questionnaire data gathered at the end of the experiment were consistent with prior results of questionnaire studies, but showed no straightforward relation to the observed choice patterns, urging caution in the extrapolation of results from one decision-making domain to the other.     

RELATIONS AMONG ACUTE AND CHRONIC NICOTINE ADMINISTRATION,SHORT-TERM MEMORY,AND TACTICS OF DATA ANALYSIS

Emerging evidence suggests that nicotine may enhance short‐term memory. Some of this evidence comes from nonhuman primate research using a procedure called delayed matching‐to‐sample, wherein the monkey is trained to select a comparison stimulus that matches some physical property of a previously presented sample stimulus. Delays between sample stimulus offset and comparison stimuli onset are manipulated and accuracy is measured. The present research attempted to systematically replicate these enhancement effects with pigeons. In addition, the effects of nicotine were assessed under another, more dynamic, memory task called titrating‐delay matching‐to‐sample. In this procedure, the delay between sample offset and comparison onset adjusts as a function of the subject's performance. Correct matches increase the delay, mismatches decrease the delay, and titrated delay values serve as the primary dependent measure. Both studies examined nicotine's effects under acute and chronic administration. Neither provided clear or compelling evidence of memory enhancement following nicotine administration despite reliable and systematic dose‐related changes in response latency measures. A modest dose‐related effect on accuracy was found, but the magnitude of the effect appears to be directly related to tactics of data analysis involving best‐dose analyses of a very circumscribed subset of trial types.     

EFFECTS OF A SIGNALED DELAY TO REINFORCEMENT IN THE PREVIOUS AND UPCOMING RATIOS ON BETWEEN-RATIO PAUSING IN FIXED-RATIO SCHEDULES

Domestic hens responded under multiple fixed‐ratio fixed‐ratio schedules with equal fixed ratios. One component provided immediate reinforcement and the other provided reinforcement after a delay, signaled by the offset of the key light. The components were presented quasirandomly so that all four possible transitions occurred in each session. The delay was varied over 0, 4, 8, 16, and 32 s with fixed‐ratio 5 schedules, and over 0, 8 and 32 s with fixed‐ratio 1, 15 and 40 schedules. Main effects of fixed‐ratio value and delay duration were detected on between‐ratio pauses. Pauses were longer when the multiple‐schedule stimulus correlated with a delayed‐reinforcer component was presented, with the longest pauses occurring at the transition from a component with an immediate reinforcer to one with a delayed reinforcer. Pause durations were shortest during immediate components. Overall, both the presence or absence of a delay in the upcoming component, and the presence or absence of a delay in the preceding component affected pause length, but the upcoming delay had the larger effect. Thus changes in delay had similar effects to past reports of the effects of changes in response force, response requirement, and reinforcer magnitude in multiple fixed‐ratio fixed‐ratio schedules.