The reinforcing value of several types of aggressive behavior: A review

Field observations of “surplus killing” and laboratory studies of operant performance rewarded by prey-killing opportunities suggest that predatory behavior is positively reinforcing. Similarly, both repeated encounter and operant performance studies suggest that intraspecific aggression can be positively reinforcing for successful aggressors. While a few studies suggest that defensive aggression under aversive conditions may also be positively reinforcing, it appears that when appropriate response modes are available escape and/or avoidance are preferred to attack. Studies of the reinforcing properties of aggression-eliciting brain stimulation are in general agreement with these conclusions, but methodological problems with these latter observations render them less compelling. The progressive escalation of aggression seen in “warm-up effects” of birds and fish, “priming effects” of mice, and ecstatic violence of humans may be analogous processes based on the positively self-reinforcing characteristics of some kinds of aggression. The transient reductions of aggression which appear as refractory periods and satiation effects in a variety of species may reflect temporary reductions in the reinforcing value of aggression. All these temporal effects must be considered in the evaluation of experiments on the reinforcing value of aggression. More generally, it is possible that these temporal fluctuations reflect the operation of common motivational processes (aggressive states) which regulate overt aggression by changing its reinforcing value.     

A comparison of multiple reinforcer assessments to identify the function of maladaptive behavior

Functional analysis results indicated that maladaptive behaviors displayed by a 25-year-old man with profound mental retardation were maintained by attention from caregivers and possibly, to a lesser degree, by access to tangible items. A concurrent-schedules procedure was then used to study the relative reinforcing value for maladaptive behavior of attention versus tangible items. Results of the concurrent-schedules assessment and subsequent functional communication training indicated that preference for attention versus access to a tangible object varied.     

An evaluation of simultaneous and sequential presentation of preferred and nonpreferred food to treat food selectivity

In the current investigation, we compared two methods of food presentation (simultaneous vs. sequential) to increase consumption of nonpreferred food for 3 children with food selectivity. In the simultaneous condition, preferred foods were presented at the same time as nonpreferred food (e.g., a piece of broccoli was presented on a chip). In the sequential condition, acceptance of the nonpreferred food resulted in presentation of the preferred food. Increases in consumption occurred immediately during the simultaneous condition for 2 of the 3 participants. For 1 participant, increases in consumption occurred in the simultaneous condition relative to the sequential condition, but only after physical guidance and re-presentation were added to treatment. Finally, consumption increased for 1 participant in the sequential condition, but only after several sessions. These results are discussed in terms of possible mechanisms that may alter preferences for food (i.e., establishing operations, flavor-flavor conditioning).     

Operant-contingency-based preparation of children for functional magnetic resonance imaging

Functional magnetic resonance imaging (fMRI) is used to study brain function during behavioral tasks. The participation of pediatric subjects is problematic because reliable task performance and control of head movement are simultaneously required. Differential reinforcement decreased head motion and improved vigilance task performance in 4 children (2 with behavioral disorders) undergoing simulated fMRI scans. Results show that behavior analysis techniques can improve child cooperation during fMRI procedures.     

Sea lions and equivalence: expanding classes by exclusion

Experiments have shown that human and nonhuman subjects are capable of performing new arbitrary stimulus-stimulus relations without error. When subjects that are experienced with matching-to-sample procedures are presented with a novel sample, a novel comparison, and a familiar comparison, most respond by correctly selecting the novel comparison in the presence of the new sample. This exclusion paradigm was expanded with two California sea lions that had previously formed two 10-member equivalence classes in a matching-to-sample procedure. Rather than being presented with a novel sample on a given trial, the sea lions were presented with a randomly selected familiar member of one class as the sample. One of the comparisons was a randomly selected familiar member of the alternative class, and the other was a novel stimulus. When required to choose which comparison matched the sample, the subjects reliably rejected the familiar comparison, and instead selected the unfamiliar one. Next, the sea lions were presented with transfer problems that could not be solved by exclusion; they immediately grouped the new stimuli into the appropriate classes. These findings show that exclusion procedures can rapidly generate new stimulus relations that can be used to expand stimulus classes.     

Effects of methylphenidate on sensitivity to reinforcement in children diagnosed with attention deficit hyperactivity disorder: an application of the matching law

The behavior of children diagnosed with attention deficit hyperactivity disorder (ADHD) has been hypothesized to be the result of decreased sensitivity to consequences compared to typical children. The present study examined sensitivity to reinforcement in 2 boys diagnosed with ADHD using the matching law to provide more precise and quantitative measurement of this construct. This experiment also evaluated the effects of methylphenidate (MPH) on sensitivity to reinforcement of children with ADHD. Subjects completed math problems to earn tokens under four different variable-interval (VI) schedules of reinforcement presented in random order under both medicated and nonmedicated conditions. Results showed that, in the medicated condition, the matching functions for both subjects resulted in higher asymptotic values, indicating an overall elevation of behavior rate under these conditions. The variance accounted for by the matching law was also higher under the medicated conditions, suggesting that their behavior more closely tracked the changing rates of reinforcement while taking MPH compared to placebo. Under medicated conditions, the reinforcing efficacy of response-contingent tokens decreased. Results are discussed with respect to quantifying behavioral changes and the extent to which the drug interacts with prevailing contingencies (i.e., schedule values) to influence behavioral variability.     

Effects of noncontingent reinforcement on problem behavior and stimulus engagement: the role of satiation, extinction, and alternative reinforcement

This study examined the effects of noncontingent reinforcement (NCR) with and without extinction on problem behavior and stimulus engagement (consumption of reinforcement) of 4 participants. Reductions in problem behavior using NCR have frequently been attributed to both satiation of the reinforcer and extinction. In the current study, aspects of the NCR treatment effects were difficult to explain based solely on either a satiation or an extinction account. Specifically, it was found that stimulus engagement remained high throughout the NCR treatment analysis, and that problem behavior was reduced to near-zero levels during NCR without extinction. The implications of these findings are discussed with respect to the satiation and extinction hypotheses frequently described in the applied literature. Findings from basic studies examining the effects of response-independent schedules are presented, and are used as the basis for a matching theory account of NCR-related effects. It is proposed that reductions in problem behavior observed during NCR interventions may be a function of the availability of alternative sources of reinforcement.     

Reinforcing variability in adolescents with autism

Five adolescents with autism, 5 adult control participants, and 4 child controls received rewards for varying their sequences of responses while playing a computer game. In preceding and following phases, rewards were provided at approximately the same rate but were independent of variability. The most important finding was that, when reinforced, variability increased significantly in all groups. Reinforced variability could provide the necessary behavioral substrate for individuals with autism to learn new responses.     

Progressive-ratio schedules: effects of later schedule requirements on earlier performances

Four rats were studied with variants of a progressive-ratio schedule with a step size of 6 in which different terminal components followed completion of the 20th ratio: (a) a reversal of the progression, (b) a fixed-ratio 6 schedule, or (c) extinction. Responding in the progressive-ratio components of these schedules was compared to performances under conventional progressive-ratio baselines. Under baseline conditions, postreinforcement pauses increased exponentially as a function of increasing ratio size, whereas running rates showed modest declines. The procedure of linking the progressive-ratio schedule to the reversed progression or to the fixed-ratio component resulted in decreased pausing. Linking the progressive-ratio schedule to the extinction component had the opposite effect, that of producing weakened progressive-ratio performances as evidenced by increased pausing. Subjects whose responses were reinforced on half of the ratios also showed exponential increases; however, pauses were substantially shorter following ratios on which the reinforcer was omitted. The results suggested that progressive-ratio pausing reflects the influence of remote as well as local contingencies.     

Timeout postponement without increased reinforcement frequency

Three experiments were conducted to examine pigeons' postponement of signaled extinction periods (timeouts) from a schedule of food reinforcement when such responding neither decreased overall timeout frequency nor increased the overall frequency of food reinforcement. A discrete-trial procedure was used in which a response during the first 5 s of a trial postponed an otherwise immediate 60-s timeout to a later part of that same trial but had no effect on whether the timeout occurred. During time-in periods, responses on a second key produced food according to a random-interval 20-s schedule. In Experiment 1, the response-timeout interval was 45 s under postponement conditions and 0 s under extinction conditions (responses were ineffective in postponing timeouts). The percentage of trials with a response was consistently high when the timeout-postponement contingency was in effect and decreased to low levels when it was discontinued under extinction conditions. In Experiment 2, the response-timeout interval was also 45 s but postponement responses increased the duration of the timeout, which varied from 60 s to 105 s across conditions. Postponement responding was maintained, generally at high levels, at all timeout durations, despite sometimes large decreases in the overall frequency of food reinforcement. In Experiment 3, timeout duration was held constant at 60 s while the response-timeout interval was varied systematically across conditions from 0 s to 45 s. Postponement responding was maintained under all conditions in which the response-timeout interval exceeded 0 s (the timeout interval in the absence of a response). In some conditions of Experiment 3, which were designed to control for the immediacy of food reinforcement and food-correlated (time-in) stimuli, responding postponed timeout but the timeout was delayed whether a response occurred or not. Responding was maintained for 2 of 3 subjects, suggesting that behavior was negatively reinforced by timeout postponement rather than positively reinforced by the more immediate presentation of food or food-correlated (time-in) stimuli.