Responding during reinforcement delay in a self-control paradigm.

Eight pigeons chose between a small, immediate reinforcer and a large, increasingly delayed reinforcer. Responding during the large-reinforcer delays was examined. During large-reinforcer delays, pecks on one key produced the small, immediate reinforcer; pecks on the other key had no effect. Thus, a pigeon could reverse its initial choice of the large, delayed reinforcer, or it could maintain its original choice. Pigeons that made a relatively high number of initial large-reinforcer choices tended to maintain these choices, and those pigeons that actually received a relatively high number of large reinforcers, tended to respond more frequently on the ineffective key during the delay periods. The findings suggest that some previous studies of self-control training in pigeons may have resulted in increased self-control partially due to a lack of opportunity for the pigeons to change their choices.     

The effects of negative reinforcement for irritable aggression on resident-intruder behavior

This experiment demonstrated that rats trained to display elevated levels of shock-induced aggression in a negative reinforcement paradigm displayed more boxing behavior than yoked control groups in a later test in which intruder rats were placed in the home cage of resident rats. Resident or intruder status did not affect the influence of the negative reinforcement procedure on the observed resident-intruder behavior of trained animals; however, naive intruders paired with trained residents displayed increased defensive behavior, suggesting that negative reinforcement for shock-induced aggression affected the behavior of these residents.     

The effects of competition and social reinforcement upon perceptual motor performance

Junior high school boys (n=180) performed 40 trials on the ball roll-up task in order to determine whether competition, initial ability level, and social reinforcement interact to influence performance. A 3 x 2 x 3 x 8 factorial design, with repeated measures on the last factor (initial ability level x competition x social reinforcement x blocks of trials) was used. The analysis of the data demonstrated that: (a) competition, initial ability level, and social reinforcement factors did not interact with one another; (b) social reinforcement (reproof) facilitated performance, while competition had no effect; and (c) the competition group had a greater tonic heart rate (increase from basal) than the noncompetitive group. Although it was not entirely clear why changes in the performance of the experimental groups did not accompany the changes in the groups' tonic heart rate, it was concluded that competition was an incentive.     

Human self-control and the density of reinforcement

Choice responding in adult humans on a discrete-trial button-pressing task was examined as a function of amount, delay, and overall density (points per unit time) of reinforcement. Reinforcement consisted of points that were exchangeable for money. In T 0 conditions, an impulsive response produced 4 points immediately and a self-control response produced 10 points after a delay of 15 s. In T 15 conditions, a constant delay of 15 s was added to both prereinforcer delays. Postreinforcer delays, which consisted of 15 s added to the end of each impulsive trial, equated trial durations regardless of choice, and was manipulated in both T 0 and T 15 conditions. In all conditions, choice was predicted directly from the relative reinforcement densities of the alternatives. Self-control was observed in all conditions except T 0 without postreinforcer delays, where the impulsive choices produced the higher reinforcement density. These results support previous studies showing that choice is a direct function of the relative reinforcement densities when conditioned (point) reinforcers are used. In contrast, where responding produces intrinsic (immediately consumable) reinforcers, immediacy of reinforcement appears to account for preference when density does not.     

Positive and negative reinforcement effects on behavior in a three-person microsociety

Three-person groups, either of males or of females, resided for 6 to 12 days in a continuously programmed environment. Subjects followed a behavioral program that determined the sequential and contingent relations within an inventory of activities. The program consisted of positive reinforcement days and avoidance days. During a positive reinforcement day, each work unit completed by a subject incremented a group account. The account was divided evenly among the three participants at the conclusion of the study. During a negative reinforcement day, no money was earned, and the group was assigned work unit criterion that, if completed, prevented a reduction in accumulated earnings. During negative reinforcement days, subjects made aggressive verbal responses, which differed in magnitude among the four groups. These differences were evident in several distinct behavioral measures. Performances on components of the work unit were not demonstrably affected by the reinforcement schedules in effect, although during the avoidance condition one subject stopped working and another subject's productivity declined.     

Mechanisms of self-control failure: motivation and limited resources

Research has found that individuals who are lower in self-control strength because of previous self-control exertions perform more poorly on subsequent tests of self-control. The present studies suggest that this effect may be moderated by motivation. In particular, depletion and motivation jointly determine self-control performance. Individuals who were depleted and believed that the task would help others (Experiment 1) or believed that their efforts could benefit them (Experiment 2) performed better on a subsequent test of self-control than individuals who were depleted and lower in motivation. The results of Experiment 3 replicated these findings and suggested that depletion only affects performance on tasks that require self-control; tasks that are difficult but do not require self-control are immune to the effects of depletion. Hence, depleted individuals may compensate for their lack of self-control resources when sufficiently motivated. The results may help explain the nature of self-control strength.     

Partial negative reinforcement: fixed-ratio escape

Rats were unable to sustain performance when eight bar-presses turned off shock (−FR 8). In a second experiment, thirsty rats were able to maintain a moderate response rate when performance on −FR 8 was also reinforced with water. Some rats continued to bar-press on −FR 8 after withdrawal of positive reinforcement, but at a much lower rate. A possible explanation of the results is that during intermittent escape conditioning in a free-responding situation the absence of shock itself acquires aversive properties.     

The effects of differential negative reinforcement of other behavior and noncontingent escape on compliance

The present study evaluated the effects of noncontingent escape and differential negative reinforcement of other behavior in reducing problem behaviors and increasing compliance in 2 children with disabilities. Results showed that both methods reduced problem behavior and increased compliance for both children.     

The effects of reinforcement upon the prepecking behaviors of pigeons in the autoshaping experiment

The autoshaping procedure confounds the effects of pairing a keylight and food with the effect of adventitious food reinforcement of responses that typically occur before the pecking response. In Experiment I, acquisition of the orientation to the key, the approach toward the key, and the peck at the key were systematically monitored. Orientations to the key and approaches toward the key frequently occurred in contiguity with food presentation before peck acquisition. In Experiment II, a negative contingency procedure was used to assess the sensitivity of the approach toward the key to its consequences. When the approach toward the key resulted in nonreinforcement, the probability of occurrence of that response decreased to zero despite repeated light-food pairings. In Experiment III, peck probability was shown to be determined during the approach toward the key by the presence of stimuli that had previously been either paired or nonpaired with food. In Experiment IV, it was shown that the effects of the stimulus present during the approach toward the key were not due solely to the effects of pairing that stimulus with food. Autoshaped key pecking appears to be determined by the interacting effects of stimulus-reinforcer and response-reinforcer variables upon orientations to, approaches toward, and pecks at the lighted key.     

Subjective and reinforcing effects of smoking during negative mood induction

Two notions strongly held by many smokers are that negative mood increases smoking behavior and that this increase is due to the ability of smoking to alleviate negative affect. This study used a modified mood induction procedure to examine both the impact of smoking on induced mood, as well as the effect of induced mood on actual smoking behavior. Forty-eight smokers were randomly assigned to a smoking or a water-drinking comparison group. Each participant attended 3 sessions during which 1 of 3 mood states (positive, negative, or neutral) was induced. Contrary to expectation, smoking did not attenuate negative affect. However, negative mood induction subsequently quickened latency to smoke and increased number of puffs consumed ad lib.     

Choice with initial and terminal link reinforcement: an alternative self-control paradigm

Self-control is demonstrated when a less desirable immediate outcome is chosen to ensure a substantially better future. In a novel animal analogue of this situation, primary reinforcement was delivered in both the initial and terminal links of a concurrent chain schedule. Rats made initial link choices between equal amounts of ethanol-free or ethanol-containing milk. Choosing the ethanol-free reinforcer resulted in delivery of the larger terminal link reinforcer and was thus analogous to self-control. Self-control decreased as the delay between initial and terminal links increased. The results have implications for human choice situations where decisions are made between two immediately available reinforcement alternatives each associated with a different delayed outcome.     

The effects of response cost in the treatment of aberrant behavior maintained by negative reinforcement

Positive reinforcement contingencies can sometimes be used to decrease problem behavior maintained by negative reinforcement (e.g., escape). In the current study, we evaluated the extent to which response cost (i.e., contingent removal of a preferred stimulus) would compete with the negative reinforcer maintaining destructive behavior. The response cost contingency reduced destructive behavior by 87% from baseline levels even though the negative reinforcement contingency (i.e., escape) remained in place.     

The effects of consequence manipulation during functional analysis of problem behavior maintained by negative reinforcement

Two distinct analytic methods have been used to identify the function of problem behavior. The antecedent-behavior-consequence (ABC) method (Iwata, Dorsey, Slifer, Bauman, & Richman, 1982/1994) includes the delivery of consequences for problem behavior. The AB method (Carr & Durand, 1985) does not include consequence delivery, instead relying exclusively on antecedent conditions to evoke the behavior. The AB and ABC functional analysis methods were compared in this study with 4 children with developmental disabilities who engaged in task-related problem behavior. Results show that the ABC method identified an escape method for all four cases, whereas the AB method failed to identify a function for any case.     

Choice in a "self-control" paradigm: effects of a fading procedure

Pigeons chose between an immediate 2-second reinforcer (access to grain) and a 6-second reinforcer delayed 6 seconds. The four pigeons in the control group were exposed to this condition initially. The four experimental subjects first received a condition where both reinforcers were delayed 6 seconds. The small reinforcer delay was then gradually reduced to zero over more than 11,000 trials. Control subjects almost never chose the large delayed reinforcer. Experimental subjects chose the large delayed reinforcer significantly more often. Two experimental subjects showed preference for the large reinforcer even when the consequences for pecking the two keys were switched. The results indicate that fading procedures can lead to increased “self-control” in pigeons in a choice between a large delayed reinforcer and a small immediate reinforcer.