Effects of delayed conditioned reinforcement in chain schedules.

The contingency between responding and stimulus change on a chain variable-interval 33-s, variable-interval 33-s, variable-interval 33-s schedule was weakened by interposing 3-s delays between either the first and second or the second and third links. No stimulus change signaled the delay interval and responses could occur during it, so the obtained delays were often shorter than the scheduled delay. When the delay occurred after the initial link, initial-link response rates decreased by an average of 77% with no systematic change in response rates in the second or third links. Response rates in the second link decreased an average of 59% when the delay followed that link, again with little effect on response rates in the first or third links. Because the effect of delaying stimulus change was comparable to the effect of delaying primary reinforcement in a simple variable-interval schedule, and the effect of the unsignaled delay was specific to the link in which the delay occurred, the results provide strong evidence for the concept of conditioned reinforcement.     

Observing responses maintained by conditional discriminative stimuli.

In a conditional discrimination procedure, pigeons' observing responses were analyzed to examine whether two color stimuli (blue or red), conditionally related to whether each of two line stimuli (vertical or horizontal) accompanied reinforcement or nonreinforcement, functioned as conditioned reinforcers. If a variable-interval (VI) 10-s requirement was fulfilled, an observing response produced onset of a color stimulus. A little later, a line stimulus was presented independently of responding, added to the color stimulus to form a compound stimulus. If 55 s elapsed with a response not having occurred either through 55 s or after the variable-interval 10-s had timed out, one of the color-line compound stimuli was presented independently of responding. To control for sensory reinforcement effects and for earlier entrance to the later link, a simple discrimination procedure also was conducted in which reinforcement was not correlated with the color stimuli but with the line stimuli only. As in the conditional discrimination, the observing response also could produce earlier presentation of blue or red. The observing response occurred more frequently during the conditional discrimination than during the simple discrimination. The results were related to different theoretical accounts of conditioned reinforcement, particularly the information hypothesis.     

Variable-interval schedules of timeout from avoidance

Rats were trained on concurrent schedules in which pressing one lever postponed shock and pressing the other occasionally produced a 2-min timeout during which the shock-postponement schedule was suspended and its correlated stimuli were removed. Throughout, the shock-postponement schedule maintained proficient levels of avoidance. Nevertheless, in Experiment 1 responding on the timeout lever was established rapidly, was maintained at stable levels on variable-interval schedules, was extinguished by withholding timeout, was reestablished when timeout was reintroduced, and was brought under discriminative control with a multiple variable-interval extinction schedule of timeout. These results are in contrast with Verhave's (1962) conclusion that timeout is an ineffective reinforcer when presented to rats on intermittent schedules. In Experiment 2 the consequence of responding on the timeout lever was altered so that the shock-postponement schedule remained in effect even though the stimulus conditions associated with timeout were produced for 2 min. Responding extinguished, indicating that suspension of the shock-postponement schedule, not stimulus change, was the source of reinforcement. By establishing the reinforcing efficacy of timeout with standard variable-interval schedules, these experiments illustrate a procedure for studying negative reinforcement in the same way as positive reinforcement.     

Superstitious behavior in humans

Twenty undergraduate students were exposed to single response-independent schedules of reinforcer presentation, fixed-time or variable-time, each with values of 30 and 60 s. The reinforcer was a point on a counter accompanied by a red lamp and a brief buzzer. Three color signals were presented, without consistent relation to reinforcer or to the subjects' behavior. Three large levers were available, but the subjects were not asked to perform any particular behavior. Three of the 20 subjects developed persistent superstitious behavior. One engaged in a pattern of lever-pulling responses that consisted of long pulls after a few short pulls; the second touched many things in the experimental booth; the third showed biased responding called sensory superstition. However, most subjects did not show consistent superstitious behavior. Reinforcers can operate effectively on human behavior even in the absence of a response-reinforcer contingency and can, in some cases, shape stable superstitious patterns. However, superstitious behavior is not a consistent outcome of exposure of human subjects to response-independent reinforcer deliveries.     

Choice with delayed and probabilistic reinforcers: effects of prereinforcer and postreinforcer stimuli.

In Experiment 1, pigeons' pecks on a green key led to a 5-s delay with green houselights, and then food was delivered on 20% (or, in other conditions, 50%) of the trials. Pecks on a red key led to an adjusting delay with red houselights, and then food was delivered on every trial. The adjusting delay was used to estimate indifference points: delays at which the two alternatives were chosen about equally often. Varying the presence or absence of green houselights during the delays that preceded possible food deliveries had large effects on choice. In contrast, varying the presence of the green or red houselights in the intertrial intervals had no effects on choice. In Experiment 2, pecks on the green key led to delays of either 5 s or 30 s with green houselights, and then food was delivered on 20% of the trials. Varying the duration of the green houselights on nonreinforced trials had no effect on choice. The results suggest that the green houselights served as a conditioned reinforcer at some times but not at others, depending on whether or not there was a possibility that a primary reinforcer might be delivered. Given this interpretation of what constitutes a conditioned reinforcer, most of the results were consistent with the view that the strength of a conditioned reinforcer is inversely related to its duration.     

Further evaluation of methods to identify matched stimulation

The effects of preferred stimulation on the vocal stereotypy of 2 individuals were evaluated in two experiments. The results of Experiment 1 showed that (a) the vocal stereotypy of both participants persisted in the absence of social consequences, (b) 1 participant manipulated toys that did and did not produce auditory stimulation, but only sound-producing toys decreased his vocal stereotypy, and (c) only noncontingent music decreased vocal stereotypy for the other participant, but sterotypy paradoxically increased when toys were presented with music. Using a three-component multiple schedule, the results of Experiment 2 showed that the vocal stereotypy of both participants remained below preintervention levels following the removal of auditory stimulation and that 1 participant's vocal stereotypy increased following the removal of contingent reprimands. These patterns suggest that auditory stimulation functioned as an abolishing operation for vocal stereotypy and reprimands functioned as an establishing operation for vocal stereotypy. Together, the two experiments provide a method for identifying alternative stimulation that may substitute for automatically reinforced behavior.     

Effects of internet-based voucher reinforcement and a transdermal nicotine patch on cigarette smoking

Nicotine replacement products are commonly used to promote smoking cessation, but alternative and complementary methods may increase cessation rates. The current experiment compared the short-term effects of a transdermal nicotine patch to voucher-based reinforcement of smoking abstinence on cigarette smoking. Fourteen heavy smokers (7 men and 7 women) completed the four 5-day phases of the study: baseline, patch treatment, voucher treatment, and return to baseline. The order of the two treatment phases was counterbalanced across participants. In the patch treatment condition, participants wore a 14-mg transdermal nicotine patch every day. In the voucher treatment condition, participants received vouchers contingent on abstinence from smoking, defined as producing carbon monoxide (CO) readings of < or =4 parts per million. Participants e-mailed two video clips per day showing them breathing into a CO monitor and the resulting CO reading to clinic staff. In the voucher treatment, 24% of samples were negative, and 5% of samples were negative in the patch treatment. Results suggest that contingent vouchers were more effective than transdermal nicotine patches in promoting abstinence.     

Evaluating the influence of postsession reinforcement on choice of reinforcers

Factors that influence reinforcer choice have been examined in a number of applied studies (e.g., Neef, Mace, Shea, & Shade, 1992; Shore, Iwata, DeLeon, Kahng, & Smith, 1997; Tustin, 1994). However, no applied studies have evaluated the effects of postsession reinforcement on choice between concurrently available reinforcers, even though basic findings indicate that this is an important factor to consider (Hursh, 1978; Zeiler, 1999). In this bridge investigation, we evaluated the influence of postsession reinforcement on choice of two food items when task responding was reinforced on progressive-ratio schedules. Participants were 3 children who had been diagnosed with developmental disabilities. Results indicated that response allocation shifted from one food item to the other food item under thinner schedules of reinforcement when no postsession reinforcement was provided. These findings suggest that the efficacy of instructional programs or treatments for problem behavior may be improved by restricting reinforcers outside treatment sessions.     

Estimation of indifference points with an adjusting-delay procedure.

In a series of conditions, pigeons chose between 1.5 s and 3 s of access to grain, each preceded by some delay. The delay that preceded the small reinforcer was constant throughout a condition. The delay that preceded the large reinforcer was increased or decreased a number of times each session in order to estimate an "indifference point," a delay at which the subject chose each alternative about equally often. The experiment was designed to determine whether variations in any of four features of this adjusting-delay procedure would systematically alter the estimated indifference points. The four features were the total trial duration, the number of center-key responses necessary to begin a trial, the number of choice trials that preceded each change in the adjusting delay, and step size--the size of each increment and decrement in the delay. Manipulation of the first three features had no systematic effects on the indifference points. As step size was increased from 0.5 s to 6 s, within-session variability of the adjusting delay steadily increased, and the 6-s step size produced larger indifference-point estimates for some subjects. The results suggest that, within certain limits, these procedural features can be altered without affecting the indifference-point estimates, but that the use of a large step size can distort the estimates. Some theoretical implications of the relative constancy of indifference points across these procedural variations are discussed.     

Effects of methylphenidate on sensitivity to reinforcement in children diagnosed with attention deficit hyperactivity disorder: an application of the matching law

The behavior of children diagnosed with attention deficit hyperactivity disorder (ADHD) has been hypothesized to be the result of decreased sensitivity to consequences compared to typical children. The present study examined sensitivity to reinforcement in 2 boys diagnosed with ADHD using the matching law to provide more precise and quantitative measurement of this construct. This experiment also evaluated the effects of methylphenidate (MPH) on sensitivity to reinforcement of children with ADHD. Subjects completed math problems to earn tokens under four different variable-interval (VI) schedules of reinforcement presented in random order under both medicated and nonmedicated conditions. Results showed that, in the medicated condition, the matching functions for both subjects resulted in higher asymptotic values, indicating an overall elevation of behavior rate under these conditions. The variance accounted for by the matching law was also higher under the medicated conditions, suggesting that their behavior more closely tracked the changing rates of reinforcement while taking MPH compared to placebo. Under medicated conditions, the reinforcing efficacy of response-contingent tokens decreased. Results are discussed with respect to quantifying behavioral changes and the extent to which the drug interacts with prevailing contingencies (i.e., schedule values) to influence behavioral variability.