Avoidance of timeout from response-independent food: effects of delivery rate and quality

In three experiments, a rat's lever presses could postpone timeouts from food pellets delivered on response-independent schedules. In Experiment 1, the pellets were delivered at variable-time (VT) rates ranging from VT 0.5 to VT 8 min. Experiment 2 replicated the VT 1 min and VT 8 min conditions of Experiment 1 with new subjects. Finally, subjects in Experiment 3 could postpone timeouts from delivery of pellets that differed in quality rather than quantity (unsweetened versus sweetened pellets). In general, response rates and success in avoiding increased as a function of the rate and quality of the pellets. Also, performance efficiency increased as the experiments progressed, that is, the avoidance response occurred later and later in the response-timeout interval. The results support the conclusion that timeout from reinforcement has functional properties similar to those of more commonly studied aversive stimuli (e.g., shock).     

PARAMETRIC ANALYSIS OF PRESESSION EXPOSURE TO EDIBLE AND NONEDIBLE STIMULI

We assessed the effects of individually defined small, medium, and large periods of presession access to edible and nonedible reinforcers on response rates during sessions in which responding produced access to identical reinforcers. Any presession access to an edible reinforcer decreased response rates for 1 participant, and small and medium periods of presession access to nonedible reinforcers resulted in similar or increased response rates for 2 participants.     

USE OF LATENCY TO PROBLEM BEHAVIOR TO EVALUATE DEMANDS FOR INCLUSION IN FUNCTIONAL ANALYSES

Few direct‐assessment procedures are designed to identify potential negative reinforcers (e.g., including demands in the escape condition of functional analyses). Two participants were systematically exposed to a series of demands nominated by caregivers as potential negative reinforcers. Sessions ended following the first instance of problem behavior, and a hierarchy of demand aversiveness was created based on the latency to the first problem behavior. Subsequent functional analyses confirmed the predictive value of the hierarchy, with shorter latency demands consistently producing more differentiated functional analysis outcomes.     

EFFECT OF REINFORCER MAGNITUDE ON PERFORMANCE MAINTAINED BY PROGRESSIVE‐RATIO SCHEDULES

This experiment examined the relationship between reinforcer magnitude and quantitative measures of performance on progressive‐ratio schedules. Fifteen rats were trained under a progressive‐ratio schedule in seven phases of the experiment in which the volume of a 0.6‐M sucrose solution reinforcer was varied within the range 6–300 μl. Overall response rates in successive ratios conformed to a bitonic equation derived from Killeen's (1994) Mathematical Principles of Reinforcement. The “specific activation” parameter, a, which is presumed to reflect the incentive value of the reinforcer, was a monotonically increasing function of reinforcer volume; the “response time” parameter, δ, which defines the minimum response time, increased as a function of reinforcer volume; the “currency” parameter, b, which is presumed to reflect the coupling of responses to the reinforcer, declined as a function of volume. Running response rate (response rate calculated after exclusion of the postreinforcement pause) decayed monotonically as a function of ratio size; the index of curvature of this function increased as a function of reinforcer volume. Postreinforcement pause increased as a function of ratio size. Estimates of a derived from overall response rates and postreinforcement pauses showed a modest positive correlation across conditions and between animals. Implications of the results for the quantification of reinforcer value and for the use of progressive‐ratio schedules in behavioral neuroscience are discussed.     

Assessing reinforcers under progressive schedule requirements.

Recent research findings suggest that reinforcing stimuli may be differentially effective as response requirements increase. We extended this line of research by evaluating responding under increasing schedule requirements via progressive‐ratio schedules and behavioral economic analyses. The differential effectiveness of preferred stimuli in treating destructive behavior maintained by automatic reinforcement also was examined. Results showed that one of two stimuli was associated with more responding under increasing schedule requirements for the 4 participants. Furthermore, stimuli associated with more responding under increasing schedule requirements generally were more effective in treating destructive behavior than stimuli associated with less responding. These data suggest that progressive‐ratio schedules and behavioral economic analyses may be useful for developing a new technology for reinforcer identification. From a clinical perspective, these results suggest that two reinforcers may be similarly effective for low‐effort tasks and differentially effective for high‐effort tasks.     

Evaluating the predictive validity of a single stimulus engagement preference assessment.

Most preference assessments require individuals to choose among two or more stimuli. More recently, the duration of engagement with items has been used as an index of preference. In the current study, the predictive validity of a single stimulus engagement (SSE) preference assessment was evaluated with 4 individuals. Stimuli were presented singly for a brief period while engagement with that stimulus was recorded. Although SSE preference rankings closely matched paired stimulus preference assessment rankings for only 2 of the 4 participants, relative preference rankings based on duration of engagement predicted relative reinforcer effectiveness for all participants in a subsequent concurrent‐schedule reinforcer assessment. The SSE procedure took less time to administer than the paired stimulus procedure but produced less stable preference rankings across administrations. The SSE procedure may be appropriate for individuals who have difficulty selecting one stimulus from among two or more stimuli, and it may be well suited for evaluating activities that are difficult to present in a paired stimulus format.     

Self-control in adult humans: variation in positive reinforcer amount and delay.

In five experiments, choice responding of female human adults was examined, as a function of variations in reinforcer amount and reinforcer delay. Experiment 1 used a discrete-trials procedure, and Experiments 2, 3, 4, and 5 used a concurrent variable-interval variable-interval schedule. Reinforcer amount and reinforcer delay were varied both separately and together. In contrast to results previously reported with pigeons, the subjects in the present experiments usually chose the larger reinforcers even when those reinforcers were delayed. Together, the results from all the experiments suggest that the subjects followed a maximization strategy in choosing reinforcers. Such behavior makes it easy to observe self-control and difficult to observe impulsiveness in traditional laboratory experiments that use adult human subjects.     

EFFECTS OF PROBLEM DIFFICULTY AND REINFORCER QUALITY ON TIME ALLOCATED TO CONCURRENT ARITHMETIC PROBLEMS

Students with learning difficulties participated in two studies that analyzed the effects of problem difficulty and reinforcer quality upon time allocated to two sets of arithmetic problems reinforced according to a concurrent variable-interval 30-s variable-interval 120-s schedule. In Study 1, high- and low-difficulty arithmetic problems were systematically combined with rich and lean concurrent schedules (nickels used as reinforcers) across conditions using a single-subject design. The pairing of the high-difficulty problems with the richer schedule failed to offset time allocated to that alternative. Study 2 investigated the interactive effects of problem difficulty and reinforcer quality (nickels vs. program money) upon time allocation to arithmetic problems maintained by the concurrent schedules of reinforcement. Unlike problem difficulty, the pairing of the lesser quality reinforcer (program money) with the richer schedule reduced the time allocated to that alternative. The magnitude of this effect was greatest when combined with the low-difficulty problems. These studies have important implications for a matching law analysis of asymmetrical reinforcement variables that influence time allocation.     

NONCONTINGENT DELIVERY OF ARBITRARY REINFORCERS AS TREATMENT FOR SELF-INJURIOUS BEHAVIOR

Results of recent research have shown that noncontingent reinforcement (NCR) can be effective in reducing the frequency of behavior problems. In typical NCR applications, the reinforcer that is responsible for behavioral maintenance (as demonstrated through a functional analysis) no longer follows occurrences of the target behavior but instead is delivered according to a time-based schedule. Thus, it is unclear if NCR would be effective if the target behavior continued to be reinforced or if arbitrary reinforcers (i.e., those irrelevant to behavioral maintenance) were substituted for the maintaining reinforcers in the NCR procedure. In this study, 2 individuals whose self-injurious behavior (SIB) was maintained by positive reinforcement were exposed to conditions in which arbitrary and maintaining reinforcers were withheld and were delivered either contingently or noncontingently. Results indicated that noncontingent delivery of arbitrary reinforcers was effective in reducing SIB even though occurrences of SIB produced access to the maintaining reinforcer. These results suggest that (a) arbitrary reinforcers may sometimes be substituted for maintaining reinforcers, (b) an important component of NCR procedures is alteration of a behavior's establishing operation, and (c) NCR with arbitrary reinforcers might therefore be effective when maintaining reinforcers cannot be identified or withheld during the course of treatment.