An evaluation of the value of choice-making opportunities in single-operant arrangements: simple fixed- and progressive-ratio schedules

The current study compared the effects of choice and no-choice reinforcement conditions on the task responding of 3 children with autism across 2 single-operant paradigm reinforcer assessments. The first assessment employed simple fixed-ratio (FR) schedules; the second used progressive-ratio (PR) schedules. The latter assessment identified the differential strength of choice-making conditions in promoting task responding relative to no-choice conditions for 2 participants; no differential findings were obtained during the FR assessment.     

The effects of reinforcer choice on rates of challenging behavior and free operant responding in individuals with severe disabilities

A multielement design was used to evaluate the effects of three reinforcement conditions on the free-operant and challenging responses of two individuals with severe disabilities. Preference assessments identified three stimuli that could function as reinforcers for each participant. Reinforcers were delivered on a variable ratio schedule for a free-operant response. In the participant-selected condition, each reinforcer delivery consisted of placing an array of three different stimuli in front of the participant, who was allowed to select one. In the constant condition, each reinforcer delivery consisted of placing an array of three identical stimuli in front of the participant. Within each session the three stimuli were held constant, but varied across sessions. In the experimenter-selected condition, each reinforcer delivery consisted of an array of three identical stimuli being placed in front of the participant. Within each session, the three stimuli were presented in an order predetermined by the experimenter such that, on average, each stimulus was available every third reinforcer delivery. For both individuals, the participant-selected condition resulted in lower average rates of challenging responses and slightly higher average free-operant response rates. No differences in responding were noted between the constant condition and the experimenter-selected condition. © 1998 John Wiley & Sons, Ltd.     

EMERGENCE OF REINFORCER PREFERENCE AS A FUNCTION OF SCHEDULE REQUIREMENTS AND STIMULUS SIMILARITY

Tustin (1994) recently observed that an individual's preference for one of two concurrently available reinforcers under low schedule requirements (concurrent fixed-ratio [FR] 1) switched to the other reinforcer when the schedule requirements were high (concurrent FR 10). We extended this line of research by examining preference for similar and dissimilar reinforcers (i.e., those affecting the same sensory modality and those affecting different sensory modalities). Two individuals with developmental disabilities were exposed to an arrangement in which pressing two different panels produced two different reinforcers according to progressively increasing, concurrent-ratio schedules. When two dissimilar stimuli were concurrently available (food and a leisure item), no clear preference for one item over the other was observed, regardless of the FR schedules in effect (FR 1, 2, 5, 10, and 20). By contrast, when two similar stimuli were concurrently available (two food items), a clear preference for one item emerged as the schedule requirements were increased from FR 1 to FR 5 or FR 10. These results are discussed in terms of implications for conducting preference assessments and for selecting reinforcers to be used under training conditions in which response requirements are relatively high or effortful.     

CORRESPONDENCE BETWEEN SINGLE VERSUS DAILY PREFERENCE ASSESSMENT OUTCOMES AND REINFORCER EFFICACY UNDER PROGRESSIVE‐RATIO SCHEDULES

Research has suggested that a daily multiple‐stimulus‐without‐replacement (MSWO) preference assessment may be more sensitive to changes in preference than other assessment formats, thereby resulting in greater correspondence with reinforcer efficacy over time ( DeLeon et al., 2001 ). However, most prior studies have measured reinforcer efficacy using rate of responding under single‐operant arrangements and dense schedules or under concurrent‐operants arrangements. An alternative measure of reinforcer efficacy involves the evaluation of responding under progressive‐ratio (PR) schedules. In the present study, 7 participants were given a single paired‐stimulus (PS) preference assessment followed by daily MSWO preference assessments. After each daily MSWO, participants responded for each stimulus on a PR schedule. The correspondence between break points and preferences, as assessed by the 2 assessment formats, was examined. Results demonstrated that both preference assessments did equally well at predicting reinforcer efficacy, although the PS more consistently identified the most effective reinforcer.     

Evaluation of absolute and relative reinforcer value using progressive-ratio schedules

We evaluated behavior exhibited by individuals with developmental disabilities using progressive-ratio (PR) schedules. High- and low-preference stimuli were determined based on the results of a paired-stimulus preference assessment and were evaluated in subsequent reinforcer and PR assessments using concurrent and single schedules of presentation. In Experiment 1, results showed that for 2 of 3 participants, stimuli determined to be low-preference functioned as reinforcers when evaluated independent of high-preference stimuli. Further, the results from Experiment 2 showed that low-preference stimuli also functioned as reinforcers under gradually increasing PR requirements. Results suggest that for cases in which a high-preference stimulus is unavailable or impractical, the contingent delivery of relatively less preferred stimuli may maintain appropriate behavior, even as schedule requirements increase.     

Preference for reinforcers under progressive- and fixed-ratio schedules: a comparison of single and concurrent arrangements

Progressive-ratio (PR) schedules were used to identify the break point (i.e., the last schedule value completed) for 2 reinforcers under single and concurrent schedules. After the respective break points were established, the same reinforcers were presented under concurrent fixed-ratio (FR) schedules that were yoked to the break points obtained with the PR schedules. Results suggested that the participants responded more for the high-preference item than for the low-preference item, regardless of the presentation arrangement (single or concurrent presentations). This pattern of responding was maintained when the reinforcers were presented under dissimilar FR schedules. The results suggest that responding for differentially preferred stimuli may vary as a function of differences in schedule requirements.     

Identification of olfactory stimuli as reinforcers in individuals with autism: a preliminary investigation

Preference for six olfactory stimuli was assessed via paired preference assessments with three adults with autism. Using a combination multielement and reversal design, a reinforcer assessment was then conducted to determine the extent to which three (high preference, medium preference, and low preference) of the six olfactory stimuli evaluated in the preference assessment functioned as reinforcers for responding in the context of a sorting task. Relative to baseline, all of the participants exhibited increased responding for access to their high preference olfactory stimulus. The utility of olfactory stimuli as components of behavior intervention plans is discussed. Copyright © 2008 John Wiley & Sons, Ltd.     

Human observing: maintained by negative informative stimuli only if correlated with improvement in response efficiency.

Two experiments investigated the effect of observing responses that enabled college students to emit more efficient distributions of reinforced responses. In Experiment 1, the gains of response efficiency enabled by observing were minimized through use of identical low-effort response requirements in two alternating variable-interval schedules. These comprised a mixed schedule of reinforcement; they differed in the number of money-backed points per reinforcer. In each of three choices between two stimuli that varied in their correlation with the variable-interval schedules, the results showed that subjects preferred stimuli that were correlated with the larger average amount of reinforcement. This is consistent with a conditioned-reinforcement hypothesis. Negative informative stimuli--that is, stimuli correlated with the smaller of two rewards--did not maintain as much observing as stimuli that were uncorrelated with amount of reward. In Experiment 2, savings in effort made possible by producing S- were varied within subjects by alternately removing and reinstating the response-reinforcement contingency in a mixed variable-interval/extinction schedule of reinforcement. Preference for an uncorrelated stimulus compared to a negative informative stimulus (S-) decreased for each of six subjects, and usually reversed when observing permitted a more efficient temporal distribution of the responses required for reinforcement; in this case, the responses were pulls on a relatively high-effort plunger. When observing the S- could not improve response efficiency, subjects again chose the control stimulus. All of these results were inconsistent with the uncertainty-reduction hypothesis.     

MULTICOMPONENT ASSESSMENT AND TREATMENT OF CIGARETTE PICA

We conducted a multicomponent assessment and treatment for 4 individuals who engaged in cigarette pica. During Phase 1, three stimulus preference assessments were conducted to identify (a) the reinforcing component of the cigarette, (b) potential alternative reinforcers that may be used during treatment, and (c) whether the alternative reinforcer would compete effectively with cigarettes. Results were successful in identifying the reinforcing component of the cigarette and suggested the feasibility of using alternative reinforcers during treatment to eliminate cigarette pica. During Phase 2, the effects of two treatment procedures were evaluated. Noncontingent reinforcement (NCR) with the alternative edible reinforcer reduced the pica of 2 of the participants, but effects were not maintained when the initial dense schedule of NCR was thinned. Subsequently, differential reinforcement of alternative behavior with the alternative edible reinforcer was effective in reducing pica for 3 participants. An evaluation of nine treatment procedures failed to identify an effective intervention for the remaining participant; consequently, preventive measures were designed to minimize occurrences of cigarette pica.     

Tests of transitivity in choices between fixed and variable reinforcer delays.

This experiment tested for transitivity in pigeons' choices between variable-time (VT) and fixed-time (FT) schedules. In a discrete-trials procedure, a subject chose between two alternatives by making a single key peck. Each choice was between a "standard alternative," which was the same schedule throughout a condition, and an "adjusting alternative," in which the delay to reinforcement was systematically increased or decreased many times a session. These adjustments enabled an approximate indifference point to be identified--the value of the adjusting delay at which the subject chose each alternative about equally often. Each test of transitivity involved four conditions. In one, the standard alternative was a variable-time schedule with a 2-s reinforcer, and the adjusting alternative also delivered a 2-s reinforcer. A second condition was similar except that the adjusting alternative delivered a 5-s reinforcer. The indifference point from each of these conditions was then converted to a fixed-time schedule for subsequent comparisons in the third and fourth conditions, respectively. Each of these last two conditions compared one of the fixed-time schedules (based upon the previous conditions and including their different reinforcer durations) with an adjusting schedule that delivered the alternative reinforcer duration, to determine whether the obtained indifference points would be those predicted from the prior alternative-duration comparisons with the VT schedule. There was little evidence for intransitivity of choice: Averaged across subjects and replications, the obtained indifference points deviated from perfect transitivity by less than 8%, and these deviations were not statistically significant. These results contrast with those of Navarick and Fantino (1972), who found frequent violations of transitivity between periodic and aperiodic schedules using a concurrent-chains procedure with variable-interval schedules in the initial links.     

Discriminative and reinforcing properties of two types of food pellets

In Experiment I some discriminative functions of food pellets were studied by developing a multiple schedule of reinforcement (mult FR 30 FI 3) in which the delivery of a standard laboratory food pellet as a reinforcer set the occasion for reinforcement on every 30th response (FR 30), and the delivery of a sucrose food pellet as a reinforcer set the occasion for reinforcement after a 3-min interval (FI 3). Discriminative stimulus control by the type of pellet was also demonstrated by reversing the operant discrimination and having the standard pellet control the FI 3 and the sucrose pellet control the FR 30. In Experiment II a mult FR 30 FR 30 with two bars was developed; a standard food pellet was followed by an FR 30 on Bar 1 and extinction (ext) on Bar 2, while a sucrose pellet was followed by an FR 30 on Bar 2 and ext on Bar 1. A control rat was placed, for comparison, on a mixed (mix) FR 30 FR 30 schedule with two bars, but neither bar correlated with the type of food pellet. In Experiments I and II the similarity between pellet controlled multiple schedules and multiple primed schedules was discussed, as was the comparability of transitions and effectiveness of control between pellet controlled multiple schedules and multiple schedules providing continuous exteroceptive stimuli.     

Further examination of video‐based preference assessments without contingent access

The first purpose of this study was to attempt to replicate previous findings that video‐based preference assessments without access to selected stimuli may accurately predict relative reinforcing efficacy of stimuli. To do this, we conducted a concurrent operant reinforcer assessment in which we evaluated the relative reinforcing value of highly preferred and less preferred items identified in a video‐based preference assessment. The second purpose of this study was to begin to evaluate the potential behavioral mechanisms responsible for the validity of this assessment. To conduct this analysis, we evaluated the relative reinforcing value of those same stimuli depicted in video format and then compared results to results obtained during the reinforcer assessment for tangible stimuli. For all five participants, stimuli identified as highly preferred functioned as reinforcers, and four of five participants, responding during the reinforcer assessment was similar in the presence of tangible stimuli and videos depicting those stimuli.     

Variable-time reinforcement schedules in the treatment of socially maintained problem behavior

Noncontingent reinforcement (NCR) consists of delivering a reinforcer on a time-based schedule, independent of responding. Studies evaluating the effectiveness of NCR as treatment for problem behavior have used fixed-time (FT) schedules of reinforcement. In this study, the efficacy of NCR with variable-time (VT) schedules was evaluated by comparing the effects of VT and FT reinforcement schedules with 2 individuals who engaged in problem behavior maintained by positive reinforcement. Both FT and VT schedules were effective in reducing problem behavior. These findings suggest that VT schedules can be used to treat problem behavior maintained by social consequences.     

NONCONTINGENT DELIVERY OF ARBITRARY REINFORCERS AS TREATMENT FOR SELF-INJURIOUS BEHAVIOR

Results of recent research have shown that noncontingent reinforcement (NCR) can be effective in reducing the frequency of behavior problems. In typical NCR applications, the reinforcer that is responsible for behavioral maintenance (as demonstrated through a functional analysis) no longer follows occurrences of the target behavior but instead is delivered according to a time-based schedule. Thus, it is unclear if NCR would be effective if the target behavior continued to be reinforced or if arbitrary reinforcers (i.e., those irrelevant to behavioral maintenance) were substituted for the maintaining reinforcers in the NCR procedure. In this study, 2 individuals whose self-injurious behavior (SIB) was maintained by positive reinforcement were exposed to conditions in which arbitrary and maintaining reinforcers were withheld and were delivered either contingently or noncontingently. Results indicated that noncontingent delivery of arbitrary reinforcers was effective in reducing SIB even though occurrences of SIB produced access to the maintaining reinforcer. These results suggest that (a) arbitrary reinforcers may sometimes be substituted for maintaining reinforcers, (b) an important component of NCR procedures is alteration of a behavior's establishing operation, and (c) NCR with arbitrary reinforcers might therefore be effective when maintaining reinforcers cannot be identified or withheld during the course of treatment.     

The effects of noncontingent reinforcement on task disengagement following failure of differential reinforcement treatment

Following the failure of applications of differential reinforcement (DR), the effects of reinforcement delivered noncontingently (NCR) on task disengagement and task completion were evaluated within reversal designs for three children with autism spectrum disorder. In Experiment 1, we compared DR and NCR schedules that combined positive and negative reinforcement. In Experiment 2, we replicated the results of Experiment 1 and then evaluated NCR schedules composed solely of negative reinforcement and NCR schedules that combined negative reinforcement with high-or low-preferred stimuli. In Experiment 3, we further analyzed NCR schedules that included different types and qualities of positive reinforcement, but without the inclusion of negative reinforcement. The results showed that NCR schedules using positive reinforcers can be effective as a treatment for task disengagement, but the type and preference of the reinforcer can alter effectiveness. These results are interpreted in terms of the motivating operations associated with task disengagement.     

Further evaluation of the use of preference categories to identify novel reinforcers: A systematic replication

Preference assessments are frequently used to identify reinforcers for individuals with autism spectrum disorder and intellectual and developmental disabilities. Although well‐established procedures have been shown to identify preferred stimuli for individual items that can be used in skill acquisition and behavior reduction programs, little research has been conducted on identifying categories of preferred items. In this study, paired‐stimulus preference assessments were conducted with 4 individuals with autism spectrum disorder. Researchers classified the edible stimuli as belonging to 1 of 4 categories: chocolate (e.g., chocolate chips and M&M's^®), salty/crunchy (e.g., chips and crackers), gummy (e.g., Swedish Fish^® and Starburst^®), or fruit/vegetable (e.g., grape and apple). Preference hierarchies were identified for individual stimuli and for categories of stimuli. For all participants, at least 3 of the 4 most preferred items came from the same category. Novel items (i.e., items not included in the preference assessments) identified by the researchers as belonging to the high‐preference category functioned as effective reinforcers during subsequent reinforcer assessments for all participants. This finding suggests that clinicians could identify likely effective edible reinforcers based on an individual's categorical preference without explicit testing.     

The effects of noncontingent delivery of high- and low-preference stimuli on attention-maintained destructive behavior

An adolescent with severe mental retardation and cerebral palsy who displayed attention-maintained destructive behavior was exposed to noncontingent reinforcer delivery (NCR) with either a high-preference or a low-preference stimulus while reinforcement for destructive behavior with attention remained in effect (i.e., NCR without extinction). NCR without extinction was effective only when the high-preference stimulus was available, suggesting that systematic assessment of stimulus quality may enhance the effectiveness of NCR with alternative stimuli.     

Examining the discriminative and strengthening effects of reinforcers in concurrent schedules

Reinforcers may increase operant responding via a response-strengthening mechanism whereby the probability of the preceding response increases, or via some discriminative process whereby the response more likely to provide subsequent reinforcement becomes, itself, more likely. We tested these two accounts. Six pigeons responded for food reinforcers in a two-alternative switching-key concurrent schedule. Within a session, equal numbers of reinforcers were arranged for responses to each alternative. Those reinforcers strictly alternated between the two alternatives in half the conditions, and were randomly allocated to the alternatives in half the conditions. We also varied, across conditions, the alternative that became available immediately after a reinforcer. Preference after a single reinforcer always favored the immediately available alternative, regardless of the local probability of a reinforcer on that alternative (0 or 1 in the strictly alternating conditions, .5 in the random conditions). Choice then reflected the local reinforcer probabilities, suggesting some discriminative properties of reinforcement. At a more extended level, successive same-alternative reinforcers from an alternative systematically shifted preference towards that alternative, regardless of which alternative was available immediately after a reinforcer. There was no similar shift when successive reinforcers came from alternating sources. These more temporally extended results may suggest a strengthening function of reinforcement, or an enhanced ability to respond appropriately to "win-stay" contingencies over "win-shift" contingencies.     

Assessing reinforcers under progressive schedule requirements.

Recent research findings suggest that reinforcing stimuli may be differentially effective as response requirements increase. We extended this line of research by evaluating responding under increasing schedule requirements via progressive‐ratio schedules and behavioral economic analyses. The differential effectiveness of preferred stimuli in treating destructive behavior maintained by automatic reinforcement also was examined. Results showed that one of two stimuli was associated with more responding under increasing schedule requirements for the 4 participants. Furthermore, stimuli associated with more responding under increasing schedule requirements generally were more effective in treating destructive behavior than stimuli associated with less responding. These data suggest that progressive‐ratio schedules and behavioral economic analyses may be useful for developing a new technology for reinforcer identification. From a clinical perspective, these results suggest that two reinforcers may be similarly effective for low‐effort tasks and differentially effective for high‐effort tasks.     

Assessing the efficacy of pictorial preference assessments for children with developmental disabilities

Past research has demonstrated that pictorial preference assessments can predict subsequent reinforcement effects for individuals with developmental disabilities only when access to the selected stimulus is provided contingent on a pictorial selection. The purpose of the present investigation was to assess more comprehensively the feasibility of the pictorial format with children with developmental disabilities. In Experiment 1, prerequisite skill assessments were conducted, and the role of a contingent reinforcer was assessed by comparing the results from the pictorial assessment without contingent access to a reinforcer assessment. If contingent access was found to be necessary, the effects of schedule thinning were evaluated to determine whether a pictorial format could be made more practical in Experiment 2. The pictorial format without contingent access was successful with only some participants. However, schedule thinning was found to be an effective method to establish conditioned reinforcement properties for pictorial stimuli to create a more practical assessment for a subset of participants.