A comparison of presession and within-session reinforcement choice.

Single- and concurrent-operants procedures were used to evaluate the effects of two reinforcement conditions on the free-operant responding of 3 individuals with developmental disabilities and 1 with attention deficit disorder. In the presession choice condition, prior to each session the participant chose one item from an array of three different highly preferred stimuli. This item was delivered by the experimenter on each reinforcer delivery during that session. In the within-session choice condition, each reinforcer delivery consisted of placing an array of three different highly preferred stimuli in front of the participant, who was allowed to select one. Only one of the two reinforcement conditions was in effect for any particular session in single-operant phases. Buttons associated with each reinforcement condition were present, and the participant could allocate responses to one or the other in concurrent-operants phases. Data showed substantially more responding to the button associated with within-session choice than presession choice during concurrent-operants phases. This effect was not as apparent during single-operant phases, suggesting that a concurrent-operants procedure provided the more sensitive evaluation of within-session and presession reinforcer choice effects.     

Effects of varying stimulus disparity and the reinforcer ratio in concurrent-schedule and signal-detection procedures.

The present study measured the effects of stimulus and reinforcer variations on pigeons' behavior in two different choice procedures. Two intensities of white light were presented as the stimuli on the main key in a switching-key concurrent schedule and as the sample stimuli in a signal-detection procedure. Under both procedures, the scheduled rate of reinforcement was varied across conditions to produce various ratios of obtained reinforcement. These ratios were obtained for seven pairs of light intensities. In the concurrent schedules, the effects of reinforcer-ratio variations were positively correlated with the physical disparity between the two light intensities. In the signal-detection procedure, changes in the reinforcer ratio produced greater effects on performance when stimulus disparity was very low or very high compared to those found at intermediate levels of stimulus disparity. This discrepancy creates a dilemma for existing behavioral models of signal-detection performance.     

Effects of video self-modeling on the preference and reinforcer value of toys for children diagnosed with autism spectrum disorder

A primary characteristic of autism spectrum disorder includes restrictive and repetitive patterns of behavior. Because having few preferred items and activities can lead to social, communicative, and educational barriers, it is important to increase the number of preferred stimuli in the individual's environment. One way to do this is through conditioned reinforcement via observation. Such procedures involve the acquisition of a skill or change in behavior as a result of indirect contact (i.e., observation) with contingencies received by others. While conditioning through observation has been shown to be effective, one novel approach is video self-modeling. The purpose of the current study was to assess the effects of video self-modeling on the preference and reinforcer value of toys for children diagnosed with autism spectrum disorder.     

EFFECTS OF REINFORCEMENT CHOICE ON TASK RESPONDING IN INDIVIDUALS WITH DEVELOPMENTAL DISABILITIES

The effects of reinforcement choice on task performance were examined with 6 individuals who had been diagnosed with severe to profound mental retardation. Five highly preferred items were identified for each participant via stimulus preference assessments. Participants then were exposed to choice and no-choice conditions that were alternated within reversal and multielement designs. During choice sessions, participants were permitted to select between two preferred stimuli contingent on responding. During no-choice sessions, the therapist delivered a single item contingent on responding. Preference for the stimuli was held constant across conditions by yoking the items delivered during no-choice sessions to those selected during the immediately preceding choice sessions. All participants exhibited similar rates of responding across choice and no-choice conditions. These findings indicate that for individuals with severe disabilities, access to choice may not improve task performance when highly preferred items are already incorporated into instructional programs.     

Discrete-trial choice in pigeons: Effects of reinforcer magnitude

The preference of pigeons for large reinforcers which occasionally followed a response versus small reinforcers which invariably followed a response was studied in a discrete-trial situation. Two differently colored keys were associated with the two reinforcement alternatives, and preference was measured as the proportion of choice trials on which the key associated with uncertain reinforcement was pecked. A combination of choice and guidance trials insured that received distributions of reinforcement equalled the scheduled distributions. For five of six subjects, preference for the uncertain reinforcer appeared to be a linear function of the magnitude of the certain reinforcer. In addition, there was greater preference for the response alternative associated with uncertain reinforcement than would be expected on the basis of net reinforcer value.     

The effects of providing access to stimuli following choice making during vocal preference assessments

Two variations of a vocal paired-stimulus preference assessment were evaluated to determine whether the verbal reports of preference, given by individuals with developmental disabilities when no access to the activity was given, matched their verbal reports when access to the activity was given contingent on their choice. The results indicated different outcomes between the two methods for 6 of the 7 participants. Subsequent reinforcer assessments, conducted for 2 participants, showed that activities identified in the preference assessments that provided access contingent on selection resulted in more responding than did activities identified in the preference assessment that did not include access to items following their selection.     

A comparison of multiple reinforcer assessments to identify the function of maladaptive behavior

Functional analysis results indicated that maladaptive behaviors displayed by a 25-year-old man with profound mental retardation were maintained by attention from caregivers and possibly, to a lesser degree, by access to tangible items. A concurrent-schedules procedure was then used to study the relative reinforcing value for maladaptive behavior of attention versus tangible items. Results of the concurrent-schedules assessment and subsequent functional communication training indicated that preference for attention versus access to a tangible object varied.     

Travel time and concurrent-schedule choice: retrospective versus prospective control

Six pigeons were trained on concurrent variable-interval schedules in which two different travel times between alternatives, 4.5 and 0.5 s, were randomly arranged. In Part 1, the next travel time was signaled while the subjects were responding on each alternative. Generalized matching analyses of performance in the presence of the two travel-time signals showed significantly higher response and time sensitivity when the longer travel time was signaled compared to when the shorter time was signaled. When the data were analyzed as a function of the previous travel time, there were no differences in sensitivity. Dwell times on the alternatives were consistently longer in the presence of the stimulus that signaled the longer travel time than they were in the presence of the stimulus that signaled the shorter travel time. These results are in accord with a recent quantitative account of the effects of travel time. In Part 2, no signals indicating the next travel time were given. When these data were analyzed as a function of the previous travel time, time-allocation sensitivity after the 4.5-s travel time was significantly greater than that after the 0.5-s travel time, but no such difference was found for response allocation. Dwell times were also longer when the previous travel time had been longer.     

Effects of reinforcer delays on choice as a function of income level

Three rats earned their daily food ration by responding during individual trials either on a lever that delivered one food pellet immediately or on a second lever that delivered three pellets after a delay that was continuously adjusted to ensure substantial responding to both alternatives. Choice of the delayed reinforcer increased when the number of trials per session was reduced. This result suggests that models seeking closure on choice effects must include a parameter reflecting how preference changes with sessionwide income. Moreover, models positing that reinforcer probability and immediacy (1/delay) function equivalently in choice are called into question by the finding that probability and immediacy produce opposing effects when income level is changed.     

Enhancing tolerance to delayed reinforcers: the role of intervening activities

Three participants with moderate to profound mental retardation were exposed to choices between an immediate small amount and a delayed larger amount of a preferred reinforcer. All participants initially showed a relatively high preference for the smaller reinforcer, suggesting impulsive choice making. However this preference reversed, suggesting self-control, when the larger reinforcer was available immediately and, over time, its delay was gradually increased. Results highlight the potential utility of incorporating concurrent activities into self-control training paradigms.     

Frequency and value both matter in the suboptimal choice procedure

Pigeons chose between two options on a concurrent‐chains task with a single response requirement in the initial link. The suboptimal option ended with food 20% of the time whereas the optimal option ended with food 80% of the time. During a Sig‐Both condition, terminal‐link stimuli on both options signaled whether or not food would occur. During a Sig‐Sub condition, terminal‐link stimuli on the suboptimal option provided differential signals, but stimuli on the optimal option did not differentially signal the food and no food outcomes. Initial‐link choices revealed a clear preference for the optimal option in the Sig‐Both condition, but preference shifted toward suboptimality in the Sig‐Sub condition. These findings show that pigeon suboptimal choice is not singularly driven by signal value, as has been suggested, but also by reinforcer frequency.     

Effects on choice of reinforcement delay and conditioned reinforcement

Pigeons chose between fixed-interval schedules of different durations presented in the terminal links of concurrent-chains schedules. The pair of schedules was always in the ratio of 2:1, but the absolute duration of the fixed intervals varied. In one set of conditions, the different terminal-link schedules were associated with different keylight stimuli (cued conditions). In a second set of conditions, the different terminal-link schedules were associated with the same stimulus (uncued conditions). Results from the cued conditions replicated previous findings that preference for the shorter fixed-interval schedule increased with fixed-interval duration. Preferences in the uncued conditions were lower than in the corresponding cued conditions but also increased with fixed-interval length. In addition, the degree of control under the uncued conditions was correlated with the extent to which the schedule during the terminal link was discriminated immediately upon entry into the terminal link. The pattern of results in both conditions was inconsistent with the notion that choice behavior matches relative immediacy of reinforcement. Reanalysis of previous evidence for matching (Chung and Herrnstein, 1967) showed that matching in fact did not occur, as the preferences of their subjects for the shorter of two delays also increased with the absolute size of the delays.     

A brief computer-based assessment of reinforcer dimensions affecting choice

In an extension of Neef, Shade, and Miller (1994), we used a brief computer-based assessment of differential responsiveness to reinforcer rate, quality, delay, and response effort in affecting the choices of 11 participants. The assessment involved successive presentations of two concurrent sets of math problems, each set associated with competing reinforcer or response dimensions in a counterbalanced fashion. The results showed that the reinforcer and response dimensions differentially affected choice, with time-allocation patterns varying across students.     

Concurrent choice: Effects of overall reinforcer rate and the temporal distribution of reinforcers

Six pigeons responded on a series of concurrent exponential variable-interval schedules, offering a within-subject comparison with previously published data from concurrent arithmetic variable-interval schedules. Both relative and overall reinforcer rates were varied between conditions. The generalized matching law described the data well, with undermatching much more frequent than strict matching. Time-allocation sensitivity consistently exceeded response-allocation sensitivity for both schedule types, and exponential-schedule sensitivity exceeded arithmetic-schedule sensitivity for both measures of choice. A further set of conditions using variable-interval schedules whose shortest interval was correlated with the mean interval, like arithmetic schedules, but that provided a constant conditional probability of reinforcement, like exponential schedules, produced sensitivities between those produced by conventional arithmetic and exponential schedules. Unlike previous arithmetic-schedule results, exponential sensitivity changed nonmonotonically with changes in overall reinforcer rate. The results clarify our knowledge of the effects of arithmetic and exponential schedules but confuse our understanding of the effects of overall reinforcer rate on concurrent choice.     

Humans' sensitivity to variation in reinforcer amount: Effects of the method of reinforcer delivery

Two experiments examined human subjects' sensitivity to variation in reinforcer amount under different methods of reinforcer delivery. Subjects chose between schedules varying in terms of amount and/or delay of reinforcement, the reinforcer being points exchangeable for money. In Experiment 1, reinforcer amount was manipulated by varying the monetary value of the points across conditions while the number of seconds of access to a consummatory response remained constant. Choice was strongly sensitive to reinforcer amount and indicative of self-control, as in previous experiments. In Experiment 2, reinforcer amount was manipulated by automatically delivering different numbers of points during the amount period, and the consummatory response was eliminated. Sensitivity to variation in reinforcer amount was significantly lower than in Experiment 1. Furthermore, the subjects in Experiment 2 exhibited significantly less self-control than did the subjects in Experiment 1. Humans' sensitivity to variation in reinforcer amount appears to be affected by factors that enhance the discrimi-nability of the consequences of responding.     

Differential reinforcement with and without instructional fading

We evaluated a differential-reinforcement-based treatment package for the reduction of problem behavior during instructional situations. Differential reinforcement of alternative behavior (DRA; compliance) was implemented across two conditions. During one condition, instructions were presented approximately once every other minute. This condition was considered the terminal goal for treatment. During the second condition, the rate of instructions was gradually increased (beginning at zero and ending when instruction rate was similar to the first condition). Results indicated that DRA with instructional fading resulted in less problem behavior than DRA without instructional fading. These results are similar to previous studies regarding the utility of instructional fading.     

Discriminative functions of schedule stimuli and memory: a combination of schedule and choice procedures

Pigeons responded under a combination brief-stimulus schedule and choice procedure. Normally, a fixed-interval schedule was in effect, where completion randomly produced either a brief stimulus or food. Intermittently, this schedule was interrupted by a choice arrangement. Two choice keys were lit, either a short or a long time since a prior event (food or stimulus). One choice response produced food if the time had been short, and the alternate response produced food if the time had been long. Across conditions, the duration of the fixed-interval schedule was varied, the stimuli that comprised the brief-stimulus operation were changed, and the stimuli were presented as paired and nonpaired with food. The focus of the study was the control of both schedule performance and choice responding across conditions. The results showed that choice accuracy was correlated with the degree of fixed-interval curvature, the response pattern of a pause followed by a gradually accelerated rate. As fixed-interval schedule duration was increased, both the degree of fixed-interval curvature and choice accuracy decreased. The particular brief stimulus used affected schedule and choice performance, with a more salient stimulus producing a greater degree of curvature and higher accuracy. Pairing and nonpairing operations produced striking differences in performance with the less salient brief stimulus, but not with the more salient stimulus. The results suggest that brief-stimulus schedule performance may be conceptualized in the context of memory research.     

Effects of reinforcement context on choice

Two experiments investigated the effects of successive reinforcement contexts on choice. In the first, concurrent variable-interval schedules of primary reinforcement operated during the initial links of concurrent chains. The rate of this reinforcement arranged by the concurrent schedules was decreased across conditions: When it was higher than the terminal-link rate, preference for the higher frequency initial-link schedule increased relative to baseline. (During baseline, a standard concurrent-schedule procedure was in effect). When the initial-link reinforcement rate was lower than the terminal-link rate, preference converged toward indifference. In the second experiment, a chain schedule was available on a third key while a concurrent schedule was in effect on the side keys. When the terminal link of the chain schedule was produced, the side keys became inoperative. Availability of the chain schedule did not affect choice between the concurrent schedules. These results show that only when successive reinforcement contexts are produced by choice responding do those successive contexts affect choice in concurrent schedules.     

Using paired-choice assessment to identify variables maintaining sleep problems in a child with severe disabilities

In this study, we used a paired-choice assessment protocol to identify the relative reinforcing value of stimuli and activities for a child with severe disabilities when she failed to settle to sleep at night. The results of this assessment indicated that the child preferred the mother's attention relative to other activities presented. Assessment results were incorporated into an intervention, that produced a reduction in sleep disturbance that was maintained at a 12-month follow up.