Concurrent schedules: short- and long-term effects of reinforcers

Five pigeons were trained on concurrent variable-interval schedules in a switching-key procedure. The overall rate of reinforcement was constant in all conditions, and the ratios of reinforcers obtainable on the two alternatives were varied over seven levels. Each condition remained in effect for 65 sessions, and the last 50 sessions of data from each condition were analyzed. The most recently obtained reinforcer had the largest effect on current preference, but each of the eight previously obtained reinforcers had a small measurable effect. These effects were larger when the reinforcer ratio was more extreme. A longer term effect of reinforcement was also evident, which changed as a function of the reinforcer ratio arranged. More local analyses showed regularities at a reinforcer-by-reinforcer level and large transient movements in preference toward the just-reinforced alternative immediately following reinforcers, followed by a return to stable levels that were related to the reinforcer ratio in effect. The present data suggest that the variables that control choice have both short- and long-term effects and that the short-term effects increased when the reinforcer ratios arranged were more extreme.     

Risk-sensitive choice in humans as a function of an earnings budget

Risky choice in 3 adult humans was investigated across procedural manipulations designed to model energy-budget manipulations conducted with nonhumans. Subjects were presented with repeated choices between a fixed and a variable number of points. An energy budget was simulated by use of an earnings budget, defined as the number of points needed within a block of trials for points to be exchanged for money. During positive earnings-budget conditions, exclusive preference for the fixed option met the earnings requirement. During negative earnings-budget conditions, exclusive preference for the certain option did not meet the earnings requirement, but choice for the variable option met the requirement probabilistically. Choice was generally risk averse (the fixed option was preferred) when the earnings budget was positive and risk prone (the variable option was preferred) when the earnings budget was negative. Furthermore, choice was most risk prone during negative earnings-budget conditions in which the earnings requirement was most stringent. Local choice patterns were also frequently consistent with the predictions of a dynamic optimization model, indicating that choice was simultaneously sensitive to short-term choice contingencies, current point earnings, and the earnings requirement. Overall, these results show that the patterns of risky choice generated by energy-budget variables can also be produced by choice contingencies that do not involve immediate survival, and that risky choice in humans may be similar to that shown in nonhumans when choice is studied under analogous experimental conditions.     

A brief computer-based assessment of reinforcer dimensions affecting choice

In an extension of Neef, Shade, and Miller (1994), we used a brief computer-based assessment of differential responsiveness to reinforcer rate, quality, delay, and response effort in affecting the choices of 11 participants. The assessment involved successive presentations of two concurrent sets of math problems, each set associated with competing reinforcer or response dimensions in a counterbalanced fashion. The results showed that the reinforcer and response dimensions differentially affected choice, with time-allocation patterns varying across students.     

Response efficiency during functional communication training: effects of effort on response allocation

An analogue functional analysis revealed that the problem behavior of a young child with developmental delays was maintained by positive reinforcement. A concurrent-schedule procedure was then used to vary the amount of effort required to emit mands. Results suggested that response effort can be an important variable when developing effective functional communication training programs.     

The general matching law describes choice on concurrent variable-interval schedules of wheel-running reinforcement.

Six male Wistar rats were exposed to concurrent variable-interval schedules of wheel-running reinforcement. The reinforcer associated with each alternative was the opportunity to run for 15 s, and the duration of the changeover delay was 1 s. Results suggested that time allocation was more sensitive to relative reinforcement rate than was response allocation. For time allocation, the mean slopes and intercepts were 0.82 and 0.008, respectively. In contrast, for response allocation, mean slopes and intercepts were 0.60 and 0.03, respectively. Correction for low response rates and high rates of changing over, however, increased slopes for response allocation to about equal those for time allocation. The results of the present study suggest that the two-operant form of the matching law can be extended to wheel-running reinforcement. 'I'he effects of a low overall response rate, a short Changeover delay, and long postreinforcement pausing on the assessment of matching in the present study are discussed.     

Assessment of impulsivity and the development of self-control in students with attention deficit hyperactivity disorder.

We examined a combined approach of manipulating reinforcer dimensions and delay fading to promote the development of self‐control with 3 students diagnosed with attention deficit hyperactivity disorder. First, we administered a brief computer‐based assessment to determine the relative influence of reinforcer rate (R), reinforcer quality (Q), reinforcer immediacy (I), and effort (E) on the students' choices between concurrently presented math problems. During each session, one of these dimensions was placed in direct competition with another dimension (e.g., RvI involving math problem alternatives associated with high‐rate delayed reinforcement vs. low‐rate immediate reinforcement), with all possible pairs of dimensions presented across the six assessment conditions (RvQ, RvI, RvE, QvI, QvE, IvE). The assessment revealed that the choices of all 3 students were most influenced by immediacy of reinforcement, reflecting impulsivity. We then implemented a self‐control training procedure in which reinforcer immediacy competed with another influential dimension (RvI or QvI), and the delay associated with the higher rate or quality reinforcer alternative was progressively increased. The students allocated the majority of their time to the math problem alternatives yielding more frequent (high‐rate) or preferred (high‐quality) reinforcement despite delays of up to 24 hr. Subsequent readministration of portions of the assessment showed that self‐control transferred across untrained dimensions of reinforcement.     

Evaluating preschool children's preferences for motivational systems during instruction

Preschool teachers rely on several strategies for motivating children to participate in learning activities. In the current study, we evaluated the effectiveness of and preference for three teaching contexts in which embedded, sequential, or no programmed reinforcement was arranged. The embedded context included highly preferred teaching materials, the sequential context included highly preferred edible items for correct responding, and a control context included neither. In addition, an exclusively play-oriented activity was included as a fourth option to determine if one of the direct teaching contexts could compete with a relatively unstructured and exclusively child-led activity. All participants preferred the sequential context (use of high-quality consequences) over the embedded context (use of high-quality teaching materials), 2 of the 4 participants preferred some motivational system to none at all, and the play area was selected over all variants of the instructional contexts during the majority of trials. We found either no or small differences in correct responding in the different instructional contexts; however, rates of undesirable behavior were highest in the least preferred interaction area for 3 of the 4 participants. Implications for the design of effective and preferred teaching environments for young children are discussed.