A PRACTICAL STRATEGY FOR ONGOING REINFORCER ASSESSMENT

There is a need for practical methods of reinforcer assessment that systematically track ongoing changes in clients' preferences. In this study, the effects of a time-efficient reinforcer assessment package were evaluated in a multiple baseline across 3 preschoolers with autism, comparing individualized item selections by experienced teachers with children's presession preferences for items of various sensory qualities. Systematic assessment of children's reinforcers for correct responding virtually eliminated nontargeted maladaptive behaviors, as well as yielding expected improvements in accuracy. The powerful side-effects of potent reinforcers underline the importance of increased attention to reinforcer assessment in research and practice.     

Response-reinforcer contingency and spatially defined operants: testing an invariance property of phi

A chamber containing 72 response keys defining the circumference of a circle 1 m in diameter was used to examine the relation between differentiation of response location and a measure of response-reinforcer contingency known as the phi coefficient. A different target key was specified in each successive phase, and response location was differentiated with respect to the target. Criterional and noncriterional responses (i.e., responses "near" and "far" from the target) were defined using targeted percentile schedules to control the overall probability of each response class. By manipulating criterional (and, hence, noncriterional) response probability and the reinforcement probabilities conditional on each, a mathematical invariance property peculiar to phi in contingency analysis was examined. Specifically, diagonally interchanging cell frequencies in a 2 x 2 table relating criterional/noncriterional responses to reinforcement/nonreinforcement leaves phi unchanged. Hence, the degree of response differentiation predicted by phi remains unchanged under the four permutations implied by the various diagonal interchanges. This predicted invariance was examined under values of phi equal to .33, .58, and .82. Increasing phi generally increased the stereotypy of response location. Three of the permutations generated almost interchangeable performance at different phi values. The remaining permutation, however, generated functions relating response concentration to phi with slopes shallower than those obtained under the other permutations. This resulted from relatively higher levels of differentiation, compared to the other permutations, at low phi values. These data strongly suggest boundary conditions on the ability of phi to reflect completely the local processes that are indexed by phi at a molar level.     

Income maximizing in concurrent interval-ratio schedules

Three mice chose between concurrent variable-ratio variable-interval schedules to produce a warm air stream while they were housed in a cold chamber. Across conditions, the duration of the warm air stream was varied between 10 and 80 s and was equal for both schedules. Preference for the VI schedule covaried with reinforcer duration as predicted by maximizing accounts of choice.     

Theories of probabilistic reinforcement.

In three experiments, pigeons chose between two alternatives that differed in the probability of reinforcement and the delay to reinforcement. A peck at a red key led to a delay of 5 s and then a possible reinforcer. A peck at a green key led to an adjusting delay and then a certain reinforcer. This delay was adjusted over trials so as to estimate an indifference point, or a duration at which the two alternatives were chosen about equally often. In Experiments 1 and 2, the intertrial interval was varied across conditions, and these variations had no systematic effects on choice. In Experiment 3, the stimuli that followed a choice of the red key differed across conditions. In some conditions, a red houselight was presented for 5 s after each choice of the red key. In other conditions, the red houselight was present on reinforced trials but not on nonreinforced trials. Subjects exhibited greater preference for the red key in the latter case. The results were used to evaluate four different theories of probabilistic reinforcement. The results were most consistent with the view that the value or effectiveness of a probabilistic reinforcer is determined by the total time per reinforcer spent in the presence of stimuli associated with the probabilistic alternative. According to this view, probabilistic reinforcers are analogous to reinforcers that are delivered after variable delays.     

Topographical variations in behavior during autoshaping, automaintenance, and omission training

Three pigeons were exposed to an autoshaping and automaintenance procedure while a computer-controlled tracking system continuously recorded the position of the bird's head as it moved freely in the experimental chamber. Although only 2 birds pecked the key during the conditional stimulus (red keylight), all 3 birds exhibited stable patterns of approaching the conditional stimulus and withdrawing from the intertrial stimulus (white keylight). Subsequent exposure to an omission procedure, in which pecks on the red key cancelled the presentation of food upon the termination of the red keylight, greatly reduced key pecking, but approaching and pecking in the vicinity of the conditional stimulus were maintained at high levels. When the omission contingency was removed key pecking increased. During all phases the birds withdrew from the area of the white key and engaged in repetitive back-and-forth or circuiting movements during this intertrial stimulus. The data document (a) the strong control the conditional stimulus in autoshaping and automaintenance exerts over approach to the key and pecking motions whether or not the conditional stimulus elicits key pecking at a high level; and (b) withdrawal from the vicinity of the key and the occurrence of stereotypic behavior during the intertrial interval.     

Tests of transitivity in choices between fixed and variable reinforcer delays.

This experiment tested for transitivity in pigeons' choices between variable-time (VT) and fixed-time (FT) schedules. In a discrete-trials procedure, a subject chose between two alternatives by making a single key peck. Each choice was between a "standard alternative," which was the same schedule throughout a condition, and an "adjusting alternative," in which the delay to reinforcement was systematically increased or decreased many times a session. These adjustments enabled an approximate indifference point to be identified--the value of the adjusting delay at which the subject chose each alternative about equally often. Each test of transitivity involved four conditions. In one, the standard alternative was a variable-time schedule with a 2-s reinforcer, and the adjusting alternative also delivered a 2-s reinforcer. A second condition was similar except that the adjusting alternative delivered a 5-s reinforcer. The indifference point from each of these conditions was then converted to a fixed-time schedule for subsequent comparisons in the third and fourth conditions, respectively. Each of these last two conditions compared one of the fixed-time schedules (based upon the previous conditions and including their different reinforcer durations) with an adjusting schedule that delivered the alternative reinforcer duration, to determine whether the obtained indifference points would be those predicted from the prior alternative-duration comparisons with the VT schedule. There was little evidence for intransitivity of choice: Averaged across subjects and replications, the obtained indifference points deviated from perfect transitivity by less than 8%, and these deviations were not statistically significant. These results contrast with those of Navarick and Fantino (1972), who found frequent violations of transitivity between periodic and aperiodic schedules using a concurrent-chains procedure with variable-interval schedules in the initial links.     

A quantitative analysis of extreme choice

Six homing pigeons were trained on a variety of concurrent variable-interval schedules in a switching-key procedure. Unlike previous work, reinforcer ratios of up to 160 to 1 and concurrent extinction variable-interval schedules were arranged in order to investigate choice when reinforcer-frequency outcomes were extremely different. The data obtained over 11 conditions were initially analyzed according to the generalized matching law, which fitted the data well. The generalized matching law was then fitted only to conditions in which the reinforcer ratios were between 1 to 10 and 10 to 1. The deviations of choice measures from the other four more extreme reinforcer-ratio conditions were significantly more towards equal choice than predicted by this second generalized matching fit. A contingency-discriminability model, which predicts such deviations, described the data more effectively than did the generalized matching law, and also correctly predicted the maintenance of responding on both alternatives when one was associated with extinction.     

ASSESSING INFLUENTIAL DIMENSIONS OF REINFORCERS ON CHOICE IN STUDENTS WITH SERIOUS EMOTIONAL DISTURBANCE

We examined how reinforcer rate, quality, delay, and response effort combined to influence the choices of 6 youths with learning and behavior difficulties, and the viability of an assessment methodology derived from matching theory for determining differential responsiveness to those reinforcer and response dimensions. The students were given two concurrent sets of math problems that were equal on two dimensions but competed on two other dimensions (e.g., one set yielded higher rate and lower quality reinforcement than the other). Competing dimensions were counterbalanced across the six conditions of the initial assessment phase, permitting assessment of each dimension on time allocation. The conditions resulting in the most and least time allocated to one problem set alternative relative to the other were then replicated. Time allocated to each of the problems within sets was differentially affected by the reinforcer and/or response dimensions, with allocation patterns varying across students. The results are discussed in the context of implications for the design of treatments and extrapolations from basic research on matching and behavioral economics.     

Class-consistent Differential Reinforcement And Stimulus Class Formation In Pigeons

Match-to-sample training clusters of A1 (sample): B1/B2 (comparisons), A2: B2/B1, B1: A1/A2, B2: A2/A1, B1: C1/C2, B2: C2/C1, C1: B1/B2, and C2: B2/B1 were presented to pigeons with class-consistent differential reinforcement using two dissimilar types of food reinforcers. Distinctive class-consistent response patterns occurred to the samples during the fixed-ratio 5 sample observing response requirement. Subsequent tests, modeled from the equivalence class paradigm demonstrated the emergence (80% class consistent) of the transitive-like A-C and C-A relations for 4 and 2 of 12 pigeons, respectively, and a strong trend (over 70%) for 7 and 6 others, respectively; the emergence of the reflexive-like identity relation when the nonidentical comparison was from the other class; and the disruption of the trained within-class relation with the addition of a reflexive comparison. After directional training of C1: D1/D2 and C2: D2/D1, tests indicated no emergence of the symmetric-like D-C relation or the composite D-B and D-A relations, but the B-D and A-D transitive-like relation occurred with some pigeons. Off-baseline training with class-consistent differential reinforcement contingent on responding to the D stimuli alone produced distinctive responding and, in turn, a trend to D-C symmetric-like control in 4 of 12 pigeons, as well as a shift toward class-consistent control on D-B and D-A test trials. Class-consistent differential reinforcement that produced distinctive sample behavior promoted stimulus control relations like those that circumscribe equivalence class formation. Respondent—operant interactions permit an analysis of the possible enrollment of stimulus values of distinctive responding to the discriminative stimuli forming the stimulus classes via processes corresponding to naming in humans.     

Reinforcement magnitude and pausing on progressive-ratio schedules

Rats responded under progressive-ratio schedules for sweetened milk reinforcers; each session ended when responding ceased for 10 min. Experiment 1 varied the concentration of milk and the duration of postreinforcement timeouts. Postreinforcement pausing increased as a positively accelerated function of the size of the ratio, and the rate of increase was reduced as a function of concentration and by timeouts of 10 s or longer. Experiment 2 varied reinforcement magnitude within sessions (number of dipper operations per reinforcer) in conjunction with stimuli correlated with the upcoming magnitude. In the absence of discriminative stimuli, pausing was longer following a large reinforcer than following a small one. Pauses were reduced by a stimulus signaling a large upcoming reinforcer, particularly at the highest ratios, and the animals tended to quit responding when the past reinforcer was large and the stimulus signaled that the next one would be small. Results of both experiments revealed parallels between responding under progressive-ratio schedules and other schedules containing ratio contingencies. Relationships between pausing and magnitude suggest that ratio pausing is under the joint control of inhibitory properties of the past reinforcer and excitatory properties of stimuli correlated with the upcoming reinforcer, rather than under the exclusive control of either factor alone.