Control of responding during stimuli that precede transitions in reinforcement frequency

Pigeons' responses were reinforced on a variant of a mixed variable-interval extinction schedule of reinforcement in which the transition to the higher reinforcement rate was signaled by a trace stimulus projected on the response key prior to the onset of the component correlated with food delivery. In the first of two experiments, the duration of the trace stimulus preceding the component correlated with food delivery was varied from 1.5 to 50.0 s and in the second experiment, the reinforcement frequency in the same component was varied from 10 to 60 reinforcers per hour. Pigeons pecked at the trace stimulus preceding the onset of the component correlated with food delivery even though responding was not reinforced in its presence and only one of the changes in reinforcement rate (i.e., from extinction to reinforcement) was signaled. The rate of pecking during the trace stimulus was a function of its duration but not of the reinforcement frequency in the following component. Higher rates generally occurred at the shorter trace-stimulus durations. Component responding following the offset of the trace stimulus was under discriminative control of the trace stimulus whether or not responding occurred in the presence of the trace stimulus.     

Auditory word discriminations in the pigeon.

Four pigeons were trained on a multiple variable-interval 30-s extinction schedule with various pairs of spoken English words presented as the discriminative stimuli. The birds typically produced discrimination indices of 70% to 90% accuracy. Discrimination accuracy was improved by shortening the interval between auditory stimulus presentations, and by increasing the number of syllables in the words.     

More on concurrent interval-ratio schedules: a replication and review.

It has been suggested that the failure to maximize reinforcement on concurrent variable-interval, variable-ratio schedules may be misleading. Inasmuch as response costs are not directly measured, it is possible that subjects are optimally balancing the benefits of reinforcement against the costs of responding. To evaluate this hypothesis, pigeons were tested in a procedure in which interval and ratio schedules had equal response costs. On a concurrent variable time (VT), variable ratio-time (VRT) schedule, the VT schedule runs throughout the session and the VRT schedule is controlled by responses to a changeover key that switches from one schedule to the other. Reinforcement is presented independent of response. This schedule retains the essential features of concurrent VI VR, but eliminates differential response costs for the two alternatives. It therefore also eliminates at least one significant ambiguity about the reinforcement maximizing performance. Pigeons did not maximize rate of reinforcement on this procedure. Instead, their times spent on the alternative schedules matched the relative rates of reinforcement, even when schedule parameters were such that matching earned the lowest possible overall rate of reinforcement. It was further shown that the observed matching was not a procedural artifact arising from the constraints built into the schedule.     

Preference for less segmented fixed-time components in concurrent-chain schedules of reinforcement

A concurrent-chain procedure was used to examine choice between segmented and less segmented response-independent schedules of reinforcement. A pair of independent, concurrent variable-interval 60-s schedules were presented in the initial link, along with a 1.5-s changeover delay. A chained fixed-interval fixed-time and its corresponding tandem schedule constituted the terminal links. The length of the fixed-interval schedule in the terminal link was varied between 5 s and 30 s while that of the fixed-time schedule was kept at 5 s over conditions. The first components of both terminal-link schedules were accompanied by the same stimulus. Except in the baseline condition, the onset of the second component of the terminal-link chained schedule was accompanied by either a localized (key color) or a nonlocalized (dark houselight) stimulus change. Stimulus conditions were constant during the terminal-link tandem schedule. With three exceptions, pigeons demonstrated a slight preference for the tandem over the chained schedule in the terminal link. Furthermore, this preference varied inversely with the length of the first component. In general, these results are consistent with previous studies that reported an adverse effect on choice by segmenting an interval schedule into two or more components, but they are inconsistent with studies that reported preference for signaled over unsignaled delay of reinforcement.     

Behavior regulation and learned performance: Some misapprehensions and disagreements

The behavior-regulation approach to learned performance has been the subject of misapprehension and disagreement concerning: (1) the nature and importance of behavior regulation, (2) the definition and role of behavioral set-points, (3) the relation of optimal schedule performance to behavioral set-points, and (4) the question of whether deviations from total responding or from response patterns are the primary determinant of molar responding under schedule constraint. After clarifying the nature and role of behavior regulation and set-points, this paper shows that the data used to question optimal schedule performance (Allison, 1981a) actually strongly support the general behavior-regulation approach. These data also indicate a role for response-pattern set-points in determining schedule behavior, but contradict the hypothesis that deviations from response-pattern characteristics are the primary determinant of molar schedule effects.     

Temporal control by signals of interval duration within variable-interval schedules

Rats' lever pressing produced sucrose reinforcers on a variable-interval schedule where, in different conditions, the duration of a stimulus presented immediately after reinforcement was either correlated or uncorrelated with the duration of the current interreinforcement interval. Under the baseline schedule, in which no stimulus was presented, the minimum interreinforcement interval was 8 s and the mean postreinforcement pause of each subject approximated this value. Response rates increased slowly over the first 10 to 15 s and then remained roughly constant throughout the remainder of the interval. In both the correlated and uncorrelated conditions, the added stimulus resulted in the postreinforcement pauses lengthening to values in excess of the duration of the preceding stimulus. This resulted in a poststimulus pause which was, in most cases, roughly constant irrespective of the duration of the preceding stimulus, or of the reinforcement contingencies prevailing immediately after stimulus offset. Local response-rate patterns in the uncorrelated conditions were similar to those obtained under the baseline schedule in which no stimulus was presented. However, in the correlated condition local response rates increased across the remainder of the interreinforcer interval. Further, the rate of acceleration was inversely related to the duration of the preceding stimulus. These results show that a correlation between stimulus duration and the ensuing time to reinforcement can control behavior—a type of temporal control not previously reported.     

FUNCTIONAL COMMUNICATION TRAINING WITH AND WITHOUT EXTINCTION AND PUNISHMENT

Functional communication training has been reported to be a promising treatment for severe behavior problems. In this study, functional communication training alone and combined with extinction and/or punishment was evaluated for 4 clients with severe retardation, behavior problems, and communication deficits. The participants were inpatients on a hospital unit for treatment of severe behavior disorders. They received individualized interventions based on functional assessment that included reinforcement of a communication response with the same function as their destructive behavior. Results showed that for some patients, functional communication training was not sufficient to produce clinically significant reductions in destructive behavior, and the combination of training plus punishment produced the largest and most consistent reductions.     

Delay reduction: current status.

Delay-reduction theory states that the effectiveness of a stimulus as a conditioned reinforcer may be predicted most accurately by the reduction in time to primary reinforcement correlated with its onset. We review support for the theory and then discuss two new types of experiments that assess it. One compares models of choice in situations wherein the less preferred outcome is made more accessible; the other investigates whether frequency of conditioned reinforcement affects choice beyond the effect exerted by frequency of primary reinforcement.     

Violations of transitivity: Implications for a theory of contextual choice

Violations of strong stochastic transitivity in concurrent-chains choice were first reported by Navarick and Fantino. In a series of articles, Navarick and Fantino concluded that neither a unidimensional model capable of predicting exact choice probabilities nor a fixed-variable equivalence rule was possible for the concurrent-chains procedure. I show that when choice is modeled contextually (i.e., when preference for a schedule is affected by factors other than the schedule itself, e.g., aspects of the alternative schedule), a unidimensional, exact-choice probability model is possible that both predicts the intransitivities reported by Navarick and Fantino and provides a fixed-variable equivalence rule for the concurrent-chains procedure. The contextual model is an extension of the generalized matching law and violates a key assumption underlying traditional choice models—simple scalability—because of (a) schedule interdependence and (b) bias from procedural contingencies. Therefore, strong stochastic transitivity cannot be expected to hold. Contextual scalability is analyzed to reveal a hierarchy of context effects in choice. Navarick and Fantino's intransitivities can be satisfactorily explained by bias. If attribute sensitivity is context dependent, however, and if there are similarity structures among choice alternatives, the contextual model is shown to be able to predict violations of ordinal preference. Therefore, it may be possible to formulate a deterministic, general psychophysical model of choice as a behavioral alternative to probabilistic, multidimensional choice theories.