Effects of differences between stimuli, responses, and reinforcer rates on conditional discrimination performance

In a discrete-trial conditional discrimination procedure, 4 pigeons obtained food reinforcers by pecking a key with a short latency on trials signaled by one stimulus and by pecking the same key with a long latency on trials signaled by a second stimulus. The physical difference between the two stimuli and the temporal separation between the latency values required for reinforcement were varied factorially over four sets of conditions, and the ratio of reinforcer rates for short and long latencies was varied within each set of conditions. Stimulus discrimination varied directly with both stimulus and response differences and was unaffected by the reinforcer ratio. Sensitivity to reinforcement, estimated by generalized-matching-law fits to the data within each set of conditions, varied directly with the response difference but inversely with the stimulus difference arranged between sets of conditions. Because variations in stimulus differences, response differences, and reinforcer differences did not have equivalent effects, these findings question the functional equivalence of the three terms of the discriminated operant: antecedent stimuli, behavior, and consequences.     

Delay reduction: current status.

Delay-reduction theory states that the effectiveness of a stimulus as a conditioned reinforcer may be predicted most accurately by the reduction in time to primary reinforcement correlated with its onset. We review support for the theory and then discuss two new types of experiments that assess it. One compares models of choice in situations wherein the less preferred outcome is made more accessible; the other investigates whether frequency of conditioned reinforcement affects choice beyond the effect exerted by frequency of primary reinforcement.     

Violations of transitivity: Implications for a theory of contextual choice

Violations of strong stochastic transitivity in concurrent-chains choice were first reported by Navarick and Fantino. In a series of articles, Navarick and Fantino concluded that neither a unidimensional model capable of predicting exact choice probabilities nor a fixed-variable equivalence rule was possible for the concurrent-chains procedure. I show that when choice is modeled contextually (i.e., when preference for a schedule is affected by factors other than the schedule itself, e.g., aspects of the alternative schedule), a unidimensional, exact-choice probability model is possible that both predicts the intransitivities reported by Navarick and Fantino and provides a fixed-variable equivalence rule for the concurrent-chains procedure. The contextual model is an extension of the generalized matching law and violates a key assumption underlying traditional choice models—simple scalability—because of (a) schedule interdependence and (b) bias from procedural contingencies. Therefore, strong stochastic transitivity cannot be expected to hold. Contextual scalability is analyzed to reveal a hierarchy of context effects in choice. Navarick and Fantino's intransitivities can be satisfactorily explained by bias. If attribute sensitivity is context dependent, however, and if there are similarity structures among choice alternatives, the contextual model is shown to be able to predict violations of ordinal preference. Therefore, it may be possible to formulate a deterministic, general psychophysical model of choice as a behavioral alternative to probabilistic, multidimensional choice theories.     

Adaptation, teleology, and selection by consequences

This paper presents and defends the view that reinforcement and natural selection are selection processes, that selection processes are neither mechanistic nor teleological, and that mentalistic and vitalistic processes are teleological but not mechanistic. The differences between these types of processes are described and used in discussing the conceptual and methodological significance of “selection type theories” and B. F. Skinner's radical behaviorist view that “operant behavior is the field of intention, purpose, and expectation. It deals with that field precisely as the theory of evolution has dealt with another kind of purpose” (1986, p. 716). The antimentalism of radical behaviorism emerges as a post-Darwinian extension of Francis Bacon's (and Galileo's) influential view that “[the introduction of final causes] rather corrupts than advances the sciences” (Bacon, 1905, p. 302).     

Unit price as a useful metric in analyzing effects of reinforcer magnitude.

In this paper, we applied the behavioral-economic concept of unit price to the study of reinforcer magnitude in an attempt to provide a consistent account of the effects of reinforcer magnitude on behavior. Recent research in the experimental analysis of behavior and in behavioral pharmacology suggests that reinforcer magnitude interacts with the schedule of reinforcement to determine response rate and total consumption. The utility of the unit-price concept thus stems from its ability to quantify this interaction as a cost-benefit ratio (i.e., unit price = characteristics of the schedule of reinforcement divided by magnitude of reinforcement). Research employing the unit-price concept has shown that as unit price increases, a positively decelerating function exists for consumption (i.e., a function with an increasingly negative slope, when plotted on log coordinates) and a bitonic function exists for response rate. Based on these findings, the present analysis applied the unit-price concept to those studies of reinforcer magnitude and drug self-administration that examined the effects of reinforcer magnitude on response rate using simple schedules of reinforcement (e.g., fixed-ratio schedule). This resulted in three findings: (a) Reinforcer-magnitude manipulations and schedule manipulations interact in a manner that can be quantified in terms of unit price as benefit and cost factors, respectively; (b) different reinforcer-magnitude manipulations are functionally interchangeable as benefit factors in the unit-price ratio; and (c) these conclusions appear warranted despite the differences in reinforcers (food or drug), species (dogs, monkeys, or rats), and schedules (interval or ratio), and despite the fact that these studies were not designed for a unit-price analysis. In methodological terms, these results provide further evidence that employing the unit-price concept is a parsimonious method for examining the effects of reinforcer magnitude. In theoretical terms, these results suggest that a single process may underlie the effect of combined reinforcer-magnitude and schedule manipulations.     

Schedule-induced defecation by rats during ratio and interval schedules of food reinforcement.

Lever pressing in rats was maintained by continuous and intermittent schedules of food while defecation was monitored. In Experiment 1, reinforcement densities were matched across variable-ratio and variable-interval schedules for three pairs of rats. Defecation occurred in all 3 rats on the variable-ratio schedule and in all 3 rats on the yoked variable-interval schedule. In Experiment 2, fixed-ratio and fixed-interval schedules with similar reinforcement densities maintained lever pressing. Defecation occurred in 3 of 4 rats on the fixed-ratio schedule and in 4 of 4 rats on the fixed-interval schedule. Almost no defecation occurred during continuous reinforcement in either experiment. These results demonstrate that defecation may occur during both ratio and interval schedules and that the inter-reinforcement interval is more important than the behavioral requirements of the schedule in generating schedule-induced defecation.     

Delayed and current stimulus control in successive discriminations

In a successive discrimination in which successively alternating red and green hues signaled component variable-interval schedules, sensitivity of the ratio of responses in the two components to variation in the component reinforcer ratio decreased systematically during the course of the component. This decrease in stimulus control or discrimination over the course of the component was shown to be the result of delayed control of responding during the component by the stimulus transition between components. When the red–green stimulus transition was altered by interpolating a white stimulus at the end of each 60-s component, discrimination at the beginning of the component (measured by the power-function exponent for sensitivity to reinforcement) was reduced. Conditions with the white stimulus inserted in other quarters of the component indicated that the current discriminative stimulus exerts control over responding throughout the component, whereas during about the first half of the component, response differentials are influenced by the transition between discriminative stimuli.     

Additional-delay schedules: A continuum of temporal contingencies by varying food delay

Pigeons performed on discrete-trial, temporally defined schedules in which the food delay (D) was adjusted according to the latency of the key peck (X) and two schedule parameters (t and A). The schedule function was D = A(t − X), where D is the experienced delay between a response and a reinforcer. The schedule parameter t is the maximum value below which the present contingencies occur. A is the additional delay to reinforcement for each second the response latency is shorter than the t value. When A = 0 s, the schedule is a continuous reinforcement schedule with immediate reinforcement. When A = 1 s, the schedule is a conjunctive fixed-ratio 1 fixed-time t-s schedule. When A approaches infinity, the schedule becomes a differential reinforcement of long latency schedule. The latencies for subjects with t = 10 s and t = 30 s were observed with the present schedules having seven values for A between 0 s and 11 s. In addition, the latencies for subjects for which t = 30 s were observed at an A value of 31 s to 41 s. As the A value increased, the latencies approached the t value for subjects for which t = 10 s. The latencies for 30-s-t subjects did not approach t, even when the A value was 41 s. The latencies for 10-s-t subjects at 11-s A value were longer than those under yoked conditions having exactly the same delays/interreinforcement intervals. These results demonstrated a continuum of latency related to the schedule continuum (value of A) at a small t value.     

Three-term contingency patterns in mother-child verbal interactions during first-language acquisition

Selections from a large longitudinal data set of verbal interactions between a mother and her child are presented. Two sets of three-term contingency sequences that seemed to reflect maternal rewards and corrections were noted. Both the antecedents as well as the immediate consequences of maternal interventions are presented to explore training and learning processes. The observed frequencies of three-step sequences are compared to those expected based upon Markov-chain logic to substantiate the patterning of the interactions. Behavioral conceptualizations of the learning process are supported by these analyses, although their sufficiency is questioned. It is suggested that maternal rewards and corrections should be integrated with perceptual, cognitive, and social learning conceptualizations in a skill-learning approach to explain the complexity of language transmission and acquisition processes.     

Timeout from concurrent schedules.

Response-contingent timeouts of equal duration and frequency were added to both alternatives of unequal concurrent schedules of reinforcement. For each of 4 pigeons in Experiment 1, relative response rates generally became less extreme as the frequency of timeout increased. In Experiment 2, relative response rates consistently approached indifference as the duration of timeout was increased. Variation in time allocation was less consistent in both experiments. Absolute response rates did not vary with the timeout contingency in either experiment. In a third experiment, neither measure of choice varied systematically when the duration of a postreinforcement blackout was varied. In contrast to the present results, preference has been shown to vary directly with the parameters of shock delivery in related procedures. The pattern of results in the first two experiments follows that obtained with other manipulations of the overall rate of reinforcement in concurrent schedules. The results of the third experiment suggest that an intertrial interval following reinforcement is not a critical feature of the overall rate of reinforcement.