Some temporal parameters of non-contingent reinforcement

In each baseline session, pigeons were exposed to a multiple schedule in which each of five distinctive stimuli was correlated with a different frequency of reinforcement. In one component, responses were reinforced with a probability of 0.10 (random-ratio schedule); in the other four components, responses were reinforced with different scheduled temporal frequencies averaging 30 to 240 sec between reinforcements (random-interval schedules). For periods lasting 30 sessions, contingent reinforcement was discontinued and reinforcement was presented independent of responding at irregular intervals averaging 30, 60, or 120 sec, while the sequence of stimuli continued. After each such period, the baseline was reinstated for 30 sessions. The data indicated that: (1) The rate of responding in the presence of all stimuli decreased as exposure to the non-contingent reinforcement procedure was prolonged, at all the frequencies of reinforcement employed; (2) The rate under the random-ratio schedule declined faster than the rates under all the random-interval schedules, presumably because the decrease in reinforcement frequency under this stimulus condition was greatest; (3) The decline in rates of responding under the stimuli correlated with the random-interval schedules tended to be greatest for the stimuli paired with the lowest frequencies of reinforcement.     

Some observations on the adventitious reinforcement of drinking under food reinforcement

The development of strong postreinforcement drinking behavior under variable-interval food reinforcement in rats was found to be influenced by the proportion of short intervals in the VI and the proximity of the water tube to the lever.     

Some implications of a relational principle of reinforcement

A formal statement of a relational principle of reinforcement is developed that makes contact with analyses of choice, interresponse-time distributions, and stimulus control. Some implications for current theoretical and empirical work in the various areas are examined.     

Some notes on time out from reinforcement

Pigeons produced food on a fixed-ratio schedule by pecking at one key, and an S^Δ period by pecking at a second (switching) key. Switching behavior was examined as a function of (a) size of the fixed ratio, (b) whether the S^Δ was of fixed duration or could be determined by the bird, (c) the introduction of a novel food S^D, (d) extinction of food responding, and (e) the stimuli associated with the S^D and S^Δ conditions. No monotonic relationship was obtained between ratio size and switching behavior. Switching behavior was, however, influenced by many variables. The results suggest that an interpretation of switching behavior in terms of its being reinforced by the removal of aversive conditions, is open to considerable question.     

Some possible forms of lexicographic evaluation

A set of definitions leading to an axiom set which makes possible distinction between two or more forms of lexicographic choice is offered. It is shown that, by treating value as quantized and only taking a finite number of levels for each attribute of a multi-attribute choice situation, lexicographic evaluation might be subsumed under more familiar forms of choice model. Special cases and implications are discussed.     

Some effects of relative reinforcement rate and changeover delay in response-independent concurrent schedules of reinforcement

Reinforcements were arranged independently of the pigeon's behavior by concurrent variable-interval schedules. The reinforcements arranged by one of the schedules occurred when the chamber was illuminated with amber light, and the reinforcements arranged by the other schedule occurred when the chamber was illuminated with blue light. Both schedules functioned concurrently, but reinforcers were delivered by each only in the presence of the appropriate stimulus condition. A response on a white key, the only key in the chamber, alternated the stimulus condition and the effective schedule. The results of this procedure were similar to those obtained with concurrent response-dependent variable-interval schedules of reinforcement. The proportion of the total session time spent in the presence of a schedule component approximated the proportion of the total number of reinforcements in the component. Changeover rate was a decreasing function of the changeover delay and of the difference between the relative rates of reinforcement for each pair of concurrent schedules.     

Some notes on conditioned suppression and reinforcement schedules

Two pigeons were trained on an FR 150 schedule of reinforcement. An Estes-Skinner conditioned suppression procedure was then superimposed on this performance at varied intervals. If the CS occurred during the early stages of the ratio run, complete suppression resulted. If the CS occurred during the later stages of the run, the birds continued to respond until the reinforcement was obtained, which was then followed by complete suppression.     

Two parameters of a temporally defined schedule of negative reinforcement

Temporal schedules of negative reinforcement were derived in a manner analogous to those for positive reinforcement, and two parametric studies were carried out with two of the three defining variables. With some limiting values of the defining variables, escape schedules result and data obtained at these values were similar to those obtained in escape studies. At other values of the defining variables avoidance behavior was generated.     

Some effects of correlation between response-contingent shock and reinforcement

Rats responded on a two-component chain schedule in which a response-contingent electric shock at the end of the first component was either positively correlated, negatively correlated, or uncorrelated with reinforcement availability in the second component. With 0.4-ma shocks, rate in the first component depended on the shock-reinforcement correlation: when shock and reinforcement availability were positively correlated, after extended exposure to the contingencies, rates exceeded those in the absence of shock; when shock and reinforcement availability were negatively correlated, responding was generally suppressed throughout. The discriminative control of shock over responding in the second component, in which reinforcement was available 50% of the time, also depended somewhat on correlation. However, rate change in the first component was not specifically related to discrimination in the second component. With 0.8-ma shocks, responding was substantially suppressed in the first component at all three values of shock-reinforcement correlations.     

Manipulating parameters of reinforcement to reduce problem behavior without extinction

Differential reinforcement of alternative behavior (DRA) most often includes extinction as a treatment component. However, extinction is not always feasible and it can be counter‐therapeutic if implemented without optimal treatment integrity. Researchers have successfully implemented DRA without extinction by manipulating various parameters of reinforcement such that alternative behavior is favored. We extended previous research by assessing three participants' sensitivities to quality, magnitude, and immediacy using arbitrary responses and reinforcers that maintain problem behavior. The results were used to implement an intervention for problem behavior using DRA without extinction. Our findings indicate that arbitrary responses can be used to identify individual and relative sensitivity to parameters of reinforcement for reinforcers that maintain problem behavior. Treatment was effective for all participants when we manipulated parameters of reinforcement to which they were most sensitive, and, for two participants, the treatment was less effective when we manipulated parameters to which they were least sensitive.     

Behavioral parameters of drug action: signalled and response-independent reinforcement

Four pigeons were initially trained under a multiple variable-interval 1-min variable-interval 1-min schedule of food reinforcement. For two of the pigeons, a signal was then presented whenever the reinforcer was available in one component; this resulted in positive contrast. For the other two pigeons, the reinforcer was presented independently of responding on a variable-time schedule in one component; this resulted in negative induction. After 30 to 50 sessions, however, a similar degree of differential responding occurred under both multiple schedules, i.e., high rates in the variable-interval component and low rates in the other component. Reinforcement frequency remained about the same in each of the schedule components. The stable performances then served as baselines for studying drug effects. In the high-rate component of both multiple schedules, small doses of d-amphetamine increased responding, whereas larger doses decreased responding. In the low-rate component of both multiple schedules, there was no rate-increasing effect at any dose of d-amphetamine; such an effect was found, however, with phenobarbital at a dose that decreased responding in the high-rate component. The drug effects thus depended on the interaction of pharmacologic variables (specific drug and dose) with behavioral variables (schedule components).     

A possible biological analogue of the reinforcement control device in self-organizing systems

Virtually all self-organizing systems proposed as models for learning require a reinforcement control device. The biological analogue of this device has never been clear. Slow changes in the cortical potential may be correlates of a biological analogue of reinforcement control devices. Frequent pairings of novel stimuli with other stimuli eliciting specific responses produce a slow shift and oscillation in the cortical potential. This D. C. shift and oscillation occurs first in the sensory, and then in the motor cortex involved; it may be associated with the decreases or increases which occur in the threshold of cells in these cortical areas.     

Some effects of discriminative training with equated frequency of reinforcement

Pigeons were exposed to a multiple schedule which provided equally frequent reinforcement in the presence of two stimuli but which produced markedly different rates of key-pecking. Generalization gradients were displaced away from the stimulus associated with the lower rate of key-pecking. Another group of pigeons had similar training, except that a low rate of key-pecking was established in a stimulus with a much higher frequency of food reinforcement. In this case, the generalization gradients were not affected by the training on the schedule producing a low response rate.