Yoked variable-ratio and variable-interval responding in pigeons

Pigeons' key pecks were maintained by variable-ratio or variable-interval schedules of food reinforcement. For pairs of pigeons in one group, variable-ratio reinforcement was arranged for one pigeon's pecks; for the second pigeon, reinforcement was arranged according to a variable-interval schedule yoked to the interreinforcement times produced by the first pigeon. For pairs of pigeons in another group, variable-interval reinforcement was arranged for one pigeon's pecks; for the second pigeon, reinforcement was arranged according to a variable-ratio schedule yoked to the interreinforcement responses produced by the first pigeon. For each pair, the yoking procedure was maintained for four or five consecutive sessions of 50 reinforcements each. In more than three-quarters of the pairs, variable-ratio response rates were higher than variable-interval rates within two sessions; in all cases, the rate difference developed within four sessions.     

Associative interaction: joint control of key pecking by stimulus-reinforcer and response-reinforcer relationships

The joint control of rate of key pecking in pigeons by stimulus-reinforcer and response-reinforcer relationships was studied in the context of a two-component multiple schedule of reinforcement. Food presentation was always associated with one component and extinction with the other. The stimulus-reinforcer relationship was manipulated by varying the relative durations of the two components. In the food-presentation component, a fixed rate of reinforcement, independent of rate of responding, was generated by a schedule referred to as “T*”. One aspect of the response-reinforcer relationship, contiguity, was manipulated by varying the percentage of delayed reinforcers. With the multiple T* extinction schedule, stimulus-reinforcer and response-reinforcer relationships could be varied independently of one another. Rate of key pecking was sensitive to manipulations of both relationships. However, significant differential effects due to either the stimulus-reinforcer or response-reinforcer relationship were obtained only when the other relationship was weak: stimulus-reinforcer and response-reinforcer relationships interacted in the joint control of responding.     

Behaviors observed during S- in a simple discrimination learning task

Key pecking of pigeons was reinforced with food in the presence of a horizontal line and never reinforced in the presence of a vertical line. Highly stereotyped behaviors, as well as key pecking, were observed and recorded in the presence of both stimuli. Results showed that a high proportion of time spent in the presence of the horizontal line was occupied by key pecking, a high proportion of time in the presence of the vertical line was occupied by stereotyped nonkey-pecking behaviors, and intermediate proportions of time spent in the presence of intermediate stimuli were occupied by each class of behavior during generalization tests. Similar running rates (number of key pecks divided by observed key-pecking time) were obtained in the presence of all stimuli, indicating that changes in time rather than tempo accounted for the changes in overall rates of key pecking. An exception occurred in responding to the horizontal line as differential performance was developing. In addition to an increase in time spent key pecking, increased running rates occurred in seven of eight birds, suggesting that both time allocation and tempo play a role in behavioral contrast of overall rates of key pecking.     

Effect of punishment on human variable-interval performance

Three female human subjects pressed a button for monetary reinforcement in a range of variable-interval schedules specifying different frequencies of reinforcement. On alternate days, responding was also punished (by subtracting money) according to a variable-ratio 34 schedule. In the absence of punishment, rate of responding was an increasing negatively accelerated function of reinforcement frequency; the relationship between response rate and reinforcement frequency conformed to Herrnstein's equation. The effect of the punishment schedule was to suppress responding at all frequencies of reinforcement. This was reflected in a change in the values of both constants in Herrnstein's equation: the value of the theoretical maximum response-rate parameter was reduced, while the parameter describing the reinforcement frequency corresponding to the half-maximal response rate was increased.     

Some implications of a relational principle of reinforcement

A formal statement of a relational principle of reinforcement is developed that makes contact with analyses of choice, interresponse-time distributions, and stimulus control. Some implications for current theoretical and empirical work in the various areas are examined.     

Reversal learning as a function of changed reward location or changed drive

In two experiments, rats were trained with food in one location (e.g., black alley) and water in another location (white alley) under hunger or thirst. Subsequently, either the locations of the rewards were reversed, or the drive was changed (from hunger to thirst or thirst to hunger). Reversal of instrumental responses took considerably longer when drive was changed and rewards remained in the same locations than when reward locations were reversed. These results were interpreted as indicating that the animal's internal representations of the rewards received in each location transfer when drive is changed. These internal-reward representations interfere with reversal learning by eliciting the responses which were conditioned to them in Phase 1. Because the values of food and water reverse when drive is changed from hunger to thirst or vice versa, it was suggested that the reward representations surviving the drive shift are cognitive representations of the specific events received (food or water), independent of the value of the rewards under either hunger or thirst.     

The program for academic survival skills (pass): Effects on student behavior and achievement

The effects of the Program for Academic Survival Skills (PASS), a group behavior management program, on behavioral observation data and standardized achievement test measures were investigated. Fifty-four of the 96 selected low-achieving, low-survival-skill students of normal IQ were assigned to an experimental condition in which their teachers used PASS. The remaining 42 were assigned to a control condition. Results indicated PASS produced significant gains in survival skills during its operation and one week following program termination in both reading and mathematics periods across grades 1–3. Findings for achievement indicated a significant gain for first-grade experimentals only in reading, with a similar but nonsignificant gain for first-grade mathematics.     

Signalled and unsignalled percentage reinforcement of performance under a chained schedule

Pigeons were trained to peck a key under a chained fixed-ratio 15 fixed-interval 25-sec schedule of food presentation. In Experiment 1, blocks of sessions in which 100%, 75%, 50%, and 25% of the sequences ended with food presentation were conducted. When food presentation was omitted, a timeout of equal duration replaced it. As the frequency of food presentation decreased so did the frequency of completing the chained schedule. In Experiment 2, 75%, 50%, or 25% of the sequences terminated with food presentation and outcomes were signalled, i.e., completion of the fixed ratio resulted in either a stimulus correlated with the fixed-interval 25-sec schedule or a stimulus correlated with extinction. As the frequency of food presentation decreased, the number of sequences completed per session increased for two pigeons and remained high for a third. In Experiments 3 and 4, assessments of the effects of signalling the outcome of the chained schedule were made with response-independent presentation of events at the end of the sequence. Again, signalling the outcome of the chained schedule led to more chains being completed per session than did not signalling the outcome. Stimuli differentially paired with food presentation have powerful behavioral effects that may be attributed to the potency of these stimuli as conditioned reinforcers.     

Increased reinforcement when timeout from avoidance includes access to a safe place

Three experiments investigated the reinforcing value of access to a safe place during timeout from an avoidance schedule. Rats were trained on conjoint schedules in which responding both postponed shock on a free-operant avoidance schedule and produced periods of timeout on fixed-ratio schedules. In some conditions, a shelf was inserted into the operant chamber during timeout, enabling subjects to get off the grid floor. The combination of timeout and shelf maintained substantially higher response rates than the baseline avoidance schedule with ratio requirements as high as 90 (Experiment I). Adding the shelf to timeouts in one component of multiple fixed-ratio schedules of timeout resulted in higher response rates in the component where the shelf was included (Experiment II). When timeouts with and without the shelf were arranged on concurrent schedules, the shelf-timeout combination was preferred, even when of shorter duration than timeout alone (Experiment III). In all three experiments, subjects climbed on the shelf, although all shocks were cancelled during timeout periods. The results could not be accounted for solely in terms of the reinforcing properties of changes in shock rates, but required an interpretation that ascribed conditioned reinforcing value to stimuli associated with such changes.     

Schedule-induced biting under fixed-interval schedules of food or electric-shock presentation

Squirrel monkeys pressed a lever under fixed-interval schedules of food or of electric-shock presentation. Both schedules induced repeated biting on a latex hose. Whether lever pressing was controlled by food or by electric shock, a pattern of decreasing hose biting and increasing lever pressing occurred within fixed-interval cycles. As the fixed-interval duration was increased from 6 to 600 sec, average rates of lever pressing decreased under both schedules. Average rates of hose biting first increased with increasing parameter value, reaching a maximum at values that varied from 60 to 337 sec in different monkeys, and then declined at higher values. d-Amphetamine at appropriate doses increased overall rates of lever pressing maintained by food or by shock, but either did not affect or decreased overall rates of hose biting. When no timeout period occurred between fixed-interval cycles, the monkeys bit most frequently immediately after food or electric shock was presented. When there was a timeout period, hose biting began shortly after the start of the fixed-interval cycles, with little or no hose biting immediately after food or electric shock was presented. Most hose biting appeared to be schedule-induced rather than food- or shock-induced.