Punishment by SD associated with fixed-ratio reinforcement

Two pigeons were trained with positive reinforcement on a multiple FR VI 2 schedule. The VI 2 component was held constant while the FR component was changed from ratios of 1 to 300. After responding had stabilized at each FR value, VI responses produced briefly either the fixed-ratio S^D or a stimulus uncorrelated with either schedule component. Compared to the effects of the uncorrelated stimulus change, the fixed-ratio S^D produced a decrease in VI responding proportional to the size of the FR requirement. It is concluded that stimuli associated with high FR schedules served as punishment for the ongoing behavior.     

Stimulus control with fixed-ratio reinforcement

Pigeons were trained on a three-stimulus simultaneous discrimination with reinforcements given on fixed-ratio schedules ranging from one response per reinforcement to 205 responses per reinforcement. Responses to any of the three stimuli advanced the ratio, but, when it was completed, a reinforcement followed a response to one designated stimulus. Throughout the ratio, the birds responded mainly to the designated stimulus. The relatively few responses to the other stimuli usually occurred immediately after postreinforcement pauses. The distribution of responses to the various stimuli was not affected by omitting reinforcements.     

Alternative fixed-ratio fixed-interval schedules of reinforcement

Five rats were trained under alternative fixed-ratio fixed-interval schedules, in which food reinforcement was provided for the completion of either a fixed-ratio or a fixed-interval requirement, whichever was met first. Overall response rate and running rate (the rate of responding after the postreinforcement pause) decreased for all subjects as the fixed-ratio value increased. As the proportion of reinforcements obtained from the fixed-ratio component increased and the alternative schedule approached a simple fixed ratio, overall response rate and running rate both increased; conversely, as the proportion of reinforcements obtained from the fixed-interval component increased and the alternative schedule approached a simple fixed interval, response rates decreased. Postreinforcement pause length increased linearly as the average time between reinforcements increased, regardless of the schedule parameters. A break-run pattern of responding was predominant at low- and medium-valued fixed ratios. All subjects displayed at least occasional positively accelerated responding within interreinforcement intervals at higher fixed-ratio values.     

Partial negative reinforcement: fixed-ratio escape

Rats were unable to sustain performance when eight bar-presses turned off shock (−FR 8). In a second experiment, thirsty rats were able to maintain a moderate response rate when performance on −FR 8 was also reinforced with water. Some rats continued to bar-press on −FR 8 after withdrawal of positive reinforcement, but at a much lower rate. A possible explanation of the results is that during intermittent escape conditioning in a free-responding situation the absence of shock itself acquires aversive properties.     

Delayed reinforcement of fixed-ratio performance without mediating exteroceptive conditioned reinforcement

The performance of pigeons was studied under conditions in which the completion of a fixed-ratio requirement was not contiguous with the presentation of a reinforcer. Timein and timeout periods alternated throughout the experimental sessions. Responses made by an experimental bird during the timein period were accumulated, and when a fixed-ratio requirement had been met, grain was presented to the experimental bird and a yoked control following their first response in the next timein period. Across most manipulations of the fixed-ratio requirement and of the duration of the timeout period, the response rates of the experimental birds were considerably higher than those of their controls, suggesting that the response-reinforcer dependency controlled the behavior of the experimental bird in the absence of a close temporal association between responding on the ratio schedule and reinforcer presentations.     

Effects of pentobarbital on fixed-ratio reinforcement,

Certain doses of pentobarbital consistently increased the rate of pecking engendered by a fixed-ratio schedule of 30 responses in a group of 13 pigeons, and still higher doses produced decrements in rate of responding. For individual subjects, the dose-effect functions were qualitatively similar, but differed with respect to the doses producing the maximum increase and subsequent decrease in rate. In general, the maximum occurred at lower doses and the decrement was greater at the highest dose in the birds with the highest control rates. It was also possible to distinguish between the effects of pentobarbital and several other drugs on the behavior maintained by FR 30. The results indicate that changes in rate of responding on FR 30 after drug administration are dose-dependent, drug-specific effects.     

Percentage reinforcement of fixed-ratio and variable-interval performances

Twenty to seventy per cent of the reinforcements scheduled for pigeons' fixed-ratio 80 performances were replaced by a 4-sec timeout. Pauses after reinforced ratios were unchanged at 80% reinforcement, but were lengthened at lower reinforcement percentages. Pauses after nonreinforced ratios were shorter than post-reinforcement pauses. When 50% of the reinforcements arranged by a variable-interval 60-sec schedule were replaced by a 4-sec timeout, pauses after reinforcement omission increased. Both frustrative nonreward and reinforcement aftereffects notions can explain the fixed-ratio results; neither easily explains the variable-interval data.     

Effects of reinforcement magnitude on pigeons' preference for different fixed-ratio schedules of reinforcement

In concurrent, two-member chains, the completion of one or the other of two initial percentage fixed-interval 90-sec links produced a terminal link in which the completion of a fixed ratio produced food reinforcement. The fixed ratios and the duration of reinforcement in the terminal links were varied. Relative response rate in initial links was proportional to the relative reinforcement duration per ratio response (reinforcement duration divided by fixed ratio) in terminal links. The rate of responding in the terminal fixed-ratio links was insensitive to both ratio size and reinforcement duration and therefore did not vary sufficiently to distinguish between responses per reinforcement and immediacy of reinforcement as controlling variables in terminal links.     

Stimulus functions in some chained fixed-ratio schedules of reinforcement

For two pigeons, behavior was compared in equivalent two-link chained and tandem schedules in which 100 responses were required for food reinforcement but the responses required in the two links of the chained schedule were varied over the values 2-98, 50-50, and 98-2. Initial pausing, response rate in each link, and the total time to complete each ratio were recorded. In chained components, initial-link pausing (for both birds) and total time to complete the ratio (for one bird) were generally shorter when the response requirement was 2-98 than when it was 50-50 or 98-2; for terminal-link pausing this relationship was reversed for both birds. There were also systematic changes in behavior in tandem components, and in the relationship between behavior in chained and tandem components. The results are discussed in terms of conditioned reinforcement.     

Septal lesions lower responding under fixed-ratio schedules of reinforcement.

Albino Sprague-Dawley rats with complete septal lesions and rats with control operations were studied under fixed-ratio (FR) schedules of reinforcement. Both groups were trained for 10 sessions each under FR 10, 20, 40, 60, 80, and 100. In contrast to findings from progressive FR studies and some simple FR studies, septal lesions resulted in lower overall and local response rates along with longer postreinforcement pauses. These effects were especially evident during the FR 100 schedule of reinforcement. A comparison of reinforcement rate as a function of FR size within the context of behavioral economics (i.e., a demand function) indicated that septal lesions did not alter the reward value of food. These findings suggest that responding on FR schedules of reinforcement can be altered by the various procedures used to train rats to reach the terminal value of a reinforcement schedule.     

Induced attack during multiple fixed-ratio, variable-ratio schedules of reinforcement

Two pigeons were exposed to a multiple schedule of reinforcement: in the presence of one discriminative stimulus, key pecks produced grain according to a fixed-ratio schedule; in the presence of a second discriminative stimulus, key pecks produced grain according to a variable-ratio schedule. The key-peck requirements in the two components were increased in successive stages from 50 to 125 responses. Live target pigeons were restrained at the rear of the chamber. Attacks against the targets were automatically recorded, and a variety of measures of attack behavior were taken. Attacks, when they occurred, always followed grain presentation. All measures revealed higher levels of attack during the fixed-ratio component at all parameter values. All measures generally increased with increases in fixed-ratio values with both birds, and with increases in variable-ratio values with one bird. With the other bird, only the per cent of reinforcements followed by attack increased with increases in variable-ratio value; all other measures first increased and then decreased. Both increasing and bitonic functions relating induced attack to schedule parameters have been reported in experiments usually employing a single measure of attack. The measures have varied widely among these experiments. It is suggested that further studies of induced attack examine a wider range of schedule parameters and that relationships among measures be studied.     

Continuous, fixed-ratio, and fixed-interval reinforcement in honey bees

Bees learned to enter a Plexiglas tube and to suck small portions of sugar solution; every entry or every fifth entry was reinforced. During an extinction phase, the bees on the fixed-ratio schedule emitted twice as many responses as did those given continuous reinforcement. Bees on a fixed-interval schedule of reinforcement emitted lower response rates than did those given fixed-ratio reinforcement. By extending the conditioning procedure for several days, it was possible to maintain responding with fixed-ratio schedules requiring 30 responses per reinforcement and with fixed-interval values up to 90 sec. Under fixed-interval schedules, response rates did not increase toward the end of the reinforcement intervals.     

The effect of reinforcement magnitude upon responding under fixed-ratio schedules

Responding under fixed-ratio schedules was studied as a function of two durations of food presentation. Latency of the first response after food presentation (post-reinforcement pause) was consistently shorter when food was presented for the longer duration. Only one of the four pigeons studied showed a consistently higher response rate, exclusive of post-reinforcement pause, as a function of the longer access to food. When ratio size was reduced, pause durations decreased, and the differences related to the two durations of food presentations became progressively smaller.     

Neurochemical changes correlated with behavior maintained under fixed-interval and fixed-ratio schedules of reinforcement.

Key pecking of 4 pigeons was maintained under a multiple 3-min fixed-interval, 30-response fixed-ratio schedule of food presentation. Only one schedule was in effect during an experimental session, and each was correlated with a different keylight stimulus and location (left vs. right). The different schedule components alternated across days or weeks. Cerebrospinal fluid was collected from chronically implanted intracerebroventricular cannulae following sessions with the different schedules, as well as following sessions in which reinforcement was withheld (extinction), when response-independent food was delivered, and when the experimental chamber was dark and there were no scheduled events. Metabolites of the neurotransmitters serotonin, norepinephrine, and dopamine were assayed in cerebrospinal fluid using high-performance liquid chromatography with electrochemical detection. Compared to the fixed-ratio condition, responding maintained under the fixed-interval schedule resulted in consistently higher levels of the serotonin metabolite 5-hydroxyindoleacetic acid and of the dopamine metabolite homovanillic acid in all pigeons. Levels of 3-methoxy-4-hydroxyphenylethylene glycol, a metabolite of norepinephrine, and dihydroxyphenylacetic acid, another dopamine metabolite, were also higher in 3 of the 4 pigeons following exposure to the fixed-interval schedules when compared to levels of these metabolites after exposure to the fixed-ratio schedule. Extinction of fixed-ratio responding resulted in large increases in 5-hydroxyindoleacetic acid compared to levels of this metabolite under the fixed-ratio schedule, whereas this serotonin metabolite decreased during extinction of responding under the fixed-interval schedule. Control procedures suggested that the neurochemical changes were not related to the rate of responding but were a function of the specific experimental conditions. Distinctive neurochemical changes that accompany schedule-controlled responding show the sensitivity of the neurochemical environment to behavioral contingencies and demonstrate further the profound impact that such contingencies have on biobehavioral processes.     

Variability of response location on fixed-ratio and fixed-interval schedules of reinforcement

Variability of response location was studied in monkeys performing in a six-lever chamber. Fixed-ratio schedules, ranging from FR 1 to FR 300, generated a high degree of stereotypy of response location. In contrast, fixed-interval schedules of comparable reinforcement frequencies (0.06 to 4 minutes) generated much greater variability. These results failed to confirm any simple relationship between response variability and intermittence of reinforcement. Rather, variability seems to be determined by the particular characteristics of the reinforcement schedule.     

Color alternation learning in the pigeon under fixed-ratio schedules of reinforcement

Pigeons were trained on a non-spatial delayed alternation task in which the correct stimulus was that color not responded to on the preceding trial. Subjects required to emit either 15 or 30 pecks to the correct stimulus within a trial learned the task, those required to emit only one or five pecks did not. Also, alternation was learned more easily after an incorrect than after a correct trial. Later experiments showed that a minimum fixed-ratio value was required for successful color alternation to occur, even though no fixed-ratio requirement was necessary when a position cue was available. The mechanism of the fixed-ratio effects derived from the pigeons' tendency to repeat their response in the presence of the color reinforced on the last trial. Whereas subjects trained on larger fixed-ratios corrected this error tendency within a trial, subjects trained on smaller fixed ratios did not.