Force and rate relations in responding during variable-interval reinforcement

Four rats responded on one-minute variable-interval schedules with several variations in peak-force of response required for food reinforcement. Measures of peak force and rate were taken for the responses, which were the downward exertions of force against a static force-transducing operandum. The analysis distinguished responses, a generic class of measured behavior, from criterion responses, an operationally specified subclass required for reinforcement. Absolute rate of response showed no systematic change, but the rate of responses meeting a newly required criterion of peak-force invariably increased through changes in the absolute rate of response, the relative-frequency distributions of peak force, or some combination of both. The relative frequency of responses meeting an elevated force criterion during variable-interval reinforcement exceeded that maintained with the same criterion with continuous reinforcement. The requirement of more effortful responding for reinforcement does not necessarily reduce response rate. Conformity of the behavior to the requirement for reinforcement is the salient effect.     

Food deliveries during the pause on fixed-interval schedules

Pigeons were trained on fixed-interval schedules of food delivery. In Experiments I and II, the fixed interval was initiated by the previous fixed-interval reinforcer; in Experiment III, the fixed interval was initiated by the first key peck following the preceding fixed-interval reinforcer (a chain fixed-ratio one, fixed-interval schedule). During the postreinforcement pause, variable-time schedules delivered food independent of any specific response. Rate of food delivery during the pause had only small effects on pause duration in Experiments I and II. In Experiment III, however, pause duration increased systematically with the rate of food delivery during the pause. These data suggest that the momentary proximity to reinforcement delivered via the fixed-interval schedule exerts potent control over pause termination. Additional analysis revealed that pause termination was unaffected by the intermittent delivery of food during the pause. Such data suggest that the temporal control by fixed-interval schedules is highly resistant to interference.     

Positive reinforcement and the elimination of reinforced responses

Key pecking was maintained on a fixed-interval schedule while either a differential-reinforcement-of-not-responding or a fixed-time schedule was imposed simultaneously. The lower the time parameter of the not-responding schedule, the lower was the response rate. Similar effects occurred with the fixed-time schedule, if the pigeons had experience with reinforcement for not responding. Otherwise the effects were less orderly, to the extent that rate could reach maximum with the lowest-valued fixed-time schedule. The not-responding and the response-independent schedules had similar effects on rate in experienced pigeons only when the time parameter or nominal frequency of food presentation was considered. When considered in terms of obtained frequency of food presentation, reinforcement of not responding produced larger decrements in rate than did the fixed-time schedule.     

Behavioral contrast as a function of the temporal location of reinforcement

Pigeons were trained on a multiple variable-interval variable-interval schedule of reinforcement. One component was then changed to a variation of a fixed-interval schedule in which the same rate of reinforcement was obtained as previously but the location of the reinforcer was fixed within the component. The effects of different temporal locations were compared. An increase in response rate for the unchanged variable-interval component (behavioral contrast) occurred when the reinforcer was located in the middle or at the end of the FI component, but response suppression occurred when it was located at the beginning of the component. The pattern of results cannot be explained by any previous theories of contrast. The overall response rates, and the pattern of local rates within the components, were consistent with the hypothesis that the major determinant of the contrast effect was the transition to a lower reinforcement rate following the unchanged component.     

Interactions in multiple schedules: the role of the stimulus-reinforcer contingency

In Experiments I and II, pigeons were exposed to single-key multiple schedules of response-independent and -dependent food presentation. Components were correlated with different keylights. When the rate of food presentation in the first component exceeded that in the second component, the local rate of key pecking was relatively high at onset of the first component. Overall rate in that component varied inversely with component duration and the rate of food presentation in the second component. When responding was maintained in the second component, the local rate of key pecking was relatively low at onset of that component. Overall rate in the second component varied directly with component duration and the rate of food presentation in that component. In Experiment III, pigeons were exposed to a two-key multiple schedule. Pecks on a constantly illuminated key produced food. Components were correlated with the color of a second key on which pecks had no scheduled consequences. The effects of component duration and rate of food presentation under the single-key response-dependent schedule were synthesized by combining response rates on each concurrently available key under the two-key procedure. The results support an account of multiple-schedule interactions in terms of the joint influence on responding of stimulus-reinforcer and response-reinforcer contingencies.     

Stimulus control of differential-reinforcement-of-low-rate responding

Five pigeons were given single-stimulus training on an 8-sec differential-reinforcement-of-low-rate schedule followed by steady-state generalization training using 12 wavelength stimuli. Three birds had a high percentage of reinforced responses on the training schedule and flat generalization gradients of total responses. The birds with fewer reinforced responses had much steeper generalization gradients. Generalization gradients plotted as a function of both stimulus wavelength and interresponse time showed that for most birds, stimulus control was restricted to responses with long interresponse times. Responses with very short interresponse times were not under stimulus control and there was some evidence of inhibitory control of short interresponse times. Interresponse-times-per-opportunity functions, plotted as a function of stimulus wavelength, showed that stimulus wavelength controlled the temporal distribution of responses, rather than the overall rate of response. The data indicate that the differential-reinforcement-of-low-rate schedule generates several response categories that are controlled in different ways by wavelength and time-correlated stimuli, and that averaging responses regardless of interresponse-time length obscures this control.     

Alternative response training, differential reinforcement of other behavior, and extinction in squirrel monkeys (Saimiri sciureus)

In Experiment I, (a) extinction, (b) extinction plus reinforcement of a discrete alternative response, and (c) differential reinforcement of other behavior were each correlated with a different stimulus in a three-component multiple schedule. The alternative-response procedure more rapidly and completely suppressed behavior than did differential reinforcement of other behavior. Differential reinforcement of other behavior was slightly more effective than extinction alone. In Experiment II, reinforcement of specific alternative behavior during extinction and differential reinforcement of other behavior were used in two components, while one component continued to provide reinforcement for the original response. Once again, the alternative-response procedure was most effective in reducing responding as long as it remained in effect. However, the responding partially recovered when reinforcement for competing behavior was discontinued. In general, responding was less readily reduced by differential reinforcement of other behavior than by the specific alternative-response procedure.     

Methodological improvements to a Procedure for Rapidly Establishing Steady-State Behavior

We performed three experiments to improve the quality and retention of data obtained from a Procedure for Rapidly Establishing Steady-State Behavior (PRESS-B; Klapes et al., 2020). In Experiment 1, 120 participants worked on nine concurrent random-interval random-interval (conc RI RI) schedules and were assigned to four conditions of varying changeover delay (COD) length. The 0.5-s COD condition group exhibited the fewest instances of exclusive reinforcer acquisition. Importantly, this group did not differ in generalized matching law (GML) fit quality from the other groups. In Experiment 2, 60 participants worked on nine conc RI RI schedules with a wider range of scheduled reinforcement rate ratios than was used in Experiment 1. Participants showed dramatic reductions in exclusive reinforcer acquisition. Experiment 3 entailed a replication of Experiment 2 wherein blackout periods were implemented between the schedule presentations and each schedule remained in operation until at least one reinforcer was acquired on each alternative. GML fit quality was slightly more consistent in Experiment 3 than in the previous experiments. Thus, these results suggest that future PRESS-B studies should implement a shorter COD, a wider and richer scheduled reinforcement rate ratio range, and brief blackouts between schedule presentations for optimal data quality and retention.     

Social preference in rats

Rats were given repeated choices between social and nonsocial outcomes, and between familiar and unfamiliar social outcomes. Lever presses on either of 2 levers in the middle chamber of a 3-chamber apparatus opened a door adjacent to the lever, permitting 45-s access to social interaction with the rat in the chosen side chamber. In Experiment 1, rats preferred (a) social over nonsocial options, choosing their cagemate rat over an empty chamber, and (b) an unfamiliar over a familiar rat, choosing a non-cagemate over their cagemate. These findings were replicated in Experiment 2 with 2 different non-cagemate rats. Rats preferred both non-cagemate rats to a similar degree when pitted against their cagemate, but were indifferent when the 2 non-cagemates were pitted against each other. Similar preference for social over nonsocial and non-cagemate over cagemate was seen in Experiment 3, with new non-cagemate rats introduced after every third session. Response rates (for both cagemate and non-cagemate rats) were elevated under conditions of nonsocial (isolated) housing compared to conditions of social (paired) housing, demonstrating a social deprivation effect. Together, the experiments contribute to an experimental analysis of social preference within a social reinforcement framework, drawing on methods with proven efficacy in the analysis of reinforcement more generally.     

The effects of negative reinforcement for irritable aggression on resident-intruder behavior

This experiment demonstrated that rats trained to display elevated levels of shock-induced aggression in a negative reinforcement paradigm displayed more boxing behavior than yoked control groups in a later test in which intruder rats were placed in the home cage of resident rats. Resident or intruder status did not affect the influence of the negative reinforcement procedure on the observed resident-intruder behavior of trained animals; however, naive intruders paired with trained residents displayed increased defensive behavior, suggesting that negative reinforcement for shock-induced aggression affected the behavior of these residents.