Matching, contrast, and equalizing in the concurrent lever-press responding of rats

Five rats pressed levers for food reinforces delivered by several concurrent variable-interval variable-interval schedules. The rate of reinforcement available for responding on one component schedule was held constant at 60 reinforcers per hour. The rate of reinforcement available for responding on the other schedule varied from 30 to 240 reinforcers per hour. The behavior of the rats resembled the behavior of pigeons pecking keys for food reinforcers. The ratio of the overall rates of responding emitted under, and the ratio of the time spent responding under, the two components of each concurrent schedule were approximately equal to the ratio of the overall rates of reinforcement obtained from the components. The overall rate of responding emitted under, and the time spent responding under, the variable component schedule varied directly with the overall rate of reinforcement from that schedule. The overall rate of responding emitted under, and the time spent responding under, the constant component schedule varied inversely with the overall rate of reinforcement obtained from the variable component. The local rates of responding emitted under, and the local rates of reinforcement obtained from, the two components did not differ consistently across subjects. But they were not exactly equal either.     

Homogeneous chains, heterogeneous chains, and delay of reinforcement

Three pigeons responded on two-component chain schedules in which the required response topography in the initial and terminal links was similar (a homogeneous chain) or dissimilar (a heterogeneous chain). Key-peck responding in the initial link under a variable-interval 60-second (VI 60) schedule produced a terminal link in which, in different conditions, either key pecking or foot treadling was reinforced according to a VI 60 schedule. Multiple VI 60 VI 60 schedules, in which the responses required in the chain schedules were maintained by primary reinforcement in the two components, preceded and followed each type of chain. These multiple schedules were used to ensure that both responses occurred reliably prior to introducing the chain schedule. Key-peck response rates in the initial link of the chain consistently were higher during the homogeneous chain than during the heterogeneous chain. These results illustrate that intervening events during a period separating an operant response from primary reinforcement influence that operant, independently of the delay between the response and reinforcement.     

Operant and nonoperant vocal responding in the mynah: Complex schedule control and deprivation-induced responding

Several recent studies have been concerned with operant responses that are also affected by nonoperant factors, (e.g., biological constraints, innate behavior patterns, respondent processes). The major reason for studying mynah vocal responding concerned the special relation of avian vocalizations to nonoperant emotional and reflexive systems. The research strategy was to evaluate operant and nonoperant control by comparing the schedule control obtained with the vocal response to that characteristic of the motor responses of other animals. We selected single, multiple, and chain schedules that ordinarily produce disparate response rates at predictable times. In multiple schedules with one component where vocal responding (“Awk”) was reinforced with food (fixed-ratio or fixed-interval schedule) and one where the absence of vocal responding was reinforced (differential reinforcement of other behavior), response rates never exceeded 15 responses per minute, but clear schedule differences developed in response rate and pause time. Nonoperant vocal responding was evident when responding endured across 50 extinction sessions at 25% to 40% of the rate during reinforcement. The “enduring extinction responding” was largely deprivation induced, because the operant-level of naive mynahs under food deprivation was comparable in magnitude, but without deprivation the operant level was much lower. Food deprivation can induce vocal responding, but the relatively precise schedule control indicated that operant contingencies predominate when they are introduced.     

Effect of punishment on human variable-interval performance

Three female human subjects pressed a button for monetary reinforcement in a range of variable-interval schedules specifying different frequencies of reinforcement. On alternate days, responding was also punished (by subtracting money) according to a variable-ratio 34 schedule. In the absence of punishment, rate of responding was an increasing negatively accelerated function of reinforcement frequency; the relationship between response rate and reinforcement frequency conformed to Herrnstein's equation. The effect of the punishment schedule was to suppress responding at all frequencies of reinforcement. This was reflected in a change in the values of both constants in Herrnstein's equation: the value of the theoretical maximum response-rate parameter was reduced, while the parameter describing the reinforcement frequency corresponding to the half-maximal response rate was increased.     

The effect of punishment on free-operant choice behavior in humans

During Phase I, three female human subjects pressed a button for monetary reinforcement in five variable-interval schedules specifying different frequencies of reinforcement. On alternate days, responding was also punished (by subtracting money) according to a variable-ratio 34 schedule. In the absence of punishment, response rates conformed to Herrnstein's equation for single variable-interval schedules. Punishment suppressed responding at all frequencies of reinforcement. This was reflected in a change in the values of both constants in Herrnstein's equation: the value of the theoretical maximum response-rate parameter was reduced, and the parameter describing the reinforcement frequency corresponding to the half-maximal response rate was elevated. During Phase II, the same five schedules (A) were in operation (without punishment), but in addition, a concurrent variable-interval schedule (B) of standard reinforcement frequency was introduced. On alternate days, responding in Component B was punished according to a variable-ratio 34 schedule. In the absence of punishment, absolute response rates conformed to equations proposed by Herrnstein to describe performance in concurrent schedules; the ratios of the response rates in the two components and the ratios of the times spent in the two components conformed to the Matching Law. When responding in Component B was punished, response rates in Component B were reduced and those in Component A were elevated, these changes being reflected in distortions of the matching relationship.     

Response-dependent point loss and response force as disrupting operations on behavioral resistance to change in humans

Behavioral momentum theory (BMT) provides a theoretical and methodological framework for understanding how differentially maintained operant responding resists disruption. A common way to test operant resistance involves contingencies with suppressive effects, such as extinction or prefeeding. Other contingencies with known suppressive effects, such as response-cost procedures arranged as point-loss or increases in response force, remain untested as disruptive events within the BMT framework. In the present set of three experiments, responding of humans was maintained by point accumulation programmed according to a multiple variable-interval (VI) VI schedule with different reinforcement rates in either of two components. Subsequently, subtracting a point following each response (Experiment 1) or increasing the force required for the response to be registered (Experiments 2 and 3 decreased response rates, but responding was less disrupted in the component associated with the higher reinforcement rate. The point-loss contingency and increased response force similarly affected response rates by suppressing responding and human persistence, replicating previous findings with humans and nonhuman animals when other types of disruptive events (e.g., extinction and prefeeding) were investigated. The present findings moreover extend the generality of the effects of reinforcement rate on persistence, and thus BMT, extending the analysis of resistance to two well-known manipulations used to reduce responding in the experimental analysis of behavior.     

Successive discrimination training with equated reinforcement frequencies: failure to obtain behavioral contrast

In two experiments, pigeons were trained on two-component multiple schedules in which responding in one component (S₁) was always maintained by a variable-interval schedule. In Experiment I, low response rates were reinforced in the second (S₂) component for six master subjects. This schedule was adjusted to equate reinforcement frequencies in the two components. These subjects were compared to yoked partners, for which reinforcement in the S₂ component was made available on a variable-interval schedule whose value was determined by the master subjects. A similar procedure was used in Experiment II, where the S₂ schedule for master subjects made reinforcers contingent on the absence of responding. No evidence was found in either experiment for a behavioral contrast effect in the S₁ component attributable to response reduction in the S₂ component. A reliable contrast effect was obtained from a group of pigeons given extinction conditions in the S₂ component, which was compared to a group maintained throughout on a multiple variable-interval schedule. The results suggest that previous indications of behavioral contrast in similar situations were probably caused by uneven reinforcement distributions or reflect uncontrolled fluctuations in response rates.     

Schedule control of the vocal behavior of Cebus monkeys

The vocal behavior of three Cebus monkeys was maintained by fixed-ratio schedules of response dependent reinforcement at values between fixed-ratio 1 and fixed-ratio 15. In one monkey that was exposed to variable-interval, fixed-interval, and conjunctive fixed-ratio fixed-interval schedules of reinforcement, vocal responding occurred at a low rate, but schedule-appropriate patterns were maintained. The rates and patterns of responding engendered indicated that the vocal operant can be brought under schedule control in the monkey by the use of response-dependent reinforcement.     

Economic and biological influences on key pecking and treadle pressing in pigeons

Pigeons were studied on a two-component multiple schedule in which the required operant was, in different conditions, biologically relevant (i.e., key pecking) or nonbiologically relevant (i.e., treadle pressing). Responding was reinforced on a variable-interval (VI) 2-min schedule in both components. In separate phases, additional food was delivered on a variable-time (VT) 15-s schedule (response independent) or a VI 15-s schedule (response dependent) in one of the components. The addition of response-independent food had different effects on responding depending on the operant response and on the frequency with which the components alternated. When components alternated frequently (every 10 s), all pigeons keypecked at a much higher rate during the component with the additional food deliveries, whether response dependent or independent. In comparison, treadle pressing was elevated only when the additional food was response dependent; rate of treadling was lower when the additional food was response independent. When components alternated infrequently (every 20 min), pigeons key pecked at high rates at points of transition into the component with the additional food deliveries. Rate of key pecking decreased with time spent in the 20-min component when the additional food was response independent, whereas rate of pecking remained elevated in that component when the additional food was response dependent. Under otherwise identical test conditions, rate of treadle pressing varied only as a function of its relative rate of response-dependent reinforcement. Delivery of response-independent food thus had different, but predictable, effects on responding depending on which operant was being studied, suggesting that animal-learning procedures can be integrated with biological considerations without the need to propose constraints that limit general laws of learning.     

Performance of humans in variable-interval avoidance schedules programmed singly, and concurrently with variable-interval schedules of positive reinforcement

Performance maintained under single variable-interval avoidance schedules, single variable-interval schedules of positive reinforcement, and concurrent schedules consisting of a variable-interval avoidance component and a variable-interval positive reinforcement component, was studied in three human subjects, using points exchangeable for money as the reinforcer. Response rate in the single variable-interval avoidance schedules was an increasing function of the frequency of monetary loss avoidance. Response rate in the single variable-interval positive reinforcement schedules was an increasing function of the frequency of obtained monetary reinforcement. In the concurrent avoidance/reinforcement schedules, the rate of responding in the avoidance component increased, and the rate of responding in the positive reinforcement schedule decreased (with one exception) as a function of the frequency of loss avoidance in the avoidance component. The logarithms of the ratios of the response rates in the two components, and the logarithms of the ratios of the times spent in the two components, were linearly related to the logarithms of the ratios of the frequency of loss avoidance in the avoidance component to the frequency of reinforcement in the positive reinforcement component. All three subjects exhibited marked undermatching of response rate ratios to reinforcement frequency ratios. The results are discussed in the context of Herrnstein's quantitative model of operant performance.     

Behavior of humans in variable-interval schedules of reinforcement

During Phase I, human subjects pressed a button for monetary reinforcement in five variable-interval schedules, each of which specified a different frequency of reinforcement. The rate of responding was an increasing, negatively accelerated function of reinforcement frequency; the data conformed closely to Herrnstein's equation. During Phase II, the same five schedules were in operation, but in addition a concurrent variable-interval schedule (B) was introduced, responses on which were always reinforced at the same frequency. Response rate in component A increased while the response rate in B decreased, as a function of the reinforcement frequency in component A. Relative response rates in the two component schedules matched the relative frequencies of reinforcement. Comparing the absolute response rates in component A during Phase I and Phase II it was found that introduction of the concurrent schedule did not affect the value of the theoretical maximum response rate, but did increase the value of the reinforcement frequency needed to obtain any particular submaximal response rate.     

Response-rate differences in variable-interval and variable-ratio schedules: An old problem revisited

In Experiment 1, a variable-ratio 10 schedule became, successively, a variable-interval schedule with only the minimum interreinforcement intervals yoked to the variable ratio, or a variable-interval schedule with both interreinforcement intervals and reinforced interresponse times yoked to the variable ratio. Response rates in the variable-interval schedule with both interreinforcement interval and reinforced interresponse time yoking fell between the higher rates maintained by the variable-ratio schedule and the lower rates maintained by the variable-interval schedule with only interreinforcement interval yoking. In Experiment 2, a tandem variable-interval 15-s variable-ratio 5 schedule became a yoked tandem variable-ratio 5 variable-interval x-s schedule, and a tandem variable-interval 30-s variable-ratio 10 schedule became a yoked tandem variable-ratio 10 variable-interval x-s schedule. In the yoked tandem schedules, the minimum interreinforcement intervals in the variable-interval components were those that equated overall interreinforcement times in the two phases. Response rates did not decline in the yoked schedules even when the reinforced interresponse times became longer. Experiment 1 suggests that both reinforced interresponse times and response rate–reinforcement rate correlations determine response-rate differences in variable-ratio 10 and yoked variable-interval schedules in rats. Experiment 2 suggests a minimal role for the reinforced interresponse time in determining response rates on tandem variable-interval 30-s variable-ratio 10 and yoked tandem variable-ratio 10 variable-interval x-s schedules in rats.     

Effect of variable-interval punishment on the behavior of humans in variable-interval schedules of monetary reinforcement

One male and three female human subjects pressed a button for monetary reinforcement under a range of variable-interval schedules specifying different frequencies of reinforcement. On alternate days, responding was also punished (by subtraction of money) according to a variable-interval 170-second schedule. In the absence of punishment, the rate of responding was an increasing negatively accelerated function of reinforcement frequency, as predicted by Herrnstein's equation. The effect of the punishment schedule was to suppress responding under lower frequencies of reinforcement; responding under higher reinforcement frequencies was much less affected. This was reflected in an increase in the value of K_H (the constant expressing the reinforcement frequency corresponding to the half-maximal response rate), whereas there was no significant change in the value of R_max (the constant expressing the maximum response rate). Previous results had shown that variable-ratio punishment resulted in a change in the values of both constants (Bradshaw, Szabadi, and Bevan, 1977). The results of the present study were consistent with the concept that the suppressive effects of punishment on responding depend on the nature of the punishment schedule.     

Concurrent performances: rate and accuracy of free-operant oddity responding

In pigeon's oddity performances, maintained by variable-interval reinforcement of pecks on the odd key of three keys in a triangular array, accuracy and response rate varied inversely with the rate of variable-interval reinforcement scheduled concurrently for pecks on a fourth, spatially isolated key. But when variable-interval and extinction components alternated in a multiple schedule for pecks on the spatially isolated key, oddity accuracy was greater during variable-interval components than during extinction components. Oddity response rate was not affected systematically by the alternating components. Changeovers between the oddity keys and the spatially isolated key were frequent during variable-interval components; responding occurred almost exclusively on the oddity keys during extinction components. This difference in performance during the two components was eliminated by arranging stimulus-correlated variable-interval reinforcement in the multiple schedule on the spatially isolated key: a stimulus was presented in the variable-interval components only when reinforcement became available, thereby reducing responding on this key to near-zero levels in both components while maintaining the variable-interval reinforcement. The effect of the multiple-schedule components on oddity accuracy was not altered, however, and thus apparently depended directly on concurrent reinforcement and not on differential sequential properties of concurrent responding during the two components.     

Within-session Response Patterns On Conjoint Variable-interval Variable-time Schedules

Operant responding often changes within sessions, even when factors such as rate of reinforcement remain constant. The present study was designed to determine whether within-session response patterns are determined by the total number of reinforcers delivered during the session or only by the reinforcers earned by the operant response. Four rats pressed a lever and 3 pigeons pecked a key for food reinforcers delivered by a conjoint variable-interval variable-time schedule. The overall rate of reinforcement of the conjoint schedule varied across conditions from 15 to 480 reinforcers per hour. When fewer than 120 reinforcers were delivered per hour, the within-session patterns of responding on conjoint schedules were similar to those previously observed when subjects received the same total number of reinforcers by responding on simple variable-interval schedules. Response patterns were less similar to those observed on simple variable-interval schedules when the overall rate of reinforcement exceeded 120 reinforcers per hour. These results suggest that response-independent reinforcers can affect the within-session pattern of responding on a response-dependent schedule. The results are incompatible with a response-based explanation of within-session changes in responding (e.g., fatigue), but are consistent with both reinforcer-based (e.g., satiation) and stimulus-based (e.g., habituation) explanations.     

Positive interaction (induction) in multiple variable-interval, differential-reinforcement-of-high-rate schedules

The effect of increases in the rate of responding in one component of a multiple schedule upon the rate of responding in a second component was investigated. Pigeons were exposed to a multiple schedule where both components were initially variable-interval schedules having the same parameter value. After rate of key pecking stabilized, one component was changed to a schedule that differentially reinforced high rates of responding. Rate of reinforcement in this varied component was adjusted to remain equal to rate of reinforcement in the constant (variable-interval) component. Four of five pigeons showed a maintained increase in rate of responding during both the constant and varied components, even though rates of reinforcement did not change.     

Response rate, reinforcement frequency, and behavioral contrast

Pigeons responded for food on a multiple schedule in which periods of green-key illumination alternated with periods of red-key illumination. When behavior had stabilized with a variable-interval 2-min schedule of reinforcement operating during both stimuli, low rates of responding (interresponse times greater than 2 sec) were differentially reinforced during the green component. Conditions during the red stimulus were unchanged. Response rates during the green component fell without changing the frequency of reinforcement but there were no unequivocal contrast effects during the red stimulus. The frequency of reinforcement during the green component was then reduced by changing to a variable-interval 8-min schedule without reducing the response rates in that component, which were held at a low level by the spacing requirement. Again, the conditions during the red stimulus were unchanged but response rates during that stimulus increased. These results show that reductions in reinforcement frequency, independently of response rate, can produce interactions in multiple schedules.     

Negative behavioral contrast on multiple treadle-press schedules

Eight pigeons pressed treadles for food reinforcers delivered by several multiple variable-interval schedules. The rate of reinforcement for responding during one component schedule was held constant at 30 reinforcers per hour. The rate of reinforcement for responding during the other component varied from 0 to 120 or 240 reinforcers per hour. The schedules were presented in different orders for different subjects. The rate of responding emitted during the variable component schedule varied directly with the rate of reinforcement it provided. The rate of responding during the constant component did not increase consistently when the rate of reinforcement obtained from the variable component decreased from 30 to 0 reinforcers per hr. The rate of responding emitted during the constant component decreased when the rate of reinforcement obtained from the variable component increased from 30 reinforcers per hour to a higher rate. That is, negative but not positive behavioral contrast occurred. The failure to find positive contrast is consistent with one of the predictions of the additive theories of behavioral contrast. Finding negative contrast has ambiguous implications for the additive theories.     

Performances on ratio and interval schedules of reinforcement: Data and theory

Two differences between ratio and interval performance are well known: (a) Higher rates occur on ratio schedules, and (b) ratio schedules are unable to maintain responding at low rates of reinforcement (ratio “strain”). A third phenomenon, a downturn in response rate at the highest rates of reinforcement, is well documented for ratio schedules and is predicted for interval schedules. Pigeons were exposed to multiple variable-ratio variable-interval schedules in which the intervals generated in the variable-ratio component were programmed in the variable-interval component, thereby “yoking” or approximately matching reinforcement in the two components. The full range of ratio performances was studied, from strained to continuous reinforcement. In addition to the expected phenomena, a new phenomenon was observed: an upturn in variable-interval response rate in the midrange of rates of reinforcement that brought response rates on the two schedules to equality before the downturn at the highest rates of reinforcement. When the average response rate was corrected by eliminating pausing after reinforcement, the downturn in response rate vanished, leaving a strictly monotonic performance curve. This apparent functional independence of the postreinforcement pause and the qualitative shift in response implied by the upturn in variable-interval response rate suggest that theoretical accounts will require thinking of behavior as partitioned among at least three categories, and probably four: postreinforcement activity, other unprogrammed activity, ratio-typical operant behavior, and interval-typical operant behavior.     

The effects of brief stimuli presented under a multiple schedule of second-order schedules

The effects of briefly presented stimuli paired or not paired with food reinforcement were investigated in the pigeon on a multiple schedule containing second-order schedules. A stimulus paired with food reinforcement was presented on a variable-interval schedule in one unit of the multiple schedule and either a stimulus not paired with food reinforcement or no stimuli were scheduled in the other unit. Response rates were highest when behavior was followed by the food-paired stimulus. Presentation of the food-paired stimulus at completion of each 1-min variable-interval component maintained a steady rate of responding between consecutive food presentations. Pausing following food reinforcement was greatest in the second-order schedule not containing the paired stimulus. Reversing the stimulus pairings led to a reversal of the relative response rates and patterns of responding for each stimulus.