The effects of component duration on multiple-schedule performance in closed and open economies.

Pigeons responded on multiple variable-interval variable-interval schedules of reinforcement in an open and a closed economy. Equal duration components were increased in duration while the component rates of reinforcement were held constant, the component schedules were reversed, and component duration was decreased. In the open economy, daily sessions were limited to 1 hr, and subjects were maintained at 80% of their free-feeding weights through supplemental feeding when necessary in their home cages. In the closed economy, subjects were housed in their experimental chambers and no deprivation regimen was enforced. Relative response rate decreased as components were lengthened in the open economy, whereas in the closed economy relative rate increased as components were lengthened. Response proportions overmatched reinforcer proportions to a greater extent at long component durations in the closed economy, but there was no systematic effect of component duration on responding in the open economy.     

Leaving patches: Effects of travel requirements

Five pigeons were trained in an analogue foraging procedure in which, by completing a travel requirement, they entered a “patch” in which a reinforcer might be available after an unpredictable time. They also had the opportunity, by emitting a defined response, to exit the patch and travel to another patch. Prey availability in a patch was not signaled. Data were collected on the length of time that subjects stayed in patches before exiting (residence times) as a function of various travel requirements: travel for a fixed time in blackout, fixed-interval schedule traveling, fixed-time traveling with an added response required to terminate traveling, and fixed-ratio traveling. For each of these conditions, the required amount of travel (time or responses) was varied over a wide range. As previously reported, residence times increased with increases in fixed-time traveling, as they did with increasing fixed-interval or fixed-ratio traveling. There was no evidence that adding response or work requirements systematically affected residence time except via increased travel time, although 3 of the 5 birds stayed longer in a patch under higher fixed-ratio values. A “threshold-maximization” model described the data well with a single parameter that was consistent across subjects, procedures, and experiments.     

Responding on concurrent-chains schedules in open and closed economies.

Pigeons' key pecks were reinforced according to concurrent-chains schedules of reinforcement. The programmed average time from the onset of the initial links to a terminal link entry was held constant across conditions while the value of variable-interval schedules in the terminal links was varied. Performance was assessed under two economic conditions: (a) an open economy in which session duration was limited to 1 hr and subjects were maintained at 80% of their free-feeding body weights with postsession food when necessary; and (b) a closed economy in which sessions were 23.5 hr long and no deprivation regimen was in effect. In all cases, the relative rate of responding in the initial links matched the reduction in overall delay to primary reinforcement correlated with entry into one terminal link relative to the reduction in delay correlated with entry into the other terminal link. Although the sum of responses made in the initial links and terminal links was found to increase, then decrease, as the rate of food presentation decreased in the closed economy, there was no consistent effect of overall rate of food presentation on total responding in the open economy. The choice data suggest that relative delay reduction predicts choice accurately, regardless of economic context.     

Effects of body weight on discriminative-stimulus control by phencyclidine in the pigeon.

Using a color-tracking procedure with responses reinforced under a second-order schedule, the discriminative-stimulus properties of phencyclidine were studied in pigeons maintained at 70%, 80%, or 90% of their free-feeding weights. The generalization curves for phencyclidine were similar at all three body weights. Generalization curves for pentobarbital, d-amphetamine, and saline were also unrelated to body weight. These data suggest that food deprivation may not influence the discriminative-stimulus properties of drugs in the way that it influences the reinforcing-stimulus properties of drugs. The reason may be that during discrimination training interoceptive stimuli resulting from food deprivation do not become conditioned to the stimulus properties of the drug, because the food-deprivation stimuli are paired equally often with the presence and absence of drug stimuli.     

Variable-interval schedule performance in open and closed economies

In two experiments, pigeons obtained food according to variable-interval schedules. In the first experiment, equivalent variable-interval schedules with average interreinforcer intervals ranging between 10 and 80 s in different conditions were studied in both open and closed economies. Response rates increased as reinforcement frequency decreased in the closed economy. By contrast, in the open economy response rates decreased for 1 bird and were variable for the other as reinforcement frequency decreased. The second experiment showed that the differences in the functions between responding and reinforcement frequency in the two types of economies were not due to changes in deprivation level. These results suggest that open and closed economies yield different behavioral effects. This conclusion is supported further by a reconsideration of previous findings that appear counter to the conclusion.     

Performance in continuously available multiple schedules

Three pigeons were given continuous access in their home cages to food reinforcement on two-component multiple variable-interval variable-interval schedules. The reinforcer rates in the two components were varied over seven experimental conditions, and a partial replication over five conditions was arranged one year later. When component reinforcer rates were unequal, ratios of component response rates were more extreme than ratios of obtained component reinforcer rates, a result which in a generalized-matching analysis is termed overmatching. This finding contrasts sharply with results obtained when multiple schedules are arranged in shorter sessions, in which performance is characterized by undermatching when subjects are deprived of food, and by matching, or equality between component response- and reinforcer-rate ratios, when deprivation is minimal. More molecular data obtained in two subsequent conditions suggested that this finding did not reflect local fluctuations or asymmetries in deprivation. Theories of multiple-schedule performance that predict that matching cannot be exceeded are disconfirmed by the present results.     

Patterns of responding within sessions.

Rates of responding changed systematically across sessions for rats pressing levers and keys and for pigeons pressing treadles and pecking keys. A bitonic function in which response rates increased and then decreased across sessions was the most common finding, although an increase in responding also occurred alone. The change in response rate was usually large. The function relating responding to time in session had the following general characteristics: It appeared early in training, and further experience moved and reduced its peak; it was flatter for longer sessions; and it was flatter, more symmetrical, and peaked later for lower than for higher rates of reinforcement. Factors related to reinforcement exerted more control over the location of the peak rate of responding and the steepness of the decline in response rates than did factors related to responding. These within-session changes in response rates have fundamental theoretical and methodological implications.     

Effect of varying the duration of grain presentation on automaintenance

In a series of three experiments the effects of variation in grain duration on automaintenance were evaluated. In the first experiment, key illumination was followed by grain only when pigeons did not peck the key. Each subject was exposed to 2-, 4-, and 8-second feeder durations in blocks of 10 sessions. Subjects pecked on a high percentage of trials at all feeder durations. The mean peck latency was shorter in the 8-second condition than in the two other conditions in five of six subjects. The conditional probability of pecking given successive keylight-grain pairings did not increase as the number of pairings increased. The second experiment was identical to the first, except that key pecking had no scheduled consequence. Under these conditions, all three subjects showed substantial responding. The recorded measures showed no systematic relationship to feeder duration in this study. In the third experiment, two different stimuli were followed by feeder presentations of either identical (2- or 8-second) or different (2- and 8-second) durations within each session. Subjects tended to respond sooner and with a higher overall rate in the presence of the stimulus associated with the longer feeder duration only when different feeder durations were presented within the same session. This result was confirmed by direct observation of the pigeons. The results of these experiments suggest that the effects of varying grain duration may be small, compared to the effects of varying other variables. The results also suggest that the location as well as the frequency of pecking may be an important measure in the analysis of factors controlling the pigeon's key peck.     

Multiple schedule component duration: a reanalysis of Shimp and Wheatley (1971) and Todorov (1972)

The tendency for relative response rate to approach matching as multiple schedule component duration decreases has been interpreted as confirming a prediction of Herrnstein's multiple schedule equation. However, the equation predicts that absolute response rate will decrease in both multiple schedule components as component duration decreases. The absolute response-rate data of two studies of component duration do not support this prediction; absolute rate either increased or remained relatively constant.     

Psychophysics of key-peck duration in the pigeon

The duration of the pigeon's key peck was differentially reinforced in either a trials or a free-operant procedure. Mean emitted peck duration was a power function of the duration required for food delivery to occur. The exponents of the power function differed considerably from those observed in earlier research involving longer duration responses in pigeons and other species. The coefficients of variation also did not correspond with those of the earlier research on other responses, nor did consideration of the durations actually reinforced resolve the differences. Duration was neither a function of response rate nor of intermittency of reinforcement. Key-peck duration was changed in an orderly way by differential reinforcement. However, it appeared to be more strongly determined by its duration in the absence of differential reinforcement than were longer duration responses.     

Short-component multiple schedules: effects of relative reinforcement duration

Pigeons were exposed to multiple variable-interval 2-min variable-interval 2-min schedules of food presentation in which relative duration of food presentation was manipulated. When components alternated every 5 sec and were scheduled on separate response keys, relative response rates closely matched relative reinforcement duration in three of four pigeons. On the other hand, relative response rates were insensitive to relative reinforcement duration when components scheduled on a single response key alternated every 5 sec, and when components scheduled on separate response keys alternated every 2 min. Thus, both rapid alternation and spatial separation of components were necessary to produce approximate matching of relative responding to relative reinforcement duration. This finding contrasts with previous findings that only rapid component alternation is necessary for matching when relative rate of reinforcement is manipulated.     

Stimulus duration as a measure of stimulus generalization

Four pigeons in the line-positive group were trained with a vertical line on a green background that signalled intermittent reinforcement while a plain green field signalled extinction. Four pigeons in the line-negative group were trained with the opposite discrimination. Response to a control key terminated any trial and initiated the next trial. The birds also used the control key during generalization tests to control the durations of trials in which various line orientations were presented. These durations were summed to provide generalization gradients of stimulus duration that were positive or negative in accordance with the trained discriminations. In Experiment 2, birds from the line-positive group were tested with a procedure in which the control key was not available on some trials. This provided an independent assessment of response rates to the test stimuli. These rates were used to predict the stimulus durations obtained when the control key was available. The findings supported a general model for the prediction of response distributions among concurrent stimuli from rates observed with single stimuli.