Fixed-ratio pausing: Joint effects of past reinforcer magnitude and stimuli correlated with upcoming magnitude

Pigeons responded on fixed-ratio schedules ending in small or large reinforcers (grain presentations of different duration) interspersed within each session. In mixed-schedule conditions, the response key was lit with a single color throughout the session, and pausing was directly related to the past reinforcer (longer pauses after large reinforcers than after small ones). In multiple-schedule conditions, different colors accompanied the ratios ending in small and large reinforcers, and pausing was affected by the upcoming reinforcer as well as the past one. Pauses were shorter before large reinforcers than before small ones, but they continued to be longer after large reinforcers than after small ones. The influence of the past reinforcer was modulated by the magnitude of the upcoming reinforcer; in the presence of the stimulus before the small reinforcer, the effect of the past reinforcer was enhanced relative to its effect in the stimulus before the large reinforcer. These results show that pausing between ratios is jointly determined by two competing factors: past conditions of reinforcement and stimuli correlated with upcoming conditions.     

Sequential effects in dimensional contrast

Two experiments examined pigeons' response rates during short trials signaled by stimuli closely spaced along a wavelength continuum. In Experiment 1 separate halves of the continuum were correlated with different reinforcement schedules. In Experiment 2, the middle stimulus was accompanied by a lower probability of reinforcement than were the remaining wavelengths. Both procedures resulted in dimensional contrast “shoulders,” seen as relatively enhanced or depressed response rates in the presence of stimuli between the extreme of the continuum and the border separating the positive and negative stimuli. Sequential analyses addressed possible contributions of the following interactions: (a) local contrast, seen when rate during a given schedule depends on the schedule in the just-preceding trial; (b) modification of local contrast by the similarity of the signaling stimuli (P. Blough, 1983); and (c) schedule-independent rate contrast, seen when rate in a given trial depends on the rate controlled by the stimulus that accompanied the just-preceding trial (Malone & Rowe, 1981). Dimensional contrast functions were similar when isolated according to the schedule, to the similarity of the signaling stimulus, and to the response rate of the just-preceding trial. The interactions noted above do not appear to make important contributions to this effect.     

Behavioral contrast in fixed-interval components: effects of extinction-component duration.

Seven albino rats were exposed to a multiple schedule of reinforcement in which the two components (fixed interval and extinction) alternated such that a presentation of the extinction component followed each fixed-interval reinforcement. In baseline sessions, the duration of the extinction component was constant and always one-third of the fixed-interval value. Probe sessions contained a probe segment in which the duration of the extinction component was increased; the response rate in fixed-interval components during the probe segment was compared with the response rate in the segments preceding and following the probe. The effect of increasing the duration of the extinction component was studied under three values of fixed interval: 30 s, 120 s, and 18 s, in three successive conditions. Response rate within fixed intervals was a direct function of duration of the extinction component. Pausing at the beginning of the fixed interval decreased as extinction duration increased. These effects were larger and more consistent for the shorter fixed-interval values (18 s and 30 s). These results indicate a functional relation between relative component duration and responding. For the component providing more frequent reinforcement, this could be stated as an inverse relationship between relative component duration and response rate. This relation is similar to findings regarding the ratio of trial and intertrial duration in Pavlovian conditioning procedures, and suggests that behavioral contrast may be related to Pavlovian contingencies underlying the multiple schedule.     

Exploring the set-theoretical structure of objects by additive trees

Arrangements of feature sets that have been proposed to represent qualitative and quantitative variation among objects are shown to generate identical sets of set-symmetric distances. The set-symmetric distances for these feature arrangements can be represented by path lengths in an additive linear tree. Imperfect versions of these feature arrangements are proposed, which also are indistinguishable by the set-symmetric distance model. The distances for the imperfect versions can be represented by path lengths in an additive imperfectly linear tree. When dissimilarities are defined by the more general contrast model and a constant may be added to proximity data, then for both the perfect and imperfect arrangements an additive tree analysis obtains a perfect fit with an imperfectly linear tree. However, in the case of the contrast model also the distinction between the perfect and imperfect arrangements disappears in that also for the perfect arrangements the resulting tree need no longer be linear.The author is grateful to Mathieu Koppen for detailed comments on an earlier version of this article.     

Contrast and reallocation of extraneous reinforcers as a function of component duration and baseline rate of reinforcement

Four pigeons responded on multiple schedules arranged on a “main” key in a two-key experimental chamber. A constant schedule component was alternated with another component that was varied over conditions. On an extra response key, conjoint schedules of reinforcement that operated in both components were arranged concurrently with the multiple schedule on the main key. On the main key, changes in reinforcement rate in the varied component were inversely related to changes in response rates in the constant component (behavioral contrast). On the extra key, some reinforcers were reallocated between components, depending on the schedules in effect on the main key in the varied component. In the varied component, the obtained rates of reinforcement on the extra key were inversely related to main-key reinforcement rate. In the constant component, extra-key reinforcer rates were positively related to main-key reinforcer rates obtained in the varied component, and were not a function of response rates on the extra key. In two comparisons, the rate at which components alternated and the value of the main-key schedule in the constant component were varied. Consistent with earlier work, long components reduced the extent of contrast. Reductions in contrast as a function of component duration were accompanied by similar reductions in the extent of reinforcer reallocation on the extra key. In the second comparison, lowering the rate of reinforcement in the constant component increased the rate at which extra-key reinforcers were obtained, reduced the extent of reinforcer reallocation, and reduced contrast. Overall, the results are consistent with the suggestion that some contrast effects are due to the changes in extraneous reinforcement during the constant component, and that manipulations of component duration, and manipulations of the rate of reinforcement in the constant component, affect contrast because they influence the extent of extraneous reinforcer real-location.     

Effects of component length and of the transitions among components in multiple schedules

Pigeons received equal variable-interval reinforcement during presentations of two line-orientation stimuli while five other orientations appeared in extinction. Component duration was 30 seconds for all orientations and the sequence was arranged so that each orientation preceded itself and each other orientation equally often. The duration of one component (0°) was shortened to 10 seconds and the other (90°) was lengthened to 50 seconds. All animals showed large increases in response rate in the shortened component and this increase was recoverable after an interpolated condition in which all components were again 30 seconds in duration. This effect was replicated in a second experiment in which component duration was changed from 150 seconds to 50 seconds and 250 seconds. An examination of local contrast effects during the first experiment showed that the shortened component produced local contrast during subsequent presentations of the lengthened component, just as would a component associated with more frequent reinforcement. When the presentation sequence was changed so that the lengthened component was always followed by the shortened component, response rates generally increased during the lengthened component. When the sequence was arranged so that the shortened component always preceded the longer component, response rate decreased in the former. These effects, as well as the increases in response rate following change in component length, seem not to be the product of local contrast effects among components.     

Behavioral contrast as differential time allocation

In Experiment I, hooded rats were exposed to multiple variable-interval schedules of reinforcement in which manipulanda and reinforcement magazines at opposite ends of the experimental chamber were associated with the different components. Time allocated to each component was measured by recording the time spent by the subject in the appropriate half of the chamber. Positive behavioral contrast was observed for the comparison between multiple variable-interval 30-second variable-interval 30-second and multiple variable-interval 30-second variable-interval 90-second conditions for both response frequency and time allocation measures, but not for mean local response rate (response frequency per time allocated to a component). In Experiment II, rats were exposed to multiple variable-time schedules in which reinforcement was response independent. Time allocated to each component was measured for two conditions, multiple variable-time 30-second variable-time 30-second and multiple variable-time 30-second variable-time 90-second. Positive behavioral contrast of time allocation was exhibited. The results indicated that time allocation was differentially sensitive to changes in reinforcement probability, and that behavioral contrast may result from the differential allocation of time to the different components of the multiple schedule.     

The effects of different component response requirements in multiple and concurrent schedules

Six pigeons were trained on multiple and concurrent schedules. The reinforcement rates were varied systematically (a) when lever pressing was required in one component and key pecking in the successive component; (b) when lever pressing was required in both multiple components; (c) when key pecking was required in both multiple components; and (d) when key pecking was required on one schedule and lever pressing was required on the concurrently-available schedule. Only the absolute level of responding was changed by different response requirements. Analyzed by the generalized matching law, performance under different response requirements resulted in a bias toward key pecking, and the measured response bias was the same in multiple and concurrent schedule arrangements. The bias in time measures obtained from concurrent schedule performance was reliably smaller than the obtained response biases. The sensitivity to reinforcement-rate changes was ordered: concurrent key-lever; multiple key-key; multiple lever-key; and, the least sensitive, multiple lever-lever. The results confirm that requirements of different topographical responses can be handled by the generalized matching law mainly in the bias parameter, but problems for this type of analysis may be caused by the changing sensitivity to reinforcement in multiple schedule performance as response requirements are changed.     

An investigation of peak shift and behavioral contrast for autoshaped and operant behavior.

Instrumental treadle press and nonreinforced key peck responses were monitored during discrimination training and generalization testing in pigeons on positive and negative reinforcement schedules. In Experiment 1, six pigeons pressed a treadle for food on a multiple variable-interval extinction schedule. In Experiment 2, three pigeons pressed a treadle to avoid shock on a multiple free-operant avoidance extinction schedule. Different color keylights signaled S+ and S- components. Some positive behavioral contrast occurred during discrimination training, but the effect was small. Pecking occurred to the S+ keylight in Experiment 1 but not in Experiment 2. On stimulus generalization tests, all subjects displayed a positive peak shift when pressing the treadle for food or to avoid shock. However, peak shift was not found for nonreinforced "autopecks" on the stimulus key, although an area shift was observed in Experiment 1. This is the first demonstration of peak shift for pigeons pressing treadles and the only reliable demonstration of peak shift when negative reinforcement maintained responding. These results, in combination with previous demonstrations of peak shift for rats pressing levers and pigeons pecking keys, indicate that peak shift is a general by-product of operant discrimination learning, since it occurs across a variety of the organisms, responses, and reinforcers.     

Local contrast and maintained generalization.

Pigeons received variable-interval reinforcement for key pecking during presentations of horizontal and vertical line-orientation stimuli, while pecks during five intermediate orientations were extinguished. Lowest peck rates were observed during presentations of negative stimuli adjacent to the positive orientations while peck rate during 45 degrees (the intermediate negative orientation) was relatively high, i.e., there were negative contrast shoulders. When peck rates were manipulated in the positive orientations, peck rate in neithboring orientations changed in the opposite direction. Contrast shoulders faded after prolonged training. A second type of contrast, local contrast, was correlated with similarity of preceding stimulus and different average peck rates during different stages of the discrimination process. The data suggest that sequential local contrast accompanying the formation of a discrimination contributes to the form of generalization gradients. Blough's model of stimulus control predicts the changes in gradient form described here, but may not accurately depict the underlying process responsible for gradient form.