Sequential effects in dimensional contrast

Two experiments examined pigeons' response rates during short trials signaled by stimuli closely spaced along a wavelength continuum. In Experiment 1 separate halves of the continuum were correlated with different reinforcement schedules. In Experiment 2, the middle stimulus was accompanied by a lower probability of reinforcement than were the remaining wavelengths. Both procedures resulted in dimensional contrast “shoulders,” seen as relatively enhanced or depressed response rates in the presence of stimuli between the extreme of the continuum and the border separating the positive and negative stimuli. Sequential analyses addressed possible contributions of the following interactions: (a) local contrast, seen when rate during a given schedule depends on the schedule in the just-preceding trial; (b) modification of local contrast by the similarity of the signaling stimuli (P. Blough, 1983); and (c) schedule-independent rate contrast, seen when rate in a given trial depends on the rate controlled by the stimulus that accompanied the just-preceding trial (Malone & Rowe, 1981). Dimensional contrast functions were similar when isolated according to the schedule, to the similarity of the signaling stimulus, and to the response rate of the just-preceding trial. The interactions noted above do not appear to make important contributions to this effect.     

Interactions in multiple schedules: negative induction with squirrel monkeys

In Experiment I, lever pressing by squirrel monkeys was maintained under a sequence of variable-interval, multiple variable-interval variable-interval, and multiple variable-interval extinction schedules of food presentation. Negative induction (decreased responding in the unchanged component) occurred when one component of the multiple variable-interval variable-interval schedule was changed to extinction. Negative induction was transient over sessions; responding in the unchanged component usually recovered to a rate similar to that under the multiple variable-interval variable-interval schedule. Negative induction was not accompanied by consistent changes in the patterns of local responding within the unchanged component, and did not depend on whether component schedules were associated with localized (lever lights) or diffuse visual stimuli (houselights), or on whether the unchanged component was a 60- or 180-sec variable-interval schedule. In Experiment II, responding was maintained under a sequence of variable-interval and multiple variable-interval timeout schedules of food presentation. Negative induction occurred when responding declined gradually in the timeout component but not when responding declined abruptly. The nature of interactions in multiple schedules may depend on the species; negative induction was observed with squirrel monkeys under conditions similar to those that produce positive contrast with pigeons.     

A re-examination of local contrast in multiple schedules

Pigeons were presented with multiple schedules of alternating 90-sec components. When components in which grain was never presented alternated with components in which grain was presented on a variable-interval schedule, the average rate of responding in the variable-interval components increased, showing overall positive behavioral contrast. Unlike previous reports, this study found that the response rates for all birds increased toward the end of the variable-interval components as training proceeded. This increase in local response rate disappeared when the multiple schedule was composed solely of variable-interval components and reappeared when the variable-interval components were again alternated with extinction. This finding cannot be predicted or explained by recent theories of behavioral contrast based on autoshaping, and thus questions their sufficiency. We suggest that this local response-rate increase results from the predictable change from high to low density of reinforcement at the end of the fixed-duration component. Thus, the present effect apparently illustrates a different type of interaction between components of a multiple schedule than that described by previous theories of contrast. In a given procedure, either or both types of interaction may occur; neither provides a complete account of behavioral contrast.     

Negative behavioral contrast on multiple treadle-press schedules

Eight pigeons pressed treadles for food reinforcers delivered by several multiple variable-interval schedules. The rate of reinforcement for responding during one component schedule was held constant at 30 reinforcers per hour. The rate of reinforcement for responding during the other component varied from 0 to 120 or 240 reinforcers per hour. The schedules were presented in different orders for different subjects. The rate of responding emitted during the variable component schedule varied directly with the rate of reinforcement it provided. The rate of responding during the constant component did not increase consistently when the rate of reinforcement obtained from the variable component decreased from 30 to 0 reinforcers per hr. The rate of responding emitted during the constant component decreased when the rate of reinforcement obtained from the variable component increased from 30 reinforcers per hour to a higher rate. That is, negative but not positive behavioral contrast occurred. The failure to find positive contrast is consistent with one of the predictions of the additive theories of behavioral contrast. Finding negative contrast has ambiguous implications for the additive theories.     

Stimulus-reinforcer contingencies and local behavioral contrast

Four pigeons were exposed to a series of multiple schedules of variable-interval reinforcement in which pecks were required on one key (operant key) and components were signalled on a second key (signal key). Four additional pigeons experienced identical conditions, except that a yoking procedure delivered food on variable-time schedules, with no key pecks required. One of the components of the multiple schedule was constant throughout the experiment as a variable-interval (or variable-time) 30-second schedule. Operant-key responding during the constant component was uniform throughout the component, uninfluenced by changes in the duration of the variable component, and only slightly influenced by changes in reinforcement frequency correlated with the variable component. By comparison, signal-key response rate during the constant component was highest at the onset of the component, was higher when the variable component was 60-sec long than when it was 1-sec long, and was higher when no reinforcement occurred in the variable component than when reinforcement was scheduled in the variable component. These characteristics of signal-key pecking matched characteristics of local positive behavioral contrast. These data are taken to support the “additivity theory” of behavioral contrast and to suggest that Pavlovian stimulus-reinforcer relations contribute primarily to the phenomenon of local positive contrast.     

Contrast effects in multiple fixed-interval reinforcement schedules

Pigeons were exposed to a multiple fixed-interval one-minute fixed-interval three-minute schedule of reinforcement following training on either a multiple fixed-interval one-minute fixed-interval one-minute schedule or a multiple fixed-interval three-minute fixed-interval three-minute schedule. For all birds, large negative local contrast effects developed during the first of four three-minute intervals in a component; response rate was depressed and postreinforcement pause lengthened in this interval. Positive local contrast effects were evident during the first of 12 one-minute intervals in a component for five of six birds; at asymptote, the pause was very short and response rate slightly elevated during this interval. Overall positive contrast was generally transient and varied considerably across subjects, while overall negative contrast effects, if they occurred, appeared only after a large number of sessions.     

Positive behavioral contrast in 3-month-old infants on multiple conjugate reinforcement schedules.

Positive behavioral contrast was assessed in two experiments with young infants using multiple conjugate reinforcement schedules. Reinforcement was produced by footkicks which activated the objects of an overhead crib mobile in a manner proportional to the vigor and rate of responding. Distinctive color/pattern cues on the sides of the objects served as discriminative stimuli for components of the multiple schedule. In Experiment 1, infants were trained with one cue (S+) only before insertion of S+ into a multiple schedule with an extinction component. A control group received S+ throughout all sessions. In Experiment 2, a multiple schedule was introduced at the outset, and responses in both components were reinforced before the introduction of extinction in the second component. In a final phase, reinforcement was reintroduced into the second component. Positive behavioral contrast occurred in both experiments. Response reduction in the extinction component was seen only in individual relative response curves. In both experiments, negative emotional behaviors accompanied the extinction component, and in Experiment 1, cooing accompanied presentations of S+.     

Inverse relations between preference and contrast

Pigeons were trained on a multiple schedule in which two target components with identical reinforcement schedules were followed by either the same-valued schedule or by extinction. Response rate increased in both target components but was higher in the target component followed by extinction, replicating previous findings of positive anticipatory contrast. A similar design was used to study negative contrast, in that the two target components were followed either by the same-valued schedule or by a higher valued schedule. Negative contrast occurred equally, on average, in both target components, thus failing to demonstrate negative contrast that is specifically anticipatory in nature. When the stimuli correlated with the two target components were paired in choice tests, the pattern of preference was in the opposite direction. For the positive contrast procedure, no significant preference between the two target stimuli was evident. But for the negative contrast procedure, preference favored the stimulus followed by the higher valued schedule. The results demonstrate a functional dissociation between positive and negative contrast in relation to stimulus value. More generally, the results demonstrate an inverse relation between response rate and preference and challenge existing accounts of contrast in terms of the concept of relative value.     

Punishment contras during free-operant avoidance

Punishment of bar-pressing responses of rhesus monkeys with electric shock in one component of a multiple free-operant avoidance schedule suppressed responding in that component. These decreases were concomitant with response rate increases in the unpunished component (punishment contrast). Response rates in both components increased when punishment was removed and decreased in successive sessions. These effects of punishment on unpunished responding were similar to those obtained during single and multiple schedules of positive reinforcement and they suggest a further similarity in the development of discriminations during positive and negative reinforcement schedules.     

Contrast and autoshaping in multiple schedules varying reinforcer rate and duration

Thirteen master pigeons were exposed to multiple schedules in which reinforcement frequency (Experiment I) or duration (Experiment II) was varied. In Phases 1 and 3 of Experiment I, the values of the first and second components' random-interval schedules were 33 and 99 seconds, respectively. In Phase 2, these values were 99 seconds for both components. In Experiment II, a random-interval 33-second schedule was associated with each component. During Phases 1 and 3, the first and second components had hopper durations of 7.5 and 2.5 seconds respectively. During Phase 2, both components' hopper durations were 2.5 seconds. In each experiment, positive contrast obtained for about half the master subjects. The rest showed a rate increase in both components (positive induction). Each master subject's key colors and reinforcers were synchronously presented on a response-independent basis to a yoked control. Richer component key-pecking occurred during each experiment's Phases 1 and 3 among half these subjects. However, none responded during the contrast condition (unchanged component of each experiment's Phase 2). From this it is inferred that autoshaping did not contribute to the contrast and induction findings among master birds. Little evidence of local contrast (highest rate at beginning of richer component) was found in any subject. These data show that (a) contrast can occur independently from autoshaping, (b) contrast assays during equal-valued components may produce induction, (c) local contrast in multiple schedules often does not occur, and (d) differential hopper durations can produce autoshaping and contrast.     

Behavioral contrast in chained schedules

In each of two experiments, the rate of key pecking maintained by a variable-interval food reinforcement schedule was measured, first when that schedule was studied in isolation, and then when it was correlated with the second component of a two-component chained schedule. In the first experiment, the first component of the chained schedule was correlated with a fixed-interval schedule; in the second experiment it was correlated with a variable-interval schedule. In both experiments, behavioral contrast was demonstrated in the second component of the chained schedule. Compared to the rate of responding on the food-reinforcement schedule when it had operated in isolation, the rate of responding on the food-reinforcement schedule when it was correlated with the second component was higher, while the rate on the schedule of the first component was lower. The results are discussed with reference to the determinants of contrast.     

Positive and negative behavioral contrast in the rat

Three groups of rats received either 8, 23, or 53 sessions of multiple variable-interval variable-interval baseline training before being shifted to a multiple extinction variable-interval schedule. The rate of responding during the unaltered component was higher for the groups shifted to multiple extinction variable-interval than for control groups remaining on multiple variable-interval variable-interval (positive contrast). Furthermore, when the multiple variable-interval variable-interval schedule was re-instated, stable negative contrast was found in the groups that had received 23 or 53 baseline sessions, but not for the group that had received only eight sessions. Positive and negative contrast were also demonstrated in the eight and 23-session groups when the multiple extinction variable-interval and multiple variable-interval variable-interval schedules were re-administered in further phases of the experiment. These results suggest that both positive and negative behavioral contrast can be obtained reliably in a species other than the pigeon.     

Positive contrast, negative induction, and inhibitory stimulus control in the rat

In Experiment I, 24 rats were trained on a multiple variable-interval variable-interval schedule with a doorlight and white noise serving as component cues. Two groups were then shifted to a multiple extinction variable-interval schedule, and a third group was maintained on the multiple variable-interval variable-interval schedule. The multiple extinction variable-interval condition produced positive contrast when either the light or noise signalled extinction, and both of these cues acquired inhibitory stimulus control as measured by a combined cue test. In Experiment II, the multiple variable-interval variable-interval condition was shifted to multiple extinction variable-interval for one group, to multiple variable-time variable-interval for a second group, and was unchanged for the third group. The two experimental conditions produced identical patterns of response-rate reduction in the altered component, but the multiple extinction variable-interval condition produced positive contrast, whereas the multiple variable-time variable-interval condition did not. Subsequent combined cue and resistance to reinforcement tests revealed that the cue signalling extinction acquired stronger inhibitory stimulus control than the cue signalling variable time.     

Contrast and reallocation of extraneous reinforcers between multiple-schedule components

Four pigeons responded in components of multiple schedules in which two responses were available and reinforced with food. Pecks on the left key (“main” key) were reinforced at a constant rate in one component and at a rate that varied over conditions in the other component. When reinforcer rate was varied, behavioral contrast occurred in the constant component. On the right key (“extra” key), five variable-interval schedules and one variable-ratio schedule, presented conjointly, arranged reinforcers for responses in all conditions. These conjoint schedules were common to both multiple-schedule components—rather than unique to particular components—and reinforcers from these schedules could therefore be arranged in one component and obtained during the other component. In this way, the additional reinforcers were analogous to the “extraneous” reinforcers thought to maintain behavior other than pecking in conventional multiple schedules. Response rate on the extra key did not change systematically over conditions in the constant component, and in the varied component extra responding was inversely related to main-key reinforcement. All subjects obtained more extra-key reinforcers in whichever component arranged fewer main-key reinforcers. Consistent with the theory that reallocation of extraneous reinforcers may cause behavioral contrast, absolute reinforcer rate for the extra key in the constant component was low in conditions that produced positive contrast on the main key and high in those that produced negative contrast. Also consistent with this theory, behavioral contrast was reduced in two conditions that canceled extra-key reinforcers that had been arranged but not obtained at the end of components. Thus, a constraint on reallocation markedly reduced the extent of contrast.     

Contrast effects in maintained generalization gradients

In Experiment I, pigeons were given equal reinforcement (variable-interval 1-min) for responding during randomized presentations of eight line-orientation stimuli. Then, only responding in the vertical orientation was reinforced. Stable generalization gradients soon formed and persistent behavioral and local (transient) contrast effects appeared. Local contrast effects were not a function of relative reinforcement frequency or of any other variable known to produce contrast. Instead, they were related to average response rates associated with each stimulus. Experiment II showed that local contrast effects represent increases and decreases in response rates relative to baseline responding, and that these effects are relative; a given stimulus might enhance responding during a subsequent presentation of one stimulus, but depress responding when followed by another. These data indicate that discrimination learning is not adequately described as the acquisition of excitatory properties by some stimuli and inhibitory properties by others. A more adequate account implies that stimuli exert both excitatory and inhibitory effects related to their value.     

PREFERENCE FOR A STIMULUS THAT FOLLOWS A RELATIVELY AVERSIVE EVENT: CONTRAST OR DELAY REDUCTION?

Several types of contrast effects have been identified including incentive contrast, anticipatory contrast, and behavioral contrast. Clement, Feltus, Kaiser, and Zentall (2000) proposed a type of contrast that appears to be different from these others and called it within-trial contrast. In this form of contrast the relative value of a reinforcer depends on the events that occur immediately prior to the reinforcer. Reinforcers that follow relatively aversive events are preferred over those that follow less aversive events. In many cases the delay reduction hypothesis proposed by Fantino (1969) also can account for such effects. The current experiments provide a direct test of the delay reduction and contrast hypotheses by manipulating the schedule of reinforcement while holding trial duration constant. In Experiment 1, preference for fixed-interval (FI) versus differential-reinforcement-of-other-behavior (DRO) schedules of reinforcement was assessed. Some pigeons preferred one schedule over the other while others demonstrated a position (side) preference. Thus, no systematic preference was found. In Experiment 2, a simultaneous color discrimination followed the FI or DRO schedule, and following training, preference was assessed by presenting the two positive stimuli simultaneously. Consistent with the contrast hypothesis, pigeons showed a significant preference for the positive stimulus that in training had followed their less preferred schedule.     

Effects of component length and of the transitions among components in multiple schedules

Pigeons received equal variable-interval reinforcement during presentations of two line-orientation stimuli while five other orientations appeared in extinction. Component duration was 30 seconds for all orientations and the sequence was arranged so that each orientation preceded itself and each other orientation equally often. The duration of one component (0°) was shortened to 10 seconds and the other (90°) was lengthened to 50 seconds. All animals showed large increases in response rate in the shortened component and this increase was recoverable after an interpolated condition in which all components were again 30 seconds in duration. This effect was replicated in a second experiment in which component duration was changed from 150 seconds to 50 seconds and 250 seconds. An examination of local contrast effects during the first experiment showed that the shortened component produced local contrast during subsequent presentations of the lengthened component, just as would a component associated with more frequent reinforcement. When the presentation sequence was changed so that the lengthened component was always followed by the shortened component, response rates generally increased during the lengthened component. When the sequence was arranged so that the shortened component always preceded the longer component, response rate decreased in the former. These effects, as well as the increases in response rate following change in component length, seem not to be the product of local contrast effects among components.     

Matching, contrast, and equalizing in the concurrent lever-press responding of rats

Five rats pressed levers for food reinforces delivered by several concurrent variable-interval variable-interval schedules. The rate of reinforcement available for responding on one component schedule was held constant at 60 reinforcers per hour. The rate of reinforcement available for responding on the other schedule varied from 30 to 240 reinforcers per hour. The behavior of the rats resembled the behavior of pigeons pecking keys for food reinforcers. The ratio of the overall rates of responding emitted under, and the ratio of the time spent responding under, the two components of each concurrent schedule were approximately equal to the ratio of the overall rates of reinforcement obtained from the components. The overall rate of responding emitted under, and the time spent responding under, the variable component schedule varied directly with the overall rate of reinforcement from that schedule. The overall rate of responding emitted under, and the time spent responding under, the constant component schedule varied inversely with the overall rate of reinforcement obtained from the variable component. The local rates of responding emitted under, and the local rates of reinforcement obtained from, the two components did not differ consistently across subjects. But they were not exactly equal either.     

Induction, contrast, and resistance to extinction

The resistance of responding to extinction after variable-interval reinforcement in one of two components of a multiple schedule of reinforcement was (1) greater, when responding in the second component was reinforced on a variable-interval schedule than when responding there was extinguished, (2) not reduced, by a more rapid decrease in the rate of responding than occurs in ordinary extinction in the second component, and, (3) increased, by the occurrence of positive behavioral contrast before the beginning of extinction.     

Undermatching and contrast within components of multiple schedules

Six multiple variable-interval schedules each comprised one variable-interval sixty second component and an alternated component which was varied. Four pigeons' responses were recorded in five successive subintervals of each component. Response rate changes across subintervals revealed instances of local contrast and small local induction effects in the changed component. In the constant component, smaller local contrast and larger local induction effects obtained. Accordingly, the magnitude of behavioral contrast, defined as an inverse relation between response rate in the constant component and reinforcement rate in the changed component, did not change reliably across subintervals of the constant component. Ratios of response rates in initial subintervals were highly sensitive to reinforcement ratios. Sensitivity decreased sharply over the first two-fifths of the components and remained constant for the remainder. The results demonstrated that changes in multiple schedule sensitivity are a function of time since the alternation of successive components.