Discrete and continuous measures of dimensional stimulus control

In two sets of experiments, we examined dimensional stimulus control of pigeons' responses to a visual flicker-rate continuum. In the first experiment, responses to a single key were reinforced periodically during stimuli from one half of the stimulus continuum, and responses during other stimuli were extinguished. In the second experiment, two response keys were simultaneously available, with reinforcement for each response alternative associated with different halves of the stimulus continuum. Conditions of the second experiment involved either free-operant or discrete-trial stimulus presentations. Results from these experiments show that positive dimensional contrast appeared in discrimination tasks with one or two response alternatives, but only with free-operant procedures. In addition, discrimination between stimulus classes established by differential reinforcement was assessed as accurately by continuous rate measures as by discrete response choice in the two-alternative situation. The general implication of these experiments is that response rate measures, when properly applied, may reveal sources of variation within stimulus classes, such as dimensional contrast, that are not evident with discrete measures.     

Local contrast and maintained generalization.

Pigeons received variable-interval reinforcement for key pecking during presentations of horizontal and vertical line-orientation stimuli, while pecks during five intermediate orientations were extinguished. Lowest peck rates were observed during presentations of negative stimuli adjacent to the positive orientations while peck rate during 45 degrees (the intermediate negative orientation) was relatively high, i.e., there were negative contrast shoulders. When peck rates were manipulated in the positive orientations, peck rate in neithboring orientations changed in the opposite direction. Contrast shoulders faded after prolonged training. A second type of contrast, local contrast, was correlated with similarity of preceding stimulus and different average peck rates during different stages of the discrimination process. The data suggest that sequential local contrast accompanying the formation of a discrimination contributes to the form of generalization gradients. Blough's model of stimulus control predicts the changes in gradient form described here, but may not accurately depict the underlying process responsible for gradient form.     

Sequential effects in dimensional contrast

Two experiments examined pigeons' response rates during short trials signaled by stimuli closely spaced along a wavelength continuum. In Experiment 1 separate halves of the continuum were correlated with different reinforcement schedules. In Experiment 2, the middle stimulus was accompanied by a lower probability of reinforcement than were the remaining wavelengths. Both procedures resulted in dimensional contrast “shoulders,” seen as relatively enhanced or depressed response rates in the presence of stimuli between the extreme of the continuum and the border separating the positive and negative stimuli. Sequential analyses addressed possible contributions of the following interactions: (a) local contrast, seen when rate during a given schedule depends on the schedule in the just-preceding trial; (b) modification of local contrast by the similarity of the signaling stimuli (P. Blough, 1983); and (c) schedule-independent rate contrast, seen when rate in a given trial depends on the rate controlled by the stimulus that accompanied the just-preceding trial (Malone & Rowe, 1981). Dimensional contrast functions were similar when isolated according to the schedule, to the similarity of the signaling stimulus, and to the response rate of the just-preceding trial. The interactions noted above do not appear to make important contributions to this effect.     

Local contrast and Pavlovian induction

Two experiments examined the effects of number and similarity of stimuli on local contrast. In the first experiment, local contrast effects differed in magnitude as a function of the similarity among stimuli; greater positive local contrast appeared when stimuli were less similar, though this effect sometimes reversed for very dissimilar stimuli. In the second experiment, both positive and negative local contrast appeared transiently during the course of training a discrimination including two quite dissimilar stimuli. When two new stimuli were added, both effects reappeared in several cases. The effects remained when the discrimination was rendered more difficult by substituting a new stimulus very similar to one of the original pair. These and other data suggest that local contrast depends on the same factors that produce Pavlovian induction; in the absence of an alternative account, Pavlov's interpretation may be useful in suggesting further research that will help identify the mechanisms involved in both classical and operant discrimination learning.     

Competition between stimulus-reinforcer contingencies and anticipatory contrast.

Procedures used to study anticipatory contrast are conceptually similar to those used to study autoshaping, in that two target stimuli signal either higher or lower rates of reinforcement in the following components of the schedule. Despite this signal contingency, anticipatory contrast entails response rates that are higher to the target stimulus followed by the lower rate of reinforcement. To determine the relation between such effects and autoshaping, different variations of the procedure were used in which the signal contingency was presented in the absence of reinforcement in the target components themselves and in which the reinforcement schedules in the different following components were signaled by the same stimulus. Autoshaping effects of this signal contingency were demonstrated when no reinforcement was available during the target-component signals themselves. Intermediate patterns of behavior occurred when reinforcement was available during the target-component signals and when their different following schedules were correlated with the same stimulus. Attempts to isolate these signal and contrast effects functionally by using the signal-key procedure were unsuccessful. The results demonstrate that Pavlovian stimulus contingencies are in competition with the dynamics of anticipatory contrast, thus reducing its occurrence under some circumstances.     

Behavioral contrast: Pavlovian effects and anticipatory contrast.

Two sources of behavioral contrast have been identified previously: Pavlovian stimulus-reinforcer relations and component sequence effects (anticipatory contrast). This study sought to isolate these sources of control procedurally in a four-ply multiple schedule composed of two fixed two-component sequences. Different cues were associated with the first component of each sequence, and contrast effects were studied in these target components. In Experiment 1, differential cuing of Component 2 between sequences and availability of reinforcement during target components were varied across three groups of pigeons; the stimulus-reinforcer relation between target-component cues and schedule of reinforcement in Component 2 was varied within subjects. Control by the Pavlovian relation was demonstrated under all conditions, and anticipatory contrast was not observed. In Experiment 2, target-component duration was systematically varied in the three groups of Experiment 1. Control by the Pavlovian relation was reliably obtained only when target-component behavior was unreinforced, and diminished with increases in component duration. Anticipatory contrast emerged in the two groups for which target-component reinforcement was available. These and other data indicate that Pavlovian effects in multiple schedules may be obscured when the requisite conditions for anticipatory contrast are present.     

Local contrast in multiple schedules: the effect of stimulus discriminability.

A three-ply multiple schedule assessed responding in a standard component as a function of the just-preceding schedule. The principal experimental condition was the difference among the wavelengths signaling the schedule components. Only the pigeons working in a narrow wavelength range showed persistent positive local contrast; that is, response rate during the standard component was higher when that component followed extinction than when it followed itself. Birds in both narrow- and medium-range groups showed persistent negative local contrast; that is, rate was lower following a relatively rich component. The dissipation of positive contrast appeared to be most clearly related to the establishment of differential responding. Negative contrast was inversely related to wavelength differences. Theories pertaining to contrast must account for the role of discrimination in both positive and negative types.     

Inverse relations between preference and contrast

Pigeons were trained on a multiple schedule in which two target components with identical reinforcement schedules were followed by either the same-valued schedule or by extinction. Response rate increased in both target components but was higher in the target component followed by extinction, replicating previous findings of positive anticipatory contrast. A similar design was used to study negative contrast, in that the two target components were followed either by the same-valued schedule or by a higher valued schedule. Negative contrast occurred equally, on average, in both target components, thus failing to demonstrate negative contrast that is specifically anticipatory in nature. When the stimuli correlated with the two target components were paired in choice tests, the pattern of preference was in the opposite direction. For the positive contrast procedure, no significant preference between the two target stimuli was evident. But for the negative contrast procedure, preference favored the stimulus followed by the higher valued schedule. The results demonstrate a functional dissociation between positive and negative contrast in relation to stimulus value. More generally, the results demonstrate an inverse relation between response rate and preference and challenge existing accounts of contrast in terms of the concept of relative value.     

Undermatching and contrast within components of multiple schedules

Six multiple variable-interval schedules each comprised one variable-interval sixty second component and an alternated component which was varied. Four pigeons' responses were recorded in five successive subintervals of each component. Response rate changes across subintervals revealed instances of local contrast and small local induction effects in the changed component. In the constant component, smaller local contrast and larger local induction effects obtained. Accordingly, the magnitude of behavioral contrast, defined as an inverse relation between response rate in the constant component and reinforcement rate in the changed component, did not change reliably across subintervals of the constant component. Ratios of response rates in initial subintervals were highly sensitive to reinforcement ratios. Sensitivity decreased sharply over the first two-fifths of the components and remained constant for the remainder. The results demonstrated that changes in multiple schedule sensitivity are a function of time since the alternation of successive components.     

A molecular analysis of multiple schedule interactions: negative contrast

The present experiments investigated the relationship between changes in the relative reinforced interresponse-time distributions and the occurrence of positive and negative contrast in multiple variable-interval—variable-interval and multiple variable-interval—extinction schedules of reinforcement. Experiment I demonstrated that changes in the interresponse-time distributions were consistently correlated with response-rate changes referred to as positive and negative contrast. Corresponding changes in the reinforced interresponse-time distributions suggested that negative contrast resulted as an inductive effect of selectively reinforcing long interresponse times in the altered component at the moment the baseline schedule was reintroduced. Experiment II demonstrated that the magnitude of the negative-contrast effect could be significantly decreased if the altered component schedule was modified in order to prevent the reinforcement of these interresponse times during the first few sessions of baseline recovery. The results supported a proposal that interresponse time—reinforcer relations may act as amplifiers or attenuators of negative contrast.     

Effects of variable-interval value and amount of training on stimulus generalization.

In Experiment 1 pigeons pecked a key that was illuminated with a 501-nm light and obtained food by doing so according to a variable-interval (VI) schedule of reinforcement, the mean value of which differed across groups: either 30 s, 120 s, or 240 s. The pigeons in all three groups were trained for 10 50-min sessions. Generalization testing was conducted in extinction with different wavelengths of light. Absolute and relative generalization gradients were similar in shape for the three groups. Experiment 2 was a systematic replication of Experiment 1 using line orientation as the stimulus dimension and a mean VI value of either 30 s or 240 s. Again, gradients of generalization were similar for the two groups. In Experiment 3 pigeons pecked a key that was illuminated with a 501-nm light and obtained food reinforcers according to either a VI 30-s or a 240-s schedule. Training continued until response rates stabilized (> 30 sessions). For subjects trained with the 30-s schedule, generalization gradients were virtually identical regardless of whether training was for 10 sessions (Experiment 1) or until response rates stabilized. For subjects trained with the VI 240-s schedule, absolute generalization gradients for subjects trained to stability were displaced upward relative to gradients for subjects trained for only 10 sessions (Experiment 1), and relative generalization gradients were slightly flatter. These results indicate that the shape of a generalization gradient does not necessarily depend on the rate of reinforcement during 10-session single-stimulus training but that the effects of prolonged training on stimulus generalization may be schedule dependent.     

Stimulus-specific contrast effects during operant discrimination learning

In two experiments, pigeons' responding was equally reinforced in the presence of four line-orientation stimuli. Responding was then reinforced when only two of the four orientation stimuli were present; the remaining two orientations appeared during extinction. Response rates were often highest in the stimulus adjacent to the orientations presented during extinction and often lowest in that orientation adjacent to the orientations presented with reinforcement. These effects were stronger and more persistent when the stimuli were separated by a smaller angle, rendering the discrimination more difficult. These and other data suggest that discrimination training may not be accurately explained in terms of the simple effects of reinforcement and nonreinforcement associated with isolated stimuli, nor by accounts that depend upon stimulus generalization. Recent accounts of contrast that depend upon “emotionality” produced by nonreinforced responding or upon reinforcement-elicited responses are also difficult to apply to these data.     

Discriminative stimulus control and the effects of concurrent operants.

Discriminative-stimulus-control functions were investigated in a concurrent operant context. Variable-interval reinforcement schedules were arranged for pigeons on two response keys. One key, illuminated with a white vertical line on green background (position irrelevant), was programmed with a given schedule value across groups. For different groups of pigeons, the alternative key, illuminated with green alone, was programmed with twice, the same, or half the reinforcement frequency of the other key. Stimulus-control gradients were collected from both keys as line orientation was varied. On the green-plus-line alternative, flattest gradients were observed when twice the reinforcement frequency was concurrently programmed and the steepest were observed when equal values were concurrently programmed. Also examined were the effects of a programmed changeover delay, important in maintaining the independence of concurrent operants. The changeover delay was found to have relatively minor effects upon stimulus control, despite its typical and marked effects upon steady-state responding.     

Determinants of contrast in the signal-key procedure: Evidence against additivity theory

Two experiments are reported that challenge the interpretation of previous results with the signal-key procedure, in which the discriminative stimuli are located on a response key different from the key associated with the operant response requirement. Experiment 1 replicated the procedure of Keller (1974), and found that contrast effects on the operant key occurred reliably for only one of four subjects. High rates to the signal key initially occurred for only one subject, but modifications of the procedure produced substantial rates to the signal key for all subjects. In all cases, however, signal-key behavior was greatly reduced by the addition of a changeover delay which prevented reinforcement within 2 seconds of the last peck to the signal key, suggesting that signal-key pecking was maintained primarily by adventitious reinforcement. Experiment 2 modified the signal-key procedure by using three response keys, so that the discriminative stimuli on the signal key controlled different responses during all phases of training. With this modification, reliable contrast effects on the operant key occurred for all subjects, suggesting that the failure to find contrast in previous studies has been due to the confounding of changes in the discrimination requirements with changes in relative rate of reinforcement. The results challenge the additivity theory of contrast, and suggest that “elicited” behavior plays a minor role, if any, in the determination of contrast effects in multiple schedules.     

Within-session Analysis Of Visual Discrimination

Within-session changes in responding by pigeons during a maintained successive discrimination procedure were examined in four experiments. In the first two experiments, which involved discrimination of visual flicker rate, within-session changes in responding were minimal or absent. A third experiment, which examined discrimination of rectangular forms, demonstrated that the absence of within-session changes in responding was not limited to flicker-rate stimuli. A fourth experiment showed that the absence of within-session changes in responding was not due to high task difficulty in the previous experiments. For the group of subjects in each experiment, within-session changes in responding did not influence discrimination performance. Therefore, measures of overall response rate accurately represented responding both within and across sessions. The occasional appearance of within-session decreases in responding for a few birds may be attributable to satiation.     

Real-time detection of orientation during negative behavioral contrast with key pecking and a turning response

We developed a video system for real-time detection of a pigeon's orientation and for reinforcement of a “turning response.” Using this system, negative behavioral contrast was found across key-peck and turning responses. In addition, turning away from the pecking key was detected by the system just after presentation of the negative discriminative stimulus on the key. The results suggest that avoidance of the discriminative stimulus in the constant component, which has been regarded as a causal factor for negative contrast (additivity theory), is not the primary factor for negative behavioral contrast of pigeons' key pecking, but may account for negative local contrast.     

The role of preliminary magazine training in acquisition of the autoshaped key peck

A series of experiments tested the hypothesis that initial key pecks in the autoshaping procedure are generalized pecks at the illuminated grain hopper. Experiment I found that autoshaping readily occurred when the chamber was continuously illuminated by a house-light. In Experiment II, pigeons given magazine training and autoshaping with an unlighted grain hopper failed to autoshape in 200 trials. Acquisition of autoshaped key pecking was retarded in Experiment III when stimulus control by the magazine light was reduced. In the fourth study, pigeons were given magazine training with either a red or white magazine light and then given autoshaping with concurrently presented red and white keys. For all pigeons in this experiment, the first key peck occurred on the key of the same color as that pigeon's magazine light. The results of these experiments were interpreted as supporting an account of autoshaping that identifies initial key pecks as arising due to generalization of pecking at the lighted grain hopper to pecking at the lighted key.     

Construction of equal-hue discriminability scales for the pigeon.

Equal-hue discriminability steps for the pigeon are shown as tabular entries that can be summed or interpolated to produce sequences of equal discriminability steps of various step size. Equal-hue discriminability sequences can be constructed where the number of stimuli and spectral range are specified, or where an interval in one spectral region is to be equated to an interval in another spectral region.     

Behavioral contrast for key pecking as a function of component duration when only one component varies

Pigeons pecked keys for food reinforcers delivered by multiple variable-interval 2-min variable-interval 2-min schedules. Positive behavioral contrast was created by changing one component to extinction; negative contrast was achieved by changing one component to a variable-interval 15-s schedule. The duration of each component was varied independently of the other from 5 to 960 s. The size of positive contrast was greatest when the extinction component was 30 or 60 s long. It did not change significantly with changes in the duration of the variable-interval 2-min component. The absolute size of negative contrast decreased with increases in the duration of the variable-interval 2-min component. It did not change significantly with changes in the duration of the variable-interval 15-s component. These results show that the size of contrast is determined primarily by the duration of the component that provides the less favorable conditions of reinforcement. These results are not predicted by current theories.     

Local contrast in behavior allocation during multiple-schedule components

Allocation of responses between two keys was studied during two alternating multiple-schedule components. Responses were recorded in successive quarters of each component. Variable-interval reinforcer schedules on the two keys were constant throughout the experiment for one (constant) component and were varied over conditions on one key for the other, producing changes in reinforcer ratios for the varied component. Behavior allocation for the first quarter of the constant component was inversely related to varied-component reinforcer ratios, a form of local contrast, but this relationship was not observed later in the component. During the first quarter of the varied component, slopes of matching lines were high and decreased later in the component. It is argued that this form of local contrast cannot be explained in terms of reallocation of extraneous reinforcers between components, and that the matching law for concurrent operants does not capture some sources of control over behavior allocation. A simple extension of the matching law is offered that adequately describes behavior changes during both components. A version of this formulation can predict contrast effects in absolute response rates.