Performance of rats under concurrent variable-interval schedules of negative reinforcement

The behavior of rats under concurrent variable-interval schedules of negative reinforcement was examined. A single one-minute variable-interval programmer determined the availability of 30-second timeouts from electric shock. These were assigned to one or the other of the two component schedules with a probability of 0 to 1.0. The response requirement for the component schedules was standing to the right or left of the center of the experimental chamber. With a six-second changeover delay, the relative time spent under one component schedule varied directly and linearly with the relative number of timeouts earned under that component schedule. The absolute number of changeovers was highest when a similar number of timeouts was earned under each component schedule, and lowest when all or nearly all timeouts were earned under one component schedule. In general, these relations are similar to those reported with concurrent variable-interval schedules of positive reinforcement.     

Additive summation following intradimensional discrimination training

Rats were exposed to intradimensional composite stimuli presented on the response lever that varied in both light intensity and flicker rate. For all subjects, pressing the lever was reinforced when it was illuminated at a high intensity and flickered at a low rate (I + f) or when it was illuminated at a low intensity and flickered at a high rate (i + F). For half the subjects, lever responding was not reinforced when it was illuminated at a low intensity and flickering at a low rate (i + f). For the remaining subjects, lever presses were not reinforced when the lever was illuminated at a high intensity and flickered at a high rate (I + F). When the composite stimulus composed of the light intensity and flicker rates that had been associated only with reinforced responding was displayed (I + F for half the subjects and i + f for the remaining subjects), it controlled the highest response rate of all stimuli (additive summation). The results demonstrated that similar attentional processes control intra- and interdimensional composite-stimulus discriminations in a manner consistent with Weiss' (1972) analysis of summation.     

Negative behavioral contrast on multiple treadle-press schedules

Eight pigeons pressed treadles for food reinforcers delivered by several multiple variable-interval schedules. The rate of reinforcement for responding during one component schedule was held constant at 30 reinforcers per hour. The rate of reinforcement for responding during the other component varied from 0 to 120 or 240 reinforcers per hour. The schedules were presented in different orders for different subjects. The rate of responding emitted during the variable component schedule varied directly with the rate of reinforcement it provided. The rate of responding during the constant component did not increase consistently when the rate of reinforcement obtained from the variable component decreased from 30 to 0 reinforcers per hr. The rate of responding emitted during the constant component decreased when the rate of reinforcement obtained from the variable component increased from 30 reinforcers per hour to a higher rate. That is, negative but not positive behavioral contrast occurred. The failure to find positive contrast is consistent with one of the predictions of the additive theories of behavioral contrast. Finding negative contrast has ambiguous implications for the additive theories.     

Behavioral contrast and the automaintained key peck

In two experiments behavioral contrast was demonstrated during discrimination training in a positive automaintenance procedure. During the baseline condition in each experiment, a key was transilluminated for eight seconds by one of two colors (CS) following a variable intertrial interval signaled by a dark key. Keylight transillumination terminated with a response-independent food presentation. In the first experiment, food was eliminated during one CS for up to fifty sessions. After reinstatement of food following each CS, the discrimination was reversed. Six of the eight subjects showed positive behavioral contrast, i.e., response rates increased during the CS associated with food as they decreased during the CS associated with no food. The effect was replicated in Experiment II, but it did not occur when both the food and its associated CS were eliminated. These results were comparable to those obtained with operant discrimination training procedures (behavioral contrast) and with Pavlovian discrimination training. The results suggest that additivity theories of behavioral contrast may be insufficient to account for these data.     

A comparison of signaled and unsignaled delay of reinforcement

Pigeons were trained on either a variable-interval 60-second schedule, or on a schedule that differentially reinforced responses that were spaced at least 20 seconds apart. The birds were then exposed to several durations of reinforcement delay, with comparisons between signaled and unsignaled delays. Although unsignaled delays of 5 and 10 seconds produced large decreases in response rate, signaled delays of up to 10 seconds produced only moderate decreases in response rates. In addition, some subjects responded more rapidly with a .5 or 1.0 second duration of unsignaled delay than with immediate reinforcement. These response rate changes occurred regardless of whether the rate of reinforcement concomitantly decreased or increased.     

Second-order schedules with paired auditory brief stimuli

Pigeons were exposed to multiple second-order schedules of paired and unpaired brief stimuli in which responding on the main key was reinforced according to a fixed-interval thirty-second schedule by a brief stimulus (a tone in the paired schedule) and advancement to the next segment of the second-order schedule. In Experiment 1, a response on the second key was required during the tone in its fourth and final presentation to produce food. Responses during earlier brief stimuli indicated the extent to which the final brief stimulus was discriminated from preceding ones. Responding was comparable during all tones, extending prior findings with visual paired brief stimuli and weakening explanations of subjects' failure to discriminate between brief-stimulus presentations in terms of elicited responding. In Experiment 2 the number of fixed-interval segments comprising the second-order schedules varied from one through eight. Although main-key response rates increased across segments in both experiments, they increased much less sharply with a variable number of segments. These results suggest that the increase in main-key response rates across segments is due primarily to a degree of temporal discrimination not reflected on the second key. Main-key response rates were higher on paired auditory brief-stimulus schedules than on unpaired visual brief-stimulus schedules, especially in Experiment 2, thus further extending findings with visual brief stimuli to second-order schedules with auditory brief stimuli.     

Conditioned reinforcement as a function of duration of stimulus

Pigeons were provided with three keys. Pecking the center key produced grain on a schedule that alternated at unpredictable times between a variable-interval component and extinction. On concurrent variable-interval schedules, pecking either side key produced a stimulus associated with the variable-interval component on the center key provided that said schedule was currently in effect. The independent variable was the length of time this stimulus remained on the keys. Pecking one side key produced the stimulus for 27 seconds, whereas the duration produced by pecking the other key varied for successive blocks of sessions. For the first four birds, the values tested were 3, 9, 27, and 81 seconds. For the second group, numbering three birds, the values tested were 1, 3, 9, and 27 seconds. The dependent variable was the proportion of total side key pecks that occurred on the variable key. For all birds, the function was positive in slope and negative in acceleration. This finding supports a formulation that ascribes the maintenance of observing responses in a normal setting to the fact that the subject exposes itself to the positive discriminative stimulus for a longer mean duration than it does to the negative stimulus.     

Effects of instructional constraints on human fixed-interval performance

Several groups of human subjects were exposed to a variety of experimental conditions involving a fixed-interval 27-second schedule of reinforcement in compound with instructions to constrain in the number of responses within the interreinforcement interval and/or the duration of the experimental session. One group was further exposed to a contingency involving the placement of responses within the IRI. A diversity of patterns of performance was observed, including those typically associated with animal subjects exposed to FI schedules. Generally, the imposition of instructions to minimize session duration reduced post-reinforcement pausing and increased overall reinforcement density from those levels obtained with only instructions to expend a given number of responses per reinforcer. The results are seen to underscore the sensitivity of human fixed-interval performance and the contribution of extra-experimental contingencies.     

Differential effects of fixed- and variable-time feedback on production rates of elementary school children

The performance of 26 third-grade students who worked on individual weekly academic tasks was compared under fixed- and variable-time "home reports". During fixed-time home reports, each student was given a report to take home on Friday that indicated the quantity of work the student had completed that week, contained comments concerning the quality of the work, and had a space for parental remarks and signature. The same report was given during the variable-time reports, except that seven to nine students were randomly selected each day to receive a home report. During variable-time reporting, students completed more assignments and completed assignments on a greater percentage of available workdays than during fixed-time reporting. The teachers' preference for the variable-time reporting was one additional advantage for the variable system.     

Behavioral adaptation to fixed-interval and fixed-time food delivery in golden hamsters

Food-deprived golden hamsters in a large enclosure received food every 30 sec contingent on lever pressing, or free while their behavior was continuously recorded in terms of an exhaustive classification of motor patterns. As with other species in other situations, behavior became organized into two main classes. One (terminal behaviors) increased in probability throughout interfood intervals; the other (interim behaviors) peaked earlier in interfood intervals. Which class an activity belonged to was independent of whether food was contingent on lever pressing. When food was omitted on some of the intervals (thwarting), the terminal activities began sooner in the next interval, and different interim activities changed in different ways. The interim activities did not appear to be schedule-induced in the usual sense. Rather, the hamsters left the area of the feeder when food was not due and engaged in activities they would normally perform in the experimental environment.