Effects of pairing stimuli with reinforcement on multiple schedule performance of children

A nonsense word was paired with reinforcement to determine if pairing affected emission of a response that produced the word in the signalled absence of reinforcement. Children were trained on a multiple schedule that consisted of a reinforcement component, conditioned reinforcement component, and control component, each set of contingencies being signalled by a different colored light. In the primary reinforcement component, lever presses produced reinforcers which, in some phases, were paired with a word. In the other two components, lever presses were not reinforced and a button was made accessible. Button presses in the conditioned reinforcement component produced the word to be (or being) paired, e.g., "yafeh", while button presses in the control component produced another word, e.g., "grunch". Button pressing increased when one of the words was being paired and decreased when pairing was discontinued, but directly related rate changes occurred also in the control component. The order of components was shown to be a contributing variable.     

Time-dependent contrast effects in a multiple schedule of food reinforcement

Four rats were rewarded for running in a wheel under two alternating conditions of food reinforcement. These periods of frequent and infrequent reinforcement, each accompanied by a particular stimulus, were presented a number of times in each daily session. Following shifts from high to low frequency of reinforcement, responding decreased suddenly and markedly, and then recovered within the next few minutes. The magnitude of this temporary depression was an increasing function of the duration of the immediately preceding component of high-frequency reinforcement. A transient elevation in performance, which did not vary with the duration of the prior component, was noted in two subjects following shifts from low to high frequency of reinforcement. The elevation and depression effects did not appear simultaneously during the 48 experimental sessions. A possible relation between the difficulty of the discrimination and the extent of contrast effects is discussed.     

Fixed-time schedule effects as a function of baseline reinforcement rate

Using an arbitrary response, we evaluated fixed-time (FT) schedules that were either similar or dissimilar to a baseline (response-dependent) reinforcement schedule and extinction. Results suggested that both FT schedules and extinction resulted in decreased responding. However, FT schedules were more effective in reducing response rates if the FT reinforcer rate was dissimilar to baseline reinforcer rates. Possible reasons for this difference were evaluated with data analysis methods designed to identify adventitious response-reinforcer relations.     

Delayed reinforcement in a multiple schedule

Three rats and a pigeon were first trained on a two-component multiple schedule in which reinforcement in the two components occurred immediately after a response. Later, reinforcement in one component was delayed by a few seconds. During both stages of the experiment, reinforcement was scheduled by equal variable- (pigeon) or random-interval (rats) schedules in the two components. The main effect of the delayed reinforcement was to increase the rate of responding in the unchanged (non-delay) component. This behavioral contrast effect did not appear in all cases to be dependent upon a reduction in the rate of responding or the frequency of reinforcement in the delay component. This finding suggests that a reduction in response rate and/or reinforcement frequency in one component of a multiple schedule may not be a necessary prerequisite for the occurrence of behavioral contrast. This finding is, however, consistent with an explanation that suggests that behavioral contrast results from the introduction of a less-preferred condition in one component of a multiple schedule, since it is known that animals “prefer” immediate to delayed reinforcement.     

Escape from SD associated with fixed-ratio reinforcement

Throughout ascending and descending fixed-ratio (FR) sequences, rats were allowed to terminate the FR stimulus control by pressing a time-out (TO) lever. To minimize chance or accidental responses on this second lever, three presses were required to produce the 30-sec S^Δ period. As FR performance became more “strained,” there was an increased predisposition to escape from the time-in stimulus complex. The generality of this finding was extended by obtaining recoverability (independent of the direction of stimulus change) of the FR-TO function in the descending series. Typically, escapes were produced only during the post-reinforcement pause; however, under a mixed FR FR schedule, their occurrence shifted to a point within the inter-reinforcement interval corresponding to the unreinforced completion of the lower ratio component. It appears that the point where the rat can discriminate the size of the ratio requirement will be the place where TOs are imposed. This inference was supported by a substantial increase in TO frequency accompanying a shift from CRF to extinction on the FR lever. Finally, the escape lever was placed on a progressively increasing FR schedule and later extinguished to demonstrate that the TO condition was in fact reinforcing.     

Behavioral regulation of gravity: schedule effects under escape-avoidance procedures

Squirrel monkeys were restrained in a centrifuge capsule and trained to escape and avoid increases in artificial gravity. During escape-avoidance, lever responses reduced centrifugally simulated gravity or postponed scheduled increases. The effect of variation in the interval of postponement (equal to the duration of decrease produced by escape responses) was studied under a multiple schedule of four components. Three components were gravity escape-avoidance with postponement times of 20, 40, and 60 sec. The fourth component was extinction. Each component was associated with a different auditory stimulus. Rate of responding decreased with increasing postponement time and higher mean g-levels occurred at shorter intervals of postponement. Effects of the schedule parameter on response rate and mean g-level were similar to effects of the schedule on free-operant avoidance and on titration behavior maintained by shock.     

Aversive aspects of a schedule of positive reinforcement

Six male White Carneaux pigeons were trained to peck at one of two keys to obtain food on several fixed-ratio schedules of reinforcement. Concurrently, the first response on a second key could, I—change the conditions of visual stimulation and remove the food reinforcement contingency, II—change the conditions of stimulation and have no effect upon the reinforcement contingency, or III—do nothing. The second response on the stimulus change key always restored baseline conditions. When second-key responses produced a stimulus change, the number of such responses was a function of the ratio value on the first key. Typically, second-key responses occurred before the start of fixed-ratio runs. The duration of stimulus change periods was an exponential function of the number of responses required for reinforcement when the possibility for reinforcement was not disturbed by periods of stimulus change (Condition II).     

Response latency as a function of reinforcement schedule

Four Ss were trained to press and hold down a telegraph key in the presence of a light. Subsequent release of the key during a tone was followed by water reinforcement. The schedule of reinforcement for key release was varied, and its effects on the latency (RT) of key release to the tone were studied. Both median RT and variability of RT were found to be inversely related to frequency of reinforcement as determined by the schedule.     

The effects of schedule history and the opportunity for adjunctive responding on behavior during a fixed-interval schedule of reinforcement.

The effects of schedule history and the availability of an adjunctive response (polydipsia) on fixed-interval schedule performance were investigated. Two rats first pressed levers under a schedule of food reinforcement with an interresponse time greater than 11 s, and 2 others responded under a fixed-ratio 40 schedule. All 4 were then exposed to a fixed-interval 15-s schedule. Water was continuously available under these conditions, but after responding became stable on the fixed-interval schedule, access was experimentally manipulated. With water freely available, subjects did not display characteristic fixed-interval response rates and patterns (i.e., scalloping or break-and-run). Instead, they exhibited predictable, stable patterns of behavior as a function of their schedule histories: Subjects with the interresponse-time history exhibited low response rates, and those with the fixed-ratio history exhibited high rates. Manipulating the amount of water available resulted in marked changes in response rates for rats with the interresponse-time history but not for those with the fixed-ratio history. The results illustrate the multiple causation of behavior by its previous and current schedules of reinforcement and other concurrent factors.     

Aversive aspects of a fixed-interval schedule of food reinforcement

The key pecking of pigeons was reinforced according to a fixed-interval schedule of reinforcement. The pigeons were also given the opportunity to attack a restrained target pigeon. The attack rates during the sessions of fixed-interval reinforcement were higher than during the operant level sessions in four of the five pigeons. Most attack occurred during the post-reinforcement pause in key pecking. It was suggested that a fixed-interval schedule of positive reinforcement possesses aversive properties, the most aversive of which are located during the post-reinforcement pause.     

Behavioral contrast in one component of a multiple schedule as a function of the reinforcement conditions operating in the following component

The key pecks of four pigeons were reinforced on a variable-interval 5-min schedule which operated in each of the four components of a multiple schedule, indicated by red, green, yellow, and blue stimuli and presented in such an order that the red stimulus always preceded the yellow and the green stimulus always preceded the blue. After establishing baseline rates, the reinforcement schedule associated with the blue and yellow components was altered so that one was now an extinction schedule and the other was a variable-interval 1-min schedule. In a second experimental stage, the blue stimulus was interchanged with the yellow so that the red stimulus preceded the blue and the green stimulus preceded the yellow. In both experimental stages the response rate in the variable-interval 5-min component that preceded the extinction component was higher than the response rate in the variable-interval 5-min component that preceded the variable-interval 1-min component. The results were discussed in relation to the importance of stimulus ordering in experiments concerned with investigating behavioral contrast.     

Polydipsia induced by a schedule of brain stimulation reinforcement

Rats pressed a lever for a signaled brain stimulation reinforcement on either fixed-interval or fixed-ratio schedules. Both schedules induced polydipsia, with a median water intake of 22.5 ml (about four times the control level) in 3-hr sessions. The stimulation did not directly elicit drinking or other behaviors. In a second experiment, two out of four rats became polydipsic during extinction following a continuous schedule of brain stimulation reinforcement. The results were compared with previous attempts to induce polydipsia with a schedule of brain stimulation reinforcement and were discussed in terms of polydipsia as a model of human “compulsive” behaviors.     

Stimulus control of responding during a fixed-interval reinforcement schedule

During training sessions, pecks by pigeons on a response key illuminated by a vertical line of white light resulted in reinforcement and an ensuing blackout according to a fixed-interval schedule. Training sessions were followed by dimensional stimulus control test sessions during which the orientation of the line present throughout the fixed interval was varied. Inverted U-shaped (excitatory) gradients of responding, with maximum responding occurring in the presence of the vertical line, were observed during the terminal part of the fixed interval. U-shaped (inhibitory) gradients of responding, with minimum responding occurring in the presence of the vertical line, were observed during the early part of the fixed interval when the preceding interval had terminated with reinforcement and blackout but not when the preceding interval had terminated with blackout only. These results suggest that the dimensional control by the stimulus present throughout the fixed interval is of a conditional variety. Whether the fixed-interval stimulus exerts inhibitory or excitatory dimensional control depends upon the presence and absence, respectively, of stimuli associated with reinforcement.     

A response-initiated fixed-interval schedule of reinforcement

On a tandem fixed-ratio one fixed-interval schedule, the first response after reinforcement initiates a fixed interval of time and the first response after the interval has elapsed is reinforced. Pigeons trained with that schedule of food reinforcement paused after reinforcement for a period of time that approximated the fixed-interval duration for values of that duration ranging from 3.75 to 60 sec. Cumulative records revealed response patterns best described as break-and-run.