Uncertainty reduction, conditioned reinforcement, and observing

In a concurrent-chains procedure, pigeons chose between equivalent mixed and multiple fixed-interval schedules of reinforcement. In the first experiment, preference for the multiple schedule was higher when the probability of the shorter fixed interval was less than .50 than for complementary points, an outcome consistent with the delay-reduction hypothesis of conditioned reinforcement and observing, but inconsistent with the uncertainty-reduction hypothesis which requires symmetrical preferences with a maximum when the two intervals are equiprobable. A second experiment assessed preference for equivalent mixed and multiple schedules when each choice outcome resulted in two reinforcements, one on the longer and one on the shorter fixed interval. The order of the two fixed intervals was determined probabilistically. Pigeons again preferred multiple to mixed schedules, although multiple-schedule preference did not vary systematically with the likelihood of the shorter fixed interval occurring first. The results from these choice procedures are consistent with those from the observing-response literature in suggesting that the strength of a stimulus cannot be well described as a function of the degree of uncertainty reduction the stimulus provides about reinforcement.     

Psychophysics of key-peck duration in the pigeon

The duration of the pigeon's key peck was differentially reinforced in either a trials or a free-operant procedure. Mean emitted peck duration was a power function of the duration required for food delivery to occur. The exponents of the power function differed considerably from those observed in earlier research involving longer duration responses in pigeons and other species. The coefficients of variation also did not correspond with those of the earlier research on other responses, nor did consideration of the durations actually reinforced resolve the differences. Duration was neither a function of response rate nor of intermittency of reinforcement. Key-peck duration was changed in an orderly way by differential reinforcement. However, it appeared to be more strongly determined by its duration in the absence of differential reinforcement than were longer duration responses.     

A comparison of ratio and interval reinforcement schedules with comparable interreinforcement times

Pigeons were trained to peck keys on fixed-ratio and fixed-interval schedules of food reinforcement. Both schedules produced a pattern of behavior characterized as pause and run, but the relation of pausing to time between reinforcers differed for the two schedules even when mean time between reinforcers was the same. Pausing in the fixed ratio occupied less of the time between reinforcers for shorter interreinforcer times. For two of three birds, the relation was reversed at longer interreinforcer times. As an interreinforcer time elapsed, there was an increasing tendency to return to responding for the fixed interval, but a roughly constant tendency to return to responding for the fixed-ratio schedule. In Experiment 1 these observations were made for both single-reinforcement schedules and multiple schedules of fixed-ratio and fixed-interval reinforcement. In Experiment 2 the observations were extended to a comparison of fixed-ratio versus variable-interval reinforcement schedules, where the distribution of interreinforcement times in the variable interval approximated that for the fixed ratio.     

Maintenance of responding by squirrel monkeys under a concurrent shock-postponement, fixed-interval shock-presentation schedule.

A chain-pulling response was initially developed under a shock-postponement (avoidance) schedule with two squirrel monkeys. Few responses occurred on a lever where responding initially had no scheduled consequence or, subsequently, when a 3-minute fixed-interval shock-presentation schedule was concurrently arranged for lever responses. Appropriate rates and patterns of lever responding developed and were later maintained under the fixed-interval 3-minute shock-presentation schedule alone when the chain and shock-postponement schedule were removed. When both the shock-postponement and shock-presentation schedules were again simultaneously in effect, steady rates of chain pulling were maintained by the shock-postponement schedule and positively accelerated rates and patterns were maintained on the lever by the shock-presentation schedule. Response rates under both schedules were directly related to shock intensity. A history of exposure to a shock-postponement schedule, even though with a topographically different response and manipulandum, was sufficient for the development and eventual maintenance of responding by the presentation of shock. Further, differential performances can be maintained simultaneously by the presentation and postponement of electric shock.     

Reinforcement of human observing behavior by a stimulue correlated with extinction or increased effort

Young men pulled a plunger on mixed and multiple schedules in which periods of variable-interval monetary reinforcement alternated irregularly with periods of extinction (Experiment 1), or in which reinforcement was contingent on different degrees of effort in the two alternating components (Experiment 2). In the baseline conditions, the pair of stimuli correlated with the schedule components could be obtained intermittently by pressing either of two observing keys. In the main conditions, pressing one of the keys continued to produce both discriminative stimuli as appropriate. Pressing the other key produced only the stimulus correlated with variable-interval reinforcement or reduced effort; presses on this key were ineffective during periods of extinction or increased effort. In both experiments, key presses producing both stimuli occurred at higher rates than key presses producing only one, demonstrating enhancement of observing behavior by a stimulus correlated with the less favorable of two contingencies. A control experiment showed that stimulus change alone was not an important factor in the maintenance of the behavior. These findings suggest that negative as well as positive stimuli may play a role in the conditioned reinforcement of human behavior.     

DIFFERENTIAL REINFORCEMENT OF CORRECT RESPONSES TO PROBES AND PROMPTS IN PICTURE-NAME TRAINING WITH SEVERELY RETARDED CHILDREN

A systematic sequence of prompt and probe trials was used to teach picture names to three severely retarded children. On prompt trials the experimenter presented a picture and said the picture name for the child to imitate; on probe trials the experimenter did not name the picture. A procedure whereby correct responses to prompts and probes were nondifferentially reinforced was compared with procedures whereby correct responses to prompts and probes were differentially reinforced according to separate and independent schedules of primary reinforcement. In Phase 1, correct responses to prompts and probes were reinforced nondifferentially on a fixed ratio (FR) 6 or 8 schedule; in Phase 2, correct responses to prompts were reinforced on the FR schedule and correct responses to probes were reinforced on an FR schedule of the same value; in Phase 3, correct responses to prompts were reinforced on the FR schedule and correct responses to probes were reinforced on a continuous reinforcement (CRF; every correct response reinforced) schedule; in Phase 4, correct responses to prompts were reinforced on a CRF schedule and correct responses to probes were reinforced on the FR schedule; in Phase 5, a reversal to the conditions of Phase 3 was conducted. For all three children, the FR schedule for correct responses to prompts combined with the CRF schedule for correct responses to probes (Phases 3 and 5) generated the highest number of correct responses to probes, the highest accuracy (correct responses relative to correct responses plus errors) on probe trials, and the highest rate of learning to name pictures.     

Contrast effects in multiple fixed-interval reinforcement schedules

Pigeons were exposed to a multiple fixed-interval one-minute fixed-interval three-minute schedule of reinforcement following training on either a multiple fixed-interval one-minute fixed-interval one-minute schedule or a multiple fixed-interval three-minute fixed-interval three-minute schedule. For all birds, large negative local contrast effects developed during the first of four three-minute intervals in a component; response rate was depressed and postreinforcement pause lengthened in this interval. Positive local contrast effects were evident during the first of 12 one-minute intervals in a component for five of six birds; at asymptote, the pause was very short and response rate slightly elevated during this interval. Overall positive contrast was generally transient and varied considerably across subjects, while overall negative contrast effects, if they occurred, appeared only after a large number of sessions.     

Conditioned reinforcement and discrimination in second-order schedules

Pigeons were exposed to multiple second-order schedules in which responding on the “main key” was reinforced according to either a variable-interval or fixed-interval schedule by production of a brief stimulus on the “brief-stimulus key”. A response was required to the brief stimulus during its fourth (final) presentation to produce food; responses to the earlier brief stimuli indicated the extent to which the final brief stimulus was discriminated from preceding ones. Main-key response rates were higher in early components of paired brief-stimulus schedules, in which each brief stimulus was the same as that paired with reinforcement, than in comparable unpaired brief-stimulus or tandem schedules. Poor discrimination occurred between paired brief stimuli (Experiment I). When chain stimuli on the main key induced a discrimination between the first two and second two brief stimuli, the response-rate enhancement in the paired brief-stimulus schedule persisted (Experiment II). Rate enhancement diminished when the initial link of the chain included the first three components (Experiment IV). Eliminating the contingency between responding and brief-stimulus production also diminished rate enhancement (Experiment III). The results show that the discriminative and conditioned reinforcing effects of food-paired brief stimuli may be selectively manipulated and suggest that the reinforcing effects are modulated by other reinforcers in the situation.     

Avoidance based on shock intensity reduction with no change in shock probability

Rats were trained on a free-operant avoidance procedure in which shock intensity was controlled by interresponse time. Shocks were random at a density of about 10 shocks per minute. Shock probability was response independent. As long as interresponse times remained less than the limit in effect, any shocks received were at the lower of two intensities (0.75 mA). Whenever interresponse times exceeded the limit, any shocks received were at the higher intensity (1.6 mA). The initial limit of 15 seconds was decreased in 3-second steps to either 6 or 3 seconds. All animals lever pressed to avoid higher intensity shock. As the interresponse time limit was reduced, the response rate during the lower intensity shock and the proportion of brief interresponse times increased. Substantial warmup effects were evident, particularly at the shorter interresponse-time limits. Shock intensity reduction without change in shock probability was effective in the acquisition and maintenance of avoidance responding, as well as in differentiation of interresponse times. This research suggests limitations on the generality of a safety signal interpretation of avoidance conditioning.     

Schedule-induced drinking as functions of interpellet interval and draught size in the Java macaque

Three Java monkeys received food pellets that were assigned by both ascending and descending series of fixed-time schedules whose values varied between 8 and 256 seconds. The draught size dispensed by a concurrently available water-delivery tube was systematically varied between 1.0 and 0.3 milliliter per lick at various fixed-time values during the second and third series determinations. Session water intake was bitonically related to the interpellet interval and was determined by the interaction of (1) the probability of initiating a drinking bout, which fell off at the highest interpellet intervals and, (2) the size of the bout, which increased directly with increases in interpellet interval. Variations in draught size had little effect on total session intakes, but reduced bout size at draught sizes of 0.5 milliliter and below. Thus, a volume-regulation process of schedule-induced drinking operated generally at the session-intake level, but was limited to higher draught sizes at the bout level.