Preference for mixed versus constant delays of reinforcement: Effect of probability of the short, mixed delay

Preference for mixed versus constant delays of reinforcement was studied with a concurrent-chain procedure. Lever pressing by rats in concurrently available variable-interval 60-second initial links occasionally produced mutually exclusive terminal-link reinforcement delays. A constant delay of reinforcement (either 15 seconds or 30 seconds) composed one terminal link and mixed delays (.2 second and twice the value of the constant delay) were arranged in the other terminal link. The proportion of .2-second delays in the mixed-delay terminal link took on values of 0, .1, .25, .5, .75, .9, and 1.0 over experimental conditions. Based on relative rates of responding in the initial links, preference for the mixed delays was a negatively accelerated function of the proportion of short, mixed delays. Three of five rats preferred the mixed delays to the constant delays when the proportion of short, mixed delays was .1 or higher, and all five rats preferred the mixed delays when the proportion of short, mixed delays was .25 or higher. Neither Squires and Fantino's (1971) delay-reduction model of choice nor a model based on the harmonic mean reinforcement delay provided a close estimate of choice proportions over the range of short-delay proportions studied. The delay-reduction model underestimated choice for the mixed delays at low and intermediate proportions of short delays, and the harmonic-mean-delay model overestimated choice for the mixed delays at intermediate and high proportions of short delays.     

The microanalysis of fixed-interval responding

The fixed-interval schedule of reinforcement is one of the more widely studied schedules in the experimental analysis of behavior and is also a common baseline for behavior pharmacology. Despite many intensive studies, the controlling variables and the pattern of behavior engendered are not well understood. The present study examined the microstructure and superstructure of the behavior engendered by a fixed-interval 5- and a fixed-interval 15-minute schedule of food reinforcement in the pigeon. Analysis of performance typical of fixed-interval responding indicated that the scalloped pattern does not result from smooth acceleration in responding, but, rather, from renewed pausing early in the interval. Individual interresponse-time (IRT) analyses provided no evidence of acceleration. There was a strong indication of alternation in shorter-longer IRTs, but these shorter-longer IRTs did not occur at random, reflecting instead a sequential dependency in successive IRTs. Furthermore, early in the interval there was a high relative frequency of short IRTs. Such a pattern of early pauses and short IRTs does not suggest behavior typical of reinforced responding as exemplified by the pattern found near the end of the interval. Thus, behavior from clearly scalloped performance can be classified into three states: postreinforcement pause, interim behavior, and terminal behavior.     

Reaction times of younger and older men and temporal contingencies of reinforcement

Influences of extended training and temporal contingencies on reaction time were studied in relation to developmental differences. Older and younger men were trained on a chained schedule in which completion of a variable interval produced a terminal link in which reaction time was measured. The reaction-time procedure involved a conditional discrimination with matching to sample in one component and oddity matching in the other. During baseline training, no time limit was placed on the response to the discrimination choice stimuli. Subsequently, increasingly severe time limits were imposed over a series of sessions. Older and younger men showed increased speeds (decreased reaction times) when temporal contingencies were imposed, and these changes were maintained during post-training baseline sessions when there was unlimited time in which to respond. The younger men generally responded faster than the older ones, and age differences were not appreciably reduced during the course of the experiment. The results indicated the feasibility of studying reaction time in human subjects using operant procedures analogous to those developed for the study of nonverbal organisms.     

Tolerance to and residual effects of cocaine in squirrel monkeys depend on reinforcement-schedule parameter.

Lever pressing by 4 squirrel monkeys was maintained under a three-component multiple fixed-ratio schedule of food presentation; components differed with respect to ratio size. For each monkey, acute administration of cocaine (0.03 to 1.3 mg/kg, i.m.) produced dose-dependent decreases in overall response rate in each component. During repeated daily administration of 1.0 mg/kg of cocaine, tolerance developed to the rate-decreasing effects under each of the ratio contingencies, but developed to a greater extent and was evident in earlier parts of sessions for performance under the smaller ratios. Response rates of 2 monkeys increased above nondrug control levels despite the putative reinforcer not being consumed during the session. When saline or a smaller dose of cocaine was substituted for 1.0 mg/kg, response rates often were suppressed below nondrug control-level responding. This suppressive effect was observed in each monkey and was more likely to be observed and/or to be of greater magnitude in large-ratio components for 3 of the 4 monkeys. When saline was administered chronically at the end of the chronic-drug phase, response rates remained suppressed in the large-ratio component for 2 of the monkeys. There was, therefore, a schedule-dependent dissociation between behavioral tolerance and the residual effects: Tolerance was greater when small ratios were arranged, whereas the residual effects were more pronounced when larger ratios were arranged.     

Sensory superstition on multiple interval schedules.

Pigeons were exposed to multiple schedules in which an irregular repeating sequence of five stimulus components was correlated with the same reinforcement schedule throughout. Stable, idiosyncratic, response-rate differences developed across components. Components were rank-ordered by response rate; an approximately linear relation was found between rank order and the deviation of mean response rate from the overall mean rate. Nonzero slopes of this line were found for multiple fixed-interval and variable-time schedules and for multiple variable-interval schedules both when number of reinforcements was the same in all components and when it varied. The steepest function slopes were found in the variable schedules with relatively long interfood intervals and relatively short component durations. When just one stimulus was correlated with all components of a multiple variable-interval schedule, the slope of the line was close to zero. The results suggest that food-rate differences may be induced initially by different reactions to the stimuli and subsequently maintained by food.     

An experimental analysis of the effects of d-amphetamine and cocaine on the acquisition and performance of response chains in monkeys.

In one component of a multiple schedule of food presentation, monkeys acquired a different four-response chain each session by responding sequentially on three keys in the presence of four geometric forms (learning). In the other component, the four-response chain was the same each session (performance). Both d-amphetamine and cocaine, at the higher doses, disrupted the behavior in the learning component; the overall response rate decreased, the overall accuracy was impaired (i.e., percent errors increased), and there was less within-session error reduction. The performance component was generally less sensitive than the learning component to the disruptive effects of both drugs on rate and accuracy. After pre-feeding or during an extended session, the response rate decreased in both components, but accuracy was generally unaffected. When the four discriminative stimuli in both components were removed, the behavior was disrupted to a greater extent in the performance component. The disruptive effects of both drugs on behavior in the learning component were attenuated when the drugs were administered during the session after the response chain had been acquired. It was concluded that the greater sensitivity of the learning component to disruptive drug effects is related to the relatively weak stimulus control and/or the lower rate of reinforcement associated with that component.     

Schedule-induced locomotor activity in humans.

In two experiments, humans received tokens either on a fixed-interval schedule for plunger pulling or various response-nondependent fixed-time schedules ranging from 16 to 140 seconds. Locomotor activity such as walking, shifting weight, or pacing was recorded in quarters of the interreinforcement interval to examine the induced characteristics of that behavior in humans. While performance was variable, several characteristics were present that have counterparts in experiments with nonhumans during periodic schedules of food reinforcement: (a) first quarter rates, and sometimes overall rates, of locomotor activity were greater during intervals that terminated in a visual stimulus and token delivery than those without: (b) overall rates of locomotor activity were greater during fixed-time 16-second schedules than during fixed-time 80- or 140-second schedules; (c) rates of locomotor activity decreased during the interreinforcement intervals; (d) locomotor activity was induced by response-dependent and response-nondependent token delivery. These results showed that the rate and temporal pattern of locomotor activity can be schedule-induced in humans.     

EFFECTS OF DIRECT,INTERMITTENT, AND VICARIOUS REINFORCEMENT PROCEDURES ON THE DEVELOPMENT AND MAINTENANCE OF INSTRUCTION-FOLLOWING BEHAVIORS IN A GROUP OF YOUNG CHILDREN1

A group of young children (mean age: 2.5 yr) were instructed to follow different requests by a teacher in a day-care setting. Experiment I verified that mean group instruction following was low (10%) despite the opportunity for “observational learning”, i.e., the group of 12 children could watch a nonreinforced adult comply with the teacher's request. In Experiment II, when positive consequences were provided contingent on the adult model's behavior, mean group instruction following was relatively unaffected (14%). When direct reinforcement was given to four peer models, each for several sessions, the individual performances of three of the four peer models was elevated (from 50% to 80%); however, the mean performance of the remaining nonreinforced children (N = 7) was only moderately affected (21%). When reinforcement contingencies were again changed, so that each group member was provided direct, but intermittent reinforcement, mean group performance increased substantially to levels of over 70%. Once instruction following was high, presentation of reinforcement only to one peer model sufficed to maintain performance whereas earlier, this same vicarious reinforcement procedure had failed to establish group compliance. The maintenance of instruction-following behavior when reinforcement was applied solely to one child was interpreted mainly in terms of a high resistance to extinction following a history of intermittent reinforcement rather than a “vicarious”- or “self”-reinforcement mechanism. Finally, removal and re-introduction of group intermittent reinforcement, respectively, lowered performance (to levels of 40%) and elevated (to levels of 65%) the group's performance.     

Concurrent schedules: a quantitative relation between changeover behavior and its consequences

Data from several published experiments on concurrent variable-interval schedules were analyzed with respect to the effects of changeover delay on the time spent responding on a schedule before changing to an alternate schedule: i.e., the interchangeover time. Interchangeover time increases as the duration of the changeover delay increases, and the present analysis shows that a power function describes the relation. The power relation applied in spite of numerous differences in the experiments: different variable-interval schedules for the concurrent pairs; equal or unequal reinforcement rates for the schedules of the concurrent pairs; different durations of the changeover delay; response-dependent or response-independent reinforcers; pigeons or rats as subjects; different reinforcers. A power function also described the data in experiments where the changeover incurred a timeout, where a fixed ratio was required to changeover, and also when asymmetrical changeover delays were used.     

Spaced food but not electrical brain stimulation induces polydipsia and air licking.

An attempt was made to induce polydipsia in rats whose lever pressing was reinforced with food pellets or electrical brain stimulation. Nine food-deprived, water-sated rats drank water excessively during sessions in which food pellets were delivered. When brain stimulation was substituted for food, drinking immediately ceased. Delivering brain stimulation according to a variety of schedules, pairing brain stimulation with food reinforcement, and substituting an air stream for water, each failed to produce polydipsic licking. These results show that polydipsia is not induced by all reinforcers.