Operant conditioning of autogrooming in vervet monkeys: Cercopithecus aethiops

Vervet monkeys received food reinforcement contingent on autogrooming. Experiment 1 reinforced grooming on a schedule of increasing intermittency and grooming increased in frequency and duration; with only pauses reinforced, grooming decreased in frequency and duration. Experiment 2 demonstrated differentiation of operant autogrooming; in each session a different single form of grooming was reinforced (for example, grooming the tail only), and that form increased in frequency while other forms became less frequent. In Experiment 3 scratching was succesfully conditioned with a method that selectively reinforced variety in behavior; reinforcement was contingent on a shift in scratching form. In Experiment 4, with no contingencies on grooming, a prefood stimulus did not increase autogrooming whether or not grooming had previously resulted in contingent reinforcement. The form of conditioned autogrooming resembled the form of unconditioned autogrooming. The discussion suggests how reinforcement principles can account for changes in the topography of operant behavior.     

The sleeping giant: Reinforcement schedules

Schedule research has been the core of operant conditioning, but it is no longer an active area, at least with respect to its traditional focus of describing and explaining moment-to-moment behavior. Yet schedules are central in psychology: Not only do they establish lawful behavior, but they also play a major role in determining the effects of other variables. The reason for the decline appears to be primarily theoretical, in that the work seems not to have led to meaningful integration. The search for controlling variables brought into play by schedule specification has proven unsuccessful, and a catalog of all possible schedule effects is of limited interest. The paper reviews the reasons for the contemporary state of affairs. One prediction about future developments is that instead of revealing component variables and their modes of interaction, schedule effects will be treated as basic empirical laws. Theory will take the form of abstract statements that integrate these separate laws by reference to higher-order principles rather than by reduction to supposedly simpler component variables.     

Separating response dependency and response-reinforcer contiguity within a recycling conjunctive schedule

A procedure is described which disrupts response-reinforcer contiguity and response dependency and which demonstrates how the location of the response dependency in interval schedules can be regarded as a controlling variable in its own right. Rats' lever pressing produced sucrose on a recycling conjunctive fixed-time 30-second fixed-ratio 1 schedule of reinforcement. Reinforcement occurred only at the end of the fixed-time component on this schedule and only if a response had occurred during that component. This produced a pause-respond-pause pattern during the interreinforcer interval for all animals. When the location of the response dependency was then restricted to a 10-second period in the middle of the fixed-time component, the pattern was accentuated and response rates increased for all animals, while postreinforcement pauses decreased sharply for two animals. When responding was required in the first 10 seconds of the fixed-time component, responding peaked earlier in the interval for all animals. Response rates were slightly below those in the previous conditions, while postreinforcement pauses were between 2 and 6 seconds across animals.     

The effects of varying the distribution of generalization stimuli within a constant range upon the bisection of a sound-intensity interval by rats

Two male, albino rats were trained on a two-valued, self-paced, discrete-trials auditory discrimination. In the presence of a high-intensity stimulus (90 decibels SPL, 4 kiloHertz), response A was reinforced; in the presence of a low-intensity stimulus (50 decibels SPL, 4 kiloHertz), response B was reinforced. When discrimination performance was asymptotic, stimuli intermediate in intensity were presented with the training stimuli in a maintained generalization paradigm. Generalization gradients were derived from the relative frequencies of response A in the presence of each stimulus. A relative frequency of 0.50 was then determined and used as the bisection point of the intensity interval defined by the 90- and 50-decibel stimuli. The bisection point varied with the distribution of the stimuli presented in generalization. This effect was similar to context effects seen in human psychophysics.     

Discriminative properties of briefly presented stimuli

In Experiment I, pigeons' responses produced food according to a fixed-interval schedule while responses on the key also produced brief stimuli according to a variable-interval schedule. Each brief stimulus reset the fixed interval. Thus, a brief stimulus occurred irregularly but a fixed minimum time separated the occurrence of food from a brief stimulus. Pauses followed brief stimuli and were followed by an accelerated response rate until another brief stimulus or food occurred. In Experiment II, four control procedures were examined. (1) Brief-stimulus presentations were omitted, producing a loss of response patterning. (2) A second-order schedule was studied with fixed-interval components. This schedule produced patterning following brief stimuli similar in kind and degree to that found in Experiment I. (3) A conjoint schedule was arranged in which food was no longer separated from the stimulus by a fixed time; pauses following the stimulus no longer resulted. (4) A brief food reinforcer replaced the brief visual stimulus, resulting in a constant response rate with no pausing following the brief food stimulus. The results suggest that the brief-stimulus effects were due to discriminative functions produced by the fixed temporal relation separating the stimulus from food.     

Successive discrimination training with equated reinforcement frequencies: failure to obtain behavioral contrast

In two experiments, pigeons were trained on two-component multiple schedules in which responding in one component (S₁) was always maintained by a variable-interval schedule. In Experiment I, low response rates were reinforced in the second (S₂) component for six master subjects. This schedule was adjusted to equate reinforcement frequencies in the two components. These subjects were compared to yoked partners, for which reinforcement in the S₂ component was made available on a variable-interval schedule whose value was determined by the master subjects. A similar procedure was used in Experiment II, where the S₂ schedule for master subjects made reinforcers contingent on the absence of responding. No evidence was found in either experiment for a behavioral contrast effect in the S₁ component attributable to response reduction in the S₂ component. A reliable contrast effect was obtained from a group of pigeons given extinction conditions in the S₂ component, which was compared to a group maintained throughout on a multiple variable-interval schedule. The results suggest that previous indications of behavioral contrast in similar situations were probably caused by uneven reinforcement distributions or reflect uncontrolled fluctuations in response rates.     

Factors influencing responding under multiple schedules of conditioned and unconditioned reinforcement

Two experiments examined pigeons' responses under multiple schedules of conditioned and unconditioned reinforcement. In one component, responses produced food according to a fixed-interval schedule; in a second component, responses produced brief stimuli according to a fixed-ratio schedule. When brief-stimulus presentations were paired with food in the first component, rates in the second component were usually higher than 10 responses per minute. When pairing in the first component was eliminated, responding continued to be maintained in the second component. Elimination of food presentation from the first component substantially decreased responding in the second component, even though the brief stimulus had not been paired with food. Experiment II demonstrated that response rate was affected by the duration of both the second component and the brief stimulus. The results suggest that three conditions are important in maintaining responding with brief-stimulus presentations: (1) pairing the brief stimulus, at least initially, with food, (2) maintaining unconditioned reinforcement in one component, and (3) employing optimal brief-stimulus and component durations.     

Fixed versus variable sequences of food and stimulus presentation in second-order schedules

Three pigeons were exposed to a second-order schedule in which the behavior specified by a fixed-interval component schedule was reinforced according to a ratio overall schedule. The completion of components not followed by food was signalled by a brief stimulus never paired with food. Food and the stimulus occurred in a random sequence or in fixed alternation, but the overall schedules (variable ratio 2 or fixed ratio 2) ensured that an equal number of food and brief-stimulus presentations occurred in each session. The control exerted by the food and by the brief stimulus was measured by overall response rates, mean pauses, frequency distributions of pauses, and response patterning across components. In general, the stimulus controlled patterns of behavior more similar to those controlled by food when food and the stimulus occurred in a random sequence than when they occurred in fixed alternation.     

Conjunctive schedules of response-dependent and response-independent reinforcement

Pigeons received food when they emitted the number of responses specified by a fixed-ratio schedule, and the time specified by a fixed-time schedule had elapsed. The order of meeting the response and time requirements was irrelevant. In different conditions, stimuli signalled completion of one, both, or neither requirement. Ratio size interacted with stimulus condition to determine performance. When a stimulus signalled the end of the fixed-time period, under all ratios the birds tended to respond after the stimulus appeared. When stimuli followed both components, small ratios produced responding during the fixed-time period, and other ratios resulted in responses after the time period had elapsed. With either no stimulus changes, or with a stimulus correlated with completion of the ratio alone, responding first increased and then decreased as the ratio increased. Low and high ratios produced stable response frequencies and patterns in successive intervals. Intermediate ratios resulted in two types of performance. Intervals with long initial pauses and few responses during the fixed-time period were followed by intervals with short pauses and numerous responses and vice versa. The source of these dynamic effects was hypothesized to be number of responses per reinforcer in one condition and response-reinforcer contiguity in the other.     

Dynamic effects of food magnitude on interim-terminal interaction

We tested the assumption of a facilitatory relation between periodic food presentation and schedule-induced drinking by examination of (a) elicited drinking, (b) drinking in anticipation of food delivery, and (c) possible indirect effects of food delivery on drinking. We exposed rats to a fixed-time 60-second schedule in which interfood intervals ended in either one or four food pellets with equal probability. In Phases 1 and 3, a stimulus signaled the magnitude of upcoming food presentation. In Phase 2, the stimulus was eliminated. Changes in drinking and “head-in-feeder” distributions within interfood intervals demonstrated that head-in-feeder was controlled directly by food presentation, but drinking was not. Head-in-feeder increased and drinking was reduced when large meals began or ended an interval. In Phases 4 to 6, meal size was manipulated across sessions yielding a positive relation between meal size and schedule-induced drinking. We conclude: (1) Schedule-induced drinking is determined by distributions of food-related behavior and results from indirect effects of food delivery; and (2) the amount of schedule-induced drinking and the form of the drinking distributions in this experiment can be accurately explained by two assumptions: (a) Food presentation facilitates food-related behavior through elicitation and anticipation; and (b) food-related behavior and drinking are reciprocally, linearly related.