Conditional Reinforcers and Informative Stimuli in A Constant Environment

Five pigeons responded on steady-state concurrent variable-interval variable-interval schedules of food presentation in which half of the foods were removed and replaced with nonfood stimuli. Across conditions, the stimuli were either paired or unpaired with food, and the correlation between the ratio of food deliveries on the two alternatives and the ratio of nonfood stimuli was either −1, 0, or +1. Neither the pairing of stimuli with food, nor the correlation between stimuli and food, affected generalized-matching performance, but paired stimuli had a demonstrable effect at a local level of analysis. This effect was independent of the food–stimulus correlation. These results differ from results previously obtained in a frequently changing environment. We attribute this difference in results to differences in the information value of response-contingent stimuli in frequently changing versus relatively constant environments, as well as to differences between forward pairing and simultaneous pairing of the stimuli with food.     

CHANGES IN BLOOD PRESSURE AND HEART RATE DURING FIXED‐INTERVAL RESPONDING IN SQUIRREL MONKEYS

Episodic and sustained increases in heart rate and mean arterial blood pressure can occur with recurring patterns of schedule‐controlled behavior. Most previous studies were conducted under fixed‐ratio schedules, which maintained a consistent high rate of responding that alternated with periods of no responding during times when the schedule was not in operation. The present study examined changes in heart rate and blood pressure under fixed‐interval schedules which maintained a range of rates that varied from little or no responding at the beginning of the fixed interval to high rates at the end of the interval. The relations of cardiovascular function to rate of responding were examined. Squirrel monkeys prepared with arterial catheters were trained to respond under fixed‐interval schedules of electric‐shock presentation. The duration of the interval was varied across sessions and cardiovascular parameters were examined. Local rates of responding were typically near zero during timeout periods, low at the beginning of each fixed‐interval cycle, and then increased as the fixed interval progressed. At most schedule durations, arterial blood pressure and heart rate levels were lowest at the beginning of the interval cycles, increased as the rate of responding increased, and then decreased during the timeout periods. At all parameters studied, there was a direct relationship between changes in response rate within fixed‐interval cycles and changes in heart rate and blood pressure. The results suggest that a much closer concordance of these cardiovascular parameters and schedule‐controlled responding is obtained by examining ongoing behavior as it occurs within the contingencies by which it is maintained.     

Within-session changes in responding during several simple schedules

Pigeons' key pecking was reinforced by food delivered by several fixed-interval, variable-ratio, and differential-reinforcement-of-low-rate schedules. Rate of responding, number of responses per reinforcer, length of postreinforcement pause, running response rate, and the time required to collect an available reinforcer changed systematically within sessions when the schedules provided high rates of reinforcement, but usually not when they provided low rates. These results suggest that the factors that produce within-session changes in responding are generally similar for different schedules of reinforcement. However, a separate factor may also contribute during variable-ratio schedules. The results question explanations for within-session changes that are related solely to the passage of time, to responding, and to one interpretation of attention. They support the idea that one or more factors related to reinforcement play a role.     

Effects of mesolimbic dopamine depletion on responding maintained by cocaine and food.

The hypothesis that mesolimbic dopamine is selectively involved in cocaine reinforcement was investigated in the rat. Animals were trained under a multiple schedule in which responding was reinforced by intravenous cocaine (0.75 mg/kg/injection) or food (45-mg pellets) under fixed-ratio 15 schedule requirements in alternate 30-min components of a 2-hr daily session. Infusion of the catecholaminergic neurotoxin 6-hydroxydopamine, but not the vehicle solution, into the region of the nucleus accumbens and olfactory tubercle produced selective reductions in cocaine self-administration without significantly altering responding maintained by food within the same sessions. This effect was reproduced in intact animals by substituting saline for cocaine in the self-administration component. These results support the hypothesis that the reinforcing effects of cocaine are dependent upon mesolimbic dopamine and demonstrate that cocaine self-administration can be disrupted in animals without altering behavior maintained by a nondrug reinforcer.     

Reinforcer magnitude (sucrose concentration) and the matching law theory of response strength

This experiment investigated the relationship between reinforcer magnitude (sucrose concentration) and response rate. The purpose was to evaluate the behavior of two parameters of an equation that predicts absolute response rate as a function of reinforcement rate and two free parameters. According to Herrnstein's (1970) theory of reinforced behavior, one parameter of this "response-strength equation" measures the efficacy of the reinforcer maintaining responding and the other parameter measures motoric components of response rate, such as response duration. Seven rats served as subjects. Experimental sessions consisted of a series of five different variable-interval schedules of reinforcement, each in effect for 5 minutes. Within each session, obtained reinforcement rates varied over more than a 30-fold range, from about 20 per hour to 700 per hour. The reinforcer was sucrose solution, and, between sessions, its concentration was varied from 0.0 to 0.64 molar (0 to 21.9%). For sucrose concentrations of 0.16 to 0.64 m, response rate was a negatively accelerated function of reinforcement rate. Increases in sucrose concentration increased response rates maintained by low but not high reinforcement rates. This pattern of changes corresponds to a change in the reinforcement-efficacy parameter of the response-strength equation. In contrast, the motor-performance parameter did not change as a function of sucrose concentration. These findings are inconsistent with the results of a similar study (Bradshaw, Szabadi, & Bevan, 1978) but support Herrnstein's theory of reinforced behavior.     

Human choice in "counterintuitive" situations: fixed- versus progressive-ratio schedules.

College undergraduates were given repeated opportunities to choose between a fixed-ratio and a progressive-ratio schedule of reinforcement. Completions of a progressive-ratio schedule produced points (exchangeable for money) and incremented that response requirement by 20 responses with each consecutive choice. In the reset condition, completion of a fixed ratio produced the same number of points and also reset the progressive ratio back to its initial value. In the no-reset condition, the progressive ratio continued to increase by increments of 20 throughout the session with each successive selection of this schedule, irrespective of fixed-ratio choices. Subjects' schedule choices were sensitive to parametric manipulations of the size of the fixed-ratio schedule and were consistent with predictions made on the basis of minimizing the number of responses emitted per point earned, which is a principle of most optimality theories. Also, the present results suggest that if data from human performances are to be compared with results for other species, humans should be exposed to schedules of reinforcement for long periods of time, as is commonly done with nonhuman subjects.     

Intractable properties of responding under a fixed-interval schedule

The behavior engendered by the fixed-interval schedule is characterized by its variability within and across intervals. The present experiment was designed to assess further the magnitude of interval-to-interval dynamics and to explore conditions which might enhance control by response number for subsequent output. Pigeons were exposed to three experimental manipulations after responding had stabilized under a fixed-interval five-minute schedule. First, a discrete five-stimulus counter was added so that the key color changed after a fixed number of responses. Then additional grain presentations were made at the end of the interval so that high response output was differentially reinforced in the presence of the counter stimuli. Finally, the counter stimuli were presented as an irregular clock (i.e., independently of responding), but the durations were yoked to performance under the counter condition. The data show that response number can exert influence from one interval to the next, but this source of control is weak and not influenced by the experimental manipulations. Results from the clock arrangement indicate that behavior is controlled largely by the stimulus conditions prevailing at the time of interval onset.     

Control rate of response or reinforcement and amphetamine's effect on behavior.

The roles of control response rate and reinforcement frequency in producing amphetamine's effect on operant behavior were evaluated independently in rats. Two multiple schedules were arranged in which one variable, either response rate or reinforcement frequency, was held constant and the other variable manipulated. A multiple differential-reinforcement-of-low-rate seven-second yoked variable-interval schedule was used to equate reinforcement frequencies at different control response rates between multiple-schedule components. Amphetamine increased responding under the variable-interval component. In contrast, amphetamine decreased responding equivalently between components of a multiple random-ratio schedule that produced similar control response rates at different reinforcement frequencies. The results provide experimental support to the rate-dependency principle that control rate of responding is an important determinant of amphetamine's effect on operant behavior.     

Melioration, matching, and maximization

Pigeons were studied in an experiment involving two concurrently available response keys. Conditions were such that in the first condition the predictions of melioration (Herrnstein & Vaughan, 1980), minimization of deviation from matching, and maximization were identical: relative time on the right key should have fallen between .125 and .25, which in fact occurred. In the second condition, melioration predicted a shift in relative time on the right to between .75 and .875, which would involve a transient deviation from matching as well as a substantial drop in rate of reinforcement. All three birds eventually shifted their distribution of behavior to within the range predicted by melioration.     

Reward Density And Variable-interval Schedule Performance In An Open Economy

There is no general agreement regarding the form of the relation between response rate and reinforcement rate when single schedules of reinforcement are studied in an open economy. The present study assessed the form of this relation using reward density, which incorporates both reinforcement rate and duration of access to food, as an independent variable. Reward density was manipulated with 4 pigeons by changing the value of the variable-interval schedule, the hopper duration, or both. The relations between response rate and reward density were sharply rising and hyperbolic in 3 of 4 pigeons, replicating results obtained by Catania and Reynolds (1968). Because eating efficiency was lower in conditions that provided longer hopper durations, programmed reward densities differed from obtained reward densities. When response rates were examined as a function of obtained reward densities, the same relations were demonstrated more strongly. In further clarifying the relation between response rate and reward density in an open economy, these results lend support to the conclusion that open and closed economies yield different behavioral effects.