Behavioral thermoregulation with microwave radiation of albino rats

The objective of this exploratory study was to investigate the extent to which microwave radiation would reinforce operant behavior in a cold environment. A reversal-design with the single subject serving as its own control was used for testing the reinforcing properties of microwaves. Six albino rats were conditioned to produce 6-sec. pulses of microwave radiation within a refrigerated environment. The schedule of reinforcement was continuous (crf). Each lever press produced a 6-sec. output of microwave radiation. The intensity of radiation was varied across blocks of sessions in the reversal design. Microwave values used were as follows: 62.5 W, 125 W, 250 W, and 437.5 W. Sessions lasted from 8 to 9 hr. over an approximate 7-mo. period. Results showed that rates of operant responding varied as a direct function of microwave intensity. Relatively high mean rates were associated with moderate microwave intensity (250 W), whereas lower mean rates of responding were associated with extreme microwave intensities (62.5 W and 437.5 W) in the reversal design. These data are explained in terms of satiation and deprivation of the reinforcing value of microwave radiation.     

Concurrent ratio schedules: Fixed vs. variable response requirements

Rats were trained on concurrent fixed-ratio variable-ratio or concurrent fixed-ratio mixed-ratio schedules of food reinforcement. The variable-ratio schedule was composed of an arithmetic sequence of 11 ratios that averaged 50; the mixed-ratio schedule consisted of equiprobable ratios of 1 and 99. Fixed-ratio values, varied over experimental conditions, included 25, 35, 50, 60, and 99. The proportion of responses and time allocated to the variable- or mixed-ratio schedule increased as the size of the fixed ratio increased. For most subjects, higher proportions of responses and time were maintained on the fixed-ratio schedule at fixed-ratio values of 25 and 35; higher proportions of responses and time were maintained on the variable- or mixed-ratio schedule at fixed-ratio values of 50 or higher. On concurrent variable-ratio fixed-ratio schedules, the tendency for responding to be maintained exclusively by one schedule was related to the difference in local reinforcement rates obtained from those schedules. Exclusive responding was approximated when the difference in local reinforcement rates obtained from those schedules was large; responding was more evenly distributed between the schedules as the difference in the rates at which reinforcement was obtained from each decreased.     

Insulin and dextrose effects on fixed-interval behavioral thermoregulation in albino rats

This study is a systematic replication of the effects of insulin doses on operant behavior reinforced (in an earlier study) by fixed-ratio schedules of microwave (MW) reinforcement. In this study, insulin and dextrose doses were administered (ip) prior to fixed-interval 2-min. schedules of MW reinforcement in rats tested in a cold environment. Six Sprague-Dawley rats were conditioned to regulate their thermal environment with 5-sec. exposures of MW radiation (SAR = 0.34 Watts/kg/(mW/cm2) under the FI-2' schedules. Humulin-regular insulin and 50% solutions of dextrose were administered (ip) alternately with saline control sessions for 8-hr. durations. A within-subjects, repeated-measures 4 x 8 x 3 factorial analysis of variance design showed that insulin doses suppressed operant responding for heat, which confirmed the results of the earlier study under a different schedule. In addition, high doses of dextrose had similar suppressing effects on operant responding for heat. The data are interpreted in terms of the discriminative properties of increased thermogenesis produced by the insulin and dextrose doses. The suppressing effects were more pronounced for the first two hours, yet they persisted for approximately six hours of the 8-hr. sessions.     

Second-order schedules of token reinforcement with pigeons: effects of fixed- and variable-ratio exchange schedules

Pigeons' key pecks produced food under second-order schedules of token reinforcement, with light-emitting diodes serving as token reinforcers. In Experiment 1, tokens were earned according to a fixed-ratio 50 schedule and were exchanged for food according to either fixed-ratio or variable-ratio exchange schedules, with schedule type varied across conditions. In Experiment 2, schedule type was varied within sessions using a multiple schedule. In one component, tokens were earned according to a fixed-ratio 50 schedule and exchanged according to a variable-ratio schedule. In the other component, tokens were earned according to a variable-ratio 50 schedule and exchanged according to a fixed-ratio schedule. In both experiments, the number of responses per exchange was varied parametrically across conditions, ranging from 50 to 400 responses. Response rates decreased systematically with increases in the fixed-ratio exchange schedules, but were much less affected by changes in the variable-ratio exchange schedules. Response rates were consistently higher under variable-ratio exchange schedules than tinder comparable fixed-ratio exchange schedules, especially at higher exchange ratios. These response-rate differences were due both to greater pre-ratio pausing and to lower local rates tinder the fixed-ratio exchange schedules. Local response rates increased with proximity to food under the higher fixed-ratio exchange schedules, indicative of discriminative control by the tokens.     

Fixed-ratio punishment

Responses were maintained by a variable-interval schedule of food reinforcement. At the same time, punishment was delivered following every nth response (fixed-ratio punishment). The introduction of fixed-ratio punishment produced an initial phase during which the emission of responses was positively accelerated between punishments. Eventually, the degree of positive acceleration was reduced and a uniform but reduced rate of responding emerged. Large changes in the over-all level of responding were produced by the intensity of punishment, the value of the punishment ratio, and the level of food deprivation. The uniformity of response rate between punishments was invariant in spite of these changes in over-all rate and contrary to some plausible a priori theoretical considerations. Fixed-ratio punishment also produced phenomena previously observed under continuous punishment: warm-up effect and a compensatory increase. This type of intermittent punishment produced less rapid and less complete suppression than did continuous punishment.     

Fixed-ratio punishment by timeout of concurrent variable-interval behavior

Pigeons' responding was maintained by two concurrently available variable-interval reinforcement schedules. A fixed-ratio punishment schedule of timeout periods from the concurrent reinforcement schedules was arranged for responding during one of the variable-interval schedules. The greater the probability of a timeout after a response on the punished variable-interval schedule (the smaller the fixed ratio that produced timeout), the greater the decline in the relative punished response rates. Relative reinforcement rates remained invariant when relative response rates declined. Both behavioral contrast and induction effects were observed on the unpunished variable-interval schedule as a function of timeout punishment of the other schedule.     

Preference between variable-ratio and fixed-ratio schedules: local and extended relations.

Although it has repeatedly been demonstrated that pigeons, as well as other species, will often choose a variable schedule of reinforcement over an equivalent (or even richer) fixed schedule, the exact nature of that controlling relation has yet to be fully assessed. In this study pigeons were given repeated choices between concurrently available fixed-ratio and variable-ratio schedules. The fixed-ratio requirement (30 responses) was constant throughout the experiment, whereas the distribution of individual ratios making up the variable-ratio schedule changed across phases: The smallest and largest of these components were varied gradually, with the mean variable-ratio requirement constant at 60 responses. The birds' choices of the variable-ratio schedule tracked the size of the smallest variable-ratio component. A minimum variable-ratio component at or near 1 produced strong preference for the variable-ratio schedule, whereas increases in the minimum variable-ratio component resulted in reduced preference for the variable-ratio schedule. The birds' behavior was qualitatively consistent with Mazur's (1984) hyperbolic model of delayed reinforcement and could be described as approximate maximizing with respect to reinforcement value.     

The effects of brief-stimulus presentations in fixed-ratio second-order schedules

Pigeons' responses were reinforced according to a three-component multiple schedule. In Component 1, key pecks produced food according to a fixed-ratio second-order schedule with fixed-ratio units. Here, a fixed number of fixed-ratio units produced food, and the brief stimulus terminating each unit also accompanied food. Responses in Component 2 produced food on an identical schedule except that the brief stimulus was not paired with food. Component 3 contained a simple fixed-ratio schedule whose response requirement equaled that of Components 1 and 2. Across conditions the size of the fixed-ratio unit (five, ten, twenty, forty, and eighty responses) and the total number of responses per reinforcement were parametrically manipulated. The highest response rates and shortest preratio pauses were observed in Component 3 (no brief stimulus). The lowest rates and longest pauses were found in the component with paired brief-stimulus presentations, indicating that the food-paired brief stimulus suppressed responding. The suppressive effects were greatest when the fixed-ratio units were small (e.g., fixed-ratio 5) and the total fixed-ratio requirement was large (e.g., fixed-ratio 160). Under no conditions did the paired brief stimulus facilitate responding. The nonpaired brief stimulus also suppressed responding but to a lesser extent. The suppressive effects of nonpaired brief stimuli were greatest when the fixed-ratio units were small and the total response requirement was large. These data suggest that the suppressive effects of the brief stimuli may have masked the conditioned-reinforcing effects reported in other studies, and that conditions that maximize suppression in second-order schedules involve the use of fixed-ratio schedule units and the presentation of many brief stimuli per reinforcer.     

Differential responding without differential reinforcement: Intensity difference, continuum position, and reinforcement density effects

The response rates of five groups of rats were observed during exposure to different intensities of a four kilohertz tone within a two-component multiple schedule of nondifferential reinforcement. Response rates were found to be higher during the multiple schedule component which contained the higher intensity tone. Larger differences in response rates between the two multiple schedule components occurred with greater intensity separations (30 versus 20 decibels). At the 30 decibel separation a low absolute magnitude produced larger response rate differences than a high absolute magnitude, while at the 20 decibel separation a high absolute magnitude produced larger response rate differences. Increases in reinforcement density were accompanied by decreases in response rate differences between high and low intensity components only when over-all response rates also increased.     

Insulin, exercise, and dietary effects upon behavioral thermoregulation in albino rats

The objectives of this exploratory research were to assess the effects of insulin preparations (Humulin-regular and NPH) on operant behavior reinforced by schedules of microwave radiation in a cold environment and to measure changes in this thermoregulatory behavior as a function of exercise and food deprivation. Eight albino rats were conditioned to regulate their thermal environment with 6-sec. exposures of microwave (MW) radiation (SAR = 0.34 Watts/kg/(mW/cm2) under FR-1 and FR-10 schedules. Regular-insulin and NPH-insulin sessions were administered alternately with saline-control sessions for 8-hr. durations. Exercise in an activity wheel and 48 hr. of food deprivation (diet) were additional independent variables used to alter thermoregulation. Three randomized-block analysis of variance designs with repeated measures showed that insulin preparations resulted in a suppression of operant responding for heat, yet food deprivation increased rates of microwave responding. These data are interpreted in terms of functional relationships between ambient temperature changes, core body temperature, blood glucose fluctuations, and operant behavior.     

Tests of behavior momentum in simple and multiple schedules with rats and pigeons.

Four experiments examined the relationship between rate of reinforcement and resistance to change in rats' and pigeons' responses under simple and multiple schedules of reinforcement. In Experiment 1, 28 rats responded under either simple fixed-ratio, variable-ratio, fixed-interval, or variable-interval schedules; in Experiment 2, 3 pigeons responded under simple fixed-ratio schedules. Under each schedule, rate of reinforcement varied across four successive conditions. In Experiment 3, 14 rats responded under either a multiple fixed-ratio schedule or a multiple fixed-interval schedule, each with two components that differed in rate of reinforcement. In Experiment 4, 7 pigeons responded under either a multiple fixed-ratio or a multiple fixed-interval schedule, each with three components that also differed in rate of reinforcement. Under each condition of each experiment, resistance to change was studied by measuring schedule-controlled performance under conditions with prefeeding, response-independent food during the schedule or during timeouts that separated components of the multiple schedules, and by measuring behavior under extinction. There were no consistent differences between rats and pigeons. There was no direct relationship between rates of reinforcement and resistance to change when rates of reinforcement varied across successive conditions in the simple schedules. By comparison, in the multiple schedules there was a direct relationship between rates of reinforcement and resistance to change during most tests of resistance to change. The major exception was delivering response-independent food during the schedule; this disrupted responding, but there was no direct relationship between rates of reinforcement and resistance to change in simple- or multiple-schedule contexts. The data suggest that rate of reinforcement determines resistance to change in multiple schedules, but that this relationship does not hold under simple schedules.     

A comparison of responding maintained under second-order schedules of intramuscular cocaine injection or food presentation in squirrel monkeys.

Key pressing by squirrel monkeys was maintained under second-order schedules of either intramuscular cocaine injection or food presentation. Under one schedule, each completion of a 10-response fixed-ratio unit produced a brief visual stimulus; the first fixed-ratio unit completed after 30 minutes elapsed produced the stimulus paired with either cocaine injection or food presentation. Generally, short pauses followed by high rates of responding were maintained within the fixed-ratio units, and responding was positively accelerated over the 30-minute interval. Under another schedule, each completion of a 3-minute fixed-interval unit produced the brief stimulus; completion of the 10th fixed-interval unit produced the stimulus paired with either cocaine injection or food presentation. Generally, short pauses followed by high rates of responding were maintained within the fixed-ratio units, and responding was positively accelerated over the 30-minute interval. Under another schedule, each completion of a 3-minute fixed-interval unit produced the brief stimulus; completion of the 10th fixed-interval unit produced the stimulus paired with either cocaine injection or food presentation. Rates of responding increased within the fixed-interval units, and to a greater extent over the entire 10 fixed-interval units. Patterns of responding depended more on the schedule of reinforcement than on whether cocaine or food maintained responding. Omitting the brief stimuli following all but the last fixed-ratio or fixed-interval units decreased average rates and altered the patterns of responding. Substituting a visual stimulus that was never paired with cocaine or food following all but the last fixed-ratio or fixed-interval units decreased response rates to a lesser extent and did not substantially alter patterns of responding. When the duration of the paired stimulus was varied from .3 to 30.0 seconds, the highest response rates occurred at intermediate durations (1.0 to 10.0 seconds). The manner in which the stimulus changes affected performances depended more on the schedule of reinforcement than on whether cocaine injection or food presentation maintained responding.     

Preference for mixed- versus fixed-ratio schedules

Pigeons' pecks on one key produced a stimulus correlated with a mixed-ratio schedule of food reinforcement. Pecks on a second key produced a stimulus correlated with a fixed-ratio schedule. When the arithmetic mean of the mixed ratios equaled the fixed ratio, the former stimulus maintained a higher rate of pecking. When the fixed ratio was sufficiently smaller, preference shifted to it. The pigeons' relative preference for the schedules could be described by comparing the geometric mean of the reinforcement rates in the several mixed-ratio components with the reinforcement rates in the fixed-ratio components.     

The effect of punishment shock intensity upon responding under multiple schedules

In the first of two experiments, responses of two pigeons were maintained by multiple variable-interval, variable-ratio schedules of food reinforcement. Concurrent punishment was introduced, which consisted of a brief electric shock after each tenth response. The initial punishment intensities had no lasting effect upon responding. Then, as shock intensity increased, variable-ratio response rates were suppressed more quickly than variable-interval response rates. When shock intensity decreased, variable-interval responding recovered more quickly, but the rates under both schedules eventually returned to their pre-punishment levels. In the second experiment, the following conditions were studied in three additional pigeons: (1) With each shock intensity in effect for a number of sessions, punishment shock intensity was gradually increased and decreased and responding was maintained by multiple variable-ratio, fixed-ratio schedules of food reinforcement; (2) Changes in punishment shock intensity as described above with responding maintained by either a variable-ratio or a fixed-ratio schedule, which were presented on alternate days; (3) Session-to-session changes in shock intensity with responding maintained by multiple variable-ratio, fixed-ratio schedules. Responding under the two schedules was suppressed to approximately the same extent by a particular shock intensity. Also, post-reinforcement pauses under the fixed-ratio schedule increased as response suppression increased.     

The contribution of an added counter to a fixed-ratio schedule

Although previous research showed that a visual counter increased the rate of responding on a large fixed-ratio schedule, a theoretical analysis of the factors responsible for fixed-ratio performance suggests that the primary control by number of responses since reinforcement is to weaken the performance. The present experiment employed a multiple schedule in which the same fixed-ratio value alternated with and without an added counter. It tested the hypothesis that the differential reinforcement of high-rate responding masked the attenuation of the fixed-ratio performance from the unoptimal discriminative control produced by the fixed relation between number of responses and reinforcement. In the present experiment the postreinforcement pause was consistently longer in the components with the added counter, while running rates remained comparable between the components of the multiple schedule. Both components of the multiple schedule involved differential reinforcement of high-rate responding while only the components with the added counter amplified the discriminative control by number of pecks since reinforcement.     

Effects of reinforcement history on responding under progressive-ratio schedules of reinforcement.

The effects of experimental history on responding under a progressive-ratio schedule of reinforcement were examined. Sixteen pigeons were divided into four equal groups. Groups 1 to 3 were trained to peck a key for food under a fixed-ratio, variable-ratio, or differential-reinforcement-of-low-rate schedule of reinforcement. After training, these pigeons were shifted to a progressive-ratio schedule, later were shifted back to their original schedule (with decreased rates of reinforcement), and finally were returned to the progressive-ratio schedule. Pigeons in Group 4 (control) were maintained on the progressive-ratio schedule for the entire experiment. To test for potential "latent history" effects, pigeons responding under the progressive-ratio schedule were injected with d-amphetamine and given behavioral-momentum tests of prefeeding and extinction. Experimental histories affected responding in the immediate transition to the progressive-ratio schedule; response rates of pigeons with variable-ratio and fixed-ratio histories were higher than rates of pigeons with differential-reinforcement-of-low-rate and progressive-ratio-only histories. Pigeons with differential-reinforcement-of-low-rate histories, and to a lesser degree pigeons with variable-ratio and fixed-ratio histories, also had shorter postreinforcement pauses than pigeons with only a progressive-ratio history. No consistent long-term effects of prior contingencies on responding under the progressive-ratio schedule were evident. d-Amphetamine and resistance-to-change tests failed to reveal consistent latent history effects. The data suggest that history effects are sometimes transitory and not susceptible to latent influences.     

Preference in concurrent variable-interval fixed-ratio schedules

Five pigeons were trained on concurrent variable-interval fixed-ratio schedules in three experiments. Experiment 1 used two variable-interval schedules and one fixed-ratio schedule, and the ratio requirement was varied. Using the generalized matching law, sensitivity to reinforcement was close to 1.0, but performance was biased toward the variable-interval schedule with the lower reinforcement rate. In Experiment 2, which used one variable-interval and one fixed-ratio schedule, the interval schedule was varied. All birds showed sensitivities to reinforcement of less than 1.0 and of less than the values obtained in Experiment 1. The performance was also biased toward the fixed-ratio schedule. Because the generalized matching law could not account for the differences in the data from Experiments 1 and 2, an extension of this law was suggested and successfully tested in Experiment 3. The proposed dual-sensitivity model was also shown to clarify some previously reported results.     

Fractional punishment of fixed-ratio performance

Key-peck responses of pigeons under a fixed-rate 60 (Exp. I) or fixed-ratio 99 (Exp. II) schedule of positive reinforcement were punished by response-dependent electric shock during a segment of the ratio. The punishing stimulus was scheduled in one of three locations: the first third of the ratio, the middle third, or the final third. At high shock levels, the different loci of punishment differentially affected the typical fixed-ratio performance pattern. Post-reinforcement pauses were lengthened by all punishment conditions but to a greater degree when the responses in initial third of the ratio were punished. Disruption of responses before the punished segment of the ratio was a conspicuous feature of the performances when the middle or final third of the ratio was punished. Two of the punishment conditions produced similar effects on both fixed-ratio baselines but punishing the final third of the ratio suppressed the punished responses of the ratio only with the fixed-ratio 99 schedule. General effects of all punishment conditions included consistent intra-session recoveries of partially suppressed performances, the rapid recovery of the FR performances after the punishment dependency was removed after complete suppression, and the facilitation of overall and/or local response rates of most subjects by low-intensity shock.     

Changing the response unit from a single peck to a fixed number of pecks in fixed-interval schedules

Each of three pigeons was studied first under a standard fixed-interval schedule. With the fixed interval held constant, the schedule was changed to a second-order schedule in which the response unit was the behavior on a small fixed-ratio schedule (first a fixed-ratio 10 and then a fixed-ratio 20 schedule). That is, every completion of the fixed-ratio schedule produced a 0.7-sec darkening of the key and reset the response count to zero for the next ratio. The first fixed-ratio completed after the fixed-interval schedule elapsed produced the 0.7-sec blackout followed immediately by food. These manipulations were carried out under two different fixed-interval durations for each bird ranging from 3 min to 12 min. The standard fixed-interval schedules produced the typical pause after reinforcement followed by responding at a moderate rate until the next reinforcement. The second-order schedules also engendered a pause after reinforcement, but responding occurred in bursts separated by brief pauses after each blackout. For a particular fixed-interval duration, post-reinforcement pauses increased slightly as the number of pecks in the response unit increased despite large differences in the rate and pattern of key pecking. Post-reinforcement pause increased with the fixed-interval duration under all response units. These data confirm that the allocation of time between pausing and responding is relatively independent of the rate and topography of responding after the pause.     

Effects of reinforcement magnitude and ratio values on behaviour maintained by a cyclic ratio schedule of reinforcement

In Experiments 1 and 2, lever pressing by rats was reinforced on a cyclic ratio schedule of food reinforcement, comprising a repeated sequence of fixed-ratio component schedules. Reinforcement magnitude was varied, on occasional sessions in Experiment 1 and across blocks of sessions in Experiment 2, from one to two or three 45-mg food pellets. In the one-pellet condition, post-reinforcement pauses increased with component schedule value. At higher magnitudes, post-reinforcement pauses increased, and overall response rates declined. Response rate on component schedules was a decreasing linear function of the obtained rate of reinforcement in all conditions. Plotted against component schedule value, response rate increased exponentially to an asymptote that decreased when reinforcement magnitude increased. These findings are consistent with regulatory accounts of food reinforced behaviour. In Experiment 3, rats were trained under a cyclic ratio schedule comprising fixed-ratio components including higher values, and some inverted U-shaped response functions were obtained. Those rats that did not showthis relationship were trained on cyclic ratios with even higher values, and all showed inverted U-shaped response functions. This suggests that behaviour on cyclic ratio schedules can reflect activating of reinforcement as well as the satiating effects seen in Experiments 1 and 2.