Avoidance based on shock intensity reduction with no change in shock probability

Rats were trained on a free-operant avoidance procedure in which shock intensity was controlled by interresponse time. Shocks were random at a density of about 10 shocks per minute. Shock probability was response independent. As long as interresponse times remained less than the limit in effect, any shocks received were at the lower of two intensities (0.75 mA). Whenever interresponse times exceeded the limit, any shocks received were at the higher intensity (1.6 mA). The initial limit of 15 seconds was decreased in 3-second steps to either 6 or 3 seconds. All animals lever pressed to avoid higher intensity shock. As the interresponse time limit was reduced, the response rate during the lower intensity shock and the proportion of brief interresponse times increased. Substantial warmup effects were evident, particularly at the shorter interresponse-time limits. Shock intensity reduction without change in shock probability was effective in the acquisition and maintenance of avoidance responding, as well as in differentiation of interresponse times. This research suggests limitations on the generality of a safety signal interpretation of avoidance conditioning.     

Matching in concurrent variable-interval avoidance schedules

After pretraining with multiple variable-interval avoidance schedules, two rats were exposed to a series of concurrent variable-interval avoidance schedules. Responses on two levers cancelled delivery of electric shocks arranged according to two independent variable-interval schedules. The ratio of responses and time spent on the two levers approximately matched the ratio of shocks avoided on each. Matching to the number of shocks received was not obtained. Concurrent variable-interval avoidance can therefore be added to the group of positive and negative reinforcement schedules that can be expressed in the quantitative framework of the matching law.     

Effect of variable-interval punishment on the behavior of humans in variable-interval schedules of monetary reinforcement

One male and three female human subjects pressed a button for monetary reinforcement under a range of variable-interval schedules specifying different frequencies of reinforcement. On alternate days, responding was also punished (by subtraction of money) according to a variable-interval 170-second schedule. In the absence of punishment, the rate of responding was an increasing negatively accelerated function of reinforcement frequency, as predicted by Herrnstein's equation. The effect of the punishment schedule was to suppress responding under lower frequencies of reinforcement; responding under higher reinforcement frequencies was much less affected. This was reflected in an increase in the value of K_H (the constant expressing the reinforcement frequency corresponding to the half-maximal response rate), whereas there was no significant change in the value of R_max (the constant expressing the maximum response rate). Previous results had shown that variable-ratio punishment resulted in a change in the values of both constants (Bradshaw, Szabadi, and Bevan, 1977). The results of the present study were consistent with the concept that the suppressive effects of punishment on responding depend on the nature of the punishment schedule.     

Acquisition of cocaine self-administration with unsignaled delayed reinforcement in rhesus monkeys

Six experimentally naive rhesus monkeys produced 0.01 mg/kg/infusion cocaine by lever pressing under a tandem fixed-ratio 1 differential-reinforcement-of-other-behavior schedule. One lever press initiated an unsignaled 15- or 30-s delay culminating in cocaine delivery. Each press made during the delay reset the delay interval. With two exceptions, responding was acquired and maintained at higher rates than responding on a second (inoperative) lever. For the exceptions, a cancellation contingency was arranged in which each formerly inoperative-lever response reset the tandem schedule. This manipulation reduced presses on the inoperative lever. Subsequently, the consequences of responding on the two levers were reversed, and the monkeys again responded at higher rates on the operative lever. As a comparison, 3 additional experimentally naive monkeys received response-independent cocaine deliveries. Although lever pressing was observed, it extinguished and was subsequently reestablished under the tandem schedule. The results suggest that although response-reinforcer contiguity is not required for cocaine to acquire reinforcing functions, a response-reinforcer relation appears necessary.     

Effects of reinforcement schedule on facilitation of operant extinction by chlordiazepoxide

Learning and memory are central topics in behavioral neuroscience, and inbred mice strains are widely investigated. However, operant conditioning techniques are not as extensively used in this field as they should be, given the effectiveness of the methodology of the experimental analysis of behavior. In the present study, male C57B1/6 mice, widely used as background for transgenic studies, were trained to lever press on discrete-trial fixed-ratio 5 or fixed-interval (11 s or 31 s) schedules of food reinforcement and then exposed to 15 extinction sessions following vehicle or chlordiazepoxide injections (15 mg/kg i.p., administered either prior to all extinction sessions, or prior to the final 10 extinction sessions). Extinction of operant behavior was facilitated by drug administration following training on either schedule, but this facilitation only occurred once a number of extinction sessions had taken place. The extinction process proceeded more rapidly following fixed-interval training. Resistance to extinction was equally high following training with either schedule type, and was reduced by drug administration in both cases. These phenomena were evident in individual cumulative records and in analyses of group data. Results are interpreted in terms of phenomena of operant extinction identified in Skinner's (1938) Behavior of Organisms, and by behavioral momentum theory. These procedures could be used to extend the contribution of operant conditioning to contemporary behavioral neuroscience.     

A TEST OF THE FORMAL AND MODERN THEORIES OF MATCHING

Pigeons' choosing between fixed-interval and random-interval schedules of reinforcement was investigated in three experiments using a discrete-trial procedure. In all three experiments, the random-interval schedule was generated by sampling a probability distribution at an interval (and in multiples of the interval) equal to that of the fixed-interval schedule. Thus the programmed delays to reinforcement on the random alternative were never shorter and were often longer than the fixed interval. Despite this feature, the fixed schedule was not strongly preferred. Increases in the probability used to generate the random interval resulted in decreased preferences for the fixed schedule. In addition, the number of consecutive choices on the preferred alternative varied directly with preference, whereas the consecutive number of choices on the nonpreferred alternative was fairly constant. The probability of choosing the random alternative was unaffected by the immediately prior interval encountered on that schedule, even when it was very long relative to the average value. The results loosely support conceptions of a "preference for variability" from foraging theory and the "utility of behavioral variability" from human decision-making literatures.     

Emergent, untrained stimulus relations in many-to-one matching-to-sample discriminations in rats

The present experiment investigated whether rats formed emergent, untrained stimulus relations in many-to-one matching-to-sample discriminations. In Phase 1, rats were trained to match two samples (triangle and horizontal stripes) to a common comparison (horizontal stripes) and two additional samples (circle or vertical stripes) to another comparison (vertical stripes). Then, in Phase 2, the rats were trained to match the one sample (triangle) to a new comparison (black) and the other sample (circle) to another comparison (white). In the Phase 3 test, half the rats (consistent group) were given two new tasks in which the sample-correct comparison relation was consistent with any emergent stimulus relations that previously may have been learned. The remaining 6 rats (inconsistent group) were given two new tasks in which the sample-correct comparison relation was not consistent with any previously learned emergent stimulus relations. Rats in the consistent group showed more accurate performance at the start of Phase 3, and faster learning to criterion in this phase, as compared with rats in the inconsistent group. This finding suggests that rats may form emergent, untrained stimulus relations between the discriminative stimuli in many-to-one matching-to-sample discriminations.     

Run length, visit duration, and reinforcers per visit in concurrent performance

The contingencies in each alternative of concurrent procedures consist of reinforcement for staying and reinforcement for switching. For the stay contingency, behavior directed at one alternative earns and obtains reinforcers. For the switch contingency, behavior directed at one alternative earns reinforcers but behavior directed at the other alternative obtains them. In Experiment 1, responses on the main lever, in S1, incremented stay and switch schedules and obtained a stay reinforcer when it became available. Responses on the switch lever changed S1 to S2 and obtained switch reinforcers when available. In S2, neither responses on the main lever nor on the switch lever were reinforced, but a switch response changed S2 to S1. Run lengths and visit durations were a function of the ratio of the scheduled probabilities of reinforcement (staying/switching). From run lengths and visit durations, traditional concurrent performance was synthesized, and that synthesized performance was consistent with the generalized matching law. Experiment 2 replicated and extended this analysis to concurrent variable-interval schedules. The synthesized results challenge any theory of matching that requires a comparison among the alternatives.     

Effects of reinforcement rate and delay on the acquisition of lever pressing by rats.

The acquisition of lever pressing by naive rats, in the absence of shaping, was studied as a function of different rates and unsignaled delays of reinforcement. Groups of 3 rats were each exposed to tandem schedules that differed in either the first or the second component. First-component schedules were either continuous reinforcement or random-interval 15, 30, 60 or 120 s; second-component schedules were fixed-time 0, 1, 3, 6, 12, or 24 s. Rate of responding was low under continuous immediate reinforcement and higher under random-interval 15 s. Random interval 30-s and 60-s schedules produced lower rates that were similar to each other. Random-interval 120 s controlled the lowest rate in the immediate-reinforcement condition. Adding a constant 12-s delay to each of the first-component schedule parameters controlled lower response rates that did not vary systematically with reinforcement rate. The continuous and random-interval 60-s schedules of immediate reinforcement controlled higher global and first-component response rates than did the same schedules combined with longer delays, and first-component rates showed some graded effects of delay duration. In addition, the same schedules controlled higher second-component response rates in combination with a 1-s delay than in combination with longer delays. These results were related to those from previous studies on acquisition with delayed reinforcement as well as to those from similar reinforcement procedures used during steady-state responding.     

Food and water intake as functions of resource consumption costs in a closed economy.

In two experiments, rats living in a closed economy were offered continuous, concurrent access to four resources: food, water, a nest, and a running wheel. Costs of consuming food and water were imposed with bar-press requirements, and the price of either one or both resources was raised. As the consumption cost increased, less was consumed in each bout of resource use. Bout frequency increased, but not sufficiently to compensate for the fall in bout size, and total intake fell. Food and water tended to be complementary resources, in that as intake of one fell with its price, intake of the other also decreased. This interaction was accounted for by the defense of the ratio of body water to lean body mass. As amount consumed decreased, increases in feed efficiency (weight gain per unit of food ingested) and the use of stored calories compensated for the reduced energy intake. There was evidence of competition between feeding and drinking at the higher costs: When both commodities were expensive, the decline in the intake of each one was greater than when only one commodity was expensive. Although the time spent nesting, running, and in unmonitored activity was adjusted when feeding or drinking took more of the rat's day, there was no particular activity that was sacrificed.