The control of responding by sounds: unusual effect of reinforcement.

Naive rats were trained to respond on one lever in the presence of noise bursts from one speaker and on a second lever in the presence of noise bursts from a second speaker. The speakers were mounted behind the levers. When responding on the lever adjacent to the sounding speaker was reinforced, control developed within fewer than five trials. When responding on the nonadjacent lever was selectively reinforced, responding on the lever adjacent to the sounding speaker increased in probability for several sessions. Naive rats were trained to respond on the nonadjacent lever following preexposure to the sound. Responding on the lever adjacent to the sounding speaker increased in probability, showing that novelty was not responsible for the effect. Naive rats were run on automaintenance procedures in which there was no explicit pairing of sound and magazine operation, 100% pairing of sound and magazine operation, or magazine operation following 40% of sound presentations. None of the rats acquired the response of approaching and sniffing the sounding speaker, indicating that sound-magazine pairing was not responsible for the effect.     

Substitutability between conditioned and primary reinforcers in discrimination acquisition.

Rats and pigeons were trained on a series of reversals of a conditional simultaneous discrimination. The percentage of reinforcement for correct trials was varied across reversals. When nonreinforced correct trials produced the same feedback as incorrect trials, the number of errors to reach an acquisition criterion was greater for smaller percentages of reinforcement, but the number of reinforcers required was either approximately constant or smaller for the smaller percentages. When a stimulus paired with food (the conditioned reinforcer) was added on nonreinforced correct trials, both measures were substantially decreased. When the same stimulus was presented, but without a history of food pairing, learning rate was similar to when no stimulus was presented on nonreinforced trials. The results provide direct evidence that conditioned reinforcers may substitute, although imperfectly, for a primary reinforcer, and that pairing with the primary reinforcer is a necessary condition for such substitutability to occur.     

KNOWING BEFORE DOING: DISCRIMINATION BY RATS OF A BRIEF INTERRUPTION OF A TONE

Eight rats' lever presses were reinforced after an interruption in a tone, provided the lever had not been pressed before the tone interruption. After a few sessions, long before the animals reliably refrained from lever pressing before the interruption, the latencies of postinterruption presses (time from the termination of the interruption to the moment of the lever press) dissociated into two classes: short ones for to-be-rewarded presses, and long ones for presses in the other trials, which contained no reward because one or more lever presses had occurred before the interruption. Thus discrimination of impending reinforcement in the current trial occurred before there was evidence of sensitivity to reinforcement in the reinforcement-producing aspect of behavior. This finding is related to Shimp's (1981) contention that the temporal properties of recent behavior are reinforceable, if remembered. The present finding shows that learning to discriminate whether one's behavior has met a contingency, and learning to carry out this behavior, need not go together, implying that memory of temporal properties is probably a necessary but not a sufficient condition for learning the latter.     

Effects of discrete-trial and free-operant procedures on the acquisition and maintenance of successive discrimination in rats.

Rats were trained on a successive discrete-trial discrimination between two tonal stimuli to examine the effects of availability of a lever during intertrial intervals. In the discrete-trial condition, in which a lever was removed from the chamber during intertrial intervals, 10-s trials were initiated by the presentation of both discriminative stimulus and lever. In the free-operant condition, in which a lever was present during both trials and intertrial intervals, 10-s trials were initiated only by the presentation of a discriminative stimulus. Experiment 1 employed 50-s intertrial intervals and demonstrated that discriminative performances were acquired faster and maintained better in the free-operant conditions than in the discrete-trial conditions. Experiment 2 employed 5-s intertrial intervals and showed that poor discriminative performances in the discrete-trial conditions were improved. These results indicate that the presentation of a lever to start a trial can overshadow or mask the control by a discriminative stimulus and thereby obstruct the acquisition and maintenance of discriminative performances. Furthermore, the overshadowing or masking effects are strengthened as a function of the duration of intertrial intervals.     

Effects of schedule of reinforcement on a pentobarbital discrimination in rats.

The purpose of this study was to determine the effects of the schedule of reinforcement on a pentobarbital discrimination in rats. Five rats were trained to discriminate 10 mg/kg pentobarbital from saline under a multiple fixed-interval 180-s fixed-ratio 20 schedule of reinforcement. During both saline and pentobarbital training sessions, subjects emitted a higher percentage of correct responses under the fixed-ratio component as compared to the fixed-interval component of the multiple schedule. Determination of the pentobarbital dose-response curve under the fixed-ratio component resulted in a steep curve characterized by responding on the saline lever at low doses and on the drug lever at higher doses. Under the fixed-interval component, a graded dose-effect curve was produced, with considerable responding on both levers after intermediate doses of pentobarbital. The administration of phencyclidine and MK-801 resulted in an intermediate level of drug-lever responding for some subjects. Administration of d-amphetamine resulted in saline (nondrug) appropriate responding. The results of this study demonstrate that the schedule of reinforcement is a determinant of drug stimulus control, just as it is a determinant of other drug effects.     

Effects of morphine, clonidine, and intensity change on electric-shock discrimination.

The effects of morphine, clonidine, and changes in stimulus intensity were examined in squirrel monkeys responding on one of two levers following brief presentations of one of two electric-shock intensities (0.1 and 0.5 mA). Responses were designated as correct or incorrect depending on which shock intensity had been presented and which lever was pressed. Morphine (0.42 to 1.80 mg/kg) and clonidine (0.075 to 0.18 mg/kg) decreased percentage correct responding. Morphine and clonidine also increased response latency and the number of shock presentations that were not followed by responses. Changes in shock intensity also decreased percentage correct responding but had no effect on response latency or on the number of shock presentations not followed by responses.     

Acquisition of lever-press responding in rats with delayed reinforcement: A comparison of three procedures

The present study examined the acquisition of lever pressing in rats under three procedures in which food delivery was delayed by 4, 8, and 16 seconds relative to the response. Under the nonresetting delay procedure, food followed the response selected for reinforcement after a specified interval elapsed; responses during this interval had no programmed effect. Under the resetting procedure, the response selected for reinforcement initiated an interval to food delivery that was reset by each subsequent response. Under the stacked delay procedure, every response programmed delivery of food t seconds after its occurrence. Two control groups were studied, one that received food immediately after each lever press and another that never received food. With the exception of the group that did not receive food, responding was established with every procedure at every delay value without autoshaping or shaping. Although responding was established under the resetting delay procedure, response rates were generally not as high as under the other two procedures. These findings support the results of other recent investigations in demonstrating that a response not previously reinforced can be brought to strength by delayed reinforcement in the absence of explicit training.     

Rapid acquisition of discrete-trial lever-press avoidance: effects of signal-shock interval

Acquisition of discrete-trial lever-press avoidance learning was studied in three experiments. Experiment I compared a new training procedure, which produces rates of lever-press avoidance learning comparable to those obtained in shuttle boxes, with a “conventional”, less efficient training procedure. A factorial design was used to compare continuous versus intermittent shock and a long-variable versus a short-fixed signal-shock interval. Learning was best in the groups trained with the long and variable interval and poorest in those trained with the short and fixed interval. Type of shock had no effect. Experiment II separated the effects of duration from those of variability of the signal-shock interval. Fixed and variable intervals of 10 and 60 sec were tested and duration was the only significant factor. Experiment III addressed the effect of the differential opportunity to avoid provided by long signal-shock intervals by varying this interval from 10 to 60 sec in 10-sec steps. Only the 10-sec group showed slow acquisition relative to the others. Analysis of avoidance response latencies showed that the distributions for all groups were positively skewed and that skewness increased with increasing duration of the signal-shock interval. At intervals longer than 20 sec, the animals made progressively less use of their increased opportunity to respond. The data do not support the opportunity-to-respond interpretation of the effects of duration of signal-shock interval and suggest that some type of inhibitory process may block lever-press avoidance learning at intervals as short as 10 sec. The significance of these findings for species-specific defense reaction and preparedness theories was emphasized.     

Control of responding by location of auditory stimuli: adjacency of sound and response.

Four rhesus monkeys were trained to respond on one key when a one-second noise burst was presented through one speaker and to respond on a second key when the noise burst was presented through a second speaker. The acquisition of stimulus control was studied under three conditions, in each of which the relationship between the sound source and the response-key positions varied: an adjacent condition in which the noise burst was presented through the key and a response on this key was reinforced; a reversed-adjacent condition in which the noise burst was presented through one key and responding on the other key was reinforced: and a nonadiacent condition in which responding on the key nearer the sound was reinforced. Under adjacent conditions, stimulus control developed within one or two sessions. Under reversed and nonadjacent conditions, 10 sessions were required for the development of control. The asymptote of correct responding was the same under each condition in all animals.     

Stimulus generalization, discrimination learning, and peak shift in horses.

Using horses, we investigated three aspects of the stimulus control of lever-pressing behavior: stimulus generalization, discrimination learning, and peak shift. Nine solid black circles, ranging in size from 0.5 in. to 4.5 in. (1.3 cm to 11.4 cm) served as stimuli. Each horse was shaped, using successive approximations, to press a rat lever with its lip in the presence of a positive stimulus, the 2.5-in. (6.4-cm) circle. Shaping proceeded quickly and was comparable to that of other laboratory organisms. After responding was maintained on a variable-interval 30-s schedule, stimulus generalization gradients were collected from 2 horses prior to discrimination training. During discrimination training, grain followed lever presses in the presence of a positive stimulus (a 2.5-in circle) and never followed lever presses in the presence of a negative stimulus (a 1.5-in. [3.8-cm] circle). Three horses met a criterion of zero responses to the negative stimulus in fewer than 15 sessions. Horses given stimulus generalization testing prior to discrimination training produced symmetrical gradients; horses given discrimination training prior to generalization testing produced asymmetrical gradients. The peak of these gradients shifted away from the negative stimulus. These results are consistent with discrimination, stimulus generalization, and peak-shift phenomena observed in other organisms.     

Effects of reinforcement rate and delay on the acquisition of lever pressing by rats.

The acquisition of lever pressing by naive rats, in the absence of shaping, was studied as a function of different rates and unsignaled delays of reinforcement. Groups of 3 rats were each exposed to tandem schedules that differed in either the first or the second component. First-component schedules were either continuous reinforcement or random-interval 15, 30, 60 or 120 s; second-component schedules were fixed-time 0, 1, 3, 6, 12, or 24 s. Rate of responding was low under continuous immediate reinforcement and higher under random-interval 15 s. Random interval 30-s and 60-s schedules produced lower rates that were similar to each other. Random-interval 120 s controlled the lowest rate in the immediate-reinforcement condition. Adding a constant 12-s delay to each of the first-component schedule parameters controlled lower response rates that did not vary systematically with reinforcement rate. The continuous and random-interval 60-s schedules of immediate reinforcement controlled higher global and first-component response rates than did the same schedules combined with longer delays, and first-component rates showed some graded effects of delay duration. In addition, the same schedules controlled higher second-component response rates in combination with a 1-s delay than in combination with longer delays. These results were related to those from previous studies on acquisition with delayed reinforcement as well as to those from similar reinforcement procedures used during steady-state responding.     

Drug discrimination using a conditioned taste-aversion paradigm in rhesus monkeys.

The development of drug discrimination was assessed in rhesus monkeys using the conditioned taste-aversion paradigm. Monkeys were initially trained to respond under a fixed-ratio 30-response schedule of food-pellet delivery to assess the rate-decreasing effects of alprazolam (0.03 to 3 mg/kg, i.m., 60 min presession). Alprazolam decreased responding at doses greater than 0.1 mg/kg. Discriminative stimulus effects of alprazolam were then assessed by giving 0.03 mg/kg before sessions in which 1.8 mEq/kg lithium chloride was given immediately after the session (alprazolam/lithium session). On intervening days, saline was given before and after the session (saline/saline session). Rates of responding decreased over successive alprazolam/lithium sessions and also during the saline/saline session that immediately followed an alprazolam/lithium session. During subsequent saline/saline sessions, rates of responding returned to levels near baseline rates within two to four sessions. The discriminative stimulus effects of alprazolam were then assessed by giving 0.1 mg/kg before sessions in which 1 mg/kg d-amphetamine was given immediately after the session (alprazolam/d-amphetamine session). Rates of responding decreased during subsequent alprazolam/d-amphetamine sessions in drug-experienced monkeys, but did not decrease during intervening saline/saline sessions. These findings demonstrate that drug stimuli associated with postsession drug injections can rapidly develop control over behavior and suggest that similar methods be explored in the assessment of drug discrimination.     

An animal model of excessive eating: schedule-induced hyperphagia in food-satiated rats.

Nineteen rats were maintained throughout the experiment on ad libitum wet mash and water and were trained to press a lever on fixed-interval or fixed-ratio schedules of reinforcement with electrical brain stimulation. Fourteen rats ate at least 150% more mash during intermittent reinforcement sessions than during baseline, massed reinforcement control, and/or extinction sessions. In a 3-hr session, 11 of those 14 consumed more than 22 g of wet mash (13 g dry weight), the equivalent of nearly half an animal's daily food intake. In subsequent control sessions, the electrodes did not support stimulus-bound eating despite attempts to make stimulation parameters optimal. These results indicate that the eating was schedule induced or adjunctive, and suggest that the procedure may provide an animal model of excessive nonregulatory eating that contributes to obesity in humans.     

Effects of D-amphetamine on response acquisition with immediate and delayed reinforcement.

The present study examined in 8-hour sessions the effects of d-amphetamine (1.0, 5.6, and 10 mg/kg) on the acquisition of lever-press responding in rats that were exposed to procedures in which water delivery was delayed by 0, 8, or 16 seconds relative to the response that produced it. Both nonresetting- and resetting-delay conditions were studied. Although neither shaping nor autoshaping occurred, substantial levels of operative-lever responding developed under all conditions in which responses produced water. The lowest dose (1.0 mg/kg) of d-amphetamine either had no effect on or increased operative-lever pressing, whereas higher doses typically produced an initial reduction in lever pressing. Nonetheless, overall rates of operative-lever pressing at these doses were as high as, or higher than, those observed with vehicle. Thus, response acquisition was observed under all reinforcement procedures at all drug doses. In the absence of the drug, most responding occurred on the operative lever when reinforcement was immediate. Such differential responding also developed under both nonresetting- and resetting-delay procedures when the delay was 8 seconds, but not when it was 16 seconds. d-Amphetamine did not affect the development of differential responding under any procedure. Thus, consistent with d-amphetamine's effects under repeated acquisition procedures, the drug had no detrimental effect on learning until doses that produced general behavioral disruption were administered.