Control of responding by location of auditory stimuli: adjacency of sound and response.

Four rhesus monkeys were trained to respond on one key when a one-second noise burst was presented through one speaker and to respond on a second key when the noise burst was presented through a second speaker. The acquisition of stimulus control was studied under three conditions, in each of which the relationship between the sound source and the response-key positions varied: an adjacent condition in which the noise burst was presented through the key and a response on this key was reinforced; a reversed-adjacent condition in which the noise burst was presented through one key and responding on the other key was reinforced: and a nonadiacent condition in which responding on the key nearer the sound was reinforced. Under adjacent conditions, stimulus control developed within one or two sessions. Under reversed and nonadjacent conditions, 10 sessions were required for the development of control. The asymptote of correct responding was the same under each condition in all animals.     

Control of responding by sounds of different quality: an evolutionary analysis.

Two experiments investigated the acquisition of discriminations between two acoustic stimuli of different quality (noise bursts vs. a 2-kHz pulsed signal) when features of the everyday environment were incorporated into the experiments. In Experiment 1, rats were trained, using food, to press a lever. Throughout all sessions, 5-s trials of noise bursts (the random stimulus) were presented, after variable intertrial intervals, through a remote speaker mounted outside the experimental enclosure. The noise burst occurred randomly with respect to reinforcement of lever pressing and had no programmed relationship to the animal's behavior. When lever pressing was established, the 2-kHz signal was presented through a speaker adjacent to the response lever according to a different set of variable intertrial intervals. A response in the presence of the 2-kHz signal terminated the trial and was reinforced. The 2-kHz signal acquired control of responding within the first few trials, whereas the random stimulus exerted no control of responding. In Experiment 2, rats were trained to press the lever in the presence of the 2-kHz signal presented through the adjacent speaker on a variable intertrial interval. After 14 sessions, 5-s trials of noise bursts (random stimulus) were presented through the remote speaker on the second variable intertrial interval. The random stimulus initially elicited exploratory behavior, which then rapidly declined. Subsequently, the random stimulus exerted no or weak control of responding. The introduction of the random stimulus had no effect on responding in the presence of the adjacent stimulus. In Experiments 3 and 4 the random stimulus was presented through the adjacent speaker, and the stimulus correlated with reinforcement was presented through the remote speaker. In both experiments, there was persistent control of responding by the random stimulus and slow development of control by the stimulus correlated with reinforcement. In Experiment 5, both stimuli were presented through the adjacent speaker. There was persistent control of responding by the random stimulus.     

Control of responding by location of auditory stimuli: rapid acquisition in monkey and rat

Monkeys require a considerably larger number of trials to bring responding under the control of the location of an auditory stimulus than cats, rats, and bats with the same experimental procedures. The present experiment sought to determine the conditions necessary for rapid acquisition of control of responding by location of noise and tone bursts in the monkey. Monkeys were run in an enclosure that contained four loudspeakers and four manipulanda. Two conditions were used in training. In the adjacent condition, a stimulus (noise or tone burst) was presented through one or other of two speakers and a response on the manipulandum adjacent to the speaker was reinforced with food. In the nonadjacent condition, a stimulus was presented through one of two speakers and a response on a manipulandum remote from the speaker was reinforced with food. Acquisition of control was measured by change in the percentage of reinforced responses during training. In the adjacent condition, responding came under control of location within zero to three sessions. In nonadjacent conditions, the animals required 14 to 20 sessions to come under control of location. These latter numbers are comparable to those reported in the literature for localization discrimination in monkeys.     

Control of responding by the location of an auditory stimulus: role of rise time of the stimulus

The control of responding by the location of tone bursts of 0.2- or 50-msec rise time was investigated in three albino rats. The apparatus consisted of an enclosure with two levers, two loudspeakers (in different locations), and a dipper feeder. The animal was exposed to tone bursts from either one or the other of the two speakers, and the speaker through which the tone bursts were delivered on any particular trial alternated in an irregular manner. Responses on one lever were reinforced with food in the presence of tone bursts from one speaker; responses on the second lever were reinforced with food in the presence of tone bursts from the second speaker. Responding came under the control of the location of 4-kHz tone bursts of 0.2-msec rise time within the first session. At this rise time, animals maintained a stable level of correct responding of greater than 95%. When the rise time was increased to 50 msec the percentage of correct responding fell to an average of 80 to 85%. It was concluded that location of an auditory stimulus is a powerful controller of responding in rats and that the degree of control is dependent upon rise time.     

Rapid acquisition of an auditory localization discrimination by rats

Acquisition of a sound localization discrimination by rats was investigated. Two loudspeakers were located outside an experimental enclosure containing two levers and a dipper feeder. In the same-side condition, responses on the lever nearest the sound-producing speaker were reinforced. Animals in this condition acquired the discrimination rapidly, generally within the first session. In the opposite-side condition, responses on the lever furthest from the sound-producing speaker were reinforced. Acquisition for animals in this condition began below the chance level (50% correct responses) and took on the order of 10 sessions to approach the final, high level. The course of acquisition in both cases appeared to depend upon an initial tendency of rats to respond on the lever nearest the source of sound in this situation. The rise-decay time of the 4-kHz tone burst signal clearly affected the performance level reached. It did not, however, affect the rate at which the discrimination was acquired.     

Body weight and response acquisition with delayed reinforcement.

The relation between body weight and responding established with unsignaled delayed reinforcement was investigated. In three experiments, naive rats were deprived to either 70%, 80%, or 90% of ad libitum weight and were then exposed to tandem variable-interval 15-s differential-reinforcement-of-other-behavior 30-s schedules. The tandem schedule defined a resetting unsignaled delay-of-reinforcement procedure. In the first experiment, speed of magazine training, acquisition of lever pressing, and final rate of lever pressing were related to body weight. In the next experiment, lever pressing was established and maintained in rats that were magazine trained at 70% of ad libitum weight but that were then exposed to the delay procedure at 90% of ad libitum weight. Responding did not change consistently either across or within subjects in subsequent conditions in which body weight was manipulated. In the final experiment, lever pressing was established and maintained with delayed reinforcement in the absence of magazine training for each of 2 rats at 70% and for 1 of 2 rats at 90% of ad libitum weight. The results further illuminate the conditions under which responding can be established in the absence of training and when such responses are reinforced only following an unsignaled delay period.     

Post-Conditioning Devaluation of an Instrumental Reinforcer has no Effect on Extinction Performance

The extent to which a representation of the reinforcer controls an instrumental response can be assessed by studying the effect of post-conditioning changes in the reinforcer value. In the first experiment rats were trained to press a lever for sucrose pellets on a variable-interval (VI) schedule. The sucrose was subsequently devalued by pairing with Lithium Chloride (LiCl). This had no effect on lever pressing in extinction, although it profoundly reduced reacquisition responding and consumption. In Experiment II rats were trained to shuttle between the two distinctive chambers of a choice-box, in which lever pressing was reinforced in one chamber by sucrose and in the other chamber by food pellets programmed on independent VI schedules. A LiCl-induced taste-aversion was conditioned to the sucrose, and although this markedly affected reacquisition, extinction responding in the sucrose chamber and chamber preference were unaffected. These results indicate that instrumental performance can be independent of the current value of the reinforcer, and are discussed with reference to stimulus-response theory and second-order Pavlovian conditioning.     

Auditory discrimination: role of time and intensity in the precedence effect.

Rats were trained to respond on a lever adjacent to a sounding speaker (the sound source) when a single click was emitted. A second click (the artificial echo) was presented through a second speaker on the opposite side. In Condition I, the echo (equal in intensity to the source) was delayed from .015 to 32 milliseconds; greater than 75% correct responses were given for delay times between about .040 milliseconds (lower threshold) and 8 milliseconds (upper threshold). In Condition II, the echo (simultaneous with the source) was reduced in intensity relative to the source over a range from 2.5 decibels to 40 decibels; greater than 75% correct responses occurred for intensity reductions greater than 5 decibels. In Condition III, both the intensity and the delay time of the echo were manipulated in a manner analogous to that which would occur under natural conditions; greater than 95% correct responses were given for delay times from 1 to 32 milliseconds. These data indicate that both time and intensity differences are necessary for localization of primary sources, with delay time contributing more at short echo path distances, and intensity differences at long distances.     

Drug discrimination in rats under concurrent variable-interval variable-interval schedules

Eight rats were trained to discriminate pentobarbital from saline under a concurrent variable-interval (VI) VI schedule, on which responses on the pentobarbital-biased lever after pentobarbital were reinforced under VI 20 s and responses on the saline-biased lever were reinforced under VI 80 s. After saline, the reinforcement contingencies programmed on the two levers were reversed. The rats made 62.3% of their responses on the pentobarbital-biased lever after pentobarbital and 72.2% on the saline-biased lever after saline, both of which are lower than predicted by the matching law. When the schedule was changed to concurrent VI 50 s VI 50 s for test sessions with saline and the training dose of pentobarbital, responding on the pentobarbital-biased lever after the training dose of pentobarbital and on the saline-biased lever after saline became nearly equal, even during the first 2 min of the session, suggesting that the presence or absence of the training drug was exerting minimal control over responding and making the determination of dose-effect relations of drugs difficult to interpret. When the pentobarbital dose-response curve was determined under the concurrent VI 50-s VI 50-s schedule, responding was fairly evenly distributed on both levers for most rats. Therefore, 6 additional rats were trained to respond under a concurrent VI 60-s VI 240-s schedule. Under this schedule, the rats made 62.6% of their responses on the pentobarbital-biased lever after pentobarbital and 73.5% of their responses on the saline-biased lever after saline, which also is lower than the percentages predicted by perfect matching. When the schedule was changed to a concurrent VI 150-s VI 150-s schedule for 5-min test sessions with additional drugs, the presence or absence of pentobarbital continued to control responding in most rats, and it was possible to generate graded dose-response curves for pentobarbital and other drugs using the data from these 5-min sessions. The dose-response curves generated under these conditions were similar to the dose-response curves generated using other reinforcement schedules and other species.     

Concurrent performances: a baseline for the study of conditioned anxiety

Three rats were trained to lever press on concurrent random interval 2-min random interval 2-min schedules of milk reinforcement. With a 5-sec changeover delay, relative response rate matched the relative reinforcement duration associated with each lever. A stimulus, during which unavoidable shocks occurred at random intervals, was superimposed on this concurrent baseline, and shifts in preference were found. However, data from this procedure were ambiguous, apparently confounded by shock-elicited response bursts. Termination of the shocks during the stimulus resulted in a rapid recovery of matching, which was preceded by a brief facilitation of responding on the less-preferred lever. The procedure was then changed to a conventional conditioned anxiety paradigm with a variable duration pre-shock stimulus. A marked shift in relative response rate towards the preferred lever was found in all three rats; that is, responding on the preferred lever was far less suppressed during the pre-shock stimulus than responding on the less-preferred lever.     

Behavior of rats under fixed consecutive number schedules: effects of drugs of abuse.

Four rats responded under a simple fixed consecutive number schedule in which eight or more consecutive responses on the run lever, followed by a single response on the reinforcement lever, produced the food reinforcer. Under this simple schedule, dose-response curves were determined for diazepam, morphine, pentobarbital, and phencyclidine. The rats were then trained to respond under a multiple fixed consecutive number schedule in which a discriminative stimulus signaled when the response requirement on the run lever had been completed in one of the two fixed consecutive number component schedules. Under control conditions, the percentage of reinforced runs under the multiple-schedule component with the discriminative stimulus added was much higher than the percentage of reinforced runs under the multiple-schedule component without the discriminative stimulus. All of the drugs decreased the percentage of reinforced runs under each of the fixed consecutive number schedules by increasing the conditional probability of short run lengths. This effect was most consistently produced by morphine. The drugs produced few differences in responding between the multiple fixed consecutive number components. Responding under the simple fixed consecutive number schedule, however, was affected at lower doses of the drugs than was responding under the same fixed consecutive number schedule when it was a component of the multiple schedule. This result may be due to the difference in schedule context or, perhaps, to the order of the experiments.     

Conditioned suppression of counting behavior in rats

Three rats were trained on a schedule in which a response on lever B was reinforced only if it was preceded by a minimum number of consecutive responses on lever A. The minimum requirement was 27 A responses for Rat 1, and 20 A responses for Rats 2 and 3. The schedule maintained high rates of responding on lever A, and a slow, spaced pattern of responding on lever B. The mean number of consecutive responses on lever A was slightly greater than the minimum required. The effect of superimposing on this behavior a stimulus that ended with an unavoidable shock was the suppression of responding on both levers during the pre-shock stimulus. Responses on lever A were more suppressed, and the proportion of relatively short response runs on lever A during the pre-shock stimulus increased. With all three rats, the mean number of consecutive responses on lever A during the pre-shock stimulus decreased to a value below the minimum requirement for reinforcement of the subsequent B response.     

Control of responding by location of auditory stimuli: role of differential and non-differential reinforcement

Sound was presented to monkeys through one of two loudspeakers, each adjacent to a response key. A response on the key adjacent to the sound source was reinforced (correct response). A response on the other key produced a timeout (incorrect response). Under these conditions, over 90% of responses were correct within one or two sessions. When the procedure was changed so that a response on either key was reinforced independently of which speaker was sounding, similar control by location developed within one or two sessions. When conditions were modified by moving the keys away from the immediate vicinity of the speakers, the animals required about 20 sessions to reach a stable level of greater than 90% correct responses under differential reinforcement conditions. No control by location developed under nondifferential reinforcement conditions.     

Free-operant escape-avoidance of noise by rats

A series of experiments was conducted to establish free-operant escape-avoidance responding in rats using noise as the stimulus. Naive rats did not acquire a bar-press response on an escape-avoidance of noise schedule. Similarly, free-operant responding established using escape-avoidance of shock was not maintained when noise was substituted for shock. Noise stimuli of 110 dB did maintain responding, but at a lower level than during training, when the noise stimuli had first been paired with shock. Noise stimuli of 97 dB and 87 dB were not effective under those same conditions. Additional rats were trained on a free-operant escape-avoidance schedule of shock and then exposed to a delayed conditioning procedure in which noise was the conditioned stimulus and shock was the unconditioned stimulus. When these subjects were then tested with noise alone, two of the three subjects conditioned and tested with 105-dB noise displayed escape-avoidance of noise, but none of the rats conditioned and tested at 97 dB displayed escape-avoidance of noise. The results suggest that free-operant escape-avoidance of noise can be demonstrated; however, only higher intensity noise stimuli that have been paired with shock are effective.     

Effects of punishing elements of a simple instrumental-consummatory response chain

Rats were trained to press a lever, with every response reinforced with water. After responding was established, nine rats were administered a brief shock after each lever press, and nine others were shocked after drinking. The two procedures resulted in similar suppression of responding, and examination of the latency data when responding was partially suppressed indicated that under both conditions response suppression was due primarily to an increase in the latency of the instrumental response, rather than to pausing between the instrumental and consummatory responses. Thus, punishment following either the instrumental or consummatory component of the simple response sequence reduced the number of sequences initiated, rather than selectively suppressing the punished behavior.     

Simultaneous auditory discrimination.

Stimuli in many visual stimulus control studies typically are presented simultaneously; in contrast the stimuli in auditory discrimination studies are presented successively. Many everyday auditory stimuli that control responding occur simultaneously. This suggests that simultaneous auditory discriminations should be readily acquired. The purpose of the present experiment was to train rats in a simultaneous auditory discrimination. The apparatus consisted of a cage with two response levers mounted on one wall and a speaker mounted adjacent to each lever. A feeder was mounted on the opposite wall. In a go-right/go-left procedure, two stimuli were presented on each trial, a wide-band noise burst through one speaker and a 2-kHz complex signal through the other. The stimuli alternated randomly from side to side across trials, and the stimulus correlated with reinforcement for presses varied across subjects. The rats acquired the discrimination in 400 to 700 trials, and no response position preference developed during acquisition. The ease with which the simultaneous discrimination was acquired suggests that procedures, such as matching to sample, that require simultaneous presentation of stimuli can be used with auditory stimuli in animals having poor vision.     

Re-assessing causal accounts of learnt behavior in rats

Rats received either a common-cause (i.e., A→B, A→food) or a causal-chain training scenario (i.e., B→A, A→food) before their tendency to approach the food magazine during the presentation of B was assessed as a function of whether it was preceded by a potential alternative cause. Causal model theory predicts that the influence of an alternative cause should be restricted to the common-cause scenario. In Experiment 1, responding to B was reduced when it occurred after pressing a novel lever during the test phase. This effect was not influenced by the type of training scenario. In Experiment 2, rats were familiarized with the lever prior to test by training it as a potential cause of B. After this treatment, the lever now failed to influence test responding to B. In Experiment 3, rats given common-cause training responded more to B when it followed a cue that had previously been trained as a predictor of B, than when it followed another stimulus. This effect was not apparent in rats that received causal-chain training. This pattern of results is the opposite of that predicted by causal model theory. Thus, in three experiments, the presence of an alternative cause failed to influence test responding in manner consistent with causal model theory. These results undermine the application of causal model theory to rats, but are consistent with associative analyses.     

Discriminative properties of shock-correlated reinforcement in an operant context

A two-choice discrete operant procedure was devised for the study of shock-correlated reinforcement effects in rats. In the presence of one auditory stimulus, responding on one response lever was reinforced with food; with another auditory stimulus, responding on a second lever was reinforced. It was found that discrimination performance of one group, relative to appropriate control groups, was facilitated when electric shock was correlated with reinforcement on one lever and not on the other. Further, relative discrimination levels were found to be higher on the lever correlated with the shock than on the alternate lever. The significance of the results for operant within-S studies and for a mediational theory of shock-correlated reinforcement was discussed.     

Intercurrent and reinforced behavior under multiple spaced-responding schedules

Lever pressing in rats was reinforced with food under a multiple spaced-responding schedule. A lever, food cup, and drinking tube were mounted in a running wheel so that lever pressing, running, and licking could be recorded. Running and licking had no scheduled consequences. Lever pressing was reinforced under a multiple schedule with three spaced-responding components and an extinction component. Each component was associated with a different auditory stimulus. Spaced-responding components reinforced only lever presses terminating interresponse times equal to or greater than 10, 20, or 60 sec, respectively. Rates of lever pressing, reinforcement, and licking all decreased as schedule parameter increased. Efficiency of spaced responding, as measured by reinforcements per response, also decreased. Rate of wheel running either increased or increased and then decreased with increasing schedule parameter. Individual running rates differed substantially. Neither licking nor running rate correlated with individual differences in efficiency. Analysis of conditional probabilities among the several response classes showed that, as the schedule requirement increased, the probability of running after a lever press increased and the probability of licking after a lever press decreased. After reinforcement, one subject always pressed the lever next. In the other subjects, the conditional probability of lever pressing, given reinforcement, increased while the probability of licking, given reinforcement, decreased with increasing schedule requirement. Results are discussed in relation to the concepts of schedule-induced and mediating behavior.     

Effects of reinforcement scheduling on simultaneous discrimination performance

Pigeons were trained on a discrete-trials, simultaneous discrimination procedure, with confusable stimuli such that asymptotic performance was about 85% correct. Trials were terminated if no response occurred within 2 sec of stimulus onset, so that probability of responding was free to vary. The schedule of reinforcement for correct responses was varied, with the following results: (1) there was no relation between frequency of reinforcement and accuracy of responding. (2) In extinction, the probability of responding fell to low levels, but accuracy remained roughly constant. (3) When reinforcement was available after a fixed number of trials or after a fixed number of correct responses, the probability of responding increased with successive trials after reinforcement, but accuracy was generally constant. (4) When every fifth correct response was reinforced, accuracy decreased immediately after reinforcement if the birds were required to respond on every trial.