Control of responding by location of auditory stimuli: adjacency of sound and response.

Four rhesus monkeys were trained to respond on one key when a one-second noise burst was presented through one speaker and to respond on a second key when the noise burst was presented through a second speaker. The acquisition of stimulus control was studied under three conditions, in each of which the relationship between the sound source and the response-key positions varied: an adjacent condition in which the noise burst was presented through the key and a response on this key was reinforced; a reversed-adjacent condition in which the noise burst was presented through one key and responding on the other key was reinforced: and a nonadiacent condition in which responding on the key nearer the sound was reinforced. Under adjacent conditions, stimulus control developed within one or two sessions. Under reversed and nonadjacent conditions, 10 sessions were required for the development of control. The asymptote of correct responding was the same under each condition in all animals.     

Control of responding by location of auditory stimuli: rapid acquisition in monkey and rat

Monkeys require a considerably larger number of trials to bring responding under the control of the location of an auditory stimulus than cats, rats, and bats with the same experimental procedures. The present experiment sought to determine the conditions necessary for rapid acquisition of control of responding by location of noise and tone bursts in the monkey. Monkeys were run in an enclosure that contained four loudspeakers and four manipulanda. Two conditions were used in training. In the adjacent condition, a stimulus (noise or tone burst) was presented through one or other of two speakers and a response on the manipulandum adjacent to the speaker was reinforced with food. In the nonadjacent condition, a stimulus was presented through one of two speakers and a response on a manipulandum remote from the speaker was reinforced with food. Acquisition of control was measured by change in the percentage of reinforced responses during training. In the adjacent condition, responding came under control of location within zero to three sessions. In nonadjacent conditions, the animals required 14 to 20 sessions to come under control of location. These latter numbers are comparable to those reported in the literature for localization discrimination in monkeys.     

Effects of compounding drug-related stimuli: escalation of heroin self-administration

Previous experiments have demonstrated that presenting independently established discriminative stimuli in compound can substantially increase operant responding maintained by food reinforcement or shock avoidance. Recently, this phenomenon was also shown to occur with cocaine self-administration. The present study further assessed the generality of these stimulus-compounding effects by systematically replicating them with heroin self-administration. Rats' nose-poke responses produced intravenous heroin (0.025 mg/kg per infusion) on a variable-ratio schedule when either a tone or a light was present. In the absence of these stimuli, responding was not reinforced. Once discriminative control by the tone and light had been established, the stimuli were presented in compound under extinction (with heroin discontinued) or maintenance conditions (with heroin available during test-stimulus presentations). In extinction, the tone-light compound increased responding approximately threefold compared to tone or light alone. Under maintenance conditions, compounding increased heroin intake approximately twofold. These effects closely matched those obtained earlier with cocaine. This consistency across pharmacological classes and across drug and nondrug reinforcers further confirms that (a) self-administered drugs support conditioning and learning in a manner similar to that supported by other reinforcers; and (b) multiple drug-related cues interact in lawful and predictable ways to affect drug seeking and consumption.     

Control of responding by the elements of a compound discriminative stimulus and by the elements as individual discriminative stimuli

In the first of two studies, the responding of four albino rats was differentially reinforced in the presence of noise and light together and then tested in the presence of the noise and the light separately during extinction. The light exercised substantially more control of responding than did the noise. In the second study the responding of a similar group of four rats was differentially reinforced in the presence of the noise and the light separately. Control of responding by the light developed more rapidly than control by the noise. Results suggest that levels of control by stimuli after differential reinforcement with respect to the stimuli together can be predicted by the rates of development of control during differential reinforcement with respect to the stimuli separately.     

Orientation and lever responding in auditory discriminations in squirrel monkeys.

Head orientation during auditory discriminations was studies in squirrel monkeys using a two-lever trial-by-trial procedure. Animals were studied using auditory discriminations based on the position of the sound and on the spectral content differences between a pure tone and a noise. After the percentage of correct responses reached asymptote, head orientation was measured using videotape recordings. Orientation occurred on virtually every trial and was under the control of the position of the sound under all conditions. Lever responding was controlled by the same parameters of the sound under some conditions, and by different parameters in others. Orientation and lever responding were correlated (a level response could be predicted from the direction of orientation) when both responses were under the control of the same parameters of the sound. The two responses were uncorrelated when they were controlled by different parameters of the sound. Orientation and lever responding were not functionally related.     

Schedules using noxious stimuli. III. Responding maintained with response-produced electric shocks

Responding was maintained in two squirrel monkeys under several variations of a 10-min fixed-interval schedule of electric shock presentation. The monkeys were first trained under a 2-min variable-interval schedule of food presentation, and then under a concurrent schedule of food presentation and shock presentation. In one monkey, when shocks (12.6 ma) followed each response during the last minute of an 11-min cycle ending with a timeout period, responding was increased during the first 10 min and suppressed during the last minute of each cycle. When the shock schedule was eliminated, both the enhancement and suppression disappeared, and a steady rate of responding was maintained under the variable-interval schedule. When the food schedule was eliminated, the shock schedule maintained a characteristic fixed-interval pattern of responding during the first 10 min, but suppressed responding during the last minute of each cycle. The fixed-interval pattern of responding was maintained when the timeout period was eliminated and when only one shock could occur at the end of the cycle. In the second monkey, responding under the concurrent food and shock schedule was suppressed when responses produced shocks after 3-min. Under an 11-min cycle, responding continued to be maintained at increasing shock intensities. When the food schedule was eliminated, a fixed-interval pattern of responding was maintained under a 10-min schedule of shock presentation (12.6 ma). Whether response-produced electric shocks suppressed responding or maintained responding depended on the schedule of shock presentation.     

Control of responding by the location of an auditory stimulus: role of rise time of the stimulus

The control of responding by the location of tone bursts of 0.2- or 50-msec rise time was investigated in three albino rats. The apparatus consisted of an enclosure with two levers, two loudspeakers (in different locations), and a dipper feeder. The animal was exposed to tone bursts from either one or the other of the two speakers, and the speaker through which the tone bursts were delivered on any particular trial alternated in an irregular manner. Responses on one lever were reinforced with food in the presence of tone bursts from one speaker; responses on the second lever were reinforced with food in the presence of tone bursts from the second speaker. Responding came under the control of the location of 4-kHz tone bursts of 0.2-msec rise time within the first session. At this rise time, animals maintained a stable level of correct responding of greater than 95%. When the rise time was increased to 50 msec the percentage of correct responding fell to an average of 80 to 85%. It was concluded that location of an auditory stimulus is a powerful controller of responding in rats and that the degree of control is dependent upon rise time.     

Generalization gradients of inhibition following auditory discrimination learning

A more direct method than the usual ones for obtaining inhibitory gradients requires that the dimension of the nonreinforced stimulus selected for testing be orthogonal to the dimensions of the reinforced stimulus. In that case, the test points along the inhibitory gradient are equally distant from the reinforced stimulus. An attempt was made to realize this condition by obtaining inhibitory gradients along the frequency dimension of a pure tone after discrimination training in which the nonreinforced stimulus was a pure tone (or tones), and the reinforced stimulus was either white noise or the absence of a tone. The results showed that some degree of specific inhibitory control was exerted by the frequency of the tone, although the gradients were broad and shallow in slope.

A further experiment was conducted to see whether the modification of an excitatory gradient resulting from training to discriminate neighboring tones could arise from a simple interaction of inhibitory and excitatory gradients. The results indicated that it could not, since discrimination training produced a concentration of responding in the vicinity of the reinforced stimulus which cannot be derived from any plausible gradient of inhibition.

     

Food-paired stimuli as conditioned reinforcers: effects of d-amphetamine.

Seven pigeons were studied in two experiments in which key pecks were reinforced under a second-order schedule wherein satisfaction of variable-interval schedule requirements produced food or a brief stimulus. In the second part of each session, responses produced only the brief stimulus according to a variable-interval schedule (food extinction). For the 4 pigeons in Experiment 1, the response key was red throughout the session. In separate phases, the brief stimulus was either paired with food, not paired with food, or not presented during extinction. d-Amphetamine (0.3 to 10.0 mg/kg) dose-dependently reduced food-maintained responding during the first part of the session and, at intermediate dosages, increased responding during the extinction portion of the session. The magnitude of these increases, however, did not consistently depend on whether the brief stimulus was paired, not paired, or not presented. It was also true that under nondrug conditions, response rates during extinction did not differ reliably depending on pairing operations for the brief stimulus. In Experiment 2, 3 different pigeons responded under a procedure wherein the key was red in the component with food presentations and blue in the extinction component (i.e., multiple schedule). Again, d-amphetamine produced dose-related decreases in responding during the first part of a session and increases in responding in the second part of the session. These increases, however, were related to the pairing operations; larger increases were observed when the brief stimulus was paired with food than when it was not or when it was not presented at all. Under nondrug conditions, the paired brief stimulus controlled higher response rates during extinction than did a nonpaired stimulus or no stimulus. These findings suggest that d-amphetamine can enhance the efficacy of conditioned reinforcers, and that this effect may be more robust if conditioned reinforcers occur in the context of a signaled period of extinction.     

Control of responding during stimuli that precede transitions in reinforcement frequency

Pigeons' responses were reinforced on a variant of a mixed variable-interval extinction schedule of reinforcement in which the transition to the higher reinforcement rate was signaled by a trace stimulus projected on the response key prior to the onset of the component correlated with food delivery. In the first of two experiments, the duration of the trace stimulus preceding the component correlated with food delivery was varied from 1.5 to 50.0 s and in the second experiment, the reinforcement frequency in the same component was varied from 10 to 60 reinforcers per hour. Pigeons pecked at the trace stimulus preceding the onset of the component correlated with food delivery even though responding was not reinforced in its presence and only one of the changes in reinforcement rate (i.e., from extinction to reinforcement) was signaled. The rate of pecking during the trace stimulus was a function of its duration but not of the reinforcement frequency in the following component. Higher rates generally occurred at the shorter trace-stimulus durations. Component responding following the offset of the trace stimulus was under discriminative control of the trace stimulus whether or not responding occurred in the presence of the trace stimulus.     

Stimulus properties of conspecific behavior

Two experiments identified the conditions in which the behavior of one bird acquired discriminative control of the behavior of a second bird. The schedule-controlled behaviors of the “stimulus” bird were differentially correlated with the components of a multiple schedule according to which the pecking of an “experimental” bird produced food. In Experiment 1, three pairs of pigeons acquired a successive discrimination and two reversals with the conspecific stimuli. Experiment 2 included a control condition in which no systematic relationship existed between the conspecific stimuli and the component schedules. While differential responding during the components of the multiple schedule was again found when the conspecific stimuli were available, differential responding did not occur in the control condition. Test conditions included in the experiments indicated that (a) the differential responding was not dependent on the discriminative properties of reinforcement, (b) the pecking of the stimulus and experimental birds was temporally interrelated, (c) the visual conspecific stimuli were critical to the maintenance of the discrimination, and (d) the observed stimulus control immediately generalized to an unfamiliar conspecific.     

Responding under fixed-ratio and multiple fixed-interval fixed-ratio schedules of electric shock presentation

Squirrel monkeys, initially trained under a schedule of electric shock postponement and then under fixed-interval schedules of electric shock presentation, were studied under multiple fixed-interval fixed-ratio and under fixed-ratio schedules of shock presentation. Under the fixed-interval (10-min) component of the multiple schedule, a pause was followed by a gradual increase in responding to a rate maintained until shock presentation; under the fixed-ratio (3-, 10-, or 30-response) component of the multiple schedule, a brief pause was typically followed by a relatively high and uniform rate of responding until shock was presented. When the 60-sec timeout periods, which usually followed shock presentation, were eliminated from the multiple schedule for one monkey, responding was only transiently affected. In the one monkey studied, responding was maintained under a fixed-ratio schedule alone (with timeout periods), but rates of responding were lower than under the fixed-ratio component of the multiple schedule. Characteristic patterns of responding, similar to those engendered under schedules of food presentation or shock termination, can be maintained under fixed-ratio schedules of shock presentation; further, patterns of responding can be controlled by discriminative stimuli in multiple schedules.     

Second-order schedules with paired auditory brief stimuli

Pigeons were exposed to multiple second-order schedules of paired and unpaired brief stimuli in which responding on the main key was reinforced according to a fixed-interval thirty-second schedule by a brief stimulus (a tone in the paired schedule) and advancement to the next segment of the second-order schedule. In Experiment 1, a response on the second key was required during the tone in its fourth and final presentation to produce food. Responses during earlier brief stimuli indicated the extent to which the final brief stimulus was discriminated from preceding ones. Responding was comparable during all tones, extending prior findings with visual paired brief stimuli and weakening explanations of subjects' failure to discriminate between brief-stimulus presentations in terms of elicited responding. In Experiment 2 the number of fixed-interval segments comprising the second-order schedules varied from one through eight. Although main-key response rates increased across segments in both experiments, they increased much less sharply with a variable number of segments. These results suggest that the increase in main-key response rates across segments is due primarily to a degree of temporal discrimination not reflected on the second key. Main-key response rates were higher on paired auditory brief-stimulus schedules than on unpaired visual brief-stimulus schedules, especially in Experiment 2, thus further extending findings with visual brief stimuli to second-order schedules with auditory brief stimuli.     

Relations between baseline contingencies and equivalence probe performances

Following the emergence of two three-member equivalence classes (A1B1C1 and A2B2C2), 5 college students were exposed to one or more changes in the reinforcement contingencies controlling baseline conditional discriminations. AC relations were either reversed (i.e., C2 was reinforced and C1 punished when A1 was the sample; C1 was reinforced and C2 punished when A2 was the sample) or arranged randomly (i.e., C2 and C1 were reinforced and punished equally often in the presence of A1 and A2). In a third condition, the original AB and AC relations were reversed. Results showed that although baseline conditional discrimination performances were under the control of reinforcement contingencies, and performances on symmetry trials varied with baseline responding for 3 of 4 subjects when contingencies were reversed, performances on transitivity probes remained consistent with the initial equivalence class. These inconsistencies between probe and baseline performances were striking because conditional discriminations are thought to be the determinants of equivalence class performance. Similarly, the contrast between performances on symmetry and transitivity probes was of theoretical interest because equivalence classes are defined by congruent patterns of responding on probe trials.     

The effect of a fading procedure upon the acquisition of control by an overshadowed auditory feature

Pigeons' key-pecking responses were reinforced in the presence of a compound stimulus that consisted of an auditory feature (a tone) and a visual feature (a light) and non-reinforced in the presence of a compound stimulus that was either a noise and a dark key, or noise and a light. In the condition where reinforcement trials differed from non-reinforcement trials on the basis of both auditory and visual features, the tone exerted very little control over responding on test. In the condition where reinforcement differed from non-reinforcement trials solely on the basis of the auditory features, an abrupt and a gradual introduction of the visual feature of the negative stimulus, a light, were compared for their effect upon control in the compounds. The tone acquired strong control in both cases. Evidence indicated that the tone had acquired control in the gradual condition without the occurrence of responses to the negative stimulus. An incidental finding was that when the negative stimulus consisted of a noise and a light, which was introduced abruptly, responding over the light dimension with tone, on test, was peaked at a point other than that light value used as positive and negative during training.     

Acquisition of stimulus control while introducing new stimuli in fading.

After establishing discrimination between a red positive stimulus and a green negative stimulus, the lowest intensity colors that restricted all responding to the positive stimulus were determined. Then, two new white lines differing in terms of line orientation were each superimposed on one of the colors and were increased in intensity. Thereafter, the intensity of the colors was decreased and eventually eliminated. Probe stimuli consisting of the lines presented against dark backgrounds were presented before each change of stimulus intensity, and probe responding was used to assess the control acquired by various dimension of the new stimuli during the course of fading. The lines acquired control of responding while they were being introduced, and control was strengthened as the colors were attenuated. Such a locus of acquisition was attributed to the starting intensity of the original controlling stimuli and was explained in terms of stimulus blocking. Finally, using probes while introducing the new stimuli enhanced the acquisition of control by the new stimuli.     

Compounding discriminative stimuli controlling free-operant avoidance

The performances of three rats were stabilized on a multiple schedule that maintained responding by a free-operant avoidance schedule during independent presentations of tone and light. The simultaneous absence of these stimuli signalled shock-free periods and controlled response cessation. Subsequently, test sessions were administered consisting of independent presentations of each stimulus and these stimuli compounded (tone-plus-light). During an extinction test, additive summation was observed to the compounded stimuli, i.e., more responses were emitted to the compound than to either tone or light. During a series of 28 maintenance-test sessions in which the shock schedule remained operative, the compounded stimuli produced a generally enhanced response rate and fewer pauses terminating with shock than either single stimulus condition. These results extend the generality of free-operant additive summation to responding maintained by aversive control. In addition, a comparison of the present study with previous experiments reporting additive summation of positively reinforced responding indicates that similar variables—rate and aversive differences between training stimulus conditions—should be considered in accounting for response distributions during stimulus compounding when responding is controlled by either positive or negative contingencies.     

Effects of a pre-aversive stimulus upon oddity performance in monkeys

Two monkeys (Macaca mulatta) were trained to perform an oddity discrimination using automatically projected patterned stimuli. After criteria for both response and discrimination stability were met, a tone followed by shock was superimposed upon the ongoing behavior. Each 60-sec tone was terminated with the onset of a 0.3-sec, 1 to 1.5-ma electric shock. During the tone, baseline responding was partially suppressed but discrimination performance was little altered from the pre-tone period. When shock was raised to 2 to 3 ma, responding was further suppressed, but discrimination performance was again essentially unaltered.     

Blocking between occasion setters and contextual stimuli

Two appetitive conditioning experiments with rats used a blocking procedure to compare the mechanisms through which contexts and positive occasion setters control responding to conditioned stimuli (CSs) in discrimination learning. In Experiment 1, a light (L) initially set the occasion for food reinforcement of a tone CS (T). Then a compound of L and a novel context signaled reinforcement of T. Previous learning about L blocked contextual control of responding to T. Blocking was not due to simple excitation conditioned to L during discrimination training; comparable excitation to L in a control group did not result in blocking. Conversely, in Experiment 2, initial learning about the context blocked the acquisition of occasion setting to L. Excitation conditioned to the context could not account for the blocking. In general, the results suggest that contexts and occasion setters may control responding to CSs through similar mechanisms.     

Analysis of discriminative control by social behavioral stimuli

Visual discriminative control of the behavior of one rat by the behavior of another was studied in a two-compartment chamber. Each rat's compartment had a food cup and two response keys arranged vertically next to the clear partition that separated the two rats. Illumination of the leader's key lights signaled a “search” period when a response by the leader on the unsignaled and randomly selected correct key for that trial illuminated the follower's keys. Then, a response by the follower on the corresponding key was reinforced, or a response on the incorrect key terminated the trial without reinforcement. Accuracy of following the leader increased to 85% within 15 sessions. Blocking the view of the leader reduced accuracy but not to chance levels. Apparent control by visual behavioral stimuli was also affected by auditory stimuli and a correction procedure. When white noise eliminated auditory cues, social learning was not acquired as fast nor as completely. A reductionistic position holds that behavioral stimuli are the same as nonsocial stimuli; however, that does not mean that they do not require any separate treatment. Behavioral stimuli are usually more variable than nonsocial stimuli, and further study is required to disentangle behavioral and nonsocial contributions to the stimulus control of social interactions.