Conditioned suppression and conditioned enhancement with the same positive UCS: an effect of CS duration

Previous experiments have shown that positively reinforced operant responding is suppressed during a conditioned stimulus terminated with an electric shock (conditioned suppression). In the present experiment, the conditioned stimulus was terminated with a positive unconditioned stimulus, and it was found that the duration of the conditioned stimulus was a key factor in determining whether response suppression or response enhancement was observed during the stimulus. The lever-pressing responses of rats were maintained by a variable-interval schedule of food reinforcement. While the rats were pressing the lever, a light was occasionally turned on, its offset coincident with a brief period of access to a sucrose solution. In consecutive blocks of sessions, the light duration was 40 sec, 12 sec, or 120 sec. Results showed that the rate of lever pressing was substantially suppressed during the 12-sec stimulus, slightly suppressed during the 40-sec stimulus, and enhanced during the 120-sec stimulus.     

Selective transfer of responding in conditional discriminations

In each of three experiments rats received discrimination training in which whether or not a 10-sec target stimulus was followed by food was signalled by a 2-min background stimulus. In the first experiment the target was paired with food in the presence but not the absence of the background stimulus. Subsequent tests revealed that the background elevated responding to a target that had taken part in a similar discrimination. However, it had no influence on the responses elicited by a partially reinforced conditioned stimulus. In the remaining experiments the target was paired with food in the absence but not the presence of the background. Test trials then revealed that although the background had an inhibitory influence on the responses elicited by a target from a similar discrimination, it had no influence on the responses elicited by either a partially or a continuously reinforced conditioned stimulus. Various explanations for this selective influence of a background stimulus are considered.     

Context, observing behavior, and conditioned reinforcement

Pigeons made observing responses for stimuli signalling either a fixed-interval 30-sec schedule or a fixed-ratio x schedule, where x was either 20, 30, 100, 140, or 200 and the schedules alternated at random after reinforcement. If observing responses did not occur, food-producing responses occurred to a stimulus common to both reinforcement schedules. When the fixed-interval schedule was paired with a low-value fixed ratio, i.e., 20 or 30, the presentation of the stimulus reliably signalling the fixed-ratio schedule reinforced observing behavior, but the presentation of the stimulus reliably signalling the fixed-interval schedule did not. The converse was the case when the fixed-interval schedule was paired with a large-valued fixed ratio, i.e., 100, 140, or 200. The results demonstrated that the occasional presentation of the stimulus signalling the shorter interreinforcement interval was necessary for the maintenance of observing behavior. The reinforcement relationship was a function of the schedule context and was reversed by changing the context. Taken together, the results show that the establishment and measurement of conditioned reinforcement is dependent upon the context or environment in which stimuli reliably correlated with differential events occur.     

Conditioning in human opiate addicts

Eight volunteers maintained on daily methadone participated in a classical conditioning procedure to determine which if any of the elements of narcotic withdrawal could be conditioned. The unconditioned stimulus was the injection of a small dose of naloxone. The unconditioned response was a brief precipitated withdrawal syndrome. The conditioning stimulus was a tone, odor, and injection of saline. Conditioning was successful in the pilot study in 5 of 8 subjects. The conditioned response consisted of tearing, yawning, lacrimation, systolic blood pressure increase, respiratory irregularities and subjective feelings of narcotic withdrawal sickness (nausea, muscle aches, chills). A second group of 8 subjects showed, in addition to the above, evidence of conditioning of heart rate, respiratory rate and skin temperature decrease. These laboratory findings support the clinical reports of a conditioned withdrawal syndrome and suggest ways to improve treatment results by detecting and extinguishing or modifying conditioned responses.     

Conditioned nalorphine-induced abstinence changes: persistence in post morphine-dependent monkeys

Every tenth lever-press of three morphine-dependent rhesus monkeys was reinforced with food. A red light, initially a neutral stimulus, was presented every third or fourth session for 5 min before and 5 min after an intravenous injection of nalorphine, a morphine antagonist that produces an immediate abstinence syndrome in morphine-dependent monkeys. After several pairings, conditioned suppression of lever pressing, heart-rate decrease, vomiting, and excessive salivation were observed during the red-light period before nalorphine injection. No conditioned electrocardiogram, respiration or temperature changes occurred. After 10 red light-nalorphine pairings, morphine administration was completely discontinued and monkeys were then tested monthly for persistence of the conditioned responses. The red light paired with saline injection continued to suppress lever pressing and to produce heart-rate decreases after 60 to 120 days of complete abstinence from morphine. Subsequently, daily presentations of the red light-saline injection complex rapidly extinguished these conditioned responses. Nevertheless, they could be rapidly reinstated by additional nalorphine injections.     

Comparison of Single Unit Responses to Tone, Light, and Compound Conditioned Stimuli during Rabbit Classical Eyeblink Conditioning

Unit recordings and lesion studies have implicated the cerebellum as an essential site for the acquisition and maintenance of the conditioned eyeblink response. The current study looked at the neural characteristics of conditioned stimulus (CS) processing in the interpositus nucleus of the cerebellum after training New Zealand white rabbits (Oryctolagus cuniculus) in one of two conditioning paradigms: (a) compound conditioning (CMP), a compound CS consisting of light and tone paired with an air puff unconditioned stimulus (US); or (b) stimulus compounding (ALT), alternating blocks of tone CS and light CS trials paired with the air puff US. Single unit responses were recorded during five sessions after the animals had reached an asymptotic level of responding. Animals were tested for behavioral and neural responses to CS alone trials that included tone alone, light alone, and compound tone-light trials. For the CMP group, the compound CS elicited 80 to 90% conditioned eyeblink responses (CRs), whereas the individual tone and light CSs elicited only 40 to 50% CRs. For the ALT group, all three CSs (tone, light, and compound) elicited very high levels of responding of at least 80% CRs. For the CMP group, there were roughly equal numbers of cells responding to all of the CSs. This includes cells that responded exclusively to one, and only one, of the three stimuli and also those cells that responded to combinations of two or more. Cells from the ALT group were far more likely to respond exclusively to only one of the CSs. Both the behavioral and physiological results suggest that the compound tone-light stimulus was processed as a distinct stimulus, separate from the component tone and light. These results are discussed in the context of multisensory processing.     

CS-specific gamma,theta, and alpha EEG activity detected in stimulus generalization following induction of behavioral memory by stimulation of the nucleus basalis

Tone paired with stimulation of the nucleus basalis (NB) induces behavioral memory that is specific to the frequency of the conditioned stimulus (CS), assessed by cardiac and respiration behavior during post-training stimulus generalization testing. This paper focuses on CS-specific spectral and temporal features of conditioned EEG activation. Adult male Sprague-Dawley rats, chronically implanted with a stimulating electrode in the NB and a recording electrode in the ipsilateral auditory cortex, received either tone (6kHz, 70dB, 2s) paired with co-terminating stimulation of the nucleus basalis (0.2s, 100Hz, 80-105 microA, ITI approximately 45s) or unpaired presentation of the stimuli (approximately 200 trials/day for approximately 14 days). CS-specificity was tested 24h post-training by presenting test tones to obtain generalization gradients for the EEG, heart rate, and respiration. Behavioral memory was evident in cardiac and respiratory responses that were maximal to the CS frequency of 6kHz. FFT analyses of tone-elicited changes of power in the delta, theta, alpha, beta1, beta2, and gamma bands in the paired group revealed that conditioned EEG activation (shift from lower to higher frequencies) was differentially spectrally and temporally specific: theta, and alpha to a lesser extent, decreased selectively to 6kHz during and for several seconds following tone presentation while gamma power increased transiently during and after 6kHz. Delta exhibited no CS-specificity and the beta bands showed transient specificity only after several seconds. The unpaired group exhibited neither CS-specific behavioral nor EEG effects. Thus, stimulus generalization tests reveal that conditioned EEG activation is not unitary but rather reflects CS-specificity, with band-selective markers for specific, associative neural processes in learning and memory.     

SOME RELATIONS BETWEEN CLASSICALLY CONDITIONED AGGRESSION AND CONDITIONED SUPPRESSION IN SQUIRREL MONKEYS

During three experiments with squirrel monkeys, stimulus and shock pairings were given in the presence of a bite tube. Experiments 1 and 2 used a conditioned-suppression procedure in which bar pressing was reinforced with food. A transparent shield prevented biting of the bar. When the stimulus was paired with shock, bar pressing decreased (conditioned suppression) and tube biting increased during the stimulus (classically conditioned aggression). When the bite tube was removed on alternate sessions in Experiment 2, there was more suppression when the tube was present, thus suggesting that biting competed with bar pressing. However, this simple competing-response interpretation was complicated by the findings of Experiment 3 where, with naive monkeys, bar pressing was never reinforced with food, yet bar pressing was induced during the stimulus and was highest when the bite tube was absent. The fact that stimulus-induced bar pressing developed indicates that bar pressing in conditioned-suppression procedures, suppressed or not, may be maintained by two types of control—the food reinforcer and induced CS control. The higher rate of induced bar pressing during the stimulus with the bite tube absent confounds a simple competing response interpretation of conditioned suppression. It suggests that shock-induced responses during conditioned suppression could be both contributing to and competing with responding maintained by food, with the net effect depending on specific but ill-defined features of the situation.     

Positive conditioned suppression: conditioned suppression using positive reinforcers as the unconditioned stimuli

Research has revealed the phenomenon of conditioned suppression in which the rate of responding is reduced during a stimulus that is paired with noncontingent shock. The present study replicated this procedure, but used noncontingent positive reinforcers instead of the aversive shock. The lever-pressing responses of rats were reinforced with food or water. While the rats were responding, a stimulus was occasionally presented and paired with the delivery of a noncontingent positive reinforcer, which was either food, water, or brain stimulation for different rats. The result was a reduction in the rate of responding during the conditioned stimulus. This finding shows that conditioned suppression occurs during a signal for reinforcing as well as aversive stimuli.     

Classical skin conductance response conditioning: effects of intermittent reinforcement and information about schedule contingencies.

Skin conductance responses were differentially conditioned using reinforcement schedules of 25%, 50%, 75%, and 100%, manipulated between subjects. Half of the subjects were informed about schedule contingencies, and half were uninformed. The interstimulus interval was 6 sec. Discrimination of first-interval responses (1.0-3.5 sec after conditioned stimulus [CS] onset) by informed subjects did not vary with the ratio variable, but that by uninformed subjects improved with increasing reinforcement ratio because of diminished response levels to the nonreinforced CS (CS-). Discrimination of second-interval responses (3.6-7.0 sec after CS onset) improved as a function of increasing reinforcement ratio because of elevated response levels to the reinforced CS (CS+), but the effect was not persistent across trials in informed subjects. Performance in the first and second intervals did not reflect sequential increments and decrements as a function of reinforced and nonreinforced trials. Third-interval responses (7.1-9.9 sec after CS on nonreinforced trials) were not affected by schedule manipulations, but unconditioned responses diminished with increasing reinforcement ratio. Information about schedule contingencies led to superior discrimination of first-, second-, and third-interval responses and to suppression of unconditioned responses.     

An experimental demonstration of discriminated (nongeneralized) imitation

In a number of experiments, nonreinforced imitation has been found to persist at high rates despite the variety of procedures which have been employed to eliminate such responses. In the present experiment, powerful stimulus control was established over imitation by providing an alternative response which was reinforcible. Four children participated in a multiple-schedule experiment in which imitation was reinforced in the presence of one light and bar pressing in the presence of a second light; throughout the experiment, responses were modeled on each trial: hand-arm responses in the presence of the red light and leg responses in the presence of the yellow light. Initially, imitation was reinforced in the presence of the red light and button pressing in the presence of the yellow light. In a within-subjects design, stimulus control was demonstrated by reversing the association of lights and contingencies, then reinstating the original contingencies. The children imitated when reinforced for imitation and pressed the button when button pressing was reinforced. The results demonstrate stimulus control over imitation which is more powerful than in previous investigations and indicate that the prevailing reinforcement contingencies determine whether or not a child will imitate on a particular occasion.This research was supported by a Faculty Summer Research Grant from The American University. The authors wish to express their appreciation to the School for Contemporary Education, McLean, Virginia, and to Dr. Sally Sibley, Mr. David Williams, and Mrs. Linda Trout for their cooperation in providing subjects and research space.     

Conditioned nausea after cancer chemotherapy and autonomic nervous system conditionability

There are marked individual differences in conditioned nausea after cancer chemotherapy. To examine if part of this variation is associated with individual differences in autonomic nervous system conditionability, the present study addressed whether patients with conditioned nausea acquired conditioned heart rate and electrodermal responses at a different rate than patients without conditioned nausea. Of 28 relapse-free patients who had completed cisplatinum treatment for testicular cancer between 1981 and 1986, 10 reported persistent conditioned nausea, 8 extinguished conditioned nausea and 10 no conditioned nausea. These three groups were subjected to a differential conditioning paradigm with 8 sec pictorial stimuli (circles and triangles) serving as conditioned stimuli for an unconditioned electric shock while heart rate and electrodermal activity was monitored. There were 4 habituation, 8 acquisition and 8 extinction trials with each of the two cues. Analyses of variance using nausea status as the independent variable and physiological responses as the dependent lended some support to the notion that conditioned heart rate deceleration developed in response to the reinforced compared to the nonreinforced cue during acquisition in the two groups with persistent or extinguished conditioned nausea but not in the group with no conditioned nausea. In addition, patients that displayed good, as compared to poor heart rate conditionability during acquisition, were more likely to have persistent conditioned nausea, whereas those who showed poor heart rate conditioning mostly were those without conditioned nausea. Electrodermal variables revealed no systematic differences between groups. This tentatively supports that individual differences in parasympathetic but not sympathetic nervous system conditionability may be associated with individual differences in conditioned nausea resulting from cancer chemotherapy.     

Conditioning the cardiorespiratory dynamics of locomotion in dogs

In 17 dogs blood pressure in the carotid artery, heart rate, pneumogram and actogram of the hind leg were recorded during rest and during locomotion on a treadmill. The increases in cardiorespiratory dynamics which occurred during locomotion were then conditioned. The conditional stimulus was represented by the noise and vibration of the treadmill. It was determined that conditional changes in cardiorespiratory dynamics can be formed quickly on the basis of locomotion. Qualitatively the changes were the same as the unconditional changes, and their magnitude was 60 to 70 per cent that of the unconditional changes. Conditional increase in cardiorespiratory dynamics was most intensive in the first 30 seconds from the onset of the conditional stimulus. In acute extinction of these conditional changes, movements of the extremities were inhibited first, followed by inhibition of increased blood pressure, then inhibition of increased heart rate, and last, inhibition of increased respiratory rate. In another series of experiments on five dogs cardiorespiratory responses were conditioned to a sudden change from moderate locomotion (50 m per min) to rapid locomotion (200 m per min). Increased cardiorespiratory dynamics could be conditioned easily. Increased circulation of blood and increased respiratory rate on exposure to conditional stimuli signalling muscular exertion can be considered an important preparation of the organism for actual muscular activity. This preparation also takes place in natural life conditions.     

Failure to develop a conditional reflex by stimulation of the cephalad portion of the severed vagosympathetic trunk: Its significance in terms of the central connections of the vagus

Stimulation of the central stump of either vagosympathetic trunk in the dog, the contralateral nerve remaining intact, regularly provoked deep respiratory movements with forceful expiration, followed by a period of apnea, and a fall in blood pressure, systolic and diastolic, of 20–60 mm/Hg. Stimulation of the cephalad portion of the left nerve provoked brief acceleration of heart rate during the period of hyperventilation, followed by bradycardia; when the stimulus was applied to the central stump of the right nerve heart rate remained relatively unchanged. When a 12-second tone as a conditional stimulus (CS) was reinforced during its last six seconds with such stimulation of the vagosympathetic trunk as an unconditional stimulus (US), despite the striking visceromotor responses elicited by the US, no conditional reflex was established even after more than 3,400 trials in 16 dogs (34–781 trials per animal).     

Punishment as a discriminative stimulus and conditioned reinforcer with humans

Mental hospital patients were reinforced for responding in a two-response operant situation. When a noise was used to punish one of the responses, all subjects shifted to the unpunished one. When the noise was then paired with positive reinforcement, the subjects responded to produce the noise. Also, a novel response was reinforced by noise in the absence of other reinforcers. This study with humans extends the findings of previous studies with animals in revealing how a punishing stimulus can acquire discriminative or conditioned reinforcing properties.     

Observing responses in pigeons

Pigeons were trained on an observing-response procedure in which periods of VR 100 and EXT alternated unpredictably during a white light (mixed stimulus). During VR 100, responses on a food-producing key (the first key) were intermittently reinforced. Responses on the observing key (the second key) produced a green light (positive stimulus) when VR 100 was in effect, and a red light (negative stimulus) for EXT. The birds did not respond on either key during the negative stimulus, but they responded on the food-producing key when the positive stimulus appeared. When observing responses produced the positive or negative stimulus on FR, observing responses were maintained until the FR reached a maximum; beyond this, only food-producing responses occurred. When observing responses did not produce either stimulus, the observing-response rates fell to zero. With prolonged exposure to an FR 20 schedule of observing, observing-response rates during EXT were higher than during VR 100. Chlorpromazine hydrochloride decreased the total response output but markedly increased observing-response rates except when it was administered before sessions of observing response extinction.     

Autoshaping in the rat: The effects of localizable visual and auditory signals for food

Two experiments investigated autoshaping in rats to localizable visual and auditory conditioned stimuli predicting response-independent food. In Experiment 1 considerable conditioned-stimulus approach behavior was generated by a localizable visual conditioned stimulus that was situated approximately 35 cm from the food tray. Using the same apparatus in Experiment 2 we found that the conditioned-stimulus approach was generated only to a visual conditioned stimulus and not to a localizable auditory conditioned stimulus even though subjects (1) could discriminate presentations of the auditory conditioned stimulus, (2) had associated it with food, (3) could localize it, and (4) would approach the auditory stimulus if this behavior constituted an instrumental response to food. The predominant conditioned responses to the auditory stimuli were goal tracking (entering the food tray) and orienting towards the food-paired conditioned stimulus by head turning and rearing and turning. These results imply that rats do not invariably approach a localizable appetitive Pavlovian conditioned stimulus but that stimulus-approach responses depend on the nature and modality of the conditioned stimulus.     

Autoshaping the pigeon's gape response: acquisition and topography as a function of reinforcer type and magnitude.

The pigeon's key-pecking response is experimentally dissociable into transport (head movement) and gape (jaw movement) components. During conditioning of the key-pecking response, both components come under the control of the conditioned stimulus. To study the acquisition of gape conditioned responses and to clarify the contribution of unconditioned stimulus (reinforcer) variables to the form of the response, gape and key-contact responses were recorded during an autoshaping procedure and reinforcer properties were systematically varied. One group of 8 pigeons was food deprived and subgroups of 2 birds each were exposed to four different pellet sizes as reinforcers, each reinforcer signaled by a keylight conditioned stimulus. A second group was water deprived and received water reinforcers paired with the conditioned stimulus. Water- or food-deprived control groups received appropriate water or food reinforcers that were randomly delivered with respect to the keylight stimulus. Acquisition of the conditioned gape response frequently preceded key-contact responses, and gape conditioned responses were generally elicited at higher rates than were key contacts. The form of the conditioned gape was similar to, but not identical with, the form of the unconditioned gape. The gape component is a critical topographical feature of the conditioned key peck, a sensitive measure of conditioning during autoshaping, and an important source of the observed similarities in the form of conditioned and consummatory responses.     

Differential acquisition,extinction, and reinstatement of conditioned suppression in mice

In animals, the reappearance of conditioned fear responses after extinction has been primarily investigated using single-cue conditioning paradigms. However, a differential paradigm can overcome several of the disadvantages associated with a single-cue procedure. In the present study, the reinstatement phenomenon was assessed in mice using a differential conditioned suppression paradigm. In a first phase, one conditioned stimulus (CS + ) was consistently paired with an unconditioned stimulus (US; footshock) while another CS (CS–) was not, resulting in selective suppression of previously trained instrumental behaviour during the CS + . After the extinction phase, half of the animals (reinstatement group) were presented with unsignalled USs, while the other half were not (control group). A differential return of conditioned responding was observed in the reinstatement group, but not in the control group. The implications of these findings for future conditioning research are discussed.     

Differential acquisition, extinction, and reinstatement of conditioned suppression in mice

In animals, the reappearance of conditioned fear responses after extinction has been primarily investigated using single-cue conditioning paradigms. However, a differential paradigm can overcome several of the disadvantages associated with a single-cue procedure. In the present study, the reinstatement phenomenon was assessed in mice using a differential conditioned suppression paradigm. In a first phase, one conditioned stimulus (CS + ) was consistently paired with an unconditioned stimulus (US; footshock) while another CS (CS-) was not, resulting in selective suppression of previously trained instrumental behaviour during the CS + . After the extinction phase, half of the animals (reinstatement group) were presented with unsignalled USs, while the other half were not (control group). A differential return of conditioned responding was observed in the reinstatement group, but not in the control group. The implications of these findings for future conditioning research are discussed.