Positive reinforcement and suppression from the same occurrence of the unconditioned stimulus in a positive conditioned suppression procedure

Responding of rats was maintained on a variable-interval schedule of food reinforcement. The same response also produced a blinking light followed by electrical brain stimulation according to a fixed-interval schedule. This conjoint schedule produced two behavioral changes. First, instead of a steady rate of responding throughout the session, which would be characteristic of the variable interval food schedule alone, responding between occurrences of the light-brain stimulation pairings became positively accelerated and thus was more characteristic of the fixed-interval schedule of these pairings. Second, food responding was suppressed during the light that preceded brain stimulation. These results indicate that positive reinforcement and suppression resulted from the same occurrence of the light-brain stimulation combination. This finding suggests that stimuli such as conditioned reinforcers that precede an unconditioned reinforcer may have a suppressive effect upon responding in their presence that is being maintained by another reinforcer.     

Effect of unconditioned stimulus magnitude on the emergence of conditioned responding

Although unconditioned stimulus (US) magnitude influences conditioning, no experiment has addressed whether it influences a decision point at which the organism first responds (Gallistel & Gibbon, 2000). Two appetitive conditioning experiments with rats confirmed that the rate of food cup entries and proportion of head jerking were related to the number of pellets (US) provided after the conditioned stimulus. In addition, the onset of responding measured by the number of reinforcers to a criterion or by a quantitatively identified change point also reflected US magnitude. Two aversive conditioning experiments also found that the amount and onset of freezing were related to footshock intensity. All experiments identified a trial at which responding increased abruptly in individual subjects. However, the point where the increase occurred was earlier with larger USs.     

Weanlings' transfer of conditioned ethanol aversion from olfaction to ingestion depends on the unconditioned stimulus

Weanling (21-day-old) rats were exposed to an alcohol odor paired with either an interoceptive (apomorphine-induced illness) or exteroceptive (footshock-induced distress) reinforcer. Twenty-four hours later, ethanol preferences were measured in a locational olfactory test (ethanol vs lemon odor) or an ingestion test (5.6% v/v ethanol vs 0.25% v/v citric acid solution). Weanling rats expressed substantial olfactory aversions, independent of the reinforcer employed in conditioning. During the drinking test, however, only rats that had experienced the ethanol odor paired with internal malaise showed a significant reduction in the intake of the ethanol solution when compared to unpaired controls. Furthermore, rats that had experienced the ethanol odor paired with external distress drank significantly more of the ethanol solution than their controls. These results provide further evidence that olfactory experiences with ethanol can lead to changes in ethanol ingestion, and indicate that the nature of the unconditioned stimulus is critical in establishing the ingestive effect.     

Factors influencing responding under multiple schedules of conditioned and unconditioned reinforcement

Two experiments examined pigeons' responses under multiple schedules of conditioned and unconditioned reinforcement. In one component, responses produced food according to a fixed-interval schedule; in a second component, responses produced brief stimuli according to a fixed-ratio schedule. When brief-stimulus presentations were paired with food in the first component, rates in the second component were usually higher than 10 responses per minute. When pairing in the first component was eliminated, responding continued to be maintained in the second component. Elimination of food presentation from the first component substantially decreased responding in the second component, even though the brief stimulus had not been paired with food. Experiment II demonstrated that response rate was affected by the duration of both the second component and the brief stimulus. The results suggest that three conditions are important in maintaining responding with brief-stimulus presentations: (1) pairing the brief stimulus, at least initially, with food, (2) maintaining unconditioned reinforcement in one component, and (3) employing optimal brief-stimulus and component durations.     

Facilitation of instrumental behavior by a Pavlovian appetitive conditioned stimulus

Three experiments examined appetitive Pavlovian-instrumental interactions by presenting separately trained conditioned stimuli (CSs) during reinforced instrumental responding in rabbits. Intra-oral reinforcement was used to minimize interference from peripheral responses such as magazine approach. In experiment 1, the rabbits were first trained to perform an instrumental head-raising response for sucrose reward. A conditioned jaw movement response was then established to a 2-sec CS by pairing it with sucrose; a control stimulus was unpaired with sucrose. Instrumental responding maintained by a variable-interval 40-sec schedule was enhanced during 10-sec presentations of the paired, but not the unpaired, CS. Responding on a variable-ratio 15 schedule was unaffected except on trials on which the pre-CS baseline response rate was low; in such cases the paired CS caused a long-lasting acceleration of responding. Noncontingent presentation of the sucrose reinforcer itself briefly suppressed responding but had no long-term effect. In Experiment 2, a CS that had been conditioned at a 10-sec duration produced the same pattern of effects as in the first study, indicating that facilitation resulted from CS presentation rather than from the frustrative effects of non-reinforcement of the CS. In Experiment 3 an inhibitory CS blocked facilitation by the excitatory CS but did not itself affect instrumental responding. These results support the view that Pavlovian processes play a positive role in instrumental performance and suggest that previous findings of suppression by a short-duration CS reflect peripheral interference. The dependence of facilitation on the baseline level of responding is discussed in terms of associative and motivational theories of Pavlovian mediation.     

Enhancement of food-rewarded instrumental responding by an appetitive conditioned stimulus

Four experiments are reported in which a stimulus (with a minimum duration of 60 s) signalling the delivery of “free” food was presented to rats lever-pressing for food available on a variable interval schedule. It was found that responding was enhanced in the presence of the stimulus when the baseline schedule of reinforcement was lean (Experiment I) and that the enhancement was dependent upon the pairing of the stimulus with free food (Experiments II and III). Experiment IV showed that an enhancement could be found after initial training in which stimulus-food pairings were given to subjects that were not concurrently lever pressing for food. It is argued that these results are consistent with the suggestion that an appetitive conditioned stimulus can energise appetitive instrumental behaviour.     

Modulation of unconditioned defense reflexes by a putative emotive Pavlovian conditioned stimulus

Four experiments showed differential modulation of defensive unconditioned responses (URs) in rabbits by contextual stimuli that Brandon and Wagner (1991) have shown similarly to modulate conditioned eyeblink responses. Two 30-s auditory cues, A and B, were differentially paired with shock. Tests were presentations of a response-eliciting probe stimulus within A, B, or a comparable blank interval, Experiments 1 and 2 demonstrated that A and B differentially facilitated eyeblink URs, and Experiments 3 and 4 showed that A and B similarly differentially facilitated startle responses elicited by airpuffs to the ear. These data are consistent with a characterization of Pavlovian conditioning that distinguishes between emotive and sensory conditioning and assumes that conditioned emotional responses similarly modulate specific conditioned and unconditioned defensive reflexes (Konorski, 1967; Wagner & Brandon, 1989).     

Variations in the sensitivity of instrumental responding to reinforcer devaluation

In five experiments hungry rats were trained to make a lever press response for a sucrose reinforcer. That sucrose was subsequently devalued by conditioning a food-aversion to it, and the ability of the rats to integrate knowledge about the instrumental contingency with that gained from aversion training was assessed in an extinction test. Experiment I showed successful integration following limited but not extended instrumental training. Experiment II suggested that the crucial factor was the spacing of training; successful integration was seen after massed but not distributed training. The third experiment implicated distributed experience with the reinforcer, rather than distributed response practice, in failures of integration. Experiment IV showed that if the distribution of food-aversion learning was dissimilar to that of instrumental training then a failure of integration could result; this finding was able to account for the distribution of training effects seen in previous studies, but not the effect of extended training. Experiment V replicated the extended training effect seen in Experiment I, and provided evidence that this may reflect the degree of exposure to the reinforcer rather than the extent of response practice.     

Explicit disassociation of a conditioned stimulus and unconditioned stimulus during extinction training reduces both time to asymptotic extinction and spontaneous recovery of a conditioned taste aversion

Conditioned taste aversions (CTAs) may be acquired when an animal consumes a novel taste (CS) and then experiences the symptoms of poisoning (US). This aversion may be extinguished by repeated exposure to the CS alone. However, following a latency period in which the CS is not presented, the CTA will spontaneously recover (SR). In the current study we employed an explicitly unpaired extinction procedure (EU-EXT) to determine if it could thwart SR of a CTA. Sprague-Dawley rats acquired a strong CTA after three pairings of saccharin (SAC the CS) and Lithium Chloride (LiCl the US). CTA acquisition was followed by extinction (EXT) training consisting of either (a) CS-only exposure (CSO) or (b) exposure to saccharin and Lithium Chloride on alternate days (i.e., explicitly unpaired: EU). Both extinction procedures resulted in ?90% reacceptance of SAC, although the EU extinction procedure (EU-EXT) significantly decreased the time necessary for rats to reach this criterion (compared to CSO controls). Rats were subsequently tested for SR of the CTA upon re-exposure to SAC following a 30-day latency period of water drinking. Rats that acquired a CTA and then underwent the CSO extinction procedure exhibited a significant suppression of SAC drinking during the SR test (as compared to their SAC drinking at the end of extinction). However, animals in the EU-EXT group did not show such suppression in drinking compared to CSO controls. These data suggest that the EU-EXT procedure may be useful in reducing both time to extinction and the spontaneous recovery of fears.     

Pavlovian conditioned stimulus effects upon instrumental choice behavior are reinforcer specific

In a transfer-of-control experiment with rats, Pavlovian CSs were tested for the specificity of their effects. The instrumental behavior consisted of a discriminative, conditional two-lever choice task in which qualitatively different appetitive reinforcers were contingent upon the two correct choices. In a Pavlovian phase, subjects experienced conditioning to establish either a CS⁺ or CS^? for one reinforcer or a CS⁺ or CS^? for the other reinforcer. Finally, in a test, these CSs were presented when there was the opportunity to make choice responses. The CS⁺s evoked choices of the lever which had eventuated in the reinforcer that had served as the Pavlovian US, while the CS^?s showed only a slight tendency to evoke the other choice responses. When the CSs were compounded with the original S^Ds, the CS⁺s had little effect upon the vigor of responding while the CS^?s reduced the vigor of responding to the S^D for the reinforcer that was the same as the US used in establishing the CS^?. The results are discussed in terms of associative mediational theory and the reinforcer specificity of Pavlovian conditioned excitation and inhibition.     

Effects of a brief stimulus accompanying reinforcement on instrumental responding in pigeons

The responding of pigeons on a variable interval schedule of reinforcement was investigated in four experiments. In some conditions in each experiment reinforced keypecks were accompanied by a brief (0.5-sec) flash of the houselight. This procedure resulted in a low rate of response in comparison with that found in conditions when response-contingent light flashes occurred uncorrelated with reinforcement (Experiments 1 and 2) or when no light flash was presented (Experiment 3). Experiment 4 allowed a comparison between the effects of a signal accompanying the reinforced response and one accompanying the delivery of “free” food. Signaling the delivery of earned food produced a lower rate of response than did signaling the delivery of free food. The role of stimulus-reinforcer and response-reinforcer associations in producing these effects is discussed.     

The effect of the instrumental training contingency on susceptibility to reinforcer devaluation

Two experiments investigated performance of instrumental lever pressing by rats following post-conditioning devaluation of the sucrose reinforcer produced by establishing an aversion to it. In Experiment I rats responded less in an extinction test after being averted from the sucrose following training on a ratio schedule, but not following an equivalent amount of training on an interval schedule. This was true even though the devalued sucrose would not act as an effective reinforcer on either the ratio or interval schedule. Experiment II provided a further investigation of the insensitivity of interval responding to reinforcer devaluation by comparing test performance under simple extinction with responding when the devalued reinforcer was presented on either a response-contingent or non-contingent schedule during the test. Once again simple extinction performance was unaffected by prior reinforcer devaluation. Furthermore, neither non-contingent nor contingent presentations of the devalued reinforcer significantly depressed responding below the level seen in the extinction condition. Ratio, but not interval performance appears to be controlled by knowledge about the instrumental contingency that encodes specific properties of the training reinforcer.     

Conditioned taste aversion is enhanced when the unconditioned stimulus is presented in a different context

Using a conditioned taste aversion procedure with rats as the subjects, two experiments examined the effect of presenting a conditioned stimulus (CS saccharin solution) in one context followed by an unconditioned stimulus (US LiCl) in a different context. Experiment 1 showed that animals which received the above-mentioned procedure (Group D) showed a more marked conditioned aversion to the CS than animals which were given both the CS and the US in the same context (Group S). Experiment 2 found that in both Group D and Group S, aversion to the CS increased when the subjects were exposed to the conditioned context after the conditioning. These findings supported the argument that the strength of the CS-US association acquired during conditioning is compared with that of the context-US to determine the magnitude of aversion revealed to the CS.     

Persistence of conditioned flavor preferences is not due to inadvertent food reinforcement

Almond preferences were produced by giving rats a mixture of almond and sucrose (Experiments 1-4) or saccharin (Experiment 4). A subsequent extinction procedure consisted of either repeated 2-bottle almond versus water tests (Experiment 1) or repeated exposure to almond alone (Experiments 2-4). The main independent variable was whether access to food following a session was given immediately, 30 min later, or 120 min later. No effect of extinction was found in any experiment. An important finding was that varying the delay until food access had no detectable effect. It was concluded that inadvertent flavor-food associations do not maintain preference for the flavor under extinction conditions.     

Effect of changing the unconditioned stimulus on appetitive blocking

In four experiments we examined the effects of changing the unconditioned stimulus (US) on appetitive blocking. In Experiments 1A, 1B, and 2 we established that substituting food for water, or water for food, in the compound stage did not attenuate blocking relative to groups that received the same US throughout conditioning. Experiment 3 showed that satiation with the US used prior to compound conditioning with a different US does not affect blocking. Experiment 4 revealed that changing the location of US delivery, as well as the quality of the US, also leaves blocking unaffected. It is suggested that these results demonstrate that blocking occurs, provided that there is no change in the affective properties of the US.