Context Conditioning and Free operant Acquisition under Delayed Reinforcement

Three experiments examined the effect of context conditioning on the acquisition of freeoperant lever pressing by hungry rats when the presentation of the food reinforcer was delayed for 32 sec. The first study replicated the preexposure effect reported by Dickinson, Watt, and Griffiths (1992): Exposure to the contextual cues with the lever withdrawn prior to each instrumental training session enhanced acquisition, an effect that was attenuated by the presentation of non-contingent reinforcement during the preexposure periods. Signalling the non-contingent reinforcers during the preexposure periods with a brief auditory stimulus enhanced acquisition in a second study, suggesting that the non-contingent reinforcement interferes with acquisition through context conditioning. The final study confirmed this conclusion using a within-subject procedure in which pressing different levers was reinforced in two contexts, one of which was also associated with non-contingent reinforcers.     

Analysis of the learned irrelevance effect in appetitive Pavlovian conditioning

In Experiments 1 and 2 rats received uncorrelated presentations of a light conditioned stimulus (CS) and a food unconditioned stimulus (US) on each day of a preexposure phase. Control subjects received the same number of USs during the first half of preexposure and the same number of CSs during the second. Uncorrelated preexposure retarded inhibitory conditioning. Experiment 3 showed, however, that the different patterns of US preexposure experienced by the two groups could in itself influence the course of subsequent inhibitory conditioning. When this factor was equated by restricting the uncorrelated treatment to the first half of the pre-exposure phase (Experiment 2) or by extending the control treatment throughout the phase (Experiment 4) it was found that uncorrelated preexposure retarded excitatory conditioning, but facilitated inhibitory conditioning. This outcome challenges an interpretation in terms of the concept of learned irrelevance, which predicts that uncorrelated preexposure should retard both forms of conditioning.     

Latent inhibition of US signal value.

Three experiments with rats examined the effects of preexposure to an unconditioned stimulus (US; a single food pellet) on the subsequent ability of that US to effectively signal the delivery of three food pellets during a US-US conditioning procedure. In Experiment 1, latent inhibition (LI) rats showed attenuated conditioning, compared to control (C) rats, when a single food pellet, delivered 10 minutes into a session, was followed by three additional pellets. In preexposure, one pellet had been delivered 10 minutes into each session (in group LI), or placed into the magazine at the beginning of each session (in group C). Experiment 2 showed that this effect was evident when the conditions of preexposure matched those of conditioning for group C, and Experiment 3 showed that the difference between groups LI and C was not a product of context conditioning, or latent inhibition to the noise of the feeder in group LI. Implications of these results for theories of latent inhibition are considered.     

The effects of lateral, medial, or complete septal lesions on positive conditioned suppression in rats

This study investigated the effects of lateral, medial, or complete septal lesions in rats on lever pressing and US-approach behaviors during the presentation of a light followed by two free food pellets. Ten days after surgery, groups of rats received 20 sessions of a random interval (RI) 60-s schedule of food reinforcement. The positive conditioned suppression paradigm consisted of 20 sessions of a 10-s light paired with free food while the rats were responding on the RI 60-s schedule. All groups of rats significantly suppressed lever pressing during the 10-s light presentation. During the last four sessions of the 10-s light condition, rats with lateral septal lesions had a significant increase in food-tray entries during the light presentation, while the other groups decreased lever pressing without a change in food-tray entries during the 10-s light presentation. Although rats with septal damage generally have difficulty inhibiting responses in a variety of operant situations, rats with lateral, medial, or complete septal lesions showed no impairment in positive conditioned suppression. This study also suggests that when the spatial arrangement of the CS and the type of US were manipulated to minimize sign-tracking and goal-tracking behaviors, emotional reactions during the presentation of the CS must be considered a factor influencing positive conditioned suppression.     

The Importance of Context in the US Preexposure Effect in CTA: Novel versus Latently Inhibited Contextual Stimuli

Three experiments were conducted to examine the role of novel contextual stimuli in producing the unconditioned stimulus (US) preexposure effect. Experiment 1 demonstrated that novel contextual stimuli produce a significantly stronger US preexposure effect than familiar or “latently inhibited” contextual stimuli. Moreover, subjects preexposed in the presence of latently inhibited contextual cues failed to show a significant US preexposure effect. Experiments 2 and 3 attempted to provide evidence that the addition of a single novel stimulus to the latently inhibited context would result in a significantly stronger US preexposure effect than when no such novel cue was present. Experiment 3 was able to demonstrate this effect. Results are consistent with the Rescorla–Wagner (1972) model of conditioning.     

Second-order schedules of token reinforcement: effects of varying the schedule of food presentation

In the initial link of a complex schedule, one discriminative stimulus was presented and lever pressing produced tokens on fixed-ratio schedules. In the terminal link, signalled by a second discriminative stimulus, deposits of the tokens produced food. With two rats, the terminal link was presented after each sixth component schedule of token reinforcement was completed. With the other two rats, the terminal link was presented following the first component schedule completed after a fixed interval. During the terminal link, each token deposit initially produced food. The schedule of food presentation was subsequently increased such that an increasing number of token deposits in the terminal link was required for each food presentation. Rates of lever pressing in the initial link were inversely related to the schedule of food presentation in the terminal link. These results are similar to those of experiments that have varied schedules of food presentation in chained schedules. Rates and patterns of responding controlled throughout the initial link were more similar to those ordinarily controlled by second-order brief-stimulus schedules than to those controlled by comparable extended chained schedules.     

The Effect of Stimulus Preexposure on Responding during a Compound Stimulus

In two experiments with rats, three stimuli, A, B, and X, were used for an AX+ BX+ Xo discrimination in which food was presented after the simultaneous presentation of A and X, or B and X, but never after X by itself. For one group in each experiment, X was repeatedly presented by itself before the start of discrimination training. This manipulation weakened responding on test trials in which the three stimuli were presented together. The results are interpreted in terms of a configural theory of conditioning that assumes that preexposure to a stimulus will reduce its capacity to promote generalization among different configurations to which it belongs.     

The role of response-contingent incentives in lithium chloride-mediated suppression of an operant response

Three experiments investigated what role a novel incentive plays in the development of operant response suppression mediated by lithium chloride. In all experiments animals were trained to press two levers under concurrent schedules of reinforcement. In Experiment 1 responding on one lever delivered a familiar incentive (food pellets), whereas responding on an alternative lever delivered a novel incentive (sucrose solution) prior to lithium chloride injections. If lithium was administered immediately after the instrumental session, the action associated with the novel, but not with the familiar, incentive was suppressed. By comparison, in a control group for which responding on both levers led to the familiar incentive, both actions were suppressed. Experiment 2 examined whether the novelty, rather than the sensory properties, of the incentive is crucial for observing performance suppression. It was found that animals familiarized with the “target” incentive were insensitive to aversion conditioning by lithium, in that there was no difference in response rates between the action that delivered the familiar incentive from that which earned the “target”. In contrast, if animals were unfamiliar with the “target” incentive at the time of aversion conditioning, they suppressed responding on the lever that was associated with the novel incentive but did not suppress responding on the lever associated with the familiar incentive. Experiment 3 investigated the mechanism underlying instrumental performance suppression. After the completion of concurrent lever press training, novel sucrose was introduced in conjunction with the pellets for responding on one lever; responding on the other lever continued to deliver only familiar pellets. Lithium injections were then administered either immediately following the sessions or several hours after the sessions. It was found that the rate of responding on the lever associated with the contingent delivery of sucrose was suppressed below that of the pellet-alone action. By comparison, if lithium injections were administered several hours following the session, an elevation in responding on the sucrose-plus-pellet lever was observed. The outcomes of all three experiments demonstrate not only that the novelty of an incentive is important in obtaining performance suppression, but also that a novel incentive can punish instrumental responding if it has been associated with toxicosis.     

The influence of context and UCS intensity on the UCS preexposure effect in a flavor aversion paradigm

Three studies were conducted to evaluate the influence of environmental context and UCS preexposure intensity on the acquisition of a flavor aversion. In the first study, rats were exposed to two UCS-alone presentations at one of three dose levels of LiCl. The rats were given the two UCS preexposures in one of two contexts (familiar or novel). Following the UCS-alone treatment, all of the subjects received two pairings of sucrose and LiCl (1.25 meq) in the familiar context. Animals receiving UCS preexposures in the same context as used during conditioning consumed significantly more sucrose than did saline control animals. In contrast, the influence of prior UCS preexposure was not evident when UCS preexposure was experienced in a context different from that experienced during conditioning. In Experiment 2, all animal received UCS preexposure and conditioning in the novel room. Animals received either two or four preexposures at 0, 1.25, or 3.75 meq dose of LiCl. Two UCS preexposures at 3.75 meq dose produced a stronger UCS preexposure effect than did the 1.25 meq dose. Animals in Experiment 3 received two exposures to either 0-, 1.25-, or 3.75-meq LiCl in one of two contexts, followed by conditioning with the 1.25-meq LiCl dose in the same context as preexposure. Greater UCS interference occurred in animals preexposed to LiCl in the novel rather than familiar environment, with no specific dose effects in either context. These observations are discussed in terms of context blocking and generalization decrement models of the UCS preexposure effect.     

Interactions in multiple schedules: negative induction with squirrel monkeys

In Experiment I, lever pressing by squirrel monkeys was maintained under a sequence of variable-interval, multiple variable-interval variable-interval, and multiple variable-interval extinction schedules of food presentation. Negative induction (decreased responding in the unchanged component) occurred when one component of the multiple variable-interval variable-interval schedule was changed to extinction. Negative induction was transient over sessions; responding in the unchanged component usually recovered to a rate similar to that under the multiple variable-interval variable-interval schedule. Negative induction was not accompanied by consistent changes in the patterns of local responding within the unchanged component, and did not depend on whether component schedules were associated with localized (lever lights) or diffuse visual stimuli (houselights), or on whether the unchanged component was a 60- or 180-sec variable-interval schedule. In Experiment II, responding was maintained under a sequence of variable-interval and multiple variable-interval timeout schedules of food presentation. Negative induction occurred when responding declined gradually in the timeout component but not when responding declined abruptly. The nature of interactions in multiple schedules may depend on the species; negative induction was observed with squirrel monkeys under conditions similar to those that produce positive contrast with pigeons.     

Influence of lithium chloride intensity on unconditioned stimulus-alone interference in a flavor aversion paradigm

Two studies were conducted to explore the influence of US preexposure intensity on the development of a flavor aversion. In the first experiment, subjects were exposed to four US-alone presentations [1 per day, every other day over 8 days at one of four dose levels (0, 0.5, 1.5, or 3.0 meq LiCl)]. Following the US-alone treatment, an equal number of rats from each US-alone dose level condition received a series of sucrose-illness pairings at one of three conditioning dose levels. The results of this study showed that if the US-alone dose level was below the conditioning dose level, less interference was found than when the preexposure and conditioning doses were equivalent. A strong proactive US-alone interference was found when the US-alone dose level was either equal to or above the conditioning US intensity. In Experiment 2, a greater range of preconditioning US-alone dose levels was used. Also, the number of US-alone exposures decreased to two in Experiment 2. The results of Experiment 2 showed that less proactive US-alone interference occurred when the US-alone dose was either below or slightly above the conditioning US dose than when the US-alone and conditioning dose levels were equal. Further, when the preexposure US intensity was much above the conditioning US intensity, the level of interference was equivalent to that produced when the US-alone and conditioning US intensities were equivalent. These observations are discussed in terms of context blocking and generalization decrement models of the US preexposure effect.     

Latent Inhibition of Contextual Stimuli Reduces the US Preexposure Effect in Rats

Two experiments are reported which utilized latent inhibition of contextual stimuli prior to administering unsignaled presentations of the Us in an attempt to further assess the role of contextual stimuli in the US preexposure effect. Specifically in Experiment 1, rats received either 0-, 5-, 10-, or 15-minute exposure to the context in which the unsignaled Uss were to occur (latent inhibition). Following preexposure to the US, animals were trained in a CER paradigm with a tone CS. Measures of suppression to the tone indicated that the greatest US preexposure effect occurred in the 0 group and that no US preexposure effect was evident in the 15 group. Experiment 2 includec two important control groups which were omitted in Experiment 1 (no US preexposures) and an additional dependent variable (time to initiate licking) to measure fear to contextual stimuli. These results are discussed in terms of the role context conditioning may play in US preexposure.

     

Re-assessing causal accounts of learnt behavior in rats

Rats received either a common-cause (i.e., A→B, A→food) or a causal-chain training scenario (i.e., B→A, A→food) before their tendency to approach the food magazine during the presentation of B was assessed as a function of whether it was preceded by a potential alternative cause. Causal model theory predicts that the influence of an alternative cause should be restricted to the common-cause scenario. In Experiment 1, responding to B was reduced when it occurred after pressing a novel lever during the test phase. This effect was not influenced by the type of training scenario. In Experiment 2, rats were familiarized with the lever prior to test by training it as a potential cause of B. After this treatment, the lever now failed to influence test responding to B. In Experiment 3, rats given common-cause training responded more to B when it followed a cue that had previously been trained as a predictor of B, than when it followed another stimulus. This effect was not apparent in rats that received causal-chain training. This pattern of results is the opposite of that predicted by causal model theory. Thus, in three experiments, the presence of an alternative cause failed to influence test responding in manner consistent with causal model theory. These results undermine the application of causal model theory to rats, but are consistent with associative analyses.     

Trace decay and the priming of short-term memory in long-delay taste aversion learning: Disruptive effects of novel exteroceptive stimulation

A variation of Kalat and Rozin's two-presentation paradigm was used to test the hypothesis that the first, as opposed to the second, presentation of a flavor conditioned stimulus (CS) constitutes the functional CS in two-presentation experiments involving moderate interflavor intervals (IFIs), and results in flavor aversions that are a function of the primary, as opposed to the secondary, conditioned stimulus-unconditioned stimulus (CS-US) interval. Contrary to the hypothesis, it was shown in Experiment 1 that holding the primary CS-US interval constant at 4 hr for each of three groups, while decreasing the secondary CS-US interval (i.e., the interval between the second flavor presentation and the illness) from 3.75 hr to 2.5 hr to .5 hr, resulted in the flavor aversion increasing as the secondary CS-US interval decreased. However, the aversion acquired by the group with a 0.5 hr secondary CS-US interval was also found to be significantly weaker than that acquired by a single-presentation 0.5 hr control group. In Experiment 2 it was demonstrated that animals exposed to novel exteroceptive stimulation (NES) immediately prior to a second flavor presentation that preceded the US by 0.5 hr acquired an aversion as strong as that acquired by a 0.5-hr control group. In Experiment 3 it was demonstrated that, in the absence of a second flavor presentation, animals exposed to novel exteroceptive stimulation 0.5 hr prior to the US acquired a weaker flavor aversion than did animals not exposed to novel exteroceptive stimulation during the 4-hr flavor CS-illness US interval. The contrasting effects of novel exteroceptive stimulation observed in Experiments 2 and 3 were replicated in Experiment 4. The results suggest, consistent with the trace-decay hypothesis and Wagner's (1976) general model of stimulus processing, that exposure to novel exteroceptive stimulation disrupts continued processing of the short-term memory (STM) trace of the initial presentation of a flavor CS, and hence minimizes stimulus preexposure effects attributable to the priming of STM.     

Discrimination between outcomes in instrumental learning: Effects of preexposure to the reinforcers

In two experiments rats received instrumental training with two response levers, one response being reinforced by sucrose solution and the other by sucrose pellets. Prior to a test session, on which both levers were made available in the absence of reinforcement, the rats were given free access to one of the reinforcers, a procedure known to reduce its value. It was found that the rats responded at a lower rate on the lever that had produced the now-devalued reinforcer, but that this effect was substantial only in rats that had received preexposure to the two reinforcers before instrumental training was begun (Experiment 1). Experiment 2 demonstrated that this effect was obtained only when presentations of the two reinforcers were presented according to an inter-mixed schedule during preexposure. It is suggested that this result constitutes an instance of the perceptual learning effect in which intermixed preexposure to similar events enhances their discriminability.     

The role of the instrumental contingency in the motivational control of performance

In four experiments we investigated an irrelevant incentive effect based upon a transition from hunger to thirst. Hungry rats were trained to lever press either for sucrose solution or for food pellets before performance was tested in extinction while they were thirsty. Reinforcer-specific motivational control was found in the first experiment in that the animals pressed the lever more on tests following training with the sucrose solution rather than with food pellets. Moreover, this effect was seen only when testing was conducted following water, but not following food deprivation. The outcome of the remaining experiments suggests that this motivational control is not mediated by the instrumental contingency between lever pressing and the sucrose reinforcer during training. In these studies lever pressing and chain pulling were reinforced concurrently, one with sucrose and the other with food pellets, in order to equate the noninstrumental functions of the incentives. Following this training, lever pressing in extinction under thirst was unaffected by the type of incentive used as its reinforcer during training.     

Overshadowing of a context aversion by a novel incentive in operant conditioning

Two experiments examined the processes underlying the suppression of instrumental behaviours by lithium in rats, as reported by Meachum (1988 and this issue). Experiment 1 examined whether presenting a novel sucrose solution prior to lithium chloride administration would overshadow aversion learning to either the stimuli of the operant chamber or to familiar food pellets. After lever pressing had been established, and in the absence of responding, animals received free deliveries of a novel sucrose solution, familiar food pellets, or both, or they were exposed to only the cues of the operant chamber, prior to lithium injections. Lever pressing for food pellets was then assessed. It was found that the animals receiving the novel sucrose, either alone or with the familiar food pellets, pressed more for pellets than either the group receiving only food pellets or the group exposed to only the context. In addition, there was no appreciable difference in the response rates between the context-only group and the group that received the familiar food pellets. These outcomes were interpreted in terms of the novel sucrose overshadowing aversion learning to the context. Experiment 2 investigated whether in fact aversive contextual conditioning could be obtained using the present parameters. This was accomplished by directly manipulating the contexts. In this experiment animals were trained to lever press in two distinctive contexts. Subsequently, one context was paired with the novel sucrose, and the second was experienced in the absence of reinforcement prior to toxicosis. During a subsequent non-reinforced test it was found that responding in the context paired with the novel sucrose was considerably higher than responding in the context that was experienced alone. These findings stand in contrast to the taste-mediated contextual potentiation observed when a consumatory response is used to assess aversive contextual conditioning.     

Motivational control of instrumental performance: The role of prior experience of the reinforcer

In four experiments we investigated the conditions that are necessary for instrumental performance to adjust appropriately to a change in drive state. Rats were trained to press a lever and pull a chain concurrently, with one action being reinforced by sucrose solution and the other by food pellets. In Experiment 1 for animals that were hungry throughout training the rate of lever pressing in an extinction test under thirst was unaffected by the type of reinforcer produced by this action during training, even though the sucrose solution would maintain a higher rate than the food pellets during training under thirst. In contrast, animals that experienced the instrumental contingencies arranged by the concurrent schedule while thirsty at some point during training pressed the lever more during the extinction test under thirst when this action had been reinforced with the sucrose solution rather than the food pellets. The remaining three experiments demonstrated that for this incentive effect to occur it is sufficient that the sucrose solution be delivered non-contingently under thirst at some stage of training. Thus, it would appear that performance mediated by an instrumental contingency adjusts appropriately to reinforcer revaluation brought about by a drive shift only if the animals have had prior experience with the incentive under the test drive state. This observation was interpreted in terms of Tolman's “cathexis” theory of motivation.     

Effects of chlordiazepoxide and cocaine on concurrent food and avoidance-of-timeout schedules.

Five rats were trained on a concurrent schedule in which responses on one lever produced a food pellet on a random-interval 30-s schedule during 10 s of food availability associated with distinctive exteroceptive stimuli. Responses on another lever postponed for 20 s the presentation of a 50-s timeout, during which all stimuli were extinguished and the schedule contingencies on the food lever were suspended. The response rates maintained by the random-interval schedule exceeded those maintained by the avoidance contingency, but both provided a stable baseline to assess the behavioral effects of different drugs. Low doses of cocaine hydrochloride (1 and 3 mg/kg) did not affect food-reinforced responding or avoidance response rates. Intermediate doses (5.6, 10, and 13 mg/kg) produced a dose-dependent decrease in food-maintained and avoidance response rates, and both types of responding were virtually eliminated after administration of the highest doses (17 and 30 mg/kg) of cocaine. Low doses of chlordiazepoxide (1 and 3 mg/kg) increased food-maintained and avoidance response rates, and both rates decreased systematically after 10 and 30 mg/kg of this drug. The effects of cocaine and chlordiazepoxide on response rates maintained by avoidance of timeout from food presentation were unlike those reported when subjects responded to avoid shock presentation. The results of this experiment thus provide evidence to suggest that the effects of drug administration on avoidance behavior may be a function of the nature of the consequent event to be avoided.     

Analysis of the US-preexposure effect in flavor acceptance conditioning

In three experiments, rats received exposure to a sucrose solution followed by conditioning with a neutral flavor as the conditioned stimulus (CS) and sucrose as the unconditioned stimulus (US). In Experiments 1 and 2, some rats were given both the preexposure and the conditioning phases in a highly familiar context (the homecage), whereas other animals received both phases in a novel and distinctive context. In both cases the magnitude of the conditioning effect was reduced by preexposure to the US. Experiment 3 directly assessed the possible role of contextual cues by changing the context between the exposure phase and the conditioning phase but found no loss of the US-preexposure effect in these conditions. These results lend no support to the blocking-by-context account of the US-preexposure effect; alternative interpretations are considered.