Associative transfer and stimulus selection in classical conditioning of the rabbit's nictitating membrane response to serial compound CSs

Four experiments were conducted to determine whether in conditioning to a serial compound, CS1-CS2-UCS, there are (a) associative mechanisms operating to extend conditioning beyond the bounds of a CS-UCS contiguity gradient and (b) stimulus selection processes acting to attenuate the potency of CS-UCS contiguity. In Experiments 1 and 2, the CS2-UCS interval was held at .35 sec while the CS1-UCS interval was varied across groups from .75 to 2.75 sec. CS1 test trials revealed substantial CR acquisition at all CS1-UCS intervals. Moreover, Experiment 2 indicated that when the contribution of cross-modal generalization from CS2 to CS1 was factored out, there still remained a substantial level of conditioning, which Experiment 3 indicated was attributable to an associative mechanism like higher-order or sensory conditioning. The observation of CR acquisition at CS1-UCS intervals of 4.75, 8.75, and 18.75 sec in Experiment 4 suggested that serial compound training yields conditioning to CSs located well beyond the single CS contiguity gradient for the rabbit's nictitating membrane response. Experiments 1 and 2 also indicated the presence of stimulus selection processes because, at the shorter CS1-UCS intervals (.75 and 1.25 sec), the levels of test-trial responding to CS2 fell below those observed to the less contiguous CS1.     

Acquisition of a spatially defined operant with delayed reinforcement.

Two experiments investigated the role of an immediate, response-produced auditory stimulus during acquisition, via delayed reinforcement, of a response selected to control for possible unprogrammed, operandum-related sources of response feedback. Experimentally naive rats were exposed to a delayed-food reinforcement condition, specifically a tandem fixed-ratio 1 differential-reinforcement-of-other-behavior 30-s schedule. The response was defined as breaking a photocell beam located near the ceiling at the rear of the operant conditioning chamber. In Experiment 1, rates of photobeam breaking by each rat increased from near zero, regardless of the presence or absence of a tone that immediately followed the response initiating the delay interval. Though not essential, the tone facilitated response acquisition and resulted in more efficient response patterns at stability. Experiment 2 demonstrated that photobeam-breaking response rates under the delayed reinforcement contingency exceeded those in a preceding baseline condition in which no food was delivered. In addition, upon introduction of the delayed reinforcement procedure, correspondence between response patterns and the requirements of the reinforcement schedule increased over baseline levels in the absence of a food contingency. Together with a previous report of Lattal and Gleeson (1990), the present results suggest that response acquisition with delayed reinforcement is a robust phenomenon that may not depend on a mechanically defined response or an immediate external stimulus change to mediate the temporal gap between response and reinforcer.     

Simple and conditional visual discrimination with wheel running as reinforcement in rats.

Three experiments explored whether access to wheel running is sufficient as reinforcement to establish and maintain simple and conditional visual discriminations in nondeprived rats. In Experiment 1, 2 rats learned to press a lit key to produce access to running; responding was virtually absent when the key was dark, but latencies to respond were longer than for customary food and water reinforcers. Increases in the intertrial interval did not improve the discrimination performance. In Experiment 2, 3 rats acquired a go-left/go-right discrimination with a trial-initiating response and reached an accuracy that exceeded 80%; when two keys showed a steady light, pressing the left key produced access to running whereas pressing the right key produced access to running when both keys showed blinking light. Latencies to respond to the lights shortened when the trial-initiation response was introduced and became much shorter than in Experiment 1. In Experiment 3, 1 rat acquired a conditional discrimination task (matching to sample) with steady versus blinking lights at an accuracy exceeding 80%. A trial-initiation response allowed self-paced trials as in Experiment 2. When the rat was exposed to the task for 19 successive 24-hr periods with access to food and water, the discrimination performance settled in a typical circadian pattern and peak accuracy exceeded 90%. When the trial-initiation response was under extinction, without access to running, the circadian activity pattern determined the time of spontaneous recovery. The experiments demonstrate that wheel-running reinforcement can be used to establish and maintain simple and conditional visual discriminations in nondeprived rats.     

Conditioned stimulus informativeness governs conditioned stimulus-unconditioned stimulus associability

In a conditioning protocol, the onset of the conditioned stimulus ([CS]) provides information about when to expect reinforcement (unconditioned stimulus [US]). There are two sources of information from the CS in a delay conditioning paradigm in which the CS-US interval is fixed. The first depends on the informativeness, the degree to which CS onset reduces the average expected time to onset of the next US. The second depends only on how precisely a subject can represent a fixed-duration interval (the temporal Weber fraction). In three experiments with mice, we tested the differential impact of these two sources of information on rate of acquisition of conditioned responding (CS-US associability). In Experiment 1, we showed that associability (the inverse of trials to acquisition) increased in proportion to informativeness. In Experiment 2, we showed that fixing the duration of the US-US interval or the CS-US interval or both had no effect on associability. In Experiment 3, we equated the increase in information produced by varying the C/T ratio with the increase produced by fixing the duration of the CS-US interval. Associability increased with increased informativeness, but, as in Experiment 2, fixing the CS-US duration had no effect on associability. These results are consistent with the view that CS-US associability depends on the increased rate of reward signaled by CS onset. The results also provide further evidence that conditioned responding is temporally controlled when it emerges.     

Appetitive conditioning in Octopus cyanea

The performance of Octopus cyanea was studied in 3 appetitive conditioning situations. In Experiment 1, 2 groups were trained in a runway; a large reward produced faster acquisition when reinforcement was consistent and better subsequent performance on a partial schedule than did a small reward. In Experiment 2, activity in the vicinity of a feeder was measured, and in Experiment 3, latency and probability of response were measured in an automated version of a traditional conditioned attack situation (Boycott & Young, 1950). There was evidence of acquisition with continuous reinforcement in both experiments but in neither with partial reinforcement. All of the results can be understood in terms of growth and decline in the strength of stimulus-reinforcer associations with reinforcement and nonreinforcement.     

The Influence of Retention Interval on the US Preexposure Effect: Changes in Contextual Blocking over Time

A number of studies manipulating the length of the interval between conditioning and testing indicate spontaneous recovery from overshadowing, suggesting that certain instances of overshadowing represent a deficit in memory retrieval rather than a failure of animals to form an association between the overshadowed stimulus and the US. The present series of experiments examined the influence of lengthening the retention interval on blocking, another stimulus selection phenomenon that is typically interpreted as an acquisition deficit. The results indicated that when subjects were tested shortly (3 days) after training conditioning to a taste blocked subsequent conditioning to an odor conditioned in compound with that taste (Experiment 1), whereas prior conditioning to an odor did not block subsequent conditioning to a taste conditioned in compound with that odor (Experiment 2). This pattern of results was essentially unchanged when testing occurred at a longer (21-day) retention interval. However, there was evidence of a US preexposure effect in Experiment 2 when subjects in the US ONLY control condition were tested at the 3-day retention interval, but not when testing occurred 21 days after conditioning. Experiments 3 and 4 examined whether this loss of the US preexposure effect over time might actually represent a change in the degree of contextual blocking as the retention interval is lengthened. Exposure to the conditioning context either during the interval between Phase 1 and Phase 2 of conditioning (Experiment 3) or prior to Phase 1 of conditioning (Experiment 4) alleviated this US preexposure effect suggesting that the loss of the US preexposure effect as the retention interval is lengthened observed in Experiment 2 is due to changes in the degree of blocking by contextual stimuli over time. The results are discussed in terms of differential susceptibility of forgetting of two functional roles played by a contextual stimuli in the current situation-context as a CS and context as a retrieval cue for other CS-US associations.     

A comparison of pecking generated by serial, delay, and trace autoshaping procedures

Pigeons were exposed to serial, delay, and trace autoshaping procedures. In Experiment I, all conditioned stimuli (CSs) were changes in illumination of the response key. The number of trials to acquisition of the keypeck increased from serial, to 4-sec delay, 8-sec delay, and 8-sec trace procedures, in that order. In Experiment II, which used a longer intertrial interval, trials to criterion increased from 8-sec delay, to 28-sec delay, 8-sec trace, and 28-sec trace procedures, in that order. In Experiment III, two groups received serial procedures in which the first CS was either a tone or a houselight, and the second was a keylight. The tone group acquired the key peck more rapidly than the houselight group. Early in conditioning in these experiments, and when the conditioned stimulus was a change in the keylight, there was a short latency to the onset of pecking and pecking was directed at the CS. After extensive conditioning, or when the CS was relatively diffuse, pecking still occurred, but had a longer latency and was not reliably directed toward the conditioned stimulus.     

The effect of continuous, intermittent, and "placebo" reinforcement on the effectiveness of the conditioning treatment for enuresis nocturna

It has been suggested that intermittent reinforcement may be of value in reducing the rate of relapse in bedwetting conditioning therapy. An experiment was conducted with 30 enuretic boys to examine acquisition and extinction parameters of continuous (100%), intermittent (70% variable ratio), and “placebo” (0%) reinforcement schedules. Reinforced trials were administered as in the typical Mowrer conditioning procedure. Non-reinforced trials were achieved by means of a time delay with the subsequent alarm being activated in the parent's room rather than in the child's room. These procedures required the development of a new conditioning device which could be programmed to automatically administer the desired schedule of reinforcement. The results of the field investigation revealed that continuous reinforcement (CR) and intermittent reinforcement (IR) groups attained acquisition in approximately the same number of trials and with essentially the same success rate. Relapse rate was significantly greater in the CR group than in the IR group. The placebo group showed no improvement over the 6 weeks of treatment. The results of this study may be interpreted as supporting the tenet that relapse can be viewed and treated as an extinction of the acquired response.     

Importance of trials versus accumulating time across trials in partially reinforced appetitive conditioning

Four experiments with rats examined partial reinforcement in appetitive conditioning. In Experiment 1, adding nonreinforced trials to a continuous reinforcement schedule slowed acquisition, whereas deleting reinforcers did not. Trial massing suppressed performance and learning. In Experiment 2, conditioning with a short conditioned stimulus (CS) was rapid, and partial reinforcement with a short CS was as effective as continuous reinforcement with equal accumulated time in the CS. In Experiment 3, conditioning was nevertheless influenced by the probability of reinforcement. In Experiments 3 and 4, conditioning was especially disrupted when nonreinforced trials preceded reinforced trials closely in time. The results underscore the importance of temporal variables in conditioning but are more consistent with trial-based accounts than time-accumulation accounts of conditioning.     

Second-order conditioning of the rabbit's nictitating membrane response. Interstimulus interval and frequency of CS-CS pairings.

Second-order conditioning of the rabbit's nictitating membrane response (NMR) was investigated when second-order trials (CS1-CS2) were intermixed with first-order trials (CS2-US) from the outset of training. Experiment 1 showed that CR acquisition to CS1 was inversely related to the CS1-CS2 interval but nevertheless extended to an interval of 8,400 ms. Experiment 2 revealed that CR acquisition of CS1 was an inverted-U function of the number of CS1-CS2 trials relative to a fixed number of CS2-US trials. Experiment 3 directly contrasted second-order conditioning with a reinforced serial compound procedure (CS1-CS2-US) and a mixed procedure in which second-order trials were intermixed with the reinforced serial compound. Second-order conditioning was about half the strength of either the reinforced serial compound or the mixed procedure, which were similar. The present results are discussed with respect to the relative strength of excitatory and inhibitory processes in second-order conditioning.     

Second-order conditioning of the rabbit’s nictitating membrane response

Second-order conditioning of the rabbit’s nictitating membrane response (NMR) was investigated when second-order trials (CS1-CS2) were intermixed with first-order trials (CS2-US) from the outset of training. Experiment 1 showed that CR acquisition to CS1 was inversely related to the CS1-CS2 interval but nevertheless extended to an interval of 8,400 ms. Experiment 2 revealed that CR acquisition of CS1 was an inverted-U function of the number of CS1-CS2 trials relative to a fixed number of CS2-US trials. Experiment 3 directly contrasted second-order conditioning with a reinforced serial compound procedure (CS1-CS2-US) and a mixed procedure in which second-order trials were intermixed with the reinforced serial compound. Second-order conditioning was about half the strength of either the reinforced serial compound or the mixed procedure, which were similar. The present results are discussed with respect to the relative strength of excitatory and inhibitory processes in second-order conditioning.     

Schedule-induced drinking as functions of interpellet interval and draught size in the Java macaque

Three Java monkeys received food pellets that were assigned by both ascending and descending series of fixed-time schedules whose values varied between 8 and 256 seconds. The draught size dispensed by a concurrently available water-delivery tube was systematically varied between 1.0 and 0.3 milliliter per lick at various fixed-time values during the second and third series determinations. Session water intake was bitonically related to the interpellet interval and was determined by the interaction of (1) the probability of initiating a drinking bout, which fell off at the highest interpellet intervals and, (2) the size of the bout, which increased directly with increases in interpellet interval. Variations in draught size had little effect on total session intakes, but reduced bout size at draught sizes of 0.5 milliliter and below. Thus, a volume-regulation process of schedule-induced drinking operated generally at the session-intake level, but was limited to higher draught sizes at the bout level.     

Differential Acquisition of Aversion by Two Distinctive Contexts Paired with Lithium-Induced Illness

In three experiments using rats as subjects, we investigated the role of the hedonic properties of the CS in context aversion conditioning. In Experiment 1, rats were allowed to drink water in two different contexts, L-S (Light room and Small cage) and D-B (Dark room and Big cage). Rats' consumption of water was higher in the D-B than in the L-S context. This result was taken as evidence for the L-S context eliciting a state of uneasiness that interferes with drinking plain water. In Experiments 2 and 3, rats were injected with lithium after placement in the L-S or the D-B context. In a blocking test (Symonds & Hall, 1997), the L-S context showed conditioning since it blocked the acquisition of aversion by a novel taste, quinine (Experiment 2) or salt (Experiment 3). By contrast, the D-B context failed to show conditioning, that is, no blocking was observed with salt or quinine. These results suggest that the hedonic properties of the context used as the CS may affect its acquisition of associative strength when paired with an internal aversive stimulus.     

Delay-induced attenuation of latent inhibition with a conditioned emotional response depends on CS–US strength

Latent Inhibition (LI) attenuation when a long delay is introduced between acquisition and test phases has been repeatedly observed using aversive conditioning procedures (e.g., Aguado, Symonds, & Hall, 1994). This effect has been used as evidence to support those theories that consider LI to be the result of a retrieval failure. We designed three experiments intended to control for a possible effect of incubation of fear as a possible source of delay-induced attenuated LI. Specifically, we examined the effects of a retention interval between conditioning and testing stages on LI using a 3-stage conditioned emotional response procedure (preexposure, conditioning, and testing). Experiment 1 showed that the LI effect was completely abolished in the delayed testing condition. Experiment 2 evaluated whether a process of fear incubation, developed during the retention interval but obscured by a ceiling effect, produced the attenuation of LI. To this end, we reduced magnitude of conditioning by decreasing US intensity and number of acquisition trials. Experiment 3 directly assessed the relationship between CS–US strength and fear incubation. Experiments 2 and 3 revealed that the apparent reduction of LI after the delay was, at least partially, the result of an incubation effect that is a function of the strength of the CS–US association. The results are discussed with respect to their implications for the different theories of LI.     

Potentiation and overshadowing in odor-aversion learning: Role of method of odor presentation,the distal-proximal cue distinction,and the conditionability of odor

Four experiments with rat subjects examined interactions between odors and tastes in compound aversion conditioning. In Experiments 1 and 2, a saccharin taste potentiated the conditioning of an almond odorant presented on a cup near the location of the drinking spout, but overshadowed the same odorant when it was mixed in drinking water. This difference depended on the type of odor administered during conditioning rather than testing (Experiment 2). Experiments 3 and 4 examined implications of two other differences between the cup and drink odors: (1) while the cup odor was a distal cue that suppressed approach to the spout, the drink odor was primarily a proximal cue that suppressed consumption, and (2) the cup odor was less conditionable than the drink odor when the stimuli were conditioned alone. In Experiment 3, unlike the proximal saccharin taste, the proximal drink odor failed to potentiate the conditioning of a different distal odor. In Experiment 4, substantial dilution of the proximal drink's concentration resulted in both weaker conditioning of the stimulus alone, and potentiation of its conditioning by saccharin. The results suggest that the difference in the conditionability of the cup and drink odors, and not their status as distal and proximal cues, may be critical in the production of potentiation. Weakly conditionable target stimuli are uniquely potentiated by saccharin.     

Palatability shifts in taste and flavour preference conditioning

Changes in palatability of tastes and flavours as a result of flavour preference conditioning were examined. In Experiment 1, when tastes were paired with glucose in a reverse-order differential conditioning paradigm, rats acquired conditioned preferences for CS + and displayed more hedonic responses to CS + than to CS - in a postconditioning taste reactivity test. In Experiment 2, rats that received oral infusions of flavours as CSs during a reverse-order conditioning procedure expressed both palatability shifts and conditioned preferences for CS + . Rats that received a forward conditioning procedure acquired a preference for CS + , but the palatability of CS + was unchanged. In Experiment 3, hungry rats drank mixtures of a flavour CS and a calorific or sweet tasting reinforcer in a long-exposure conditioning paradigm. When tested hungry, rats preferred CS + whether they had acquired flavour-calorie or flavour-taste associations. However, CS + became more palatable only for rats that acquired flavour-calorie associations. These results suggest that acquisition of flavour preferences, as measured by 2-bottle tests, may not always be accompanied by enhanced palatability.     

Behavioral contrast in competitive and noncompetitive environments

Three experiments examined the effects of opportunities for an alternative response (drinking) on positive behavioral contrast of rats' food-reinforced bar pressing. In both Experiments 1 and 2 the baseline multiple variable-interval schedules were rich (variable interval 10-s), and contrast was examined both with and without a water bottle present. In Experiment 1, the rats were not water deprived. When one component of the multiple schedule was changed to extinction, the rate of bar pressing increased in the constant component (positive behavioral contrast). The magnitude of contrast was larger when the bottle was absent than when it was present, as predicted by the matching law. Drinking did not shift from the constant variable-interval component to the extinction component, as might have been expected from competition theory. In Experiment 2, the rats were water deprived. Contrast was larger when the bottle was present than when it was absent, and drinking did shift to the extinction component, as predicted by competition theory. In Experiment 3, water-deprived rats responded on leaner multiple variable-interval schedules (60-s) in the presence of a water bottle. When one component was changed to extinction, contrast did not occur, and drinking did not shift to the extinction component. The present results suggest that there are at least two different sources of behavioral contrast: “competitive” contrast, observed when an alternative response occurs with high probability, and “noncompetitive” contrast, observed when an alternative response occurs with low probability. The results, in conjunction with earlier studies, also suggest that the form of the alternative response and the rate of food reinforcement provided by the multiple schedule combine to determine the amount of contrast.     

Timeout postponement without increased reinforcement frequency

Three experiments were conducted to examine pigeons' postponement of signaled extinction periods (timeouts) from a schedule of food reinforcement when such responding neither decreased overall timeout frequency nor increased the overall frequency of food reinforcement. A discrete-trial procedure was used in which a response during the first 5 s of a trial postponed an otherwise immediate 60-s timeout to a later part of that same trial but had no effect on whether the timeout occurred. During time-in periods, responses on a second key produced food according to a random-interval 20-s schedule. In Experiment 1, the response-timeout interval was 45 s under postponement conditions and 0 s under extinction conditions (responses were ineffective in postponing timeouts). The percentage of trials with a response was consistently high when the timeout-postponement contingency was in effect and decreased to low levels when it was discontinued under extinction conditions. In Experiment 2, the response-timeout interval was also 45 s but postponement responses increased the duration of the timeout, which varied from 60 s to 105 s across conditions. Postponement responding was maintained, generally at high levels, at all timeout durations, despite sometimes large decreases in the overall frequency of food reinforcement. In Experiment 3, timeout duration was held constant at 60 s while the response-timeout interval was varied systematically across conditions from 0 s to 45 s. Postponement responding was maintained under all conditions in which the response-timeout interval exceeded 0 s (the timeout interval in the absence of a response). In some conditions of Experiment 3, which were designed to control for the immediacy of food reinforcement and food-correlated (time-in) stimuli, responding postponed timeout but the timeout was delayed whether a response occurred or not. Responding was maintained for 2 of 3 subjects, suggesting that behavior was negatively reinforced by timeout postponement rather than positively reinforced by the more immediate presentation of food or food-correlated (time-in) stimuli.     

An analysis of sequential variables in Pavlovian conditioning employing extended and limited acquisition training

Sequential theory’s memory model of learning has been successfully applied in response contingent instrumental conditioning experiments (Capaldi, 1966, Capaldi, 1967, Capaldi, 1994 and Capaldi and Miller, 2003). However, it has not been systematically tested in nonresponse contingent Pavlovian conditioning experiments. The present experiments attempted to determine if several sequential variables affect responding in Pavlovian situations as they do in instrumental ones. Of primary concern here were the effects on extinction of number of NR transitions (the number of times a nonreinforced trial is followed by a reinforced trial), N-length (the number of successive nonreinforced trials that precede a reinforced trial), and percentage of reinforcement (50 versus 100%) following either extended acquisition training (Experiment 1, 720 trials) or limited acquisition training (Experiment 3, 24 trials). In agreement with a sequential analysis, N-length increased resistance to extinction more than number of NR transitions following extensive training with the opposite occurring following limited training. In Experiment 1, greater resistance to extinction was associated with 50% than with 100% reinforcement, a partial reinforcement extinction effect (PREE). Experiment 2 examined an anomalous finding obtained in Experiment 1. A major theoretical difference between instrumental and Pavlovian conditioning has been held to be the greater ease of producing a PREE in instrumental than in Pavlovian conditioning (Kimble, 1961 and Mackintosh, 1974). However, the findings obtained here suggest that the probability of obtaining a PREE and other Pavlovian extinction effects, as in instrumental conditioning, increases along with the effectiveness of the sequential variables employed.     

Effects of an infusion of morphine into the accumbens nucleus upon acquisition of hypoalgesic and fear responses in rats exposed to a heat stressor

Four experiments examined the effects of an infusion of morphine into the accumbens nucleus upon the aversive conditioning that can occur in rats exposed to the heated floor of a hot-plate apparatus. An infusion of morphine into the accumbens nucleus but not into the caudoputamen or into the prefrontal cortex impaired the acquisition of a conditioned hypoalgesic (Experiment 1) and fear (Experiment 4) response. This impairment was dose-dependent (Experiment 2) and mediated by opioid receptors in the accumbens nucleus, because it was removed by a systemic (Experiment 3a) or by an accumbal (Experiment 3b) infusion of naloxone. The results were attributed to an antagonism between the reinforcement process for aversive conditioning and the appetitive properties of an accumbal infusion of morphine.