Instrumental responding following reinforcer devaluation

In two experiments, hungry rats were given instrumental lever-press training for an appetitive reinforcer and, in addition, were exposed to another type of food which was not contingent on lever pressing. In the first experiment, exposure to each type of food was on separate days, whereas in the second experiment rats were exposed to each type of food in strict alternation within each session. Subsequently, a food aversion was conditioned to the reinforcer for the experimental group and to the non-contingent food for the control group. In both experiments, animals with an aversion to the reinforcer responded less in an extinction test than animals with an aversion to the non-contingent food. Subsequent reacquisition tests confirmed that the aversion to the non-contingent food in the control group was of comparable strength with that to the reinforcer in the experimental group. The results were discussed in terms of whether the reinforcer is encoded in the associative structure set up by exposure to an instrumental contingency.     

Within compound Associations Mediate the Retrospective Revaluation of Causality Judgements

The role of within-compound associations in the retrospective revaluation of causality judgements was investigated in a two-stage procedure in which the subjects were asked to learn whether or not different food stimuli caused an allergic reaction in hypothetical patients. In the compound-cue stage a number of compound cues, each consisting of a competing stimulus and a target stimulus, were associated with the reaction across a series of trials, whereas in the single-cue stage the subjects had the opportunity to learn which of the competing cues, when presented alone, caused the reaction. Each target stimulus was presented with the same competing cue across all compound trials in the consistent condition, but with a different competing cue on each trial in the varied condition. In a forward procedure, in which the single-cue stage preceded compound cue training, judgements of the causal effectiveness of the target stimuli were reduced or blocked by training them in compound with a competing cue that had been previously paired with the reaction. Moreover, the magnitude of this reduction was comparable in the consistent and varied conditions. This was not true, however, when the single- and compound-cue stages were reversed in the backward procedure. Judgements for target cues compounded with competing cues that were subsequently paired with the reaction were reduced only in the consistent condition. If it is assumed that stronger associations were formed between the competing and target stimuli during the compound-cue stage in the consistent condition than in the varied condition, this pattern suggests that the retrospective revaluation of causality judgements can be mediated by the formation of within-compound associations.     

Contextual conditional discriminations

Three experiments used a discriminated operant procedure to study conditional discrimination learning in rats. The first experiment showed that rats were capable of learning a biconditional discrimination in which two contexts served as conditional cues signalling the reinforcement contingencies associated with two discriminative stimuli. The discrimination was learned equally well when one discriminative stimulus signalled food, the other its absence, and when one stimulus signalled food, the other extinction plus mild footshock.

In Experiment 2 it was shown that prior training on such a conditional discrimination enhanced the subsequent context specificity of simple conditioning relative to control groups of animals for whom the prior training had not been conditional. Experiment 3 showed that a reversal of the significance of one pair of discriminative stimuli produced no spontaneous reversal in performance to a second, target, pair.

The pattern of results is best accounted for by an analysis of contextual conditional discrimination learning in terms of stimulus configurations and offers no support for the notion that rats may learn a general conditional rule or set.     

Signalling and incentive processes in instrumental reinforcer devaluation

We have previously reported that conditioning an aversion to the reinforcer using an isotonic lithium chloride (LiCl) solution following instrumental training reduces performance in a subsequent extinction test only if animals are re-exposed to the reinforcer prior to the test. Rescorla (1992), in contrast, reported an immediate devaluation effect using a hypertonic LiCl solution that did not depend upon re-exposure. In two experiments we examined the effect of using a hypertonic LiCl solution to condition the aversion to the reinforcer on subsequent instrumental performance in extinction, with and without re-exposure. In Experiment 1 thirsty rats were trained to press a lever for a sucrose solution before being injected with 0.6 M LiCl either immediately or after a delay. Half of the immediate and delay groups were then re-exposed to the sucrose in the absence of the lever, with the remainder being exposed to water. Contrary to the previously reported effects of isotonic LiCl, a hypertonic solution induced a reinforcer devaluation effect in all the immediately poisoned animals, which did not depend upon re-exposure to the reinforcer. In Experiment 2 the possibility that this devaluation effect was induced by the discomfort associated with the hypertonicity of the solution was assessed by replicating Experiment 1 but, in addition, using two immediately poisoned groups given the LiCl injection under anaesthesia. In the absence of anaesthesia, the devaluation effect observed without re-exposure to the reinforcer in Experiment 1 was replicated. When the injection was given under anaesthesia, however, a reinforcer devaluation effect was observed only in animals that were re-exposed to the reinforcer prior to the extinction test. These results were interpreted as evidence that a reinforcer devaluation effect induced by pairing the reinforcer with illness depends upon a process of incentive learning, whereas a devaluation effect mediated by learning a signalling relationship between the reinforcer and somatic discomfort does not.     

Bidirectional Instrumental Conditioning

Three experiments examined bidirectional instrumental conditioning by training hungry rats to push a pole in one direction for food pellets and in the other for either a sugar or a starch solution. In the first study we examined whether the animals learned about the actionreinforcer relations using a specific satiety procedure. Prefeeding one type of reinforcer before an extinction test selectively depressed the performance of the action that had been paired with this reinforcer during training. The second experiment investigated the sensitivity of the bidirectional actions to variations in the action-reinforcer contingencies. When the instrumental contingency was degraded by presenting unpaired reinforcers, the animals pushed less in the direction that was paired with the reinforcer type that was the same as the non-contiguous one. A third study revealed that increasing the rate of reinforcement for one action enhanced its rate of performance without significantly affecting the performance of the other action. We conclude that the effects of reinforcer devaluation, the action-outcome contingency, and the rate of reinforcement are not mediated by Pavlovian associations between the manipulandum and the reinforcer.     

Stimulus generalization and the peak shift with movement stimuli

Stimulus generalization is suggested as an alternative method for examination of the "novelty" problem in motor learning. These experiments demonstrated that stimulus generalization occurs using simple movements as stimuli. The phenomenon of the "peak shift" in post-discrimination generalization gradients was also examined. The first experiment demonstrated that a peak shift occurred using linear movements as stimuli and that the magnitude of the peak shift increased as the difference between the training stimuli decreased. The second experiment showed similar results when the stimuli consisted of a range of movements rather than single movement length. The final experiment provided evidence that perception of movement length is influenced by the magnitude of an immediately preceding movement. The relevance of these studies to current motor-learning theory is discussed.     

Positive contrast following gradual and abrupt increases in reward magnitude using delay of reinforcement

In Experiment 1, rats were given a 1-pellet reward for 48 preshift trials. During a subsequent 20-trial postshift phase, one group was shifted to a 12-pellet reward on Trial 1, a second was shifted on Trial 11, and a third was given 1 more pellet each trial and then 12 pellets for the last 10 trials. The speeds of all three groups increased to a level above that of a control group given a 12-pellet food reward throughout training (positive contrast). In experiment 2, rats were shifted from 1 to 12 pellets either gradually or abruptly following either abbreviated training (9 trials) or extended training (20 trials). One group of control subjects received 12 pellets throughout training. The results revealed a positive contrast effect for gradually shifted subjects following extended training but not following abbreviated training. The abrupt shift procedure produced positive contrast following abbreviated training but only a marginal effect following extended training. These results indicate that, contingent upon the amount of preshift training, either gradual or abrupt reward increases may produce positive contrast.