The hide-and-seek of retrospective revaluation: recovery from blocking is context dependent in human causal learning

In a typical blocking procedure, pairings of a compound consisting of 2 stimuli, A and X, with the outcome are preceded by pairings of only A with the outcome (i.e., A+ then AX+). This procedure is known to diminish responding to the target cue (X) relative to a control group that does not receive the preceding training with blocking cue A. We report 2 experiments that investigated the effect of extinguishing a blocking cue on responding to the target cue in a human causal learning paradigm (i.e., A+ and AX+ training followed by A- training). The results indicate that extinguishing a blocking cue increases conditioned responding to the target cue. Moreover, this increase appears to be context dependent, such that increased responding to the target is limited to the context in which extinction of the blocking cue took place. We discuss these findings in the light of associative and propositional learning theories.     

The Effect of Stimulus Preexposure on Responding during a Compound Stimulus

In two experiments with rats, three stimuli, A, B, and X, were used for an AX+ BX+ Xo discrimination in which food was presented after the simultaneous presentation of A and X, or B and X, but never after X by itself. For one group in each experiment, X was repeatedly presented by itself before the start of discrimination training. This manipulation weakened responding on test trials in which the three stimuli were presented together. The results are interpreted in terms of a configural theory of conditioning that assumes that preexposure to a stimulus will reduce its capacity to promote generalization among different configurations to which it belongs.     

People want to see information that will help them make valid inferences in human causal learning

According to higher order reasoning accounts of human causal learning (e.g., Lovibond, Been, Mitchell, Bouton, and Frohardt, 2003; Waldmann and Walker, 2005) ceiling effects in forward blocking (i.e., smaller blocking effects when the outcome occurs with a maximal intensity on A+ and AX+ trials) are due to the fact that people are uncertain about the causal status of a blocked cue X in a forward blocking design when the outcome is always fully present on A+ and AX+ trials. This should not be the case for a reduced overshadowing cue Y (B- trials followed by BY+ trials). We tested this hypothesis by asking participants which additional information they preferred to see after seeing all learning trials. Results showed (1) that all participants preferred to see the effect of the blocked cue X over seeing the effect of the reduced overshadowing cue Y (Experiment 1), and (2) that more participants preferred to see the blocked cue X on its own when the outcome on A+ and AX+ trials was fully present than when the outcome on those trials had a submaximalintensity (Experiment 2).     

Representation-mediated Inhibitory Learning in the Conditioned-suppression Procedure

In three experiments, rats in group I (for intermixed) were given non-reinforced exposure to two compound stimuli, AX and BX, where A and B represent different auditory cues, and X represents a visual cue. AX and BX were presented in alternation. Group B (blocked) received similar exposure except that subjects experienced a block of AX trials and then a block of BX trials. Subsequent shock reinforcement of A was found to endow B with inhibitory strength in group I, as assessed by retardation (Experiments 1 and 2) and summation tests (Experiment 3). This outcome confirms and extends the results reported by Espinet, Iraola, Bennett, and Mackintosh (1995) and constitutes a further example of mediated learning in which the associative strength of a stimulus is found to be modified as a consequence of training given to some other event with which that stimulus is associated.     

Attention and relative novelty in human perceptual learning

Four experiments examined the role of attention in human perceptual learning. In Experiment 1, participants were preexposed to a pair of visual (checkerboard) stimuli AX and BX, with common elements X and unique features A and B. A same-different task was then used to assess discrimination of AX and BX and a pair of control stimuli, CY and DY. In addition, participants' eye movements were recorded to assess the role of attentional processes. The results showed that preexposure enhanced discrimination between AX and BX. Furthermore, participants showed greater attention to the preexposed unique features A and B than to the novel unique features C and D, as measured by the eye gaze monitor. Experiments 2 and 3 examined the prediction that perceptual learning is due to the relative familiarity of the common and unique stimulus features. Experiment 4 replicated the intermixed-blocked effect and showed that the way in which AX and BX are presented is also important for perceptual learning. The results generally support the idea that intermixed preexposure to AX and BX increases attention to the unique stimulus features A and B. Some aspects of the results are consistent with a relative novelty account, whereas others implicate a high-level attentional process that is not driven by stimulus novelty.     

Analysis of the role of associative inhibition in perceptual learning by means of the same-different task

In Experiment 1a, participants were exposed, over a series of trials, to separate presentations of 2 similar checkerboard stimuli, AX and BX (where X represents a common background). In one group, AX and BX were presented on alternating trials (intermixed), in another, they were presented in separate blocks of trials (blocked). The intermixed group performed to a higher standard than the blocked group on a same-different test. A superiority of intermixed over blocked exposure was also evident in a within-subject design (Experiment 1b) and when the test required discrimination between a preexposed stimulus and the background (e.g., AX vs. X), even if the background changed between preexposure and test (AY vs. Y) (Experiment 2). In Experiment 3, the intermixed/blocked effect was observed when, in preexposure, stimulus presentations were alternated with the background alone (e.g., AX/X). This suggests that the perceptual learning effect is not the consequence of inhibitory associations between unique features but to increased salience of those features. Experiment 4 confirmed this finding and also ruled out an account of the effect in terms of trial spacing.     

Visual dominance in inhibitory conditioning in the pigeon

In a conditioned inhibition paradigm (A+, B+, AX?_, pigeons received either of two keylight stimuli reliably followed by food (A+, B+). However, when one of these keylights was accompanied by another stimulus, food did not follow (AX?). For some groups, the putative inhibitor was a tone, whereas for others it was illumination of a red houselight. The birds pecked the A and B stimuli at a high rate. When X was red houselight, the birds pecked A at a much lower rate in the presence of X. When X was a tone, discrimination between A and AX was much poorer. Moreover, in a transfer test, red houselight inhibited responding to the other keylight, B, but tone did not. These results indicate that red houselight becomes a conditioned inhibitor more quickly than tone in appetitive situations, just as red houselight becomes a conditioned excitor more quickly in those situations. These results contradict the assertion that the latter outcome occurs because red houselight is a stronger appetitive excitor than tone at the start of the experiment (the “head start” hypothesis).     

Optional-shift behaviour in rats: a novel procedure for assessing attentional processes in discrimination learning

A novel, optional-shift procedure was used to assess changes in the attention paid to stimuli that occur over the course of discrimination learning. In Phase 1, rats were trained on a conditional instrumental discrimination using audiovisual stimulus compounds; one stimulus dimension (auditory or visual) was relevant to the solution of the discrimination, the other was irrelevant. In Phase 2, all animals received three sessions of training with novel audiovisual compounds where both dimensions were equally diagnostic. Results from probe test trials indicated that, during Phase 2, animals learnt most about cues belonging to the stimulus dimension that was relevant during Phase 1. These results suggest that over the course of discrimination learning there was an increase in the amount of attention paid to relevant stimuli and/or a decrease in the attention paid to irrelevant stimuli.     

Contextual conditional discriminations

Three experiments used a discriminated operant procedure to study conditional discrimination learning in rats. The first experiment showed that rats were capable of learning a biconditional discrimination in which two contexts served as conditional cues signalling the reinforcement contingencies associated with two discriminative stimuli. The discrimination was learned equally well when one discriminative stimulus signalled food, the other its absence, and when one stimulus signalled food, the other extinction plus mild footshock.

In Experiment 2 it was shown that prior training on such a conditional discrimination enhanced the subsequent context specificity of simple conditioning relative to control groups of animals for whom the prior training had not been conditional. Experiment 3 showed that a reversal of the significance of one pair of discriminative stimuli produced no spontaneous reversal in performance to a second, target, pair.

The pattern of results is best accounted for by an analysis of contextual conditional discrimination learning in terms of stimulus configurations and offers no support for the notion that rats may learn a general conditional rule or set.     

Optional-shift behaviour in rats: A novel procedure for assessing attentional processes in discrimination learning

A novel, optional-shift procedure was used to assess changes in the attention paid to stimuli that occur over the course of discrimination learning. In Phase 1, rats were trained on a conditional instrumental discrimination using audiovisual stimulus compounds; one stimulus dimension (auditory or visual) was relevant to the solution of the discrimination, the other was irrelevant. In Phase 2, all animals received three sessions of training with novel audiovisual compounds where both dimensions were equally diagnostic. Results from probe test trials indicated that, during Phase 2, animals learnt most about cues belonging to the stimulus dimension that was relevant during Phase 1. These results suggest that over the course of discrimination learning there was an increase in the amount of attention paid to relevant stimuli and/or a decrease in the attention paid to irrelevant stimuli.     

More learned irrelevance than perseveration errors in rule shifting in healthy subjects

The present experiments examined the extent to which two possible sources of error affect healthy subjects' performance in a rule-shift task. All 115 participants first received a discrimination learning task, in which a pair of different visual stimuli was presented on each trial, one of which had to be identified as 'correct.' Each stimulus varied in two dimensions: a task-relevant and a task-irrelevant dimension. Feedback on correctness was given after each choice. After eight successive correct choices, the nature of the task-relevant dimension changed: the post-shift learning phase. Two types of error can occur in this phase: continued responding to the former relevant, but now irrelevant, dimension, a perseverative error, and non-responding to the former irrelevant, but now relevant, dimension, an error due to learned irrelevance. Different groups received a post-shift task in which none, one, or both of these two types of error could affect performance. The number of incorrect choices in the post-shift phase was significantly affected by learned-irrelevance errors but not by perseverative errors. An associative-learning model incorporating feedback-induced changes in both associative strength and saliency of the elements comprising the stimuli can explain these results.     

Cue selection in verbal discrimination learning of retarded subjects.

A series of experiments was conducted to examine cue function in trigram verbal discrimination learning by retarded subjects. The issue was to determine the factors that control attention in this type of learning situation. The two variables of chief interest were trigram meaningfulness and reinforcement history. The major general conclusion was that retarded subjects employ complex cue selection strategies in solving a verbal discrimination involving compound verbal stimuli. Major findings were as follows: (a) Retarded subjects exhibit a response bias in favor of words over nonsense trigrams; (b) relatively little active cue selection based on meaningfulness was observed; (c) a compound stimulus discrimination was more difficult to learn than a discrimination involving single verbal stimuli; (d) compound and single stimuli may be processed differently in original discrimination learning; (e) cue position probably controls attention in compound discrimination learning; and (f) a frequency theory of verbal discrimination learning is supported by these data.     

Mediated configural learning in rats

Three experiments investigated mediated configural learning in male rats. In Experiment 1, after exposure to audio-visual compounds AX and BY, rats received trials where X was paired with shock, and Y was not. The idea that conditioning with X enables the evoked configural representation of AX to be linked to shock received support from the facts that while AX provoked more fear than BX, there was no difference between BY and AY. Similarly, Experiment 2 showed that after exposure to AX and BY, separate pairings of X and Y with shock resulted in more fear to AX and BY than AY and BX. In Experiment 3, rats in group consistent received separate exposures to A and X in Context C, and B and Y in D, while those in group inconsistent received A and X (and B and Y) in both C and D. After rats had received shocks in both C and D, rats in group consistent showed more fear to AX and BY than to BX and AY, but this was not the case in group inconsistent. These results indicate that configural representations, formed either by presenting auditory and visual stimuli as parts of a compound or in a shared context, are subject to a process of mediated learning.     

Salience modulation in serial preexposure: implications for perceptual learning

In three experiments rats were given serial preexposure to two flavor stimuli. In Experiment 1, some animals were given exposure to AX followed by the presentation of BX, a forward schedule; the others were given backward preexposure (BX→AX). Conditioning and test trials with the A element showed that salience or effectiveness of A was better protected in the forward than in the backward condition. Experiments 2 and 3 assessed the relevance of this salience modulation mechanism for perceptual learning. In these experiments, generalization of a conditioned aversion from AX to BX was reduced in the forward (but not in the backward) condition only after prolonged exposure, indicating that the establishment of an inhibitory link from B to A is required for successful discrimination. However, generalization to a novel compound stimulus, NX, was reduced in the forward group both after short and long preexposure, suggesting the existence of salience modulation processes that work in parallel with associative inhibition. These results seem to support the existence of a salience modulation mechanism that seems to be beyond the scope of current theories of perceptual learning.     

Memory for, and salience of, the unique features of similar stimuli in perceptual learning

In two experiments, participants received exposure to complex checkerboards (e.g., AX and BX) that consisted of small distinctive features (A and B) superimposed on a larger common background (X). Subsequent discrimination between AX and BX, assessed by a same-different task, was facilitated when the stimuli were presented on alternate trials in preexposure--a perceptual learning effect (Experiment 1). The hypothesis that this form of exposure results in more accurate representations of the unique features was supported in Experiment 1, which showed that participants were well able to match the color of the feature with its shape. Experiment 2 showed that exposure to A and B in isolation, intermixed with presentations of AX and BX, enhanced the perceptual learning effect, which confirmed that the better encoding of the unique features during intermixed preexposure is a direct cause of the enhanced discrimination observed following preexposure on this schedule.     

Temporal discrimination using different feature--target intervals in classical conditioning of the rabbit's nictitating membrane response

In a typical conditional discrimination, a target stimulus (X) is reinforced during one feature cue (A-->X+), but not during another feature cue (B-->X-). The present experiments used only a single "feature" cue (a 66-sec tone). On half of the trials, the target stimulus (a 400-msec light) was paired with the reinforcer when the feature-target interval was one duration (e.g., 5 sec). On the remaining trials, the interval was different (e.g., 45 sec), and the target stimulus was presented without the reinforcer. All the animals acquired this temporal discrimination, and subsequent testing with other feature-target intervals yielded generalization-like gradients. These results provide solid evidence that each portion of a feature cue is encoded in a distinctive fashion. Had temporal encoding not occurred, the feature cue would have been just as ambiguous a predictor of the reinforcer as was the target stimulus, and discrimination would not have been possible. The integration of real-time temporal encoding mechanisms into models of conditional discrimination is discussed.     

Superior discrimination between similar stimuli after simultaneous exposure

Human participants received unsupervised exposure to difficult-to-discriminate chequerboard stimuli (e.g., AX and BX), before learning a discrimination between them. Experiment 1 demonstrated that prior exposure enhanced later discrimination and that intermixed exposure (AX, BX, AX, BX …) resulted in better subsequent discrimination than did blocked exposure (CY, CY … DY, DY …). Experiment 2 showed that simultaneous exposure to two similar stimuli (AX–BX, BX–AX …) facilitated the later acquisition of a successive discrimination, more than successive exposure (AX–AX, BX–BX …). These results parallel those observed by Mundy, Honey, and Dwyer (2007) who used pictures of human faces as stimuli and establish the generality of the fact that simultaneous exposure produces a particularly marked perceptual learning effect.     

Effects of associatively significant posttrial stimuli on learning and memory

Pigeons were trained on a delayed conditional discrimination in which the choice between two simultaneously presented stimuli depended on how the trial started. Choice of one of the stimuli was reinforced if the trial had been initiated by presentation of a food sample and choice of the other was reinforced if no sample had been presented. Subsequently, test trials were administered on which an associatively significant stimulus was presented during the retention interval. This manipulation was intended to modulate the short-term retention of information about the food sample. It was found that performance on food sample test trials was enhanced by presentation of an excitor for food, disrupted by presentation of an inhibitor for food and unaffected by presentation of an associatively neutral stimulus. The impact of these posttrial stimuli was also assessed on the ability of the food sample to serve as a reinforcer. This was done by recording the development of responding to a keylight that signalled the food sample on these test trials. Compared to the associatively neutral stimulus, both the excitor and the inhibitor interfered with the development of keypecking. These results are discussed with regard to the issue of how posttrial events modulate associative learning.     

Similarity and Discrimination Learning

The role played by similarity in discrimination learning was examined in four experiments using compound stimuli. In Experiment 1, pigeons received training in which food was presented after stimulus A, compound AB, but not compound ABC—A+ BC+ ABCo. The A+ ABCo discrimination was acquired more readily than was the BC+ ABCo discrimination. In the remaining experiments, training was of the form, A+ B+ C+ AB+ AC+ BC+ ABCo. The discrimination between the single stimuli A+ B+ C+ and ABCo consistently developed more readily than between the pairs of stimuli AB+ AC+ BC+, and ABCo. The results are shown to be more consistent with a configural than with an elemental theory of conditioning.     

Effects of preexposure on stimulus discrimination: an investigation of the mechanisms responsible for human perceptual learning

The effect of preexposure on human perceptual learning was investigated in four experiments. In Experiments 1a and 1b, participants were preexposed to one pair of visual stimuli on an intermixed schedule (AX/BX) and one on a blocked schedule (CX_DX). The ability to discriminate between AX and BX and between CX and DX was then assessed by examining the extent to which key presses assigned to each member of a stimulus pair generalized to the other member (Experiment 1a) and by looking at the accuracy of same-different responses (Experiment 1b). Stimuli were more easily discriminated following intermixed than following blocked preexposure on both the generalization and same-different tasks. This suggests that two stimuli are more perceptually distinct after intermixed preexposure. Experiments 2a and 2b investigated the mechanisms responsible for perceptual learning using same-different tasks. The results support the suggestion that the enhanced discrimination observed after intermixed preexposure is due to increases in the salience of the unique elements.