Further Investigation of Responding Elicited by BC and C After A+, AB-, ABC+ Training

Two experiments with pigeons explored conditioned keypeck responding to new visual targets after visual compound discrimination training. In the first experiment, pigeons were trained with an A+, AB-, ABC+, AD-, ADC+ task, in which stimulus A signalled food, stimulus compounds AB and AD signalled no food, and stimulus compounds ABC and ADC signalled food. According to both an elemental model (Rescorla & Wagner, 1972) and a configural model (Pearce, 1987) of Pavlovian conditioning, test compounds BC and DC should elicit less responding than should C alone. However, the birds responded more to BC and DC than to C. In the second experiment, another set of pigeons was trained with an A+, AB-, ABC+, AD-, ADE+ task, in which stimulus A signalled food, stimulus compounds AB and AD signalled no food, and stimulus compounds ABC and ADE signalled food. Contrary to the prediction of the Rescorla-Wagner model, keypeck responding was not less on BC and DE trials than on C and E trials in testing. However, B and D attenuated responding to E and C, respectively, when presented in compounds BE and DC. The Pearce model was able to accommodate these results.     

Overshadowing and associability change

Three appetitive Pavlovian conditioning experiments with rats examined the associability of stimuli A and B that had a history of compound conditioning (AB+), relative to stimuli X and Y that had a history of conditioning in isolation (X+, Y+). Following this training, Experiment 1 revealed that conditioned responding was higher to X and Y than to A and B (overshadowing). In a subsequent AY+, AX-, BY- test discrimination, the AY/BY discrimination was solved more readily than the AY/AX discrimination. In Experiment 2, following AB+, X+, Y+ training, A and Y were presented as a compound and signaled the availability of reinforcement upon the performance of an instrumental response. Test trials in which A and Y were presented alone, and in extinction, revealed that A acquired greater control of instrumental responding than Y. Experiment 3 revealed that following AB+, X+, Y+ training, A and B served as more effective discriminative stimuli for instrumental responding than X and Y. Overall, these results imply that the associability of stimuli conditioned in compound is higher than stimuli conditioned in isolation. These results are discussed in terms of attentional theories of associative learning.     

Similarity and Discrimination Learning

The role played by similarity in discrimination learning was examined in four experiments using compound stimuli. In Experiment 1, pigeons received training in which food was presented after stimulus A, compound AB, but not compound ABC—A+ BC+ ABCo. The A+ ABCo discrimination was acquired more readily than was the BC+ ABCo discrimination. In the remaining experiments, training was of the form, A+ B+ C+ AB+ AC+ BC+ ABCo. The discrimination between the single stimuli A+ B+ C+ and ABCo consistently developed more readily than between the pairs of stimuli AB+ AC+ BC+, and ABCo. The results are shown to be more consistent with a configural than with an elemental theory of conditioning.     

Conditions favoring superconditioning of irrelevant conditioned stimuli

Three appetitive conditioning experiments with rats found partial learning of complex XA+, XB+, XAB- (+ stands for reinforced; - stands for unreinforced) negative patterning discriminations with intermixed A+ and B+ trials (Experiment 1). AB+ trials (Experiment 2), and A+, B+, and AB+ trials (Experiment 3). In all experiments, differential responding emerged more slowly during the learning of the negative patterning discriminations than during learning of the XA+, XB+, XC- control discriminations. Additionally, the negative patterning groups responded more to X than to a separately reinforced Y on unreinforced test trials: thus, X derived superexcitatory properties. This pattern was reversed in the control groups. Results are consistent with theories that allow for different activation patterns when elements are combined.     

Past experience influences the processing of stimulus compounds in human Pavlovian conditioning

In two human skin conductance conditioning experiments we investigated whether processing of stimulus compounds can be influenced by past experience. Participants were either pre-trained with a discrimination problem that could be solved elementally (A+, B−, AB+, C− in Experiment 1 and A+, AB+, C−, CB− in Experiment 2) or one that required a configural solution (AB+, BC−, CD+, DA− in Experiment 1 and A−, AB+, C+, CB− in Experiment 2). After pre-training, participants were shown an EX+, FX− discrimination. Subsequently, responding to individual components (E and F) was tested. After elemental pre-training, participants showed larger responses to the component from the previously reinforced compound (E) than to the component from the nonreinforced compound (F) whereas no such difference was found after configural pre-training. This means that the kind of pre-training influenced whether the later discrimination problem was processed elementally or configurally. The results indicate that organisms can flexibly process stimulus compounds in different ways.     

Summation effects in human learning: evidence from patterning discriminations in goal-tracking

Participants in two human goal-tracking experiments were simultaneously trained with negative patterning (NP) and positive patterning (PP) discriminations (A+, B+, AB–, C–, D–, CD+). Both elemental and configural models of associative learning predict a PP advantage, such that NP is solved less readily than PP. However, elemental models like the unique cue approach additionally predict responding in AB– trials to be initially stronger than that in A+ and B+ trials due to summation of associative strength. Both experiments revealed a PP advantage and a strong summation effect in AB– trials in the first half of the experiments, irrespective of whether the same US was used for both discriminations (Experiment 1) or two different USs (Experiment 2). We discuss that the correct predictions of the unique cue approach are based on its assumptions of non-normalized and context-independent stimulus processing rather than elemental processing per se.     

Second-order conditioning with diffuse auditory reinforcers in the pigeon

Pigeon subjects were used in five experiments investigating second-order conditioning with visual second-order and diffuse auditory first-order stimuli. Experiment 1 used a discriminative conditioning procedure to demonstrate reliable and substantial second-order conditioning with these stimuli. In Experiments 2 and 3, extinction of the auditory first-order stimulus after second-order conditioning had little effect upon responding to the second-order stimulus, when compared to a stimulus whose reinforcer was maintained. Experiment 4 compared directly the susceptibility of second-order responding to extinction of the first-order reinforcing stimulus as a function of the modality of that reinforcer. When a visual second-order stimulus was paired with a visual reinforcer, and the response to the latter was extinguished, then second-order responding was greatly reduced relative to control levels. In contrast, when that reinforcer was an auditory stimulus, second-order responding was not affected by the current value of the first-order stimulus after conditioning. Finally, in Experiment 5 the auditory stimulus was established as a reinforcer through discriminative-operant training. Following second-order conditioning, extinction of responding to this stimulus again had little impact upon responding to the second-order stimulus with which it had been paired. These results are discussed in terms of previous work on second-order conditioning with rat and pigeon subjects.     

Solving XOR

Three experiments examined the way in which exclusive-or (XOR) problems are solved by rats. All rats first received food-rewarded positive and negative patterning problems with two stimulus sets: either A+, B+, AB- and C-, D-, CD+, or A-, B-, AB + and C+, D +, and CD-. Subsequently, rats received revaluation trials in which A was paired with shock and C was not, prior to generalization test trials with B, D, AB, and CD (Experiments 1 & 2); or received A-->shock trials prior to tests with B and CD (Experiment 3). There was greater generalized fear to B than to either D (Experiments 1 & 2) or AB (Experiment 2) and CD (Experiments 2 & 3). These results are inconsistent with configural, connectionist models, but are consistent with an alternative connectionist model that can represent the logical structure of XOR problems.     

Summation in autoshaping is affected by the similarity of the visual stimuli to the stimulation they replace

Pigeons received autoshaping with 2 stimuli, A and B, presented in adjacent regions on a television screen. Conditioning with each stimulus was therefore accompanied by stimulation that was displaced from the screen whenever the other stimulus was presented. Test trials with AB revealed stronger responding if this displaced stimulation was similar to, rather than different from, A and B. For a further experiment the training just described included trials with A and B accompanied by an additional, similar, stimulus. Responding during test trials with AB was stronger if the additional trials signaled the presence rather than the absence of food. The results are explained with a configural theory of conditioning.     

Reversibility of single-incentive selective associations.

Rats were trained to press a lever in the presence of a tone-light compound stimulus and not to press in its absence. In each of two experiments, schedules were designed to make the compound a conditioned punisher for one group and a conditioned reinforcer for the other. In Experiment 1, one group's responding produced food in the presence of the compound but not in its absence. The other group's responding terminated the compound stimulus, and food was presented only in its absence. When tone and light were later presented separately, light controlled more responding than did tone in the former group, but tone gained substantial control in the latter. The same effects were also observed within subjects when the training schedules were switched over groups. In Experiment 2, two groups avoided shock in the presence of the compound stimulus. In the absence of the compound, one group was not shocked, and the other received both response-independent and response-produced shock. When tone and light were presented separately, the former group's responding was mainly controlled by tone, but the latter group's responding was almost exclusively controlled by light. These effects were also observed within subjects when the training schedules were switched over groups. Thus, these single-incentive selective association effects (appetitive in Experiment 1 and aversive in Experiment 2) were completely reversible. The schedules in which the compound should have been a conditioned reinforcer consistently produced visual control, and auditory control increased when the compound should have become a conditioned punisher. Currently accepted accounts of selective associations based on affinities between shock and auditory stimuli and between food and visual stimuli (i.e., stimulus-reinforcer interactions) do not adequately address these results. The contingencies of reinforcement most recently associated with the compound and with its absence, rather than the nature of the reinforcer, determined whether auditory or visual stimulus control developed.     

A role for stimulus generalization in conditional discrimination learning

In each of three experiments on discrimination learning by rats, whether or not a 10-sec target stimulus was followed by food was determined by the nature of a 2-min background stimulus that accompanied it. A conditional discrimination was employed in Experiment 1 such that background A indicated food would follow one target but not the other, whereas this relationship between the targets and food was reversed in the presence of background B. Experiment 2 employed two feature-positive discriminations. Subsequent test trials revealed that the background for one discrimination was able to enhance responding during the target for the other discrimination. Experiment 3 employed a feature-positive and a feature-negative discrimination prior to test trials in which each target was presented separately during a compound of both background stimuli. The compound enhanced responding to the target from the feature-positive discrimination and reduced it to the target from the feature-negative discrimination. We suggest that to accommodate all these findings, the best explanation is provided by a configural model of Pavlovian conditioning.     

Acquired equivalence and distinctiveness of cues: I. Exploring a neural network approach

Rats were placed in 4 contexts (A, B, C, D) where they received 2 auditory stimuli (X, Y); in A and B, presentations of X were paired with food and those of Y were not, and in C and D, Y was paired with food and X was not. Rats then received combinations of contexts that had provided congruent (AB, CD) or incongruent (AD, CB) information about X and Y's relationship to food. Responding was more variable during congruent than incongruent trials (Experiment 1) and was systematically increased and decreased during congruent (relative to incongruent) trials by the presentation of food or no food, respectively (Experiment 2). These results support a connectionist approach to acquired changes in stimulus distinctiveness.     

Configural associations in discrimination learning

In 4 experiments, Sprague-Dawley rats and homing pigeons received training with an A+ AB0 BC+ discrimination, in which food (+) accompanied trials with A and BC. Food was not presented (0) on trials with the compound AB. Subsequent test trials revealed that responding during C by itself, or the compound ABC, was slower than during either A or BC. Responding during the ABC compound was also found to be slower after training with the A+ AB0 BC+ than an A0 AB+ BC+ discrimination. We argue that these findings demonstrate the importance of configural associations in discrimination learning. Two accounts for the way in which these associations exert their influence are considered.     

Backward blocking in honeybees

Three experiments with foraging honeybees were designed to study the effect of experience with A on responding to B after AB+ training. In the first experiment, responding to B was the same whether the AB+ training was preceded or followed by A+ training. In the second experiment, responding to B after AB+ training was less in animals that also had A+ training than in control animals that were equally often reinforced in the absence of A; whether the A+ training preceded, was concurrent with, or followed the AB+ training made no difference. In the third experiment, responding to B after AB+ training was less when the AB+ training was followed by A+C- training than when it was followed by C+/A- training. These results, like those of some recent vertebrate experiments, take us beyond the traditional explanation of blocking in terms of impaired conditioning of B on AB+ trials and support the suggestion that the mechanism, still poorly understood, may nevertheless be a relatively simple one.     

Effects of discrimination training on responding during a compound conditioned stimulus.

Four experiments examined responding in the presence of a triple-element compound ABC after discrimination training in which 2 compounds, AB and BC, signaled the delivery of food and 1 element alone, B, signaled the absence of food. In Experiments 1 and 2, using rats, responding during ABC was more vigorous than in a control group for which A and C but not B had been individually paired with food. This finding was replicated in Experiment 3, which used pigeons, and in Experiment 4, where all 3 stimuli of the control condition were individually paired with food. The results are more consistent with a configural than with an elemental theory of learning.     

The content of compound conditioning

In three experiments using Pavlovian conditioning of magazine approach, rats were trained with a compound stimulus, AB, and were concurrently trained with stimulus B on its own. The reinforcement rate of B, rB, was either 1/2, 2/3, or 2/5 of rAB. After extended training, the conditioning strength of A was assessed using probe trials in which A was presented alone. Responding during A was compared with that during AB, B, and a third stimulus, C, for which rC = rAB - rB. In each experiment, the rats' response rate during A was almost identical to that during C (and during B, when rB = 1/2rAB). This suggests that, during AB conditioning, the rats had learned about rA as being equal to [rAB - rB], and implies that the content of their learning was a linear function of r. The findings provide strong support for rate-based models of conditioning (e.g., Gallistel & Gibbon, 2000). They are also consistent with the associative account of learning defined in the Rescorla and Wagner (1972) model, but only if the learning rate during reinforcement equals that during nonreinforcement.     

Stimulus and temporal cues in classical conditioning

In 2 experiments, separate groups of rats were given stimulus conditioning, temporal conditioning, untreated control and (in Experiment 2) learned irrelevance control procedures, followed by a compound with both stimulus and temporal cues. Stimulus conditioning consisted of a random 15-s duration conditioned stimulus (CS) followed by food; temporal conditioning consisted of food-food intervals of fixed 90 s (Experiment 1) or fixed 75 + random 15 s (Experiment 2). The stimulus group abruptly increased responding after CS onset, and the temporal group gradually increased responding over the food-food interval. When the food-food interval was fixed 90 s, the temporal cue exerted stronger control in the compound, whereas when the food-food interval was fixed 75 + random 15 s, the stimulus cue exerted stronger control. The strength of conditioning, temporal gradients of responding, and cue competition effects appear to reflect simultaneous timing of multiple intervals.     

Prior experience can influence whether the whole is different from the sum of its parts

In two conditioning experiments with humans, we found that participants’ prior experience exerted considerable influence on later learning of configural discrimination problems. Prior experience was manipulated by pre-training participants before the main acquisition stage. They either received a discrimination problem that encouraged an elemental solution (A+, B−, AB+, CD− in Experiment 1 and A+, AB+, C−, CB− in Experiment 2) or one that required a configural solution (AB+, BC−, CD+, DA− in Experiment 1 and A−, AB+, C+, CB− in Experiment 2). Then, all participants were shown a discrimination that required a configural solution (E+, F+, EF− in Experiment 1 and DE+, EF−, FG+, GD− in Experiment 2). In both experiments, participants who had received elemental pre-training were impaired on the later configural problem compared to participants who had received configural pre-training. The results suggest that organisms can flexibly process stimuli elementally or configurally.     

Changes in cue associability across training in human causal learning

A series of experiments studied the amount learned about two food cues (A and B) whose presentation in a meal was followed by an allergy (+) in a fictitious patient. Participants were trained with A+ and C+ in Phase 1 and then with AB+ or AB++ in Phase 2. Subsequent testing revealed that BC was more allergenic than AD, showing that more had been learned about B than A in Phase 2. Participants were also trained with A+, then with AB+, and finally with AB++. The results of interpolating AB+ between A+ and AB++ training were consistent with the hypothesis that pretraining with Cue A selectively suppressed attention to its associate across the AB+ trials and, thereby, reduced the amount subsequently learned about B on AB++ trials.     

The effect of a fading procedure upon the acquisition of control by an overshadowed auditory feature

Pigeons' key-pecking responses were reinforced in the presence of a compound stimulus that consisted of an auditory feature (a tone) and a visual feature (a light) and non-reinforced in the presence of a compound stimulus that was either a noise and a dark key, or noise and a light. In the condition where reinforcement trials differed from non-reinforcement trials on the basis of both auditory and visual features, the tone exerted very little control over responding on test. In the condition where reinforcement differed from non-reinforcement trials solely on the basis of the auditory features, an abrupt and a gradual introduction of the visual feature of the negative stimulus, a light, were compared for their effect upon control in the compounds. The tone acquired strong control in both cases. Evidence indicated that the tone had acquired control in the gradual condition without the occurrence of responses to the negative stimulus. An incidental finding was that when the negative stimulus consisted of a noise and a light, which was introduced abruptly, responding over the light dimension with tone, on test, was peaked at a point other than that light value used as positive and negative during training.