The role of memory for compounds in cue competition

Revisions of common associative learning models incorporate a within-compound association mechanism in order to explain retrospective cue competition effects (e.g., [Dickinson, A., & Burke, J. (1996). Within-compound associations mediate the retrospective revaluation of causality judgements. Quarterly Journal of Experimental Psychology, 49B, pp. 60-80.]). These models predict a correlation between memory for compounds (as a measure for the strength of within-compound associations) and retrospective cue competition but not forward cue competition. This was indeed found in a study of [Melchers, K. G., Lachnit, H., & Shanks, D. (2004). Within-compound associations in retrospective revaluation and in direct learning: A challenge for comparator theory. Quarterly Journal of Experimental Psychology, 57B, pp. 25-54.]. We argue that a higher-order reasoning account of causal learning can also explain the evidence for the role of within-compound associations in cue competition. Moreover, this account predicts that if making inferences during the learning stage is impeded, a correlation between memory for compounds and forward cue competition should be found as well. The results of a new study confirmed this prediction.     

Within-compound associations in retrospective revaluation and in direct learning: A challenge for comparator theory

In three human causal learning experiments we investigated the role of within-compound associations in learning about absent cues versus learning about present cues. Different theoretical approaches agree that within-compound associations are essential for learning about absent cues-that is, for retrospective revaluation. They differ, however, with regard to the role of within-compound associations for learning about present cues-that is, for direct learning. A memory test was used to assess within-compound associations. Experiment 1 used a blocking/release from overshadowing design, Experiment 2 used a conditioned inhibition design, and Experiment 3 used a higher-order cue selection design. In all experiments, first-order retrospective revaluation was significantly correlated with within-compound associations, but no significant correlations were found for the direct learning conditions. In addition to this, second-order retrospective revaluation in Experiment 3 was positively correlated to joint knowledge of first-order and second-order within-compound associations. Furthermore, cue selection effects were stronger for direct learning conditions than for retrospective learning conditions. These results are at variance with the comparator hypothesis but are in agreement with a modified associative theory and with the suggestion that retrospective revaluation might be due to rehearsal processes.     

The 28th Bartlett Memorial Lecture Causal learning: An associative analysis

The concordance between performance and judgements of the causal effectiveness of an instrumental action suggests that such actions are mediated by causal knowledge. Although causal learning exhibits many associative phenomena—blocking, inhibitory or preventative learning, and super-learning—judgements of the causal status of a cue can be changed retrospectively as a result of learning episodes that do not directly involve the cue. In order to explain retrospective revaluation, a modified associative theory is described in which the learning processes for retrieved cue representations are the opposite to those for presented cues, and this theory is evaluated by studies of the role of within-compound associations in retrospective revaluation and blocking. However, this modified theory only applies when the within-compound association represents a contiguous rather than a causal cue relationship.     

The comparator theory fails to account for the selective role of within-compound associations in cue-selection effects

In a human causal learning experiment, we investigated cue selection effects to test the comparator theory (Denniston, Savastano, & Miller, 2001; Miller & Matzel, 1988). The theory predicts that the occurrence of cue selection is independent of whether the relevant learning trials are presented in a standard forward manner or in a backward manner and that within-compound associations are of equal importance in both cases. We found that the strength of the cue-selection effect was positively correlated with knowledge of within-compound associations in the backward condition but not in the forward condition. Furthermore, cue-selection effects were less pronounced in the former than in the latter condition. These results are at variance with the comparator hypothesis but are in agreement with a modified associative theory and with the suggestion that retrospective revaluation might be due to rehearsal processes.     

Does the type of judgement required modulate cue competition?

According to the comparator process hypothesis (Matute, Arcediano, & Miller, 1996), cue competition in the learning of between-events relationships arises if the judgement required involves a comparison between the probability of the outcome given the target cue and the probability of the outcome given the competing cue. Alternatively, other associative accounts (the Rescorla-Wagner model: Rescorla &Wagner, 1972) conceive cue competition as a learning deficit affecting the target cue-outcome association. Consequently, the comparator process hypothesis predicts that cue competition occurs in inference judgements but not in contiguity ones, for only the first type of judgement implicitly involves such a comparison. On the other hand, the Rescorla-Wagner model predicts cue competition in both inference and contiguity judgements, because it establishes no relevant role for the type of judgement in producing cue competition. In Experiments 1 and 2 we manipulated the relative validity of cues and the type of question (inference vs. contiguity) in a predictive learning task. In both experiments we found a cue competition effect, but no interaction between the relative validity of cues and the type of question, suggesting that the Rescorla-Wagner theory suffices to explain cue competition.     

Causal Learning: Association Versus Computation

Causal learning enables humans and other animals not only to predict important events or outcomes, but also to control their occurrence in the service of needs and desires. Computational theories assume that causal judgments are based on an estimate of the contingency between a causal cue and an outcome. However, human causal learning exhibits many of the characteristics of the associative learning processes thought to underlie animal conditioning. One problem for associative theory arises from the finding that judgments of the causal power of a cue can be revalued retrospectively after learning episodes when that cue is not present. However, if retrieved representations of cues can support learning, retrospective revaluation is anticipated by modified versions of standard associative theories.     

Retrospective revaluation in humans: Learning or memory?

The phenomenon of retrospective revaluation has posed considerable problems for many associative learning theories as it involves a change in the associative strength of a cue on trials on which that cue is absent. The present series of experiments pursues this idea of changes in associative strength between evoked representations of cues, in an effort to establish, de novo, an excitatory connection between two cues simultaneously activated in memory. Given the finding of Dwyer, Mackintosh, and Boakes (1998) that simultaneous activation of absent cues in the memory of rats resulted in learning comparable to that seen inretrospective revaluation, we expected that if retrospective revaluation was found in humans, then excitatory learning due to simultaneous activation would also be seen. This was not the case. The implications of our results are discussed in terms of Dickinson and Burke's (1996) modified SOP model and a version of McLaren's (1993) APECS network. We conclude that many of the effects attributed to learning in retrospective revaluation studies are better thought of as due to changes in the retrievability of items in memory.     

An inhibitory within-compound association attenuates overshadowing

According to the comparator hypothesis (Miller & Matzel, 1988), cue competition depends on the association between a target stimulus (X) and a competing cue (e.g., an overshadowing cue [A]). Thus, it was expected that overshadowing would be reduced by establishing an inhibitory-like relationship between X and A before compound conditioning. In three lever press suppression experiments with rats, this expectation was supported. Experiment 1 showed that establishing an inhibitory X-A relationship reduced overshadowing. In Experiment 2, degrading the inhibitory-like relationship before conditioning allowed reinforced AX compound trials to result in overshadowing. Experiment 3 replicated the results of Experiment 2 when the inhibitory relationship was degraded after compound conditioning. The results support the view that within-compound associations are necessary not only for retrospective revaluation, but also for conventional cue competition.     

Associative history affects the associative change undergone by both presented and absent cues in human causal learning

R. A. Rescorla (2000) noted that a number of influential theories of associative learning do not take the associative history of cues (i.e., the prior training that they have received) into account when calculating the associative change undergone by those cues. The authors tested this assumption in a human causal learning paradigm and found associative history to be an important determinant of the learning undergone by cues that are presented on a trial. Moreover, associative history was also found to influence the amount of retrospective revaluation undergone by absent cues. These findings conflict with models of causal learning in which the associative change undergone by an element of a cue compound is governed by a summed error term (e.g., R. A. Rescorla & A. R. Wagner, 1972).     

Asymmetries in cue competition in forward and backward blocking designs: Further evidence for causal model theory

A hallmark feature of elemental associative learning theories is that multiple cues compete for associative strength when presented with an outcome. Cue competition effects have been observed in humans, both in forward and in backward blocking procedures (e.g., Shanks, 1985) and are often interpreted as evidence for an associative account of human causal learning (e.g., Shanks & Dickinson, 1987). Waldmann and Holyoak (1992), however, demonstrated that cue competition only occurs in predictive, and not diagnostic, learning paradigms. While unexplainable from an associative perspective, this asymmetry readily follows from structural considerations of causal model theory. In this paper, we show that causal models determine the extent of cue competition not only in forward but also in backward blocking designs. Implications for associative and inferential accounts of causal learning are discussed.     

Overshadowed cues have reduced ability to retroactively interfere with other cues

The present series of experiments explores the interaction between retroactive interference and cue competition in human contingency learning. The results of two experiments show that a cue that has been exposed to a cue competition treatment (overshadowing) loses part of its ability to retroactively interfere with responding to a different cue that was paired with the same outcome. These results pose problems for associative models of contingency learning and are also difficult to explain in terms of current theories of causal reasoning. Additionally, it is proposed that in light of the interaction between interference and cue competition, interference could be used as an indirect measure for the study of cue competition effects.     

Conditioned inhibition produced by extinction-mediated recovery from the relative stimulus validity effect: a test of acquisition and performance models of empirical retrospective revaluation

Empirical retrospective revaluation is a phenomenon of Pavlovian conditioning and human causal judgment in which posttraining changes in the conditioned response (Pavlovian task) or causal rating (causal judgment task) of a cue occurs in the absence of further training with that cue. Two experiments tested the contrasting predictions made by 2 families of models concerning retrospective revaluation effects. In a conditioned lick-suppression task, rats were given relative stimulus validity training, consisting of reinforcing a compound of conditioned stimuli (CSs) A and X and nonreinforcement of a compound of CSs B and X, which resulted in low conditioned responding to CS X. Massive posttraining extinction of CS A not only enhanced excitatory responding to CS X, but caused CS B to pass both summation (Experiment 1) and retardation (Experiment 2) tests for conditioned inhibition. The inhibitory status of CS B is predicted by the performance-focused extended comparator hypothesis (J. C. Denniston, H. I. Savastano, & R. R. Miller, 2001), but not by acquisition-focused models of empirical retrospective revaluation (e.g., A. Dickinson & J. Burke, 1996; L. J. Van Hamme & E. A. Wasserman, 1994).     

Retrospective revaluation as simple associative learning

Backward blocking, unovershadowing, and backward conditioned inhibition are examples of retrospective revaluation phenomena that have been suggested to involve more than simple associative learning. Models of these phenomena have thus used additional concepts, for example, appealing to attentional effects or more elaborate learning mechanisms. The author shows that a suitable representation of stimuli, paired with a careful analysis of the discriminations faced by animals, leads to an account of these and other phenomena in terms of a simple elemental model of associative learning, with essentially the same learning mechanism as the R. A. Rescorla and A. R. Wagner (1972) model. The author concludes with a discussion of some implications for theories of learning.     

The role of outcome inhibition in interference between outcomes: A contingency‐learning analogue of retrieval‐induced forgetting

Current associative theories of contingency learning assume that inhibitory learning plays a part in the interference between outcomes. However, it is unclear whether this inhibitory learning results in the inhibition of the outcome representation or whether it simply counteracts previous excitatory learning so that the outcome representation is neither activated nor inhibited. Additionally, these models tend to conceptualize inhibition as a relatively transient and cue‐dependent state. However, research on retrieval‐induced forgetting suggests that the inhibition of representations is a real process that can be relatively independent of the retrieval cue used to access the inhibited information. Consistent with this alternative view, we found that interference between outcomes reduces the retrievability of the target outcome even when the outcome is associated with a novel (non‐inhibitory) cue. This result has important theoretical implications for associative models of interference and shows that the empirical facts and theories developed in studies of retrieval‐induced forgetting might be relevant in contingency learning and vice versa.     

A dissociation between causal judgment and outcome recall

It has been suggested that causal learning in humans is similar to Pavlovian conditioning in animals. According to this view, judgments of cause reflect the degree to which an association exists between the cause and the effect. Inferential accounts, by contrast, suggest that causal judgments are reasoning based rather than associative in nature. We used a direct measure of associative strength, identification of the outcome with which a cause was paired (cued recall), to see whether associative strength translated directly into causal ratings. Causal compounds AB+ and CD+ were intermixed with A+ and C- training. Cued-recall performance was better for cue B than for cue D; thus, associative strength was inherited by cue B from the strongly associated cue A (augmentation). However, the reverse was observed on the causal judgment measure: Cue B was judged to be less causal than D (cue competition). These results support an inferential over an associative account of causal judgments.     

ALTSim: A MATLAB simulator for current associative learning theories

ALTSim is a MATLAB-based simulator of several associative learning models, including Pearce’s configural model, the extended configural model, the Rescorla-Wagner model, the unique cue hypothesis, the modified unique cue hypothesis, the replaced elements model, and Harris’s elemental model. It allows for specifying all relevant parameters, as well as exact stimulus sequences by graphical user interfaces. It is an easy-to-use tool that facilitates evaluating and comparing the featured associative learning models. ALTSim is available free of charge from www.staff.uni-marburg.de/~lachnit/ALTSim/.     

Predictive and diagnostic learning within causal models: asymmetries in cue competition.

Several researchers have recently claimed that higher order types of learning, such as categorization and causal induction, can be reduced to lower order associative learning. These claims are based in part on reports of cue competition in higher order learning, apparently analogous to blocking in classical conditioning. Three experiments are reported in which subjects had to learn to respond on the basis of cues that were defined either as possible causes of a common effect (predictive learning) or as possible effects of a common cause (diagnostic learning). The results indicate that diagnostic and predictive reasoning, far from being identical as predicted by associationistic models, are not even symmetrical. Although cue competition occurs among multiple possible causes during predictive learning, multiple possible effects need not compete during diagnostic learning. The results favor a causal-model theory.     

Recovery from one-trial overshadowing

Prevailing models of associative learning can all account for multitrial overshadowing. However, they fail to account for one-trial overshadowing, which is ordinarily explained in terms of distraction of the subject by the more salient of two simultaneously trained cues from the less salient cue, which interferes with associative acquisition. In the present study, we demonstrate that recovery from overshadowing can be obtained through two techniques that have previously been found to restore responding to overshadowed cues in multitrial training situations. Specifically, recovery from one-trial overshadowing was obtained by extinguishing the overshadowing stimulus and also by administering a posttraining reminder treatment consisting of brief exposure to the overshadowed cue. The similarity of these observations to those in multitrial overshadowing suggests that one-trial and multitrial overshadowing arise from a common underlying mechanism and further augments the view that all cue competition is due (at least in part) to a failure to express acquired information, rather than to a failure to learn.     

Interaction between preexposure and overshadowing: Further analysis of the extended comparator hypothesis

Three experiments with rats used conditioned suppression of barpress to test predictions of the extended comparator hypothesis, which assumes that the effectiveness of (first-order) comparator stimuli in modulating responding to a target conditioned stimulus (CS) is itself modulated by other (second-order) comparator stimuli. Experiment 1 demonstrated that both pretraining exposure to the target CS alone (i.e., CS-preexposure effect, also known as latent inhibition) and pretraining exposure to a compound of the target CS and nontarget CS (i.e., compound-CS-preexposure effect) counteract overshadowing, and that posttraining deflation (i.e., extinction) of the overshadowing stimulus attenuates responding to the target CS when overshadowing is preceded by a CS-preexposure treatment (i.e., yields a CS-preexposure effect), but not when overshadowing is preceded by a compound-CS-preexposure treatment. Experiment 2 examined the consequences of posttraining associative inflation of the overshadowing stimulus or the preexposure companion stimulus following conjoint compound-CS-preexposure and overshadowing treatment. Experiment 3 examined the consequences of posttraining inflation of the overshadowing stimulus or the context following conjoint CS-alone preexposure and overshadowing treatment. The results support the expression-focused comparator view in contrast to recent acquisition-focused models of retrospective revaluation.     

A comparison between elemental and compound training of cues in retrospective revaluation

Associative learning theories assume that cue interaction and, specifically, retrospective revaluation occur only when the target cue is previously trained in compound with the to-be-revalued cue. However, there are recent demonstrations of retrospective revaluation in the absence of compound training (e.g., Matute & Pine?o, 1998a, 1998b). Nevertheless, it seems reasonable to assume that cue interaction should be stronger when the cues are trained together than when they are trained apart. In two experiments with humans, we directly compared compound and elemental training of cues. The results showed that retrospective revaluation in the elemental condition can be as strong as and, sometimes, stronger than that in the compound condition. This suggests that within-compound associations are not necessary for retrospective revaluation to occur and that these effects can possibly be best understood in the framework of general interference theory.