Conditioned inhibition produced by extinction-mediated recovery from the relative stimulus validity effect: a test of acquisition and performance models of empirical retrospective revaluation

Empirical retrospective revaluation is a phenomenon of Pavlovian conditioning and human causal judgment in which posttraining changes in the conditioned response (Pavlovian task) or causal rating (causal judgment task) of a cue occurs in the absence of further training with that cue. Two experiments tested the contrasting predictions made by 2 families of models concerning retrospective revaluation effects. In a conditioned lick-suppression task, rats were given relative stimulus validity training, consisting of reinforcing a compound of conditioned stimuli (CSs) A and X and nonreinforcement of a compound of CSs B and X, which resulted in low conditioned responding to CS X. Massive posttraining extinction of CS A not only enhanced excitatory responding to CS X, but caused CS B to pass both summation (Experiment 1) and retardation (Experiment 2) tests for conditioned inhibition. The inhibitory status of CS B is predicted by the performance-focused extended comparator hypothesis (J. C. Denniston, H. I. Savastano, & R. R. Miller, 2001), but not by acquisition-focused models of empirical retrospective revaluation (e.g., A. Dickinson & J. Burke, 1996; L. J. Van Hamme & E. A. Wasserman, 1994).     

The 28th Bartlett Memorial Lecture Causal learning: An associative analysis

The concordance between performance and judgements of the causal effectiveness of an instrumental action suggests that such actions are mediated by causal knowledge. Although causal learning exhibits many associative phenomena—blocking, inhibitory or preventative learning, and super-learning—judgements of the causal status of a cue can be changed retrospectively as a result of learning episodes that do not directly involve the cue. In order to explain retrospective revaluation, a modified associative theory is described in which the learning processes for retrieved cue representations are the opposite to those for presented cues, and this theory is evaluated by studies of the role of within-compound associations in retrospective revaluation and blocking. However, this modified theory only applies when the within-compound association represents a contiguous rather than a causal cue relationship.     

Within-compound associations in retrospective revaluation and in direct learning: A challenge for comparator theory

In three human causal learning experiments we investigated the role of within-compound associations in learning about absent cues versus learning about present cues. Different theoretical approaches agree that within-compound associations are essential for learning about absent cues-that is, for retrospective revaluation. They differ, however, with regard to the role of within-compound associations for learning about present cues-that is, for direct learning. A memory test was used to assess within-compound associations. Experiment 1 used a blocking/release from overshadowing design, Experiment 2 used a conditioned inhibition design, and Experiment 3 used a higher-order cue selection design. In all experiments, first-order retrospective revaluation was significantly correlated with within-compound associations, but no significant correlations were found for the direct learning conditions. In addition to this, second-order retrospective revaluation in Experiment 3 was positively correlated to joint knowledge of first-order and second-order within-compound associations. Furthermore, cue selection effects were stronger for direct learning conditions than for retrospective learning conditions. These results are at variance with the comparator hypothesis but are in agreement with a modified associative theory and with the suggestion that retrospective revaluation might be due to rehearsal processes.     

Re-examination of the role of within-compound associations in the retrospective revaluation of causal judgements

We investigated blocking and retrospective revaluation of causal judgements using a scenario in which food cues acted as potential causes of an allergic reaction as the outcome. In the blocking contingency,the treatment cues were either paired or unpaired with the outcome prior to a second stage in which sequential compounds of treatment and target cues were paired with the outcome. The order of this compound and treatment training was reversed in retrospective revaluation contingencies. When the interstimulus interval between the treatment and target cues was unfilled on compound trials (Experiments 1 and 3), both blocking and retrospective revaluation were observed in that the target cue trained in compound with the paired treatment cue attracted lower causal ratings than the target cue trained in compound with the unpaired treatment cue. By contrast, performing a mental arithmetic task using numerals presented during the interstimulus interval had no effect on the magnitude of blocking but rendered retrospective revaluation unreliable (Experiments 2 and 3). These results provide further support for accounts of revaluation based upon within-compound associations.     

Recursive retrospective revaluation of causal judgments

Recursive causal evaluation is an iterative process in which the evaluation of a target cause, T, is based on the outcome of the evaluation of another cause, C, the evaluation of which itself depends on the evaluation of a 3rd cause, D. Retrospective revaluation consists of backward processing of information as indicated by the fact that the evaluation of T is influenced by subsequent information that is not concerned with T directly. Two experiments demonstrate recursive retrospective revaluation with contingency information presented in list format as well as with trial-by-trial acquisition. Existing associative models are unable to predict the results. The model of recursive causal disambiguation that conceptualizes the revaluation as a recursive process of disambiguation predicts the pattern of results correctly.     

Inference-based retrospective revaluation in human causal judgments requires knowledge of within-compound relationships

In an allergist causal-judgment task, food compounds were followed by an allergic reaction (e.g., AB+), and then 1 cue (A) was revalued. Experiment 1, in which participants who were instructed that whatever was true about one element of a causal compound was also true of the other, showed a reverse of the standard retrospective revaluation effect. That is, ratings of B were higher when A was causal (A+) than when A was safe (A-). This effect was taken to reflect inferential reasoning, not an associative mechanism. In Experiment 2, within-compound associations were found to be necessary to produce this inference-based revaluation. Therefore, evidence that within-compound associations are necessary for retrospective revaluation is consistent with the inferential account of causal judgments.     

The role of contextual associations in producing the partial reinforcement acquisition deficit

Three conditioned suppression experiments with rats as subjects assessed the contributions of the conditioned stimulus (CS)-context and context-unconditioned stimulus (US) associations to the degraded stimulus control by the CS that is observed following partial reinforcement relative to continuous reinforcement training. In Experiment 1, posttraining associative deflation (i.e., extinction) of the training context after partial reinforcement restored responding to a level comparable to the one produced by continuous reinforcement. In Experiment 2, posttraining associative inflation of the context (achieved by administering unsignaled outcome presentations in the context) enhanced the detrimental effect of partial reinforcement. Experiment 3 found that the training context must be an effective competitor to produce the partial reinforcement acquisition deficit. When the context was down-modulated, the target regained behavioral control thereby demonstrating higher-order retrospective revaluation. The results are discussed in terms of retrospective revaluation, and are used to contrast the predictions of a performance-focused model with those of an acquisition-focused model.     

Simultaneous backward conditioned inhibition and mediated conditioning

Demonstrations of retrospective revaluation suggest that remembered stimuli undergo a reduction in association with the unconditioned stimulus (US) present during learning. Conversely, demonstrations of mediated conditioning in flavor-conditioning experiments with rats suggest that remembered stimuli undergo an increase in association with the US present during learning. In a food allergy prediction task with 23 undergraduates, we demonstrated simultaneous backward conditioned inhibition and mediated conditioning effects. These results are compatible with the hypothesis that the direction of change (decrease or increase) in associative strength depends on whether the remembered stimulus was of a different category (conditioned stimulus/antecedent) or the same category (US/outcome) as the presented US.     

The power of causal beliefs and conflicting evidence on causal judgments and decision making

In two experiments, we investigated the relative impact of causal beliefs and empirical evidence on both decision making and causal judgments, and whether this relative impact could be altered by previous experience. Participants had to decide which of two alternatives would attain a higher outcome on the basis of four cues. After completing the decision task, they were asked to estimate to what extent each cue was a reliable cause of the outcome. Participants were provided with instructions that causally related two of the cues to the outcome, whereas they received neutral information about the other two cues. Two of the four cues—a causal and a neutral cue—had high validity and were both generative. The remaining two cues had low validity, and were generative in Experiment 1, but almost not related to the outcome in Experiment 2. Selected groups of participants in both experiments received pre-training with either causal or neutral cues, or no pre-training was provided. Results revealed that the impact of causal beliefs and empirical evidence depends on both the experienced pre-training and cue validity. When all cues were generative and participants received pre-training with causal cues, they mostly relied on their causal beliefs, whereas they relied on empirical evidence when they received pre-training with neutral cues. In contrast, when some of the cues were almost not related to the outcome, participants’ responses were primarily influenced by validity and—to a lesser extent—by causal beliefs. In either case, however, the influence of causal beliefs was higher in causal judgments than in decision making. While current theoretical approaches in causal learning focus either on the effect of causal beliefs or empirical evidence, the present research shows that both factors are required to explain the flexibility involved in human inferences.     

Aging and retrospective revaluation of causal learning

In a 2-stage causal learning task, young and older participants first learned which foods presented in compound were followed by an allergic reaction (e.g., STEAK-BEANS→ REACTION) and then the causal efficacy of 1 food from these compounds was revalued (e.g., BEANS→ NO REACTION). In Experiment 1, unrelated food pairs were used, and although there were no age differences in compound- or single-cue-outcome learning, older adults did not retrospectively revalue the causal efficacy of the absent target cues (e.g., STEAK). However, they had weaker within-compound associations for the unrelated foods, and this may have prevented them from retrieving the representations of these cues. In Experiment 2, older adults still showed no retrospective revaluation of absent cues even though compound food cues with pre-existing associations were used (e.g., STEAK-POTATO), and they received additional learning trials. Finally, in Experiment 3, older adults revalued the causal efficacy of the target cues when small, unobtrusive icons of these cues were present during single-cue revaluation. These findings suggest that age-related deficits in causal learning for absent cues are due to ineffective associative binding and reactivation processes.     

Prevention of the degraded-contingency effect by signalling training trials

Presentation of unsignalled unconditioned stimuli (USs) interspersed among Pavlovian excitatory conditioning trials weakens conditioned responding to a target conditioned stimulus (CS; Rescorla, 1968). However, signalling these intertrial USs with another cue (a cover stimulus) has been shown to alleviate this degraded-contingency effect (e.g. Durlach, 1982, 1983). In contrast to signalling the inter-trial USs, the present experiments examined the effect on the degraded-contingency effect of signalling the target CS-US pairings. Experiment 1, using parameters selected to avoid overshadowing, found that consistently presenting a cover stimulus immediately prior to the target CS-US pairings during degraded-contingency training alleviated the degraded-contingency effect. Experiment 2 examined the underlying mechanism responsible for this cover-stimulus effect through posttraining associative inflation of the cover stimulus or the context, and found that inflation of the cover stimulus attenuated responding to the target CS (i.e. empirical retrospective revaluation). The results are discussed in terms of various acquisition- and expression-focused models of acquired responding.     

Higher-order retrospective revaluation in human causal learning

Previous studies demonstrated that participants will retrospectively adjust their ratings about the relation between a target cue and an outcome on the basis of information about the causal status of a competing cue that was previously paired with the target cue. We demonstrate that such retrospective revaluation effects occur not only for target cues with which the competing cue was associated directly, but also for target cues that were associated indirectly with the competing cue. These second-order and third-order retrospective revaluation effects are compatible with certain implementations of the probabilistic contrast model and with a modified, extended comparator model, but cannot be explained on the basis of a revised Rescorla-Wagner model or a revised SOP model.     

The effect of UCS inflation and deflation procedures on 'fear' conditioning

Davey (1992: Classical conditioning and the acquisition of human fears and phobias: a review and synthesis of the literature. Advances in Behaviour Research and Therapy, 14, 29-66) hypothesized that subjective revaluation of an unconditioned stimulus (UCS) would determine the strength of the autonomic conditioned response (CR) in the fear conditioning paradigm. The purpose of the present study was to examine the effect of UCS aversiveness on the CR strength in the fear conditioning paradigm. The UCS aversiveness was controlled by the UCS intensity; that is, the UCS intensity was increased for the inflation group or decreased for the deflation group. Thirty subjects were randomly assigned to the inflation or the deflation group, and they participated under both experimental and control conditions. All subjects went through the pretest, the acquisition of classical conditioning, the UCS intensity operation, and the test sessions. The indices of the CR were skin conductance responses (SCRs) and a subjective aversion to the conditioned stimulus (CS). The main results were as follows. (1) The CR strength measured by SCR was increased by the UCS inflation and decreased by the UCS deflation. (2) The subjective aversiveness of the CS was not sensitive to both manipulations of UCS intensity. These results suggested that the autonomic CR strength might be influenced by the subjective revaluation of UCS, as Davey (1992) described. The result from the test of the subjective aversiveness of the CS, however, could not support Davey's model. The difference between expressions of the SCR and the subjective aversiveness of the CS might be caused by different learning systems.     

Impact of anticipatory processing versus distraction on multiple indices of anxiety in socially anxious individuals

In models of social phobia, anticipatory processing before a social-evaluative event is a key maintaining factor for the disorder. This study investigated the impact of anticipatory processing versus distraction before a social-evaluative task on affective (self-reported anxiety), psychophysiological (skin conductance), cognitive (self-reported maladaptive self-beliefs) and behavioural (in-situation performance) responses of participants. High and low socially anxious undergraduates were randomly allocated to either an anticipatory processing or distraction condition, and then completed an impromptu speech task. Relative to distraction, anticipatory processing increased self-reported anxiety in all participants, and increased skin conductance and the strength of conditional and high standard beliefs in the high (but not low) socially anxious participants. Unconditional beliefs were not affected. For high socially anxious individuals, anticipatory processing was also indirectly associated with poorer speech performance by increasing self-reported anxiety. Anticipatory processing appears to have multiple adverse effects in socially anxious individuals.     

Associative history affects the associative change undergone by both presented and absent cues in human causal learning

R. A. Rescorla (2000) noted that a number of influential theories of associative learning do not take the associative history of cues (i.e., the prior training that they have received) into account when calculating the associative change undergone by those cues. The authors tested this assumption in a human causal learning paradigm and found associative history to be an important determinant of the learning undergone by cues that are presented on a trial. Moreover, associative history was also found to influence the amount of retrospective revaluation undergone by absent cues. These findings conflict with models of causal learning in which the associative change undergone by an element of a cue compound is governed by a summed error term (e.g., R. A. Rescorla & A. R. Wagner, 1972).     

Excitatory strength of expressive faces: effects of happy and fear expressions and context on the extinction of a conditioned fear response

In a recent study, Orr and Lanzetta (1984) showed that the excitatory properties of fear facial expressions previously described (Lanzetta & Orr, 1981; Orr & Lanzetta, 1980) do not depend on associative mechanisms; even in the absence of reinforcement, fear faces intensify the emotional reaction to a previously conditioned stimulus and disrupt extinction of an acquired fear response. In conjunction with the findings on acquisition, the failure to obtain extinction suggests that fear faces have some of the functional properties of "prepared" (fear-relevant) stimuli. In the present study we compared the magnitude of conditioned fear responses to happy and fear faces when a potent danger signal, the shock electrodes, are attached or unattached. If fear faces are functionally analogous to prepared stimuli, then, even in the absence of veridical support for an expectation of shock, they should retain excitatory strength, whereas happy faces should not. The results are consistent with this view of fear expressions. In the absence of reinforcement, and with shock electrodes removed, conditioned fear responses and basal levels of arousal were of greater magnitude for the fear-face condition than for the happy-face condition.     

Backward Blocking and Recovery from Overshadowing in Human Causal Judgement: The Role of Within-compound Associations

We replicated and extended a project by Dickinson and Burke (1996) that concerned human causal judgement. In a medical diagnostic setting, college students' ratings of the causal efficacy of target cues showed retrospective revaluation: relative to a proper control condition, ratings of target cues both increased ('recovery from overshadowing') and decreased ('backward blocking') during a second stage of training in which competing cues, but not target cues, were presented. These changes in causal judgements were exhibited only by subjects who had learned which target and competing cues were paired with one another during the first stage of training. These results cannot be explained by the Rescorla-Wagner (1972) model of associative learning, but they can be explained by the revised model of Van Hamme and Wasserman (1994); the revised model assigns non-zero salience to nonpresented target stimuli whose memories or representations are retrieved by competing stimuli that had previously been paired with those target stimuli.     

The comparator theory fails to account for the selective role of within-compound associations in cue-selection effects

In a human causal learning experiment, we investigated cue selection effects to test the comparator theory (Denniston, Savastano, & Miller, 2001; Miller & Matzel, 1988). The theory predicts that the occurrence of cue selection is independent of whether the relevant learning trials are presented in a standard forward manner or in a backward manner and that within-compound associations are of equal importance in both cases. We found that the strength of the cue-selection effect was positively correlated with knowledge of within-compound associations in the backward condition but not in the forward condition. Furthermore, cue-selection effects were less pronounced in the former than in the latter condition. These results are at variance with the comparator hypothesis but are in agreement with a modified associative theory and with the suggestion that retrospective revaluation might be due to rehearsal processes.     

The role of anxiety sensitivity in subjective and physiological responses to social and physical stressors

This study examined the specificity of the relationship between anxiety sensitivity (AS), a measure of catastrophizing about arousal-related sensations, and pain responses, by examining the effect of AS on responses to stressors of a physical and social nature. Healthy men and women (n = 129) between the ages of 18 and 25 years were recruited from the community to participate in a study examining subjective, cognitive and behavioural responses to different types of stressors. Participants were randomly assigned to one of 3 groups: (i) a neutral condition in which they sat quietly and read a popular magazine; (ii) a social stress condition in which they anticipated having to give a self-disclosing speech; and (iii) a physical stress condition in which they were presented with 3 countdown to shock trials where a mild electrical shock was administered on the non-dominant arm. Subjective ratings and physiological responses were recorded in anticipation of the stressor and immediately after stress exposure. Results indicated that AS was indirectly related to pain ratings via its effect on anticipatory anxiety ratings. AS was associated with anticipatory anxiety ratings, regardless of whether the stressor was of a physical or social nature. Furthermore, AS was not shown to be directly associated with exaggerated subjective or physiological reactions to the physical stressor. These results indicate that the role of AS in pain responses may be mediated through a global effect on anxiety, and limited to the anticipatory stage of the pain experience. If future studies yield similar findings in pain patients, then they would suggest that interventions for helping individuals high in AS should focus on catastrophic thinking in anticipation of stressors in general, rather than on pain-specific stressors.