Blocking as a retrieval failure: Reactivation of associations to a blocked stimulus

Conditioned lick suppression in rats was used to examine the effectiveness of three different “reminder” treatments in reactivating associations to a blocked stimulus in a Kamin blocking paradigm. Experiment I indicated that with our parameters prior tone-footshock pairings could block manifestation of a light-footshock association that would otherwise be evident following pairings of a light-tone compound stimulus with footshock. In Experiment II, exposure to either the US, the blocked stimulus (light), or the apparatus cues between the compound conditioning trials and testing decreased blocking. Experiments III(a) and III(b) replicated the unblocking effects seen in Experiment II and included control groups that received the identical training and reminder treatments except for the omission of the light from the compound stimulus. These latter animals failed to display behaviour comparable to the blocked and reminded subjects, thereby establishing the associative basis of suppression to the light in the animals reminded following treatment known to produce blocking. Experiment IV also replicated the results of Experiment II and included control groups that received identical light-tone compound trials and reminder treatments without prior conditioning to the tone alone. In these control groups, reminder treatments tended to disrupt rather than increase evidence of conditioning to the light. The results suggest that associations are formed to the added element of a compound despite prior conditioning to the initial element, and that failure on the test trial to retrieve these associations to the blocked CS, rather than a failure to attend to or learn about the added element, is at least in part responsible the Kamin blocking effect.     

Variations in the sensitivity of instrumental responding to reinforcer devaluation

In five experiments hungry rats were trained to make a lever press response for a sucrose reinforcer. That sucrose was subsequently devalued by conditioning a food-aversion to it, and the ability of the rats to integrate knowledge about the instrumental contingency with that gained from aversion training was assessed in an extinction test. Experiment I showed successful integration following limited but not extended instrumental training. Experiment II suggested that the crucial factor was the spacing of training; successful integration was seen after massed but not distributed training. The third experiment implicated distributed experience with the reinforcer, rather than distributed response practice, in failures of integration. Experiment IV showed that if the distribution of food-aversion learning was dissimilar to that of instrumental training then a failure of integration could result; this finding was able to account for the distribution of training effects seen in previous studies, but not the effect of extended training. Experiment V replicated the extended training effect seen in Experiment I, and provided evidence that this may reflect the degree of exposure to the reinforcer rather than the extent of response practice.     

Differential effects of two ways of devaluing the unconditioned stimulus after Pavlovian appetitive conditioning

Three experiments with rat subjects investigated the effects of two methods of devaluing a food unconditioned stimulus (US) after pairings of an auditory conditioned stimulus (CS) with that US. Experiment 1 found no effect of postconditioning pairings of the food US with lithium chloride (LiCl) on general activity to a tone CS, even though those pairings substantially reduced food consumption. Experiments 2 and 3 compared the effects on conditioned responding of postconditioning pairings of food with LiCl and with high-speed rotation. In these experiments the general activity measure was supplemented by a detailed visual analysis of the rats' behavior. Experiment 2 found that food-rotation pairings had larger effects than food-LiCl pairings on general activity responding and on two detailed behavioral measures but that food-LiCl pairings had larger effects on food consumption and on one behavioral measure. Experiment 3 replicated the findings of Experiment 2 and found that the ability of the CS to serve as a reinforcer for second-order conditioning after US devaluation was reduced more by food-LiCl pairings.     

Signalling and incentive processes in instrumental reinforcer devaluation

We have previously reported that conditioning an aversion to the reinforcer using an isotonic lithium chloride (LiCl) solution following instrumental training reduces performance in a subsequent extinction test only if animals are re-exposed to the reinforcer prior to the test. Rescorla (1992), in contrast, reported an immediate devaluation effect using a hypertonic LiCl solution that did not depend upon re-exposure. In two experiments we examined the effect of using a hypertonic LiCl solution to condition the aversion to the reinforcer on subsequent instrumental performance in extinction, with and without re-exposure. In Experiment 1 thirsty rats were trained to press a lever for a sucrose solution before being injected with 0.6 M LiCl either immediately or after a delay. Half of the immediate and delay groups were then re-exposed to the sucrose in the absence of the lever, with the remainder being exposed to water. Contrary to the previously reported effects of isotonic LiCl, a hypertonic solution induced a reinforcer devaluation effect in all the immediately poisoned animals, which did not depend upon re-exposure to the reinforcer. In Experiment 2 the possibility that this devaluation effect was induced by the discomfort associated with the hypertonicity of the solution was assessed by replicating Experiment 1 but, in addition, using two immediately poisoned groups given the LiCl injection under anaesthesia. In the absence of anaesthesia, the devaluation effect observed without re-exposure to the reinforcer in Experiment 1 was replicated. When the injection was given under anaesthesia, however, a reinforcer devaluation effect was observed only in animals that were re-exposed to the reinforcer prior to the extinction test. These results were interpreted as evidence that a reinforcer devaluation effect induced by pairing the reinforcer with illness depends upon a process of incentive learning, whereas a devaluation effect mediated by learning a signalling relationship between the reinforcer and somatic discomfort does not.     

Post-trial stimulation and the acquisition of conditioned suppression in the rat

Three experiments investigated the effect of post-trial stimulation on conditioning. Rats were trained in a conditioned suppression procedure in which only half of the CS presentations were followed immediately by a shock reinforcer. Presenting a second, post-trial, shock 8 s after the end of reinforced CS presentations increased resistance to extinction in Experiment I and facilitated conditioning in Experiment II relative to a condition in which the same post-trial shock was delivered 8 s after non-reinforced trials. Experiment III demonstrated that prior exposure to pairings of the shock reinforcer and the post-trial shock also enhanced subsequent conditioning, and thus ruled out an explanation of the facilitation in terms of the surprising nature of the post-trial stimulation.     

Some conditions affecting the choice to cooperate or compete

Three experiments investigated conditions affecting the choice to cooperate or compete. Experiment I compared the effects first of an individual activity, then of a competitive task as an alternative to cooperation. For both comparisons, subjects could earn more by cooperating. Choice of competition, but not individual activity, was found to depend on the task choice contingencies. Competition predominated when both subjects could compete if either or both chose competition. Previously competitive pairs cooperated when both subjects could cooperate if either or both chose cooperation. Experiment II investigated the effects of differences in magnitude of the reinforcers for cooperating or competing. Choice between the two alternatives was manipulated in all pairs by varying reinforcer difference. Competition was chosen over cooperation only within the limits within which competition was potentially profitable. Experiment III replicated the findings of Experiment II using triads. Subjects in triads, however, were more likely to withdraw from the experiment. Thus, the data for pairs and triads suggest an orderly relation between reinforcer difference for cooperating or competing and task choice. Motivation of subjects to maximize relative gain by competing can be overridden by moderate reinforcer differences favoring cooperation.     

The effect of vicarious punishment on prosocial behavior in children

Two experiments are reported dealing with the effects of vicarious punishment on prosocial behavior. In Experiment I, first and second grade females who witnessed a peer model being punished for a refusal to share (“nonsharing, punished”), shared more than an appropriate control group. Sharing was similarly heightened, however, in a group who witnessed punishment to the model which was not contingent upon any specific behavior (“punishment only”). Experiment II tested and confirmed the hypothesis derived from Experiment I that noncontingent vicarious punishment has a generalized inhibitory effect on antisocial behaviors. First, second, and third grade females were shown either the “nonsharing, punished,” “punishment only,” or baseline videotapes used in Experiment I. Subsequent to viewing the tapes, subjects in the “punishment only” condition helped the experimenter significantly more than did subjects in the “nonsharing, punished” and baseline conditions. The ability of existing theoretical treatments of vicarious punishment to account for these results is questioned.     

Blocking and sensory preconditioning effects in morphine analgesic tolerance: Support for a pavlovian conditioning model of drug tolerance

Two experiments on rats tested predictions of a Pavlovian conditioning model of drug tolerance which holds that tolerance is the result of compensatory conditioned responses, developed to environmental stimuli accompanying the drug administrations, which attenuate the direct effects of the drug. In Experiment I, the acquisition of tolerance-modulating properties by the tone component of a tone-light compound stimulus which accompanied morphine administrations was reduced by prior light-morphine pairings (blocking). In Experiment II, a tone stimulus acquired tolerance-modulating properties through prior pairings with a light stimulus which later accompanied morphine administrations (sensory preconditioning). These findings are uniquely predicted by the Pavlovian conditioning model of drug tolerance and are incompatible with traditional theories which assign no role to environmental stimuli present at the time of drug administration.     

Locus of the effect of a surprising reinforcer in the attenuation of blocking

Previous experiments on conditioned suppression in rats have shown that prior conditioning to one element of a compound conditioned stimulus paired with shock may block or prevent conditioning to the other element. Reliable conditioning may, however, occur to the added element (blocking may be attenuated), if a surprising second shock is added shortly after each compound trial. Experiment I confirmed this finding, and further showed that blocking was attenuated only when the second shock occurred 10 s after the compound trial, not when it occurred 100 s later. Experiment II showed that the surprising omission of an expected second shock 10 s after each compound trial would also attenuate blocking, thus implying that the surprising event does not itself act to reinforce conditioning to the added element, but rather permits the unconditioned stimulus (the first shock) to play its normal role as an effective reinforcer. This conclusion was confirmed by Experiment III, which showed that a surprising second shock does not produce any increase in conditioning to the added element on the trial on which it occurs; rather it serves to ensure adequate conditioning to that element on a subsequent compound trial. The implication is that the surprising event acts proactively to prevent subjects learning to ignore an otherwise redundant stimulus.     

Reversibility of single-incentive selective associations.

Rats were trained to press a lever in the presence of a tone-light compound stimulus and not to press in its absence. In each of two experiments, schedules were designed to make the compound a conditioned punisher for one group and a conditioned reinforcer for the other. In Experiment 1, one group's responding produced food in the presence of the compound but not in its absence. The other group's responding terminated the compound stimulus, and food was presented only in its absence. When tone and light were later presented separately, light controlled more responding than did tone in the former group, but tone gained substantial control in the latter. The same effects were also observed within subjects when the training schedules were switched over groups. In Experiment 2, two groups avoided shock in the presence of the compound stimulus. In the absence of the compound, one group was not shocked, and the other received both response-independent and response-produced shock. When tone and light were presented separately, the former group's responding was mainly controlled by tone, but the latter group's responding was almost exclusively controlled by light. These effects were also observed within subjects when the training schedules were switched over groups. Thus, these single-incentive selective association effects (appetitive in Experiment 1 and aversive in Experiment 2) were completely reversible. The schedules in which the compound should have been a conditioned reinforcer consistently produced visual control, and auditory control increased when the compound should have become a conditioned punisher. Currently accepted accounts of selective associations based on affinities between shock and auditory stimuli and between food and visual stimuli (i.e., stimulus-reinforcer interactions) do not adequately address these results. The contingencies of reinforcement most recently associated with the compound and with its absence, rather than the nature of the reinforcer, determined whether auditory or visual stimulus control developed.     

Second-order conditioning with diffuse auditory reinforcers in the pigeon

Pigeon subjects were used in five experiments investigating second-order conditioning with visual second-order and diffuse auditory first-order stimuli. Experiment 1 used a discriminative conditioning procedure to demonstrate reliable and substantial second-order conditioning with these stimuli. In Experiments 2 and 3, extinction of the auditory first-order stimulus after second-order conditioning had little effect upon responding to the second-order stimulus, when compared to a stimulus whose reinforcer was maintained. Experiment 4 compared directly the susceptibility of second-order responding to extinction of the first-order reinforcing stimulus as a function of the modality of that reinforcer. When a visual second-order stimulus was paired with a visual reinforcer, and the response to the latter was extinguished, then second-order responding was greatly reduced relative to control levels. In contrast, when that reinforcer was an auditory stimulus, second-order responding was not affected by the current value of the first-order stimulus after conditioning. Finally, in Experiment 5 the auditory stimulus was established as a reinforcer through discriminative-operant training. Following second-order conditioning, extinction of responding to this stimulus again had little impact upon responding to the second-order stimulus with which it had been paired. These results are discussed in terms of previous work on second-order conditioning with rat and pigeon subjects.     

One-trial overshadowing

Two experiments on conditioned suppression in rats examined the extent to which conditioning to a tone was overshadowed by the presence of a light. When animals received four conditioning trials, a light of moderate intensity significantly overshadowed the tone. On the first trial of conditioning, however, the light had no effect on conditioning to the tone, unless (Experiment I) its intensity was increased, or (Experiment II) it occurred in closer temporal contiguity to reinforcement than the tone. The results establish that overshadowing can occur on the first trial of conditioning, contrary to the predictions of several theories, but suggest that this may be for different reasons from those operating to produce overshadowing over a series of conditioning trials.     

Studies in observational paired-associate learning: Informational,social, and individual difference variables

Four experiments examined the relative importance of informational (proportion of correct responses and kinds of errors emitted by a model), social (model competency, sex of model, video vs. audio taped model), and individual difference (sex of subject, grade) variables in observational paired-associate learning. In Experiments I–III, vicarious subjects received cycles of study-model-test trials, while direct subjects were given the same sequences with intervening test or stimulus familiarization trials. In Experiment IV, vicarious subjects received cycles of study-test-model-test trials, while direct subjects received the cycles with a test trial replacing the model trial. No confirmation was provided on test and model trials. Whereas the effects attributable to social and individual difference variables were generally negligible, mere accuracy of the model's responses repeatedly covaried with performance on the last test trial of each cycle. Conditional analyses established that (1) vicarious facilitation is comparable across cycles and localized in items responded to incorrectly on immediately preceding test trials, and (2) observers learn fewer incorrect than correct model responses. Vicarious groups performed at reliably higher levels than direct subjects on model correct but not incorrect items. The results strongly suggest a close correspondence between direct and vicarious verbal learning principles and mechanisms.     

Context specificity of conditioning and latent inhibition: Evidence for a dissociation of latent inhibition and associative interference

Conditioning may generalize from one context to another when latent inhibition (the effect on subsequent conditioning of prior unreinforced exposure to the stimulus) does not. Experiment 1 studied conditioned approach and licking by rats to a stimulus paired with the delivery of water and confirmed that latent inhibition could be abolished by a change of context, while prior aversive conditioning to the stimulus, produced by pairing it with mild shock, interfered with the acquisition of conditioned approach and licking regardless of this change of context. Thus even when conditioning and latent inhibition were measured in the same way, the former generalized across contexts, and the latter did not. Experiment 2 showed that the effects not only of unreinforced exposure to a stimulus but also of presentation of the stimulus uncorrelated with the delivery of water were confined to the context in which they occurred. Thus the generalization of conditioning from one context to another and the failure of latent inhibition to generalize cannot be attributed to the occurrence of rein-forcers during conditioning and their absence in latent inhibition. This conclusion was confirmed in Experiment 3, where animals received both aversive conditioning trials and unreinforced presentations of other stimuli in the treatment phase of the experiment, but were then conditioned to one of these stimuli paired with water. Once again, the effects of aversive conditioning transferred perfectly from one context to another, while those of unreinforced presentations did not. Latent inhibition, these results suggest, is not easily explained by supposing that animals associate an unreinforced stimulus with zero consequences and have to unlearn this association when the stimulus is then paired with a reinforcer.     

Differentiation between vicarious instigation and classical conditioning of electrodermal responses

In past research of vicarious conditioning when a conditioned stimulus (CS) was repeatedly presented both to a model and an observer, the observer's reaction to the CS may have been the result of a vicariously conditioned reaction to the CS, as well as a vicariously instigated reaction to the inferred emotional state of the model who anticipates the reception of a noxious stimulus when the CS is presented. In order to partial out these two reactions, the present experiment employed 32 subjects of both sexes who took part in a two-group study of differential, vicarious classical conditioning of skin conductance responses. In one of the group, the tones serving as CS+ and CS- and which preceded the aversive and non aversive events to the mode, were presented over earphones to both the confederate model and the observer subject. In the second group, only the subjects had earphones on and were led to believe that the model was not aware of the CS presentations. This eliminated the possibility of vicariously instigated reactions. Although the conditioning effects produced in the present study were somewhat weak, results clearly showed equal levels of vicarious instigation and conditioning in the two groups. These results indicate that the potential confounding of these two reactions studies has not significantly affected result or conclusions from previous studies.     

The effect of reinforcement differences on choice and response distribution during stimulus compounding

In Experiments I and II, rats were trained to respond on one lever during light and another during tone. The absence of tone and light controlled response cessation. In the multiple schedule of Experiment I, all reinforcements were received for responding in tone or light; in the chain schedule of Experiment II, all reinforcements were received in no tone + no light for not responding. Experiment I subjects, for which tone and light were associated with response and reinforcement increase, responded significantly more to tone-plus-light than to tone or light alone (additive summation). Experiment II subjects, for which tone and light were associated with response increase and reinforcement decrease, responded comparably to tone, light, and tone + light. Thus, additive summation was observed when stimulus-response and stimulus-reinforcer associations in tone and light were both positive, but not when they were conflicting. All subjects in both experiments responded predominantly on the light-correlated lever during tone + light, even when light intensity was reduced in testing. Furthermore, when a light was presented to a subject engaged in tone-associated responding, all subjects immediately switched the locus of responding to the light-correlated lever. No change in locus occurred when a tone was presented to a subject engaged in light-associated responding, irrespective of the stimulus-reinforcer association conditioned to tone. The light-lever preference in tone + light indicates that the heightened responding observed in Experiment I was not the summation of tone-associated behavior with light-associated behavior. Rather, it appears to be the result of a facilitation of one operant (light-associated responding) by the reinforcement-associated cue for the other.     

Potentiation by a novel flavour of conditioned place aversions based on both toxicosis and shock

Three experiments examined how a flavour modified the development of aversions to the place in which it was presented and paired with a reinforcer. Experiment 1 confirmed the cue-to-consequence effect: rats made sick after exposure to a flavour in a novel place (Skinner boxes) displayed stronger aversions than shocked animals when they were presented with the flavour in a second, familiar place; rats shocked after exposure to water acquired stronger place aversions than animals made sick. Experiment 2 confirmed the potentiation effect: rats made sick after exposure to the flavour developed stronger place aversions than those made sick after ingestion of water. This experiment also revealed that rats shocked after exposure to the flavour likewise acquired stronger place aversions than the animals shocked after ingestion of water. Experiment 3 replicated this flavour potentiation of place aversions based on shock. The results are not consistent with Garcia, Lasiter, Bermudez-Rottoni, & Deems' (1985) account of how a flavour interacts with an aversive reinforcer to modify what is learned about its associates in a compound.     

The outcome specificity of learned predictiveness effects: parallels between human causal learning and animal conditioning

Two experiments examined the outcome specificity of a learned predictiveness effect in human causal learning. Experiment 1 indicated that prior experience of a cue-outcome relation modulates learning about that cue with respect to a different outcome from the same affective class but not with respect to an outcome from a different affective class. Experiment 2 ruled out an interpretation of this effect in terms of context specificity. These results indicate that learned predictiveness effects in human causal learning index an associability that is specific to a particular class of outcomes. Moreover, they mirror demonstrations of the reinforcer specificity of analogous effects in animal conditioning, supporting the suggestion that, under some circumstances, human causal learning and animal conditioning reflect the operation of common associative mechanisms.     

Conditioned approach and withdrawal behavior in pigeons: Effects of a novel extraneous stimulus during acquisition and extinction

Three experiments examined the effects of complete removal of reinforcement and of the introduction of a novel stimulus on conditioned approach and withdrawal behavior exhibited by pigeons in an autoshaping paradigm. Experiment 1 indicated that complete omission of food from the experimental situation resulted in the gradual disappearance of both approach and withdrawal behavior in subjects that had received either explicitly paired or explicitly unpaired conditioning. Subsequent presentation of a novel visual stimulus reinstated both approach and withdrawal. Experiment 2 replicated these findings in a within-subjects, discriminative paradigm. In Experiment 3, presenting the novel visual stimulus during acquisition when approach and withdrawal behaviors were asymptotic did not produce significant disruption of performance. These data suggest that removal of reinforcement leads to the disappearance of withdrawal as well as approach performance, and that subsequent presentation of a novel stimulys reinstates whatever behavior was dominant prior to extinction—a finding that seems analogous to results of experiments concerning proactive interference.     

Dogmatism, field dependence, and perception of demand characteristics in a verbal operant conditioning experiment

Using a 2 × 2 analysis of variance design, effects of dogmatism and field dependence on subjects' awareness of demand characteristics in a verbal operant conditioning experiment were investigated. From 103 introductory psychology students who participated in a replication of an earlier verbal conditioning experiment, 92 were randomly selected for final study. It was found that only subjects aware of the purpose of the conditioning study appeared to “condition”. Subject awareness was assessed by a series of converging questions which were independently content analyzed by two judges and coded to yield a total awareness score. Based on earlier research it was expected that dogmatism and field dependence would interact to affect levels of awareness. The two-way interaction was statistically significant (p < .05) as predicted. The results were discussed in terms of speculations regarding the modes of perceptual functioning involved in perceiving demand cues.