Reversibility of single-incentive selective associations.

Rats were trained to press a lever in the presence of a tone-light compound stimulus and not to press in its absence. In each of two experiments, schedules were designed to make the compound a conditioned punisher for one group and a conditioned reinforcer for the other. In Experiment 1, one group's responding produced food in the presence of the compound but not in its absence. The other group's responding terminated the compound stimulus, and food was presented only in its absence. When tone and light were later presented separately, light controlled more responding than did tone in the former group, but tone gained substantial control in the latter. The same effects were also observed within subjects when the training schedules were switched over groups. In Experiment 2, two groups avoided shock in the presence of the compound stimulus. In the absence of the compound, one group was not shocked, and the other received both response-independent and response-produced shock. When tone and light were presented separately, the former group's responding was mainly controlled by tone, but the latter group's responding was almost exclusively controlled by light. These effects were also observed within subjects when the training schedules were switched over groups. Thus, these single-incentive selective association effects (appetitive in Experiment 1 and aversive in Experiment 2) were completely reversible. The schedules in which the compound should have been a conditioned reinforcer consistently produced visual control, and auditory control increased when the compound should have become a conditioned punisher. Currently accepted accounts of selective associations based on affinities between shock and auditory stimuli and between food and visual stimuli (i.e., stimulus-reinforcer interactions) do not adequately address these results. The contingencies of reinforcement most recently associated with the compound and with its absence, rather than the nature of the reinforcer, determined whether auditory or visual stimulus control developed.     

Control of instrumental behavior by deprivation stimuli

In Experiment 1, rats were given one trial per day in a straight alley under food deprivation on half of the trials and under water deprivation on the other half. Wet mash was available in the goal box under food deprivation for Group H and under water deprivation for Group T, the other deprivation being nonrewarded for each group. After 15--18 trials both groups ran significantly faster on their rewarded than on their nonrewarded deprivation days. A third group showed that random variation of alley color retarded formation of the discrimination. A fourth group was run in a conditional discrimination in which under food deprivation wet mash was available in a black alley, nonreward in a white alley, and vice versa under water deprivation. This group took 114 trials to begin running significantly faster in their rewarded than in their nonrewarded alley under each deprivation. In Experiment 2, it was shown that prior learning about deprivation cues "blocks" learning about alley color when alley color is subsequently presented in compound with the deprivation cue but that when both alley color and deprivation cues are relevant from the start of training, the rat learns about both cues. It is suggested that previous studies have underestimated the importance of deprivation cues by using conditional discrimination designs, choice measures rather than speeds, and parameters that are not optimal for discrimination learning.     

Contextual conditional discriminations

Three experiments used a discriminated operant procedure to study conditional discrimination learning in rats. The first experiment showed that rats were capable of learning a biconditional discrimination in which two contexts served as conditional cues signalling the reinforcement contingencies associated with two discriminative stimuli. The discrimination was learned equally well when one discriminative stimulus signalled food, the other its absence, and when one stimulus signalled food, the other extinction plus mild footshock.

In Experiment 2 it was shown that prior training on such a conditional discrimination enhanced the subsequent context specificity of simple conditioning relative to control groups of animals for whom the prior training had not been conditional. Experiment 3 showed that a reversal of the significance of one pair of discriminative stimuli produced no spontaneous reversal in performance to a second, target, pair.

The pattern of results is best accounted for by an analysis of contextual conditional discrimination learning in terms of stimulus configurations and offers no support for the notion that rats may learn a general conditional rule or set.     

DOES CONDITIONAL DISCRIMINATION LEARNING BY PIGEONS NECESSARILY INVOLVE HIERARCHICAL RELATIONSHIPS?

Four experiments demonstrate that when putative conditional and discriminative cues are presented simultaneously in the single reversal procedure, it is not possible to ascribe a uniquely conditional or uniquely discriminative function to either of the cues. In Experiment 1, pigeons were trained to respond to a blue key and not to a red key while the houselight was on; then in a different session they learned the reversal of this discrimination with the houselight off (single reversal). Separate groups were tested for color generalization with houselight conditions alternating in blocks of trials or for houselight intensity generalization with blue and red key colors alternating in blocks of trials. Both test procedures revealed a conditional relationship between houselight and key color conditions. Experiment 2 produced the same result following training in which the key colors were held constant across training sessions while the houselight and no houselight conditions varied within sessions. In Experiment 3, separate groups were trained with the two procedures but were tested with randomly ordered combinations of key colors and houselight intensities. The two groups yielded indistinguishable bidimensional generalization gradients with peaks at both previously reinforced stimulus combinations. In Experiment 4 the subjects were switched from one of these training procedures to the other with no decrement in their discriminative performance. We conclude that for successive discriminations between conditional- and discriminative-stimulus combinations, the notion of a hierarchical relation between conditional and discriminative stimuli must be extended to include a symmetrical relationship or the notion should be abandoned altogether.     

Modulation of a conditioned eyeblink response by a putative emotive stimulus conditioned with hindleg shock

Two experiments with rabbits showed that the differential modulation of a conditioned eyeblink response (CR) by 30-s auditory stimuli previously paired with shock was independent of the locus of shock application. In Experiment 1, the modulation occurred when the CR was trained with paraorbital shock and the 30-s stimuli were trained with either hindleg or paraorbital shock. Experiment 2 replicated the observed adequacy of hindleg shock for modulation training, under 2 different conditions of eyeblink conditioning. The data, along with the findings that the same 30-s stimuli similarly facilitate the unconditioned eyeblink and the airpuff-elicited startle response (Brandon, Bombace, Falls & Wagner, 1991), were viewed as supporting the notion that the CR-modulation is dependent upon a conditioned fear response elicited by the 30-s cues (Wagner & Brandon, 1989).     

Rats learn the relationship between responding and environmental events: An expansion of the learned helplessness hypothesis

Previous research has shown that preexposure to inescapable shock interferes with subsequent acquisition of escape responding, while pretraining with escapable shock facilitates subsequent acquisition of a different escape response. It has also been demonstrated that interference and facilitation persist when the aversive event is changed between the two phases of training. The present experiment extended these findings, showing generalized learning from an appetitive to an aversive situation. Six groups of rats received the following treatment in the presence of discriminative stimuli: One group was trained to nose press for food, a second to chain pull for food, and a third to chain pull to escape or avoid shock. Two groups received either signalled free food or inescapable shock, and a naive control group received no pretreatment. All groups were then tested in a nose-press escape-avoidance situation. The three groups with prior response training acquired responding most rapidly, and at the same rate. The naive controls acquired responding slowly, and the two groups with response-independent histories did not acquire responding during the 5 days of training. It was concluded that rats learn the relationship between responding and environmental events and that such learning strongly influences subsequent learning.     

Perceptual learning in maze discriminations

In Experiment 1, rats were trained on a discrimination between rubber- and sandpaper-covered arms of a maze after one group had been pre-exposed to these intra-maze cues. Pre-exposure facilitated subsequent discrimination learning, unless the discrimination was made easier by adding further discriminative stimuli, when it now significantly retarded learning. In Experiment 2, rats were trained on an extra-maze spatial discrimination, again after one group, but not another, had been pre-exposed to the extra-maze landmarks. Here too, pre-exposure facilitated subsequent discrimination learning, unless the discrimination was made substantially easier by arranging that the two arms between which rats had to choose were always separated by 135°. The results of both experiments can be explained by supposing that perceptual learning depends on the presence of features common to S+ and S-.     

An assessment of the role of handling cues in "spontaneous recovery" after extinction

Three experiments examined the assertion that presession handling cues that accompany training with reinforcement might account for spontaneous recovery when they reoccur following extinction. In Experiment 1, after extensive training on a variable-interval schedule, key pecking in pigeons was extinguished following either normal or distinctively different handling and transportational cues. Those cues resulted in enhanced spontaneous recovery 24 hr later when normal cues were reinstated. In Experiment 2, however, subjects tested following the normal handling cues showed no more spontaneous recovery than did subjects that spent the entire extinction-test interval in the experimental chambers and thus were tested without handling cues altogether. In Experiment 3, a group whose test for recovery began 10 min after being placed in the chambers yielded as much spontaneous recovery as did a group tested normally. Furthermore, a group for which extinction began at mid-session and for which handling therefore could not be a discriminative cue for extinction showed no more spontaneous recovery than did the other two groups. Handling cues thus contributed to spontaneous recovery only after explicit discrimination training, as provided in Experiment 1.     

The effect of deprivation level during noncontingent pairings and instrumental learning on subsequent instrumental performance

In Experiment 1, rats received either response-noncontingent pairings of a tone stimulus with food or response-contingent instrumental training during which only responses in the presence of the tone were reinforced. During this training rats were maintained at either 70 or 90% of their growth-adjusted predeprivation body weights. In a subsequent test phase, one-half of the subjects in each training condition were tested under either 70 or 90% body weight. Subjects which had received response-contingent instrumental training under 70% body weight responded significantly faster to presentations of the tone than did 90% body weight-trained subjects, regardless of test deprivation condition. There was no effect of the deprivation level in effect during response-noncontingent pairings. In Experiment 2, rats received noncontingent tone-reward pairings or nonpairings under either 70 or 90% body weight. In a later test phase under 90% body weight, instrumental responding to the tone was significantly faster for subjects which had received the tone-reward pairings. Deprivation level during the pairings again produced no effect. These results support two conclusions. First, the expectancy learning process appears to be relatively independent of deprivation conditions in effect when such learning takes place; and secondly, deprivation conditions in effect during instrumental learning affect the strength of S-R associative bonds formed.     

On the role of covarying functions in stimulus class formation and transfer of function

This experiment investigated whether directly trained covarying functions are necessary for stimulus class formation and transfer of function in humans. Initial class training was designed to establish two respondent-based stimulus classes by pairing two visual stimuli with shock and two other visual stimuli with no shock. Next, two operant discrimination functions were trained to one stimulus of each putative class. The no-shock group received the same training and testing in all phases, except no stimuli were ever paired with shock. The data indicated that skin conductance response conditioning did not occur for the shock groups or for the no-shock group. Tests showed transfer of the established discriminative functions, however, only for the shock groups, indicating the formation of two stimulus classes only for those participants who received respondent class training. The results suggest that transfer of function does not depend on first covarying the stimulus class functions.     

Selective attention and stimulus-reinforcer interactions in the pigeon

The study supplies further evidence that non-associative effects and temporal-spatial similarities between certain combinations of cue and consequence cannot explain all instances of stimulus-reinforcer interactions. Pigeons were trained to press a treadle in the presence of a discriminative compound stimulus either to avoid shock or to obtain a food reinforcer. The compound stimulus was composed of diffuse tone and light cues which had identical temporal patterns of onset, duration and offset. With the avoidance schedule the auditory cue acquired more control than the visual cue; however, when food was the reinforcer, the visual cue exerted more control. This pattern of stimulus control on the appetitive schedule did not change if random shocks were also added, even though these shocks were equal in density to the food presentations and equal in magnitude to those used for the avoidance schedule. Other changes in the appetitive procedure, such as making the tone spatially contiguous with food and removing the light in the food hopper, also failed to alter the relative control by the different cues. Prior training with a food reinforcer did not produce any change in the relative control by the two cues when the birds were retrained on the shock-avoidance schedule. The results suggest that some frequently stated alternatives to selective associability are not adequate explanations of this instance of a stimulus-reinforcer interaction.     

The control of appetitive instrumental responding does not depend on classical conditioning to the discriminative stimulus

In Experiment I, rats were exposed to a classical relationship between a clicker-light compound and response-independent food. Conditioning to the light was blocked if the clicker had previously served as a classical signal for food, but not if it had been established as a discriminative stimulus for food-reinforced lever pressing. In Experiment II, a tone-light compound served as a discriminative stimulus for lever pressing. Control by the light was blocked if the tone was independently trained as a discriminative stimulus, but not if it was trained as a classical signal for response-independent food. These results suggest that discriminative stimuli do not come to control appetitive instrumental responding by virtue of their implicit classical relationship to the instrumental reinforcer.     

Retrospective revaluation effects in the conditioned suppression procedure

In four experiments using the conditioned suppression procedure, rats received initial reinforced training with two compound stimuli, AX and BY, each compound consisting of one auditory and one visual element. After a second phase of training consisting of nonreinforced presentations of A, the suppression governed by X and Y was tested. In Experiment 1 X evoked slightly less suppression than Y (a mediated extinction effect). This outcome was obtained when the auditory cues served as Xand Y(Experiment 1a), when the visual cues served as Xand Y(Experiment 1b), and when the number of nonreinforced presentations of Awas increased (Experiment 1c) from 18 to 216. In Experiment 2, however, in which the initial training was given with serial compounds (i.e., A ⇒ X and B ⇒ Y) X evoked more suppression than Y (a recovery-from-overshadowing effect). It was argued that extinction of A engages two learning processes, one increasing the effective associative strength of its associate (X) and one reducing it, and that the balance between these two depends on the specific conditions of training.     

Partial reinforcement and context switch effects in human predictive learning

Human participants were trained in a trial-by-trial contingency judgements task in which they had to predict the probability of an outcome (diarrhoea) following different cues (food names) in different contexts (restaurants). Cue P was paired with the outcome on half of the trials (partial reinforcement), while cue C was paired with the outcome on all the trials (continuous reinforcement), both cues in Context A. Test was conducted in both Context A and a different but equally familiar context (B). Context change decreased judgements to C, but not to P (Experiment 1). This effect was found only in the cue trained in the context where a different cue was partially reinforced (Experiment 2). Context switch effects disappeared when different cues received partial reinforcement in both contexts of training (Experiment 3). The implications of these results for an explanation of context switch effects in terms of ambiguity in the meaning of the cues prompting attention to the context (e.g., Bouton, 1997) are discussed.     

Reciprocal overshadowing between intra-maze and extra-maze cues

In three experiments, rats learned a maze discrimination where the location of food was defined either by reference to extra-maze cues alone, or by both extra- and intra-maze cues. Experiment 1 confirmed earlier results in showing that the presence of intra-maze cues failed to overshadow learning about extra-maze cues, in spite of the former's apparently greater salience. Experiment 2, however, suggested that this result was an artefactual consequence of differences between groups in the proportion of reinforced and unreinforced trials during the course of discriminative training. In Experiment 3, the discrimination was taught by a series of reinforced and unreinforced placement trials, and a significant overshadowing effect was observed. Intra-maze and extra-maze cues seem to compete for association with reinforcement in exactly the same way as any other cues.     

Food delivery as a conditional stimulus: Feature-learning and memory in pigeons

Three experiments investigated the learning and memory of discriminations based on presence versus absence of a pre-trial food delivery. In Experiment 1 half the illuminations of a response key were followed by food regardless of the subject's behavior. In one group an extra food delivery preceded only reinforced trials (feature-positive condition), whereas in a second group it preceded only nonreinforced trials (feature-negative condition). Key pecks and approaches revealed more rapid and superior discrimination learning in the first group. Experiment 2 replicated the results of Experiment 1 but yielded no evidence that greater “unexpectedness” of pretrial food conditions facilitates discriminative performance. In Experiment 3, individual pigeons trained on a conditional discrimination exhibited a within-subject feature-positive superiority. Delay between pretrial and trial stimuli interacted with feature-positive versus feature-negative training in both the between-group (Experiment 2) and within-subject (Experiment 3) procedures: performance was decremented at both short and long delays in the feature-positive condition but was decremented only at longer delays in the feature-negative condition. The feature-positive superiority obtained here is incompatible with explanations based on either the general concept of “perceptual organization” or on the conditional nature of feature-negative discriminations.     

Partial reinforcement and context switch effects in human predictive learning

Human participants were trained in a trial-by-trial contingency judgements task in which they had to predict the probability of an outcome (diarrhoea) following different cues (food names) in different contexts (restaurants). Cue P was paired with the outcome on half of the trials (partial reinforcement), while cue C was paired with the outcome on all the trials (continuous reinforcement), both cues in Context A. Test was conducted in both Context A and a different but equally familiar context (B). Context change decreased judgements to C, but not to P (Experiment 1). This effect was found only in the cue trained in the context where a different cue was partially reinforced (Experiment 2). Context switch effects disappeared when different cues received partial reinforcement in both contexts of training (Experiment 3). The implications of these results for an explanation of context switch effects in terms of ambiguity in the meaning of the cues prompting attention to the context (e.g., Bouton, 1997) are discussed.     

Incidental retrieval processes influence explicit test performance with data-limited cues

In two experiments, the influence of incidental retrieval processes on explicit test performance was tested. In Experiment 1, subjects studied words under four conditions (auditory-shallow, auditory-deep, visual-shallow, and visual-deep). One group of subjects received auditory and visual word-fragment completion; another group received auditory and visual word-fragment cued recall. Results indicated that changes in sensory modality between study and test reduced both recall and priming performances; levels of processing significantly affected only the cued recall test. These results indicated that incidental retrieval processes might affect explicit test performance when retrieval cues are data limited. Experiment 2 supported this conclusion by showing an effect of matching study and test modalities on explicit test performance with fragment but not with copy cues. Taken together, these results support Roediger and McDermott’s (1993) suggestion that explicit test performance is influenced by incidental retrieval processes when data-limited retrieval cues are used.     

Acquisition and extinction of signaled avoidance as a function of intermittent reinforcement

Signaled, shuttle-box avoidance responding in female rats of the Fischer₃₄₄ strain was examined as a function of four separate contingencies of intermittent reinforcement. In Experiment 1, when avoidance responses during acquisition were reinforced 25% of the time with prompt CS termination, animals responded equally often during acquisition and significantly more often during extinction than animals who received such reinforcement on a 100% schedule. Similar results were found under a trace procedure in Experiment 2 when avoidance responses were reinforced 25% of the time with informational feedback stimuli. In contrast, during Experiment 3, when animals were shocked on only 25% of the trials on which they failed to respond, the level of avoidance responding during both acquisition and extinction was significantly less than it was when animals were shocked on a 100% schedule. Comparable results were found in Experiment 4 when avoidance responses during acquisition averted shock on only 25% of the trials. Thus, intermittent reinforcement contingencies involving response-contingent feedback stimuli and shock have differential effects on avoidance responding during both acquisition and extinction trials under the signaled avoidance procedure.     

Contextual control of biconditional task performance: Evidence for cue and response competition in rats

A novel paradigm is presented that was designed to mimic aspects of cue and response competition seen in humans in conflict procedures such as the Stroop task. Rats were trained simultaneously on two biconditional discrimination tasks, one auditory and one visual, in two different contexts: C1, in which A1:LP1 → R, A2:LP2 → R; and C2, in which V1:LP1 → R, V2:LP2 → R, where C1/C2 represent different training contexts (produced by different operant chambers), A1/A2 are different auditory cues, V1/V2 are different visual cues, LP1/LP2 are discrete operant responses, and R is reward. At test, rats received presentations of audiovisual compounds of these training stimuli in extinction. These compounds had dictated either the same (A1V1 or A2V2) or different (A1V2 or A2V1) responses during training: termed congruent and incongruent trials, respectively. Experiment 1 showed that following equal training on the two biconditional tasks, the contextual cues came to control responding to conflicting information provided by incongruent stimulus compounds such that animals responded according to the stimulus element previously trained in that test context. Experiment 2 demonstrated that differential training on the biconditional discriminations (with rats receiving training on the two discriminations in the ratio 3∶1) resulted in greater interference from the overtrained task when animals were tested in the undertrained context. This finding is similar to the classic Stroop asymmetry seen in human performance whereby dominant word reading interferes with colour naming for incongruent colour–word compounds. Further analysis also revealed some evidence for a reverse Stroop effect in which the undertrained stimulus element interfered with performance on the overtrained task.