A transfer of functions through derived arbitrary and nonarbitrary stimulus relations

During Experiments 1 and 2, subjects were trained in a series of related conditional discriminations in a matching-to-sample format (A1-B1, A1-C1 and A2-B2, A2-C2). A low-rate performance was then explicitly trained in the presence of B1, and a high-rate performance was explicitly trained in the presence of B2. The two types of schedule performance transferred to the C stimuli for all subjects in both experiments, in the absence of explicit reinforcement through equivalence (i.e., C1 = low rate and C2 = high rate). In Experiment 2, it was also shown that these discriminative functions transferred from the C1-C2 stimuli to two novel stimuli that were physically similar to the C stimuli (SC1 and SC2, respectively). For both these experiments, subjects demonstrated the predicted equivalence responding during matching-to-sample equivalence tests. In Experiments 3 and 4, the conditional discrimination training from the first two experiments was modified in that two further conditional discrimination tasks were trained (C1-D1 and C2-D2). However, for these tasks the D stimuli served only as positive comparisons, and ND1 and ND2 stimuli served as negative comparisons (i.e., C1 × ND1 and C2 × ND2). Subsequent to training, the negatively related stimuli (ND1 and ND2) did not become discriminative for the schedule performances explicitly trained in the presence of B1 and B2, respectively. Instead, the ND1 stimulus became discriminative for the schedule performance trained in the presence of B2, and ND2 became discriminative for the schedule performance trained in the presence of B1. All subjects from Experiment 4 showed that the novel stimulus SND1, which was physically similar to ND1, became discriminative for the same response pattern as that controlled by ND1. Similarly, SND2, which was physically similar to ND2, became discriminative for the same response pattern as that controlled by ND2. Subjects from both Experiments 3 and 4 also produced equivalence responding on matching-to-sample equivalence tests that corresponded perfectly to the derived performances shown on the transfer of discriminative control tests.     

Blocking and overshadowing between intra-maze and extra-maze cues: A test of the independence of locale and guidance learning

Rats were trained on an elevated maze where the rewarded alternative was defined either in terms of intra-maze cues (rubber or sandpaper flooring on rewarded and unrewarded arms, regardless of their position) or in terms of extra-maze cues (the correct arm always pointed toward a particular corner of the room, and was sometimes covered with rubber and sometimes with sandpaper), or where both sets of cues were simultaneously relevant. In Experiment 1 rats pretrained with either intra-maze or extra-maze cues alone relevant learned less about the other set of cues than non-pretrained control groups, when, in a second phase of the experiment, both sets of cues were simultaneously relevant. Experiment 2 confirmed that intra-maze cues could block extra-maze cues, and ruled out one alternative explanation of the results of Experiment 1. Experiment 3 showed that extra-maze cues overshadowed intra-maze cues, but that there was no reciprocal overshadowing of extra-maze by intra-maze cues. This was despite the fact that animals learned the intra-maze discrimination significantly faster than the extra-maze discrimination. Experiment 3 also suggested that rats did not solve the extra-maze discrimination by learning to approach or avoid specific extra-maze cues, but rather by locating the correct arm by reference to the entire set of extra-maze cues. The results suggest that locale or place learning and cue or guidance learning, in O'Keefe and Nadel's (1978) terminology, interact with one another in much the same way as does learning about any pair of stimuli in a Pavlovian conditioning experiment.     

Cue selection in verbal discrimination learning of retarded subjects.

A series of experiments was conducted to examine cue function in trigram verbal discrimination learning by retarded subjects. The issue was to determine the factors that control attention in this type of learning situation. The two variables of chief interest were trigram meaningfulness and reinforcement history. The major general conclusion was that retarded subjects employ complex cue selection strategies in solving a verbal discrimination involving compound verbal stimuli. Major findings were as follows: (a) Retarded subjects exhibit a response bias in favor of words over nonsense trigrams; (b) relatively little active cue selection based on meaningfulness was observed; (c) a compound stimulus discrimination was more difficult to learn than a discrimination involving single verbal stimuli; (d) compound and single stimuli may be processed differently in original discrimination learning; (e) cue position probably controls attention in compound discrimination learning; and (f) a frequency theory of verbal discrimination learning is supported by these data.     

Partial reinforcement and context switch effects in human predictive learning

Human participants were trained in a trial-by-trial contingency judgements task in which they had to predict the probability of an outcome (diarrhoea) following different cues (food names) in different contexts (restaurants). Cue P was paired with the outcome on half of the trials (partial reinforcement), while cue C was paired with the outcome on all the trials (continuous reinforcement), both cues in Context A. Test was conducted in both Context A and a different but equally familiar context (B). Context change decreased judgements to C, but not to P (Experiment 1). This effect was found only in the cue trained in the context where a different cue was partially reinforced (Experiment 2). Context switch effects disappeared when different cues received partial reinforcement in both contexts of training (Experiment 3). The implications of these results for an explanation of context switch effects in terms of ambiguity in the meaning of the cues prompting attention to the context (e.g., Bouton, 1997) are discussed.     

Partial reinforcement and context switch effects in human predictive learning

Human participants were trained in a trial-by-trial contingency judgements task in which they had to predict the probability of an outcome (diarrhoea) following different cues (food names) in different contexts (restaurants). Cue P was paired with the outcome on half of the trials (partial reinforcement), while cue C was paired with the outcome on all the trials (continuous reinforcement), both cues in Context A. Test was conducted in both Context A and a different but equally familiar context (B). Context change decreased judgements to C, but not to P (Experiment 1). This effect was found only in the cue trained in the context where a different cue was partially reinforced (Experiment 2). Context switch effects disappeared when different cues received partial reinforcement in both contexts of training (Experiment 3). The implications of these results for an explanation of context switch effects in terms of ambiguity in the meaning of the cues prompting attention to the context (e.g., Bouton, 1997) are discussed.     

Incidental cue learning in rats

Continuity theories of discrimination learning appear to say that animals learn equally about all cues impinging upon their receptors; noncontinuity theories that they learn about only one cue at a time. Experiment I showed that neither of these positions is correct: rats trained to attend to one cue learned less about a subsequently introduced incidental cue than rats given no such pretraining; but attention to one cue did not totally prevent learning about the other. A second experiment established that if rats are trained with one cue, and a second cue is then also made relevant, the amount learned about this second cue varies directly with (a) the abruptness with which it is introduced, and (b) the difficulty of the original discrimination.     

Conditional Control of Fluid Consumption in an Occasion Setting Paradigm Is Independent of Pavlovian Associations

Drug states, flavors, and contextual cues were each trained as conditional discriminative stimuli to control a saccharin-LiCl association. In transfer tests, drug states transferred control over consumption to other flavored solutions and to food. Contexts and flavors transferred control only to other flavored solutions. Pavlovian control groups given direct pairings of context-LiCl or flavor-LiCl did not show reliable transfer. However, these control groups did show greater or the same aversion to the specific context or flavor predicting LiCl compared to the context or flavor discrimination groups. The dissociation of the discrimination and Pavlovian groups on transfer versus preference tests suggests that performance on the occasion setting task cannot be due to simple excitation or learning about a unique compound cue. Data from extinction procedures provide further support for the dissociation between simple excitation and occasion setting.     

Relational responses in tests of transposition with Rhesus monkeys

Three adult Rhesus monkeys (Macaca mulatta), one with nonrelated discrimination learning experience and two experimentally naive, were trained to discriminate between two simultaneously presented stimuli differing only in height. After exceeding the learning criteria on a VR 4 reinforcement schedule and considerable overtraining, subjects were tested for transposition. Both upward and downward and near and far tests were administered to determine the effects of distance from the original training pair on the amount of transposition. In these tests, each of the 24 stimulus pairs contained one or more novel stimuli. Training trials were interpolated to avoid extinction effects and measures were taken to avoid motivational deficits or differential rewards during testing. All three subjects responded relationally at far as well as near distances from the original training pair. Stimulus generalization, on the basis of increments of association, was found to be an inferior explanation for these data. Slight decrements on far tests can be better explained in terms of the learning-performance distinction.     

Inescapable shock and attention to internal versus external cues in a water discrimination escape task

In these experiments we examined discrimination learning in a water escape task following exposure to escapable, yoked inescapable, or no electric shock. Inescapable shock did not have an effect on swim speeds in any of the experiments. Inescapable shock interfered with the acquisition of a position (left-right) discrimination when an irrelevant brightness cue (black and white stimuli) was present. However, inescapable shock did not affect the acquisition of the position discrimination when the irrelevant brightness cue was removed. Inescapably shocked subjects showed facilitated learning relative to escapably shocked and nonshocked subjects when the brightness cue was included as a relevant cue. These data may resolve discrepancies between studies that did, and did not, find inescapable shock to interfere with the acquisition of discriminations. Moreover, they point to attentional processes as one locus of the cognitive changes produced by inescapable shock and suggest that exposure to inescapable shock biases attention away from "internal" response-related cues toward "external" cues.     

Positive contrast, negative induction, and inhibitory stimulus control in the rat

In Experiment I, 24 rats were trained on a multiple variable-interval variable-interval schedule with a doorlight and white noise serving as component cues. Two groups were then shifted to a multiple extinction variable-interval schedule, and a third group was maintained on the multiple variable-interval variable-interval schedule. The multiple extinction variable-interval condition produced positive contrast when either the light or noise signalled extinction, and both of these cues acquired inhibitory stimulus control as measured by a combined cue test. In Experiment II, the multiple variable-interval variable-interval condition was shifted to multiple extinction variable-interval for one group, to multiple variable-time variable-interval for a second group, and was unchanged for the third group. The two experimental conditions produced identical patterns of response-rate reduction in the altered component, but the multiple extinction variable-interval condition produced positive contrast, whereas the multiple variable-time variable-interval condition did not. Subsequent combined cue and resistance to reinforcement tests revealed that the cue signalling extinction acquired stronger inhibitory stimulus control than the cue signalling variable time.     

Same/different discrimination by bumblebee colonies

Bumblebees were exposed to a discrimination procedure in which reinforcement was contingent on choice of one of two spatial locations. The correct choice depended on whether a stimulus display contained two identical stimuli or two different stimuli. Some bees were trained with color stimuli and tested with line grating stimuli and others with the opposite arrangement. Four colonies of bumblebees produced more correct than incorrect choices to both identical and different stimuli during the transfer phase. This pattern of results is a signature of choices under control of an identity (“same/different”) concept. The results therefore indicate the existence of an identity concept in bumblebees.     

Tiger salamanders’ (<Emphasis Type="Italic">Ambystoma tigrinum</Emphasis>) response learning and usage of visual cues

We explored tiger salamanders’ (Ambystoma tigrinum) learning to execute a response within a maze as proximal visual cue conditions varied. In Experiment 1, salamanders learned to turn consistently in a T-maze for reinforcement before the maze was rotated. All learned the initial task and executed the trained turn during test, suggesting that they learned to demonstrate the reinforced response during training and continued to perform it during test. In a second experiment utilizing a similar procedure, two visual cues were placed consistently at the maze junction. Salamanders were reinforced for turning towards one cue. Cue placement was reversed during test. All learned the initial task, but executed the trained turn rather than turning towards the visual cue during test, evidencing response learning. In Experiment 3, we investigated whether a compound visual cue could control salamanders’ behaviour when it was the only cue predictive of reinforcement in a cross-maze by varying start position and cue placement. All learned to turn in the direction indicated by the compound visual cue, indicating that visual cues can come to control their behaviour. Following training, testing revealed that salamanders attended to stimuli foreground over background features. Overall, these results suggest that salamanders learn to execute responses over learning to use visual cues but can use visual cues if required. Our success with this paradigm offers the potential in future studies to explore salamanders’ cognition further, as well as to shed light on how features of the tiger salamanders’ life history (e.g. hibernation and metamorphosis) impact cognition.     

Stimulus generalization following extra-dimensional training in educationally subnormal (severely) children.

The use of discrimination learning paradigms in the study of attentional transfer is discussed. The technique of go/no-go discrimination learning followed by stimulus generalization testing is contrasted with the more familiar simultaneous learning paradigm followed by a shift in the relevant cues. In the former paradigm the effect of training a discrimination on one dimension on the slope of the stimulus generalization gradient on an independent gradient dimension (extra-dimensional training) is assessed. A steepening of the gradient relative to appropriate control procedures is taken as evidence of positive attentional transfer. The relevance of the technique to the detailed study of attentional transfer in educationally subnormal (severely) (ESN(S)) children is considered. In Expt. I nine ESN(S) children were trained in a go/no-go discrimination involving stimuli differing in orientation, and were generalization tested on a dimension that was orthogonal, namely hue. Of the six subjects who learnt the discrimination five showed clear decremental gradients on the hue dimension. In contrast a Pseudo-Discrimination group (PD) of eight subjects matched to those in the TD group showed no gradients. These subjects were not trained in the orientation discrimination, but were reinforced for responding on 50 per cent of each of the S+ and S- stimulus presentations. They thus received equal exposure to, but no differential training on, the orientation dimension. An S+ only group of four subjects who received no exposure to the orientation stimuli showed no gradients when stimulus generalization testing on the hue continuum was carried out. The result is discussed in terms of transfer deriving from stimulus control by relational aspects of the stimuli; in terms of control by constant irrelevant stimuli; and in terms of the study of stimulus control in ESN(S) children. In Expt. II the influence of the codability of the colours on the location of the peak of the stimulus generalization gradients in the TD group is investigated.     

Steady state responding based upon simple and compound stimuli

Two pigeons were trained to perform discrimination tasks along two dimensions, wavelength of a circular spot of light and orientation of a white line. Discriminability among stimuli along these dimensions was established for both subjects by means of a steady state testing procedure. The two dimensions were then combined by superimposing the white line upon the colored background. Subjects were given a series of tests in which a correct response could be made on the basis of either of the two components of the stimulus compounds. Discriminability among these redundant compound stimuli was found to be better than that among wavelength and tilt stimuli alone. A second series of tests was administered using both redundant and conflicting compound stimuli. The results of this test series are consistent with a response strategy in which subjects first examine both elements of a compound and then emit a choice response on the basis of the element that best predicts reinforcement.     

A transfer of self-discrimination response functions through equivalence relations

The present study tested the idea that human self-discrimination response functions may transfer through equivalence relations. Four subjects were trained in six symbolic matching-to-sample tasks (if see A1, choose B1; A1-C1, A2-B2, A2-C2, A3-B3, A3-C3) and were then tested for the formation of three equivalence relations (B1-C1, B2-C2, B3-C3). Two of the B stimuli (B1 and B2) were then used to train two different self-discrimination responses using either detailed instructions (Subjects 1 to 3) or minimal instructions (Subject 4) on two complex schedules of reinforcement (i.e., subjects were trained to pick the B1 stimulus if they had not emitted a response, and to pick the B2 stimulus if they had emitted one or more responses on the previous schedule). All 4 subjects showed the predicted transfer of self-discrimination response functions through equivalence relations (i.e., no response on the schedule, pick C1; one or more responses on the schedule, pick C2). Subjects also demonstrated this transfer when they were required to discriminate their schedule performance before exposure to the schedule (i.e., “what I intend to do”). Four control subjects were also used in the study. Two of these (Subjects 5 and 6) were not exposed to any form of matching-to-sample training and testing (nonequivalence controls). The 2 remaining subjects (7 and 8) were exposed to matching-to-sample training and testing that incorporated stimuli not used during the transfer test; C1 and C2 were replaced by N1 and N2 during the matching-to-sample training and testing, but C1 and C2 were used for the transfer tests (equivalence controls). All 4 subjects failed to produce the self-discrimination transfer performances observed with the experimental subjects.     

Conditional discrimination in mentally retarded adults: the effect of training the component simple discriminations.

Two subjects with retardation who exhibited generalized identity matching, but who had extensive histories of failure to acquire arbitrary matching, were exposed to a series of conditions designed to train separately the components of a two-choice conditional discrimination. First, the successive discrimination between the sample stimuli was established by programming a different schedule of reinforcement in the presence of each sample stimulus. Schedule performance was acquired and maintained by both subjects, but neither acquired arbitrary matching. To train the simultaneous discrimination between the comparison stimuli, 1 subject was then exposed to a series of simple discrimination reversals and subsequently failed to acquire arbitrary matching. Both subjects acquired arbitrary matching under a procedure that maintained both the sample and the comparison discrimination by first presenting entire sessions composed of one sample-comparison relation and then gradually reducing the number of consecutive trials with the same sample until sample presentation was randomized (schedule performance was maintained). Removal of the schedule requirement had no effect on arbitrary matching accuracy. Both subjects subsequently demonstrated control by relations symmetric to the trained relations.     

Representation-mediated Inhibitory Learning in the Conditioned-suppression Procedure

In three experiments, rats in group I (for intermixed) were given non-reinforced exposure to two compound stimuli, AX and BX, where A and B represent different auditory cues, and X represents a visual cue. AX and BX were presented in alternation. Group B (blocked) received similar exposure except that subjects experienced a block of AX trials and then a block of BX trials. Subsequent shock reinforcement of A was found to endow B with inhibitory strength in group I, as assessed by retardation (Experiments 1 and 2) and summation tests (Experiment 3). This outcome confirms and extends the results reported by Espinet, Iraola, Bennett, and Mackintosh (1995) and constitutes a further example of mediated learning in which the associative strength of a stimulus is found to be modified as a consequence of training given to some other event with which that stimulus is associated.     

Effects of ratio reinforcement schedules on discrimination performance by Japanese monkeys

In Experiment 1, Japanese monkeys were trained on three conditional position-discrimination problems with colors as the conditional cues. Within each session, each problem was presented for two blocks of ten reinforcements; correct responses were reinforced under continuous-reinforcement, fixed-ratio 5, and variable-ratio 5 schedules, each assigned to one of the three problems. The assignment of schedules to problems was rotated a total of three times (15 sessions per assignment) after 30 sessions of acquisition training. Accuracy of discrimination increased to a moderate level with fewer trials under CRF than under ratio schedules. In contrast, the two ratio schedules, fixed and variable, were more effective in maintaining accurate discrimination than was CRF. With further training, as asymptotes were reached, accuracy was less affected by the schedule differences. These results demonstrated an interaction between the effects of reinforcement schedules and the level of acquisition. In Experiment 2, ratio sizes were gradually increased to 30. Discrimination accuracy was maintained until the ratio reached 20; ratio 30 strained the performance. Under FR conditions, accuracy increased as correct choice responses cumulated after reinforcement.     

Overshadowing in operant conditioning as a function of discriminability

Pigeons were trained in an operant, go/no-go, discrimination by successive presentations of discrete, positive and negative trials. In separate groups, the rate of discriminaion learning based on an auditory cue, on visual cues of different discriminability, and on combined auditory and visual cues was determined. The auditory cue was tone/no-tone, the visual cue was a difference in brightness level on the key. Following discrimination training, stimulus control was tested in extinction by presenting tone or notone at each of four key-brightness levels.Learning was more rapid with two cues than with either cue singly, demonstrating summation. The contribution made by the tone cue to the learning of the discrimination decreased with increasing discriminability of the light cue. The control exerted by the tone cue also decreased (i.e., the tone cue was overshadowed) with increasing discriminability of the light cue. In certain cases, the tone cue decreased control by brightness, showing that in two-cue discriminations each cue may reduce the control exerted by the other.     

Formation of the sameness-difference concept by Japanese monkeys from a small number of color stimuli

Japanese monkeys were trained to form the sameness-difference concept. In Experiment 1, four monkeys were trained with two colors to discriminate matching stimulus pairs from nonmatching pairs by reinforcing only lever-pressing responses to matching pairs with a variable-interval schedule. Three monkeys showed successful transfer of this discrimination to two new colors, thus demonstrating that some Japanese monkeys are able to form this relational concept from a minimum number of stimuli. In Experiment 2, two monkeys were trained, in a Yes/No procedure with three colors, to press one lever under matching pairs and another lever under nonmatching pairs. Poor transfer performances to three new colors suggest that simultaneously establishing two different response patterns to matching and nonmatching pairs is ineffective in forming the concept. In Experiment 3, the amount of transfer to three new colors after mastering a standard three-color matching-to-sample task was compared with that of a modified task in which correct responses were reinforced with a within-trial variable-interval schedule. All three monkeys showed greater transfer with the modified procedure. The results suggest that the variable-interval schedule adopted within trials is effective in forming the sameness-difference concept.