An investigation of reversal learning in octopus vulgaris lamarck

Eighteen octopuses were trained by a method of successive discrimination training to discriminate between a vertical and a horizontal rectangle. They were then overtrained for either 20 or 60 trials, after which they learnt the reverse discrimination. At the beginning of each reversal they were given 20 trials pretraining on the new positive stimulus. The subjects completed from two to nine reversals.

It was found that the amount of overtraining had no effect on the rate of learning the subsequent reversal. The first four reversals all took significantly longer to learn than the original problem, but did not differ significantly from one another. However, examination of the raw data suggests that later reversals do take longer to learn. The performance when learnt (i.e. on the first day of overtraining) was as good after reversal learning as after the learning of the original problem.

The results do not show definite signs that could be interpreted as an exhaustion of a limited supply of neurones available for learning.     

Stimulus function in simultaneous discrimination

In discrimination learning, the negativity of the stimulus correlated with nonreinforcement (S-) declines after 100 training trials while the stimulus correlated with reinforcement (S+) is paradoxically more positive with lesser amounts of discrimination training. Training subjects on two simultaneous discrimination tasks revealed a within-subjects overlearning reversal effect, where a more-frequently presented discrimination problem was better learned in reversal than was a discrimination problem presented less frequently during training.     

Discrimination and Reversal Learning by Toddlers Aged 15-23 Months

Few studies have investigated simple discrimination and discrimination reversal learning by children younger than 2 years. Extant research has shown that teaching discrimination reversals may be challenging with this population. We used social reinforcement and correction procedures to teach simple simultaneous discrimination and discrimination reversal tasks involving three pairs of animal pictures displayed in a paper notebook. Participants were eight typically developing toddlers aged 15-23 months. All learned at least one simple discrimination/discrimination reversal problem. Four children learned all problems and showed evidence of learning set formation. Perhaps surprisingly, discrimination reversals were sometimes learned more rapidly than original discriminations. The procedures suggest a potentially efficient methodology for investigating more complex aspects of relational learning in toddlers.

     

Experimental evidence for spatial learning in cuttlefish (Sepia officinalis)

Laboratory mazes were used to study spatial-learning capabilities in cuttlefish (Sepia offcinalis), using escape for reinforcement. In preliminary observations, cuttlefish in an artificial pond moved actively around the environment and appeared to learn about features of their environment. In laboratory experiments, cuttlefish exited a simple alley maze more quickly with experience and retained the learned information. Similar improvement was not found in open-field mazes or T mazes, perhaps because of motor problems. Cuttlefish learned to exit a maze that required them to find openings in a vertical wall. The wall maze was modified to an arena, and simultaneous discrimination learning and reversal learning were demonstrated. These experiments indicate that cuttlefish improve performance over serial reversals of a simultaneous, visual-spatial discrimination problem.     

Successive reversals involving two cues

Rats were trained on a visual discrimination problem with two relevant cues—brightness and orientation. They were then given eight reversals in succession on the same problem. After reversals 7 and 8 they were tested with each cue presented on its own to see how much they had learned about each. Individual animals tended to reverse the cue about which they learned more from reversals 7 to 8, so that animals that had learned reversal 7 mainly in terms of the brightness cue learned reversal 8 mainly in terms of the orientation cue and vice versa. The result provides further confirmation for a two-process model of discrimination learning in which one process is that of selective attention     

The easy to hard effect and perceptual learning in flavor aversion conditioning

In experiments on the easy to hard effect, pretraining on an easy discrimination results in better performance on a harder version of the discrimination than pretraining on the hard discrimination itself. In addition, some theories posit that unreinforccd preexposure to the easy discrimination should be as effective as differentially reinforced easy pretraining in producing the easy to hard effect. Two experiments on flavor aversion conditioning in rats demonstrated the basic easy to hard effect. However, in neither experiment was easy preexposure more effective than hard preexposure in enhancing learning of the hard discrimination. Indeed, in Experiment 2, rats preexposed to an easy discrimination learned the hard discrimination significantly more slowly than those preexposed to the hard discrimination itself.     

Emergent, untrained stimulus relations in many-to-one matching-to-sample discriminations in rats

The present experiment investigated whether rats formed emergent, untrained stimulus relations in many-to-one matching-to-sample discriminations. In Phase 1, rats were trained to match two samples (triangle and horizontal stripes) to a common comparison (horizontal stripes) and two additional samples (circle or vertical stripes) to another comparison (vertical stripes). Then, in Phase 2, the rats were trained to match the one sample (triangle) to a new comparison (black) and the other sample (circle) to another comparison (white). In the Phase 3 test, half the rats (consistent group) were given two new tasks in which the sample-correct comparison relation was consistent with any emergent stimulus relations that previously may have been learned. The remaining 6 rats (inconsistent group) were given two new tasks in which the sample-correct comparison relation was not consistent with any previously learned emergent stimulus relations. Rats in the consistent group showed more accurate performance at the start of Phase 3, and faster learning to criterion in this phase, as compared with rats in the inconsistent group. This finding suggests that rats may form emergent, untrained stimulus relations between the discriminative stimuli in many-to-one matching-to-sample discriminations.     

Sequential effects on discrimination reversal

In Experiment 1 the sequence of trials to the positive (S+) and negative (S?) discriminanda was varied between groups during acquisition and reversal of a successive brightness discrimination. In Experiments 2 and 3, groups received different reward sequences in Phase 1 within S+. In general, groups given transitions from nonrewarded trials to rewarded trials (N-R transitions) in Phase 1 learned both the original discrimination and its reversal more slowly than groups given schedules devoid of N-R transitions. The results were discussed in relation to previously reported effects of partial reinforcement on acquisition and reversal of a discrimination and the role of sequential variables and internal, reward-produced cues in discrimination learning, reversal learning, and nonreversal shifts.     

The role of R-S1 expectancy in discrimination and discrimination reversal learning

Four experiments assessed the role of response-reinforcement (R-S¹) expectancy as rats either learned a discrimination or a discrimination reversal. Experiment 1 showed that the higher the percentage of reinforcement during nondiscriminative pretraining the more quickly a subsequent discrimination is learned. Experiment 2 demonstrated that the overlearning reversal effect (ORE) can be obtained even though the overtraining phase consists of responses to a single neutral card. In Experiment 3 subjects were again overtrained on a single neutral stimulus under conditions of varying reinforcement. ORE was apparent under reinforcement of a high percentage of responses but was not apparent under reinforcement of a low percentage. Experiment 4 revealed that the fewer errors a subject makes prior to reversal the better its reversal performance is. Results of these studies were discussed in terms of generalized attention theories and the expectancy notions of Bolles (Psychological Review, 1972, 79(5), 394–409.     

Stimulus exposure and discrimination in rats: A test of a theory for the role of contextual factors

In two experiments rats were trained on a simultaneous discrimination in a jumping stand. On each trial choice always lay between one stimulus (an obliquely striped object in Experiment I, and a plain grey object in Experiment II) and a second that varied from trial to trial. On half the trials this variable stimulus bore horizontal stripes (H) and on the remaining trials it bore vertical stripes (V). It was argued that the solution of this discrimination would be hindered if the animals tended to classify H and V apart (Bateson and Chantrey, 1972). It was found, however, that prior exposure to H and V in the home cage (which has been supposed to promote classifying apart) facilitated learning and that prior exposure to H and V in the apparatus itself (which might be thought to promote classifying together) hindered later learning. Possible alternative accounts for these exposure learning effects are discussed.     

Learning to ignore irrelevant stimuli: Variations within and between displays

Pigeons were exposed to stimuli differing in orientation. Some birds received both horizontal and vertical on every trial; others received two horizontals on some trials and two verticals on other trials. These stimuli were irrelevant, i.e., did not predict reliably the availability of reinforcement. When required to learn a discrimination between horizontal and vertical, the birds that had experienced the stimulus variation within each display learned more slowly. This was true whether the test problem was a simultaneous or a successive discrimination. It is argued that this result implies that animals will actively learn to ignore stimuli that are irrelevant.     

Incidental cue learning in rats

Continuity theories of discrimination learning appear to say that animals learn equally about all cues impinging upon their receptors; noncontinuity theories that they learn about only one cue at a time. Experiment I showed that neither of these positions is correct: rats trained to attend to one cue learned less about a subsequently introduced incidental cue than rats given no such pretraining; but attention to one cue did not totally prevent learning about the other. A second experiment established that if rats are trained with one cue, and a second cue is then also made relevant, the amount learned about this second cue varies directly with (a) the abruptness with which it is introduced, and (b) the difficulty of the original discrimination.     

The course of acquisition of a line-tilt discrimination by rhesus monkeys

Each of four groups of monkeys were trained on a different simultaneous discrimination procedure involving a vertical line as the correct choice. Each group, after acquiring the discrimination, was tested for generalization along the dimension of line tilt. Monkeys that learned to select the vertical line when the alternative choices were distinguished from the correct choice by two aspects (brightness and absence of line) showed almost complete tilt generalization (flat gradient). Monkeys that learned to select the line when the alternatives were distinguished only by the absence of the line showed poor tilt discrimination (generalization gradient slightly peaked at vertical). Monkeys developed a good tilt discrimination when nonvertical lines were gradually introduced by progressively darkening them on the previously blank alternatives. Monkeys developed a tilt discrimination with the lowest error rate when only horizontal alternatives were gradually introduced and then pairs of alternatives progressively closer to vertical were made available.     

Errorless learning of a conditional temporal discrimination

In the present study we extended errorless learning to a conditional temporal discrimination. Pigeons' responses to a left-red key after a 2-s sample and to a right-green key after a 10-s sample were reinforced. There were two groups: One learned the discrimination through trial and error and the other through an errorless learning procedure. Then, both groups were presented with three types of tests. First, they were exposed to intermediate durations between 2 s and 10 s, and given a choice between both keys (stimulus generalization test). Second, a delay from 1 s to 16 s was included between the offset of the sample and the onset of the choice keys (delay test). Finally, pigeons learned a new discrimination in which the stimuli were switched (reversal test). Results showed that pigeons from the Errorless group made significantly fewer errors than those in the Trial-and-Error group. Both groups performed similarly during the stimulus generalization test and the reversal test, but results of the delay test suggested that, on long stimulus trials, responding in the errorless training group was less disrupted by delays.     

Contextual conditional discriminations

Three experiments used a discriminated operant procedure to study conditional discrimination learning in rats. The first experiment showed that rats were capable of learning a biconditional discrimination in which two contexts served as conditional cues signalling the reinforcement contingencies associated with two discriminative stimuli. The discrimination was learned equally well when one discriminative stimulus signalled food, the other its absence, and when one stimulus signalled food, the other extinction plus mild footshock.

In Experiment 2 it was shown that prior training on such a conditional discrimination enhanced the subsequent context specificity of simple conditioning relative to control groups of animals for whom the prior training had not been conditional. Experiment 3 showed that a reversal of the significance of one pair of discriminative stimuli produced no spontaneous reversal in performance to a second, target, pair.

The pattern of results is best accounted for by an analysis of contextual conditional discrimination learning in terms of stimulus configurations and offers no support for the notion that rats may learn a general conditional rule or set.     

Role of the biogenic amines in the reversal of cycloheximide-induced amnesia.

Amnesia was induced by pretraining injections of cycloheximide (CYC) in a food motivated discrimination reversal task. Magnitude of amnesia varied as a function of the amount of training on both the initial discrimination and the reversal and also as a function of the length of intertrial interval used on both the reversal and the test. Memory spontaneously recovered 48 hr. following reversal training. Recovery from amnesia was induced by pretesting injections of d-amphetamine and 2 monoamine oxidase inhibitors, pargyline and catron. This enhanced performance was a true recovery of the memory and not a result of enhanced learning or increased arousal. Depletion of catecholamines by alpha-methyl-para-tyrosine, a tyrosine hydroxylase inhibitor, and diethyldithiocarbamate, a dopamine beta hydroxylase inhbitor, resulted in an amnesia quantitatively and qualitatively similar to amnesia induced by CYC. These data support the hypothesis that CYC-induced amnesia is mediated via central catecholamines.     

Touch screen assays of behavioural flexibility and error characteristics in Eastern grey squirrels (<Emphasis Type="Italic">Sciurus carolinensis</Emphasis>)

Behavioural flexibility allows animals to adjust their behaviours according to changing environmental demands. Such flexibility is frequently assessed by the discrimination–reversal learning task. We examined grey squirrels’ behavioural flexibility, using a simultaneous colour discrimination–reversal learning task on a touch screen. Squirrels were trained to select their non-preferred colour in the discrimination phase, and their preferred colour was rewarded in a subsequent reversal phase. We used error rates to divide learning in each phase into three stages (perseveration, chance level and ‘learned’) and examined response inhibition and head-switching during each stage. We found consistent behavioural patterns were associated with each learning stage: in the perseveration stage, at the beginning of each training phase, squirrels showed comparable response latencies to correct and incorrect stimuli, along with a low level of head-switching. They quickly overcame perseveration, typically in one to three training blocks. In the chance-level stage, response latencies to both stimuli were low, but during initial discrimination squirrels showed more head-switches than in the previous stage. This suggests that squirrels were learning the current reward contingency by responding rapidly to a stimulus, but with increased attention to both stimuli. In the learned stage, response latencies to the correct stimulus and the number of head-switches were at their highest, whereas incorrect response latencies were at their lowest, and differed significantly from correct response latencies. These results suggest increased response inhibition and attention allowed the squirrels to minimise errors. They also suggest that errors in the ‘learned’ stage were related to impulsive emission of the pre-potent or previously learned responses.     

Effects of error and errorless discrimination acquisition on reversal learning

The effectiveness of trial-and-error, graded-choice, and verbal-instruction procedures on the acquisition and maintenance of a two-choice simultaneous color discrimination in an intradimensional double-reversal learning situation was studied using 18 first-grade children. After acquiring a red-green discrimination during one 70-trial session, the discriminative roles of the stimuli were reversed for 30 trials, followed by a second reversal for 30 trials. Children in the graded-choice and verbal-instruction groups acquired and maintained the discriminations with fewer errors than children who learned by trial and error. The importance of the results in terms of two-stage discrimination learning theories is pointed out and similarities between errorless learning and overtraining are discussed.     

Transfer of Learning Between Concurrent and Matching (or Non-matching)-to-Sample Discriminations in Rats

Three experiments examined transfer of learning between a concurrent discrimination and a matching (or non-matching)-to-sample discrimination in rats. In Experiment 1, rats were trained to criterion (group NOT) or were overtrained (group OT) on two concurrent discriminations. Subsequently, group OT learned a matching (or non-matching) task more rapidly than did group NOT. In Experiment 2, rats were initially given matching (or nonmatching) tasks and then given whole or half reversal with these tasks. Group whole reversed faster than group half. In Experiment 3, two groups of rats were trained on matching (or non-matching) tasks, and then given concurrent discrimination training, followed by either whole or half reversal training (groups matching and non-matching). Another group (group control) received a pseudo-discrimination followed by the same training in Phases 2 and 3 as groups matching and non-matching. In groups matching and non-matching, rats learned the whole reversal more rapidly than the half reversal. But the opposite result was observed in group control. These findings suggest that transfer effects reported in Experiments 1 and 2 are governed by the same mechanism for the formation of associations between stimuli.     

Olfactory discrimination, reversal learning, and stimulus control in rats.

Rats were trained to discriminate lights, tones, or odors and then given a series of discrimination reversals. Only rats trained with odors showed positive transfer on the first reversal and acquisition of a reversal set. Other experiments demonstrated that rats preferentially attend to odors when presented in compound with lights or tones; that odors exert more discriminative control than tones in tests using compound stimuli of competing sign; and that after pretraining on the positive stimulus, acquisition of an odor but not a light discrimination occurs with virtually no errors. These results demonstrate the importance of stimulus modality in the establishment of stimulus control and the need for more careful analysis of stimulus factors in cross-species comparisons of learning ability.