Effects of overtraining on reversal learning by rats in concurrent and single discriminations

Two experiments examined the whole-partial effect of overtraining in concurrent discriminations and assessed the effect against single discrimination training in rats. In Experiment 1 overtraining facilitated reversal in Group W, in which rats were given concurrent training on two simultaneous discrimination tasks (A and B) in original learning before both tasks were reversed. By contrast, overtraining delayed reversal in Group P, in which animals were given the same training as in Group W in original learning, but only Task A was reversed. After overtraining, Group W reversed more rapidly than Group P. Without overtraining, Group P reversed more rapidly than both Group W and Group C, in which animals were trained only on Task A before this task was reversed. Experiment 2 investigated the effects of overtraining on the reversal of a successive discrimination in Groups W, P, and C. In addition, animals in a further group, Group S, received the same concurrent training as Group W before Task B was omitted and Task A reversed. Overtraining facilitated reversal in Groups W, C, and S but delayed it in Group P. After overtraining, Group W reversed more rapidly than Groups P, S, and C. Both Groups S and C also reversed more rapidly than did Group P. Without overtraining, Group P reversed more rapidly than Groups W, S, and C. There were no significant differences in reversal performance among Groups W, S, and C. These findings indicate that the effects of overtraining on reversal learning in concurrent discriminations differ from those observed in single discriminations.     

Transfer of Learning Between Concurrent and Matching (or Non-matching)-to-Sample Discriminations in Rats

Three experiments examined transfer of learning between a concurrent discrimination and a matching (or non-matching)-to-sample discrimination in rats. In Experiment 1, rats were trained to criterion (group NOT) or were overtrained (group OT) on two concurrent discriminations. Subsequently, group OT learned a matching (or non-matching) task more rapidly than did group NOT. In Experiment 2, rats were initially given matching (or nonmatching) tasks and then given whole or half reversal with these tasks. Group whole reversed faster than group half. In Experiment 3, two groups of rats were trained on matching (or non-matching) tasks, and then given concurrent discrimination training, followed by either whole or half reversal training (groups matching and non-matching). Another group (group control) received a pseudo-discrimination followed by the same training in Phases 2 and 3 as groups matching and non-matching. In groups matching and non-matching, rats learned the whole reversal more rapidly than the half reversal. But the opposite result was observed in group control. These findings suggest that transfer effects reported in Experiments 1 and 2 are governed by the same mechanism for the formation of associations between stimuli.     

Massed trial Overtraining Effects on Extinction and Reversal Performance in Turtles (Geoclemys reevesii)

Two experiments with turtles (Geoclemys reevesii) examined the overtraining extinction effect (OEE) and the overtraining reversal effect (ORE), under massed training conditions. In Experiment 1, three groups of turtles received 7, 14, or 21 sessions of training in a runway situation for food reinforcement, followed by 15 sessions of extinction. Extinction was faster, the greater the number of acquisition sessions. In Experiment 2, the two groups of turtles learned a spatial discrimination for food reinforcement either to a criterion (19 of 20 correct responses), or to that criterion plus 100 additional trials of overtraining. When the validity of the positions was reversed, learning was faster for the overtrained group than for the group trained to a criterion. This evidence of the OEE and the ORE is the first yet reported for a reptile. The results are discussed in the framework of comparative research on rewardschedule effects.     

Effects of error and errorless discrimination acquisition on reversal learning

The effectiveness of trial-and-error, graded-choice, and verbal-instruction procedures on the acquisition and maintenance of a two-choice simultaneous color discrimination in an intradimensional double-reversal learning situation was studied using 18 first-grade children. After acquiring a red-green discrimination during one 70-trial session, the discriminative roles of the stimuli were reversed for 30 trials, followed by a second reversal for 30 trials. Children in the graded-choice and verbal-instruction groups acquired and maintained the discriminations with fewer errors than children who learned by trial and error. The importance of the results in terms of two-stage discrimination learning theories is pointed out and similarities between errorless learning and overtraining are discussed.     

Overtraining, transfer to proprioceptive control and position reversal

If rats are overtrained on a visual discrimination they generally learn the reversal of the discrimination faster than non-overtrained rats. In position discriminations, however, this effect does not generally hold—indeed several investigators have found overtraining to retard position reversal. One of the important differences between the two types of problem seems to be the presence of irrelevant cues in visual discriminations, and their absence in position discriminations. It is suggested that a second important feature of position discriminations is that overtraining usually causes control of the maze running habit to be transferred from external to proprioceptive stimuli, and that successful reversal cannot normally occur until external control is re-established. In two experiments a study by Krechevsky and Honzik (1932) is repeated with certain modifications, with results that support this hypothesis; and a third experiment provides direct evidence of transfer to proprioceptive control in a T-maze. It is shown that this analysis will explain the apparently conflicting results of all recent position reversal experiments.     

An investigation of reversal learning in octopus vulgaris lamarck

Eighteen octopuses were trained by a method of successive discrimination training to discriminate between a vertical and a horizontal rectangle. They were then overtrained for either 20 or 60 trials, after which they learnt the reverse discrimination. At the beginning of each reversal they were given 20 trials pretraining on the new positive stimulus. The subjects completed from two to nine reversals.

It was found that the amount of overtraining had no effect on the rate of learning the subsequent reversal. The first four reversals all took significantly longer to learn than the original problem, but did not differ significantly from one another. However, examination of the raw data suggests that later reversals do take longer to learn. The performance when learnt (i.e. on the first day of overtraining) was as good after reversal learning as after the learning of the original problem.

The results do not show definite signs that could be interpreted as an exhaustion of a limited supply of neurones available for learning.     

Transfer after pretraining with the negative stimulus

Two groups of rats trained in the jumping stand acquired a horizontal stripes vs. vertical stripes discrimination and then learned its reversal. The groups differed in their pretraining. One group had previously learned a black vs. white discrimination; the other a discrimination in which the S- was the same as that used in the horizontal against vertical problem. S- pretraining facilitated not only acquisition but also the reversal of the orientation discrimination thereby confirming a prediction that reversal learning will be rapid when the original problem is learned chiefly in terms of the S-. It is suggested that overtraining may facilitate reversal learning, in some cases at least, by inducing animals to concentrate on the S-.     

Elemental and Configural Processes in Patterning Discrimination Learning

Three experiments used appetitive conditioning with rats to examine the involvement of elemental and configural processes in positive and negative patterning discriminations. The first experiment demonstrated that negative and, to some extent, positive patterning discriminations were learned more rapidly when these discriminations consisted of stimulus elements that had previously been the reinforced as opposed to the non-reinforced elements of a simple discrimination. Experiment 2 revealed an excitatory summation effect during the early phase of negative patterning learning that depended upon discrimination pretraining. The final experiment demonstrated faster discrimination learning between the compound and the less salient, rather than the more salient, element of an instrumental patterning task. The present set of results were interpreted as reflecting the possibility, consistent with connectionist theory, that internal representations of the conditioned stimuli change over the course of a patterning discrimination.     

The effects of amount of training per reversal on successive reversals of a color discrimination

Three groups of pigeons were trained on a red-green discrimination in which the stimuli were alternately presented in a multiple schedule of reinforcement. The discrimination was reversed 24 times. Groups were given 1, 2, or 4 hr of training on each discrimination. Increasing the length of training had two principal effects on reversal performance: it increased the rate of extinction of responding to one of the stimuli and increased the rate of reacquisition of responding to the other. The latter effect involved both an increase in reacquisition of responding to a positive stimulus within reversals and an increase in recovery of responding to the previous negative stimulus between reversals. Improvements in performance of each group over the series of reversals were qualitatively similar to the two effects of length of training on each discrimination, and were analogous to effects obtained in other studies involving overtraining and successive reversals of simultaneous discriminations.     

Discrimination and Reversal Learning by Toddlers Aged 15-23 Months

Few studies have investigated simple discrimination and discrimination reversal learning by children younger than 2 years. Extant research has shown that teaching discrimination reversals may be challenging with this population. We used social reinforcement and correction procedures to teach simple simultaneous discrimination and discrimination reversal tasks involving three pairs of animal pictures displayed in a paper notebook. Participants were eight typically developing toddlers aged 15-23 months. All learned at least one simple discrimination/discrimination reversal problem. Four children learned all problems and showed evidence of learning set formation. Perhaps surprisingly, discrimination reversals were sometimes learned more rapidly than original discriminations. The procedures suggest a potentially efficient methodology for investigating more complex aspects of relational learning in toddlers.

     

A primacy effect in monkeys when list position is relevant

In Experiment 1 (1a and 1b), Rhesus monkeys (Macaca mulatta) learned lists of two-choice visual discriminations in which list position was relevant to discrimination performance. For example, Stimulus A was the rewarded stimulus if it was presented at List Position 1, but was not rewarded if it was presented at any other position in the list; similarly, Stimulus B was rewarded only at List Position 2, and so on. In learning these lists, all animals showed a marked primacy effect. In Experiment 2 (2a and 2b), Rhesus monkeys and Cynomolgus monkeys (M. fascicularis) learned lists of visual discriminations in which each visual stimulus occupied a fixed position in a list, but list position was not relevant to discrimination performance. For example, Stimulus E was always rewarded, and was always presented at List Position 1. To increase the salience of list beginning as a distinctive event, successive presentations of the list were separated by 24-hr intervals. In Experiment 2 there was no primacy effect, however. These results show for the first time that a primacy effect can be obtained in visual discrimination learning by monkeys. Furthermore, they suggest that it is obtained only when list position is relevant to the discrimination learning task.     

Occasion-setting training renders stimuli more similar: Acquired equivalence between the targets of feature-positive discriminations

In two experiments rats received training on two concurrent appetitive feature-positive discriminations. A preliminary test in Experiment 1 confirmed previous demonstrations of the transfer of occasion-setting properties—the feature from one of these discriminations was better able to facilitate responding to the occasion-set target CS from the second discrimination than to a control stimulus that had not been the subject of occasion-setting. The source of this transfer was investigated in a second phase of training, and in Experiment 2. In both experiments one of the occasion-set CSs was paired with food, and generalization of appetitive conditioned responding from this stimulus to the second occasion-set CS, and to a control cue, was examined. There was more generalization from the first occasion-set CS to the second CS that had also been occasion-set than to the control cue. This is taken as evidence that occasion-set CSs are rendered more similar as a result of their common training history. The implications of these findings for explaining transfer of occasion setting are discussed.     

EXTENSIVE TRAINING IS INSUFFICIENT TO PRODUCE THE WORK‐ETHIC EFFECT IN PIGEONS

Zentall and Singer (2007a) hypothesized that our failure to replicate the work‐ethic effect in pigeons (Vasconcelos, Urcuioli, & Lionello‐DeNolf, 2007) was due to insufficient overtraining following acquisition of the high‐ and low‐effort discriminations. We tested this hypothesis using the original work‐ethic procedure (Experiment 1) and one similar to that used with starlings (Experiment 2) by providing at least 60 overtraining sessions. Despite this extensive overtraining, neither experiment revealed a significant preference for stimuli obtained after high effort. Together with other findings, these data support our contention that pigeons do not reliably show a work‐ethic effect.     

Common coding in symbolic matching tasks with humans: Training with a common consequence or antecedent

The present experiments explored the importance of training with a common antecedent or consequence for common coding in symbolic matching-to-sample tasks with human subjects using reversal and transfer tests. Experiment 1 assessed common coding following training in many-to-one (MTO) and one-to-many (OTM) symbolic matching-to-sample tasks by comparing learning of partial and total reversals of these contingencies. Experiment 2 assessed common coding in MTO and OTM tasks by comparing performances in transfer tests when the common coding relations in the transfer phase were either consistent or inconsistent with those present during initial training. Evidence for common coding in the MTO and OTM discriminations was obtained in both experiments, although the amount of common coding was greater in the MTO discrimination in Experiment 1. These data are discussed in terms of associative mediational approaches to common coding phenomena. It is suggested that a basic requirement of an associative theory is that common coding should be more likely to occur when the stimuli are trained with a common consequence than when they are trained with a common antecedent, and that this requirement has been at least partly satisfied in the present studies.     

The role of R-S1 expectancy in discrimination and discrimination reversal learning

Four experiments assessed the role of response-reinforcement (R-S¹) expectancy as rats either learned a discrimination or a discrimination reversal. Experiment 1 showed that the higher the percentage of reinforcement during nondiscriminative pretraining the more quickly a subsequent discrimination is learned. Experiment 2 demonstrated that the overlearning reversal effect (ORE) can be obtained even though the overtraining phase consists of responses to a single neutral card. In Experiment 3 subjects were again overtrained on a single neutral stimulus under conditions of varying reinforcement. ORE was apparent under reinforcement of a high percentage of responses but was not apparent under reinforcement of a low percentage. Experiment 4 revealed that the fewer errors a subject makes prior to reversal the better its reversal performance is. Results of these studies were discussed in terms of generalized attention theories and the expectancy notions of Bolles (Psychological Review, 1972, 79(5), 394–409.     

The overtraining reversal effect in rats: A function of task difficulty

Two experiments were conducted with rats. The first study showed that in the T-maze a brightness discrimination learning problem was more difficult than a spatial learning problem, but in a Ross-maze a brightness problem was less difficult than a spatial task. T-maze brightness and Ross-maze spatial tasks were found to be of equal difficulty.

In the second experiment rats were trained either on a brightness or spatial discrimination reversal problem in the Ross-maze. It was found that overtraining facilitated reversal performance in the spatial task but not in the brightness problem. The theoretical implications of these results were discussed.     

Sequential effects on discrimination reversal

In Experiment 1 the sequence of trials to the positive (S+) and negative (S?) discriminanda was varied between groups during acquisition and reversal of a successive brightness discrimination. In Experiments 2 and 3, groups received different reward sequences in Phase 1 within S+. In general, groups given transitions from nonrewarded trials to rewarded trials (N-R transitions) in Phase 1 learned both the original discrimination and its reversal more slowly than groups given schedules devoid of N-R transitions. The results were discussed in relation to previously reported effects of partial reinforcement on acquisition and reversal of a discrimination and the role of sequential variables and internal, reward-produced cues in discrimination learning, reversal learning, and nonreversal shifts.     

A role for stimulus generalization in conditional discrimination learning

In each of three experiments on discrimination learning by rats, whether or not a 10-sec target stimulus was followed by food was determined by the nature of a 2-min background stimulus that accompanied it. A conditional discrimination was employed in Experiment 1 such that background A indicated food would follow one target but not the other, whereas this relationship between the targets and food was reversed in the presence of background B. Experiment 2 employed two feature-positive discriminations. Subsequent test trials revealed that the background for one discrimination was able to enhance responding during the target for the other discrimination. Experiment 3 employed a feature-positive and a feature-negative discrimination prior to test trials in which each target was presented separately during a compound of both background stimuli. The compound enhanced responding to the target from the feature-positive discrimination and reduced it to the target from the feature-negative discrimination. We suggest that to accommodate all these findings, the best explanation is provided by a configural model of Pavlovian conditioning.     

Conditions favoring superconditioning of irrelevant conditioned stimuli

Three appetitive conditioning experiments with rats found partial learning of complex XA+, XB+, XAB- (+ stands for reinforced; - stands for unreinforced) negative patterning discriminations with intermixed A+ and B+ trials (Experiment 1). AB+ trials (Experiment 2), and A+, B+, and AB+ trials (Experiment 3). In all experiments, differential responding emerged more slowly during the learning of the negative patterning discriminations than during learning of the XA+, XB+, XC- control discriminations. Additionally, the negative patterning groups responded more to X than to a separately reinforced Y on unreinforced test trials: thus, X derived superexcitatory properties. This pattern was reversed in the control groups. Results are consistent with theories that allow for different activation patterns when elements are combined.     

Elemental and configural processing of novel cues in deterministic and probabilistic tasks

Three experiments examined whether transfer of past learning depends on how well the original discrimination is learned. To vary terminal learning levels, cues were either perfect (deterministic) or imperfect (probabilistic) predictors of a trial’s outcome. Participants in Experiment 1 acquired a configural, an elemental or a control discrimination. Tests for generalization showed that past learning influenced the processing of new compounds formed from elements of the original discrimination, especially so when the original discrimination was deterministic. Similar results were found in Experiment 2 when the test stimuli were elements derived from novel compounds presented after the original discrimination was acquired. Experiment 3 used filler trials to equate learning in the probabilistic and deterministic tasks, and demonstrated that final levels of learning, rather than task per se, was the critical variable mediating transfer. Implications for rule-based and associative theories are discussed.