Application of a graded choice procedure to obtain errorless learning in children

A simultaneous, two-choice color discrimination was carried out with three groups of four- to seven-year-old children. For Groups I and II, the opportunity to respond to the incorrect stimulus was controlled (graded) over three different conditions. First, only a red light (S+) and its retractable bar were presented (16 trials for Group I and 316 trials for Group II). Second, a green light (S−) was added with its correlated bar retracted for 14 trials. Third, 40 trials were given with both stimuli on and their correlated retractable bars extended. The opportunity to respond to S− was not graded for Group III children. They experienced only the third condition applied to Groups I and II. Responses to S+ were reinforced for all three groups, while responses to S− were not. Children in the first two groups made from zero to three responses to S−, while the control children emitted 11 to 46 errors. The results demonstrate that fading in S− or presenting S− early in the training procedure are sufficient, but not necessary conditions for errorless learning.     

Infantile stimulation and its effects on frustration- and fear-motivated behavior in rats

Infant rats that were either removed from the nest each day (handled) or left undisturbed (nonhandled) were, in adulthood, given 72 food-reinforced runway acquisition trials followed by 24 trials of extinction training with or without shock. Handled and nonhandled control animals were given runway training without food reinforcement. Reinforced rats ran faster than nonreinforced rats, and handled rats ran faster than nonhandled rats during the initial trials of runway acquisition irrespective of the reinforcement condition. Nonhadled rats stopped running sooner than handled rats when shock was introduced in the goalbox, but differences between handled and nonhandled rats given extinction training without shock were small. Results of a second experiment showed no differences between handled and non-handled rats in the magnitude of the depression effect after an incentive shift. It was concluded that infantile handling had little effect on frustration-motivated behavior, but did affect fear-motivated behavior.     

Microcomputer-based programmed instruction in identity matching to sample for persons with severe disabilities

Three individuals with mental retardation, who had failed to learn identity matching to sample with standard fading and prompting procedures, were given microcomputer-based programmed instruction. The methods were based on an analysis of two features of typical identity matching procedures: (a) within each trial, the current sample stimulus must control comparison selection, and (b) across trials, specific comparison stimuli must function both as S+ and as S–, depending upon the sample presented (conditional discrimination). During the first phase of training, one-trial acquisition of discriminative stimulus control was established in a nonconditional discrimination context where the S+ or S– functions of specific stimuli did not change from trial to trial. After one-trial learning was established, conditional discrimination was programmed by gradually introducing reversals of S+/S– stimulus functions. All three participants learned to perform conditional identity matching. Avenues for further analysis of the prerequisites for conditional discrimination and continued development of programmed methods are discussed.     

Discrimination learning with and without “errors”

Responses to S− (“errors”) are not a necessary condition for the formation of an operant discrimination of color. Errors do not occur if discrimination training begins early in conditioning and if S+ and S− initially differ with respect to brightness, duration and wavelength. After training starts, S−'s duration and brightness is progressively increased until S+ and S− differ only with respect to wavelength. Errors do occur if training starts after much conditioning in the presence of S+ has occurred or if S+ and S− differ only with respect to wavelength throughout training. Performance following discrimination learning without errors lacks three characteristics that are found following learning with errors. Only those birds that learned the discrimination with errors showed (1) “emotional” responses in the presence of S−, (2) an increase in the rate (or a decrease in the latency) of its response to S+, and (3) occasional bursts of responses to S−.     

Differential autoshaping to common and distinctive elements of positive and negative discriminative stimuli

The learning by hungry pigeons of a discrimination between two successively presented compound visual stimuli was investigated using a two-key autoshaping procedure. Common and distinctive stimulus elements were simultaneously presented on separate keys and either followed by food delivery, S+, or not, S−. The subjects acquired both between-trial and within-trial discriminations. On S+ trials, pigeons pecked the distinctive stimulus more than the common stimulus; before responding ceased on S− trials, they pecked the common stimulus more than the distinctive one. Mastery of the within-display discrimination during S+ trials preceded mastery of the between-trials discrimination. These findings extend the Jenkins-Sainsbury analysis of discriminations based upon a single distinguishing feature to discriminations in which common and distinctive elements are associated with both the positive and negative discriminative stimuli. The similarity of these findings to other effects found in autoshaping—approach to signals that forecast reinforcement and withdrawal from signals that forecast nonreinforcement—is also discussed.     

Memory retrieval and discrimination learning

A better reinforcement schedule may be associated with one exteroceptive stimulus (S+) than with another exteroceptive stimulus (S−). While all theories agree that performance in such discrimination tasks is affected by the reinforcement schedules associated with the exteroceptive S+ and S− cues, some theories suggest that performance is also affected by the reinforcement schedule associated with interoceptive reward produced cues. The two experiments reported here were concerned with identifying the conditions under which the interoceptive cues produced by nonreward come to affect performance. According to one hypothesis, such cues will acquire control over approach responding if animals make an approach response in their presence, but not otherwise. According to the memory hypothesis, the memory of nonreinforcement will become a signal for reinforcement, thus invigorating performance, if it is retrieved on a rewarded trial. In two experiments, two groups made strong approach responses to the nonreinforced cues on S− trials, but the memory of nonreward was better retrieved on a subsequent rewarded trial in one group than in the other. Subsequently, both groups were extinguished. The extinction findings support the memory view.     

A search for contrast effects in discrete-trial discrimination learning by pigeons

Behavioral contrast has often been observed in free-operant experiments with pigeons, rarely in discrete-trial experiments with rats. Although Jenkins (1961) and Terrace (1963) have reported a discrete-trial contrast effect in pigeons, a series of experiments reported here found no evidence that latency of responding to S+ in a discrete-trial situation was reliably decreased by alternating reinforced trials to S+ with nonreinforced trials to S?. Latency of responding to S+ was affected neither by the length of the preceding intertrial interval (within the range of 10–60 sec), nor by whether the preceding trial had been to S+ or to S?. The results of two of these experiments suggested that the appearance of positive contrast in Jenkins's experiment was a consequence of differences in the variability of the intertrial interval experienced by control and discrimination groups. In two final experiments, employing standard free-operant procedures, contrast was observed as an increase in rate of responding to S+, but not as a decrease in latency of the first response on each S+ trial. The implication is that contrast effects are more readily observed with the rate measures of free-operant experiments than with the latency measures of discrete-trial experiments.     

Discrete-trial alternation in the rat

The acquisition and maintenance by rats of single alternation, double alternation, and four other repeating patterns of reinforced and non-reinforced trials was studied in a discrete-trial lever-pressing situation. The rats learned all these patterns in a small number of experimental sessions. Single alternation was learned more rapidly than the more complex patterns. Rate of learning single and double alternation decreased moderately as inter-trial interval increased. Abrupt changes in the scheduling of trials, either by doubling the inter-trial interval or by shifting from fixed to variable trial spacing, temporarily disrupted the patterned performance. Two hypotheses concerned with the means by which the rats could have learned to conform to the pattern were examined: (1) “timing” of the interval between successive reinforcements; and (2) control of responding on a trial by the outcome of preceding trials, depending on the consistency with which these outcomes were associated with reinforced or non-reinforced trials in the pattern and on how many trials back these outcomes occurred. The second hypothesis accounted for the relative frequency of errors on trials at various locations in the sequences, and predicted most of the changes in error frequency observed in experiments in which “inter-trial stimuli” were added to the sequences.     

On conditioned reinforcing effects of negative discriminative stimuli

Observing responses by pigeons were studied during sessions in which a food key and an observing key were available continuously. A variable-interval schedule and extinction alternated randomly on the food key. In one condition, food-key pecking during extinction decreased reinforcement frequency during the next variable-interval component, and in the other condition such pecking did not affect reinforcement frequency. Observing responses either changed both keylight colors from white to green (S+) or to red (S−) depending on the condition on the food key, or the observing responses never produced the S+ but produced the S− when extinction was in effect on the food key. Observing responses that produced only S− were maintained only when food-key pecking during extinction decreased reinforcement frequency in the subsequent variable-interval component. The red light conformed to conventional definitions of a negative discriminative stimulus, rendering results counter to previous findings that production of S− alone does not maintain observing. Rather than offering support for an informational account of conditioned reinforcement, the results are discussed in terms of a molar analysis to account for how stimuli acquire response-maintaining properties.     

Stimulus control of schedule-induced activity in pigeons during multiple schedules

Stimulus control of schedule-induced general activity was demonstrated with pigeons using multiple schedules of response-independent food delivery. In Experiment 1, the introduction of food during a multiple variable-time 30-second variable-time 30-second schedule produced a tenfold increase in activity above the no-food baseline. Each pigeon developed stable differential activity rates during the components (correlated with red and green lights) of a multiple variable-time 30-second extinction schedule. Lengthening the extinction component from 1 to 7 minutes increased the rate differences and produced a reliable pattern of responding during S− (the stimulus correlated with extinction): Activity rate was high immediately following the change from S+ (the stimulus correlated with variable-time 30-second) to S−, then decreased abruptly and remained low throughout the middle of the interval, and subsequently showed a positively accelerated increase until the stimulus changed to S+. In Experiment 2, three pigeons were exposed to a mixed variable-time extinction schedule prior to a multiple variable-time extinction schedule. Auditory rather than visual stimuli were used to determine the generality of Experiment 1 results. The multiple- versus mixed-schedule results indicated that stimulus control of activity occurred for two of the birds, but rate differences between S+ and S− were much less than those demonstrated with visual stimuli. A direct comparison of visual and auditory stimulus control in Experiment 3 supported this conclusion. These parallels between the stimulus control of reinforced responding and that of schedule-induced activity suggest that the stimulus control of induced activity may be a factor in operant stimulus control.     

The effect of negative stimulus presentations on observing-response rates

Theories of observing differ in predicting whether or not a signal for absence of reinforcement (S−) is capable of reinforcing observing responses. Experiments in which S− was first removed from and then restored to the procedure have yielded mixed results. The present experiments suggest that failure to control for the direct effect of presenting S− may have been responsible. Pigeons and operant procedures were used. Experiment 1 showed that presentations of S−, even when not contingent on observing, can raise the rate of an observing response that was reinforced only by presentations of a signal (S+) that accompanied a schedule of food delivery. Experiment 2 showed that this effect resulted from bursts of responding that followed offsets of S−. Experiment 3 showed that, when the presence of S− was held constant, lower rates occurred when S− was dependent on, rather than independent of, observing. These results support theories that characterize S− as incapable of reinforcing observing responses.     

Discrimination and differentiation of response number in stimulus directed pecking of pigeons.

In Experiment 1, autoshaping trials terminated with food only if pigeons emitted more than a target number of responses during a trial in one condition and fewer than a target number in another. The median number of responses per trial shifted in accordance wtih the requirements. The responding of yoked-control birds that received response-independent reinforcers did not vary with the response requirements. In Experiment 2, the number of responses in autoshaping trial became the discriminative stimulus for reinforcement in the second component of a chained schedule. In one condition, responding was reinforced only if the number of responses in the first component was above a target value; in the other condition, responding was reinforced only if the number was below the target value. The distribution of the first-component response numbers did not shift systematically between discrimination conditions, but response rates in the second component indicated that the number of responses in the autoshaping trial was a discriminable property behavior.     

Studies in observational paired-associate learning: Informational,social, and individual difference variables

Four experiments examined the relative importance of informational (proportion of correct responses and kinds of errors emitted by a model), social (model competency, sex of model, video vs. audio taped model), and individual difference (sex of subject, grade) variables in observational paired-associate learning. In Experiments I–III, vicarious subjects received cycles of study-model-test trials, while direct subjects were given the same sequences with intervening test or stimulus familiarization trials. In Experiment IV, vicarious subjects received cycles of study-test-model-test trials, while direct subjects received the cycles with a test trial replacing the model trial. No confirmation was provided on test and model trials. Whereas the effects attributable to social and individual difference variables were generally negligible, mere accuracy of the model's responses repeatedly covaried with performance on the last test trial of each cycle. Conditional analyses established that (1) vicarious facilitation is comparable across cycles and localized in items responded to incorrectly on immediately preceding test trials, and (2) observers learn fewer incorrect than correct model responses. Vicarious groups performed at reliably higher levels than direct subjects on model correct but not incorrect items. The results strongly suggest a close correspondence between direct and vicarious verbal learning principles and mechanisms.     

Conditions favoring superconditioning of irrelevant conditioned stimuli

Three appetitive conditioning experiments with rats found partial learning of complex XA+, XB+, XAB- (+ stands for reinforced; - stands for unreinforced) negative patterning discriminations with intermixed A+ and B+ trials (Experiment 1). AB+ trials (Experiment 2), and A+, B+, and AB+ trials (Experiment 3). In all experiments, differential responding emerged more slowly during the learning of the negative patterning discriminations than during learning of the XA+, XB+, XC- control discriminations. Additionally, the negative patterning groups responded more to X than to a separately reinforced Y on unreinforced test trials: thus, X derived superexcitatory properties. This pattern was reversed in the control groups. Results are consistent with theories that allow for different activation patterns when elements are combined.     

Human peak shift: Analysis of the effects of three-stimulus discrimination training

In a series of studies, the effects of different types of intradimensional discrimination training on human auditory frequency generalization were examined. When subjects were trained with a single S− located on one or the other side of S+, postdiscrimination gradients were displaced away from S−. Subjects trained with two negative stimuli both on one side of S+ showed a greater extent of displacement with true peak shift. In a second experiment the procedures were repeated with two fixed amounts of training: either 12 or 42 training trials. Again the subjects trained with two negative stimuli showed more shift than those trained with one S−, and this effect was independent of amount of training. Experiment 3 showed increased peak shift when two positive stimuli surrounded a central S− as compared to groups with a single S+ and S−. The general conclusion is that training with more difficult, three-stimulus discrimination problems results in enhanced peak shift.     

The effects of early handling on the partial reinforcement extinction effect and the partial punishment effect in male and female rats

Handled (Day 1-22) and non-handled infantile Wistar rats were tested in maturity for the partial reinforcement extinction effect (PREE) and the partial punishment effect (PPE). In Experiments 1 and 2, mature male and female rats were trained to run in an alley for food reward on a 1-trial/day schedule. In the PREE paradigm (Experiment 1), the partially reinforced group (PRF) received reinforcement on a quasi-random 50% schedule, while the continuously reinforced group (CRF) received reinforcement on every trial. In the test stage, both groups were given extinction training. In the PPE paradigm (Experiment 2), the partially punished (PP) group received, together with continuous reinforcement, shocks on a quasirandom 50% schedule, while the continuously reinforced group was reinforced on every trial. In test, all animals were given both reinforcement and shock on every trial. In Experiment 1, PREE—i.e. increased resistance to extinction in the PRF as compared to the CRF group—was more pronounced in the handled animals. More specifically, no PREE was obtained in the non-handled males, and in the non-handled females the PREE was reduced compared to the handled females. The results of Experiment 2 revealed no effect of handling or sex on PPE, that is, increased resistance to punishment in the PP group as compared to the CRF group was evident in all four conditions. In Experiment 3, handled and non-handled male rats were tested for the PREE using a multi-trial procedure in an operant chamber. PREE was obtained in the handled but not in the non-handled animals. The implications of these results for the differential effects of handling on male and female rats and the distinction between the PREE and PPE paradigms are discussed.     

Sources of Intertrial Proactive Interference in Rats’ Short-Term Memory in a Delayed Successive Matching-to-Sample Modality Discrimination

Rats were trained on a delayed successive matching-to-stimulus modality task consisting of onset of chamber lights or a tone for the sample stimulus, S1, and a comparison stimulus, S2. Lever pressing to S1 was reinforced as was lever pressing to its matching S2 (light–light or tone–tone pairs) but not to its mismatching S2 (light–tone, tone–light pairs). The interval between S1 and S2 within a trial, the retention interval (RI), was varied between 1 and 6 s within sessions while the interval between S2 and the next S1, the intertrial interval (ITI), was reduced from 24 to 12 s and finally to 6 s over blocks of sessions. In Experiment 1, where S1 was kept at 2 s and S2 at 10 s, rats’ matching accuracy declined over the longer RI, was slightly disrupted as ITIs were reduced to 6 s only over 1-s RIs, and was generally poorer to the tone than light S1. In Experiment 2, where both stimuli were 10 s increasing RIs caused steeper declines in matching accuracy to the tone S1 than light S1 and decreasing ITIs to 6 s disrupted rats performance over both RIs. Matching accuracy to the tone but not to the light S1 was also poorer when a preceding trial's S2 was a light S2 than when it was a tone S2 only during Experiment 2. Thisintertrial stimulus disagreementeffect was not influenced by ITI duration. These results suggest that intertrial proactive interference in delayed matching tasks consists of two separate and independent processes in rats similar to those found in pigeons (Edhouse & White, 1988).     

MODIFICATION OF SHUTTLE BOX TO IMPROVE RATE OF AVOIDANCE LEARNING IN RATS

W allgren , H. & S avolainen , S. Modification of shuttle-box to improve rate of avoidance learning in rats. Scand. J. Psychol ., 1962, 3 , 78–80.—Acquisition by rats of a conditioned avoidance response seems to be retarded in an ordinary shuttle-box by the necessity to re-enter the compartment where shocks have previously been received. To avoid this, a four-compartment box was introduced in which the animals can proceed in one direction. Rats were given either continuous trials until nine avoidance responses were made during 10 consecutive trials, or 30 trials per day until 27 correct responses were made during one session. With both methods of training, the rate of learning was approximately 40 per cent more rapid in the four-compartment box than in the ordinary shuttle-box.     

Intertrial interval effects on internal stimulus control of behavior in brightness differential conditioning

In Experiment 1, groups were given a trial sequence in differential conditioning in which all S+ trials preceded all S? trials (+? schedule) or one in which some S+ trials followed S? trials (+?+ schedule) and either a 1- or a 30-min intertrial interval (ITI). ITI affected discrimination learning only in the +? schedule condition; schedule affected discrimination only at massed trials. In Experiment.2, all groups received a +?+ schedule. In two groups, given a 1- or 15-min ITI between all trials, discrimination learning was independent of ITI. Discrimination learning was facilitated in two other groups given a 1-min ITI between all trials except between S? and the subsequent S+ trial, when the ITI was either 15 or 60 min. The results were discussed in terms of their implications for internal reward-related stimulus control of behavior in differential conditioning.     

The acquisition of conditioned responding

This report analyzes the acquisition of conditioned responses in rats trained in a magazine approach paradigm. Following the suggestion by Gallistel, Fairhurst, and Balsam (2004), Weibull functions were fitted to the trial-by-trial response rates of individual rats. These showed that the emergence of responding was often delayed, after which the response rate would increase relatively gradually across trials. The fit of the Weibull function to the behavioral data of each rat was equaled by that of a cumulative exponential function incorporating a response threshold. Thus, the growth in conditioning strength on each trial can be modeled by the derivative of the exponential--a difference term of the form used in many models of associative learning (e.g., Rescorla & Wagner, 1972). Further analyses, comparing the acquisition of responding with a continuously reinforced stimulus (CRf) and a partially reinforced stimulus (PRf), provided further evidence in support of the difference term. In conclusion, the results are consistent with conventional models that describe learning as the growth of associative strength, incremented on each trial by an error-correction process.