Acquisition of matching-to-sample performance in rats using visual stimuli on nose keys.

Steady and blinking white lights were projected on three nose keys arranged horizontally on one wall. The procedure was a conditional discrimination with a sample stimulus presented on the middle key and comparison stimuli on the side keys. Three rats acquired simultaneous "identity matching." Accuracy reached 80% in about 25 sessions and 90% or higher after about 50 sessions. Acquisition progressed through several stages of repeated errors, alteration between comparison keys from trial to trial, preference of specific keys or stimuli, and a gradual lengthening of strings of consecutive trials with correct responses. An analysis of the acquisition curves for individual trial configurations indicated that the matching-to-sample performance possibly consisted of separate discriminations.     

Effects of error and errorless discrimination acquisition on reversal learning

The effectiveness of trial-and-error, graded-choice, and verbal-instruction procedures on the acquisition and maintenance of a two-choice simultaneous color discrimination in an intradimensional double-reversal learning situation was studied using 18 first-grade children. After acquiring a red-green discrimination during one 70-trial session, the discriminative roles of the stimuli were reversed for 30 trials, followed by a second reversal for 30 trials. Children in the graded-choice and verbal-instruction groups acquired and maintained the discriminations with fewer errors than children who learned by trial and error. The importance of the results in terms of two-stage discrimination learning theories is pointed out and similarities between errorless learning and overtraining are discussed.     

Simultaneous auditory discrimination.

Stimuli in many visual stimulus control studies typically are presented simultaneously; in contrast the stimuli in auditory discrimination studies are presented successively. Many everyday auditory stimuli that control responding occur simultaneously. This suggests that simultaneous auditory discriminations should be readily acquired. The purpose of the present experiment was to train rats in a simultaneous auditory discrimination. The apparatus consisted of a cage with two response levers mounted on one wall and a speaker mounted adjacent to each lever. A feeder was mounted on the opposite wall. In a go-right/go-left procedure, two stimuli were presented on each trial, a wide-band noise burst through one speaker and a 2-kHz complex signal through the other. The stimuli alternated randomly from side to side across trials, and the stimulus correlated with reinforcement for presses varied across subjects. The rats acquired the discrimination in 400 to 700 trials, and no response position preference developed during acquisition. The ease with which the simultaneous discrimination was acquired suggests that procedures, such as matching to sample, that require simultaneous presentation of stimuli can be used with auditory stimuli in animals having poor vision.     

Influence of two types of information trials on the formation of a discrimination-reversal learning set in Japanese monkeys

Abstract: Three groups of male adult Japanese monkeys were trained in 30 discrimination-reversal learning-set (LS) problems using the Wisconsin General Test Apparatus. A control group ( N = 3) was trained in the standard procedure: acquisition of up to 12 consecutive correct responses, reversal to the same criterion, and then shift to a new problem. To the other two groups, three information trials signaling the stimulus value in reversal were given after they reached the criterion in acquisition. Subjects in the positive-stimulus information (PSI) group ( N = 4) were exposed only to the reversal positive stimulus, and a response to it was rewarded. Subjects in the negative-stimulus information (NSI) group ( N = 4) were exposed only to the reversal negative stimulus, and any response to it was not rewarded. Information trials reduced reversal errors and NSI trials were more effective than PSI trials in error reduction ( p < .05). Information trials also aided in acquisition: the NSI and PSI groups learned the acquisition phase of the problems with significantly fewer errors than control group ( p < .01) in the last stage of training. The implications of these results are discussed in relation to strategy learning and attention learning in LS formation.     

Redundant information in an observing-response procedure

In three observing-response experiments relevant to the information hypothesis of conditioned reinforcement, the basic procedure was one in which an observing response produced one stimulus on trials that terminated in non-contingent reinforcement and another stimulus on trials that terminated in a brief timeout. In Experiment I, the observing response consisted of a single peck or a short fixed-ratio schedule (FR 3 or FR 6), depending on the type of trial. If the single peck produced the negative stimulus and the fixed ratio produced the positive stimulus, observing responses were maintained. If the single peck produced the positive stimulus and the fixed-ratio produced the negative stimulus, observing responses were not maintained on negative trials. In the second experiment, the response key was either white or dark at the beginning of a trial, indicating whether it was a positive or negative trial. Observing responses continued to be maintained on positive trials but not on negative trials. In Experiment III, only positive or negative trials were scheduled for several sessions. Observing responses extinguished regardless of whether positive or negative trials were scheduled. The results do not support the hypothesis that making the stimuli produced by observing responses redundant will reduce observing responses.     

Extinction of a discriminative operant following discrimination learning with and without errors

Different groups of pigeons were trained to respond to red and not to green with and without errors (responses to green) under a free operant procedure, in which responding to red was intermittently reinforced, and under a trial procedure in which all responses to red were reinforced. The response to red was then extinguished under a procedure in which the discriminative stimuli were successively alternated as during discrimination training. The performances of those birds that learned the discrimination without errors under the trial procedure were seriously disrupted during extinction; the birds persistently responded to green for the first time. The performances of those subjects that learned the discrimination without errors under the free operant procedure were not disrupted during extinction. In a second experiment, the same discrimination was trained without errors under a trial procedure in which the response to red was intermittently reinforced. Extinction did not disrupt discrimination performance. Thus, errorless discrimination performance was shown to remain intact during extinction so long as the response to red was intermittently reinforced during discrimination training.     

Contrast and stimulus generalization following prolonged discrimination training

Different groups of pigeons received discrimination training in which the reinforcement-associated and extinction-associated stimuli were respectively either (a) a line tilt vs a blank key, (b) a blank key vs a line tilt, or (c) two different line tilts. The high response rates that developed to the positive stimulus in all groups during discrimination learning were maintained over 64 sessions of training. After these sessions, all subjects were tested for stimulus generalization along the line-tilt dimension. Gradients of relative (per cent) generalization around the stimulus associated with reinforcement (so-called excitatory gradients) and around the stimulus associated with extinction (so-called inhibitory gradients) were as steep as they typically are after much briefer training periods. These results do not support several of Terrace's predictions on the basis of the hypothesis that emotional responses develop to the stimulus associated with extinction during discrimination learning with errors, but eventually dissipate after extended training.     

Pigeon concept formation: successive and simultaneous acquisition

Pigeons were trained to discriminate the presence of one or more human forms in displays projected on a panel above the response key. This task was mastered, although imperfectly, with successive and with simultaneous presentations of positive and negative instances. The course of acquisition of the discrimination was similar for the two training procedures. Animals were able to transfer the discrimination from the successive to the simultaneous situation. Various tests were carried out to control for artifactual cues on which the discrimination might have been based. The discrimination was maintained when new displays were presented, when reinforcement was omitted, and when displays were inverted 180°. Animals were also able to discriminate between pairs of displays that were identical, except that one member of the pair contained a human form. The research extends the techniques used by Herrnstein and Loveland (1964), and confirms their finding that pigeons can master the concept of “person-present” in a visual display.     

Acquisition of delayed matching in the pigeon

Pigeons were exposed to three successive matching-to-sample procedures. On a given trial, the sample (red, green or blue light) appeared on a center key; observing responses to this key produced the comparison stimuli on two side keys. Seven different experimental conditions could govern the temporal relations between the sample and comparison stimuli. In the "simultaneous" condition, the center key response was followed immediately by illumination of the side key comparison stimuli, with the center key remaining on. In "zero delay" the center key response simultaneously turned the side keys on and the center key off, while in the "variable delay" conditions, intervals of 1, 2, 4, 10, and 24 sec were interposed between the offset of the sample and the appearance of the comparison stimuli on the side keys. In all conditions, a response to the side key of matching hue produced reinforcement, while a response to the non-matching side key was followed by a blackout. In procedure I all seven experimental conditions were presented in randomly permutated order. After nine sessions of exposure (at 191 trials per session, for a total of 1719 trials) the birds gave no evidence of acquisition in any of the conditions. They were therefore transferred to Procedure II, which required them to match only in the "simultaneous" condition, with both the sample and comparison stimuli present at the same time. With the exception of one bird, all subjects acquired this performance to near 100% levels. Next, in Procedure III, they were once more exposed to presentation of all seven experimental conditions in random order. In contrast to Procedure I, they now acquired the delay performance, and were able to match effectively at delays of about 4 sec.     

Effects of reinforcement scheduling on simultaneous discrimination performance

Pigeons were trained on a discrete-trials, simultaneous discrimination procedure, with confusable stimuli such that asymptotic performance was about 85% correct. Trials were terminated if no response occurred within 2 sec of stimulus onset, so that probability of responding was free to vary. The schedule of reinforcement for correct responses was varied, with the following results: (1) there was no relation between frequency of reinforcement and accuracy of responding. (2) In extinction, the probability of responding fell to low levels, but accuracy remained roughly constant. (3) When reinforcement was available after a fixed number of trials or after a fixed number of correct responses, the probability of responding increased with successive trials after reinforcement, but accuracy was generally constant. (4) When every fifth correct response was reinforced, accuracy decreased immediately after reinforcement if the birds were required to respond on every trial.     

Effects of criterion-level probing on demonstrating newly acquired discriminative behavior.

The purpose of the study was to determine whether probes of the final criterion-level discrimination administered during and after training provided an accurate measure of acquisition. Training and probe stimuli were designed to make training and probe trials initially very discriminable and then progressively less discriminable as training progressed. Initially, the discrimination required on probe trials was more difficult than the discrimination required on training trials. However, this difference in difficulty was gradually eliminated as training stimuli were topographically altered and made identical to probe stimuli by the end of training. Results showed that while correct responding was maintained throughout training, error patterns occurred on all probe trials administered during training. Error patterns developed regardless of whether probe trials occurred only at the beginning of training sessions (temporally discriminable probes) or were randomly interspersed in the training sessions (temporally indiscriminable probes). Probe error patterns seemed to be controlled by the stimulus properties of training and probe trials. Thus, probes did not measure acquisition as it occurred during training. Probe error patterns were maintained when probes were administered after completion of training. This final measure of acquisition did not agree with the demonstration of acquisition provided by the final training trial. The results suggest that probe trials can measure a different stimulus-response relationship from that trained when training starts with an easier or known discrimination and probes involve a final or criterion test of a more difficult or unknown discrimination. Stimulus control of correct responses versus error patterns is discussed.     

Errorless learning of a conditional temporal discrimination

In the present study we extended errorless learning to a conditional temporal discrimination. Pigeons' responses to a left-red key after a 2-s sample and to a right-green key after a 10-s sample were reinforced. There were two groups: One learned the discrimination through trial and error and the other through an errorless learning procedure. Then, both groups were presented with three types of tests. First, they were exposed to intermediate durations between 2 s and 10 s, and given a choice between both keys (stimulus generalization test). Second, a delay from 1 s to 16 s was included between the offset of the sample and the onset of the choice keys (delay test). Finally, pigeons learned a new discrimination in which the stimuli were switched (reversal test). Results showed that pigeons from the Errorless group made significantly fewer errors than those in the Trial-and-Error group. Both groups performed similarly during the stimulus generalization test and the reversal test, but results of the delay test suggested that, on long stimulus trials, responding in the errorless training group was less disrupted by delays.     

The emergence of symmetry in a conditional discrimination task using different responses as propioceptive samples in pigeons

In Experiment 1, 10 pigeons were exposed to a successive symbolic matching-to-sample procedure in which the sample was generated by the pigeons' own behavior. Each trial began with both response keys illuminated white, one being the "correct" key and the other the "incorrect" key. The pigeons had no way of discriminating which key was correct and which incorrect, since these roles were assigned on a random basis with the same probability of 0.5 for each key. A fixed ratio of five responses was required on the correct key. However, each time the pigeon pecked the incorrect key, the correct key response counter reset. Five consecutive pecks on the correct key was the only way to end this component, and switch off both key lights. Two seconds later, these same keys were illuminated again, one green and the other red (comparison stimuli). Now, if the correct white key had been on the left, a peck at one color produced food, and if the correct white key had been on the right, a peck at the other color produced food. When the pigeons had learned this discrimination, they were exposed to several symmetry tests (simultaneous presentations of both keys illuminated the same color-i.e., both red or both green), in order to interchange the sample with the comparison stimuli. In Experiment 2, the importance of requiring discrimination between the samples and between the comparisons was analyzed. In Experiment 3, we compared the results of Experiment 1 with a slightly different experiment, which resulted in discrimination of key position, an exteroceptive stimulus. The results showed that symmetry emerged only when different responses were used as samples.     

Choice behavior in transition: development of preference for the higher probability of reinforcement.

Ten acquisition curves were obtained from each of 4 pigeons in a two-choice discrete-trial procedure. In each of these 10 conditions, the two response keys initially had equal probabilities of reinforcement, and subjects' choice responses were about equally divided between the two keys. Then the reinforcement probabilities were changed so that one key had a higher probability of reinforcement (the left key in half of the conditions and the right key in the other half), and in nearly every case the subjects developed a preference for this key. The rate of acquisition of preference for this key was faster when the ratio of the two reinforcement probabilities was higher. For instance, acquisition of preference was faster in conditions with reinforcement probabilities of .12 and .02 than in conditions with reinforcement probabilities of .40 and .30, even though the pairs of probabilities differed by .10 in both cases. These results were used to evaluate the predictions of some theories of transitional behavior in choice situations. A trial-by-trial analysis of individual responses and reinforcers suggested that reinforcement had both short-term and long-term effects on choice. The short-term effect was an increased probability of returning to the same key on the one or two trials following a reinforcer. The long-term effect was a gradual increase in the proportion of responses on the key with the higher probability of reinforcement, an increase that usually continued for several hundred trials.     

When two actions are easier than one: How inhibitory control demands affect response processing

Numerous studies showed that the simultaneous execution of multiple actions is associated with performance costs. Here, we demonstrate that when highly automatic responses are involved, performance in single-response conditions can actually be worse than in dual-response conditions. Participants responded to peripheral visual stimuli with an eye movement (saccade), a manual key press, or both. To manipulate saccade automaticity, a central fixation cross either remained present throughout the trial (overlap condition, lower automaticity) or disappeared 200 ms before visual target onset (gap condition, greater automaticity). Crucially, single-response conditions yielded more performance errors than dual-response conditions (i.e., dual-response benefit), especially in gap trials. This was due to difficulties associated with inhibiting saccades when only manual responses were required, suggesting that response inhibition (remaining fixated) can be even more resource-demanding than overt response execution (saccade to peripheral target).     

Repeated acquisition of conditional discriminations

A new technique was developed to study the repeated acquisition of conditional discriminations. Using a discrete trial procedure, pigeons were required to learn during each session a different two-member chain of conditional discriminations. Key color and geometric forms were used as stimuli. After the pigeons had reached a steady state of relearning (40 to 60 sessions), the technique was used to investigate variables that have previously been shown to affect the repeated acquisition of response sequences. Various (0 to 90 seconds) durations of timeout for errors were investigated in Experiment I. The stimulus change associated with a timeout, rather than its duration, was found to be the critical variable in acquisition of the discrimination. Extended training on a single chain was found to reduce total errors across sessions in Experiment II. Extended training (three sessions) did not, however, change the pattern of within-session error reduction. In some cases, extended training facilitated acquisition of a partially reversed discrimination. In Experiment III, color rather than chain position was found to control behavior, for three of the four birds, as the second stimulus dimension in the conditional situation. The results of these experiments replicate and extend previous findings concerning some of the variables that affect the repeated acquisition of response sequences.     

A method for studying stimulus class dynamics using budgerigars and vocal responding

We describe a methodology for examining stimulus class dynamics in budgerigars. Three budgerigars served as subjects. Four call types were trained as operant responses to four discriminative stimuli. The birds were over‐trained in this discrimination, and then run through two conditions. In Condition 1 the birds were trained to peck two of the four stimuli when these two stimuli appeared in two novel locations, while continuing to vocalize to all four stimuli when they occurred in the original training location. An analysis of vocal errors showed that the two stimuli assigned to the peck response were more likely to become confused with one another. In Condition 2 the birds experienced symbolic matching‐to‐sample training. Vocal discrimination trials were run concurrently with this training. The observed vocal‐response errors suggest that during a matching‐to‐sample task, sample stimuli became temporarily confused with one another. The results, although primarily intended to illustrate the utility of our method, support the hypothesis that stimuli assigned a common response become more similar, or equivalent, to one another.     

Disruption of temporally organized behavior by morphine

Four pigeons pecked keys in two different procedures commonly used in the study of timing, or temporal discrimination. Sessions consisted of 40 trials. During half of the trials, two keys were presented for 50 s. Left-key pecks were reinforced according to a variable-interval 67.86-s schedule during the first 25 s of the trial, and right-key pecks were not reinforced. During the second 25 s of the trial, right-key pecks were reinforced according to the same schedule, and left-key pecks were not reinforced. In the other half of the 40-trial session, the center key was presented. The majority of these trials arranged fixed-interval 2.5-s schedules. Occasionally a probe, or peak-interval, trial was presented. These trials were 100 s in duration and terminated without reinforcement. These two procedures were used to examine the effects of morphine on indexes of timing and on patterns of responding. Morphine altered behavior in a race-dependent manner in both procedures. Low baseline (saline) response rates were increased following morphine administration, and high baseline rates were either unaffected or decreased slightly. Rate-dependent effects appeared as leftward shifts in the timing index for two-key trials and decreases in the index of curvature for fixed-interval trials. Despite large changes in response rates, no consistent shift of the peak time was observed during peak-interval trials. These results are discussed primarily in terms of rate dependency; that is, rates of responding following drug administration tend to be determined in large part by rates of responding under baseline conditions.     

Errorless transfer of a discrimination across two continua

A procedure developed earlier (Terrace, 1963) successfully trained a red-green discrimination without the occurrence of any errors in 12 out of 12 cases. Errorless transfer from the red-green discrimination to a discrimination between a vertical and a horizontal line was accomplished by first superimposing the vertical and the horizontal lines on the red and green backgrounds, respectively, and then fading out the red and the green backgrounds. Superimposition of the two sets of stimuli without fading, or an abrupt transfer from the first to the second set of stimuli, resulted in the occurrence of errors during transfer. Superimposition, however, did result in some “incidental learning”. Performance following acquisition of the vertical-horizontal discrimination with errors differed from performance following acquisition without errors. If the vertical-horizontal discrimination was learned with errors, the latency of the response to S+ was permanently shortened and errors occurred during subsequent testing on the red-green discrimination even though the red-green discrimination was originally acquired without errors. If the vertical-horizontal discrimination was learned without errors, the latency of the response to S+ was unaffected and no errors occurred during subsequent testing on the red-green discrimination.     

Stimulus duration as a measure of stimulus generalization

Four pigeons in the line-positive group were trained with a vertical line on a green background that signalled intermittent reinforcement while a plain green field signalled extinction. Four pigeons in the line-negative group were trained with the opposite discrimination. Response to a control key terminated any trial and initiated the next trial. The birds also used the control key during generalization tests to control the durations of trials in which various line orientations were presented. These durations were summed to provide generalization gradients of stimulus duration that were positive or negative in accordance with the trained discriminations. In Experiment 2, birds from the line-positive group were tested with a procedure in which the control key was not available on some trials. This provided an independent assessment of response rates to the test stimuli. These rates were used to predict the stimulus durations obtained when the control key was available. The findings supported a general model for the prediction of response distributions among concurrent stimuli from rates observed with single stimuli.