Color alternation learning in the pigeon under fixed-ratio schedules of reinforcement

Pigeons were trained on a non-spatial delayed alternation task in which the correct stimulus was that color not responded to on the preceding trial. Subjects required to emit either 15 or 30 pecks to the correct stimulus within a trial learned the task, those required to emit only one or five pecks did not. Also, alternation was learned more easily after an incorrect than after a correct trial. Later experiments showed that a minimum fixed-ratio value was required for successful color alternation to occur, even though no fixed-ratio requirement was necessary when a position cue was available. The mechanism of the fixed-ratio effects derived from the pigeons' tendency to repeat their response in the presence of the color reinforced on the last trial. Whereas subjects trained on larger fixed-ratios corrected this error tendency within a trial, subjects trained on smaller fixed ratios did not.     

Visual discrimination learning with a 1-min delay of reward

Eight rats were successfully trained in a black-white discrimination with a 1-min delay of reward. The procedure was unusual in that the rat spent the delay outside the apparatus in its home cage. Immediately after the rat responded, whether correctly or incorrectly, it was removed from the choice compartment and placed in its home cage. When the delay ended, it was returned to the startbox. If the preceding response had been correct, the rat received a reward of sugar water; otherwise, it was allowed to make another choice response. Mediation by external cues was excluded because there was no difference in the way the rats were treated after a correct or an incorrect response until the delay interval ended. Mediation by proprioceptive stimuli was excluded because position was an irrelevant cue.     

Response patterns and cardiovascular effects during response sequence acquisition by humans.

The effects of temporal delays imposed between successive responses and of vitamin C administration were examined on the acquisition of response sequences and on cardiovascular reactivity during sequence acquisition. Thirteen adult subjects (6 female, 7 male), in good health, gave written consent prior to participating in 12 weekly 45-min sessions. Points, exchanged for money after each session, were presented when subjects completed 15-response sequences on a touch-sensitive three-response keypad. A position counter increased from 0 to 14 as subjects emitted correct responses in the sequence. Four novel 15-response sequences were presented each session. No delays were imposed between successive responses during the acquisition of one sequence; delays were imposed immediately following each response during the acquisition of a second sequence, thereby delaying response feedback; delays were imposed following feedback during acquisition of a third sequence, resulting in the removal of the stimulus correlated with sequence position; and, as a control condition, delays were imposed following feedback, but stimuli correlated with sequence position were reinstated prior to the next response during acquisition of a fourth sequence. Subjects were exposed to one of two delay durations (0.2 and 0.5 or 0.5 and 1.0 s) each session, and delay durations alternated every session. During Weeks 5 to 8, subjects received 3 grams of vitamin C per day, whereas during Weeks 1 to 4 and 9 to 12, subjects received placebo under single-blind conditions. All subjects acquired the sequences, as evidenced by decreasing percentages of incorrect responses across trials. When temporal delays were imposed between successive responses during sequence acquisition, acquisition efficiency was enhanced. Examination of response latencies suggested that the status of preceding responses (i.e., correct or incorrect) rather than the status of the position counter influenced subsequent responding. Cardiovascular effects were inversely related to the length of the temporal delay. Neither cardiovascular reactivity or sequence acquisition were related to vitamin C administration.     

Context specificity of conditioned-reinforcement effects on discrimination acquisition

Pigeons were trained on a series of reversals of a simultaneous form discrimination in which the trial outcomes were separated from the choice responses by an 8-s delay interval. Different conditions were defined by the stimuli occurring during the two halves of the delay interval. Discrimination learning was greatly facilitated by having differential stimuli during the delay following correct versus incorrect choices. When the differential stimuli appeared only at the midpoint of the delay, some facilitation occurred relative to when no different stimuli occurred, but there was substantially less facilitation than when the differential stimuli occurred immediately contingent on choice. A reversed-stimulus condition, in which the stimulus at the onset of the delay following a correct choice was the same as that during the last segment of the delay following an incorrect choice, and the stimulus at the onset of the delay following an incorrect choice was the same as that preceding food during the last segment of the delay following a correct choice, also facilitated discrimination learning relative to the nondifferential stimulus conditions.     

Immediate reinforcement in delayed reward learning in pigeons

Pigeons were trained on simultaneous red-green discrimination procedures with delayed reward and sequences of stimuli during the delay. In Experiment 1, three stimuli appeared during the 60-second intervals between the correct responses and reward, and the incorrect responses and nonreward. The stimulus that immediately followed a correct response also preceded nonreward, and the stimulus that followed an incorrect response preceded reward. These stimuli were 10 or .33 second in duration for different groups. Stimuli during the remainder of the delay interval differed following correct and incorrect responses. Group 10 initially persisted in the nonrewarded choice, but shifted to a preponderance of rewarded responses after further training. Group .33 rapidly acquired the correct response. Similar results were obtained in Experiment 2 where delay intervals consisted of opposite sequences of two stimuli of equal duration and total delays were 6, 20, or 60 seconds. Early in training, generalization of differential conditioned-reinforcing properties from the conditions preceding reward and nonreward to postchoice conditions had a greater effect relative to backchaining than it did later. It was concluded that delayed-reward learning is best analyzed in terms of the conditioned-reinforcing value of the patterns of cues that follow immediately after rewarded and nonrewarded responses.     

Effects of symmetrical and asymmetrical changeover delays on concurrent performances

Two variable-interval 3-min schedules functioned concurrently to arrange reinforcement of a pigeon's pecks on a single key, the main key. Each schedule was associated with a distinct color of the main key; a response on a second key alternated the color and schedule assignment of the main key. A changeover delay, a period of time following schedule and key-color alternation during which reinforcement of responding on the main key could not occur, was arranged with equal or with unequal durations for the two directions of alternation. Durations were varied from 0.33 sec to 27 sec, in addition to no delay. With equal delays for the two directions of alternation, the pigeon alternated the schedules less often the larger the delay duration. When the delays in the two directions of alternation were unequal, it could be shown that alternation of the schedules was reduced both by a delay just incurred by the last alternation and by a. delay to be incurred by the next. The latter delay was more potent in reducing the frequency of alternations.     

Directed forgetting of elements in compound samples.

Pigeons were trained in a delayed matching-to-sample procedure in which the sample stimuli consisted of a compound of color (red or green) and spatial location (left or right). A postsample cue (houselight on or off) signaled whether color matching or location matching would be required following the delay. In Experiment 1, the reduction in performance on probe trials (in which the houselight condition was reversed relative to that on regular trials) was greater for location matching than for color matching. The birds showed overt mediational behavior during the delays on location-matching trials. On color-matching trials, the birds exhibited behavior during delays that might have interfered with that mediational behavior. In Experiment 2, the houselight condition was changed shortly before presentation of the comparison stimuli on probe trials. Accuracy of location matching was reduced when the cue initially signaled color matching and was then changed to signal location matching, whereas matching accuracy was not reduced by a change in the opposite direction. Accuracy of color matching was reduced by a change in illumination level from dark to light, regardless of type of the relevant dimension signaled by houselight illumination. Discussion of these findings focuses on the variables critical to establishment of an effective cue to forget.     

Sequence effects in a spatial cueing task: Endogenous orienting is sensitive to orienting in the preceding trial

In a spatial cueing paradigm it was investigated whether endogenous orienting is sensitive to orienting processes in the previous trial. Specifically, the effect of the previous cue direction, the previous trial type (valid, invalid, neutral, catch) and target alternation effects were studied. Strategic effects were shown as attentional costs and benefits were larger after a valid than after an invalid trial. Following catch trials, an overall response slowing was observed, but costs and benefits were unaffected. This was interpreted as a reduction in alertness and as support for the dissociation between spatial and temporal attentional mechanisms. Repetition of target position per se had no effect, but in neutral trials responses were slower to targets appearing at the location that was cued in the previous trial, independent of validity of the preceding trial. This suggests that long-term inhibition-of-return can occur between trials when attention is controlled endogenously.     

Delayed alternation in the pigeon

Pigeons were studied in a delayed-response task requiring alternation of key pecks on two response keys. Blackouts of from 1 to 10 sec intervened between successive choices on the two keys.

The following results were obtained: (1) Birds performed at well above chance accuracy on all the delays tested. Accuracy was generally lowest at 1- and 10-sec delays. (2) Overt postural orientations during the delay interval appeared to mediate accurate key-pecking behavior. (3) The shape of the delay vs. accuracy function was discussed in terms of the possibly confounding influences of (a) stimulus “trace” variables, and (b) aversive effects of the time outs produced by incorrect responding.

     

Spontaneous private speech and performance on a delayed match-to-sample task

Spontaneous private speech samples were obtained from 65 kindergarten children (mean age 70.3 months) from one suburban (n = 36) and one city (n = 29) school as they worked alone on a delayed match-to-sample (DMS) task with three levels of difficulty (2, 10, and 30 sec delays). As expected increases in DMS delay intervals produced decreased performance and increases in private speech. The expected increased positive relationship between task relevant private speech and performance for longer delays was found in city children but not suburban children. Since mean IQ scores were significantly different for the two groups this variable was further examined in post hoc analyses and discussed along with socio-economic status as possible explanations for the observed school-sample differences. A within-subject comparison for all children showed the percentage of speaking trials correct at 30-sec delay to be significantly greater than the percentage of nonspeaking trials correct. The effect of one experimenter modeled trial on a subsequent 10 trials at 30-sec delay was to increase speech and performance and to show a stronger relationship between speech and performance than for premodeling trials. These exploratory findings with a relatively simple two color matching task suggest further explorations of spontaneous private speech as a way of studying internalization of self regulatory cognitive strategies.     

Developmental differences in the use of task goals in a cued version of the stroop task

The ability of children (M= 8.8 years) and adults (M= 25.6 years) to maintain task goals was examined by comparing their performance on a cued version of the Stroop colour‐word task. The experimental task presented a cue on each trial that instructed the participant to either read aloud the forthcoming word or name the colour of the word's lettering. Participants were tested with each of two cue‐stimulus delays (1,000 and 5,000 ms). Analysis of error rates in the colour‐naming condition revealed that children experienced greater interference than adults at each of the cue‐stimulus delays. In an effort to separate the relative contributions of colour‐naming and word‐reading processes, additional analyses were performed based on the process dissociation procedure of Lindsay and Jacoby (1994) . While colour‐naming process estimates did not vary with age group or cue‐stimulus delay, word‐reading process estimates were found to vary with age group and cue‐stimulus delay. Specifically, adults were superior to children in the inhibition of irrelevant word information only during a long cue‐stimulus delay. Collectively, these findings indicate that children have difficulty maintaining task goals in order to suppress stronger, goal‐irrelevant responses.     

The effect of previous trial type on inhibition of return

Inhibition of return (IOR) refers to the finding that targets appearing at previously cued locations are more slowly responded to than targets appearing at previously uncued locations when a relatively long temporal interval occurs between the cue and target. This experiment was conducted to determine whether the magnitude of IOR is influenced by the type of preceding trial (cued or uncued) and/or the location of the cue/target on the previous trial. Although no effect of cue/target location is observed, there was a marked effect of previous trial type, as IOR was greater following an uncued trial relative to a cued trial. This effect was attributable to differences in the response time as a function of previous trial type: specifically, participants were faster to respond to cued and uncued trials when the previous trial type was identical.     

Use of an ambiguous-sample procedure to establish a cue to forget in pigeons

Pigeons were trained on a variation of the matching-to-sample task in which on double-sample trials two samples, one associated with each of the comparison stimuli, were presented successively. Responding to the comparison associated with the first sample was reinforced on half the double-sample trials, and responding to the comparison associated with the second sample was reinforced on the remaining half. One of two postsample stimuli was presented following the termination of each colored sample. A vertical line was presented after a correct or target sample, and a horizontal line was presented after an incorrect or interfering sample. With extended training, each bird demonstrated above-chance accuracy on double-sample trials, providing prima facie evidence that one or both of the postsample stimuli exerted control over matching behavior. Experiment 2 provided evidence that the horizontal line functioned as a cue to forget the code activated by the preceding sample stimulus. It was concluded that a condition sufficient to establish a postsample stimulus as a cue to forget is that the postsample immediately follow presentation of a sample that, if it were to control test responding, would lead to nonreinforcement.     

Comparing time-based and event-based prospective memory over short delays

The current study compared monitoring in time- and event-based prospective memory (PM). Time- and event-based non-focal task instructions were given after a baseline block of a lexical decision ongoing task. Delay between instruction and presentation of PM cue/time was manipulated between-subjects to examine monitoring across short delays (1–6?min). Longer delays decreased performance in the event-based task, but not in the time-based task. This accuracy decline was accompanied by a decline in monitoring (as measured by PM cost to the ongoing task in the trials immediately before the PM cue was presented) between the 1 and 3?min delays. Monitoring was only evident for the time-based task at the 6?min delay as measured by PM cost to the ongoing task. Clock checks were also not affected by delay, but did increase in frequency as the response time neared. These results suggest that delay from the time of intention formation decreases both accuracy and monitoring in event-based tasks, but does not decrease accuracy or monitoring in time-based tasks.     

Knowledge of one's own responding and the relation of such knowledge to learning: A developmental study

First-, third-, fifth-grade children, and college students (ages 6, 8, 10, and 19 years) acquired a paired-associate list under the study-test procedure to a one error-less trial criterion. In addition, as each pair was presented the individual indicated whether he/she had that pair correct on the immediately preceding trial (postdiction responses). The data were interpreted in terms of a discrimination-utilization hypothesis which postulates that individuals discriminate their own correct and incorrect responses on a given trial and use this information for distributing processing effort on the subsequent trial. Analyses involving the accuracy of postdiction responses, the relation of postdiction accuracy to acquisition, and the consideration of the acquisition data in terms of a two-stage model led to the conclusion that older children and adults may use the discrimination-utilization strategy but younger children tend not to use it, probably because of both mediation and production deficiencies.     

Acquisition and maintenance of delayed matching-to-sample in tufted capuchin monkeys

Delayed matching-to-sample (DMTS) is a commonly used procedure to investigate short-term memory. For the study of functions of forgetting, the delay between the disappearance of the sample stimulus and appearance of choices is manipulated. The intertrial interval (ITI) is also varied to assess interference effects. Performance decrements have been observed as delay increases and, in some cases, performance recovery occurs when ITIs are increased. Other studies indicate that the higher the ITI/delay ratio, the greater the accuracy in DMTS. In this study, 2 experiments investigated DMTS performances of 3 tufted capuchin monkeys as function of delay and ITI. In Experiment 1, alternation of gradual increases of delay and ITI was effective in producing ≥90% accuracy at delays as long as 90 s. Individual monkeys differed in the highest value of delay at which this criterion was met. In Experiment 2, the monkeys were exposed to 5-s DMTS with different ITIs to assess the effects of various ITI/delay ratios on accuracy. Highest accuracy tended to occur at the higher ITI/delay ratios.     

Interaction of memories and expectancies as mediators of choice behavior

The interaction of food-based memories and food-event outcome expectancies in pigeons was assessed using a simultaneous, delayed-symbolic-matching-to-sample procedure. The components of the compound sample were presented in sequence, and consisted of a food-based event (food or no-food) followed by a color cue (red or green). Choice of a pattern of horizontal lines was "correct" following presentation of the red cue, while choice of a vertical line pattern was "correct" after green. In all but a control condition, the food-based event with which a trial began, or the food-event outcome with which a trial concluded, or both, were also correlated with the correct pattern. Of particular interest was the relative accuracy of two groups for whom both memories and expectancies were correlated with the correct choice-pattern. For one group, the memories and expectancies corresponding to the pre- and postchoice food-related events were similar, whereas for the other they were dissimilar. Outcome expectancies supported a higher level of performance than food-based memories, and subjects with both outcome expectancies and food-based memories chose more accurately than those with memories or expectancies only. In addition, subjects with dissimilar food-based memories and outcome expectancies chose more accurately than those with similar memories and expectancies. The implications of the above findings for the nature of event representation in pigeons are discussed.     

Pigeons' spatial memory: III. Effect of distractors on delayed matching of key location.

The effect of distractors on pigeons' delayed matching of key location was investigated. Baseline trials began with a "ready" stimulus (brief operation of the grain feeder). Then one (randomly chosen) key from a three-by-three matrix was lit briefly as the sample. After a short delay (retention interval) the sample key was lit again along with one of the other eight keys. A peck at the key that had served as the sample (correct comparison) produced grain reinforcement, whereas a peck to the other key (incorrect comparison) produced only the intertrial interval. In Experiment 1, a houselight distractor, presented during either the sample, retention interval, or choice phases of the trial, had little if any effect on accuracy of matching key location. In Experiment 2, one of three types of spatial stimuli was interpolated during the retention interval, or the interval was blank as during baseline trials. The three stimuli were: the sample (correct comparison) location for that trial, the incorrect comparison location for that trial, or one of the seven unused locations for that trial. Relative to blank trials, accuracy improved slightly on sample-interpolated trials, decreased slightly on unused location-interpolated trials, and decreased considerably on incorrect comparison-interpolated trials. In Experiment 3, retention intervals were blank or had one of six types of interpolation: the sample, the incorrect comparison, two presentations of the sample, two presentations of the incorrect comparison, the sample followed by the incorrect comparison, or the incorrect comparison followed by the sample.(ABSTRACT TRUNCATED AT 250 WORDS)     

Short-term visual memory for location in depth: A U-shaped function of time

Short-term visual memory was studied by displaying arrays of four or five numerals, each numeral in its own depth plane, followed after various delays by an arrow cue shown in one of the depth planes. Subjects reported the numeral at the depth cued by the arrow. Accuracy fell with increasing cue delay for the first 500 ms or so, and then recovered almost fully. This dipping pattern contrasts with the usual iconic decay observed for memory traces. The dip occurred with or without a verbal or color–shape retention load on working memory. In contrast, accuracy did not change with delay when a tonal cue replaced the arrow cue. We hypothesized that information concerning the depths of the numerals decays over time in sensory memory, but that cued recall is aided later on by transfer to a visual memory specialized for depth. This transfer is sufficiently rapid with a tonal cue to compensate for the sensory decay, but it is slowed by the need to tag the arrow cue’s depth relative to the depths of the numerals, exposing a dip when sensation has decayed and transfer is not yet complete. A model with a fixed rate of sensory decay and varied transfer rates across individuals captures the dip as well as the cue modality effect.     

A Simon effect in pigeons

Pigeons pecked left versus right keys contingent upon the color presented at 1 of those locations. Spatial-response latencies were shorter when the color appeared at the same location as the required response than at the opposite location. This Simon effect occurred when the stimulus on the alternative key was constant, varied from trial to trial, or changed when the color cue appeared and when the reinforcement probability for correct responses was the same on corresponding as on noncorresponding trials. Humans performing the same task by touching the keys also showed the Simon effect. These findings demonstrate that for pigeons, too, a relevant symbolic cue activates a spatial code that produces faster responses at the location corresponding with the activated code.