Pigeons' memory for number of events: Effects of intertrial interval and delay interval illumination

In Experiment 1, pigeons were trained at a 0-s baseline delay to discriminate sequences of light flashes (illumination of the feeder) that varied in number but not time (2f/4s and 8f/4s). During training, the intertrial interval was illuminated by the houselight for Group Light, but it was dark for Group Dark. Testing conducted with dark delay intervals produced a strong choose-small bias in both groups. All birds then received baseline training with a 5-s dark delay and were subsequently tested at shorter and longer dark delays. A choose-small bias was again observed at delays longer than the training delay, while a choose-large bias occurred at delays shorter than the training delay. Differentiating the ambient chamber illumination during the intertrial interval and the delay interval did not attenuate choose-small or choose-large effects. In Experiment 2, all birds received baseline training with a 5-s illuminated delay and were subsequently tested at shorter and longer illuminated delays. A choose-large bias was observed at delays longer than the training delay, while a choose-small bias occurred at delays shorter than the training delay. In Experiment 3, on intermittent test trials, when the duration of the second flash on small-sample trials was equal to the total flash duration on large-sample trials (i.e., 1600 ms), accuracy fell to approximately chance. These results suggest that pigeons discriminated the sequences of light flashes that varied in number but not in total duration of the sequence by relying on other temporal properties of the sequence rather than by using an event switch to count flashes.     

Effect of small cue-response separation on pattern discrimination in macaques (Macaca fuscata and M. mulatta)

In order to elucidate the nature of the effect of small cue-response separations on pattern discriminations by monkeys, three studies were performed. When training on a pattern discrimination with a cue-response separation was discontinued during performance at the chance level, there was no saving on the rate of learning a second task (with identical cues but a different cue-response separation) relative to the performance of naive control animals. By contrast, when training was discontinued at a performance level a little better than chance, there was significant saving on learning a second task. After learning the second task, a third task with new pattern cues was learned, with marked saving on the duration of performance at the chance level. The results indicate that during the initial stage of performance at the chance level, monkeys do not attend to cues if there is even a small separation between the cue and the response site.     

Auditory delayed matching in the bottlenose dolphin

A bottlenose dolphin, already highly proficient in two-choice auditory discriminations, was trained over a nine-day period on auditory delayed matching-to-sample and then tested on 346 unique matching problems, as a function of the delay between the sample and test sounds. Each problem used new sounds and was from five to 10 trials long, with the same sound used as the sample for all trials of a problem. At each trial, the sample was projected underwater for 2.5 sec, followed by a delay and then by a sequence of two 2.5-sec duration test sounds. One of the test sounds matched the sample and was randomly first or second in the sequence, and randomly appeared at either a left or right speaker. Responses to the locus of the matching test sound were reinforced. Over nine, varying-sized blocks of problems, the longest delay of a set of delays in a block was progressively increased from 15 sec initially to a final value of 120 sec. There was a progressive increase across the early blocks in the percentage of correct Trial 1 responses. A ceiling-level of 100% correct responses was then attained over the final six blocks, during which there were 169 successive Trial 1 responses bracketed by two Trial 1 errors (at 24- and 120-sec delays). Performance on trials beyond the first followed a similar trend. Finally, when the sample duration was decreased to 0.2 sec or less, matching performance on Trial 1 of new problems dropped to chance levels.     

Effects of practice on task architecture: combined evidence from interference experiments and random-walk models of decision making

Does extensive practice reduce or eliminate central interference in dual-task processing? We explored the reorganization of task architecture with practice by combining interference analysis (delays in dual-task experiment) and random-walk models of decision making (measuring the decision and non-decision contributions to RT). The main delay observed in the Psychologically Refractory Period at short stimulus onset asynchronies (SOA) values was largely unaffected by training. However, the range of SOAs over which this interference regime held diminished with learning. This was consistent with an overall shift observed in single-task performance from a highly variable decision time to a reliable (non-decision time) contribution to response time. Executive components involved in coordinating dual-task performance decreased (and became more stable) after extensive practice. The results suggest that extensive practice reduces the duration of central decision stages, but that the qualitative property of central seriality remains a structural invariant.     

The Effect of Delayed Responding on Stroop-Like Task Performance Among Preschoolers

Forty-four preschoolers completed 2 conditions of a Stroop-like procedure (e.g., saying “boat” for car and “car” for boat) that differed in whether a 3-s delay was imposed before responding. The test card was visible during the delay period for half of the children and occluded for the other children. Preschoolers’ interference control was significantly improved in the delay condition. There was no difference between the two delay variants (test card visible or occluded). Children were more prone to interference as testing progressed regardless of whether the delay was present. These results suggest that delays effectively reduce interference by reducing the potency of the competing response during test trials, although memory demands may moderate the effectiveness of delays.     

Responding of pigeons under variable-interval schedules of signaled-delayed reinforcement: effects of delay-signal duration.

Two experiments with pigeons examined the relation of the duration of a signal for delay ("delay signal") to rates of key pecking. The first employed a multiple schedule comprised of two components with equal variable-interval 60-s schedules of 27-s delayed food reinforcement. In one component, a short (0.5-s) delay signal, presented immediately following the key peck that began the delay, was increased in duration across phases; in the second component the delay signal initially was equal to the length of the programmed delay (27 s) and was decreased across phases. Response rates prior to delays were an increasing function of delay-signal duration. As the delay signal was decreased in duration, response rates were generally higher than those obtained under identical delay-signal durations as the signal was increased in duration. In Experiment 2 a single variable-interval 60-s schedule of 27-s delayed reinforcement was used. Delay-signal durations were again increased gradually across phases. As in Experiment 1, response rates increased as the delay-signal duration was increased. Following the phase during which the signal lasted the entire delay, shorter delay-signal-duration conditions were introduced abruptly, rather than gradually as in Experiment 1, to determine whether the gradual shortening of the delay signal accounted for the differences observed in response rates under identical delay-signal conditions in Experiment 1. Response rates obtained during the second exposures to the conditions with shorter signals were higher than those observed under identical conditions as the signal duration was increased, as in Experiment 1. In both experiments, rates and patterns of responding during delays varied greatly across subjects and were not systematically related to delay-signal durations. The effects of the delay signal may be related to the signal's role as a discriminative stimulus for adventitiously reinforced intradelay behavior, or the delay signal may have served as a conditioned reinforcer by virtue of the temporal relation between it and presentation of food.     

Non-spatial delayed alternation by the pigeon

Pigeons were trained on a non-spatial delayed alternation task in which the color not pecked on the previous trial was correct. When varying delays were interposed between trials, alternation accuracy decreased as a function of delay, but remained greater than chance with a 45-sec delay. Successful alternation on the longer delays was accomplished without behavioral mediation of the delay intervals. Also, during initial testing when a position cue was available in addition to the color cue after incorrect trials, alternation accuracy was greater after a preceding incorrect trial than after a correct trial. When the position cue was removed, no differences occurred as a function of the outcome of the preceding trial.     

The effect of delayed responding on Stroop-like task performance among preschoolers

Forty-four preschoolers completed 2 conditions of a Stroop-like procedure (e.g., saying "boat" for car and "car" for boat) that differed in whether a 3-s delay was imposed before responding. The test card was visible during the delay period for half of the children and occluded for the other children. Preschoolers' interference control was significantly improved in the delay condition. There was no difference between the two delay variants (test card visible or occluded). Children were more prone to interference as testing progressed regardless of whether the delay was present. These results suggest that delays effectively reduce interference by reducing the potency of the competing response during test trials, although memory demands may moderate the effectiveness of delays.     

Choice with delayed and probabilistic reinforcers: effects of variability, time between trials, and conditioned reinforcers.

In a discrete-trials procedure with pigeons, a response on a green key led to a 4-s delay (during which green houselights were lit) and then a reinforcer might or might not be delivered. A response on a red key led to a delay of adjustable duration (during which red houselights were lit) and then a certain reinforcer. The delay was adjusted so as to estimate an indifference point--a duration for which the two alternatives were equally preferred. Once the green key was chosen, a subject had to continue to respond on the green key until a reinforcer was delivered. Each response on the green key, plus the 4-s delay that followed every response, was called one "link" of the green-key schedule. Subjects showed much greater preference for the green key when the number of links before reinforcement was variable (averaging four) than when it was fixed (always exactly four). These findings are consistent with the view that probabilistic reinforcers are analogous to reinforcers delivered after variable delays. When successive links were separated by 4-s or 8-s "interlink intervals" with white houselights, preference for the probabilistic alternative decreased somewhat for 2 subjects but was unaffected for the other 2 subjects. When the interlink intervals had the same green houselights that were present during the 4-s delays, preference for the green key decreased substantially for all subjects. These results provided mixed support for the view that preference for a probabilistic reinforcer is inversely related to the duration of conditioned reinforcers that precede the delivery of food.     

Self-control of smoking—II effects of cue salience and source of delay imposition on the effectiveness of training under increasing delay

Imposed increasing delay of cigarette puffs has been shown to facilitate smoking inhibition. Hypothetical mechanisms involved (frustration extinction or rehearsal of coping responses) imply that increased temptation cue salience and decreased degree of external control in increasing delay training, should facilitate smoking inhibition. After three pre-test delay tolerance trials, all subjects were cued to pace their smoking in an increasing sequence of delay. During treatment the cigarette temptation cues were either visible or hidden. Delays were either self-imposed but cued by the experimenter or the delays were physically imposed by the experimenter. Post-test consisted of three delay tolerance trials. Pre-test to post-test improvement was significantly facilitated by cue salience and reduced external control. No significant interaction effects were obtained. Cue salience significantly reduced the self-reported aversiveness and GSRs during self-control trials. Implications for treatment were advanced.     

Unsignalled delay of reinforcement in variable-interval schedules

Three pigeons responded on several tandem variable-interval fixed-time schedules in which the value of the fixed-time component was varied to assess the effects of different unsignalled delays of reinforcement. Actual (obtained) delays between the last key peck in an interval and reinforcement were consistently shorter than the nominal (programmed) delay. When nominal delays were relatively short, response rates were higher during the delay condition than during the corresponding nondelay condition. At longer nominal delay intervals, response rates decreased monotonically with increasing delays. The results were consistent with those obtained from delay-of-reinforcement procedures that impose either a stimulus change (signal) or a no-response requirement during the delay interval.     

Immediate reinforcement in delayed reward learning in pigeons

Pigeons were trained on simultaneous red-green discrimination procedures with delayed reward and sequences of stimuli during the delay. In Experiment 1, three stimuli appeared during the 60-second intervals between the correct responses and reward, and the incorrect responses and nonreward. The stimulus that immediately followed a correct response also preceded nonreward, and the stimulus that followed an incorrect response preceded reward. These stimuli were 10 or .33 second in duration for different groups. Stimuli during the remainder of the delay interval differed following correct and incorrect responses. Group 10 initially persisted in the nonrewarded choice, but shifted to a preponderance of rewarded responses after further training. Group .33 rapidly acquired the correct response. Similar results were obtained in Experiment 2 where delay intervals consisted of opposite sequences of two stimuli of equal duration and total delays were 6, 20, or 60 seconds. Early in training, generalization of differential conditioned-reinforcing properties from the conditions preceding reward and nonreward to postchoice conditions had a greater effect relative to backchaining than it did later. It was concluded that delayed-reward learning is best analyzed in terms of the conditioned-reinforcing value of the patterns of cues that follow immediately after rewarded and nonrewarded responses.     

Transfer of matching performance in pigeons.

Three pigeons were given extensive training on three-key simultaneous matching problems using geometric-form and hue stimuli. After acquisition of matching, the birds were tested with pairs of stimuli involving one or both novel members. Matching during the test stimuli occurred less often than during the later stages of the acquisition phase, but more often than would occur if no transfer had taken place. Greater positive transfer was observed for problems that involved one, rather than two, novel stimuli. In the second phase of the experiment, previously trained birds were shifted to problems that required symbolic matching, i.e., the pigeons had to associate a particular center-key stimulus with a particular side-key stimulus. On each trial, one of two simuli was presented on the center key, and two other stimuli, different from those used on the center key, were displayed on the side keys. When the problem shift was introduced, correct responding was impaired, but remained considerably above chance level and quickly recovered in following sessions. The results were interpreted as favoring a stimulus-response-chaining account of matching behavior.     

Effects of symmetrical and asymmetrical changeover delays on concurrent performances

Two variable-interval 3-min schedules functioned concurrently to arrange reinforcement of a pigeon's pecks on a single key, the main key. Each schedule was associated with a distinct color of the main key; a response on a second key alternated the color and schedule assignment of the main key. A changeover delay, a period of time following schedule and key-color alternation during which reinforcement of responding on the main key could not occur, was arranged with equal or with unequal durations for the two directions of alternation. Durations were varied from 0.33 sec to 27 sec, in addition to no delay. With equal delays for the two directions of alternation, the pigeon alternated the schedules less often the larger the delay duration. When the delays in the two directions of alternation were unequal, it could be shown that alternation of the schedules was reduced both by a delay just incurred by the last alternation and by a. delay to be incurred by the next. The latter delay was more potent in reducing the frequency of alternations.     

Establishing preference for unreliable reinforcement in adults with dual diagnoses

We evaluated the choice responding of three adults dually diagnosed with developmental and psychiatric disabilities using concurrent schedules of reinforcement. Specifically, participants were given a choice between a response option resulting in reliable reinforcement and a response option resulting in unreliable reinforcement. Our primary purpose was to shift preference from reliable to unreliable reinforcement via the systematic presentation of stimuli during delay intervals. A second purpose was to evaluate the effectiveness of intervening stimuli in shifting preference at differing delay-to-reinforcement intervals. Preference for unreliable reinforcement was first examined in the absence of stimulus presentations during delays, at three different delay values. Next, we aimed to establish preference for unreliable reinforcement by presenting pictures of reinforcers during delays preceding unreliable reinforcement. Preference was again examined at three different delay values. In the absence of stimulus presentations during delays, participants were shown to prefer reliable reinforcement, particularly at the longer delay value. When stimuli were presented during the delays, two of the three participants preferred unreliable reinforcement, particularly the longer the delay value. These results suggest that the presentation of intervening stimuli during delays may help facilitate tolerance for unreliable reinforcement.     

How do African grey parrots (Psittacus erithacus) perform on a delay of gratification task?

Humans and other animals often find it difficult to choose a delayed reward over an immediate one, even when the delay leads to increased pay-offs. Using a visible incremental reward procedure, we tested the ability of three grey parrots to maintain delay of gratification for an increasingly valuable food pay-off. Up to five sunflower seeds were placed within the parrot’s reach, one at a time, at a rate of one seed per second. When the parrot took a seed the trial was ended and the birds consumed the accumulated seeds. Parrots were first tested in daily sessions of ten trials and then with single daily trials. For multiple trial sessions, all three parrots showed some limited improvement across 30 sessions. For single trial sessions, only one parrot showed any increase in seed acquisition across trials. This parrot was also able to consistently obtain two or more seeds per trial (across both multiple and single trial conditions) but was unable to able to wait 5 s to obtain the maximum number of seeds. This parrot was also tested on a slower rate of seed presentation, and this significantly reduced her mean seed acquisition in both multiple and single trial conditions, suggesting that both value of reward available and delay duration impact upon self-control. Further manipulation of both the visibility and proximity of seeds during delay maintenance had little impact upon tolerance of delays for both parrots tested in this condition. This task demanded not just a choice of delayed reward but the maintenance of delayed gratification and was clearly difficult for the parrots to learn; additional training or alternative paradigms are required to better understand the capacity for self-control in this and other species.     

Delayed alternation in the pigeon

Pigeons were studied in a delayed-response task requiring alternation of key pecks on two response keys. Blackouts of from 1 to 10 sec intervened between successive choices on the two keys.

The following results were obtained: (1) Birds performed at well above chance accuracy on all the delays tested. Accuracy was generally lowest at 1- and 10-sec delays. (2) Overt postural orientations during the delay interval appeared to mediate accurate key-pecking behavior. (3) The shape of the delay vs. accuracy function was discussed in terms of the possibly confounding influences of (a) stimulus “trace” variables, and (b) aversive effects of the time outs produced by incorrect responding.

     

Transitional and steady-state choice behavior under an adjusting-delay schedule

Twelve rats made repeated choices on an adjusting-delay schedule between a smaller reinforcer (A) that was delivered immediately after a response and a larger reinforcer (B) that was delivered after a delay which increased or decreased by 20% depending on the subject's choices in successive blocks of trials. In two phases of the experiment (100 sessions and 40 sessions), reinforcer sizes were selected which enabled theoretical parameters expressing the rate of delay discounting and sensitivity to reinforcer size to be estimated from the ratio of the indifference delays obtained in the two phases. Indifference delays, calculated from adjusting delays in the last 10 sessions of each phase, were shorter when the sizes of A and B were 14 and 25 μl of a 0.6 M sucrose solution than when they were 25 and 100 μl of the same solution. The ratio of the indifference delays was significantly smaller than that predicted on the basis of an assumed linear relation between reinforcer size and instantaneous reinforcer value, consistent with a previous proposal that this relation may be hyperbolic in form. Estimates of the rate of delay discounting based on the ratio of the two indifference delays (mean, 0.08 s(-1)) were similar to values obtained previously using different intertemporal choice protocols. Estimates of the size-sensitivity parameter (mean 113 μl) were similar to estimates recently derived from performance on progressive-ratio schedules. In both phases of the experiment, adjusting delays in successive blocks of trials were analyzed using the Fourier transform. The power spectrum obtained from individual rats had a dominant frequency that corresponded to a period of oscillation of the adjusting delay between 30 and 100 trial blocks (mean, 78). Power in the dominant frequency band was highest in the early sessions of the first phase and declined with extended training. It is suggested that this experimental protocol may have utility in neurobehavioral studies of intertemporal choice.     

Choice, rate of reinforcement, and the changeover delay

Pigeons distribute their responses on concurrently available variable-interval schedules in the same proportion as reinforcements are distributed on the two schedules only when a changeover delay is used. The present study shows that this equality between proportions of responses and proportions of reinforcements (“matching”) is obtained when the value of the changeover delay is varied. When responses are partitioned into the set of rapid response bursts occurring during the delay interval and the set of responses occurring subsequently, the proportion of neither set of responses matches the proportion of reinforcements. Instead, each set deviates from matching but in opposite directions. Matching on the gross level results from the interaction of two patterns evident in the local response rates: (I) the lengthening of the changeover delay response burst is accompanied by a commensurate decrease in the number of changeovers; (2) the changeover delay response burst is longer than the scheduled delay duration. When delay responses are eliminated by introducing a blackout during the delay interval, response matching is eliminated; the pigeon, however, continues to match the proportion of time spent responding on a key to the proportion of reinforcements obtained on that key.     

Temperature reinforcement for visual discrimination training in baby chicks

A fully automated training apparatus, using thermoregulation as performance incentive, was constructed to train baby chicks on visual discrimination and reversal problems. In the base condition, the S is bathed in cold air in a small training cubicle. Two stimuli are back-projected onto two display windows according to a pseudorandom balanced schedule. A peck at the positive stimulus gives convective as well as radiant heat reward with adjustable temperature and duration. A peck at the negative stimulus merely advances the program to the next trial. Permanent printout records give trial-to-trial information on response choice and latency. Performance data of 64 Ss are reported.