Discriminability between alternatives in a switching-key concurrent schedule

Six pigeons were trained to discriminate between two intensities of white light in a symbolic matching-to-sample procedure. These stimuli were then used to signal which schedule was available on the main key in a switching-key concurrent schedule. The concurrent schedules led to a symbolic matching-to-sample phase in which the subject identified the concurrent schedule to which it last responded before a reinforcer could be obtained. The concurrent schedules were varied across conditions. Discriminability, measured during the symbolic matching-to-sample performance, was high throughout and did not differ across the two procedures. Performance in the concurrent schedules was like that typically obtained using these schedules. Delays were then arranged between completion of the concurrent schedules and presentations of the symbolic matching-to-sample phase. A series of conditions with an intervening delay of 10 s showed that both concurrent-schedule performance and symbolic matching-to-sample performance were affected by the delay in a similar way; that is, choice responding was closer to indifference.     

Children's choice: Sensitivity to changes in reinforcer density

Two experiments were carried out in which children's sensitivity to changes in reinforcer density (number of reinforcers per session) was measured in a choice paradigm. In Experiment 1, 24 girls (ages 6, 9, and 12 years) performed on concurrent-chain schedules of reinforcement. The initial links were variable-interval 10-s schedules. One terminal link always gave three tokens after 30 s, but the parameters associated with the other were varied. Independent manipulations of reinforcer size (two tokens or four tokens) and prereinforcement delay (25 s or 65 s) led to equal changes in the relative density of tokens that could be earned on the schedules. Subjects at all ages were sensitive to changes in reinforcer density brought about by changes in reinforcer size, whereas only 3 12-year-olds showed sensitivity to the changes brought about by manipulation of prereinforcer delay. In Experiment 2, titration procedures were used to test the extent of this insensitivity to delay in 32 6- and 12-year-old children. In these procedures, a repeated choice of the large reinforcer increased the delay to its delivery, and a repeated choice of the small reinforcer reduced the delay to the delivery of the large reinforcer. Whereas 6-year-old boys and girls tended to maintain a strong preference for the large reinforcer, so increasing the delay to its delivery, 12-year-olds tended to distribute their responses to both alternatives, thus producing a stable level of delay to the large reinforcer. The results from the two experiments support the idea of two stages in the development of adaptive intertemporal choice.     

A quantitative analysis of chain-schedule performance

Six pigeons were trained with a chain variable-interval variable-interval schedule on the left key and with reinforcers available on the right key on a single variable-interval schedule arranged concurrently with both links of the chain. All three schedules were separately and systematically varied over a wide range of mean intervals. During these manipulations, the obtained reinforcer rates on constant arranged schedules also frequently changed systematically. Increasing reinforcer rates in Link 2 of the chain increased response rates in both links and decreased response rates in the variable-interval schedule concurrently available with Link 2. Increasing Link-1 reinforcer rates increased Link-1 response rates and decreased Link-2 response rates. Increasing reinforcer rates on the right-key schedule decreased response rates in Link 1 of the chain but did not affect the rate in Link 2. The results extend and amplify previous analyses of chain-schedule performance and help define the effects that a quantitative model must describe. However, the complexity of the results, and the fact that constant arranged reinforcer schedules did not necessarily lead to constant obtained reinforcer rates, precluded a quantitative analysis.     

Connectionist models of conditioning: A tutorial

Models containing networks of neuron-like units have become increasingly prominent in the study of both cognitive psychology and artificial intelligence. This article describes the basic features of connectionist models and provides an illustrative application to compound-stimulus effects in respondent conditioning. Connectionist models designed specifically for operant conditioning are not yet widely available, but some current learning algorithms for machine learning indicate that such models are feasible. Conversely, designers for machine learning appear to have recognized the value of behavioral principles in producing adaptive behavior in their creations.     

Effects of ratio reinforcement schedules on discrimination performance by Japanese monkeys

In Experiment 1, Japanese monkeys were trained on three conditional position-discrimination problems with colors as the conditional cues. Within each session, each problem was presented for two blocks of ten reinforcements; correct responses were reinforced under continuous-reinforcement, fixed-ratio 5, and variable-ratio 5 schedules, each assigned to one of the three problems. The assignment of schedules to problems was rotated a total of three times (15 sessions per assignment) after 30 sessions of acquisition training. Accuracy of discrimination increased to a moderate level with fewer trials under CRF than under ratio schedules. In contrast, the two ratio schedules, fixed and variable, were more effective in maintaining accurate discrimination than was CRF. With further training, as asymptotes were reached, accuracy was less affected by the schedule differences. These results demonstrated an interaction between the effects of reinforcement schedules and the level of acquisition. In Experiment 2, ratio sizes were gradually increased to 30. Discrimination accuracy was maintained until the ratio reached 20; ratio 30 strained the performance. Under FR conditions, accuracy increased as correct choice responses cumulated after reinforcement.     

Handling time and choice in pigeons

According to optimal foraging theory, animals should prefer food items with the highest ratios of energy intake to handling time. When single items have negligible handling times, one large item should be preferred to a collection of small ones of equivalent total weight. However, when pigeons were offered such a choice on equal concurrent variable-interval schedules in a shuttlebox, they preferred the side offering many small items per reinforcement to that offering one or a few relatively large items. This preference was still evident on concurrent fixed-cumulative-duration schedules in which choosing the alternative with longer handling time substantially lowered the rate of food intake.     

Temporal proximity and reinforcement sensitivity in multiple schedules

Distributions of reinforcers between two components of multiple variable-interval schedules were varied over a number of conditions. Sensitivity to reinforcement, measured by the exponent of the power function relating ratios of responses in the two components to ratios of reinforcers obtained in the components, did not differ between conditions with 15-s or 60-s component durations. The failure to demonstrate the “short-component effect,” where sensitivity is high for short components, was consistent with reanalysis of previous data. With 60-s components, sensitivity to reinforcement decreased systematically with time since component alternation, and was higher in the first 15-s subinterval of the 60-s component than for the component whose total duration was 15 s. Varying component duration and sampling behavior at different times since component transition may not be equivalent ways of examining the effects of average temporal distance between components.     

Concurrent access to two concentrations of orally delivered phencyclidine: effects of feeding conditions.

Two experiments addressed the effects of food satiation and deprivation on oral self-administration of two concurrently available phencyclidine concentrations. In the first experiment, 8 rhesus monkeys self-administered either of two concentrations of phencyclidine ("PCP, angel dust") and water under concurrent fixed-ratio 16 schedules. One concentration was always held constant (0.25 mg/mL) while a series of other phencyclidine concentrations, ranging from 0 (water) to 1.0 mg/mL, was presented in a nonsystematic order. Initially the monkeys were tested while food satiated, and the procedure was then repeated during food deprivation. The monkeys usually selected the higher concentration within the first few minutes of the session, indicating that taste and/or other immediate postingestional effects were important factors. Contrary to a number of previous reports, there were no consistent differences across subjects in the mean number of liquid deliveries or mean drug intake (mg/kg) during food satiation and deprivation. However, for all monkeys the within-session time course of responding during food satiation consistently differed from that during deprivation. A second experiment assessed whether the failure to find consistent differences in drug intake during food satiation and deprivation had been due to the history of concurrent access to different phencyclidine concentrations or to the extended experience with phencyclidine under food-satiation conditions. Six additional monkeys (Group 2) were exposed to the phencyclidine self-administration procedure (during food satiation and deprivation) for the same length of time as the monkeys in Experiment 1 (Group 1), except they received only concurrent access to phencyclidine (0.25 mg/mL) and water. Both groups then received concurrent access to phencyclidine and water during five repeated cycles of food deprivation and satiation. There were also marked individual differences in Group 2: During food satiation, 2 of the monkeys' responding increased, 1 showed no change, and 3 decreased. Examination of a number of historical variables indicated that the greater the percentage of total sessions spent during food satiation with phencyclidine available (before these experiments began), the greater the amounts of phencyclidine consumed during food satiation and the smaller the differences in phencyclidine intake when the two feeding conditions were compared.     

Choice between reliable and unreliable outcomes: mixed percentage-reinforcement in concurrent chains.

Pigeons' choices between alternatives that provided different percentages of reinforcement in mixed schedules were studied using the concurrent-chains procedure. In Experiment 1, the alternatives were terminal-link schedules that were equal in delay and magnitude of reinforcement, but that provided different percentages of reinforcement, with one schedule providing, reinforcement twice as reliably as the other. All pigeons preferred the more reliable schedule, and their level of preference was not systematically affected by variation in the absolute percentage values, or in the magnitude of reinforcement. In Experiment 2, preference for a schedule providing 100% reinforcement over one providing 33% reinforcement increased systematically with increases in the duration of the terminal links. In contrast, preference decreased systematically with increases in the duration of the initial links. Experiment 3 examined choice with equal percentages of reinforcement but unequal delays to reinforcement. Preference for the shorter delay to reinforcement was not systematically affected by variation in the absolute percentage of reinforcement. The overall pattern of results supported predictions based on an extension of the delay-reduction hypothesis to choice procedures involving mixed schedules of percentage reinforcement.