Molecular maximizing characterizes choice on Vaughan's (1981) procedure

Pigeons keypecked on a two-key procedure in which their choice ratios during one time period determined the reinforcement rates assigned to each key during the next period (Vaughan, 1981). During each of four phases, which differed in the reinforcement rates they provided for different choice ratios, the duration of these periods was four minutes, duplicating one condition from Vaughan's study. During the other four phases, these periods lasted six seconds. When these periods were long, the results were similar to Vaughan's and appeared compatible with melioration theory. But when these periods were short, the data were consistent with molecular maximizing (see Silberberg & Ziriax, 1982) and were incompatible with melioration, molar maximizing, and matching. In a simulation, stat birds following a molecular-maximizing algorithm responded on the short- and long-period conditions of this experiment. When the time periods lasted four minutes, the results were similar to Vaughan's and to the results of the four-minute conditions of this study; when the time periods lasted six seconds, the choice data were similar to the data from real subjects for the six-second conditions. Thus, a molecular-maximizing response rule generated choice data comparable to those from the short- and long-period conditions of this experiment. These data show that, among extant accounts, choice on the Vaughan procedure is most compatible with molecular maximizing.     

Effects of ratio reinforcement schedules on discrimination performance by Japanese monkeys

In Experiment 1, Japanese monkeys were trained on three conditional position-discrimination problems with colors as the conditional cues. Within each session, each problem was presented for two blocks of ten reinforcements; correct responses were reinforced under continuous-reinforcement, fixed-ratio 5, and variable-ratio 5 schedules, each assigned to one of the three problems. The assignment of schedules to problems was rotated a total of three times (15 sessions per assignment) after 30 sessions of acquisition training. Accuracy of discrimination increased to a moderate level with fewer trials under CRF than under ratio schedules. In contrast, the two ratio schedules, fixed and variable, were more effective in maintaining accurate discrimination than was CRF. With further training, as asymptotes were reached, accuracy was less affected by the schedule differences. These results demonstrated an interaction between the effects of reinforcement schedules and the level of acquisition. In Experiment 2, ratio sizes were gradually increased to 30. Discrimination accuracy was maintained until the ratio reached 20; ratio 30 strained the performance. Under FR conditions, accuracy increased as correct choice responses cumulated after reinforcement.     

Symmetry and transitivity of conditional relations in monkeys (Cebus apella) and pigeons (Columba livia)

In Experiment 1 six monkeys were tested with discriminative relations that were backward relative to their training in a 0-second conditional (“symbolic”) matching procedure. Although there was some indication of backward associations, the evidence was generally weak, and statistical evaluations did not reach conventional significance levels. Unlike children, who show backward associations to the point of symmetry, monkeys and pigeons display at best only weak and transient backward associations. In Experiment 2 associative transitivity was assessed across two sets of conditional matching tasks. All four monkeys tested demonstrated strong transitivity. In contrast, in Experiment 3 there was no evidence of transitivity in three pigeons tested under conditions closely comparable to those of Experiment 2. These results may identify some key features of interspecies differences and contribute to analyses of serial learning in animals.     

Sequential effects in dimensional contrast

Two experiments examined pigeons' response rates during short trials signaled by stimuli closely spaced along a wavelength continuum. In Experiment 1 separate halves of the continuum were correlated with different reinforcement schedules. In Experiment 2, the middle stimulus was accompanied by a lower probability of reinforcement than were the remaining wavelengths. Both procedures resulted in dimensional contrast “shoulders,” seen as relatively enhanced or depressed response rates in the presence of stimuli between the extreme of the continuum and the border separating the positive and negative stimuli. Sequential analyses addressed possible contributions of the following interactions: (a) local contrast, seen when rate during a given schedule depends on the schedule in the just-preceding trial; (b) modification of local contrast by the similarity of the signaling stimuli (P. Blough, 1983); and (c) schedule-independent rate contrast, seen when rate in a given trial depends on the rate controlled by the stimulus that accompanied the just-preceding trial (Malone & Rowe, 1981). Dimensional contrast functions were similar when isolated according to the schedule, to the similarity of the signaling stimulus, and to the response rate of the just-preceding trial. The interactions noted above do not appear to make important contributions to this effect.     

Positive reinforcement and the elimination of reinforced responses

Key pecking was maintained on a fixed-interval schedule while either a differential-reinforcement-of-not-responding or a fixed-time schedule was imposed simultaneously. The lower the time parameter of the not-responding schedule, the lower was the response rate. Similar effects occurred with the fixed-time schedule, if the pigeons had experience with reinforcement for not responding. Otherwise the effects were less orderly, to the extent that rate could reach maximum with the lowest-valued fixed-time schedule. The not-responding and the response-independent schedules had similar effects on rate in experienced pigeons only when the time parameter or nominal frequency of food presentation was considered. When considered in terms of obtained frequency of food presentation, reinforcement of not responding produced larger decrements in rate than did the fixed-time schedule.     

A comparison of the key-peck and treadle-press operants in the pigeon: differential-reinforcement-of-low-rate schedule of reinforcement

Key pecking and treadle pressing in pigeons were compared under concurrent (key-treadle) and single-operant differential-reinforcement-of-low-rate schedules of food reinforcement ranging from 5 to 60 sec (concurrent procedure) or 5 to 120 sec (single-operant procedure). Under both procedures, the two operants followed the same general law: decreasing response rate and reinforcement rate and increasing number of responses per reinforcement as a function of increasing schedule interval. High correlations were found between key pecking and treadle pressing for the measures of response rate, reinforcement rate, and responses per reinforcement. Regression equations allowed the prediction of treadle pressing from key pecking. More bursting occurred in responding to the key, and key pecking showed a more precise temporal discrimination than treadle pressing. A test for sequential dependencies between key and treadle responses showed significant dependencies not only under the concurrent procedure but also in data created artificially by merging key and treadle sequences from different pigeons under the concurrent procedure and from the same pigeon under the single-operant procedure. It seems likely that the sequential dependencies found were due to the independent action of the schedule on each operant and that behavioral dependencies did not occur with the concurrent training procedure. The key-peck operant does not appear to have any special qualities that preclude its use in discovering general laws of behavior, at least under the differential-reinforcement-of-low-rate schedule. The usefulness of the key peck in other situations requires direct experimental study.     

The stages of acquisition in stimulus fading

Pigeons were exposed to a stimulus fading procedure in which control of responding was transferred from red and black stimuli to lines of different angular orientation. After superimposing one line on the red stimulus and the other line on the black stimulus, the intensity of the lines was gradually increased and that of the red stimulus was gradually reduced. Probes consisting of red and line stimuli presented separately were used during the course of fading to assess control exerted by each element of the compound. As the lines were faded in, they did not acquire control of responding. As red was faded out, control of responding was acquired first by the lower intensity red stimuli in combination with the line stimulus, and finally by the angular orientation of the lines. Probes also determined the point at which the line stimuli, presented alone, would maintain a high degree of stimulus control. The results demonstrated that new stimuli in fading acquire dimensional control of responding in two sequential stages. Acquisition of stimulus control in fading was explained in terms of attenuation of stimulus blocking.     

Infants’ recognition of objects using canonical color

We explored infants’ ability to recognize the canonical colors of daily objects, including two color-specific objects (human face and fruit) and a non-color-specific object (flower), by using a preferential looking technique. A total of 58 infants between 5 and 8 months of age were tested with a stimulus composed of two color pictures of an object placed side by side: a correctly colored picture (e.g., red strawberry) and an inappropriately colored picture (e.g., green-blue strawberry). The results showed that, overall, the 6- to 8-month-olds showed preference for the correctly colored pictures for color-specific objects, whereas they did not show preference for the correctly colored pictures for the non-color-specific object. The 5-month-olds showed no significant preference for the correctly colored pictures for all object conditions. These findings imply that the recognition of canonical color for objects emerges at 6 months of age.     

Stimulus control of Pavlovian facilitation

Two experiments were conducted using an autoshaping procedure with pigeons to examine whether dimensional stimulus control by a Pavlovian facilitator parallels the control established following operant discrimination training. Facilitation training consisted of the presentation of a black vertical line on a white background as the B stimulus in a feature-positive discrimination in which the A stimulus (white keylight) was followed by grain presentation only if preceded by B. In this way, B facilitates or sets the occasion for pecking at A. Subsequent testing for generalization along the line-orientation dimension produced decremental gradients when the facilitation paradigm incorporated an explicit feature-negative stimulus (B−). These results parallel the decremental control obtained following operant discrimination training and suggest that Pavlovian facilitators and instrumental discriminative stimuli are functionally equivalent.     

The interaction between stimulus and reinforcer control on remembering.

In a symbolic matching-to-sample task, 6 pigeons obtained food by pecking a red side key when the brighter of two white lights had been presented on the center key and by pecking a green side key when the dimmer of two white lights had been presented on the center key. Across Part 1 and Parts 6 to 10, the delay between sample-stimulus presentation and the availability of the choice keys was varied between 0 s and 25 s. Across Parts 1 to 5, the delay between the emission of a correct choice and the delivery of a reinforcer was varied between 0 s and 30 s. Although increasing both types of delay decreased stimulus discriminability, lengthening the stimulus-choice delay produced a greater decrement in choice accuracy than did lengthening the choice-reinforcer delay. Additionally, the relative reinforcer rate for correct choice was varied across both types of delay. The sensitivity of behavior to the distribution of reinforcers decreased as discriminability decreased under both procedures. These data are consistent with the view, based on the generalized matching law, that sample stimuli and reinforcers interact in their control over remembering.