Quantification of the effects of chlorpromazine on performance under delayed matching to sample in pigeons.

The effects of four doses of chlorpromazine (dose range 0.5 to 12.5 mg/kg) on performance under a delayed matching-to-sample procedure in pigeons was investigated, using the exponential model of memory (White, 1985). Performance was measured using a bias-free measure of discriminability, log d (Davison & Tustin, 1978), and negative exponential functions were fitted to individual-subject and group data at each dose level. A decrease in matching accuracy was found to be caused by an increase in the rate of forgetting, b, and a decrease in the initial discriminability, log d0. Changes in rate of forgetting and discriminability occurred at doses that had no statistically significant effect on response latency. The exponential model of memory accounted well for the data and provided a useful way of quantifying the effects of chlorpromazine on the processes involved in delayed matching-to-sample performance.     

Formation of transitivity in conditional matching to sample by pigeons

Four homing pigeons were trained over 5 months in a zero-delay, “arbitrary” matching-to-sample procedure with sample and comparison stimuli presented on any of three response keys. Birds were also required to complete a fixed-ratio 10 requirement on both sample and comparison stimuli to terminate their presentation. The procedure resulted in the establishment of relations that were not specifically trained and that can be characterized by the property of transitivity in a stimulus equivalence context. This result was in contrast with the findings obtained from most previous research with nonhuman subjects.     

Effects of chlorpromazine on fixed-ratio responding: modification by fixed-interval discriminative stimuli.

Effects of chlorpromazine (1 to 100 mg/kg) were assessed on two pigeons' responding under various modifications of a multiple schedule of food delivery. During a fixed-interval component, the first response after 5 min produced food; during the subsequent, fixed-ratio component, the 30th response produced food. Modifications of the schedule entailed changes in stimulus conditions imposed during the fixed-ratio component that did not systematically alter characteristics of performance under non-drug conditions. In the first phase of the experiment, distinctive visual stimuli were correlated with each schedule component (conventional multiple schedule); chlorpromazine produced small decreases in fixed-ratio responding (20% at 30 mg/kg). When each response during the fixed-ratio component produced the stimulus correlated with the fixed-interval schedule (fixed-interval discriminative stimulus) for 1.2 s, effects of chlorpromazine were not different from those under the conventional multiple schedule. Chlorpromazine produced greater decreases in fixed-ratio responding (55% at 30 mg/kg) when either the first response of each fixed ratio changed the stimulus correlated with the fixed-ratio schedule to the fixed-interval discriminative stimulus for the remainder of the fixed-ratio component, or when the fixed-interval discriminative stimulus was presented independently of responding according to a matched temporal sequence. When the fixed-interval discriminative stimulus was present continuously during the fixed-ratio component (mixed schedule), chlorpromazine produced even more substantial decreases in fixed-ratio responding (greater than 80% at 30 mg/kg). Effects of chlorpromazine on fixed-interval responding were also modified by the schedules of fixed-interval discriminative stimulus presentation. The effects of chlorpromazine were a joint function of the stimuli prevailing during the multiple schedule and the degree to which responding influenced these stimuli.     

Choice between sequences of fixed-ratio schedules: effects of ratio values and probability of food delivery.

Pigeons were exposed to schedules of food delivery that consisted of two sequential fixed ratios. When alternative sequences provided two food deliveries per 50 responses, the schedule with the shorter initial fixed-ratio value was consistently preferred. Progressively reducing from 1.0 to .25 the probability of food delivery following completion of the second fixed ratio of the sequence with the shorter initial fixed ratio did not reduce preference for this sequence. Moreover, the sequence with the shorter initial fixed ratio also was preferred when the probability of food delivery following completion of the initial ratio in that sequence was progressively reduced from 1.0 to .5, although preference shifted to the alternative when the probability was reduced to 0. These findings suggest that the length of the initial fixed ratio was a primary determinant of choice. Subsequent manipulations demonstrated, however, that when the initial fixed ratios of the two alternatives were equal, changes in the ratio value and probability of food delivery following completion of the second fixed ratio lawfully affected choice.     

Effect of delay-interval stimuli on delayed symbolic matching to sample in the pigeon

In Experiment 1, food-deprived pigeons received delayed symbolic matching to sample training in a darkened Skinner box. Trials began with the illumination of the grain feeder lamp (no food sample), or illumination of this lamp, accompanied by the raising of the feeder tray (food sample). After a delay of a few seconds, the two side response keys were illuminated, one with red and one with green light, with positions counterbalanced over trials. Pecking the red (green) comparison produced grain reinforcement if the trial had started with food (no food); pecking red after a no-food sample or green after a food sample was not reinforced. Once matching performance was stable, four stimuli were presented during the delay interval, and their effects on matching accuracy were evaluated. Both illumination of the houselight and the center key with white geometric forms decreased matching accuracy, whereas presentation of a tone and vibration of the test chamber did not. In Experiment 2, pecking the red center key was reinforced with food according to a variable interval schedule. The effects of occasional brief presentations of the four stimuli used in the first experiment on ongoing pecking were assessed. The houselight and form disturbed key pecking, but the tone and vibration did not. Thus, stimuli that interfered with delayed matching also interfered with simple operant behavior. Implications of these results for theories of remembering are discussed.     

Stimulus control of behavioral history.

Pigeons were exposed to two different reinforcement schedules under different stimulus conditions in each of two daily sessions separated by 6 hr (Experiments 1 and 2) or in a single session (Experiment 3). Following this, either a fixed-interval (Experiment 1) or a variable-interval schedule (Experiments 2 and 3) was effected in both stimulus conditions. In the first two experiments, exposure to fixed-ratio or differential-reinforcement-of-low-rate schedules led to response-rate, but not pattern, differences in subsequent performance on fixed- or variable-interval schedules that persisted for up to 60 sessions. The effects of reinforcement-schedule history on fixed-interval schedule performance generally were more persistent. In Experiment 3, a history of high and low response rates in different components of a multiple schedule resulted in subsequent response-rate differences under identical variable-interval schedules. Higher response rates initially occurred in the component previously correlated with high response rates. For 3 of 4 subjects, the differences persisted for 20 or more sessions. Previous demonstrations of behavioral history effects have been confined largely to between-subject comparisons. By contrast, the present results demonstrate strong behavioral effects of schedule histories under stimulus control within individual subjects.     

Cocaine's effects on food-reinforced pecking in pigeons depend on food-deprivation level.

Four pigeons deprived to 80% of their laboratory free-feeding weights pecked keys under a multiple fixed-ratio 30 fixed-interval 5-min schedule of food presentation. Components alternated strictly with 15-s timeouts separating them; each was presented six times. When rates of pecking were stable, 2 pigeons' weights were reduced to 70%, and the other 2 pigeons' weights were increased to 82.5% to 85% of free-feeding levels. Cocaine (1.0, 3.0, 5.6, and 10.0 mg/kg and saline) was administered 5 min prior to sessions. When each dose had been tested twice, pigeons' weights were adjusted to the level that they had not yet experienced, and cocaine was tested again. Cocaine reduced response rates in a dose-dependent manner under the fixed-ratio schedule and under the fixed-interval schedule at high doses, and increased rates under the fixed-interval schedule at low low doses. Reductions in pecking rates occurred at lower doses under both schedules in 3 of 4 pigeons when they were less food deprived compared to when they were more food deprived. Low doses of cocaine increased low baseline rates of pecking in the initial portions of the fixed-interval schedules by a greater magnitude when pigeons were more food deprived. Thus, food-deprivation levels altered both the rate-decreasing and rate-increasing effects of cocaine. The implications of these results for the mechanisms by which food deprivation increases cocaine self-administration and for the dependence of cocaine's effects on the baseline strength of operant behavior are discussed.     

Effectiveness and persistence of precurrent mediating behavior in delayed matching to sample and oddity matching with children.

Two kinds of mediating behavior were compared with respect to their effectiveness in variable-delay matching-to-sample and oddity-matching tasks. Each of four 5-year-old children was trained to emit either differential or common mediating responses. The differential mediating response consisted of pressing a specific computer key corresponding to either of two possible sample stimuli (a red or a green square). The common mediating response consisted of pressing one of the two response keys regardless of the sample. The differential-response subjects did not show the typical, delay-related decrease in matching-to-sample performance that characterized the behavior of common-response subjects. An oddity-matching task was then introduced, and subjects were instructed to use the mediating keys however they preferred, including not at all. Differential-response subjects continued to respond on the originally trained mediating keys in response to sample presentation and later reversed their choice responding, thus accommodating the oddity-matching requirements. Common-response subjects continued to emit the previously trained mediating response and experienced limited success in oddity matching. Results were interpreted in terms of stimulus control, instructional control, and experimental history.     

Delayed stimulus control: recall for single and relational stimuli.

In a discrete-trial symbolic matching-to-sample procedure, pigeons' left-key responses were reinforced following presentation of one center-key sample, and right-key responses were reinforced following presentation of another. Recallability was measured by the difference between log ratios of left to right responses following each sample. In Experiment 1, samples were successively presented same or different wavelengths in the relational discrimination, or individual wavelengths in the single discrimination. The rate at which recallability decreased with increasing delay since sample presentation was the same for single and relational discriminations, but the initial level of performance differed, indicating that the relational discrimination was more difficult. In Experiment 2, recall functions for easy and difficult discriminations between individual wavelengths also differed in levels of initial performance but not in rate of decrement of recallability over time. Recall for stimuli differing in complexity may therefore reflect differences in discrimination difficulty.     

Preference in pigeons given a choice between sequences of fixed-ratio schedules: Effects of ratio values and duration of food delivery

Pigeons were exposed to schedules that consisted of two sequential fixed ratios, the completion of each followed by food delivery. When each alternative provided two food deliveries per 100 responses, the schedule with the shorter initial fixed-ratio value was consistently preferred. Subsequent attempts were made to shift this established preference by (1) increasing the ratio requirement in the second fixed ratio of the preferred schedule; (2) increasing the duration of food delivery in the second fixed ratio of the nonpreferred schedule; (3) decreasing the duration of food delivery in the first fixed ratio of the preferred schedule; and (4) shortening the second fixed ratio of the nonpreferred schedule. Preference shifted from the schedule with the shorter initial fixed ratio only when the duration of food delivery associated with the first fixed ratio of that schedule was too brief to allow eating. Under all other conditions, pigeons strongly preferred the schedule with the shorter initial fixed ratio even when, overall, that schedule yielded briefer access to food or required more responses to obtain equivalent access.     

Sample-specific ratio effects in matching to sample

In a symbolic matching-to-sample task, pigeons were trained using sample-specific, fixed-ratio “observing responses.” Subsequently, in a mixed condition, each sample was presented equally often with each ratio requirement, i.e., the ratios were no longer correlated with the samples. In a second experiment, pigeons were trained initially in the mixed condition and subsequently shifted to the sample-specific condition in which the required ratios were correlated with the samples. Results of both experiments suggested joint control of choices by ratio value and by the exteroceptive stimuli. The discriminative properties of the ratios appeared to outweigh absolute ratio-size effects.     

Waiting in pigeons: the effects of daily intercalation on temporal discrimination.

Pigeons trained on cyclic-interval schedules adjust their postfood pause from interval to interval within each experimental session. But on regular fixed-interval schedules, many sessions at a given parameter value are usually necessary before the typical fixed-interval "scallop" appears. In the first case, temporal control appears to act from one interfood interval to the next; in the second, it appears to act over hundreds of interfood intervals. The present experiments look at the intermediate case: daily variation in schedule parameters. In Experiments 1 and 2 we show that pauses proportional to interfood interval develop on short-valued response-initiated-delay schedules when parameters are changed daily, that additional experience under this regimen leads to little further improvement, and that pauses usually change as soon as the schedule parameter is changed. Experiment 3 demonstrates identical waiting behavior on fixed-interval and response-initiated-delay schedules when the food delays are short (less than 20 s) and conditions are changed daily. In Experiment 4 we show that daily intercalation prevents temporal control when interfood intervals are longer (25 to 60 s). The results of Experiment 5 suggest that downshifts in interfood interval produce more rapid waiting-time adjustments than upshifts. These and other results suggest that the effects of short interfood intervals seem to be more persistent than those of long intervals.     

Choice between response units: The rate constancy model

In a conjoint schedule, reinforcement is available simultaneously on two or more schedules for the same response. The present experiments provided food for key pecking on both a random-interval and a differential-reinforcement-of-low-rate (DRL) schedule. Experiment 1 involved ordinary DRL schedules; Experiment 2 added an external stimulus to indicate when the required interresponse time had elapsed. In both experiments, the potential reinforcer frequency from each component was varied by means of a second-order fixed-ratio schedule, and the DRL time parameter was changed as well. Response rates were described by a model stating that time allocation to each component matches the relative frequency of reinforcement for that component. When spending time in a given component, the subject is assumed to respond at the rate characteristic of baseline performance. This model appeared preferable to the absolute-rate version of the matching law. The model was shown to be applicable to multiple-response concurrent schedules as well as to conjoint schedules, and it described some of the necessary conditions for response matching, undermatching, and bias. In addition, the pigeons did not optimize reinforcer frequency.     

Instructional control of generalized relational matching to sample in children.

Three experiments examined the performance of 4-year-old children in matching geometric stimuli. Performance was developed as a simulation in which all components of the behavior were overt and directly measured. A correct match depended on the state of an instructional stimulus: the background color of the display. In the first two experiments, on nonidentity trials (signified by a green background) the next longer length, larger size, or greater distance was correct. With a blue background, a comparison identical to the sample was correct. In Experiment 3, red was added for which shorter, smaller, or nearer was correct. Also here, on nonidentity trials, if a comparison of the correct length was not presented, the children adjusted their search target to the comparison of the next succeeding size (larger or smaller) so as to maintain a constant matching relation. Subsequently, when exposure to the instructional stimulus was reduced to presentation only at the beginning of each trial, performance simulated matching based on instructions about abstract relations. In all experiments, accurate matching generalized across novel stimuli and reduced exposure to the instructional stimuli.     

Delayed and current stimulus control in successive discriminations

In a successive discrimination in which successively alternating red and green hues signaled component variable-interval schedules, sensitivity of the ratio of responses in the two components to variation in the component reinforcer ratio decreased systematically during the course of the component. This decrease in stimulus control or discrimination over the course of the component was shown to be the result of delayed control of responding during the component by the stimulus transition between components. When the red–green stimulus transition was altered by interpolating a white stimulus at the end of each 60-s component, discrimination at the beginning of the component (measured by the power-function exponent for sensitivity to reinforcement) was reduced. Conditions with the white stimulus inserted in other quarters of the component indicated that the current discriminative stimulus exerts control over responding throughout the component, whereas during about the first half of the component, response differentials are influenced by the transition between discriminative stimuli.     

Induced attack during fixed-ratio and matched-time schedules of food presentation

Adjunctive or induced behavior is generated during a variety of schedules of reinforcement. Several theoretical conceptualizations suggest that rate of reinforcement is the primary variable controlling the strength or levels of induced behavior. The operant response requirement within the schedule context has not been extensively studied as a determinant of induced responding. In the present study, levels of induced attack by food-deprived pigeons against restrained conspecifics were compared during response-dependent and response-independent schedules of food presentation equated or yoked interval-by-interval for reinforcement frequency. Experiment 1 compared levels of attack induced by fixed-ratio schedules of key pecking and yoked "matched-time" schedules. Experiment 2 similarly compared chained fixed-ratio 1 fixed-ratio 74 and yoked chained matched-time matched-time schedules. In both experiments, the response-dependent schedules generated greater levels (amount and probability) of induced attack than the response-independent time-based schedules. Thus, the ratio response requirement may be an important determinant of levels of induced responding, and the lower levels of attack observed during the response-independent condition may not be due to the absence of stimuli predicting food presentations. It is concluded that rate of reinforcement is not the sole variable determining levels of induced responding and that response-based and time-based schedules differ in their generation of induced responding.     

Conditioned reinforcement versus time to reinforcement in chain schedules.

Pigeons were trained on three-component chain schedules in which the initial component was either a fixed-interval or variable-interval schedule. The middle and terminal components were varied among fixed-interval fixed-interval, variable-interval variable-interval, and an interdependent variable-interval variable-interval schedule in which the sum of the durations of the two variable-interval components was always equal to the sum of the fixed-interval fixed-interval components. At issue was whether the response rate in the initial component was controlled by its time to primary reinforcement or by the temporal parameters of the stimulus correlated with the middle terminal link. The fixed-interval initial-link schedule maintained much lower response rates than the variable-interval initial-link schedule regardless of the schedules in the middle and terminal links. Nevertheless, the intervening schedules played some role: With fixed-interval schedules in the initial links, response rates were consistently highest with independent variable-interval schedules in the middle and terminal links and intermediate with the interdependent variable-interval schedules; these initial-link differences were predicted by the response rates in the middle link of the chain. With variable-interval schedules in the initial links, response rates were lowest with the fixed-interval fixed-interval schedules following the initial link and were not systematically different for the two types of variable-interval variable-interval schedules. The results suggest that time to reinforcement itself accounts for little if any variance in initial-link responding.     

Choice and delay of reinforcement: Effects of terminal-link stimulus and response conditions

In two experiments, pigeons were exposed to concurrent-chains schedules in which a single initial-link variable-interval schedule led to access to terminal links composed of fixed-interval or fixed-delay schedules. In Experiment 1, an 8-s (or 16-s) delay to reinforcement was associated with the standard key, while reinforcer delay values associated with the experimental key were varied from 4 to 32 s. The results of Experiment 1 showed undermatching of response ratios to delay ratios with terminal-link fixed-delay schedules, whereas in some pigeons matching or overmatching was evident with the fixed-interval schedules. In Experiment 2, one pair of reinforcer delay values, either 8 versus 16 s or 16 versus 32 s, was used. In the first condition of Experiment 2, different delays were associated with different keylight stimuli (cued condition). In the second condition, different terminal-link delays were associated with the same stimulus, either a blackout (uncued-blackout condition) or a white key (uncued-white condition). To examine the role of responses emitted during delays, the keys were retracted during a delay (key-absent condition) in the third condition and responses were required by a fixed-interval schedule in the fourth condition. Experiment 2 demonstrated that the choice proportions for the shorter delay were more extreme in the cued condition than in the uncued-blackout condition, and that the response requirement imposed by the fixed-interval schedules did not affect choice of the shorter delay, nor did the key-absent and key-present conditions. These results indicate that the keylight-stimulus conditions affected preference for the shorter of two delays and that the findings obtained in Experiment 1 depended mainly on the keylight-stimulus conditions of the terminal links (i.e., the conditioned reinforcing value of the terminal-link stimuli).     

Extending sequence-class membership with matching to sample

Three normal adults were first trained to point sequentially to each member of several pairs of visual stimuli. This baseline training established one class of stimuli to which subjects responded first, and another class of stimuli to which they responded second. Then, in a matching-to-sample procedure, baseline-sequence stimuli served as samples and new visual stimuli served as comparisons. Subjects were trained to choose one group of new comparisons when the sample was a "first" stimulus from the sequence baseline, and to choose the other new comparison stimuli when the sample was a "second" from the sequence baseline. When the new stimuli were then presented as pairs in the posttest, two subjects pointed to them in sequences predictable on the basis of the stimulus-class membership established during matching to sample. The failure of one subject to demonstrate sequential transfer was shown to be a consequence of the failure of the matching-to-sample procedure to establish stimulus classes. The production of sequences that were not directly trained suggested an empirical approach to the analysis of simple grammatical behavior.     

Neurochemical changes correlated with behavior maintained under fixed-interval and fixed-ratio schedules of reinforcement.

Key pecking of 4 pigeons was maintained under a multiple 3-min fixed-interval, 30-response fixed-ratio schedule of food presentation. Only one schedule was in effect during an experimental session, and each was correlated with a different keylight stimulus and location (left vs. right). The different schedule components alternated across days or weeks. Cerebrospinal fluid was collected from chronically implanted intracerebroventricular cannulae following sessions with the different schedules, as well as following sessions in which reinforcement was withheld (extinction), when response-independent food was delivered, and when the experimental chamber was dark and there were no scheduled events. Metabolites of the neurotransmitters serotonin, norepinephrine, and dopamine were assayed in cerebrospinal fluid using high-performance liquid chromatography with electrochemical detection. Compared to the fixed-ratio condition, responding maintained under the fixed-interval schedule resulted in consistently higher levels of the serotonin metabolite 5-hydroxyindoleacetic acid and of the dopamine metabolite homovanillic acid in all pigeons. Levels of 3-methoxy-4-hydroxyphenylethylene glycol, a metabolite of norepinephrine, and dihydroxyphenylacetic acid, another dopamine metabolite, were also higher in 3 of the 4 pigeons following exposure to the fixed-interval schedules when compared to levels of these metabolites after exposure to the fixed-ratio schedule. Extinction of fixed-ratio responding resulted in large increases in 5-hydroxyindoleacetic acid compared to levels of this metabolite under the fixed-ratio schedule, whereas this serotonin metabolite decreased during extinction of responding under the fixed-interval schedule. Control procedures suggested that the neurochemical changes were not related to the rate of responding but were a function of the specific experimental conditions. Distinctive neurochemical changes that accompany schedule-controlled responding show the sensitivity of the neurochemical environment to behavioral contingencies and demonstrate further the profound impact that such contingencies have on biobehavioral processes.