Dimensional stimulus control following brief wavelength training

Pigeons with extensive training pecking a key illuminated by a white line then had brief training with the key illuminated by 555 nanometers. This was immediately followed by a wavelength generalization test in extinction. Dimensional stimulus control about the training wavelength increased with the duration and number of reinforcements given on variable-interval 30-sec and variable-interval 10-sec schedules in Experiment I. In Experiment II, dimensional stimulus control was obtained after only 4 min of wavelength training from birds with prior and independent discrimination training. Experiment III provided groups equated in number of reinforcers with groups in Experiment I and two 8-min duration groups. Analyses, which included results from both Experiments I and III, showed that dimensional stimulus control increased: (a) more rapidly as a function of the duration of variable-interval 10-sec than variable-interval 30-sec reinforcement; (b) at the same rate across variable-interval reinforcement schedules, as a function of the number of reinforcers available during brief wavelength training.     

A comparison of the key-peck and treadle-press operants in the pigeon: differential-reinforcement-of-low-rate schedule of reinforcement

Key pecking and treadle pressing in pigeons were compared under concurrent (key-treadle) and single-operant differential-reinforcement-of-low-rate schedules of food reinforcement ranging from 5 to 60 sec (concurrent procedure) or 5 to 120 sec (single-operant procedure). Under both procedures, the two operants followed the same general law: decreasing response rate and reinforcement rate and increasing number of responses per reinforcement as a function of increasing schedule interval. High correlations were found between key pecking and treadle pressing for the measures of response rate, reinforcement rate, and responses per reinforcement. Regression equations allowed the prediction of treadle pressing from key pecking. More bursting occurred in responding to the key, and key pecking showed a more precise temporal discrimination than treadle pressing. A test for sequential dependencies between key and treadle responses showed significant dependencies not only under the concurrent procedure but also in data created artificially by merging key and treadle sequences from different pigeons under the concurrent procedure and from the same pigeon under the single-operant procedure. It seems likely that the sequential dependencies found were due to the independent action of the schedule on each operant and that behavioral dependencies did not occur with the concurrent training procedure. The key-peck operant does not appear to have any special qualities that preclude its use in discovering general laws of behavior, at least under the differential-reinforcement-of-low-rate schedule. The usefulness of the key peck in other situations requires direct experimental study.     

Short-term retention of response outcome as a determinant of serial reversal learning

The correlation between short-term retention of the outcome of the preceding response and overall learning proficiency was investigated for serial reversal learning. Pigeons were trained to asymptote on a serial reversal problem and then were presented a percentage reinforcement schedule where only some correct trials were rewarded. Nonrewarded correct trials were treated exactly as incorrect trials. The difference in error probability following the two types of correct trials was then used as a measure of short-term retention. When intertrial intervals (ITI) were short (6 sec), substantial differences occurred. When the ITI's were increased, the difference in accuracy declined regularly to no difference at an ITI of 60 sec. This demonstration of a short-term retention gradient, coupled with the finding that overall reversal learning was much better with the shorter ITI's, suggests that a primary mechanism of improvement in serial reversal learning is the acquisition of a conditional discrimination based on the outcome of the preceding response.     

Stimulus control of free-operant avoidance: The contribution of response rate and incentive relations between multiple-schedule components

The associations formed in the components of a multiple schedule can be classified as (1) stimulus-response (S-R) associations and (2) stimulus-reinforcer (S-S^R) associations. The present experiments sought to determine the individual contribution of these S-R and S-S^R associations to stimulus control by manipulating them independently. Responses postponed shocks by 25 sec in the presence of a tone alone and a light alone in all experiments. The contingencies programmed in the absence of both tone and light established a reference for the S-R and S-S^R associations in tone and in light. All four possible combinations of signalling response increase or decrease together with incentive increase or decrease were studied. Although the influence of the contingencies operating in the absence of tone and light was difficult to detect from response rates in tone or light, presenting tone and light together revealed clear effects. Response rates in tone and light together relative to those in either alone depended upon the contingency operating in the absence of tone and light. Stimulus-response and stimulus-reinforcer associations appeared to counteract each other when in opposition and combine together to enhance each other when in agreement. This suggested that the associations of a stimulus to response and to incentive combine algebraically in determining stimulus control. An algebraic analysis in terms of the S-R and S-S^R associations conditioned to the stimulus elements comprising the training and test stimuli accounted for the observed patterns of data.     

Configural conditioning in the CER: Loss of element strength after repeated reinforced compound CS trials

Different groups of rats received different numbers of compound CS (light/noise) conditioning trials in the CER procedure. The amount of suppression evident to the single elements of the compound decreased as a function of the number of previous compound trials. This loss of CR strength was interpreted as a configuring effect. Further experimental comparisons indicated that the configuring effect could not be readily explained in terms of a generalization decrement or a stimulus novelty hypothesis.     

Food deliveries during the pause on fixed-interval schedules

Pigeons were trained on fixed-interval schedules of food delivery. In Experiments I and II, the fixed interval was initiated by the previous fixed-interval reinforcer; in Experiment III, the fixed interval was initiated by the first key peck following the preceding fixed-interval reinforcer (a chain fixed-ratio one, fixed-interval schedule). During the postreinforcement pause, variable-time schedules delivered food independent of any specific response. Rate of food delivery during the pause had only small effects on pause duration in Experiments I and II. In Experiment III, however, pause duration increased systematically with the rate of food delivery during the pause. These data suggest that the momentary proximity to reinforcement delivered via the fixed-interval schedule exerts potent control over pause termination. Additional analysis revealed that pause termination was unaffected by the intermittent delivery of food during the pause. Such data suggest that the temporal control by fixed-interval schedules is highly resistant to interference.     

Positive contrast following gradual and abrupt increases in reward magnitude using delay of reinforcement

In Experiment 1, rats were given a 1-pellet reward for 48 preshift trials. During a subsequent 20-trial postshift phase, one group was shifted to a 12-pellet reward on Trial 1, a second was shifted on Trial 11, and a third was given 1 more pellet each trial and then 12 pellets for the last 10 trials. The speeds of all three groups increased to a level above that of a control group given a 12-pellet food reward throughout training (positive contrast). In experiment 2, rats were shifted from 1 to 12 pellets either gradually or abruptly following either abbreviated training (9 trials) or extended training (20 trials). One group of control subjects received 12 pellets throughout training. The results revealed a positive contrast effect for gradually shifted subjects following extended training but not following abbreviated training. The abrupt shift procedure produced positive contrast following abbreviated training but only a marginal effect following extended training. These results indicate that, contingent upon the amount of preshift training, either gradual or abrupt reward increases may produce positive contrast.     

Effect of sample presentation time on long-delay matching in the pigeon

The effect of sample stimulus presentation time on long-delay matching in highly practiced pigeons was investigated. The birds were found capable of above chance matching performance at a delay of 60 sec provided the sample stimulus was presented for 4 sec or longer. Matching accuracy increased as a negatively accelerated function of sample stimulus presentation time and decreased as a negatively accelerated function of time since the termination of the sample. The rate of forgetting was found to be independent of sample stimulus presentation time. The data were inconsistent with a temporal discrimination interpretation of the effect of presentation time on delayed matching. The data were interpreted as supporting a simple trace strength and decay model of pigeon delayed matching.     

Effects of schedule and magnitude of reinforcement under conditions of thirst motivation

In contrast to a recent finding (Macdonald, G. E., & De Toledo, L. Learning and Motivation, 1974, 5, 288–298.) the results of three experiments investigating various partial reinforcement (PRF) manipulations under conditions of thirst motivation demonstrated strong similarity to analogous manipulations involving food reward. Specifically, for animals receiving water reinforcement, PRF was shown to generate greater resistance to extinction than continuous reinforcement (Expt 1 & 3), the schedule of reinforcement was shown to interact with level of acquisition (Expt 1 and 2), and the magnitude of the partial reinforcement extinction effect was shown to be a function of reward magnitude (Expt 3). These results provide strong evidence that mechanisms which operate in partial reinforcement situations are highly similar, regardless of the type of appetitive reinforcement.     

Effect of CS-US pairings on shock-elicited aggression as a function of US intensity

In two experiments with paired rats, the effect of superimposing CS-US pairings on a baseline of shock-elicited aggression was studied. Baseline shocks (3.0 mA, 0.125-sec duration) occurred at a rate of 20 shocks per min throughout each session. In Experiment I, each independent group of two pairs of subjects received (in addition to baseline shocks) US shocks of 1.0, 3.0, or 5.0 mA and 5-sec duration, each shock signalled by a 1-min CS. At all three US intensities, aggression increased during the CS. In Experiment II, pairs of subjects received each unconditioned stimulus intensity in a within-subjects design. This procedure revealed a direct relationship between rate of responding and unconditioned shock intensity.