Short-term retention of response outcome as a determinant of serial reversal learning

The correlation between short-term retention of the outcome of the preceding response and overall learning proficiency was investigated for serial reversal learning. Pigeons were trained to asymptote on a serial reversal problem and then were presented a percentage reinforcement schedule where only some correct trials were rewarded. Nonrewarded correct trials were treated exactly as incorrect trials. The difference in error probability following the two types of correct trials was then used as a measure of short-term retention. When intertrial intervals (ITI) were short (6 sec), substantial differences occurred. When the ITI's were increased, the difference in accuracy declined regularly to no difference at an ITI of 60 sec. This demonstration of a short-term retention gradient, coupled with the finding that overall reversal learning was much better with the shorter ITI's, suggests that a primary mechanism of improvement in serial reversal learning is the acquisition of a conditional discrimination based on the outcome of the preceding response.     

Stimulus control of free-operant avoidance: The contribution of response rate and incentive relations between multiple-schedule components

The associations formed in the components of a multiple schedule can be classified as (1) stimulus-response (S-R) associations and (2) stimulus-reinforcer (S-S^R) associations. The present experiments sought to determine the individual contribution of these S-R and S-S^R associations to stimulus control by manipulating them independently. Responses postponed shocks by 25 sec in the presence of a tone alone and a light alone in all experiments. The contingencies programmed in the absence of both tone and light established a reference for the S-R and S-S^R associations in tone and in light. All four possible combinations of signalling response increase or decrease together with incentive increase or decrease were studied. Although the influence of the contingencies operating in the absence of tone and light was difficult to detect from response rates in tone or light, presenting tone and light together revealed clear effects. Response rates in tone and light together relative to those in either alone depended upon the contingency operating in the absence of tone and light. Stimulus-response and stimulus-reinforcer associations appeared to counteract each other when in opposition and combine together to enhance each other when in agreement. This suggested that the associations of a stimulus to response and to incentive combine algebraically in determining stimulus control. An algebraic analysis in terms of the S-R and S-S^R associations conditioned to the stimulus elements comprising the training and test stimuli accounted for the observed patterns of data.     

Configural conditioning in the CER: Loss of element strength after repeated reinforced compound CS trials

Different groups of rats received different numbers of compound CS (light/noise) conditioning trials in the CER procedure. The amount of suppression evident to the single elements of the compound decreased as a function of the number of previous compound trials. This loss of CR strength was interpreted as a configuring effect. Further experimental comparisons indicated that the configuring effect could not be readily explained in terms of a generalization decrement or a stimulus novelty hypothesis.     

Food deliveries during the pause on fixed-interval schedules

Pigeons were trained on fixed-interval schedules of food delivery. In Experiments I and II, the fixed interval was initiated by the previous fixed-interval reinforcer; in Experiment III, the fixed interval was initiated by the first key peck following the preceding fixed-interval reinforcer (a chain fixed-ratio one, fixed-interval schedule). During the postreinforcement pause, variable-time schedules delivered food independent of any specific response. Rate of food delivery during the pause had only small effects on pause duration in Experiments I and II. In Experiment III, however, pause duration increased systematically with the rate of food delivery during the pause. These data suggest that the momentary proximity to reinforcement delivered via the fixed-interval schedule exerts potent control over pause termination. Additional analysis revealed that pause termination was unaffected by the intermittent delivery of food during the pause. Such data suggest that the temporal control by fixed-interval schedules is highly resistant to interference.     

Positive contrast following gradual and abrupt increases in reward magnitude using delay of reinforcement

In Experiment 1, rats were given a 1-pellet reward for 48 preshift trials. During a subsequent 20-trial postshift phase, one group was shifted to a 12-pellet reward on Trial 1, a second was shifted on Trial 11, and a third was given 1 more pellet each trial and then 12 pellets for the last 10 trials. The speeds of all three groups increased to a level above that of a control group given a 12-pellet food reward throughout training (positive contrast). In experiment 2, rats were shifted from 1 to 12 pellets either gradually or abruptly following either abbreviated training (9 trials) or extended training (20 trials). One group of control subjects received 12 pellets throughout training. The results revealed a positive contrast effect for gradually shifted subjects following extended training but not following abbreviated training. The abrupt shift procedure produced positive contrast following abbreviated training but only a marginal effect following extended training. These results indicate that, contingent upon the amount of preshift training, either gradual or abrupt reward increases may produce positive contrast.     

Effect of sample presentation time on long-delay matching in the pigeon

The effect of sample stimulus presentation time on long-delay matching in highly practiced pigeons was investigated. The birds were found capable of above chance matching performance at a delay of 60 sec provided the sample stimulus was presented for 4 sec or longer. Matching accuracy increased as a negatively accelerated function of sample stimulus presentation time and decreased as a negatively accelerated function of time since the termination of the sample. The rate of forgetting was found to be independent of sample stimulus presentation time. The data were inconsistent with a temporal discrimination interpretation of the effect of presentation time on delayed matching. The data were interpreted as supporting a simple trace strength and decay model of pigeon delayed matching.     

Effects of schedule and magnitude of reinforcement under conditions of thirst motivation

In contrast to a recent finding (Macdonald, G. E., & De Toledo, L. Learning and Motivation, 1974, 5, 288–298.) the results of three experiments investigating various partial reinforcement (PRF) manipulations under conditions of thirst motivation demonstrated strong similarity to analogous manipulations involving food reward. Specifically, for animals receiving water reinforcement, PRF was shown to generate greater resistance to extinction than continuous reinforcement (Expt 1 & 3), the schedule of reinforcement was shown to interact with level of acquisition (Expt 1 and 2), and the magnitude of the partial reinforcement extinction effect was shown to be a function of reward magnitude (Expt 3). These results provide strong evidence that mechanisms which operate in partial reinforcement situations are highly similar, regardless of the type of appetitive reinforcement.     

Effect of CS-US pairings on shock-elicited aggression as a function of US intensity

In two experiments with paired rats, the effect of superimposing CS-US pairings on a baseline of shock-elicited aggression was studied. Baseline shocks (3.0 mA, 0.125-sec duration) occurred at a rate of 20 shocks per min throughout each session. In Experiment I, each independent group of two pairs of subjects received (in addition to baseline shocks) US shocks of 1.0, 3.0, or 5.0 mA and 5-sec duration, each shock signalled by a 1-min CS. At all three US intensities, aggression increased during the CS. In Experiment II, pairs of subjects received each unconditioned stimulus intensity in a within-subjects design. This procedure revealed a direct relationship between rate of responding and unconditioned shock intensity.     

Effects of expectancies of different reward magnitudes in transfer from noncontingent pairings to instrumental performance

In two experiments, rats received noncontingent pairings of two stimuli with food reward, one paired with small reward and the other with large reward, and received bar press training with large reward or with small reward. When the noncontingent stimuli (NS) were presented for test during subsequent rewarded bar pressing and during early extinction of bar pressing, responding for each group was faster in the presence of the NS which was paired with the same reward magnitude that group received in bar press training than to the NS which had been paired with a different reward magnitude. As extinction progressed, all groups responded more slowly in the presence of the NS which had been paired with the large reward than in the presence of the NS which had been paired with small reward. These results were interpreted as indicating that responding in the presence of an NS depends on: (i) whether the reward expectancy elicited by the NS has been conditioned to the instrumental response, and (ii) the relationship between the reward expected in the presence of the NS and that received in test.     

Stimulus control of differential-reinforcement-of-low-rate responding

Five pigeons were given single-stimulus training on an 8-sec differential-reinforcement-of-low-rate schedule followed by steady-state generalization training using 12 wavelength stimuli. Three birds had a high percentage of reinforced responses on the training schedule and flat generalization gradients of total responses. The birds with fewer reinforced responses had much steeper generalization gradients. Generalization gradients plotted as a function of both stimulus wavelength and interresponse time showed that for most birds, stimulus control was restricted to responses with long interresponse times. Responses with very short interresponse times were not under stimulus control and there was some evidence of inhibitory control of short interresponse times. Interresponse-times-per-opportunity functions, plotted as a function of stimulus wavelength, showed that stimulus wavelength controlled the temporal distribution of responses, rather than the overall rate of response. The data indicate that the differential-reinforcement-of-low-rate schedule generates several response categories that are controlled in different ways by wavelength and time-correlated stimuli, and that averaging responses regardless of interresponse-time length obscures this control.