Delayed signal detection, differential reinforcement, and short-term memory in the pigeon.

In two discrete-trial delayed-detection experiments, six pigeons were trained on dependent concurrent variable-interval schedules. Pecking a red side key was reinforced when the brighter of two white lights (S1) had been presented on the center key, and pecking a green side key was reinforced when the duller of two white lights (S2) had been presented on the center key. Incorrect responses were red side-key pecks following S2 presentations and green side-key pecks following S1 presentations; these resulted in three-second blackouts. In Experiment 1, the time between presentation of S1 or S2 on the center key and the onset of the red and green side keys was varied nonsystematically from 0.06 seconds to 19.69 seconds across experimental conditions. Stimulus discriminability decreased as the stimulus-choice delay increased. A rectangular-hyperbolic function better described this decrease in discriminability over time than did a negative-exponential function. In Experiment 2, at each of three stimulus-choice delays (0.06, 3.85, and 10.36 seconds), relative reinforcer frequency for correct responses to the red and green side keys was varied by changing the values of the dependent concurrent variable-interval schedules. The sensitivity of choice to relative reinforcer frequency was independent of the decrease in stimulus discriminability with increasing stimulus-choice delay.     

Frequency versus magnitude of reinforcement: New data with a different procedure

Two pigeons, with previous exposure to concurrent schedules, were submitted to 29 sessions of 8 hours each with concurrent variable-interval variable-interval schedules in which reinforcement parameters changed from session to session. In the first nine sessions reinforcement durations were equal in both schedules while reinforcement frequencies varied; in Sessions 10 through 18, both frequency and duration of reinforcement were varied; in Sessions 19 through 29, only reinforcement duration was varied. Results with this different procedure confirm previous findings that behavior is more sensitive to changes in reinforcement frequency than to reinforcement magnitude.     

Discriminability of frequency of food or stimulus presentations in variable-time schedules

Pigeons responded in a two-alternative forced-choice task in which reinforcement was dependent upon the frequency of events that occurred in an immediately preceding schedule sample. On a given trial the events were either brief food presentations or brief visual and auditory stimulus changes. High levels of stimulus control were obtained by food-presentation schedules only. Discriminative control by frequency or stimulus change was absent. Stimulus control by food frequency was decreased by the imposition of a delay period between the schedule sample and the choice. Moreover, stimulus control by food frequency was related to the ratio of food-presentation schedule pairs when novel schedules were presented in a transfer test.     

Effect of punishment on human variable-interval performance

Three female human subjects pressed a button for monetary reinforcement in a range of variable-interval schedules specifying different frequencies of reinforcement. On alternate days, responding was also punished (by subtracting money) according to a variable-ratio 34 schedule. In the absence of punishment, rate of responding was an increasing negatively accelerated function of reinforcement frequency; the relationship between response rate and reinforcement frequency conformed to Herrnstein's equation. The effect of the punishment schedule was to suppress responding at all frequencies of reinforcement. This was reflected in a change in the values of both constants in Herrnstein's equation: the value of the theoretical maximum response-rate parameter was reduced, while the parameter describing the reinforcement frequency corresponding to the half-maximal response rate was increased.     

Thurstone's discriminal processes fifty years later

Four issues are discussed concerning Thurstone's discriminal processes: the distributions governing the representation, the nature of the response decision rules, the relation of the mean representation to physical characteristics of the stimulus, and factors affecting the variance of the representation. A neural schema underlying the representation is proposed which involves samples in time of pulse trains on individual neural fibers, estimators of parameters of the several pulse trains, samples of neural fibers, and an aggregation of the estimates over the sample. The resulting aggregated estimate is the Thurstonian representation. Two estimators of pulse rate, which is monotonic with signal intensity, are timing and counting ratios and two methods of aggregation are averaging and maximizing. These lead to very different predictions in a speed-accuracy experiment; data indicate that both estimators are available and the aggregation is by averaging. Magnitude estimation data are then used both to illustrate an unusual response rule and to study the psychophysical law. In addition, the pattern of variability and correlation of magnitude estimates on successive trials is interpreted in terms of the sample size over which the aggregation takes place. Neural sample size is equated with selective attention, and is an important factor affecting the variability of the representation. It accounts for the magical number seven phenomenon in absolute identification and predicts the impact of nonuniform distributions of intensities on the absolute identification of two frequencies. 1977 Psychometric Society Presidential Address. This work was supported in part by a grant of the National Science Foundation to Harvard University. I wish to express my appreciation to S. Burbeck, D. M. Green, M. Shaw, and B. Wandell for their useful comments on an earlier draft of this paper.     

Relative durations of conditioned stimulus and intertrial interval in conditioned suppression.

The effects of the relative durations of the conditional stimulus and the intertrial interval on bar pressing during a conditioned-suppression procedure were examined as a function of two additional variables--type of operant baseline schedule and rate of shock presentation. In Experiment 1, response suppression was compared across components of a multiple fixed-ratio, random-ratio, fixed-interval, random-interval schedule, at relative conditioned-stimulus/intertrial-interval durations of 1/1, 1/4, and 1/9. In Experiment 2, relative conditioned-stimulus/intertrial-interval duration (1/5, 3/3, or 5/1) was manipulated across groups, while shock frequency (2, 6, or 10 shocks/hr) was manipulated within groups. In both experiments, suppression during the signal was virtually complete at all relative durations. Responding was also suppressed during the intertrial interval, but that suppression varied as a function of experimental manipulations. In Experiment 1, intertrial-interval response rates were higher when relative signal duration was 1/9 than when it was 1/1, although both relative signal duration and shock frequency, which covaried, could have contributed to the difference. In Experiment 2, the patterning of response rates between successive shocks was affected by relative duration, absolute rates during the intertrial interval varied as a function of shock frequency, and differences between suppression during the signal and suppression during the intertrial interval were affected by both relative duration and shock frequency. The data support an analysis based upon relationships between shock-correlated and intertrial-interval stimuli and, as assessed by the relative-delay-to-reinforcement metric, are comparable to results that have been reported from experiments using similar manipulations under the autoshaping paradigm.     

The effect of signaled reinforcement availability on concurrent performances in humans

During Phase I, three female human subjects pressed a button for monetary reinforcement in two-component concurrent variable-interval schedules. Five different reinforcement frequencies were used in component A, whereas the reinforcement frequency in component B was held constant. Absolute rates of responding conformed to equations proposed by Herrnstein to describe concurent performances, and the ratios of the response rates and the times spent in the two components conformed to the matching law. During Phase II, the availability of reinforcement in component A was signaled by the illumination of a lamp. This resulted in suppression of response rates in component A and elevation of response rates in component B, these changes being reflected in a distortion of the matching relationship which took the form of a bias in favor of component B.     

Schedule-induced drinking as functions of interpellet interval and draught size in the Java macaque

Three Java monkeys received food pellets that were assigned by both ascending and descending series of fixed-time schedules whose values varied between 8 and 256 seconds. The draught size dispensed by a concurrently available water-delivery tube was systematically varied between 1.0 and 0.3 milliliter per lick at various fixed-time values during the second and third series determinations. Session water intake was bitonically related to the interpellet interval and was determined by the interaction of (1) the probability of initiating a drinking bout, which fell off at the highest interpellet intervals and, (2) the size of the bout, which increased directly with increases in interpellet interval. Variations in draught size had little effect on total session intakes, but reduced bout size at draught sizes of 0.5 milliliter and below. Thus, a volume-regulation process of schedule-induced drinking operated generally at the session-intake level, but was limited to higher draught sizes at the bout level.     

Effect of variable-interval punishment on the behavior of humans in variable-interval schedules of monetary reinforcement

One male and three female human subjects pressed a button for monetary reinforcement under a range of variable-interval schedules specifying different frequencies of reinforcement. On alternate days, responding was also punished (by subtraction of money) according to a variable-interval 170-second schedule. In the absence of punishment, the rate of responding was an increasing negatively accelerated function of reinforcement frequency, as predicted by Herrnstein's equation. The effect of the punishment schedule was to suppress responding under lower frequencies of reinforcement; responding under higher reinforcement frequencies was much less affected. This was reflected in an increase in the value of K_H (the constant expressing the reinforcement frequency corresponding to the half-maximal response rate), whereas there was no significant change in the value of R_max (the constant expressing the maximum response rate). Previous results had shown that variable-ratio punishment resulted in a change in the values of both constants (Bradshaw, Szabadi, and Bevan, 1977). The results of the present study were consistent with the concept that the suppressive effects of punishment on responding depend on the nature of the punishment schedule.     

Input-specific long-term potentiation in the rat lateral amygdala of horizontal slices

Long-term potentiation (LTP) at input synapses to the lateral nucleus of the amygdala (LA) is a candidate mechanism for memory storage during fear learning. Cellular mechanisms of LTP have been nearly exclusively investigated in coronal brain slices. In our experiments, we used a horizontal brain slice preparation of rats that preserved most of the connections to cortical areas and the hippocampus. The stimulation electrodes were located either within the external capsule (EC) or the LA. The aim of the present study was to investigate the mechanisms of LTP induced either by weak theta burst stimulation (TBS) or strong high frequency stimulation (HFS) using the two different stimulation sites. Whereas both TBS and HFS of afferences running through the LA induced stable LTP, TBS failed to induce LTP of EC-inputs to the LA. The present findings also show that LTP in the LA exhibits vulnerability at different time windows after induction. The time window was dependent on the kind of stimulated afferences. Later LTP becomes resistant to disruption by low frequency stimulation. We could show that both used inputs depended on NMDA receptors for LTP-induction. LTP induced by stimulation of fibers within the LA was not altered by nifedipine (10 microM). In contrast, EC-induced LTP was dependent on L-type voltage-gated calcium channels (VGCC). Finally, we found a higher magnitude of LTP in females using TBS, whereas HFS did not cause gender-specific differences. Our study supports the conclusion that the form of LA-LTP depend on which afferences are activated and what pattern of stimulation is used to induce LTP.