Temporal control of behavior and the power law

The performance of rats and pigeons under fixed-interval schedules was studied in two experiments. The duration of postreinforcement pause was a declining proportion of fixed-interval duration. For pigeons this was true both when the duration of the reinforcer was fixed and when it was increased in direct proportion to increases in fixed-interval duration; the longer reinforcer durations did, however, lengthen the postreinforcement pause at higher schedule values. A quantitative analysis of data from Experiments 1 and 2 and from other studies showed that fractional exponent power functions described the relationship between postreinforcement pause and fixed-interval value; similar functions have previously been observed in studies of temporal differentiation. It was concluded that power functions reflect a direct causal, rather than artifactual, relationship between performance and the temporal requirements of reinforcement schedules.     

Two types of pigeon key pecking: suppression of long- but not short-duration key pecks by duration-dependent shock

The key pecking of eight pigeons was maintained on a variable-interval 1-minute schedule of food reinforcement. Sometimes, all responses between 35 and 50 milliseconds in duration produced a shock; sometimes, all responses between 10 and 25 milliseconds produced a shock; sometimes, shocks were produced by pecks without regard to duration (nondifferential punishment), and sometimes shocks were delivered independently of responding. Punishment of 35- to 50-millisecond responses selectively suppressed those responses, while punishment of 10- to 25-millisecond responses and nondifferential punishment suppressed responding overall but did not suppress responses of particular duration. Punishment of 35- to 50-millisecond responses suppressed key pecking slightly less than did nondifferential punishment. Punishment of 10- to 25-millisecond responses and response-independent shock produced roughly equal amounts of suppression, substantially less than the other punishment procedures. The data support the view that there are at least two kinds of key peck, identifiable on the basis of duration, one of which (short duration) is insensitive to its consequences.     

Electric shock produced drinking in the squirrel monkey.

Squirrel monkeys were periodically exposed to brief electric tail shocks in a test environment containing a rubber hose, response lever, and a water spout. Shock delivery produced preshock lever pressing and postshock hose biting. Additionally, all subjects displayed licking responses following postshock biting-attack episodes. Further experiments showed that licking was: (1) influenced by hours of water deprivation; (2) drinking behavior; (3) the direct result of shock delivery; and (4) developed spontaneously in naive subjects with or without opportunities for hose biting or lever pressing. Removing the opportunity to attack increased postshock drinking. A noxious environmental stimulus that causes aggression can also produce drinking.     

Clock control of human performance on avoidance and fixed-interval schedules

The avoidance and fixed-interval performances of human subjects were studied in two experiments. Addition of time-correlated stimuli (added clock) improved behavioral efficiency, since response rates decreased without decreases in reinforcement rates. Response-dependent display of the clock maintained a second, observing response and reductions in clock duration weakened such observing behavior. Generally, the reinforcing properties of the clock were more apparent with the avoidance than with the fixed-interval schedule, a finding attributed to temporal cues already provided by delivery of the fixed-interval reinforcers. Reduced rates of the main response when the clock was dependent on an observing response were more than offset by rates of the observing response in the majority of subjects. Thus, the results do not support an interpretation of the reinforcing properties of added clocks simply in terms of work reduction.     

Food deliveries during the pause on fixed-interval schedules

Pigeons were trained on fixed-interval schedules of food delivery. In Experiments I and II, the fixed interval was initiated by the previous fixed-interval reinforcer; in Experiment III, the fixed interval was initiated by the first key peck following the preceding fixed-interval reinforcer (a chain fixed-ratio one, fixed-interval schedule). During the postreinforcement pause, variable-time schedules delivered food independent of any specific response. Rate of food delivery during the pause had only small effects on pause duration in Experiments I and II. In Experiment III, however, pause duration increased systematically with the rate of food delivery during the pause. These data suggest that the momentary proximity to reinforcement delivered via the fixed-interval schedule exerts potent control over pause termination. Additional analysis revealed that pause termination was unaffected by the intermittent delivery of food during the pause. Such data suggest that the temporal control by fixed-interval schedules is highly resistant to interference.     

Positive reinforcement and the elimination of reinforced responses

Key pecking was maintained on a fixed-interval schedule while either a differential-reinforcement-of-not-responding or a fixed-time schedule was imposed simultaneously. The lower the time parameter of the not-responding schedule, the lower was the response rate. Similar effects occurred with the fixed-time schedule, if the pigeons had experience with reinforcement for not responding. Otherwise the effects were less orderly, to the extent that rate could reach maximum with the lowest-valued fixed-time schedule. The not-responding and the response-independent schedules had similar effects on rate in experienced pigeons only when the time parameter or nominal frequency of food presentation was considered. When considered in terms of obtained frequency of food presentation, reinforcement of not responding produced larger decrements in rate than did the fixed-time schedule.     

Behavioral contrast as a function of the temporal location of reinforcement

Pigeons were trained on a multiple variable-interval variable-interval schedule of reinforcement. One component was then changed to a variation of a fixed-interval schedule in which the same rate of reinforcement was obtained as previously but the location of the reinforcer was fixed within the component. The effects of different temporal locations were compared. An increase in response rate for the unchanged variable-interval component (behavioral contrast) occurred when the reinforcer was located in the middle or at the end of the FI component, but response suppression occurred when it was located at the beginning of the component. The pattern of results cannot be explained by any previous theories of contrast. The overall response rates, and the pattern of local rates within the components, were consistent with the hypothesis that the major determinant of the contrast effect was the transition to a lower reinforcement rate following the unchanged component.     

Effects of signals preceding and following shock on baseline responding during a conditioned-suppression procedure

Long-Evans rats were exposed to a succession of conditioned-suppression procedures involving pairings of (1) signal-shock, (2) shock-signal, and (3) a signal-shock-signal sequence in which first and second signals were at first physically identical. Traditional suppression of food-reinforced responding was obtained under the signal-shock arrangement, and exposure to the shock-signal sequence resulted in conditioned enhancement of responding during the signal. The signal-shock-signal condition reliably suppressed responding during the first signal, but produced no differential effect on response rate during the second signal. Baseline responding was least changed from preshock rates under the signal-shock-signal procedure, but baseline rate was considerably reduced under the signal-shock and shock-signal arrangements, the latter yielding most substantial reductions. A second experiment indicated that the magnitude and direction of changes in baseline responding reported in Experiment I were not confined to cases in which the first and second signals in the signal-shock-signal arrangement were physically identical. It is suggested that the major effects of the conditioned-suppression procedure on response rate might not be confined to presentations of the signal.     

The use of strategies and messages to alter aggressive interactions

Male and female college students were instigated to aggression by a confederate's shocks during a preliminary task. The confederate informed half of the treatment subjects of the response strategy which he intended to adopt. The other half received an irrelevant message. All subjects then competed against the confederate, who employed one of the following five response consequence strategies: a) set a maximum shock on all trials; b) set a minimum shock on all trials; c) set shocks identical to the subject's response on the preceding trial; d) set shocks two settings below the subject's response; or e) set shocks two settings above the subject's. The subject's latency to setting a shock, the intensities of the shocks set, the durations of the shock settings, and the subject's reaction times were recorded. When an irrelevant message was delivered, passive responses, well below those of the opponent, resulted in the lowest level of retaliation. In the presence of a relevant message, the match-same strategy emerged as an effective deterrent to aggressive behavior. The results were found to be consistent with predictions derived from an application of the norm of reciprocity and research demonstrating the enhancing effects achieved through the communication of existing contingencies.     

No Time of Day Modulation or Time Stamp on Multiple Memory Tasks in Rats

Various demonstrations of “time stamp” effects in the animal learning literature have reinforced the idea that circadian information is encoded as part of a combined internal/external representation of context and that this contextual information is utilized for complex retrieval processes supporting memory. The goal of the present series of experiments is to assess this idea by manipulating training/testing circadian times on a battery of learning and memory tasks commonly used in the rodent. The data obtained from five experiments using four different learning and memory paradigms provide no evidence for “time stamp” effects on place memory, context memory (aversive or appetitive), or S-R habit learning.