Effects of reinforcer duration on responding in two-link chained interval schedules

Each of five pigeons was exposed to two or more durations of access to mixed grains on two-link, chained, interval schedules in which both links were identical fixed-interval or variable-interval schedules. Response rates were an increasing function of reinforcer duration for both initial and terminal links. For both types of interval schedules, initial-link response rates were more sensitive to reinforcer duration than were terminal-link response rates. The present results, together with prior ones, suggest that chaining and choice procedures are each sufficient for demonstrating substantial sensitivity of responding to changes in reinforcer duration.     

Intractable properties of responding under a fixed-interval schedule

The behavior engendered by the fixed-interval schedule is characterized by its variability within and across intervals. The present experiment was designed to assess further the magnitude of interval-to-interval dynamics and to explore conditions which might enhance control by response number for subsequent output. Pigeons were exposed to three experimental manipulations after responding had stabilized under a fixed-interval five-minute schedule. First, a discrete five-stimulus counter was added so that the key color changed after a fixed number of responses. Then additional grain presentations were made at the end of the interval so that high response output was differentially reinforced in the presence of the counter stimuli. Finally, the counter stimuli were presented as an irregular clock (i.e., independently of responding), but the durations were yoked to performance under the counter condition. The data show that response number can exert influence from one interval to the next, but this source of control is weak and not influenced by the experimental manipulations. Results from the clock arrangement indicate that behavior is controlled largely by the stimulus conditions prevailing at the time of interval onset.     

Fixed-interval performance: The dynamics of behavior and the interval length

Postreinforcement pauses from successive intervals under various fixed-interval schedules (ranging from 15 seconds to 480 seconds in length) were subjected to lag-1 autocorrelation analysis. Results from both rats and pigeons suggested that there was a consistent tendency for pause values in successive intervals to be weakly positively related. This tendency did not appear to change systematically with interval length and was exhibited both when the reinforcer magnitude was constant and when it was variable at different interval values. The findings do not support suggestions that the dynamic properties of performance under fixed-interval schedules vary systematically with interval length, and are in the opposite direction from some previous findings suggesting that measures of behavior (such as post-reinforcement pause length or number of responses) in successive intervals are inversely related.     

Timing without a timer.

Inferred-process theories propose various internal timing mechanisms to provide discriminative stimuli for temporal control of behavior. Biobehaviorally informed computer simulations indicate that timing may emerge from the action of reinforcement on neural circuits without the need to postulate timers of any sort.     

Second-order schedules: discrimination of components

Pigeons were exposed to a series of second-order schedules in which the completion of a fixed number of fixed-interval components produced food. In Experiment 1, brief (2 sec) stimulus presentations occurred as each fixed-interval component was completed. During the brief-stimulus presentation terminating the last fixed-interval component, a response was required on a second key, the brief-stimulus key, to produce food. Responses on the brief-stimulus key before the last brief-stimulus presentation had no scheduled consequences, but served as a measure of the extent to which the final component was discriminated from preceding components. Whether there were one, two, four, or eight fixed-interval components, responses on the brief-stimulus key occurred during virtually every brief-stimulus presentation. In Experiment 2, an attempt was made to punish unnecessary responses on the brief-stimulus key, i.e., responses on the brief-stimulus key that occurred before the last component. None of the pigeons learned to withhold these responses, even though they produced a 15-sec timeout and loss of primary reinforcement. In Experiment 3, different key colors were associated with each component of a second-order schedule (a chain schedule). In contrast to Experiment 1, brief-stimulus key responses were confined to the last component. It was concluded that pigeons do not discriminate well between components of second-order schedules unless a unique exteroceptive cue is provided for each component. The relative discriminability of the components may account for the observed differences in initial-component response rates between comparable brief-stimulus, tandem, and chain schedules.     

The influence of the victim on shock induced aggression in rats.

In two studies, free-roaming male rats (aggressors) were shocked in the presence of male target rats restrained in either an upright or a supine posure. In addition, in Experiment II, two levels of aggressor shock intensity (0.8 mA or 2.0 mA) were used while targets received one of three levels of shock (0.5 mA, 1.5 mA, or 2.5 mA). In both studies, upright targets were attacked less than supine targets. Frequency of aggression was directly related to level of aggressor shock intensity in Experiment II. Also, attack by 0.8-mA aggressors against supine targets was inversely related to level of target shock intensity. The low level of attack against upright targets was interpreted in terms of a threat diaplay. Similarily, it was concluded that the target shock-intensity effect in Experiment II was due to specific threat behaviors displayed by those supine rats that received the highest-intensity shocks.     

Choice and the dependability of stimuli that predict shock and safety

This study assessed whether choosing a signalled shock condition over an unsignalled one is controlled by a stimulus that predicts the presence of shock (Experiment I), or by a stimulus that predicts the absence of shock (Experiment II). The dependability of these stimuli as predictors of either the presence or the absence of shock was parametrically varied over a wide range, and subjects (rats) were given an option to change from an unsignalled to a signalled condition. In the first experiment, all shocks were preceded by signals; however, the probability of a signal being followed by shock varied from 1.0 to 0.02. The data obtained indicate that the dependability of the signal as a predictor of shock is unimportant. Rats changed to the signalled condition when the signal was completely dependable (all signals followed by shock) and when the dependability of the signal was systematically degraded. In the second experiment, all signals were followed by shock; however, some shocks were not preceded by a signal. The data show that the dependability of a stimulus predicting the absence of shock is important in that, as dependability decreases, changing to the signalled condition also decreases.     

Effects of concurrent response-independent reinforcement on fixed-interval schedule performance

In three experiments, behavior maintained by fixed-interval schedules changed when response-independent reinforcement was delivered concurrently according to fixed- or variable-time schedules. In Experiment I, a pattern of positively accelerated responding during fixed interval was changed to a linear pattern when response-independent reinforcement occurred under a variable-time schedule. Overall response rates (total responses/total time) decreased as the frequency of response-independent reinforcement increased. Experiment II showed that the response-rate changes in the first experiment were controlled by the response-reinforcer relation, but the changes in patterns of responding were similar whether concurrently available reinforcement at varying times was response-dependent or response-independent. In the final experiment, the addition of response-independent reinforcement at fixed times to a fixed-interval schedule resulted in changes in both local and overall response rates and in the occurrence of positively accelerated responding between reinforcements. These results suggest that the temporal distribution of reinforcers determines response patterns and that both the response-reinforcement dependency and the schedule of reinforcement determine overall response rates during concurrently scheduled response-dependent and response-independent reinforcement.     

DEVELOPMENT AND EVALUATION OF TREATMENT PARADIGMS FOR THE SUPPRESSION OF SMOKING BEHAVIOR1

A multiple-baseline component-analysis design was employed to assess the effectiveness of three treatment programs for suppressing the cigarette smoking behavior of 24 subjects. Satiation, cognitive control, and contingent shock procedures were evaluated. The results demonstrated a consistent relationship between contingent shock and suppression of smoking. It was further indicated that subjects should be exposed to the number of sessions necessary to achieve total suppression in order to gain maximally from treatment and to avoid relapse. Neither the satiation component nor the cognitive control component was correlated with clear, permanent decrements in smoking frequencies. To date, no other treatment program has demonstrated the dramatic effects of the contingent shock procedures used in the present study.