Effects of d-amphetamine and chlordiazepoxide on spaced responding in pigeons

The effects of d-amphetamine and chlordiazepoxide were studied in pigeons on performance (1) under a schedule that reinforced responses on a key (food key) if they were more than 20 sec apart, (2) under the same schedule when responses also were required on a collateral key during the interresponse time on the food key, and (3) under the same schedule when responses were required on a collateral key during the interresponse time on the food key and collateral-key responses could produce a stimulus correlated with the availability of food. Under all three spaced-responding schedules, d-amphetamine and chlordiazepoxide at low dose levels slightly increased the frequency of short interresponse times on the food key for about half the birds, and either did not affect the interresponse time patterns of the other birds, or lengthened the durations slightly. At higher dose levels, d-amphetamine and chlordiazepoxide increased the frequency of long interresponse times or abolished responding in all birds. Changes in the pattern of interresponse times on the food key did not seem to depend on changes in the rate or pattern of collateral-key responses.     

Collateral responding during differential reinforcement of low rates

Two pigeons were trained to peck either of two response keys for food, under two different variable-interval schedules. When responding stabilized, the schedule on the left key (reinforcement-key) was changed to a differential-reinforcement-of-low-rates schedule, and responses on the right key (extinction-key) were no longer reinforced. The mean interresponse time of responses on the reinforcement-key approximated the temporal requirement of the reinforcement schedule on that key. Collateral responding on the extinction-key was maintained by one of the birds. A “run” of these collateral responses was defined as a sequence of responses on the extinction-key occurring between two responses on the reinforcement-key. For this one bird, collateral behavior, measured by mean time per run and mean number of responses per run, was an increasing function of the temporal requirements of the reinforcement schedule on the reinforcement key, and it was strongly positively correlated with the mean interresponse time of responses on the reinforcement-key. However, from an analysis of the results, the collateral behavior did not appear to have mediated the temporal spacing of responses on the reinforcement-key.     

On conditioned reinforcing effects of negative discriminative stimuli

Observing responses by pigeons were studied during sessions in which a food key and an observing key were available continuously. A variable-interval schedule and extinction alternated randomly on the food key. In one condition, food-key pecking during extinction decreased reinforcement frequency during the next variable-interval component, and in the other condition such pecking did not affect reinforcement frequency. Observing responses either changed both keylight colors from white to green (S+) or to red (S−) depending on the condition on the food key, or the observing responses never produced the S+ but produced the S− when extinction was in effect on the food key. Observing responses that produced only S− were maintained only when food-key pecking during extinction decreased reinforcement frequency in the subsequent variable-interval component. The red light conformed to conventional definitions of a negative discriminative stimulus, rendering results counter to previous findings that production of S− alone does not maintain observing. Rather than offering support for an informational account of conditioned reinforcement, the results are discussed in terms of a molar analysis to account for how stimuli acquire response-maintaining properties.     

Signalled reinforcement in differential-reinforcement-of-low rate schedules

At several fixed and variable minimum reinforced interresponse times, a stimulus was added to differential-reinforcement-of-low-rate schedules to signal the availability or nonavailability of reinforcement. As the minimum reinforced interresponse time increased, the rate of unreinforced responding decreased. Changing from fixed to variable minimum interresponse time in the basic differential-reinforcement-of-low-rate schedule further decreased the rate of unreinforced responding. Both effects were to some degree reversible. For fixed minimum reinforced interresponse times of 30 sec or shorter, most unreinforced responses terminated interresponse times just short of that required for reinforcement. The minimum reinforced interresponse time and the number of short response latencies (≤0.5 sec) to the onset of the signal were negatively correlated. Both of these analyses suggested that at values of 30 sec or shorter, the subjects discriminated the availability of the reinforcer more on the basis of time than on the basis of presence or absence of the signal.     

Effects of timeout on spaced responding in pigeons

Three pigeons were trained under a differential-reinforcement-of-low-rate schedule of 20 sec, and then exposed to a schedule under which responses terminating interresponse times less than 20 sec produced timeout and responses terminating interresponse times greater than 20 sec produced reinforcement. Response-produced timeouts selectively decreased the probability of short interresponse times and thereby produced a higher frequency of reinforcement. The suppressive effect of timeout was independent of timeout duration, with timeouts of 5, 10, or 20 sec. Similar effects were found when the minimum interresponse time that could be terminated by response-produced reinforcement was increased to 30 sec. The suppressive effects of timeout on responding maintained by these schedules were similar to previous reports in which responding was punished with electric shock.     

Behavior under large values of the differential-reinforcement-of-low-rate schedule

Pigeons pecked a key and rats pressed a lever for food reinforcement under large values of the differential-reinforcement-of-low-rate schedule. Each subject was tested under 10 different schedule values ranging from 1 to 45 min and was exposed to each schedule value at least twice. The mean interresponse time and mean interreinforcement time increased with the schedule value according to power functions. Response-probability functions were computed for schedule values below 20 min and showed an increase in response probability as a function of time since the last response in most cases. Mean responses per reinforcer increased as a function of schedule value for the rats, but decreased as a function of schedule value for the pigeons. The proportion of responses with interresponse times shorter than 1 sec were an increasing function of schedule value for the pigeons, but did not vary as a function of schedule value for the rats.     

Conditioned reinforcement value and resistance to change

Three experiments examined the effects of conditioned reinforcement value and primary reinforcement rate on resistance to change using a multiple schedule of observing-response procedures with pigeons. In the absence of observing responses in both components, unsignaled periods of variable-interval (VI) schedule food reinforcement alternated with extinction. Observing responses in both components intermittently produced 15 s of a stimulus associated with the VI schedule (i.e., S+). In the first experiment, a lower-valued conditioned reinforcer and a higher rate of primary reinforcement were arranged in one component by adding response-independent food deliveries uncorrelated with S+. In the second experiment, one component arranged a lower valued conditioned reinforcer but a higher rate of primary reinforcement by increasing the probability of VI schedule periods relative to extinction periods. In the third experiment, the two observing-response components provided similar rates of primary reinforcement but arranged different valued conditioned reinforcers. Across the three experiments, observing-response rates were typically higher in the component associated with the higher valued conditioned reinforcer. Resistance to change was not affected by conditioned reinforcement value, but was an orderly function of the rate of primary reinforcement obtained in the two components. One interpretation of these results is that S+ value does not affect response strength and that S+ deliveries increase response rates through a mechanism other than reinforcement. Alternatively, because resistance to change depends on the discriminative stimulus-reinforcer relation, the failure of S+ value to impact resistance to change could have resulted from a lack of transfer of S+ value to the broader discriminative context.     

Conditioned suppression and conditioned enhancement with the same positive UCS: an effect of CS duration

Previous experiments have shown that positively reinforced operant responding is suppressed during a conditioned stimulus terminated with an electric shock (conditioned suppression). In the present experiment, the conditioned stimulus was terminated with a positive unconditioned stimulus, and it was found that the duration of the conditioned stimulus was a key factor in determining whether response suppression or response enhancement was observed during the stimulus. The lever-pressing responses of rats were maintained by a variable-interval schedule of food reinforcement. While the rats were pressing the lever, a light was occasionally turned on, its offset coincident with a brief period of access to a sucrose solution. In consecutive blocks of sessions, the light duration was 40 sec, 12 sec, or 120 sec. Results showed that the rate of lever pressing was substantially suppressed during the 12-sec stimulus, slightly suppressed during the 40-sec stimulus, and enhanced during the 120-sec stimulus.     

Contingent Stimuli Signal Subsequent Reinforcer Ratios

Conditioned reinforcer effects may be due to the stimulus' discriminative rather than its strengthening properties. While this was demonstrated in a frequently‐changing choice procedure, a single attempt to replicate in a relatively static choice environment failed. We contend that this was because the information provided by the stimuli was nonredundant in the frequently‐changing preparation, and redundant in the steady‐state arrangement. In the present experiments, 6 pigeons worked in a steady‐state concurrent schedule procedure with nonredundant informative stimuli (red keylight illuminations). When a response‐contingent red keylight signaled that the next food delivery was more likely on one of the two alternatives, postkeylight choice responding was reliably for that alternative. This effect was enhanced after a history of extended informative red keylight presentation (Experiment 2). These results lend support to recent characterizations of conditioned reinforcer effects as reflective of a discriminative, rather than a reinforcing, property of the stimulus.     

Reinforcement of spaced responding in a simultaneous discrimination

Pigeons were exposed to three stimuli simultaneously with responses reinforced according to differential-reinforcement-of-low-rate schedules. Responses to one stimulus (the positive stimulus) that were spaced appropriately resulted in food presentation. The variables manipulated were the time parameter of the schedule (5, 10, 20, 30 sec) and the consequences of responding to the other two stimuli (the negative stimuli). The percentage of the total responses that occurred to each stimulus was independent of the schedule value but was dependent on the consequences of responding to the negative stimuli. If responses to both reset the schedule timer, responding was confined largely to the positive stimulus. If responses to neither had scheduled effects, the birds were more likely to respond to those stimuli. Responding to one negative stimulus could be selectively attenuated by having responses to that stimulus alone reset the timer. With the schedule time value held constant, the absolute rate of responding to the positive stimulus was either stable or decreased with maintained exposure; it did not change as a function of increases or decreases in responding to the negative stimuli. Rather than interacting and affecting each other, responses to the three stimuli were controlled independently by their relation to reinforcement. There was no evidence that responses to the negative stimuli mediated the spacing of responses to the positive stimulus.     

Positive conditioned suppression: conditioned suppression using positive reinforcers as the unconditioned stimuli

Research has revealed the phenomenon of conditioned suppression in which the rate of responding is reduced during a stimulus that is paired with noncontingent shock. The present study replicated this procedure, but used noncontingent positive reinforcers instead of the aversive shock. The lever-pressing responses of rats were reinforced with food or water. While the rats were responding, a stimulus was occasionally presented and paired with the delivery of a noncontingent positive reinforcer, which was either food, water, or brain stimulation for different rats. The result was a reduction in the rate of responding during the conditioned stimulus. This finding shows that conditioned suppression occurs during a signal for reinforcing as well as aversive stimuli.     

Effects of alternative reinforcement sources: A reevaluation

The effects of two alternative sources of food delivery on the key-peck responding of pigeons were examined. Pecking was maintained by a variable-interval 3-min schedule. In the presence of this schedule in different conditions, either a variable-time 3-min schedule delivering food independently of responding or an equivalent schedule that required a minimum 2-s pause between a key peck and food delivery (a differential-reinforcement-of-other-behavior schedule) was added. The differential-reinforcement-of-other-behavior schedule reduced response rates more than did the variable-time schedule in most instances. The delay between a key peck and the next reinforcer consistently was longer under the differential-reinforcement-of-other-behavior schedule than under the variable-time schedule. Response rates and median delay between responses and reinforcers were negatively correlated. These results contradict earlier conclusions about the behavioral effects of alternative reinforcement. They suggest that an interpretation in terms of response–reinforcer contiguity is consistent with the data.     

Discrete-trials spaced responding in the pigeon: the dependence of efficient performance on the availability of a stimulus for collateral pecking

Four pigeons were exposed to a discrete-trial schedule in which only responses spaced by at least 6 sec were reinforced. After 45, fifty-trial sessions, they failed to meet the spacing requirement in over 90% of the trials. When an alternative, non-contingent key (pecks on which had no consequence) was illuminated concurrently with the first key, the spacing performance of the three pigeons that pecked the non-contingent key improved so that they were obtaining 75% of the possible reinforcers. These data demonstrated the importance of collateral behavior in mediating spaced performance. It was suggested that pigeons may successfully refrain from responding on the spacing procedure only when another stimulus correlated with reinforcement is available for pecking, and that the form that collateral behavior takes may, in general, be non-arbitrary, and species dependent.     

Discriminative properties of briefly presented stimuli

In Experiment I, pigeons' responses produced food according to a fixed-interval schedule while responses on the key also produced brief stimuli according to a variable-interval schedule. Each brief stimulus reset the fixed interval. Thus, a brief stimulus occurred irregularly but a fixed minimum time separated the occurrence of food from a brief stimulus. Pauses followed brief stimuli and were followed by an accelerated response rate until another brief stimulus or food occurred. In Experiment II, four control procedures were examined. (1) Brief-stimulus presentations were omitted, producing a loss of response patterning. (2) A second-order schedule was studied with fixed-interval components. This schedule produced patterning following brief stimuli similar in kind and degree to that found in Experiment I. (3) A conjoint schedule was arranged in which food was no longer separated from the stimulus by a fixed time; pauses following the stimulus no longer resulted. (4) A brief food reinforcer replaced the brief visual stimulus, resulting in a constant response rate with no pausing following the brief food stimulus. The results suggest that the brief-stimulus effects were due to discriminative functions produced by the fixed temporal relation separating the stimulus from food.     

Effects of chlorpromazine on fixed-ratio responding: modification by fixed-interval discriminative stimuli.

Effects of chlorpromazine (1 to 100 mg/kg) were assessed on two pigeons' responding under various modifications of a multiple schedule of food delivery. During a fixed-interval component, the first response after 5 min produced food; during the subsequent, fixed-ratio component, the 30th response produced food. Modifications of the schedule entailed changes in stimulus conditions imposed during the fixed-ratio component that did not systematically alter characteristics of performance under non-drug conditions. In the first phase of the experiment, distinctive visual stimuli were correlated with each schedule component (conventional multiple schedule); chlorpromazine produced small decreases in fixed-ratio responding (20% at 30 mg/kg). When each response during the fixed-ratio component produced the stimulus correlated with the fixed-interval schedule (fixed-interval discriminative stimulus) for 1.2 s, effects of chlorpromazine were not different from those under the conventional multiple schedule. Chlorpromazine produced greater decreases in fixed-ratio responding (55% at 30 mg/kg) when either the first response of each fixed ratio changed the stimulus correlated with the fixed-ratio schedule to the fixed-interval discriminative stimulus for the remainder of the fixed-ratio component, or when the fixed-interval discriminative stimulus was presented independently of responding according to a matched temporal sequence. When the fixed-interval discriminative stimulus was present continuously during the fixed-ratio component (mixed schedule), chlorpromazine produced even more substantial decreases in fixed-ratio responding (greater than 80% at 30 mg/kg). Effects of chlorpromazine on fixed-interval responding were also modified by the schedules of fixed-interval discriminative stimulus presentation. The effects of chlorpromazine were a joint function of the stimuli prevailing during the multiple schedule and the degree to which responding influenced these stimuli.     

Facilitation of food-reinforced responding by a signal for response-independent food

Five pigeons whose key pecking was maintained by 4-sec access to grain on a variable-interval 2-min schedule received Pavlovian differential conditioning trials superimposed upon the instrumental baseline. The conditioned stimuli were changes in the stimulus on the key from white to red, or to a white horizontal line against a dark background. The positive conditioned stimulus was 20 sec long, and was followed immediately by 8-sec access to grain. The negative conditioned stimulus, also 20 sec long, was never paired with response-independent food. All pigeons responded more rapidly in the presence of the positive conditioned stimulus than in the presence of the negative one. The positive conditioned stimulus produced an increase in response rate over the pre-conditioned stimulus period. The negative conditioned stimulus had no marked effect upon response rate. When the roles of the positive and negative stimuli were reversed, and the duration of the response-independent reinforcement was reduced to 4 sec, the new positive conditioned stimulus came to facilitate responding, and the new negative conditioned stimulus no longer produced facilitation. A second discrimination reversal produced similar outcomes. When a third reversal was initiated, and the duration of response-independent reinforcement was reduced to 2 sec, the difference between the effects of the positive and negative stimuli diminished.     

The relationship between observing behavior and food-key response rates under mixed and multiple schedules of reinforcement

Pigeons were trained under an observing response procedure in which pecks on one key (food key) were reinforced under a mixed fixed-interval 30-sec extinction schedule. A response on a second (observing) key replaced the mixed-schedule stimulus with either of two multiple-schedule stimuli (red and green keylights) for 5 sec. Observing response rates were positively correlated with food-key response rates in the presence of multiple-schedule stimuli and inversely related to food-key response rates in the presence of mixed-schedule stimuli. These results suggest that observing response output is controlled not only by the stimuli produced by observing responses but also by the stimuli in the presence of which observing responses occur. The possibility that observing responses alter the probability of reinforcement is advanced.     

Discriminated timeout avoidance in pigeons: the roles of added stimuli

Two experiments examined pigeons' postponement of a signaled extinction period, or timeout (TO), from an ongoing schedule of response-dependent food delivery. A concurrent-operant procedure was used in which responses on one (food) key produced food according to a variable-interval schedule and responses on a second (postponement) key delayed the next scheduled TO according to a response-TO (R-TO) interval. A series of response-independent stimulus changes on the food key temporally partitioned the R-TO into three equal segments (S1, S2, and S3). Postponement responses, in addition to postponing TO, also reinstated S1, the stimulus correlated with the greatest temporal distance from TO. In Experiment 1, the R-TO interval was manipulated systematically across blocks of sessions (conditions) at a given ratio of R-TO:TO duration. This R-TO:TO ratio was manipulated across blocks of conditions (phases). Postponement response rates varied inversely with R-TO interval in each phase. Changes in the R-TO:TO ratio did not produce consistent differences except at the 1:10 ratio for some pigeons, where it disrupted postponement responding in some conditions. Most of the postponement responses occurred in the presence of S2 and S3, the stimuli most proximal to TO, whereas most of the food-key responses occurred in S1. In Experiment 2, the R-TO contingencies were systematically manipulated in the presence of the time-correlated stimuli. In one set of conditions, the R-TO contingencies were made either ineffective or less effective in the presence of one or more stimuli. Postponement responses typically shifted to stimuli in the presence of which responses were relatively more effective. Postponement responses decreased markedly when the added stimuli were removed, and then recovered when the stimuli were reinstated. Results from both experiments indicate that the added stimuli in a discriminated TO-avoidance procedure serve predominately discriminative functions, delineating periods during which behavior is maximally effective. The results parallel those obtained in shock-avoidance procedures, providing further evidence that TO functions as an aversive stimulus.     

Conditioned reinforcement in second-order schedules

Pigeons responded under a schedule in which food was presented only after a fixed number of fixed-interval components were completed. Two such second-order schedules were studied: under one, 30 consecutive 2-min fixed-interval components were required; under the other, 15 consecutive 4-min fixed-interval components were required. Under both schedules, when a 0.7-sec stimulus light was presented at completion of each fixed interval, positively accelerated responding developed in each component. When no stimulus change occurred at completion of each fixed interval, relatively low and constant rates of responding prevailed in each component; a similar result was obtained when a 0.7-sec stimulus change occurred at completion of each fixed interval except the one which terminated with primary reinforcement. The 0.7-sec stimulus correlated with food delivery was an effective conditioned reinforcer in maintaining patterns of responding in fixed-interval components despite low average frequencies of food reinforcement.     

Effects on responding of mixed and multiple schedules of signalled and unsignalled response-dependent electric-shock delivery

Responding in two rats was maintained under mixed and multiple variable-interval 35-sec variable-interval 35-sec food delivery schedules. Similar rates and patterns of responding occurred in each component of the two schedules. Mixed and multiple variable-interval 65-sec variable-interval 65-sec schedules of response-dependent shock delivery were super-imposed on the mixed and multiple baseline food schedules, respectively. In one component, a 5-sec stimulus was presented on the average of once every 65 sec. Offset of the stimulus arranged that the next response would produce shock. In the other component, no stimulus was presented during the 5-sec period. The mixed schedule of signalled and unsignalled dependent shock delivery yielded similar degrees of response suppression in each component, but the multiple schedule of shock delivery revealed differential degrees of response suppression. Considerably more suppression occurred in the component not associated with the preshock stimulus, thus implicating the discriminative functions of the correlated stimulus.