Response bias and the discrimination of stimulus duration

Pigeons discriminated stimulus duration in a psychophysical choice situation. Following presentation of any duration from a set of short duration (11 to 15 sec), responses on a red key were reinforced intermittently. Following presentation of any duration from a set of long durations (16 to 22 sec), responses on a green key were reinforced intermittently. Relative reinforcement rates were manipulated for choice responses across conditions. As relative reinforcement rates were varied, psychometric functions showed shifts in green-key responses at all durations. A signal-detection analysis showed that sensitivity remained roughly constant across conditions while response bias changed as a function of changes in relative reinforcement rate. Relative error rates tended to match relative reinforcement rates.     

Effects of schedule of reinforcement on a pentobarbital discrimination in rats.

The purpose of this study was to determine the effects of the schedule of reinforcement on a pentobarbital discrimination in rats. Five rats were trained to discriminate 10 mg/kg pentobarbital from saline under a multiple fixed-interval 180-s fixed-ratio 20 schedule of reinforcement. During both saline and pentobarbital training sessions, subjects emitted a higher percentage of correct responses under the fixed-ratio component as compared to the fixed-interval component of the multiple schedule. Determination of the pentobarbital dose-response curve under the fixed-ratio component resulted in a steep curve characterized by responding on the saline lever at low doses and on the drug lever at higher doses. Under the fixed-interval component, a graded dose-effect curve was produced, with considerable responding on both levers after intermediate doses of pentobarbital. The administration of phencyclidine and MK-801 resulted in an intermediate level of drug-lever responding for some subjects. Administration of d-amphetamine resulted in saline (nondrug) appropriate responding. The results of this study demonstrate that the schedule of reinforcement is a determinant of drug stimulus control, just as it is a determinant of other drug effects.     

The effects of morphine on fixed-interval patterning and temporal discrimination

Changes produced by drugs in response patterns under fixed-interval schedules of reinforcement have been interpreted to result from changes in temporal discrimination. To examine this possibility, this experiment determined the effects of morphine on the response patterning of 4 pigeons during a fixed-interval 1-min schedule of food delivery with interpolated temporal discrimination trials. Twenty of the 50 total intervals were interrupted by choice trials. Pecks to one key color produced food if the interval was interrupted after a short time (after 2 or 4.64 s). Pecks to another key color produced food if the interval was interrupted after a long time (after 24.99 or 58 s). Morphine (1.0 to 10.0 mg/kg) decreased the index of curvature (a measure of response patterning) during fixed intervals and accuracy during temporal discrimination trials. Accuracy was equally disrupted following short and long sample durations. Although morphine disrupted temporal discrimination in the context of a fixed-interval schedule, these effects are inconsistent with interpretations of the disruption of response patterning as a selective overestimation of elapsed time. The effects of morphine may be related to the effects of more conventional external stimuli on response patterning.     

Stimulus control and response bias in an analogue prey-detection procedure

The present study compared the performance of 6 pigeons trained to detect luminance differences in two different signal-detection procedures. Exposed to a three-key array, the pigeons were trained to peck the left key when the brighter of two light intensities had been presented on the center key and to peck the right key when the dimmer of two light intensities had been presented on the center key. Procedure A was a standard signal-detection procedure in which left/bright and right/dim responses produced food reinforcement and left/dim and right/bright responses produced periods of timeout. Procedure B was designed to simulate some of the contingencies operating in a prey-detection situation. Left-key responses produced reinforcement following the brighter center-key stimulus and a period of timeout following the dimmer center-key stimulus. Right-key responses always produced a short period of timeout irrespective of the stimulus. Within each procedure, the duration of timeout arranged for false alarms (left/dim responses) was varied between 3 s and 120 s. Measures of accuracy and response bias were compared between the two procedures. The timeout manipulation produced systematic, but relatively small, changes in these measures when right/dim responses (i.e., correct rejections) produced reinforcement (Procedure A). Arranging timeout for right/dim responses in Procedure B produced greater variability in accuracy and response bias than did arranging reinforcement, but this variability was not related to timeout duration. Overall, discrimination accuracy was considerably higher when right/dim responses produced timeout than when they resulted in reinforcement, and accuracy was accompanied by a large bias toward the response associated with reinforcement. These results are consistent with a recently proposed model of signal detection.     

Effects of discrete-trial and free-operant procedures on the acquisition and maintenance of successive discrimination in rats.

Rats were trained on a successive discrete-trial discrimination between two tonal stimuli to examine the effects of availability of a lever during intertrial intervals. In the discrete-trial condition, in which a lever was removed from the chamber during intertrial intervals, 10-s trials were initiated by the presentation of both discriminative stimulus and lever. In the free-operant condition, in which a lever was present during both trials and intertrial intervals, 10-s trials were initiated only by the presentation of a discriminative stimulus. Experiment 1 employed 50-s intertrial intervals and demonstrated that discriminative performances were acquired faster and maintained better in the free-operant conditions than in the discrete-trial conditions. Experiment 2 employed 5-s intertrial intervals and showed that poor discriminative performances in the discrete-trial conditions were improved. These results indicate that the presentation of a lever to start a trial can overshadow or mask the control by a discriminative stimulus and thereby obstruct the acquisition and maintenance of discriminative performances. Furthermore, the overshadowing or masking effects are strengthened as a function of the duration of intertrial intervals.     

The effects of d-amphetamine on the temporal control of operant responding in rats during a preshock stimulus.

The operant behavior of six rats was maintained by a random-interval schedule of reinforcement. Three-minute periods of noise were superimposed on this behavior, each period ending with the delivery of an unavoidable shock. Overall rates of responding were generally lower during the periods of noise than in its absence (conditioned suppression). These suppressed response rates also exhibited temporal patterning, with responding becoming less frequent as each noise period progressed. The effects of d-amphetamine on this behavioral baseline were then assessed. In four animals the relative response rates during the noise and in its absence suggested that the drug produced a dose-related decrease in the amount of conditioned suppression. However, this effect was often due to a decrease in the rates of responding in the absence of the preshock stimulus, rather than to an increase in response rates during the stimulus. Temporal patterning in response rates during the preshock stimulus was abolished, an effect that was interpreted in terms of rate-dependent effect of d-amphetamine. This study thus extends rate-dependent analyses of the effects of amphetamines to the patterns of operant behavior that occur during a preshock stimulus, and which have been discussed in terms of the disrupting effects of anxiety on operant behavior.     

An inverse relationship between baseline fixed-interval response rate and the effects of a tandem response requirement.

Previous experiments examining the effects of adding a tandem fixed-ratio response requirement on fixed-interval schedule performance have reported inconsistent results. One variable that may account for such inconsistencies is the baseline response rate in the fixed-interval condition. This possibility was investigated in the present study. Rats were given histories with either interresponse times greater than 11 s or fixed-ratio 40 schedules of reinforcement, which engendered either relatively low or high rates of responding, respectively, in the subsequent fixed-interval condition. A tandem ratio response requirement (fixed-ratio 9) was then introduced. The effects of adding this tandem response requirement were inversely related to the baseline fixed-interval response rates; low rates of responding in the fixed-interval condition were markedly increased, whereas high rates of responding were relatively unaffected. This inverse relationship appears to be similar to the rate-dependent relations observed in behavioral pharmacology. These results may provide an explanation for the inconsistent findings reported in previous studies on tandem fixed-interval fixed-ratio schedules and suggest that principles of behavioral pharmacology research may be applicable to the study of the effects of nonpharmacological variables on schedule-controlled behavior.     

The interaction of stimulus and reinforcer control in complex temporal discrimination.

Six pigeons were trained in a discrete-trials signal-detection procedure to discriminate between a fixed-duration stimulus (5 s or 20 s) and a set of variable durations ranging from 2.5 s to 57.5 s in steps of 5 s. For each fixed-duration stimulus, the ratio of reinforcer frequencies contingent upon reporting the fixed versus the variable stimulus was systematically manipulated. Detection performance was well controlled by both the stimulus value and the reinforcer ratio. Both the discriminability between the fixed duration and the set of variable durations, and the discriminability between the fixed duration and each of the variable durations, were independent of the reinforcer-frequency ratio when discriminability was measured as log d. The sensitivity of response bias to reinforcement-ratio changes was independent of the value of the fixed duration, but was not independent of the discriminability of the variable durations from the fixed durations. Under current models, discriminability measures in complex temporal discrimination may be independent of biasing manipulations, but bias measures are not independent of stimulus values.     

Effects of a variable-ratio conditioning history on sensitivity to fixed-interval contingencies in rats.

We investigated the possibility that human-like fixed-interval performances would appear in rats given a variable-ratio history (Wanchisen, Tatham, & Mooney, 1989). Nine rats were trained under single or compound variable-ratio schedules and then under a fixed-interval 30-s schedule. The histories produced high fixed-interval rates that declined slowly over 90 sessions; differences as a function of the particular history were absent. Nine control animals given only fixed-interval training responded at lower levels initially, but rates increased with training. Despite differences in absolute rates, rates within the intervals and postreinforcement pauses indicated equivalent development of the accelerated response patterns suggestive of sensitivity to fixed-interval contingencies. The finding that the histories elevated rates without retarding development of differentiated patterns suggests that the effective response unit was a burst of several lever presses and that the fixed-interval contingencies acted on these units in the same way as for single responses. Regardless of history, the rats did not manifest the persistent, undifferentiated responding reported for humans under comparable schedules. We concluded that the shortcomings of animal models of human fixed-interval performances cannot be easily remedied by including a variable-ratio conditioning history within the model.     

Effects of reinforcement rate and delay on the acquisition of lever pressing by rats.

The acquisition of lever pressing by naive rats, in the absence of shaping, was studied as a function of different rates and unsignaled delays of reinforcement. Groups of 3 rats were each exposed to tandem schedules that differed in either the first or the second component. First-component schedules were either continuous reinforcement or random-interval 15, 30, 60 or 120 s; second-component schedules were fixed-time 0, 1, 3, 6, 12, or 24 s. Rate of responding was low under continuous immediate reinforcement and higher under random-interval 15 s. Random interval 30-s and 60-s schedules produced lower rates that were similar to each other. Random-interval 120 s controlled the lowest rate in the immediate-reinforcement condition. Adding a constant 12-s delay to each of the first-component schedule parameters controlled lower response rates that did not vary systematically with reinforcement rate. The continuous and random-interval 60-s schedules of immediate reinforcement controlled higher global and first-component response rates than did the same schedules combined with longer delays, and first-component rates showed some graded effects of delay duration. In addition, the same schedules controlled higher second-component response rates in combination with a 1-s delay than in combination with longer delays. These results were related to those from previous studies on acquisition with delayed reinforcement as well as to those from similar reinforcement procedures used during steady-state responding.     

Control over response number by a targeted percentile schedule: reinforcement loss and the acute effects of d-amphetamine.

Two fixed-consecutive-number-like procedures were used to examine effects of acute d-amphetamine administration on control over response number. In both procedures, rats were required to press the left lever at least once and then press the right lever to complete a trial. The consecutive left-lever presses on each trial comprised a "run." Under the targeted percentile schedule, reinforcement was provided if the current run length was closer to the target length (16) than half of the most recent 24 runs. This differentially reinforced run length while holding reinforcement probability constant at .5. A second group acquired the differentiation under the targeted percentile schedule, but were then shifted to a procedure that yoked reinforcement probability by subject and run length to that obtained under the targeted percentile schedule. The two procedures generated practically identical control run lengths, response rates, reinforcement probabilities, and reinforcement rates. Administration of d-amphetamine disrupted percentile responding to a greater degree than yoked control responding. This disruption decreased reinforcement frequency less in the former than the latter procedure. The similar baseline responding under these two procedures suggests that this difference in sensitivity was due to behavioral adjustments to drug prompted by reduction of reinforcement density in the yoked control but not the percentile schedule. These adjustments attenuate the drug's effects under the former, but not the latter, procedure.     

The effects of 100 dB 1‐kHz and 22‐kHz tones as punishers on lever pressing in rats

Aversive control is an important yet understudied process of learning. One reason aversive control may be relatively understudied is ethical concerns about painful stimuli (e.g., electric shock). High decibel broad‐band noise and 22‐kHz vocalizations both demonstrably affect rodent behavior while not necessarily being painful. The goal of this study was to determine if 100‐dB 22‐kHz‐pure tones were differentially more effective in reducing operant response rates in rats. We examined whether 22‐kHz pure tones would function as aversive stimuli, specifically as positive punishers. The effects of response‐dependent as well as continuously presented 22‐kHz and 1‐kHz tones on rate of response maintained by variable interval 30‐s food deliveries were assessed across several conditions. We found that response rates were lower when tones were presented response dependently than when tones were presented continuously throughout a session. We also found that the lower response rates obtained with response‐dependent 22‐kHz tones were not significantly different from response rates obtained with response‐dependent 1‐kHz tones. The primary conclusion of this experiment is that both 1‐kHz and 22‐kHz tones functioned as punishers, but that the 22‐kHz tones were not differentially more effective in reducing response rate.     

The sensitivity of response rate to the rate of variable-interval reinforcement for pigeons and rats: a review

The relation between the rate of a response (B) and the rate of its reinforcement (R) is well known to be approximately hyperbolic: B = kR/(R + Ro), where k represents the maximum response rate, and Ro indicates the rate of reinforcers that will engender a response rate equal to half its maximum value. A review of data reported in 17 published papers revealed that, under variable-interval schedules of reinforcement, Ro was usually lower when pigeons were the subjects than when rats were the subjects. The value of k, in contrast, did not differ consistently between pigeons and rats. Some accounts interpret Ro as the rate of alternative, unscheduled reinforcers in the situation, expressed in units of the scheduled reinforcer. So interpreted, the difference in Ro implies that less alternative reinforcement (relative to the scheduled reinforcement) typically is available to pigeons in their operant conditioning chambers than it is to rats in theirs. Whether or not that interpretation of Ro is valid, the pigeon-rat difference in Ro ensures that for reinforcer rates above about 10 per hour, response rate will be noticeably less sensitive to changes in reinforcer rate (and presumably to changes in other incentive and motivational operations) with pigeons than with rats as subjects, at least with the experimental conditions typically employed.     

Rats' performance on variable-interval schedules with a linear feedback loop between response rate and reinforcement rate

Three experiments investigated whether rats are sensitive to the molar properties of a variable-interval (VI) schedule with a positive relation between response rate and reinforcement rate (i.e., a VI+ schedule). In Experiment 1, rats responded faster on a variable ratio (VR) schedule than on a VI+ schedule with an equivalent feedback function. Reinforced interresponse times (IRTs) were shorter on the VR as compared to the VI+ schedule. In Experiments 2 and 3, there was no systematic difference in response rates maintained by a VI+ schedule and a VI schedule yoked in terms of reinforcement rate. This was found both when the yoking procedure was between-subject (Experiment 2) and within-subject (Experiment 3). Mean reinforced IRTs were similar on both the VI+ and yoked VI schedules, but these values were more variable on the VI+ schedule. These results provided no evidence that rats are sensitive to the feedback function relating response rate to reinforcement rate on a VI+ schedule.     

Simple and conditional visual discrimination with wheel running as reinforcement in rats.

Three experiments explored whether access to wheel running is sufficient as reinforcement to establish and maintain simple and conditional visual discriminations in nondeprived rats. In Experiment 1, 2 rats learned to press a lit key to produce access to running; responding was virtually absent when the key was dark, but latencies to respond were longer than for customary food and water reinforcers. Increases in the intertrial interval did not improve the discrimination performance. In Experiment 2, 3 rats acquired a go-left/go-right discrimination with a trial-initiating response and reached an accuracy that exceeded 80%; when two keys showed a steady light, pressing the left key produced access to running whereas pressing the right key produced access to running when both keys showed blinking light. Latencies to respond to the lights shortened when the trial-initiation response was introduced and became much shorter than in Experiment 1. In Experiment 3, 1 rat acquired a conditional discrimination task (matching to sample) with steady versus blinking lights at an accuracy exceeding 80%. A trial-initiation response allowed self-paced trials as in Experiment 2. When the rat was exposed to the task for 19 successive 24-hr periods with access to food and water, the discrimination performance settled in a typical circadian pattern and peak accuracy exceeded 90%. When the trial-initiation response was under extinction, without access to running, the circadian activity pattern determined the time of spontaneous recovery. The experiments demonstrate that wheel-running reinforcement can be used to establish and maintain simple and conditional visual discriminations in nondeprived rats.     

Signal detection and matching: analyzing choice on concurrent variable-interval schedules.

Pigeons' pecks on a red key and a green key were followed by access to grain according to pairs of concurrent independent variable-interval schedules in a combined signal detection/matching law paradigm. Pecks on the red key were reinforced by the richer variable-interval schedule if a short-duration tone had been presented; pecks on the green key were reinforced by the richer variable-interval schedule if a long-duration tone had been presented. Pecks on the green key given a short-duration tone, or on the red key given a long-duration tone, were reinforced by the leaner variable-interval schedule. The data were analyzed according to both signal detection's and the matching law's separate measures of, first, the discrimination of the choices and, second, the bias to make one response or another. Increasing the difficulty of the tone-duration discrimination decreased both methods' measures of the discrimination of the choices and did not change both methods' measures of the bias to make one response or another. Changing the leaner variable-interval schedule so that it approached the richer variable-interval schedule decreased signal detection's measure of discrimination but left its measure of response bias and the matching law measures unchanged. Data collected only until a subject's first changeover response following presentation of a long or a short tone showed higher values for both methods' measures of discrimination, no change in signal detection's measure of response bias, and lower values for the matching law's measure of response bias. Relationships between the matching law's and signal detection's methods of analyzing choice are discussed. It is concluded that a signal detection analysis is more efficient for examining changes in the difficulty of a discrimination, whereas a matching law analysis is more effective for examining the effects of changes in relative reinforcer frequency.     

Lever attacking and pressing as a function of conditioning and extinguishing a lever-press avoidance response in rats

Six experimental rats were conditioned to press one of two available levers to avoid shock. The levers registered bites as well as presses. For four of these rats, shock was contingent on lever bites when a specified time period had elapsed after the previous shock. An extinction period, in which only periodic noncontingent shocks were presented, followed avoidance training. Six yoked-control rats received the same sequence of shocks as did the corresponding experimental rats in both the conditioning and extinction phases. All six experimental rats repeatedly bit the avoidance lever. Four bit it more than the nonavoidance lever during conditioning, and five bit it more during extinction. Five of the six experimental rats consistently bit the levers many more times during each session than did their respective control rats, suggesting that avoidance conditioning facilitated lever biting. Rates of lever biting and pressing by all of the experimental rats and by some of the control rats were highest immediately following shock throughout both phases. During later portions of the intervals following shock, characteristic effects of conditioning and extinction were observed. This finding suggests that extinction of avoidance behavior by unavoidable shock presentations can be demonstrated more readily when shock-elicited responding is extricated from the data.     

The effects of reinforcement frequency and response requirements on the maintenance of behavior.

Six rats responded under fixed-interval and tandem fixed-interval fixed-ratio schedules of food reinforcement. Basic fixed-interval schedules alternated over experimental conditions with tandem fixed-interval fixed-ratio schedules with the same fixed-interval value. Fixed-interval length was varied within subjects over pairs of experimental conditions; the ratio requirement of the tandem schedules was varied across subjects. For both subjects with a ratio requirement of 10, overall response rates and running response rates typically were higher under the tandem schedules than under the corresponding basic fixed-interval schedules. For all subjects with ratio requirements of 30 or 60, overall response rates and running response rates were higher under the tandem schedules than under the corresponding basic fixed-interval schedules only with relatively short fixed intervals. At longer fixed intervals, higher overall response rates and running rates were maintained by the basic fixed-interval schedules than by the tandem schedules. These findings support Zeiler and Buchman's (1979) reinforcement-theory account of response strength as an increasing monotonic function of both the response requirement and reinforcement frequency. Small response requirements added in tandem to fixed-interval schedules have little effect on reinforcement frequency and so their net effect is to enhance responding. Larger response requirements reduce reinforcement frequency more substantially; therefore their net effect depends on the length of the fixed interval, which limits overall reinforcement frequency. At the longest fixed intervals studied in the present experiment, reinforcement frequency under the tandem schedules was sufficiently low that responding weakened or ceased altogether.     

Effects of response disparity on stimulus and reinforcer control in human detection tasks

In two detection experiments, university students reported whether the second of two sequentially presented tones was longer or shorter than the first by responding to stimuli presented on a touch screen. Stimulus disparity and response disparity were manipulated to compare their effects on measures of discrimination and response bias when the reinforcement ratio for correct responses was asymmetric. Choice stimuli consisted of squares filled with different pixel densities. Response disparity was manipulated by varying the difference in density between the two choice stimuli. In both experiments, decreasing stimulus disparity reduced discrimination but had no consistent effect on bias. Decreasing response disparity also reduced discrimination in both experiments, and often reduced estimates of bias. The effects of response disparity on bias were most clear in Experiment 2, in which a greater overall level of response disparity was arranged. The data show that, like corresponding research with pigeons, detection performance of human subjects can be conceptualized as discriminated operants.     

Relationship between response rate and reinforcement frequency in variable-interval schedules: III. The effect of d-amphetamine.

Four rats were exposed to variable-interval schedules specifying a range of different reinforcement frequencies. The effects of two doses of d-amphetamine (1.6 and 3.2 mumol/kg) upon performance maintained under each schedule were examined. In the case of each rat, the response rates observed under control conditions (no injection or injection of the vehicle alone) were increasing, negatively accelerated functions of reinforcement frequency, the data conforming closely to Herrnstein's (1970) equation. In each rat, d-amphetamine (3.2 mumol/kg) significantly reduced the value of the constant Rmax, which expresses the theoretical maximum response rate. In each rat, the value of KH, which expresses the reinforcement frequency needed to obtain the half-maximal response rate, was also reduced, although this only achieved statistical significance in the case of one rat. When the proportional change in response rate in the presence of the drug was plotted against the response rate under control conditions on double logarithmic co-ordinates, linear functions of negative slope were obtained; in each rat the slope was steeper and the value of the control response rate at which d-amphetamine exerted no effect was lower in the case of the higher dose (3.2 mumol/kg) than in the case of the lower dose (1.6 mumol/kg).