Effects of response-produced stimuli upon conditional discrimination performance

In zero-delay matching procedures the performance of three groups of pigeons was examined when exteroceptive stimuli, response-produced stimuli associated with the completion of either of two fixed ratios, or a compound of exteroceptive and response-produced stimuli were available as samples. Exteroceptive samples were found to control a higher level of matching accuracy than response-produced samples, while compound samples controlled a higher level of accuracy than did exteroceptive samples alone. When all subjects were placed on a transfer procedure, during which the previously used red and green samples were replaced by horizontal and vertical lines, the availability of sample-specific fixed-ratios facilitated acquisition of the task.     

Fixed-ratio discrimination: effects of response-produced blackouts

For three pigeons, reinforcement depended upon a left side-key response after execution of a fixed ratio 10 on the center key, and upon a right side-key response after fixed ratio 20. Each response during the fixed ratios produced a 0.5-sec blackout. The time between the first and last response in fixed ratio 10 was then equated with the time between the first and last response in fixed ratio 20 by increasing the blackout duration. The accuracy of side-key choice was disrupted, thereby suggesting that time, rather than number of responses, controlled choice responding. When the time between the first and last response was equated during both ratios, asymptotic accuracy was approximately equal to (two birds) or somewhat higher than (one bird) that obtained previously. The results of probes with intermediate fixed ratios and blackouts suggested that control of side-key choice had transferred from the time between the first and last response in ratios to blackout duration.     

Stimulus control and response bias in an analogue prey-detection procedure

The present study compared the performance of 6 pigeons trained to detect luminance differences in two different signal-detection procedures. Exposed to a three-key array, the pigeons were trained to peck the left key when the brighter of two light intensities had been presented on the center key and to peck the right key when the dimmer of two light intensities had been presented on the center key. Procedure A was a standard signal-detection procedure in which left/bright and right/dim responses produced food reinforcement and left/dim and right/bright responses produced periods of timeout. Procedure B was designed to simulate some of the contingencies operating in a prey-detection situation. Left-key responses produced reinforcement following the brighter center-key stimulus and a period of timeout following the dimmer center-key stimulus. Right-key responses always produced a short period of timeout irrespective of the stimulus. Within each procedure, the duration of timeout arranged for false alarms (left/dim responses) was varied between 3 s and 120 s. Measures of accuracy and response bias were compared between the two procedures. The timeout manipulation produced systematic, but relatively small, changes in these measures when right/dim responses (i.e., correct rejections) produced reinforcement (Procedure A). Arranging timeout for right/dim responses in Procedure B produced greater variability in accuracy and response bias than did arranging reinforcement, but this variability was not related to timeout duration. Overall, discrimination accuracy was considerably higher when right/dim responses produced timeout than when they resulted in reinforcement, and accuracy was accompanied by a large bias toward the response associated with reinforcement. These results are consistent with a recently proposed model of signal detection.     

Response differentiation: A psychophysical method for response produced stimuli

Twenty-four rats were reinforced for releasing a lever between t and t + .20 sec after pressing it. Response duration differentiation performance decreased monotonically as t was increased in length from .10 sec to 1.60 sec. A response analogue of Weber’s ratio was constant throughout the middle range of duration bandwidth requirements and increased at the ex tremely short bandwidth—a response-differentiation finding analogous to Weber’s law of stimulus discrimination. This finding was interpreted as support for the conceptualization that response differentiation represents a special instance of response discrimination or discrimination based on response-produced stimuli.     

Signalled and unsignalled percentage reinforcement of performance under a chained schedule

Pigeons were trained to peck a key under a chained fixed-ratio 15 fixed-interval 25-sec schedule of food presentation. In Experiment 1, blocks of sessions in which 100%, 75%, 50%, and 25% of the sequences ended with food presentation were conducted. When food presentation was omitted, a timeout of equal duration replaced it. As the frequency of food presentation decreased so did the frequency of completing the chained schedule. In Experiment 2, 75%, 50%, or 25% of the sequences terminated with food presentation and outcomes were signalled, i.e., completion of the fixed ratio resulted in either a stimulus correlated with the fixed-interval 25-sec schedule or a stimulus correlated with extinction. As the frequency of food presentation decreased, the number of sequences completed per session increased for two pigeons and remained high for a third. In Experiments 3 and 4, assessments of the effects of signalling the outcome of the chained schedule were made with response-independent presentation of events at the end of the sequence. Again, signalling the outcome of the chained schedule led to more chains being completed per session than did not signalling the outcome. Stimuli differentially paired with food presentation have powerful behavioral effects that may be attributed to the potency of these stimuli as conditioned reinforcers.     

The effects of warned loss magnitude and timeout duration on human avoidance behavior

This study experimentally investigated the determinants of avoidance behavior when participants are forewarned of aversive outcomes. The effects of 3 variables on avoidance behavior were examined: point-loss amount (5 levels, from 20 to 100 points), duration of timeout from positive reinforcement (5 levels, 20 to 100 s), and 3 predictive accuracy levels (100%, 50%, and 0%) of warning stimuli. Twelve participants completed 3 sessions, each comprising 25 discrete trials, that differed in predictive accuracy level. Throughout a session, a participant engaged in button press responses that were reinforced by points under a conjunctive fixed-ratio fixed-interval schedule. During each trial, a warning stimulus that indicated a loss amount and a timeout duration was presented. If the participant pressed the avoidance button, then the timeout started, otherwise the loss occurred. The trial ended with termination of timeout or an occurrence of the loss. Results showed that avoidance responses increased when the loss amount increased and decreased when the timeout duration increased. The frequency of avoidance responses was lowest when the predictive accuracy of warning stimuli was 0%. These findings demonstrated that this experimental procedure could be useful for investigating human avoidance behavior outside the laboratory.     

Design and evaluation of a touchscreen apparatus for operant research with pigeons

We developed a touchscreen apparatus for pigeons and conducted a series of experiments that assessed its utility for free-operant procedures. The apparatus incorporated an on-board Windows computer, an electromechanical interface, an amplified speaker, and the touchscreen. We found that merely projecting a virtual key on the screen was insufficient; too many pecks missed the key. Adding a visual target in the center of the key and providing visual feedback for on-key pecks both failed to improve response accuracy. Accuracy was improved by imposing a timeout after off-key pecks or providing a physical boundary around the key. With the physical boundary, response accuracy was comparable to that obtained with conventional plastic keys, and response acquisition via autoshaping also was comparable. Mixing the color elements of the screen's pixels produced color stimuli, but the colors did not function as pure wavelengths of light in tests of stimulus generalization. Both colors and geometric shapes functioned as discriminative stimuli in multiple schedules with variable-interval and extinction components or rich and lean fixed-ratio components. In general, our touchscreen apparatus is a viable alternative to conventional pigeon chambers and increases the experimenter's options for visual stimuli, auditory stimuli, and the number and location of response keys.     

The effects of morphine on fixed-interval patterning and temporal discrimination

Changes produced by drugs in response patterns under fixed-interval schedules of reinforcement have been interpreted to result from changes in temporal discrimination. To examine this possibility, this experiment determined the effects of morphine on the response patterning of 4 pigeons during a fixed-interval 1-min schedule of food delivery with interpolated temporal discrimination trials. Twenty of the 50 total intervals were interrupted by choice trials. Pecks to one key color produced food if the interval was interrupted after a short time (after 2 or 4.64 s). Pecks to another key color produced food if the interval was interrupted after a long time (after 24.99 or 58 s). Morphine (1.0 to 10.0 mg/kg) decreased the index of curvature (a measure of response patterning) during fixed intervals and accuracy during temporal discrimination trials. Accuracy was equally disrupted following short and long sample durations. Although morphine disrupted temporal discrimination in the context of a fixed-interval schedule, these effects are inconsistent with interpretations of the disruption of response patterning as a selective overestimation of elapsed time. The effects of morphine may be related to the effects of more conventional external stimuli on response patterning.     

The effect of increased response requirements on discriminative performance of the domestic hen in a visual acuity task.

Six domestic hens were trained in a spatial discrimination task. A controlled reinforcement procedure insured that the ratio of scheduled and obtained reinforcement remained equal. Gray stimuli and gratings ranging in spatial frequency from 1 to 10 cycles per millimeter were presented in seven descending series of probes. The response requirement to the sample key was varied from fixed ratio 1 to fixed ratio 40 in seven experimental conditions. An increase in response requirements from fixed ratio 1 to fixed ratio 5 and fixed ratio 10 resulted in significantly higher accuracy at discriminable grating values. Further increases in response requirements did not consistently improve performance. Generally, response biases increased and occasionally became extreme for probes at finer gratings with increased response requirements.     

Response bias induced in rats by response effects

Two experiments examined whether response choice in rats is affected by the presentation of response-produced stimuli. Rats were first trained to emit two different responses, with each response producing a unique auditory stimulus. Subsequently, the former response-produced stimuli were presented while the two response options were freely available. Presentation of a former response-produced stimulus caused the rats to choose more frequently the response option that had previously produced that specific stimulus over the other response option. However, although statistically significant, this response-biasing effect was numerically weak and was only apparent when the stimuli no longer had a general response-activating effect. Moreover, in the case of relatively short presentations of the stimuli, the response-biasing effect was only present if, during testing, the responses continued to produce the auditory stimuli according to the response-effect mapping used during training. These results were discussed in terms of possible underlying associations and were contrasted with previous results from analogous human studies on action control by response-produced stimuli.     

Response bias induced in rats by response effects

Two experiments examined whether response choice in rats is affected by the presentation of response-produced stimuli. Rats were first trained to emit two different responses, with each response producing a unique auditory stimulus. Subsequently, the former response-produced stimuli were presented while the two response options were freely available. Presentation of a former response-produced stimulus caused the rats to choose more frequently the response option that had previously produced that specific stimulus over the other response option. However, although statistically significant, this response-biasing effect was numerically weak and was only apparent when the stimuli no longer had a general response-activating effect. Moreover, in the case of relatively short presentations of the stimuli, the response-biasing effect was only present if, during testing, the responses continued to produce the auditory stimuli according to the response-effect mapping used during training. These results were discussed in terms of possible underlying associations and were contrasted with previous results from analogous human studies on action control by response-produced stimuli.     

Effects of reinforcement scheduling on simultaneous discrimination performance

Pigeons were trained on a discrete-trials, simultaneous discrimination procedure, with confusable stimuli such that asymptotic performance was about 85% correct. Trials were terminated if no response occurred within 2 sec of stimulus onset, so that probability of responding was free to vary. The schedule of reinforcement for correct responses was varied, with the following results: (1) there was no relation between frequency of reinforcement and accuracy of responding. (2) In extinction, the probability of responding fell to low levels, but accuracy remained roughly constant. (3) When reinforcement was available after a fixed number of trials or after a fixed number of correct responses, the probability of responding increased with successive trials after reinforcement, but accuracy was generally constant. (4) When every fifth correct response was reinforced, accuracy decreased immediately after reinforcement if the birds were required to respond on every trial.     

Bias functions and operating characteristics of rats discriminating auditory stimuli

Rats were trained to discriminate between two bursts of random noise that differed in intensity. In a two-lever, discrete-trial procedure, correct responses were reinforced with brain stimulation, and incorrect responses produced timeout. Responding was studied as a function of the decibel difference between the stimuli, the probabilities of presenting the stimuli, the relative duration of timeout consequent upon the two types of incorrect responses, and the absolute duration of timeout consequent upon incorrect responses. The results showed that the distribution of responses between the two levers depended upon the stimulus probabilities, but were independent of either the absolute or relative durations of timeout. When the stimulus probabilities were varied, the response probabilities did not match the stimulus probabilities; when the relative durations of timeout were varied, the animals did not obtain the maximum rate of reinforcement per unit time. Instead, the animals distributed their responses so as to obtain the maximum number of reinforcements at each level of discrimination. In addition, the level of discrimination increased as a function of the decibel difference between the stimuli.     

Discrimination of brightness differences by rats with food or brain-stimulation reinforcement

Rats were trained to respond to the brighter of two keys. Four animals were trained with food pellets and four with electrical brain stimulation. Each discrimination sequence was initiated when the animal broke a light beam at the rear of the chamber, turning on the key lights and starting a 30-sec reinforcement period. An initial response on the brighter key was immediately reinforced, and further responses on the brighter key were then intermittently reinforced. Any time the dimmer key was pressed, a 30-sec timeout was introduced. During timeout, no response had any programmed consequence. When the reinforcement period or the timeout ended, a new discrimination sequence could be initiated. Daily 1-hr training sessions were conducted, and after seven or eight sessions, all animals were at or near errorless performance levels. The luminance of the brighter key was then systematically reduced, in seven steps, with two 30-min test sessions at each step. Orderly psychometric functions were generated for individual animals. Initial acquisition, once position preferences were broken, was equally rapid for food and for brain-stimulation animals, and the two reinforcement procedures yielded comparable levels of brightness discriminability.     

Discrimination based on response-produced stimuli

This study outlines a simplified operant conditioning procedure for investigating discrimination based on response-produced stimuli. The method, using concurrent schedules of reinforcement, greatly reduced the complexity of the procedures and the number of training sessions necessitated by a recently offered alternative technique. Calculations of Weber’s Constant for discrimination between response-produced stimuli are presented and the relevance for learning theory of empirical studies concerning response-produced stimuli is indicated.     

Elimination of behavior of mental patients by response-produced extinction

Mental hospital patients were conditioned to respond at a high rate. Then an attempt was made to eliminate the response by means of a mild punishment consisting of a period of timeout from reinforcement (response-produced extinction). When only one response was available for obtaining the reinforcement, the mild punishment was not effective in eliminating that response. When an alternative response was also made available for obtaining the reinforcement, the mild punishment was completely effective. It appears that even very mild punishment may be effective if the over-all frequency of reinforcement can be maintained by means of an alternative unpunished response.     

Behavior simultaneously maintained by both presentation and termination of noxious stimuli

Lever pressing by two squirrel monkeys was maintained under a 3-minute variable-interval schedule of response-produced electric-shock presentation. At the same time, responding on a second lever was maintained under a 3-minute fixed-interval schedule of termination of the shock-presentation schedule and shock-correlated stimuli. Under the termination schedule, the first response after a 3-minute period produced a 1-minute timeout, during which no events occurred and responding had no scheduled consequence. Relatively high and constant rates of responding were maintained on the lever where responding produced shock. Lower rates and positively accelerated patterns of responding occurred on the lever where responding terminated the shock schedule. Thus, responding was simultaneously maintained by presentation of an event and by termination of a stimulus associated with that event. Rates and patterns of responding on each lever were reversed when the schedules arranged on each lever were reversed on two occasions. When shock intensity was increased from 0 to 10 mA, responding maintained both by presentation of shock and by termination of the shock schedule increased, but responding maintained by shock presentation increased to a greater extent. Positive and negative reinforcement, usually regarded as separate behavioral processes involving different events, can coexist when behavior is controlled by different contingencies involving the same event.     

Schedules using noxious stimuli. III. Responding maintained with response-produced electric shocks

Responding was maintained in two squirrel monkeys under several variations of a 10-min fixed-interval schedule of electric shock presentation. The monkeys were first trained under a 2-min variable-interval schedule of food presentation, and then under a concurrent schedule of food presentation and shock presentation. In one monkey, when shocks (12.6 ma) followed each response during the last minute of an 11-min cycle ending with a timeout period, responding was increased during the first 10 min and suppressed during the last minute of each cycle. When the shock schedule was eliminated, both the enhancement and suppression disappeared, and a steady rate of responding was maintained under the variable-interval schedule. When the food schedule was eliminated, the shock schedule maintained a characteristic fixed-interval pattern of responding during the first 10 min, but suppressed responding during the last minute of each cycle. The fixed-interval pattern of responding was maintained when the timeout period was eliminated and when only one shock could occur at the end of the cycle. In the second monkey, responding under the concurrent food and shock schedule was suppressed when responses produced shocks after 3-min. Under an 11-min cycle, responding continued to be maintained at increasing shock intensities. When the food schedule was eliminated, a fixed-interval pattern of responding was maintained under a 10-min schedule of shock presentation (12.6 ma). Whether response-produced electric shocks suppressed responding or maintained responding depended on the schedule of shock presentation.     

On the discriminability of stimulus duration.

The performance of pigeons trained to detect differences in the duration of stimuli was analysed using a matching model of signal detection. Two white stimuli, S1 and S2, differing in duration, were arranged with equal probability on the center key of a three-key chamber. S1 was systematically varied from 5 seconds to 25 seconds while S2 remained constant at 30 seconds. On completion of the center-key stimulus, a peck on the center key turned on the two red side keys. A left-key response was "correct" when S1 had been in effect on the center key and a right-key response was "correct" on S2 trials. A correct response produced a 3-second magazine light accompanied intermittently by food. Incorrect responses produced 3-second blackouts. Detection performance was measured under two procedures. In the first, the obtained reinforcement ratio was uncontrolled by allowing the number of food reinforcements obtained for correct left- and right-key responses to vary as the stimuli were changed. In the second procedure, the presentation of food reinforcement was controlled by holding the obtained reinforcement ratio constant. Discriminability changed as a function of stimulus differences under both procedures. No such trend was found in response bias.     

Disruption of a temporal discrimination under response-independent shock

The responding of rats was reinforced on one key after a 1-sec auditory stimulus and on a second key after a 5-sec stimulus. With errors punished by a short timeout, all subjects achieved a high level of accuracy. A chain of responses during the stimuli mediated the performance so that when the auditory signals were omitted accuracy decreased only slightly. Response-independent aversive stimulation superimposed upon this procedure both suppressed the total amount of behavior and reduced the accuracy of the discriminative performance, the intensity of the stimulus determining the error rate. The increase in errors under these conditions may have depended in part upon differential suppression of members of the response chain, but such suppression was not necessary, since error rate increased even in its absence. Furthermore, the locus of response disruption within the chain was not consistent from day to day either for any individual animal or across animals.