Reductions in shock frequency and response effort as factors in reinforcement by timeout from avoidance

Rats' presses on one lever canceled shocks programmed after variable cycles, while presses on a second lever occasionally produced a 2-min timout during which the shock-delection schedule was suspended and its correlated stimuli removed. These concurrent schedules of avoidance and timeout were embedded in a multiple schedule whose components differed, within and across conditions, in terms of the programmed shock rate associated with the shock-deletion schedule. Analyses based on the generalized matching law suggest that the reduction in the response requirement correlated with termination of the avoidance schedule was a more important factor in the reinforcing effectiveness of timeout than was shock-frequency reduction, at least in 2 of 3 rats. After training in each condition, responding on the timeout lever was extinguished by withholding timeouts in both components over seven sessions. Resistance to extinction varied directly with the rates of both shock-frequency reduction and avoidance-response reduction experienced during training. Although reduction in response effort appeared to dominate shock-frequency reduction in the maintenance of responding, neither factor had a clear advantage in predicting the course of extinction.     

Reinforcement of inhibition

A differential-reinforcement-of-other-behavior (DRO) schedule with trials and delayed reinforcement was investigated. Periodically a wheel was briefly available to rats, followed six seconds later by brief availability of a bar. Variable-ratio food reinforcement of wheel turns was adjusted to give 95% turns. After variable-ratio-five reinforcement of bar presses produced 100% pressing, then separate ratio schedules were used for presses following turns (turn presses) and presses following nonturns (nonturn presses). Increasing nonturn-press reinforcements decreased turns, even though total reinforcements increased. Reversal by decreasing nonturn-press reinforcements raised turns, though with hysteresis. Thus food reinforcement increased nonturns even though delayed six to ten seconds after nonturns, a delay that greatly reduces response reinforcement. Those and other results indicate that the turn decrease was not due to reinforcement of competing responses. Evidence against other alternatives, and the reduction of responding by increased reinforcement, indicate that the term inhibition is appropriate for the phenomenon reinforced. Response-specific inhibition appears appropriate for this particular kind, since its effects are more specific to particular responses than Pavlovian conditioned-inhibition. Response-specific inhibition seems best considered a behavioral output comparable to responses (e.g., both reinforcible) but with important properties different from responses (e.g., different reinforcement-delay gradients).     

Extinction of responding maintained by timeout from avoidance

The resistance to extinction of lever pressing maintained by timeout from avoidance was examined. Rats were trained under a concurrent schedule in which responses on one lever postponed shock on a free-operant avoidance (Sidman) schedule (response-shock interval = 30 s) and responses on another lever produced 2 min of signaled timeout from avoidance on a variable-ratio 15 schedule. Following extended training (106 to 363 2-hr sessions), two experiments were conducted. In Experiment 1 two different methods of extinction were compared. In one session, all shocks were omitted, and there was some weakening of avoidance but little change in timeout responding. In another session, responding on the timeout lever was ineffective, and under these conditions timeout responding showed rapid extinction. The within-session patterns produced by extinction manipulations were different than the effects of drugs such as morphine, which also reduces timeout responding. In Experiment 2 shock was omitted for many consecutive sessions. Response rates on the avoidance lever declined relatively rapidly, with noticeable reductions within 5 to 10 sessions. Extinction of the timeout lever response was much slower than extinction of avoidance in all 4 rats, and 2 rats continued responding at baseline levels for more than 20 extinction sessions. These results show that lever pressing maintained by negative reinforcement can be highly resistant to extinction. The persistence of responding on the timeout lever after avoidance extinction is not readily explained by current theories.     

THE AVERSIVE CONTROL OF EXCESSIVE ALCOHOL CONSUMPTION BY CHRONIC ALCOHOLICS IN THE LABORATORY SETTING1

The efficacy of several methods of aversive control of excessive alcoholic drinking was investigated in a semi-naturalistic setting that permitted objective measurement of the drinking behavior of chronic alcoholics. Studies 1A and 1B compared an escape-conditioning procedure with a control procedure in which aversive electrical shocks were administered before drinking. Neither procedure effectively decreased subjects' pretreatment, baseline alcoholic drinking behavior. In Study 2, aversive response-contingent shocks effectively suppressed alcoholic drinking, but drinking subsequently returned to its former levels after withdrawal of punishment. Self-administered shock appeared to be as effective as experimenter-administered punishment for controlling drinking, even when the punishment contingency was faded out over time. Study 3 replicated the suppressant effect of punishment, and demonstrated that contingent shock was significantly more effective than yoked, noncontingent shock. A direct comparison of self- versus experimenter-administered punishment suggested a possible slight advantage for the latter.     

Responding in the squirrel monkey under fixed-ratio schedules of stimulus termination

Key pressing was maintained under a fixed-ratio schedule in which electric shock was scheduled for delivery at a fixed time (t seconds) after each stimulus onset, and every n^th response terminated the stimulus and initiated a timeout from shock. Under this procedure, the higher the rate of responding, the briefer the duration of the stimulus presentation and the lower the frequency of shock delivery. The effects of several schedule parameters were studied to determine whether the maintenance of responding was dependent on an inverse relation between response rate and shock frequency. Shock rate and shock frequency were made independent of response rate by decreasing the value of t to 0.5 second and delivering shock only during the first presentation of the stimulus after a fixed time, including stimulus and timeout durations, had elapsed since the previous shock. The experiments showed that shock frequency and response rate are inversely related when t is of relatively long duration compared to the value of the fixed-ratio parameter, but that a decrease in shock rate or frequency due to a high rate of responding is not necessary for the maintenance of responding under a fixed-ratio schedule of stimulus termination.     

The effects of two response-elimination procedures on reinforced and induced aggression.

Pecks against a stuffed pigeon were reinforced according to a fixed-interval schedule for one group of pigeons and a variable-interval schedule for a second group. Red and green stimulus lights were alternately illuminated. Subsequently, food deliveries no longer occurred during one color (extinction). In the presence of the other color, food was presented only when no attack occurred for 30 sec. When attack produced food, all pigeons generally exhibited characteristic fixed-interval or variable-interval response patterns. Two birds in each group frequently exhibited postreinforcement schedule-induced aggression. Attack was reduced to low levels at approximately the same rate by extinction and differential reinforcement of other behavior. For birds that had previously exhibited schedule-induced aggression the initial reduction of attack during the second experimental phase was followed by induced attack immediately after food delivery in the differential-reinforcement-of-other-behavior component and upon onset of the extinction component, Either extinction or differential reinforcement of other behavior may eliminate reinforced aggression but may be relatively ineffective for reducing induced attack.     

Operant and nonoperant vocal responding in the mynah: Complex schedule control and deprivation-induced responding

Several recent studies have been concerned with operant responses that are also affected by nonoperant factors, (e.g., biological constraints, innate behavior patterns, respondent processes). The major reason for studying mynah vocal responding concerned the special relation of avian vocalizations to nonoperant emotional and reflexive systems. The research strategy was to evaluate operant and nonoperant control by comparing the schedule control obtained with the vocal response to that characteristic of the motor responses of other animals. We selected single, multiple, and chain schedules that ordinarily produce disparate response rates at predictable times. In multiple schedules with one component where vocal responding (“Awk”) was reinforced with food (fixed-ratio or fixed-interval schedule) and one where the absence of vocal responding was reinforced (differential reinforcement of other behavior), response rates never exceeded 15 responses per minute, but clear schedule differences developed in response rate and pause time. Nonoperant vocal responding was evident when responding endured across 50 extinction sessions at 25% to 40% of the rate during reinforcement. The “enduring extinction responding” was largely deprivation induced, because the operant-level of naive mynahs under food deprivation was comparable in magnitude, but without deprivation the operant level was much lower. Food deprivation can induce vocal responding, but the relatively precise schedule control indicated that operant contingencies predominate when they are introduced.     

Choice of timeout during response-independent food schedules

Rats' lever pressing terminated visual or auditory stimuli associated with fixed-time or variable-time schedules of food delivery and produced a timeout period during which food delivery could not occur. Lever pressing during a timeout period reinstated the food-associated stimuli and again permitted food delivery according to the fixed-time or variable-time schedules. The mean interfood interval ranged from 1 minute to 16 minutes (variable-time schedules) or 32 minutes (fixed-time schedules); the timer controlling schedule intervals did not stop during timeout periods. The percentage of session time spent in timeout increased when the mean interfood intervals were lengthened and decreased when the mean interfood intervals were shortened. Timeouts were initiated most frequently about half way between successive food deliveries (fixed-time schedules) or after 15 seconds or more had lapsed since the last food delivery (variable-time schedules). Elimination of food delivery increased the percentage of session time spent in timeout, and elimination of the timeout contingency decreased lever press rates. When timeout was produced only when the lever was held in the depressed position, little time was spent in timeout. The main determinants of timeout initiation and termination appeared to be the rate of food delivery, freedom of movement during timeout, and the stimulus change associated with initiation and termination of timeout.     

COMPARISON OF EXTINCTION,DRO 0-SEC,AND DRO 6-SEC IN THE ELIMINATION OF IMITATIVE RESPONDING UNDER DISCRETE-TRIAL PARADIGMS1

Imitative response levels were observed for normal 5-yr-old children within a discrete-trial imitation paradigm. Following imitation training sessions, children were observed under conditions of contingent reinforcement for three experimental sessions. Following the contingent reinforcement phase, children were then observed under reversal conditions for four sessions. A 3 × 4 repeated measures design was employed for observing response decrements under conditions of extinction, DRO 6-sec, and DRO 0-sec. The DRO 0-sec group demonstrated a significantly greater decrement in imitative responding than did the DRO 6-sec and extinction group. The differences in effects between the two DRO conditions and results from previous studies in which DRO procedures have had little effect in reducing imitative responding, suggest an incomplete understanding of the ways in which DRO procedures may operate.     

Reinforcement by an imprinting stimulus versus water on simple schedules in ducklings

Ducklings (5 to 28 days old) were trained to peck a pole on fixed-ratio, fixed-interval, and multiple schedules using brief presentation of an imprinting stimulus as the response-contingent event. Other ducklings of the same age were trained similarly except that reinforcement consisted of access to water. With water reinforcement the typical fixed-ratio (“break-run”), fixed-interval (“scallop”), and multiple schedule response patterns were readily established and consistently maintained. With the imprinting stimulus these schedule effects were inconsistent in some subjects and virtually nonexistent in others, despite extended training. Schedule control with the imprinting stimulus was not improved by the use of a reinforcement signaling procedure which enhances responding reinforced by electrical brain stimulation on intermittent schedules. However, the overall rates of responding and the extinction functions generated after reinforcement with water versus the imprinting stimulus were comparable. These findings imply that control by temporal and discriminative stimuli may be relatively weak when a young organism's behavior is reinforced by presentation of an imprinting stimulus.