Persistent behavior maintained by unavoidable shocks

Squirrel monkeys were trained on a multiple schedule in which 10-min periods on a continuous shock avoidance schedule, indicated by a yellow light, alternated with 10-min periods on a 1.5-min variable interval schedule of food reinforcement (VI 1.5). A white light indicated that VI 1.5 was in effect, except for the middle 2 min of the period on VI 1.5, in which a blue light appeared and terminated with the delivery of a 0.5-sec unavoidable shock. Stable response rates developed in the avoidance and VI 1.5 components. However, the highest response rates occurred in the blue, preshock stimulus. A series of experiments showed that responding in the blue stimulus persisted even when responding had been extinguished on both the VI schedule of food reinforcement and the shock avoidance schedule. Responding in the blue stimulus ceased when the blue stimulus terminated without shock or when it terminated with a response-contingent shock. Each time responding ceased, it was restored by terminating the blue stimulus with an unavoidable shock. When the blue stimulus was on throughout each session and unavoidable shocks were delivered at regular 10-min intervals, responding was well maintained. These results show that in monkeys that have been trained on a continuous avoidance schedule, unavoidable shocks can maintain responding even under conditions where responses have no programmed consequences.     

Variable-interval escape from stimuli accompanied by shocks

Individual performances of three rats were examined under a procedure in which steady rates of bar pressing were maintained by conditioned aversive stimulation. Originally neutral visual and auditory stimuli were accompanied by widely and irregularly spaced pulses of shock; they were terminated on a variable-interval schedule by pressing a bar. The contingencies between behavior and shock were also duplicated in a control procedure in which no visual or auditory stimuli were provided. Pressing observed under the control procedure was attributed to differences in the aversiveness of pressing and nonpressing behavior engendered by differences in the incidence of shock following the two classes of behavior. Increased rates with visual and auditory stimuli were attributed to termination of conditioned aversive stimulation. Control rates declined more rapidly than did experimental rates as the mean interval between successive shocks was lengthened; both rates tended to decline when less than 60 sec was allowed as time out from shocks following the successful response. In the control procedure, discrimination between the continuation and discontinuation of the shock series, as measured by relative rates, depended on the relative length of the interval between shocks and the time-out period. Regular warm-up accelerations in rate were noted following an initial delay in responding at the beginning of each session. The length of time required for the warm-up depended on the length of the mean interval between shocks, indicating that exposure to a certain amount of shock was required to establish a supporting state for the observed performance.     

Reinforcement of least-frequent sequences of choices

When a pigeon's choices between two keys are probabilistically reinforced, as in discrete trial probability learning procedures and in concurrent variable-interval schedules, the bird tends to maximize, or to choose the alternative with the higher probability of reinforcement. In concurrent variable-interval schedules, steady-state matching, which is an approximate equality between the relative frequency of a response and the relative frequency of reinforcement of that response, has previously been obtained only as a consequence of maximizing. In the present experiment, maximizing was impossible. A choice of one of two keys was reinforced only if it formed, together with the three preceding choices, the sequence of four successive choices that had occurred least often. This sequence was determined by a Bernoulli-trials process with parameter p. Each of three pigeons matched when p was ½ or ¼. Therefore, steady-state matching by individual birds is not always a consequence of maximizing. Choice probability varied between successive reinforcements, and sequential statistics revealed dependencies which were adequately described by a Bernoulli-trials process with p depending on the time since the preceding reinforcement.     

The reinforcement of short interresponse times

Five contingencies were superimposed successively on a variable-interval schedule of reinforcement. In each of the resulting conditions, a different short, interresponse time was reinforced and an interresponse-time distribution was obtained from each of three pigeons. The lower bound of the reinforced interresponse times ranged from 0.3 to 2.4 sec. The resulting distributions were combined, according to a rationale based upon concurrent operants, induction, and a property of variable-interval schedules, to describe the interresponse-time distributions from a variable-interval schedule.     

Book reviews

The Journal of Value Inquiry -