Some effects of interreinforcement time upon choice

Pigeons' responses were reinforced on two identical and concurrently available chain variable-interval-schedules. Unlike the typical concurrent chains procedure, both links were operative throughout, thus producing three types of concurrency: (1) concurrent initial links; (2) concurrent initial and terminal links; (3) concurrent terminal links. Choice proportions in each of these three states suggested that the pigeons were sensitive to momentary likelihoods of reinforcement: choice proportions for a schedule were higher when the schedule had been operative for some time, resulting in a higher probability of reinforcement. The study also showed that the relative rates of responding did not match the relative rates of reinforcement in any of the three states of concurrency. Instead, the choice proportions in both the concurrent initial and in the concurrent terminal links were intermediate between the scheduled and the obtained relative rates of reinforcement, while the choice proportions for a terminal link concurrent with an initial link consistently overmatched the relative interreinforcement times (and were typically 1.00). These data indicate that an accurate characterization of choice may not be obtained by considering only the relative interreinforcement interval where one interreinforcement interval is segmented into a chain. Instead, the organism's choice for a schedule will be substantially lowered by the chaining operation.     

Inverse relation between choice and local response rate with a schedule of response-produced blackouts

Pigeons were exposed to a two-key concurrent chains schedule in which identical frequencies and distributions of food presentations generated different response rates in the terminal links. An inverse relation between local rate of response in the terminal links and relative frequency of response in the initial links was observed. The high response rate was produced in one terminal link by a second-order schedule in which responding produced brief blackouts of the response key. Responding under the same schedule in the other terminal link did not produce blackouts. Under initial training and after spatial reversal of the terminal-link schedules, two of three pigeons had lower relative frequencies of response in the initial member of the chain with the higher terminal link response rate. The third pigeon showed no change in preference at reversal.     

Two temporal parameters of food postponement

Rats were trained to press a lever under schedules of food postponement. In the absence of lever presses, food was delivered periodically (food-food interval). Responses initiated a second interval (response-food interval) that was reset by each additional response. Performance was first studied at different response-food intervals with the food-food interval fixed at 30 or 60 sec, or 10 min. Response-food intervals were examined in ascending order and then recovery was studied at shorter intervals. Finally, the food-food interval was manipulated with response-food interval fixed at 30 sec. At food-food intervals of 30 and 60 sec, responding first increased and then decreased as the response-food interval increased. At the 10-min food-food interval, responding decreased with increasing response-food interval. In general, very low rates of responding occurred when the response-food interval was 60 sec or more and when it equalled or exceeded the food-food interval. However, responding was maintained in one animal when the food-food interval was decreased from 120 to 15 sec with the response-food interval at 30 sec. Results, in terms of several dependent variables, are compared with data on shock avoidance. Effects of response-independent and response-produced food and shock are discussed.     

Sustained behavioral contrast in children

Children were exposed to a multiple schedule involving equal variable-interval schedules in each of two components and a multiple schedule involving a variable-interval schedule in one component and an extinction schedule in the other. Response rates were equal in both components when each involved a variable-interval schedule. Response rates differed in the two components of the multiple variable-interval extinction schedule. Response rates were higher in the variable-interval schedule when the accompanying schedule was extinction than when it was variable interval. The increase in response rate in the variable-interval component, simultaneous with the decrease in response rate in the extinction component, illustrated sustained behavioral contrast, and was the first evidence of this phenomenon in children.     

Probability learning as a function of momentary reinforcement probability

Pigeons were trained on a probability learning task where the overall reinforcement probability was 0.50 for each response alternative but where the momentary reinforcement probability differed and depended upon the outcome of the preceding trial. In all cases, the maximum reinforcement occurred with a “win-stay, lose-shift” response pattern. When both position and color were relevant cues, the optimal response pattern was learned when the reinforcement probability for repeating the just-reinforced response was 0.80 but not when the probability was 0.65. When only color was relevant, learning occurred much more slowly, and only for subjects trained on large fixed ratio requirements.     

Schedule control of the vocal behavior of Cebus monkeys

The vocal behavior of three Cebus monkeys was maintained by fixed-ratio schedules of response dependent reinforcement at values between fixed-ratio 1 and fixed-ratio 15. In one monkey that was exposed to variable-interval, fixed-interval, and conjunctive fixed-ratio fixed-interval schedules of reinforcement, vocal responding occurred at a low rate, but schedule-appropriate patterns were maintained. The rates and patterns of responding engendered indicated that the vocal operant can be brought under schedule control in the monkey by the use of response-dependent reinforcement.     

Fixed-interval limited-hold avoidance with and without signalled reinforcement

Rats trained to lever press on a fixed-interval limited-hold avoidance schedule maintained a pattern of responding similar to that maintained by fixed-interval limited-hold schedules of positive reinforcement. But this positively accelerated pattern of behavior was maintained only when the occurrence of reinforcement was signalled by the presentation of a brief flash of light. This result suggests that the discriminative function of the reinforcer in avoidance is less pronounced than the discriminative function of the reinforcer in escape or positive reinforcement. It also suggests that the distinction between positive reinforcement and avoidance is not superfluous. Although the schedule of reinforcement is an important variable in determining the pattern of behavior, other variables, such as the nature (i.e., stimulus presentation, termination, or omission) of the reinforcer, are also potent determinants of behavior.     

Negation of Park's transformations

Zusammenfassung Parks Kritik beruht, meiner Ansicht nach, auf einem entscheidenden Mißverständnis meiner Intentionen: es geht mir überhaupt nicht um eine Argumentation gegen eine Transformationsgrammatik à la Chomsky, und nicht einmal in erster Linie gegen die Absicht mancher Psycholinguisten, eine derartige Theorie in ihren psychischen Funktionen aufzuzeigen. Ich möchte lediglich dafür plädieren, daß die Psycholinguistik in erster Linie psychologische (und nicht linguistische) Überlegungen und Modellvorstellungen als Leitlinien verwendet.