The paradox of preference for unreliable reinforcement: The role of context and conditioned reinforcement

We discuss Belke and Spetch's (1994) work on choice between reliable and unreliable reinforcement. The studies by Belke and Spetch extend a line of basic research demonstrating that under certain experimental conditions in a concurrent chains procedure, pigeons prefer an alternative that produces unreliable reinforcement. The authors describe the variables that influence preference for unreliable reinforcement, including the signaling and the duration of the reinforcement schedules, the context in which the signaling stimuli occur, and the effects of conditioned reinforcement. Hypothetical applied examples that address these variables are provided, and their influence on preference for unreliable reinforcement in humans is discussed. We conclude by suggesting a line of applied research to examine the relationship between these variables and a preference for unreliable reinforcement.     

LEVEL OF INTERACTIVITY OF VIDEODISC INSTRUCTION ON COLLEGE STUDENTS' RECALL OF AIDS INFORMATION

Experiment 1 confirmed the greater effectiveness of constructed-response interactive videodisc instruction when compared to a click-to-continue or passive viewing formats on posttest recall of AIDS information by 101 college students. Experiment 2 extended the analysis using a counterbalanced (ABAB-BABA) intrasubject design with 4 students in each of three ability groups. The necessity of constructing answers appears to be an important factor in the effectiveness of instructional programs.     

Comparing interspersed requests and social comments as antecedents for increasing student compliance

Two students were alternately presented with interspersed high-compliance requests and social comments as antecedents to low-compliance requests. An initial comparison demonstrated similar positive effects on compliance for interspersed requests and social comments. A second analysis indicated that the effectiveness of social comments for increasing compliance was related to the time interval between social comments and low-compliance requests.     

REDUCING ESCAPE BEHAVIOR AND INCREASING TASK COMPLETION WITH FUNCTIONAL COMMUNICATION TRAINING,EXTINCTION AND RESPONSE CHAINING

The effects of functional communication training, extinction, and response chaining on 3 subjects' escape-maintained aberrant behavior were evaluated using a multielement design. Functional communication training consisted of teaching subjects a verbal response that was functionally equivalent to their aberrant behavior. Subjects initially were allowed to escape from a task contingent on the trained verbal response. In subsequent treatment phases, escape was contingent on the trained verbal response plus the completion of the specified number of steps in the task (response chaining). The number of steps was increased until a subject completed the task to obtain a break. Results showed that the treatment reduced rates of aberrant behavior and that the chaining procedure was effective in decreasing the availability of escape.     

Effects of a variable-ratio conditioning history on sensitivity to fixed-interval contingencies in rats.

We investigated the possibility that human-like fixed-interval performances would appear in rats given a variable-ratio history (Wanchisen, Tatham, & Mooney, 1989). Nine rats were trained under single or compound variable-ratio schedules and then under a fixed-interval 30-s schedule. The histories produced high fixed-interval rates that declined slowly over 90 sessions; differences as a function of the particular history were absent. Nine control animals given only fixed-interval training responded at lower levels initially, but rates increased with training. Despite differences in absolute rates, rates within the intervals and postreinforcement pauses indicated equivalent development of the accelerated response patterns suggestive of sensitivity to fixed-interval contingencies. The finding that the histories elevated rates without retarding development of differentiated patterns suggests that the effective response unit was a burst of several lever presses and that the fixed-interval contingencies acted on these units in the same way as for single responses. Regardless of history, the rats did not manifest the persistent, undifferentiated responding reported for humans under comparable schedules. We concluded that the shortcomings of animal models of human fixed-interval performances cannot be easily remedied by including a variable-ratio conditioning history within the model.     

Resistance to reinforcement change in multiple and concurrent schedules assessed in transition and at steady state

Behavioral momentum theory relates resistance to change of responding in a multiple-schedule component to the total reinforcement obtained in that component, regardless of how the reinforcers are produced. Four pigeons responded in a series of multiple-schedule conditions in which a variable-interval 40-s schedule arranged reinforcers for pecking in one component and a variable-interval 360-s schedule arranged them in the other. In addition, responses on a second key were reinforced according to variable-interval schedules that were equal in the two components. In different parts of the experiment, responding was disrupted by changing the rate of reinforcement on the second key or by delivering response-independent food during a blackout separating the two components. Consistent with momentum theory, responding on the first key in Part 1 changed more in the component with the lower reinforcement total when it was disrupted by changes in the rate of reinforcement on the second key. However, responding on the second key changed more in the component with the higher reinforcement total. In Parts 2 and 3, responding was disrupted with free food presented during intercomponent blackouts, with extinction (Part 2) or variable-interval 80-s reinforcement (Part 3) arranged on the second key. Here, resistance to change was greater for the component with greater overall reinforcement. Failures of momentum theory to predict short-term differences in resistance to change occurred with disruptors that caused greater change between steady states for the richer component. Consistency of effects across disruptors may yet be found if short-term effects of disruptors are assessed relative to the extent of change observed after prolonged exposure.     

The effects of cocaine on behavior maintained by timeout from avoidance.

Rats were trained on concurrent schedules under which responses on one lever postponed shock (avoidance) and responses on the other lever produced brief (2-min) periods of signaled timeout from avoidance. For 6 rats, timeout from avoidance was programmed on a variable-interval 45-s schedule that generally resulted in rates that were lower than those on the avoidance lever. For another 6 rats, timeout was arranged on a variable-ratio 15 schedule that produced higher baseline rates. Cocaine (3 to 40 mg/kg) produced large, dose-dependent increases in behavior maintained by timeout in both groups of rats. Avoidance responding was also generally increased by cocaine, but the increases were of lesser magnitude. Increases in response rates were seen across a broad range of doses on behavior maintained by either interval or ratio schedules, an outcome that was unexpected on the basis of most studies of cocaine on food-maintained behavior. These results were similar to those of previous studies of the effects of amphetamine on behavior maintained by timeout from avoidance and suggest that stimulant drugs affect behavior maintained under a shock-postponement schedule differently than they affect behavior maintained by timeout from avoidance.     

A transformation of self-discrimination response functions in accordance with the arbitrarily applicable relations of sameness, more than, and less than

In Experiment 1, 2 experimental subjects were given pretraining of nonarbitrary relations that brought their responses under the control of four contextual stimuli; same, opposite, more than, and less than. One control subject was not exposed to this pretraining. The 2 pretrained subjects and the 3rd nonpretrained subject then received training in six arbitrary relations, the following four relations being the most critical: same/A1-B1, same/A1-C1, less than/A1-B2, more than/A1-C2. All 3 subjects were then tested for seven derived relations, the following three relations being the most important: same/B1-C1, more than/B1-C2, less than/B1-B2. The 2 pretrained subjects, but not the nonpretrained subject, showed the derived relations. One of the stimuli (B1) from the relational network and two novel stimuli (X1 and X2) were then used to train three different self-discrimination responses on three complex schedules of reinforcement. That is, all 3 subjects were trained to pick X1 if they had not emitted a response, to pick B1 if they had emitted one response only, and to pick X2 if they had emitted two responses only. The 2 pretrained subjects, but not the nonpretrained subject, showed the predicted transformation of self-discrimination response functions in accordance with the relations of sameness, more than, and less than (i.e., no response, pick B2; one response only, pick C1; and two responses only, pick C2). In Experiment 2, 2 new subjects were employed, and the arbitrary relational training and testing phases were modified to control for a procedural artifact that may have contributed to the results of the first experiment. Experiment 2 replicated the findings of Experiment 1. The pattern of results support the utility of a relational frames approach to understanding derived stimulus relations.     

Biasing the pacemaker in the behavioral theory of timing

In the behavioral theory of timing, pacemaker rate is determined by overall rate of reinforcement. A two-alternative free-operant psychophysical procedure was employed to investigate whether pacemaker period was also sensitive to the differential rate of reinforcement. Responding on a left key during the first 25 s and on a right key during the second 25 s of a 50-s trial was reinforced at variable intervals, and variable-interval schedule values during the two halves of the trials were varied systematically. Responding on the right key during the first 25 s and on the left key during the second 25 s was not reinforced. Estimates of pacemaker period were derived from fits of a function predicted by the behavioral theory of timing to right-key response proportions in consecutive 5-s bins of the 50-s trial. Estimates of pacemaker period were shortest when the differential reinforcer rate most strongly favored right-key responses, and were longest when the differential reinforcer rate most strongly favored left-key responses. The results were consistent with the conclusion that pacemaker rate is influenced by relative reinforcer rate.     

Repetition effects on word fragment completion: The role of competition among responses

Four experiments examined the effect of spaced repetition of study words on completion of word fragments with only one solution and word fragments with multiple solutions. Recognition was used as test of explicit memory in the first two experiments. The study words were presented either once or three times. Repetition was found to increase recognition memory substantially, and to affect fragment completion performance only marginally. This was true for both single- and multiple-solution fragments, showing that competition among responses is not critical for the magnitude of the repetition effect in fragment completion. This finding, that the repetition effect is marginal also when the type of cues provides an occasion for repetition effects to show up, suggests that the real effect of repetition on perceptual priming is borderline. It is proposed that memory from the first presentation eliminates necessary processing of items when they are re-exposed, and that the repetition effect thereby is reduced.