Effects of self-generated rules on the development of schedule-controlled behavior.

College students responded under a multiple differential-reinforcement-of-low-rate 5-s fixed-ratio 8 schedule, with components alternating every 2 min. After 40 programmed minutes of acquisition and 12 min of maintenance, without notice, both schedules changed to extinction for 28 min. During acquisition, between alternations of the multiple schedule, some subjects were asked to develop rules describing the schedule contingencies. Other subjects were given these same rules between alternations, and a third group neither received nor were asked to develop rules. By the end of the acquisition phase, self-generated-rule subjects were more likely to show schedule-typical behavior than were subjects not asked to generate rules. The behavior of those given rules was similar to those asked to generate rules at the end of acquisition, but yoked-rule subjects acquired schedule-typical behavior at a quicker rate. By the end of extinction, during the period corresponding to the previous fixed-ratio interval, all no-rule subjects who had earned points during acquisition and maintenance were responding at a rate of less than 30 responses per minute. Only 3 of the 9 self-generated-rule subjects and 2 of the 5 yoked-rule subjects were similarly responding at this low rate. Results suggest that asking subjects to develop self-rules facilitates acquisition, but can retard extinction. Results also suggest that self-generated rules function similarly to external rules.     

Conditional discrimination in mentally retarded adults: the development of generalized skills.

The development of generalized conditional discrimination skills was examined in adults with retardation. Two subjects with histories of failure to acquire arbitrary matching under trial-and-error procedures were successful under procedures that trained one or more prerequisite skills. The successive discrimination between the sample stimuli was established by training the subjects to name the stimuli. The simultaneous discrimination between the comparison stimuli was established using either (a) standard simple discrimination training with reversals or (b) a procedure in which each of the two sample-comparison relations in the conditional discrimination was presented in blocks of trials, with the size of the blocks decreasing gradually until sample presentation was randomized. The amount of prerequisite training required varied across subjects and across successive conditional discriminations. After acquiring either two or three conditional discriminations with component training, both subjects learned new conditional discriminations under trial-and-error procedures. In general, each successive conditional discrimination was acquired more rapidly. Tests showed that conditional responding had become a generalized skill. Symmetry was shown for almost all trained relations. Symmetry trial samples were ultimately named the same as the stimuli to which they were related in training.     

An analysis of rats' drinking-tube contacts under tandem and fixed-interval schedules of food presentation

Rats' lever presses and drinking-tube contacts were studied under fixed-interval schedules of food presentation and under a tandem schedule composed of three fixed intervals. One group of rats was exposed first to the tandem schedule, next to fixed-interval schedules of comparable interpellet intervals, and once again to the tandem schedule; a second group of rats was exposed first to a fixed-interval and then to the tandem schedule. Under the tandem schedule, lever presses occurred at a higher rate and were more uniformly distributed in time than under the fixed-interval schedule. Tube contacts emitted by rats exposed first to a fixed-interval schedule consisted mostly of tongue contacts, which occurred at a high rate shortly after food; tube contacts emitted by rats exposed first to the tandem schedule consisted mostly of paw contacts, which occurred at a lower rate at times other than shortly after food. Changing the schedule from fixed interval to tandem decreased the frequency of tongue contacts for all rats. Under schedules of food presentation with comparable interpellet intervals, the schedule of food presentation, rather than the rate of food delivery per se, determined the topography and temporal locus of drinking-tube contacts.     

Optimal temporal differentiation

In order to illuminate a light signaling a correct response, adult humans had to space their button presses according to a range of time requirements. In some conditions, the spacing needed only to exceed a minimum duration; in others, it had to fall between lower and upper bounds. Mean interresponse times always exceeded the lower limit, and decreased the more stringent were the upper bounds. Variability of interresponse times increased with larger lower bounds, but was unaffected by the size of the upper bound. Feedback about the direction of errors in conditions involving both upper and lower bounds did not affect the means, but it did reduce variability. Predictions were derived from optimality theory, based on the assumption that the critical factor was minimization of the time between correct responses. Without upper bounds, the theory overestimated the mean interresponse times by about 10%; with upper bounds, the theoretical predictions corresponded closely to the actual data. The results did not appear to reflect a scalar timing process. Optimality theory, in contrast to Weber's law, correctly predicted the variety of curves relating sensitivity to duration requirements.     

Instructed versus shaped human verbal behavior: Interactions with nonverbal responding

Undergraduate students' presses on left and right buttons occasionally made available points exchangeable for money. Blue lights over the buttons were correlated with multiple random-ratio random-interval components; usually, the random-ratio schedule was assigned to the left button and the random-interval to the right. During interruptions on the multiple schedule, students filled out sentence-completion guess sheets (e.g., The way to earn points with the left button is to...). For different groups, guesses were shaped with differential points also worth money (e.g., successive approximations to “press fast” for the left button), or were instructed (e.g., Write “press slowly” for the left button), or were simply collected. Control of rate of pressing by guesses was examined in individual cases by reversing shaped or instructed guesses, by instructing pressing rates, and/or by reversing multiple-schedule contingencies. Shaped guesses produced guess-consistent pressing even when guessed rates opposed those characteristic of the contingencies (e.g., slow random-ratio and fast random-interval rates), whereas guesses and rates of pressing rarely corresponded after unsuccessful shaping of guesses or when guessing had no differential consequences. Instructed guesses and pressing were inconsistently related. In other words, when verbal responses were shaped (contingency-governed), they controlled nonverbal responding. When they were instructed (rule-governed), their control of nonverbal responding was inconsistent: the verbal behavior sometimes controlled, sometimes was controlled by, and sometimes was independent of the nonverbal behavior.     

Some parameters of behavioral contrast and allocation of interim behavior in rats

Two experiments examined the effects of baseline reinforcement rate and component duration on behavioral contrast and on re-allocation of interim behavior in rats. Positive behavioral contrast occurred during multiple variable-interval 10-second extinction (VI 10 EXT) after a multiple VI 10 VI 10 baseline condition, but not during multiple VI 60 EXT following multiple VI 60 VI 60 baseline. Component duration had no significant effect on contrast. These results differed from those found in studies of pigeons' key pecking. Contrast was accompanied by an increased rate of drinking in the changed component, but drinking in the constant component did not decrease. These results are not consistent with the competition theory of contrast, but are consistent with the predictions based on the matching law. However, no current theory seems to account for all instances of behavioral contrast.     

Effects of adding a second reinforcement alternative: implications for Herrnstein's interpretation of r(e)

Herrnstein's hyperbola describes the relation between response rate and reinforcer rate on variable-interval (VI) schedules. According to Herrnstein's (1970) interpretation, the parameter r(e) represents the reinforcer rate extraneous to the alternative to which the equation is fitted (the target alternative). The hyperbola is based on an assumption that extraneous reinforcer rate remains constant with changes in reinforcer rate on the target alternative (the constant-r(e) assumption) and that matching with no bias and perfect sensitivity occurs between response and reinforcer ratios. In the present experiment, 12 rats pressed levers for food on a series of 10 VI schedules arranged on the target alternative. Across conditions, six VI values and extinction were arranged on a second alternative. Reinforcer rate on the second alternative, r2, negatively covaried with reinforcer rate on the target alternative for five of the six VI values on the second alternative, and significant degrees of bias and undermatching occurred in response ratios. Given covariation of reinforcer rate on the second and target alternatives, the constant-r(e) assumption can be maintained only by assuming that reinforcer rate from unmeasured background sources, rb, covaries with reinforcer rate on the second alternative such that their sum, r(e), remains constant. In a single-schedule arrangement, however, r(e) equals rb and thus rb is assumed to remain constant, forcing a conceptual inconsistency between single- and concurrent-schedule arrangements. Furthermore, although an alternative formulation of the hyperbola can account for variations in bias and sensitivity, the modified equation also is based on the constant-r(e) assumption and therefore suffers from the same logical problem as the hyperbola when reinforcer rate on the second alternative covaries with reinforcer rate on the target alternative.     

Effects of social context, reinforcer probability, and reinforcer magnitude on humans' choices to compete or not to compete.

In the first two experiments, subjects' choices to earn points (exchangeable for money) either by competing with a fictitious opponent or by not competing were studied. Buskist, Barry, Morgan, and Rossi's (1984) competitive fixed-interval schedule was modified to include a second response option, a noncompetitive fixed-interval schedule. After choosing to enter either option, the opportunity for reinforcers became available after the fixed-interval's duration had elapsed. Under the no-competition condition, points were always available after the interval had elapsed. Under the competition condition, points were available based on a predetermined probability of delivery. Experiments 1 and 2 examined how reinforcer probabilities and reinforcer magnitudes affected subjects' choices to compete. Several general conclusions can be made about the results: (a) Strong preferences to compete were observed at high and moderate reinforcer probabilities; (b) competing was observed even at very low reinforcer probabilities; (c) response rates were always higher in the competition component than in the no-competition component; and (d) response rates and choices to compete were insensitive to reinforcer-magnitude manipulations. In Experiment 3, the social context of this choice schedule was removed to determine whether the high levels of competing observed in the first two experiments were due to a response preference engendered by the social context provided by the experimenters through instructions. In contrast to the first two experiments, these subjects preferred the 60-s fixed-interval schedule (formerly the no-competition option), indicating that the instructions themselves were responsible for the preference to compete. This choice paradigm may be useful to future researchers interested in the effects of other independent variables (e.g., drugs, social context, instructions) on competitive behavior.     

Effects of different accessibility of reinforcement schedules on choice in humans

Based on the delay-reduction hypothesis, a less profitable schedule should be rejected if its duration exceeds the mean delay to reinforcement. It should be accepted if its duration is shorter than the mean delay. This was tested for humans, using a successive-choice schedule. The accessibility of the less profitable (variable-interval 18 s) schedule was varied by changing the duration (in terms of a fixed interval) of the waiting-time component preceding its presentation. Forty-eight students were randomly assigned to three groups. In Phase 1, the duration of the less profitable schedule equaled the mean delay to reinforcement in all groups. In Phase 2, waiting time preceding the less profitable schedule was reduced in Group 1 and increased in Group 2. Thus, the schedule was correlated either with a relative delay increase (Group 1) or a delay reduction (Group 2). In Group 3, conditions remained unchanged. As predicted, acceptance of the less profitable schedule decreased in Group 1 and increased in Group 2. The increased acceptance in Group 2 was accompanied by a decreased acceptance of the more profitable (variable-interval 3 s) schedule, resembling a pattern of negative contrast. Response rates were higher under the component preceding (a) the more profitable schedule in Group 1 and (b) the less profitable schedule in Group 2. Implications for the modification of human choice behavior are discussed.     

Verbal self-reports about matching to sample: effects of the number of elements in a compound sample stimulus.

Adults' self-reports about their choices in a delayed matching-to-sample task were studied as a function of the number of elements (one, two, or three) in a compound sample stimulus. Signal-detection analyses were used to examine control of self-reports by the number of sample elements, by the speed and accuracy of choices reported about, and by several events contingent on self-reports. On each matching-to-sample trial, a sample element appeared as one of two comparison stimuli. Choice of the matching element, if made within 500 ms of the onset of the comparison stimuli, produced points worth money or chances in a drawing for money, depending on the subject. After each choice, subjects pressed either a "yes" or "no" button to answer a computer-generated query about whether the choice met the point contingency. The number of sample elements in the matching-to-sample task varied across trials, and events contingent on self-reports varied across experimental conditions. In Experiment 1, the conditions were defined by different combinations of feedback messages and point consequences contingent on self-reports, but self-reports were systematically influenced only by the sample-stimulus manipulation. Self-report errors increased with the number of sample elements. False alarms (inaccurate reports of success) were far more common than misses (inaccurate reports of failure), and false alarms were especially likely after choices that were correct but too slow to meet the point contingency. Sensitivity (A') of self-reports decreases as the number of sample elements increased. In addition, self-reports were more sensitive to choice accuracy than to choice speed. All subjects showed a pronounced bias (B'H) for reporting successful responses, although the bias was reduced as the number of sample elements increased and successful choices became less frequent. Experiment 2 demonstrated that the failure of point contingencies to influence self-reports in the first experiment was not due to a general ineffectiveness of the point consequences. Rates of inaccurate self-reports decreased when they resulted in point losses and increased when they resulted in point gains.