MAINTENANCE OF THERAPEUTIC CHANGE BY MOMENTARY DRO

Differential reinforcement of other behavior (DRO) involves delivery of reinforcement at the end of an interval during which the target behavior has not occurred. Momentary DRO, however, is a procedure in which reinforcement is delivered if a response did not occur at the end of an interval. We examined the extent to which momentary DRO maintained suppression, following initial treatment with whole-interval DRO, of nine retarded students' maladaptive behavior. Results indicate that momentary DRO maintained response suppression comparable to that obtained by whole-interval DRO.     

MAINTENANCE FACTORS IN COERCIVE MOTHER-CHILD INTERACTIONS: THE COMPLIANCE AND PREDICTABILITY HYPOTHESES

Two stimulus control processes by which some parent-child dyads occasionally escalate their aversive exchanges into progressively more coercive interactions are described. The compliance hypothesis suggests that aversive actions have instructional properties for the dyad and that parent compliance with such child instructions maintains behavior chains of increasing aversiveness. The predictability hypothesis suggests that social interactions are most likely to function as aversive stimuli in the dyad when delivered in unpredictable fashion by either party and that responses instrumental in reducing dyadic unpredictability maintain aversive behavior chains. Expectations derived from both hypotheses are evaluated in a series of correlational analyses of mother-child interactions obtained in extended baseline observations of three dyads seeking psychological help for severe interactional problems. Results provide tentative support for the predictability hypothesis and suggest important avenues of further research.     

The economics of the law of effect.

A corollary of the law of effect predicts that the larger the reinforcement, the greater the rate of responding. However, an animal must eat more small portions than large portions to obtain the same daily intake, and one would predict, therefore, that when eating smaller portions an efficient animal would eat less (conserving time and energy) and/or respond faster (conserving time). The latter of these predictions was supported by the present experiments with free-feeding rats for which portion size (pellet size or duration of feeder presentation) and portion price within meals were varied. Response rate was a function of the unit price (responses/g) of food: Rats responded faster when portions were smaller or when prices were higher. Meal size and frequency were relatively unaffected by unit price, but were influenced by the price of meal initiation. The results are discussed in relation to the economic differences between traditional operant and free-feeding paradigms and to both traditional and more recent formulations of the law of effect.     

Response-reinforcer contingency and spatially defined operants: testing an invariance property of phi

A chamber containing 72 response keys defining the circumference of a circle 1 m in diameter was used to examine the relation between differentiation of response location and a measure of response-reinforcer contingency known as the phi coefficient. A different target key was specified in each successive phase, and response location was differentiated with respect to the target. Criterional and noncriterional responses (i.e., responses "near" and "far" from the target) were defined using targeted percentile schedules to control the overall probability of each response class. By manipulating criterional (and, hence, noncriterional) response probability and the reinforcement probabilities conditional on each, a mathematical invariance property peculiar to phi in contingency analysis was examined. Specifically, diagonally interchanging cell frequencies in a 2 x 2 table relating criterional/noncriterional responses to reinforcement/nonreinforcement leaves phi unchanged. Hence, the degree of response differentiation predicted by phi remains unchanged under the four permutations implied by the various diagonal interchanges. This predicted invariance was examined under values of phi equal to .33, .58, and .82. Increasing phi generally increased the stereotypy of response location. Three of the permutations generated almost interchangeable performance at different phi values. The remaining permutation, however, generated functions relating response concentration to phi with slopes shallower than those obtained under the other permutations. This resulted from relatively higher levels of differentiation, compared to the other permutations, at low phi values. These data strongly suggest boundary conditions on the ability of phi to reflect completely the local processes that are indexed by phi at a molar level.     

The development of adaptive choice in a self-control paradigm

Sixteen girls (ages 4, 6, 9, and 12) performed on concurrent-chain schedules of reinforcement. The initial links were variable-interval 10-s schedules, and the terminal links offered a long delay (20, 30, 40, or 50 s) followed by two tokens or a short delay (10 s) followed by one token. Tokens were used to buy toys and sweets. The effect of increasing the delay to the large reward differed significantly across age groups. Whereas 6- and 9-year-olds maintained a strong preference for the larger, more delayed reward under all delay conditions, half of the 4-year-olds and all the 12-year-olds showed increasing preference for the small reward as the delay to the large reward increased. The results suggest a two-stage account of the development of self-control. In the first stage, behavior is increasingly controlled by reward size, as children learn how to wait for delayed rewards, and in the second phase behavior is increasingly controlled by reward rate, as children learn when it is in fact profitable to wait.     

Theories of probabilistic reinforcement.

In three experiments, pigeons chose between two alternatives that differed in the probability of reinforcement and the delay to reinforcement. A peck at a red key led to a delay of 5 s and then a possible reinforcer. A peck at a green key led to an adjusting delay and then a certain reinforcer. This delay was adjusted over trials so as to estimate an indifference point, or a duration at which the two alternatives were chosen about equally often. In Experiments 1 and 2, the intertrial interval was varied across conditions, and these variations had no systematic effects on choice. In Experiment 3, the stimuli that followed a choice of the red key differed across conditions. In some conditions, a red houselight was presented for 5 s after each choice of the red key. In other conditions, the red houselight was present on reinforced trials but not on nonreinforced trials. Subjects exhibited greater preference for the red key in the latter case. The results were used to evaluate four different theories of probabilistic reinforcement. The results were most consistent with the view that the value or effectiveness of a probabilistic reinforcer is determined by the total time per reinforcer spent in the presence of stimuli associated with the probabilistic alternative. According to this view, probabilistic reinforcers are analogous to reinforcers that are delivered after variable delays.     

Pigeons' choices in situations of diminishing returns: fixed- versus progressive-ratio schedules.

In two different discrete-trial procedures, pigeons were faced with choices between fixed-ratio and progressive-ratio schedules. The latter schedules entail diminishing returns, a feature analogous to foraging situations in the wild. In the first condition (no reset), subjects chose between a progressive-ratio schedule that increased in increments of 20 throughout a session and a fixed-ratio schedule that was constant across blocks of sessions. The size of the fixed ratio was varied parametrically through an ascending and then a descending series. In the reset condition, the same fixed-ratio values were used, but each selection (and completion) of the fixed ratio reset the progressive-ratio schedule back to its minimal value. In the no-reset procedure, the pigeons tended to cease selecting the progressive ratio when it equaled or slightly exceeded the fixed-ratio value, whereas in reset, they chose the fixed ratio well in advance of that equality point. These results indicate sensitivity to molar as well as to molecular reinforcement rates, and those molar relationships are similar to predictions based on the marginal value theorem of optimal foraging theory (e.g., Charnov, 1976). However, although previous results with monkeys (Hineline & Sodetz, 1987) appeared to minimize responses per reinforcement, the present results corresponded more closely to predictions based on sums-of-reciprocals of distance from point of choice to each of the next four reinforcers. Results obtained by Hodos and Trumbule (1967) with chimpanzees in a similar procedure were intermediate between these two relationships. Variability of choices, as well as median choice points, differed between the reset and no-reset conditions.(ABSTRACT TRUNCATED AT 250 WORDS)     

Oral self-administration of pentobarbital by rhesus monkeys: relative reinforcing effects under concurrent fixed-ratio schedules.

During daily 3-hr sessions, orally delivered pentobarbital solutions and water, or two separate pentobarbital solutions, were concurrently available to rhesus monkeys according to fixed-ratio schedules of mouth contacts with a spout. First water, and then each of four "comparison-concentration" pentobarbital solutions (0.0625, 0.25, 1, and 4 mg/mL), was successively available from one spout for a block of sessions under a fixed-ratio-64 (three monkeys) or fixed-ratio-16 (one monkey) schedule. Under an identically sized fixed-ratio schedule, deliveries of a "standard-concentration" pentobarbital solution were concurrently available from a second spout. The concentration of the standard solution remained unchanged throughout testing of the series of comparison solutions. Each of three pentobarbital concentrations (4, 1, and 0.25 mg/mL) in turn served as the standard concentration. Within each pair of concurrently available solutions, the higher drug concentration maintained more behavior than the lower concentration. Thus when monkeys were provided with concurrent access to different pentobarbital concentrations, relative reinforcing effects were directly related to drug concentration. Further, the amount of behavior maintained by a particular drug concentration was dependent on the concentration of the concurrently available drug solution. Thus, the relative effectiveness of a reinforcer in maintaining behavior is a function of both the reinforcer's magnitude and the availability of alternative reinforcers in the environment.     

IDENTIFYING REINFORCERS FOR PERSONS WITH PROFOUND HANDICAPS: STAFF OPINION VERSUS SYSTEMATIC ASSESSMENT OF PREFERENCES

We evaluated a systematic means of determining stimulus preferences among seven profoundly handicapped persons. Preferences were determined by observing student approach responses to individual stimuli. Results indicated that there were differential stimulus preferences across the multiply handicapped participants. However, results of the systematic assessment did not coincide with the results of a more traditional, caregiver-opinion method of assessing student preferences. A second experiment was then conducted with five participants to evaluate whether stimuli that were assessed to consistently represent preferences would function as reinforcers in skill training programs. Results indicated that stimuli that were systematically assessed to represent student preferences typically functioned as reinforcers when applied contingently. However, preferred stimuli as reflected by caregiver opinion did not function as reinforcers unless those stimuli were also preferred on the systematic assessment. Results are discussed in terms of assisting profoundly handicapped persons by (a) improving the effectiveness of training programs by increasing the likelihood of using stimuli that have reinforcing value and (b) increasing the overall quality of life by providing preferred stimuli in the routine living environment.     

Shaping by automated tracking of an arbitrary operant response

Although shaping is a widely accepted operant-conditioning procedure for establishing new responses, technological problems involved in specifying and recording precise approximations to the target response have hindered experimental analysis of the shaping process. The present study used a computer-controlled system that allows relatively precise procedural specification by continuous tracking of a pigeon's head and reinforcing successively closer approximations to contact of the head with an arbitrary fixed spherical region of 3-cm diameter. The procedure was demonstrated to be effective, in that shaping of the target response occurred rapidly for each of the 3 birds in the study.