Shaping by automated tracking of an arbitrary operant response

Although shaping is a widely accepted operant-conditioning procedure for establishing new responses, technological problems involved in specifying and recording precise approximations to the target response have hindered experimental analysis of the shaping process. The present study used a computer-controlled system that allows relatively precise procedural specification by continuous tracking of a pigeon's head and reinforcing successively closer approximations to contact of the head with an arbitrary fixed spherical region of 3-cm diameter. The procedure was demonstrated to be effective, in that shaping of the target response occurred rapidly for each of the 3 birds in the study.     

Discriminative stimulus control and the effects of concurrent operants.

Discriminative-stimulus-control functions were investigated in a concurrent operant context. Variable-interval reinforcement schedules were arranged for pigeons on two response keys. One key, illuminated with a white vertical line on green background (position irrelevant), was programmed with a given schedule value across groups. For different groups of pigeons, the alternative key, illuminated with green alone, was programmed with twice, the same, or half the reinforcement frequency of the other key. Stimulus-control gradients were collected from both keys as line orientation was varied. On the green-plus-line alternative, flattest gradients were observed when twice the reinforcement frequency was concurrently programmed and the steepest were observed when equal values were concurrently programmed. Also examined were the effects of a programmed changeover delay, important in maintaining the independence of concurrent operants. The changeover delay was found to have relatively minor effects upon stimulus control, despite its typical and marked effects upon steady-state responding.     

Molar optimization versus delayed reinforcement as explanations of choice between fixed-ratio and progressive-ratio schedules.

In a discrete-trials procedure, pigeons chose between a fixed-ratio 81 schedule and a progressive-ratio schedule by making a single peck at the key correlated with one or the other of these schedules. The response requirement on the progressive-ratio schedule began at 1 and increased by 10 each time the progressive-ratio schedule was chosen. Each time the fixed-ratio schedule was chosen, the requirement on the progressive-ratio schedule was reset to 1 response. In conditions where there was no intertrial interval, subjects chose the progressive-ratio schedule for an average of about five consecutive trials (during which the response requirement increased to 41), and then chose the fixed-ratio schedule. This ratio was larger than that predicted by an optimality analysis that assumes that subjects respond in a pattern that minimizes the response-reinforcer ratio or one that assumes that subjects respond in a pattern that maximizes the overall rate of reinforcement. In conditions with a 25-s or 50-s intertrial interval, subjects chose the progressive-ratio schedule for an average of about eight consecutive trials before choosing the fixed-ratio schedule. This change in performance with the addition of an intertrial interval was also not predicted by an optimality analysis. On the other hand, the results were consistent with the theory that choice is determined by the delays to the reinforcers delivered on the present trial and on subsequent trials.     

IDENTIFYING REINFORCERS FOR PERSONS WITH PROFOUND HANDICAPS: STAFF OPINION VERSUS SYSTEMATIC ASSESSMENT OF PREFERENCES

We evaluated a systematic means of determining stimulus preferences among seven profoundly handicapped persons. Preferences were determined by observing student approach responses to individual stimuli. Results indicated that there were differential stimulus preferences across the multiply handicapped participants. However, results of the systematic assessment did not coincide with the results of a more traditional, caregiver-opinion method of assessing student preferences. A second experiment was then conducted with five participants to evaluate whether stimuli that were assessed to consistently represent preferences would function as reinforcers in skill training programs. Results indicated that stimuli that were systematically assessed to represent student preferences typically functioned as reinforcers when applied contingently. However, preferred stimuli as reflected by caregiver opinion did not function as reinforcers unless those stimuli were also preferred on the systematic assessment. Results are discussed in terms of assisting profoundly handicapped persons by (a) improving the effectiveness of training programs by increasing the likelihood of using stimuli that have reinforcing value and (b) increasing the overall quality of life by providing preferred stimuli in the routine living environment.     

Pigeons' choices in situations of diminishing returns: fixed- versus progressive-ratio schedules.

In two different discrete-trial procedures, pigeons were faced with choices between fixed-ratio and progressive-ratio schedules. The latter schedules entail diminishing returns, a feature analogous to foraging situations in the wild. In the first condition (no reset), subjects chose between a progressive-ratio schedule that increased in increments of 20 throughout a session and a fixed-ratio schedule that was constant across blocks of sessions. The size of the fixed ratio was varied parametrically through an ascending and then a descending series. In the reset condition, the same fixed-ratio values were used, but each selection (and completion) of the fixed ratio reset the progressive-ratio schedule back to its minimal value. In the no-reset procedure, the pigeons tended to cease selecting the progressive ratio when it equaled or slightly exceeded the fixed-ratio value, whereas in reset, they chose the fixed ratio well in advance of that equality point. These results indicate sensitivity to molar as well as to molecular reinforcement rates, and those molar relationships are similar to predictions based on the marginal value theorem of optimal foraging theory (e.g., Charnov, 1976). However, although previous results with monkeys (Hineline & Sodetz, 1987) appeared to minimize responses per reinforcement, the present results corresponded more closely to predictions based on sums-of-reciprocals of distance from point of choice to each of the next four reinforcers. Results obtained by Hodos and Trumbule (1967) with chimpanzees in a similar procedure were intermediate between these two relationships. Variability of choices, as well as median choice points, differed between the reset and no-reset conditions.(ABSTRACT TRUNCATED AT 250 WORDS)     

Oral self-administration of pentobarbital by rhesus monkeys: relative reinforcing effects under concurrent fixed-ratio schedules.

During daily 3-hr sessions, orally delivered pentobarbital solutions and water, or two separate pentobarbital solutions, were concurrently available to rhesus monkeys according to fixed-ratio schedules of mouth contacts with a spout. First water, and then each of four "comparison-concentration" pentobarbital solutions (0.0625, 0.25, 1, and 4 mg/mL), was successively available from one spout for a block of sessions under a fixed-ratio-64 (three monkeys) or fixed-ratio-16 (one monkey) schedule. Under an identically sized fixed-ratio schedule, deliveries of a "standard-concentration" pentobarbital solution were concurrently available from a second spout. The concentration of the standard solution remained unchanged throughout testing of the series of comparison solutions. Each of three pentobarbital concentrations (4, 1, and 0.25 mg/mL) in turn served as the standard concentration. Within each pair of concurrently available solutions, the higher drug concentration maintained more behavior than the lower concentration. Thus when monkeys were provided with concurrent access to different pentobarbital concentrations, relative reinforcing effects were directly related to drug concentration. Further, the amount of behavior maintained by a particular drug concentration was dependent on the concentration of the concurrently available drug solution. Thus, the relative effectiveness of a reinforcer in maintaining behavior is a function of both the reinforcer's magnitude and the availability of alternative reinforcers in the environment.     

EFFECTS AND SIDE EFFECTS OF DRO AS TREATMENT FOR SELF-INJURIOUS BEHAVIOR

A three-part controlled case study is presented in which severe and longstanding self-injurious behavior exhibited by a 9-year-old-boy was treated successfully with differential reinforcement of other behavior. In Phase 1, an experimental analysis demonstrated that the boy's scratching was not maintained by environmental contingencies; instead, it appeared that the self-injurious behavior was a stereotypic (automatically reinforced) response. In Phase 2, the effects of an escalating differential-reinforcement-of-other-behavior schedule mediated through token reinforcement (pennies) were evaluated in a reversal design. Results showed that differential-reinforcement-of-other-behavior eliminated self-injurious behavior very quickly and for periods of time as long as 30 min. A noteworthy side effect observed during Phase 2 was the occurrence of crying behavior following the nondelivery of reinforcement. In Phase 3, the token program was gradually extended in 30-min increments throughout the day. Additionally, results of a brief multielement manipulation showed that the effects of token reinforcement were superior to those of a more easily administered differential reinforcement of other behavior based on social reinforcement, which differed little from baseline.     

USE OF NEGATIVE REINFORCEMENT IN THE TREATMENT OF SELF-INJURIOUS BEHAVIOR

Behavioral assessment procedures were used to determine the maintaining conditions of self-injury exhibited by 2 children with severe multiple handicaps. For both children, negative reinforcement (escape from grooming activities) was determined to be the maintaining reinforcer for self-injury (hand/arm biting) within an alternating treatments design. The treatment packages involved the use of negative reinforcement (brief escape from grooming activities) contingent upon a behavior that was incompatible with self-injury (reaching and pressing a microswitch that activated a prerecorded message of “stop”). Treatment was evaluated with a reversal design for 1 child and with a multiple baseline across grooming activities for the 2nd child. The treatment led to a marked decrease in self-injury for both children. At follow-up, high rates of self-injury were reported for the 1st child, but low rates of self-injury and an increase in task-related appropriate behavior were observed for the 2nd child.     

Matching, delay-reduction, and maximizing models for choice in concurrent-chains schedules.

Models of choice in concurrent-chains schedules are derived from melioration, generalized matching, and optimization. The resulting models are compared with those based on Fantino's (1969, 1981) delay-reduction hypothesis. It is found that all models involve the delay reduction factors (T - t2L) and (T - t2R), where T is the expected time to primary reinforcement and t2L, t2R are the durations of the terminal links. In particular, in the case of equal initial links, the model derived from melioration coincides with Fantino's original model for full (reliable) reinforcement and with the model proposed by Spetch and Dunn (1987) for percentage (unreliable) reinforcement. In the general case of unequal initial links, the model derived from melioration differs from the revised model advanced by Squires and Fantino (1971) only in the factors affecting the delay-reduction terms (T - t2L) and (T - t2R). The models of choice obtained by minimizing the expected time to reinforcement depend on the type of feedback functions used. In particular, if power feedback functions are used, the optimization model coincides with that obtained from melioration.     

Suboptimal choice in a percentage-reinforcement procedure: effects of signal condition and terminal-link length.

Pigeons' choice between reliable (100%) and unreliable (50%) reinforcement was studied using a concurrent-chains procedure. Initial links were fixed-ratio 1 schedules, and terminal links were equal fixed-time schedules. The duration of the terminal links was varied across conditions. The terminal link on the reliable side always ended in food; the terminal link on the unreliable side ended with food 50% of the time and otherwise with blackout. Different stimuli present during the 50% terminal links signaled food or blackout outcomes under signaled conditions but were uncorrelated with outcomes under unsignaled conditions. In signaled conditions, most pigeons displayed a nearly exclusive preference for the 100% alternative when terminal links were short (5 or 10 s), but with terminal links of 30 s or longer, preference for the 100% alternative was sharply reduced (often to below .5). In unsignaled conditions, most pigeons showed extreme preference for the 100% alternative with either short (5 s) or longer (30 s) terminal links. Thus, pigeons' choice between reliable and unreliable reinforcement is influenced by both the signal conditions on the unreliable alternative and the duration of the terminal-link delay. With a long delay and signaled outcomes, many pigeons display a suboptimal tendency to choose the unreliable side.