Effects of food deprivation and reinforcement magnitude on conditioned suppression

In Experiment I, the responding of rats lever pressing on a variable-interval schedule for sucrose solution was partially suppressed by a variable duration conditioned stimulus followed by shock. When food deprivation was increased, response rates during and before the conditioned stimulus increased monotonically. Varying the concentration of sucrose across blocks of sessions or from session to session in a semi-random sequence had little effect on response rates either before or during the conditioned stimulus. With a fixed sequence of increasing concentrations across a five-session block, increased concentration produced much more rapid increases in response rates before than during the conditioned stimulus. In Experiment II, rats were presented with the same sequence of increasing concentrations across a five-session block. When tested at 80% body weight, response rates increased rapidly as concentration increased, but at 100%, body-weight rates increased only slightly. The effect of a change in body weight in Experiment II thus mimicked the effect of the conditioned stimulus in the latter part of Experiment I. These findings support the view that the effect of a pre-aversive conditioned stimulus is similar to that of a change in food deprivation, but unlike that of a change in reinforcement magnitude.     

Duration and rate of reinforcement as determinants of concurrent responding

The duration and frequency of food presentation were varied in concurrent variable-interval variable-interval schedules of reinforcement. In the first experiment, in which pigeons were exposed to a succession of eight different schedules, neither relative duration nor relative frequency of reinforcement had as great an effect on response distribution as they have when they are manipulated separately. These results supported those previously reported by Todorov (1973) and Schneider (1973). In a second experiment, each of seven pigeons was exposed to only one concurrent schedule in which the frequency and/or duration of reinforcement differed on the two keys. Under these conditions, each pigeon's relative rate of response closely matched the relative total access to food that each schedule provided. This result suggests that previous failures to obtain matching may be due to factors such as an insufficient length of exposure to each schedule or to the pigeons' repeated exposure to different concurrent schedules.     

BEHAVIOR ANALYSIS APPLIED TO ENVIRONMENTAL/ECOLOGICAL PROBLEMS; A REVIEW1

Recent applications of operant technology, including the manipulation of environmental conditions and response consequences, have been directed toward the improvement of man-environment relations. This document summarizes the research designs, procedures, results, and conclusions of these recent behavioral interventions for ecological rebalance. Each of the 32 studies reviewed was undertaken since 1970; all studies were relatively successful in changing the probability of an ecology-related response; all studies incorporated basic methodologies applicable for large-scale, community programs; most of the investigations were conducted in field settings (e.g., college campuses, grocery stores, mobile-trailer parks, homes, movie theaters, public campgrounds, and a football stadium). Several of the studies are as yet unpublished. Sources for receiving documentation of the unpublished research are provided in this document. About 50% of the investigations reviewed were designed to influence behaviors related to environmental litter; the others were of behavior-modification programs that substantially increased bus-ridership, decreased lawn-trampling, promoted the purchase of drinks in returnable rather than throwaway containers, initiated a recycling process, or reduced energy consumption. Essentially, the interventions were either preventive in nature (i.e., designed to discourage environment-destructive behaviors before they occur), or remedial (i.e., designed to encourage behaviors that correct an existing environmental problem). Usually, the preventive measures emphasized responses priming (or prompting), while the corrective measures applied some form of positive reinforcement. Response priming was accomplished with modelling techniques, or with written and/or verbal prompts presented either publicly or on a personal, one-to-one basis. Among the positive reinforcement procedures were field applications of token economies, lottery systems, feedback programming, and intergroup contests, as well as individual contingency contracting. Some experimental designs provided for comparisons between the behavioral effects of response priming and positive reinforcement.     

INTERACTIONS BETWEEN TEACHER GUIDANCE AND CONTINGENT ACCESS TO PLAY IN DEVELOPING PREACADEMIC SKILLS OF DEVIANT PRESCHOOL CHILDREN1

Token-mediated access to play and snacks was made contingent on completion of academic tasks in the Baseline Experiment. This contingency produced stable completion rates that were subsequently doubled, and then tripled, for four deviant children in a special preschool. A reversal design demonstrated that the contingency was functional in maintaining the children's rates of task completion. The Guidance Experiment examined the role of a social event, teacher guidance, in the acquisition of task-completion skills, in a multiple-baseline-across-tasks design (with reversals). The analysis demonstrated that teacher guidance was an important supplement to the token-mediated contingency in establishing significant increases in task completions for a second group of three deviant children in the special class. The importance of teacher guidance was related to the difficulty level of the children's tasks.     

Self-reinforcement

Self-reinforcement in operant situations generally refers to those arrangements in which the subject delivers to himself a consequence, contingent on his behavior. However, it is noted that the definition of all other types of reinforcement make its delivery contingent on the subject's behavior. What is actually at issue is the agent who defines whether or not the response required for reinforcement has been met. In self-reinforcement, the subject himself defines this. In the laboratory, this requirement is machine-defined; in school examinations, it is teacher-defined; and in many clinical self-control situations, it is also independently defined. A reinforcement contingency presupposes such independence, absent in self-reinforcement. Implications for research and practice are discussed and alternative formulations are offered.     

The effects of instructions, incentive, and feedback on a community problem: dormitory noise

A reinforcement system utilizing instructions, modelling, feedback, and group reinforcement was employed in an attempt to reduce disruptive noise on three university residence halls. A fourth hall received the same treatment program without the reinforcement component. Noise scores were determined by recording the number of discrete noise occurrences over a criterion decibel level. On all four residential floors, noise scores during treatment conditions were lower than initial and final baseline levels. Additionally, periods of noise reduction corresponded to the changing criterion multiple-baseline and reversal designs utilized. Pre- and posttreatment questionnaire responses from the three reinforcement floors paralleled changes in objective noise data. At posttreatment, residents reported less noise disturbance of study and sleep and more control over the noise situation and floor problems in general. These results indicated that a comprehensive behavior-modification treatment package was effective in reducing disruptive noise in university residence halls. Difficulties in data collection and anomalies in the data are discussed. Future directions for field-based behavior-modification research are outlined.     

MODIFICATION OF THE EXCESSIVE INAPPROPRIATE CLASSROOM BEHAVIOR OF TWO ELEMENTARY SCHOOL STUDENTS USING HOME-BASED CONSEQUENCES AND DAILY REPORT-CARD PROCEDURES1

Two experiments investigated home-based reinforcement contingencies to control excessive behavior in normal classrooms. Subjects were, respectively, a 12-yr-old fifth-grade boy and a 9-yr-old fourth-grade boy, each in a separate classroom and with a different teacher. Following baseline observations in which observers recorded several categories of student behavior and teacher-student interaction, separate conferences were held including parents of the two children, the principal, teachers, and experimenters. A daily report-card procedure was agreed on, stipulating a one-day suspension from school following three successive “undesirable” daily report cards as well as the supervision of home-based privileges and other reinforcers usually contingent on satisfactory daily reports. Measurements of daily rates of teacher attention indicated no important change in this variable throughout the various experimental conditions. The daily report procedure significantly reduced disruptive classroom behavior. In a second experiment, a teacher-operated timer cued her own time-sample observations. Reliability measures revealed that the teacher could accurately measure the child's behavior while she was teaching the class. The procedure was ultimately successfully expanded to the teacher's total contact hours each day.     

THE EFFECTIVENESS OF REINFORCEMENT,RESPONSE COST,AND MIXED PROGRAMS ON CLASSROOM BEHAVIORS1

Six elementary school children served as subjects in an experiment comparing the relative effectiveness of (1) token reinforcement, in which children received tokens for attending and for correct arithmetic performance; (2) response cost, in which children received “free” tokens at the start of a period but lost them for inattention and for arithmetic performance below a specified level; and (3) a combination of both token reinforcement and response cost. During training, the six subjects received all three procedures in counterbalanced sequence. The effects of the three procedures were assessed by a within-subject comparison divided into three phases: (i) baseline, (ii) training, (iii) withdrawal of tokens. Introduction of the three token procedures markedly increased the two dependent measures. However, there were no differences across the procedures in the amount of change produced in either attending behavior or arithmetic performance. During baseline, the subjects averaged 29% attending behavior and 6.4 correct problems. These levels increased to 85% for attending behavior and 11.4 correct problems for arithmetic performance during training. Removal of all token procedures significantly decreased attending behavior (to an average of 65%), but produced a nonsignificant reduction in arithmetic performance (to an average of 7.6 correct problems). There was evidence that this lack of differential effects of the three token procedures was not due to an inability to discriminate among them. Furthermore, the subjects were evenly divided in their preference for the three procedures.     

A comparison of the key-peck and treadle-press operants in the pigeon: differential-reinforcement-of-low-rate schedule of reinforcement

Key pecking and treadle pressing in pigeons were compared under concurrent (key-treadle) and single-operant differential-reinforcement-of-low-rate schedules of food reinforcement ranging from 5 to 60 sec (concurrent procedure) or 5 to 120 sec (single-operant procedure). Under both procedures, the two operants followed the same general law: decreasing response rate and reinforcement rate and increasing number of responses per reinforcement as a function of increasing schedule interval. High correlations were found between key pecking and treadle pressing for the measures of response rate, reinforcement rate, and responses per reinforcement. Regression equations allowed the prediction of treadle pressing from key pecking. More bursting occurred in responding to the key, and key pecking showed a more precise temporal discrimination than treadle pressing. A test for sequential dependencies between key and treadle responses showed significant dependencies not only under the concurrent procedure but also in data created artificially by merging key and treadle sequences from different pigeons under the concurrent procedure and from the same pigeon under the single-operant procedure. It seems likely that the sequential dependencies found were due to the independent action of the schedule on each operant and that behavioral dependencies did not occur with the concurrent training procedure. The key-peck operant does not appear to have any special qualities that preclude its use in discovering general laws of behavior, at least under the differential-reinforcement-of-low-rate schedule. The usefulness of the key peck in other situations requires direct experimental study.     

Force and rate relations in responding during variable-interval reinforcement

Four rats responded on one-minute variable-interval schedules with several variations in peak-force of response required for food reinforcement. Measures of peak force and rate were taken for the responses, which were the downward exertions of force against a static force-transducing operandum. The analysis distinguished responses, a generic class of measured behavior, from criterion responses, an operationally specified subclass required for reinforcement. Absolute rate of response showed no systematic change, but the rate of responses meeting a newly required criterion of peak-force invariably increased through changes in the absolute rate of response, the relative-frequency distributions of peak force, or some combination of both. The relative frequency of responses meeting an elevated force criterion during variable-interval reinforcement exceeded that maintained with the same criterion with continuous reinforcement. The requirement of more effortful responding for reinforcement does not necessarily reduce response rate. Conformity of the behavior to the requirement for reinforcement is the salient effect.