Police evaluation research: an experimental and cost-benefit analysis of a helicopter patrol in a high crime area

The significance of a helicopter patrol procedure directed toward prevention of home burglaries was evaluated from experimental and cost-benefit perspectives. The helicopter patrolled one city zone from 9 a.m. to 5 p.m. for two 12-day periods. Each 12-day period was separated by a baseline period in which only normal patrol-car levels were maintained. Significantly reduced burglary levels during the intervention periods, compared to baseline periods, documented the experimental significance of the helicopter procedure. The cash costs of implementing the patrol procedure were compared to two estimates of the resulting cash benefits. This latter cost-benefit analysis was supplemented by a discussion of the intangible costs and benefits of the helicopter procedure. Taken together, these analyses documented that the marginal costs of the helicopter intervention were exceeded by all estimates of benefits.     

THE BEHAVIOR OBSERVATION INSTRUMENT: A METHOD OF DIRECT OBSERVATION FOR PROGRAM EVALUATION1

The background and development of a multicategory direct observation system, the Behavior Observation Instrument (BOI), is described. This time-sampling procedure for recording the behavior of persons is demonstrated in several treatment settings and the results applied to issues of program evaluation. Elements that have prevented direct observation from being widely adopted, such as costs, manpower, and training requirements, are systematically analyzed. A basic psychometric analysis of the instrument is used to determine optimum frequency and duration of observation intervals as well as observer agreement. The results imply that direct observation methods, once assumed by some to belong to the special province of the single-subject design, can be used to assess the effects of programs on groups of psychiatric clients in an efficient and economic manner.     

A SUPERVISORY STRATEGY TO IMPROVE WORK PERFORMANCE FOR LOWER FUNCTIONING RETARDED CLIENTS IN A SHELTERED WORKSHOP

A multiple component strategy was investigated for aiding staff responsible for supervising production of lower functioning retarded clients on contract tasks in an institution-based sheltered workshop. The strategy was assessed in a combined multi-element, multiple baseline across groups design with a reversal component. Production performance increased during the production supervisory strategy with all 16 clients, with the range of increase varying from a few percentage points to 150% of baseline production. Both the clients and staff (responsible for conducting the research) preferred working under experimental conditions rather than under baseline conditions which approximated those found in “typical” sheltered workshops.     

NATURALISTIC OBSERVATIONS OF INSTITUTIONALIZED RETARDED PERSONS: A COMPARISON OF LICENSURE DECISIONS AND BEHAVIORAL OBSERVATIONS

In the last several years, various organizations have produced strikingly similar documents by which institutions for retarded persons are judged for licensure. The purpose of the present study was to determine whether residential units that were licensed differed from residential units that were not licensed in terms of the active programming behaviors of their staff and residents. Data were collected through a time-sampling procedure that yielded about 160,000 observations on eight staff and six resident behaviors. Results showed that the licensed units were just as derelict as unlicensed units in providing habilitative programming for their retarded residents. Maladaptive responding by residents occurred at least as much as task-related behaviors: residents spent as much time self-stimulating as they did in programming; they also engaged in self-abusive behavior about as much time as they engaged in on-task responding. Results were discussed in terms of the failure of governmental regulations that are not based on observation to adequately assess habilitative programming.     

Do medical decision analyses' largest gains grow from the smallest trees?

Some decision analysts recommend reserving their models for careful, complete study of complex problems. Others believe simple problem analyses provide the greatest gains. To clarify these issues, I tested: (1) whether simple published analyses compared to complex ones, produced results as non-intuitive; and (2) whether non-intuitiveness represented analytic gain (or equivalently, intuitive loss). Very limited data also examined (3) the gain from adding model intricacy for a given problem vs. selecting more complex problems for analysis. To assess two non-intuitiveness measures, 75 subjects (33 physicians and 42) non-physicians stated their intuitive preferences in 40 (22 published and 18 unpublished) medical dilemmas. For both physicians and non-physicians, simpler models (those with lees than 30 terminal branches in the decision tree) had about one third the non-intuitiveness of more complex ones. Three tests also supported the premise that analyses outperform intuition, therefore that on average the formers' non-intuitiveness reflects less analytic gain. In addition, for different models of the same problem, tree complexity did not correlate with gain. Thus, simpler trees may not generally gain less because they inadequately describe problems. Instead, simpler analyses may represent simpler problems, with more similar intuitive and formal solutions. If so, these findings may help us avoid some costly but unnecessary simple analyses.     

Human performance on conjunctive fixed-interval fixed-ratio schedules

Eighteen young adults performed a lever-pulling task for money. Subjects were initially exposed to a fixed-interval 80-second schedule and subsequently to one of three conjunctive schedules in which the added fixed-ratio requirement was set at either 10, 80, or 120 responses. Three fixed-interval response patterns emerged: high constant rate, intermediate rate, or low rate, with most subjects displaying the last. Conjunctive performance was related to the subjects' prior fixed-interval patterns and the conjunctive ratio requirements. Low-rate subjects tended to optimize reinforcement (maximum reinforcers for minimum responses) on conjunctive schedules. Response rate was directly related to ratio requirements. Subjects' performance closely corresponded to their verbal statements of the contingencies.     

Standardized classroom management program: Social validation and replication studies in Utah and Oregon

A comprehensive validation study was conducted of the Program for Academic Survival Skills (PASS), a consultant-based, teacher-mediated program for student classroom behavior. The study addressed questions related to: (a) brief consultant training, (b) subsequent teacher training by consultants using PASS manuals, (c) contrasts between PASS experimental teachers and students and equivalent controls on measures of teacher management skills, student classroom behavior, teacher ratings of student problem behaviors, and academic achievement, (d) reported satisfaction of participants, and (e) replication of effects across two separate school sites. Results indicated that in both sites significant effects were noted in favor of the PASS experimental group for (a) teacher approval, (b) student appropriate classroom behavior, and (c) four categories of student inappropriate behavior. Program satisfaction ratings of students, teachers, and consultants were uniformly positive, and continued use of the program was reported a year later. Discussion focused upon issues of cost-effectiveness, differential site effects, and the relationship between appropriate classroom behavior and academic achievement.     

Issues in multivariate assessment of a large-scale behavioral program

Several social and research issues directly affected the development and implementation of multivariate assessment in a large community-based applied research program. Examples are drawn from experiences of the Preparation through Responsive Educational Programs Project for disruptive and skill deficient adolescents in suburban, rural, and urban junior high school settings, focusing on the assessment of academic and social skill development and long-term skill maintenance. The social context altered both project treatment and follow-up plans, requiring assessment of potentially unintended effects and decreasing consistency across sites. Future community acceptance of such programs may depend on the investigators' adaptation to diverse community pressures for program conduct and assessment and the measurement of phenomena that are not always directly observable.     

Concurrent schedules: undermatching and control by previous experimental conditions.

Five pigeons were trained on concurrent variable-interval schedules. A series of conditions in which the ratio of reinforcement rates on two keys was progressively increased and then decreased was arranged twice. The birds were then exposed to an irregular sequence of conditions. Each condition in which reinforcement was available on both keys lasted six sessions. Performance in the first, third, and sixth sessions after a condition change was analyzed. Following a condition change, preference was biased toward the preference in the last condition, but this effect largely disappeared before the sixth session of training. The birds' preferences also appeared less sensitive to reinforcement rates in early sessions after a transition. Preference in a session was a function of both the reinforcements in that session and the reinforcements obtained in as many as four or five previous sessions. The effects of reinforcements in previous sessions could be summarized by the performance in the immediately preceding session, giving a relatively simple relation between present performance and a combination of present reinforcement and prior session performance. While such hysteresis could cause undermatching when only a small number of sessions are arranged in a condition, undermatching in a stable-state performance probably arises elsewhere.     

New assessment systems for residential treatment,management, research,and evaluation: A symposium

An introduction and overview are presented to new observational assessment systems for ongoing assessment and monitoring of both staff and resident (client or patient) functioning in residential treatment programs for emotionally disturbed and mentally retarded adults.Preparation of articles and the research and development on which the articles are based was supported, in part, by Public Health Service Grants MH-15553 and MH-25464 from the National Institute of Mental Health, and by grants from the Joyce Foundation and the Illinois Department of Mental Health and Developmental Disabilities.A symposium presented at the 87th Annual Meetings of the American Psychological Association, New York City, September 1979.