Police evaluation research: an experimental and cost-benefit analysis of a helicopter patrol in a high crime area

The significance of a helicopter patrol procedure directed toward prevention of home burglaries was evaluated from experimental and cost-benefit perspectives. The helicopter patrolled one city zone from 9 a.m. to 5 p.m. for two 12-day periods. Each 12-day period was separated by a baseline period in which only normal patrol-car levels were maintained. Significantly reduced burglary levels during the intervention periods, compared to baseline periods, documented the experimental significance of the helicopter procedure. The cash costs of implementing the patrol procedure were compared to two estimates of the resulting cash benefits. This latter cost-benefit analysis was supplemented by a discussion of the intangible costs and benefits of the helicopter procedure. Taken together, these analyses documented that the marginal costs of the helicopter intervention were exceeded by all estimates of benefits.     

THE BEHAVIOR OBSERVATION INSTRUMENT: A METHOD OF DIRECT OBSERVATION FOR PROGRAM EVALUATION1

The background and development of a multicategory direct observation system, the Behavior Observation Instrument (BOI), is described. This time-sampling procedure for recording the behavior of persons is demonstrated in several treatment settings and the results applied to issues of program evaluation. Elements that have prevented direct observation from being widely adopted, such as costs, manpower, and training requirements, are systematically analyzed. A basic psychometric analysis of the instrument is used to determine optimum frequency and duration of observation intervals as well as observer agreement. The results imply that direct observation methods, once assumed by some to belong to the special province of the single-subject design, can be used to assess the effects of programs on groups of psychiatric clients in an efficient and economic manner.     

NATURALISTIC OBSERVATIONS OF INSTITUTIONALIZED RETARDED PERSONS: A COMPARISON OF LICENSURE DECISIONS AND BEHAVIORAL OBSERVATIONS

In the last several years, various organizations have produced strikingly similar documents by which institutions for retarded persons are judged for licensure. The purpose of the present study was to determine whether residential units that were licensed differed from residential units that were not licensed in terms of the active programming behaviors of their staff and residents. Data were collected through a time-sampling procedure that yielded about 160,000 observations on eight staff and six resident behaviors. Results showed that the licensed units were just as derelict as unlicensed units in providing habilitative programming for their retarded residents. Maladaptive responding by residents occurred at least as much as task-related behaviors: residents spent as much time self-stimulating as they did in programming; they also engaged in self-abusive behavior about as much time as they engaged in on-task responding. Results were discussed in terms of the failure of governmental regulations that are not based on observation to adequately assess habilitative programming.     

Do medical decision analyses' largest gains grow from the smallest trees?

Some decision analysts recommend reserving their models for careful, complete study of complex problems. Others believe simple problem analyses provide the greatest gains. To clarify these issues, I tested: (1) whether simple published analyses compared to complex ones, produced results as non-intuitive; and (2) whether non-intuitiveness represented analytic gain (or equivalently, intuitive loss). Very limited data also examined (3) the gain from adding model intricacy for a given problem vs. selecting more complex problems for analysis. To assess two non-intuitiveness measures, 75 subjects (33 physicians and 42) non-physicians stated their intuitive preferences in 40 (22 published and 18 unpublished) medical dilemmas. For both physicians and non-physicians, simpler models (those with lees than 30 terminal branches in the decision tree) had about one third the non-intuitiveness of more complex ones. Three tests also supported the premise that analyses outperform intuition, therefore that on average the formers' non-intuitiveness reflects less analytic gain. In addition, for different models of the same problem, tree complexity did not correlate with gain. Thus, simpler trees may not generally gain less because they inadequately describe problems. Instead, simpler analyses may represent simpler problems, with more similar intuitive and formal solutions. If so, these findings may help us avoid some costly but unnecessary simple analyses.     

Standardized classroom management program: Social validation and replication studies in Utah and Oregon

A comprehensive validation study was conducted of the Program for Academic Survival Skills (PASS), a consultant-based, teacher-mediated program for student classroom behavior. The study addressed questions related to: (a) brief consultant training, (b) subsequent teacher training by consultants using PASS manuals, (c) contrasts between PASS experimental teachers and students and equivalent controls on measures of teacher management skills, student classroom behavior, teacher ratings of student problem behaviors, and academic achievement, (d) reported satisfaction of participants, and (e) replication of effects across two separate school sites. Results indicated that in both sites significant effects were noted in favor of the PASS experimental group for (a) teacher approval, (b) student appropriate classroom behavior, and (c) four categories of student inappropriate behavior. Program satisfaction ratings of students, teachers, and consultants were uniformly positive, and continued use of the program was reported a year later. Discussion focused upon issues of cost-effectiveness, differential site effects, and the relationship between appropriate classroom behavior and academic achievement.     

Issues in multivariate assessment of a large-scale behavioral program

Several social and research issues directly affected the development and implementation of multivariate assessment in a large community-based applied research program. Examples are drawn from experiences of the Preparation through Responsive Educational Programs Project for disruptive and skill deficient adolescents in suburban, rural, and urban junior high school settings, focusing on the assessment of academic and social skill development and long-term skill maintenance. The social context altered both project treatment and follow-up plans, requiring assessment of potentially unintended effects and decreasing consistency across sites. Future community acceptance of such programs may depend on the investigators' adaptation to diverse community pressures for program conduct and assessment and the measurement of phenomena that are not always directly observable.     

New assessment systems for residential treatment,management, research,and evaluation: A symposium

An introduction and overview are presented to new observational assessment systems for ongoing assessment and monitoring of both staff and resident (client or patient) functioning in residential treatment programs for emotionally disturbed and mentally retarded adults.Preparation of articles and the research and development on which the articles are based was supported, in part, by Public Health Service Grants MH-15553 and MH-25464 from the National Institute of Mental Health, and by grants from the Joyce Foundation and the Illinois Department of Mental Health and Developmental Disabilities.A symposium presented at the 87th Annual Meetings of the American Psychological Association, New York City, September 1979.     

Systems use to objectify program evaluation,clinical, and management decisions

The utility of the observational assessment systems at different levels — from local clinical to systemwide management — is outlined. An overview is provided of TSBC information applied to individualized problem identification and programming/monitoring, discharge and competency determinations, and both absolute and comparative program evaluation. The utility of SRIC information for prgoramming/monitoring and for staff training and evaluation is outlined in addition to the applied uses of the information of the assessment systems in combination. Once implemented, the continuous data from the systems allow for empirically based self-corrective improvements in the quality of mental health services while automatically providing a basis for legal documentation and accurate cost/effectiveness comparisons of mental health programs.Preparation of this article and the research and development on which the article is based were supported, in part, by Public Health Service Grants MH-15553 and MH-25464 from the National Institute of Mental Health, and by grants from The Joyce Foundation and the Illinois Department of Mental Health and Developmental Disabilities.Presented at the 87th Annual Meetings of the American Psychological Association, New York City, September 1979, as part of a symposium on New assessment systems for residential treatment, management, research, and evaluation.     

COMPARING TREATMENT TACTICS WITH A HYPERACTIVE PRESCHOOL CHILD: STIMULANT MEDICATION AND PROGRAMMED TEACHER INTERVENTION1

Two treatment tactics, food and praise contingent on appropriate play and varying doses of methylphenidate (Ritalin), were evaluated for their effects on a preschool child's activity changes. In addition, other social, verbal, and academic behaviors were monitored to examine possible side effects of the two treatment tactics. Fewer free-play activity changes occurred during contingent reinforcement phases while medication had variable effects: increasing attention to tasks but, at higher doses, decreasing intelligibility of speech and responsiveness to mands. The study outlines a replicable model for comparing medication with alternative behavioral strategies to control hyperactivity and enhance skill development.     

青少年结果预期与评价的ERP研究

大脑不断地对环境事件产生预期并将这些预期与实际结果进行比较, 通过对反馈刺激的结果评价以优化后续行为。采用抽奖式赌博任务范式, 操纵得奖的确定性程度, 利用事件相关电位技术(ERP), 研究青少年结果预期与评价的认知和神经电生理过程, 以成人作为对照组进行比较分析。研究结果表明：(1)在反映自动、快速结果评价的FRN上, 无论在高确定性还是在低确定性条件下, 青少年与成人均未表现出显著性差异; (2)组别与确定性程度在P300波幅上表现交互作用显著, 简单效应分析表明, 在高确定性条件下, 青少年组输、赢的P300波幅表现出差异; 而成人组输、赢的P300波幅无显著性差异。青少年对反馈刺激自动的快速结果评价能力已接近成人水平, 而对反馈刺激功能意义评价的控制加工能力还未发展成熟。