Sorting out categories: Incremental learning of category structure

Two experiments examine how inferences might promote unsupervised and incremental category learning. Many categories have members related through overall similarity (e.g., a family resemblance structure) rather than by a defining feature. However, when people are asked to sort category members in a category construction task, they often do so by partitioning on a single feature. Starting from an earlier result showing that pairwise inferences increase family resemblance sorting (Lassaline & Murphy, 1996), we examine how these inferences lead to learning the family resemblance structure. Results show that the category structure is learned incrementally. The pairwise inferences influence participants’ weightings of feature pairs that were specifically asked about, which in turn affects their sorting. The sorting then allows further learning of the categorical structure. Thus, the inferences do not directly lead learners to the family resemblance structure, but they do provide a foundation to build on as the participants make additional judgments.     

Effects of a family literacy program on low-literate children and their parents: findings from an evaluation of the Even Start family literacy program

A randomized experiment was conducted to test the effectiveness of Even Start, a federally supported family literacy program providing early childhood education, adult education, parenting education, and joint parent-child literacy activities to children and parents from low-literate families. The evaluation of 18 Even Start projects followed 463 families for 2 years and found no statistically significant or educationally important impacts on Even Start families when they were compared with control families on child literacy outcomes, parent literacy outcomes, or parent-child interactions. The study concludes that Even Start projects were able to properly implement family literacy programs, and the observed lack of effectiveness is attributed to a combination of 2 factors: (a) a lack of full participation on the part of families and (b) instructional services that may be ineffective because of the curriculum content or the instructional approach.     

Systems use to objectify program evaluation,clinical, and management decisions

The utility of the observational assessment systems at different levels — from local clinical to systemwide management — is outlined. An overview is provided of TSBC information applied to individualized problem identification and programming/monitoring, discharge and competency determinations, and both absolute and comparative program evaluation. The utility of SRIC information for prgoramming/monitoring and for staff training and evaluation is outlined in addition to the applied uses of the information of the assessment systems in combination. Once implemented, the continuous data from the systems allow for empirically based self-corrective improvements in the quality of mental health services while automatically providing a basis for legal documentation and accurate cost/effectiveness comparisons of mental health programs.Preparation of this article and the research and development on which the article is based were supported, in part, by Public Health Service Grants MH-15553 and MH-25464 from the National Institute of Mental Health, and by grants from The Joyce Foundation and the Illinois Department of Mental Health and Developmental Disabilities.Presented at the 87th Annual Meetings of the American Psychological Association, New York City, September 1979, as part of a symposium on New assessment systems for residential treatment, management, research, and evaluation.     

Model-guided implementation of an instrument for program evaluation: The use of social policy and innovation models

A research program in the Netherlands is aimed at the implementation of an instrument for program evaluation in organizations for intramural treatment of juveniles with psychosocial and/or behavioral problems. The basis and guide for the implementation is a sequence of three complementary models, each model being more specific than its predecessor. The results of the research program in nine organizations suggest that the choice of an adequate guiding model depends on the policy level at which the organization is operating, the number of persons involved in the implementation, and the culture of decision-making in the organization. K. Mesman Schultz is senior investigator at the Leyden Institute for Social Policy Research (LISPOR) and director of the Research Centre for Youth-at-Risk (RCY) at the State University of Leyden, Rijnsburgerweg 100, 233 AE Leiden The Netherlands. His research mainly refers to diagnosis, decision-making and social policy in the field of youth care. W.I. Poot is investigator at LISPOR and RCY. She is in charge of the execution of utilization and implementation research projects in the field of youth care. P.H.M. van den Bogaart is senior investigator at LISPOR and RCY. He has wide experience in educational research and youth care research.     

Adaptation to difficult designs: Facilitating use of new technology

The interface between technology and people has long been the focus of human factors engineering. The past decade has been a growth period for cognitive psychologists and computer scientists to collaborate on research and design for human-computer interaction. Psychologists in general and organizational psychologists in particular can also contribute to this work with models that capture the dynamics of technology implementation and the impact of technology on people, their work and working relationships. Strategies to support and adapt technology can affect users' evaluation of new technology. Facilitation may take the form of job aids, training, access to technical support staff, or the design of a comprehensive service, of which new technology is only one component.The work described in this article was conducted while the author was employed at AT&T Bell Laboratories.Portions of this article were presented at the 1991 Annual Convention of the American Psychological Association in San Francisco, and at a 1992 meeting of the New York Metropolitan Human Factors Society. The author wishes to acknowledge Pamela Kidder, Karen Patten and Larry Penwell for their helpful comments on an earlier draft of this article.     

A system of program evaluation and the use of feedback as a means of improving service delivery

Agencies providing services to individuals with developmental disabilities must demonstrate quality programing as evidenced through a high level of staff compliance to organizational, licensing, and accreditation standards. In addition, economic and practical considerations impose the need for cost-effective procedures for evaluating and improving staff performance. This study utilized a combination of checklists, as an evaluative tool to measure staff performance, and private feedback to improve staff performance. A multiple baseline design was used to determine the effects of providing staff with (a) orientation training, (b) task-analyzed checklists of job skills, (c) private feedback from the agency trainer, and (d) private feedback from their immediate supervisor. Results indicate that training alone does not ensure competency; checklists alone do not ensure competency; private feedback from trainers improves competency; and private feedback from direct supervisors improves competency even further.     

Pairs of Latin squares that produce digram-balanced Greco-Latin designs: A BASIC program

It is possible to create pairs of Latin squares that are digram balanced (in other words, that counterbalance immediate sequential effects) in a Greco-Latin design. A behavioral researcher can use these squares to design an efficient, well-balanced study without relying on chance. Researchers can apply these squares to any experiment in which they must pair conditions with different stimuli in a within-subject design. For experiments with a large number of conditions, however, the procedure is very time-consuming if done manually. A BASIC program is described that generates the correct pairs of squares for experiments with as many as 80 conditions.     

The precision fluency shaping program: Replication and evaluation

The purpose of this article is to present the results of a two-year project to evaluate the Precision Fluency Shaping Program (Webster, 1980) in a community speech and hearing center. Fifty stutterers participated in therapy. Results indicated that Precision Fluency Shaping was an effective therapy for the treatment of stuttering. In addition, stutterer's perception of their speech changed from pre to post therapy. Follow-up data are presented on 28 clients. Advantages of conducting Precision Fluency Shaping, meeting accountability standards, and procedures for collecting follow-up data are discussed.     

The clinical approach: Triangulated program evaluation and adjustment

In the discussion about “enlightenment” or “utilization” in program evaluation, it is increasingly clear that the discussants implicitly refer to different professional contexts. Weiss, in Alkin (1990), using the “scientist” approach appears to reflect upon the academic context of the traditional university, where, beyond the land grant institutions, “enlightenment” is the honored objective. In contrast, Patton (Alkin, 1990) speaks from the clinical perspective of the organization consultant, with “utilization” the essential element in the evaluator-client relationship. Yet, those contextual differences notwithstanding, each party defends its case on the implicit assumption ofone methodological procedure of program evaluation—equally shared by both. Correcting this assumption, this article articulates major principles and methods of the “clinical” approach in program evaluation. The method has been tested in the field in western Europe and the United States. Its characteristic difference with the academic tradition is that in clinical evaluation, improving the program is part of the method. Mark van de Vall is professor of Sociology, Erasmus University Rotterdam and adjunct professor at SUNY / Buffalo.     

Reporting a program evaluation: Needs,program plan,intervention, and decisions

The approach to intervention programs varies depending on the methodological perspective adopted. This means that health professionals lack clear guidelines regarding how best to proceed, and it hinders the accumulation of knowledge. The aim of this paper is to set out the essential and common aspects that should be included in any program evaluation report, thereby providing a useful guide for the professional regardless of the procedural approach used. Furthermore, the paper seeks to integrate the different methodologies and illustrate their complementarity, this being a key aspect in terms of real intervention contexts, which are constantly changing. The aspects to be included are presented in relation to the main stages of the evaluation process: needs, objectives and design (prior to the intervention), implementation (during the intervention), and outcomes (after the intervention). For each of these stages the paper describes the elements on which decisions should be based, highlighting the role of empirical evidence gathered through the application of instruments to defined samples and according to a given procedure.     

Applications of the self-awareness model of alcohol consumption: predicting patterns of use and abuse

We conducted two studies to test the applicability of a recently proposed self-awareness model of alcohol consumption to patterns of alcohol use outside of the laboratory. In both studies, we predicted that alcohol use would be a joint function of private self-consciousness and personal success or failure. High self-conscious individuals were predicted to drink following personal failure and avoid drinking following personal success in an attempt to control their sensitivity to the self-relevant implications of such events. Consumption by low self-conscious individuals was predicted to be relatively independent of self-relevant events. These predictions were supported in a longitudinal study of relapse following alcoholic detoxification. They were then replicated in a study of adolescent alcohol use and shown to be relatively independent of other significant environmental and behavioral predictors of consumption. Results are discussed in terms of their implications for theories of self-awareness and alcohol use.