Publish Yet Perish: On the Pitfalls of Philosophy of Education in an Age of Impact Factors

In many countries publications in Web of Knowledge journals are dominant in the evaluation of educational research. For various purposes comparisons are made between the output of philosophers of education in these journals and the publications of their colleagues in educational research generally, sometimes also including psychologists and/or social scientists. Taking its starting-point from Hayden’s article in this journal (Stud Philos Educ 31:1–27, 2012), this paper discusses the situation of educational research in three countries: The Netherlands, South Africa and Norway. In this paper an alternative for comparing research output is offered by invoking comparisons with colleagues at the international level from within the same sub-discipline. It is argued that if one would do so a different picture would emerge, even if one were to limit oneself to particular kinds of publications. The case is then made that if comparisons are regarded as a necessary part of the evaluation of an individual scholar (for appointment, promotion, tenure, and/or funding application purposes), it would be more fair to use a proxy system which is sub-discipline specific, or minimally contains some kind of correction factor in relation to the over-all quality assessment device. Debates about the relevance or irrelevance of philosophy of education in the context of educational sciences are now obscured, even poisoned by focusing almost exclusively on a particular kind of publication output. As the ‘reward’ system that is developed accordingly is possibly the most important driver of educational research, it puts the sub-discipline unduly under pressure to the extent that it possibly cannot survive.     

Evaluating Ethics Education Programs: A Multilevel Approach

Although education in the responsible conduct of research is considered necessary, evidence bearing on the effectiveness of these programs in improving research ethics has indicated that, although some programs are successful, many fail. Accordingly, there is a need for systematic evaluation of ethics education programs. In the present effort, we examine procedures for evaluation of ethics education programs from a multilevel perspective: examining both within-program evaluation and cross-program evaluation. With regard to within-program evaluation, we note requisite designs and measures for conducting systematic program evaluation have been developed and multiple measures should be applied in program evaluation. With regard to cross-program evaluation, we argue that a meta-analytic framework should be employed where analyses are used to identify best practices in ethics education. The implications of this multilevel approach for improving responsible conduct of research educational programs are discussed.     

Yes,but how?: Development and evaluation of careers education in higher education by careers advisers

Contrasting approaches to the evaluation of careers education activities are outlined, one based on the organisational needs of careers services (an 'accountability' model), the other based on individual needs of careers advisers (a 'developmental' model). The case is considered for adopting educational research methods developed from the ethnographic research tradition, such as action research, to help careers advisers meet the challenges facing them in the development, delivery and evaluation of careers education in higher education. Practical experience is cited, together with some positive outcomes that have arisen from undertaking fieldwork research. The difficulties and dilemmas in carrying out such research are presented.     

Educational software evaluation research: Balancing internal,external, and ecological validity

The difficulties inherent in the evaluation of educational software are described in terms of the tradeoffs between internal, external, and ecological validity. Larger issues in evaluation research design and computer-based instruction are highlighted by primary and metaanalytic studies designed to reveal the effects of computer simulations in psychology classrooms and laboratories. The effectiveness of classroom and laboratory computer activities depends on how the inclusion of software, as well as the evaluation process itself, changes the entire instructional process.     

Developing a Framework for Assessing Responsible Conduct of Research Education Programs

Education in the responsible conduct of research (RCR) in the United States has evolved over the past decade from targeting trainees to including educational efforts aimed at faculty and staff. In addition RCR education has become more focused as federal agencies have moved to recommend specific content and to mandate education in certain areas. RCR education has therefore become a research-compliance issue necessitating the development of policies and the commitment of resources to develop or expand systems for educating faculty and staff and for assuring compliance. These changes implied the need to develop a program evaluation model that could be applied to institutional RCR education programs, which were expected to differ from traditional academic credit-bearing courses targeting trainees. Information gleaned from the examination of corporate compliance models was analyzed in order to create a program evaluation module that could be used to document and assess educational programs focused on teaching RCR. A programmed series of questions for each of the nine RCR content areas identified by the United States Office of Research Integrity was created based on a performance-monitoring evaluation model. The questions focus on educational goals, resources provided to support the educational efforts, educational content, content delivery, educational outcomes, compliance requirements and feedback. Answers collected in response to the questions could be used to both document and continually improve the quality of RCR educational programs through on-going formative assessment and feedback.     

Evaluating programs in applied settings through behavioral consultation

A behavioral consultation school psychology service model is presented which provides a vehicle for services and communication of process and outcome measures in program evaluation research. Within the context of the problem-solving perspective of applied behavior analysis, the consultation model (a) promotes process and outcome evaluation across a wide variety of settings, situations, and time; (b) leads to use of an applied research technology with wide applicability in educational settings; and (c) provides a communication technology for the program evaluation process through a four-stage problem-solving strategy. It is argued that the professional behavioral school psychologist can provide technical expertise to function as a system change agent within this evaluation model.     

The measurement of self-esteem for program evaluation

The purpose of this paper is to examine the area of self-esteem in the professional literature, its relationship to educational programs, its measurement problems, and one approach to program evaluation in terms of students' self-esteem. Self-esteem has been an important topic in the educational literature in recent years. There have been many important contributions by investigators on the relationship between self-esteem and educational achievement. Until recently, the results of self-esteem investigations have yielded a somewhat negative appraisal from reviewers, but there is optimism for the future possibilities of assessing this elusive construct. The investigator focusing upon program evaluation has advantages over his predecessors. He can utilize different measurement strategies. The strengths and criticisms of Q methodology are discussed. The L-L Q-Sort is presented as one approach to the evaluation of self-esteem in educational program evaluation.     

Psychometric and related deficits in preventive alcohol intervention programming.

The 1991 study by Collins and Cellucci ignores some important research principles needed for sound educational inquiry. Psychometric properties of evaluation instruments cannot be omitted from even field tests of small scale. Selected other omissions need review since other researchers may replicate such errors.     

Integrating consultation and program evaluation in school psychology

Consultation approaches to providing psychological services are widely used by school psychologists. Recently, the need for school psychologists to be proficient in educational program evaluation has been recognized. The present paper discusses how school psychologists can use their existing consultation skills as an approach to program evaluation. The integration of consultation skills with evaluation results in an approach to program evaluation that is particularly useful where program goals and objectives are broad and nonspecific (as in many educational innovations). Also, the consultation approach to evaluation is easier for school psychologists to blend with their other roles in schools than the assessment-oriented evaluator role of some evaluation models. The consultation approach to evaluation is illustrated using a federally sponsored training program for school teachers and administrators.     

A method for evaluating the effectiveness of educational software

A method for executing a detailed evaluation of educational software is described. Several issues are discussed, including the use of an experimental setting versus a field study, and the design of assessment instruments suited to evaluation of educational software. The instruments include a test of remedial skills, a 103-item test of conceptual understanding, and a system for recording students’ use of the software. The method was used to evaluate ConStatS, a program for teaching conceptual understanding of probability and statistics. Preliminary results of the evaluation are presented.     

Why “Gender” disappeared from the gender gap: (re-)introducing gender identity theory to educational gender gap research

Educational gender gap research tries to explain the differential achievement of boys and girls at secondary school, which manifests in many western countries. Several explanatory frameworks are used for this purpose, such as masculinities theory. In this review article, the history of educational gender gap research in Anglo-Saxon literature and problems with the contemporary approach are discussed. It is argued that gender identity theory could prove valuable both in furthering educational gender gap research and mitigating several problems with masculinities theory. To this end, an overview of the history and recent developments in gender identity theory is given. The scarce research combining educational gender gap research with gender identity theory is reviewed. Possible contributions, assets and research questions from gender identity theory to educational gender gap research are discussed.     

Imputation methods for missing data in educational diagnostic evaluation

In the diagnostic evaluation of educational systems, self-reports are commonly used to collect data, both cognitive and orectic. For various reasons, in these self-reports, some of the students' data are frequently missing. The main goal of this research is to compare the performance of different imputation methods for missing data in the context of the evaluation of educational systems. On an empirical database of 5,000 subjects, 72 conditions were simulated: three levels of missing data, three types of loss mechanisms, and eight methods of imputation. The levels of missing data were 5%, 10%, and 20%. The loss mechanisms were set at: Missing completely at random, moderately conditioned, and strongly conditioned. The eight imputation methods used were: listwise deletion, replacement by the mean of the scale, by the item mean, the subject mean, the corrected subject mean, multiple regression, and Expectation-Maximization (EM) algorithm, with and without auxiliary variables. The results indicate that the recovery of the data is more accurate when using an appropriate combination of different methods of recovering lost data. When a case is incomplete, the mean of the subject works very well, whereas for completely lost data, multiple imputation with the EM algorithm is recommended. The use of this combination is especially recommended when data loss is greater and its loss mechanism is more conditioned. Lastly, the results are discussed, and some future lines of research are analyzed.     

TRANSFERENCE OF PSYCHOLOGICAL KNOWLEDGE AND ITS IMPACT ON MEXICO

The impact of the transfer of the psychological knowledge from the developed countries to Mexico, is briefly described. It is clear that scientific psychological methodology and contents were introduced to Mexico at the end of the 19th Century. The impetus to the National Educational System was primarily derived from psychometric methods and secondarily from modern conceptions of education. The professional psychological practice in Mexico today is practically indistinguishable from its exercise in the developed nations as far as client services are concerned. On the other hand, there is relatively scarce and often inept use of professional or applied research techniques to the social problems of groups or to the evaluation of programs. The impact on pure and applied research, none the less, has been extensive and a relatively large number of people are doing research in several areas of psychology, particularly cross-cultural, neuro-psychological, the experimental analysis of behavior, action and interdisciplinary research in social and educational psychology. Priorities are: (1) Systematic teaching at the graduate level of the statistical and computational methodology of psychology in the context of research design and evaluation; (2) The operationalization or transferring to every day language of the concepts and techniques of psychology for use of the general public; (3) The better staffing of many, particularly the private schools of professional psychology.     

Genetic Counseling Milestones: A Framework for Student Competency Evaluation

Graduate medical education has recently increased focus on the development of medical specialty competency milestones to provide a targeted tool for medical resident evaluation. Milestones provide developmental assessment of the attainment of competencies over the course of an educational program. An educational framework is described to explore the development of Genetic Counseling Milestones for the evaluation of the development of genetic counseling competencies by genetic counseling students. The development of Genetic Counseling Milestones may provide a valuable tool to assess genetic counseling students across all program activities. Historical educational context, current practices, and potential benefits and challenges in the development of Genetic Counseling Milestones are discussed.     

教育现实情境取向的教育心理学研究——德国近十年教育心理学发展的基本走向

摘 要：迄今国内对德国教育心理学的发展状况了解、评介甚少。在全球化的今天,将目光聚焦于曾对心理学,其中包括教育心理学做出过巨大贡献,至今仍在国际心理学界占一席之地的德国十分必要。文章以三种德文教育心理学权威学术期刊近十年发表的论文为资料源进行分析,概括出德国教育心理学的新近发展特点是：以教育现实情境为基本研究取向,以学习者心理研究为中心,以量化研究为主并注重多方法结合,凸现了教育心理学对教育实践的指导价值。德国教育心理学发展的基本走向为：重视校外环境对学习者的影响,重视教与学双主体的相关能力及面临的问题的解决,重视以多媒体网络技术为基础的新媒体的作用、重视整合研究及国际交流等。     

Effects of expectations about evaluation and peer recommendations on students' ratings

Previous research on consumer satisfaction suggests that the anticipation of providing a later evaluation leads to more negative appraisals. Within the context of higher education, the current experiment focused on the evaluation of a presentation and its presenter. College students (35 men, 59 women) were randomly assigned to six conditions regarding evaluative expectations and peer recommendations. Students watched a brief video of a lecture on an educational topic and then evaluated the speaker and presentation. Anticipation of providing evaluations did not influence the subsequent evaluations; however, peers' positive recommendations led to more positive evaluations whereas negative recommendations led to more negative evaluations.     

The school psychologist as program evaluator

School psychologists are being required to evaluate educational programs. This paper discusses the role and responsibilities of a program evaluator, the programs of measurement, and the staff fear of evaluation. A model for program evaluation is then described with an illustrative example.     

Depending on My Mood: Mood-Driven Influences on Text Comprehension

Reading comprehension is a critical component of success in educational settings. To date, research on text processing in educational and cognitive psychological domains has focused predominantly on cognitive influences on comprehension, and in particular, those influences that might be derived from particular tasks or strategies. However, there is growing interest in documenting the influences of emotional factors on the processes and products of text comprehension, because these factors are less likely to be associated with explicit reading strategies. The present study examines this issue by evaluating the degree to which mood can influence readers' processing of text. Participants in control, happy-induced, or sad-induced groups thought aloud while reading expository texts. Happy, sad, and neutral moods influenced the degree to which readers engaged in particular types of coherence-building processes in the service of comprehension. Although reading strategies clearly influence processing, understudied factors that are less explicitly goal-driven, such as mood, can similarly impact comprehension activity. These findings have important implications for the role of mood on reading instruction and evaluation.     

The NCATE Process and behaviorally-based special education

The National Council for Accreditation of Teacher Education (NCATE) has long sought to identify effective programs for teacher preparation in this country. Recently, the Council has revised its standards to be more rigorous and demanding. This revision presents new and challenging standards for the accreditation of programs preparing educators. The most problematic but most important of these new standards is the requirement of a well-articulated knowledge base supporting a program's content and processes. Development of the knowledge base statement involves the articulation of the program's philosophy, theme, model, goals, objectives, primary research base, wisdom of practice, and evaluation procedures. A behavioral model serves well in meeting these requirements, particularly since behavioral applications in education are well researched and the approach is compatible with the emphasis on specific goals and objectives and evaluation of effectiveness. Effective educational methods are available and are mostly behavioral. The articulation of the NCATE knowledge base encourages education faculty, traditionally nonbehavioral, to examine the effectiveness of their programs and to demonstrate research and professional support for content and instructional methods. A behavioral knowledge base statement appropriate for NCATE is demonstrated through examples drawn from Gonzaga University's knowledge base for special education.     

Language and reading development in profoundly hearing-impaired children—Intelligence,learning, and communication factors: A review

This review defines educational underachievement and presents information confirming the low reading and even lower language development of profoundly hearing-impaired children. It then discusses the role of intelligence, learning ability, and communication factors in this educational underachievement. Teacher and pupil classroom communication are identified as major factors in the poor educational performance of hearing-impaired children. Some research needs are discussed.