Referees, editors, and publication practices: Improving the reliability and usefulness of the peer review system

The documented low levels of reliability of the peer review process present a serious challenge to editors who must often base their publication decisions on conflicting referee recommendations. The purpose of this article is to discuss this process and examine ways to produce a more reliable and useful peer review system. The author is a Senior Research Scientist & Biostatistician, Child Study Center and Department of Psychiatry in the Yale University School of Medicine. Note: The main points of this report were presented at the Annual Meeting of the American Association for the Advancement of Science (AAAS) in Baltimore, Maryland, on February 9, 1996.