Note on the selection of a panel of judges so as to maximize panel efficiency

Attempts to develop improved methods of selecting a panel of judges for psychometric work are presented. The applications reported are in the sensory field and are limited to the assumption of a unidimensional ability underlying the judgments in question. Some aspects of cost efficiency are also considered.The writers wish to acknowledge the value of a discussion with Dr. Harold Gulliksen of Princeton University and the Educational Testing Service, Princeton; Dr. Frederic Lord, also of the Educational Testing Service, contributed some valuable criticisms. The writers' thanks are also due Mr. George Bosy, at the Research Laboratories, Kraft Foods Company, where the senior author is currently employed.