A PROCESS FOR CONTENT VALIDATION OF EDUCATION AND EXPERIENCED-BASED MINIMUM QUALIFICATIONS: AN APPROACH RESULTING IN FEDERAL COURT APPROVAL

The use of education and experience minimum qualifications (MQs) is nearly ubiquitous in employment settings, yet it appears to be rare that such MQs are validated by the end user (either via content validity or criterion-related validation approaches). In this article, we present a method of content-validating MQs that is related to a procedure noted by Levine, Maye, Ulm, and Gordon (1997) , and we demonstrate the method's application for an upper-level management position in a state agency. Our procedure is based on adherence to the Uniform Guidelines and sound professional practice. In addition, the procedure was heard in a federal court proceeding (deposition and expert testimony in relation to 3 jobs), was approved by that court, and we discuss the court's findings. In particular, the court found, "The MQ development process used by the State Personnel Department (SPD) is consistent with the requirements of the Guidelines and leads to content-valid MQs." Given data available to us for another job, we also show that the obtained MQs may result in less adverse impact than a previously determined, task-based set of MQs.     

WORK SAMPLE TESTS IN PERSONNEL SELECTION: A META‐ANALYSIS OF BLACK–WHITE DIFFERENCES IN OVERALL AND EXERCISE SCORES

Work sample exams are generally thought to have either low or comparatively low levels of ethnic group differences when used for personnel selection. Such exams are sometimes called “simulation exercises” and involve having applicants perform a set of tasks that are similar to those performed on the job. The nearly ubiquitous meta‐analytic value of Black–White subgroup differences in the literature is d= .38. Unfortunately, this estimate is plagued by a variety of problems (e.g., range restriction, inclusion of nonwork sample tests). Further, there are virtually no analyses that examine how the saturation of different constructs influence work sample tests. We gathered available data for Black–White ethnic group differences and found that overall work sample differences were markedly larger for samples of job applicants (d= .73) than previously thought. We also examined how different exercises and saturation of different constructs influenced work sample ds. For example, work sample test ratings of cognitive and job knowledge skills were associated with a mean observed d= .80, whereas ratings of various social skills were associated with mean observed ds that varied from .21 to .27. We urge scientists and practitioners to consider both the method and the constructs that are targeted when forecasting predictor ds.