GENERALIZING PHYSICAL ABILITY TEST VALIDITY: A CASE STUDY USING TEST TRANSPORTABILITY, VALIDITY GENERALIZATION, AND CONSTRUCT-RELATED VALIDATION EVIDENCE

This paper describes a field study using Position Analysis Questionnaire (PAQ; McCormick, Jeanneret, & Mecham, 1972) data to support inferences of physical ability test (PAT) validity at a large utility company. The project developed a test transportability procedure using worker-oriented job analysis, and was based on synthesizing the findings of an earlier consortium project (American Gas Association, 1990), recent validity generalization evidence, and findings from a variety of physical ability construct-related research projects published or presented since the completion of the original consortium study. Selected PAQ divisional dimension scores for 95 jobs were analyzed via cluster analysis to develop five physical demand job families. Statistically derived job families were modified very slightly based on reviews by subject matter experts who found PAQ-derived job family structures quite reasonable (agreement of 95% between statistical and rational procedures). PAQ strength attributes were used to estimate the physical demands underlying job families. The statistical and analytic procedures developed and reported here could be applied in other organizational settings, and allow broader applicability of the PAT than would a task-based transportability model.