The detection and influence of problematic item content in ability tests: An examination of sensitivity review practices for personnel selection test development |
| |
Authors: | James A. Grand Juliya Golubovich Ann Marie Ryan Neal Schmitt |
| |
Affiliation: | 1. College of Health Professions and Department of Psychology, The University of Akron, Akron, OH 44325-3701, United States;2. Department of Psychology, Michigan State University, East Lansing, MI 48824, United States |
| |
Abstract: | In organizational and educational practices, sensitivity reviews are commonly advocated techniques for reducing test bias and enhancing fairness. In the present paper, results from two studies are reported which investigate how effective individuals are at detecting problematic test content and the influence such content has on important testing outcomes. In Study 1, signal detection analyses are used to examine the role of individual differences in the identification of insensitive test items, while Study 2 investigates the extent to which insensitivity differentially influences item performance and reactions. Results revealed small but significant differences in the overall accuracy and response tendencies of student test reviewers on the basis of demographics and key individual differences variables. Contrary to predictions however, problematic items did not exhibit differential item functioning across sex nor did their presence engender negative test taker reactions. Implications and suggestions for future research and sensitivity review practices are discussed. |
| |
Keywords: | Sensitivity review Fairness review Test review Signal detection analysis Test bias Test development Differential item functioning Selection Assessment |
本文献已被 ScienceDirect 等数据库收录! |
|