Using Situational Judgment Tests to Assess Training Effectiveness: Lessons Learned Evaluating Military Equal Opportunity Advisor Trainees

Situational judgment tests (SJTs) are well suited for training evaluation, especially when measures of on-the-job behaviors/performances are unavailable. Yet, SJTs are underutilized in the training evaluation context. This research details the development and use of an SJT to evaluate equal opportunity/diversity training in the military. We focus on issues that differentiate the development of SJTs for training evaluation from the development of SJTs for selection. Finally, results are presented for two cycles of training evaluation using an SJT, and the strengths and limitations of using SJTs in the training context are discussed.