Evaluating Cognitive Training Outcomes: Validity and Utility of Structural Knowledge Assessment

Conventional approaches to evaluating cognitive outcomes of training typically use paper-and-pencil tests that emphasize gains or differences in declarative knowledge. Yet a key factor in differentiating expert and novice performance is the way individuals organize their knowledge. Accordingly, the acquisition of meaningful knowledge structures and methods of assessing structural knowledge are potentially important issues for designing and evaluating training programs. Two studies were conducted to examine the validity and utility of one structural assessment technique called Pathfinder (Schvaneveldt, Durso, & Dearholt, 1989). Results from academic and organizational samples indicated that Pathfinder measures of structural knowledge quality predicted individual differences in performance self-efficacy. After controlling for differences in declarative knowledge, measures of structural knowledge quality added to the prediction of performance self-efficacy in the student sample, but not in the organizational sample. The unique features and potential advantages of structural assessment for training evaluation are discussed.