How to Gain the Benefits of the Expert Performance Approach in Domains Where the Correctness of Decisions are Not Readily Available: A Reply to Weiss and Shanteau

Weiss and Shanteau criticize the expert‐performance approach and argue that this approach has not, and most importantly, cannot be applied to the study of ‘experts’ in domains that lack readily available objective measures of performance, such as accuracy of judgments. In this response, I demonstrate that it is not necessary to use fictitious stimuli for the judgments, for which no correct responses can be identified, and where only their Cochrane, Weiss, and Shanteau index can be calculated. Instead, the expert performance approach regenerates the judgment situation for actual cases and tracks down their subsequent observed real‐world outcomes. Participants' judgments of the stimuli can then be directly scored against the actual outcomes. Opportunities for training and deliberate practice are discussed. Copyright © 2014 John Wiley & Sons, Ltd.