A computer-automated laboratory for studying complex perception-action skills

In this paper, we describe a computer-based laboratory for collecting and analyzing real-time performance and eye-movement data by using video game-like tasks. These tasks assess skills that require the integration of varying numbers of perception and action components. Customized hardware and software are described for configuring tasks, collecting data, reconstructing performance, and organizing, editing, and reducing data. General design considerations are emphasized for solving several of the problems encountered in constructing a real-time data collection system. The paper concludes with examples of data that illustrate the system’s usefulness for studying complex perception-action skills.