Collecting and analyzing on-line protocols from novice programmers

Methodology for collecting and analyzing on-line protocols from novice programmers is described. On-line protocols are copies of all syntactically correct programs that students have written using an interactive computer system. Since the number of on-line protocols collected is quite large, we have developed a computer program, called the Bug Finder, which can auto-matically identify semantic and pragmatic bugs in subjects’ programs. In this paper, we describe the theory upon which the Bug Finder is built and provide an example of the Bug Finder in operation.