Reporting observer agreement on stuttering event judgments: A survey and evaluation of current practice

A survey of articles appearing in three national journals over a five-year period was conducted in order to examine current practice in reporting observer agreement on stuttering event judgments. Of 55 articles in which observer agreement was deemed critical, 47 reported at least one observer agreement procedure. A total of eleven agreement procedures were reported and current practice is characterized by five procedures which account for 92% of the articles in which procedures are reported. Problems with using these five indices to represent observer agreement are detailed and several alternatives are discussed.