Cloze analysis in schizophrenic speech: scoring method and raters' education

This report examines two methodologic concerns pertaining to use of the cloze procedure in studying the predictability of schizophrenic speech, scoring criteria and raters' education (at or below college level). We find that two strategies for scoring the predictions of raters, one requiring the exact word, the other permitting a reasonable synonym, do not appear to differ in distinguishing groups of patients. The accuracy of raters' guessing is, however, correlated with raters' education: the more educated the rater, the more accurate the guessing. Thought-disordered schizophrenic speech is significantly less predictable than that of nonthought-disordered schizophrenics and normal controls when scored by less educated raters. These differences diminish when more highly educated raters are used. We conclude that raters' education can influence the sensitivity of cloze analysis.