Reconsideration of measurement of error in human motor learning

Human motor learning is often measured by error scores. The convention of using mean absolute error, mean constant error, and variable error shows lack of desirable parsimony and interpretability. This paper provides the background of error measurement and states criticisms of conventional methodology. A parsimonious model of error analysis is provided, along with operationalized interpretations and implications for motor learning. Teaching, interpreting, and using error scores in research may be simplified and facilitated with the model.     

SETTING CUTOFF SCORES: LEGAL, PSYCHOMETRIC, AND PROFESSIONAL ISSUES AND GUIDELINES

Cutoff scores are used in a variety of settings to help managers make personnel decisions. Although cutoff scores are used widely, information about their derivation and appropriate use is scattered in the legal, psychometric, and professional literatures. The purpose of this paper is to analyze critically and to integrate these diverse literatures, to summarize what is known and what is unknown about the use and misuse of cutoff scores. Alternative methods are examined in relation to legal precedents set by the courts, to psychometric principles, and to the various sets of professional guidelines. Directions for future research are suggested, and we conclude with a set of recommendations regarding acceptable professional practice in this area.     

Cloze analysis in schizophrenic speech: scoring method and raters' education

This report examines two methodologic concerns pertaining to use of the cloze procedure in studying the predictability of schizophrenic speech, scoring criteria and raters' education (at or below college level). We find that two strategies for scoring the predictions of raters, one requiring the exact word, the other permitting a reasonable synonym, do not appear to differ in distinguishing groups of patients. The accuracy of raters' guessing is, however, correlated with raters' education: the more educated the rater, the more accurate the guessing. Thought-disordered schizophrenic speech is significantly less predictable than that of nonthought-disordered schizophrenics and normal controls when scored by less educated raters. These differences diminish when more highly educated raters are used. We conclude that raters' education can influence the sensitivity of cloze analysis.