The psychometricians' fallacy: Too clever by half?

The psychometricians' fallacy concludes that an attribute is quantitative from the premise that it is ordinal. This fallacy occupies a central place in the paradigm of psychometrics. Most of the founders of the discipline committed it and it makes sense of otherwise anomalous developments within the discipline, such as the permissible statistics controversy and the dominant form taken by item response theories. The fallacy is displayed by showing (1) that an attribute's quantitative structure reduces to a weak order upon differences between degrees that satisfies the double cancellation, solvability, and Archimedean conditions of conjoint measurement theory and (2) the fact that any order on the degrees themselves does not entail sufficient structure on this weak order to guarantee satisfaction of these conditions. Thus, it is possible that an ordered attribute is non‐quantitative. Also, each pair of differences between degrees of an ordinal attribute falls into one of two disjoint classes: (1) those where the order relation between the pair follows from an order on the attribute and (2) those where it is independent of that order and possibly diagnostic of quantitative structure and this fact means that the distinction between order and quantity is an empirical one.     

Further evidence in favor of prior entry from endogenous attention to a location in space

Titchener’s (1908) law of prior entry states that “the object of attention comes to consciousness more quickly than the objects which we are not attending to,” or otherwise, that attended stimuli are perceived earlier than unattended stimuli. Shore, Spence, and Klein (Psychological Science, 12, 205–212. doi: 10.1111/1467-9280.00337, 2001) showed that endogenous visuospatial orienting does in fact elicit prior-entry effects, albeit to a smaller degree than does exogenous visuospatial orienting. In disagreement with this finding, Schneider and Bavelier (Cognitive Psychology, 47, 333–366. doi: 10.1016/S0010-0285(03)00035-5, 2003) found no effect of their instruction to attend. They concluded that nonattentional effects could masquerade as prior entry, which could account for findings such as those in Shore et al.’s endogenous condition. We investigated this empirical and theoretical discord by replicating the temporal-order judgment task used by Shore, Spence, and Klein, while manipulating and measuring endogenous orienting by way of an orthogonal color probe task. We showed evidence of prior entry as a consequence of endogenous orienting, supporting the conclusions of Shore, Spence, and Klein.     

Improving understanding and recall of the probation service contract

The role of the probation service within the Criminal Justice System is to provide support to probationees so they can serve out their probation orders in accordance with certain regulations. These regulations are expressed in a formal contract. The current article reports an assessment of the readability of the current Kent Probation Service's users' contract. A Flesch (1948) analysis of the original document indicated that it required an IQ of 111+ for full comprehension. Using several criteria suggested by the Flesch formula and other literature, the document was revised to improve its readability. Analysis revealed the revised document to require an IQ of 84+ for full comprehension, indicating that the revised contract should be considerably easier to understand than the original. An exploratory study revealed that both understanding and recall were significantly greater for the revised contract than for the original. We conclude that in assessing readability of written materials, it is important that (in conjunction with a Flesch analysis) documents are actually tested on the intended readership. Copyright © 2000 John Wiley & Sons, Ltd.