Reliability of test scores in nonparametric item response theory

Three methods for estimating reliability are studied within the context of nonparametric item response theory. Two were proposed originally by Mokken (1971) and a third is developed in this paper. Using a Monte Carlo strategy, these three estimation methods are compared with four classical lower bounds to reliability. Finally, recommendations are given concerning the use of these estimation methods.The authors are grateful for constructive comments from the reviewers and from Charles Lewis.     

Grading the ‘cultural literacy’ project

The essay examines the argument advanced by E.D. Hirsch, Jr., for instituting ‘cultural literacy’ as a fundamental priority of schools. A number of confusions and equivocations in Hirsch's reasoning are identified, and the propensity of his project to indoctrinate is exposed. Among the features of Hirsch's argument shown to be troubling are his shifting construal of ‘language’, his inconsistency about the requirements of cultural literacy, and his uncritical relation to traditional images of the American past and present. The upshot is to raise the question why Hirsch's project has elicited wide support and praise.     

Stochastic ordering using the latent trait and the sum score in polytomous IRT models

In a restricted class of item response theory (IRT) models for polytomous items the unweighted total score has monotone likelihood ratio (MLR) in the latent trait. MLR implies two stochastic ordering (SO) properties, denoted SOM and SOL, which are both weaker than MLR, but very useful for measurement with IRT models. Therefore, these SO properties are investigated for a broader class of IRT models for which the MLR property does not hold.In this study, first a taxonomy is given for nonparametric and parametric models for polytomous items based on the hierarchical relationship between the models. Next, it is investigated which models have the MLR property and which have the SO properties. It is shown that all models in the taxonomy possess the SOM property. However, counterexamples illustrate that many models do not, in general, possess the even more useful SOL property.Hemker's research was supported by the Netherlands Research Council, Grant 575-67-034. Junker's research was supported in part by the National Institutes of Health, Grant CA54852, and by the National Science Foundation, Grant DMS-94.04438.     

Referenzsemantik in der Partnermodellierung

How can we explain that an assertion on something perceived can be understood in the same manner by somebody who cannot perceive that scene? This problem bases the interest in computational linguistics in how listener modeling could possibly be harmonized with reference semantics. Mental images substituting real perception appear as a way out. The architecture of the listener model has to be adapted to the creation and use of such pictorial data structures. Furthermore, the relation between the latter and a verbal (i. e., propositional) representation must be understood. The resulting architecture of a listener model with reference semantics can be employed to solve communicational problems from three general classes in a better way, as is demonstrated by an example implementation.