A rasch model for partial credit scoring

A unidimensional latent trait model for responses scored in two or more ordered categories is developed. This “Partial Credit” model is a member of the family of latent trait models which share the property of parameter separability and so permit “specifically objective” comparisons of persons and items. The model can be viewed as an extension of Andrich's Rating Scale model to situations in which ordered response alternatives are free to vary in number and structure from item to item. The difference between the parameters in this model and the “category boundaries” in Samejima's Graded Response model is demonstrated. An unconditional maximum likelihood procedure for estimating the model parameters is developed. Preparation of this paper was supported by grants from the Spencer Foundation and the National Institute for Justice. I would like to thank Professor Benjamin D. Wright of the University of Chicago for his very kind help with the various drafts of this paper.     

A rasch model for continuous ratings

A unidimensional latent trait model for continuous ratings is developed. This model is an extension of Andrich's rating formulation which assumes that the response process at latent thresholds is governed by the dichotomous Rasch model. Item characteristic functions and information functions are used to illustrate that the model takes ceiling and floor effects into account. Both the dichotomous Rasch model and a linear model with normally distributed error can be derived as limiting cases. The separability of the structural and incidental parameters is demonstrated and a procedure for estimating the parameters is outlined.     

A rating formulation for ordered response categories

A rating response mechanism for ordered categories, which is related to the traditional threshold formulation but distinctively different from it, is formulated. In addition to the subject and item parameters two other sets of parameters, which can be interpreted in terms of thresholds on a latent continuum and discriminations at the thresholds, are obtained. These parameters are identified with the category coefficients and the scoring function of the Rasch model for polychotomous responses in which the latent trait is assumed uni-dimensional. In the case where the threshold discriminations are equal, the scoring of successive categories by the familiar assignment of successive integers is justified. In the case where distances between thresholds are also equal, a simple pattern of category coefficients is shown to follow.This work was conducted in part in the first half of 1977 while the author was on study leave at the Danish Institute for Educational Research. The Institute provided required research facilities while The University of Western Australia provided financial support.     

A generalized rasch model for manifest predictors

A logistic regression model is suggested for estimating the relation between a set of manifest predictors and a latent trait assumed to be measured by a set ofk dichotomous items. Usually the estimated subject parameters of latent trait models are biased, especially for short tests. Therefore, the relation between a latent trait and a set of predictors should not be estimated with a regression model in which the estimated subject parameters are used as a dependent variable. Direct estimation of the relation between the latent trait and one or more independent variables is suggested instead. Estimation methods and test statistics for the Rasch model are discussed and the model is illustrated with simulated and empirical data.     

Conditions for rasch-dichotomizability of the unidimensional polytomous rasch model

Jansen and Roskam (1986) discussed the compatibility of the unidimensional polytomous Rasch model with dichotomization of the response continuum. They derived a rather strict condition in which dichotomization of multicategory data that fit the unidimensional polytomous Rasch model, results in dichotomous data which fit the dichotomous Research model with effectively the same subject parameter. In this paper a more general dichotomization condition is derived for the polytomous Rasch model, which appears less restrictive, but upholds that the intrinsic logic of the unidimensional polytomous Rasch model defies dichotomization in general. The robustness of dichotomous analysis investigated in a simulation study. It shows a close relation with the two-parameters (Birnbaum) model. Theoretical and methodological implications are discussed.The authors are indebted to H. Müller (personal communication, August 1986), for giving an example which pointed toward the core equation in this paper. The authors also acknowledge the critical comments of Th. Bezambinder and P. Wakker, and of Psychometrika's reviewers to an earlier version of this paper.     

The equivalence of two methods of parameter estimation for the rasch model

Two methods of estimating parameters in the Rasch model are compared. It is shown that estimates for a certain loglinear model for the score × item × response table are equivalent to the unconditional maximum likelihood estimates for the Rasch model.     

An extension of the concept of specific objectivity

Comparisons of subjects are specifically objective if they do not depend on the items involved. Such comparisons are not restricted to the 1-parameter logistic latent trait model, but may also be defined within ordinal independence models and even within the 2-parameter logistic model.     

Some improved diagnostics for failure of the Rasch model

Although several goodness of fit tests have been developed for the Rasch model for dichotomous items, most of them are of a global, asymptotic, and confirmatory type. This paper, based on ideas from a recent thesis by Van den Wollenberg, offers some suggestions for local, small sample, and exploratory techniques: difficulty plots for person groups scoring right and wrong on a specific item, a slope test per item based on a binomial distribution per score group, and a unidimensionality check based on an extended hypergeometric distribution per score group. This paper owes much to the inspiring and pioneering work of Arnold Van den Wollenberg, of which only minor aspects are criticized. Thanks go to Charles Lewis for stimulating discussions and for solutions to some programming problems.     

Consistent estimation in the rasch model based on nonparametric margins

Consider the class of two parameter marginal logistic (Rasch) models, for a test ofm True-False items, where the latent ability is assumed to be bounded. Using results of Karlin and Studen, we show that this class of nonparametric marginal logistic (NML) models is equivalent to the class of marginal logistic models where the latent ability assumes at most (m + 2)/2 values. This equivalence has two implications. First, estimation for the NML model is accomplished by estimating the parameters of a discrete marginal logistic model. Second, consistency for the maximum likelihood estimates of the NML model can be shown (whenm is odd) using the results of Kiefer and Wolfowitz. An example is presented which demonstrates the estimation strategy and contrasts the NML model with a normal marginal logistic model.This research was supported by NIMH traning grant, 2 T32 MH 15758-06 and by ONR contract N00014-84-K-0588. The author would like to thank Diane Lambert, John Rolph, and Stephen Fienberg for their assistance. Also, the comments of the referees helped to substantially improve the final version of this paper.     

The rasch model,the law of comparative judgment and additive conjoint measurement

Relationships between the Rasch model and both the law of comparative judgment and additive conjoint measurement are discussed. The distance between the ability of Persona and the difficult of Itemi is, in the Rasch model, the baseline value corresponding to the probability thata will respond correctly toi, where this probability is interpreted as the area under a logistic curve (which is substantially equivalent to the normal curve) and is thus an application of the law of comparative judgment. Under certain assumptions, the Rasch model is also a special case of additive conjoint measurement and, properly reinterpreted, may be usefully applied in contexts other than individual differences.     

Analysis of residuals for the multionmial item response model

Using the item response model as developed on the multinomial distribution, asymptotic variances are obtained for residuals associated with response patterns and first-, and second-order marginal frequencies of manifest variables. When the model does not fit well, an examination of these residuals may reveal the source of the poor fit. Finally, a limited-information test of fit for the model is developed by using residuals defined for the first-, and second-order marginals. Model evaluation based on residuals for these marginals is particularly useful when the response pattern frequencies are sparse.The author would like to thank Yasuo Amemiya and Joseph Lucke for helpful suggestions. This research was supported by a Research Incentive Grant from Arizona State University.     

On the existence and uniqueness of maximum-likelihood estimates in the Rasch model

Necessary and sufficient conditions for the existence and uniqueness of a solution of the so-called unconditional (UML) and the conditional (CML) maximum-likelihood estimation equations in the dichotomous Rasch model are given. The basic critical condition is essentially the same for UML and CML estimation. For complete data matricesA, it is formulated both as a structural property ofA and in terms of the sufficient marginal sums. In case of incomplete data, the condition is equivalent to complete connectedness of a certain directed graph. It is shown how to apply the results in practical uses of the Rasch model.Paper read at the European Meeting of the Psychometric Society, Groningen, June 19–21, 1980.Part of the research reported herein was done while the author was staying at the Pulmologisches Zentrum der Stadt Wien; he is indebted to Professor Dr. F. Muhar and Dr. R. Mutschlechner for providing excellent working conditions.     

An exact and optimal standardized person test for assessing consistency with the rasch model

The Rasch model predicts that an individual's ability level is invariant over subtests of the total test, and thus, all subtests measure the same latent trait. A person test of this invariance hypothesis is discussed that is uniformly most powerful and standardized in the sense that the conditional distribution of the test statistic, given a particular level of ability, does not depend on the absolute value of the examinee's ability parameter. The test can be routinely performed by applying a computer program designed by and obtainable from the author. Finally, a suboptimal test is derived that is extremely easy to use, and an overall group test of the invariance hypothesis discussed. All tests considered do not rely on asymptotic approximations; hence, they may be applied when the test is of only moderate length and the group of examinees is small.     

Optimal item difficulty for the three-parameter normal ogive response model

In tailored testing, it is important to determine the optimal difficulty of the next item to present to the examinee. This paper shows that the difference that maximizes information for the three-parameter normal ogive response model is approximately 1.7 times the optimal difference –b for the three-parameter logistic model. Under the normal model, calculation of the optimal difficulty for minimizing the Bayes risk is equivalent to maximizing an associated information function.The views expressed herein, are those of the author and do not necessarily reflect those of the Department of the Navy.     

Spatial categories and the estimation of location

Four experiments are reported in which people organize a space hierarchically when they estimate particular locations in that space. Earlier work showed that people subdivide circles into quadrants bounded at the vertical and horizontal axes, biasing their estimates towards prototypical diagonal locations within those spatial categories (Psychological Review 98 (1991) 352). In this work Huttenlocher, Hedges, and Duncan showed that the use of such spatial categories can increase the accuracy of estimation of inexactly represented locations. The stimulus locations we examined were uniformly distributed across the circle. In the present study we explore whether variation in the distribution of locations affects how the circle is categorized. Other things being equal, categories that capture high density regions in a stimulus space should contribute most to accuracy of estimation. However, precision of boundaries is also important to accuracy; with imprecise boundaries stimuli may be misclassified, leading to large errors in estimation. We found that people use the same spatial categories regardless of the distribution of the locations. We argue that this spatial organization nevertheless can maximize the accuracy of estimates because vertical and horizontal category boundaries are the most exact, minimizing misclassification of stimuli.     

Unbiased estimators of ability parameters,of their variance,and of their parallel-forms reliability

Given known item parameters, unbiased estimators are derived i) for an examinee's ability parameter and for his proportion-correct true score, ii) for the variances of and across examinees in the group tested, and iii) for the parallel-forms reliability of the maximum likelihood estimator .This work was supported in part by contract N00014-80-C-0402, project designation NR 150-453 between the Office of Naval Research and Educational Testing Service. Reproduction in whole or in part is permitted for any purpose of the United States Government.     

An estimating equations approach for the LISCOMP model

Maximum likelihood estimation is computationally infeasible for latent variable models involving multivariate categorical responses, in particular for the LISCOMP model. A three-stage generalized least squares approach introduced by Muthén (1983, 1984) can experience problems of instability, bias, non-convergence, and non-positive definiteness of weight matrices in situations of low prevalence, small sample size and large numbers of observed indicator variables. We propose a quadratic estimating equations approach that only requires specification of the first two moments. By performing simultaneous estimation of parameters, this method does not encounter the problems mentioned above and experiences gains in efficiency. Methods are compared through a numerical study and an application to a study of life-events and neurotic illness.The authors would like to thank Bengt Muthén for many helpful discussions and Scott Henderson for generously providing the Canberra data set. This work was supported in part by grant number GM49909 of the National Institutes of Health.     

The derivation of some tests for the rasch model from the multinomial distribution

The present paper is concerned with testing the fit of the Rasch model. It is shown that this can be achieved by constructing functions of the data, on which model tests can be based that have power against specific model violations. It is shown that the asymptotic distribution of these tests can be derived by using the theoretical framework of testing model fit in general multinomial and product-multinomial models. The model tests are presented in two versions: one that can be used in the context of marginal maximum likelihood estimation and one that can be applied in the context of conditional maximum likelihood estimation.I am indebted to Norman Verhelst and Niels Veldhuijzen for their helpful comments. Requests for reprints should be sent to Cees A. W. Glas, Cito, PO Box 1034, 6801 MG Arnhem, THE NETHERLANDS.