Some improved diagnostics for failure of the Rasch model

Although several goodness of fit tests have been developed for the Rasch model for dichotomous items, most of them are of a global, asymptotic, and confirmatory type. This paper, based on ideas from a recent thesis by Van den Wollenberg, offers some suggestions for local, small sample, and exploratory techniques: difficulty plots for person groups scoring right and wrong on a specific item, a slope test per item based on a binomial distribution per score group, and a unidimensionality check based on an extended hypergeometric distribution per score group. This paper owes much to the inspiring and pioneering work of Arnold Van den Wollenberg, of which only minor aspects are criticized. Thanks go to Charles Lewis for stimulating discussions and for solutions to some programming problems.     

The equivalence of two methods of parameter estimation for the rasch model

Two methods of estimating parameters in the Rasch model are compared. It is shown that estimates for a certain loglinear model for the score × item × response table are equivalent to the unconditional maximum likelihood estimates for the Rasch model.     

On the existence and uniqueness of JML estimates for the partial credit model

A necessary and sufficient condition is given in this paper for the existence and uniqueness of the maximum likelihood (the so-called joint maximum likelihood) estimate of the parameters of the Partial Credit Model. This condition is stated in terms of a structural property of the pattern of the data matrix that can be easily verified on the basis of a simple iterative procedure. The result is proved by using an argument of Haberman (1977). The author wishes to thank the Editor and the anonymous reviewers for their comments that helped to substantially improve the final version of this paper. This research was supported in part by a MURST grant (ex 60%).     

Robust estimation of ability in the Rasch model

Estimating ability parameters in latent trait models in general, and in the Rasch model in particular is almost always hampered by noise in the data. This noise can be caused by guessing, inattention to easy questions, and other factors which are unrelated to ability. In this study several alternative formulations which attempt to deal with these problems without a reparameterization are tested through a Monte Carlo simulation. It was found that although no one of the tested schemes is uniformly superior to all others, a modified jackknife stood out as the best one in general, it was also super efficient (more efficient than the asymptotically optimal estimator) for tests with forty or fewer items. It is proposed that this sort of jackknifing scheme for estimating ability be considered for practical work.This research was funded through a grant from the Law Enforcement Assistance Administration (78-NI-AX-0047) to the Bureau of Social Science Research, Howard Wainer, Principal Investigator. We would like to thank Ronald Mead, Anne Morgan and James Ramsay for kind, generous, and invaluable help at various stages of the project.     

Conditions for rasch-dichotomizability of the unidimensional polytomous rasch model

Jansen and Roskam (1986) discussed the compatibility of the unidimensional polytomous Rasch model with dichotomization of the response continuum. They derived a rather strict condition in which dichotomization of multicategory data that fit the unidimensional polytomous Rasch model, results in dichotomous data which fit the dichotomous Research model with effectively the same subject parameter. In this paper a more general dichotomization condition is derived for the polytomous Rasch model, which appears less restrictive, but upholds that the intrinsic logic of the unidimensional polytomous Rasch model defies dichotomization in general. The robustness of dichotomous analysis investigated in a simulation study. It shows a close relation with the two-parameters (Birnbaum) model. Theoretical and methodological implications are discussed.The authors are indebted to H. Müller (personal communication, August 1986), for giving an example which pointed toward the core equation in this paper. The authors also acknowledge the critical comments of Th. Bezambinder and P. Wakker, and of Psychometrika's reviewers to an earlier version of this paper.     

Loglinear Rasch model tests

Existing statistical tests for the fit of the Rasch model have been criticized, because they are only sensitive to specific violations of its assumptions. Contingency table methods using loglinear models have been used to test various psychometric models. In this paper, the assumptions of the Rasch model are discussed and the Rasch model is reformulated as a quasi-independence model. The model is a quasi-loglinear model for the incomplete subgroup × score × item 1 × item 2 × ... × itemk contingency table. Using ordinary contingency table methods the Rasch model can be tested generally or against less restrictive quasi-loglinear models to investigate specific violations of its assumptions.     

A dynamic generalization of the Rasch model

In the present paper a model for describing dynamic processes is constructed by combining the common Rasch model with the concept of structurally incomplete designs. This is accomplished by mapping each item on a collection of virtual items, one of which is assumed to be presented to the respondent dependent on the preceding responses and/or the feedback obtained. It is shown that, in the case of subject control, no unique conditional maximum likelihood (CML) estimates exist, whereas marginal maximum likelihood (MML) proves a suitable estimation procedure. A hierarchical family of dynamic models is presented, and it is shown how to test special cases against more general ones. Furthermore, it is shown that the model presented is a generalization of a class of mathematical learning models, known as Luce's beta-model.     

A rasch model for partial credit scoring

A unidimensional latent trait model for responses scored in two or more ordered categories is developed. This “Partial Credit” model is a member of the family of latent trait models which share the property of parameter separability and so permit “specifically objective” comparisons of persons and items. The model can be viewed as an extension of Andrich's Rating Scale model to situations in which ordered response alternatives are free to vary in number and structure from item to item. The difference between the parameters in this model and the “category boundaries” in Samejima's Graded Response model is demonstrated. An unconditional maximum likelihood procedure for estimating the model parameters is developed. Preparation of this paper was supported by grants from the Spencer Foundation and the National Institute for Justice. I would like to thank Professor Benjamin D. Wright of the University of Chicago for his very kind help with the various drafts of this paper.     

A generalized rasch model for manifest predictors

A logistic regression model is suggested for estimating the relation between a set of manifest predictors and a latent trait assumed to be measured by a set ofk dichotomous items. Usually the estimated subject parameters of latent trait models are biased, especially for short tests. Therefore, the relation between a latent trait and a set of predictors should not be estimated with a regression model in which the estimated subject parameters are used as a dependent variable. Direct estimation of the relation between the latent trait and one or more independent variables is suggested instead. Estimation methods and test statistics for the Rasch model are discussed and the model is illustrated with simulated and empirical data.     

Residualanalysis in the polytomous rasch model

Residuals for check of model fit in the polytomous Rasch model are examined. Comparisons are made between using counts for all response pattern and using item totals for score groups for the construction of the residuals. Comparisons are also, for the residuals based on score group totals, made between using as basis the item totals, or using the estimated item parameters. The developed methods are illustrated by two examples, one from a psychiatric rating scale, one from a Danish Welfare Study.     

Latent trait models and dichotomization of graded responses

This paper discusses thecompatibility of the polychotomous Rasch model with dichotomization of the response continuum. It is argued that in the case of graded responses, the response categories presented to the subject are essentially an arbitrary polychotomization of the response continuum, ranging for example from total rejection or disagreement to total acceptance or agreement of an item or statement. Because of this arbitrariness, the measurement outcome should be independent of the specific polychotomization applied, for example, presenting a specific multicategory response format should not affect the measurement outcome. When such is the case, the original polychotomous model is called compatible with dichotomization.A distinction is made between polychotomization or dichotomization before the fact, that is, in constructing the response format, and polycho- or dichotomization after the fact, for example in dichotomizing existing graded response data.It is shown that, at least in case of dichotomization after-the-fact, the polychotomous Rasch model is not compatible with dichotomization, unless a rather special condition of the model parameters is met. Insofar as it may be argued that dichotomization before the fact is not essentially different from dichotomization after the fact, the value of the unidimensional polychotomous Rasch model is consequently questionable. The impact of our conclusion on related models is also discussed.     

心理科学领域内的客观测量——Rasch模型之特点及发展趋势

Rasch模型是在国外学术界受到广泛关注和深入研究的一个潜在特质模型。该模型为解决心理科学领域内测量的客观性问题提供了一个可行性很高的解决方案。而国内关于Rasch模型的理论探讨和应用研究却并不多见。不同于一般项目反应理论, Rasch模型要求所收集的数据必须符合模型的先验要求, 而不是使用不同的参数去适应数据的特点。Rasch模型的主要特点(包括个体与题目共用标尺、线性数据、参数分离)确保了客观测量的实现。未来关于Rasch模型的研究方向包括多维度Rasch模型、测验的等值与链接、计算机自适应性考试, 大型应用测量系统(比如Lexile系统)等等。     

The essential process in a family of measurement models

Five members of the Rasch family of latent trait models which have appeared more or less independently in the literature are brought together and identified as one model. In addition to sharing the distinguishing characteristic of the dichotomous Rasch model—separable person and item parameters and hence sufficient statistics—all five models share a common algebraic form and have as their basic element the fundamental process defined by Rasch's simple logistic expression. In these models, the sufficient statistics for person and item parameters are counts of events constructed to be indicative of the variable being measured, and the measures they enable are ‘fundamental’.     

Parameter estimation in latent trait models

Latent trait models for binary responses to a set of test items are considered from the point of view of estimating latent trait parameters=( ₁, , _n ) and item parameters=( ₁, , _k ), where _j may be vector valued. With considered a random sample from a prior distribution with parameter, the estimation of (, ) is studied under the theory of the EM algorithm. An example and computational details are presented for the Rasch model.This work was supported by Contract No. N00014-81-K-0265, Modification No. P00002, from Personnel and Training Research Programs, Psychological Sciences Division, Office of Naval Research. The authors wish to thank an anonymous reviewer for several valuable suggestions.     

Loglinear Rasch models for the analysis of stability and change

Loglinear unidimensional and multidimensional Rasch models are considered for the analysis of repeated observations of polytomous indicators with ordered response categories. Reparameterizations and parameter restrictions are provided which facilitate specification of a variety of hypotheses about latent processes of change. Models of purely quantitative change in latent traits are proposed as well as models including structural change. A conditional likelihood ratio test is presented for the comparison of unidimensional and multiple scales Rasch models. In the context of longitudinal research, this renders possible the statistical test of homogeneity of change against subject-specific change in latent traits. Applications to two empirical data sets illustrate the use of the models.The author is greatly indebted to Ulf Böckenholt, Rolf Langeheine, and several anonymous reviewers for many helpful suggestions.     

Development and psychometric evaluation of a post exercise exhaustion scale utilising the Rasch measurement model

ObjectivesThe objective of this study to report on the development and psychometric analysis of a scale to measure post exercise exhaustion.DesignThis study utilised the Rasch measurement model for the psychometric analysis of a new scale aimed at measuring acute onset exhaustion in athletes.MethodAn extensive literature review, feedback from athletes and an expert panel from educators in psychology, sports science and exercise physiology provided feedback on the scale, providing evidence of content validity. A final survey, consisting of the 25 items and completed by three hundred and seventy-nine athletes (Sport: 187 tri-athletes and 192 cyclists; gender: 211 males, and 168 females; age: 18–25 [31], 26–35 [114], 36–45 [120], and 46+ [114]), was submitted to Rasch analysis.ResultsAfter amendments a final 14 item scale provided internally consistent and reliable measures of exhaustion for participants. The items of the final scale have good fit, and the scale has high PSI providing statistical evidence of reliability. The scale could benefit from items dealing with mid-range levels of exhaustion. The correlational association between the new scale and a similar scale was positive and significant correlation adding to the evidence of the validity of the new scale.ConclusionsThe scale appears to be a valuable tool for the assessment of exercise-induced acute onset exhaustion and may be an attractive option for researchers, clinicians, and coaches seeking to measure the levels of exhaustion in individuals. In addition to its valid theoretical structure and sound psychometric properties, the scale has advantages over other exhaustion or fatigue scales as it is not disease-specific.     

Models for measurement,precision, and the nondichotomization of graded responses

It is common in educational, psychological, and social measurement in general, to collect data in the form of graded responses and then to combine adjacent categories. It has been argued that because the division of the continuum into categories is arbitrary, any model used for analyzing graded responses should accommodate such action. Specifically, Jansen and Roskam (1986) enunciate ajoining assumption which specifies that if two categoriesj andk are combined to form categoryh, then the probability of a response inh should equal the sum of the probabilities of responses inj andk. As a result, they question the use of the Rasch model for graded responses which explicitly prohibits the combining of categories after the data are collected except in more or less degenerate cases. However, the Rasch model is derived from requirements of invariance of comparisons of entities with respect to different instruments, which might include different partitions of the continuum, and is consistent with fundamental measurement. Therefore, there is a strong case that the mathematical implication of the Rasch model should be studied further in order to understand how and why it conflicts with the joining assumption. This paper pursues the mathematics of the Rasch model and establishes, through a special case when the sizes of the categories are equal and when the model is expressed in the multiplicative metric, that its probability distribution reflects the precision with which the data are collected, and that if a pair of categories is collapsed after the data are collected, it no longer reflects the original precision. As a consequence, and not because of a qualitative change in the variable, the joining assumption is destroyed when categories are combined. Implications of the choice between a model which satisfies the joining assumption or one which reflects on the precision of the data collection considered are discussed.     

主观评分中多面Rasch模型的应用

主观评分中存在的不一致性导致主观评分的信度降低。多面Rasch模型基于项目反应理论,可以应用于评分员效应的识别和消除,从而提高主观评分的信度。该文介绍多面Rasch模型的理论和应用框架,介绍了国外相关的典型应用,并且讨论了该模型的应用条件。     

无领导小组讨论的多侧面Rasch模型应用*

采用项目反应理论(IRT)的多侧面Rasch模型(MFRM),分析评价中心技术中无领导小组讨论(LGD)的测评结果,探讨被试能力水平、评委评分宽严度、评分内部一致性、维度难度和评定等级等问题,进而讨论各种偏差。通过 MFRM 分析人事测评结果,可深入了解被试能力的真实差异、甑别维度难度、探查测评误差源,从而完善测评试题编制、评估或诊断评委合格性、提高测评维度与测评目的匹配性,为拓展项目反应理论在人事测评中的应用提供独特视角。     

A rating formulation for ordered response categories

A rating response mechanism for ordered categories, which is related to the traditional threshold formulation but distinctively different from it, is formulated. In addition to the subject and item parameters two other sets of parameters, which can be interpreted in terms of thresholds on a latent continuum and discriminations at the thresholds, are obtained. These parameters are identified with the category coefficients and the scoring function of the Rasch model for polychotomous responses in which the latent trait is assumed uni-dimensional. In the case where the threshold discriminations are equal, the scoring of successive categories by the familiar assignment of successive integers is justified. In the case where distances between thresholds are also equal, a simple pattern of category coefficients is shown to follow.This work was conducted in part in the first half of 1977 while the author was on study leave at the Danish Institute for Educational Research. The Institute provided required research facilities while The University of Western Australia provided financial support.