Maximum likelihood estimation of multivariate polyserial and polychoric correlation coefficients

The method of finding the maximum likelihood estimates of the parameters in a multivariate normal model with some of the component variables observable only in polytomous form is developed. The main stratagem used is a reparameterization which converts the corresponding log likelihood function to an easily handled one. The maximum likelihood estimates are found by a Fletcher-Powell algorithm, and their standard error estimates are obtained from the information matrix. When the dimension of the random vector observable only in polytomous form is large, obtaining the maximum likelihood estimates is computationally rather labor expensive. Therefore, a more efficient method, the partition maximum likelihood method, is proposed. These estimation methods are demonstrated by real and simulated data, and are compared by means of a simulation study.     

On the estimation of polychoric correlations and their asymptotic covariance matrix

A general theory for parametric inference in contingency tables is outlined. Estimation of polychoric correlations is seen as a special case of this theory. The asymptotic covariance matrix of the estimated polychoric correlations is derived for the case when the thresholds are estimated from the univariate marginals and the polychoric correlations are estimated from the bivariate marginals for given thresholds. Computational aspects are also discussed.The research was supported by the Swedish Council for Research in the Humanities and Social Sciences (HSFR) under the programMultivariate Statistical Analysis. The author thanks a reviewer for pointing out an error in the original version of the paper.     

A short note on the estimation of the asymptotic covariance matrix for polychoric correlations

By using a Taylor expansion of the equations that define the two step estimator for polychoric correlations, the asymptotic covariance matrix for the estimated correlations can be derived in a simple and straightforward way.     

Selecting polychoric instrumental variables in confirmatory factor analysis: An alternative specification test and effects of instrumental variables

The polychoric instrumental variable (PIV) approach is a recently proposed method to fit a confirmatory factor analysis model with ordinal data. In this paper, we first examine the small-sample properties of the specification tests for testing the validity of instrumental variables (IVs). Second, we investigate the effects of using different numbers of IVs. Our results show that specification tests derived for continuous data are extremely oversized at all sample sizes when applied to ordinal variables. Possible modifications for ordinal data are proposed in the present study. Simulation results show that the modified specification tests with all available IVs are able to detect model misspecification. In terms of estimation accuracy, the PIV approach where the IVs outnumber the endogenous variables by one produces a lower bias but a higher variation than the PIV approach with more IVs for correctly specified factor loadings at small samples.     

Maximum likelihood estimation of polyserial correlations

This paper considers a multivariate normal model with one of the component variables observable only in polytomous form. The maximum likelihood approach is used for estimation of the parameters in the model. The Newton-Raphson algorithm is implemented to obtain the solution of the problem. Examples based on real and simulated data are reported.The research of the first author was supported in part by a research grant (DA01070) from the US Public Health Service. We are indebted to the referees and the editor for some very valuable comments and suggestions.     

Maximum likelihood estimation in multidimensional scaling

A variety of distributional assumptions for dissimilarity judgments are considered, with the lognormal distribution being favored for most situations. An implicit equation is discussed for the maximum likelihood estimation of the configuration with or without individual weighting of dimensions. A technique for solving this equation is described and a number of examples offered to indicate its performance in practice. The estimation of a power transformation of dissimilarity is also considered. A number of likelihood ratio hypothesis tests are discussed and a small Monte Carlo experiment described to illustrate the behavior of the test of dimensionality in small samples.The research reported here was supported by grant number APA 320 to the author by the National Research Council of Canada.     

Maximum likelihood estimation and factor analysis

Fisher's method of maximum likelihood is applied to the problem of estimation in factor analysis, as initiated by Lawley, and found to lead to a generalization of the Eckart matrix approximation problem. The solution of this in a special case is applied to show how test fallability enters into factor determination, it being noted that the method of communalities underestimates the number of factors.Dr. George Brown of Princeton University has independently made the same suggestion in some unpublished work.     

Maximum marginal likelihood estimation for semiparametric item analysis

The item characteristic curve (ICC), defining the relation between ability and the probability of choosing a particular option for a test item, can be estimated by using polynomial regression splines. These provide a more flexible family of functions than is given by the three-parameter logistic family. The estimation of spline ICCs is described by maximizing the marginal likelihood formed by integrating ability over a beta prior distribution. Some simulation results compare this approach with the joint estimation of ability and item parameters.IRCAMThe research reported in this paper was supported by Grants APA320 and A4035 from the Natural Sciences and Engineering Research Council of Canada. It was also supported by Contract No. F41689-82-C-10020 from the Air Force Human Resources Laboratory to Educational Testing Service. The author wishes to thank M. Abrahamowicz for his assistance and R. Darrell Bock for providing the parameters for the items used in the simulations.     

Estimating the polychoric correlation from misclassified data

Many variables that are used in social and behavioural science research are ordinal categorical or polytomous variables. When more than one polytomous variable is involved in an analysis, observations are classified in a contingency table, and a commonly used statistic for describing the association between two variables is the polychoric correlation. This paper investigates the estimation of the polychoric correlation when the data set consists of misclassified observations. Two approaches for estimating the polychoric correlation have been developed. One assumes that the probabilities in relation to misclassification are known, and the other uses a double sampling scheme to obtain information on misclassification. A parameter estimation procedure is developed, and statistical properties for the estimates are discussed. The practicability and applicability of the proposed approaches are illustrated by analysing data sets that are based on real and generated data. Excel programmes with visual basic for application (VBA) have been developed to compute the estimate of the polychoric correlation and its standard error. The use of the structural equation modelling programme Mx to find parameter estimates in the double sampling scheme is discussed.     

Estimating the polyserial correlation coefficient

We develop simple noniterative estimators of the polyserial correlation coefficient. A general relationship between the polyserial correlation and the point polyserial correlation is exploited to give extensions of Pearson's, Brogden's, and Lord's biserial estimators to the multicategory setting. The small sample and asmptotic properties of these estimators are studied in some detail. A comparison with maximum likelihood estimates shows that Lord's polyserial estimator is fairly efficient across three probability models.The authors would like to thank the referees for suggestions that improved the presentation of the paper.     

On the estimation of the tetrachoric correlation coefficient

This paper presents briefly the rationale of the tetrachoric correlation coefficient. Pearson's results are outlined and several estimates of the coefficient are given. These estimates are compared with Pearson's expressions to determine the relative accuracy of the various approximations in determining the tetrachoric correlation coefficient.Preparation of this paper was supported in part by Fellowship 1-F1-MH-24, 324-01, from the National Institute of Mental Health; and in part by the Tri-Ethnic Research Project, Grant 3M-9156 from the National Institute of Mental Health to the Institute of Behavioral Science, University of Colorado. This paper comprises Publication Number 57 of the Institute. The author would like to thank D. E. Bailey for his helpful comments and criticisms.     

Maximum likelihood estimation of latent interaction effects with the LMS method

In the context of structural equation modeling, a general interaction model with multiple latent interaction effects is introduced. A stochastic analysis represents the nonnormal distribution of the joint indicator vector as a finite mixture of normal distributions. The Latent Moderated Structural Equations (LMS) approach is a new method developed for the analysis of the general interaction model that utilizes the mixture distribution and provides a ML estimation of model parameters by adapting the EM algorithm. The finite sample properties and the robustness of LMS are discussed. Finally, the applicability of the new method is illustrated by an empirical example. This research has been supported by a grant from the Deutsche Forschungsgemeinschaft, Germany, No. Mo 474/1 and Mo 474/2. The data for the empirical example have been provided by Andreas Thiele of the University of Frankfurt, Germany. The authors are indebted to an associate editor and to three anonymous reviewers ofPsychometrika whose comments and suggestions have been very helpful.     

Maximum likelihood estimation of the joint covariance matrix for sections of tests given to distinct samples with application to test equating

Consider an old testX consisting ofs sections and two new testsY andZ similar toX consisting ofp andq sections respectively. All subjects are given testX plus two variable sections from either testY orZ. Different pairings of variable sections are given to each subsample of subjects. We present a method of estimating the covariance matrix of the combined test (X ₁, ...,X _s ,Y ₁, ...,Y _p ,Z ₁, ...,Z _q ) and describe an application of these estimation techniques to linear, observed-score, test equating.The author is indebted to Paul W. Holland and Donald B. Rubin for their encouragement and many helpful comments and suggestions that contributed significantly to the development of this paper.This research was supported by the Program Statistics Research Project of the ETS Research Statistics Group.     

The polyserial correlation coefficient

The polyserial and point polyserial correlations are discussed as generalizations of the biserial and point biserial correlations. The relationship between the polyserial and point polyserial correlation is derived. The maximum likelihood estimator of the polyserial correlation is compared with a two-step estimator and with a computationally convenient ad hoc estimator. All three estimators perform reasonably well in a Monte Carlo simulation. Some practical applications of the polyserial correlation are described.By coincidence, the first author and the second and third authors learned that they were working independently on closely related problems and, consequently, decided to write a jointly authored paper.     

An ordinal coefficient of relational agreement for multiple judges

In a recent article, Fagot proposed a generalized family of coefficients of relational agreement for multiple judges, focusing on the concept of empirically meaningful relationships. In this paper an ordinal coefficient of relational agreement, based on ranking data, is presented as a special case of the generalized family. It is shown that the proposed ordinal coefficient encompasses other ordinal coefficients, such as the Kendall coefficient of concordance, the average Spearman rank-order coefficient, and intraclass correlation based on ranks. It is also shown that the Kendall coefficient of concordance, corrected for chance agreement, is equivalent to the ordinal coefficient proposed in this paper.     

Contributions to Estimation of Polychoric Correlations

This research concerns the estimation of polychoric correlations in the context of fitting structural equation models to observed ordinal variables by multistage estimation. The first main contribution of this research is to propose and evaluate a Monte Carlo estimator for the asymptotic covariance matrix (ACM) of the polychoric correlation estimates. In multistage estimation, the ACM plays a prominent role, as overall test statistics, derived fit indices, and parameter standard errors all depend on this quantity. The ACM, however, must itself be estimated. Established approaches to estimating the ACM use a sample-based version, which can yield poor estimates with small samples. A simulation study demonstrates that the proposed Monte Carlo estimator can be more efficient than its sample-based counterpart. This leads to better calibration for established test statistics, in particular with small samples. The second main contribution of this research is a further exploration of the consequences of violating the normality assumption for the underlying response variables. We show the consequences depend on the type of nonnormality, and the number and location of thresholds. The simulation study also demonstrates that overall test statistics have little power to detect the studied forms of nonnormality, regardless of the ACM estimator.