Correcting Too Much or Too Little? The Performance of Three Chi-Square Corrections

This simulation study investigates the performance of three test statistics, T₁, T₂, and T₃, used to evaluate structural equation model fit under non normal data conditions. T₁ is the well-known mean-adjusted statistic of Satorra and Bentler. T₂ is the mean-and-variance adjusted statistic of Sattertwaithe type where the degrees of freedom is manipulated. T₃ is a recently proposed version of T₂ that does not manipulate degrees of freedom. Discrepancies between these statistics and their nominal chi-square distribution in terms of errors of Type I and Type II are investigated. All statistics are shown to be sensitive to increasing kurtosis in the data, with Type I error rates often far off the nominal level. Under excess kurtosis true models are generally over-rejected by T₁ and under-rejected by T₂ and T₃, which have similar performance in all conditions. Under misspecification there is a loss of power with increasing kurtosis, especially for T₂ and T₃. The coefficient of variation of the nonzero eigenvalues of a certain matrix is shown to be a reliable indicator for the adequacy of these statistics.     

An Approach to Multi‐Criteria Decision Problems Under Severe Uncertainty

Solving complex decision problems is a demanding task; it requires determining and evaluating the consequences of decision alternatives. To this end, uncertain factors that can only partly be influenced by the decision makers, and their interdependencies need to be considered. Scenarios focus on this part of the decision problem; they enable a systematic exploration of a multitude of possible future developments that are relevant for the decision including external events and decisions made. Scenarios are particularly useful when the problem is pervaded by severe uncertainties that cannot be quantified. For the evaluation of alternatives, multiple objectives and the potentially diverging preferences of the involved actors need to be respected. Multi‐criteria decision analysis aims at structuring the problem, evaluating the alternatives and supporting decision makers pursuing multiple goals. We propose an approach integrating scenarios and multi‐criteria decision analysis that focuses on the robustness of alternatives in complex, dynamic, uncertain and time‐bound situations. In this integrated framework, the scenarios provide the basis for evaluating a set of alternatives. Ideally, the set of scenarios considered captures all possible future developments. To appropriately explore this set, formal or analytical approaches to scenario construction generate a large number of scenarios. This challenges the decision makers' information‐processing capacity. To support them in managing the richness of information, a two‐fold approach that uses selection and aggregation is presented. By using a selection method, the scenarios that are deemed most relevant are identified, and their evaluations are presented in detail to decision makers. This approach is complemented by an aggregation of scenario evaluations on the basis of the decision makers' preferences. We present two approaches to facilitate the preference elicitation process. Copyright © 2013 John Wiley & Sons, Ltd.     

On the use of ridit analysis

Ridit analysis is statistical method for comparing ordinal-scale responses. In this paper, the extact variance and asymptotic distribution of the average ridit is developed, including the cases in which the reference group is sampled or the comparison group is finite. The appropriate use and interpretation of ridit analysis is also discussed.The authors wish to thank Andrew Klugh for this support, and the references and David Feigenbaum for their very helpful comments.     

A comparison of severalk sample tests for ordered alternatives in completely randomized designs

The importance of appropriate test selection for a given research endeavor cannot be over-emphasized. Using samples drawn from eleven populations (differing in shape, peakedness, and density in the tails), this study investigates the small sample empirical powers of ninek-sample tests against ordered location alternatives under completely randomized designs. The results then are intended to aid the researcher in the selection of a particular procedure appropriate for a given endeavor. To highlight this an industrial psychology application involving work productivity is presented.Research was supported in part by the Scholastic Assistance Program, Baruch College. The author wishes to thank Professors Matthew Goldstein, Shulamith Gross, David Levine, and Edward Wolf for their helpful comments when writing this paper. In addition, the author wishes to thank the referees and editor for their useful suggestions for improving the paper.     

On the estimation of polychoric correlations and their asymptotic covariance matrix

A general theory for parametric inference in contingency tables is outlined. Estimation of polychoric correlations is seen as a special case of this theory. The asymptotic covariance matrix of the estimated polychoric correlations is derived for the case when the thresholds are estimated from the univariate marginals and the polychoric correlations are estimated from the bivariate marginals for given thresholds. Computational aspects are also discussed.The research was supported by the Swedish Council for Research in the Humanities and Social Sciences (HSFR) under the programMultivariate Statistical Analysis. The author thanks a reviewer for pointing out an error in the original version of the paper.     

A comparison of generalized and modified sample biserial correlation estimators

In a recent paper, Bedrick derived the asymptotic distribution of Lord's modified sample biserial correlation estimator and studied its efficiency for bivariate normal populations. We present a more detailed examination of the properties of Lord's estimator and several competitors, including Brogden's estimator. We show that Lord's estimator is more efficient for three nonnormal distributions than a generalization of Pearson's sample biserial estimator. In addition, Lord's estimator is reasonably efficient relative to the maximum likelihood estimator for these distributions. These conclusions are consistent with Bedrick's results for the bivariate normal distribution. We also study the small sample bias and variance of Lord's estimator, and the coverage properties of several confidence interval estimates.The author would like to thank the referees for several suggestions that improved the paper.     

Model selection and Akaike's Information Criterion (AIC): The general theory and its analytical extensions

During the last fifteen years, Akaike's entropy-based Information Criterion (AIC) has had a fundamental impact in statistical model evaluation problems. This paper studies the general theory of the AIC procedure and provides its analytical extensions in two ways without violating Akaike's main principles. These extensions make AIC asymptotically consistent and penalize overparameterization more stringently to pick only the simplest of the “true” models. These selection criteria are called CAIC and CAICF. Asymptotic properties of AIC and its extensions are investigated, and empirical performances of these criteria are studied in choosing the correct degree of a polynomial model in two different Monte Carlo experiments under different conditions.     

Standard errors of fit indices using residuals in structural equation modeling

The asymptotic standard errors of the correlation residuals and Bentler's standardized residuals in covariance structures are derived based on the asymptotic covariance matrix of raw covariance residuals. Using these results, approximations of the asymptotic standard errors of the root mean square residuals for unstandardized or standardized residuals are derived by the delta method. Further, in mean structures, approximations of the asymptotic standard errors of residuals, standardized residuals and their summary statistics are derived in a similar manner. Simulations are carried out, which show that the asymptotic standard errors of the various types of residuals and the root mean square residuals in covariance, correlation and mean structures are close to actual ones.The author is indebted to the reviewers for their comments and suggestions which have led to an improvement of this work.     

Should we rely on the Kenward–Roger approximation when using linear mixed models if the groups have different distributions?

The study explores the robustness to violations of normality and sphericity of linear mixed models when they are used with the Kenward–Roger procedure (KR) in split‐plot designs in which the groups have different distributions and sample sizes are small. The focus is on examining the effect of skewness and kurtosis. To this end, a Monte Carlo simulation study was carried out, involving a split‐plot design with three levels of the between‐subjects grouping factor and four levels of the within‐subjects factor. The results show that: (1) the violation of the sphericity assumption did not affect KR robustness when the assumption of normality was not fulfilled; (2) the robustness of the KR procedure decreased as skewness in the distributions increased, there being no strong effect of kurtosis; and (3) the type of pairing between kurtosis and group size was shown to be a relevant variable to consider when using this procedure, especially when pairing is positive (i.e., when the largest group is associated with the largest value of the kurtosis coefficient and the smallest group with its smallest value). The KR procedure can be a good option for analysing repeated‐measures data when the groups have different distributions, provided the total sample sizes are 45 or larger and the data are not highly or extremely skewed.