A Comparative Investigation of Rotation Criteria Within Exploratory Factor Analysis

Exploratory factor analysis (EFA) is a commonly used statistical technique for examining the relationships between variables (e.g., items) and the factors (e.g., latent traits) they depict. There are several decisions that must be made when using EFA, with one of the more important being choice of the rotation criterion. This selection can be arduous given the numerous rotation criteria available and the lack of research/literature that compares their function and utility. Historically, researchers have chosen rotation criteria based on whether or not factors are correlated and have failed to consider other important aspects of their data. This study reviews several rotation criteria, demonstrates how they may perform with different factor pattern structures, and highlights for researchers subtle but important differences between each rotation criterion. The choice of rotation criterion is critical to ensure researchers make informed decisions as to when different rotation criteria may or may not be appropriate. The results suggest that depending on the rotation criterion selected and the complexity of the factor pattern matrix, the interpretation of the interfactor correlations and factor pattern loadings can vary substantially. Implications and future directions are discussed.     

Rotation in the dynamic factor modeling of multivariate stationary time series

A special rotation procedure is proposed for the exploratory dynamic factor model for stationary multivariate time series. The rotation procedure applies separately to each univariate component series of aq-variate latent factor series and transforms such a component, initially represented as white noise, into a univariate moving-average. This is accomplished by minimizing a so-called state-space criterion that penalizes deviations of the rotated solution from a generalized state-space model with only instantaneous factor loadings. Alternative criteria are discussed in the closing section. The results of an empirical application are presented in some detail.This research was supported by the Institute for Developmental and Health Research Methodology, University of Virginia.     

A simple general method for oblique rotation

A simple and very general algorithm for oblique rotation is identified. While motivated by the rotation problem in factor analysis, it may be used to minimize almost any function of a not necessarily square matrix whose columns are restricted to have unit length. The algorithm has two steps. The first is to compute the gradient of the rotation criterion and the second is to project this onto a manifold of matrices with unit length columns. For this reason it is called a gradient projection algorithm. Because the projection step is very simple, implementation of the algorithm involves little more than computing the gradient of the rotation criterion which for many applications is very simple. It is proven that the algorithm is strictly monotone, that is as long as it is not already at a stationary point, each step will decrease the value of the criterion. Examples from a variety of areas are used to demonstrate the algorithm, including oblimin rotation, target rotation, simplimax rotation, and rotation to similarity and simplicity simultaneously. While it may be, the algorithm is not intended for use as a standard algorithm for well established problems, but rather as a tool for investigating new methods where its generality and simplicity may save an investigator substantial effort.The author would like to thank the review team for their insights and recommendations.     

Simplimax: Oblique rotation to an optimal target with simple structure

Factor analysis and principal component analysis are usually followed by simple structure rotations of the loadings. These rotations optimize a certain criterion (e.g., varimax, oblimin), designed to measure the degree of simple structure of the pattern matrix. Simple structure can be considered optimal if a (usually large) number of pattern elements is exactly zero. In the present paper, a class of oblique rotation procedures is proposed to rotate a pattern matrix such that it optimally resembles a matrix which has an exact simple pattern. It is demonstrated that this method can recover relatively complex simple structures where other well-known simple structure rotation techniques fail.This research has been made possible by a fellowship from the Royal Netherlands Academy of Arts and Sciences. The author is obliged to Jos ten Berge for helpful comments on an earlier version.     

Factor structure and measurement invariance of the Women's Health Initiative Insomnia Rating Scale

As part of the Women's Health Initiative Study, the 5-item Women's Health Initiative Insomnia Rating Scale (WHIIRS) was developed. This article summarizes the development of the scale through the use of responses from 66,269 postmenopausal women (mean age = 62.07 years, SD = 7.41 years). All women completed a 10-item questionnaire concerning sleep. A novel resampling technique was introduced as part of the data analysis. Principal-axes factor analysis without iteration and rotation to a varimax solution was conducted for 120,000 random samples of 1,000 women each. Use of this strategy led to the development of a scale with a highly stable factor structure. Structural equation modeling revealed no major differences in factor structure across age and race-ethnic groups. WHIIRS norms for race-ethnicity and age subgroups are detailed.     

Orthogonal procrustes rotation maximizing congruence

Procedures for assessing the invariance of factors found in data sets using different subjects and the same variables are often using the least squares criterion, which appears to be too restrictive for comparing factors.Tucker's coefficient of congruence, on the other hand, is more closely related to the human interpretation of factorial invariance than the least squares criterion. A method maximizing simultaneously the sum of coefficients of congruence between two matrices of factor loadings, using orthogonal rotation of one matrix is presented. As shown in examples, the sum of coefficients of congruence obtained using the presented rotation procedure is slightly higher than the sum of coefficients of congruence using Orthogonal Procrustes Rotation based on the least squares criterion.The author is obliged to Lewis R. Goldberg for critically reviewing the first draft of this paper.     

The simultaneous maximization of congruence for two or more matrices under orthogonal rotation

While a rotation procedure currently exists to maximize simultaneously Tucker's coefficient of congruence between corresponding factors of two factor matrices under orthogonal rotation of one factor matrix, only approximate solutions are known for the generalized case where two or more matrices are rotated. A generalization and modification of the existing rotation procedure to simultaneously maximize the congruence is described. An example using four data matrices, comparing the generalized congruence maximization procedure with alternative rotation procedures, is presented. The results show a marked improvement of the obtained congruence using the generalized congruence maximization procedure compared to other procedures, without a significant loss of success with respect to the least squares criterion. A computer program written by the author to perform the rotations is briefly discussed.     

A cluster‐based factor rotation

A new oblique factor rotation method is proposed, the aim of which is to identify a simple and well‐clustered structure in a factor loading matrix. A criterion consisting of the complexity of a factor loading matrix and a between‐cluster dissimilarity is optimized using the gradient projection algorithm and the k‐means algorithm. It is shown that if there is an oblique rotation of an initial loading matrix that has a perfect simple structure, then the proposed method with Kaiser's normalization will produce the perfect simple structure. Although many rotation methods can also recover a perfect simple structure, they perform poorly when a perfect simple structure is not possible. In this case, the new method tends to perform better because it clusters the loadings without requiring the clusters to be perfect. Artificial and real data analyses demonstrate that the proposed method can give a simple structure, which the other methods cannot produce, and provides a more interpretable result than those of widely known rotation techniques.     

A general rotation criterion and its use in orthogonal rotation

Measures of test parsimony and factor parsimony are defined. Minimizing their weighted sum produces a general rotation criterion for either oblique or orthogonal rotation. The quartimax, varimax and equamax criteria are special cases of the expression. Two new criteria are developed. One of these, the parsimax criterion, apparently gives excellent results. It is argued that one of the most important factors bearing on the choice of a rotation criterion for a particular problem is the amount of information available on the number of factors that should be rotated. This research was supported by the National Research Council of Canada research grant 291-13 to Dr. G. A. Ferguson.     

Exploratory Bi-factor Analysis: The Oblique Case

Bi-factor analysis is a form of confirmatory factor analysis originally introduced by Holzinger and Swineford (Psychometrika 47:41?C54, 1937). The bi-factor model has a general factor, a number of group factors, and an explicit bi-factor structure. Jennrich and Bentler (Psychometrika 76:537?C549, 2011) introduced an exploratory form of bi-factor analysis that does not require one to provide an explicit bi-factor structure a priori. They use exploratory factor analysis and a bifactor rotation criterion designed to produce a rotated loading matrix that has an approximate bi-factor structure. Among other things this can be used as an aid in finding an explicit bi-factor structure for use in a confirmatory bi-factor analysis. They considered only orthogonal rotation. The purpose of this paper is to consider oblique rotation and to compare it to orthogonal rotation. Because there are many more oblique rotations of an initial loading matrix than orthogonal rotations, one expects the oblique results to approximate a bi-factor structure better than orthogonal rotations and this is indeed the case. A surprising result arises when oblique bi-factor rotation methods are applied to ideal data.     

Exploratory Bi-Factor Analysis

Bi-factor analysis is a form of confirmatory factor analysis originally introduced by Holzinger. The bi-factor model has a general factor and a number of group factors. The purpose of this paper is to introduce an exploratory form of bi-factor analysis. An advantage of using exploratory bi-factor analysis is that one need not provide a specific bi-factor model a priori. The result of an exploratory bi-factor analysis, however, can be used as an aid in defining a specific bi-factor model. Our exploratory bi-factor analysis is simply exploratory factor analysis using a bi-factor rotation criterion. This is a criterion designed to produce perfect cluster structure in all but the first column of a rotated loading matrix. Examples are given to show how exploratory bi-factor analysis can be used with ideal and real data. The relation of exploratory bi-factor analysis to the Schmid-Leiman method is discussed.     

The prediction of averages

Criterion measures are frequently obtained by averaging ratings, but the number and kind of ratings available may differ from individual to individual. This raises issues as to the appropriateness of any single regression equation, about the relation of variance about regression to number and kind of criterion observations, and about the preferred estimate of regression parameters. It is shown that if criterion ratings all have the same true score the regression equation for predicting the average is independent of the number and kind of criterion scores averaged.Two cases are distinguished, one where criterion measures are assumed to have the same true score, and the other where criterion measures have the same magnitude of error of measurement as well. It is further shown that the variance about regression is a function of the number and kind of criterion ratings averaged, generally decreasing as the number of measures averaged increases. Maximum likelihood estimates for the regression parameters are derived for the two cases, assuming a joint normal distribution for predictors and criterion average within each subpopulation of persons for whom the same type of criterion average is available.     

A General Approach for Fitting Pure Exploratory Bifactor Models

This article proposes a procedure for fitting a pure exploratory bifactor solution in which the general factor is orthogonal to the group factors, but the loadings on the group factors can satisfy any orthogonal or oblique rotation criterion. The proposal combines orthogonal Procrustes rotations with analytical rotations and consists of a sequence of four steps. The basic input is a semispecified target matrix that can be (a) defined by the user, (b) obtained by using Schmid-Leiman orthogonalization, or (c) automatically built from a conventional unrestricted solution based on a prescribed number of factors. The relevance of the proposal and its advantages over existing procedures is discussed and assessed via simulation. Its feasibility in practice is illustrated with two empirical examples in the personality domain.     

探索性结构方程建模(ESEM):EFA和CFA的整合

探索性结构方程建模(ESEM)是在测量模型部分使用了类似于EFA模型的SEM.作为一种高级统计方法,ESEM整合了EFA和CFA两种因子分析方法的功能和优点.通过ESEM,研究者既可以灵活地探索因子结构,又可以系统地验证因子模型,为潜变量的关系分析提供更适宜的测量模型.ESEM已经在某些社科领域的研究中得到应用,是一种值得推介的因子分析方法.ESEM的具体应用问题,例如因子旋转方法的选用、测验信度评价等,仍有待探讨.     

Psychometric Properties of the WHOQOL-BREF Questionnaire among Disabled Students in Malaysian Higher Learning Institutions

This study aims to evaluate reliability, internal consistency and dimensional structure of the World Health Organization Quality of Life (WHOQOL-BREF) among disabled students. The study covers 127 disabled students studying in public universities, 26 in private universities, 109 in polytechnic and 19 studying in community colleges. The World Health Organization Quality of Life Abbreviation (WHOQOL-BREF) has been used to assess QOL. The reliability and validity of the questionnaire were evaluated by Cronbach’s alpha (α) and Pearson’s correlation coefficients. Alpha scores greater than or equal to 0.6 are considered to denote acceptable and adequate internal consistency. Correlation matrix also showed satisfactory results in all domains. Factor analysis was carried out using the principal components method with varimax rotation to examine the dimensional structure of the questionnaire. This study has provided some preliminary evidence of the reliability and validity of the WHOQOL-BREF to be used for evaluating quality of life among disabled students.     

Two-dimensional Langevin approach to the human stabilogram

Two-dimensional Langevin equation is considered as a model of the center of pressure (COP) random walk at quiet standing condition. The matrix of the mean square displacement describes quantitatively the COP random walk. Twenty-six young subjects were included in the study. Elements of the matrix of the mean square displacement derived from experimental data are well approximated by theoretical expressions derived from the Langevin equation, in the short-term regime. We have studied statistical properties of the COP displacements. Non-Gaussian behaviour of the displacements is indicated by the characteristic functions. New coordinate system constituted and utilised by the postural control system (PCS) was found for every subject. This new coordinate system is turned with respect to the system defined by the anatomy of the body. In this new coordinate system the matrix of the mean square displacement takes the form close to diagonal. The status of PCS in this new coordinate system can be quantified by the elements of the diffusion matrix, which are the measure of the stochastic activity of that system, rotation angle of new coordinate system and the friction coefficient. We have applied this analysis to examine how the visual inputs affect the PCS. We have found that the stochastic activity of the PCS increases after exclusion of the visual inputs. We have also shown that the visual system does not affect the friction coefficient. Furthermore, we have found that orientation of the new coordinate system chosen by PCS at included visual inputs differs from the orientation at excluded visual inputs.     

Derivative free gradient projection algorithms for rotation

A simple modification substantially simplifies the use of the gradient projection (GP) rotation algorithms of Jennrich (2001, 2002). These algorithms require subroutines to compute the value and gradient of any specific rotation criterion of interest. The gradient can be difficult to derive and program. It is shown that using numerical gradients gives almost precisely the same results as using exact gradients. The resulting algorithm is very easy to use because the only problem specific code required is that needed to define the rotation criterion. The computing time is increased when using numerical gradients, but it is still very modest for most purposes. While used extensively elsewhere, numerical derivatives seem to be underutilized in statistics.     

Procrustes matching by congruence coefficients

Matching by Procrustes methods involves the transformation of one matrix to match with another. A special least squares criterion, the congruence coefficient, has advantages as a criterion for some factor analytic interpretations. A Procrustes method maximizing the congruence coefficient is given. This solution is identical to Mosier's [1939] approximate solution, but is an exact solution for maximum congruence.     

A note on a matrix criterion for unique colorability of a signed graph

A signed graph,S, is colorable if its point set can be partitioned into subsets such that all positive lines join points of the same subset and all negative lines join points of different subsets.S is uniquely colorable if there is only one such partition. Developed in this note is a new matrix, called thetype matrix ofS, which provides a classification of the way pairs of points are joined inS. Such a classification yields a criterion for colorability and unique colorability.The work reported here was supported by Grant MH 10834 from the National Institute of Mental Health.