The relationship between external variables and common factors

A theorem is presented which gives the range of possible correlations between a common factor and an external variable (i.e., a variable not included in the test battery factor analyzed). Analogous expressions for component (and regression component) theory are also derived. Some situations involving external correlations are then discussed which dramatize the theoretical differences between components and common factors.Support by the National Research Council of Canada (NRC Grant No. A4640) and the University of British Columbia (UBC Humanities and Social Sciences Grant 26-9718) is gratefully acknowledged.This paper is based in part on the author's Ph.D. dissertation. I am particularly grateful to my dissertation advisor, Dr. Peter H. Schönemann. Thanks also to the editor and the anonymous reviewers, who contributed many helpful comments and suggestions.     

The effect of additional variables on factor indeterminacy in models with a single common factor

Determinate solutions for the indeterminate common factor ofp variables satisfying the single common factor model are not unique. Therefore an infinite sequence of additional variables that conform jointly with the originalp variables to the original single common factor model does not determine a unique solution for the indeterminate factor of thep variables (although the solution is unique for the factor of the infinite sequence). Other infinite sequences may be found to determine different solutions for the factor of the originalp variables. The paper discusses a number of theorems about the effects of additional variables on factor indeterminacy in a model with a single common factor and draws conclusions from them for factor theory in general.     

A note on the factor analysis of partial covariance matrices

A relationship is given between the joint common factor structure of two sets of variables, and the factor structure of the partial covariance matrix of one of the sets with the other partialled out.     

A note on the identification of restricted factor loading matrices

It is shown that problems of rotational equivalence of restricted factor loading matrices in orthogonal factor analysis are equivalent to problems of identification in simultaneous equations systems with covariance restrictions. A necessary (under a regularity assumption) and sufficient condition for local uniqueness is given and a counterexample is provided to a theorem by J. Algina concerning necessary and sufficient conditions for global uniqueness.     

A note on identification in the oblique and orthogonal factor analysis models

Conditions for removing the indeterminancy due to rotation are given for both the oblique and orthogonal factor analysis models. The conditions indicate why published counterexamples to conditions discussed by Jöreskog are not identifiable.The author would like to thank Gordon Bechtel and the reviewers for their comments and suggestions.     

In Spite of Indeterminacy Many Common Factor Score Estimates Yield an Identical Reproduced Covariance Matrix

It was investigated whether commonly used factor score estimates lead to the same reproduced covariance matrix of observed variables. This was achieved by means of Schönemann and Steiger’s (1976) regression component analysis, since it is possible to compute the reproduced covariance matrices of the regression components corresponding to different factor score estimates. It was shown that Thurstone’s, Ledermann’s, Bartlett’s, Anderson-Rubin’s, McDonald’s, Krijnen, Wansbeek, and Ten Berge’s, as well as Takeuchi, Yanai, and Mukherjee’s score estimates reproduce the same covariance matrix. In contrast, Harman’s ideal variables score estimates lead to a different reproduced covariance matrix.     

The nonconvergence of factals: A nonmetric common factor analysis

FACTALS is a nonmetric common factor analysis model for multivariate data whose variables may be nominal, ordinal or interval. In FACTALS an Alternating Least Squares algorithm is utilized which is claimed to be monotonically convergent.In this paper it is shown that this algorithm is based upon an erroneous assumption, namely that the least squares loss function (which is in this case a nonscale free loss function) can be transformed into a scalefree loss function. A consequence of this is that monotonical convergence of the algorithm can not be guaranteed.     

A note on structural models for the circumplex

Jöreskog (1974) developed a latent variable model for the covariance structure of the circumplex which, under certain conditions, includes a model for a patterned correlation matrix (Browne, 1977). This model is of limited usefulness, however, in that it employs a known matrix that is rank deficient for many problems. Furthermore, the model is inappropriate for the circumplex which contains negative covariances. This paper presents alternative models for the perfect circumplex and quasi-circumplex that avoids these difficulties, and that includes the important model for a patterned correlation circumplex matrix. Two numerical examples are provided.This research was supported in part by a grant from the Graduate School of the University of Minnesota. I wish to thank M. W. Browne for suggesting the final model presented in this paper. James Steiger and the Editor also made several valuable suggestions.     

A note on the minres method

This paper discusses the advantages and problems related to factor analysis by minimizing residuals (minres). It is shown that this method fails if the starting point of iterations is not well chosen. A suitable starting point is suggested.     

A note on residual M-distances for identifying aberrant response patterns

Although a statistical model might fit well to a large proportion of the individuals of a random sample, some individuals might give ‘unusual’ responses that are not well explained by the hypothesized model. If individual responses are given as continuous response vectors, M-distances can be used to produce real valued indicators of how well an individual's response vector corresponds to a covariance structure implied by a psychometric model. In this note, we focus on the so-called one-factor model. Two M-distances, d_si and d_ri, which are sensitive to different aspects of the assumed factor model, have been proposed. While one of the M-distances, d_ri, has been derived based on Bartlett factor scores, in this note we show that the second M-distance, d_si, can be derived in an analogous fashion based on Thomson factor scores.     

Simultaneous factor analysis of dichotomous variables in several groups

A new method is proposed for a simultaneous factor analysis of dichotomous responses from several groups of individuals. The method makes it possible to compare factor loading pattern, factor variances and covariances, and factor means over groups. The method uses information from first and second order proportions and estimates the model by generalized least-squares. Hypotheses regarding different degrees of invariance over groups may be evaluated by a large-sample chi-square test.The research of the first author was supported partly by the Bank of Sweden Tercentenary Foundation under project Structural Equation Models in the Social Sciences, project director Karl G. Jöreskog, and partly by the Swedish Research Council in the Humanistic and Social Sciences under project Analysis of Contingency Tables, project director Bengt Muthén.     

Classical test theory based and factor analytic structural models for analyzing change: A note on differences and similarities

This note is concerned with differences and similarities between structural models for analyzing change, which are conceptualized within two different modelling traditions: the one based on the classical test theory, and that within the factor-analytic approach. It is shown that these two possibilities lead to models for studying change, which are indistinguishable when using for data analytic purposes structural modeling programs, such as LISREL, EQS, COSAN, LISCOMP, RAMONA, EzPATH, SAS PROC CALIS. The reason for this data-analytic equivalence of the two conceptually different types of models is the confounding of their differences in the corresponding implied covariance matrix structures.     

Selection of variables in exploratory factor analysis: An empirical comparison of a stepwise and traditional approach

The purpose of this study was to investigate and compare the performance of a stepwise variable selection algorithm to traditional exploratory factor analysis. The Monte Carlo study included six factors in the design; the number of common factors; the number of variables explained by the common factors; the magnitude of factor loadings; the number of variables not explained by the common factors; the type of anomaly evidenced by the poorly explained variables; and sample size. The performance of the methods was evaluated in terms of selection and pattern accuracy, and bias and root mean squared error of the structure coefficients. Results indicate that the stepwise algorithm was generally ineffective at excluding anomalous variables from the factor model. The poor selection accuracy of the stepwise approach suggests that it should be avoided.     

A note on Freeman's measure of association for relating an ordered to an unordered factor

Within the context of a contingency table, this note describes the relationship between Freeman's measure of association and the asymmetric association measures developed by Somers. The coefficient is appropriate for a contingency table in which the levels of one factor are ordered and the levels of the other factor are unordered; the indices defined by Somers are usually used when the levels of both factors are ordered and one is assumed to be the independent factor.     

A note on a sufficiency condition for uniqueness of a restricted factor matrix

A counterexample is produced to a conjecture by K. G. Jöreskog concerning sufficiency conditions for uniqueness of a restricted factor matrix. A substitute condition is stated and proved for the most common situation where the restricted elements are specified to be zero.     

On the relationship between sources of within- and between-group differences and measurement invariance in the common factor model

Investigating sources of within- and between-group differences and measurement invariance (MI) across groups is fundamental to any meaningful group comparison based on observed test scores. It is shown that by placing certain restrictions on the multigroup confirmatory factor model, it is possible to investigate the hypothesis that within- and between-group differences are due to the same factors. Moreover, the modeling approach clarifies that absence of measurement bias implies common sources of within- and between-group variation. It is shown how the influence of background variables can be incorporated in the model. The advantages of the modeling approach as compared with other commonly used methods for group comparisons is discussed and illustrated by means of an analysis of empirical data.     

A bayesian estimation of factor score in confirmatory factor model with polytomous, censored or truncated data

The posterior analysis in estimating factor score in a confirmatory factor analysis model with polytomous, censored or truncated data is investigated in this paper. For the above three types of data, posterior distributions of the factor score are studied, and the estimators of the factor score are obtained to be the location parameters of the posterior distributions. The accuracy of Bayesian estimates is studied via simulation studies.This research was supported by a Hong Kong UGC grant.