Note on the squared multiple correlation as a lower bound to communality

It is demonstrated that the squared multiple correlation of a variable with the remaining variables in a set of variables is a function of the communalities and the squared canonical correlations between the observed variables and common factors. This equation is shown to imply a strict inequality between the squared multiple correlation and communality.     

A note on sufficient conditions that a common factor will be determinate in an infinite domain of variables

It is proved for the common factor model withr common factors that under certain condition s which maintain the distinctiveness of each common factor a given common factor will be determinate if there exists an unlimited number of variables in the model each having an absolute correlation with the factor greater than some arbitrarily small positive quantity.The author is indebted to R. P. McDonald for suggesting the proof of Guttman's determinantal equation for the squared multiple correlation in predicting a factor from the observed variables used in the parenthetical note.     

A note on multiple and canonical correlation for a singular covariance matrix

A weaker generalized inverse (Rao's g-inverse; Graybill's c-inverse) can be used in place of the Moore-Penrose generalized inverse to obtain multiple and canonical correlations from singular covariance matrices.The author expresses his gratitude to a referee for his suggestions.     

The relation between sample and population characteristic vectors

Data are reported which show the statistical relation between the sample and population characteristic vectors of correlation matrices with squared multiple correlations as communality estimates. Sampling fluctuations were found to relate only to differences in the square roots of characteristic roots and to sample size. A principle for determining the number of factors to rotate and interpret after rotation is suggested.This study was supported by the National Science Foundation, Grant GB 4230. The author wishes to express his appreciation for the use of Western Data Processing Center and the Health Sciences Computing Facility, UCLA. He also thanks Dr. Roger Pennell for extremely valuable assistance in a number of phases of the study.     

Iterative least squares estimates of communality: Initial estimate need not affect stabilized value

A common criticism of iterative least squares estimates of communality is that method of initial estimation may influence stabilized values. As little systematic research on this topic has been performed, the criticism appears to be based on cumulated experience with empirical data sets. In the present paper, two studies are reported in which four types of initial estimate (unities, squared multiple correlations, highestr, and zeroes) and four levels of convergence criterion were employed using four widely available computer packages (BMDP, SAS, SPSS, and SOUPAC). The results suggest that initial estimates have no effect on stabilized communality estimates when a stringent criterion for convergence is used, whereas initial estimates appear to affect stabilized values employing rather gross convergence criteria. There were no differences among the four computer packages for matrices without Heywood cases.     

Relationships between two systems of factor analysis

Considering only population values, it is shown that the complete set of factors of a correlation matrix with units in the diagonal cells may be transformed into the factors derived by factoring these correlations with communalities in the diagonal cells. When the correlations are regarded as observed values, the common factors derived as a transformation of the complete set of factors of the correlation matrix with units in the diagonal cells satisfy Lawley's requirement for a maximum likelihood solution and are a first approximation to Rao's canonical factors.     

The relation between results obtainable with raw and corrected correlation coefficients in multiple factor analysis

This paper presents three theorems concerning the relation between results with obtained and corrected correlation coefficients in the Thurstone method of multiple factor analysis. (1) The rank of the correlational matrix, and thus the number of factors involved, is unaffected by correcting the obtained coefficients for attenuation. (2) The communality of a variable when the obtained coefficients have been corrected for attenuation is equal to the communality with obtained coefficients divided by the reliability coefficient of the variable. (3) The relationship is shown between the factorial matrix of a correlational matrix of raw correlation coefficients and the factorial matrix of a correlational matrix of corrected correlation coefficients, and a method of obtaining either of these factorial matrices from the other is indicated.     

Obtaining squared multiple correlations from a correlation matrix which may be singular

A theorem is presented relating the squared multiple correlation of each measure in a battery with the other measures to the unique generalized inverse of the correlation matrix. This theorem is independent of the rank of the correlation matrix and may be utilized for singular correlation matrices. A coefficient is presented which indicates whether the squared multiple correlation is unity or not. Note that not all measures necessarily have unit squared multiple correlations with the other measures when the correlation matrix is singular. Some suggestions for computations are given for simultaneous determination of squared multiple correlations for all measures.The research reported in this paper was supported by the Personnel and Training Branch of the Office of Naval Research under Contract Number 00014-67-A-0305-0003 with the University of Illinois.     

On Green's best linear composites with a specified structure,and oblique estimates of factor scores

Green solved the problem of least-squares estimation of several criteria subject to the constraint that the estimates have an arbitrary fixed covariance or correlation matrix. In the present paper an omission in Green's proof is discussed and resolved. Furthermore, it is shown that some recently published solutions for estimating oblique factor scores are special cases of Green's solution for the case of fixed covariance matrices.     

Exploratory second-order analyses for components and factors

Abstract: Exploratory methods using second‐order components and second‐order common factors were proposed. The second‐order components were obtained from the resolution of the correlation matrix of obliquely rotated first‐order principal components. The standard errors of the estimates of the second‐order component loadings were derived from an augmented information matrix with restrictions for the loadings and associated parameters. The second‐order factor analysis proposed was similar to the classical method in that the factor correlations among the first‐order factors were further resolved by the exploratory method of factor analysis. However, in this paper the second‐order factor loadings were estimated by the generalized least squares using the asymptotic variance‐covariance matrix for the first‐order factor correlations. The asymptotic standard errors for the estimates of the second‐order factor loadings were also derived. A numerical example was presented with simulated results.     

Some properties of the communality in multiple factor theory

Several theorems concerning properties of the communaltiy of a test in the Thurstone multiple factor theory are established. The following theorems are applicable to a battery ofn tests which are describable in terms ofr common factors, with orthogonal reference vectors.1. The communality of a testj is equal to the square of the multiple correlation of testj with ther reference vectors.2. The communality of a testj is equal to the square of the multiple correlation of testj with ther reference vectors and then—1 remaining tests. Corollary: The square of the multiple correlation of a testj with then—1 remaining tests is equal to or less than the communality of testj. It cannot exceed the communality.3. The square of the multiple correlation of a testj with then—1 remaining tests equals the communality of testj if the group of tests containsr statistically independent ests teach with a communality of unity.4. With correlation coefficients corrected for attenuation, when the number of tests increases indefinitely while the rank of the correlational matrix remains unchanged, the communality of a testj equals the square of the multiple correlation of testj with then—1 remaining tests.5. With raw correlation coefficients, it is shown in a special case that the square of the multiple correlation of a testj with then—1 remaining tests approaches the communality of testj as a limit when the number of tests increases indefinitely while the rank of correlational matrix remains the same. This has not yet been proved for the general case.The author wishes to express his appreciation of the encouragement and assistance given him by Dr. L. L. Thurstone.     

Note on the squared multiple correlation as a lower bound to communality

A simple proof that the squared multiple correlation of a variable with the remaining variables in the set of variables is a lower bound to the communality of that variable is presented.     

Formulas for component scores

General formulas for obtaining scores for individuals on components (factors derived from correlation matrices with unit communality estimates) are given. They are specialized to give Hotelling's formula for principal component scores. Formulas for scores on components rotated from principal components are developed.The final version of this paper was prepared while the author was a U. S. Public Health Service Fellow at the Center for Advanced Study in the Behavioral Sciences.     

Some relationships between factors and components

The asymptotic correlations between the estimates of factor and component loadings are obtained for the exploratory factor analysis model with the assumption of a multivariate normal distribution for manifest variables. The asymptotic correlations are derived for the cases of unstandardized and standardized manifest variables with orthogonal and oblique rotations. Based on the above results, the asymptotic standard errors for estimated correlations between factors and components are derived. Further, the asymptotic standard error of the mean squared canonical correlation for factors and components, which is an overall index for the closeness of factors and components, is derived. The results of a Monte Carlo simulation are presented to show the usefulness of the asymptotic results in the data with a finite sample size.The author is indebted to anonymous referees for their comments, corrections and suggestions which have led to the improvement of this article.     

Properties of the maximum likelihood solution in factor analysis regression

Algebraic properties of the normal theory maximum likelihood solution in factor analysis regression are investigated. Two commonly employed measures of the within sample predictive accuracy of the factor analysis regression function are considered: the variance of the regression residuals and the squared correlation coefficient between the criterion variable and the regression function. It is shown that this within sample residual variance and within sample squared correlation may be obtained directly from the factor loading and unique variance estimates, without use of the original observations or the sample covariance matrix.     

Information Matrices and Standard Errors for MLEs of Item Parameters in IRT

The paper clarifies the relationship among several information matrices for the maximum likelihood estimates (MLEs) of item parameters. It shows that the process of calculating the observed information matrix also generates a related matrix that is the middle piece of a sandwich-type covariance matrix. Monte Carlo results indicate that standard errors (SEs) based on the observed information matrix are robust to many, but not all, conditions of model/distribution misspecifications. SEs based on the sandwich-type covariance matrix perform most consistently across conditions. Results also suggest that SEs based on other matrices are either not consistent or perform not as robust as those based on the sandwich-type covariance matrix or the observed information matrix.     

Four Covariance Structure Models for Canonical Correlation Analysis: A COSAN Modeling Approach

The mathematical connection between canonical correlation analysis (CCA) and covariance structure analysis was first discussed through the Multiple Indicators and Multiple Causes (MIMIC) approach. However, the MIMIC approach has several technical and practical challenges. To address these challenges, a comprehensive COSAN modeling approach is proposed. Specifically, we define four COSAN-CCA models to correspond with four possible combinations of the data to be analyzed and the unique parameters to be estimated. In terms of the data, one can analyze either the unstandardized or standardized variables. In terms of the unique parameters, one can estimate either the weights or loadings. Besides the unique parameters of each COSAN-CCA model, all four COSAN-CCA models also estimate the canonical correlations as their common parameters. Taken together, the four COSAN-CCA models provide the correct point estimates and standard error estimates for all commonly used CCA parameters. Two numeric examples are used to compare the standard error estimates obtained from the MIMIC approach and the COSAN modeling approach. Moreover, the standard error estimates from the COSAN modeling approach are validated by a simulation study and the asymptotic theory. Finally, software implementation and future extensions are discussed.     

The Infinitesimal Jackknife with Exploratory Factor Analysis

The infinitesimal jackknife, a nonparametric method for estimating standard errors, has been used to obtain standard error estimates in covariance structure analysis. In this article, we adapt it for obtaining standard errors for rotated factor loadings and factor correlations in exploratory factor analysis with sample correlation matrices. Both maximum likelihood estimation and ordinary least squares estimation are considered.