Generalizations of the partial,part and bipartial canonical correlation analysis

Theg ₁- andg ₂-bipartial canonical correlation analyses are developed as generalizations of the partial, part, and bipartial canonical correlation analysis. Illustrative examples are provided.     

Influence in canonical correlation analysis

The perturbation theory of the generalized eigenproblem is used to derive influence functions of each squared canonical correlation coefficient and the corresponding canonical vector pair. Three sample versions of these functions are described and some properties are noted. As particular applications, the influence function of the squared multiple correlation coefficient and influence functions of eigenvalues and eigenvectors in correspondence analysis are obtained. Three numerical examples are briefly discussed.We thank the Editor and the anonymous reviewers for their helpful comments. This research was carried out with the financial support of the Italian Ministry of the University and the National Research Council.     

Part and bipartial canonical correlation analysis

Extending the definitions of part and bipartial correlation to sets of variates, the notion of part and bipartial canonical correlation analysis are developed and illustrated.     

The second order approximation to sample influence curve in canonical correlation analysis

A second order approximation to the sample influence curve (SIC) in canonical correlation analysis has been derived in the literature. However, it does not seem satisfactory for some cases. In this paper, we present a more accurate second order approximation. As a particular case, the proposed method is exact for the SIC of the squared multiple correlation coefficient. An example is given. The authors are most grateful to the associate editor and three reviewers for valuable comments and suggestions which improved the presentation of the paper considerably. The first author was partly supported by a RGC earmarked research grant of Hong Kong.     

Interpreting canonical correlation analysis through biplots of structure correlations and weights

This paper extends the biplot technique to canonical correlation analysis and redundancy analysis. The plot of structure correlations is shown to the optimal for displaying the pairwise correlations between the variables of the one set and those of the second. The link between multivariate regression and canonical correlation analysis/redundancy analysis is exploited for producing an optimal biplot that displays a matrix of regression coefficients. This plot can be made from the canonical weights of the predictors and the structure correlations of the criterion variables. An example is used to show how the proposed biplots may be interpreted.     

Generalized canonical correlation analysis of matrices with missing rows: a simulation study

A method is presented for generalized canonical correlation analysis of two or more matrices with missing rows. The method is a combination of Carroll’s (1968) method and the missing data approach of the OVERALS technique (Van der Burg, 1988). In a simulation study we assess the performance of the method and compare it to an existing procedure called GENCOM, proposed by Green and Carroll (1988). We find that the proposed method outperforms the GENCOM algorithm both with respect to model fit and recovery of the true structure. The research of Michel van de Velden was partly funded through EU Grant HPMF-CT-2000-00664. The authors would like to thank the associate editor and three anonymous referees for their constructive comments and suggestions that led to a considerable improvement of the paper.     

Redundancy analysis an alternative for canonical correlation analysis

A component method is presented maximizing Stewart and Love's redundancy index. Relationships with multiple correlation and principal component analysis are pointed out and a rotational procedure for obtaining bi-orthogonal variates is given. An elaborate example comparing canonical correlation analysis and redundancy analysis on artificial data is presented.A Fortran IV program for the method of redundancy analysis described in this paper can be obtained from the author upon request.     

Some symmetric,invariant measures of multivariate association

A distinction is drawn between redundancy measurement and the measurement of multivariate association for two sets of variables. Several measures of multivariate association between two sets of variables are examined. It is shown that all of these measures are generalizations of the (univariate) squared-multiple correlation; all are functions of the canonical correlations, and all are invariant under linear transformations of the original sets of variables. It is further shown that the measures can be considered to be symmetric and are strictly ordered for any two sets of observed variables. It is suggested that measures of multivariate relationship may be used to generalize the concept of test reliability to the case of vector random variables.     

Range restrictions for product-moment correlation matrices

It is well-known that for a trivariate distribution if two correlations are fixed the remaining one is constrained. Indeed, if one correlation is fixed, then the remaining two are constrained. Both results are extended to the case of a multivariate distribution. The results are applied to some special patterned matrices.     

Robust canonical discriminant analysis

A method for robust canonical discriminant analysis via two robust objective loss functions is discussed. These functions are useful to reduce the influence of outliers in the data. Majorization is used at several stages of the minimization procedure to obtain a monotonically convergent algorithm. An advantage of the proposed method is that it allows for optimal scaling of the variables. In a simulation study it is shown that under the presence of outliers the robust functions outperform the ordinary least squares function, both when the underlying structure is linear in the variables as when it is nonlinear. Furthermore, the method is illustrated with empirical data.The research of the first author was supported by the Netherlands Organization of Scientific Research (NWO grant 560-267-029).     

Least-squares approximation of an improper correlation matrix by a proper one

An algorithm is presented for the best least-squares fitting correlation matrix approximating a given missing value or improper correlation matrix. The proposed algorithm is based upon a solution for Mosier's oblique Procrustes rotation problem offered by ten Berge and Nevels. A necessary and sufficient condition is given for a solution to yield the unique global minimum of the least-squares function. Empirical verification of the condition indicates that the occurrence of non-optimal solutions with the proposed algorithm is very unlikely. A possible drawback of the optimal solution is that it is a singular matrix of necessity. In cases where singularity is undesirable, one may impose the additional nonsingularity constraint that the smallest eigenvalue of the solution be , where is an arbitrary small positive constant. Finally, it may be desirable to weight the squared errors of estimation differentially. A generalized solution is derived which satisfies the additional nonsingularity constraint and also allows for weighting. The generalized solution can readily be obtained from the standard unweighted singular solution by transforming the observed improper correlation matrix in a suitable way.     

Global optimality of the successive Maxbet algorithm

The Maxbet method is an alternative to the method of generalized canonical correlation analysis and of Procrustes analysis. Contrary to these methods, it does not maximize the inner products (covariances) between linear composites, but also takes their sums of squares (variances) into account. It is well-known that the Maxbet algorithm, which has been proven to converge monotonically, may converge to local maxima. The present paper discusses an eigenvalue criterion which is sufficient, but not necessary for global optimality. However, in two special cases, the eigenvalue criterion is shown to be necessary and sufficient for global optimality. The first case is when there are only two data sets involved; the second case is when the inner products between all variables involved are positive, regardless of the number of data sets.The authors are obliged to Henk Kiers for critical comments on a previous draft.     

Note on the squared multiple correlation as a lower bound to communality

It is demonstrated that the squared multiple correlation of a variable with the remaining variables in a set of variables is a function of the communalities and the squared canonical correlations between the observed variables and common factors. This equation is shown to imply a strict inequality between the squared multiple correlation and communality.     

Testing the significance of the successive components in redundancy analysis

In this paper we study the interrelationships between two sets of data measured on the same subjects via redundancy analysis. We consider redundancy analysis from an inferential point of view. Under the hypothesis of multinormality, tests of significance are obtained for each successive redundancy component so that only the significant factors are retained for prediction purposes. An example illustrates the method. The authors would like to thank the Editor and the referees for their helpful comments. This research has been partly financed by NSERC (Canada).     

A note on Roy's largest root

The name Roy's largest root and similar names are used in practice to label two different but functionally related statistics—one proportional to anF, and the other, a squared canonical correlation. This note presents the logic that leads to the two formulations, states which statistic some popular statistical packages use, and shows the possible source of this inconsistency in the original work of Roy (1953) and Heck (1960).     

Canonical Correlation and Chi-Square: Relationships and Interpretation

A 2 × 2 chi-square can be computed from a phi coefficient, which is the Pearson correlation between two binomial variables. Similarly, chi-square for larger contingency tables can be computed from canonical correlation coefficients. The authors address the following series of issues involving this relationship: (a) how to represent a contingency table in terms of a correlation matrix involving r - 1 row and c - 1 column dummy predictors; (b) how to compute chi-square from canonical correlations solved from this matrix; (c) how to compute loadings for the omitted row and column variables; and (d) the possible interpretive advantage of describing canonical relationships that comprise chi-square, together with some examples. The proposed procedures integrate chi-square analysis of contingency tables with general correlational theory and serve as an introduction to some recent methods of analysis more widely known by sociologists.     

Canonical/redundancy factoring analysis

The interrelationships between two sets of measurements made on the same subjects can be studied by canonical correlation. Originally developed by Hotelling [1936], the canonical correlation is the maximum correlation betweenlinear functions (canonical factors) of the two sets of variables. An alternative statistic to investigate the interrelationships between two sets of variables is the redundancy measure, developed by Stewart and Love [1968]. Van Den Wollenberg [1977] has developed a method of extracting factors which maximize redundancy, as opposed to canonical correlation.A component method is presented which maximizes user specified convex combinations of canonical correlation and the two nonsymmetric redundancy measures presented by Stewart and Love. Monte Carlo work comparing canonical correlation analysis, redundancy analysis, and various canonical/redundancy factoring analyses on the Van Den Wollenberg data is presented. An empirical example is also provided.Wayne S. DeSarbo is a Member of Technical Staff at Bell Laboratories in the Mathematics and Statistics Research Group at Murray Hill, N.J. I wish to express my appreciation to J. Kettenring, J. Kruskal, C. Mallows, and R. Gnanadesikan for their valuable technical assistance and/or for comments on an earlier draft of this paper. I also wish to thank the editor and reviewers of this paper for their insightful remarks.     

Canonical analysis of longitudinal and repeated measures data with stationary weights

When measuring the same variables on different occasions, two procedures for canonical analysis with stationary compositing weights are developed. The first, SUMCOV, maximizes the sum of the covariances of the canonical variates subject to norming constraints. The second, COLLIN, maximizes the largest root of the covariances of the canonical variates subject to norming constraints. A characterization theorem establishes a model building approach. Both methods are extended to allow for Cohort Sequential Designs. Finally a numerical illustration utilizing Nesselroade and Baltes data is presented.The authors wish to thank John Nesselroade for permitting us to use the data whose analysis we present.     

青少年的社会支持系统与自尊的关系

采用典型相关分析方法对502名青少年的社会支持系统与自尊的关系进行研究,结果表明,在影响自尊的因素中,有29．8％是可以由青少年所感知的社会支持系统所解释的。母亲、父亲、朋友和教师的肯定与支持、冲突与惩罚、陪伴与亲密及满意度等功能分别可以解释青少年的家庭自尊、整体自尊、学业自尊、人际自尊和外貌自尊的8．5％、8．596、5．8％和7％。而社会支持功能与青少年的利他自尊和运动能力的自尊没有显著相关。