Relationships between redundancy analysis,canonical correlation,and multivariate regression

This paper attempts to clarify the nature of redundancy analysis and its relationships to canonical correlation and multivariate multiple linear regression. Stewart and Love introduced redundancy analysis to provide non-symmetric measures of the dependence of one set of variables on the other, as channeled through the canonical variates. Van den Wollenberg derived sets of variates which directly maximize the between set redundancy. Multivariate multiple linear regression on component scores (such as principal components) is considered. The problem is extended to include an orthogonal rotation of the components. The solution is shown to be identical to van den Wollenberg's maximum redundancy solution.This research was supported in part by U.S. Environmental Protection Agency contract 68-02-3402. The author gratefully acknowledges the stimulation of Maurice Tatsuoka and Beth Dawson-Saunders in first interesting him in redundancy analysis, as well as a useful change suggested by Warren Sarle.     

The effect of affine transformation on redundancy analysis

Canonical redundancy analysis provides an estimate of the amount of shared variance between two sets of variables and provides an alternative to canonical correlation. The proof that the total redundancy is equal to the average squared multiple correlation coefficient obtained by regressing each variable in the criterion set on all variables in the predictor set is generalized to the case in which there are a larger number of criterion than predictor variables. It is then shown that the redundancy for the criterion set of variables is invariant under affine transformation of the predictor variables, but not invariant under transformation of the criterion variables.     

Some symmetric,invariant measures of multivariate association

A distinction is drawn between redundancy measurement and the measurement of multivariate association for two sets of variables. Several measures of multivariate association between two sets of variables are examined. It is shown that all of these measures are generalizations of the (univariate) squared-multiple correlation; all are functions of the canonical correlations, and all are invariant under linear transformations of the original sets of variables. It is further shown that the measures can be considered to be symmetric and are strictly ordered for any two sets of observed variables. It is suggested that measures of multivariate relationship may be used to generalize the concept of test reliability to the case of vector random variables.     

Some improved diagnostics for failure of the Rasch model

Although several goodness of fit tests have been developed for the Rasch model for dichotomous items, most of them are of a global, asymptotic, and confirmatory type. This paper, based on ideas from a recent thesis by Van den Wollenberg, offers some suggestions for local, small sample, and exploratory techniques: difficulty plots for person groups scoring right and wrong on a specific item, a slope test per item based on a binomial distribution per score group, and a unidimensionality check based on an extended hypergeometric distribution per score group. This paper owes much to the inspiring and pioneering work of Arnold Van den Wollenberg, of which only minor aspects are criticized. Thanks go to Charles Lewis for stimulating discussions and for solutions to some programming problems.     

Canonical correlations with fallible data

The technique of canonical correlation may be used to determine the extent to which two sets of measurements reflect the same underlying traits. However, if the two sets are not perfectly reliable, the unreliability may obscure the fact that they are essentially dependent on similar processes. If we attempt to determine sets of weights so as to maximize the correlation between linear composites after correction for attenuation in the composites, it turns out that the results may be obtained by determining the canonical correlations and canonical regression weights between the true score components of the measures making up the two sets. In addition, formulas are developed for calculating the correlations between the canonical variates and original measures, both corrected and uncorrected for attenuation. A numerical example relating the verbal to the performance subtests of the Wechsler Intelligence Scale for Children is presented.     

Testing the significance of the successive components in redundancy analysis

In this paper we study the interrelationships between two sets of data measured on the same subjects via redundancy analysis. We consider redundancy analysis from an inferential point of view. Under the hypothesis of multinormality, tests of significance are obtained for each successive redundancy component so that only the significant factors are retained for prediction purposes. An example illustrates the method. The authors would like to thank the Editor and the referees for their helpful comments. This research has been partly financed by NSERC (Canada).     

Interpreting canonical correlation analysis through biplots of structure correlations and weights

This paper extends the biplot technique to canonical correlation analysis and redundancy analysis. The plot of structure correlations is shown to the optimal for displaying the pairwise correlations between the variables of the one set and those of the second. The link between multivariate regression and canonical correlation analysis/redundancy analysis is exploited for producing an optimal biplot that displays a matrix of regression coefficients. This plot can be made from the canonical weights of the predictors and the structure correlations of the criterion variables. An example is used to show how the proposed biplots may be interpreted.     

Redundancy analysis an alternative for canonical correlation analysis

A component method is presented maximizing Stewart and Love's redundancy index. Relationships with multiple correlation and principal component analysis are pointed out and a rotational procedure for obtaining bi-orthogonal variates is given. An elaborate example comparing canonical correlation analysis and redundancy analysis on artificial data is presented.A Fortran IV program for the method of redundancy analysis described in this paper can be obtained from the author upon request.     

On the inhomogeneity of a test compounded of two Rasch homogeneous subscales

Van den Wollenberg stated a theorem specifying the conditions for a test, which is composed of two Rasch homogeneous subscales, as also behaving Rasch homogeneously. In our note, simple numerical counterexamples are given for which this theorem fails.While preparing the final version of this note, Ilse Rop passed away. The first author therefore takes sole responsibility for this final version.     

An Empirical Investigation Of Step-Down Canonical Correlation With Cross-Validation

Three potential applications of stepwise procedures in canonical analysis and several alternative stepping decision rules are described. A stepdown procedure using smallest interest multiple correlation as the stepping criterion was applied to data on the Minnesota Importance Questionnaire and the Minnesota Vocational Interest Inventory for two random halves of a group of 500 males in a double cross-validation design. Results indicated that up to 75 percent of variables could be dropped from either set with little drop in the R[SUBc]. Cross-validation coefficients were usually higher after dropping several variables than for the full sets.     

Canonical analysis of longitudinal and repeated measures data with stationary weights

When measuring the same variables on different occasions, two procedures for canonical analysis with stationary compositing weights are developed. The first, SUMCOV, maximizes the sum of the covariances of the canonical variates subject to norming constraints. The second, COLLIN, maximizes the largest root of the covariances of the canonical variates subject to norming constraints. A characterization theorem establishes a model building approach. Both methods are extended to allow for Cohort Sequential Designs. Finally a numerical illustration utilizing Nesselroade and Baltes data is presented.The authors wish to thank John Nesselroade for permitting us to use the data whose analysis we present.     

A unified approach to multiple‐set canonical correlation analysis and principal components analysis

Multiple‐set canonical correlation analysis and principal components analysis are popular data reduction techniques in various fields, including psychology. Both techniques aim to extract a series of weighted composites or components of observed variables for the purpose of data reduction. However, their objectives of performing data reduction are different. Multiple‐set canonical correlation analysis focuses on describing the association among several sets of variables through data reduction, whereas principal components analysis concentrates on explaining the maximum variance of a single set of variables. In this paper, we provide a unified framework that combines these seemingly incompatible techniques. The proposed approach embraces the two techniques as special cases. More importantly, it permits a compromise between the techniques in yielding solutions. For instance, we may obtain components in such a way that they maximize the association among multiple data sets, while also accounting for the variance of each data set. We develop a single optimization function for parameter estimation, which is a weighted sum of two criteria for multiple‐set canonical correlation analysis and principal components analysis. We minimize this function analytically. We conduct simulation studies to investigate the performance of the proposed approach based on synthetic data. We also apply the approach for the analysis of functional neuroimaging data to illustrate its empirical usefulness.     

Canonical versus factor analytic perspectives on the structure of associations between the MMPI and the Buss-Durkee Hostility Inventory

A canonical correlational analysis of MMPI profiles versus Buss-Durkee hostility and aggression scales was conducted, resulting in the identification of a general hostility-aggression-maladjustment dimension and three relatively specific aggression-personality relationships. These findings were contrasted with those obtained from a factor analysis of the combination of both sets of scores. Though often used in previous studies of associations between the Buss-Durkee Hostility Inventory and other measures, factor analysis was seen to be less than optimally suited to such a purpose. It was concluded that canonical correlation is preferable to factor analysis when seeking to clarify the multivariate structure of relationships between two sets of variables.     

A management skills audit for future managers

This paper reports on the development of an Inventory of Managing Skills designed to provide working MBA students with a current assessment of their managing skills. A canonical correlation matrix reporting interrelationships between the 20 scale dimensions in a pilot sample of 378 respondents is reported. The Inventory can be used for self-assessment by students and for other-assessment by the student’s superiors and peers. Portions of this paper were presented at the annual conference of the Midwest Academy of Management, Cincinnati, on April 12, 1991.     

Regularized Generalized Canonical Correlation Analysis

Regularized generalized canonical correlation analysis (RGCCA) is a generalization of regularized canonical correlation analysis to three or more sets of variables. It constitutes a general framework for many multi-block data analysis methods. It combines the power of multi-block data analysis methods (maximization of well identified criteria) and the flexibility of PLS path modeling (the researcher decides which blocks are connected and which are not). Searching for a fixed point of the stationary equations related to RGCCA, a new monotonically convergent algorithm, very similar to the PLS algorithm proposed by Herman Wold, is obtained. Finally, a practical example is discussed.     

A rationale and test for the number of factors in factor analysis

It is suggested that if Guttman's latent-root-one lower bound estimate for the rank of a correlation matrix is accepted as a psychometric upper bound, following the proofs and arguments of Kaiser and Dickman, then the rank for a sample matrix should be estimated by subtracting out the component in the latent roots which can be attributed to sampling error, and least-squares capitalization on this error, in the calculation of the correlations and the roots. A procedure based on the generation of random variables is given for estimating the component which needs to be subtracted.I wish to acknowledge the valuable help given by J. Jaspers and L. G. Humphreys in the development of the ideas presented in this paper.     

Part and bipartial canonical correlation analysis

Extending the definitions of part and bipartial correlation to sets of variates, the notion of part and bipartial canonical correlation analysis are developed and illustrated.     

External Single-Set Components Analysis Of Multiple Criterion/Multiple Predictor Variables

Although much progress has been made in clarifying the properties of canonical correlation analysis in order to enhance its applicability, there are several remaining problems. Canonical variates do not always represent the observed variables even though the canonical correlation is high. In addition, canonical solutions are often difficult to interpret.

This paper presents a method designed to deal with these two problems. Instead of maximizing the correlation between unobserved variates, the sum of squared inter-set loadings is maximized. Contrary to the canonical correlation solution, this method ensures that the shared variance between predictor variates and criterion variables is maximal. Instead of extracting variates from both criterion and predictor variables, only one set of components (from the predictor variables) is constructed. Without loss of common variance, an orthogonal rotation is applied to the resulting loadings in order to simplify structure.     

Orthogonal inter-battery factor analysis

It is the purpose of this paper to present a method of analysis for obtaining (i) inter-battery factors and (ii) battery specific factors for two sets of tests when the complete correlation matrix including communalities is given. In particular, the procedure amounts to constructing an orthogonal transformation such that its application to an orthogonal factor solution of the combined sets of tests results in a factor matrix of a certain desired form. The factors isolated are orthogonal but may be subjected to any suitable final rotation, provided the above classification of factors into (i) and (ii) is preserved. The general coordinate-free solution of the problem is obtained with the help of methods pertaining to the theory of linear spaces. The actual numerical analysis determined by the coordinate-free solution turns out to be a generalization of the formalism of canonical correlation analysis for two sets of variables. A numerical example is provided.This investigation has been supported by the U.S. Office of Naval Research under Contract Nonr-2752(00).     

Claiming Kant for Feminism: A Discussion of Anderson's Re-visioning Gender in Philosophy of Religion

I wish to expose the possibility of a Kantian feminism made actual by Pamela Sue Anderson’s recent book Re-visioning Gender in Philosophy of Religion: Reason, Love and Epistemic Locatedness. In this paper I show how Kantian philosophy structures Anderson’s project, and I argue that in embodying the spirit of Kantian critique, this project may be used to turn that spirit against the letter of its expression in an act that would claim Kant for feminism.