Component analysis with different sets of constraints on different dimensions

Many of the classical multivariate data analysis and multidimensional scaling techniques call for approximations by lower dimensional configurations. A model is proposed, in which different sets of linear constraints are imposed on different dimensions in component analysis and classical multidimensional scaling frameworks. A simple, efficient, and monotonically convergent algorithm is presented for fitting the model to the data by least squares. The basic algorithm is extended to cover across-dimension constraints imposed in addition to the dimensionwise constraints, and to the case of a symmetric data matrix. Examples are given to demonstrate the use of the method.The work reported in this paper has been supported by the Natural Sciences and Engineering Research Council of Canada, grant number A6394, and by the McGill-IBM Cooperative Grant, both granted to the first author. The research of H. A. L. Kiers has been made possible by a fellowship of the Royal Netherlands Academy of Arts and Sciences. We thank Michael Hunter for his helpful comments on earlier drafts of this paper.     

An efficient algorithm for TUCKALS3 on data with large numbers of observation units

A modification of the TUCKALS3 algorithm is proposed that handles three-way arrays of order I × J × K for any I. When I is much larger than JK, the modified algorithm needs less work space to store the data during the iterative part of the algorithm than does the original algorithm. Because of this and the additional feature that execution speed is higher, the modified algorithm is highly suitable for use on personal computers. This research has been made possible by a fellowship from the Royal Netherlands Academy of Arts and Sciences to the first author.     

Minimization of a class of matrix trace functions by means of refined majorization

A procedure is described for minimizing a class of matrix trace functions. The procedure is a refinement of an earlier procedure for minimizing the class of matrix trace functions using majorization. It contains a recently proposed algorithm by Koschat and Swayne for weighted Procrustes rotation as a special case. A number of trial analyses demonstrate that the refined majorization procedure is more efficient than the earlier majorization-based procedure. The research of H. A. L. Kiers has been made possible by a fellowship from the Royal Netherlands Academy of Arts and Sciences.     

Simple structure in component analysis techniques for mixtures of qualitative and quantitative variables

Several methods have been developed for the analysis of a mixture of qualitative and quantitative variables, and one, called PCAMIX, includes ordinary principal component analysis (PCA) and multiple correspondence analysis (MCA) as special cases. The present paper proposes several techniques for simple structure rotation of a PCAMIX solution based on the rotation of component scores and indicates how these can be viewed as generalizations of the simple structure methods for PCA. In addition, a recently developed technique for the analysis of mixtures of qualitative and quantitative variables, called INDOMIX, is shown to construct component scores (without rotational freedom) maximizing the quartimax criterion over all possible sets of component scores. A numerical example is used to illustrate the implication that when used for qualitative variables, INDOMIX provides axes that discriminate between the observation units better than do those generated from MCA.The Netherlands organization for scientific research (NWO) is gratefully acknowledged for funding this project. This research was conducted while the author was supported by a PSYCHON-grant (560-267-011) from this organization. The author is obliged to Jos ten Berge for his comments on an earlier version.     

An efficient algorithm for PARAFAC of three-way data with large numbers of observation units

The CANDECOMP algorithm for the PARAFAC analysis ofn×m×p three-way arrays is adapted to handle arrays in whichn>mp more efficiently. For such arrays, the adapted algorithm needs less memory space to store the data during the iterations, and uses less computation time than the original CANDECOMP algorithm. The size of the arrays that can be handled by the new algorithm is in no way limited by the number of observation units (n) in the data.The authors are obliged to Jos ten Berge for his comments on an earlier version of this paper. The research of Henk A. L. Kiers has been made possible by a fellowship of the Royal Netherlands Academy of Arts and Sciences.     

Majorization as a tool for optimizing a class of matrix functions

The problem of minimizing a general matrix, trace function, possibly subject to certain constraints, is approached by means of majorizing this function by one having a simple quadratic shape and whose minimum is easily found. It is shown that the parameter set that minimizes the majorizing function also decreases the matrix trace function, which in turn provides a monotonically convergent algorithm for minimizing the matrix trace function iteratively. Three algorithms based on majorization for solving certain least squares problems are shown to be special cases. In addition, by means of several examples, it is noted how algorithms may be provided for a wide class of statistical optimization tasks for which no satisfactory algorithms seem available.The Netherlands organization for scientific research(NWO) is gratefully acknowledged for funding this project. This research was conducted while the author was supported by a PSYCHON-grant (560-267-011) from this organization. The author is obliged to Jos ten Berge, Willem Heiser, and Wim Krijnen for helpful comments on an earlier version of this paper.     

The analysis of multitrait-multimethod matrices via constrained components analysis

Multitrait-Multimethod (MTMM) matrices are often analyzed by means of confirmatory factor analysis (CFA). However, fitting MTMM models often leads to improper solutions, or non-convergence. In an attempt to overcome these problems, various alternative CFA models have been proposed, but with none of these the problem of finding improper solutions was solved completely. In the present paper, an approach is proposed where improper solutions are ruled out altogether and convergence is guaranteed. The approach is based on constrained variants of components analysis (CA). Besides the fact that these methods do not give improper solutions, they have the advantage that they provide component scores which can later on be used to relate the components to external variables. The new methods are illustrated by means of simulated data, as well as empirical data sets.This research has been made possible by a fellowship from the Royal Netherlands Academy of Arts and Sciences to the first author. The authors are obliged to three anonymous reviewers and an associate editor for constructive suggestions on the first version of this paper.     

王岱舆的“天命有三品”论与儒家的天命观

王岱舆作为明末清初四教（儒、释、道、回）皆通的伊斯兰著名学者,他提出的“天命有三品”论,既适应了当时以儒家为主流文化的背景,也保持了其独特的伊斯兰性,在巧妙地处理与儒家天命观分歧的同时,又开放地拿儒家文化为己所用,从而为两种文明都赢得了宽松的环境,使得两种文明能够共存、共荣、共同发展。本文从王岱舆天命观与儒家天命观的介绍入手,分析其与儒家天命观的契合与分歧。     

The LMPCA program: A graphical user interface for fitting the linked-mode PARAFAC-PCA model to coupled real-valued data

In behavioral research, PARAFAC analysis, a three-mode generalization of standard principal component analysis (PCA), is often used to disclose the structure of three-way three-mode data. To get insight into the underlying mechanisms, one often wants to relate the component matrices resulting from such a PARAFAC analysis to external (two-way two-mode) information, regarding one of the modes of the three-way data. To this end, linked-mode PARAFAC-PCA analysis can be used, in which the three-way and the two-way data set, which have one mode in common, are simultaneously analyzed. More specifically, a PARAFAC and a PCA model are fitted to the three-way and the two-way data, respectively, restricting the component matrix for the common mode to be equal in both models. Until now, however, no software program has been publicly available to perform such an analysis. Therefore, in this article, the LMPCA program, a free and easy-to-use MATLAB graphical user interface, is presented to perform a linked-mode PARAFAC-PCA analysis. The LMPCA software can be obtained from the authors at http://ppw.kuleuven.be/okp/software/LMPCA. For users who do not have access to MATLAB, a stand-alone version is provided.