Factor analysis of ipsative data: a simulation study

This paper introduces a summary on how to proceed to conduct a factor analysis when the input data are ipsative. The classical factor analysis procedures cannot be used because the covariance matrix is singular. Additionally, previous research on the optimal conditions to conduct factor analysis for ipsatized data is reviewed, and the results of a simulation study are presented. The study includes conditions of sample size, model complexity, and model specification (correct vs. incorrect). The results suggest that researchers should be careful when factor analyzing ipsatized data, particularly if they suspect that the model is incorrectly specified and includes a smaller number of factors.     

Internal Validity and Reliability of Kolb’s Learning Style Inventory Version 3 (1999)

This study explores the internal validity and reliability of Kolb’s revised Learning Style Inventory (LSI-2A and LSI-3) in a sample of 221 graduate and undergraduate business students. Research on the LSI is also reviewed and the implications of conducting factor analysis using ipsative data are explored. Experiential Learning Theory is presented and the concept of learning styles explained. This study largely supports prior research supporting the internal reliability of scales. Principle Component Analysis provides evidence for a 2 factor structure as hypothesized by Kolb.     

The Rokeach Value Survey: Underlying Structure and Multidimensional Scaling

Studies have demonstrated that the ordinal, ipsative data provided by the Rokeach Value Survey (RVS; Rokeach 1973) are not suited to factor analysis. In this study, nonmetric multidimensional scaling (MDS) was used with a sorting task to identify the underlying subset of values. American college students were the participants, and the results indicate that individualism-achievement and collectivism-affiliation are the underlying dimensions of the RVS for both the terminal and the instrumental values. Observed variation in the use of MDS space was predicted, based on participants' developmental differences as measured by the Maslowian Assessment Survey (Williams & Page, 1989). Gender differences in the use of MDS space by participants were not observed. Analysis of angular variance was used to test both hypotheses.     

当代大学生自比型价值观数据的潜在结构

本研究对采自3796名在校大学生的Rokeach Value Survey自比型数据进行了因素分析和多维尺度分析。因素分析从两组价值观选项中分别获得6个双极因素,虽然内容各不相同,但均体现出个人指向-亲社会指向的特点。多维尺度分析所获得的两组选项的2维空间距离分布结果也体现类似特点,结果显示终极性价值观可分为四类,工具性价值观可分为五类。当前大学生价值观中存在着舒适的物质生活、兴奋的生活、幸福、快乐和自尊以及雄心壮志的、勇敢的和诚实的等个人取向内容占优势的可能性。在两种分析方法中,多维尺度分析更适合对自比型价值观数据潜在结构的探究。     

Ipsative and Normative Scales in Adjectival Measurement of Personality: Problems of Bias and Discrepancy

887 respondents completed ipsative and normative versions of the PAL-TOPAS personality questionnaire. Data were analysed to test for (1) systematic bias in scores associated with the two response formats and (2) predictors of the magnitude of the discrepancy in the individual's ipsative and normative scores. Discrepancy was assessed for both item responses and scale scores. Sources of biases investigated included ipsative scaling artifact, extremeness of scores on the normative scales and response variability. Results showed that systematic bias in scale scores and magnitude of discrepancy were predicted by different factors. One source of systematic bias was associated with ipsative scaling artifact: the ipsative scales measure both the scale itself and rejection of other alternatives. A second source of systematic bias was acquiescence in response to normative items. A confirmatory factor analysis showed that a good but imperfect fit to the data may be obtained by constructing a structural model of the inter-relationship between normative and ipsative scores which accommodates both sources of bias. The strongest influence on discrepancy in scale scores was extremeness of normative scoring, associated with a bias towards either general acceptance or rejection of trait adjectives. It is concluded that both normative and ipsative response formats have limitations, and it may often be desirable to assess both.     

Validation of an ipsative personality measure (DISCUS)

The purpose of this study was to examine the construct validity of an ipsative personality test (DISCUS), and various effects of the ipsative format of the test. Both an ipsative and a normative version of the DISCUS test was administered to a sample of undergraduate students (N = 103), along with an adjective based personality test that measures the Big-Five personality traits (5PFa). The results indicated that the normative and the ipsative version of DISCUS are not equivalent, and caution is needed when using the ipsative version for psychometric evaluations as in validation studies. The four DISCUS dimensions (Dominance, Influence, Stability, and Carefulness) represented combinations of the Big-Five traits rather than independent traits as indicated by the correlations with the Big-Five measure.     

Análisis factorial de ítems de respuesta forzada: una revisión y un ejemplo

Forced-choice tests are widely used in order to reduce the impact of different response set biases typically associated to psychological tests (e.g. acquiescence or social desirability). However, these tests produce ipsative data which have undesirable properties, thereby making an inappropriate application of classical factor analysis techniques for psychometric evaluation commonly used by researchers. This paper explains the analytical properties of forced-choice tests, along with an example that illustrates how these properties have an impact on the application of conventional statistical techniques and produce improper results. Additionally, one of the current proposals is presented in order to analyze these data based on the comparative judgment model by Thurstone, along with the results of a simulation study which illustrates its implementation and effectiveness in recovering the original factor structure.     

中学生职业兴趣的结构及其特点

参考国内外有关资料,设计适合我国中学生的职业兴趣测验。对309名在校中学生测查结果的因素分析表明,共存在六个因素,可以解释为现实型（R)、研究型 (I)、艺术型 (A)、社会型 (S)、经营型 (E)和常规型(C),这与霍兰德的六种职业类型一致。但六种兴趣之间的关系与霍兰德的职业六边形不完全一致。进一步的分析表明,初三以上的中学生的职业兴趣已出现明显分化。年级和性别因素对职业兴趣均有显著影响,年级与性别的交互作用不显著。     

Psychometric problems and issues involved with creating and using ipsative measures for selection

Data are described as ipsative if a given set of responses always sum to the same total. However, there are many properties of data collection that can give rise to different types of ipsative data. In this study, the most common type of ipsative data used in employee selection (forced‐choice ipsative data; FCID) is discussed as a special case of other types of ipsative data. Although all ipsative data contains constraints on covariance matrices (covariance‐level interdependence), FCID contains additional item‐level interdependencies as well. The psychological processes that give rise to FCID and the resultant psychometric properties are discussed. In addition, data from which both normative and ipsative responses were provided by job applicants illustrate very different patterns of correlations as well as very different selection decisions between normative, FCID and ipsatized measures.     

Issues in Factor-Analyzing Ipsative Measures: The Learning Style Inventory (LSI-1985) Example

This paper reviews the statistical issues in factor analyzing ipsative measures and then illustrates the issue using ipsative data from Kolb's revised Learning Style Inventory (LSI-1985) and Dunlap & Cronwell's (1994) recommended procedures. The statistical findings underscore the problem of determining the valid underlying factor structure of ipsative measures.     

大学生的职业自我概念清晰度与抑郁的关系:性别与性别平等观的调节作用

尽管抑郁的影响因素得到了比较多的探讨,但是鲜有研究探讨职业自我概念清晰度与抑郁的关系以及性别和性别平等观在其中的作用。根据生涯发展理论和自我差异理论,本研究探讨了大学生职业自我概念清晰度与大学生抑郁的关系,并考察了性别和性别平等观在二者关系之间的调节作用。通过对463份大学生的数据进行实证分析发现：（1）职业自我概念清晰度与大学生抑郁负相关;（2）职业自我概念清晰度与抑郁的关系存在显著的性别差异;（3）职业自我概念清晰度、性别和性别平等观对大学生抑郁存在三重交互作用。当个体持有高性别平等观时,男性和女性的职业自我概念清晰度都与抑郁负相关。当个体的性别平等观较低时,女性的职业自我概念清晰度与抑郁正相关。研究结果对于大学生的职业发展和心理健康教育具有重要实践意义。     

Increasing Validity with Forced‐Choice Criterion Measurement Formats

The relative validities of forced‐choice (ipsative) and Likert rating‐scale item formats as criterion measures are examined. While there has been much debate about the relative technical and psychometric merits and demerits of ipsative instruments, the present research focused on the crucial question of whether the use of this format has any practical benefit – in terms of improved validity. An analysis is reported from a meta‐analysis data set. This demonstrates that higher operational validity coefficients (prediction of line‐manager ratings of competencies) are associated with the use of forced‐choice (r=.38) rather than rating scale (r=.25) item formats for the criterion measurement instrument when performance is rated by the same line managers on both formats and where the predictor is held constant. Thus the apparent criterion‐related validity of a predictor can increase by 50% simply by changing the format of the criterion measurement instrument. The implications of this for practice are discussed.     

青少年病理性互联网使用量表的编制与验证

参照国内外研究并结合我国青少年的实际情况,旨在编制出更适合我国情况的青少年病理性互联网使用量表（Adolescent Pathological Internet Use Scale,APIUS）。探索性因素分析和验证性因素分析的结果表明APIUS由6个维度构成,即突显性、耐受性、强迫性上网/戒断症状、心境改变、社交抚慰、消极后果。APIUS显示了良好的信、效度指标,可以作为我国青少年病理性互联网使用的测量工具     

Are defeat and entrapment best defined as a single construct?

The concepts of defeat and entrapment have been employed in evolutionary accounts of clinical phenomena such as depression and suicide. Recently theorists have argued that both concepts may be best conceptualised as a single distinct factor. The current study is the first to empirically test this assertion. A sample of 305 students completed measures of defeat and entrapment. Their responses were then analysed via exploratory factor analysis. The results strongly suggest that a single factor underlies both defeat and entrapment. These findings have considerable implications for past studies and theoretical accounts that rely on the distinction between defeat and entrapment.     

Covariance structure analysis of ordinal ipsative data

Data are ipsative if they are subject to a constant-sum constraint for each individual. In the present study, ordinal ipsative data (OID) are defined as the ordinal rankings across a vector of variables. It is assumed that OID are the manifestations of their underlying nonipsative vector y, which are difficult to observe directly. A two-stage estimation procedure is suggested for the analysis of structural equation models with OID. In the first stage, the partition maximum likelihood (PML) method and the generalized least squares (GLS) method are proposed for estimating the means and the covariance matrix of A_cy, where A_c is a known contrast matrix. Based on the joint asymptotic distribution of the first stage estimator and an appropriate weight matrix, the generalized least squares method is used to estimate the structural parameters in the second stage. A goodness-of-fit statistic is given for testing the hypothesized covariance structure. Simulation results show that the proposed method works properly when a sufficiently large sample is available.This research was supported by National Institute on Drug Abuse Grants DA01070 and DA10017. The authors are indebted to Dr. Lee Cooper, Dr. Eric Holman, Dr. Thomas Wickens for their valuable suggestions on this study, and Dr. Fanny Cheung for allowing us to use her CPAI data set in this article. The authors would also like to acknowledge the helpful comments from the editor and the two anonymous reviewers.     

Normative versus ipsative configural frequency analysis in personality research—their use discussed in a reanalysis of data on situation-bound anxiety

Configural frequency analysis (CFA) tests whether certain individual patterns in different variables are observed more frequently in a sample than expected by chance. In normative CFA, these patterns are derived from the subject's specific position in relation to sample characteristics such as the median or the mean. In ipsative CFA, patterns are defined within an individual reference system, e.g. relative to the subject's median of different variable scores. Normative CFA examines dimensionality of scales and is comparable to factor analysis in this respect. Ipsative CFA rather yields information about location of scores in different variables, in a similar way to ANOVA or Friedman testing. However, both normative and ipsative CFA may supply information not obtainable by means of the aforementioned methods. This is illustrated in a reanalysis of data in four scales of an anxiety inventory. © 1997 John Wiley & Sons, Ltd.     

神经质人格迫选量表的开发及其抗作假效果研究

传统的迫选量表得分是自模式数据,最近提出的Thurstone IRT模型建构了被试对迫选量表反应的数学模型,能够更精确地度量被试的特质水平.研究自编了神经质人格迫选量表,与常用的测量神经质的Likert量表一起,在无压力、模拟应聘和实际应聘三种情境下进行施测.结果发现,迫选量表的实测数据能够较好地拟合Thurstone IRT模型,该模型估计的特质得分不具有自模式数据的性质,比传统计分更能够抵抗作假.无论采用哪种计分方式,迫选量表都比Likert量表更能够抵抗作假.     

Psychometric critique of acculturation psychology: the case of Iranian migrants in Norway

The presumptions, terminology, psychometrics, statistical analyses, and ethics of the fourfold acculturation paradigm are criticized in detail. Illustrative data came from Iranian refugees in Norway (N = 80) answering: 1) the Satisfaction with Life Scale (SWLS), 2) Zung's Self-Rating Depression Scale (ZSRDS), 3) ipsative fourfold scales of Integration, Assimilation, Separation, and Marginalization, 4) orthogonal scales of attitudes towards Norwegian and Iranian cultures, measured independently and using balanced reverse-keying, and 5) ipsative forced-choice preferences for cultural practices of Norway, Iran, both, or from other societies as well. Iranians in Norway favored global multiculturalism and, as a group. did not show distress. The SWLS and ZSRDS were correlated, but the measures of acculturation failed to replicate one another. As unconstrained ipsative measures, the fourfold scales showed acquiescence response bias contamination and doubtful operationalization of scale constructs. Recommendations are discussed for improving acculturation research.     

迫选式人格测验的传统计分与IRT计分模型

迫选测验的传统计分方式会产生自模式数据, 不能进行传统的信效度检验、因素分析和方差分析等。近年来研究者提出了一些基于项目反应理论的计分模型, 如瑟斯顿IRT模型和MUPP模型等, 它们可以规避自模式数据的弊端。瑟斯顿IRT模型方便进行参数估计, 模型定义灵活; 而MUPP模型的拓展性较差, 参数估计的方法有待提高。另一方面, 已有研究者基于MUPP模型开发了一些抗作假的迫选测验, 而瑟斯顿IRT模型距离这种应用还比较远。此外, 两个模型的适用性和有效性都有待更多的实证研究来检验。     

Utility of the REDFLAGS Model for Supporting Community College Students’ Mental Health: Implications for Counselors

The counseling literature is lacking in research on supporting the mental health needs of the growing community college student population. A number of past investigators have demonstrated the utility of mental health literacy for supporting college students’ mental health on 4‐year universities. The present researchers examined the validity of the REDFLAGS model (a theoretical model for promoting mental health literacy) with a national stratified random sample (N = 640, stratified by age, gender, and ethnicity) of community college students. Collectively, the results of the confirmatory factor analysis, hierarchical logistic regression, and factorial analysis of variance supported the use of the model with community college students. Implications for enhancing counseling practice as well as directions for future research are provided.