Heterogeneous factor analysis models: A bayesian approach

Multilevel factor analysis models are widely used in the social sciences to account for heterogeneity in mean structures. In this paper we extend previous work on multilevel models to account for general forms of heterogeneity in confirmatory factor analysis models. We specify various models of mean and covariance heterogeneity in confirmatory factor analysis and develop Markov Chain Monte Carlo (MCMC) procedures to perform Bayesian inference, model checking, and model comparison.We test our methodology using synthetic data and data from a consumption emotion study. The results from synthetic data show that our Bayesian model perform well in recovering the true parameters and selecting the appropriate model. More importantly, the results clearly illustrate the consequences of ignoring heterogeneity. Specifically, we find that ignoring heterogeneity can lead to sign reversals of the factor covariances, inflation of factor variances and underappreciation of uncertainty in parameter estimates. The results from the emotion study show that subjects vary both in means and covariances. Thus traditional psychometric methods cannot fully capture the heterogeneity in our data.     

表现性评价中评分者信度估计方法的比较研究--从相关法、百分比法到概化理论

随着素质教育的推进．表现性评价受到越来越多的重视。影响表现性评价结果信度的一个重要因素是评分者之间的不一致。文章使用模拟数据,在对比评分者一致性的相关法、一致性百分比法和概化系数等各种估计方法的基础上,提出概化理论在表现性评价中评分者信度问题上的应用是理论和实践发展的有益方向。     

On Similarity Coefficients for 2×2 Tables and Correction for Chance

This paper studies correction for chance in coefficients that are linear functions of the observed proportion of agreement. The paper unifies and extends various results on correction for chance in the literature. A specific class of coefficients is used to illustrate the results derived in this paper. Coefficients in this class, e.g. the simple matching coefficient and the Dice/Sørenson coefficient, become equivalent after correction for chance, irrespective of what expectation is used. The coefficients become either Cohen’s kappa, Scott’s pi, Mak’s rho, Goodman and Kruskal’s lambda, or Hamann’s eta, depending on what expectation is considered appropriate. Both a multicategorical generalization and a multivariate generalization are discussed.     

Coefficients Alpha,Beta, Omega,and the glb: Comments on Sijtsma

There are three fundamental problems in Sijtsma (Psychometrika, 2008): (1) contrary to the name, the glb is not the greatest lower bound of reliability but rather is systematically less than ω _t (McDonald, Test theory: A unified treatment, Erlbaum, Hillsdale, 1999), (2) we agree with Sijtsma that when considering how well a test measures one concept, α is not appropriate, but recommend ω _t rather than the glb, and (3) the end user needs procedures that are readily available in open source software.     

Minimizing the number of observations: A generalization of the spearman-brown formula

A new method for determining the minimum number of observations per subject needed to achieve a specific generalizability coefficient is presented. This method, which consists of a branch-and-bound algorithm, allows for the employment of constraints specified by the investigator.     

中文版无手机恐惧量表的修订

该研究以国外学者Caglar Yildirim和Ana-Paula Correia于2015年编制的Nomophobia量表为基础,修订出了适用于国内的中文版无手机恐惧量表。研究首先使用探索性结构方程模型对量表结构进行初探; 其次使用项目反应模型进行项目分析并根据其分析结果对项目进行修改和筛选,最终形成正式版量表; 最后对正式版量表其进行信效度检验,并再次对量表题目进行项目分析。最终量表共16道题目,包括害怕无法获得信息、害怕失去便利、害怕失去联系和害怕失去网络连接4个维度; 总量表的Cronbach α系数为0.931,四维度的α系数分别为:0.789,0.816,0.887和0.896。CFA验证性结果显示量表结构较好(χ2/df=3.91,RMSEA=0.067,TLI=0.941,CFI=0.952,SRMR=0.04); 使用手机成瘾倾向量表作为校标的结果显示二者之间相关为0.626,效度良好。最终量表项目区分度在[1.734,4.806]之间,四维度区分度均值为2.1765,2.72,3.2925和3.883,项目难度参数在[-1.830,4.806]之间。综上结果显示该研究编制的无手机恐惧量表各项指标均达到了心理测量学要求,可供后续研究使用