用结构方程建模(SEM)估计概化理论(GT)中的评分者信度

评分者的信度分析 ,已从经典测量理论的方法 (Kendall和谐系数 )发展为基于现代测量理论 (如GT)的方法 ,但由于GT中方差分量估计的工具和途径有限 ,使该方法的推广受到限制。本文介绍了结构方程建模 (SEM )估计GT中方差分量的必要性及原理 ,并通过对某省直国家机关公务员录用考试结构化面试的评分者信度分析 ,阐述用SEM估计概化理论中不同设计下的评分者信度研究

USING STRUCTURAL EQUATION MODELS TO ESTIMATE RATER RELIABILITY IN GENERALIZABILITY THEORY

Due to the lack of tools and ways for estimating variance components in Generalizability Theory, the application of GT is limited. In this study, the principle of using Structural Equation Models to estimate variance components was introduced. This paper studied raters' consistency of structured interview in Council Servant Recruiting Test. 27 subjects of one unit were sampled in a certain province randomly. The crossed design(p×r×o) and unbalanced mixed design (p×(r:o))were analyzed. Estimation of variance components was conducted through EQS in two designs. This study illustrated that SEM is a powerful method for estimating rater reliability in GT.