首页 | 本学科首页   官方微博 | 高级检索  
     

认知诊断模型Q矩阵修正:完整信息矩阵的作用
引用本文:刘彦楼,吴琼琼. 认知诊断模型Q矩阵修正:完整信息矩阵的作用[J]. 心理学报, 2023, 55(1): 142-158. DOI: 10.3724/SP.J.1041.2023.00142
作者姓名:刘彦楼  吴琼琼
作者单位:1.曲阜师范大学教育大数据研究院;2.曲阜师范大学心理学院, 山东 济宁 273165
基金项目:国家自然科学基金青年项目(31900794);山东省自然科学基金项目(ZR2019BC084)
摘    要:Q矩阵是CDM的核心元素之一,反映了测验的内部结构和内容设计,通常由领域专家根据经验进行主观界定,因此需要对可能存在的错误进行修正。本研究提出了一种新的Q矩阵修正方法——基于完整经验交叉相乘信息矩阵的Wald-XPD方法。采用Monte Carlo模拟检验了新方法的表现,并与同类方法进行了比较。研究表明:新开发的Wald-XPD方法在Q矩阵恢复率、保留正确标定属性的比例以及修正错误标定属性的比例这3个主要指标上均有较好的表现,且整体上优于其他方法,尤其是在修正错误标定的属性方面。通过实证数据展示了Wald-XPD方法在Q矩阵修正中的良好表现。总之,本研究为Q矩阵修正提供了有效的方法。

关 键 词:认知诊断模型  Q矩阵  XPD矩阵  Wald检验
收稿时间:2022-03-09

An empirical Q-matrix validation method using complete information matrix in cognitive diagnostic models
LIU Yanlou,WU Qiongqiong. An empirical Q-matrix validation method using complete information matrix in cognitive diagnostic models[J]. Acta Psychologica Sinica, 2023, 55(1): 142-158. DOI: 10.3724/SP.J.1041.2023.00142
Authors:LIU Yanlou  WU Qiongqiong
Affiliation:1.Academy of Big Data for Education; Qufu Normal University, Jining 273165, China;2.School of Psychology, Qufu Normal University, Jining 273165, China
Abstract:A Q-matrix, which defines the relations between latent attributes and items, is a central building block of the cognitive diagnostic models (CDMs). In practice, a Q-matrix is usually specified subjectively by domain experts, which might contain some misspecifications. The misspecified Q-matrix could cause several serious problems, such as inaccurate model parameters and erroneous attribute profile classifications. Several Q-matrix validation methods have been developed in the literature, such as the G-DINA discrimination index (GDI), Wald test based on an incomplete information matrix (Wald-IC), and Hull methods. Although these methods have shown promising results on Q-matrix recovery rate (QRR) and true positive rate (TPR), a common drawback of these methods is that they obtain poor results on true negative rate (TNR). It is important to note that the worse performance of the Wald-IC method on TNR might be caused by the incorrect computation of the information matrix.
Keywords:cognitive diagnostic models  Q-matrix  XPD information matrix  Wald test  
点击此处可从《心理学报》浏览原始摘要信息
点击此处可从《心理学报》下载全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号