| 认知诊断模型Q矩阵修正：完整信息矩阵的作用 |
| |
| 引用本文： | 刘彦楼,吴琼琼. 认知诊断模型Q矩阵修正：完整信息矩阵的作用[J]. 心理学报, 2023, 55(1): 142-158. DOI: 10.3724/SP.J.1041.2023.00142 |
| |
| 作者姓名： | 刘彦楼 吴琼琼 |
| |
| 作者单位： | 1.曲阜师范大学教育大数据研究院;2.曲阜师范大学心理学院, 山东 济宁 273165 |
| |
| 基金项目： | 国家自然科学基金青年项目(31900794);山东省自然科学基金项目(ZR2019BC084) |
| |
| 摘 要： | Q矩阵是CDM的核心元素之一,反映了测验的内部结构和内容设计,通常由领域专家根据经验进行主观界定,因此需要对可能存在的错误进行修正。本研究提出了一种新的Q矩阵修正方法——基于完整经验交叉相乘信息矩阵的Wald-XPD方法。采用Monte Carlo模拟检验了新方法的表现,并与同类方法进行了比较。研究表明：新开发的Wald-XPD方法在Q矩阵恢复率、保留正确标定属性的比例以及修正错误标定属性的比例这3个主要指标上均有较好的表现,且整体上优于其他方法,尤其是在修正错误标定的属性方面。通过实证数据展示了Wald-XPD方法在Q矩阵修正中的良好表现。总之,本研究为Q矩阵修正提供了有效的方法。
|
| 关 键 词： | 认知诊断模型 Q矩阵 XPD矩阵 Wald检验 |
| 收稿时间： | 2022-03-09 |
An empirical Q-matrix validation method using complete information matrix in cognitive diagnostic models |
| |
| LIU Yanlou,WU Qiongqiong. An empirical Q-matrix validation method using complete information matrix in cognitive diagnostic models[J]. Acta Psychologica Sinica, 2023, 55(1): 142-158. DOI: 10.3724/SP.J.1041.2023.00142 |
| |
| Authors: | LIU Yanlou WU Qiongqiong |
| |
| Affiliation: | 1.Academy of Big Data for Education; Qufu Normal University, Jining 273165, China;2.School of Psychology, Qufu Normal University, Jining 273165, China |
| |
| Abstract: | A Q-matrix, which defines the relations between latent attributes and items, is a central building block of the cognitive diagnostic models (CDMs). In practice, a Q-matrix is usually specified subjectively by domain experts, which might contain some misspecifications. The misspecified Q-matrix could cause several serious problems, such as inaccurate model parameters and erroneous attribute profile classifications. Several Q-matrix validation methods have been developed in the literature, such as the G-DINA discrimination index (GDI), Wald test based on an incomplete information matrix (Wald-IC), and Hull methods. Although these methods have shown promising results on Q-matrix recovery rate (QRR) and true positive rate (TPR), a common drawback of these methods is that they obtain poor results on true negative rate (TNR). It is important to note that the worse performance of the Wald-IC method on TNR might be caused by the incorrect computation of the information matrix. |
| |
| Keywords: | cognitive diagnostic models Q-matrix XPD information matrix Wald test |
|
| 点击此处可从《心理学报》浏览原始摘要信息 |
|
点击此处可从《心理学报》下载全文 |
|
