Nested diagnostic classification models for multiple-choice items

This study proposes and evaluates a diagnostic classification model framework for multiple-choice items. Models in the proposed framework have a two-level nested structure which allows for binary scoring (for correctness) and polytomous scoring (for distractors) at the same time. One advantage of these models is that they can provide distractor information while maintaining the statistical properties of the correct response option. We evaluated parameter recovery through a simulation study using Hamiltonian Monte Carlo algorithms in Stan. We also discussed three approaches to implementing the proposed modelling framework for different purposes and testing scenarios. We illustrated those approaches and compared them with a binary model and a traditional nominal model through an operational study.     

新一代测验理论-认知诊断理论的源起与特征

认知诊断理论被视为新一代测验理论的核心,是认知心理学与现代测量学相结合的产物。对认知诊断的研究已成为当前国外心理学研究的一个重要热点,并引起国内学者的广泛关注。本文从认知诊断的源起、概念、特征,及研究的基础、框架、意义和难点等七个方面对认知诊断的理论与技术作了一个简要述评,以期推进我国心理学界认知诊断的研究工作。     

医学影像诊断报告的双重属性——现状与对策

医学影像诊断报告是重要的医疗文书,在临床诊治过程中发挥重要作用。影像报告具有客观性和主观性的双重属性。一方面,报告需要客观描述影像所见,真实地记录病变特点,而另一方面,报告中又包含根据图像做出的主观评价。如何努力化解两方面要求带来的冲突,是摆在影像医生面前需要解决的问题。     

对学前儿童语言学习能力诊断量表的效度评价

以所编制的量表为工具 ,对采集的数据进行效度分析 ,结果表明各分测验与全量表有较好的相关 ,说明量表的内容效度是比较高的。使用因素分析的方法 ,将全部变量作系统分类 ,研究量表的结构 ,绝大部分分测验在所得的四个因素上的共通性都大于 0 .70 ;保留下的分测验与所属因素的相关系数在0 .5 3 -0 .84之间 ,它们在各个因素上有较高的负荷量 ,说明量表有较好的结构效度。从效度分析的结果看 ,本量表的测量结果应该是准确的。另外 ,还根据因素分析结果指示的方向 ,调整了分测验 ,调整后的量表结构不但与假设的量表结构十分吻合 ,而且更条理化。     

Virtually overcoming grammar learning with 3D application of Loci mnemonics?

The importance of contextual information for memory organization has been advocated by memory research and ancient mnemonic techniques (e.g., method of loci), yet it remains overlooked in most current study environments. Here, German noun gender was presented to 48 participants without prior knowledge of German, either without or within a provided spatial context consisting of a simulated virtual environment that could be explored freely. The three main findings were: in addition to reduced forgetting rate, memory was significantly enhanced when acquisition had occurred with a spatial context than without, in immediate, and delayed cued recall, as well as in delayed free recall. Second, visualization ability predicted spatial context efficiency as a memory aid for cued recall. Lastly, performance of the method of loci‐based method correlated with its perceived efficiency. This is the first study to experimentally demonstrate the potential effectiveness of computer‐induced spatial context on grammar learning.     

Goal-setting in diabetes self-management: A systematic review and meta-analysis examining content and effectiveness of goal-setting interventions

Background: Goal-setting is recommended and widely used within diabetes self-management programmes. However, empirical evidence around its effectiveness lacks clarity. This review aims to evaluate the effectiveness of goal-setting interventions on diabetes outcomes and to determine which behaviour change techniques (BCTs) are frequently used within these interventions.

Methods: A systematic search identified 14 studies, describing 12 interventions targeting diabetic-control which incorporated goal-setting as the main intervention strategy. Study characteristics, outcome measures and effect sizes of the included studies were extracted and checked by two authors. The BCT taxonomy v1 was used to identify intervention content. Meta-analyses were conducted to assess intervention effects on the primary outcome of average blood glucose levels (HbA1c) and on body-weight. Psycho-social and behavioural outcomes were summarised in narrative syntheses.

Results: Significant post-intervention improvements in HbA1C were found (?.22, 95% CI, ?.40, ?.04) across studies. No other main effects were identified. The BCT ‘goal-setting (behaviour)’ was most frequently implemented and was identified in 84% of the interventions.

Conclusions: Goal-setting interventions appear to be associated with reduced HbA1C levels. However, the low numbers of studies identified and the risk biases across studies suggest more research is needed to further explore goal-setting BCTs in diabetes self-management.     

Parent-Reported Behavioral and Emotional Responses of Children to Disaster and Parental Psychopathology

Child disaster mental health research has been largely limited by investigation of one disaster at a time and inconsistent methods across different studies. This study assessed 160 survivors of 3 disasters with structured diagnostic interviews, asking about the behavioral and emotional disaster reactions of their 266 children, ages 3–17. Most children had ≥1 postdisaster behavior change or disaster-related posttraumatic stress symptom. The children’s postdisaster behavioral and emotional problems were associated with parental postdisaster psychopathology. The results underscore the importance of asking disaster survivors about their children’s disaster reactions and considering parental disaster experiences and reactions in addressing their children’s reactions.     

On Interim Cognitive Diagnostic Computerized Adaptive Testing in Learning Context

Interim assessment occurs throughout instruction to provide feedback about what students know and have achieved. Different from the current available cognitive diagnostic computerized adaptive testing (CD-CAT) design that focuses on assessment at a single time point, the authors discuss several designs of interim CD-CAT that are suitable in the learning context. The interim CD-CAT differs from the current available CD-CAT designs primarily because students’ mastery profile (i.e., skills mastery) changes due to learning, and new attributes are added periodically. Moreover, hierarchies exist among attributes taught sequentially and such information could be used during item selection. Two specific designs are considered: The first one is when new attributes are taught in Stage II, but the student mastery status of the previously taught attributes stays the same. The second design is when both new attributes are taught, and previously taught attributes can be further learned or forgotten in Stage II. For both designs, the authors propose an individual prior, which considers a person’s learning history and population learning model, to start an interim CD-CAT. Simulation results show that the Stage II CD-CAT using individual prior outperforms the methods using population priors. The GDINA (generalized deterministic inputs, noisy, “and” gate) diagnostic index (GDI) is extended to accommodate item hierarchies, and analytic results are provided to further illustrate the types of items that are most popular during item selection. As the first study that focuses on the application of CD-CAT in a learning context, the methods and results present herein showed the great promise of using CD-CAT to monitor learning.     

基于选项层面的认知诊断非参数方法

充分挖掘选择题(Multiple-Choice, MC)的诊断信息受到了较多关注, 将干扰项信息考虑在内可以提升诊断精度。为了弥补参数模型基于大样本才能获得可靠估计的不足, 以及适用于班级水平的小样本诊断测验情境, 本研究提出了非参数的多选题诊断方法。模拟和实证研结果表明：(1)当MC测验中题目参数不存在较大差异时, ${{d}_{\text{ph}-\text{MC}}}$法在多数情况下表现优于参数类诊断模型。(2)当MC测验中题目参数存在较大差异时, ${{d}_{ph-MC}}$法的表现最优。(3)实证研究中非参数方法和参数类模型的分类一致性程度较高, ${{d}_{\text{ph}-\text{MC}}}$距离法估计得到的考生属性总体掌握程度与总分相关最高。最后, 基于MC诊断测验的特点提出了若干研究方向。     

What is the best way to promote cycling? A systematic review and meta-analysis

Cycling has the potential to address a number of personal and societal challenges, not least with respect to health and the need for more sustainable modes of transport. However, the best way(s) to promote cycling is still unclear. In an effort to answer this question, we identified 39 interventions designed to promote cycling, with a total sample of 46,102 participants. Random effects meta-analysis estimated a small but statistically significant effect of interventions on cycling behaviour (g₊ = 0.14, 95% CI [0.05, 0.23]). To identify the most effective intervention strategies, we coded the behaviour change techniques used within each of the interventions. Interventions that prompted people to self-monitor their behaviour or added objects to the environment (e.g., provided shared bikes) were more effective than those that did not use these strategies. Interventions that restructured the physical environment (e.g., built new cycle paths) were less effective than the studies that did not do this. We also identified a number of factors that moderated the effect of the interventions on outcomes; specifically, interventions that targeted a specific group, used objective measures of cycling such as accelerometers, and that were tested using independent groups designs typically yielded stronger effects. The findings should help to guide interventions to promote cycling in the future.