A Multivariate Multilevel Approach to the Modeling of Accuracy and Speed of Test Takers

Response times on test items are easily collected in modern computerized testing. When collecting both (binary) responses and (continuous) response times on test items, it is possible to measure the accuracy and speed of test takers. To study the relationships between these two constructs, the model is extended with a multivariate multilevel regression structure which allows the incorporation of covariates to explain the variance in speed and accuracy between individuals and groups of test takers. A Bayesian approach with Markov chain Monte Carlo (MCMC) computation enables straightforward estimation of all model parameters. Model-specific implementations of a Bayes factor (BF) and deviance information criterium (DIC) for model selection are proposed which are easily calculated as byproducts of the MCMC computation. Both results from simulation studies and real-data examples are given to illustrate several novel analyses possible with this modeling framework. The authors thank Steven Wise, James Madison University, and Pere Joan Ferrando, Universitat Rovira i Virgili, for generously making available their data sets for the empirical examples in this paper.     

定量运动负荷后间隔不同时间的肘关节动觉方位准确性

该研究以过去研究中发现的定量运动负荷可以显著提高肘关节动觉方位准确性为基础,试图讨论这种定量运动负荷后间隔不同时间的肘关节动觉方位准确性。     

A phase transition model for the speed-accuracy trade-off in response time experiments

Most models of response time (RT) in elementary cognitive tasks implicitly assume that the speed-accuracy trade-off is continuous: When payoffs or instructions gradually increase the level of speed stress, people are assumed to gradually sacrifice response accuracy in exchange for gradual increases in response speed. This trade-off presumably operates over the entire range from accurate but slow responding to fast but chance-level responding (i.e., guessing). In this article, we challenge the assumption of continuity and propose a phase transition model for RTs and accuracy. Analogous to the fast guess model (Ollman, 1966), our model postulates two modes of processing: a guess mode and a stimulus-controlled mode. From catastrophe theory, we derive two important predictions that allow us to test our model against the fast guess model and against the popular class of sequential sampling models. The first prediction--hysteresis in the transitions between guessing and stimulus-controlled behavior--was confirmed in an experiment that gradually changed the reward for speed versus accuracy. The second prediction--bimodal RT distributions--was confirmed in an experiment that required participants to respond in a way that is intermediate between guessing and accurate responding.     

词频和年级对FOK判断的影响

本实验以识记材料的词频高低和被试年级为自变量对被试元记忆监测的FOK(feeling of knowing)判断进行研究。实验采用Hart提出的RJR(回忆—FOK判断—标准测验 )的经典范式。结果表明 :被试的年级影响FOK判断等级和准确性 ,大学生的FOK判断等级和准确性均高于高一年级学生 ;识记材料词频影响FOK判断等级的高低 ,不影响FOK判断准确性 ,被试对高频词对的FOK判断等级高于对低频词对的FOK判断等级 ,但FOK判断准确性无明显差异。     

Discounting: A practical guide to multilevel analysis of choice data

Multilevel modeling provides the ability to simultaneously evaluate the discounting of individuals and groups by examining choices between smaller sooner and larger later rewards. A multilevel logistic regression approach is advocated in which sensitivity to relative reward magnitude and relative delay are considered as separate contributors to choice. Examples of how to fit choice data using multilevel logistic models are provided to help researchers in the adoption of these methods.     

变长CD-CAT中的曝光控制与终止规则

本研究借鉴传统计算机化自适应测验的思想, 并结合认知诊断的特点, 在认知诊断框架下提出了4种变长CD-CAT的终止规则, 分别是属性标准误法(SEA)、邻近后验概率之差法(DAPP)、二等分法(HA)以及混合法(HM)。在未控制曝光和采用不同曝光控制条件下, 与HSU法及KL法进行了比较。研究结果表明：(1) 终止条件越严格, 平均测验长度越长, 按测验长度最大值终止的测验百分比越大, 模式判准率越高。(2) 当未加入曝光控制时, 4种新的终止规则均有较好表现, 与HSU法十分接近。随着最大后验概率预设值的增加或e的减小, 模式判准率呈上升趋势, 平均测验长度逐渐增加, 但在题库使用率方面均较差。(3) 当加入项目曝光控制时, 6种变长终止规则下的题库使用率有了极大的提升, 仍能保持较高的模式判准率, 并且不同的曝光控制方法对终止规则的影响是不同的。其中, 相对标准终止规则极易受到曝光控制方法的影响。(4) 综合来看, SEA、HM以及HA法在各项指标上的表现与HSU法基本一致, 其次为KL法和DAPP法。     

A Monte Carlo evaluation of masked visual analysis in response‐guided versus fixed‐criteria multiple‐baseline designs

We developed masked visual analysis (MVA) as a structured complement to traditional visual analysis. The purpose of the present investigation was to compare the effects of computer‐simulated MVA of a four‐case multiple‐baseline (MB) design in which the phase lengths are determined by an ongoing visual analysis (i.e., response‐guided) versus those in which the phase lengths are established a priori (i.e., fixed criteria). We observed an acceptably low probability (less than .05) of false detection of treatment effects. The probability of correctly detecting a true effect frequently exceeded .80 and was higher when: (a) the masked visual analyst extended phases based on an ongoing visual analysis, (b) the effects were larger, (c) the effects were more immediate and abrupt, and (d) the effects of random and extraneous error factors were simpler. Our findings indicate that MVA is a valuable combined methodological and data‐analysis tool for single‐case intervention researchers.     

线索冲突情境下幼儿对不同领域知识的选择性信任特点

探讨幼儿在准确性线索和共识线索冲突情境下对自然与社会领域知识的选择性信任特点。实验1探究幼儿在线索冲突情境下对自然领域知识的选择性信任,选取88名4~6岁幼儿,采用对物品命名的方法,结果发现4岁幼儿依据共识线索进行信任判断,而5~6岁幼儿依据准确性线索进行信任判断;实验2探究幼儿在线索冲突情境下对社会领域知识的选择性信任,选取94名4-6岁幼儿,采用对人格特质命名的方法,结果发现4岁幼儿依据共识线索进行信任判断,5岁幼儿对两类线索没有做出偏向性选择,6岁幼儿依据准确性线索进行信任判断。实验3采用被试内设计,探讨5岁幼儿对两个领域知识的选择性信任,验证了实验1和实验2的相关结果。结论:在线索冲突情境下幼儿对不同领域知识的选择性信任具有不同的年龄发展特点。     

Beyond inference by eye: Statistical and graphing practices in JEAB, 1992‐2017

Debates about the utility of p values and correct ways to analyze data have inspired new guidelines on statistical inference by the American Psychological Association (APA) and changes in the way results are reported in other scientific journals, but their impact on the Journal of the Experimental Analysis of Behavior (JEAB) has not previously been evaluated. A content analysis of empirical articles published in JEAB between 1992 and 2017 investigated whether statistical and graphing practices changed during that time period. The likelihood that a JEAB article reported a null hypothesis significance test, included a confidence interval, or depicted at least one figure with error bars has increased over time. Features of graphs in JEAB, including the proportion depicting single‐subject data, have not changed systematically during the same period. Statistics and graphing trends in JEAB largely paralleled those in mainstream psychology journals, but there was no evidence that changes to APA style had any direct impact on JEAB. In the future, the onus will continue to be on authors, reviewers and editors to ensure that statistical and graphing practices in JEAB continue to evolve without interfering with characteristics that set the journal apart from other scientific journals.