选项具有诊断信息的多选题认知诊断测验编制

编制选项具有诊断信息的多选题是提高多选题认知诊断测验诊断效果的有效方法.研究从认知诊断的目标出发,根据认知诊断测验质量的评价标准,结合多选题的特点,探讨选项具有诊断信息的多选题认知诊断测验编制的原则.同时,结合多选题的特点和多选题采用称名计分方式的需要,对编制选项具有诊断信息的多选题提出两点要求.根据多选题认知诊断测验编制的原则和要求,给出具有可操作性的多选题认知诊断测验编制的步骤.模拟研究结果表明：根据所提出的原则和要求编制的多选题认知诊断测验具有较好的诊断效果,说明这些原则和要求合理、可行.由于这些原则、要求和步骤具有较强的可操作性,因此它对于编制多选题认知诊断测验具有一定的指导意义.     

Achievement Goal Impacts Students' Preferences for “Personalized Problems” in Computer-Adaptive Tests1

The contemporary development of psychometric theories and information technologies enables students to work on algorithm-based personalized tests in classroom settings. This study aims to investigate the relationship between students' achievement goals and what they prefer as “personalized problems” in computer-adaptive tests. We theoretically contrast achievement goals with developing competency through mastery and demonstrating competency through performance goals. We asked elementary and secondary school students to work on a computer-adaptive test and to complete questionnaires about what they prefer as “personalized problems” in computer-adaptive tests. The results revealed that while mastery goals positively predicted preference for challenging problems, performance goals positively predicted preference for problems that guaranteed students’ success. Moreover, only the preference for challenging problems positively predicted the intention to take computer-adaptive tests in the future. These results suggest that simply introducing a computer-adaptive test into the classroom may not be effective. We discuss how educational technologies should be integrated into human teaching activities.     

ITC Guidelines for Translating and Adapting Tests (Second Edition)

The second edition of the International Test Commission Guidelines for Translating and Adapting Tests was prepared between 2005 and 2015 to improve upon the first edition, and to respond to advances in testing technology and practices. The 18 guidelines are organized into six categories to facilitate their use: pre-condition (3), test development (5), confirmation (4), administration (2), scoring and interpretation (2), and documentation (2). For each guideline, an explanation is provided along with suggestions for practice. A checklist is provided to improve the implementation of the guidelines.     

The Flynn effect,group differences,and g loadings

Flynn effect gains are predominantly driven by environmental factors. Might these factors also be responsible for group differences in intelligence? Group differences in intelligence have been clearly shown to strongly correlate with g loadings. The empirical studies on whether the pattern of Flynn effect gains is the same as the pattern of group differences yield conflicting findings. We present new evidence on the topic using a number of datasets from the US and the Netherlands. Score gains and g loadings showed a small negative average correlation. The general picture is now that there is a small, negative correlation between g loadings and Flynn effect gains. It appears that the Flynn effect and group differences have different causes.     

Comment on “Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology”

A serious problem with Popperian falsificationism in the presence of auxiliary hypotheses and experimental conditions, in addition to a theory under test, is raised by Meehl. In brief, a negative result endangers both the theory in question, and the auxiliary hypotheses; which should we reject? I discuss how considering series of studies, rather than a single study, helps make this problem somewhat more tractable. I treat situations where negative results are in hand, as well as situations where positive results may be discounted by skeptics who question auxiliary hypotheses.     

Neuropsychological Performance in Gulf War Era Veterans: Neuropsychological Symptom Reporting

Relationships between broad-based health symptoms and neuropsychological performance have been investigated previously in Gulf War (GW) veterans. However, very little has been done to assess relationships between severity of neuropsychological symptom complaints and performance on objective neuropsychological tests. In this study, relationships between level of self-reported neuropsychological symptom severity and objective neuropsychological performance measures were investigated. Participants included 240 veterans from three GW-era cohorts: GW-deployed veterans recruited from Ft. Devens, MA, (n = 142) and from New Orleans, LA (n = 51), and veterans deployed to Germany from a Maine National Guard unit (n = 47). Findings suggest that level of subjective neuropsychological complaints was associated primarily with mood symptoms in GW-era veterans. Among GW-deployed troops, high neuropsychological symptom reporters endorsed more tension, fatigue, and confusion and less vigor than those reporting fewer cognitive complaints. Current findings emphasize the importance of independent assessment of subjective symptoms and objective neuropsychological performance.     

资格认证测验的信度估计及其特征分析

资格认证测验属于典型的标准参照测验,在国内已得到普遍应用,但在报告心理测量学指标时很少提到标准参照模式的信度估计指标。该文归纳了标准参照测验信度估计的指标体系,分析讨论了适用于资格认证测验的信度估计及其与测验长度、分界标准分布、样本同质性的关系与特征。     

Prospect theory analysis of guessing in multiple choice tests

The guessing of answers in multiple choice tests adds random error to the variance of the test scores, lowering their reliability. Formula scoring rules that penalize for wrong guesses are frequently used to solve this problem. This paper uses prospect theory to analyze scoring rules from a decision‐making perspective and focuses on the effects of framing on the tendency to guess. In three experiments participants were presented with hypothetical test situations and were asked to indicate the degree of certainty that they thought was required for them to answer a question. In accordance with the framing hypothesis, participants tended to guess more when they anticipated a low grade and therefore considered themselves to be in the loss domain, or when the scoring rule caused the situation to be framed as entailing potential losses. The last experiment replicated these results with a task that resembles an actual test. Copyright © 2002 John Wiley & Sons, Ltd.     

Replicability and randomization test logic in behavior analysis

Randomization tests are a class of nonparametric statistics that determine the significance of treatment effects. Unlike parametric statistics, randomization tests do not assume a random sample, or make any of the distributional assumptions that often preclude statistical inferences about single‐case data. A feature that randomization tests share with parametric statistics, however, is the derivation of a p‐value. P‐values are notoriously misinterpreted and are partly responsible for the putative “replication crisis.” Behavior analysts might question the utility of adding such a controversial index of statistical significance to their methods, so it is the aim of this paper to describe the randomization test logic and its potentially beneficial consequences. In doing so, this paper will: (1) address the replication crisis as a behavior analyst views it, (2) differentiate the problematic p‐values of parametric statistics from the, arguably, more useful p‐values of randomization tests, and (3) review the logic of randomization tests and their unique fit within the behavior analytic tradition of studying behavioral processes that cut across species.     

Cerebral lateralization and general intelligence: gender differences in a transcranial Doppler study

The present study evaluated cerebral lateralization during Raven's progressive matrices (RPM) paradigm in female and male subjects. Bilateral simultaneous transcranial Doppler (TCD) ultrasound was used to measure mean blood flow velocities (MBFV) in the right and left middle cerebral arteries (MCAs) in 24 (15 females and 9 males) right-handed normal subjects. The female subjects used a left hemisphere strategy, while males used a right hemisphere strategy to successfully solve RPM tasks. This implies that general intelligence is associated with neural systems within one hemisphere that are accessible to a variety of cognitive processes.