Scoring Depression on a Common Metric: A Comparison of EAP Estimation,Plausible Value Imputation,and Full Bayesian IRT Modeling

There are a growing number of item response theory (IRT) studies that calibrate different patient-reported outcome (PRO) measures, such as anxiety, depression, physical function, and pain, on common, instrument-independent metrics. In the case of depression, it has been reported that there are considerable mean score differences when scoring on a common metric from different, previously linked instruments. Ideally, those estimates should be the same. We investigated to what extent those differences are influenced by different scoring methods that take into account several levels of uncertainty, such as measurement error (through plausible value imputation) and item parameter uncertainty (through full Bayesian IRT modeling). Depression estimates from different instruments were more similar, and their corresponding confidence/credible intervals were larger when plausible value imputation or Bayesian modeling was used, compared to the direct use of expected a posteriori (EAP) estimates. Furthermore, we explored the use of Bayesian IRT models to update item parameters based on newly collected data.     

IRT框架下追踪数据的测量不变性分析——————以4至5岁儿童认知能力测验为例

本研究以4岁~5岁儿童认知能力测验为例,在IRT框架下探讨了如何进行追踪数据的测量不变性分析。分析模型采用项目间多维项目反应理论模型(between-item MIRT model)和项目内（within-item MIRT model）多维two-tier model,被试为来自全国的882名48个月的儿童,工具为自编4岁~5岁儿童认知能力测验。经测验水平 分析和项目水平分析,结果表明：(1)本文对追踪数据的测量不变性分析方法合理有效; (2)该测验在两个时间点上满足部分测量不变性要求,测验的潜在结构稳定; (3)“方位题”的区分度和难度参数都发生变化,另有4题难度参数出现浮动; (4)儿童在4岁~5岁期间认知能力总体呈快速发展趋势,能力增长显著。     

Selection of strategies for narrowing choice options: Antecedents and consequences

This study investigates the antecedents (task and decision maker characteristics) and consequences (set size and decision quality) of prescreening strategy selection. In Experiment 1 we investigated which strategy, inclusion or exclusion, is more natural for narrowing choices in tasks with a single correct answer; about 70% of the participants selected exclusion. Experiment 2 directly contrasted correct answer tasks with personal judgment tasks, using the same foils for the two tasks. Participants were more likely to use exclusion for items with a correct answer than for personal judgments. In Experiment 3, participants could choose different strategies for different items and rated the difficulty of each item. The greater the perceived difficulty of an item, the more likely participants were to choose an exclusion strategy. In all three experiments exclusion led to larger set sizes, across task type and experimental design. There were no differences in decision quality as a function of strategy selection after correcting for set size. Individual differences based on personality inventories were not found to be good predictors of strategy selection, but had moderate effects on set size for personal judgment tasks. Results are discussed in terms of a status quo bias for adding or deleting options from an initial reference frame.     

Measuring individual differences in sensitivities to basic emotions in faces

The assessment of individual differences in facial expression recognition is normally required to address two major issues: (1) high agreement level (ceiling effect) and (2) differential difficulty levels across emotions. We propose a new assessment method designed to quantify individual differences in the recognition of the six basic emotions, 'sensitivities to basic emotions in faces.' We attempted to address the two major assessment issues by using morphing techniques and item response theory (IRT). We used morphing to create intermediate, mixed facial expression stimuli with various levels of recognition difficulty. Applying IRT enabled us to estimate the individual latent trait levels underlying the recognition of respective emotions (sensitivity scores), unbiased by stimulus properties that constitute difficulty. In a series of two experiments we demonstrated that the sensitivity scores successfully addressed the two major assessment issues and their concomitant individual variability. Intriguingly, correlational analyses of the sensitivity scores to different emotions produced orthogonality between happy and non-happy emotion recognition. To our knowledge, this is the first report of the independence of happiness recognition, unaffected by stimulus difficulty.     

计算机自适应测验在特质焦虑量表中的运用

将基于项目反应理论的计算机自适应测验运用于特质焦虑量表,考察这一测验形式在人格测量中所具有的特性.收集特质焦虑量表真实纸笔作答数据,选用合适的心理测量模型,模拟计算机自适应测验.结果表明：相对纸笔测验而言,计算机自适应测验的测试效率更高、对被试的分辨力更强、结果更直观.计算机自适应测验在人格测量中的实践值得进一步探索.     

The role of item similarity in part-list cueing impairment

The presentation of a subset of studied items as retrieval cues can have detrimental effects on recall of the remaining (target) items. In three experiments we examined whether such part-list cueing impairment depends on the similarity between cue and target items. Item similarity was manipulated by making use of pre-experimental semantic similarities between cue and target items (Experiments 1 and 2), or was episodically induced through a similarity-encoding task, in which participants were asked to interrelate cue and target items in a meaningful way (Experiment 3). In all three experiments reliable part-list cueing impairment arose when the similarity between cues and targets was low, but no impairment was found when the similarity between cues and targets was high. Inhibitory as well as non-inhibitory explanations of the findings are discussed.     

高考数学试卷多维项目反应理论的分析及应用

高考数学学科试卷的试题综合性较强,一道试题通常考查多种能力属性,而基于单维性假设下的经典测量理论和传统的项目反应理论无法完成该种情形下试卷测量性能分析和考生作答表现分析.本文以MIRT理论为基础,使用CONQUEST软件为工具进行分析,可以获得试卷内部不同能力维度之间的相关以及考生不同维度的能力参数,为提升命题质量和改进教学提供了依据,表明MIRT具有很好的应用前景.由于MIRT理论的复杂性以至于目前分析软件的不足制约其进一步的深入应用,这是今后应该深入研究的问题.     

Development of an abbreviated Personal Globe Inventory using item response theory: The PGI-Short

The responses of 2813 individuals to the Personal Globe Inventory (Tracey, 2002) were examined with the goal of developing a shorter, yet valid version of the scale using item response theory to guide the process. A random sample of 1000 individuals was used to select the best items and then the remaining 1813 were used as a validation sample to examine psychometric properties. For items to be included in the shortened form, the option characteristic curves had to conform to theory and there could be no presence of differential item functioning across either gender or ethnicity. The best 80 items were retained forming the PGI-Short. This instrument demonstrated excellent reliability and adherence to a circular model, there was no differential item functioning across either gender or ethnicity. The PGI-Short was supported as an alternative to the fuller version of the PGI.     

The role of processes and contents in human memory: An item response theory approach

This study investigated the specificities and communalities of visuospatial and verbal memory contents, as well as short-term memory and working memory (STM and WM) processes with the use of Rasch models as an alternative to the previous studies based on the classical test theory. A sample of 547 undergraduate students executed four computerised tasks, each consisting of verbal-numeric WM, visuospatial WM, verbal-numeric STM, and visuospatial STM content. Confirmatory factor analyses indicated that visuospatial and verbal-numeric memory are distinct, but correlated variables. Findings also support a domain-general view of WM capacity distinct from domain-specific storage. With the use of Rasch models, our results confirm previous experimental, psychometric, and neuropsychological studies, highlighting that memory span tasks can be divided into separate subsystems for content and processes. This study also shows that better results are obtained when models with person parameter estimates (provided from Rasch models) are adopted, rather than summed raw scores.     

Depressed Adolescents and Comorbid Psychiatric Disorders: Are There Differences in the Presentation of Depression?

Patterns and correlates of comorbidity, as well as differences in manifest depressive profiles were investigated in a sample of depressed adolescents. A sub-sample of the youth were characterized as belonging to either a Pure depression group, an Internalizing group (depression and co-occurring internalizing disorders), or an Externalizing group (depression and co-occurring externalizing disorders). Item response theory (IRT) and differential item functioning (DIF) were used to assess whether the depressed adolescents from the different comorbidity groups presented with different depressive symptoms. Results indicated that the comorbidity groups were meaningfully distinct in terms of psychosocial correlates as well as showed differences in depressive symptom profiles as informed by DIF analyses. In particular, the comorbidity groups differed in terms of presentation of psychomotor changes and cognitive impairments. Implications for assessment are discussed.