Effects of signal uncertainty on statistical decisions

The experimental task involved statistical judgements about parameters of a random sample of dots displayed sequentially from a ‘signal’ or ‘noise’ distribution. Signal uncertainty was introduced by presenting small signal subsets of dots within larger observation sequences. Observer detection performance was adversely affected by this kind of signal uncertainty, but in the same way and to similar extent as that expected on the basis of ‘ideal’ and ‘independent’ statistical decision strategies.     

项目表述效应的统计控制：以中文版生活定向测验为例

本研究以中文版生活定向测验（LOT-R）为例,使用CTCM和CTCU方法进行建模,旨在探讨中文表述的量表中是否存在项目表述效应以及影响项目表述效应的特质因素。采用中文版生活定向测验等量表组成的问卷对334名大学生进行测试。结果表明,中文版LOT-R存在项目表述效应,是一种反向题的项目表述效应,也可称为语言标签效应;在分离了反向题项目表述效应后,发现中文版LOT-R只存在乐观因子,而不再有悲观因子。这表明乐观-悲观同属于一种人格特质,而非两种不同的人格特质;反向题项目表述效应是一种结构性误差,会导致量表结构的扭曲。研究还发现担心错误和父母期望与反向题项目表述效应存在显著的负相关,表明越是担心错误或父母期望水平越高的被试,他们对反向题的项目表述效应（语言标签效应）越小。社会赞许性对反向题项目表述效应没有影响。     

Hierarchical single- and dual-process models of recognition memory

Recognition memory is commonly modeled as either a single, continuous process within the theory of signal detection, or with two-process models such as Yonelinas’ dual-process model. Previous attempts to determine which model provides a better account of the data have relied on fitting the models to data that are averaged over items. Because such averaging distorts conclusions, we develop and compare hierarchical versions of competing single and dual-process models that account for item variability. The dual-process model provides a superior account of a typical data set when models are compared with the deviance information criterion. Parameters of the dual-process model are highly correlated, however, suggesting that a single-process model may exist that can provide a better account of the data.     

Source monitoring and multivariate signal detection theory, with a model for selection

Participants in source monitoring studies, in addition to determining whether an item is old or new, also discriminate the source of the item, such as whether the item was presented in a male or female voice. This article shows how to apply multivariate signal detection theory (SDT) to source monitoring. An interesting aspect of one version of the source monitoring procedure, from the perspective of multivariate SDT, is that it involves a type of selection, in that a discrimination response is observed only if the detection decision is that an item is old. If the selection is ignored, then the estimate of the discrimination parameter can be biased; the nature and magnitude of the bias are illustrated. A bivariate signal detection model that recognizes selection is presented and its application is illustrated. The approach to source monitoring via multivariate SDT provides new results that are informative about underlying psychological processes.     

Glimpses of a one-speed mind: Focus-switching and search for verbal and visual, and easy and difficult items in working memory

We investigated focus-switching and search rates in an N-Back task for stimuli presumably encoded either in a phonological/semantic or an abstract-visual format. Experiment 1 used Chinese characters and tested Chinese speakers and non-Chinese speakers; character frequency and visual complexity were also manipulated. Experiment 2 presented Chinese characters and English words to non-Chinese English speakers. Effects of focus-switching on accuracy were larger for abstract-visual stimuli and for more difficult stimuli; effects on RT were larger for abstract-visual stimuli, but there was no effect of difficulty, with the exception of the most difficult stimulus set in Experiment 1. Search slopes outside the focus of attention did not covary with either type of code or item difficulty. The decline in accuracy over set-size was stronger for the items coded in abstract-visual format. This suggests that item availability is sensitive to robustness of the memory representations, but item accessibility is not. The data fit well with a model of STM in which a fixed number of ‘slots’ are searched at a constant rate, regardless of the slot’s contents.     

Two are better than one: comparison influences infants' visual recognition memory

Despite a large literature on infants’ memory for visually presented stimuli, the processes underlying visual memory are not well understood. Two studies with 4-month-olds (N = 60) examined the effects of providing opportunities for comparison of items on infants’ memory for those items. Experiment 1 revealed that 4-month-olds failed to show evidence of memory for an item presented during familiarization in a standard task (i.e., when only one item was presented during familiarization). In Experiment 2, infants showed robust memory for one of two different items presented during familiarization. Thus, infants’ memory for the distinctive features of individual items was enhanced when they could compare items.     

随机截距因子分析模型在控制条目表述效应中的应用

本研究用中文修订版罗森博格自尊量表(RSES-R)考察随机截距因子分析模型在控制条目表述效应时的表现。用RSES-R和过分宣称问卷组成的量表调查621名中学生。结果表明,随机截距模型在建模时,拟合指数良好、因子方差与负荷合理,自尊因子分与RSES-R总分有极高相关,表明该模型能有效分离RSES-R得分的特质与表述效应。分离的表述效应因子分与受测者的自我提升水平具有显著但较弱的相关,表明表述效应与自受测者的社会赞许性有共同的成分。     

汉语口语句子产生的语法编码计划单元

语法编码的计划单元作为口语句子产生领域的一个重要命题,近年来备受心理语言学者的关注。本研究利用词图干扰范式下的语义效应,通过两个行为实验探讨了汉语口语句子产生中的语法编码计划单元。实验中要求被试用介词短语做主语的句子或者并列名词短语做主语的句子来命名两个竖直排列的图片,并视觉呈现干扰词。结果表明,对于两个句式而言,在第二个名词上都没有潜伏期的语义干扰效应,只有错误率上的语义干扰效应,而且这个结果并没有随着SOA(目标图片和干扰词开始呈现的时间间隔)的改变(0、150或300ms)而改变。当干扰词与图片同时呈现时(SOA=0)在并列名词短语做主语的句子中,第二个名词上出现了潜伏期的语义促进效应。这些结果说明,语法编码的说法较为宽泛,应具体描述为:词汇选择是严格递进的,而概念激活的计划单元可能是功能短语。     

The mirror effect and mixture signal detection theory

The mirror effect for word frequency refers to the finding that low-frequency words have higher hit rates and lower false alarm rates than high-frequency words. This result is typically interpreted in terms of conventional signal detection theory (SDT), in which case it indicates that the order of the underlying old item distributions mirrors the order of the new item distributions. However, when viewed in terms of a mixture version of SDT, the order of hits and false alarms does not necessarily imply the same order in the underlying distributions because of possible effects of mixing. A reversal in underlying distributions did not appear for fits of mixture SDT models to data from 4 experiments.     

Item Characteristic Curve Estimation of Signal Detection Theory-Based Personality Data: A Two-Stage Approach to Item Response Modeling

Signal Detection Theory (SDT; MacMillan & Creelman, 1991) is a method of data collection that has been used for several years, which describes the decision-making strategies of individuals. However, its use has been largely restricted to experiments involving sensation and perception. The Overclaiming Questionnaire (OCQ; Paulhus & Bruce, 1990) is a scale that has been developed to measure intellectual ability and personality, using SDT as a guideline. Although the scale has been successful in measuring human characteristics such as narcissism and intelligence, it is still unclear how to measure the characteristics of the various stimuli used (e.g., item difficulty, item discrimination, etc.). In some ways, this is a direct consequence of the general lack of research involved in item parameter estimation in the field of SDT. Using the OCQ, this article presents a graphical and nonparametric form of item response modeling to address this issue. In many ways, the approach is influenced by and structured around item response theory (IRT; Hambleton, Swaminathan, & Rogers, 1991). The general features of both SDT and IRT are described. Results suggest that this method is indeed a reasonable approach to describing item functioning, and there are several advantages to using this method over traditional IRT methods. Furthermore, SDT appears to be a fruitful approach to assessing intelligence, ability, and other psychological constructs, with advantages over traditional approaches. Overall, the results provide interesting implications for item selection and test development in several scientific and academic fields.     

Units of analysis and item statistics for environmental assessment scales

Choice of units of analysis is a critical problem in evaluating environmental assessment items. The “Ecological Fallacy” involves interpreting results based on ecological entities, such as environmental settings, as applying to individuals. A less familiar error, the “Individual Differences Fallacy,” involves interpreting results based on individuals as applying to settings. Although this second error has been ubiquitous, little is known about the empirical consequences of using different units of analysis in item analysis. This study examined this issue when the units were (1) individuals, (2) observed settings, or (3) “artificial” or random settings. Neither item validities based on individuals nor item validities based on settings yielded unequivocal results. However, a measure developed specifically for environmental research, the Split-Sample Correlation, appeared useful for identifying environmental items. Researchers constructing environmental assessment scales should select items with both high Split-Sample Correlations and high setting-level item validities.     

Positive and negative remember judgments and ROCs in the plurals paradigm: Evidence for alternative decision strategies

Using old-new ratings and remember-know judgments we explored the plurals paradigm, in which studied words must be distinguished from plurality-changed lures. The paradigm allowed us to investigate negative remembering—that is, the remembering of a plural-altered study item; capacity for this judgment was found to be poorer than or equivalent to the conventional positive remembering. A response-bias manipulation affected positive but not negative remembering. The ratings were used to construct ROC curves and test the prediction of the most common dual-process theory of recognition memory (Yonelinas, 2001) that the amount of recollection can be independently estimated from ROC curves and from remember judgments. By fitting the individual data with pure signal detection theory (SDT) models and dual-process models that combined SDT and high-threshold components (HTSDT), we identified two types of subjects. For those who were better described by HTSDT, the predicted convergence of remember-know and ROC measures was observed. For those who were better described by SDT, the ROC intercept could not predict the remember rate. The data are consistent with the idea that all subjects rely on the same representation but base their decisions on different partitions of a decision space.     

Units of analysis and item statistics for environmental assessment scales

Choice of units of analysis is a critical problem in evaluating environmental assessment items. The “Ecological Fallacy” involves interpreting results based on ecological entities, such as environmental settings, as applying to individuals. A less familiar error, the “Individual Differences Fallacy,” involves interpreting results based on individuals as applying to settings. Although this second error has been ubiquitous, little is known about the empirical consequences of using different units of analysis in item analysis. This study examined this issue when the units were (1) individuals, (2) observed settings, or (3) “artificial” or random settings. Neither item validities based on individuals nor item validities based on settings yielded unequivocal results. However, a measure developed specifically for environmental research, the Split-Sample Correlation, appeared useful for identifying environmental items. Researchers constructing environmental assessment scales should select items with both high Split-Sample Correlations and high setting-level item validities.     

Random Item IRT Models

It is common practice in IRT to consider items as fixed and persons as random. Both, continuous and categorical person parameters are most often random variables, whereas for items only continuous parameters are used and they are commonly of the fixed type, although exceptions occur. It is shown in the present article that random item parameters make sense theoretically, and that in practice the random item approach is promising to handle several issues, such as the measurement of persons, the explanation of item difficulties, and trouble shooting with respect to DIF. In correspondence with these issues, three parts are included. All three rely on the Rasch model as the simplest model to study, and the same data set is used for all applications. First, it is shown that the Rasch model with fixed persons and random items is an interesting measurement model, both, in theory, and for its goodness of fit. Second, the linear logistic test model with an error term is introduced, so that the explanation of the item difficulties based on the item properties does not need to be perfect. Finally, two more models are presented: the random item profile model (RIP) and the random item mixture model (RIM). In the RIP, DIF is not considered a discrete phenomenon, and when a robust regression approach based on the RIP difficulties is applied, quite good DIF identification results are obtained. In the RIM, no prior anchor sets are defined, but instead a latent DIF class of items is used, so that posterior anchoring is realized (anchoring based on the item mixture). It is shown that both approaches are promising for the identification of DIF.     

BRINGING COMPUTATIONAL MODELS OF WORD NAMING DOWN TO THE ITEM LEVEL

Abstract— Early noncomputational models of word recognition have topically attempted to account for effects of categorical factors such as word frequency (high vs low) and spelling-to-sound regularity (regular vs irregular) More recent computational models that adhere to general connections: principles hold the promise of being sensitive to underlying item differences that are only approximated by these categorical factors In contrast to earlier models, these connectionist models provide predictions of performance for individual items In the present study, we used the item-level estimates from two connectionist models (Plaut, McClelland, Seidenberg, & Patterson, 1996, Seidenberg & McClelland, 1989) to predict naming latencies on the individual items on which the models were trained The results indicate that the models capture, at best, slightly more variance than simple log frequency and substantially less than the combined predictive power of log frequency, neighborhood density, and orthographic length. The discussion focuses on the importance of examining the item-level performance of word-naming models and possible approaches that may improve the models' sensitivity to such item differences     

Selective interference with verbal short-term memory for serial order information: A new paradigm and tests of a timing-signal hypothesis

Many recent computational models of verbal short-term memory postulate a separation between processes supporting memory for the identity of items and processes supporting memory for their serial order. Furthermore, some of these models assume that memory for serial order is supported by a timing signal. We report an attempt to find evidence for such a timing signal by comparing an “item probe” task, requiring memory for items, with a “list probe” task, requiring memory for serial order. Four experiments investigated effects of irrelevant speech, articulatory suppression, temporal grouping, and paced finger tapping on these two tasks. In Experiments 1 and 2, irrelevant speech and articulatory suppression had a greater detrimental effect on the list probe task than on the item probe task. Reaction time data indicated that the list probe task, but not the item probe task, induced serial rehearsal of items. Phonological similarity effects confirmed that both probe tasks induced phonological recoding of visual inputs. Experiment 3 showed that temporal grouping of items during list presentation improved performance on the list probe task more than on the item probe task. In Experiment 4, paced tapping had a greater detrimental effect on the list probe task than on the item probe task. However, there was no differential effect of whether tapping was to a simple or a complex rhythm. Overall, the data illustrate the utility of the item probe/list probe paradigm and provide support for models that assume memory for serial order and memory for items involve separate processes. Results are generally consistent with the timing-signal hypothesis but suggest further factors that need to be explored to distinguish it from other accounts.     

兼顾测验效率和题库使用率的CD-CAT选题策略

CD–CAT中已有选题策略较注重测验效率,而对题库使用率不够重视。针对此问题,基于DINA模型,引入两种新的选题策略KLED和RHA,同时对HA进行模拟研究。结果显示：PWKL与KLED只在测验效率上具有优势;KLED若按属性向量分层,题库使用率有所提高,KLED比ED更容易推广到其他有显式表达的诊断模型场合;HA、RHA和RP–PWKL可较好兼顾测验效度和题库使用率,但RP-PWKL需设置项目的最大曝光率阈值。两种新选题方法在定长和变长CD-CAT都具有一定的应用价值。     

Bayesian tests of measurement invariance

Random item effects models provide a natural framework for the exploration of violations of measurement invariance without the need for anchor items. Within the random item effects modelling framework, Bayesian tests (Bayes factor, deviance information criterion) are proposed which enable multiple marginal invariance hypotheses to be tested simultaneously. The performance of the tests is evaluated with a simulation study which shows that the tests have high power and low Type I error rate. Data from the European Social Survey are used to test for measurement invariance of attitude towards immigrant items and to show that background information can be used to explain cross‐national variation in item functioning.     

Orthography, phonology, short-term memory and the effects of concurrent articulation on rhyme and homophony judgements

The role of phonological short-term memory (pSTM) in phonological judgement tasks of print has been widely explored using concurrent articulation (CA). A number of studies have examined the effects of CA on written word/nonword rhyme and homophone judgements but the findings have been mixed and few studies have examined both tasks within subjects. Also important is the influence of orthographic similarity on such tasks (i.e., items that share phonology often strongly overlap on orthography). Although there are reports of orthographic similarity effects (e.g., LOAD-TOAD vs. DIAL-MILE) on rhyme judgements, it is unknown whether (a) similar orthographic effects are present with homophone judgements, (b) the degree to which such orthographic effects interact with CA, and (c) the degree to which such orthographic effects interact with lexical status (words vs. nonwords). The present work re-examines these three issues in a within subject design. CA and orthographic similarity yielded subtle differences across tasks. CA impaired accuracy for both homophone and rhyme judgement, but only slowed RTs on the rhyme judgement task, and then only for words. Orthographic similarity yielded an increase in false positives for similar items and vice versa for dissimilar items, suggesting a general impact of an orthographically based ‘bias’ in choosing similar or dissimilar sounding items. This pattern was amplified under CA but only on the homophone judgement task. These results highlight important interactions between phonological and orthographic representations in phonological judgement tasks, and the findings are considered both with reference to earlier studies and several models of pSTM.