Ordinal consistency and ordinal true scores

This paper argues that test data are ordinal, that latent trait scores are only determined ordinally, and that test data are used largely for ordinal purposes. Therefore it is desirable to develop a test theory based only on ordinal assumptions. A set of ordinal assumptions is presented, including an ordinal version of local independence. From these assumptions it is first shown that the gamma-correlation between two tests is the product of their gamma-correlations with the true latent order. The theory is generalized to allow for heterogeneous tests by defining a weighted average local independence. The tau-correlations between total score and the latent order can be found in both homogeneous and heterogeneous cases, and a system of differential item weighting to maximize the tau-correlation between weighted items and the latent order is provided. Thus a purely ordinal test theory seems possible.Part of this work was done while the author was a Visiting Fellow at Macquarrie University. The paper has benefitted from discussions with Professors Thomas J. Reynolds and Roderick P. McDonald and from the comments of several anonymous reviewers.     

质性研究中编码者信度的多种方法考察

质性研究中检验编码者信度的方法有归类一致性指数、编码信度系数、相关系数、中位数检验、概化系数等。基于教师胜任力访谈数据集,对编码者信度考察结果表明,归类一致性指数和编码信度系数受相同编码数影响而不稳定,相关系数受数据类型制约,中位数检验受研究设计影响,概化系数则受编码者和编码项目的数量影响。研究中须合理选用。     

Elaboration et validation de tests de jugement situationnel comme outil de sélection professionnelle : guide méthodologique

Current views in personnel selection recognize the necessity for situational judgements tests (SJT) which are closed to the real work context of companies. The SJTs have also become a popular selection tool across Europe. SJTs are attractive because they show good validity, positive applicants reactions and can be cost effective to test large group of applicants at once. The aim of this paper is to describe a structured methodology for the elaboration of such test. Each stage is illustrated by examples and psychometrics validation issues are discussed.     

Does simile comprehension differ from metaphor comprehension? A functional MRI study

Since Aristotle, people have believed that metaphors and similes express the same type of figurative meaning, despite the fact that they are expressed with different sentence patterns. In contrast, recent psycholinguistic models have suggested that metaphors and similes may promote different comprehension processes. In this study, we investigated the neural substrates involved in the comprehension of metaphor and simile using functional magnetic resonance imaging (fMRI) to evaluate whether simile comprehension differs from metaphor comprehension or not. In the metaphor and simile sentence conditions, higher activation was seen in the left inferior frontal gyrus. This result suggests that the activation in both metaphor and simile conditions indicates similar patterns in the left frontal region. The results also suggest that similes elicit higher levels of activation in the medial frontal region which might be related to inference processes, whereas metaphors elicit more right-sided prefrontal activation which might be related to figurative language comprehension.     

基于作答时间数据的改变点分析在检测加速作答中的探索——已知和未知项目参数

相对于传统的离散作答数据, 作答时间作为连续数据, 可以提供更多信息。改变点分析(change point analysis)技术在心理和教育领域是一个比较新的技术。本文一方面对改变点分析在心理测量领域的应用进行了一个综合的总结和分析; 另一方面, 将基于作答数据的两种改变点分析统计量推广到作答时间数据, 将改变点分析技术应用到测验异常作答模式：加速作答speededness的检测上。采用两种检验方法：似然比检验和Wald检验, 分别在已知和未知项目参数的条件下, 实现异常作答模式的检测。结果表明, 所采用的方法对于加速作答行为的检测具有很高的检验力, 同时能够很好的控制I类错误率。实证数据分析进一步表明本文中所使用的方法具有应用价值。     

新世纪20年国内假设检验及其关联问题的方法学研究

新世纪20年来国内假设检验方法学研究内容可分为如下几类: 零假设显著性检验的不足、p值的使用问题、心理学研究的可重复性问题、效应量、检验力、等效性检验、其他与假设检验关联的研究。零假设显著性检验已经发展成一套组合流程: 为了保证检验力和节省成本, 实验研究需要做先验检验力分析预估样本容量, 但问卷超过160人在传统统计中就没有必要这样做。当拒绝零假设时, 应当结合效应量做出结论。当不拒绝零假设时, 需要报告后验检验力; 如果效应量中或大而检验力不够高, 则可增加被试再行分析, 但这一过程应主动披露, 报告最后的实际p值并对可能犯的第一类错误率做出评估。     

多义词造句任务对负性解释偏差的测量

本研究旨在归纳中文里可以用于测量解释偏差的多义词,并使用多义词造句任务,在广泛性焦虑症状人群中评估其测量有效性。经过对多义词负性与非负性含义常用程度的评分以及多义词造句任务项目区分度、信度、效度和目的隐蔽性的检验,筛选出两含义常用程度大致相同且对焦虑较为敏感的34个题目构成多义词造句任务,该任务信度良好,可以有效测得高低广泛性焦虑和状态焦虑人群中解释偏差的显著差异,且与同类的乱句重排任务相比,能猜出与猜对实验目的的被试显著更少。因此,中文多义词造句任务信效度良好,具有便捷、隐蔽的优势,可以用于解释偏差的相关研究。     

If I imagine it,then it happened: The Implicit Truth Value of imaginary representations

Imagination sometimes leads people to behave, feel, and think as though imagined events were real even when they know they were not. In this paper, we suggest that some understanding of these phenomena can be achieved by differentiating between Implicit Truth Value (ITV), a spontaneous truth evaluation, and Explicit Truth Value (ETV), a self-reported truth judgment. In three experiments, we measure ITV using the autobiographical Implicit Association Test (Sartori, Agosta, Zogmaister, Ferrara, & Castiello, 2008), which has been used to assess which of two autobiographical events is true. Our findings demonstrate that imagining an event, like experiencing an event, increases its ITV, even when people explicitly acknowledge the imagined event as false (Experiments 1a and 1b). Furthermore, we show that imagined representations generated from a first-person perspective have higher ITV than imagined representations generated from a third-person perspective (Experiment 2). Our findings suggest that implicit and explicit measures of truth differ in their sensitivity to properties underlying truth judgment. We discuss the contribution of characterizing events according to both ITV and ETV to the understanding of various psychological phenomena, such as lying and self-deception.     

Effects of punctuation on the processing of temporarily ambiguous sentences in Japanese

This study explored the effects of comma insertion on the processing of garden path sentences in Japanese. In two experiments, participants read relative clause sentences containing two ambiguities: single versus relative clause and early‐opening (EO) versus late‐opening (LO) left clause boundaries. EO sentences were presented with or without a comma compatible with an EO boundary in Experiment 1 and, in Experiment 2, with an LO boundary. The results showed that the comma, whether compatible or incompatible with the correct clause boundary, decreased reading time for the relative clause's head noun, indicating that a comma helps readers avoid or recover from garden paths caused by relative clause structures. Conversely, a comma incompatible with a clause boundary increased processing costs of second ambiguity resolution (EO vs. LO). We concluded that punctuation affects processing of temporary ambiguity in Japanese as in languages with stricter punctuation rules; furthermore, readers depend strongly on punctuation for online processing of whole sentence structures. We also discuss the relationship between punctuation and (implicit) prosody.