Multiple-answer multiple-choice test items: Responding and scoring through bayes and minimax strategies

A multiple-answer multiple-choice test item has a certain number of alternatives,any number of which might be keyed. The examinee is also allowed to mark any number of alternatives. This increased flexibility over the one keyed alternative case is useful in practice but raises questions about appropriate scoring rules. In this article a certain class of item scoring rules called thebinary class is considered. The concepts ofstandard scoring rules and equivalence among these scoring rules are introduced in the misinformation model for which the traditional knowledge model is a special case. The examinee's strategy with respect to a scoring rule is examined. The critical role of a quantity called the scoring ratio is emphasized. In the case of examinee uncertainty about the number of correct alternatives on an item, a Bayes and a minimax strategy for the examinee are developed. Also an appropriate response for the examiner to the minimax strategy is outlined.Research partially supported under Grants N00014-67-A-0314-0022 from the Office of Naval Research and GS-32514 and MPS 75-07539 from the National Science Foundation.     

Beyond Speech Lateralization: A Review of the Variability, Reliability, and Validity of the Intracarotid Amobarbital Procedure and Its Nonlanguage Uses in Epilepsy Surgery Candidates

While the intracarotid amobarbital procedure (IAP) was originally utilized to lateralize speech functions as an aid in the surgical treatment of epilepsy, additional uses for the IAP have emerged including: (1) the use of the IAP to predict post-surgical memory changes, including both global amnesia and smaller, yet significant, material-specific memory deficits; (2) the use of the IAP to provide confirmatory evidence of lateralization of seizure focus; and (3) the use of the IAP to predict post-surgical relief from seizures. While the literature on the IAP is extensive and growing, its utility is marred by the wide variability associated with the procedure itself from epilepsy center to center. This variability renders comparisons among IAP studies problematic and conclusions about IAP efficacy difficult. The variability associated with the amobarbital procedures, as well as the reliability and the validity of the IAP in its nonlanguage uses is reviewed here. A special emphasis is devoted to research conducted in the last decade. Also discussed is the future of the IAP including anticipated research directions.     

A multitrait-multimethod model with minimal assumptions

A new model of confirmatory factor analysis (CFA) for multitrait-multimethod (MTMM) data sets is presented. It is shown that this model can be defined by only three assumptions in the framework of classical psychometric test theory (CTT). All other properties of the model, particularly the uncorrelated-ness of the trait with the method factors are logical consequences of the definition of the model. In the model proposed there are as many trait factors as different traits considered, but the number of method factors is one fewer than the number of methods included in an MTMM study. The covariance structure implied by this model is derived, and it is shown that this model is identified even under conditions under which other CFA-MTMM models are not. The model is illustrated by two empirical applications. Furthermore, its advantages and limitations are discussed with respect to previously developed CFA models for MTMM data.     

Test theory without an answer key

A general model is presented for homogeneous, dichotomous items when the answer key is not known a priori. The model is structurally related to the two-class latent structure model with the roles of respondents and items interchanged. For very small sets of respondents, iterative maximum likelihood estimates of the parameters can be obtained by existing methods. For other situations, new estimation methods are developed and assessed with Monte Carlo data. The answer key can be accurately reconstructed with relatively small sets of respondents. The model is useful when a researcher wants to study objectively the knowledge possessed by members of a culturally coherent group that the researcher is not a member of.This research was supported by NSF Grant No. SES-8320173 to the authors. We gratefully acknowledge comments and suggestions from John Boyd, Tarow Indow, and Kathy Maher as well as the editor and several anonymous referees.     

汉字词识别过程的形,音,义编码作用的研究

本文通过两个实验,采用汉字词形、音、义特征匹配任务,探讨了影响汉字词的形、音、义编码与提取方式的有关因素。实验一发现在速示条件下,对汉字词再认的成绩并不受字词的使用度的影响,反应时无明显变化,而主要受编码加工的深度影响。在形、音、义特征加工中,对音码的加工时间最长,再认的正确率最低;义码的加工时间较短,再认正确率最高;形码的反应时及再认成绩介于音码与义码之间。实验二在非速示条件下也获得了相同的结果。研究结果表明,在汉字词的形、音、义特征中,存在着编码加工深度的差异。     

Application of the bootstrap methods in factor analysis

A Monte Carlo experiment is conducted to investigate the performance of the bootstrap methods in normal theory maximum likelihood factor analysis both when the distributional assumption is satisfied and unsatisfied. The parameters and their functions of interest include unrotated loadings, analytically rotated loadings, and unique variances. The results reveal that (a) bootstrap bias estimation performs sometimes poorly for factor loadings and nonstandardized unique variances; (b) bootstrap variance estimation performs well even when the distributional assumption is violated; (c) bootstrap confidence intervals based on the Studentized statistics are recommended; (d) if structural hypothesis about the population covariance matrix is taken into account then the bootstrap distribution of the normal theory likelihood ratio test statistic is close to the corresponding sampling distribution with slightly heavier right tail.This study was carried out in part under the ISM cooperative research program (91-ISM · CRP-85, 92-ISM · CRP-102). The authors would like to thank the editor and three reviewers for their helpful comments and suggestions which improved the quality of this paper considerably.     

教师评分用语词义赋值特征的分析

本研究运用模糊统计试验方法对教师的六组定性的评分用语词 (符号 )进行了经验赋值。参加赋值的是 2 66名小学教师。结果表明 ,六组评分用语词 (符号 )都是模糊概念 ,其中每种评分方式中处于最高等级的词 (符号 )的模糊度最小 ,处于中间等级的词 (符号 )的模糊度居中 ,处于最低等级的词 (符号 )的模糊度最大。词 (符号 )义的模糊度与评价的把握度呈现负相关 ,即词 (符号 )义越具体 ,模糊度越小 ,赋值的把握度就越大 ;反之 ,词义越含混 ,模糊度越大 ,赋值的把握度就越小。教师对各种评分用语词 (符号 )的赋值受百分制的“及格—不及格”的划分的影响 ,受评分方式中等级数目的影响 ,即增加评分等级会减少评分用语词 (符号 )的模糊度 ,增加赋值的把握度 ,还受评分用语词 (符号 )本身数量特征的影响。在各种评分方式中 ,评语词 (符号 )在心理量表上的距离是不等的。本研究的结果对教育评价的实践具有一定的参考价值。     

Nonparametric IRT: Testing the bi-isotonicity of isotonic probabilistic models (ISOP)

Nonparametric tests for testing the validity of polytomous ISOP-models (unidimensional ordinal probabilistic polytomous IRT-models) are presented. Since the ISOP-model is a very general nonparametric unidimensional rating scale model the test statistics apply to a great multitude of latent trait models. A test for the comonotonicity of item sets of two or more items is suggested. Procedures for testing the comonotonicity of two item sets and for item selection are developed. The tests are based on Goodman-Kruskal's gamma index of ordinal association and are generalizations thereof. It is an essential advantage of polytomous ISOP-models within probabilistic IRT-models that the tests of validity of the model can be performed before and without the model being fitted to the data. The new test statistics have the further advantage that no prior order of items or subjects needs to be known.     

聋生和听力正常学生解决加减文字题的眼动比较研究

采用EyetinkⅡ眼动记录仪,探讨了聋生与解题正确率高的听力正常学生表征和解决加减文字题的差异。被试为小学3年级学生．聋生12名．听力正常学生8名。研究结果表明：（1）在解决加减文字题时,聋生与解题正确率高的听力正常学生在阅读方式、关注关键信息上有显著差异,很多聋生阅读没规律．漏看文字题的关键信息;（2）聋生解决加减文字题的困难与其不能正确表征文字题的文本有关。     

三种心理测量理论的信度观

目前,心理测量领域中主要存在三大理论派别。本文分别对这三种理论即经典测验理论、可概括性理论和项目反应理论作了简要介绍,着重分析这三种理论的信度观。文章讨论了这三种信度观的理论基础和研究方法,比较了它们的异同,指出经典测验理论存在的一些不足及概化理论和项目反应理论所作的改进。概化理论是对经典测验理论的扩展,它用多维的信度指标（概化系数）替代了经典测验理论的信度系数,项目反应理论则从信息量的角度出发,用项目信息函数、测验信息函数等指标更具体深入地反映项目、测验的测量可靠程度。