Multiple-answer multiple-choice test items: Responding and scoring through bayes and minimax strategies

A multiple-answer multiple-choice test item has a certain number of alternatives,any number of which might be keyed. The examinee is also allowed to mark any number of alternatives. This increased flexibility over the one keyed alternative case is useful in practice but raises questions about appropriate scoring rules. In this article a certain class of item scoring rules called thebinary class is considered. The concepts ofstandard scoring rules and equivalence among these scoring rules are introduced in the misinformation model for which the traditional knowledge model is a special case. The examinee's strategy with respect to a scoring rule is examined. The critical role of a quantity called the scoring ratio is emphasized. In the case of examinee uncertainty about the number of correct alternatives on an item, a Bayes and a minimax strategy for the examinee are developed. Also an appropriate response for the examiner to the minimax strategy is outlined.Research partially supported under Grants N00014-67-A-0314-0022 from the Office of Naval Research and GS-32514 and MPS 75-07539 from the National Science Foundation.     

Reliability of multiple classifications

Cohen's kappa index is reformulated for multiple classifications based on exchangeable random variables. It is found that kappa is between 0 and 1 inclusive. Two characterizations for kappa are stated in terms of the relationship between such random variables. Within the normal test score model, kappa increases with test reliability and test length. Furthermore, when based on binary classifications, kappa is an inverse U-shaped function of the cutoff score. These trends also hold for the beta-binomial test score model.Paper read at the Spring meeting of the Psychometric Society, Bell Laboratories (Murray Hill, New Jersey), March 1976.The editorial assistance and helpful comments of Leonard S. Feldt, Sarah P. Seaman-Huynh, and the three referees are gratefully acknowledged.     

The Del Greco Assertive Behavior Inventory

Previous research in the area of assertiveness training has been examined with respect to the definitions of assertive, aggressive, and nonassertive behavior and the prominent assertion model. Logical inconsistencies have led to a refinement of the definitions of these behaviors, the inclusion of passive aggressive behavior, and the testing of a new two-dimensional model of assertion. The present study has developed a psychometric test to measure assertive, aggressive, nonassertive, and passive aggressive behavior in the college dormitory population. In addition, support was demonstrated for the validity of the two dimensional model of assertion. The instrument development was divided into four phases: item generation, item evaluation and revision, reliability testing and item analysis, and validity testing. Data analysis supported the two-dimensional model of assertion. In addition, an 86-item Del Greco Assertive Behavior Inventory designed for use with college dormitory students has weathered preliminary validity and reliability testing.     

Maximum likelihood estimation of the joint covariance matrix for sections of tests given to distinct samples with application to test equating

Consider an old testX consisting ofs sections and two new testsY andZ similar toX consisting ofp andq sections respectively. All subjects are given testX plus two variable sections from either testY orZ. Different pairings of variable sections are given to each subsample of subjects. We present a method of estimating the covariance matrix of the combined test (X ₁, ...,X _s ,Y ₁, ...,Y _p ,Z ₁, ...,Z _q ) and describe an application of these estimation techniques to linear, observed-score, test equating.The author is indebted to Paul W. Holland and Donald B. Rubin for their encouragement and many helpful comments and suggestions that contributed significantly to the development of this paper.This research was supported by the Program Statistics Research Project of the ETS Research Statistics Group.     

Parental divorce as a factor in children''s perception of human relationships: An analysis of human movement responses in the Rorschach test

The subjects were 108 Swedish children between 10 and 12 years old, who constituted a divorce and a non-divorce group of 27 girls and 27 boys each. Rorschach Tests were administered individually and human movement responses were analysed. Non-divorce children perceived more cooperative and fewer hostile interactions than the divorce children. Responses containing figures engaged in hostile interaction were most common among divorce girls, whereas the divorce boys had difficulties in perceiving any interaction whatsoever. The different effect of parental divorce on the ability of girls and boys to develop satisfactory social relationships is discussed.     

Two simple classes of mastery scores based on the beta-binomial model

Two simple classes of mastery scores which are suitable for hand calculations are presented for beta-binomial test score distributions combined with linear and cubic referral success. The models provide a simple way to explore the consequences of selecting an arbitrary mastery score. Such assessment would be useful whenever the test user is not willing to posta priori a loss ratio, but wishes to look at the various consequences before aiming at a particular score.     

A further note on freeman's measure of association

This note extends and elaborates Hubert's attempt to provide an interpretation of Freeman's measure of association,. The measure is used in a a contingency table when observations are ordered on one variable and unordered on the other. No attempt is made explore the distribution of.     

人际关系适应特征的情境评价方法研究

本研究运用情境评价法对人际关系适应特征进行了实验研究 ,结果表明 :1以 Schutz提出的人际关系六因素为评价标准 ,采用情境评价法比问卷形式能更有效地揭示人际适应特征 ;2在情境评价中 ,以合作为主的情境设置比以竞争为主的情境设置更利于反映出人际适应特征 ;3情境评价采用定向、组织、交流和问题解决等阶段的过程设计符合情境评价的实际进程 ,有助于分阶段展开被试的行为特征 ,提高情境评价的可控性和准确性。     

《中学生心理健康诊断测验》结构的探索及修改

在浙江省8个城市的6所高中和6所初中,采取分层整群抽样方法选取初一到高三600名学生,用修改后的《心理健康诊断测验》(MHT)进行了测查,着重检验该测验的结构。结果发现,因素分析所获取的因素与原测验相一致,但对原测验的项目进行了一些删减。因素分析和相关分析结果以及内部一致性系数显示,修改后的问卷具有较高的信度,其效度也符合心理测量的要求。     

语言产生中词频效应老化的神经基础与时间进程

词频效应指语言产生中人们对高频词汇的加工比低频词汇更快更准确的一种现象,它可能发生在语言产生中的不同阶段。对青年人和老年人词频效应的不同特点和加工机制进行比较,可以考察语言产生的认知老化机制。通过语言产生理论可对词频效应的老化进行预测,提出词频效应在个体发展和老化阶段的相对稳定性,分析老化导致词频效应相关的神经基础和加工时间进程的改变。未来研究可进一步分离词频效应与习得年龄效应对语言产生老化的影响,并扩展至神经退行性疾病患者中。