Maximum likelihood estimation of item response parameters when some responses are omitted

A theoretical model is given for dealing with omitted responses. Two special cases are investigated.This work was supported in part by contract N00014-80-C-0402, project designation NR 150-453 between the Office of Naval Research and Educational Testing Service. Reproduction in whole or in part is permitted for any purpose of the United States Government.     

Maximum likelihood additivity analysis

A maximum likelihood estimation procedure was developed to fit unweighted and weighted additive models to conjoint data obtained by the categorical rating, the pair comparison or the directional ranking method. The scoring algorithm used to fit the models was found to be both reliable and efficient, and the program MAXADD is capable of handling up to 300 parameters to be estimated. Practical uses of the procedure are reported to demonstrate various advantages of the procedure as a statistical method.The research reported here was supported by Grant A6394 to the author from the Natural Sciences and Engineering Research Council of Canada. Portions of this research were presented at the Psychometric Society meeting in Iowa City, Iowa, in May, 1980.Thanks are due to Jim Ramsay, Justine Sergent and anonymous reviewers for their helpful comments.Two MAXADD programs which perform the computations discussed in this paper may be obtained from the author.     

画人智力测验评分项目的再确定

该研究参照国内外已有的画人测验材料 ,并在以往使用绘人智能测验的基础上 ,重新设计 ,提出了一份包含 80个评分项目的画人评分标准。新标准首先在课题组内试用修改 ,然后又用于 9名标准评分员的培训 ,最后运用总计 2 5 8名 ,年龄为 6～ 1 2岁的小学儿童作预试 ,进行系统的项目分析。在上述过程中 ,对项目进行反复推敲删改 ,最终形成了一份供制订画人智力测验常模用的画人评分标准。该标准分有无、细节、比例、奖励四个维度 ,按身体部位分成头、头发、眼、耳、鼻、口、颈、躯干、上肢、手、下肢、脚以及连接和服饰共十四个大类 ,每大类包含 4～ 8个评分点 ,总计 75个评分点。     

Grading distractor-identification tests

On distractor-identification tests students mark as many distractors as possible on each test item. A grading scale is developed for this type testing. The scale is optimal in that it is the unique scale giving an unbiased estimate of the student's true score, i.e., the score that would result if no guessing occurred. If the test is administered as a usual multiple choice test and graded using the usual correction for guessing scale, the expected item score is the same as for the distractor-identification testing using the optimal grading scale. However, the variance of the item score is shown to be less for distractor-identification testing than for usual multiple choice testing under certain conditions.     

Generalized latent trait models

In this paper we discuss a general model framework within which manifest variables with different distributions in the exponential family can be analyzed with a latent trait model. A unified maximum likelihood method for estimating the parameters of the generalized latent trait model will be presented. We discuss in addition the scoring of individuals on the latent dimensions. The general framework presented allows, not only the analysis of manifest variables all of one type but also the simultaneous analysis of a collection of variables with different distributions. The approach used analyzes the data as they are by making assumptions about the distribution of the manifest variables directly.     

The Multiplicative AHP,SMART and ELECTRE in a Common Context

This paper presents a comparative study of three popular methods for multicriteria decision analysis based on a particular model of human preferential judgement. Since decisions are invariably made within a given context, we model relative preferences as ratios of increments or decrements in an interval on an axis of desirability. Next we sort the ratio magnitudes into a small number of categories, represented by numerical values on a geometric scale. We explain why the analytic hierarchy process (AHP) and the French collection of ELECTRE methods, typically based on pairwise comparison methods, are concerned with categories of ratio magnitudes, whereas the simple multiattribute rating technique (SMART) essentially uses orders of magnitude of these ratios. This phenomenon provides a common basis for the analysis of the methods in question and for a cross-validation of their results. We illustrate the approach via a well-known case study, the choice of a location for a nuclear power plant. We conclude by discussing the scope of the comparative study. © 1997 John Wiley & Sons, Ltd.     

说谎行为及其识别的心理学研究

国外关于说谎行为及其识别的心理学研究主要包括对说谎时行为表现的研究、对说谎识别准确率的研究及测谎技术的开发与应用。说谎是人类社会普遍存在的现象,但研究显示人们对说谎行为的识别准确率并不显著高于随机判断的概率。说谎者通常所表现出来的与说真话时不同的特点被称为“线索”,人们对说谎线索的看法与说谎者的实际行为表现并不一致。动机、互动特点、个体差异、沟通情境等因素对说谎和识别行为都会产生影响。网络沟通方式下的说谎行为呈现出一些新的特点     

Prediction of true test scores from observed item scores and ancillary data

In many educational tests which involve constructed responses, a traditional test score is obtained by adding together item scores obtained through holistic scoring by trained human raters. For example, this practice was used until 2008 in the case of GRE^®General Analytical Writing and until 2009 in the case of TOEFL^® iBT Writing. With use of natural language processing, it is possible to obtain additional information concerning item responses from computer programs such as e‐rater^®. In addition, available information relevant to examinee performance may include scores on related tests. We suggest application of standard results from classical test theory to the available data to obtain best linear predictors of true traditional test scores. In performing such analysis, we require estimation of variances and covariances of measurement errors, a task which can be quite difficult in the case of tests with limited numbers of items and with multiple measurements per item. As a consequence, a new estimation method is suggested based on samples of examinees who have taken an assessment more than once. Such samples are typically not random samples of the general population of examinees, so that we apply statistical adjustment methods to obtain the needed estimated variances and covariances of measurement errors. To examine practical implications of the suggested methods of analysis, applications are made to GRE General Analytical Writing and TOEFL iBT Writing. Results obtained indicate that substantial improvements are possible both in terms of reliability of scoring and in terms of assessment reliability.     

The Detection of Prosocial Lying by Children

The purpose of the present study was to explore the detection of prosocial lying in children. Six‐ to 11‐year‐olds and adults were videotaped telling the truth or a lie about the desirability of an object, sometimes being asked a follow‐up question (i.e., elaborative trials) and other times not (i.e., regular trials). A different group of adults and children then judged the veracity of the individuals' statements in the video clips. Adults and children performed significantly better than chance at detecting lies in the youngest age group, and children's detection performance was unrelated to their age. Child lie detectors, unlike the adults, were also able to discriminate between adults' truthful and untruthful statements in the regular trials, but misidentified adults' truthful responses as lies. They appeared to be more trusting of other children. Copyright © 2016 John Wiley & Sons, Ltd.