应用项目反应理论对瑞文测验联合型的分析

使用BILOG-MG3.0软件,边际极大似然估计,3参数Logistic模型对354名不同能力水平的男性青年的瑞文测验联合型数据进行了分析。结果显示:大多数瑞文测验联合型的题目都适合3参数Logistic模型(有6道题不适合)。整个测验的信息函数峰值的位置在难度量表的-3到-2之间,其值为16.82。共有18道题的信息函数峰值在0.2以下。从区分度来看,72道题目的区分度均大于0.5,比较理想。难度参数显示所有题目均较低,绝大部分都在0以下,最高的只有1.01。题目的难度主要由所需的操作水平决定。伪猜测参数在0.07-0.24之间。综合分析表明瑞文测验联合型对正常青年的智力评价精度较差。     

Combining mixture distribution and multidimensional IRTree models for the measurement of extreme response styles

Personality constructs, attitudes and other non-cognitive variables are often measured using rating or Likert-type scales, which does not come without problems. Especially in low-stakes assessments, respondents may produce biased responses due to response styles (RS) that reduce the validity and comparability of the measurement. Detecting and correcting RS is not always straightforward because not all respondents show RS and the ones who do may not do so to the same extent or in the same direction. The present study proposes the combination of a multidimensional IRTree model with a mixture distribution item response theory model and illustrates the application of the approach using data from the Programme for the International Assessment of Adult Competencies (PIAAC). This joint approach allows for the differentiation between different latent classes of respondents who show different RS behaviours and respondents who show RS versus respondents who give (largely) unbiased responses. We illustrate the application of the approach by examining extreme RS and show how the resulting latent classes can be further examined using external variables and process data from computer-based assessments to develop a better understanding of response behaviour and RS.     

Multiple trajectories of physical aggression among adolescent boys and girls

Latent growth mixture modeling was used to identify discrete patterns of physical aggression from Grades 7 to 11 among a sample of 1,877 youth. Four trajectory classes adequately explained the development of physical aggression in both boys and girls: Low/No Aggression; Persistent High Aggression; Desisting Aggression, characterized by decreasing risk throughout adolescence; and Adolescent Aggression, characterized by low early risk that increases until Grade 9, levels out, and then declines in late adolescence. Girls were less likely than boys were to be in any trajectory besides the Low/No Aggression trajectory. Parental supervision, deviant peer association, academic orientation, impulsivity, and emotional distress at Grade 7 were all strongly associated with trajectory class membership. These associations did not differ by gender. These findings strongly suggest that the processes involved in the development of physical aggression in adolescence operate similarly in boys and girls.     

Bayesian IRT Guessing Models for Partial Guessing Behaviors

According to the recent Nation’s Report Card, 12th-graders failed to produce gains on the 2005 National Assessment of Educational Progress (NAEP) despite earning better grades on average. One possible explanation is that 12th-graders were not motivated taking the NAEP, which is a low-stakes test. We develop three Bayesian IRT mixture models to describe the results from a group of examinees including both nonguessers and partial guessers. The first assumes that the guesser answers questions based on his or her knowledge up to a certain test item, and guesses thereafter. The second model assumes that the guesser answers relatively easy questions based on his or her knowledge and guesses randomly on the remaining items. The third is constructed to describe more general low-motivation behavior. It assumes that the guesser gives less and less effort as he or she proceeds through the test. The models can provide not only consistent estimates of IRT parameters but also estimates of each examinee’s nonguesser/guesser status and degree of guessing behavior. We show results of a simulation study comparing the performance of the three guessing models to the 2PL-IRT model. Finally, an analysis of real data from a low-stakes test administered to university students is presented.     

CTT与IRT方法对人格测验结果处理的比较研究

为了说明使用经典测量理论(CTT)方法和项目反应理论(IRT)方法计算出的人格测验结果的差异,本研究使用IRT和CTT这两种方法分别计算出模拟人格测验和实际人格测验的测验结果,并对此进行比较。研究表明,两种不同的方法得到的测验结果之间平均有0．11个标准差以上的差异。进一步研究发现,在对测验结果进行分析时,IRT方法比CTT方法更为有效。     

Building an identifiable latent class model with covariate effects on underlying and measured variables

In recent years, latent class models have proven useful for analyzing relationships between measured multiple indicators and covariates of interest. Such models summarize shared features of the multiple indicators as an underlying categorical variable, and the indicators' substantive associations with predictors are built directly and indirectly in unique model parameters. In this paper, we provide a detailed study on the theory and application of building models that allow mediated relationships between primary predictors and latent class membership, but that also allow direct effects of secondary covariates on the indicators themselves. Theory for model identification is developed. We detail an Expectation-Maximization algorithm for parameter estimation, standard error calculation, and convergent properties. Comparison of the proposed model with models underlying existing latent class modeling software is provided. A detailed analysis of how visual impairments affect older persons' functioning requiring distance vision is used for illustration.This work was supported by National Institute on Aging (NIA) Program Project P01-AG-10184-03 and National Institutes of Mental Health grant R01-MH-56639-01A1. Dr. Bandeen-Roche is a Brookdale National Fellow. The authors wish to thank Drs. Gary Rubin and Sheila West for kindly making the Salisbury Eye Evaluation data available. We also thank the Editor, the Associate Editor, and three referees for their valuable comments.     

Equivalent linear logistic test models

This paper is about the Linear Logistic Test Model (LLTM). We demonstrate that there are infinitely many equivalent ways to specify a model. An implication is that there may well be many ways to change the specification of a given LLTM and achieve the same improvement in model fit. To illustrate this phenomenon, we analyze a real data set using a Lagrange multiplier test for the specification of the model. This Lagrange multiplier test is similar to the modification index used in structural equation modeling.     

Factor Analysis of Scales Composed of Binary Items: Illustration with the Maudsley Obsessional Compulsive Inventory

It is well known that traditional factor analytic methods are designed for use with continuous data, and suboptimal for items with 2 response options (i.e., binary items). Nevertheless, traditional methods have been employed in all previous assessment of the dimensionality of the Maudsley Obsessional Compulsive Inventory (MOCI), a true/false measure of obsessive–compulsive symptoms ( R. J. Hodgson &; S. Rachman, 1977). The aim of this paper is to illustrate 2 techniques that are more suitable for factor-analyzing binary items than traditional methods, through application to the MOCI (n = 1,080). Computer files for use with the TESTFACT (D. Wilson, R. L. Wood, &; R. Gibbons, 1991 ) and Mplus (Muthén &; Muthén, 1998) computer programs are provided. Results from an inappropriately applied principal axis factor analysis are presented for comparison, and factor structures, loadings, and interfactor correlations are compared across methods.     

Solution Strategies and Achievement in Dutch Complex Arithmetic: Latent Variable Modeling of Change

In the Netherlands, national assessments at the end of primary school (Grade 6) show a decline of achievement on problems of complex or written arithmetic over the last two decades. The present study aims at contributing to an explanation of the large achievement decrease on complex division, by investigating the strategies students used in solving the division problems in the two most recent assessments carried out in 1997 and in 2004. The students’ strategies were classified into four categories. A data set resulted with two types of repeated observations within students: the nominal strategies and the dichotomous achievement scores (correct/incorrect) on the items administered.It is argued that latent variable modeling methodology is appropriate to analyze these data. First, latent class analyses with year of assessment as a covariate were carried out on the multivariate nominal strategy variables. Results showed a shift from application of the traditional long division algorithm in 1997, to the less accurate strategy of stating an answer without writing down any notes or calculations in 2004, especially for boys. Second, explanatory IRT analyses showed that the three main strategies were significantly less accurate in 2004 than they were in 1997.     

On Holland's Dutch identity conjecture

The manifest probabilities of observed examinee response patterns resulting from marginalization with respect to the latent ability distribution produce the marginal likelihood function in item response theory. Under the conditions that the posterior distribution of examinee ability given some test response pattern is normal and the item logit functions are linear, Holland (1990a) gives a quadratic form for the log-manifest probabilities by using the Dutch Identity. Further, Holland conjectures that this special quadratic form is a limiting one for all smooth unidimensional item response models as test length tends to infinity. The purpose of this paper is to give three counterexamples to demonstrate that Holland's Dutch Identity conjecture does not hold in general. The counterexamples suggest that only under strong assumptions can it be true that the limits of log-manifest probabilities are quadratic. Three propositions giving sets of such strong conditions are given.