Reliability of multiple classifications

Cohen's kappa index is reformulated for multiple classifications based on exchangeable random variables. It is found that kappa is between 0 and 1 inclusive. Two characterizations for kappa are stated in terms of the relationship between such random variables. Within the normal test score model, kappa increases with test reliability and test length. Furthermore, when based on binary classifications, kappa is an inverse U-shaped function of the cutoff score. These trends also hold for the beta-binomial test score model.Paper read at the Spring meeting of the Psychometric Society, Bell Laboratories (Murray Hill, New Jersey), March 1976.The editorial assistance and helpful comments of Leonard S. Feldt, Sarah P. Seaman-Huynh, and the three referees are gratefully acknowledged.     

The Del Greco Assertive Behavior Inventory

Previous research in the area of assertiveness training has been examined with respect to the definitions of assertive, aggressive, and nonassertive behavior and the prominent assertion model. Logical inconsistencies have led to a refinement of the definitions of these behaviors, the inclusion of passive aggressive behavior, and the testing of a new two-dimensional model of assertion. The present study has developed a psychometric test to measure assertive, aggressive, nonassertive, and passive aggressive behavior in the college dormitory population. In addition, support was demonstrated for the validity of the two dimensional model of assertion. The instrument development was divided into four phases: item generation, item evaluation and revision, reliability testing and item analysis, and validity testing. Data analysis supported the two-dimensional model of assertion. In addition, an 86-item Del Greco Assertive Behavior Inventory designed for use with college dormitory students has weathered preliminary validity and reliability testing.     

Maximum likelihood estimation of the joint covariance matrix for sections of tests given to distinct samples with application to test equating

Consider an old testX consisting ofs sections and two new testsY andZ similar toX consisting ofp andq sections respectively. All subjects are given testX plus two variable sections from either testY orZ. Different pairings of variable sections are given to each subsample of subjects. We present a method of estimating the covariance matrix of the combined test (X ₁, ...,X _s ,Y ₁, ...,Y _p ,Z ₁, ...,Z _q ) and describe an application of these estimation techniques to linear, observed-score, test equating.The author is indebted to Paul W. Holland and Donald B. Rubin for their encouragement and many helpful comments and suggestions that contributed significantly to the development of this paper.This research was supported by the Program Statistics Research Project of the ETS Research Statistics Group.     

Parental divorce as a factor in children''s perception of human relationships: An analysis of human movement responses in the Rorschach test

The subjects were 108 Swedish children between 10 and 12 years old, who constituted a divorce and a non-divorce group of 27 girls and 27 boys each. Rorschach Tests were administered individually and human movement responses were analysed. Non-divorce children perceived more cooperative and fewer hostile interactions than the divorce children. Responses containing figures engaged in hostile interaction were most common among divorce girls, whereas the divorce boys had difficulties in perceiving any interaction whatsoever. The different effect of parental divorce on the ability of girls and boys to develop satisfactory social relationships is discussed.     

Covariance structure analysis in several populations

This paper is concerned with the study of covariance structural models in several populations. Estimation theory of the parameters that are subject to general functional restraints is developed based on the generalized least squares approach. Asymptotic properties of the constrained estimator are studied; and asymptotic chi-square tests are presented to evaluate appropriate model comparisons. The method of multipliers and the standard reparametrization technique are discussed in obtaining the estimates. The methodology is demonstrated by a set of real data.Computer facilities were provided by the Computer Services Center, The Chinese University of Hong Kong. The authors are indebted to several anonymous reviewers for suggestions for improvement of this paper.     

Two simple classes of mastery scores based on the beta-binomial model

Two simple classes of mastery scores which are suitable for hand calculations are presented for beta-binomial test score distributions combined with linear and cubic referral success. The models provide a simple way to explore the consequences of selecting an arbitrary mastery score. Such assessment would be useful whenever the test user is not willing to posta priori a loss ratio, but wishes to look at the various consequences before aiming at a particular score.     

A further note on freeman's measure of association

This note extends and elaborates Hubert's attempt to provide an interpretation of Freeman's measure of association,. The measure is used in a a contingency table when observations are ordered on one variable and unordered on the other. No attempt is made explore the distribution of.     

Individual differences in flow proneness are linked to a dopamine D2 receptor gene variant

Flow is a special mental state characterized by deep concentration that occurs during the performance of optimally challenging tasks. In prior studies, proneness to experience flow has been found to be moderately heritable. In the present study, we investigated whether individual differences in flow proneness are related to a polymorphism of the dopamine D2 receptor coding gene (DRD2 C957T rs6277). This polymorphism affects striatal D2 receptor availability, a factor that has been shown to be related to flow proneness. To our knowledge, this is the first study to investigate the association between this trait and a specific gene variant. In a sample of 236 healthy Hungarian adults, we found that CC homozygotes report higher flow proneness than do T allele carriers, but only during mandatory activities (i.e., studying and working), not during leisure time. We discuss implications of this result, e.g., the potential mediators of the relationship.     

Stopping rules for multi-category computerized classification testing

Computerized classification testing (CCT) aims to classify persons into one of two or more possible categories to make decisions such as mastery/non-mastery or meet most/meet all/exceed. A defining feature of CCT is its stopping criterion: the test terminates when there is enough confidence to make a decision. There is abundant research on CCT with a single cut-off, and two common stopping criteria are the sequential probability ratio test (SPRT) statistic and the generalized likelihood ratio statistic (GLR). However, there is a relative scarcity of research extending the SPRT to the multi-hypothesis case for when there is more than one cut-off. In this paper, we propose a new multi-category GLR (mGLR) statistic as well as a stochastically curtailed version of the CCT with three or more categories. A simulation study was conducted to show that the mGLR statistic outperformed the existing stopping rules by generating shorter average test length without sacrificing classification accuracy. Results also revealed that the stochastically curtailed mGLR successfully increased test efficiency in certain testing conditions.     

Psychometric Properties of Two Implicit Associations Tests measuring Adult Attachment

Adult attachment style has consequences for mental health, interpersonal functioning and emotion regulation. This occurs partly deliberately, also referred to as explicit, and partly on an automatic level outside of conscious awareness, also referred to as implicit. Whereas explicit adult attachment can be assessed with self-report instruments, measurement of implicit adult attachment requires indirect methods. This paper describes the psychometric properties of two Implicit Association Tests measuring general adult attachment in a population sample. The study evaluated the reliability and the validity of the Avoidant Attachment IAT (ANX-IAT) and the Anxious Attachment IAT (AVOID-IAT). Validity was evaluated against self-report measures of adult attachment style (RQ), psychopathology (SQ-48), and well-being (MHC-SF). The split-half reliabilities of both IATs were good; the test-retest reliability of the ANX-IAT was adequate; however the AVOID-IAT had low test-retest reliability. Both IATs did not explain variance in psychopathology additional to explicit measures. The AVOID-IAT showed added value over explicit measurement of avoidant attachment in explaining variance in well-being, particularly regarding emotional and psychological well-being. The ANX-IAT did not explain variance in any measure of well-being additional to the explicit measure of anxious attachment. Our findings provide a basis from which more valid IATs measuring general adult attachment can be developed. Furthermore, they suggest that implicit avoidant attachment might be related to well-being, particularly emotional and psychological well-being. However, further research is needed to investigate the role of implicit general adult attachment in mental health and to optimize the two IATs in terms of validity before clinical use is recommended.