A Note on the Identifiability of Fixed-Effect 3PL Models

In this note, we prove that the 3 parameter logistic model with fixed-effect abilities is identified only up to a linear transformation of the ability scale under mild regularity conditions, contrary to the claims in Theorem 2 of San Martín et al. (Psychometrika, 80(2):450–467, 2015a).     

The Editor's Note on Change

The American Journal of Psychoanalysis -     

A Note on Recurring Misconceptions When Fitting Nonlinear Mixed Models

Nonlinear mixed-effects (NLME) models are used when analyzing continuous repeated measures data taken on each of a number of individuals where the focus is on characteristics of complex, nonlinear individual change. Challenges with fitting NLME models and interpreting analytic results have been well documented in the statistical literature. However, parameter estimates as well as fitted functions from NLME analyses in recent articles have been misinterpreted, suggesting the need for clarification of these issues before these misconceptions become fact. These misconceptions arise from the choice of popular estimation algorithms, namely, the first-order linearization method (FO) and Gaussian-Hermite quadrature (GHQ) methods, and how these choices necessarily lead to population-average (PA) or subject-specific (SS) interpretations of model parameters, respectively. These estimation approaches also affect the fitted function for the typical individual, the lack-of-fit of individuals’ predicted trajectories, and vice versa.     

A Note on Change in Creativity by Handedness Over A Maturational Time Period

Thirty left-handed and right-handed Ss (10 each from the second grade, fifth grade, and college) were compared on four subtests of the Torrance creativity test. At each age level, left-handed students had higher creativity scores than right-handers. The greatest differences were found on the Elaboration subtest.     

On Insensitivity of the Chi-Square Model Test to Nonlinear Misspecification in Structural Equation Models

In this paper, we show that for some structural equation models (SEM), the classical chi-square goodness-of-fit test is unable to detect the presence of nonlinear terms in the model. As an example, we consider a regression model with latent variables and interactions terms. Not only the model test has zero power against that type of misspecifications, but even the theoretical (chi-square) distribution of the test is not distorted when severe interaction term misspecification is present in the postulated model. We explain this phenomenon by exploiting results on asymptotic robustness in structural equation models. The importance of this paper is to warn against the conclusion that if a proposed linear model fits the data well according to the chi-quare goodness-of-fit test, then the underlying model is linear indeed; it will be shown that the underlying model may, in fact, be severely nonlinear. In addition, the present paper shows that such insensitivity to nonlinear terms is only a particular instance of a more general problem, namely, the incapacity of the classical chi-square goodness-of-fit test to detect deviations from zero correlation among exogenous regressors (either being them observable, or latent) when the structural part of the model is just saturated.     

Fitting Psychometric Models with Methods Based on Automatic Differentiation

Quantitative psychology is concerned with the development and application of mathematical models in the behavioral sciences. Over time, models have become more complex, a consequence of the increasing complexity of research designs and experimental data, which is also a consequence of the utility of mathematical models in the science. As models have become more elaborate, the problems of estimating them have become increasingly challenging. This paper gives an introduction to a computing tool called automatic differentiation that is useful in calculating derivatives needed to estimate a model. As its name implies, automatic differentiation works in a routine way to produce derivatives accurately and quickly. Because so many features of model development require derivatives, the method has considerable potential in psychometric work. This paper reviews several examples to demonstrate how the methodology can be applied. From the Presidential Address delivered at the 70th Annual Meeting of the Psychometric Society, Tilburg University, The Netherlands, July 5–8, 2005.     

A Note on Item Analysis of Family Relations Test Data

Two statistical problems prevent meaningful item analysis of Family Relations Test (FRT) data: (a) multiple assignment invalidates the assumption of independence and (b) low frequencies prevent computation of probabilities. It is suggested that: (a) multiple assignment be disallowed and (b) items be made more representative of family interactions.     

Psychometric properties of the Hooper Visual Organization Test

The psychometric properties of the Hooper Vsual Organization Test (VOT) have not been well investigated Here the authors present internal consistency and interrater reliability coefficients, and an item analysis, using data from a sample (N = 281) of "cognitively impaired" and "cognitively intact" patients, and patients with undetermined cognitive status. Coefficient alpha for the VOT total sample was .882. An item analysis found that 26 of the 30 items were good at discriminating among patients. Also, the interrater reliabilities for three raters (.992), two raters (.988), and one rater (.977) were excellent. Therefore, the judgmental scoring of the VOT does not interfere significantly with its clinical utility. The authors conclude that the VOT is a psychometrically sound test.     

Psychometric analysis of the Visual Form Discrimination Test

The Visual Form Discrimination Test is a matching-to-sample test involving visual discrimination. Although normative information has been presented, limited psychometric data have been available. The current study estimated the internal consistency and additional psychometric properties of the test in a sample of 66 persons with acute traumatic brain injury. Internal consistency as measured by alpha was .66. A homogeneous sample and a restricted range of scores likely attenuated this estimate. Using the standard cutoff score, only 32% of the sample showed impaired performance. Visual form discrimination as measured by this test may be affected less by traumatic brain injury than other cognitive processes such as attention and memory.     

Evaluating the Psychometric Properties of the Teamwork KSA Test

The Teamwork KSA Test has been a welcome addition to the practitioner's selection toolkit as well as a useful measure for teamwork researchers. We analyzed the psychometric properties of the Teamwork KSA Test and recognized correlates of the construct using three samples of working individuals recruited through a university (N = 241, N = 230, N = 332) and found slim evidence for a factor structure of the underlying constructs. Furthermore, classical reliability estimates did not meet traditional psychometric standards. Total TKSA scores predicted self‐ratings and instructor ratings of teamwork in two of the samples; effect sizes were small.     

测验项目反应机制与心理测量模型假设的对应性分析

从测验项目解决的认知过程的视角分析了在不同测验理论框架下的测量模型中的基本假设, 指出测量模型是测验开发者有关测验项目反应机制的理论假设的具体表征, 是系统检验测量假设和过程的统计框架。然而, 不管是经典测验理论、概化理论, 还是早期的项目反应理论模型, 相关假设都过于简化, 缺少相应实质理论的支持。与之相比, 认知测量模型强调与个体在测验项目反应过程中的认知过程、认知策略和知识结构的对应性, 提供了在实质理论基础上界定测量建构、设计测验项目、进行建模分析和解释的可能性, 为日益边缘化的心理测量学和主流心理学研究的融合奠定了基础。     

A Test of the Network Models of Political Priming

Extensive media coverage of a political issue has been shown to influence, or prime, the criteria used to judge overall performance of political leaders. This political priming effect is traditionally explained with network models of memory, which identify priming intensity and recency as key factors in determining the strength and endurance of a priming effect. However, these two assumptions of network models have not been directly tested in media studies. The potential of priming valence to influence the priming effect also has had little treatment. This experiment evaluated priming intensity, recency, and valence within a typical political priming context. In support of previous psychological findings, priming effects were apparent immediately following positively valenced primes, dissipating quickly thereafter. For negative primes, the influence of the prime on judgment formation was contingent on the individual's political leaning, in that individuals who would likely agree with the message exhibited priming effects and individuals who would likely disagree with the message exhibited little effect. The adequacy of applying associative memory models to political priming studies is discussed.     

Psychometric analysis of the Minnesota Test of Critical Thinking

With the increase over the past two decades in interest in critical thinking instruction, reliable and valid means for measuring critical thinking are necessary. The Minnesota Test of Critical Thinking was developed to measure critical thinking as defined by the American Philosophical Association in 1990. The present purpose was to explore the structure and reliability of the intervention and its instantiation of the critical thinking framework. Analyses of responses from 151 adult participants gave estimates of reliability varying from .29 to .78. A factor analysis of the test scores supported critical thinking conceptualized as a single, latent trait. With further refinement, the invention should become a valuable measure of general critical thinking skills of upper-division secondary and postsecondary students.     

Assessing Parental Readiness to Change: A Psychometric Evaluation of the READI-SF in a Community Sample

Engagement in behavioral parent training programs continues to be a barrier to service delivery. Parental readiness is an important construct for understanding parental engagement in parent training services, as these programs place a high level of action-oriented demands on caregivers. The present study examines the performance of one parental readiness measure, the Readiness, Efficacy, Attributions, Defensiveness, and Importance Scale—Short Form (READI-SF) in a community-based sample. Participants included 103 families of children ages three to seven recruited from an urban charter school. Mothers completed an abbreviated version of the READI as well as indices of child disruptive behavior and a second measure of parental readiness. The psychometric properties and factor structure of the READI-SF are explored as well as indices of reliability and validity. Exploratory factor analysis revealed a three-factor model of readiness to change, treatment readiness, and perceived importance of the problem. Analyses also supported the validity and clinical utility of the measure, as READI-SF scores were found to predict attendance at a one-time parenting group. Lastly, the study examines the relationship between parental readiness and child disruptive behavior. Limitations and future directions are discussed.