Ant Colony Optimization and Local Weighted Structural Equation Modeling. A Tutorial on Novel Item and Person Sampling Procedures for Personality Research

Measurement in personality development faces many psychometric problems. First, theory‐based measurement models do not fit the empirical data in terms of traditional confirmatory factor analysis. Second, measurement invariance across age, which is necessary for a meaningful interpretation of age‐associated personality differences, is rarely accomplished. Finally, continuous moderator variables, such as age, are often artificially categorized. This categorization leads to bias when interpreting differences in personality across age. In this tutorial, we introduce methods to remedy these problems. We illustrate how Ant Colony Optimization can be used to sample indicators that meet prespecified demands such as model fit. Further, we use Local Structural Equation Modeling to resample and weight subjects to study differences in the measurement model across age as a continuous moderator variable. We also provide a detailed illustration for both tools with the Neuroticism scale of the openly available International Personality Item Pool – NEO inventory using data from the UK sample (N = 15 827). Combined, both tools can remedy persistent problems in research on personality and its development. In addition to a step‐by‐step illustration, we provide commented syntax for both tools. © 2019 European Association of Personality Psychology     

True or False? Keying Direction and Acquiescence Influence the Validity of Socio-Emotional Skills Items in Predicting High School Achievement

What type of items, keyed positively or negatively, makes social-emotional skill or personality scales more valid? The present study examines the different criterion validities of true- and false-keyed items, before and after correction for acquiescence. The sample included 12,987 children and adolescents from 425 schools of the State of São Paulo Brazil (ages 11–18 attending grades 6–12). They answered a computerized 162-item questionnaire measuring 18 facets grouped into five broad domains of social-emotional skills, i.e.: Open-mindedness (O), Conscientious Self-Management (C), Engaging with others (E), Amity (A), and Negative-Emotion Regulation (N). All facet scales were fully balanced (3 true-keyed and 3 false-keyed items per facet). Criterion validity coefficients of scales composed of only true-keyed items versus only false-keyed items were compared. The criterion measure was a standardized achievement test of language and math ability. We found that coefficients were almost as twice as big for false-keyed items’ scales than for true-keyed items’ scales. After correcting for acquiescence coefficients became more similar. Acquiescence suppresses the criterion validity of unbalanced scales composed of true-keyed items. We conclude that balanced scales with pairs of true and false keyed items make a better scale in terms of internal structural and predictive validity.