Test theory without an answer key

A general model is presented for homogeneous, dichotomous items when the answer key is not known a priori. The model is structurally related to the two-class latent structure model with the roles of respondents and items interchanged. For very small sets of respondents, iterative maximum likelihood estimates of the parameters can be obtained by existing methods. For other situations, new estimation methods are developed and assessed with Monte Carlo data. The answer key can be accurately reconstructed with relatively small sets of respondents. The model is useful when a researcher wants to study objectively the knowledge possessed by members of a culturally coherent group that the researcher is not a member of.This research was supported by NSF Grant No. SES-8320173 to the authors. We gratefully acknowledge comments and suggestions from John Boyd, Tarow Indow, and Kathy Maher as well as the editor and several anonymous referees.     

Examining differential item functioning due to item difficulty and alternative attractiveness

A method for analyzing test item responses is proposed to examine differential item functioning (DIF) in multiple-choice items through a combination of the usual notion of DIF, for correct/incorrect responses and information about DIF contained in each of the alternatives. The proposed method uses incomplete latent class models to examine whether DIF is caused by the attractiveness of the alternatives, difficulty of the item, or both. DIF with respect to either known or unknown subgroups can be tested by a likelihood ratio test that is asymptotically distributed as a chi-square random variable.     

Criterion-related construct validity

Established results on latent variable models are applied to the study of the validity of a psychological test. When the test predicts a criterion by measuring a unidimensional latent construct, not only must the total score predict the criterion, but the joint distribution of criterion scores and item responses must exhibit a certain pattern. The presence of this population pattern may be tested with sample data using the stratified Wilcoxon rank sum test. Often, criterion information is available only for selected examinees, for instance, those who are admitted or hired. Three cases are discussed: (i) selection at random, (ii) selection based on the current test, and (iii) selection based on other measures of the latent construct. Discriminant validity is also discussed.This work was supported in part by Grant SES-87-01890 from the Measurement Methods and Data Improvement Program of the U.S. National Science Foundation.     

A structural model for postpartum responses to the somatic and cognitive items on the Beck Depression Inventory

A distinction can be drawn between those items on the Beck Depression Inventory (BDI) that reflect mainly cognitive and emotional symptoms and those that reflect somatic symptoms. Responses to the BDI were obtained from women at 3, 6, 9, and 24 weeks postpartum. The covariances of cognitive and somatic symptom scores across the four time points were closely fit by a structural equations model referred to as the simplex. The modeling indicates that earlier cognitive scores directly predict later somatic scores but that early somatic scores do not directly predict later cognitive scores. Other data confirm the results.Much of this research was supported while the first author was an NIMH Fellow at the University of Iowa (MH15168).     

A nonparametric approach for assessing latent trait unidimensionality

Assuming a nonparametric family of item response theory models, a theory-based procedure for testing the hypothesis of unidimensionality of the latent space is proposed. The asymptotic distribution of the test statistic is derived assuming unidimensionality, thereby establishing an asymptotically valid statistical test of the unidimensionality of the latent trait. Based upon a new notion of dimensionality, the test is shown to have asymptotic power 1. A 6300 trial Monte Carlo study using published item parameter estimates of widely used standardized tests indicates conservative adherence to the nominal level of significance and statistical power averaging 81 out of 100 rejections for examinee sample sizes and psychological test lengths often incurred in practice.The referees' comments were remarkably detailed and greatly enhanced the writeup and sensitized the author to certain pertinent issues. Discussions with Fritz Drasgow, Lloyd Humphreys, Dennis Jennings, Brian Junker, Robert Linn, Ratna Nandakumar, and Robin Shealy were also very useful.This research was supported by the Office of Naval Research under grant N00014-84-K-0186; NR 150-533, and by the National Science Foundation under grant DMS 85-03321.     

Latent trait models and dichotomization of graded responses

This paper discusses thecompatibility of the polychotomous Rasch model with dichotomization of the response continuum. It is argued that in the case of graded responses, the response categories presented to the subject are essentially an arbitrary polychotomization of the response continuum, ranging for example from total rejection or disagreement to total acceptance or agreement of an item or statement. Because of this arbitrariness, the measurement outcome should be independent of the specific polychotomization applied, for example, presenting a specific multicategory response format should not affect the measurement outcome. When such is the case, the original polychotomous model is called compatible with dichotomization.A distinction is made between polychotomization or dichotomization before the fact, that is, in constructing the response format, and polycho- or dichotomization after the fact, for example in dichotomizing existing graded response data.It is shown that, at least in case of dichotomization after-the-fact, the polychotomous Rasch model is not compatible with dichotomization, unless a rather special condition of the model parameters is met. Insofar as it may be argued that dichotomization before the fact is not essentially different from dichotomization after the fact, the value of the unidimensional polychotomous Rasch model is consequently questionable. The impact of our conclusion on related models is also discussed.     

Critical action among Asian and Hispanic/Latinx youth: Identifying a multidimensional measure and exploring within-group differences

Critical action—behaviours aimed at dismantling systems of oppression—must be examined within youths' racialized experiences and should incorporate cultural and sociohistorical factors. We considered an expansive list of items capturing youth behaviours to create a novel four-factor (service, community change, expression, and care) measure of critical action for Asian and Hispanic/Latinx youth. Multiple distinct profiles of critical action were identified within both racial-ethnic groups, and associations between the profiles and sociodemographic and contextual support variables were explored. Gender differences in the type of critical action were found in both racial-ethnic groups, pointing to the potential influence of gender roles on critical action among these populations. Differences in critical action patterns were also found between those born in the U.S. versus those born outside the U.S.; access to critical action may differ within racial-ethnic groups depending on birthplace and associated nuances in familial and cultural contexts. This paper demonstrated a need for attending to variation between and within groups in the study of critical action in order to effectively support racialized youth's coping within and resistance against systems of oppression.     

特质自我控制对食物线索注意偏向的影响及干预：来自眼动的证据

采用眼动技术,以BMI指数处于正常范围的女性为被试,考察特质自我控制对食物线索注意偏向的影响以及注意偏向训练在改变注意偏向强度上的干预效果。结果发现,对于高热量食物线索,低特质自我控制水平女性表现出了更强的注意偏向;注意偏向训练有效降低了低特质自我控制水平女性对高热量食物线索注意偏向的强度。上述结果表明,特质自我控制影响个体对食物线索的注意偏向,注意偏向训练能有效改变个体对食物线索注意偏向的强度。     

Stolen elections: How conspiracy beliefs during the 2020 American presidential elections changed over time

Conspiracy beliefs have been studied mostly through cross-sectional designs. We conducted a five-wave longitudinal study (N = 376; two waves before and three waves after the 2020 American presidential elections) to examine if the election results influenced specific conspiracy beliefs and conspiracy mentality, and whether effects differ between election winners (i.e., Biden voters) versus losers (i.e., Trump voters) at the individual level. Results revealed that conspiracy mentality kept unchanged over 2 months, providing first evidence that this indeed is a relatively stable trait. Specific conspiracy beliefs (outgroup and ingroup conspiracy beliefs) did change over time, however. In terms of group-level change, outgroup conspiracy beliefs decreased over time for Biden voters but increased for Trump voters. Ingroup conspiracy beliefs decreased over time across all voters, although those of Trump voters decreased faster. These findings illuminate how specific conspiracy beliefs are, and conspiracy mentality is not, influenced by an election event.