Multidimensional CAT Item Selection Methods for Domain Scores and Composite Scores: Theory and Applications

Multidimensional computer adaptive testing (MCAT) can provide higher precision and reliability or reduce test length when compared with unidimensional CAT or with the paper-and-pencil test. This study compared five item selection procedures in the MCAT framework for both domain scores and overall scores through simulation by varying the structure of item pools, the population distribution of the simulees, the number of items selected, and the content area. The existing procedures such as Volume (Segall in Psychometrika, 61:331?C354, 1996), Kullback?CLeibler information (Veldkamp & van?der Linden in Psychometrika 67:575?C588, 2002), Minimize the error variance of the linear combination (van?der Linden in J. Educ. Behav. Stat. 24:398?C412, 1999), and Minimum Angle (Reckase in Multidimensional item response theory, Springer, New York, 2009) are compared to a new procedure, Minimize the error variance of the composite score with the optimized weight, proposed for the first time in this study. The intent is to find an item selection procedure that yields higher precisions for both the domain and composite abilities and a higher percentage of selected items from the item pool. The comparison is performed by examining the absolute bias, correlation, test reliability, time used, and item usage. Three sets of item pools are used with the item parameters estimated from real live CAT data. Results show that Volume and Minimum Angle performed similarly, balancing information for all content areas, while the other three procedures performed similarly, with a high precision for both domain and overall scores when selecting items with the required number of items for each domain. The new item selection procedure has the highest percentage of item usage. Moreover, for the overall score, it produces similar or even better results compared to those from the method that selects items favoring the general dimension using the general model (Segall in Psychometrika 66:79?C97, 2001); the general dimension method has low precision for the domain scores. In addition to the simulation study, the mathematical theories for certain procedures are derived. The theories are confirmed by the simulation applications.     

Item Characteristic Curve Estimation of Signal Detection Theory-Based Personality Data: A Two-Stage Approach to Item Response Modeling

Signal Detection Theory (SDT; MacMillan & Creelman, 1991) is a method of data collection that has been used for several years, which describes the decision-making strategies of individuals. However, its use has been largely restricted to experiments involving sensation and perception. The Overclaiming Questionnaire (OCQ; Paulhus & Bruce, 1990) is a scale that has been developed to measure intellectual ability and personality, using SDT as a guideline. Although the scale has been successful in measuring human characteristics such as narcissism and intelligence, it is still unclear how to measure the characteristics of the various stimuli used (e.g., item difficulty, item discrimination, etc.). In some ways, this is a direct consequence of the general lack of research involved in item parameter estimation in the field of SDT. Using the OCQ, this article presents a graphical and nonparametric form of item response modeling to address this issue. In many ways, the approach is influenced by and structured around item response theory (IRT; Hambleton, Swaminathan, & Rogers, 1991). The general features of both SDT and IRT are described. Results suggest that this method is indeed a reasonable approach to describing item functioning, and there are several advantages to using this method over traditional IRT methods. Furthermore, SDT appears to be a fruitful approach to assessing intelligence, ability, and other psychological constructs, with advantages over traditional approaches. Overall, the results provide interesting implications for item selection and test development in several scientific and academic fields.     

Sons and Mothers: New Insight into the End of Active Motherhood in the ‘Age of Austerity’

True independence is difficult for young adults to achieve by leaving home due to economic austerity and contemporary expectation. Such extended dependence has, however, been little studied. Midlife mothers were interviewed to explore their experience of having their adult sons live at home. The interviews were analysed using Grounded Theory (Strauss and Corbin in Basics of qualitative research: grounded theory procedures and techniques. Sage, Newbury Park, CA, 1990). The essence of the mothers’ (n = 5) experience was captured in the core category, Coming to Terms and Entering a New Phase. This category integrates the three-stage model of process that occurred as mothers accepted that their maternal role was changing and they needed to prepare for the next stage of their lives. The three stages were represented by the subcategories, Shifting Role, Anticipating Loss and Letting Go. The women believed that their sons would not be able to leave home until they could purchase a property, a distant prospect for many. The findings extend the work of previous lifespan models, including that of Apter (Secret paths: women in the new midlife. W. W. Norton, New York, 1995) but with greater depth and clarity, in a vital and changed contemporary context that is likely to be relevant for a large population of women.     

New Directions for Research on the Role of Parents and Teachers in the Development of Gender-Related Math Attitudes: Response to Commentaries

We frame our response to the commentaries by Cheryan (2011), Lane (2011), and Shapiro and Williams (2011), in terms of two broad points made by Lane (2011). First, we agree that the various constructs that we termed “math attitudes”—including math-gender stereotypes, math anxiety, math self-concepts, and achievement motivation in math—are in fact distinct (Gunderson et al. 2011b). Nevertheless, we argue that investigating common mechanisms underlying the transmission of these constructs from adults to children is a productive approach because it can lead to general interventions to boost children’s performance and dispositions toward math. Second, we argue that research on the development of gender-related math attitudes exists at the intersection of multiple research areas, including research on attitudes (broadly defined), math, gender, social learning, and child development, and that drawing on well-developed theories in these areas can lead to novel research questions and predictions. The three excellent commentaries broaden the scope of our article on gender-related math attitudes to include the transmission of implicit attitudes from adults to children, stereotype threat, and gender roles in math-related careers (Cheryan 2011; Gunderson et al. 2011b; Lane 2011; Shapiro and Williams 2011).     

Disrupting the Coloniality of Being: Toward De-colonial Ontologies in Philosophy of Education

This essay works to bridge conversations in philosophy of education with decolonial theory. The author considers Margonis?? (1999, 2011a, b) use of Rousseau (1979) and Heidegger (1962) in developing an ontological attitude that counters social hierarchies and promotes anti-colonial relations. While affirming this effort, the essay outlines a coloniality of being at work in Rousseau and Heidegger through thier reliance on the colonial conceptualization of African Americans and Native Americans as savage and primitive. The essay turns to decolonial theory and the work of Maldenado-Torres (Cult Stud 21(2?C3):240?C270, 2007, 2009) to highlight how a decolonial attitude complicates, yet enriches Margonis?? philosophical framework.     

Exemplification as molecular function

Since the publication of Universals and Scientific Realism (Armstrong 1978a, b) until Sketch for a Systematic Metaphysics (Armstrong 2010), via Universals: An Opinionated Introduction (Armstrong 1989), a World of States of Affairs (Armstrong 1997), and Truth and Truthmakers (Armstrong 2004), David Armstrong has developed one of the most influential theories of instantiation in contemporary analytic metaphysics (see, for example, Lewis, in Aust J Phil 61(4), 343–377, 1983; Baxter in Aust J Phil, 79, 449–464, 2001; Forrest, in Aust J Phil, 83, 213–228, 2006). Instantiation has been advocated by Armstrong to give a solution to what he has called the “pressing problem” of “the multiple location of property universals” (Armstrong, in Universals: An opinionated introduction. University Press, Cambridge, 1989, pp. 89–90). Here I argue that Armstrong’s theory of instantiation fails to solve the problem because it involves two kinds of instantiation to account for particulars “having” and “sharing” universals. As a viable alternative to Armstrong’s theory, I propose a theory of instantiation capable of accounting for both phenomena in a univocal way.     

Using Deterministic, Gated Item Response Theory Model to Detect Test Cheating due to Item Compromise

The Deterministic, Gated Item Response Theory Model (DGM, Shu, Unpublished Dissertation. The University of North Carolina at Greensboro, 2010) is proposed to identify cheaters who obtain significant score gain on tests due to item exposure/compromise by conditioning on the item status (exposed or unexposed items). A “gated” function is introduced to decompose the observed examinees’ performance into two distributions (the true ability distribution determined by examinees’ true ability and the cheating distribution determined by examinees’ cheating ability). Test cheaters who have score gain due to item exposure are identified through the comparison of the two distributions. Hierarchical Markov Chain Monte Carlo is used as the model’s estimation framework. Finally, the model is applied in a real data set to illustrate how the model can be used to identify examinees having pre-knowledge on the exposed items.     

Importing Logics

The novel notion of importing logics is introduced, subsuming as special cases several kinds of asymmetric combination mechanisms, like temporalization [8, 9], modalization [7] and exogenous enrichment [13, 5, 12, 4, 1]. The graph-theoretic approach proposed in [15] is used, but formulas are identified with irreducible paths in the signature multi-graph instead of equivalence classes of such paths, facilitating proofs involving inductions on formulas. Importing is proved to be strongly conservative. Conservative results follow as corollaries for temporalization, modalization and exogenous enrichment.     

The Heteroscedastic Graded Response Model with a Skewed Latent Trait: Testing Statistical and Substantive Hypotheses Related to Skewed Item Category Functions

The Graded Response Model (GRM; Samejima, Estimation of ability using a response pattern of graded scores, Psychometric Monograph No.?17, Richmond, VA: The Psychometric Society, 1969) can be derived by assuming a linear regression of a continuous variable, Z, on the trait, ??, to underlie the ordinal item scores (Takane & de Leeuw in Psychometrika, 52:393?C408, 1987). Traditionally, a normal distribution is specified for Z implying homoscedastic error variances and a normally distributed ??. In this paper, we present the Heteroscedastic GRM with Skewed Latent Trait, which extends the traditional GRM by incorporation of heteroscedastic error variances and a skew-normal latent trait. An appealing property of the extended GRM is that it includes the traditional GRM as a special case. This enables specific tests on the normality assumption of Z. We show how violations of normality in Z can lead to asymmetrical category response functions. The ability to test this normality assumption is beneficial from both a statistical and substantive perspective. In a simulation study, we show the viability of the model and investigate the specificity of the effects. We apply the model to a dataset on affect and a dataset on alexithymia.     

Margaret R. Miles’ Augustine and the Fundamentalist’s Daughter: An Eriksonian Perspective

My perspective on Margaret R. Miles’s Augustine and the Fundamentalist’s Daughter is informed by Erik H. Erikson’s life cycle model (Erikson 1950, 1959, 1963, 1964, 1968a, b, 1982; Erikson and Erikson 1997) and, more specifically, by my relocation of his life stages and their accompanying human strengths (Erikson 1964) according to decades (Capps 2008). I interpret Miles’s account of her life from birth to age forty as revealing the selves that comprise the composite Self (Erikson 1968a) that come into their own during the first four decades of the life cycle, i.e., the hopeful, willing, purposeful, and competent selves     

Psychotherapy as Moral Encounter: A Crisis of Modern Conscience

Psychotherapy can no longer be understood as a morally neutral or value-free practice. Many have argued that psychology is implicitly and inevitably laden with moral assumptions and has a significant impact on the moral and ethical fabric of its clients and surrounding society (Browning 1987; Doherty 1995; Dueck and Reimer 2003; Kelly and Strupp 1992; Rieff 1987, 2006). In this work, the authors highlight the profound identity crises within the field of psychology around the place of morality/ethics in its theories and practices. Chronicling some of the shifts between modern and postmodern theory will allow for a meaningful engagement with this issue. The postmodern shifts in the field have left clinicians ideologically hampered in their ability to attend to the moral dimensions of their clients’ lives. In conclusion, the authors posit a virtue ethics and consider avenues of holistically and meaningfully infusing clinical practice with moral sensibilities.     

Addressing Conceptual Confusions About Evolutionary Theorizing: How and Why Evolutionary Psychology and Feminism Do Not Oppose Each Other

This commentary is a rejoinder to the Buss and Schmitt (2011) and Eagly and Wood (2011) commentaries concerning how evolutionary psychology and feminism might fit together. This rejoinder provides one path toward uniting these perspectives in psychological literature by accomplishing three tasks. First, this rejoinder addresses and removes conceptual confusions offered by Buss and Schmitt (2011) concerning the philosophy of science and psychology research. Second, this rejoinder fits evolutionary psychology perspectives into a correctly understood philosophy of science for psychology. Third, enacting Eagly and Wood’s (2011) suggestions, this rejoinder connects evolutionary psychology and feminism by expanding Tate and Ledbetter’s (2010) stepwise model for understanding the simultaneous contributions of evolutionary and developmental factors to psychological phenomena. Thus, by removing conceptual roadblocks, this rejoinder provides a scaffold for fruitful discussions concerning the interplay of evolutionary psychology and feminist perspectives when characterizing gender differences and similarities.     

Semantic plasticity and epistemicism

This paper considers the connections between semantic shiftiness (plasticity), epistemic safety and an epistemic theory of vagueness as presented and defended by Williamson (1996a, b, 1997a, b). Williamson explains ignorance of the precise intension of vague words as rooted in insensitivity to semantic shifts: one??s inability to detect small shifts in intension for a vague word results in a lack of knowledge of the word??s intension. Williamson??s explanation, however, falls short of accounting for ignorance of intension.     

An Inequality for Correlations in Unidimensional Monotone Latent Variable Models for Binary Variables

It is shown that a unidimensional monotone latent variable model for binary items implies a restriction on the relative sizes of item correlations: The negative logarithm of the correlations satisfies the triangle inequality. This inequality is not implied by the condition that the correlations are nonnegative, the criterion that coefficient H exceeds 0.30, or manifest monotonicity. The inequality implies both a lower bound and an upper bound for each correlation between two items, based on the correlations of those two items with every possible third item. It is discussed how this can be used in Mokken’s (A theory and procedure of scale-analysis, Mouton, The Hague, 1971) scale analysis.     

An Introduction to Issues of Gender in Stalking Research

Stalking research has increased substantially in the past 20?years. This special issue is intended to contribute to this literature by using gender as a focus point in 1) applying new theoretical perspectives that incorporate the role of gender to the study of stalking perpetration (Davis et al. 2010; Duntley and Buss 2010), 2) addressing divergent findings regarding gender in experiences of victims (Sheridan and Lyndon 2010) and perpetrators (Thompson et al. 2010), and 3) furthering the study of how gender influences perceptions of stalking (Cass and Rosay 2011; Dunlap et al. 2011; Sinclair 2010; Yanowitz and Yanowitz 2010). To place this special issue in context of the current state of knowledge on gender and stalking, we review the state of the existing research as it relates to the domains covered by articles present in this issue.     

More on the Gendered Division of Household Labor: A Response to Commentators

This article is a response to the commentaries made regarding our original article (Lachance-Grzela and Bouchard 2010), which reviewed the state of research on the division of household labor and summarized the main theoretical perspectives used to explain why women continue to complete the larger share of household tasks. In the following pages, we underline how the commentators were helpful in identifying some limitations of the current research on the allocation of household labor and in suggesting relevant paths for future studies. We discuss points on which the commentators agree, such as the need to achieve a better understanding of all forms of inequalities, and points on which they disagree, such as the way researchers should proceed when studying the impact of national context. We also reply to each individual commentary. In response to Coltrane (2010), we discuss the causal loops that exist between gender inequalities in the private and public spheres. We agree with Davis (2010) who proposed that studying the question from other angles could help understand why household labor continues to be divided along gendered lines. We add to Claffey and Manning’s discussion (2010) of the paradox which stems from the fact that couples often perceive an objectively unequal division of household labor as fair to both partners. In conclusion, we take the opportunity to address additional issues related to the division of household labor. For instance, from a clinical psychology standpoint, we discuss how couples who strive to achieve a more egalitarian division of household labor do so.     

25 years of research on the use of geometry in spatial reorientation: a current theoretical perspective

The purpose of this article is to review and evaluate the range of theories proposed to explain findings on the use of geometry in reorientation. We consider five key approaches and models associated with them and, in the course of reviewing each approach, five key issues. First, we take up modularity theory itself, as recently revised by Lee and Spelke (Cognitive Psychology, 61, 152–176, 2010a; Experimental Brain Research, 206, 179–188, 2010b). In this context, we discuss issues concerning the basic distinction between geometry and features. Second, we review the view-matching approach (Stürzl, Cheung, Cheng, & Zeil, Journal of Experimental Psychology: Animal Behavior Processes, 34, 1–14, 2008). In this context, we highlight the possibility of cross-species differences, as well as commonalities. Third, we review an associative theory (Miller & Shettleworth, Journal of Experimental Psychology: Animal Behavior Processes, 33, 191–212, 2007; Journal of Experimental Psychology: Animal Behavior Processes, 34, 419–422, 2008). In this context, we focus on phenomena of cue competition. Fourth, we take up adaptive combination theory (Newcombe & Huttenlocher, 2006). In this context, we focus on discussing development and the effects of experience. Fifth, we examine various neurally based approaches, including frameworks proposed by Doeller and Burgess (Proceedings of the National Academy of Sciences of the United States of America, 105, 5909–5914, 2008; Doeller, King, & Burgess, Proceedings of the National Academy of Sciences of the United States of America, 105, 5915–5920, 2008) and by Sheynikhovich, Chavarriaga, Strösslin, Arleo, and Gerstner (Psychological Review, 116, 540–566, 2009). In this context, we examine the issue of the neural substrates of spatial navigation. We conclude that none of these approaches can account for all of the known phenomena concerning the use of geometry in reorientation and clarify what the challenges are for each approach.