Gender Differences in Academic Achievement: Is Writing an Exception to the Gender Similarities Hypothesis?

The gender similarities hypothesis by J. S. Hyde (2005 Hyde, J.S. (2005). The gender similarities hypothesis. American Psychologist, 60, 581–592.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]), based on large-scale reviews of studies, concludes that boys and girls are more alike than different on most psychological variables, including academic skills such as reading and math (J. S. Hyde, 2005 Hyde, J.S. (2005). The gender similarities hypothesis. American Psychologist, 60, 581–592.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). Writing is an academic skill that may be an exception. The authors investigated gender differences in academic achievement using a large, nationally stratified sample of children and adolescents ranging from ages 7–19 years (N = 2,027). Achievement data were from the conormed sample for the Kaufman intelligence and achievement tests. Multiple-indicator, multiple-cause, and multigroup mean and covariance structure models were used to test for mean differences. Girls had higher latent reading ability and higher scores on a test of math computation, but the effect sizes were consistent with the gender similarities hypothesis. Conversely, girls scored higher on spelling and written expression, with effect sizes inconsistent with the gender similarities hypothesis. The findings remained the same after controlling for cognitive ability. Girls outperform boys on tasks of writing.     

Theory and Analysis of Total,Direct, and Indirect Causal Effects

Mediation analysis, or more generally models with direct and indirect effects, are commonly used in the behavioral sciences. As we show in our illustrative example, traditional methods of mediation analysis that omit confounding variables can lead to systematically biased direct and indirect effects, even in the context of a randomized experiment. Therefore, several definitions of causal effects in mediation models have been presented in the literature (Baron &; Kenny, 1986 Baron, R.M., &; Kenny, D.A. (1986). The moderator-mediator variable distinction in social psychological research: Conceptual, strategic and statistical considerations. Journal of Personality and Social Psychology, 51, 1173–1182. doi:10.1037/0022-3514.51.6.1173[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Imai, Keele, &; Tingley, 2010 Imai, K., Keele, L., &; Tingley, D. (2010). A general approach to causal mediation analysis. Psychological Methods, 15, 309–334. doi:10.1037/a0020761[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Pearl, 2012 Pearl, J. (2012). The causal mediation formula: A guide to the assessment of pathways and mechanisms. Prevention Science, 13, 426–436. doi:10.1007/s11121-011-0270-1[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). We illustrate the stochastic theory of causal effects as an alternative foundation of causal mediation analysis based on probability theory. In this theory we define total, direct, and indirect effects and show how they can be identified in the context of our illustrative example. A particular strength of the stochastic theory of causal effects are the causality conditions that imply causal unbiasedness of effect estimates. The causality conditions have empirically testable implications and can be used for covariate selection. In the discussion, we highlight some similarities and differences of the stochastic theory of causal effects with other theories of causal effects.     

Examining Current Conceptualizations of Psychopathology With the MMPI–2/MMPI–2–RF Restructured Clinical Scales: Preliminary Findings From a Cross-Cultural Study

Watson (2005 Watson, D. (2005). Rethinking the mood and anxiety disorders: A quantitative hierarchical model for DSM–V. Journal of Abnormal Psychology, 114, 522–536.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) proposed a hierarchical reorganization of the underlying structure of emotional disorders. This study cross-culturally evaluated Watson's (2005) structure of mood and anxiety disorders, using mainly dichotomous criteria, and explored the placement of obsessive–compulsive disorder (OCD) in this model. It also tested Sellbom, Ben-Porath, and Bagby's (2008) proposed elaboration of the 2-factor model (positive and negative activation) that incorporates a higher order dimension of demoralization. One hundred men and 133 women from psychiatric settings in Israel completed the Minnesota Multiphasic Personality Inventory–2 (Butcher et al., 2001 Butcher, J. N., Graham, J. R., Ben-Porath, Y. S., Tellegen, A., Dahlstrom, W. G., &; Kaemmer, B. (2001). Minnesota Multiphasic Personality Inventory–2 (MMPI–2): Manual for administration, scoring and interpretation (Rev. ed.). Minneapolis: University of Minnesota Press.[Crossref] , [Google Scholar]) and the Maudsley Obsessional–Compulsive Inventory (Hodgson &; Rachman, 1977 Hodgson, R. J., &; Rachman, S. (1977). Obsessive–compulsive complaints. Behaviour Research and Therapy, 15, 389–395.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). They were interviewed using the Mini International Neuropsychiatric Interview (Sheehan et al., 1998 Sheehan, D. V., Lecrubier, Y., Sheehan, K. H., Amorim, P., Janavs, J., &; Weiller, E. (1998). The Mini-International Neuropsychiatric Interview (M.I.N.I.): The development and validation of a structured diagnostic psychiatric interview for DSM–IV and ICD–10. Journal of Clinical Psychiatry, 59, 22–33.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). Confirmatory factor analyses replicated Watson's structure for women but not for men. Mixed results were obtained regarding OCD's location in the model. Findings among women support the applicability of Watson's (2005) model across a variety of assessment modalities, as well as in a different language and for diversified cultural backgrounds. This conclusion, however, should be tempered in consideration of the results among men. Findings also provide evidence of the importance of demoralization in mood and anxiety disorders.     

A Polytomous Model of Cognitive Diagnostic Assessment for Graded Data

Pursuing the line of the difference models in IRT (Thissen &; Steinberg, 1986 Thissen, D., &; Steinberg, L. (1986). A taxonomy of item response models. Psychometrika, 51:567–577. doi:10.1007/BF02295596.[Crossref], [Web of Science ®] , [Google Scholar]), this article proposed a new cognitive diagnostic model for graded/polytomous data based on the deterministic input, noisy, and gate (Haertel, 1989 Haertel, E. H. (1989). Using restricted latent class models to map the skill structure of achievement items. Journal of Educational Measurement, 26, 333–352. doi:10.1111/j.1745-3984.1989.tb00336.x.[Crossref], [Web of Science ®] , [Google Scholar]; Junker &; Sijtsma, 2001 Junker, B. W., &; Sijtsma, K. (2001). Cognitive assessment models with few assumptions, and connections with nonparametric item response theory. Applied Psychological Measurement, 25, 258–272. doi:10.1177/01466210122032064.[Crossref], [Web of Science ®] , [Google Scholar]), which is named the DINA model for graded data (DINA-GD). We investigated the performance of a full Bayesian estimation of the proposed model. In the simulation, the classification accuracy and item recovery for the DINA-GD model were investigated. The results indicated that the proposed model had acceptable examinees' correct attribute classification rate and item parameter recovery. In addition, a real-data example was used to illustrate the application of this new model with the graded data or polytomously scored items.     

The Structure of Multidimensional Perfectionism: Support for a Bifactor Model With a Dominant General Factor

Evidence suggests perfectionism is a multidimensional construct composed of 2 higher order factors: perfectionistic strivings and perfectionistic concerns. However, the substantial overlap between perfectionistic strivings and perfectionistic concerns is problematic, as are the unanswered questions regarding the structure of perfectionism following removal of common variance. This research addressed this through bifactor modeling. Three student samples (N = 742) completed Hewitt and Flett's (1991 Hewitt, P. L., &; Flett, G. L. (1991). Perfectionism in the self and social contexts: Conceptualization, assessment, and association with psychopathology. Journal of Personality and Social Psychology, 60, 456.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) Multidimensional Perfectionism Scale, Frost, Marten, Lahart, and Rosenblate's (1990 Frost, R. O., Marten, P., Lahart, C., &; Rosenblate, R. (1990). The dimensions of perfectionism. Cognitive Therapy and Research, 14, 449–468.[Crossref], [Web of Science ®] , [Google Scholar]) Multidimensional Perfectionism Scale, and Slaney, Rice, Mobley, Trippi, and Ashby's (2001 Slaney, R. B., Rice, K. G., Mobley, M., Trippi, J., &; Ashby, J. S. (2001). The revised almost perfect scale. Measurement and Evaluation in Counseling and Development, 34, 130–145.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) Almost Perfect Scale–Revised. Greater support was consistently found for the bifactor model, relative to the 2-factor model. Results suggest the bifactor model best represents the structure of perfectionism and provide preliminary support for the use of a general factor score. Researchers are cautioned that removal of general variance may render the reliability of specific factors (i.e., perfectionistic strivings and perfectionistic concerns) suspect.     

Model Conditioned Data Elasticity in Path Analysis: Assessing the “Confoundability” of Model/Data Characteristics

Much research has been directed at the validity of fit indices in Path Analysis and Structural Equation Modeling (e.g., Browne, MacCallum, Kim, Andersen, &; Glaser, 2002 Browne, M.W., MacCallum, R.C., Kim, C.T., Andersen, B.L., &; Glaser, R. (2002). When fit indices and residuals are incompatible. Psychological Methods, 7, 403–421.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Heene, Hilbert, Draxler, Ziegler, &; Bühner, 2011 Heene, M., Hilbert, S., Draxler, C., Ziegler, M., &; Bühner, M. (2011). Masking misfit in confirmatory factor analysis by increasing unique variances: A cautionary note on the usefulness of cutoff values of fit indices. Psychological Methods, 16(3), 319–336.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Hu &; Bentler, 1999 Hu, L., &; Bentler, P. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, J., 6(1), 1–55.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]; Marsh, Hau, &; Wen, 2004 Marsh, H.W., Hau, K.T., &; Wen, Z. (2004). In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler’s (1999) findings. Structural Equation Modeling, 11(3), 320–341.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]). Recent developments (e.g., Preacher, 2006 Preacher, K.J. (2006). Quantifying parsimony in structural equation modeling. Multivariate Behavioral Research, 41(3), 227–259.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]; Roberts &; Pashler, 2000 Roberts, S., &; Pashler, H. (2000). How persuasive is a good fit? A comment on theory testing. Psychological Review, 107(2), 358–367.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar], 2002 Roberts, S., &; Pashler, H. (2002). Reply to Rodgers and Rowe (2002). Psychological Review, 109(3), 605–607.[Crossref] , [Google Scholar]) have encouraged researchers to investigate other criteria for comparing models, including model complexity. What has not been investigated is the inherent ability of a particular data set to be fitted with a constrained set of randomly generated linear models, which we call Model Conditioned Data Elasticity (DE). In this article we show how DE can be compared with the problem of equivalent models and a more general problem of the “confoundability” of data/model combinations (see MacCallum, Wegener, Uchino, &; Fabrigar, 1993 MacCallum, R.C., Wegener, D.T., Uchino, B.N., &; Fabrigar, L.R. (1993). The problem of equivalent models in applications of covariance structure analysis. Psychological Bulletin, 114(1), 185–199.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). Using the DE package in R, we show how DE can be assessed through automated computer searches. Finally, we discuss how DE fits within the controversy surrounding the use of fit statistics.     

Lassoing Skill Through Learner Choice

The authors examined several issues related to the motor learning benefits resulting from giving learners choices. In 2 experiments, participants practiced a novel task, throwing a lasso. In Experiment 1, giving learners a choice ostensibly irrelevant to performance (color of mat under target) resulted in enhanced learning relative to a control group. The choice group also reported more positive affect. Experiment 2 compared the effectiveness of task-irrelevant (mat color) versus task-relevant (video demonstrations of the skill) choices. In both choice groups, each participant was yoked to a participant in the other group, and each received the same mat color or saw the video demonstration, respectively, as chosen by their counterpart in the other group. In the control group, participants were yoked to their respective counterparts in each of the choice groups. On a retention test, the 2 choice groups did not differ from each other, but both outperformed the control group. The affective and learning effects seen when learners are given choices, and the fact that task-relevant and task-irrelevant choices resulted in similar learning benefits, are consistent with a content-neutral mechanism for the effects of choice on learning, as described in the OPTIMAL theory of motor learning (Wulf &; Lewthwaite, 2016 Wulf, G., &; Lewthwaite, R. (2016). Optimizing performance through intrinsic motivation and attention for learning: The OPTIMAL theory of motor learning. Psychonomic Bulletin &; Review, 23, 1382–1414. https://doi.org/10.3758/s13423-015-0999-9.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]).     

Using the TAT to Assess the Relation Between Gender Identity and the Use of Defense Mechanisms

The purpose of this study is to explore whether 2 different dimensions of personality, when assessed at an implicit level with the Thematic Apperception Test (TAT; Murray, 1943 Murray, H. A. (1943). Thematic Apperception Test manual. Cambridge, MA: Harvard University Press. [Google Scholar]) will show a theoretically meaningful coherence not demonstrated when 1 is assessed at an implicit level and the other at an explicit level. Gender identity and defense mechanisms were assessed implicitly using the TAT. Gender identity was compared with a self-report measure of gender-related attributes assessed at the explicit level. The results showed a theoretically meaningful coherence when different dispositions were assessed at the same level, but a lack of agreement when similar dispositions were assessed at different levels. The study is based on a secondary analysis of data from 2 previously published papers (Cramer, 1998 Cramer, P. (1998). Threat to gender representation: Identity and identification. Journal of Personality, 66, 335–354.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Cramer &; Westergren, 1999 Cramer, P., &; Hogan, K. (1975). Sex differences in verbal and play fantasy. Developmental Psychology, 11, 145–154.[Crossref], [Web of Science ®] , [Google Scholar]).     

How Robust is the Influence of Causal Explanation on Clinical Judgments? Assessments in Structured Clinical Interviews

When causal life-event explanations for disorder symptoms are available, clinicians tend to explain away those symptoms (Ahn, Novick, &; Kim, 2003 Ahn, W., Novick, L. R., &; Kim, N. S. (2003). Understanding behavior makes it normal. Psychonomic Bulletin Review, 10(3), 746–752. doi:10.3758/BF03196541[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Meehl, 1973 Meehl, P. E. (1973). Why I do not attend case conferences. In P. Meehl (Ed.), Psychodiagnosis: Selected papers (pp. 225–302). Minneapolis, MN: University of Minnesota Press. [Google Scholar]), eschewing formal diagnostic guidelines such as the DSM-5 (American Psychiatric Association, 2013 American Psychiatric Association [APA]. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Arlington, VA: American Psychiatric Publishing.[Crossref] , [Google Scholar]). We asked whether this effect is attenuated in the context of a structured diagnostic clinical interview procedure, which deliberately directs evaluators' attention to symptoms alone, or whether it is robust enough to continue to emerge. Across two experiments, lay evaluators given causal life-event explanations for disordered behaviors gave them lower judgments of abnormality and need for treatment compared to evaluators not given such explanations, regardless of whether they used a structured clinical interview. Thus, causal life-event explanations may have significant impact on clinical evaluations regardless of the mode of assessment. Implications for the clinical utility of structured interviews and the role of life-event context in diagnosis and classification are discussed.     

Why do we need perceptual content?

Most representationalists argue that perceptual experience has to be representational because phenomenal looks are, by themselves, representational. Charles Travis (2004 Travis, C. (2004). The silence of the senses. Mind, 113, 57–94.[Crossref], [Web of Science ®] , [Google Scholar]) argues that looks cannot represent. I argue that perceptual experience has to be representational due to the way the visual system works.     

Development of a Response Inconsistency Scale for the Personality Inventory for DSM–5

The advent of a dimensional model of personality disorder included in DSM–5 has necessitated the development of a new measurement scheme, specifically a self-report questionnaire termed the Personality Inventory for DSM–5 (PID–5; Krueger, Derringer, Markon, Watson, &; Skodol, 2012 Krueger, R. F., Derringer, J., Markon, K. E., Watson, D., &; Skodol, A. E. (2012). Initial construction of a maladaptive personality trait model and inventory for DSM–5. Psychological Medicine, 42, 1879–1890. doi:10.1017/S0033291711002674[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). However, there are many threats to the validity of a self-report measure, including response inconsistency. This study outlines the development of an inconsistency scale for the PID–5. Across both college student and clinical samples, the inconsistency scale was able to reliably differentiate real from random responding. Random responses led to increased scores on the PID–5 facets, indicating the importance of detecting inconsistent responding prior to test interpretation. Thus, this inconsistency scale could be of use to researchers and clinicians in detecting inconsistent responses to this new personality disorder measure.     

Effect of Instructions Prioritizing Speed or Accuracy on Kinematics and Kicking Performance in Football Players

The authors' purpose was to investigate if there is a speed accuracy trade-off in soccer kicking by using instructions prioritizing velocity, accuracy, or both upon soccer kicking performance and kicking direction in experienced soccer players. In addition, kinematics were measured to investigate the eventual differences in performance. Thirteen experienced male footballers performed penalty kicks with different instructions prioritizing velocity, accuracy or both. Three-dimensional kinematics, together with maximal ball velocity and hitting accuracy, were measured on all kicks. The main findings were that when the main aim was accuracy, accuracy increased, while the velocity reduced, which supports Fitts' law (Fitts, 1954 Fitts, P. M. (1954). The information capacity of the human motor system in controlling the amplitude of movement. Journal of Experimental Psychology, 47, 381–391.[Crossref], [PubMed] , [Google Scholar]). In addition, kicking accuracy was higher when kicking to the contralateral side. The slower ball velocity was caused by lower segmental and in run velocities. These lower segmental velocities were mainly caused by the lower maximal knee extension and pelvis rotation during the accuracy priority kicks.     

Tactile Ranschburg effects: facilitation and inhibitory repetition effects analogous to verbal memory

The present paper examines the effect of within-sequence item repetitions in tactile order memory. Employing an immediate serial recall procedure, participants reconstructed a six-item sequence tapped upon their fingers by moving those fingers in the order of original stimulation. In Experiment 1a, within-sequence repetition of an item separated by two-intervening items resulted in a significant reduction in recall accuracy for that repeated item (i.e., the Ranschburg effect). In Experiment 1b, within-sequence repetition of an adjacent item resulted in significant recall facilitation for that repeated item. These effects mirror those reported for verbal stimuli (e.g., Henson, 1998a Henson, R. N. A. (1998a). Item repetition in short-term memory: Ranschburg repeated. Journal of Experimental Psychology: Learning, Memory, and Cognition, 24(5), 1162–1181. doi:doi.org/10.1037/0278-7393.24.5.1162[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]. Item repetition in short-term memory: Ranschburg repeated. Journal of Experimental Psychology: Learning, Memory, and Cognition, 24(5), 1162–1181. doi:doi.org/10.1037/0278-7393.24.5.1162). These data are the first to demonstrate the Ranschburg effect with non-verbal stimuli and suggest further cross-modal similarities in order memory.     

Mapping the MMPI–2/MMPI–2–RF Restructured Clinical Scales Onto Mood Markers in an Israeli Sample

This study cross-culturally evaluated the Minnesota Multiphasic Personality Inventory–2/MMPI–2 Restructured Form (MMPI–2/MMPI–2–RF) emotion-focused Restructured Clinical (RC) Scales to examine whether their patterns of associations with positive affect (PA) and negative affect (NA) are as expected based on Tellegen, Watson, and Clark's (1999a Tellegen, A., Watson, D., &; Clark, L. A. (1999a). Further support for a hierarchical model of affect. Psychological Science, 10, 307–309.[Crossref], [Web of Science ®] , [Google Scholar], 1999b Tellegen, A., Watson, D., &; Clark, L. A. (1999b). On the dimensional and hierarchical structure of affect. Psychological Science, 10, 297–303.[Crossref], [Web of Science ®] , [Google Scholar]) mood model. The sample was composed of 100 men and 133 women from psychiatric settings in Israel who completed the MMPI–2 and the Mood Check List (MCL; Zevon &; Tellegen, 1982 Zevon, M. A., &; Tellegen, A. (1982). The structure of mood change: An idiographic/nomothetic analysis. Journal of Personality and Social Psychology, 43, 111–122.[Crossref], [Web of Science ®] , [Google Scholar]). Results indicated that RCd was substantially correlated with both PA and NA in opposite directions, and that RC2 and RC7 were more highly correlated with PA and NA, respectively. Further, when compared with their Clinical Scale counterparts, RC2 and RC7 exhibited comparable convergent validities and improved discriminant properties. Findings provide support for Tellegen et al.'s (2003 Tellegen, A., Ben-Porath, Y. S., McNulty, J. L., Arbisi, P. A., Graham, J. R., &; Kaemmer, B. (2003). MMPI–2 Restructured Clinical (RC) scales: Development, validation, and interpretation. Minneapolis: University of Minnesota Press. [Google Scholar]) goal to link the RC scales to contemporary conceptualizations of mood.     

Measuring Effortful Control Using the Children's Behavior Questionnaire–Very Short Form: Modeling Matters

Effortful control (EC) is an important concept in the research on self-regulation in children. We tested 2 alternative factor models of EC as measured by the Children's Behavior Questionnaire–Very Short Form (CBQ–VSF; Putnam &; Rothbart, 2006 Putnam, S. P., &; Rothbart, M. K. (2006). Development of short and very short forms of the Children's Behavior Questionnaire. Journal of Personality Assessment, 87, 103–113. doi:10.1207/s15327752jpa8701_9[Crossref], [Web of Science ®] , [Google Scholar]) in a large sample of preschoolers (N = 1,007): 1 lower order and 1 hierarchical second-order structure. Additionally, convergent and predictive validity of EC as measured by the CBQ–VSF were investigated. The results supported a hierarchical model. Moderate convergent validity of the second-order latent EC factor was found in that it correlated with compliance and observed EC tasks. Both CBQ–VSF EC measures were also negatively correlated with child physical aggression. The results have implications for the measurement, modeling, and interpretation of EC applying the CBQ.     

An Introduction to Kristof’s Theorem for Solving Least-Square Optimization Problems Without Calculus

Kristof’s Theorem (Kristof, 1970 Kristof, W. (1970). A theorem on the trace of certain matrix products and some applications. Journal of Mathematical Psychology, 7(3), 515–530. https://doi.org/10.1016/0022-2496(70)90037-4[Crossref], [Web of Science ®] , [Google Scholar]) describes a matrix trace inequality that can be used to solve a wide-class of least-square optimization problems without calculus. Considering its generality, it is surprising that Kristof’s Theorem is rarely used in statistics and psychometric applications. The underutilization of this method likely stems, in part, from the mathematical complexity of Kristof’s (1964 Kristof, W. (1964). Die beste orthogonale Transformation zur gegenseitigen Uberfiihrung zweier Faktorenmatrizen. Diagnostica, 10, 87–90. [Google Scholar], 1970 Kristof, W. (1970). A theorem on the trace of certain matrix products and some applications. Journal of Mathematical Psychology, 7(3), 515–530. https://doi.org/10.1016/0022-2496(70)90037-4[Crossref], [Web of Science ®] , [Google Scholar]) writings. In this article, I describe the underlying logic of Kristof’s Theorem in simple terms by reviewing four key mathematical ideas that are used in the theorem’s proof. I then show how Kristof’s Theorem can be used to provide novel derivations to two cognate models from statistics and psychometrics. This tutorial includes a glossary of technical terms and an online supplement with R (R Core Team, 2017 R Core Team (2017). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. Retrieved from https://www.R-project.org/ [Google Scholar]) code to perform the calculations described in the text.     

The Abbreviated Character Strengths Test (ACST): A Preliminary Assessment of Test Validity

The 24-item Abbreviated Character Strengths Test (ACST) was developed to efficiently measure character strengths (Peterson, Park, &; Castro, 2011 Peterson, C., Park, N., &; Castro, C. A. (2011). Assessment for the US Army Comprehensive Soldier Fitness program: The Global Assessment Tool. American Psychologist, 66, 10–18.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). However, its validity for this purpose has not yet been sufficiently established. Using confirmatory factor analysis to test a series of structural models, only a modified bifactor model showed reasonably acceptable fit. Further analyses of this model failed to demonstrate measurement invariance between male and female respondents. Relationships between ACST dimension and Big Five personality trait scores were generally weak-to-moderate, and support for hypotheses regarding each ACST virtue's expected correspondence with specific Big Five dimensions was mixed. Finally, scores on ACST dimensions accounted for a combined 12% of the variance in satisfaction with life scores, after controlling for socially desirability. Although an abbreviated measure of character strengths represents a practical need, considerable improvements to the ACST are needed for it to adequately meet this purpose.     

Mind Perception and Individual Differences: A Replication and Extension

Mind perception involves attributing higher functional abilities to others (e.g., saying a dog feels pain). The relationships between mind perception and psychopathology—autism, psychopathy, and schizotypy—have been revealed by K. Gray, Jenkins, Heberlein, and Wegner (2011 Gray, K., Jenkins, A. C., Heberlein, A. S., &; Wegner, D. M. (2011). Distortions of mind perception in psychopathology. Proceedings of the National Academy of Sciences of the United States of America, 108, 477–479. doi:10.1073/pnas.1015493108[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]); however, mind perception has yet to be correlated with personality. Participants (N = 180) completed measures of personality, psychopathology, and mind perception. The psychopathology results were consistent with Gray et al. (2011 Gray, K., Jenkins, A. C., Heberlein, A. S., &; Wegner, D. M. (2011). Distortions of mind perception in psychopathology. Proceedings of the National Academy of Sciences of the United States of America, 108, 477–479. doi:10.1073/pnas.1015493108[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). The Big Five captured mind perception virtually as much as the three psychopathologies captured mind perception. Mind perception is not solely relevant to psychopathology; it is also relevant to everyday personality.     

A Statistical Consideration Regarding the Threshold of the Psychopathy Checklist–Revised

The Psychopathy Checklist–Revised (PCL–R; Hare, 2003 Hare, R. D. (2003). Hare Psychopathy Checklist–Revised technical manual (2nd ed.). Toronto, ON, Canada: Multi-Health Systems. [Google Scholar]) is one of the most commonly used measures of psychopathy. Scores range from 0 to 40, and legal and mental health professionals sometimes rely on a cut score or threshold to classify individuals as psychopaths. This practice, among other things, assumes that all items contribute equally to the overall raw score. Results from an item response theory analysis (Bolt, Hare, Vitale, &; Newman, 2004 Bolt, D. M., Hare, R. D., Vitale, J. E., &; Newman, J. P. (2004). A multigroup item response theory analysis of the Psychopathy Checklist–Revised. Psychological Assessment, 16, 155–168. doi:10.1037/1040-3590.16.2.155[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]), however, indicate that PCL–R items differ in the amount of information they can provide about psychopathy. We examined the consequences of these item differences for using a cut score, detailing the consequences for a previously applied cut score of 30 as an example. Results indicated that there were more than 8.5 million different response combinations that equaled 30 and more than 14.2 million that equaled 30 or more. This raw score, like others, corresponded to a broad range of PCL–R-defined psychopathy, indicating that applying cut scores on this measure results in imprecise quantifications of psychopathy. We show that by using the item parameters along with an individual's particular scores on the PCL–R items, it is possible to arrive at a more precise understanding of an individual's level of psychopathy on this instrument.     

Addressing Item-Level Missing Data: A Comparison of Proration and Full Information Maximum Likelihood Estimation

Often when participants have missing scores on one or more of the items comprising a scale, researchers compute prorated scale scores by averaging the available items. Methodologists have cautioned that proration may make strict assumptions about the mean and covariance structures of the items comprising the scale (Schafer &; Graham, 2002 Schafer, J.L., &; Graham, J.W. (2002). Missing data: Our view of the state of the art. Psychological Methods, 7, 147–177.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Graham, 2009 Graham, J.W. (2009). Missing data analysis: Making it work in the real world. Annual Review of Psychology, 60, 549–576.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Enders, 2010 Enders, C.K. (2010). Applied missing data analysis. New York, NY: Guilford Press. [Google Scholar]). We investigated proration empirically and found that it resulted in bias even under a missing completely at random (MCAR) mechanism. To encourage researchers to forgo proration, we describe a full information maximum likelihood (FIML) approach to item-level missing data handling that mitigates the loss in power due to missing scale scores and utilizes the available item-level data without altering the substantive analysis. Specifically, we propose treating the scale score as missing whenever one or more of the items are missing and incorporating items as auxiliary variables. Our simulations suggest that item-level missing data handling drastically increases power relative to scale-level missing data handling. These results have important practical implications, especially when recruiting more participants is prohibitively difficult or expensive. Finally, we illustrate the proposed method with data from an online chronic pain management program.