Valedictory

Contingentism, generally contrasted with law necessitarianism, is the view that the laws of nature are contingent. It is often coupled with the claim that their contingency is knowable a priori. This paper considers Bird's [2001 Bird, Alexander 2001. Necessarily, Salt Dissolves In Water, Analysis 61/4: 267–74.[Crossref], [Web of Science ®] , [Google Scholar], 2002 Bird, Alexander 2002. On Whether Some Laws Are Necessary, Analysis 62/3: 257–70.[Crossref], [Web of Science ®] , [Google Scholar], 2005 Bird, Alexander 2005. Unexpected A Posteriori Necessary Laws of Nature, Australasian Journal of Philosophy 83/4: 533–48.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar], 2007 Bird, Alexander 2007. Nature's Metaphysics: Laws and Properties, Oxford: Clarendon Press.[Crossref] , [Google Scholar]] arguments for the thesis that, necessarily, salt dissolves in water; and it defends his view against Beebee's [2001] and Psillos's [2002 Psillos, Stathis 2002. Salt Does Dissolve In Water, But Not Necessarily, Analysis 62/3: 255–7.[Crossref], [Web of Science ®] , [Google Scholar]] contingentist objections. A new contingentist objection is offered and several reasons for scepticism about its success are raised. It is concluded that certain higher-level laws describing the behaviours of molecular compounds may be necessary due to their dependence on underlying physical laws, and that the modal status of laws of nature cannot be determined a priori, as the structural features of the substances and properties they govern must first be investigated.     

Gender Differences in Academic Achievement: Is Writing an Exception to the Gender Similarities Hypothesis?

The gender similarities hypothesis by J. S. Hyde (2005 Hyde, J.S. (2005). The gender similarities hypothesis. American Psychologist, 60, 581–592.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]), based on large-scale reviews of studies, concludes that boys and girls are more alike than different on most psychological variables, including academic skills such as reading and math (J. S. Hyde, 2005 Hyde, J.S. (2005). The gender similarities hypothesis. American Psychologist, 60, 581–592.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). Writing is an academic skill that may be an exception. The authors investigated gender differences in academic achievement using a large, nationally stratified sample of children and adolescents ranging from ages 7–19 years (N = 2,027). Achievement data were from the conormed sample for the Kaufman intelligence and achievement tests. Multiple-indicator, multiple-cause, and multigroup mean and covariance structure models were used to test for mean differences. Girls had higher latent reading ability and higher scores on a test of math computation, but the effect sizes were consistent with the gender similarities hypothesis. Conversely, girls scored higher on spelling and written expression, with effect sizes inconsistent with the gender similarities hypothesis. The findings remained the same after controlling for cognitive ability. Girls outperform boys on tasks of writing.     

Theory and Analysis of Total,Direct, and Indirect Causal Effects

Mediation analysis, or more generally models with direct and indirect effects, are commonly used in the behavioral sciences. As we show in our illustrative example, traditional methods of mediation analysis that omit confounding variables can lead to systematically biased direct and indirect effects, even in the context of a randomized experiment. Therefore, several definitions of causal effects in mediation models have been presented in the literature (Baron &; Kenny, 1986 Baron, R.M., &; Kenny, D.A. (1986). The moderator-mediator variable distinction in social psychological research: Conceptual, strategic and statistical considerations. Journal of Personality and Social Psychology, 51, 1173–1182. doi:10.1037/0022-3514.51.6.1173[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Imai, Keele, &; Tingley, 2010 Imai, K., Keele, L., &; Tingley, D. (2010). A general approach to causal mediation analysis. Psychological Methods, 15, 309–334. doi:10.1037/a0020761[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Pearl, 2012 Pearl, J. (2012). The causal mediation formula: A guide to the assessment of pathways and mechanisms. Prevention Science, 13, 426–436. doi:10.1007/s11121-011-0270-1[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). We illustrate the stochastic theory of causal effects as an alternative foundation of causal mediation analysis based on probability theory. In this theory we define total, direct, and indirect effects and show how they can be identified in the context of our illustrative example. A particular strength of the stochastic theory of causal effects are the causality conditions that imply causal unbiasedness of effect estimates. The causality conditions have empirically testable implications and can be used for covariate selection. In the discussion, we highlight some similarities and differences of the stochastic theory of causal effects with other theories of causal effects.     

Model Conditioned Data Elasticity in Path Analysis: Assessing the “Confoundability” of Model/Data Characteristics

Much research has been directed at the validity of fit indices in Path Analysis and Structural Equation Modeling (e.g., Browne, MacCallum, Kim, Andersen, &; Glaser, 2002 Browne, M.W., MacCallum, R.C., Kim, C.T., Andersen, B.L., &; Glaser, R. (2002). When fit indices and residuals are incompatible. Psychological Methods, 7, 403–421.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Heene, Hilbert, Draxler, Ziegler, &; Bühner, 2011 Heene, M., Hilbert, S., Draxler, C., Ziegler, M., &; Bühner, M. (2011). Masking misfit in confirmatory factor analysis by increasing unique variances: A cautionary note on the usefulness of cutoff values of fit indices. Psychological Methods, 16(3), 319–336.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Hu &; Bentler, 1999 Hu, L., &; Bentler, P. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, J., 6(1), 1–55.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]; Marsh, Hau, &; Wen, 2004 Marsh, H.W., Hau, K.T., &; Wen, Z. (2004). In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler’s (1999) findings. Structural Equation Modeling, 11(3), 320–341.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]). Recent developments (e.g., Preacher, 2006 Preacher, K.J. (2006). Quantifying parsimony in structural equation modeling. Multivariate Behavioral Research, 41(3), 227–259.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]; Roberts &; Pashler, 2000 Roberts, S., &; Pashler, H. (2000). How persuasive is a good fit? A comment on theory testing. Psychological Review, 107(2), 358–367.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar], 2002 Roberts, S., &; Pashler, H. (2002). Reply to Rodgers and Rowe (2002). Psychological Review, 109(3), 605–607.[Crossref] , [Google Scholar]) have encouraged researchers to investigate other criteria for comparing models, including model complexity. What has not been investigated is the inherent ability of a particular data set to be fitted with a constrained set of randomly generated linear models, which we call Model Conditioned Data Elasticity (DE). In this article we show how DE can be compared with the problem of equivalent models and a more general problem of the “confoundability” of data/model combinations (see MacCallum, Wegener, Uchino, &; Fabrigar, 1993 MacCallum, R.C., Wegener, D.T., Uchino, B.N., &; Fabrigar, L.R. (1993). The problem of equivalent models in applications of covariance structure analysis. Psychological Bulletin, 114(1), 185–199.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). Using the DE package in R, we show how DE can be assessed through automated computer searches. Finally, we discuss how DE fits within the controversy surrounding the use of fit statistics.     

Motive Arousal Without Pictures? An Experimental Validation of a Hybrid Implicit Motive Test

Pictures are widely used as stimuli in implicit motive tests. Hybrid forms of such tests present pictures and declarative statements underneath pictures. Some authors have argued that explicitly declaring agreement with motive-related statements presented underneath pictures might shift the validity of such tests from capturing less implicit motives to more explicit motives. If that is the case, pictures as elicitors of implicit motives might become less relevant. Adopting the views on validity presented by Borsboom, Mellenbergh, and van Heerden (2004 Borsboom, D., Mellenbergh, G. J., &; van Heerden, J. (2004). The concept of validity. Psychological Review, 111, 1061–1071. doi:10.1037/0033-295X.111.4.1061[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) and Bornstein (2011 Bornstein, R. F. (2011). Toward a process-focused model of test score validity: Improving psychological assessment in science and practice. Psychological Assessment, 23, 532–544. doi:10.1037/a0022402[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]), as well as item generation theory, we investigated whether the availability of pictures in hybrid motive tests causally affects test scores. To this end, we administered the Multi-Motive Grid (MMG; Sokolowski, Schmalt, Langens, &; Puca, 2000 Sokolowski, K., Schmalt, H.-D., Langens, T. A., &; Puca, R. M. (2000). Assessing achievement, affiliation, and power motives all at once: The Multi-Motive-Grid (MMG). Journal of Personality Assessment, 74, 126–145. doi:10.1207/S15327752JPA740109[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]), as an example of a hybrid motive test, either with or without pictures to 108 participants. Results revealed that the availability of pictures had no effect on 3 out of 6 test scores. Furthermore, eliminating pictures had only inconsistent effects on correlations with a test of explicit motives. We conclude that pictures might not unanimously elicit motives in implicit motive tests that use declarative statements as response options.     

Considering too few alternatives: The mental model theory of extensional reasoning

When solving a simple probabilistic problem, people tend to build an incomplete mental representation. We observe this pattern in responses to probabilistic problems over a set of premises using the conjunction, disjunction, and conditional propositional connectives. The mental model theory of extensional reasoning explains this bias towards underestimating the number of possibilities: In reckoning with different interpretations of the premises (logical rules, mental model theoretical, and, specific to conditional premises, conjunction and biconditional interpretation) the mental model theory accounts for the majority of observations. Different interpretations of a premise result in a build-up of mental models that are often incomplete. These mental models are processed using either an extensional strategy relying on proportions amongst models, or a conflict monitoring strategy. The consequence of considering too few possibilities is an erroneous probability estimate akin to that faced by decision makers who fail to generate and consider all alternatives, a characteristic of bounded rationality. We compare our results to the results published by Johnson-Laird, Legrenzi, Girotto, Legrenzi, and Caverni [Johnson-Laird, P., Legrenzi, P., Girotto, V., Legrenzi, M., &; Caverni, J. (1999 Johnson-Laird, P., Legrenzi, P., Girotto, V., Legrenzi, M., &; Caverni, J. (1999). Naive probability: A mental model theory of extensional reasoning. Psychological Review, 106, 62–88. doi:10.1037/0033-295X.106.1.62[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). Naive probability: A mental model theory of extensional reasoning. Psychological Review, 106 Johnson-Laird, P., Legrenzi, P., Girotto, V., Legrenzi, M., &; Caverni, J. (1999). Naive probability: A mental model theory of extensional reasoning. Psychological Review, 106, 62–88. doi:10.1037/0033-295X.106.1.62[Crossref], [PubMed], [Web of Science ®] , [Google Scholar], 62 Johnson-Laird, P., Legrenzi, P., Girotto, V., Legrenzi, M., &; Caverni, J. (1999). Naive probability: A mental model theory of extensional reasoning. Psychological Review, 106, 62–88. doi:10.1037/0033-295X.106.1.62[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]–88 Johnson-Laird, P., Legrenzi, P., Girotto, V., Legrenzi, M., &; Caverni, J. (1999). Naive probability: A mental model theory of extensional reasoning. Psychological Review, 106, 62–88. doi:10.1037/0033-295X.106.1.62[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]. doi:10 Johnson-Laird, P., Legrenzi, P., Girotto, V., Legrenzi, M., &; Caverni, J. (1999). Naive probability: A mental model theory of extensional reasoning. Psychological Review, 106, 62–88. doi:10.1037/0033-295X.106.1.62[Crossref], [PubMed], [Web of Science ®] , [Google Scholar].1037 Johnson-Laird, P., Legrenzi, P., Girotto, V., Legrenzi, M., &; Caverni, J. (1999). Naive probability: A mental model theory of extensional reasoning. Psychological Review, 106, 62–88. doi:10.1037/0033-295X.106.1.62[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]/0033 Johnson-Laird, P., Legrenzi, P., Girotto, V., Legrenzi, M., &; Caverni, J. (1999). Naive probability: A mental model theory of extensional reasoning. Psychological Review, 106, 62–88. doi:10.1037/0033-295X.106.1.62[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]-295X Johnson-Laird, P., Legrenzi, P., Girotto, V., Legrenzi, M., &; Caverni, J. (1999). Naive probability: A mental model theory of extensional reasoning. Psychological Review, 106, 62–88. doi:10.1037/0033-295X.106.1.62[Crossref], [PubMed], [Web of Science ®] , [Google Scholar].106 Johnson-Laird, P., Legrenzi, P., Girotto, V., Legrenzi, M., &; Caverni, J. (1999). Naive probability: A mental model theory of extensional reasoning. Psychological Review, 106, 62–88. doi:10.1037/0033-295X.106.1.62[Crossref], [PubMed], [Web of Science ®] , [Google Scholar].1 Johnson-Laird, P., Legrenzi, P., Girotto, V., Legrenzi, M., &; Caverni, J. (1999). Naive probability: A mental model theory of extensional reasoning. Psychological Review, 106, 62–88. doi:10.1037/0033-295X.106.1.62[Crossref], [PubMed], [Web of Science ®] , [Google Scholar].62 Johnson-Laird, P., Legrenzi, P., Girotto, V., Legrenzi, M., &; Caverni, J. (1999). Naive probability: A mental model theory of extensional reasoning. Psychological Review, 106, 62–88. doi:10.1037/0033-295X.106.1.62[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]], and we observe lower performance levels than those in the original article.     

Grit Happens: Moderating Effects on Motivational Feedback and Sport Performance

Research on motivational climates within athletics has focused on mastery and ego achievement approaches, yielding different psychological consequences (Smith, Smoll, &; Cumming, 2007 Smith, R. E., Smoll, F. L., &; Cumming, S. P. (2007). Effects of a motivational climate intervention for coaches on young athletes' sport performance anxiety. Journal of Sport &; Exercise Psychology, 29, 39–59.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]). Further, the motivational climate may interact with athletes' trait characteristics, such as grit, resulting in different outcomes. Grit may alter athletes' experience of the motivational climate by helping them remain oriented to their long-term quest in sport (Duckworth, Peterson, Matthews, &; Kelly, 2007 Duckworth, A. L., Peterson, C., Matthews, M. D., &; Kelly, D. R. (2007). Grit: Perseverance and passion for long-term goals. Journal of Personality and Social Psychology, 92, 1087–1101. doi:10.1037/0022-3514.92.6.1087[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). However, to date, the impact of these motivational climates and potential moderating factors on athlete performance remains in question, as the research utilizing objective measures of athletic performance is limited (Harwood, Keegan, Smith, &; Raine, 2015 Harwood, C. G., Keegan, R. J., Smith, J. M., &; Raine, A. S. (2015). A systematic review of the intrapersonal correlates of motivational climate perceptions in sport and physical activity. Psychology of Sport and Exercise, 18, 9–25. doi:10.1016/j.psychsport.2014.11.005[Crossref], [Web of Science ®] , [Google Scholar]). We used a motivational research paradigm (e.g., Mueller &; Dweck, 1998 Mueller, C. M., &; Dweck, C. S. (1998). Praise for intelligence can undermine children's motivation and performance. Journal of Personality and Social Psychology, 75, 33–52. doi:10.1037//0022-3514.75.1.33[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) to examine the effects of mastery- or ego-involving feedback on 71 high school adolescent soccer players' (M_age = 15.81) performance on a kicking task. Then we explored the potential moderating effects of grit on the relationship between motivational feedback and the athletes' performance, desire to persist, and choice of task difficulty on a soccer task. Athletes performed significantly better receiving mastery- as opposed to ego-involving feedback. Further, grit was a significant moderator of the feedback-shooting performance relationship, accounting for 3.9% of variance. Simple slopes analysis revealed a significant effect for low (B = 13.32, SE_b = 4.44, p =.004, t = 2.99), but not high (B = 2.11, SE_b = 4.31, p =.63, t = 0.49), grit on task performance. These results suggest that the feedback athletes receive matters, especially for those low in grit.     

A New Model for Acquiescence at the Interface of Psychometrics and Cognitive Psychology

ABSTRACT

When measuring psychological traits, one has to consider that respondents often show content-unrelated response behavior in answering questionnaires. To disentangle the target trait and two such response styles, extreme responding and midpoint responding, Böckenholt (2012a Böckenholt, U. (2012a). Modeling multiple response processes in judgment and choice. Psychological Methods, 17, 665–678. doi:10.1037/a0028111[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) developed an item response model based on a latent processing tree structure. We propose a theoretically motivated extension of this model to also measure acquiescence, the tendency to agree with both regular and reversed items. Substantively, our approach builds on multinomial processing tree (MPT) models that are used in cognitive psychology to disentangle qualitatively distinct processes. Accordingly, the new model for response styles assumes a mixture distribution of affirmative responses, which are either determined by the underlying target trait or by acquiescence. In order to estimate the model parameters, we rely on Bayesian hierarchical estimation of MPT models. In simulations, we show that the model provides unbiased estimates of response styles and the target trait, and we compare the new model and Böckenholt’s model in a recovery study. An empirical example from personality psychology is used for illustrative purposes.     

Using the TAT to Assess the Relation Between Gender Identity and the Use of Defense Mechanisms

The purpose of this study is to explore whether 2 different dimensions of personality, when assessed at an implicit level with the Thematic Apperception Test (TAT; Murray, 1943 Murray, H. A. (1943). Thematic Apperception Test manual. Cambridge, MA: Harvard University Press. [Google Scholar]) will show a theoretically meaningful coherence not demonstrated when 1 is assessed at an implicit level and the other at an explicit level. Gender identity and defense mechanisms were assessed implicitly using the TAT. Gender identity was compared with a self-report measure of gender-related attributes assessed at the explicit level. The results showed a theoretically meaningful coherence when different dispositions were assessed at the same level, but a lack of agreement when similar dispositions were assessed at different levels. The study is based on a secondary analysis of data from 2 previously published papers (Cramer, 1998 Cramer, P. (1998). Threat to gender representation: Identity and identification. Journal of Personality, 66, 335–354.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Cramer &; Westergren, 1999 Cramer, P., &; Hogan, K. (1975). Sex differences in verbal and play fantasy. Developmental Psychology, 11, 145–154.[Crossref], [Web of Science ®] , [Google Scholar]).     

Bayes Factors Have Frequency Properties—This Should Not Be Ignored: A Rejoinder to Morey,Wagenmakers, and Rouder

Hoijtink, van Kooten, and Hulsker (2016 Hoijtink, H., van Kooten, P., &; Hulsker, K. (2016). Why Bayesian psychologists should change the way they used the Bayes factor. Multivariate Behavioral Research, 51, 1--9. doi: 10.1080/00273171.2014.969364.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) outline a research agenda for Bayesian psychologists: evaluate and use the frequency properties of Bayes factors. Morey, Wagenmakers, and Rouder (2016 Morey, R. D., Wagenmakers, E. -J., &; Rouder, J. N. (2016). Calibrated Bayes factors should not be used: A reply to Hoijtink, van Kooten, and Hulsker. Multivariate Behavioral Research, 51, 10--17. doi: 10.1080/00273171.2015.1052710.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) respond that Bayes factors calibrated using frequency properties should not be used. This paper contains the response of Hoijtink, van Kooten, and Hulsker to the criticism of Morey, Wagenmakers, and Rouder (2016 Morey, R. D., Wagenmakers, E. -J., &; Rouder, J. N. (2016). Calibrated Bayes factors should not be used: A reply to Hoijtink, van Kooten, and Hulsker. Multivariate Behavioral Research, 51, 10--17. doi: 10.1080/00273171.2015.1052710.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]).     

Calibrated Bayes Factors Should Not Be Used: A Reply to Hoijtink,van Kooten,and Hulsker

Hoijtink, Kooten, and Hulsker (2016 Hoijtink, H., van Kooten, P., &; Hulsker, K. (2016). Why Bayesian psychologists should change the way they use the Bayes factor. Multivariate Behavioral Research, 51, 1--9. doi: 10.1080/00273171.2014.969364.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) present a method for choosing the prior distribution for an analysis with Bayes factor that is based on controlling error rates, which they advocate as an alternative to our more subjective methods (Morey &; Rouder, 2014 Morey, R.D., &; Rouder, J.N. (2014). Bayesfactor: Computation of Bayes factors for common designs. R package version 0.9.9. Retrieved from http://CRAN.R-project.org/package=BayesFactor [Google Scholar]; Rouder, Speckman, Sun, Morey, &; Iverson, 2009 Rouder, J.N., Speckman, P.L., Sun, D., Morey, R.D., &; Iverson, G. (2009). Bayesian t-tests for accepting and rejecting the null hypothesis. Psychonomic Bulletin and Review, 16, 225–237. doi: 10.3758/PBR.16.2.225[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Wagenmakers, Wetzels, Borsboom, &; van der Maas, 2011 Wagenmakers, E.-J., Wetzels, R., Borsboom, D., &; van der Maas, H. (2011). Why psychologists must change the way they analyze their data: The case of psi. A comment on Bem (2011). Journal of Personality and Social Psychology, 100, 426–432. doi: 10.1037/a0022790[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). We show that the method they advocate amounts to a simple significance test, and that the resulting Bayes factors are not interpretable. Additionally, their method fails in common circumstances, and has the potential to yield arbitrarily high Type II error rates. After critiquing their method, we outline the position on subjectivity that underlies our advocacy of Bayes factors.     

Development of the Short Version of the Individuation Test for Emerging Adults (ITEA–S) and Its Measurement Invariance Across Slovene and U.S. Emerging Adults

In this study we developed a short version of the Individuation Test for Emerging Adults (ITEA–S) and tested its measurement invariance across Slovene and U.S. samples of emerging adults. The item reduction process resulted in retaining 21 out of 36 items. The content analysis of the retained and discarded items revealed that the ITEA–S adequately measures the 5 individuation domains (support seeking, connectedness, intrusiveness, self-reliance, and fear of disappointing the parent). In our samples, the ITEA–S demonstrated evidence for construct validity and its 5 scales showed adequate internal consistency. The scale scores were also meaningfully associated with the relevant demographic variables in both countries, as well as the three scales of the Psychological Separation Inventory (Hoffman, 1984 Hoffman, J. A. (1984). Psychological separation of late adolescents from their parents. Journal of Counseling Psychology, 31, 170–178.[Crossref], [Web of Science ®] , [Google Scholar]; the Slovene sample), and the scales of the Differentiation of Self–Revised questionnaire (Skowron &; Schmitt, 2003 Skowron, E. A., &; Schmitt, T. A. (2003). Assessing interpersonal fusion: Reliability and validity of a new DSI Fusion with Others subscale. Journal of Marital and Family Therapy, 29, 209–222.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; the U.S. sample). The results of multiple group confirmatory factor analyses supported the hypothesis of full metric and partial scalar invariance for both ITEA–S forms (in relation to mother and father) across the 2 country groups.     

A Polytomous Model of Cognitive Diagnostic Assessment for Graded Data

Pursuing the line of the difference models in IRT (Thissen &; Steinberg, 1986 Thissen, D., &; Steinberg, L. (1986). A taxonomy of item response models. Psychometrika, 51:567–577. doi:10.1007/BF02295596.[Crossref], [Web of Science ®] , [Google Scholar]), this article proposed a new cognitive diagnostic model for graded/polytomous data based on the deterministic input, noisy, and gate (Haertel, 1989 Haertel, E. H. (1989). Using restricted latent class models to map the skill structure of achievement items. Journal of Educational Measurement, 26, 333–352. doi:10.1111/j.1745-3984.1989.tb00336.x.[Crossref], [Web of Science ®] , [Google Scholar]; Junker &; Sijtsma, 2001 Junker, B. W., &; Sijtsma, K. (2001). Cognitive assessment models with few assumptions, and connections with nonparametric item response theory. Applied Psychological Measurement, 25, 258–272. doi:10.1177/01466210122032064.[Crossref], [Web of Science ®] , [Google Scholar]), which is named the DINA model for graded data (DINA-GD). We investigated the performance of a full Bayesian estimation of the proposed model. In the simulation, the classification accuracy and item recovery for the DINA-GD model were investigated. The results indicated that the proposed model had acceptable examinees' correct attribute classification rate and item parameter recovery. In addition, a real-data example was used to illustrate the application of this new model with the graded data or polytomously scored items.     

Examining Current Conceptualizations of Psychopathology With the MMPI–2/MMPI–2–RF Restructured Clinical Scales: Preliminary Findings From a Cross-Cultural Study

Watson (2005 Watson, D. (2005). Rethinking the mood and anxiety disorders: A quantitative hierarchical model for DSM–V. Journal of Abnormal Psychology, 114, 522–536.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) proposed a hierarchical reorganization of the underlying structure of emotional disorders. This study cross-culturally evaluated Watson's (2005) structure of mood and anxiety disorders, using mainly dichotomous criteria, and explored the placement of obsessive–compulsive disorder (OCD) in this model. It also tested Sellbom, Ben-Porath, and Bagby's (2008) proposed elaboration of the 2-factor model (positive and negative activation) that incorporates a higher order dimension of demoralization. One hundred men and 133 women from psychiatric settings in Israel completed the Minnesota Multiphasic Personality Inventory–2 (Butcher et al., 2001 Butcher, J. N., Graham, J. R., Ben-Porath, Y. S., Tellegen, A., Dahlstrom, W. G., &; Kaemmer, B. (2001). Minnesota Multiphasic Personality Inventory–2 (MMPI–2): Manual for administration, scoring and interpretation (Rev. ed.). Minneapolis: University of Minnesota Press.[Crossref] , [Google Scholar]) and the Maudsley Obsessional–Compulsive Inventory (Hodgson &; Rachman, 1977 Hodgson, R. J., &; Rachman, S. (1977). Obsessive–compulsive complaints. Behaviour Research and Therapy, 15, 389–395.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). They were interviewed using the Mini International Neuropsychiatric Interview (Sheehan et al., 1998 Sheehan, D. V., Lecrubier, Y., Sheehan, K. H., Amorim, P., Janavs, J., &; Weiller, E. (1998). The Mini-International Neuropsychiatric Interview (M.I.N.I.): The development and validation of a structured diagnostic psychiatric interview for DSM–IV and ICD–10. Journal of Clinical Psychiatry, 59, 22–33.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). Confirmatory factor analyses replicated Watson's structure for women but not for men. Mixed results were obtained regarding OCD's location in the model. Findings among women support the applicability of Watson's (2005) model across a variety of assessment modalities, as well as in a different language and for diversified cultural backgrounds. This conclusion, however, should be tempered in consideration of the results among men. Findings also provide evidence of the importance of demoralization in mood and anxiety disorders.     

Processing of musical structure by high-functioning adolescents with autism spectrum disorders

Enhanced pitch perception and memory have been cited as evidence of a local processing bias in autism spectrum disorders (ASD). This bias is argued to account for enhanced perceptual functioning (Mottron &; Burack, 2001 Mottron, L. and Burack, J. A. 2001. “Enhanced perceptual functioning in the development of autism”. In The development of autism: Perspectives from theory to research, Edited by: Burack, J. A., Charman, T., Yirmiya, N. and Zelazo, P. R. 131–147. Mahwah, NJ: Lawrence Erlbaum.  [Google Scholar]; Mottron, Dawson, Soulières, Hubert, &; Burack, 2006 Mottron, L., Dawson, M., Soulières, I., Hubert, B. and Burack, J. 2006. Enhanced perceptual functioning in autism: An update, and eight principles of autistic perception. Journal of Autism and Developmental Disorders, 36(1): 27–43. doi:10.1007/s10803-005-0040-7[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) and central coherence theories of ASD (Frith, 1989 Frith, U. 1989. Autism: Explaining the enigma, Oxford: United Kingdom: Blackwell.  [Google Scholar]; Happé &; Frith, 2006 Happé, F. and Frith, U. 2006. The weak coherence account: Detail-focused cognitive style in autism spectrum disorders. Journal of Autism and Developmental Disorders, 36(1): 5–25. doi:10.1007/s10803-005-0039-0[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). A local processing bias confers a different cognitive style to individuals with ASD (Happé, 1999 Happé, F. 1999. Autism: Cognitive deficit or cognitive style?. Trends in Cognitive Sciences, 3(6): 216–222. doi:10.1016/S1364-6613(99)01318-2[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]), which accounts in part for their good visuospatial and visuoconstructive skills. Here, we present analogues in the auditory domain, audiotemporal or audioconstructive processing, which we assess using a novel experimental task: a musical puzzle. This task evaluates the ability of individuals with ASD to process temporal sequences of musical events as well as various elements of musical structure and thus indexes their ability to employ a global processing style. Musical structures created and replicated by children and adolescents with ASD (10–19 years old) and typically developing children and adolescents (7–17 years old) were found to be similar in global coherence. Presenting a musical template for reference increased accuracy equally for both groups, with performance associated to performance IQ and short-term auditory memory. The overall pattern of performance was similar for both groups; some puzzles were easier than others and this was the case for both groups. Task performance was further found to be correlated with the ability to perceive musical emotions, more so for typically developing participants. Findings are discussed in light of the empathizing-systemizing theory of ASD (Baron-Cohen, 2009 Baron-Cohen, S. 2009. Autism: The Empathizing-Systemizing (E-S) Theory. Annals of the New York Academy of Sciences, 1156: 68–80. doi:10.1111/j.1749-6632.2009.04467.x[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) and the importance of describing the strengths of individuals with ASD (Happé, 1999 Happé, F. 1999. Autism: Cognitive deficit or cognitive style?. Trends in Cognitive Sciences, 3(6): 216–222. doi:10.1016/S1364-6613(99)01318-2[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Heaton, 2009 Heaton, P. 2009. Assessing musical skills in autistic children who are not savants. Philosophical Transactions of the Royal Society Biological Sciences, 364: 1443–1447. doi:10.1098/rstb.2008.0327[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]).     

The Structure of Multidimensional Perfectionism: Support for a Bifactor Model With a Dominant General Factor

Evidence suggests perfectionism is a multidimensional construct composed of 2 higher order factors: perfectionistic strivings and perfectionistic concerns. However, the substantial overlap between perfectionistic strivings and perfectionistic concerns is problematic, as are the unanswered questions regarding the structure of perfectionism following removal of common variance. This research addressed this through bifactor modeling. Three student samples (N = 742) completed Hewitt and Flett's (1991 Hewitt, P. L., &; Flett, G. L. (1991). Perfectionism in the self and social contexts: Conceptualization, assessment, and association with psychopathology. Journal of Personality and Social Psychology, 60, 456.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) Multidimensional Perfectionism Scale, Frost, Marten, Lahart, and Rosenblate's (1990 Frost, R. O., Marten, P., Lahart, C., &; Rosenblate, R. (1990). The dimensions of perfectionism. Cognitive Therapy and Research, 14, 449–468.[Crossref], [Web of Science ®] , [Google Scholar]) Multidimensional Perfectionism Scale, and Slaney, Rice, Mobley, Trippi, and Ashby's (2001 Slaney, R. B., Rice, K. G., Mobley, M., Trippi, J., &; Ashby, J. S. (2001). The revised almost perfect scale. Measurement and Evaluation in Counseling and Development, 34, 130–145.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) Almost Perfect Scale–Revised. Greater support was consistently found for the bifactor model, relative to the 2-factor model. Results suggest the bifactor model best represents the structure of perfectionism and provide preliminary support for the use of a general factor score. Researchers are cautioned that removal of general variance may render the reliability of specific factors (i.e., perfectionistic strivings and perfectionistic concerns) suspect.     

Addressing Item-Level Missing Data: A Comparison of Proration and Full Information Maximum Likelihood Estimation

Often when participants have missing scores on one or more of the items comprising a scale, researchers compute prorated scale scores by averaging the available items. Methodologists have cautioned that proration may make strict assumptions about the mean and covariance structures of the items comprising the scale (Schafer &; Graham, 2002 Schafer, J.L., &; Graham, J.W. (2002). Missing data: Our view of the state of the art. Psychological Methods, 7, 147–177.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Graham, 2009 Graham, J.W. (2009). Missing data analysis: Making it work in the real world. Annual Review of Psychology, 60, 549–576.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Enders, 2010 Enders, C.K. (2010). Applied missing data analysis. New York, NY: Guilford Press. [Google Scholar]). We investigated proration empirically and found that it resulted in bias even under a missing completely at random (MCAR) mechanism. To encourage researchers to forgo proration, we describe a full information maximum likelihood (FIML) approach to item-level missing data handling that mitigates the loss in power due to missing scale scores and utilizes the available item-level data without altering the substantive analysis. Specifically, we propose treating the scale score as missing whenever one or more of the items are missing and incorporating items as auxiliary variables. Our simulations suggest that item-level missing data handling drastically increases power relative to scale-level missing data handling. These results have important practical implications, especially when recruiting more participants is prohibitively difficult or expensive. Finally, we illustrate the proposed method with data from an online chronic pain management program.     

The Abbreviated Character Strengths Test (ACST): A Preliminary Assessment of Test Validity

The 24-item Abbreviated Character Strengths Test (ACST) was developed to efficiently measure character strengths (Peterson, Park, &; Castro, 2011 Peterson, C., Park, N., &; Castro, C. A. (2011). Assessment for the US Army Comprehensive Soldier Fitness program: The Global Assessment Tool. American Psychologist, 66, 10–18.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). However, its validity for this purpose has not yet been sufficiently established. Using confirmatory factor analysis to test a series of structural models, only a modified bifactor model showed reasonably acceptable fit. Further analyses of this model failed to demonstrate measurement invariance between male and female respondents. Relationships between ACST dimension and Big Five personality trait scores were generally weak-to-moderate, and support for hypotheses regarding each ACST virtue's expected correspondence with specific Big Five dimensions was mixed. Finally, scores on ACST dimensions accounted for a combined 12% of the variance in satisfaction with life scores, after controlling for socially desirability. Although an abbreviated measure of character strengths represents a practical need, considerable improvements to the ACST are needed for it to adequately meet this purpose.     

Patient Personality and Relational Patterns in Psychotherapy: Factor Structure,Reliability, and Validity of the Psychotherapy Relationship Questionnaire

The aim of this study was to examine the factor structure and the psychometric properties of the Psychotherapy Relationship Questionnaire (PRQ; Bradley, Heim, &; Westen, 2005 Bradley, R., Heim, A. K., &; Westen, D. (2005). Transference patterns in the psychotherapy of personality disorders: Empirical investigation. The British Journal of Psychiatry, 186, 342–349. doi:10.1192/bjp.186.4.342[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]), a clinician report instrument that measures a wide spectrum of thoughts, feelings, motives, conflicts, and behaviors expressed by patients toward their therapists in psychotherapy. A national sample of psychiatrists and clinical psychologists (N = 314) of different theoretical orientations completed the PRQ, as well as the Shedler–Westen Assessment Procedure–200 (SWAP–200; Westen &; Shedler, 1999a Westen, D., &; Shedler, J. (1999a). Revising and assessing Axis II, Part I: Developing a clinically and empirically valid assessment method. The American Journal of Psychiatry, 156, 258–272.[PubMed], [Web of Science ®] , [Google Scholar], 1999b Westen, D., &; Shedler, J. (1999a). Revising and assessing Axis II, Part I: Developing a clinically and empirically valid assessment method. The American Journal of Psychiatry, 156, 258–272.[PubMed], [Web of Science ®] , [Google Scholar]) to assess the personality of a patient in their care. Factor-analytic procedures identified 6 transference dimensions that showed excellent internal consistencies: (a) hostile, (b) positive/working alliance, (c) special/entitled, (d) anxious/preoccupied, (e) avoidant/dismissing attachment, and (f) sexualized. Factor scores were significantly related to patients’ personality characteristics and psychological functioning, regardless of the clinicians’ orientations. The findings support that the PRQ is a valid and reliable tool for evaluating the patients’ relational patterns emerging in clinical practice in a clinically coherent and psychometrically robust way. Clinicians’ careful understanding of these patterns can be very useful for making accurate diagnostic formulations, as well as for providing a roadmap for effective therapeutic intervention.     

Matching Methods for Selection of Participants for Follow-Up

This work examines ways to make the best use of limited resources when selecting individuals to follow up in a longitudinal study estimating causal effects. In the setting under consideration, covariate information is available for all individuals but outcomes have not yet been collected and may be expensive to gather, and thus only a subset of the comparison participants are followed. Expressions in Rubin and Thomas (1996) Rubin, D. B. and Thomas, N. 1996. Matching using estimated propensity scores, relating theory to practice.. Biometrics, 52: 249–264. [Crossref], [PubMed], [Web of Science ®] , [Google Scholar] show the benefits that can be obtained, in terms of reduced bias and variance of the estimated treatment effect, of selecting comparison individuals well matched to those in the treated group compared with a random sample of comparison individuals. We primarily consider nonexperimental settings but also consider implications for randomized trials. The methods are illustrated using data from the Johns Hopkins University Baltimore Prevention Program, which included data collection from age 6 to young adulthood of participants in an evaluation of 2 early elementary-school-based universal prevention programs.