Model Conditioned Data Elasticity in Path Analysis: Assessing the “Confoundability” of Model/Data Characteristics

Much research has been directed at the validity of fit indices in Path Analysis and Structural Equation Modeling (e.g., Browne, MacCallum, Kim, Andersen, &; Glaser, 2002 Browne, M.W., MacCallum, R.C., Kim, C.T., Andersen, B.L., &; Glaser, R. (2002). When fit indices and residuals are incompatible. Psychological Methods, 7, 403–421.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Heene, Hilbert, Draxler, Ziegler, &; Bühner, 2011 Heene, M., Hilbert, S., Draxler, C., Ziegler, M., &; Bühner, M. (2011). Masking misfit in confirmatory factor analysis by increasing unique variances: A cautionary note on the usefulness of cutoff values of fit indices. Psychological Methods, 16(3), 319–336.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Hu &; Bentler, 1999 Hu, L., &; Bentler, P. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, J., 6(1), 1–55.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]; Marsh, Hau, &; Wen, 2004 Marsh, H.W., Hau, K.T., &; Wen, Z. (2004). In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler’s (1999) findings. Structural Equation Modeling, 11(3), 320–341.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]). Recent developments (e.g., Preacher, 2006 Preacher, K.J. (2006). Quantifying parsimony in structural equation modeling. Multivariate Behavioral Research, 41(3), 227–259.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]; Roberts &; Pashler, 2000 Roberts, S., &; Pashler, H. (2000). How persuasive is a good fit? A comment on theory testing. Psychological Review, 107(2), 358–367.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar], 2002 Roberts, S., &; Pashler, H. (2002). Reply to Rodgers and Rowe (2002). Psychological Review, 109(3), 605–607.[Crossref] , [Google Scholar]) have encouraged researchers to investigate other criteria for comparing models, including model complexity. What has not been investigated is the inherent ability of a particular data set to be fitted with a constrained set of randomly generated linear models, which we call Model Conditioned Data Elasticity (DE). In this article we show how DE can be compared with the problem of equivalent models and a more general problem of the “confoundability” of data/model combinations (see MacCallum, Wegener, Uchino, &; Fabrigar, 1993 MacCallum, R.C., Wegener, D.T., Uchino, B.N., &; Fabrigar, L.R. (1993). The problem of equivalent models in applications of covariance structure analysis. Psychological Bulletin, 114(1), 185–199.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). Using the DE package in R, we show how DE can be assessed through automated computer searches. Finally, we discuss how DE fits within the controversy surrounding the use of fit statistics.     

Theory and Analysis of Total,Direct, and Indirect Causal Effects

Mediation analysis, or more generally models with direct and indirect effects, are commonly used in the behavioral sciences. As we show in our illustrative example, traditional methods of mediation analysis that omit confounding variables can lead to systematically biased direct and indirect effects, even in the context of a randomized experiment. Therefore, several definitions of causal effects in mediation models have been presented in the literature (Baron &; Kenny, 1986 Baron, R.M., &; Kenny, D.A. (1986). The moderator-mediator variable distinction in social psychological research: Conceptual, strategic and statistical considerations. Journal of Personality and Social Psychology, 51, 1173–1182. doi:10.1037/0022-3514.51.6.1173[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Imai, Keele, &; Tingley, 2010 Imai, K., Keele, L., &; Tingley, D. (2010). A general approach to causal mediation analysis. Psychological Methods, 15, 309–334. doi:10.1037/a0020761[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Pearl, 2012 Pearl, J. (2012). The causal mediation formula: A guide to the assessment of pathways and mechanisms. Prevention Science, 13, 426–436. doi:10.1007/s11121-011-0270-1[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). We illustrate the stochastic theory of causal effects as an alternative foundation of causal mediation analysis based on probability theory. In this theory we define total, direct, and indirect effects and show how they can be identified in the context of our illustrative example. A particular strength of the stochastic theory of causal effects are the causality conditions that imply causal unbiasedness of effect estimates. The causality conditions have empirically testable implications and can be used for covariate selection. In the discussion, we highlight some similarities and differences of the stochastic theory of causal effects with other theories of causal effects.     

Examining Current Conceptualizations of Psychopathology With the MMPI–2/MMPI–2–RF Restructured Clinical Scales: Preliminary Findings From a Cross-Cultural Study

Watson (2005 Watson, D. (2005). Rethinking the mood and anxiety disorders: A quantitative hierarchical model for DSM–V. Journal of Abnormal Psychology, 114, 522–536.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) proposed a hierarchical reorganization of the underlying structure of emotional disorders. This study cross-culturally evaluated Watson's (2005) structure of mood and anxiety disorders, using mainly dichotomous criteria, and explored the placement of obsessive–compulsive disorder (OCD) in this model. It also tested Sellbom, Ben-Porath, and Bagby's (2008) proposed elaboration of the 2-factor model (positive and negative activation) that incorporates a higher order dimension of demoralization. One hundred men and 133 women from psychiatric settings in Israel completed the Minnesota Multiphasic Personality Inventory–2 (Butcher et al., 2001 Butcher, J. N., Graham, J. R., Ben-Porath, Y. S., Tellegen, A., Dahlstrom, W. G., &; Kaemmer, B. (2001). Minnesota Multiphasic Personality Inventory–2 (MMPI–2): Manual for administration, scoring and interpretation (Rev. ed.). Minneapolis: University of Minnesota Press.[Crossref] , [Google Scholar]) and the Maudsley Obsessional–Compulsive Inventory (Hodgson &; Rachman, 1977 Hodgson, R. J., &; Rachman, S. (1977). Obsessive–compulsive complaints. Behaviour Research and Therapy, 15, 389–395.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). They were interviewed using the Mini International Neuropsychiatric Interview (Sheehan et al., 1998 Sheehan, D. V., Lecrubier, Y., Sheehan, K. H., Amorim, P., Janavs, J., &; Weiller, E. (1998). The Mini-International Neuropsychiatric Interview (M.I.N.I.): The development and validation of a structured diagnostic psychiatric interview for DSM–IV and ICD–10. Journal of Clinical Psychiatry, 59, 22–33.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). Confirmatory factor analyses replicated Watson's structure for women but not for men. Mixed results were obtained regarding OCD's location in the model. Findings among women support the applicability of Watson's (2005) model across a variety of assessment modalities, as well as in a different language and for diversified cultural backgrounds. This conclusion, however, should be tempered in consideration of the results among men. Findings also provide evidence of the importance of demoralization in mood and anxiety disorders.     

The Structure of Multidimensional Perfectionism: Support for a Bifactor Model With a Dominant General Factor

Evidence suggests perfectionism is a multidimensional construct composed of 2 higher order factors: perfectionistic strivings and perfectionistic concerns. However, the substantial overlap between perfectionistic strivings and perfectionistic concerns is problematic, as are the unanswered questions regarding the structure of perfectionism following removal of common variance. This research addressed this through bifactor modeling. Three student samples (N = 742) completed Hewitt and Flett's (1991 Hewitt, P. L., &; Flett, G. L. (1991). Perfectionism in the self and social contexts: Conceptualization, assessment, and association with psychopathology. Journal of Personality and Social Psychology, 60, 456.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) Multidimensional Perfectionism Scale, Frost, Marten, Lahart, and Rosenblate's (1990 Frost, R. O., Marten, P., Lahart, C., &; Rosenblate, R. (1990). The dimensions of perfectionism. Cognitive Therapy and Research, 14, 449–468.[Crossref], [Web of Science ®] , [Google Scholar]) Multidimensional Perfectionism Scale, and Slaney, Rice, Mobley, Trippi, and Ashby's (2001 Slaney, R. B., Rice, K. G., Mobley, M., Trippi, J., &; Ashby, J. S. (2001). The revised almost perfect scale. Measurement and Evaluation in Counseling and Development, 34, 130–145.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) Almost Perfect Scale–Revised. Greater support was consistently found for the bifactor model, relative to the 2-factor model. Results suggest the bifactor model best represents the structure of perfectionism and provide preliminary support for the use of a general factor score. Researchers are cautioned that removal of general variance may render the reliability of specific factors (i.e., perfectionistic strivings and perfectionistic concerns) suspect.     

Considering too few alternatives: The mental model theory of extensional reasoning

When solving a simple probabilistic problem, people tend to build an incomplete mental representation. We observe this pattern in responses to probabilistic problems over a set of premises using the conjunction, disjunction, and conditional propositional connectives. The mental model theory of extensional reasoning explains this bias towards underestimating the number of possibilities: In reckoning with different interpretations of the premises (logical rules, mental model theoretical, and, specific to conditional premises, conjunction and biconditional interpretation) the mental model theory accounts for the majority of observations. Different interpretations of a premise result in a build-up of mental models that are often incomplete. These mental models are processed using either an extensional strategy relying on proportions amongst models, or a conflict monitoring strategy. The consequence of considering too few possibilities is an erroneous probability estimate akin to that faced by decision makers who fail to generate and consider all alternatives, a characteristic of bounded rationality. We compare our results to the results published by Johnson-Laird, Legrenzi, Girotto, Legrenzi, and Caverni [Johnson-Laird, P., Legrenzi, P., Girotto, V., Legrenzi, M., &; Caverni, J. (1999 Johnson-Laird, P., Legrenzi, P., Girotto, V., Legrenzi, M., &; Caverni, J. (1999). Naive probability: A mental model theory of extensional reasoning. Psychological Review, 106, 62–88. doi:10.1037/0033-295X.106.1.62[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). Naive probability: A mental model theory of extensional reasoning. Psychological Review, 106 Johnson-Laird, P., Legrenzi, P., Girotto, V., Legrenzi, M., &; Caverni, J. (1999). Naive probability: A mental model theory of extensional reasoning. Psychological Review, 106, 62–88. doi:10.1037/0033-295X.106.1.62[Crossref], [PubMed], [Web of Science ®] , [Google Scholar], 62 Johnson-Laird, P., Legrenzi, P., Girotto, V., Legrenzi, M., &; Caverni, J. (1999). Naive probability: A mental model theory of extensional reasoning. Psychological Review, 106, 62–88. doi:10.1037/0033-295X.106.1.62[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]–88 Johnson-Laird, P., Legrenzi, P., Girotto, V., Legrenzi, M., &; Caverni, J. (1999). Naive probability: A mental model theory of extensional reasoning. Psychological Review, 106, 62–88. doi:10.1037/0033-295X.106.1.62[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]. doi:10 Johnson-Laird, P., Legrenzi, P., Girotto, V., Legrenzi, M., &; Caverni, J. (1999). Naive probability: A mental model theory of extensional reasoning. Psychological Review, 106, 62–88. doi:10.1037/0033-295X.106.1.62[Crossref], [PubMed], [Web of Science ®] , [Google Scholar].1037 Johnson-Laird, P., Legrenzi, P., Girotto, V., Legrenzi, M., &; Caverni, J. (1999). Naive probability: A mental model theory of extensional reasoning. Psychological Review, 106, 62–88. doi:10.1037/0033-295X.106.1.62[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]/0033 Johnson-Laird, P., Legrenzi, P., Girotto, V., Legrenzi, M., &; Caverni, J. (1999). Naive probability: A mental model theory of extensional reasoning. Psychological Review, 106, 62–88. doi:10.1037/0033-295X.106.1.62[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]-295X Johnson-Laird, P., Legrenzi, P., Girotto, V., Legrenzi, M., &; Caverni, J. (1999). Naive probability: A mental model theory of extensional reasoning. Psychological Review, 106, 62–88. doi:10.1037/0033-295X.106.1.62[Crossref], [PubMed], [Web of Science ®] , [Google Scholar].106 Johnson-Laird, P., Legrenzi, P., Girotto, V., Legrenzi, M., &; Caverni, J. (1999). Naive probability: A mental model theory of extensional reasoning. Psychological Review, 106, 62–88. doi:10.1037/0033-295X.106.1.62[Crossref], [PubMed], [Web of Science ®] , [Google Scholar].1 Johnson-Laird, P., Legrenzi, P., Girotto, V., Legrenzi, M., &; Caverni, J. (1999). Naive probability: A mental model theory of extensional reasoning. Psychological Review, 106, 62–88. doi:10.1037/0033-295X.106.1.62[Crossref], [PubMed], [Web of Science ®] , [Google Scholar].62 Johnson-Laird, P., Legrenzi, P., Girotto, V., Legrenzi, M., &; Caverni, J. (1999). Naive probability: A mental model theory of extensional reasoning. Psychological Review, 106, 62–88. doi:10.1037/0033-295X.106.1.62[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]], and we observe lower performance levels than those in the original article.     

Gender Differences in Academic Achievement: Is Writing an Exception to the Gender Similarities Hypothesis?

The gender similarities hypothesis by J. S. Hyde (2005 Hyde, J.S. (2005). The gender similarities hypothesis. American Psychologist, 60, 581–592.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]), based on large-scale reviews of studies, concludes that boys and girls are more alike than different on most psychological variables, including academic skills such as reading and math (J. S. Hyde, 2005 Hyde, J.S. (2005). The gender similarities hypothesis. American Psychologist, 60, 581–592.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). Writing is an academic skill that may be an exception. The authors investigated gender differences in academic achievement using a large, nationally stratified sample of children and adolescents ranging from ages 7–19 years (N = 2,027). Achievement data were from the conormed sample for the Kaufman intelligence and achievement tests. Multiple-indicator, multiple-cause, and multigroup mean and covariance structure models were used to test for mean differences. Girls had higher latent reading ability and higher scores on a test of math computation, but the effect sizes were consistent with the gender similarities hypothesis. Conversely, girls scored higher on spelling and written expression, with effect sizes inconsistent with the gender similarities hypothesis. The findings remained the same after controlling for cognitive ability. Girls outperform boys on tasks of writing.     

Using the TAT to Assess the Relation Between Gender Identity and the Use of Defense Mechanisms

The purpose of this study is to explore whether 2 different dimensions of personality, when assessed at an implicit level with the Thematic Apperception Test (TAT; Murray, 1943 Murray, H. A. (1943). Thematic Apperception Test manual. Cambridge, MA: Harvard University Press. [Google Scholar]) will show a theoretically meaningful coherence not demonstrated when 1 is assessed at an implicit level and the other at an explicit level. Gender identity and defense mechanisms were assessed implicitly using the TAT. Gender identity was compared with a self-report measure of gender-related attributes assessed at the explicit level. The results showed a theoretically meaningful coherence when different dispositions were assessed at the same level, but a lack of agreement when similar dispositions were assessed at different levels. The study is based on a secondary analysis of data from 2 previously published papers (Cramer, 1998 Cramer, P. (1998). Threat to gender representation: Identity and identification. Journal of Personality, 66, 335–354.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Cramer &; Westergren, 1999 Cramer, P., &; Hogan, K. (1975). Sex differences in verbal and play fantasy. Developmental Psychology, 11, 145–154.[Crossref], [Web of Science ®] , [Google Scholar]).     

A Polytomous Model of Cognitive Diagnostic Assessment for Graded Data

Pursuing the line of the difference models in IRT (Thissen &; Steinberg, 1986 Thissen, D., &; Steinberg, L. (1986). A taxonomy of item response models. Psychometrika, 51:567–577. doi:10.1007/BF02295596.[Crossref], [Web of Science ®] , [Google Scholar]), this article proposed a new cognitive diagnostic model for graded/polytomous data based on the deterministic input, noisy, and gate (Haertel, 1989 Haertel, E. H. (1989). Using restricted latent class models to map the skill structure of achievement items. Journal of Educational Measurement, 26, 333–352. doi:10.1111/j.1745-3984.1989.tb00336.x.[Crossref], [Web of Science ®] , [Google Scholar]; Junker &; Sijtsma, 2001 Junker, B. W., &; Sijtsma, K. (2001). Cognitive assessment models with few assumptions, and connections with nonparametric item response theory. Applied Psychological Measurement, 25, 258–272. doi:10.1177/01466210122032064.[Crossref], [Web of Science ®] , [Google Scholar]), which is named the DINA model for graded data (DINA-GD). We investigated the performance of a full Bayesian estimation of the proposed model. In the simulation, the classification accuracy and item recovery for the DINA-GD model were investigated. The results indicated that the proposed model had acceptable examinees' correct attribute classification rate and item parameter recovery. In addition, a real-data example was used to illustrate the application of this new model with the graded data or polytomously scored items.     

The Abbreviated Character Strengths Test (ACST): A Preliminary Assessment of Test Validity

The 24-item Abbreviated Character Strengths Test (ACST) was developed to efficiently measure character strengths (Peterson, Park, &; Castro, 2011 Peterson, C., Park, N., &; Castro, C. A. (2011). Assessment for the US Army Comprehensive Soldier Fitness program: The Global Assessment Tool. American Psychologist, 66, 10–18.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). However, its validity for this purpose has not yet been sufficiently established. Using confirmatory factor analysis to test a series of structural models, only a modified bifactor model showed reasonably acceptable fit. Further analyses of this model failed to demonstrate measurement invariance between male and female respondents. Relationships between ACST dimension and Big Five personality trait scores were generally weak-to-moderate, and support for hypotheses regarding each ACST virtue's expected correspondence with specific Big Five dimensions was mixed. Finally, scores on ACST dimensions accounted for a combined 12% of the variance in satisfaction with life scores, after controlling for socially desirability. Although an abbreviated measure of character strengths represents a practical need, considerable improvements to the ACST are needed for it to adequately meet this purpose.     

Bayes Factors Have Frequency Properties—This Should Not Be Ignored: A Rejoinder to Morey,Wagenmakers, and Rouder

Hoijtink, van Kooten, and Hulsker (2016 Hoijtink, H., van Kooten, P., &; Hulsker, K. (2016). Why Bayesian psychologists should change the way they used the Bayes factor. Multivariate Behavioral Research, 51, 1--9. doi: 10.1080/00273171.2014.969364.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) outline a research agenda for Bayesian psychologists: evaluate and use the frequency properties of Bayes factors. Morey, Wagenmakers, and Rouder (2016 Morey, R. D., Wagenmakers, E. -J., &; Rouder, J. N. (2016). Calibrated Bayes factors should not be used: A reply to Hoijtink, van Kooten, and Hulsker. Multivariate Behavioral Research, 51, 10--17. doi: 10.1080/00273171.2015.1052710.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) respond that Bayes factors calibrated using frequency properties should not be used. This paper contains the response of Hoijtink, van Kooten, and Hulsker to the criticism of Morey, Wagenmakers, and Rouder (2016 Morey, R. D., Wagenmakers, E. -J., &; Rouder, J. N. (2016). Calibrated Bayes factors should not be used: A reply to Hoijtink, van Kooten, and Hulsker. Multivariate Behavioral Research, 51, 10--17. doi: 10.1080/00273171.2015.1052710.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]).     

Grit Happens: Moderating Effects on Motivational Feedback and Sport Performance

Research on motivational climates within athletics has focused on mastery and ego achievement approaches, yielding different psychological consequences (Smith, Smoll, &; Cumming, 2007 Smith, R. E., Smoll, F. L., &; Cumming, S. P. (2007). Effects of a motivational climate intervention for coaches on young athletes' sport performance anxiety. Journal of Sport &; Exercise Psychology, 29, 39–59.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]). Further, the motivational climate may interact with athletes' trait characteristics, such as grit, resulting in different outcomes. Grit may alter athletes' experience of the motivational climate by helping them remain oriented to their long-term quest in sport (Duckworth, Peterson, Matthews, &; Kelly, 2007 Duckworth, A. L., Peterson, C., Matthews, M. D., &; Kelly, D. R. (2007). Grit: Perseverance and passion for long-term goals. Journal of Personality and Social Psychology, 92, 1087–1101. doi:10.1037/0022-3514.92.6.1087[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). However, to date, the impact of these motivational climates and potential moderating factors on athlete performance remains in question, as the research utilizing objective measures of athletic performance is limited (Harwood, Keegan, Smith, &; Raine, 2015 Harwood, C. G., Keegan, R. J., Smith, J. M., &; Raine, A. S. (2015). A systematic review of the intrapersonal correlates of motivational climate perceptions in sport and physical activity. Psychology of Sport and Exercise, 18, 9–25. doi:10.1016/j.psychsport.2014.11.005[Crossref], [Web of Science ®] , [Google Scholar]). We used a motivational research paradigm (e.g., Mueller &; Dweck, 1998 Mueller, C. M., &; Dweck, C. S. (1998). Praise for intelligence can undermine children's motivation and performance. Journal of Personality and Social Psychology, 75, 33–52. doi:10.1037//0022-3514.75.1.33[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) to examine the effects of mastery- or ego-involving feedback on 71 high school adolescent soccer players' (M_age = 15.81) performance on a kicking task. Then we explored the potential moderating effects of grit on the relationship between motivational feedback and the athletes' performance, desire to persist, and choice of task difficulty on a soccer task. Athletes performed significantly better receiving mastery- as opposed to ego-involving feedback. Further, grit was a significant moderator of the feedback-shooting performance relationship, accounting for 3.9% of variance. Simple slopes analysis revealed a significant effect for low (B = 13.32, SE_b = 4.44, p =.004, t = 2.99), but not high (B = 2.11, SE_b = 4.31, p =.63, t = 0.49), grit on task performance. These results suggest that the feedback athletes receive matters, especially for those low in grit.     

Valedictory

Contingentism, generally contrasted with law necessitarianism, is the view that the laws of nature are contingent. It is often coupled with the claim that their contingency is knowable a priori. This paper considers Bird's [2001 Bird, Alexander 2001. Necessarily, Salt Dissolves In Water, Analysis 61/4: 267–74.[Crossref], [Web of Science ®] , [Google Scholar], 2002 Bird, Alexander 2002. On Whether Some Laws Are Necessary, Analysis 62/3: 257–70.[Crossref], [Web of Science ®] , [Google Scholar], 2005 Bird, Alexander 2005. Unexpected A Posteriori Necessary Laws of Nature, Australasian Journal of Philosophy 83/4: 533–48.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar], 2007 Bird, Alexander 2007. Nature's Metaphysics: Laws and Properties, Oxford: Clarendon Press.[Crossref] , [Google Scholar]] arguments for the thesis that, necessarily, salt dissolves in water; and it defends his view against Beebee's [2001] and Psillos's [2002 Psillos, Stathis 2002. Salt Does Dissolve In Water, But Not Necessarily, Analysis 62/3: 255–7.[Crossref], [Web of Science ®] , [Google Scholar]] contingentist objections. A new contingentist objection is offered and several reasons for scepticism about its success are raised. It is concluded that certain higher-level laws describing the behaviours of molecular compounds may be necessary due to their dependence on underlying physical laws, and that the modal status of laws of nature cannot be determined a priori, as the structural features of the substances and properties they govern must first be investigated.     

Calibrated Bayes Factors Should Not Be Used: A Reply to Hoijtink,van Kooten,and Hulsker

Hoijtink, Kooten, and Hulsker (2016 Hoijtink, H., van Kooten, P., &; Hulsker, K. (2016). Why Bayesian psychologists should change the way they use the Bayes factor. Multivariate Behavioral Research, 51, 1--9. doi: 10.1080/00273171.2014.969364.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) present a method for choosing the prior distribution for an analysis with Bayes factor that is based on controlling error rates, which they advocate as an alternative to our more subjective methods (Morey &; Rouder, 2014 Morey, R.D., &; Rouder, J.N. (2014). Bayesfactor: Computation of Bayes factors for common designs. R package version 0.9.9. Retrieved from http://CRAN.R-project.org/package=BayesFactor [Google Scholar]; Rouder, Speckman, Sun, Morey, &; Iverson, 2009 Rouder, J.N., Speckman, P.L., Sun, D., Morey, R.D., &; Iverson, G. (2009). Bayesian t-tests for accepting and rejecting the null hypothesis. Psychonomic Bulletin and Review, 16, 225–237. doi: 10.3758/PBR.16.2.225[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Wagenmakers, Wetzels, Borsboom, &; van der Maas, 2011 Wagenmakers, E.-J., Wetzels, R., Borsboom, D., &; van der Maas, H. (2011). Why psychologists must change the way they analyze their data: The case of psi. A comment on Bem (2011). Journal of Personality and Social Psychology, 100, 426–432. doi: 10.1037/a0022790[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). We show that the method they advocate amounts to a simple significance test, and that the resulting Bayes factors are not interpretable. Additionally, their method fails in common circumstances, and has the potential to yield arbitrarily high Type II error rates. After critiquing their method, we outline the position on subjectivity that underlies our advocacy of Bayes factors.     

Development of a Response Inconsistency Scale for the Personality Inventory for DSM–5

The advent of a dimensional model of personality disorder included in DSM–5 has necessitated the development of a new measurement scheme, specifically a self-report questionnaire termed the Personality Inventory for DSM–5 (PID–5; Krueger, Derringer, Markon, Watson, &; Skodol, 2012 Krueger, R. F., Derringer, J., Markon, K. E., Watson, D., &; Skodol, A. E. (2012). Initial construction of a maladaptive personality trait model and inventory for DSM–5. Psychological Medicine, 42, 1879–1890. doi:10.1017/S0033291711002674[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). However, there are many threats to the validity of a self-report measure, including response inconsistency. This study outlines the development of an inconsistency scale for the PID–5. Across both college student and clinical samples, the inconsistency scale was able to reliably differentiate real from random responding. Random responses led to increased scores on the PID–5 facets, indicating the importance of detecting inconsistent responding prior to test interpretation. Thus, this inconsistency scale could be of use to researchers and clinicians in detecting inconsistent responses to this new personality disorder measure.     

Mind Perception and Individual Differences: A Replication and Extension

Mind perception involves attributing higher functional abilities to others (e.g., saying a dog feels pain). The relationships between mind perception and psychopathology—autism, psychopathy, and schizotypy—have been revealed by K. Gray, Jenkins, Heberlein, and Wegner (2011 Gray, K., Jenkins, A. C., Heberlein, A. S., &; Wegner, D. M. (2011). Distortions of mind perception in psychopathology. Proceedings of the National Academy of Sciences of the United States of America, 108, 477–479. doi:10.1073/pnas.1015493108[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]); however, mind perception has yet to be correlated with personality. Participants (N = 180) completed measures of personality, psychopathology, and mind perception. The psychopathology results were consistent with Gray et al. (2011 Gray, K., Jenkins, A. C., Heberlein, A. S., &; Wegner, D. M. (2011). Distortions of mind perception in psychopathology. Proceedings of the National Academy of Sciences of the United States of America, 108, 477–479. doi:10.1073/pnas.1015493108[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). The Big Five captured mind perception virtually as much as the three psychopathologies captured mind perception. Mind perception is not solely relevant to psychopathology; it is also relevant to everyday personality.     

Amplitude and Width Manipulations in Fitts' Paradigm: Comment on Heath et al. (2011) and Heath et al. (2016)

Heath, Weiler, Marriott, Elliott, and Binstead (2011 Heath, M., Weiler, J., Marriott, K. A., Elliott, D., &; Binstead, G. (2011). Revisiting Fitts and Peterson (1964): Width and Amplitude manipulations to the reaching environment elicit dissociable movement times. Canadian Journal of Experimental Psychology, 65, 259–268.1.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) and Heath, Samani, Tremblay, and Elliott (2016 Heath, M., Samani, A., Tremblay, L., &; Elliott, D. (2016). Fitts' theorem in oculomotor control: Dissociable movement times for amplitude and width manipulations. Journal of Motor Behavior, 48, 489–499.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) have claimed that there are dissociable movement times for amplitude and width manipulations in the Fitts' paradigm. This may to some extent be true, but the Heath et al. (2011 Heath, M., Weiler, J., Marriott, K. A., Elliott, D., &; Binstead, G. (2011). Revisiting Fitts and Peterson (1964): Width and Amplitude manipulations to the reaching environment elicit dissociable movement times. Canadian Journal of Experimental Psychology, 65, 259–268.1.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) and Heath et al. (2016 Heath, M., Samani, A., Tremblay, L., &; Elliott, D. (2016). Fitts' theorem in oculomotor control: Dissociable movement times for amplitude and width manipulations. Journal of Motor Behavior, 48, 489–499.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) data do not support that contention, as shown in this comment. It is shown that data from the research of Heath et al. is not in the range of index of difficulty where ongoing visual control would be used and hence their fits of data to Fitts' law are spurious. The data of Heath et al. (2011 Heath, M., Weiler, J., Marriott, K. A., Elliott, D., &; Binstead, G. (2011). Revisiting Fitts and Peterson (1964): Width and Amplitude manipulations to the reaching environment elicit dissociable movement times. Canadian Journal of Experimental Psychology, 65, 259–268.1.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) for arm movements and for the primary eye saccade submovements of Heath et al. (2016 Heath, M., Samani, A., Tremblay, L., &; Elliott, D. (2016). Fitts' theorem in oculomotor control: Dissociable movement times for amplitude and width manipulations. Journal of Motor Behavior, 48, 489–499.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) are well correlated by the ballistic movement time equation of Hoffmann (1981 Hoffmann, E. R. (1981). An ergonomic approach to predetermined motion time systems. Proceedings of the 9th National Conference of the Institute of Industrial Engineers, Australia, 30–47. [Google Scholar]) and Gan and Hoffmann (1988 Gan, K.-C. &; Hoffmann, E. R. (1988). Geometrical conditions for ballistic and visually controlled movements. Ergonomics, 31, 829–839.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]). When the ballistic equation is used to model data for constant amplitude and constant target width conditions, the effects of the amplitude and width manipulations disappear. Other research indicates that the independent effects of movement amplitude occur due to changes in the time for the distance-covering phase of the movement.     

Mapping the MMPI–2/MMPI–2–RF Restructured Clinical Scales Onto Mood Markers in an Israeli Sample

This study cross-culturally evaluated the Minnesota Multiphasic Personality Inventory–2/MMPI–2 Restructured Form (MMPI–2/MMPI–2–RF) emotion-focused Restructured Clinical (RC) Scales to examine whether their patterns of associations with positive affect (PA) and negative affect (NA) are as expected based on Tellegen, Watson, and Clark's (1999a Tellegen, A., Watson, D., &; Clark, L. A. (1999a). Further support for a hierarchical model of affect. Psychological Science, 10, 307–309.[Crossref], [Web of Science ®] , [Google Scholar], 1999b Tellegen, A., Watson, D., &; Clark, L. A. (1999b). On the dimensional and hierarchical structure of affect. Psychological Science, 10, 297–303.[Crossref], [Web of Science ®] , [Google Scholar]) mood model. The sample was composed of 100 men and 133 women from psychiatric settings in Israel who completed the MMPI–2 and the Mood Check List (MCL; Zevon &; Tellegen, 1982 Zevon, M. A., &; Tellegen, A. (1982). The structure of mood change: An idiographic/nomothetic analysis. Journal of Personality and Social Psychology, 43, 111–122.[Crossref], [Web of Science ®] , [Google Scholar]). Results indicated that RCd was substantially correlated with both PA and NA in opposite directions, and that RC2 and RC7 were more highly correlated with PA and NA, respectively. Further, when compared with their Clinical Scale counterparts, RC2 and RC7 exhibited comparable convergent validities and improved discriminant properties. Findings provide support for Tellegen et al.'s (2003 Tellegen, A., Ben-Porath, Y. S., McNulty, J. L., Arbisi, P. A., Graham, J. R., &; Kaemmer, B. (2003). MMPI–2 Restructured Clinical (RC) scales: Development, validation, and interpretation. Minneapolis: University of Minnesota Press. [Google Scholar]) goal to link the RC scales to contemporary conceptualizations of mood.     

Addressing Item-Level Missing Data: A Comparison of Proration and Full Information Maximum Likelihood Estimation

Often when participants have missing scores on one or more of the items comprising a scale, researchers compute prorated scale scores by averaging the available items. Methodologists have cautioned that proration may make strict assumptions about the mean and covariance structures of the items comprising the scale (Schafer &; Graham, 2002 Schafer, J.L., &; Graham, J.W. (2002). Missing data: Our view of the state of the art. Psychological Methods, 7, 147–177.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Graham, 2009 Graham, J.W. (2009). Missing data analysis: Making it work in the real world. Annual Review of Psychology, 60, 549–576.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Enders, 2010 Enders, C.K. (2010). Applied missing data analysis. New York, NY: Guilford Press. [Google Scholar]). We investigated proration empirically and found that it resulted in bias even under a missing completely at random (MCAR) mechanism. To encourage researchers to forgo proration, we describe a full information maximum likelihood (FIML) approach to item-level missing data handling that mitigates the loss in power due to missing scale scores and utilizes the available item-level data without altering the substantive analysis. Specifically, we propose treating the scale score as missing whenever one or more of the items are missing and incorporating items as auxiliary variables. Our simulations suggest that item-level missing data handling drastically increases power relative to scale-level missing data handling. These results have important practical implications, especially when recruiting more participants is prohibitively difficult or expensive. Finally, we illustrate the proposed method with data from an online chronic pain management program.     

Implicit and Explicit Sexual Motives as Related,But Distinct Characteristics

A measure of implicit sexual motives—the implicit AMORE—was constructed employing the Affect Misattribution Procedure (Payne, Cheng, Govorun, &; Stewart, 2005 Payne, B. K., Cheng, C. M., Govorun, O., &; Stewart, B. D. (2005). An inkblot for attitudes: Affect misattribution as implcit measurement. Journal of Personality and Social Psychology, 89, 277–293. doi:10.1037/0022-3514.89.3.277[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). Subscales paralleled the 8 dimensions identified previously by the self-report measure of sexual motives, the explicit AMORE (Hill &; Preston, 1996 Hill, C. A., &; Preston, L. K. (1996). Individual differences in the experience of sexual motivation: Theory and measurement of dispositional sexual motives. Journal of Sex Research, 33, 27–45. doi:10.1080/00224499609551812[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]). Confirmatory factor analyses supported the proposed 8-factor model in slightly revised form, which was confirmed based on a second independent set of participants. Consistent with hypotheses, the implicit scales correlated with nonconscious erotica-viewing behavior for women in a laboratory setting. In contrast to explicit scales, implicit scales were unrelated to self-report ratings of likely sexual behavior. Finally, self-reports of aspects of sexual behavior were generally associated with the measures of implicit motives independently of corresponding explicit motives for both women and men. The results support the conception of implicit sexual motives as related, but distinct from explicit sexual motives.     

Processing of musical structure by high-functioning adolescents with autism spectrum disorders

Enhanced pitch perception and memory have been cited as evidence of a local processing bias in autism spectrum disorders (ASD). This bias is argued to account for enhanced perceptual functioning (Mottron &; Burack, 2001 Mottron, L. and Burack, J. A. 2001. “Enhanced perceptual functioning in the development of autism”. In The development of autism: Perspectives from theory to research, Edited by: Burack, J. A., Charman, T., Yirmiya, N. and Zelazo, P. R. 131–147. Mahwah, NJ: Lawrence Erlbaum.  [Google Scholar]; Mottron, Dawson, Soulières, Hubert, &; Burack, 2006 Mottron, L., Dawson, M., Soulières, I., Hubert, B. and Burack, J. 2006. Enhanced perceptual functioning in autism: An update, and eight principles of autistic perception. Journal of Autism and Developmental Disorders, 36(1): 27–43. doi:10.1007/s10803-005-0040-7[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) and central coherence theories of ASD (Frith, 1989 Frith, U. 1989. Autism: Explaining the enigma, Oxford: United Kingdom: Blackwell.  [Google Scholar]; Happé &; Frith, 2006 Happé, F. and Frith, U. 2006. The weak coherence account: Detail-focused cognitive style in autism spectrum disorders. Journal of Autism and Developmental Disorders, 36(1): 5–25. doi:10.1007/s10803-005-0039-0[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). A local processing bias confers a different cognitive style to individuals with ASD (Happé, 1999 Happé, F. 1999. Autism: Cognitive deficit or cognitive style?. Trends in Cognitive Sciences, 3(6): 216–222. doi:10.1016/S1364-6613(99)01318-2[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]), which accounts in part for their good visuospatial and visuoconstructive skills. Here, we present analogues in the auditory domain, audiotemporal or audioconstructive processing, which we assess using a novel experimental task: a musical puzzle. This task evaluates the ability of individuals with ASD to process temporal sequences of musical events as well as various elements of musical structure and thus indexes their ability to employ a global processing style. Musical structures created and replicated by children and adolescents with ASD (10–19 years old) and typically developing children and adolescents (7–17 years old) were found to be similar in global coherence. Presenting a musical template for reference increased accuracy equally for both groups, with performance associated to performance IQ and short-term auditory memory. The overall pattern of performance was similar for both groups; some puzzles were easier than others and this was the case for both groups. Task performance was further found to be correlated with the ability to perceive musical emotions, more so for typically developing participants. Findings are discussed in light of the empathizing-systemizing theory of ASD (Baron-Cohen, 2009 Baron-Cohen, S. 2009. Autism: The Empathizing-Systemizing (E-S) Theory. Annals of the New York Academy of Sciences, 1156: 68–80. doi:10.1111/j.1749-6632.2009.04467.x[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) and the importance of describing the strengths of individuals with ASD (Happé, 1999 Happé, F. 1999. Autism: Cognitive deficit or cognitive style?. Trends in Cognitive Sciences, 3(6): 216–222. doi:10.1016/S1364-6613(99)01318-2[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Heaton, 2009 Heaton, P. 2009. Assessing musical skills in autistic children who are not savants. Philosophical Transactions of the Royal Society Biological Sciences, 364: 1443–1447. doi:10.1098/rstb.2008.0327[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]).