Addressing Item-Level Missing Data: A Comparison of Proration and Full Information Maximum Likelihood Estimation

Often when participants have missing scores on one or more of the items comprising a scale, researchers compute prorated scale scores by averaging the available items. Methodologists have cautioned that proration may make strict assumptions about the mean and covariance structures of the items comprising the scale (Schafer &; Graham, 2002 Schafer, J.L., &; Graham, J.W. (2002). Missing data: Our view of the state of the art. Psychological Methods, 7, 147–177.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Graham, 2009 Graham, J.W. (2009). Missing data analysis: Making it work in the real world. Annual Review of Psychology, 60, 549–576.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Enders, 2010 Enders, C.K. (2010). Applied missing data analysis. New York, NY: Guilford Press. [Google Scholar]). We investigated proration empirically and found that it resulted in bias even under a missing completely at random (MCAR) mechanism. To encourage researchers to forgo proration, we describe a full information maximum likelihood (FIML) approach to item-level missing data handling that mitigates the loss in power due to missing scale scores and utilizes the available item-level data without altering the substantive analysis. Specifically, we propose treating the scale score as missing whenever one or more of the items are missing and incorporating items as auxiliary variables. Our simulations suggest that item-level missing data handling drastically increases power relative to scale-level missing data handling. These results have important practical implications, especially when recruiting more participants is prohibitively difficult or expensive. Finally, we illustrate the proposed method with data from an online chronic pain management program.     

Model Conditioned Data Elasticity in Path Analysis: Assessing the “Confoundability” of Model/Data Characteristics

Much research has been directed at the validity of fit indices in Path Analysis and Structural Equation Modeling (e.g., Browne, MacCallum, Kim, Andersen, &; Glaser, 2002 Browne, M.W., MacCallum, R.C., Kim, C.T., Andersen, B.L., &; Glaser, R. (2002). When fit indices and residuals are incompatible. Psychological Methods, 7, 403–421.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Heene, Hilbert, Draxler, Ziegler, &; Bühner, 2011 Heene, M., Hilbert, S., Draxler, C., Ziegler, M., &; Bühner, M. (2011). Masking misfit in confirmatory factor analysis by increasing unique variances: A cautionary note on the usefulness of cutoff values of fit indices. Psychological Methods, 16(3), 319–336.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Hu &; Bentler, 1999 Hu, L., &; Bentler, P. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, J., 6(1), 1–55.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]; Marsh, Hau, &; Wen, 2004 Marsh, H.W., Hau, K.T., &; Wen, Z. (2004). In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler’s (1999) findings. Structural Equation Modeling, 11(3), 320–341.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]). Recent developments (e.g., Preacher, 2006 Preacher, K.J. (2006). Quantifying parsimony in structural equation modeling. Multivariate Behavioral Research, 41(3), 227–259.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]; Roberts &; Pashler, 2000 Roberts, S., &; Pashler, H. (2000). How persuasive is a good fit? A comment on theory testing. Psychological Review, 107(2), 358–367.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar], 2002 Roberts, S., &; Pashler, H. (2002). Reply to Rodgers and Rowe (2002). Psychological Review, 109(3), 605–607.[Crossref] , [Google Scholar]) have encouraged researchers to investigate other criteria for comparing models, including model complexity. What has not been investigated is the inherent ability of a particular data set to be fitted with a constrained set of randomly generated linear models, which we call Model Conditioned Data Elasticity (DE). In this article we show how DE can be compared with the problem of equivalent models and a more general problem of the “confoundability” of data/model combinations (see MacCallum, Wegener, Uchino, &; Fabrigar, 1993 MacCallum, R.C., Wegener, D.T., Uchino, B.N., &; Fabrigar, L.R. (1993). The problem of equivalent models in applications of covariance structure analysis. Psychological Bulletin, 114(1), 185–199.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). Using the DE package in R, we show how DE can be assessed through automated computer searches. Finally, we discuss how DE fits within the controversy surrounding the use of fit statistics.     

Valedictory

Contingentism, generally contrasted with law necessitarianism, is the view that the laws of nature are contingent. It is often coupled with the claim that their contingency is knowable a priori. This paper considers Bird's [2001 Bird, Alexander 2001. Necessarily, Salt Dissolves In Water, Analysis 61/4: 267–74.[Crossref], [Web of Science ®] , [Google Scholar], 2002 Bird, Alexander 2002. On Whether Some Laws Are Necessary, Analysis 62/3: 257–70.[Crossref], [Web of Science ®] , [Google Scholar], 2005 Bird, Alexander 2005. Unexpected A Posteriori Necessary Laws of Nature, Australasian Journal of Philosophy 83/4: 533–48.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar], 2007 Bird, Alexander 2007. Nature's Metaphysics: Laws and Properties, Oxford: Clarendon Press.[Crossref] , [Google Scholar]] arguments for the thesis that, necessarily, salt dissolves in water; and it defends his view against Beebee's [2001] and Psillos's [2002 Psillos, Stathis 2002. Salt Does Dissolve In Water, But Not Necessarily, Analysis 62/3: 255–7.[Crossref], [Web of Science ®] , [Google Scholar]] contingentist objections. A new contingentist objection is offered and several reasons for scepticism about its success are raised. It is concluded that certain higher-level laws describing the behaviours of molecular compounds may be necessary due to their dependence on underlying physical laws, and that the modal status of laws of nature cannot be determined a priori, as the structural features of the substances and properties they govern must first be investigated.     

Using the TAT to Assess the Relation Between Gender Identity and the Use of Defense Mechanisms

The purpose of this study is to explore whether 2 different dimensions of personality, when assessed at an implicit level with the Thematic Apperception Test (TAT; Murray, 1943 Murray, H. A. (1943). Thematic Apperception Test manual. Cambridge, MA: Harvard University Press. [Google Scholar]) will show a theoretically meaningful coherence not demonstrated when 1 is assessed at an implicit level and the other at an explicit level. Gender identity and defense mechanisms were assessed implicitly using the TAT. Gender identity was compared with a self-report measure of gender-related attributes assessed at the explicit level. The results showed a theoretically meaningful coherence when different dispositions were assessed at the same level, but a lack of agreement when similar dispositions were assessed at different levels. The study is based on a secondary analysis of data from 2 previously published papers (Cramer, 1998 Cramer, P. (1998). Threat to gender representation: Identity and identification. Journal of Personality, 66, 335–354.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Cramer &; Westergren, 1999 Cramer, P., &; Hogan, K. (1975). Sex differences in verbal and play fantasy. Developmental Psychology, 11, 145–154.[Crossref], [Web of Science ®] , [Google Scholar]).     

Bayes Factors Have Frequency Properties—This Should Not Be Ignored: A Rejoinder to Morey,Wagenmakers, and Rouder

Hoijtink, van Kooten, and Hulsker (2016 Hoijtink, H., van Kooten, P., &; Hulsker, K. (2016). Why Bayesian psychologists should change the way they used the Bayes factor. Multivariate Behavioral Research, 51, 1--9. doi: 10.1080/00273171.2014.969364.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) outline a research agenda for Bayesian psychologists: evaluate and use the frequency properties of Bayes factors. Morey, Wagenmakers, and Rouder (2016 Morey, R. D., Wagenmakers, E. -J., &; Rouder, J. N. (2016). Calibrated Bayes factors should not be used: A reply to Hoijtink, van Kooten, and Hulsker. Multivariate Behavioral Research, 51, 10--17. doi: 10.1080/00273171.2015.1052710.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) respond that Bayes factors calibrated using frequency properties should not be used. This paper contains the response of Hoijtink, van Kooten, and Hulsker to the criticism of Morey, Wagenmakers, and Rouder (2016 Morey, R. D., Wagenmakers, E. -J., &; Rouder, J. N. (2016). Calibrated Bayes factors should not be used: A reply to Hoijtink, van Kooten, and Hulsker. Multivariate Behavioral Research, 51, 10--17. doi: 10.1080/00273171.2015.1052710.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]).     

Calibrated Bayes Factors Should Not Be Used: A Reply to Hoijtink,van Kooten,and Hulsker

Hoijtink, Kooten, and Hulsker (2016 Hoijtink, H., van Kooten, P., &; Hulsker, K. (2016). Why Bayesian psychologists should change the way they use the Bayes factor. Multivariate Behavioral Research, 51, 1--9. doi: 10.1080/00273171.2014.969364.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) present a method for choosing the prior distribution for an analysis with Bayes factor that is based on controlling error rates, which they advocate as an alternative to our more subjective methods (Morey &; Rouder, 2014 Morey, R.D., &; Rouder, J.N. (2014). Bayesfactor: Computation of Bayes factors for common designs. R package version 0.9.9. Retrieved from http://CRAN.R-project.org/package=BayesFactor [Google Scholar]; Rouder, Speckman, Sun, Morey, &; Iverson, 2009 Rouder, J.N., Speckman, P.L., Sun, D., Morey, R.D., &; Iverson, G. (2009). Bayesian t-tests for accepting and rejecting the null hypothesis. Psychonomic Bulletin and Review, 16, 225–237. doi: 10.3758/PBR.16.2.225[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Wagenmakers, Wetzels, Borsboom, &; van der Maas, 2011 Wagenmakers, E.-J., Wetzels, R., Borsboom, D., &; van der Maas, H. (2011). Why psychologists must change the way they analyze their data: The case of psi. A comment on Bem (2011). Journal of Personality and Social Psychology, 100, 426–432. doi: 10.1037/a0022790[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). We show that the method they advocate amounts to a simple significance test, and that the resulting Bayes factors are not interpretable. Additionally, their method fails in common circumstances, and has the potential to yield arbitrarily high Type II error rates. After critiquing their method, we outline the position on subjectivity that underlies our advocacy of Bayes factors.     

Development of the Short Version of the Individuation Test for Emerging Adults (ITEA–S) and Its Measurement Invariance Across Slovene and U.S. Emerging Adults

In this study we developed a short version of the Individuation Test for Emerging Adults (ITEA–S) and tested its measurement invariance across Slovene and U.S. samples of emerging adults. The item reduction process resulted in retaining 21 out of 36 items. The content analysis of the retained and discarded items revealed that the ITEA–S adequately measures the 5 individuation domains (support seeking, connectedness, intrusiveness, self-reliance, and fear of disappointing the parent). In our samples, the ITEA–S demonstrated evidence for construct validity and its 5 scales showed adequate internal consistency. The scale scores were also meaningfully associated with the relevant demographic variables in both countries, as well as the three scales of the Psychological Separation Inventory (Hoffman, 1984 Hoffman, J. A. (1984). Psychological separation of late adolescents from their parents. Journal of Counseling Psychology, 31, 170–178.[Crossref], [Web of Science ®] , [Google Scholar]; the Slovene sample), and the scales of the Differentiation of Self–Revised questionnaire (Skowron &; Schmitt, 2003 Skowron, E. A., &; Schmitt, T. A. (2003). Assessing interpersonal fusion: Reliability and validity of a new DSI Fusion with Others subscale. Journal of Marital and Family Therapy, 29, 209–222.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; the U.S. sample). The results of multiple group confirmatory factor analyses supported the hypothesis of full metric and partial scalar invariance for both ITEA–S forms (in relation to mother and father) across the 2 country groups.     

Motive Arousal Without Pictures? An Experimental Validation of a Hybrid Implicit Motive Test

Pictures are widely used as stimuli in implicit motive tests. Hybrid forms of such tests present pictures and declarative statements underneath pictures. Some authors have argued that explicitly declaring agreement with motive-related statements presented underneath pictures might shift the validity of such tests from capturing less implicit motives to more explicit motives. If that is the case, pictures as elicitors of implicit motives might become less relevant. Adopting the views on validity presented by Borsboom, Mellenbergh, and van Heerden (2004 Borsboom, D., Mellenbergh, G. J., &; van Heerden, J. (2004). The concept of validity. Psychological Review, 111, 1061–1071. doi:10.1037/0033-295X.111.4.1061[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) and Bornstein (2011 Bornstein, R. F. (2011). Toward a process-focused model of test score validity: Improving psychological assessment in science and practice. Psychological Assessment, 23, 532–544. doi:10.1037/a0022402[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]), as well as item generation theory, we investigated whether the availability of pictures in hybrid motive tests causally affects test scores. To this end, we administered the Multi-Motive Grid (MMG; Sokolowski, Schmalt, Langens, &; Puca, 2000 Sokolowski, K., Schmalt, H.-D., Langens, T. A., &; Puca, R. M. (2000). Assessing achievement, affiliation, and power motives all at once: The Multi-Motive-Grid (MMG). Journal of Personality Assessment, 74, 126–145. doi:10.1207/S15327752JPA740109[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]), as an example of a hybrid motive test, either with or without pictures to 108 participants. Results revealed that the availability of pictures had no effect on 3 out of 6 test scores. Furthermore, eliminating pictures had only inconsistent effects on correlations with a test of explicit motives. We conclude that pictures might not unanimously elicit motives in implicit motive tests that use declarative statements as response options.     

Amplitude and Width Manipulations in Fitts' Paradigm: Comment on Heath et al. (2011) and Heath et al. (2016)

Heath, Weiler, Marriott, Elliott, and Binstead (2011 Heath, M., Weiler, J., Marriott, K. A., Elliott, D., &; Binstead, G. (2011). Revisiting Fitts and Peterson (1964): Width and Amplitude manipulations to the reaching environment elicit dissociable movement times. Canadian Journal of Experimental Psychology, 65, 259–268.1.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) and Heath, Samani, Tremblay, and Elliott (2016 Heath, M., Samani, A., Tremblay, L., &; Elliott, D. (2016). Fitts' theorem in oculomotor control: Dissociable movement times for amplitude and width manipulations. Journal of Motor Behavior, 48, 489–499.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) have claimed that there are dissociable movement times for amplitude and width manipulations in the Fitts' paradigm. This may to some extent be true, but the Heath et al. (2011 Heath, M., Weiler, J., Marriott, K. A., Elliott, D., &; Binstead, G. (2011). Revisiting Fitts and Peterson (1964): Width and Amplitude manipulations to the reaching environment elicit dissociable movement times. Canadian Journal of Experimental Psychology, 65, 259–268.1.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) and Heath et al. (2016 Heath, M., Samani, A., Tremblay, L., &; Elliott, D. (2016). Fitts' theorem in oculomotor control: Dissociable movement times for amplitude and width manipulations. Journal of Motor Behavior, 48, 489–499.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) data do not support that contention, as shown in this comment. It is shown that data from the research of Heath et al. is not in the range of index of difficulty where ongoing visual control would be used and hence their fits of data to Fitts' law are spurious. The data of Heath et al. (2011 Heath, M., Weiler, J., Marriott, K. A., Elliott, D., &; Binstead, G. (2011). Revisiting Fitts and Peterson (1964): Width and Amplitude manipulations to the reaching environment elicit dissociable movement times. Canadian Journal of Experimental Psychology, 65, 259–268.1.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) for arm movements and for the primary eye saccade submovements of Heath et al. (2016 Heath, M., Samani, A., Tremblay, L., &; Elliott, D. (2016). Fitts' theorem in oculomotor control: Dissociable movement times for amplitude and width manipulations. Journal of Motor Behavior, 48, 489–499.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) are well correlated by the ballistic movement time equation of Hoffmann (1981 Hoffmann, E. R. (1981). An ergonomic approach to predetermined motion time systems. Proceedings of the 9th National Conference of the Institute of Industrial Engineers, Australia, 30–47. [Google Scholar]) and Gan and Hoffmann (1988 Gan, K.-C. &; Hoffmann, E. R. (1988). Geometrical conditions for ballistic and visually controlled movements. Ergonomics, 31, 829–839.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]). When the ballistic equation is used to model data for constant amplitude and constant target width conditions, the effects of the amplitude and width manipulations disappear. Other research indicates that the independent effects of movement amplitude occur due to changes in the time for the distance-covering phase of the movement.     

Theory and Analysis of Total,Direct, and Indirect Causal Effects

Mediation analysis, or more generally models with direct and indirect effects, are commonly used in the behavioral sciences. As we show in our illustrative example, traditional methods of mediation analysis that omit confounding variables can lead to systematically biased direct and indirect effects, even in the context of a randomized experiment. Therefore, several definitions of causal effects in mediation models have been presented in the literature (Baron &; Kenny, 1986 Baron, R.M., &; Kenny, D.A. (1986). The moderator-mediator variable distinction in social psychological research: Conceptual, strategic and statistical considerations. Journal of Personality and Social Psychology, 51, 1173–1182. doi:10.1037/0022-3514.51.6.1173[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Imai, Keele, &; Tingley, 2010 Imai, K., Keele, L., &; Tingley, D. (2010). A general approach to causal mediation analysis. Psychological Methods, 15, 309–334. doi:10.1037/a0020761[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Pearl, 2012 Pearl, J. (2012). The causal mediation formula: A guide to the assessment of pathways and mechanisms. Prevention Science, 13, 426–436. doi:10.1007/s11121-011-0270-1[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). We illustrate the stochastic theory of causal effects as an alternative foundation of causal mediation analysis based on probability theory. In this theory we define total, direct, and indirect effects and show how they can be identified in the context of our illustrative example. A particular strength of the stochastic theory of causal effects are the causality conditions that imply causal unbiasedness of effect estimates. The causality conditions have empirically testable implications and can be used for covariate selection. In the discussion, we highlight some similarities and differences of the stochastic theory of causal effects with other theories of causal effects.     

Psychological Skills and “the Paras”: The Indirect Effects of Psychological Skills on Endurance

We examined the indirect effects of basic psychological skills (PS) on military endurance through enhanced advanced PS while controlling for fitness. British Army recruits (n = 159) participated in three endurance events for Parachute Regiment selection and completed an adapted Test of Performance Strategies questionnaire (Hardy et al., 2010 Hardy, L., Roberts, R., Thomas, P. R., &; Murphy, S. M. (2010). Test of performance strategies (TOPS): Instrument refinement using confirmatory factor analysis. Psychology of Sport and Exercise, 11, 27–35. doi:10.1016/j.psychsport.2009.04.007[Crossref], [Web of Science ®] , [Google Scholar]). Following confirmatory factor analyses, the multiple mediation regression analyses using PROCESS (Hayes, 2013 Hayes, A.F. (2013). Introduction to mediation, moderation and conditional process analysis: A regression-based approach. New York, NY: Guilford Press. [Google Scholar]) suggested that goal setting, imagery and relaxation all had positive indirect effects on endurance via activation, with goal setting also impacting on endurance via negative thinking. These data provide some support for basic PS influencing endurance via advanced PS.     

Grit Happens: Moderating Effects on Motivational Feedback and Sport Performance

Research on motivational climates within athletics has focused on mastery and ego achievement approaches, yielding different psychological consequences (Smith, Smoll, &; Cumming, 2007 Smith, R. E., Smoll, F. L., &; Cumming, S. P. (2007). Effects of a motivational climate intervention for coaches on young athletes' sport performance anxiety. Journal of Sport &; Exercise Psychology, 29, 39–59.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]). Further, the motivational climate may interact with athletes' trait characteristics, such as grit, resulting in different outcomes. Grit may alter athletes' experience of the motivational climate by helping them remain oriented to their long-term quest in sport (Duckworth, Peterson, Matthews, &; Kelly, 2007 Duckworth, A. L., Peterson, C., Matthews, M. D., &; Kelly, D. R. (2007). Grit: Perseverance and passion for long-term goals. Journal of Personality and Social Psychology, 92, 1087–1101. doi:10.1037/0022-3514.92.6.1087[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). However, to date, the impact of these motivational climates and potential moderating factors on athlete performance remains in question, as the research utilizing objective measures of athletic performance is limited (Harwood, Keegan, Smith, &; Raine, 2015 Harwood, C. G., Keegan, R. J., Smith, J. M., &; Raine, A. S. (2015). A systematic review of the intrapersonal correlates of motivational climate perceptions in sport and physical activity. Psychology of Sport and Exercise, 18, 9–25. doi:10.1016/j.psychsport.2014.11.005[Crossref], [Web of Science ®] , [Google Scholar]). We used a motivational research paradigm (e.g., Mueller &; Dweck, 1998 Mueller, C. M., &; Dweck, C. S. (1998). Praise for intelligence can undermine children's motivation and performance. Journal of Personality and Social Psychology, 75, 33–52. doi:10.1037//0022-3514.75.1.33[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) to examine the effects of mastery- or ego-involving feedback on 71 high school adolescent soccer players' (M_age = 15.81) performance on a kicking task. Then we explored the potential moderating effects of grit on the relationship between motivational feedback and the athletes' performance, desire to persist, and choice of task difficulty on a soccer task. Athletes performed significantly better receiving mastery- as opposed to ego-involving feedback. Further, grit was a significant moderator of the feedback-shooting performance relationship, accounting for 3.9% of variance. Simple slopes analysis revealed a significant effect for low (B = 13.32, SE_b = 4.44, p =.004, t = 2.99), but not high (B = 2.11, SE_b = 4.31, p =.63, t = 0.49), grit on task performance. These results suggest that the feedback athletes receive matters, especially for those low in grit.     

A Polytomous Model of Cognitive Diagnostic Assessment for Graded Data

Pursuing the line of the difference models in IRT (Thissen &; Steinberg, 1986 Thissen, D., &; Steinberg, L. (1986). A taxonomy of item response models. Psychometrika, 51:567–577. doi:10.1007/BF02295596.[Crossref], [Web of Science ®] , [Google Scholar]), this article proposed a new cognitive diagnostic model for graded/polytomous data based on the deterministic input, noisy, and gate (Haertel, 1989 Haertel, E. H. (1989). Using restricted latent class models to map the skill structure of achievement items. Journal of Educational Measurement, 26, 333–352. doi:10.1111/j.1745-3984.1989.tb00336.x.[Crossref], [Web of Science ®] , [Google Scholar]; Junker &; Sijtsma, 2001 Junker, B. W., &; Sijtsma, K. (2001). Cognitive assessment models with few assumptions, and connections with nonparametric item response theory. Applied Psychological Measurement, 25, 258–272. doi:10.1177/01466210122032064.[Crossref], [Web of Science ®] , [Google Scholar]), which is named the DINA model for graded data (DINA-GD). We investigated the performance of a full Bayesian estimation of the proposed model. In the simulation, the classification accuracy and item recovery for the DINA-GD model were investigated. The results indicated that the proposed model had acceptable examinees' correct attribute classification rate and item parameter recovery. In addition, a real-data example was used to illustrate the application of this new model with the graded data or polytomously scored items.     

Patient Personality and Relational Patterns in Psychotherapy: Factor Structure,Reliability, and Validity of the Psychotherapy Relationship Questionnaire

The aim of this study was to examine the factor structure and the psychometric properties of the Psychotherapy Relationship Questionnaire (PRQ; Bradley, Heim, &; Westen, 2005 Bradley, R., Heim, A. K., &; Westen, D. (2005). Transference patterns in the psychotherapy of personality disorders: Empirical investigation. The British Journal of Psychiatry, 186, 342–349. doi:10.1192/bjp.186.4.342[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]), a clinician report instrument that measures a wide spectrum of thoughts, feelings, motives, conflicts, and behaviors expressed by patients toward their therapists in psychotherapy. A national sample of psychiatrists and clinical psychologists (N = 314) of different theoretical orientations completed the PRQ, as well as the Shedler–Westen Assessment Procedure–200 (SWAP–200; Westen &; Shedler, 1999a Westen, D., &; Shedler, J. (1999a). Revising and assessing Axis II, Part I: Developing a clinically and empirically valid assessment method. The American Journal of Psychiatry, 156, 258–272.[PubMed], [Web of Science ®] , [Google Scholar], 1999b Westen, D., &; Shedler, J. (1999a). Revising and assessing Axis II, Part I: Developing a clinically and empirically valid assessment method. The American Journal of Psychiatry, 156, 258–272.[PubMed], [Web of Science ®] , [Google Scholar]) to assess the personality of a patient in their care. Factor-analytic procedures identified 6 transference dimensions that showed excellent internal consistencies: (a) hostile, (b) positive/working alliance, (c) special/entitled, (d) anxious/preoccupied, (e) avoidant/dismissing attachment, and (f) sexualized. Factor scores were significantly related to patients’ personality characteristics and psychological functioning, regardless of the clinicians’ orientations. The findings support that the PRQ is a valid and reliable tool for evaluating the patients’ relational patterns emerging in clinical practice in a clinically coherent and psychometrically robust way. Clinicians’ careful understanding of these patterns can be very useful for making accurate diagnostic formulations, as well as for providing a roadmap for effective therapeutic intervention.     

The Abbreviated Character Strengths Test (ACST): A Preliminary Assessment of Test Validity

The 24-item Abbreviated Character Strengths Test (ACST) was developed to efficiently measure character strengths (Peterson, Park, &; Castro, 2011 Peterson, C., Park, N., &; Castro, C. A. (2011). Assessment for the US Army Comprehensive Soldier Fitness program: The Global Assessment Tool. American Psychologist, 66, 10–18.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). However, its validity for this purpose has not yet been sufficiently established. Using confirmatory factor analysis to test a series of structural models, only a modified bifactor model showed reasonably acceptable fit. Further analyses of this model failed to demonstrate measurement invariance between male and female respondents. Relationships between ACST dimension and Big Five personality trait scores were generally weak-to-moderate, and support for hypotheses regarding each ACST virtue's expected correspondence with specific Big Five dimensions was mixed. Finally, scores on ACST dimensions accounted for a combined 12% of the variance in satisfaction with life scores, after controlling for socially desirability. Although an abbreviated measure of character strengths represents a practical need, considerable improvements to the ACST are needed for it to adequately meet this purpose.     

Spontaneous Interentity Coordination in a Dissipative Structure

Humans and other creatures display remarkable interorganism coordination. For ecological theorists, interorganism coordination poses a challenge because it appears to be an especially “representation-hungry” phenomenon (Clark, 1999 Clark, A. (1999). An embodied cognitive science? Trends in Cognitive Sciences, 3, 345–351.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). Ecological researchers have proposed that interorganism coordination arises from fundamental laws of pattern formation and synchronization. A key example in support of the ecological approach to coordination is the phase locking of 2 or more weakly coupled metronomes. Here we provide a complementary example of interentity coordination in a system that is more closely analogous to living systems. We show that two self-organizing dissipative structures, coupled in a single electrical field, spontaneously exhibit fairly complex motion coordination. Further, the degree of coordination predicts the rate of entropy production for the system as a whole. We suggest that the complex behavior of motion coordination fulfills a rudimentary end-directedness of the system: evolve to states that create higher rates of entropy production.     

Why Bayesian Psychologists Should Change the Way They Use the Bayes Factor

The discussion following Bem’s (2011 Bem, D. J. (2011). Feeling the future: Experimental evidence for anomalous retroactive influences on cognition and affect. Journal of Personality and Social Psychology, 100, 407–425. doi: 10.1037/a0021524[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) psi research highlights that applications of the Bayes factor in psychological research are not without problems. The first problem is the omission to translate subjective prior knowledge into subjective prior distributions. In the words of Savage (1961 Savage, L. J. (1961). The foundations of statistical inference reconsidered. In J. Neyman, (Ed.), Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability, Volume 1: Contributions to the Theory of Statistics, pp. 575–586. BerkeleyCA: University of California. [Google Scholar]): “they make the Bayesian omelet without breaking the Bayesian egg.” The second problem occurs if the Bayesian egg is not broken: the omission to choose default prior distributions such that the ensuing inferences are well calibrated. The third problem is the adherence to inadequate rules for the interpretation of the size of the Bayes factor. The current paper will elaborate these problems and show how to avoid them using the basic hypotheses and statistical model used in the first experiment described in Bem (2011 Bem, D. J. (2011). Feeling the future: Experimental evidence for anomalous retroactive influences on cognition and affect. Journal of Personality and Social Psychology, 100, 407–425. doi: 10.1037/a0021524[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). It will be argued that a thorough investigation of these problems in the context of more encompassing hypotheses and statistical models is called for if Bayesian psychologists want to add a well-founded Bayes factor to the tool kit of psychological researchers.     

Gender Differences in Academic Achievement: Is Writing an Exception to the Gender Similarities Hypothesis?

The gender similarities hypothesis by J. S. Hyde (2005 Hyde, J.S. (2005). The gender similarities hypothesis. American Psychologist, 60, 581–592.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]), based on large-scale reviews of studies, concludes that boys and girls are more alike than different on most psychological variables, including academic skills such as reading and math (J. S. Hyde, 2005 Hyde, J.S. (2005). The gender similarities hypothesis. American Psychologist, 60, 581–592.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). Writing is an academic skill that may be an exception. The authors investigated gender differences in academic achievement using a large, nationally stratified sample of children and adolescents ranging from ages 7–19 years (N = 2,027). Achievement data were from the conormed sample for the Kaufman intelligence and achievement tests. Multiple-indicator, multiple-cause, and multigroup mean and covariance structure models were used to test for mean differences. Girls had higher latent reading ability and higher scores on a test of math computation, but the effect sizes were consistent with the gender similarities hypothesis. Conversely, girls scored higher on spelling and written expression, with effect sizes inconsistent with the gender similarities hypothesis. The findings remained the same after controlling for cognitive ability. Girls outperform boys on tasks of writing.     

Interactions Between Modality of Working Memory Load and Perceptual Load in Distractor Processing

The present study investigated interactions between working memory load and perceptual load. The load theory (Lavie, Hirst, de Fockert, &; Viding, 2004 Lavie, N., Hirst, A., de Fockert, J.W., &; Viding, E. (2004). Load theory of selective attention and cognitive control. Journal of Experimental Psychology: General, 133, 339–354.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) claims that perceptual load decreases distractor interference, whereas working memory load increases interference. However, recent studies showed that effects of working memory might depend on the relationship between modalities of working memory and task stimuli. Here, we examined whether the relationship between working memory load and perceptual load would remain the same across modalities. The results of Experiment 1 showed that verbal working memory load did not affect a compatibility effect for low perceptual load, whereas it increased the compatibility effect for high perceptual load. In Experiment 2, the compatibility effect remained the same regardless of visual working memory load. These results suggest that the effects of working memory load and perceptual load depend on the relationship between the modalities of working memory and stimuli.     

Groupness and Leadership Perceptions in Relation to Social Identity in Youth Sport

Despite support for a number of consequences emanating from social identity in sport, much less is known pertaining to potential antecedents. This study sought to extend preliminary findings from recent youth sport research (e.g., Bruner et al., 2015 Bruner, M. W., Eys, M. A., Evans, M. B., &; Wilson, K. (2015). Interdependence and social identity in youth sport teams. Journal of Applied Sport Psychology, 27, 351–358.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) by investigating perceptions of groupness and leadership status in relation to social identity in 480 athletes. Results indicated that perceptions of groupness at the individual and team levels were positively related to social identity, as was being a formal or informal leader. As such, both identifying as a leader and perceiving an increased amount of groupness among teammates increased social identity.