Calibrated Bayes Factors Should Not Be Used: A Reply to Hoijtink,van Kooten,and Hulsker

Hoijtink, Kooten, and Hulsker (2016 Hoijtink, H., van Kooten, P., &; Hulsker, K. (2016). Why Bayesian psychologists should change the way they use the Bayes factor. Multivariate Behavioral Research, 51, 1--9. doi: 10.1080/00273171.2014.969364.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) present a method for choosing the prior distribution for an analysis with Bayes factor that is based on controlling error rates, which they advocate as an alternative to our more subjective methods (Morey &; Rouder, 2014 Morey, R.D., &; Rouder, J.N. (2014). Bayesfactor: Computation of Bayes factors for common designs. R package version 0.9.9. Retrieved from http://CRAN.R-project.org/package=BayesFactor [Google Scholar]; Rouder, Speckman, Sun, Morey, &; Iverson, 2009 Rouder, J.N., Speckman, P.L., Sun, D., Morey, R.D., &; Iverson, G. (2009). Bayesian t-tests for accepting and rejecting the null hypothesis. Psychonomic Bulletin and Review, 16, 225–237. doi: 10.3758/PBR.16.2.225[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Wagenmakers, Wetzels, Borsboom, &; van der Maas, 2011 Wagenmakers, E.-J., Wetzels, R., Borsboom, D., &; van der Maas, H. (2011). Why psychologists must change the way they analyze their data: The case of psi. A comment on Bem (2011). Journal of Personality and Social Psychology, 100, 426–432. doi: 10.1037/a0022790[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). We show that the method they advocate amounts to a simple significance test, and that the resulting Bayes factors are not interpretable. Additionally, their method fails in common circumstances, and has the potential to yield arbitrarily high Type II error rates. After critiquing their method, we outline the position on subjectivity that underlies our advocacy of Bayes factors.     

Grit Happens: Moderating Effects on Motivational Feedback and Sport Performance

Research on motivational climates within athletics has focused on mastery and ego achievement approaches, yielding different psychological consequences (Smith, Smoll, &; Cumming, 2007 Smith, R. E., Smoll, F. L., &; Cumming, S. P. (2007). Effects of a motivational climate intervention for coaches on young athletes' sport performance anxiety. Journal of Sport &; Exercise Psychology, 29, 39–59.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]). Further, the motivational climate may interact with athletes' trait characteristics, such as grit, resulting in different outcomes. Grit may alter athletes' experience of the motivational climate by helping them remain oriented to their long-term quest in sport (Duckworth, Peterson, Matthews, &; Kelly, 2007 Duckworth, A. L., Peterson, C., Matthews, M. D., &; Kelly, D. R. (2007). Grit: Perseverance and passion for long-term goals. Journal of Personality and Social Psychology, 92, 1087–1101. doi:10.1037/0022-3514.92.6.1087[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). However, to date, the impact of these motivational climates and potential moderating factors on athlete performance remains in question, as the research utilizing objective measures of athletic performance is limited (Harwood, Keegan, Smith, &; Raine, 2015 Harwood, C. G., Keegan, R. J., Smith, J. M., &; Raine, A. S. (2015). A systematic review of the intrapersonal correlates of motivational climate perceptions in sport and physical activity. Psychology of Sport and Exercise, 18, 9–25. doi:10.1016/j.psychsport.2014.11.005[Crossref], [Web of Science ®] , [Google Scholar]). We used a motivational research paradigm (e.g., Mueller &; Dweck, 1998 Mueller, C. M., &; Dweck, C. S. (1998). Praise for intelligence can undermine children's motivation and performance. Journal of Personality and Social Psychology, 75, 33–52. doi:10.1037//0022-3514.75.1.33[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) to examine the effects of mastery- or ego-involving feedback on 71 high school adolescent soccer players' (M_age = 15.81) performance on a kicking task. Then we explored the potential moderating effects of grit on the relationship between motivational feedback and the athletes' performance, desire to persist, and choice of task difficulty on a soccer task. Athletes performed significantly better receiving mastery- as opposed to ego-involving feedback. Further, grit was a significant moderator of the feedback-shooting performance relationship, accounting for 3.9% of variance. Simple slopes analysis revealed a significant effect for low (B = 13.32, SE_b = 4.44, p =.004, t = 2.99), but not high (B = 2.11, SE_b = 4.31, p =.63, t = 0.49), grit on task performance. These results suggest that the feedback athletes receive matters, especially for those low in grit.     

Bayes Factors Have Frequency Properties—This Should Not Be Ignored: A Rejoinder to Morey,Wagenmakers, and Rouder

Hoijtink, van Kooten, and Hulsker (2016 Hoijtink, H., van Kooten, P., &; Hulsker, K. (2016). Why Bayesian psychologists should change the way they used the Bayes factor. Multivariate Behavioral Research, 51, 1--9. doi: 10.1080/00273171.2014.969364.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) outline a research agenda for Bayesian psychologists: evaluate and use the frequency properties of Bayes factors. Morey, Wagenmakers, and Rouder (2016 Morey, R. D., Wagenmakers, E. -J., &; Rouder, J. N. (2016). Calibrated Bayes factors should not be used: A reply to Hoijtink, van Kooten, and Hulsker. Multivariate Behavioral Research, 51, 10--17. doi: 10.1080/00273171.2015.1052710.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) respond that Bayes factors calibrated using frequency properties should not be used. This paper contains the response of Hoijtink, van Kooten, and Hulsker to the criticism of Morey, Wagenmakers, and Rouder (2016 Morey, R. D., Wagenmakers, E. -J., &; Rouder, J. N. (2016). Calibrated Bayes factors should not be used: A reply to Hoijtink, van Kooten, and Hulsker. Multivariate Behavioral Research, 51, 10--17. doi: 10.1080/00273171.2015.1052710.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]).     

Exploring the Relationship Between Autistic Traits and Body Image,Body Satisfaction,and Body Competence

Autism spectrum disorders (ASD) have been linked to bodily disorders (anorexia nervosa, obesity), and individuals with ASD are known to experience unique bodily states (e.g., exaggerated interoceptive sensitivity). Though there is evidence to suggest body variables may significantly impact quality of life in those with ASD, research has yet to examine the potential relationship between ASD and body image variables, that is, the evaluation of one's body. The present study examined 80 healthy college students (40 male, 40 female) who completed an online set of questionnaires regarding body image and satisfaction, body competency, depression, anxiety, and autistic traits (Autism Spectrum Quotient, or AQ) (Baron-Cohen, Wheelwright, Skinner, Martin, &; Clubley, 2001 Baron-Cohen, S., Wheelwright, S., Skinner, R., Martin, J., &; Clubley, E. (2001). The autism spectrum quotient (AQ): Evidence from asperger syndrome/high-functioning autism, males and females, scientists, and mathematicians. Journal of Autism and Developmental Disorders, 31, 5–17.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). Of primary interest was whether AQ scores, gender, and the interaction between AQ scores and gender could successfully predict participants' scores on body image, satisfaction, and competency scales. Autistic traits were only a significant predictor of scores on one measure of momentary body image and satisfaction (Body Image States Scale: Cash et al., 2002 Cash, T. F., Fleming, E. C., Alindogan, J., Steadman, L., &; Whitehead, A. (2002). Beyond body image as a trait: The development and validation of the body image states scale. Eating Disorders, 10, 103–113. https://doi.org/10.1080/10640260290081678[Taylor &; Francis Online] , [Google Scholar]). However, our results did suggest the possibility of an interaction between gender and AQ scores in predicting reports of body image, satisfaction, and competency.     

The Structure of Multidimensional Perfectionism: Support for a Bifactor Model With a Dominant General Factor

Evidence suggests perfectionism is a multidimensional construct composed of 2 higher order factors: perfectionistic strivings and perfectionistic concerns. However, the substantial overlap between perfectionistic strivings and perfectionistic concerns is problematic, as are the unanswered questions regarding the structure of perfectionism following removal of common variance. This research addressed this through bifactor modeling. Three student samples (N = 742) completed Hewitt and Flett's (1991 Hewitt, P. L., &; Flett, G. L. (1991). Perfectionism in the self and social contexts: Conceptualization, assessment, and association with psychopathology. Journal of Personality and Social Psychology, 60, 456.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) Multidimensional Perfectionism Scale, Frost, Marten, Lahart, and Rosenblate's (1990 Frost, R. O., Marten, P., Lahart, C., &; Rosenblate, R. (1990). The dimensions of perfectionism. Cognitive Therapy and Research, 14, 449–468.[Crossref], [Web of Science ®] , [Google Scholar]) Multidimensional Perfectionism Scale, and Slaney, Rice, Mobley, Trippi, and Ashby's (2001 Slaney, R. B., Rice, K. G., Mobley, M., Trippi, J., &; Ashby, J. S. (2001). The revised almost perfect scale. Measurement and Evaluation in Counseling and Development, 34, 130–145.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) Almost Perfect Scale–Revised. Greater support was consistently found for the bifactor model, relative to the 2-factor model. Results suggest the bifactor model best represents the structure of perfectionism and provide preliminary support for the use of a general factor score. Researchers are cautioned that removal of general variance may render the reliability of specific factors (i.e., perfectionistic strivings and perfectionistic concerns) suspect.     

Patient Personality and Relational Patterns in Psychotherapy: Factor Structure,Reliability, and Validity of the Psychotherapy Relationship Questionnaire

The aim of this study was to examine the factor structure and the psychometric properties of the Psychotherapy Relationship Questionnaire (PRQ; Bradley, Heim, &; Westen, 2005 Bradley, R., Heim, A. K., &; Westen, D. (2005). Transference patterns in the psychotherapy of personality disorders: Empirical investigation. The British Journal of Psychiatry, 186, 342–349. doi:10.1192/bjp.186.4.342[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]), a clinician report instrument that measures a wide spectrum of thoughts, feelings, motives, conflicts, and behaviors expressed by patients toward their therapists in psychotherapy. A national sample of psychiatrists and clinical psychologists (N = 314) of different theoretical orientations completed the PRQ, as well as the Shedler–Westen Assessment Procedure–200 (SWAP–200; Westen &; Shedler, 1999a Westen, D., &; Shedler, J. (1999a). Revising and assessing Axis II, Part I: Developing a clinically and empirically valid assessment method. The American Journal of Psychiatry, 156, 258–272.[PubMed], [Web of Science ®] , [Google Scholar], 1999b Westen, D., &; Shedler, J. (1999a). Revising and assessing Axis II, Part I: Developing a clinically and empirically valid assessment method. The American Journal of Psychiatry, 156, 258–272.[PubMed], [Web of Science ®] , [Google Scholar]) to assess the personality of a patient in their care. Factor-analytic procedures identified 6 transference dimensions that showed excellent internal consistencies: (a) hostile, (b) positive/working alliance, (c) special/entitled, (d) anxious/preoccupied, (e) avoidant/dismissing attachment, and (f) sexualized. Factor scores were significantly related to patients’ personality characteristics and psychological functioning, regardless of the clinicians’ orientations. The findings support that the PRQ is a valid and reliable tool for evaluating the patients’ relational patterns emerging in clinical practice in a clinically coherent and psychometrically robust way. Clinicians’ careful understanding of these patterns can be very useful for making accurate diagnostic formulations, as well as for providing a roadmap for effective therapeutic intervention.     

Examining Current Conceptualizations of Psychopathology With the MMPI–2/MMPI–2–RF Restructured Clinical Scales: Preliminary Findings From a Cross-Cultural Study

Watson (2005 Watson, D. (2005). Rethinking the mood and anxiety disorders: A quantitative hierarchical model for DSM–V. Journal of Abnormal Psychology, 114, 522–536.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) proposed a hierarchical reorganization of the underlying structure of emotional disorders. This study cross-culturally evaluated Watson's (2005) structure of mood and anxiety disorders, using mainly dichotomous criteria, and explored the placement of obsessive–compulsive disorder (OCD) in this model. It also tested Sellbom, Ben-Porath, and Bagby's (2008) proposed elaboration of the 2-factor model (positive and negative activation) that incorporates a higher order dimension of demoralization. One hundred men and 133 women from psychiatric settings in Israel completed the Minnesota Multiphasic Personality Inventory–2 (Butcher et al., 2001 Butcher, J. N., Graham, J. R., Ben-Porath, Y. S., Tellegen, A., Dahlstrom, W. G., &; Kaemmer, B. (2001). Minnesota Multiphasic Personality Inventory–2 (MMPI–2): Manual for administration, scoring and interpretation (Rev. ed.). Minneapolis: University of Minnesota Press.[Crossref] , [Google Scholar]) and the Maudsley Obsessional–Compulsive Inventory (Hodgson &; Rachman, 1977 Hodgson, R. J., &; Rachman, S. (1977). Obsessive–compulsive complaints. Behaviour Research and Therapy, 15, 389–395.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). They were interviewed using the Mini International Neuropsychiatric Interview (Sheehan et al., 1998 Sheehan, D. V., Lecrubier, Y., Sheehan, K. H., Amorim, P., Janavs, J., &; Weiller, E. (1998). The Mini-International Neuropsychiatric Interview (M.I.N.I.): The development and validation of a structured diagnostic psychiatric interview for DSM–IV and ICD–10. Journal of Clinical Psychiatry, 59, 22–33.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). Confirmatory factor analyses replicated Watson's structure for women but not for men. Mixed results were obtained regarding OCD's location in the model. Findings among women support the applicability of Watson's (2005) model across a variety of assessment modalities, as well as in a different language and for diversified cultural backgrounds. This conclusion, however, should be tempered in consideration of the results among men. Findings also provide evidence of the importance of demoralization in mood and anxiety disorders.     

Amplitude and Width Manipulations in Fitts' Paradigm: Comment on Heath et al. (2011) and Heath et al. (2016)

Heath, Weiler, Marriott, Elliott, and Binstead (2011 Heath, M., Weiler, J., Marriott, K. A., Elliott, D., &; Binstead, G. (2011). Revisiting Fitts and Peterson (1964): Width and Amplitude manipulations to the reaching environment elicit dissociable movement times. Canadian Journal of Experimental Psychology, 65, 259–268.1.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) and Heath, Samani, Tremblay, and Elliott (2016 Heath, M., Samani, A., Tremblay, L., &; Elliott, D. (2016). Fitts' theorem in oculomotor control: Dissociable movement times for amplitude and width manipulations. Journal of Motor Behavior, 48, 489–499.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) have claimed that there are dissociable movement times for amplitude and width manipulations in the Fitts' paradigm. This may to some extent be true, but the Heath et al. (2011 Heath, M., Weiler, J., Marriott, K. A., Elliott, D., &; Binstead, G. (2011). Revisiting Fitts and Peterson (1964): Width and Amplitude manipulations to the reaching environment elicit dissociable movement times. Canadian Journal of Experimental Psychology, 65, 259–268.1.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) and Heath et al. (2016 Heath, M., Samani, A., Tremblay, L., &; Elliott, D. (2016). Fitts' theorem in oculomotor control: Dissociable movement times for amplitude and width manipulations. Journal of Motor Behavior, 48, 489–499.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) data do not support that contention, as shown in this comment. It is shown that data from the research of Heath et al. is not in the range of index of difficulty where ongoing visual control would be used and hence their fits of data to Fitts' law are spurious. The data of Heath et al. (2011 Heath, M., Weiler, J., Marriott, K. A., Elliott, D., &; Binstead, G. (2011). Revisiting Fitts and Peterson (1964): Width and Amplitude manipulations to the reaching environment elicit dissociable movement times. Canadian Journal of Experimental Psychology, 65, 259–268.1.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) for arm movements and for the primary eye saccade submovements of Heath et al. (2016 Heath, M., Samani, A., Tremblay, L., &; Elliott, D. (2016). Fitts' theorem in oculomotor control: Dissociable movement times for amplitude and width manipulations. Journal of Motor Behavior, 48, 489–499.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) are well correlated by the ballistic movement time equation of Hoffmann (1981 Hoffmann, E. R. (1981). An ergonomic approach to predetermined motion time systems. Proceedings of the 9th National Conference of the Institute of Industrial Engineers, Australia, 30–47. [Google Scholar]) and Gan and Hoffmann (1988 Gan, K.-C. &; Hoffmann, E. R. (1988). Geometrical conditions for ballistic and visually controlled movements. Ergonomics, 31, 829–839.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]). When the ballistic equation is used to model data for constant amplitude and constant target width conditions, the effects of the amplitude and width manipulations disappear. Other research indicates that the independent effects of movement amplitude occur due to changes in the time for the distance-covering phase of the movement.     

Theory and Analysis of Total,Direct, and Indirect Causal Effects

Mediation analysis, or more generally models with direct and indirect effects, are commonly used in the behavioral sciences. As we show in our illustrative example, traditional methods of mediation analysis that omit confounding variables can lead to systematically biased direct and indirect effects, even in the context of a randomized experiment. Therefore, several definitions of causal effects in mediation models have been presented in the literature (Baron &; Kenny, 1986 Baron, R.M., &; Kenny, D.A. (1986). The moderator-mediator variable distinction in social psychological research: Conceptual, strategic and statistical considerations. Journal of Personality and Social Psychology, 51, 1173–1182. doi:10.1037/0022-3514.51.6.1173[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Imai, Keele, &; Tingley, 2010 Imai, K., Keele, L., &; Tingley, D. (2010). A general approach to causal mediation analysis. Psychological Methods, 15, 309–334. doi:10.1037/a0020761[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Pearl, 2012 Pearl, J. (2012). The causal mediation formula: A guide to the assessment of pathways and mechanisms. Prevention Science, 13, 426–436. doi:10.1007/s11121-011-0270-1[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). We illustrate the stochastic theory of causal effects as an alternative foundation of causal mediation analysis based on probability theory. In this theory we define total, direct, and indirect effects and show how they can be identified in the context of our illustrative example. A particular strength of the stochastic theory of causal effects are the causality conditions that imply causal unbiasedness of effect estimates. The causality conditions have empirically testable implications and can be used for covariate selection. In the discussion, we highlight some similarities and differences of the stochastic theory of causal effects with other theories of causal effects.     

A Cross-Cultural Analysis of the Infant Behavior Questionnaire Very Short Form: An Item Response Theory Analysis of Infant Temperament in New Zealand

The Infant Behavior Questionnaire–Revised Very Short Form (IBQ–R VSF; Putnam, Helbig, Gartstein, Rothbart, &; Leerkes, 2014 Putnam, S. P., Helbig, A. L., Gartstein, M. A., Rothbart, M. K., &; Leerkes, E. (2014). Development and assessment of short and very short forms of the Infant Behavior Questionnaire–Revised. Journal of Personality Assessment, 96, 445–458. doi:10.1080/00223891.2013.841171[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) is a newly published measure of infant temperament with a 3-factor structure. Recently Peterson et al. (2017 Peterson, E. R., Waldie, K. E., Mohal, J., Reese, E., Atatoa Carr, P.E., Grant, C. C., &; Morton, S. M. B. (2017). Infant Behavior Questionnaire–Revised Very Short Form: A new factor structure's associations with parenting perceptions and child language outcomes. Journal of Personality Assessment. Advance online publication. doi:10.1080/00223891.2017.1287709[Taylor &; Francis Online] , [Google Scholar]) suggested that a 5-factor structure (Positive Affectivity/Surgency, Negative Emotionality, Orienting Capacity, Affiliation/Regulation, and Fear) was more parsimonious and showed promising reliability and predictive validity in a large, diverse sample. However, little is known about the 5-factor model's precision across the temperament dimensions range and whether it discriminates equally well across ethnicities. A total of 5,567 mothers responded to the IBQ–R VSF in relation to their infants (N = 5,639) between 23 and 52 weeks old. Using item response theory, we conducted a series of 2 parameter logistic item response models and found that 5 IBQ–R VSF temperament dimensions showed a good distribution of estimates across each latent trait range and these estimates centered close to the population mean. The IBQ–R VSF was also similarly precise across 4 ethnic groups (European, Māori, Pacific peoples, and Asians), suggesting that it can be used as comparable measure for infant temperament in a diversity of ethnic groups.     

Constructivism,Ethics, and Knowing What's Right: A Reply to McNamee,Burr, McWilliams,Osbeck, and Held

Five responses to Raskin and Debany's (this issue Raskin, J. D., &; Debany, A. E. (this issue). The inescapability of ethics and the impossibility of “anything goes”: A constructivist model of ethical meaning making. Journal of Constructivist Psychology. doi:10.1080/10720537.2017.1383954[Taylor &; Francis Online] , [Google Scholar]) original target article on a constructivist model of ethical meaning making are discussed. The authors responding to the article raise many important issues about constructivist approaches to ethics. Differences between social constructionism and constructivism, the importance of multiple modalities of knowing, and a continuing hope for rapprochement between constructivist and realist perspectives are briefly explored.     

A Polytomous Model of Cognitive Diagnostic Assessment for Graded Data

Pursuing the line of the difference models in IRT (Thissen &; Steinberg, 1986 Thissen, D., &; Steinberg, L. (1986). A taxonomy of item response models. Psychometrika, 51:567–577. doi:10.1007/BF02295596.[Crossref], [Web of Science ®] , [Google Scholar]), this article proposed a new cognitive diagnostic model for graded/polytomous data based on the deterministic input, noisy, and gate (Haertel, 1989 Haertel, E. H. (1989). Using restricted latent class models to map the skill structure of achievement items. Journal of Educational Measurement, 26, 333–352. doi:10.1111/j.1745-3984.1989.tb00336.x.[Crossref], [Web of Science ®] , [Google Scholar]; Junker &; Sijtsma, 2001 Junker, B. W., &; Sijtsma, K. (2001). Cognitive assessment models with few assumptions, and connections with nonparametric item response theory. Applied Psychological Measurement, 25, 258–272. doi:10.1177/01466210122032064.[Crossref], [Web of Science ®] , [Google Scholar]), which is named the DINA model for graded data (DINA-GD). We investigated the performance of a full Bayesian estimation of the proposed model. In the simulation, the classification accuracy and item recovery for the DINA-GD model were investigated. The results indicated that the proposed model had acceptable examinees' correct attribute classification rate and item parameter recovery. In addition, a real-data example was used to illustrate the application of this new model with the graded data or polytomously scored items.     

Motive Arousal Without Pictures? An Experimental Validation of a Hybrid Implicit Motive Test

Pictures are widely used as stimuli in implicit motive tests. Hybrid forms of such tests present pictures and declarative statements underneath pictures. Some authors have argued that explicitly declaring agreement with motive-related statements presented underneath pictures might shift the validity of such tests from capturing less implicit motives to more explicit motives. If that is the case, pictures as elicitors of implicit motives might become less relevant. Adopting the views on validity presented by Borsboom, Mellenbergh, and van Heerden (2004 Borsboom, D., Mellenbergh, G. J., &; van Heerden, J. (2004). The concept of validity. Psychological Review, 111, 1061–1071. doi:10.1037/0033-295X.111.4.1061[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) and Bornstein (2011 Bornstein, R. F. (2011). Toward a process-focused model of test score validity: Improving psychological assessment in science and practice. Psychological Assessment, 23, 532–544. doi:10.1037/a0022402[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]), as well as item generation theory, we investigated whether the availability of pictures in hybrid motive tests causally affects test scores. To this end, we administered the Multi-Motive Grid (MMG; Sokolowski, Schmalt, Langens, &; Puca, 2000 Sokolowski, K., Schmalt, H.-D., Langens, T. A., &; Puca, R. M. (2000). Assessing achievement, affiliation, and power motives all at once: The Multi-Motive-Grid (MMG). Journal of Personality Assessment, 74, 126–145. doi:10.1207/S15327752JPA740109[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]), as an example of a hybrid motive test, either with or without pictures to 108 participants. Results revealed that the availability of pictures had no effect on 3 out of 6 test scores. Furthermore, eliminating pictures had only inconsistent effects on correlations with a test of explicit motives. We conclude that pictures might not unanimously elicit motives in implicit motive tests that use declarative statements as response options.     

Introduction to the Special Section: Linking the MMPI–2–RF to Contemporary Models of Psychopathology

This special section considers 9 independent articles that seek to link the Minnesota Multiphasic Personality Inventory–2–Restructured Form (MMPI–2–RF; Ben-Porath &; Tellegen, 2008/2011 Ben-Porath, Y. S., &; Tellegen, A. (2011). MMPI–2–RF (Minnesota Multiphasic Personality Inventory–2 Restructured Form) manual. Minneapolis: University of Minnesota Press. (Original work published 2008) [Google Scholar]) to contemporary models of psychopathology. Sellbom (this issue Sellbom, M. (this issue). Mapping the MMPI–2–RF Specific Problems scales onto extant psychopathology structures. Journal of Personality Assessment. doi:10.1080/00223891.2016.1206909[Taylor &; Francis Online] , [Google Scholar]) maps the Specific Problems scales onto hierarchical psychopathology structures, whereas Romero, Toorabally, Burchett, Tarescavage, and Glassmire (this issue Romero, I. E., Toorabally, N., Burchett, D., Tarescavage, A. M., &; Glassmire, D. M. (this issue). Mapping the MMPI–2–RF Substantive scales onto internalizing, externalizing, and thought dysfunction dimensions in a forensic inpatient setting. Journal of Personality Assessment. doi:10.1080/00223891.2016.1223681[Taylor &; Francis Online] , [Google Scholar]) and Shkalim, Almagor, and Ben-Porath (this issue Shkalim, E., Almagor, M., &; Ben-Porath, Y. S. (this issue). Examining current conceptualizations of psychopathology with the MMPI–2/MMPI–2–RF Restructured Clinical scales: Preliminary findings from a cross-cultural study. Journal of Personality Assessment. doi:10.1080/00223891.2016.1189429[Taylor &; Francis Online] , [Google Scholar]) show evidence of linking the instruments' scales to diagnostic representations of common higher order psychopathology constructs. McCord, Achee, Cannon, Harrop, and Poynter (this issue McCord, D. M., Achee, M. C., Cannon, E. M., Harrop, T. M., &; Poynter, W. D. (this issue). Using the research domain criteria framework to explore associations between MMPI–2–RF constructs and physiological variables assessed by eye-tracker technology. Journal of Personality Assessment. doi:10.1080/00223891.2016.1228067[Taylor &; Francis Online] , [Google Scholar]) link the MMPI–2–RF scales to psychophysiological constructs inspired by the National Institute of Mental Health (NIMH) Research Domain Criteria. Sellbom and Smith (this issue Sellbom, M. (this issue). Mapping the MMPI–2–RF Specific Problems scales onto extant psychopathology structures. Journal of Personality Assessment. doi:10.1080/00223891.2016.1206909[Taylor &; Francis Online] , [Google Scholar]) find support for MMPI–2–RF scale hypotheses in covering personality psychopathology in general, whereas Klein Haneveld, Kamphuis, Smid, and Forbey (this issue Klein Haneveld, E., Kamphuis, J.H., Smid, W., &; Forbey, J. D. (this issue). Using MMPI–2–RF correlates to elucidate the PCL–R and its four facets in a sample of male forensic psychiatric patients. Journal of Personality Assessment. doi:10.1080/00223891.2016.1228655[Taylor &; Francis Online] , [Google Scholar]) and Kutchen et al. (this issue Kutchen, T. J., Wygant, D. B., Tylicki, J. L., Dieter, A. M., Veltri, C. O., &; Sellbom, M. (this issue). Construct validity of the MMPI–2–RF Triarchic Psychopathy scales in correctional and collegiate samples. Journal of Personality Assessment. doi:10.1080/00223891.2016.1238829[Taylor &; Francis Online] , [Google Scholar]) demonstrate the utility of the MMPI–2–RF in capturing contemporary conceptualizations of the psychopathic personality. Finally, Franz, Harrop, and McCord (this issue Franz, A. O., Harrop, T. M., &; McCord, D. M. (this issue). Examining the construct validity of the MMPI–2–RF Interpersonal Functioning scales using the Computerized Adaptive Test of Personality Disorder as a comparative framework. Journal of Personality Assessment. doi:10.1080/00223891.2016.1222394[Taylor &; Francis Online] , [Google Scholar]) and Rogers et al. (this issue Rogers, M. L., Anestis, J. C., Harrop, T. M., Schneider, M., Bender, T. W., Ringer, F. B., &; Joiner, T. E. (this issue). Examination of MMPI–2–RF Substantive scales as indicators of acute suicidal affective disturbance components. Journal of Personality Assessment. doi:10.1080/00223891.2016.1222393[Taylor &; Francis Online] , [Google Scholar]) mapped the MMPI–2–RF scales onto more specific transdiagnostic constructs reflecting interpersonal functioning and suicide behavior proneness, respectively.     

Groupness and Leadership Perceptions in Relation to Social Identity in Youth Sport

Despite support for a number of consequences emanating from social identity in sport, much less is known pertaining to potential antecedents. This study sought to extend preliminary findings from recent youth sport research (e.g., Bruner et al., 2015 Bruner, M. W., Eys, M. A., Evans, M. B., &; Wilson, K. (2015). Interdependence and social identity in youth sport teams. Journal of Applied Sport Psychology, 27, 351–358.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) by investigating perceptions of groupness and leadership status in relation to social identity in 480 athletes. Results indicated that perceptions of groupness at the individual and team levels were positively related to social identity, as was being a formal or informal leader. As such, both identifying as a leader and perceiving an increased amount of groupness among teammates increased social identity.     

Using the TAT to Assess the Relation Between Gender Identity and the Use of Defense Mechanisms

The purpose of this study is to explore whether 2 different dimensions of personality, when assessed at an implicit level with the Thematic Apperception Test (TAT; Murray, 1943 Murray, H. A. (1943). Thematic Apperception Test manual. Cambridge, MA: Harvard University Press. [Google Scholar]) will show a theoretically meaningful coherence not demonstrated when 1 is assessed at an implicit level and the other at an explicit level. Gender identity and defense mechanisms were assessed implicitly using the TAT. Gender identity was compared with a self-report measure of gender-related attributes assessed at the explicit level. The results showed a theoretically meaningful coherence when different dispositions were assessed at the same level, but a lack of agreement when similar dispositions were assessed at different levels. The study is based on a secondary analysis of data from 2 previously published papers (Cramer, 1998 Cramer, P. (1998). Threat to gender representation: Identity and identification. Journal of Personality, 66, 335–354.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Cramer &; Westergren, 1999 Cramer, P., &; Hogan, K. (1975). Sex differences in verbal and play fantasy. Developmental Psychology, 11, 145–154.[Crossref], [Web of Science ®] , [Google Scholar]).     

Development of the Short Version of the Individuation Test for Emerging Adults (ITEA–S) and Its Measurement Invariance Across Slovene and U.S. Emerging Adults

In this study we developed a short version of the Individuation Test for Emerging Adults (ITEA–S) and tested its measurement invariance across Slovene and U.S. samples of emerging adults. The item reduction process resulted in retaining 21 out of 36 items. The content analysis of the retained and discarded items revealed that the ITEA–S adequately measures the 5 individuation domains (support seeking, connectedness, intrusiveness, self-reliance, and fear of disappointing the parent). In our samples, the ITEA–S demonstrated evidence for construct validity and its 5 scales showed adequate internal consistency. The scale scores were also meaningfully associated with the relevant demographic variables in both countries, as well as the three scales of the Psychological Separation Inventory (Hoffman, 1984 Hoffman, J. A. (1984). Psychological separation of late adolescents from their parents. Journal of Counseling Psychology, 31, 170–178.[Crossref], [Web of Science ®] , [Google Scholar]; the Slovene sample), and the scales of the Differentiation of Self–Revised questionnaire (Skowron &; Schmitt, 2003 Skowron, E. A., &; Schmitt, T. A. (2003). Assessing interpersonal fusion: Reliability and validity of a new DSI Fusion with Others subscale. Journal of Marital and Family Therapy, 29, 209–222.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; the U.S. sample). The results of multiple group confirmatory factor analyses supported the hypothesis of full metric and partial scalar invariance for both ITEA–S forms (in relation to mother and father) across the 2 country groups.     

Development of a Response Inconsistency Scale for the Personality Inventory for DSM–5

The advent of a dimensional model of personality disorder included in DSM–5 has necessitated the development of a new measurement scheme, specifically a self-report questionnaire termed the Personality Inventory for DSM–5 (PID–5; Krueger, Derringer, Markon, Watson, &; Skodol, 2012 Krueger, R. F., Derringer, J., Markon, K. E., Watson, D., &; Skodol, A. E. (2012). Initial construction of a maladaptive personality trait model and inventory for DSM–5. Psychological Medicine, 42, 1879–1890. doi:10.1017/S0033291711002674[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). However, there are many threats to the validity of a self-report measure, including response inconsistency. This study outlines the development of an inconsistency scale for the PID–5. Across both college student and clinical samples, the inconsistency scale was able to reliably differentiate real from random responding. Random responses led to increased scores on the PID–5 facets, indicating the importance of detecting inconsistent responding prior to test interpretation. Thus, this inconsistency scale could be of use to researchers and clinicians in detecting inconsistent responses to this new personality disorder measure.