Calibrated Bayes Factors Should Not Be Used: A Reply to Hoijtink,van Kooten,and Hulsker

Hoijtink, Kooten, and Hulsker (2016 Hoijtink, H., van Kooten, P., &; Hulsker, K. (2016). Why Bayesian psychologists should change the way they use the Bayes factor. Multivariate Behavioral Research, 51, 1--9. doi: 10.1080/00273171.2014.969364.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) present a method for choosing the prior distribution for an analysis with Bayes factor that is based on controlling error rates, which they advocate as an alternative to our more subjective methods (Morey &; Rouder, 2014 Morey, R.D., &; Rouder, J.N. (2014). Bayesfactor: Computation of Bayes factors for common designs. R package version 0.9.9. Retrieved from http://CRAN.R-project.org/package=BayesFactor [Google Scholar]; Rouder, Speckman, Sun, Morey, &; Iverson, 2009 Rouder, J.N., Speckman, P.L., Sun, D., Morey, R.D., &; Iverson, G. (2009). Bayesian t-tests for accepting and rejecting the null hypothesis. Psychonomic Bulletin and Review, 16, 225–237. doi: 10.3758/PBR.16.2.225[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]; Wagenmakers, Wetzels, Borsboom, &; van der Maas, 2011 Wagenmakers, E.-J., Wetzels, R., Borsboom, D., &; van der Maas, H. (2011). Why psychologists must change the way they analyze their data: The case of psi. A comment on Bem (2011). Journal of Personality and Social Psychology, 100, 426–432. doi: 10.1037/a0022790[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). We show that the method they advocate amounts to a simple significance test, and that the resulting Bayes factors are not interpretable. Additionally, their method fails in common circumstances, and has the potential to yield arbitrarily high Type II error rates. After critiquing their method, we outline the position on subjectivity that underlies our advocacy of Bayes factors.     

Considering too few alternatives: The mental model theory of extensional reasoning

When solving a simple probabilistic problem, people tend to build an incomplete mental representation. We observe this pattern in responses to probabilistic problems over a set of premises using the conjunction, disjunction, and conditional propositional connectives. The mental model theory of extensional reasoning explains this bias towards underestimating the number of possibilities: In reckoning with different interpretations of the premises (logical rules, mental model theoretical, and, specific to conditional premises, conjunction and biconditional interpretation) the mental model theory accounts for the majority of observations. Different interpretations of a premise result in a build-up of mental models that are often incomplete. These mental models are processed using either an extensional strategy relying on proportions amongst models, or a conflict monitoring strategy. The consequence of considering too few possibilities is an erroneous probability estimate akin to that faced by decision makers who fail to generate and consider all alternatives, a characteristic of bounded rationality. We compare our results to the results published by Johnson-Laird, Legrenzi, Girotto, Legrenzi, and Caverni [Johnson-Laird, P., Legrenzi, P., Girotto, V., Legrenzi, M., &; Caverni, J. (1999 Johnson-Laird, P., Legrenzi, P., Girotto, V., Legrenzi, M., &; Caverni, J. (1999). Naive probability: A mental model theory of extensional reasoning. Psychological Review, 106, 62–88. doi:10.1037/0033-295X.106.1.62[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). Naive probability: A mental model theory of extensional reasoning. Psychological Review, 106 Johnson-Laird, P., Legrenzi, P., Girotto, V., Legrenzi, M., &; Caverni, J. (1999). Naive probability: A mental model theory of extensional reasoning. Psychological Review, 106, 62–88. doi:10.1037/0033-295X.106.1.62[Crossref], [PubMed], [Web of Science ®] , [Google Scholar], 62 Johnson-Laird, P., Legrenzi, P., Girotto, V., Legrenzi, M., &; Caverni, J. (1999). Naive probability: A mental model theory of extensional reasoning. Psychological Review, 106, 62–88. doi:10.1037/0033-295X.106.1.62[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]–88 Johnson-Laird, P., Legrenzi, P., Girotto, V., Legrenzi, M., &; Caverni, J. (1999). Naive probability: A mental model theory of extensional reasoning. Psychological Review, 106, 62–88. doi:10.1037/0033-295X.106.1.62[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]. doi:10 Johnson-Laird, P., Legrenzi, P., Girotto, V., Legrenzi, M., &; Caverni, J. (1999). Naive probability: A mental model theory of extensional reasoning. Psychological Review, 106, 62–88. doi:10.1037/0033-295X.106.1.62[Crossref], [PubMed], [Web of Science ®] , [Google Scholar].1037 Johnson-Laird, P., Legrenzi, P., Girotto, V., Legrenzi, M., &; Caverni, J. (1999). Naive probability: A mental model theory of extensional reasoning. Psychological Review, 106, 62–88. doi:10.1037/0033-295X.106.1.62[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]/0033 Johnson-Laird, P., Legrenzi, P., Girotto, V., Legrenzi, M., &; Caverni, J. (1999). Naive probability: A mental model theory of extensional reasoning. Psychological Review, 106, 62–88. doi:10.1037/0033-295X.106.1.62[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]-295X Johnson-Laird, P., Legrenzi, P., Girotto, V., Legrenzi, M., &; Caverni, J. (1999). Naive probability: A mental model theory of extensional reasoning. Psychological Review, 106, 62–88. doi:10.1037/0033-295X.106.1.62[Crossref], [PubMed], [Web of Science ®] , [Google Scholar].106 Johnson-Laird, P., Legrenzi, P., Girotto, V., Legrenzi, M., &; Caverni, J. (1999). Naive probability: A mental model theory of extensional reasoning. Psychological Review, 106, 62–88. doi:10.1037/0033-295X.106.1.62[Crossref], [PubMed], [Web of Science ®] , [Google Scholar].1 Johnson-Laird, P., Legrenzi, P., Girotto, V., Legrenzi, M., &; Caverni, J. (1999). Naive probability: A mental model theory of extensional reasoning. Psychological Review, 106, 62–88. doi:10.1037/0033-295X.106.1.62[Crossref], [PubMed], [Web of Science ®] , [Google Scholar].62 Johnson-Laird, P., Legrenzi, P., Girotto, V., Legrenzi, M., &; Caverni, J. (1999). Naive probability: A mental model theory of extensional reasoning. Psychological Review, 106, 62–88. doi:10.1037/0033-295X.106.1.62[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]], and we observe lower performance levels than those in the original article.     

Examining Current Conceptualizations of Psychopathology With the MMPI–2/MMPI–2–RF Restructured Clinical Scales: Preliminary Findings From a Cross-Cultural Study

Watson (2005 Watson, D. (2005). Rethinking the mood and anxiety disorders: A quantitative hierarchical model for DSM–V. Journal of Abnormal Psychology, 114, 522–536.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) proposed a hierarchical reorganization of the underlying structure of emotional disorders. This study cross-culturally evaluated Watson's (2005) structure of mood and anxiety disorders, using mainly dichotomous criteria, and explored the placement of obsessive–compulsive disorder (OCD) in this model. It also tested Sellbom, Ben-Porath, and Bagby's (2008) proposed elaboration of the 2-factor model (positive and negative activation) that incorporates a higher order dimension of demoralization. One hundred men and 133 women from psychiatric settings in Israel completed the Minnesota Multiphasic Personality Inventory–2 (Butcher et al., 2001 Butcher, J. N., Graham, J. R., Ben-Porath, Y. S., Tellegen, A., Dahlstrom, W. G., &; Kaemmer, B. (2001). Minnesota Multiphasic Personality Inventory–2 (MMPI–2): Manual for administration, scoring and interpretation (Rev. ed.). Minneapolis: University of Minnesota Press.[Crossref] , [Google Scholar]) and the Maudsley Obsessional–Compulsive Inventory (Hodgson &; Rachman, 1977 Hodgson, R. J., &; Rachman, S. (1977). Obsessive–compulsive complaints. Behaviour Research and Therapy, 15, 389–395.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). They were interviewed using the Mini International Neuropsychiatric Interview (Sheehan et al., 1998 Sheehan, D. V., Lecrubier, Y., Sheehan, K. H., Amorim, P., Janavs, J., &; Weiller, E. (1998). The Mini-International Neuropsychiatric Interview (M.I.N.I.): The development and validation of a structured diagnostic psychiatric interview for DSM–IV and ICD–10. Journal of Clinical Psychiatry, 59, 22–33.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). Confirmatory factor analyses replicated Watson's structure for women but not for men. Mixed results were obtained regarding OCD's location in the model. Findings among women support the applicability of Watson's (2005) model across a variety of assessment modalities, as well as in a different language and for diversified cultural backgrounds. This conclusion, however, should be tempered in consideration of the results among men. Findings also provide evidence of the importance of demoralization in mood and anxiety disorders.     

The Effect of the Accountability Variables of Responsibility,Openness, and Answerability on Authentic Leadership

One salient aspect of authentic leadership is the possibility that it can be developed (Walumbwa, Avolio, Gardner, Wernsing, &; Peterson, 2008 Walumbwa, F. O., Avolio, B. J., Gardner, W. L., Wernsing, T. S., &; Peterson, S. J. (2008). Authentic leadership: Development and validation of a theory-based measure. Journal of Management, 34(1), 89–126. doi:10.1177/0149206307308913[Crossref], [Web of Science ®] , [Google Scholar]). However, the relative paucity of research on authentic leadership as a dependent variable needs to be addressed. The purpose of this cross-sectional quantitative study is to examine the three factors of accountability: (a) responsibility, (b) openness, and (c) answerability (Wood &; Winston, 2007 Wood, J. A., &; Winston, B. E. (2007). Development of three scales to measure leader accountability. Leadership &; Organization Development Journal, 28(2), 167–185. doi:10.1108/01437730710726859[Crossref] , [Google Scholar]) as antecedents to authentic leadership. Using survey results from a sample of full-time employees at six faith-based institutions of higher education in the United States, a predictive relationship was investigated through hierarchical regression analysis. The results indicated that the variables of responsibility, openness, and answerability predict the perception of authentic leadership.     

The Structure of Multidimensional Perfectionism: Support for a Bifactor Model With a Dominant General Factor

Evidence suggests perfectionism is a multidimensional construct composed of 2 higher order factors: perfectionistic strivings and perfectionistic concerns. However, the substantial overlap between perfectionistic strivings and perfectionistic concerns is problematic, as are the unanswered questions regarding the structure of perfectionism following removal of common variance. This research addressed this through bifactor modeling. Three student samples (N = 742) completed Hewitt and Flett's (1991 Hewitt, P. L., &; Flett, G. L. (1991). Perfectionism in the self and social contexts: Conceptualization, assessment, and association with psychopathology. Journal of Personality and Social Psychology, 60, 456.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) Multidimensional Perfectionism Scale, Frost, Marten, Lahart, and Rosenblate's (1990 Frost, R. O., Marten, P., Lahart, C., &; Rosenblate, R. (1990). The dimensions of perfectionism. Cognitive Therapy and Research, 14, 449–468.[Crossref], [Web of Science ®] , [Google Scholar]) Multidimensional Perfectionism Scale, and Slaney, Rice, Mobley, Trippi, and Ashby's (2001 Slaney, R. B., Rice, K. G., Mobley, M., Trippi, J., &; Ashby, J. S. (2001). The revised almost perfect scale. Measurement and Evaluation in Counseling and Development, 34, 130–145.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) Almost Perfect Scale–Revised. Greater support was consistently found for the bifactor model, relative to the 2-factor model. Results suggest the bifactor model best represents the structure of perfectionism and provide preliminary support for the use of a general factor score. Researchers are cautioned that removal of general variance may render the reliability of specific factors (i.e., perfectionistic strivings and perfectionistic concerns) suspect.     

Mind Perception and Individual Differences: A Replication and Extension

Mind perception involves attributing higher functional abilities to others (e.g., saying a dog feels pain). The relationships between mind perception and psychopathology—autism, psychopathy, and schizotypy—have been revealed by K. Gray, Jenkins, Heberlein, and Wegner (2011 Gray, K., Jenkins, A. C., Heberlein, A. S., &; Wegner, D. M. (2011). Distortions of mind perception in psychopathology. Proceedings of the National Academy of Sciences of the United States of America, 108, 477–479. doi:10.1073/pnas.1015493108[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]); however, mind perception has yet to be correlated with personality. Participants (N = 180) completed measures of personality, psychopathology, and mind perception. The psychopathology results were consistent with Gray et al. (2011 Gray, K., Jenkins, A. C., Heberlein, A. S., &; Wegner, D. M. (2011). Distortions of mind perception in psychopathology. Proceedings of the National Academy of Sciences of the United States of America, 108, 477–479. doi:10.1073/pnas.1015493108[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). The Big Five captured mind perception virtually as much as the three psychopathologies captured mind perception. Mind perception is not solely relevant to psychopathology; it is also relevant to everyday personality.     

Implicit and Explicit Sexual Motives as Related,But Distinct Characteristics

A measure of implicit sexual motives—the implicit AMORE—was constructed employing the Affect Misattribution Procedure (Payne, Cheng, Govorun, &; Stewart, 2005 Payne, B. K., Cheng, C. M., Govorun, O., &; Stewart, B. D. (2005). An inkblot for attitudes: Affect misattribution as implcit measurement. Journal of Personality and Social Psychology, 89, 277–293. doi:10.1037/0022-3514.89.3.277[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). Subscales paralleled the 8 dimensions identified previously by the self-report measure of sexual motives, the explicit AMORE (Hill &; Preston, 1996 Hill, C. A., &; Preston, L. K. (1996). Individual differences in the experience of sexual motivation: Theory and measurement of dispositional sexual motives. Journal of Sex Research, 33, 27–45. doi:10.1080/00224499609551812[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]). Confirmatory factor analyses supported the proposed 8-factor model in slightly revised form, which was confirmed based on a second independent set of participants. Consistent with hypotheses, the implicit scales correlated with nonconscious erotica-viewing behavior for women in a laboratory setting. In contrast to explicit scales, implicit scales were unrelated to self-report ratings of likely sexual behavior. Finally, self-reports of aspects of sexual behavior were generally associated with the measures of implicit motives independently of corresponding explicit motives for both women and men. The results support the conception of implicit sexual motives as related, but distinct from explicit sexual motives.     

Amplitude and Width Manipulations in Fitts' Paradigm: Comment on Heath et al. (2011) and Heath et al. (2016)

Heath, Weiler, Marriott, Elliott, and Binstead (2011 Heath, M., Weiler, J., Marriott, K. A., Elliott, D., &; Binstead, G. (2011). Revisiting Fitts and Peterson (1964): Width and Amplitude manipulations to the reaching environment elicit dissociable movement times. Canadian Journal of Experimental Psychology, 65, 259–268.1.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) and Heath, Samani, Tremblay, and Elliott (2016 Heath, M., Samani, A., Tremblay, L., &; Elliott, D. (2016). Fitts' theorem in oculomotor control: Dissociable movement times for amplitude and width manipulations. Journal of Motor Behavior, 48, 489–499.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) have claimed that there are dissociable movement times for amplitude and width manipulations in the Fitts' paradigm. This may to some extent be true, but the Heath et al. (2011 Heath, M., Weiler, J., Marriott, K. A., Elliott, D., &; Binstead, G. (2011). Revisiting Fitts and Peterson (1964): Width and Amplitude manipulations to the reaching environment elicit dissociable movement times. Canadian Journal of Experimental Psychology, 65, 259–268.1.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) and Heath et al. (2016 Heath, M., Samani, A., Tremblay, L., &; Elliott, D. (2016). Fitts' theorem in oculomotor control: Dissociable movement times for amplitude and width manipulations. Journal of Motor Behavior, 48, 489–499.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) data do not support that contention, as shown in this comment. It is shown that data from the research of Heath et al. is not in the range of index of difficulty where ongoing visual control would be used and hence their fits of data to Fitts' law are spurious. The data of Heath et al. (2011 Heath, M., Weiler, J., Marriott, K. A., Elliott, D., &; Binstead, G. (2011). Revisiting Fitts and Peterson (1964): Width and Amplitude manipulations to the reaching environment elicit dissociable movement times. Canadian Journal of Experimental Psychology, 65, 259–268.1.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) for arm movements and for the primary eye saccade submovements of Heath et al. (2016 Heath, M., Samani, A., Tremblay, L., &; Elliott, D. (2016). Fitts' theorem in oculomotor control: Dissociable movement times for amplitude and width manipulations. Journal of Motor Behavior, 48, 489–499.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) are well correlated by the ballistic movement time equation of Hoffmann (1981 Hoffmann, E. R. (1981). An ergonomic approach to predetermined motion time systems. Proceedings of the 9th National Conference of the Institute of Industrial Engineers, Australia, 30–47. [Google Scholar]) and Gan and Hoffmann (1988 Gan, K.-C. &; Hoffmann, E. R. (1988). Geometrical conditions for ballistic and visually controlled movements. Ergonomics, 31, 829–839.[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]). When the ballistic equation is used to model data for constant amplitude and constant target width conditions, the effects of the amplitude and width manipulations disappear. Other research indicates that the independent effects of movement amplitude occur due to changes in the time for the distance-covering phase of the movement.     

Computer Scoring of Emotional Awareness in a Nonclinical Population of Young Adults

The Levels of Emotional Awareness Scale (LEAS; Lane, Quinlan, Schwartz, Walker, &; Zeitlin, 1990 Lane, R. D., Quinlan, D. M., Schwartz, G. E., Walker, P. A., &; Zeitlin, S. B. (1990). The Levels of Emotional Awareness Scale: A cognitive-developmental measure of emotion. Journal of Personality Assessment, 55, 124–134. doi:10.1207/s15327752jpa5501&;2_12[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) is an open-ended measure of the ability to describe emotional reactions. Scoring the LEAS by hand is complex and time consuming (Barchard, Bajgar, Leaf, &; Lane, 2010 Barchard, K. A., Bajgar, J., Leaf, D. E., &; Lane, R. D. (2010). Computer scoring of the Levels of Emotional Awareness Scale. Behavior Research Methods, 42, 586–595. doi:10.3758/BRM.42.2.586[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). Therefore, Program for Open-Ended Scoring (POES; Leaf &; Barchard, 2010 Leaf, D. E., &; Barchard, K. A. (2010). Program for Open-Ended Scoring [POES] version 1.4.1 [Unpublished program]. Available from Kim Barchard, Department of Psychology, University of Nevada, Las Vegas, 4505 Maryland Parkway, Las Vegas, NV, 89154–5030, kim.barchard@unlv.edu [Google Scholar]) was designed to score the LEAS quickly and easily. Using 268 undergraduates, this article compares traditional LEAS hand scoring to 6 POES methods, 2 of which are holistic methods that have never before been examined. Based on split-half reliability, correlations with measures of emotional and social intelligence, and partial correlations once response length and vocabulary were partialed out, we recommend 3 of the POES methods when testing nonclinical samples of young adults. Because POES scoring is fast and efficient, it allows more researchers and clinicians to use the LEAS, thus moving away from self-report measures of emotional awareness.     

A Cross-Cultural Analysis of the Infant Behavior Questionnaire Very Short Form: An Item Response Theory Analysis of Infant Temperament in New Zealand

The Infant Behavior Questionnaire–Revised Very Short Form (IBQ–R VSF; Putnam, Helbig, Gartstein, Rothbart, &; Leerkes, 2014 Putnam, S. P., Helbig, A. L., Gartstein, M. A., Rothbart, M. K., &; Leerkes, E. (2014). Development and assessment of short and very short forms of the Infant Behavior Questionnaire–Revised. Journal of Personality Assessment, 96, 445–458. doi:10.1080/00223891.2013.841171[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]) is a newly published measure of infant temperament with a 3-factor structure. Recently Peterson et al. (2017 Peterson, E. R., Waldie, K. E., Mohal, J., Reese, E., Atatoa Carr, P.E., Grant, C. C., &; Morton, S. M. B. (2017). Infant Behavior Questionnaire–Revised Very Short Form: A new factor structure's associations with parenting perceptions and child language outcomes. Journal of Personality Assessment. Advance online publication. doi:10.1080/00223891.2017.1287709[Taylor &; Francis Online] , [Google Scholar]) suggested that a 5-factor structure (Positive Affectivity/Surgency, Negative Emotionality, Orienting Capacity, Affiliation/Regulation, and Fear) was more parsimonious and showed promising reliability and predictive validity in a large, diverse sample. However, little is known about the 5-factor model's precision across the temperament dimensions range and whether it discriminates equally well across ethnicities. A total of 5,567 mothers responded to the IBQ–R VSF in relation to their infants (N = 5,639) between 23 and 52 weeks old. Using item response theory, we conducted a series of 2 parameter logistic item response models and found that 5 IBQ–R VSF temperament dimensions showed a good distribution of estimates across each latent trait range and these estimates centered close to the population mean. The IBQ–R VSF was also similarly precise across 4 ethnic groups (European, Māori, Pacific peoples, and Asians), suggesting that it can be used as comparable measure for infant temperament in a diversity of ethnic groups.     

Mapping the MMPI–2/MMPI–2–RF Restructured Clinical Scales Onto Mood Markers in an Israeli Sample

This study cross-culturally evaluated the Minnesota Multiphasic Personality Inventory–2/MMPI–2 Restructured Form (MMPI–2/MMPI–2–RF) emotion-focused Restructured Clinical (RC) Scales to examine whether their patterns of associations with positive affect (PA) and negative affect (NA) are as expected based on Tellegen, Watson, and Clark's (1999a Tellegen, A., Watson, D., &; Clark, L. A. (1999a). Further support for a hierarchical model of affect. Psychological Science, 10, 307–309.[Crossref], [Web of Science ®] , [Google Scholar], 1999b Tellegen, A., Watson, D., &; Clark, L. A. (1999b). On the dimensional and hierarchical structure of affect. Psychological Science, 10, 297–303.[Crossref], [Web of Science ®] , [Google Scholar]) mood model. The sample was composed of 100 men and 133 women from psychiatric settings in Israel who completed the MMPI–2 and the Mood Check List (MCL; Zevon &; Tellegen, 1982 Zevon, M. A., &; Tellegen, A. (1982). The structure of mood change: An idiographic/nomothetic analysis. Journal of Personality and Social Psychology, 43, 111–122.[Crossref], [Web of Science ®] , [Google Scholar]). Results indicated that RCd was substantially correlated with both PA and NA in opposite directions, and that RC2 and RC7 were more highly correlated with PA and NA, respectively. Further, when compared with their Clinical Scale counterparts, RC2 and RC7 exhibited comparable convergent validities and improved discriminant properties. Findings provide support for Tellegen et al.'s (2003 Tellegen, A., Ben-Porath, Y. S., McNulty, J. L., Arbisi, P. A., Graham, J. R., &; Kaemmer, B. (2003). MMPI–2 Restructured Clinical (RC) scales: Development, validation, and interpretation. Minneapolis: University of Minnesota Press. [Google Scholar]) goal to link the RC scales to contemporary conceptualizations of mood.     

Development of a Response Inconsistency Scale for the Personality Inventory for DSM–5

The advent of a dimensional model of personality disorder included in DSM–5 has necessitated the development of a new measurement scheme, specifically a self-report questionnaire termed the Personality Inventory for DSM–5 (PID–5; Krueger, Derringer, Markon, Watson, &; Skodol, 2012 Krueger, R. F., Derringer, J., Markon, K. E., Watson, D., &; Skodol, A. E. (2012). Initial construction of a maladaptive personality trait model and inventory for DSM–5. Psychological Medicine, 42, 1879–1890. doi:10.1017/S0033291711002674[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). However, there are many threats to the validity of a self-report measure, including response inconsistency. This study outlines the development of an inconsistency scale for the PID–5. Across both college student and clinical samples, the inconsistency scale was able to reliably differentiate real from random responding. Random responses led to increased scores on the PID–5 facets, indicating the importance of detecting inconsistent responding prior to test interpretation. Thus, this inconsistency scale could be of use to researchers and clinicians in detecting inconsistent responses to this new personality disorder measure.     

Extending a Multilab Preregistered Replication of the Ego-Depletion Effect to a Research Program

We reanalyze the recent multilab preregistered study on ego-depletion by Hagger and Chatzisarantis (2016 Hagger, M. S., &; Chatzisarantis, N. L. D. (2016). A multilab preregistered replication of the ego-depletion effect. Perspectives on Psychological Science, 11, 546–573. doi:10.1177/1745691616652873[Crossref], [Web of Science ®] , [Google Scholar]) as if their data were obtained under the research program-strategy (Witte &; Zenker, 2016a Witte, E. H., &; Zenker, F. (2016a). Beyond schools—Reply to Marsman, Ly, and Wagenmakers. Basic and Applied Social Psychology, 38, 313–317. doi:10.1080/01973533.2016.1227710[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar], 2016b Witte, E. H., &; Zenker, F. (2016b). Reconstructing recent work on macro-social stress as a research program. Basic and Applied Social Psychology, 38, 301–307. doi:10.1080/01973533.2016.1207077[Taylor &; Francis Online], [Web of Science ®] , [Google Scholar]). This strengthens Hagger and Chatzisarantis’s (2016 Hagger, M. S., &; Chatzisarantis, N. L. D. (2016). A multilab preregistered replication of the ego-depletion effect. Perspectives on Psychological Science, 11, 546–573. doi:10.1177/1745691616652873[Crossref], [Web of Science ®] , [Google Scholar]) main conclusion, because our reanalysis more directly corroborates the absence of a medium-sized, or a small-sized, ego-depletion effect (d?=?.50 under α?=?β?=?.05; d?=?.20 under α?=?β?=?.01). We explain how a smaller ego-depletion effect of d?=?.04 can be tested under similar conditions, having determined this value by maximum likelihood estimation, and compare the research program-strategy to a standard meta-analytic integration.     

Unmasking a shady mirror effect: Recognition of normal versus obscured faces

Hockley, Hemsworth, and Consoli (1999) Hockley, W. E., Hemsworth, D. E. and Consoli, A. 1999. Shades of the mirror effect: Recognition of faces with and without sunglasses. Memory & Cognition, 27: 128–138. [Crossref], [PubMed], [Web of Science ®] , [Google Scholar] found that following the study of normal faces, a recognition test of normal faces versus faces wearing sunglasses produced a mirror effect: The sunglasses manipulation decreased hit rates and increased false-alarm rates. The stimuli used by Hockley et al. (1999) Hockley, W. E., Hemsworth, D. E. and Consoli, A. 1999. Shades of the mirror effect: Recognition of faces with and without sunglasses. Memory & Cognition, 27: 128–138. [Crossref], [PubMed], [Web of Science ®] , [Google Scholar] consisted of separate poses of models wearing or not wearing sunglasses. In the current experiments, we separately manipulated same versus different depictions of individual faces and whether or not the faces were partially obscured. The results of a simulation and four experiments suggest that the test-based, mirror effect observed by Hockley et al. (1999) Hockley, W. E., Hemsworth, D. E. and Consoli, A. 1999. Shades of the mirror effect: Recognition of faces with and without sunglasses. Memory & Cognition, 27: 128–138. [Crossref], [PubMed], [Web of Science ®] , [Google Scholar] is actually two separable effects.     

Memorable Experiences in Therapeutic Assessment: Inviting the Patient's Perspective Following a Pretreatment Randomized Controlled Trial

Accumulating evidence documents the efficacy of Therapeutic Assessment (TA) in terms of symptom reduction and other outcomes, but only minimal data speak to the patient's perspective of what is memorable, or potentially important, about this intervention. In line with the humanistic and phenomenological philosophy of TA, we solicited patient input by asking personality disorder (PD) patients who participated in a recent randomized controlled trial (De Saeger et al., 2014 De Saeger, H., Kamphuis, J. H., Finn, S. E., Verheul, R., Smith, J. D., van Busschbach, J. J. V., … Horn, E. (2014). Therapeutic Assessment promotes treatment readiness but does not affect symptom change in patients with personality disorders: Findings from a randomized clinical trial. Psychological Assessment, 26, 474–483. doi:10.1037/a0035667[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]) about their experiences. We report on 10 PD patients who were administered semistructured interviews designed to assess an in-depth perspective of undergoing TA. Our methodological approach can be described as phenomenological and integrative, approximating guidelines provided by the Consensual Qualitative Research paradigm (Hill, 2012 Hill, C. E. (Ed.). (2012). Consensual qualitative research: A practical resource for investigating social science phenomena. Washington, DC: American Psychological Association. [Google Scholar]). Four core content domains emerged from the transcribed and coded interview protocols: (a) relationship aspects, (b) new insight into personal dynamics, (c) sense of empowerment, and (d) validation of self. Novel experiences were mostly of a relational nature, and pertained to feeling of being treated like an equal and essential partner in a highly individualized venture. Research and clinical implications of these patient reports of TA participation are discussed.     

Using the Research Domain Criteria Framework to Explore Associations Between MMPI–2–RF Constructs and Physiological Variables Assessed by Eye-Tracker Technology

The National Institute of Mental Health has proposed a paradigm shift in the conceptualization of psychopathology, abandoning the traditional categorical model in favor of one based on hierarchically organized dimensional constructs (Insel et al., 2010 Insel, T., Cuthbert, B., Garvey, M., Heinssen, R., Pine, D. S., Quinn, K., … Wang, P. (2010). Research domain criteria (RDoC): Toward a new classification framework for research on mental disorders. American Journal of Psychiatry, 167, 748–751.[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). One explicit goal of this initiative, the Research Domain Criteria (RDoC) project, is to facilitate the incorporation of newly available neurobiologic variables into research on psychopathology. The Minnesota Multiphasic Personality Inventory–2–Restructured Form (MMPI–2–RF; Ben-Porath &; Tellegen, 2008/2011 Ben-Porath, Y., &; Tellegen, A. (2011). Minnesota Multiphasic Personality Inventory–Restructured Form: Manual for administration, scoring, and interpretation. Minneapolis: University of Minnesota Press. (Original work published 2008) [Google Scholar]) represents a similar paradigm shift, also adopting a hierarchical arrangement of dimensional constructs. This study examined associations between MMPI–2–RF measures of psychopathology and eye-movement metrics. Participants were college students (n = 270) who completed the MMPI–2–RF and then viewed a sequence of 30-s video clips. Results show a pattern of positive correlations between pupil size and emotional/internalizing dysfunction scales when viewing video eliciting negative emotional reactions, reflecting greater arousability in individuals with higher scores on these measures. In contrast, when viewing stimuli depicting angry, threatening material, a clear pattern of negative correlations was found between pupil size and behavioral/externalizing trait measures. These data add to the construct validity of the MMPI–2–RF and support the use of the RDoC matrix as a framework for research on psychopathology.     

Lexicality and Stimulus Length Effects in Italian Dyslexics: Role of the Overadditivity Effect

The effect of lexicality and stimulus length was studied in 32 third- and fourth-grade Italian dyslexics and in 86 age-matched controls. A visual lexical decision task was used. As proposed by Faust et al. (1999) Faust, M. E., Balota, D. A., Spieler, D. H. and Ferraro, F. R. 1999. Individual differences in information-processing rate and amount: Implications for group differences in response latency. Psychological Bulletin, 125: 777–799. [INFOTRIEVE][CROSSREF][CSA][Crossref], [PubMed], [Web of Science ®] , [Google Scholar], the results were analyzed in terms of raw reaction time (RT) data and using the z-score transformation to control for the presence of overadditivity effects. In terms of RTs, dyslexics showed a larger difference between words and nonwords (lexicality effect) and between short and long stimuli (length effect) than proficient readers. When data were transformed into z scores, only the group by length interaction remained significant while that with lexicality vanished. This pattern indicates that stimulus length has a specific role in Italian dyslexics’ reading deficit; in contrast, slowness in responding to nonwords was not specific but was interpreted as one aspect of dyslexics’ general inability to deal with alphabetical material (overadditivity effect).     

Introduction to the Special Section: Linking the MMPI–2–RF to Contemporary Models of Psychopathology

This special section considers 9 independent articles that seek to link the Minnesota Multiphasic Personality Inventory–2–Restructured Form (MMPI–2–RF; Ben-Porath &; Tellegen, 2008/2011 Ben-Porath, Y. S., &; Tellegen, A. (2011). MMPI–2–RF (Minnesota Multiphasic Personality Inventory–2 Restructured Form) manual. Minneapolis: University of Minnesota Press. (Original work published 2008) [Google Scholar]) to contemporary models of psychopathology. Sellbom (this issue Sellbom, M. (this issue). Mapping the MMPI–2–RF Specific Problems scales onto extant psychopathology structures. Journal of Personality Assessment. doi:10.1080/00223891.2016.1206909[Taylor &; Francis Online] , [Google Scholar]) maps the Specific Problems scales onto hierarchical psychopathology structures, whereas Romero, Toorabally, Burchett, Tarescavage, and Glassmire (this issue Romero, I. E., Toorabally, N., Burchett, D., Tarescavage, A. M., &; Glassmire, D. M. (this issue). Mapping the MMPI–2–RF Substantive scales onto internalizing, externalizing, and thought dysfunction dimensions in a forensic inpatient setting. Journal of Personality Assessment. doi:10.1080/00223891.2016.1223681[Taylor &; Francis Online] , [Google Scholar]) and Shkalim, Almagor, and Ben-Porath (this issue Shkalim, E., Almagor, M., &; Ben-Porath, Y. S. (this issue). Examining current conceptualizations of psychopathology with the MMPI–2/MMPI–2–RF Restructured Clinical scales: Preliminary findings from a cross-cultural study. Journal of Personality Assessment. doi:10.1080/00223891.2016.1189429[Taylor &; Francis Online] , [Google Scholar]) show evidence of linking the instruments' scales to diagnostic representations of common higher order psychopathology constructs. McCord, Achee, Cannon, Harrop, and Poynter (this issue McCord, D. M., Achee, M. C., Cannon, E. M., Harrop, T. M., &; Poynter, W. D. (this issue). Using the research domain criteria framework to explore associations between MMPI–2–RF constructs and physiological variables assessed by eye-tracker technology. Journal of Personality Assessment. doi:10.1080/00223891.2016.1228067[Taylor &; Francis Online] , [Google Scholar]) link the MMPI–2–RF scales to psychophysiological constructs inspired by the National Institute of Mental Health (NIMH) Research Domain Criteria. Sellbom and Smith (this issue Sellbom, M. (this issue). Mapping the MMPI–2–RF Specific Problems scales onto extant psychopathology structures. Journal of Personality Assessment. doi:10.1080/00223891.2016.1206909[Taylor &; Francis Online] , [Google Scholar]) find support for MMPI–2–RF scale hypotheses in covering personality psychopathology in general, whereas Klein Haneveld, Kamphuis, Smid, and Forbey (this issue Klein Haneveld, E., Kamphuis, J.H., Smid, W., &; Forbey, J. D. (this issue). Using MMPI–2–RF correlates to elucidate the PCL–R and its four facets in a sample of male forensic psychiatric patients. Journal of Personality Assessment. doi:10.1080/00223891.2016.1228655[Taylor &; Francis Online] , [Google Scholar]) and Kutchen et al. (this issue Kutchen, T. J., Wygant, D. B., Tylicki, J. L., Dieter, A. M., Veltri, C. O., &; Sellbom, M. (this issue). Construct validity of the MMPI–2–RF Triarchic Psychopathy scales in correctional and collegiate samples. Journal of Personality Assessment. doi:10.1080/00223891.2016.1238829[Taylor &; Francis Online] , [Google Scholar]) demonstrate the utility of the MMPI–2–RF in capturing contemporary conceptualizations of the psychopathic personality. Finally, Franz, Harrop, and McCord (this issue Franz, A. O., Harrop, T. M., &; McCord, D. M. (this issue). Examining the construct validity of the MMPI–2–RF Interpersonal Functioning scales using the Computerized Adaptive Test of Personality Disorder as a comparative framework. Journal of Personality Assessment. doi:10.1080/00223891.2016.1222394[Taylor &; Francis Online] , [Google Scholar]) and Rogers et al. (this issue Rogers, M. L., Anestis, J. C., Harrop, T. M., Schneider, M., Bender, T. W., Ringer, F. B., &; Joiner, T. E. (this issue). Examination of MMPI–2–RF Substantive scales as indicators of acute suicidal affective disturbance components. Journal of Personality Assessment. doi:10.1080/00223891.2016.1222393[Taylor &; Francis Online] , [Google Scholar]) mapped the MMPI–2–RF scales onto more specific transdiagnostic constructs reflecting interpersonal functioning and suicide behavior proneness, respectively.