The validity and utility of the positive presentation management and negative presentation management scales for the Revised NEO Personality Inventory

Schinka, Kinder, and Kremer developed "validity" scales for the Revised NEO Personality Inventory (NEO PI-R; Costa & McCrae) to detect underreporting-the Positive Presentation Management (PPM) Scale and overreporting-the Negative Presentation Management (NPM) Scale. In this investigation, the clinical utility of these scales was examined using the established validity scales from the Minnesota Multiphasic Personality Inventory-2 (MMPI-2; Butcher et al.) as the referent. The sample was composed of 370 psychiatric patients who completed the NEO PI-R and the MMPI-2 as part of a routine evaluation. Results indicated that response distortion compromised the utility of the NEO PI-R domain scales. Moreover, the PPM and NPM scales and an NPM-PPM index significantly differentiated invalid under-and overreporting groups from a valid responding group. The PPM and NPM-PPM index were adequate in classifying under- and overreporters, respectively.     

On the usefulness of measures of normal personality for clinical assessment: evidence of the incremental validity of the Revised NEO Personality Inventory

As a means of examining the incremental validity of a normal personality measure in the prediction of selected Axis I and II diagnoses, 1,342 inpatient substance abusers completed the Revised NEO Personality Inventory (NEO-PI-R) and the Minnesota Multiphasic Personality Inventory--2 (MMPI-2) and were assessed with structured clinical interviews to determine diagnostic status. Results demonstrated that scores from the NEO-PI-R (a) were substantially related to the majority of diagnoses, accounting for between 8% and 26% of the variance in the diagnostic criteria; (b) explained an additional 3% to 8% of the variability beyond 28 selected MMPI-2 scale scores; (c) increased diagnostic classification an additional 7% to 23% beyond MMPI-2 scale scores; and (d) were significantly more useful when examined at the facet trait level than at the domain trait level. Implications for incorporating measures of normal personality into clinical assessment batteries are discussed.     

Searching for Conscientiousness on the MMPI-2

It has been argued that the revised Minnesota Multiphasic Personality Inventory (MMPI-2) fails to measure the Big Five dimension of conscientiousness (C) an assertion supported by the research finding that none of the factors underlying the MMPI correlate substantially with the C factor of the NEO Personality Inventory (NEO-PI)—a popular operationalization of the Big Five model. In this study we reconsidered the relationship between the MMPI-2 item pool and the C factor of the NEO-PI-R (Form S). Collections of MMPI-2 C markers did not correlate much higher than .5 with the NEO-PI-R factor scale in cross-validation hold-out samples. Most pervasive, however, was the finding that MMPI-2 item markers of C were also strongly (in many cases, more highly) related to the NEO-PI-R factor of neuroticism (N). Efforts to purify collections of MMPI-2 C markers, first by careful item selection and then by suppression of N variance, were met with limited success. Intercorrelations among NEO-PI-R scales suggest that the difficulty in finding markers that discriminate between N and C extends beyond any shortcomings of the MMPI-2 item pool.     

Searching for conscientiousness on the MMPI-2

It has been argued that the revised Minnesota Multiphasic Personality Inventory (MMPI-2) fails to measure the Big Five dimension of conscientiousness (C) an assertion supported by the research finding that none of the factors underlying the MMPI correlate substantially with the C factor of the NEO Personality Inventory (NEO-PI)-a popular operationalization of the Big Five model. In this study we reconsidered the relationship between the MMPI-2 item pool and the C factor of the NEO-PI-R (Form S). Collections of MMPI-2 C markers did not correlate much higher than .5 with the NEO-PI-R factor scale in cross-validation hold-out samples. Most pervasive, however, was the finding that MMPI-2 item markers of C were also strongly (in many cases, more highly) related to the NEO-PI-R factor of neuroticism (N). Efforts to purify collections of MMPI-2 C markers, first by careful item selection and then by suppression of N variance, were met with limited success. Intercorrelations among NEO-PI-R scales suggest that the difficulty in finding markers that discriminate between N and C extends beyond any shortcomings of the MMPI-2 item pool.     

Semantic response consistency and protocol validity in structured personality assessment: the case of the NEO-PI-R

In this study we tested the hypothesis that groups of NEO Personality Inventory-Revised (NEO-PI-R; Costa & McCrae, 1992a) protocols identified as potentially invalid by an inconsistency scale (INC; Schinka, Kinder, & Kremer, 1997) would show reduced reliability and validity according to a series of psychometric tests. Data were obtained from 2 undergraduate student samples, a self-report group (n = 132) who provided NEO-PI-R self-ratings on 2 occasions separated by a 7- to 14-day interval and an informant group (n = 109) who provided ratings of well-known friends or relatives on 2 occasions separated by a 6 month interval. INC scores from the Time 1 protocols were used to divide these samples into low, moderate, and elevated inconsistency groups. In both samples, these 3 groups showed equivalent levels of reliability and validity as measured by: contingency coefficients for the 20 INC item responses across occasions; test-retest intraclass correlations of NEO-PI-R domain scores; convergent correlations with Goldberg's (1992) Bipolar Adjective Scale scores; and discriminant correlations between the 5 NEO-PI-R domain scores. The similarity of results across self-report and informant assessment contexts provides additional evidence that semantic consistency approaches to assessing protocol validity may overestimate the prevalence of random or careless response behavior in standard administration conditions. Several theories are discussed that accommodate the existence of valid inconsistency in structured personality assessment.     

On the invalidity of validity scales: evidence from self-reports and observer ratings in volunteer samples

Because of the potential for bias and error in questionnaire responding, many personality inventories include validity scales intended to correct biased scores or identify invalid protocols. The authors evaluated the utility of several types of validity scales in a volunteer sample of 72 men and 106 women who completed the Revised NEO Personality Inventory (NEO-PI-R; P. T. Costa & R. R. McCrae, 1992) and the Multidimensional Personality Questionnaire (MPQ; A. Tellegen, 1978/1982) and were rated by 2 acquaintances on the observer form of the NEO-PI-R. Analyses indicated that the validity indexes lacked utility in this sample. A partial replication (N = 1,728) also failed to find consistent support for the use of validity scales. The authors illustrate the use of informant ratings in assessing protocol validity and argue that psychological assessors should limit their use of validity scales and seek instead to improve the quality of personality assessments.     

An exploration of the impact of invalid MMPI-2 protocols on collateral self-report measure scores

Although a number of studies have examined the impact of invalid MMPI-2 (Butcher et al., 2001) response styles on MMPI-2 scale scores, limited research has specifically explored the effects that such response styles might have on conjointly administered collateral self-report measures. This study explored the potential impact of 2 invalidating response styles detected by the Validity scales of the MMPI-2, overreporting and underreporting, on scores of collateral self-report measures administered conjointly with the MMPI-2. The final group of participants included in analyses was 1,112 college students from a Midwestern university who completed all measures as part of a larger study. Results of t-test analyses suggested that if either over- or underreporting was indicated by the MMPI-2 Validity scales, the scores of most conjointly administered collateral measures were also significantly impacted. Overall, it appeared that test-takers who were identified as either over- or underreporting relied on such a response style across measures. Limitations and suggestions for future study are discussed.     

Predicting dimensions of personality disorder from domains and facets of the Five-Factor Model

We compared the utility of several trait models for describing personality disorder in a heterogeneous clinical sample (N = 94). Participants completed the Schedule for Nonadaptive and Adaptive Personality (SNAP; Clark, 1993b), a self-report measure that assesses traits relevant to personality disorder, and two measures of the Five-Factor Model: the Revised NEO Personality Inventory (NEO-PI-R; Costa and McCrae, 1992) and the Big Five Inventory (BFI; John, Donahue, & Kentle, 1991). Regression analyses indicated substantial overlap between the SNAP scales and the NEO-PI-R facets. In addition, use of the NEO-PI-R facets afforded substantial improvement over the Five-Factor Model domains in predicting interview-based ratings of DSM-IV personality disorder (American Psychiatric Association, 1994), such that the NEO facets and the SNAP scales demonstrated roughly equivalent levels of predictive power. Results support assessment of the full range of NEO-PI-R facets over the Five-Factor Model domains for both research and clinical use.     

The MMPI-2 Restructured Clinical (RC) Scales and restraints to innovation, or "what have they done to my song?"

Rogers, Sewell, Harrison, and Jordan (2006/this issue) largely replicate in an independent clinical sample the MMPI-2 Restructured Clinical (RC) Scales developed by Tellegen et al. (2003). Nichols (2006/this issue) raises numerous concerns about the development and utility of the RC Scales, which on close appraisal did not change our view that the scales are well conceived and potentially valuable to researchers and clinicians alike. We present two case studies in which the RC Scales helped clarify complex MMPI-2 (Butcher, Dahlstrom, Graham, Tellegen, & Kaemmer, 1989) profiles with multiple elevations on the Clinical, Content, Supplementary, and Personality Psychopathology Five (Harkness, McNulty, Ben-Porath, & Graham, 2001) scales. When interpretations refined by the RC Scales were discussed with the clients, each seemed to feel deeply understood. Reservations about instrument innovation can be appreciated as helping to counterbalance change and thereby ensure the MMPI-2's successful ongoing evolution. We discuss specific ways the MMPI-2 community could avoid polarization about the RC Scales.     

Effects of response sets on NEO-PI-R scores and their relations to external criteria

Validity scales indicate the extent to which the results of a self-report inventory are a valid indicator of the test taker's psychological functioning. Validity scales generally are designed to detect the common response sets of positive impression management (underreporting, or faking good), negative impression management (overreporting, or faking bad), and random responding. The revised NEO Personality Inventory (NEO-PI-R; Costa & McCrae, 1992b) is a popular personality assessment tool based on the 5-factor model of personality and is used in a variety of settings. The NEO-PI-R does not include objective validity scales to screen for positive or negative impression management. The purpose of this study was to examine the utility of recently proposed validity scales for detecting these response sets on the NEO-PI-R (Schinka, Kinder, & Kremer, 1997) and to examine the effects of positive and negative impression management on correlations between the NEO-PI-R and external criteria (the Interpersonal Adjective Scale-Revised-B5 [Wiggins & Trapnell, 1997] and the NEO-PI-R Form R). The validity scales discriminated with reasonable accuracy between standard responding and the 2 response sets. Additionally, most correlations between the NEO-PI-R and external criteria were significantly lower when participants were dissimulating than when responding to standard instructions. It appears that response sets of positive and negative impression management may pose a significant threat to the external validity of the NEO-PI-R and that validity scales for their detection might be a useful addition to the inventory.     

Effectiveness of NEO-PI-R research validity scales for discriminating analog malingering and genuine psychopathology

We investigated the research validity scales for the NEO Personality Inventory-Revised (NEO-PI-R) proposed by Schinka, Kinder, and Kremer (1997): Positive Presentation Management (PPM) and Negative Presentation Management (NPM). Additionally, an experimental analog to the Minnesota Multiphasic Personality Inventory-2's (MMPI-2; Butcher, Dahlstrom, Graham, Tellegen, & Kaemmer, 1989) F-K index was calculated by subtracting the raw score on PPM from the raw score on NPM (NPM-PPM). In 2 studies, all indexes showed significant between-group differences when samples of analog malingerers (n = 97) were contrasted with psychiatric outpatients (n = 272). The sensitivity and specificity of these validity indexes indicated that although none performed well in extremely low base rate environments, the NPM and NPM-PPM indexes showed promise when the base rate of faking bad rose to higher levels.     

Effectiveness of NEO-PI-R Research Validity Scales for Discriminating Analog Malingering and Genuine Psychopathology

We investigated the research validity scales for the NEO Personality Inventory-Revised (NEO-PI-R) proposed by Schinka, Kinder, and Kremer (1997): Positive Presentation Management (PPM) and Negative Presentation Management (NPM). Additionally, an experimental analog to the Minnesota Multiphasic Personality Inventory-2's (MMPI-2; Butcher, Dahlstrom, Graham, Tellegen, & Kaemmer, 1989) F - K index was calculated by subtracting the raw score on PPM from the raw score on NPM (NPM - PPM). In 2 studies, all indexes showed significant between-group differences when samples of analog malingerers (n = 97) were contrasted with psychiatric outpatients (n = 272). The sensitivity and specificity of these validity indexes indicated that although none performed well in extremely low base rate environments, the NPM and NPM - PPM indexes showed promise when the base rate of faking bad rose to higher levels.     

Comparability and validity of computerized adaptive testing with the MMPI-2

The comparability and validity of a computerized adaptive (CA) Minnesota Multiphasic Personality Inventory-2 (MMPI-2) were assessed in a sample of 571 undergraduate college students. The CA MMPI-2 administered adaptively Scales L, E the 10 clinical scales, and the 15 content scales, utilizing the countdown method (Butcher, Keller, & Bacon, 1985). All subjects completed the MMPI-2 twice, with three experimental conditions: booklet test-retest, booklet-CA, and conventional computerized (CC)-CA. Profiles across administration modalities show a high degree of similarity, providing evidence for the comparability of the three forms. Correlations between MMPI-2 scales and other psychometric measures (Beck Depression Inventory; Symptom Checklist-Revised; State-Trait Anxiety and Anger Scales; and the Anger Expression Scale) support the validity of the CA MMPI-2. Substantial item savings may be realized with the implementation of the countdown procedure.     

Personality and psychopathology: mapping the MMPI-2 Restructured Clinical (RC) Scales onto the Five Factor Model of personality

The MMPI-2 Restructured Clinical (RC) Scales (Tellegen et al., 2003) reflect a recent shift for this instrument toward the measurement of contemporary conceptualizations of psychopathology. The current investigation aimed to replicate and extend the theoretical and empirical linkage between the RC scales and dimensional models of personality and to investigate how well the RC scales conform to a higher-order structure of psychopathology. Participants were 271 psychiatric patients who had been administered the MMPI-2 and revised NEO Personality Inventory (Costa & McCrae, 1992) as part of a routine psychological evaluation. The results indicated that the RC scales map onto the Five Factor Model of personality as hypothesized and in congruence with previous findings in personality and psychopathology. The RC scales conformed to a higher-order structure of internalizing, externalizing, and thought disturbance, replicating and extending previous work concerning hierarchical structures of psychopathology.     

Reducing MMPI-2 defensiveness: the effect of specialized instructions on retest validity in a job applicant sample

The MMPI-2 is often used for screening job applicants when public safety or security are at risk. Inherent in such applications is concern for profile validity and test defensiveness. In this study, we examine the impact of revised instructions on profile validity for a group of job applicants who initially produced invalid profiles. Participants were 271 male applicants for airline pilot positions. Of these, 72 produced invalid defensive MMPI-2 profiles during preemployment screening. The MMPI-2 was readministered to these applicants with instructions informing them of validity scales and instructing them to respond in a more open, honest manner. Comparisons were made between valid and invalid profiles for initial administrations and between valid and invalid profiles at readministration. Some clinical scales were more elevated for valid, nondefensive profiles. Most content scales showed more elevation for valid profiles, and 12% of the applicants who were retested produced significant elevations (T>or=65) on the content scales. Profiles were similar to those produced by employed pilots of a previous study.     

Exploring the Role of Spirituality in the Context of the Five Factor Model of Personality in a South African Sample

The study explored the relationship between the Five Factor Model of personality and spirituality by using the NEO PI-R (Costa & McCrae, 1992) and the Spiritual Transcendence Scale (STS) (Piedmont, 1999) respectively. Participants were 94 psychology undergraduate students at a large South African university (mean age = 19.1 years; SD =1.43, males =19, females=75). Data were analyzed using both correlations as well as principal components analysis with varimax rotation. Evidence from both correlations and factor analysis suggest separate domains within the FFM as well as a separate factor for spirituality. These results provide support for claims that aspects of spirituality are not accounted for by the FFM as operationalised by the NEO-PI-R and by implication the FFM may not be a complete taxonomy of personality.     

Validity rates of the Personality Assessment Inventory and the Minnesota Multiphasic Personality Inventory-2 in a VA Medical Center Setting

In this study, we compared protocol validity rates between the MMPI-2 (Butcher, Dahlstrom, Graham, Tellegen, & Kaemmer, 1989) and the Personality Assessment Inventory (PAI; Morey, 1991) in a veteran population. Veterans (N=472) were administered both instruments as part of routine psychological evaluations. Profile validity was based on previously published criteria. When applying primary validity indicators, inpatients produced significantly fewer invalid PAI profiles (37%) than MMPI-2 profiles (63%). We found similar results among outpatients for which we considered 47% of MMPI-2 profiles invalid compared to only 21% of PAI profiles. When applying both primary and supplementary validity indicators, both inpatients and outpatients continued to produce fewer invalid PAI profiles than MMPI-2 profiles. We discuss factors that may be related to the differences in validity rates.     

Bridging the divide: comments on the Restructured Clinical Scales of the MMPI-2

In this comment, I discuss the target articles written by Nichols (2006/this issue) and Rogers, Sewell, Harrison, and Jordan (2006/this issue) regarding the Restructured Clinical (RC) Scales (Tellegen et al., 2003) of the MMPI-2 (Butcher, Dahlstrom, Graham, Tellegen, & Kaemmer, 1989). Both articles provide thoughtful discussion of the extent to which the RC Scales achieved the primary goals set forth by Tellegen et al., but they set different tones and come to somewhat different conclusions. I argue that the initial studies conducted on the RC Scales suggest a promising future for them. However, further studies are needed to explore the construct validity of the scales, assess their incremental validity with respect to other more established MMPI-2 scale sets, and determine their interpretive meaning in clinical contexts.     

Convergence of Vocational Interests and Personality: Examples in an Adolescent Gifted Sample

This investigation explored the convergence between vocational interests as measured by the Strong Interest Inventory (Hansen & Campbell, 1985) and two competing personality models: the Big Five as measured by the NEO Personality Inventory-Revised (NEO-PI-R) (Costa & McCrae, 1992) and the Big Three as measured by the Multidimensional Personality Questionnaire (MPQ) (Tellegen, 1982; Tellegen & Waller, in press). The participants were 323 gifted adolescents. The authors predicted that specific NEO-PI-R facet scales and specific MPQ primary scales would add meaningful variance to the prediction of hypothesized Basic Interest Scales (BISs) on the Strong after the variation due to the respective Big Five or Big Three factors was removed. The predictions were largely supported. Moreover, this study provided additional evidence regarding convergence of Holland's Big Six and the Big Five model of personality. This study could serve to prompt a new generation of studies relating vocational interests and personality.