Computerized adaptive personality testing: a review and illustration with the MMPI-2 Computerized Adaptive Version

Computerized adaptive testing in personality assessment can improve efficiency by significantly reducing the number of items administered to answer an assessment question. Two approaches have been explored for adaptive testing in computerized personality assessment: item response theory and the countdown method. In this article, the authors review the literature on each and report the results of an investigation designed to explore the utility, in terms of item and time savings, and validity, in terms of correlations with external criterion measures, of an expanded countdown method-based research version of the Minnesota Multiphasic Personality Inventory-2 (MMPI-2), the MMPI-2 Computerized Adaptive Version (MMPI-2-CA). Participants were 433 undergraduate college students (170 men and 263 women). Results indicated considerable item savings and corresponding time savings for the adaptive testing modalities compared with a conventional computerized MMPI-2 administration. Furthermore, computerized adaptive administration yielded comparable results to computerized conventional administration of the MMPI-2 in terms of both test scores and their validity. Future directions for computerized adaptive personality testing are discussed.     

Comparability and validity of computerized adaptive testing with the MMPI-2

The comparability and validity of a computerized adaptive (CA) Minnesota Multiphasic Personality Inventory-2 (MMPI-2) were assessed in a sample of 571 undergraduate college students. The CA MMPI-2 administered adaptively Scales L, E the 10 clinical scales, and the 15 content scales, utilizing the countdown method (Butcher, Keller, & Bacon, 1985). All subjects completed the MMPI-2 twice, with three experimental conditions: booklet test-retest, booklet-CA, and conventional computerized (CC)-CA. Profiles across administration modalities show a high degree of similarity, providing evidence for the comparability of the three forms. Correlations between MMPI-2 scales and other psychometric measures (Beck Depression Inventory; Symptom Checklist-Revised; State-Trait Anxiety and Anger Scales; and the Anger Expression Scale) support the validity of the CA MMPI-2. Substantial item savings may be realized with the implementation of the countdown procedure.     

Comparability of computerized adaptive and conventional testing with the MMPI-2

A computerized adaptive version and the standard version of the Minnesota Multiphasic Personality Inventory-2 (MMPI-2) were administered 1 week apart to a sample of 155 college students to assess the comparability of the two versions. The countdown method was used to adaptively administer Scales L, F, the I0 clinical scales, and the 15 new content scales. Profiles across administration modalities show a high degree of similarity, providing evidence for the comparability of computerized adaptive and conventional testing with the MMPI-2. Substantial item savings were found with the adaptive version. Future directions in the study of adaptive testing with the MMPI-2 are discussed.     

Similarities and differences between MMPI and MMPI-2 applications to the assessment of posttraumatic stress disorder

The purpose of this study was to address the question: Is the Minnesota Multiphasic Personality Inventory-2 (MMPI-2) comparable to the original MMPI in its applicability to the assessment of posttraumatic stress disorder (PTSD) among Vietnam combat veterans? The question was addressed by administering both the original MMPI and MMPI-2 to 29 subjects classified as meeting Diagnostic and Statistical Manual of Mental Disorders (3rd ed., rev.; DSM-III-R) criteria for PTSD and comparing MMPI and MMPI-2 scores in terms of: degree of association, code-type congruence, diagnostic hit rates (when compared to two other clinical samples, and one normal sample), and congruence of the Keane PTSD Scale (PK). Results reveal highly significant correlations between MMPI and MMPI-2 basic scales for the PTSD sample as well as congruence in 2-point codes comparable to previous studies. The MMPI-2 was found to identify effectively PTSD subjects from the other groups. Results also showed a high degree of association between the MMPI and MMPI-2 in regard to PK scores, although minor differences were found in PK raw scores between the two tests. Overall, the findings suggest a high degree of comparability between the MMPI and MMPI-2 in the assessment of PTSD.     

Differentiating Overreporting and Extreme Distress: MMPI-2 Use With Compensation-Seeking Veterans With PTSD

This purpose of this study was to examine overreporting on the Minnesota Multiphasic Personality Inventory-2 (MMPI-2; Butcher, Dahlstrom, Graham, Tellegen, & Kaemmer, 1989) in compensation-seeking veterans with posttraumatic stress disorder (PTSD). A sample of veterans tested during a V.A. hospital compensation and pension exam were given the MMPI-2 and measures of PTSD, depression, and combat exposure. Veteran's MMPI-2s were only included in the analyses if their profile was extremely exaggerated, as measured by an F scale T score above 80, did not elevate the MMPI-2 VRIN and TRIN scales, and had a primary diagnosis of PTSD (n = 127). Using the Infrequency-Psychopathology, F(p), scale to distinguish overreporting from distress, it was found that 98 veterans elevated profiles due to distress, whereas 29 elevated due to overreporting, F(p) below and above 7, respectively. Differences between groups on MMPI-2 clinical scales and the other measures were assessed. Implications of these findings for assessing veteran response style and using the MMPI-2 with a PTSD population are discussed.     

Differentiating overreporting and extreme distress: MMPI-2 use with compensation-seeking veterans with PTSD

This purpose of this study was to examine overreporting on the Minnesota Multiphasic Personality Inventory-2 (MMPI-2; Butcher, Dahlstrom, Graham, Tellegen, & Kaemmer, 1989) in compensation-seeking veterans with posttraumatic stress disorder (PTSD). A sample of veterans tested during a V.A. hospital compensation and pension exam were given the MMPI-2 and measures of PTSD, depression, and combat exposure. Veteran's MMPI-2s were only included in the analyses if their profile was extremely exaggerated, as measured by an F scale T score above 80, did not elevate the MMPI-2 VRIN and TRIN scales, and had a primary diagnosis of PTSD (n = 127). Using the Infrequency-Psychopathology, F(p), scale to distinguish overreporting from distress, it was found that 98 veterans elevated profiles due to distress, whereas 29 elevated due to overreporting, F(p) below and above 7, respectively. Differences between groups on MMPI-2 clinical scales and the other measures were assessed. Implications of these findings for assessing veteran response style and using the MMPI-2 with a PTSD population are discussed.     

Interrelationship Between MMPI-2 and Rorschach Variables in a Sample of Vietnam Veterans With PTSD

We examined interrelationships between theoretically related MMPI-2 and Rorschach variables in a sample of Veterans Affairs outpatients with Posttraumatic Stress Disorder (PTSD). Subjects were 20 White Vietnam combat veterans diagnosed with PTSD who completed the Rorschach and MMPI-2 as part of a comprehensive evaluation. Correlations were calculated for variables in three groups: validity, depression and anxiety, and thought disturbance. Results showed strong relationships between m, MOR, and t he Dramatic special score of the Rorschach and MMPI-2 indices of distress. Positive relationships were also found for some indicators of thought disturbance, whereas correlations for other depressive indicators were not significant. Findings are discussed with regard to implications for the clinical assessment of combat-related PTSD and future directions for assessment research.     

Cross-validation of the MMPI-2 in detecting malingered posttraumatic stress disorder

We attempted to cross-validate findings from a previous study (Elhai, Gold, Sellers, & Dorfman, in press) using a clinical sample of combat-related war veterans to distinguish genuine from malingered posttraumatic stress disorder (PTSD) on the MMPI-2 (Butcher, Dahlstrom, Graham, Tellegen, & Kaemmer, 1989). The MMPI-2 scores of 124 male combat war veterans at the PTSD outpatient treatment program of a Veterans Affairs Medical Center were compared with those of 84 adult college students instructed and trained to malinger PTSD. MMPI-2 overreporting variables examined were F, F-Fb, F-K, F(p), Ds2, O-S, OT, and FBS. A stepwise discriminant analysis identified F. F-Fb, F-K, Ds2, O-S, and OT as the best malingering predictors. A predictive discriminant analysis yielded good hit rates for the model with impressive cross-validation results. We assessed cutting scores for the predictors of the model. We discuss clinical implications for using the MMPI-2 to distinguish malingered PTSD from combat-related PTSD.     

Searching for conscientiousness on the MMPI-2

It has been argued that the revised Minnesota Multiphasic Personality Inventory (MMPI-2) fails to measure the Big Five dimension of conscientiousness (C) an assertion supported by the research finding that none of the factors underlying the MMPI correlate substantially with the C factor of the NEO Personality Inventory (NEO-PI)-a popular operationalization of the Big Five model. In this study we reconsidered the relationship between the MMPI-2 item pool and the C factor of the NEO-PI-R (Form S). Collections of MMPI-2 C markers did not correlate much higher than .5 with the NEO-PI-R factor scale in cross-validation hold-out samples. Most pervasive, however, was the finding that MMPI-2 item markers of C were also strongly (in many cases, more highly) related to the NEO-PI-R factor of neuroticism (N). Efforts to purify collections of MMPI-2 C markers, first by careful item selection and then by suppression of N variance, were met with limited success. Intercorrelations among NEO-PI-R scales suggest that the difficulty in finding markers that discriminate between N and C extends beyond any shortcomings of the MMPI-2 item pool.     

Searching for Conscientiousness on the MMPI-2

It has been argued that the revised Minnesota Multiphasic Personality Inventory (MMPI-2) fails to measure the Big Five dimension of conscientiousness (C) an assertion supported by the research finding that none of the factors underlying the MMPI correlate substantially with the C factor of the NEO Personality Inventory (NEO-PI)—a popular operationalization of the Big Five model. In this study we reconsidered the relationship between the MMPI-2 item pool and the C factor of the NEO-PI-R (Form S). Collections of MMPI-2 C markers did not correlate much higher than .5 with the NEO-PI-R factor scale in cross-validation hold-out samples. Most pervasive, however, was the finding that MMPI-2 item markers of C were also strongly (in many cases, more highly) related to the NEO-PI-R factor of neuroticism (N). Efforts to purify collections of MMPI-2 C markers, first by careful item selection and then by suppression of N variance, were met with limited success. Intercorrelations among NEO-PI-R scales suggest that the difficulty in finding markers that discriminate between N and C extends beyond any shortcomings of the MMPI-2 item pool.     

MMPI-2 Assessment of Varying Levels of Posttraumatic Stress in Vietnam Combat Veterans

The effectiveness of the MMPI-2 in the detection of posttraumatic stress (PTS) symptomatology was investigated. Forty-nine veterans at a VA posttraumatic stress clinic were evaluated for PTS symptomatology according to DSM-III-R criteria. The ability of the MMPI-2 to differentiate between Vietnam combat veterans (VCV) who met DSM-III-R criteria for posttraumatic stress disorder (PTSD; N = 36) and those who reported varying levels of posttraumatic stress symptoms (PTSS; N = 13) was examined. Overall, the MMPI-2 was effective in differentiating between the two groups of veterans. Of the 15 MMPI-2 scales used to evaluate PTS symptomatology, 12 significantly differentiated veterans with PTSD from those with PTSS. Diagnostic efficiency statistics for the MMPI-2 PTSD scales (PS and PK) were calculated at four cutoff points (T 65, 70, 75, and 80). The PS Scale was the most robust and effective index in differentiating between veterans with PTSD and those with PTSS. Implications for the assessment of varying degrees of PTS are discussed.     

Comparison of the MMPI and MMPI-2 Among Job Applicants

The primary objective was to compare the MMPI-2 profiles for professional job applicants with corresponding profiles on the original MMPI. Male and female MMPI-2 profiles were also compared, and correlational and factor analyses were used to examine: A) Interscale correlations vis-à-vis item overlap, and B) The impact of K-corrections. The subjects were 82 auditor applicants, plus 212 sales and management applicants from an earlier study. The original MMPI was found to overpathologize applicant profiles. Male and female MMPI-2 profiles differed only on Mf. Scales L, K, and Hy formed a favorable cluster for job applicants, while F, Hs, Pt, Sc formed one unfavorable cluster—and D, Si a second. K-corrections consistently moved clinical scales in the direction of the favorable cluster.     

The derivation of gender-role scales GM and GF for MMPI-2 and their relationship to Scale 5 (Mf).

Separate scales for masculine and feminine gender roles (GM and GF, respectively) were developed for the Minnesota Multiphasic Personality Inventory-2 (MMPI-2) based on the item endorsements of men and women in the restandardization sample. Each scale reflects the pattern of answers of a majority of the members of the respective sexes. There are no items in common between the two scales, and they correlate -.10 with each other for both men and women. Distributional, temporal stability, and internal consistency characteristics were analyzed, as well as their item overlap and correlations with the basic profile scales. These separate unipolar scales were contrasted with Scale 5 (the Masculinity-Femininity scale, Mf), the traditional measure of these constructs in the Minnesota Multiphasic Personality Inventory (MMPI). The conjoint use of GM and GF to form gender-role groups is recommended to supplement and clarify the ambiguity of midlevel scores on Scale 5.     

The Derivation of Gender-Role Scales GM and GF for MMPI-2 and Their Relationship to Scale 5 (Mf)

Separate scales for masculine and feminine gender roles (GM and GF, respectively) were developed for the Minnesota Multiphasic Personality inventory-2 (MMPI-2) based on the item endorsements of men and women in the restandardization sample. Each scale reflects the pattern of answers of a majority of the members of the respective sexes. There are no items in common between the two scales, and they correlate -.10 with each other for both men and women. Distributional, temporal stability, and internal consistency characteristics were analyzed, as well as their item overlap and correlations with the basic profile scales. These separate unipolar scales were contrasted with Scale 5 (the Masculinity-Femininity scale, Mf), the traditional measure of these constructs in the Minnesota Multiphasic Personaaty Inventory (MMPI). The conjoint use of GM and GF to form gender-role groups is recommended to supplement and clarify the ambiguity of midleveI scores on Scale 5.     

Detecting symptom exaggeration in combat veterans using the MMPI-2 symptom validity scales: a mixed group validation

Although validity scales of the Minnesota Multiphasic Personality Inventory-2 (MMPI-2; J. N. Butcher, W. G. Dahlstrom, J. R. Graham, A. Tellegen, & B. Kaemmer, 1989) have proven useful in the detection of symptom exaggeration in criterion-group validation (CGV) studies, usually comparing instructed feigners with known patient groups, the application of these scales has been problematic when assessing combat veterans undergoing posttraumatic stress disorder (PTSD) examinations. Mixed group validation (MGV) was employed to determine the efficacy of MMPI-2 exaggeration scales in compensation-seeking (CS) and noncompensation-seeking (NCS) veterans. Unlike CGV, MGV allows for a mix of exaggerating and nonexaggerating individuals in each group, does not require that the exaggeration versus nonexaggerating status of any individual be known, and can be adjusted for different base-rate estimates. MMPI-2 responses of 377 male veterans were examined according to CS versus NCS status. MGV was calculated using 4 sets of base-rate estimates drawn from the literature. The validity scales generally performed well (adequate sensitivity, specificity, and efficiency) under most base-rate estimations, and most produced cutoff scores that showed adequate detection of symptom exaggeration, regardless of base-rate assumptions. These results support the use of MMPI-2 validity scales for PTSD evaluations in veteran populations, even under varying base rates of symptom exaggeration.     

Comparison of MMPI-2 profiles of Gulf War veterans with epileptic and nonepileptic seizure patients

As part of a larger study of illnesses related to service in the Gulf War, MMPI-2 profiles of epileptic seizure (ES) patients; nonepileptic seizure (NES) patients; Gulf War veterans with unexplained cognitive, psychological, musculoskeletal, fatigue, or dermatologic symptoms; and asymptomatic Gulf War veterans (Controls) were analyzed. There were 70 people in each group. Seizure diagnosis was based upon intensive EEG monitoring. Gulf War cases were mildly abnormal on MMPI-2 Scales Hs and D and significantly higher than controls on 8 of 10 MMPI-2 clinical scales, but they were significantly lower than NES patients on several scales including Hs and Hy.     

Examining the impact of unscorable item responses on the validity and interpretability of MMPI-2/MMPI-2-RF Restructured Clinical (RC) Scale scores

This article examined the impact of unscorable item responses on the psychometric validity and practical interpretability of scores on the Restructured Clinical (RC) Scales of the Minnesota Multiphasic Personality Inventory-2/Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2/MMPI-2-RF). In analyses conducted with five archival samples, we found that relatively large proportions of unscorable responses (defined as 10% or more of the items scored on a scale) were relatively uncommon, occurring most often in forensic samples. Simulated unscorable responses were inserted in varying proportions (10% to 90%) in place of the responses of participants in two of the archival samples for which criterion data were available. Analyses were conducted to gauge the impact of unscorable responses on the criterion validity of scores on these scales and their interpretability. Impact on validity was evaluated by examining correlations with extra-test variables as a function of increasing levels of unscorable responding. Interpretability was evaluated by examining the proportion of participants who produced clinically elevated RC Scale scores as a function of unscorable responding. Results indicate that whereas scale score validity was relatively robust up to a level of 50% unscorable responses, interpretability was substantially compromised at only 10% unscorable responding. This suggests that prorated scores may be used to correct for the impact of unscorable responses on the interpretability of RC Scale scores at levels as high as 50% unscorable responses. Classification analyses supported this possibility. Further steps needed to explore the feasibility of using prorated scores are discussed.     

Current status of MMPI-2 research: a methodologic overview

MMPI-2 research since 1990 has been reviewed to assess whether Butcher and Tellegen's (1978) concerns and suggestions about MMPI research were being followed. Guidelines are provided for when the MMPI-2 is appropriate to administer, how to describe the sample used, assessing validity of the profile, what scores to analyze, and how to report the results. Suggestions also are presented for research within several current areas of debate in the MMPI-2: codetype comparability between the MMPI and MMPI-2, incremental validity of new or existing scales, obvious and subtle subscales, emphasis on item content, development of new scales, and correcting profiles for specific medical and physical conditions.     

Confirmatory Factor Analyses of the Anxiety and Depression Content Scales of the MMPI-2

A sample of 408 patients with substance use disorders was equally divided into derivation and cross-validation samples. All patients had taken the MMPI-2. Exploratory factor analyses of MMPI-2 item data in the derivation sample permitted construction of latent variable measurement models for the Anxiety (ANX) and Depression (DEP) content scales. The 2-factor model for ANX consisted of Trait Anxiety and Worry, and the 3-factor model for DEP contained factors of Trait Depression. Hopelessness, and Self-Depreciation. Confirmatory factor analyses in cross-validation demonstrated a good fit for both models and for their combination in a 5-factor measurement model. Latent variable correlations in the 5-factor model helped explain the high correlation and low discriminant validity of ANX and DEP.     

MMPI-2 validity scale characteristics in a correctional sample

The current study investigated the proportion of content-nonresponsive and content-responsive faking Minnesota Multiphasic Personality Inventory-2 (MMPI-2) protocols in a state corrections sample. Participants were 51,486 inmates who completed the MMPI-2 at the time they entered the Ohio Department of Rehabilitation and Correction system. Overall, approximately 79% of the study participants produced valid profiles. Of the entire study sample, 11.3% produced content-nonresponsive profiles, and 9.4% produced content-responsive faking profiles. African Americans produced a higher proportion of content-nonresponsive profiles than Caucasians, and women were slightly more likely than men to produce content-responsive faking profiles. Differences in level of education between African Americans and Caucasians did not account for the disparity in content-nonresponsive profiles. Implications for current practice and future research are discussed.