Circumplex structure and personality disorder correlates of the Interpersonal Problems model (IIP-C): construct validity and clinical implications

This study assessed the construct validity of the circumplex model of the Inventory of Interpersonal Problems (IIP-C) in Norwegian clinical and nonclinical samples. Structure was examined by evaluating the fit of the circumplex model to data obtained by the IIP-C. Observer-rated personality disorder criteria (DSM-IV, Axis II) were used as external correlates. The reliability of the IIP-C scales was acceptable and in the same range as in the original version. A multisample analysis strategy did not support an invariant circumplex model across the 2 groups. However, the estimated structures reflected mostly the same circular pattern of a quasi-circumplex model in the 2 groups. Departures from the ideal model were of negligible practical significance. The validity results examining personality disorder correlates of the IIP-C generally conformed to predictions, providing direct evidence for agreement between self-report and expert judgments of interpersonal problems.     

Integrating leadership: The leadership circumplex

The present study aims to integrate leadership conceptualizations into one overarching model, using a “leadership circumplex”. Two studies describe the construction and examine the psychometric characteristics of an operationalization of the leadership circumplex, the Circumplex Leadership Scan (CLS). Results showed that the CLS complies with the criteria of a true circumplex. Furthermore, scales, representing leadership styles, showed reasonable to high reliability. A third study confirmed the stability of the CLS structure and additionally explored the circumplex structure of subordinates’ ratings of their leaders, which were found to have the same underlying circumplex structure. A fourth study was conducted to assess the convergent validity with other leadership styles from the existing leadership literature, the predictive validity of the styles, as well as the test–retest reliability. A fifth study confirmed the predictive validity results observed in Study 4 using different-source ratings of leadership outcomes. Finally, a sixth study explored the possibility of creating a short version of the CLS.     

Circumplex scales of interpersonal values: reliability, validity, and applicability to interpersonal problems and personality disorders

Three studies describe the development, psychometric properties, and potential utility of a new self-report measure, the Circumplex Scales of Interpersonal Values (CSIV). The CSIV was designed to complement other interpersonal circumplex measures that assess interpersonal behavior by efficiently assessing a comprehensive set of agentic and communal values. The eight 8-item scales of the CSIV were shown to have good internal consistency and test-retest reliability and a circumplex structure. The CSIV showed convergent and discriminant validity with measures of interpersonal traits (the Bem Sex Role Inventory; Bem, 1974), interpersonal problems (the Inventory of Interpersonal Problems-Circumplex; Horowitz, 2000), implicit interpersonal motives (the Thematic Apperception Test; see Atkinson, 1958), and interpersonal goals (the Interpersonal Goals Inventory; Dryer & Horowitz, 1997). Finally, the locations of the MCMI-III (Millon, 1994) personality disorder scales on the CSIV circumplex generally mirrored the locations of personality disorders on other interpersonal circumplex measures.     

A Further Study of the Validity of Human Form Drawings In Personality Evaluation

Three studies describe the development, psychometric properties, and potential utility of a new self-report measure, the Circumplex Scales of Interpersonal Values (CSIV). The CSIV was designed to complement other interpersonal circumplex measures that assess interpersonal behavior by efficiently assessing a comprehensive set of agentic and communal values. The eight 8-item scales of the CSIV were shown to have good internal consistency and test-retest reliability and a circumplex structure. The CSIV showed convergent and discriminant validity with measures of interpersonal traits (the Bem Sex Role Inventory; Bem, 1974), interpersonal problems (the Inventory of Interpersonal Problems-Circumplex; Horowitz, 2000), implicit interpersonal motives (the Thematic Apperception Test; see Atkinson, 1958), and interpersonal goals (the Interpersonal Goals Inventory; Dryer &; Horowitz, 1997). Finally, the locations of the MCMI-III (Millon, 1994) personality disorder scales on the CSIV circumplex generally mirrored the locations of personality disorders on other interpersonal circumplex measures.     

Construction of Circumplex Scales for the Inventory of Interpersonal Problems

We constructed a set of circumplex scales for the Inventory of Interpersonal Problems (IIP; Horowitz, Rosenberg, Baer, Ureno, & Villasenor, 1988). Initial scale construction used all 127 items from this instrument in two samples of university undergraduates (n = 197; n = 273). Cross-sample stability of item locations plotted against the first two principal components was high. A final set of eight 8-item circumplex scales was derived from the combined sample (n = 470) and cross-validated in a third university sample (n = 974). Finally, we examined the structural convergence of the IIP circumplex scales with an established measure of interpersonal dispositions, the Revised Interpersonal Adjective Scales (IAS-R; Wiggins, Trapnell, & Phillips, 1988). Although both circumplex instruments were derived independently, they shared a common Circular space. Implications of these results are discussed with reference to current research methods for the study of interpersonal behavior.     

An openness scale for the California Psychological Inventory

We developed a 36-item scale to measure Openness, using items on the California Psychological Inventory (CPI; Gough, 1957, 1987, 1996), Form 434. Items were initially chosen on the basis of content validity. Five samples (N = 2,375) were used to establish reliability, validity, and norms; 4 samples consisted of university undergraduate students, and 1 comprised applicants for nonmanagement call centerjobs. Internal consistency estimates obtained in each sample averaged approximately .75, and test-retest stability, assessed in 1 sample, was estimated at .84. Cross-correlations with related scales, for example, the NEO Personality Inventory-Revised Openness scale (Costa & McCrae, 1992) and other CPI-based scales, provided evidence of construct validity. Statistically significant predictive validities were obtained in 2 call centerjob-incumbent samples, with range-corrected true validities of .20 to .36 for a number of job performance criteria. Construct and predictive validity were found to be higher than for other scales consisting of CPI items designed to measure Openness or a related construct. Finally, norms were prepared for university undergraduate students (n = 1,847) and nonmanagement service-sector job applicants (n = 528).     

Psychometric Evaluation of the MMPI–2 Restructured Clinical Scales in Two Dutch Samples

In this article, we evaluate internal validity, internal consistency, and test–retest reliability of the MMPI–2 Restructured Clinical (RC) scales in the Dutch MMPI–2 normative sample (N = 1,244) and a Dutch outpatient psychiatric sample (N = 1,066). We pay special attention to a critique regarding construct drift of RC3 and the redundancy of the RC scales with existing MMPI–2 scales. The results indicate that the RC scales in both samples show comparable or better internal consistencies than the Clinical scales. Also, in both samples, the RC scales demonstrate lower scale-level intercorrelations than the Clinical scales. As to the structural characteristics, principal component analysis of the RC scales provided a clearer pattern than an analysis of the Clinical scales. Furthermore, mean raw scores on the RC scales for men in the Dutch normative sample corresponded highly with those in the U.S. normative sample except for RC2 and RC4. Less correspondence was found for women. Overall, we conclude that the RC scales show satisfactory reliability and promising internal validity in our Dutch samples. We suggest that U.S. validation studies on the RC scales may be generalized to the Dutch-language version of the MMPI–2 RC scales.     

A Chinese Translation of the Inventory of Interpersonal Problems–Short Circumplex

The Inventory of Interpersonal Problems–Short Circumplex (IIP–SC) is a self-report measure of subjective distress linked to behavioral excesses and inhibitions in social relationships. The IIP–SC exhibits circumplex structure reflecting the underlying dimensions of dominance–submissiveness and warmth–coldness. We translated the IIP–SC into Mandarin Chinese using rigorous translation and back-translation methods with independent native speakers. University students in the People's Republic of China (N = 401) completed the translated IIP–SC and the Chinese Personality Assessment Inventory (CPAI–2), an omnibus measure of indigenous personality trait dimensions and symptoms of psychopathology. The circumplex structure of the Chinese IIP–SC was confirmed using principal components analysis, a randomization test for hypothesized order relations, and confirmatory circumplex analysis. The validity of the Chinese IIP–SC was evaluated by examining its associations with the CPAI–2 scales. Validity evidence for Chinese translation of the IIP–SC extends its use for clinical assessment to native Chinese speakers, although ongoing work to improve its reliability is needed.     

Psychometric evaluation of the MMPI-2 Restructured Clinical scales in two Dutch samples

In this article, we evaluate internal validity, internal consistency, and test-retest reliability of the MMPI-2 Restructured Clinical (RC) scales in the Dutch MMPI-2 normative sample (N = 1,244) and a Dutch outpatient psychiatric sample (N = 1,066). We pay special attention to a critique regarding construct drift of RC3 and the redundancy of the RC scales with existing MMPI-2 scales. The results indicate that the RC scales in both samples show comparable or better internal consistencies than the Clinical scales. Also, in both samples, the RC scales demonstrate lower scale-level intercorrelations than the Clinical scales. As to the structural characteristics, principal component analysis of the RC scales provided a clearer pattern than an analysis of the Clinical scales. Furthermore, mean raw scores on the RC scales for men in the Dutch normative sample corresponded highly with those in the U.S. normative sample except for RC2 and RC4. Less correspondence was found for women. Overall, we conclude that the RC scales show satisfactory reliability and promising internal validity in our Dutch samples. We suggest that U.S. validation studies on the RC scales may be generalized to the Dutch-language version of the MMPI-2 RC scales.     

Large-sample confidence intervals for validity and reliability coefficients

Large-sample confidence intervals (CI) for reliability, validity, and unattenuated validity are presented. The CI for unattenuated validity is based on the Bonferroni inequality, which relies on one CI for test-retest reliability and one for validity. Covered are four reliability-validity situations: (a) both estimates were from random samples; (b) reliability was from a random sample but validity was from a selected sample; (c) validity was from a random sample but reliability was from a selected sample; and (d) both estimates were from selected samples. All CIs were evaluated by using a simulation. CIs on reliability, validity, or unattenuated validity are accurate as long as selection ratio is at least 20% and selected sample size is 100 or larger. When selection ratio is less than 20%, estimators tend to underestimate their parameters.     

A Rigorous Test of the Fit of the Circumplex Model to Big Five Personality Data: Theoretical and Methodological Issues and Two Large Sample Empirical Tests

Our objective was to apply the rigorous test developed by Browne (1992) to determine whether the circumplex model fits Big Five personality data. This test has yet to be applied to personality data. Another objective was to determine whether blended items explained correlations among the Big Five traits. We used two working adult samples, the Eugene-Springfield Community Sample and the Professional Worker Career Experience Survey. Fit to the circumplex was tested via Browne's (1992) procedure. Circumplexes were graphed to identify items with loadings on multiple traits (blended items), and to determine whether removing these items changed five-factor model (FFM) trait intercorrelations. In both samples, the circumplex structure fit the FFM traits well. Each sample had items with dual-factor loadings (8 items in the first sample, 21 in the second). Removing blended items had little effect on construct-level intercorrelations among FFM traits. We conclude that rigorous tests show that the fit of personality data to the circumplex model is good. This finding means the circumplex model is competitive with the factor model in understanding the organization of personality traits. The circumplex structure also provides a theoretically and empirically sound rationale for evaluating intercorrelations among FFM traits. Even after eliminating blended items, FFM personality traits remained correlated.     

Structural examination of RIASEC scales in high school students: Variation across ethnicity and method

The structural validity of Holland’s model of vocational interests across racial/ethnic groups was examined in the population of high school juniors in two states. The fit of the circumplex model to Holland’s RIASEC types as assessed by the UNIACT-R was evaluated for the general sample and five subgroups: Caucasian/Euro-Americans, African Americans, Asian Americans, Latinos, and Native Americans. Four different methods were used to test the proposed circumplex structure, each with various circumplex definitions. Results indicate that nonparametric methods generally showed good model-data fit, whereas SEM-based results indicated less support. No differences in fit were found across ethnicity supporting the usage with U.S. ethnic groups.     

Research Validity Scales for the NEO-PI-R: Additional Evidence for Reliability and Validity

We examined the reliability and validity of the research validity scales (Schinka, Kinder, & Kremer, 1997) for the NEO-Personality Inventory-Revised (NEO-PI-R) in a clinical sample. The Negative Presentation Management (NPM) and Positive Presentation Management (PPM) scales were found to have satisfactory internal consistency reliability. Support for the validity of these scales was provided by the pattern of convergent and discriminant correlations with respective Personality Assessment Inventory (PAI) validity scales. Finally, PAI profiles of individuals with invalid NPM scores were found to differ significantly from those with valid NPM scores. Comparisons of the invalid profiles with profiles from other clinical samples provided additional support for the use of the NPM scale as a measure of negative impression management.     

Communication patterns during marital conflict: A cross-cultural replication

This study examines the reliability and validity of the Communication Patterns Questionnaire (CPQ) from Christensen and Sullaway (1984). The CPQ is a relatively new questionnaire aimed at assessing marital communication at the dyadic level. It addresses communication patterns involving the behavior of both members of the dyad rather than just one partner. The CPQ permits the evaluation of communication in close relationships on three scales: (a) mutual constructive communication; (b) mutual avoidance of communication; (c) demand/withdrawal. Previous research among American samples has yielded empirical evidence concerning the reliability and validity of this instrument. The current study focuses upon whether the CPQ may also be applied to European subjects. To address this question, a German and a Swiss sample were used. Our results demonstrate that the questionnaire's reliability and validity also prove satisfactory among European samples. In both studies, communication avoidance and withdrawal were negatively correlated with relationship satisfaction.     

Research Validity Scales for the NEO-PI-R: additional evidence for reliability and validity

We examined the reliability and validity of the research validity scales (Schinka, Kinder, & Kremer, 1997) for the NEO-Personality Inventory-Revised (NEO-PI-R) in a clinical sample. The Negative Presentation Management (NPM) and Positive Presentation Management (PPM) scales were found to have satisfactory internal consistency reliability. Support for the validity of these scales was provided by the pattern of convergent and discriminant correlations with respective Personality Assessment Inventory (PAI) validity scales. Finally, PAI profiles of individuals with invalid NPM scores were found to differ significantly from those with valid NPM scores. Comparisons of the invalid profiles with profiles from other clinical samples provided additional support for the use of the NPM scale as a measure of negative impression management.     

Conceptual and Statistical Interactions: An Illustration with the AB5C and CWBs

Purpose

The purpose of this study was to compare the criterion validity of conceptual interactions between the Big Five traits of agreeableness, conscientiousness, and emotional stability to the statistical interactions between these traits. For illustration purposes we focus on linking these interactions to counterproductive work behaviors (CWBs).

Design/Methodology/Approach

Data for Study 1 was obtained from 196 employed students and focuses on the interaction between agreeableness and conscientiousness. Data for Study 2 was obtained from 220 employees and expanded the interaction space examined to include emotional stability.

Findings

All of the circumplex traits representing conceptual interactions were related to CWBs but only the traits most closely associated with conscientiousness showed incremental validity beyond their associated Big Five traits. Dominance analysis highlights increased concurrent validity of the circumplex traits compared to the Big Five statistical interactions in relation to CWBs.

Implications

Understanding the unique circumplex blends of the Big Five traits offers opportunities to enhance the criterion validity of Big Five measures. Results question the similarity between the AB5C circumplex traits and Big Five interactions, with their contributions appearing to be unique but their justification drastically different.

Originality/Value

The validity of the AB5C circumplex traits are relatively unknown. The current results expand this knowledge and directly compare the circumplex traits to interaction terms between agreeableness, conscientiousness, and emotional stability.     

Using reliability generalization methods to explore measurement error: an illustration using the MMPI-2 PSY-5 scales

Reliability generalization (RG) is a meta-analytic technique that allows for the systematic examination of variation in score reliability for different samples of test takers; this procedure is based on the recognition that reliability is not a stable property of a test but is sample dependent. As a demonstration of an RG analysis, I obtained 63 reliability coefficients for each of the MMPI-2 (Butcher et al., 2001) Personality Psychopathology 5 (Harkness, McNulty, & Ben-Porath, 1995) scales. The overall variability of alpha coefficients supports the argument that reliability is sample dependent and underscores the need for researchers to calculate reliability estimates based on their research samples rather than simply citing published alpha coefficients as evidence of score reliability. I observed statistically significant mean reliability differences for scores across the 5 scales, with the highest level of reliability observed for scores on the measure of Negative Emotionality and the lowest levels of reliability observed for scores on the measures of Aggression and Disconstraint. There was no evidence that the sex-composition of a sample was systematically related to score reliability, and there were no statistically significant differences in reliability between scores obtained with the English version of the test and those obtained with translated forms. However, reliability was consistently lower for scores on some scales when the data were obtained in nonclinical settings as opposed to clinical ones. Sample size was not significantly correlated with reliability estimates. RG methods have the potential for deepening the level of understanding about the role of reliability in the evaluation and use of personality tests.     

An interpersonal circumplex model of children's social goals: links with peer-reported behavior and sociometric status

The objective of the present research was to develop an assessment model for children's social goals. The aims were (a) to fit children's social goals to a circumplex model and to examine links between goals and peer-reported social behaviors (aggression, withdrawal, and prosocial behavior) in a sample of 276 participants (134 girls, 11- to 12-year-olds) and (b) to replicate these findings and examine whether social behavior mediates the relationship between goals and sociometric status in an independent cross-validation sample of 310 participants (143 girls, 11- to 13-year-olds). Results showed a satisfactory fit to the circumplex model and adequate psychometric properties of the goal scales of the new measure, the Interpersonal Goals Inventory for Children. Other findings included significant and meaningful relations between goals and peer-reported behavior. Social behavior mediated the relations between goals and sociometric status.     

Validation of scales from the Deployment Risk and Resilience Inventory in a sample of Operation Iraqi Freedom veterans

The Deployment Risk and Resilience Inventory (DRRI) is a suite of scales that can be used to assess deployment-related factors implicated in the health and well-being of military veterans. Although initial evidence for the reliability and validity of DRRI scales based on Gulf War veteran samples is encouraging, evidence with respect to a more contemporary cohort of Operation Iraqi Freedom (OIF) veterans is not available. Therefore, the primary goal of the present study was to validate scales from the DRRI in a large sample of OIF army personnel diversified in occupational and demographic characteristics. In general, results supported the use of these DRRI scales in this population. Internal consistency reliability estimates were quite strong. Additionally, support was obtained for criterion-related validity, as demonstrated by associations with mental and physical health measures, and discriminative validity, as demonstrated by differences between key military subgroups.