Psychometric examination and normative data for the narcissistic personality inventory 29 item version

The Narcissistic Personality Inventory (NPI) is commonly used in empirical studies of narcissism. Few population-based studies have been published. Our aim was to do a confirmatory factor analysis (CFA) of the NPI 29 item version with a four-factor structure, in two population-based samples and in a patient sample, and present normative population-based data. The NPI-29 was filled in by 324 respondents from the Norwegian population, 231 from the Swedish population and 167 Norwegian psychiatric patients. The four-factor structure of the NPI-29 with Leadership/Power, Exhibitionism/Self-admiration, Superiority/Arrogance and Uniqueness/Entitlement was reproduced in these samples. The CFA models showed good fit indices in all samples. Mean scores on the NPI-29 and four subscales hardly differed between the samples. For the NPI-29 total score and factors, few significant differences were observed. CFA of the samples supported the factor structure of the NPI-29 formerly identified by principal component analysis of the Swedish population sample.     

An item response theory analysis of DSM-IV personality disorder criteria across younger and older age groups

Many of the Diagnostic and Statistical Manual of Mental Disorders, 4th edition (DSM-IV; American Psychiatric Association, 1994) personality disorder (PD) diagnostic criteria focus on a younger social and occupational context. The absence of age-appropriate criteria for older adults forces researchers and clinicians to draw conclusions based on existing criteria, which are likely inadequate. To explore which DSM-IV PD criteria contain age group measurement bias, the authors report 2 analyses of data on nearly 37,000 participants, ages 18-98 years, taken from a public data set that includes 7 of the 10 PDs (antisocial, avoidant, dependent, histrionic, obsessive-compulsive, paranoid, and schizoid). The 1st analysis revealed that older age groups tend to endorse fewer PD criteria than younger age groups. The 2nd analysis revealed that 29% of the criteria contain measurement bias. Although the latent variable structure for each PD was quite similar across younger and older age groups, some individual criteria were differentially endorsed by younger and older adults with equivalent PD pathology. The presence of measurement bias for these criteria raises questions concerning the assessment of PDs in older adults and the interpretation of existing data.     

An application of item response theory to the DSM-III-R criteria for borderline personality disorder

This paper summarizes results from analyses of the DSM criteria for borderline personality disorder (BPD) using models from item response theory (IRT). The study sample consisted of 353 participants, the majority of whom were psychiatric patients. Confirmatory factor analysis showed that a one-factor model provided the best fit to the data. All the DSM BPD criteria had moderate or higher item discrimination parameters, indicating that all items contributed meaningful information in assessing BPD. Item information functions revealed that the BPD criteria as a whole were useful for capturing BPD traits in the moderately severe to severe range, but that they performed less well in the less severe range. The general conclusion is that the criteria do represent a coherent syndrome and that further research on the informational value of the individual criteria would be useful.     

An item response theory analysis of the Problem Gambling Severity Index

Increases in the availability of gambling heighten the need for a short screening measure of problem gambling. The Problem Gambling Severity Index (PGSI) is a brief measure that allows for the assessment of characteristics of gambling behavior and severity and its consequences. The authors evaluate the psychometric properties of the PGSI using item response theory methods in a representative sample of the urban adult population in South Africa (N = 3,000). The PGSI items were evaluated for differential item functioning (DIF) due to language translation. DIF was not detected. The PGSI was found to be unidimensional, and use of the nominal categories model provided additional information at higher values of the underlying construct relative to a simpler binary model. This study contributes to the growing literature supporting the PGSI as the screen of choice for assessing gambling problems in the general population.     

An item response theory analysis of self-report measures of adult attachment

Self-report measures of adult attachment are typically scored in ways (e.g., averaging or summing items) that can lead to erroneous inferences about important theoretical issues, such as the degree of continuity in attachment security and the differential stability of insecure attachment patterns. To determine whether existing attachment scales suffer from scaling problems, the authors conducted an item response theory (IRT) analysis of 4 commonly used self-report inventories: Experiences in Close Relationships scales (K. A. Brennan, C. L. Clark, & P. R. Shaver, 1998), Adult Attachment Scales (N. L. Collins & S. J. Read, 1990), Relationship Styles Questionnaire (D. W. Griffin & K. Bartholomew, 1994) and J. Simpson's (1990) attachment scales. Data from 1,085 individuals were analyzed using F. Samejima's (1969) graded response model. The authors' findings indicate that commonly used attachment scales can be improved in a number of important ways. Accordingly, the authors show how IRT techniques can be used to develop new attachment scales with desirable psychometric properties.     

An item response theory analysis of the Impulsive Behaviors Checklist for Adolescents

This study used item response theory (IRT) to examine the Impulsive Behaviors Checklist for Adolescents (IBCL-A) among 6,276 (67.7% girls) Chinese secondary school students. The IBCL-A included 15 maladaptive impulsive behaviors adapted from the Revised Diagnostic Interview for Borderlines. The authors obtained the severity and discrimination parameters for each item in the IBCL-A, examined differential item functioning across gender and age groups, and tested reliability and concurrent validity of the IBCL-A IRT-scaled score. Most items in the IBCL-A were the most accurate in assessing moderate to high levels of impulsivity and discriminated well among adolescents with varied levels of impulsivity. Differential item functioning emerged in several items across gender. The IRT-scaled score showed good construct validity and incremental predictive validity. Findings demonstrate the sound psychometric properties of the IBCL-A and support the clinical utility of this scale.     

Gender bias in diagnostic criteria for personality disorders: an item response theory analysis

The authors examined gender bias in the diagnostic criteria for Diagnostic and Statistical Manual of Mental Disorders (4th ed., text revision; American Psychiatric Association, 2000) personality disorders. Participants (N=599) were selected from 2 large, nonclinical samples on the basis of information from self-report questionnaires and peer nominations that suggested the presence of personality pathology. All were interviewed with the Structured Interview for DSM-IV Personality (B. Pfohl, N. Blum, & M. Zimmerman, 1997). Using item response theory methods, the authors compared data from 315 men and 284 women, searching for evidence of differential item functioning in the diagnostic features of 10 personality disorder categories. Results indicated significant but moderate measurement bias pertaining to gender for 6 specific criteria. In other words, men and women with equivalent levels of pathology endorsed the items at different rates. For 1 paranoid personality disorder criterion and 3 antisocial criteria, men were more likely to endorse the biased items. For 2 schizoid personality disorder criteria, women were more likely to endorse the biased items.     

Bayesian item fit analysis for unidimensional item response theory models

Assessing item fit for unidimensional item response theory models for dichotomous items has always been an issue of enormous interest, but there exists no unanimously agreed item fit diagnostic for these models, and hence there is room for further investigation of the area. This paper employs the posterior predictive model‐checking method, a popular Bayesian model‐checking tool, to examine item fit for the above‐mentioned models. An item fit plot, comparing the observed and predicted proportion‐correct scores of examinees with different raw scores, is suggested. This paper also suggests how to obtain posterior predictive p‐values (which are natural Bayesian p‐values) for the item fit statistics of Orlando and Thissen that summarize numerically the information in the above‐mentioned item fit plots. A number of simulation studies and a real data application demonstrate the effectiveness of the suggested item fit diagnostics. The suggested techniques seem to have adequate power and reasonable Type I error rate, and psychometricians will find them promising.     

The impact of social desirability bias on the EPQ-R item scores: An item response theory analysis

This study assessed the potential influence of social desirability (SD) response bias on the E, N, and P EPQ-R scores at the level of individual items. The study was based on a bidimensional IRT model which was fitted in a large sample. This allowed a detailed analysis of both the internal validities of the items and the content of the items which were most affected by SD. The E items were least affected by SD, but the direction of the impact depended on the type of item. As expected, in the N and P cases the relations obtained were consistently negative, but the strength of the SD impact also depended considerably on the type of item. The P scale was the most problematic in terms of convergent and discriminant validity.     

The five-factor narcissism inventory: a five-factor measure of narcissistic personality traits

This study provides convergent, discriminant, and incremental validity data for a new measure of narcissistic personality traits created from the perspective of the Five-factor model (FFM) of general personality structure. Fifteen scales were constructed as maladaptive variants of respective facets of the FFM (e.g., Reactive Anger as a narcissistic variant of angry hostility), with item selection made on the basis of a criterion-keying approach using results from 167 undergraduates. On the basis of data from 166 additional undergraduates, the convergent validity of these 15 scales was tested with respect to 8 established measures of narcissism (including measures of both grandiose and vulnerable narcissism) and the respective facets of the FFM. Discriminant validity was tested with respect to facets from other FFM domains. Incremental validity was tested with respect to the ability of the FFM narcissism trait scales to account for variance in 2 alternative measures of narcissism, after variance accounted for by respective NEO PI-R facet scales and other established measures of narcissism were first removed. The findings support the validity of these new scales as measures of narcissistic personality traits and as maladaptive variants of the FFM.     

An introduction to mixture item response theory models

Mixture item response theory (IRT) allows one to address situations that involve a mixture of latent subpopulations that are qualitatively different but within which a measurement model based on a continuous latent variable holds. In this modeling framework, one can characterize students by both their location on a continuous latent variable as well as by their latent class membership. For example, in a study of risky youth behavior this approach would make it possible to estimate an individual's propensity to engage in risky youth behavior (i.e., on a continuous scale) and to use these estimates to identify youth who might be at the greatest risk given their class membership. Mixture IRT can be used with binary response data (e.g., true/false, agree/disagree, endorsement/not endorsement, correct/incorrect, presence/absence of a behavior), Likert response scales, partial correct scoring, nominal scales, or rating scales. In the following, we present mixture IRT modeling and two examples of its use. Data needed to reproduce analyses in this article are available as supplemental online materials at http://dx.doi.org/10.1016/j.jsp.2016.01.002.     

A brief inventory of Interpersonal Problems-Circumplex using nonparametric item response theory: introducing the IIP-C-IRT

Nonparametric item response theory methods were applied to the responses of 1,000 college students on the 64 items of the Inventory of Interpersonal Problems-Circumplex (IIP-C; Alden, Wiggins, & Pincus, 1990) to develop an abbreviated 32-item version of the instrument. In a separate validation sample of 981 students, the newly selected scale items did not show evidence of differential item functioning across males and females. There was high convergence found between the new scales and IIP-C parent scales, along with commensurate or improved fits to the circular structural model relative to the full scale and its existing brief derivatives-the IIP-32 and the IIP-SC. Results provide evidence that the new brief scales can improve the level of precision and information yielded in brief assessments of interpersonal problems without gender bias.     

A multigroup item response theory analysis of the psychopathy checklist--revised

Item response theory was used to investigate the functioning of the Psychopathy Checklist-Revised (PCL-R; R. D. Hare, 1991, 2003) in several offender populations. With male criminal offenders (N=3,847) as a reference group, differential item functioning analyses were performed for 3 comparison groups: female criminal offenders (N=1,219), male forensic psychiatric patients (N=1,246), and male criminal offenders scored from file reviews (N=2,626). Results are discussed in the context of the 2-factor, 4-facet model for the PCL-R (R. D. Hare, 2003; J. Parker, G. Sitarenios, & R. D. Hare, 2003). Application of a multigroup graded response model to all 4 groups suggests scalar equivalence may hold at least approximately for each population, although the PCL-R provided slightly greater information about the latent trait of psychopathy for male criminal offenders scored from the standard procedure.     

Differential functioning of the Beck depression inventory in late-life patients: use of item response theory

The present analyses examined age-related measurement bias in responses to items on the revised Beck Depression Inventory (BDI) in depressed late-life patients versus midlife patients. Item response theory (IRT) models were used to equate the scale and to differentiate true-group differences from bias in measurement in the 2 samples. Baseline BDI data (218 late life and 613 midlife) were used for the present analysis. IRT results indicated that late-life patients tended to report fewer cognitive symptoms, especially at low to average levels of depression. Conversely, they tended to report more somatic symptoms, especially at higher levels of depression. Adjusted cutoff scores in the late-life group are provided, and possible reasons for age-related differences in the performance of the BDI are discussed.     

An investigation of hierarchical Bayes procedures in item response theory

Hierarchical Bayes procedures for the two-parameter logistic item response model were compared for estimating item and ability parameters. Simulated data sets were analyzed via two joint and two marginal Bayesian estimation procedures. The marginal Bayesian estimation procedures yielded consistently smaller root mean square differences than the joint Bayesian estimation procedures for item and ability estimates. As the sample size and test length increased, the four Bayes procedures yielded essentially the same result.The authors wish to thank the Editor and anonymous reviewers for their insightful comments and suggestions.     

Conjunctive item response theory kernels

Conjunctive item response models are introduced such that (a) sufficient statistics for latent traits are not necessarily additive in item scores; (b) items are not necessarily locally independent; and (c) existing compensatory (additive) item response models including the binomial, Rasch, logistic, and general locally independent model are special cases. Simple estimates and hypothesis tests for conjunctive models are introduced and evaluated as well. Conjunctive models are also identified with cognitive models that assume the existence of several individually necessary component processes for a global ability. It is concluded that conjunctive models and methods may show promise for constructing improved tests and uncovering conjunctive cognitive structure. It is also concluded that conjunctive item response theory may help to clarify the relationships between local dependence, multidimensionality, and item response function form.I appreciate the many helpful suggestions that were given by the reviewers and Ivo Molenaar.     

Use of item ratings to examine personality test item cognitive response processes

This research examines the processes respondents use to answer personality test items. A total of 158 true/false items from four scales of the Personality Research Form and the California Psychological Inventory were used as stimuli. University students (N = 120) responded to each item and indicated one of nine strategies used in deciding on a response. Obtained response strategy ratings for items were reliable and their frequencies corresponded closely to previous findings with other items. Subsequently, the associations between item response strategy frequencies and item-total correlations were computed. Congruent with previous research, better items avoided behaviours or experiences and evoked responding based on traits and on referring to the statements of others. The associations between item response strategies and other indices of item quality are discussed and implications regarding scale development are offered.     

Two item response theory models for analysing normative forced‐choice personality items

This paper proposes two unidimensional item response theory (IRT) models for analysing normative forced‐choice personality items. Both models are derived from a common theoretical framework and arise as a result of different assumptions regarding the mechanism of choice. The simplest mechanism gives rise to the one‐parameter normal‐ogive model. The second mechanism gives rise to a new IRT model, which is closely related to the Coombs–Zinnes probabilistic unfolding model. The second model is compared theoretically to the normal‐ogive model in terms of item characteristic curves and amount of item information. Next, procedures for estimating the respondent and the item parameters in the second model are described. Finally, both models are empirically compared by using two well‐known personality measures.