An assessment of the fakeability of self-report and implicit personality measures

Researchers are focusing on developing implicit measures of personality to address concerns related to the faking of self-report measures. The present study examined the validity and fakeability of Implicit Association Test (IAT) measures of personality self-concept in a repeated-measures design (N = 33). People’s predictions about how they represented themselves on the measures were also assessed. Results indicated that participants were able fake self-report measures when instructed to do so and that they could accurately predict how they represented themselves on these measures. Participants were also able to fake an IAT measure of Extraversion, but were unable to fake an IAT measure of Conscientiousness or predict how they represented themselves on either IAT measure.     

The concurrent validity of three self-report measures of borderline personality

The recent accumulation of self-report measures of borderline personality disorder (BPD) affords the opportunity to evaluate both the construct validity of the concept and the quality of these measures. This study examines the relationship among three recently developed self-report instruments for assessing BPD from the Personality Assessment Inventory (PAI; Morey, 1991), the MMPI Personality Disorders Scales (MPD; Morey, Waugh, & Blashfield, 1985), and the Bell Object Relations Inventory (BORI: Bell, Billington, & Becker, 1986). Data on the three measures were provided by 119 undergraduate subjects from a southeastern university. A correlational analysis addresses the convergence of these measures of BPD, their divergence from measures of different but related traits, and their independence from variance due to method. Application of the Campbell-Fiske (1959) criteria indicates adequate convergence for all the BPD measures but a lack of discriminant validity for the BORI scales. The fit of the data to a structural model of construct validity is tested using confirmatory factor analysis, and these results are consistent with the hypothesis of a latent borderline trait factor independent of measurement method factors. In sum, the construct validity of the borderline personality concept using self-report methodologies receives support, and a strong association between borderline personality and paranoid phenomena is also suggested.     

The relationship between self-report mood and personality

Past research pertaining to personality and mood has been concerned with the relationship between specific personality traits and specific mood states. The present examines the relationship between self-report measures of personality and mood. University students (82 males, 118 females), completed a personality questionnaire consisting of 20 personality bipolar adjectives and a mood inventory measuring six mood dimensions. Factor analysis of the personality adjectives revealed four factors, which were then correlated with the mood scales. Results of this analysis revealed significant correlations between the personality factors and mood dimensions suggesting that personality is related to some aspects of mood.     

The altruistic personality and the self-report altruism scale

This paper is divided into two parts. In the first, the rank order stability of individual differences in altruism across situations is examined and it is found that substantial consistency occurs when due regard is given to the principle of aggregation. In the second, a self-report altruism scale, on which respondents rate the frequency with which they have engaged in some 20 specific behaviors, is found to predict such criteria as peer-ratings of altruism, completing an organ-donor card, and paper-and-pencil measures of prosocial orientation. These data suggest there is a broad-based trait of altruism.     

Level validity of self-report whole-family measures

This article introduces an approach to testing the level validity of family assessment instruments (i.e., whether a family instrument measures family functioning at the level of the system it purports to assess). Two parents and 2 adolescents in 69 families rated the warmth in each of their family relationships and in the family as a whole. Family members' ratings of whole-family warmth assessed family functioning not only at the family level (i.e., characteristics of the family as a whole) but also at the individual level of analysis (i.e., characteristics of family members as raters), indicating a lack of level validity. Evidence was provided for the level validity of a latent variable based on family members' ratings of whole-family warmth. The findings underscore the importance of assessing the level validity of individual ratings of whole-family functioning.     

Gender bias in self-report personality disorder inventories

There has been considerable controversy and research regarding gender biases in the diagnosis of personality disorders, but few studies have explored whether personality disorder self-report inventories might contain gender biases. The current study investigated whether items from three commonly used inventories evidence a potential for gender bias. Subjects were from outpatient mental health clinics. Items were considered gender biased if they exhibited gender differences and failed to correlate with or, more importantly, correlated negatively with dysfunction. Thirty-eight items evidenced potential bias, the majority of which were from Narcissistic scales. The implications of the results for the clinical assessment of purportedly maladaptive personality traits and for the construction of personality disorder scales are discussed.     

Correspondence between self-report and interview-based assessments of antisocial personality disorder

Antisocial personality disorder (ASPD) is associated with suicide, violence, and risk-taking behavior and can slow response to first-line treatment for Axis I disorders. ASPD may be assessed infrequently because few efficient diagnostic tools are available. This study evaluated 2 promising self-report measures for assessing ASPD--the ASPD scale of the Personality Diagnostic Questionnaire-4 (PDQ-4; S. E. Hyler, 1994) and the Personality Assessment Inventory (PAI; L. Morey, 1991, 2007)--as well as the ASPD module of the Structured Clinical Interview for DSM-IV Axis II (SCID-II; M. B. First, R. L. Spitzer, M. Gibbon, J. B. W. Williams, & L. S. Benjamin, 1997). The measures were administered to 1,345 offenders in court-mandated residential substance abuse treatment programs and prisons. PDQ-4 and PAI scores related strongly to SCID-II symptom counts (rs = .67 and .51, respectively), indicating these measures convey useful clinical information about the severity of offenders' ASPD pathology. The dimensional association between the measures was relatively invariant across gender, race, and site, although differences in mean scores were observed. Levels of agreement of the SCID-II with the PDQ-4 (kappa = .31) and PAI (kappa = .32) in classifying participants as ASPD was limited. Alternative thresholds for both self-report measures were identified and cross-validated.     

The relationship between impulsivity, aggression, and impulsive-aggression in borderline personality disorder: an empirical analysis of self-report measures

Impulsivity has been repeatedly identified as a key construct in BPD; however, its precise definition seems to vary especially regarding the overlap with aggression. The term impulsive-aggression , also generally seen as central to an understanding of BPD, seems to address itself to the interface between the two, but has itself been used inconsistently in the literature, sometimes having reference to a unitary phenotypic dimension, and at other times suggesting some combination of distinct traits. This study examined the relationship between multiple measures of impulsivity, aggression, and impulsive-aggression in a BPD sample ( N = 92) in order to clarify the relationship between these measured constructs in this clinical population. Results show little relationship between measures of aggression and impulsivity in BPD, with measures of impulsive-aggression correlating strongly with measures of aggression only. Implications of the present results for future research and clinical work with BPD are discussed.     

Reliability and validity of two self-report measures of psychopathy

The present study assessed the psychometric properties and construct validity of two self-report measures of psychopathy in a male-college sample: the Levenson Psychopathy scales (LPS; Levenson, Kiehl, & Fitzpatrick, 1995) and the Psychopathic Personality Inventory (PPI; Lilienfeld & Andrews, 1996). Both the LPS and the PPI demonstrated good internal consistency, although selected items from the PPI correlated weakly with their respective factor scores, suggesting the need for further investigation of the factors' item content. The PPI showed stronger validity than the LPS in terms of convergent and discriminant validity of its factor scores and factor associations with two criterion variables, aggression, and anxiety. Overall, the current study provides greater support for the use of the PPI over the LPS in studies investigating psychopathic traits in nonclinical and nonforensic samples.     

A comparison of self-report and interview diagnoses of DSM-III-R personality disorders

A total of 73 psychiatric inpatients, all of whom (but two) fulfilled criteria for at least one specific personality disorder (PD) on SCID-II PQ, were interviewed with the help of PDE. The self-report PD diagnosis was confirmed in 35 (48 per cent) patients. The diagnostic agreement between the two instruments was poor, yielding an overall weighted kappa of 0.22. Levelling off the PD base rates by increasing or decreasing the diagnostic threshold of SCID-II PQ and PDE respectively increased the overall weighted kappa to 0.38 in both instances. 70 per cent of SCID-II PQ but only 29 per cent of PDE personality disorders were of extensive type. Most frequent important co-occurrences occurred between individual PD types within cluster 2. On the whole, the results confirmed the relatively poor agreement between self-report and interview PD diagnoses. The utilization of self-report questionnaires in a clinical practice remains a controversial issue. © 1998 John Wiley & Sons, Ltd.     

Comparing the temporal stability of self-report and interview assessed personality disorder

Findings from several large-scale, longitudinal studies over the last decade have challenged the long-held assumption that personality disorders (PDs) are stable and enduring. However, the findings, including those from the Collaborative Longitudinal Personality Disorders Study (CLPS; Gunderson et al., 2000), rely primarily on results from semistructured interviews. As a result, less is known about the stability of PD scores from self-report questionnaires, which differ from interviews in important ways (e.g., source of the ratings, item development, and instrument length) that might increase temporal stability. The current study directly compared the stability of the Diagnostic and Statistical Manual of Mental Disorders (4th ed.; DSM-IV) PD constructs assessed via the Schedule for Nonadaptive and Adaptive Personality (SNAP-2; Clark, Simms, Wu, & Casillas, in press) with those from the Diagnostic Interview for DSM-IV Personality Disorders (Zanarini, Frankenburg, Sickel, & Yong, 1996) over 2 years in a sample of 529 CLPS participants. Specifically, we compared dimensional and categorical representations from both measures in terms of rank-order and mean-level stability. Results indicated that the dimensional scores from the self-report questionnaire had significantly greater rank-order (mean r=.69 vs. .59) and mean-level (mean d=0.21 vs. 0.30) stability. In contrast, categorical diagnoses from the two measures evinced comparable rank-order (mean κ=.38 vs. .37) and mean-level stability (median prevalence rate decrease of 3.5% vs. 5.6%). These findings suggest the stability of PD constructs depends at least partially on the method of assessment and are discussed in the context of previous research and future conceptualizations of personality pathology.     

Response bias in self-report measures of general health

This study set out to examine the susceptability of two widely used, self-report, psychiatric inventories to response set bias. Subjects were requested to either fake well (physically and psychologically fit), fake psychologically ill, fake physically ill or respond honestly on the General Health Questionnaire (GHQ) and the Langner Scale of Distress (L-22). Predictably subjects who faked well had significantly lower scores than either of the other two experimental groups, however there was no difference between the Fake Well and Control group on the GHQ total or the Somatic and Depression scales. Subjects who faked psychologically ill showed 4 out of 11 significant differences between those who faked physically ill. All of the comparisons between the two Fake Ill groups, and the Well and Control groups, were statistically significant the former reporting higher incidences of distress than the latter. The results are discussed in terms of questionnaire design, subject motivation and alternative methods of assessing mental health.     

Alcohol and correspondence between self-report and physiological measures of anxiety

The present study was designed to determine the main effects of alcohol intoxication on self-report and physiological measures of anxiety. Second, we aimed to assess the role of the Marlowe-Crowne Social Desirability (MCSD) scale in predicting the relationship between self-report and physiological indices of anxiety irrespective of drink content. A final purpose of the study was to determine whether the MCSD could account for discrepancies in the effects of alcohol on the two anxiety response systems. Subjects were male social drinkers who received an 0.70 g/kg dose of alcohol or placebo. Results indicated that irrespective of drink content, subjects with high MCSD scores reported lower levels of anxiety than did subjects with low MCSD scores. This relationship was not evident for heart rate. These results for measures of anxiety were not influenced by drink content.     

Temporal stability of self-report measures in agoraphobia research

Forty subjects, meeting DSM-III criteria for agoraphobia completed, on two occasions, a comprehensive assessment battery. Measures encompassed anxiety, phobia, depression and general symptomatology dimensions of functioning, and consisted of instruments widely employed as outcome measures in agoraphobia research. The test-retest time periods were divided into 4-, 10- and 16-week intervals to ascertain their temporal stability, an often ignored parameter of reliability. The results indicate that agoraphobia, anxiety, depression and general symptomatology measures were temporally stable. However, test-retest reliabilities of the scales' subscores were generally inferior to those of the total score. The findings are discussed, with recommendations for more programmatic psychometric research in the assessment of anxiety disorders.     

Improving self-report measures of non-adherence to HIV medications

The aim of this article is to clarify what factors should be measured to assess non-adherence to an antiretroviral medication regimen among individuals with the Human Immunodeficiency Virus (HIV). In order to consider a patient as non-adherent, a clear operational definition of medication non-adherence should be formulated. This definition should specify the medication to be taken, the medical advice to be followed as well as the behaviors a patient should adopt in a given period of time. Techniques aimed at reducing the influence of several potential biases in self-report questionnaires, such as forgetfulness and social desirability, are also reviewed.     

A comparison of the validity of the five-factor model (FFM) personality disorder prototypes. Using FFM self-report and interview measures

Recent studies have demonstrated that personality disorders (PDs) can be assessed via a prototype-matching technique, which enables researchers and clinicians to match an individual's five-factor model (FFM) personality profile to an expert-generated prototype. The current study examined the relations between these prototype scores, using interview and self-report data, and PD symptoms in an outpatient sample (N = 115). Both sets of PD prototype scores demonstrated significant convergent validity with PD symptom counts, suggesting that the FFM PD prototype scores are appropriate for use with both sources of data.     

A psychometric evaluation of behavioral inhibition and approach self-report measures

Despite the putative applicability and unquestioned heuristic value of capturing individual variation in behavioral inhibition (BIS) and approach system (BAS) sensitivities, the field has yet to achieve widespread agreement regarding a self-report instrument of choice. The current study evaluates perhaps the two strongest candidates, the BIS/BAS scales (Carver & White, 1994) and the Sensitivity to Punishment and Sensitivity to Reward Questionnaire (SPSRQ; Torrubia, Avila, Molto, & Caseras, 2001). Using both confirmatory and exploratory factor analytic techniques in two university samples, we determined that neither measure achieved adequate fit to our data set, and both contain multiple items we deemed to be problematic. Models trimmed of the poor items achieved better fit than the full models. However, even after trimming the data, model fit was marginal at best. Caution is urged in the continued use of both measures on conceptual and psychometric grounds.