The concurrent validity of three self-report measures of borderline personality

The recent accumulation of self-report measures of borderline personality disorder (BPD) affords the opportunity to evaluate both the construct validity of the concept and the quality of these measures. This study examines the relationship among three recently developed self-report instruments for assessing BPD from the Personality Assessment Inventory (PAI; Morey, 1991), the MMPI Personality Disorders Scales (MPD; Morey, Waugh, & Blashfield, 1985), and the Bell Object Relations Inventory (BORI: Bell, Billington, & Becker, 1986). Data on the three measures were provided by 119 undergraduate subjects from a southeastern university. A correlational analysis addresses the convergence of these measures of BPD, their divergence from measures of different but related traits, and their independence from variance due to method. Application of the Campbell-Fiske (1959) criteria indicates adequate convergence for all the BPD measures but a lack of discriminant validity for the BORI scales. The fit of the data to a structural model of construct validity is tested using confirmatory factor analysis, and these results are consistent with the hypothesis of a latent borderline trait factor independent of measurement method factors. In sum, the construct validity of the borderline personality concept using self-report methodologies receives support, and a strong association between borderline personality and paranoid phenomena is also suggested.     

Psychometric evaluation of the Multidimensional Assessment of Fatigue scale for use with pregnant and postpartum women

Although fatigue is a common experience for pregnant women and new mothers, few measures of fatigue have been validated for use with this population. To address this gap, the authors assessed psychometric properties of the Multidimensional Assessment of Fatigue (MAF) scale, which was used in 2 independent samples of pregnant women. Results indicated that the psychometric properties of the scale were very similar across samples and time points. The scale possesses a high level of internal consistency, has good convergent validity with measures of sleep quality and depression, and discriminates well from a measure of social support. Contrary to previous evaluations of the MAF, data strongly suggest that the scale represents a unidimensional construct best represented by a single factor. Results indicate that the MAF is a useful measure of fatigue among pregnant and postpartum women.     

Assessment of dysfunctional beliefs in borderline personality disorder

This study had two aims: to test the hypothesis that borderline personality disorder (BPD) patients hold numerous dysfunctional beliefs associated with a variety of Axis II disorders, and to construct a BPD belief scale which captures these beliefs. Beliefs were measured using the Personality Belief Questionnaire (PBQ) which is designed to assess beliefs associated with various personality disorders, although not specifically BPD. Eighty-four BPD patients and 204 patients with other personality disorders (OPD) were randomly split into two study samples. Fourteen PBQ items were found to discriminate BPD from OPD patients in both samples. These items came from the PBQ Dependent, Paranoid, Avoidant, and Histrionic scales and reflect themes of dependency, helplessness, distrust, fears of rejection/abandonment/losing emotional control, and extreme attention-seeking behavior. A BPD beliefs scale constructed from these items showed good internal consistency and diagnostic validity among the 288 study patients. The scale may be used to assist in diagnosis and cognitive therapy of BPD.     

Development and validation of a work‐specific measure of cognitive failure: Implications for occupational safety

Two studies were conducted to develop and validate a work‐specific measure of cognitive failure, the Workplace cognitive failure scale (WCFS). In initial item development, content validity was gained via sorting. In Study 1, data were obtained from an employee sample that supported the factorial, construct, and criterion‐related validity of the WCFS. In particular, results supported the expected relationships of workplace cognitive failure with facets of personality, role overload, components of self‐regulation, and self‐reported measures of safety outcomes. Study 2 examined the WCFS in two additional employee samples, and provided further criterion‐related validity using objective measures of injury and supervisor ratings of safety behaviour. Overall, results supported the validity and utility of the new measure in assessing organizational safety behaviour and outcomes, more so than the general cognitive failure scale.     

Self-report measure of parental reflective functioning: A study of reliability and validity across three samples of varying clinical risk

The Parental Reflective Functioning Questionnaire (PRFQ) provides an efficient way to measure a parent's capacity to recognize their child's mental states and to understand the relationship between underlying mental states and behavior. To date, limited work evaluates its psychometric properties beyond initial validation studies. Here we examined the reliability and validity of the PRFQ in three samples of varying clinical risk (e.g., community sample, previous mental health diagnosis, substance use disorder diagnosis). Across samples, the majority (e.g., 75%–78%) of mothers identified as White; all mothers were from the USA. We compared the PRFQ to task-based measures of mentalization, the Parent Development Interview (PDI), and measures of the parent-child relationship. The PRFQ was a reliable measure across samples, and it was associated in theoretically consistent ways with task-based measures of mentalization. Parental RF across the PDI and PRFQ were not highly correlated in a sample of mothers with substance use disorders. Existing RF measures may be tapping into a different component of the broader construct of parental reflective functioning (PRF). The PRFQ was further validated by demonstrating relationships with parent-report measures of the parent-child relationship. Taken together, these findings provide additional support for the reliability and validity of the PRFQ.     

Reliability and validity of three screening measures of borderline personality disorder in a nonclinical population

This study explored reliability and validity of three self-report screening measures of borderline personality disorder (BPD): the Personality Assessment Inventory-Borderline Features Scale (PAI-BOR; Morey, 1991), Personality Diagnostic Questionnaire-4-BPD scale (PDQ4-BPD; Hyler, 1994) and Mclean Screening Instrument for BPD (MSI-BPD; Zanarini et al., 2003). Participants (N = 523) were drawn predominantly from community and student populations. All three measures were internally consistent. Confirmatory Factor Analysis of the PAI-BOR did not support Jackson and Trull’s (2001) six-factor structure or Morey’s (1991) four-factor structure. The three measures converged highly, despite the broader theoretical basis of the PAI-BOR. Expected demographic differences on the measures supported construct validity, and concurrent validity in relation to theoretical-related criteria was also supported. Only the PAI-BOR and PDQ4-BPD showed incremental validity in predicting specific criteria, although, the amount of unique variance predicted was small.     

Rainbows in the society: A measure of hope for society

The aim of this study was to develop and validate a measure of social hope. Previous studies have extensively reported on personal hope and its outcomes. Although a few studies have suggested the concept of collective or social hope, there is no instrument to assess the construct. In this study, we created a 5‐item scale, drawing on Snyder's hope theory, and collected two sets of survey data online. Analysis of these data sets revealed that the new scale was structurally unidimensional and internally consistent. In association with Snyder's State Hope Scale, the Social Hope Scale showed convergent and discriminant validity. The social hope construct also exhibited theoretically meaningful relationships with political efficacy and self‐construal (concurrent validity). Finally, social hope was higher for those who had participated in certain types of social activism than it was for those who had not (predictive validity). These results suggest that the Social Hope Scale is a reliable and valid self‐report measure of hopeful thinking for society.     

A measure of autonomy

This article reports the development of a measure of indicidual differences in autonomous rule compliance. The autonomy scale (a short, easily administered CPI based test) was developed within the framework of a multidimensional, role-theoretical model of moral development. Five samples were used in the construction of the scale. Two of the samples (total n = 111) were used to derive the autonomy scale. The items for the scale were derived through the sequential use of two common item selection stategies: criterion keying and factor analysis. An initial set of 55 CPI items were derived using an "ideal" autonomy Q-sort profile as a selection criterion, and an Alpha factor solution was used to reduce this initial pool to a final set of 25 items. Several analyses were conducted using three additional samples (total n = 245) to estimate the reliability of the scale and determine its validity. The results of these analyses provide initial evidence for the content, criterion-realted, and construct validity of the scale and indicate that the measure has an adequate reliability.     

The positivity scale

Five studies document the validity of a new 8-item scale designed to measure positivity, defined as the tendency to view life and experiences with a positive outlook. In the first study (N = 372), the psychometric properties of Positivity Scale (P Scale) were examined in accordance with classical test theory using a large number of college participants. In Study 2, the unidimensionality of the P Scale was corroborated with confirmatory factor analysis in 2 independent samples (N1 = 322; N2 = 457). In Study 3, P Scale invariance across sexes and its relations with self-esteem, life satisfaction, optimism, positive negative affect, depression, and the Big Five provided further evidence of the internal and construct validity of the new measure in a large community sample (N = 3,589). In Study 4, test-retest reliability of the P Scale was found in a sample of college students (N = 262) who were readministered the scale after 5 weeks. In Study 5, measurement invariance and construct validity of P Scale were further supported across samples in different countries and cultures, including Italy (N = 689), the United States (N = 1,187), Japan (N = 281), and Spain (N = 302). Psychometric findings across diverse cultural context attest to the robustness of the P Scale and to positivity as a basic disposition. (PsycINFO Database Record (c) 2012 APA, all rights reserved).     

Further validation of a measure of irrational belief

Malouff and Schutte (1986) developed a measure of irrational belief intended to be shorter and more content valid than other such measures and reported preliminary evidence of reliability and validity for the measure. The present two studies examined further the validity of the new measure. Study 1 produced evidence of construct validity in that a significant correlation was found between scores on the Malouff & Schutte measure and scores on a measure of hostility, which is a theoretically related construct. Study 2 produced evidence of construct validity in that scores on the Malouff & Schutte measure were found to be correlated with scores on two measures of theoretically related constructs: anxiety and irrational tendencies/beliefs. Study 2 also produced evidence of discriminant validity in that scores on the Malouff & Schutte measure were found to be significantly more highly correlated with scores on the more theoretically similar irrational tendencies/beliefs scale than with scores on the anxiety measure.     

Development of the Muscle Appearance Satisfaction Scale: a self-report measure for the assessment of muscle dysmorphia symptoms

Muscle dysmorphia has recently been described as a variant of body dysmorphic disorder that involves an intense preoccupation with one's perceived lack of muscle size. Currently, no assessment measures specific to the cognitive, affective, and behavioral dimensions of the construct of muscle dysmorphia have been published. To address this need, the authors developed the Muscle Appearance Satisfaction Scale (MASS), a brief 19-item self-report measure for the assessment of muscle dysmorphia symptoms. Psychometric evaluation of the MASS across two samples of male weight lifting participants (total N = 372) revealed a stable five-factor structure. An evaluation of factor content resulted in the following factor labels: Bodybuilding Dependence, Muscle Checking, Substance Use, Injury, and Muscle Satisfaction. Internal consistency, test-retest reliability, and construct validity were established with the MASS total score and its subscales. The authors believe the MASS will be a useful measure for research and applied work relating to muscle dysmorphia.     

The Fantasy Questionnaire: A Measure to Assess Creative and Imaginative Fantasy

This article reports the construction and validation of a comprehensive self-report measure of fantasy. Unlike previous measures of fantasy, which focus on psychopathology, we conceive fantasy as a trait with positive connotation. Principal component analysis (N = 318) and confirmatory factor analyses (N = 345) were conducted using 2 sociodemographically diverse samples. The results provided support for a 2-factor conceptualization of the construct, with the dimensions imaginative fantasy and creative fantasy. Imaginative fantasy refers to vivid imagination and absorption in these images and daydreams. Creative fantasy refers to the activity of using fantasy to create new ideas. The trait measure showed good internal consistency, test–retest reliability, discriminant and convergent construct validity, as well as incremental validity. Moreover, in 3 behavioral studies, we put fantasy scores in relationship with behavioral data to provide further proof of validity. A comprehensive measure of fantasy can contribute to our understanding of individual differences in inner experiences, creative processes, and problem solving.     

Planned missing data designs in psychological research

The authors describe 2 efficiency (planned missing data) designs for measurement: the 3-form design and the 2-method measurement design. The 3-form design, a kind of matrix sampling, allows researchers to leverage limited resources to collect data for 33% more survey questions than can be answered by any 1 respondent. Power tables for estimating correlation effects illustrate the benefit of this design. The 2-method measurement design involves a relatively cheap, less valid measure of a construct and an expensive, more valid measure of the same construct. The cost effectiveness of this design stems from the fact that few cases have both measures, and many cases have just the cheap measure. With 3 brief simulations involving structural equation models, the authors show that compared with the same-cost complete cases design, a 2-method measurement design yields lower standard errors and a higher effective sample size for testing important study parameters. With a large cost differential between cheap and expensive measures and small effect sizes, the benefits of the design can be enormous. Strategies for using these 2 designs are suggested.     

Validity of self-reports of alcohol and other drug use: a multitrait-multimethod assessment

Four methods (self-reported rating, self-reported intake, peer-reported rating, peer-reported intake) and multiple analytical criteria were employed to assess the construct validity of reports of three types of substance use (alcohol, marijuana, and cigarettes) in a study of 194 college students who were members of friendship pairs. The resulting multitrait-multimethod matrix was analyzed in the traditional fashion as well as with confirmatory factor analysis. Convergent and discriminant validity for the three substance use traits were quite adequate, although the validity of one measure (the peer-reported intake measure of alcohol use) may be considered inadequate according to some criteria. This study demonstrates the usefulness of multimethod assessment and confirmatory factor analysis for research on construct validity and for derivation of more accurate measures of drug use.     

ON THE VALIDITY OF SUBJECTIVE MEASURES OF COMPANY PERFORMANCE

Subjective measures of company performance are widely used in research and typically are interpreted as equivalent to objective measures. Yet, the assumption of equivalence is open to challenge. We compared the use of both types of measure in 3 separate samples. Findings were consistent in showing that: (a) subjective and objective measures of company performance were positively associated (convergent validity); (b) those relationships were stronger than those between measures of differing aspects of performance using the same method (discriminant validity); and (c) the relationships of subjective and objective company performance measures with a range of independent variables were equivalent (construct validity).     

A comparison of the psychometric properties of the psychopathic personality inventory full-length and short-form versions

The Psychopathic Personality Inventory (PPI) has shown promising construct validity as a measure of psychopathy. Because of its relative efficiency, a short-form version of the PPI (PPI-SF) was developed and has proven useful in many psychopathy studies. The validity of the PPI-SF, however, has not been thoroughly examined, and no studies have directly compared the validity of the short form with that of the full-length version. The current study was designed to compare the psychometric properties of both PPI versions, with an emphasis on convergent and discriminant validity in predicting external criteria conceptually relevant to psychopathy. We used both prison (n = 558) and college samples (n = 322) for this investigation. PPI scale scores were more reliable and more strongly correlated with the conceptually relevant criterion measures compared with the PPI-SF, particularly in the prison sample. There were no differences in relative discriminant validity. Thus, overall, the PPI full-length version showed more evidence of construct validity than did the short form, and the consequences of this psychometric difference should be considered when evaluating the clinical utility of each measure.     

External validity of the new Devereux Adolescent Behavior Rating scales

The discriminant and concurrent validity of the five new scales for the Devereux Adolescent Behavior Rating Scale (DAB) was explored using a heterogeneous sample of psychiatric and substance abuse patients. Consistent with predictions, the substance abuse patients scored higher on the Acting Out Behaviors (AOB) and Heterosexual Interests (HI) scales, and psychiatric patients scored higher on the Psychotic Behaviors scale. Gender differences also were found, including boys being rated higher on Acting Out Behaviors, and girls higher on Heterosexual Interests. The new DAB scales demonstrated sufficient concurrent validity using a thorough record review and a patient rating scale (the Child Behavior Checklist [CBCL]). The Neurotic/Dependent Behaviors scale (NDB) showed a consistent relationship with substance abuse and several other measures of more externalizing behaviors, in addition to the predicted relationships with anxious, tense, and dependent behaviors. The Withdrawn/Timid Behaviors scale (WTB) proved to be a purer measure of internalizing behaviors in both sexes.     

External Validity of the New Devereux Adolescent Behavior Rating Scales

The discriminant and concurrent validity of the five new scales for the Devereux Adolescent Behavior Rating Scale (DAB) was explored using a heterogeneous sample of psychiatric and substance abuse patients. Consistent with predictions, the substance abuse patients scored higher on the Acting Out Behaviors (AOB) and Heterosexual Interests (HI) scales, and psychiatric patients scored higher on the Psychotic Behaviors scale. Gender differences also were found, including boys being rated higher on Acting Out Behaviors, and girls higher on Heterosexual Interests. The new DAB scales demonstrated sufficient concurrent validity using a thorough record review and a parent rating scale (the Child Behavior Checklist [CBCL]). The Neurotic/Dependent Behaviors scale (NDB) showed a consistent relationship with substance abuse and several other measures of more externalizing behaviors, in addition to the predicted relationships with anxious, tense, and dependent behaviors. The Withdrawn/Timid Behaviors scale (WTB) proved to be a purer measure of internalizing behaviors in both sexes.     

An examination of the Validity of the Elemental Psychopathy Assessment: Relations with Other Psychopathy Measures,Aggression, and Externalizing Behaviors

The Elemental Psychopathy Assessment (EPA) is a new self-report measure of psychopathy designed to assess the personality traits associated with psychopathy from a Five Factor Model perspective. The current study examined the validity of the EPA in sample of undergraduates by examining the relations between the EPA scales and three validated self-report psychopathy instruments, as well as assessments of aggression, substance use, and antisocial behavior. The EPA scales manifested strong convergent validity with the extant psychopathy measures and an expected pattern of relations with measures of externalizing behaviors. Overall, the EPA appears to be a promising measure of psychopathy which provides new opportunities to explore the underlying structure of this construct and parse its relations with constructs central to its nomological network.     

Development and Preliminary Validation of a Self-Report Measure of Psychopathic Personality Traits in Noncriminal Population

Research on psychopathy has been hindered by persisting difficulties and controversies regarding its assessment. The primary goals of this set of studies were to (a) develop, and initiate the construct validation of, a self-report measure that assesses the major personality traits of psychopathy in noncriminal populations and (b) clarify the nature of these traits via an exploratory approach to test construction. This measure, the Psychopathic Personality inventory (PPI), was developed by writing items to assess a large number of personality domains relevant to psychopathy and performing successive item-level factor analyses and revisions on three undergraduate samples. The PPI total score and its eight subscales were found to possess satisfactory internal consistency and test-retest reliability. In four studies with undergraduates, the PPI and its subscales exhibited a promising pattern of convergent and discriminant validity with self-report, psychiatric interview, observer rating, and family history data. In addition, the PPI total score demonstrated incremental validity relative to several commonly used self-report psychopathy-related measures. Future construct validational studies, unresolved conceptual issues regarding the assessment of psychopathy, and potential research uses of the PPI are outlined.