The Body Esteem Scale: a convergent and discriminant validity study

This research was intended to further establish convergent and discriminant validity for a recent Body Esteem Scale (BES) which measures different dimensions of body satisfaction in young adults. One hundred and fifty-four male and 193 female undergraduates completed the BES, the Body Consciousness Questionnaire (BCQ), the Self-Esteem Scale, and several questions pertaining to exercise, food intake, and attractiveness. Good convergent and discriminant validity was demonstrated by the Male Upper Body Strength and Physical Condition subscales and by the female Weight Concern, Physical Condition, and Sexual Attractiveness subscales.     

The convergent and discriminant validity of subjective fit perceptions

This study examined whether employees develop perceptions about 3 different types of fit: person-organization fit, needs-supplies fit, and demands-abilities fit. Confirmatory factor analyses of data from 2 different samples strongly suggested that employees differentiate between these 3 types of fit. Furthermore, results from a longitudinal design of 187 managers supported both the convergent and discriminant validity of the different types of fit perceptions. Specifically, person-organization fit perceptions were related to organization-focused outcomes (e.g., organizational identification, citizenship behaviors, turnover decisions), whereas needs-supplies fit perceptions were related to job- and career-focused outcomes (e.g., job satisfaction, career satisfaction, occupational commitment). Although demands-abilities fit perceptions emerged as a distinct construct, they were not related to hypothesized outcomes (e.g., job performance, raises).     

The convergent and discriminant validity of the Need for Cognition Scale

This article reports two studies that examined the convergent and discriminant validity of the Need for Cognition Scale (Cacioppo & Petty, 1982). Using samples of college students and prison inmates, need for cognition scores were found to be positively associated with measures of self-esteem, masculine sex role attitudes, absorption, and private self-consciousness. Modest negative associations between need for cognition and measures of public self-consciousness and social anxiety were also uncovered. Need for cognition scores were generally unrelated to measures of feminine and androgynous sex role attitudes, shyness, sociability, and loneliness. These findings add further evidence supporting the construct validity of the Need for Cognition Scale and expand our understanding of the construct of need for cognition.     

Large-scale investigation of the role of trait activation theory for understanding assessment center convergent and discriminant validity

This study used trait activation theory as a theoretical framework to conduct a large-scale test of the interactionist explanation of the convergent and discriminant validity findings obtained in assessment centers. Trait activation theory specifies the conditions in which cross-situationally consistent and inconsistent candidate performances are likely to occur. Results obtained by aggregating correlations across 30 multitrait-multimethod matrices supported the propositions of trait activation theory, shedding a more positive light on the construct validity puzzle in assessment centers. Overall, convergence among assessment center ratings was better between exercises that provided an opportunity to observe behavior related to the same trait, and discrimination among ratings within exercises was generally better for dimensions that were not expressions of the same underlying traits. Implications for assessment center research and practice are discussed.     

Using SAS PROC NLMIXED to fit item response theory models

Researchers routinely construct tests or questionnaires containing a set of items that measure personality traits, cognitive abilities, political attitudes, and so forth. Typically, responses to these items are scored in discrete categories, such as points on a Likert scale or a choice out of several mutually exclusive alternatives. Item response theory (IRT) explains observed responses to items on a test (questionnaire) by a person’s unobserved trait, ability, or attitude. Although applications of IRT modeling have increased considerably because of its utility in developing and assessing measuring instruments, IRT modeling has not been fully integrated into the curriculum of colleges and universities, mainly because existing general purpose statistical packages do not provide built-in routines with which to perform IRT modeling. Recent advances in statistical theory and the incorporation of those advances into general purpose statistical software such as the Statistical Analysis System (SAS) allow researchers to analyze measurement data by using a class of models known as generalized linear mixed effects models (McCulloch & Searle, 2001), which include IRT models as special cases. The purpose of this article is to demonstrate the generality and flexibility of using SAS to estimate IRT model parameters. With real data examples, we illustrate the implementations of a variety of IRT models for dichotomous, polytomous, and nominal responses. Since SAS is widely available in educational institutions, it is hoped that this article will contribute to the spread of IRT modeling in quantitative courses.     

Using multidimensional item response theory to evaluate how response styles impact measurement

Multidimensional item response theory (MIRT) models for response style (e.g., Bolt, Lu, & Kim, 2014, Psychological Methods, 19, 528; Falk & Cai, 2016, Psychological Methods, 21, 328) provide flexibility in accommodating various response styles, but often present difficulty in isolating the effects of response style(s) from the intended substantive trait(s). In the presence of such measurement limitations, we consider several ways in which MIRT models are nevertheless useful in lending insight into how response styles may interfere with measurement for a given test instrument. Such a study can also inform whether alternative design considerations (e.g., anchoring vignettes, self-report items of heterogeneous content) that seek to control for response style effects may be helpful. We illustrate several aspects of an MIRT approach using real and simulated analyses.     

The implications of convergent and discriminant validity data for instrument validation

It seems intuitively compelling to many investigators that measurements, on the same subjects by different methods, purportedly of the same given trait are somehow better evidenced to be mutually valid measurements of that trait to the degree that they are intercorrelated. It is similarly compelling that measurements on the same subjects of purportedly different and uncorrelated traits are somehow better evidenced to be valid measurements to the degree that they are not intercorrelated. Further, a demonstration of hetero-method mono-trait intercorrelation (convergence) jointly with one of hetero-method, or preferably mono-method, hetero-trait independence (discrimination) is more compelling than either single demonstration alone [see Campbell & Fiske, 1959]. I hope to show in what follows that this intuition is misleadingunless certain rather demanding prerequisites are satisfied. Then I hope to show that contrary demonstrations are generally too indecisive to consitute validity disconfirmations. Finally, I shall consider some issues in the practical use of the indecisive multitrait-multimethod data.An earlier version of this paper was presented at the Midwestern Society of Multivariate Experimental Psychology meetings of May 1969 in Chicago. Some explication of the concept of measuring instrument has also been presented elsewhere [Krause, 1969].     

Evaluation of convergent and discriminant validity with multitrait–multimethod correlations

A procedure for evaluation of convergent and discriminant validity coefficients is outlined. The method yields interval estimates of these coefficients in a construct validation study conducted via the multitrait–multimethod approach, as well as permitting examination of their population relationships. The procedure is readily employed in behavioural research using the increasingly popular latent variable modelling methodology. The method is illustrated with a numerical example.     

Using item response theory to understand comorbidity among anxiety and unipolar mood disorders

The authors hypothesized that anxiety and unipolar mood disorders are often comorbid because each disorder indicates a broad, higher order factor. In a clinical subsample of the nationally representative National Comorbidity Survey participants (N = 251), a one-factor model fit the correlations among 7 dichotomous anxiety and unipolar mood diagnoses. Following the lead provided by literature on the structure of emotional and behavioral problems in children, we labeled this factor internalizing. Item response theory was used to explore how each diagnosis mapped onto the internalizing factor. The test information function derived from the 7 diagnoses suggested that they measure primarily the higher end of the factor. In addition, very high scores on internalizing (meeting criteria for 6-7 disorders) were associated with increased social costs, a phenomenon not well captured by the "comorbidity" concept. The results underscore the need to develop clinical assessment instruments that span the full range of the internalizing factor and measure both the shared and distinctive features of anxiety and unipolar mood disorders in a graded, continuous fashion.     

A confirmatory evaluation of the profile of mood states: Convergent and discriminant item validity

The Profile of Mood States was administered to samples of 182 college males, 179 college females, and 257 prison inmates. College males and females did not differ significantly from each other in terms of scale elevation but differed from prison inmates on all scales except Fatigue-Inertia. The college samples differed from the published normative college samples, suggesting the importance of using local norms. A confirmatory item factor analysis suggested convergent item validity with the scoring key and similarity of structure across samples. Discriminant item validity, however, suggested that a smaller number of mood scales would offer a more justifiable interpretation of this inventory.This study was supported by the Alberta Hospital Edmonton, the Solicitor General of Canada, and Social Sciences and Humanities Research Council of Canada Grant 410-80-0576-XI.     

Further examination of the convergent and discriminant validity of the student–teacher relationship scale

Two studies extended psychometric research on the Student–Teacher Relationship Scale (STRS) with kindergarten and preschool children (N₁ = 60–71; N₂ = 35) and their teachers. These studies used a multi‐method approach to replicate and extend previous findings concerning the convergent validity of the STRS Closeness, Conflict, and Dependency scale and to further examine the discriminant validity of the STRS. Study 1 investigated convergence between the STRS scales and child‐ and peer‐reports of the same constructs based on a multi‐trait multi‐method approach. Study 2 examined the pattern of associations between the STRS and indicators of teacher–child relationship quality rated by external observers. Support was found for the convergent validity and to a lesser extent the discriminant validity of the STRS Closeness and Conflict scale. For the STRS Dependency scale, additional research remains necessary. Copyright © 2009 John Wiley & Sons, Ltd.     

The convergent and discriminant validity of the MCMI as a measure of the DSM-III personality disorders

The personality scales of the Millon Clinical Multiaxial Inventory (MCMI) were constructed and validated to measure the typology developed by Millon (1981). The ability of the MCMI to measure the DSM-III personality disorders has not yet been empirically evaluated. The current study found better convergent validity for the DSM-III personality disorders that are consistent with Millon's typology (i.e., the avoidant and the dependent) than for the disorders that are inconsistent (i.e., the antisocial and the passive-aggressive). However, the results may reflect some advantages Millon's typology might have over the DSM-III. The discriminant validity of all four scales was limited, due in part to the overlap among the MCMI scales and the DSM-III personality disorders. We discuss implications of the results for the revision of the MCMI and the DSM-III.     

Psychometric properties of the mobility inventory for agoraphobia: convergent, discriminant, and criterion-related validity

Aims of this study were (a) to summarize the psychometric literature on the Mobility Inventory for Agoraphobia (MIA), (b) to examine the convergent and discriminant validity of the MIA's Avoidance Alone and Avoidance Accompanied rating scales relative to clinical severity ratings of anxiety disorders from the Anxiety Disorders Interview Schedule (ADIS), and (c) to establish a cutoff score indicative of interviewers’ diagnosis of agoraphobia for the Avoidance Alone scale. A meta-analytic synthesis of 10 published studies yielded positive evidence for internal consistency and convergent and discriminant validity of the scales. Participants in the present study were 129 people with a diagnosis of panic disorder. Internal consistency was excellent for this sample, α = .95 for AAC and .96 for AAL. When the MIA scales were correlated with interviewer ratings, evidence for convergent and discriminant validity for AAL was strong (convergent r with agoraphobia severity ratings = .63 vs. discriminant rs of .10–.29 for other anxiety disorders) and more modest but still positive for AAC (.54 vs. .01–.37). Receiver operating curve analysis indicated that the optimal operating point for AAL as an indicator of ADIS agoraphobia diagnosis was 1.61, which yielded sensitivity of .87 and specificity of .73.     

Convergent and discriminant validity of three measures of stage of change

The University of Rhode Island Change Assessment (E. A. McConnaughy, J. O. Prochaska, & W. F. Velicer, 1983), the Stages of Change Readiness and Treatment Eagerness Scale (W. R. Miller & J. S. Tonigan, 1996), and the Readiness to Change Questionnaire (S. Rollnick, N. Heather, R. Gold, & W. Hall, 1992) are commonly used multidimensional measures of stage of change. The authors examined the convergent and discriminant validity of drug-use versions of these 3 measures through multitrait-multimethod analysis in a population of indigent, out-of-treatment drug users (N = 377). Agreement in stage-of-change assignment and the relationship between stage of change and drug-use behaviors were also examined. Confirmatory factor analysis suggests that the Stages of Change Readiness and Treatment Eagerness Scale may have questionable convergent validity with the University of Rhode Island Change Assessment and Readiness to Change Questionnaire. There was moderate agreement in stage assignment. Analysis of behavior did provide some support for the construct validity of the measures. The results suggest that these drug-use stage-of-change measures may not be equivalent.     

On the sampling theory roundations of item response theory models

Item response theory (IT) models are now in common use for the analysis of dichotomous item responses. This paper examines the sampling theory foundations for statistical inference in these models. The discussion includes: some history on the stochastic subject versus the random sampling interpretations of the probability in IRT models; the relationship between three versions of maximum likelihood estimation for IRT models; estimating versus estimating -predictors; IRT models and loglinear models; the identifiability of IRT models; and the role of robustness and Bayesian statistics from the sampling theory perspective.A presidential address can serve many different functions. This one is a report of investigations I started at least ten years ago to understand what IRT was all about. It is a decidedly one-sided view, but I hope it stimulates controversy and further research. I have profited from discussions of this material with many people including: Brian Junker, Charles Lewis, Nicholas Longford, Robert Mislevy, Ivo Molenaar, Donald Rock, Donald Rubin, Lynne Steinberg, Martha Stocking, William Stout, Dorothy Thayer, David Thissen, Wim van der Linden, Howard Wainer, and Marilyn Wingersky. Of course, none of them is responsible for any errors or misstatements in this paper. The research was supported in part by the Cognitive Science Program, Office of Naval Research under Contract No. Nooo14-87-K-0730 and by the Program Statistics Research Project of Educational Testing Service.     

Convergent and discriminant validity of three measures of depressive personality disorder

Sixty-eight outpatients from a veterans' administration psychiatry clinic and community mental health center were assessed with 3 measures of depressive personality disorder (DPD)-the Diagnostic Interview for Depressive Personality Disorder (Gunderson, Phillips, Triebwasser, & Hirschfeld, 1994), the Depressive Personality Disorder Inventory (Huprich, Margrett, Barthelemy, & Fine, 1996), and the Structured Clinical Interview for DSM-IV Axis II Disorders (First, Gibbon, Spitzer, Williams, & Benjamin, 1997a)-to evaluate their convergent and discriminant validity. Evidence supporting the measures' validity was mixed. The rate of convergence of depressive personality diagnoses across 3 measures was less than optimal, but the degree of intercorrelation among the measures was strong. Although depressive personality scores had moderate levels of intercorrelations with other personality disorders, the degree of intercorrelation decreased substantially after controlling for depressive symptoms. I conclude that further work is needed to strengthen the validity of measures of DPD.     

Further validation of the IDAS: evidence of convergent, discriminant, criterion, and incremental validity

The authors explicated the validity of the Inventory of Depression and Anxiety Symptoms (IDAS; D. Watson et al., 2007) in 2 samples (306 college students and 605 psychiatric patients). The IDAS scales showed strong convergent validity in relation to parallel interview-based scores on the Clinician Rating version of the IDAS; the mean convergent correlations were .51 and .62 in the student and patient samples, respectively. With the exception of the Well-Being Scale, the scales also consistently demonstrated significant discriminant validity. Furthermore, the scales displayed substantial criterion validity in relation to Diagnostic and Statistical Manual of Mental Disorders (4th ed.; DSM-IV; American Psychiatric Association, 1994) mood and anxiety disorder diagnoses in the patient sample. The authors identified particularly clear and strong associations between (a) major depression and the IDAS General Depression, Dysphoria and Well-Being scales, (b) panic disorder and IDAS Panic, (c) posttraumatic stress disorder and IDAS Traumatic Intrusions, and (d) social phobia and IDAS Social Anxiety. Finally, in logistic regression analyses, the IDAS scales showed significant incremental validity in predicting several DSM-IV diagnoses when compared against the Beck Depression Inventory-II (A. T. Beck, R. A. Steer, & G. K. Brown, 1996) and the Beck Anxiety Inventory (A. T. Beck & R. A. Steer, 1990).     

The redundancy of work alienation and job satisfaction: Some evidence of convergent and discriminant validity

The multitrait-multimethod matrix (MTMM) technique was used in an attempt to help clarify the ambiguities regarding concepts of work alienation, job satisfaction, and the relationships between them. Within each attitude domain considered separately, generally acceptable evidence of convergent and (to a lesser degree) discriminant validity was found for the trait measures (four dimensions of alienation and five of satisfaction). However, the discrimination between alienation and satisfaction measures was no greater than that among satisfaction and among alienation, casting doubt on the demarcation of these as two distinct domains. The measures of satisfaction and alienation also were not correlated differentially with demographic and self-esteem measures. Note was taken of the limitations in our knowledge and operationalization of these areas, as these relate to the assumptions of MTMM technique regarding independence of both underlying trait constructs and measurement methods.