The convergent and discriminant validity of the Need for Cognition Scale

This article reports two studies that examined the convergent and discriminant validity of the Need for Cognition Scale (Cacioppo & Petty, 1982). Using samples of college students and prison inmates, need for cognition scores were found to be positively associated with measures of self-esteem, masculine sex role attitudes, absorption, and private self-consciousness. Modest negative associations between need for cognition and measures of public self-consciousness and social anxiety were also uncovered. Need for cognition scores were generally unrelated to measures of feminine and androgynous sex role attitudes, shyness, sociability, and loneliness. These findings add further evidence supporting the construct validity of the Need for Cognition Scale and expand our understanding of the construct of need for cognition.     

The Body Esteem Scale: a convergent and discriminant validity study

This research was intended to further establish convergent and discriminant validity for a recent Body Esteem Scale (BES) which measures different dimensions of body satisfaction in young adults. One hundred and fifty-four male and 193 female undergraduates completed the BES, the Body Consciousness Questionnaire (BCQ), the Self-Esteem Scale, and several questions pertaining to exercise, food intake, and attractiveness. Good convergent and discriminant validity was demonstrated by the Male Upper Body Strength and Physical Condition subscales and by the female Weight Concern, Physical Condition, and Sexual Attractiveness subscales.     

Individual differences in sociosexuality: evidence for convergent and discriminant validity

Individual differences in willingness to engage in uncommitted sexual relations were investigated in 6 studies. In Study 1, a 5-item Sociosexual Orientation Inventory (SOI) was developed. Studies 2, 3, and 4 provided convergent validity evidence for the SOI, revealing that persons who have an unrestricted sociosexual orientation tend to (a) engage in sex at an earlier point in their relationships, (b) engage in sex with more than 1 partner at a time, and (c) be involved in relationships characterized by less investment, commitment, love, and dependency. Study 5 provided discriminant validity for the SOI, revealing that it does not covary appreciably with a good marker of sex drive. Study 6 demonstrated that the SOI correlates negligibly with measures of sexual satisfaction, anxiety, and guilt. The possible stability of, origins of, and motivational bases underlying individual differences in sociosexuality are discussed.     

The Beliefs in the Inheritance of Risk Factors for Suicide Scale (BIRFSS): Cross‐Cultural Validation in Estonia,Malaysia, Romania,the United Kingdom,and the United States

The genetics of suicide is increasingly recognized and relevant for mental health literacy, but actual beliefs may lag behind current knowledge. We examined such beliefs in student samples (total N = 686) from Estonia, Malaysia, Romania, the United Kingdom, and the United States with the Beliefs in the Inheritance of Risk Factors for Suicide Scale. Cultural effects were small, those of key demographics nil. Several facets of construct validity were demonstrated. Marked differences in perceived plausibility of evidence about the genetics of suicide according to research design, observed in all samples, may be of general interest for investigating lay theories of abnormal behavior and communicating behavioral and psychiatric genetic research findings.     

Psychometric properties of the mobility inventory for agoraphobia: convergent, discriminant, and criterion-related validity

Aims of this study were (a) to summarize the psychometric literature on the Mobility Inventory for Agoraphobia (MIA), (b) to examine the convergent and discriminant validity of the MIA's Avoidance Alone and Avoidance Accompanied rating scales relative to clinical severity ratings of anxiety disorders from the Anxiety Disorders Interview Schedule (ADIS), and (c) to establish a cutoff score indicative of interviewers’ diagnosis of agoraphobia for the Avoidance Alone scale. A meta-analytic synthesis of 10 published studies yielded positive evidence for internal consistency and convergent and discriminant validity of the scales. Participants in the present study were 129 people with a diagnosis of panic disorder. Internal consistency was excellent for this sample, α = .95 for AAC and .96 for AAL. When the MIA scales were correlated with interviewer ratings, evidence for convergent and discriminant validity for AAL was strong (convergent r with agoraphobia severity ratings = .63 vs. discriminant rs of .10–.29 for other anxiety disorders) and more modest but still positive for AAC (.54 vs. .01–.37). Receiver operating curve analysis indicated that the optimal operating point for AAL as an indicator of ADIS agoraphobia diagnosis was 1.61, which yielded sensitivity of .87 and specificity of .73.     

The Overvalued Ideas Scale: development, reliability and validity in obsessive-compulsive disorder.

The presence of overvalued ideas in obsessive-compulsive disorder (OCD) has been theoretically linked to poorer treatment outcome [Kozak, M. J. & Foa, E. B. (1994). Obsessions, overvalued ideas and delusions in obsessive-compulsive disorder. Behaviour Research and Therapy, 32, 343-353]. To date, no measures have been developed which quantitatively assess levels of overvalued ideas in obsessive-compulsives. The present studies examined the psychometric properties of a scale developed to measure this form of psychopathology, the Overvalued Ideas Scale (OVIS). In study 1, 102 patients diagnosed with OCD were administered a battery of instruments including the OVIS at baseline and two weeks later, prior to initiating treatment. Results indicate that the OVIS has adequate internal consistency reliability (coefficient alpha = 0.88 at baseline), test-retest reliability (r = 0.86) and interrater reliability (r = 0.88). Moderate to high levels of convergent validity was found with measures of obsessive-compulsive symptoms, a single item assessment of overvalued ideas and psychotic symptoms. Medium levels of discriminant validity with measures of anxiety and depression was obtained in this study. Individuals determined to have high OVI showed greater stability of this pathology than those with lower OVI, suggesting that overvalued ideas are stable for extreme scorers. In study 2 a total of 40 patients participated who were diagnosed with OCD. The same battery of instruments was administered as in study 1, as well as the Beck Depression Inventory and Beck Anxiety Inventories. Results were similar to that obtained in study 1, including a relative lack of discriminant validity with self-report measures of depression and anxiety. It is suggested that further research with the OVIS may show predictive value in treatment outcome studies of OCD.     

The Tourette's Disorder Scale (TODS): development, reliability, and validity

To address the lack of a simple and standardized instrument to assess overall illness severity of Tourette's disorder (TD), the authors developed and tested a 15-item scale to measure a broad range of common symptoms including tics, inattention, hyperactivity, obsessions, compulsions, aggression, and emotional symptoms. Independent investigators used the 15-item Tourette's Disorder Scale (TODS) to assess 60 TD patients who were taking part in a double-blind placebo-controlled multicenter 8-week treatment study. Interrater reliability, internal consistency, convergent and discriminant validity, and sensitivity to change were examined. The TODS was associated with good interrater reliability, excellent internal consistency, and favorable levels of validity and sensitivity to change. Individual TODS items showed good convergent and discriminant validity against other measures. The TODS is a simple, efficient way for clinicians and parents to rate the severity of multiple symptoms commonly found in patients with Tourette's disorder.     

The implications of convergent and discriminant validity data for instrument validation

It seems intuitively compelling to many investigators that measurements, on the same subjects by different methods, purportedly of the same given trait are somehow better evidenced to be mutually valid measurements of that trait to the degree that they are intercorrelated. It is similarly compelling that measurements on the same subjects of purportedly different and uncorrelated traits are somehow better evidenced to be valid measurements to the degree that they are not intercorrelated. Further, a demonstration of hetero-method mono-trait intercorrelation (convergence) jointly with one of hetero-method, or preferably mono-method, hetero-trait independence (discrimination) is more compelling than either single demonstration alone [see Campbell & Fiske, 1959]. I hope to show in what follows that this intuition is misleadingunless certain rather demanding prerequisites are satisfied. Then I hope to show that contrary demonstrations are generally too indecisive to consitute validity disconfirmations. Finally, I shall consider some issues in the practical use of the indecisive multitrait-multimethod data.An earlier version of this paper was presented at the Midwestern Society of Multivariate Experimental Psychology meetings of May 1969 in Chicago. Some explication of the concept of measuring instrument has also been presented elsewhere [Krause, 1969].     

The convergent and discriminant validity of subjective fit perceptions

This study examined whether employees develop perceptions about 3 different types of fit: person-organization fit, needs-supplies fit, and demands-abilities fit. Confirmatory factor analyses of data from 2 different samples strongly suggested that employees differentiate between these 3 types of fit. Furthermore, results from a longitudinal design of 187 managers supported both the convergent and discriminant validity of the different types of fit perceptions. Specifically, person-organization fit perceptions were related to organization-focused outcomes (e.g., organizational identification, citizenship behaviors, turnover decisions), whereas needs-supplies fit perceptions were related to job- and career-focused outcomes (e.g., job satisfaction, career satisfaction, occupational commitment). Although demands-abilities fit perceptions emerged as a distinct construct, they were not related to hypothesized outcomes (e.g., job performance, raises).     

Further validation of the IDAS: evidence of convergent, discriminant, criterion, and incremental validity

The authors explicated the validity of the Inventory of Depression and Anxiety Symptoms (IDAS; D. Watson et al., 2007) in 2 samples (306 college students and 605 psychiatric patients). The IDAS scales showed strong convergent validity in relation to parallel interview-based scores on the Clinician Rating version of the IDAS; the mean convergent correlations were .51 and .62 in the student and patient samples, respectively. With the exception of the Well-Being Scale, the scales also consistently demonstrated significant discriminant validity. Furthermore, the scales displayed substantial criterion validity in relation to Diagnostic and Statistical Manual of Mental Disorders (4th ed.; DSM-IV; American Psychiatric Association, 1994) mood and anxiety disorder diagnoses in the patient sample. The authors identified particularly clear and strong associations between (a) major depression and the IDAS General Depression, Dysphoria and Well-Being scales, (b) panic disorder and IDAS Panic, (c) posttraumatic stress disorder and IDAS Traumatic Intrusions, and (d) social phobia and IDAS Social Anxiety. Finally, in logistic regression analyses, the IDAS scales showed significant incremental validity in predicting several DSM-IV diagnoses when compared against the Beck Depression Inventory-II (A. T. Beck, R. A. Steer, & G. K. Brown, 1996) and the Beck Anxiety Inventory (A. T. Beck & R. A. Steer, 1990).     

Reinvestment: Examining convergent,discriminant, and criterion validity using psychometric and behavioral measures

Given scarce external validity available to date concerning the reinvestment construct, the aim of this four-study research project was to further explore the validity of the Movement-Specific Reinvestment Scale and the Decision-Specific Reinvestment Scale, using psychometric and behavioral measures. Study 1 showed that deliberative participants had a higher reinvestment tendency than intuitive participants. Study 2 showed that reinvestment was linked to self-consciousness, rumination, perfectionism, and had satisfactory test–retest reliability. Moreover, it provided some potential insights on the development of reinvestment due to parental criticisms. Study 3 indicated that high decision reinvestors performed worse than their low decision reinvestor counterparts in a visual search task under pressure. Study 4 showed that older participants had a lower reinvestment score, and that reinvestment was associated with higher motor imagery ability, challenging the idea that reinvestment can only be seen as detrimental to performance.     

Implicit attitude measures: consistency, stability, and convergent validity

In recent years, several techniques have been developed to measure implicit social cognition. Despite their increased use, little attention has been devoted to their reliability and validity. This article undertakes a direct assessment of the interitem consistency, stability, and convergent validity of some implicit attitude measures. Attitudes toward blacks and whites were measured on four separate occasions, each 2 weeks apart, using three relatively implicit measures (response-window evaluative priming, the Implicit Association Test, and the response-window Implicit Association Test) and one explicit measure (Modern Racism Scale). After correcting for interitem inconsistency with latent variable analyses, we found that (a) stability indices improved and (b) implicit measures were substantially correlated with each other, forming a single latent factor. The psychometric properties of response-latency implicit measures have greater integrity than recently suggested.     

The Environmental Reward Observation Scale (EROS): development, validity, and reliability

Researchers acknowledge a strong association between the frequency and duration of environmental reward and affective mood states, particularly in relation to the etiology, assessment, and treatment of depression. Given behavioral theories that outline environmental reward as a strong mediator of affect and the unavailability of an efficient, reliable, and valid self-report measure of environmental reward, we developed the Environmental Reward Observation Scale (EROS) and examined its psychometric properties. In Experiment 1, exploratory factor analysis supported a unidimensional 10-item measure with strong internal consistency and test-retest reliability. When administered to a replication sample, confirmatory factor analysis suggested an excellent fit to the 1-factor model and convergent/discriminant validity data supported the construct validity of the EROS. In Experiment 2, further support for the convergent validity of the EROS was obtained via moderate correlations with the Pleasant Events Schedule (PES; MacPhillamy & Lewinsohn, 1976). In Experiment 3, hierarchical regression supported the ecological validity of the EROS toward predicting daily diary reports of time spent in highly rewarding behaviors and activities. Above and beyond variance accounted for by depressive symptoms (BDI), the EROS was associated with significant incremental variance in accounting for time spent in both low and high reward behaviors. The EROS may represent a brief, reliable and valid measure of environmental reward that may improve the psychological assessment of negative mood states such as clinical depression.     

Analyzing the convergent and discriminant validity of states and traits: development and applications of multimethod latent state-trait models

The analysis of convergent and discriminant validity is an integral part of the construct validation process. Models for analyzing the convergent and discriminant validity have typically been developed for cross-sectional data. There exist, however, only a few approaches for longitudinal data that can be applied for analyzing the construct validity of fluctuating states. In this article, the authors show how models of latent state-trait theory can be combined with models of multitrait-multimethod analysis to develop a model that allows for analyzing convergent and discriminant validity in time: the multimethod latent state-trait model. The model allows for identifying different sources of variance (trait consistency, trait-method specificity, occasion-specific consistency, occasion-specific method specificity, and unreliability). It is applied to the repeated measurement of depression and anxiety in children, which was assessed by self and teacher reports (N = 375). The application shows that the proposed models fit the data well and allow a deeper understanding of method effects in clinical assessment.     

Convergent and discriminant validity of the Marital Disillusionment Scale

The Marital Disillusionment Scale, together with measures of divorce proneness, marital disaffection, work addiction, sensation seeking, intimacy, and marital satisfaction (using the subscales Marital Disharmony and Disaffection), was administered to 116 married people (42 men, 74 women) in a university town in the western USA. Scores on the Marital Disillusionment Scale had significant positive correlations with scores on the Marital Instability Scale (r = .54), the Marital Disaffection Scale (r = .72), and the two subscales Disharmony (r = .53) and Disaffection (r = .75) of the eMarital Satisfaction Inventory. Scores for the Marital Disillusionment Scale were negatively correlated with those for the Personal Assessment of Intimacy in Relationships Inventory (r = -.65) but were not significantly associated with scores for the Work Addiction Risk Test and the Brief Sensation Seeking Scale. The results support the convergent and discriminant validity of the Marital Disillusionment Scale.     

Validation of the Social Appearance Anxiety Scale: factor, convergent, and divergent validity

The Social Appearance Anxiety Scale (SAAS) was created to assess fear of overall appearance evaluation. Initial psychometric work indicated that the measure had a single-factor structure and exhibited excellent internal consistency, test-retest reliability, and convergent validity. In the current study, the authors further examined the factor, convergent, and divergent validity of the SAAS in two samples of undergraduates. In Study 1 (N = 323), the authors tested the factor structure, convergent, and divergent validity of the SAAS with measures of the Big Five personality traits, negative affect, fear of negative evaluation, and social interaction anxiety. In Study 2 (N = 118), participants completed a body evaluation that included measurements of height, weight, and body fat content. The SAAS exhibited excellent convergent and divergent validity with self-report measures (i.e., self-esteem, trait anxiety, ethnic identity, and sympathy), predicted state anxiety experienced during the body evaluation, and predicted body fat content. In both studies, results confirmed a single-factor structure as the best fit to the data. These results lend additional support for the use of the SAAS as a valid measure of social appearance anxiety.     

Testing the convergent and discriminant validity of the Decisional Balance Scale of the Transtheoretical Model using the Multi-Trait Multi-Method approach.

The authors extended research on the construct validity of the Decisional Balance Scale for smoking in adolescence by testing its convergent and discriminant validity. Hierarchical confirmatory factor analysis multi-trait multi-method approach (HCFA MTMM) was used with data from 2,334 UK adolescents, both smokers and non-smokers. They completed computerized and paper versions of the questionnaire on 3 occasions over 2 years. The results indicated a 3-factor solution; Social Pros, Coping Pros, and Cons fit the data best. The HCFA MTMM model fit the data well, with correlated methods and correlated trait factors. Subsequent testing confirmed discriminant validity between the factors and convergent validity of both methods of administering the questionnaire. There was, however, clear evidence of a method effect, which may have arisen due to different response formats or may be a function of the method of presentation. Taken with other data, there is strong evidence for construct validity of Decisional Balance for smoking in adolescence, but evidence of predictive validity is required.     

Obsessions and compulsions: Dimensional structure, reliability, convergent and divergent validity of the padua inventory

This study presents data on dimensional structure, reliability, convergent and divergent validity of the Padua Inventory (PI). In a sample (n = 430) of normal Dutch subjects. The dimensional structure and the strength of the factors were comparable to those found in the Italian sample. The reliability of the PI was found to be satisfactory. As hypothesized substantial correlations were found between the PI and related scales of the Maudsley Obsessive-Compulsive Inventory (MOCI) and between the PI and the subscales Sensitivity, Hostility and Depression of the revised version of the Symptom Checklist. Low correlations were found between the PI on the one side and the Eysenck Personality Questionnaire revised Extraversion, Psychoticism and Social Desirability scale on the other side. Finally, the mean score of the PI differs across the Italian, American and Dutch samples. This is of theoretical interest and deserves further study.     

Multiculturally Sensitive Mental Health Scale (MSMHS): development, factor analysis, reliability, and validity

Effectively and efficiently diagnosing African Americans' mental health has been a chronically unresolved challenge. To meet this challenge we developed a tool to better understand African Americans' mental health: the Multiculturally Sensitive Mental Health Scale (MSMHS). Three studies reporting the development and initial validation of the MSMHS were conducted with African American student samples. First, an exploratory factor analysis of an initial item pool yielded 5 factors assessing subscales of perceived racism, depression, well-being, anxiety, and suicidal thoughts. Second, a confirmatory factor analysis supported the MSMHS's 5-dimensional factor structure. Third, test-retest reliability, internal consistency, and validity coefficients supported the viability, use, and potential for continued development of this new instrument. Implications for theory and research on multicultural mental health scales are discussed.