The redundancy of work alienation and job satisfaction: Some evidence of convergent and discriminant validity

The multitrait-multimethod matrix (MTMM) technique was used in an attempt to help clarify the ambiguities regarding concepts of work alienation, job satisfaction, and the relationships between them. Within each attitude domain considered separately, generally acceptable evidence of convergent and (to a lesser degree) discriminant validity was found for the trait measures (four dimensions of alienation and five of satisfaction). However, the discrimination between alienation and satisfaction measures was no greater than that among satisfaction and among alienation, casting doubt on the demarcation of these as two distinct domains. The measures of satisfaction and alienation also were not correlated differentially with demographic and self-esteem measures. Note was taken of the limitations in our knowledge and operationalization of these areas, as these relate to the assumptions of MTMM technique regarding independence of both underlying trait constructs and measurement methods.     

The convergent and discriminant validity of the Need for Cognition Scale

This article reports two studies that examined the convergent and discriminant validity of the Need for Cognition Scale (Cacioppo & Petty, 1982). Using samples of college students and prison inmates, need for cognition scores were found to be positively associated with measures of self-esteem, masculine sex role attitudes, absorption, and private self-consciousness. Modest negative associations between need for cognition and measures of public self-consciousness and social anxiety were also uncovered. Need for cognition scores were generally unrelated to measures of feminine and androgynous sex role attitudes, shyness, sociability, and loneliness. These findings add further evidence supporting the construct validity of the Need for Cognition Scale and expand our understanding of the construct of need for cognition.     

The Body Esteem Scale: a convergent and discriminant validity study

This research was intended to further establish convergent and discriminant validity for a recent Body Esteem Scale (BES) which measures different dimensions of body satisfaction in young adults. One hundred and fifty-four male and 193 female undergraduates completed the BES, the Body Consciousness Questionnaire (BCQ), the Self-Esteem Scale, and several questions pertaining to exercise, food intake, and attractiveness. Good convergent and discriminant validity was demonstrated by the Male Upper Body Strength and Physical Condition subscales and by the female Weight Concern, Physical Condition, and Sexual Attractiveness subscales.     

The implications of convergent and discriminant validity data for instrument validation

It seems intuitively compelling to many investigators that measurements, on the same subjects by different methods, purportedly of the same given trait are somehow better evidenced to be mutually valid measurements of that trait to the degree that they are intercorrelated. It is similarly compelling that measurements on the same subjects of purportedly different and uncorrelated traits are somehow better evidenced to be valid measurements to the degree that they are not intercorrelated. Further, a demonstration of hetero-method mono-trait intercorrelation (convergence) jointly with one of hetero-method, or preferably mono-method, hetero-trait independence (discrimination) is more compelling than either single demonstration alone [see Campbell & Fiske, 1959]. I hope to show in what follows that this intuition is misleadingunless certain rather demanding prerequisites are satisfied. Then I hope to show that contrary demonstrations are generally too indecisive to consitute validity disconfirmations. Finally, I shall consider some issues in the practical use of the indecisive multitrait-multimethod data.An earlier version of this paper was presented at the Midwestern Society of Multivariate Experimental Psychology meetings of May 1969 in Chicago. Some explication of the concept of measuring instrument has also been presented elsewhere [Krause, 1969].     

Further validation of the IDAS: evidence of convergent, discriminant, criterion, and incremental validity

The authors explicated the validity of the Inventory of Depression and Anxiety Symptoms (IDAS; D. Watson et al., 2007) in 2 samples (306 college students and 605 psychiatric patients). The IDAS scales showed strong convergent validity in relation to parallel interview-based scores on the Clinician Rating version of the IDAS; the mean convergent correlations were .51 and .62 in the student and patient samples, respectively. With the exception of the Well-Being Scale, the scales also consistently demonstrated significant discriminant validity. Furthermore, the scales displayed substantial criterion validity in relation to Diagnostic and Statistical Manual of Mental Disorders (4th ed.; DSM-IV; American Psychiatric Association, 1994) mood and anxiety disorder diagnoses in the patient sample. The authors identified particularly clear and strong associations between (a) major depression and the IDAS General Depression, Dysphoria and Well-Being scales, (b) panic disorder and IDAS Panic, (c) posttraumatic stress disorder and IDAS Traumatic Intrusions, and (d) social phobia and IDAS Social Anxiety. Finally, in logistic regression analyses, the IDAS scales showed significant incremental validity in predicting several DSM-IV diagnoses when compared against the Beck Depression Inventory-II (A. T. Beck, R. A. Steer, & G. K. Brown, 1996) and the Beck Anxiety Inventory (A. T. Beck & R. A. Steer, 1990).     

The convergent and discriminant validity of subjective fit perceptions

This study examined whether employees develop perceptions about 3 different types of fit: person-organization fit, needs-supplies fit, and demands-abilities fit. Confirmatory factor analyses of data from 2 different samples strongly suggested that employees differentiate between these 3 types of fit. Furthermore, results from a longitudinal design of 187 managers supported both the convergent and discriminant validity of the different types of fit perceptions. Specifically, person-organization fit perceptions were related to organization-focused outcomes (e.g., organizational identification, citizenship behaviors, turnover decisions), whereas needs-supplies fit perceptions were related to job- and career-focused outcomes (e.g., job satisfaction, career satisfaction, occupational commitment). Although demands-abilities fit perceptions emerged as a distinct construct, they were not related to hypothesized outcomes (e.g., job performance, raises).     

Assessing support networks: Stability and evidence for convergent and divergent validity

Data on important methodological problems in assessing support networks is presented. Stability (over 1 year) and construct validity were examined in two groups of mothers of preschool children. One group of mothers had children with a physical handicap (n = 25); the other group had normally developing children (n = 44). When their children were 4 years of age and again at 5 years of age, mothers' support networks were assessed with the Pattison Psychosocial Kinship Inventory (a semistructured interview) and a log diary. Results indicated considerable stability in mothers' support networks over the 1-year period. In addition, agreement across methods was fairly high despite marked differences in format, providing evidence for the construct of support networks. Further evidence for construct validity was provided by generally low correlations between support network variables and other measures of social ecology. Findings were roughly similar for both groups of mothers indicating general replicability of findings.     

Psychometric properties of the mobility inventory for agoraphobia: convergent, discriminant, and criterion-related validity

Aims of this study were (a) to summarize the psychometric literature on the Mobility Inventory for Agoraphobia (MIA), (b) to examine the convergent and discriminant validity of the MIA's Avoidance Alone and Avoidance Accompanied rating scales relative to clinical severity ratings of anxiety disorders from the Anxiety Disorders Interview Schedule (ADIS), and (c) to establish a cutoff score indicative of interviewers’ diagnosis of agoraphobia for the Avoidance Alone scale. A meta-analytic synthesis of 10 published studies yielded positive evidence for internal consistency and convergent and discriminant validity of the scales. Participants in the present study were 129 people with a diagnosis of panic disorder. Internal consistency was excellent for this sample, α = .95 for AAC and .96 for AAL. When the MIA scales were correlated with interviewer ratings, evidence for convergent and discriminant validity for AAL was strong (convergent r with agoraphobia severity ratings = .63 vs. discriminant rs of .10–.29 for other anxiety disorders) and more modest but still positive for AAC (.54 vs. .01–.37). Receiver operating curve analysis indicated that the optimal operating point for AAL as an indicator of ADIS agoraphobia diagnosis was 1.61, which yielded sensitivity of .87 and specificity of .73.     

Evaluation of convergent and discriminant validity with multitrait–multimethod correlations

A procedure for evaluation of convergent and discriminant validity coefficients is outlined. The method yields interval estimates of these coefficients in a construct validation study conducted via the multitrait–multimethod approach, as well as permitting examination of their population relationships. The procedure is readily employed in behavioural research using the increasingly popular latent variable modelling methodology. The method is illustrated with a numerical example.     

Reinvestment: Examining convergent,discriminant, and criterion validity using psychometric and behavioral measures

Given scarce external validity available to date concerning the reinvestment construct, the aim of this four-study research project was to further explore the validity of the Movement-Specific Reinvestment Scale and the Decision-Specific Reinvestment Scale, using psychometric and behavioral measures. Study 1 showed that deliberative participants had a higher reinvestment tendency than intuitive participants. Study 2 showed that reinvestment was linked to self-consciousness, rumination, perfectionism, and had satisfactory test–retest reliability. Moreover, it provided some potential insights on the development of reinvestment due to parental criticisms. Study 3 indicated that high decision reinvestors performed worse than their low decision reinvestor counterparts in a visual search task under pressure. Study 4 showed that older participants had a lower reinvestment score, and that reinvestment was associated with higher motor imagery ability, challenging the idea that reinvestment can only be seen as detrimental to performance.     

Individual differences in processing styles: validity of the Rational-Experiential Inventory

In Study 1 (N= 203) the factor structure of a Swedish translation of Pacini and Epstein's Rational-Experiential Inventory (REI-40) was investigated using confirmatory factor analysis. The hypothesized model with rationality and experientiality as orthogonal factors had satisfactory fit to the data, significantly better than alternative models (with two correlated factors or a single factor). Inclusion of "ability" and "favorability" subscales for rationality and experientiality increased fit further. It was concluded that the structural validity of the REI is adequate. In Study 2 (N= 72) the REI-factors were shown to have theoretically meaningful correlations to other personality traits, indicating convergent and discriminant validity. Finally, scores on the rationality scale were negatively related to risky choice framing effects in Kahneman and Tversky's Asian disease task, indicating concurrent validity. On the basis of these findings it was concluded that the test has satisfactory psychometric properties.     

Large-scale investigation of the role of trait activation theory for understanding assessment center convergent and discriminant validity

This study used trait activation theory as a theoretical framework to conduct a large-scale test of the interactionist explanation of the convergent and discriminant validity findings obtained in assessment centers. Trait activation theory specifies the conditions in which cross-situationally consistent and inconsistent candidate performances are likely to occur. Results obtained by aggregating correlations across 30 multitrait-multimethod matrices supported the propositions of trait activation theory, shedding a more positive light on the construct validity puzzle in assessment centers. Overall, convergence among assessment center ratings was better between exercises that provided an opportunity to observe behavior related to the same trait, and discrimination among ratings within exercises was generally better for dimensions that were not expressions of the same underlying traits. Implications for assessment center research and practice are discussed.     

Beliefs in the Inheritance of Risk Factors for Suicide Scale: development, reliability, stability, and convergent and discriminant validity

Findings from adoption, family, geographical, immigrant, molecular genetic, surname, and twin studies suggest genetic risk factors have a role in suicidal behavior. However, related mental health literacy (knowledge and beliefs) even of future health-care professionals who will be concerned with suicide lag behind this research progress. As no scale for assessing such beliefs is available, the 22-item Beliefs in the Inheritance of Risk Factors for Suicide Scale was constructed, its contents rated by experts in a validation survey and administered to samples of 70 medical and 165 psychology students. Medical students held stronger beliefs in the genetics of suicide than psychology students. Internal scale consistency and test-retest reliability were assessed as adequate. Factor analysis of the 22 items yielded a dominant first factor. Scores were positively related to knowledge about suicide (convergent validity) but for the most part unrelated to lay theories of suicide, political orientation, religiosity, and social desirability (discriminant validity). This novel scale shows potential for assessing individuals' beliefs about the genetics of suicide. Applications may include basic research, educational contexts, and evaluation of professional training.     

Analyzing the convergent and discriminant validity of states and traits: development and applications of multimethod latent state-trait models

The analysis of convergent and discriminant validity is an integral part of the construct validation process. Models for analyzing the convergent and discriminant validity have typically been developed for cross-sectional data. There exist, however, only a few approaches for longitudinal data that can be applied for analyzing the construct validity of fluctuating states. In this article, the authors show how models of latent state-trait theory can be combined with models of multitrait-multimethod analysis to develop a model that allows for analyzing convergent and discriminant validity in time: the multimethod latent state-trait model. The model allows for identifying different sources of variance (trait consistency, trait-method specificity, occasion-specific consistency, occasion-specific method specificity, and unreliability). It is applied to the repeated measurement of depression and anxiety in children, which was assessed by self and teacher reports (N = 375). The application shows that the proposed models fit the data well and allow a deeper understanding of method effects in clinical assessment.     

Further examination of the convergent and discriminant validity of the student–teacher relationship scale

Two studies extended psychometric research on the Student–Teacher Relationship Scale (STRS) with kindergarten and preschool children (N₁ = 60–71; N₂ = 35) and their teachers. These studies used a multi‐method approach to replicate and extend previous findings concerning the convergent validity of the STRS Closeness, Conflict, and Dependency scale and to further examine the discriminant validity of the STRS. Study 1 investigated convergence between the STRS scales and child‐ and peer‐reports of the same constructs based on a multi‐trait multi‐method approach. Study 2 examined the pattern of associations between the STRS and indicators of teacher–child relationship quality rated by external observers. Support was found for the convergent validity and to a lesser extent the discriminant validity of the STRS Closeness and Conflict scale. For the STRS Dependency scale, additional research remains necessary. Copyright © 2009 John Wiley & Sons, Ltd.     

Neuroticism, negative affect, and negative affect instability: Establishing convergent and discriminant validity using ecological momentary assessment

Few investigations have examined the role of affective instability within a broad model of general personality functioning. The present study employed self-report and ecological momentary assessments (EMA) to examine the relations between self-reported Five-Factor Model Neuroticism, EMA average negative affect, and EMA negative affect instability. Results suggest that Neuroticism and negative affect instability are related yet distinct constructs, and that Neuroticism better represents average negative affect across time. Results also suggest that negative affect instability is related to low Agreeableness and specific externalizing facets of Neuroticism, such as Angry Hostility and Impulsiveness. The implications of these findings and potential areas for future research are discussed.     

The convergent and discriminant validity of the MCMI as a measure of the DSM-III personality disorders

The personality scales of the Millon Clinical Multiaxial Inventory (MCMI) were constructed and validated to measure the typology developed by Millon (1981). The ability of the MCMI to measure the DSM-III personality disorders has not yet been empirically evaluated. The current study found better convergent validity for the DSM-III personality disorders that are consistent with Millon's typology (i.e., the avoidant and the dependent) than for the disorders that are inconsistent (i.e., the antisocial and the passive-aggressive). However, the results may reflect some advantages Millon's typology might have over the DSM-III. The discriminant validity of all four scales was limited, due in part to the overlap among the MCMI scales and the DSM-III personality disorders. We discuss implications of the results for the revision of the MCMI and the DSM-III.     

Neuroticism,negative affect,and negative affect instability: Establishing convergent and discriminant validity using ecological momentary assessment

Few investigations have examined the role of affective instability within a broad model of general personality functioning. The present study employed self-report and ecological momentary assessments (EMA) to examine the relations between self-reported Five-Factor Model Neuroticism, EMA average negative affect, and EMA negative affect instability. Results suggest that Neuroticism and negative affect instability are related yet distinct constructs, and that Neuroticism better represents average negative affect across time. Results also suggest that negative affect instability is related to low Agreeableness and specific externalizing facets of Neuroticism, such as Angry Hostility and Impulsiveness. The implications of these findings and potential areas for future research are discussed.     

Individual differences in perceptual space for tactile textures: evidence from multidimensional scaling

Ratio scaling was used to obtain from 5 subjects estimates of the subjective dissimilarity between the members of all possible pairs of 17 tactile surfaces. The stimuli were a diverse array of everyday surfaces, such as corduroy, sandpaper, and synthetic fur. The results were analyzed using the multidimensional scaling (MDS) program ALSCAL. There was substantial, but not complete, agreement across subjects in the spatial arrangement of perceived textures. Scree plots and multivariate analysis suggested that, for some subjects, a two-dimensional space was the optimal MDS solution, whereas for other subjects, a three-dimensional space was indicated. Subsequent to their dissimilarity scaling, subjects rated each stimulus on each of five adjective scales. Consistent with earlier research, two of these (rough/smooth and soft/hard) were robustly related to the space for all subjects. A third scale, sticky/slippery, was more variably related to the dissimilarity data: regressed into three-dimensional MDS space, it was angled steeply into the third dimension only for subjects whose scree plots favored a nonplanar solution. We conclude that the sticky/slippery dimension is perceptually weighted less than the rough/smooth and soft/hard dimensions, materially contributing to the structure of perceptual space only in some individuals.