Further validation of a measure of irrational belief

Malouff and Schutte (1986) developed a measure of irrational belief intended to be shorter and more content valid than other such measures and reported preliminary evidence of reliability and validity for the measure. The present two studies examined further the validity of the new measure. Study 1 produced evidence of construct validity in that a significant correlation was found between scores on the Malouff & Schutte measure and scores on a measure of hostility, which is a theoretically related construct. Study 2 produced evidence of construct validity in that scores on the Malouff & Schutte measure were found to be correlated with scores on two measures of theoretically related constructs: anxiety and irrational tendencies/beliefs. Study 2 also produced evidence of discriminant validity in that scores on the Malouff & Schutte measure were found to be significantly more highly correlated with scores on the more theoretically similar irrational tendencies/beliefs scale than with scores on the anxiety measure.     

Subjective Well-Being: The Convergence and Stability of Self-Report and Non-Self-Report Measures

ABSTRACT The validity of self-report measures of subjective well-being (SWB) was examined and compared with non-self-report measures using a sample of 136 college students studied over the course of a semester. A principal axis factor analysis of self- and non-self-report SWB measures revealed a single unitary construct underlying the measures. Conventional single-item and multi-item self-report measures correlated highly with alternative measures, with theoretical correlates of SWB, and with a principal axis factor underlying five non-self-report measures of well-being. Comparisons of family versus friend informant reports demonstrated the considerable cross-situational consistency and temporal stability of SWB. Evidence of the discriminant validity of the measures was provided by low correlations of the various SWB measures with constructs theoretically unrelated to well-being. It was concluded that conventional self-report instruments validly measure the SWB construct, and that alternative, non-serf-report measures are useful for providing a comprehensive theoretical account of happiness and life satisfaction.     

Identification,Reflection, And Correlation: Problems In The Bases Of Repertory Grid Measures

Repertory grids, deriving from George Kelly's personal construct theory, have been used to provide measures of a number of personality and cognitive variables. Several of these grid measures, such as the identification index, some measures of cognitive complexity, and other indices extracted from factor analyses of grids, are based on correlations between the columns (elements) of the grid data matrix. These measures are problematic and unstable because the intercolumn correlations depend on the direction of scoring across each of the matrix rows (constructs). This direction is not guided by explicit or theoretically justified rules and appears to be arbitrary and inconsistent between researchers. Also, correlation is a poor measure of element similarity, the basis of the identification measure. The importance of the valuating aspect of construing may provide a basis for the standardization of scoring. And scoring from the valued pole of a construct may help bring stability and meaning to the correlation-based measures.     

Structural equation models and personality research

This article is a nontechnical introduction to the use of structural equation models in personality research Although such models can be fruitfully used to address a variety of important theoretical issues, the substantive focus in this article is on the use of such models for elucidating the construct validity of personality measures We include numerous more specific topics under our treatment of construct validity First of all, we show how structural equation models can be applied to the issues of convergent and discriminant validity Do our variables measure the constructs we want them to measure and not other constructs that we would prefer not to measure? Second, we show the utility of structural equation models for predictive validity Do our variables reliably predict other constructs with which they are theoretically linked? Finally, we examine the stability of personality constructs through structural equation models Through-out, our emphasis is on the particular advantages that structural equation models bring to these analytic tasks Ultimately, such models must be used in the service of theory, and when used appropriately, they can help us to refine both our measures and our theories of individual differences     

Testing the latent factor structure and construct validity of the Ten-Item Personality Inventory

Recent efforts have aimed to develop relatively short measures of the Five-Factor Model (FFM) of personality, particularly for when time and/or space is limited. We evaluate the Ten-Item Personality Inventory (TIPI), a non-proprietary FFM measure with two items per dimension. We use a latent variable methodology to examine the TIPI’s factor structure and convergent validity with the 50-item International Personality Item Pool (IPIP) FFM measure. We provide correlations between the scale scores and latent factors, and compare each measure’s pattern of correlations with measures of other individual difference constructs. Results were favorable in terms of the factor structure and convergent validity of the TIPI, particularly regarding the correlations between the respective latent factors of the TIPI and the IPIP–FFM measures.     

Testing the latent factor structure and construct validity of the Ten-Item Personality Inventory

Recent efforts have aimed to develop relatively short measures of the Five-Factor Model (FFM) of personality, particularly for when time and/or space is limited. We evaluate the Ten-Item Personality Inventory (TIPI), a non-proprietary FFM measure with two items per dimension. We use a latent variable methodology to examine the TIPI’s factor structure and convergent validity with the 50-item International Personality Item Pool (IPIP) FFM measure. We provide correlations between the scale scores and latent factors, and compare each measure’s pattern of correlations with measures of other individual difference constructs. Results were favorable in terms of the factor structure and convergent validity of the TIPI, particularly regarding the correlations between the respective latent factors of the TIPI and the IPIP–FFM measures.     

Development and empirical validation of symmetric component measures of multidimensional constructs: customer and competitor orientation

Atheoretical measure purification may lead to construct deficient measures. The purpose of this paper is to provide a theoretically driven procedure for the development and empirical validation of symmetric component measures of multidimensional constructs. Particular emphasis is placed on establishing a formalized three-step procedure for achieving a posteriori content validity. Then the procedure is applied to development and empirical validation of two symmetrical component measures of market orientation, customer orientation and competitor orientation. Analysis suggests that average variance extracted is particularly critical to reliability in the respecification of multi-indicator measures. In relation to this, the results also identify possible deficiencies in using Cronbach alpha for establishing reliable and valid measures.     

Measuring Processing Fluency: One versus Five Items

While there is an ample amount of consumer behavior research that recruits processing fluency as an explanatory construct, the question how to best measure the fluency experience has received little attention. Therefore, there is a lack of consistency in measuring the construct, particularly with regard to the use of single‐item versus multi‐item measures. The current research, thus, aims to investigate how processing fluency can be consistently measured across different experimental fluency manipulations and which type of measure has the highest validity. Based on classic scale development procedures, we propose a reliable and valid multi‐item measure and compare this measure against a single‐item measure in terms of predictive validity. We show that both measures mediate the effect of five established fluency manipulations and that the single‐item measure is sufficient. In addition to providing a measure for future research that can be adapted to different empirical settings, we provide empirical evidence on the replicability of fluency effects and on the theoretical conjecture that people have a uniform fluency experience across different manipulations of fluency.     

The Validity of Receptive and Expressive Vocabulary Measures with Spanish-Speaking Kindergarteners Learning English

Research examined construct meaning and validity for two new measures of receptive and expressive vocabulary for Spanish-speaking kindergarteners learning English. Substantive validity and generalizability of score meaning was assessed by examining correlations between an established measure (Peabody Picture Vocabulary Test–PPVT) and new measures (Stanford English Language Proficiency Test–SELP; Dynamic Indicators of Basic Early Literacy Skills, Word Use Fluency, DIBELS–WUF). Positive correlations between the SELP and PPVT supported validity of the SELP as a measure of receptive and expressive vocabulary for these children. DIBELS–WUF results were less clear with lower correlations between the PPVT raising questions about appropriateness.     

Development of the Cognitive Dysfunction Questionnaire (CDQ) in a population based sample

The study reports on the development of a questionnaire for assessment of adult cognitive dysfunction (CDQ). Participants in a population-based sample (65±15 years, N=370) responded to a 90-item pilot version covering multiple aspects of memory/cognition. Based on exploratory principal components analyses and correlations with criterion measures of cognitive functioning (MMSE, Block Design, semantic/episodic memory), 20 items loading on 6 components were selected for the final version of the questionnaire. Cronbach's α for the total score was 0.90. There was evidence of construct validity as judged by correlations between CDQ scores, objective cognitive measures, and a subjective memory measure (PRMQ). Discriminant validity was demonstrated by a low and non-significant correlation with depressive symptoms. Further evidence of construct validity was provided by correlations with age and educational attainment. In conclusion, the CDQ is promising as a self-rating screening tool for cognitive dysfunction, and will be the subject of further development and validation.     

A Case Illustrating the Concept of the Alpha Schizophrenic

The construct validity of the Academic Self-Concept Scale (Reynolds, in press) as a measure of an academic facet of general self-concept in college students was examined. Subjects were 589 undergraduate students from three colleges. Convergent validity was demonstrated in the form of correlations between the academic self-concept measure and subjects' grade point average (GPA), and scores on measures of general self-concept and locus of control. A multiple regression analysis of the Academic Self-Concept Scale produced a multiple correlation of .59 with GPA and general self-concept. Discriminant validity was shown via low correlations between academic self-concept and measures of mental ability and social desirability. As expected, differences in academic self-concept between year levels in college were also found. Factor analysis of the Academic Self-Concept Scale and subsequent oblique rotation resulted in seven interpretable factors. The results of this investigation lend support for the construct validity of the Academic Self-Concept Scale.     

Personality Correlates of Assessment Center Consensus Competency Ratings: Evidence from Russia

Controversy has revolved around whether assessment center ratings have construct validity to measure intended dimensions of managerial performance. In contrast to much recent research on the internal structure of assessment center ratings, the present studies investigated the relationship of final competency ratings derived by consensus discussion with external questionnaire measures of personality characteristics. Expanding on previous studies showing correlations of dimension scores in relation to individual trait measures, this study investigated the relationship of complex competencies with both single personality traits and with composites of personality traits. Evidence from two samples of managers in Russia shows that final competency ratings are related to predicted composites of personality factors more consistently than to single factors. Taken together, these findings provide evidence that assessment center ratings derived by consensus discussion show construct validity in relationship with predicted composites of personality characteristics.     

Correlates of sensation seeking by heavy, chronic drug users

Product-moment correlations among number of drugs used and several measures of constructs related to sensation seeking were examined for four matched groups of chronic drug users and two supplementary groups of nine persons each. Number of drugs used correlated positively with all scores on the Sensation Seeking Scales, the Extraversion and Neuroticism Scales of the Eysenck Personality Inventory, and the Change Seeker Index. The pattern is consistent with the proposition that a need for stimulation or change underlies experimentation with a large number of chemical substances. The general pattern of correlations among tests resembled that reported by other investigators. The construct validity of the General Score from the Sensation Seeking Scales is enhanced by these findings. The data suggest that this score measures much the same construct as the Change Seeker Index.     

INTERRATER CORRELATIONS DO NOT ESTIMATE THE RELIABILITY OF JOB PERFORMANCE RATINGS

Interrater correlations are widely interpreted as estimates of the reliability of supervisory performance ratings, and are frequently used to correct the correlations between ratings and other measures (e.g., test scores) for attenuation. These interrater correlations do provide some useful information, but they are not reliability coefficients. There is clear evidence of systematic rater effects in performance appraisal, and variance associated with raters is not a source of random measurement error. We use generalizability theory to show why rater variance is not properly interpreted as measurement error, and show how such systematic rater effects can influence both reliability estimates and validity coefficients. We show conditions under which interrater correlations can either overestimate or underestimate reliability coefficients, and discuss reasons other than random measurement error for low interrater correlations.     

A Confirmatory Factor Analysis of the Short Form Sex Role Behavior Scale

The Sex Role Behavior Scale (SRBS; Orlofsky & O'Heron, 1987; Orlofsky, Ramsden, & Cohen, 1982) is the only measure of the extent to which people engage in male- and female-valued behaviors, as well as sex-specific behaviors. Because of this, researchers must be assured of its reliability and validity. Although the SRBS has demonstrated good reliability, validity tests have been limited to examinations of scale intercorrelations, correlations with other gender role measures, and tests of gender differences. Tests of the SRBS's construct validity have not been performed. Thus, a scale-based confirmatory factor analysis of the short form SRBS was undertaken to determine the validity of its proposed 12-factor, lower-order and 3-factor, higher-order factor structures. In this sample of undergraduates, both lower-order and higher-order models failed to provide a good fit to the data, which suggests that a new version of the SRBS may be required. Discussion focussed on possible directions for a revision, potential limitations, as well as the need for more measures like the SRBS.     

Velocity discrimination: reliability and construct validity in older adults

The aim of this study was to determine whether a test of velocity discrimination is a reliable and valid measure of proprioception in healthy older adults. Results revealed excellent test-retest reliability over a 2-week period. Velocity discrimination also indicated good construct validity with modest correlations with center of pressure sway outcomes in eyes open and closed conditions as well as stair climbing time. Good construct validity was identified by velocity discrimination sensitivity to age with a higher mean value for the older participants than for the younger participants. These findings suggest velocity discrimination is a valid and reliable measure of velocity sense, which may be included with measures of position and movement sense to enhance the proprioceptive testing repertoire among researchers. Implications of these results are discussed in terms of evaluation of proprioceptive training programs aimed to enhance postural control.     

Assessing the validity of multinomial models using extraneous variables: an application to prospective memory

The class of multinomial processing tree (MPT) models has been used extensively in cognitive psychology to model latent cognitive processes. Critical for the usefulness of a MPT model is its psychological validity. Generally, the validity of a MPT model is demonstrated by showing that its parameters are selectively and predictably affected by theoretically meaningful experimental manipulations. Another approach is to test the convergent validity of the model parameters and other extraneous measures intended to measure the same cognitive processes. Here, we advance the concept of construct validity (Cronbach & Meehl, 1955 ) as a criterion for model validity in MPT modelling and show how this approach can be fruitfully utilized using the example of a MPT model of event-based prospective memory. For that purpose, we investigated the convergent validity of the model parameters and established extraneous measures of prospective memory processes over a range of experimental settings, and we found a lack of convergent validity between the two indices. On a conceptual level, these results illustrate the importance of testing convergent validity. Additionally, they have implications for prospective memory research, because they demonstrate that the MPT model of event-based prospective memory is not able to differentiate between different processes contributing to prospective memory performance.     

Measuring time perspective in adolescents: Can you get the right answer by asking the wrong questions?

Time perspective continues to evolve as a psychological construct. The extant literature suggests that higher future orientation and lower present orientation are associated with better developmental outcomes. However, the extant literature also suggests that issues remain with the measurement of the construct. Recently, a 25-item version of the Zimbardo Time Perspective Inventory (ZTPI-25) was suggested for use based on high internal consistency estimates and good discriminant validity of scores in a sample of Italian adolescents. However, the genesis of this scale is uncertain. The present study examined the factorial validity, reliability, and concurrent validity of ZTPI-25 scores in Slovenian, American, and British adolescents. Results revealed satisfactory concurrent validity based on correlations with measures used in the development of the full ZTPI. However, internal consistency and factorial validity of scores were unsatisfactory. The present study questions the use of the ZTPI-25 with adolescents in the context of conceptual and measurement issues more broadly.     

A Psychometric Examination of the Pathological Obsessive Compulsive Personality Scale (POPS): Initial Study in an Undergraduate Sample

Obsessive-compulsive personality disorder (OCPD) has been subject to numerous definition and classification changes, which has contributed to difficulties in reliable measurement of the disorder. Consequently, OCPD measures have yielded poor validity and inconsistent prevalence estimates. Reliable and valid measures of OCPD are needed. The aim of the current study was to examine the factor structure and psychometric properties of the Pathological Obsessive Compulsive Personality Scale (POPS). Participants (N = 571 undergraduates) completed a series of self-report measures online, including the POPS. Confirmatory factor analysis was used to compare the fit of unidimensional, five factor, and bifactor models of the POPS. Convergent and divergent validity were assessed in relation to other personality dimensions. A bifactor model provided the best fit to the data, indicating that the total POPS scale and four subscales can be scored to obtain reliable indicators of OCPD. The POPS was most strongly associated with a disorder-specific measure of OCPD, however there were also positive associations with theoretically disparate constructs, thus further research is needed to clarify validity of the scale.     

Development and validation of a brief self-report measure of trauma exposure: the Trauma History Screen

Although information about individuals' exposure to highly stressful events such as traumatic stressors is often very useful for clinicians and researchers, available measures are too long and complex for use in many settings. The Trauma History Screen (THS) was developed to provide a very brief and easy-to-complete self-report measure of exposure to high magnitude stressor (HMS) events and of events associated with significant and persisting posttraumatic distress (PPD). The measure assesses the frequency of HMS and PPD events, and it provides detailed information about PPD events. Test-retest reliability was studied in four samples, and temporal stability was good to excellent for items and trauma types and excellent for overall HMS and PPD scores. Comprehensibility of items was supported by expert ratings of how well items appeared to be understood by participants with relatively low reading levels. In five samples, construct validity was supported by findings of strong convergent validity with a longer measure of trauma exposure and by correlations of HMS and PPD scores with posttraumatic stress disorder (PTSD) symptoms. The psychometric properties of the THS appear to be comparable or better than longer and more complex measures of trauma exposure.