An inquiry into the construct validity of the Vividness of Visual Imagery Questionnaire

The construct validity of the Vividness of Visual Imagery Questionnaire (VVIQ) was investigated using a series of visual memory tasks. Subjects were shown a picture after completing the questionnaire. Their ability to recall that picture was probed through a free-recall procedure, drawing, two spatial-recall tasks, and a multiple-choice questionnaire. Scores on the VVIQ were statistically unrelated to performance on any of the memory tasks demonstrating a lack of support for construct validity as a measure of visual memory imagery.     

Internal consistency and construct validity of two versions of the Revised Vividness of Visual Imagery Questionnaire

The Vividness of Visual Imagery Questionnaire (VVIQ; Marks, 1973) is the questionnaire most extensively used to measure imagery vividness, but two newer versions have been developed. In this study, the reliability and construct validity of these two measures were assessed: the Vividness of Visual Imagery Questionnaire-2 (VVIQ-2) and the Vividness of Visual Imagery Questionnaire-Revised Version (VVIQ-RV). A total of 206 undergraduate psychology students completed both questionnaires, and to assess construct validity, they also completed the Object-Spatial Imagery and Verbal Questionnaire (OSIVQ), Betts' Questionnaire Upon Mental Imagery (Betts' QMI), and the Measure of Ability to Form Spatial Mental Imagery (MASMI). Internal consistency reliability for both was high, with the VVIQ-RV having a Cronbach's alpha of .96, and the VVIQ-2 an alpha of .91. The construct validity of the VVIQ-RV and the VVIQ-2 was supported by the high correlations they had with the other three measures of imagery, which were all close to .50, and the very small correlations (.06-.07) they had with the Verbal scale of the OSIVQ, indicating that they validly measured the imagery construct. Thus, the findings support the two versions as equally valid psychometric instruments for measuring image vividness.     

Thwarted belongingness and perceived burdensomeness: construct validity and psychometric properties of the Interpersonal Needs Questionnaire

The present study examined the psychometric properties and construct validity of scores derived from the Interpersonal Needs Questionnaire (INQ) using latent variable modeling with 5 independent samples varying in age and level of psychopathology. The INQ was derived from the interpersonal theory of suicide and was developed to measure thwarted belongingness and perceived burdensomeness-both proximal causes of desire for suicide. Results support that thwarted belongingness and perceived burdensomeness are distinct but related constructs and that they can be reliably measured. Further, multiple-group analyses were consistent with invariance for young versus older adults and nonclinical versus clinical populations, thereby supporting the relevance of these constructs to diverse populations. Finally, both constructs demonstrated convergent associations with related interpersonal constructs-including loneliness and social support for belongingness and social worth and death ideation for burdensomeness--as well as prospective associations with suicidal ideation.     

Racial groups and test fairness, considering history and construct validity

According to Helms, "test fairness" is defined as "removal from test scores of systematic variance attributable to experiences of racial or cultural socialization." Some of Helms's reasoning is based on earlier work, which recommended that racial group or category variables be replaced entirely with individual-level constructs, to reflect racial socialization experiences that vary within racial groups. Treatment of the test fairness issue--a social and political issue--will benefit from explicitly considering historical events that contributed to group-level race differences. In light of this history, D. A. Newman et al suggest (a) retaining a group-level conceptualization of race/racial socialization and also (b) focusing on criterion-irrelevant variance in test scores that is attributable to race.     

Comparison of the construct validity of the Gray–Wilson Personality Questionnaire and the BIS/BAS scales

345 subjects completed a translated, shortened version of the Gray–Wilson Personality Questionnaire (GWPQ), along with Russian versions of Carver and White’s BIS/BAS scales, the Eysenck Personality Profiler, the Eysenck Personality Questionnaire, and Spielberger’s State-Trait Anxiety Inventory. Exploratory factor analysis of GWPQ items pointed to a three-factor solution and three new scales were created which demonstrated adequate psychometric characteristics. Confirmatory factor analysis of the BIS/BAS scales showed that a four-factor model best fitted the data but the three BAS subscales should be treated as sub-factors of a second-order factor. Structural equation modelling showed that GWPQ scales generally explained Eysenck’s dimensions better than BIS/BAS scales. The distinction between GWPQ and Carver and White’s scales mainly concerned BAS measures. GWPQ BAS captured more of Psychoticism, whereas Carver and White’s BAS captured more of Extraversion.     

Using FMRI to test models of complex cognition

This article investigates the potential of fMRI to test assumptions about different components in models of complex cognitive tasks. If the components of a model can be associated with specific brain regions, one can make predictions for the temporal course of the BOLD response in these regions. An event-locked procedure is described for dealing with temporal variability and bringing model runs and individual data trials into alignment. Statistical methods for testing the model are described that deal with the scan-to-scan correlations in the errors of measurement of the BOLD signal. This approach is illustrated using a "sacrificial" ACT-R model that involves mapping 6 modules onto 6 brain regions in an experiment from Ravizza, Anderson, and Carter (in press) concerned with equation solving. The model's visual encoding predicted the BOLD response in the fusiform gyrus, its controlled retrieval predicted the BOLD response in the lateral inferior prefrontal cortex, and its subgoal setting predicted the BOLD response in the anterior cingulate cortex. On the other hand, its motor programming failed to predict anticipatory activation in the motor cortex, its representational changes failed to predicted the pattern of activity in the posterior parietal cortex, and its procedural component failed to predict an initial spike in caudate. The results illustrate the power of such data to direct the development of a theory of complex problem solving, both at the level of a specific task model as well as at the level of the cognitive architecture.     

The construct validity of burnout

Considerable confusion exists in the burnout literature about the similarities and separateness among the constructs of burnout, depression and job satisfaction. This study examined the construct validity of burnout using Campbell & Fiske's multitrait-multimethod approach. The constructs of burnout, depression and orderliness (chosen as a discriminant construct) were assessed by three types of self-report instruments. Data were analysed for 181 females and 139 male faculty members who spent at least 50 per cent of their time in teaching. Results indicated that measures of burnout largely met Campbell & Fiske's criteria for construct validity: burnout measures possessed adequate to good internal reliability and convergent validity. However, burnout measures also correlated substantially with measures of depression. Results are discussed in terms of possible explanations for the substantial overlap that has been demonstrated among measures of burnout, depression and job satisfaction.     

Finite mixture distribution models of simple discrimination learning

Through the application of finite mixture distribution models, we investigated the existence of distinct modes of behavior in learning a simple discrimination. The data were obtained in a repeated measures study in which subjects aged 6 to 10 years carried out a simple discrimination learning task. In contrast to distribution models of exclusively rational learners or exclusively incremental learners, a mixture distribution model of rational learners and slow learners was found to fit the data of all measurement occasions and all age groups. Hence, the finite mixture distribution analysis provides strong support for the existence of distinct modes of learning behavior. The results of a second experiment support this conclusion by crossvalidation of the models that fit the data of the first experiment. The effect of verbally labeling the values on the relevant stimulus dimension and the consistency of behavior over measurement occasions are related to the mixture model estimates.     

Servant Leadership Behaviour Scale: A hierarchical model and test of construct validity

Servant leadership is widely believed to be a multidimensional construct. However, existing measures of servant leadership typically suffer from highly correlated dimensions, raising concerns over discriminant validity. We set out in this study to examine the dimensionality of the hypothesized six-factor Servant Leadership Behaviour Scale (SLBS) and validate a hierarchical model of servant leadership. Using structural equation modelling, convergent and discriminant validity of the higher-order servant leadership construct was examined in relation to measures of character-related behaviour, Machiavellian leadership orientation, and social desirability. Our findings suggest that the SLBS assesses a single, higher-order construct of servant leadership with evidence of construct validity and absence of social desirability bias. The high correlation between servant leadership and character-related behaviour supports our expectation that servant leadership reflects in large part the character strength of the leader.     

On the complexity of quantifying construct validity

To validate a measure of a construct is to validate a theory: The process includes theory specification, theory elaboration, choice of methods, choice of research design, reliance on necessary auxiliary theories, and empirical observation. Evaluating the success of the process is likely to be enhanced through quantification. To date, scientists have quantified the final step of empirical observation, but earlier steps in the validation process appear more difficult to measure. In this issue, D. Westen and R. Rosenthal (2005) emphasize that threats to validity are often methodological ones that precede empirical observation. Yet, their earlier attempt to quantify construct validity focused only on the final, empirical observation step of the process. For that reason, it can produce positive results despite real theoretical and methodological threats to validity. Nonetheless, the laudable attempt by these distinguished authors to quantify construct validity reminds us of the complexity of the construct validation process.     

Using latent class analysis to test developmental models

While psychology in general has moved away from using typologies and toward using continua to conceptualize dimensions of behavior, certain aspects of learning and development are still fruitfully considered in typological terms. One reason for the abandonment of typologies was that a small number of types seemed unable to explain the enormous diversity of behavior. The development of statistical models such as latent class analysis has allowed theories involving types to be tested, and the allowance for errors of measurement explains how a small number of types can result in a large number of observed patterns of behavior. This paper demonstrates the application of latent class analysis in several areas of interest to developmental psychologists.     

A test of the construct validity of the Triarchic Psychopathy Measure in an Italian community sample

The Triarchic Psychopathy Measure (TriPM) is a relatively new self-report measure of the basic traits thought to be associated with psychopathy: Boldness, Disinhibition and Meanness. The TRiPM was administered to 286 Italian individuals along with the Psychopathy Personality Inventory-Revised as well as measures of negative affect (anxiety, depression, stress, and hopelessness) and normal-range personality traits. The Italian TriPM showed excellent reliability and was minimally influenced by age and education. Some interesting differences emerged between males and females even though the overall pattern of correlations for TriPM scales with many criterion measures was fairly consistent across gender. TriPM Boldness was associated with indices of adaptive function as well as maladjustment. TriPM Disinhibition was most strongly associated with indices of the behavioral deviance, as well as internalizing problems. Scores on TriPM Meanness were most strongly associated with scales indexing coldheartedness, Machiavellianism, and antagonism. These findings broaden the nomological network of the Triarchic model of psychopathy.     

Using working memory theory to investigate the construct validity of multiple-choice reading comprehension tests such as the SAT.

When taking multiple-choice tests of reading comprehension such as the Scholastic Assessment Test (SAT), test takers use a range of strategies that vary in the extent to which they emphasize reading the questions versus reading the passages. Researchers have challenged the construct validity of these tests because test takers can achieve better-than-chance performance even if they do not read the passages at all. By using an individual-differences approach that compares the relative power of working memory span to predict SAT performance for different test-taking strategies, the authors show that the SAT appears to be tapping reading comprehension processes as long as test takers engage in at least some reading of the passages themselves.     

Using temporal information to construct, update, and retrieve situation models of narratives

Four experiments explored how readers use temporal information to construct and update situation models and retrieve them from memory. In Experiment 1, readers spontaneously constructed temporal and spatial situation models of single sentences. In Experiment 2, temporal inconsistencies caused problems in updating situation models similar to those observed previously for other dimensions of situation models. In Experiment 3, merely implied temporal order information was inferred from narratives, affecting comprehension of later sentences like explicitly stated order information. Moreover, inconsistent temporal order information prevented the creation and storage in memory of an integrated situation model. In Experiment 4, a temporal inconsistency increased processing time even if readers were unable to report the inconsistency. These results confirm the significance of the temporal dimension of situation models.     

Examining the construct validity of the Eating Disorder Inventory

The construct validity of the Eating Disorder Inventory (EDI) was examined in 3 samples. An archival clinic sample (n = 318) of women completed the EDI, a structured interview, and the Millon Clinical Multiaxial Inventory-II (MCMI-II). Confirmatory factor analyses (CFAs) indicated that neither null nor 1-factor models of the EDI fit item-level or item-parcel data. The proposed 8-factor model did not fit at the item level but did fit item-parcel data. Reliability estimates of the 8 scales ranged from .82 to .93, and low-to-moderate interscale correlations among the eating and weight-related scales provided partial support for convergent validity. EDI personality scales showed moderate interscale correlations and were associated with MCMI-II scales. A final CFA of the EDI scales supported a 2-factor model (Eating and Weight, Personality) of the 8 EDI scales. Strong associations between depression and several EDI scale scores were found in a treatment study sample (n = 50). The archival clinic sample scored significantly higher on the 8 EDI scales than the nonpatient college comparison sample (n = 487).