An inquiry into the construct validity of the Vividness of Visual Imagery Questionnaire

The construct validity of the Vividness of Visual Imagery Questionnaire (VVIQ) was investigated using a series of visual memory tasks. Subjects were shown a picture after completing the questionnaire. Their ability to recall that picture was probed through a free-recall procedure, drawing, two spatial-recall tasks, and a multiple-choice questionnaire. Scores on the VVIQ were statistically unrelated to performance on any of the memory tasks demonstrating a lack of support for construct validity as a measure of visual memory imagery.     

Internal consistency and construct validity of two versions of the Revised Vividness of Visual Imagery Questionnaire

The Vividness of Visual Imagery Questionnaire (VVIQ; Marks, 1973) is the questionnaire most extensively used to measure imagery vividness, but two newer versions have been developed. In this study, the reliability and construct validity of these two measures were assessed: the Vividness of Visual Imagery Questionnaire-2 (VVIQ-2) and the Vividness of Visual Imagery Questionnaire-Revised Version (VVIQ-RV). A total of 206 undergraduate psychology students completed both questionnaires, and to assess construct validity, they also completed the Object-Spatial Imagery and Verbal Questionnaire (OSIVQ), Betts' Questionnaire Upon Mental Imagery (Betts' QMI), and the Measure of Ability to Form Spatial Mental Imagery (MASMI). Internal consistency reliability for both was high, with the VVIQ-RV having a Cronbach's alpha of .96, and the VVIQ-2 an alpha of .91. The construct validity of the VVIQ-RV and the VVIQ-2 was supported by the high correlations they had with the other three measures of imagery, which were all close to .50, and the very small correlations (.06-.07) they had with the Verbal scale of the OSIVQ, indicating that they validly measured the imagery construct. Thus, the findings support the two versions as equally valid psychometric instruments for measuring image vividness.     

Thwarted belongingness and perceived burdensomeness: construct validity and psychometric properties of the Interpersonal Needs Questionnaire

The present study examined the psychometric properties and construct validity of scores derived from the Interpersonal Needs Questionnaire (INQ) using latent variable modeling with 5 independent samples varying in age and level of psychopathology. The INQ was derived from the interpersonal theory of suicide and was developed to measure thwarted belongingness and perceived burdensomeness-both proximal causes of desire for suicide. Results support that thwarted belongingness and perceived burdensomeness are distinct but related constructs and that they can be reliably measured. Further, multiple-group analyses were consistent with invariance for young versus older adults and nonclinical versus clinical populations, thereby supporting the relevance of these constructs to diverse populations. Finally, both constructs demonstrated convergent associations with related interpersonal constructs-including loneliness and social support for belongingness and social worth and death ideation for burdensomeness--as well as prospective associations with suicidal ideation.     

Racial groups and test fairness, considering history and construct validity

According to Helms, "test fairness" is defined as "removal from test scores of systematic variance attributable to experiences of racial or cultural socialization." Some of Helms's reasoning is based on earlier work, which recommended that racial group or category variables be replaced entirely with individual-level constructs, to reflect racial socialization experiences that vary within racial groups. Treatment of the test fairness issue--a social and political issue--will benefit from explicitly considering historical events that contributed to group-level race differences. In light of this history, D. A. Newman et al suggest (a) retaining a group-level conceptualization of race/racial socialization and also (b) focusing on criterion-irrelevant variance in test scores that is attributable to race.     

Finite mixture distribution models of simple discrimination learning

Through the application of finite mixture distribution models, we investigated the existence of distinct modes of behavior in learning a simple discrimination. The data were obtained in a repeated measures study in which subjects aged 6 to 10 years carried out a simple discrimination learning task. In contrast to distribution models of exclusively rational learners or exclusively incremental learners, a mixture distribution model of rational learners and slow learners was found to fit the data of all measurement occasions and all age groups. Hence, the finite mixture distribution analysis provides strong support for the existence of distinct modes of learning behavior. The results of a second experiment support this conclusion by crossvalidation of the models that fit the data of the first experiment. The effect of verbally labeling the values on the relevant stimulus dimension and the consistency of behavior over measurement occasions are related to the mixture model estimates.     

Comparison of the construct validity of the Gray–Wilson Personality Questionnaire and the BIS/BAS scales

345 subjects completed a translated, shortened version of the Gray–Wilson Personality Questionnaire (GWPQ), along with Russian versions of Carver and White’s BIS/BAS scales, the Eysenck Personality Profiler, the Eysenck Personality Questionnaire, and Spielberger’s State-Trait Anxiety Inventory. Exploratory factor analysis of GWPQ items pointed to a three-factor solution and three new scales were created which demonstrated adequate psychometric characteristics. Confirmatory factor analysis of the BIS/BAS scales showed that a four-factor model best fitted the data but the three BAS subscales should be treated as sub-factors of a second-order factor. Structural equation modelling showed that GWPQ scales generally explained Eysenck’s dimensions better than BIS/BAS scales. The distinction between GWPQ and Carver and White’s scales mainly concerned BAS measures. GWPQ BAS captured more of Psychoticism, whereas Carver and White’s BAS captured more of Extraversion.     

The construct validity of burnout

Considerable confusion exists in the burnout literature about the similarities and separateness among the constructs of burnout, depression and job satisfaction. This study examined the construct validity of burnout using Campbell & Fiske's multitrait-multimethod approach. The constructs of burnout, depression and orderliness (chosen as a discriminant construct) were assessed by three types of self-report instruments. Data were analysed for 181 females and 139 male faculty members who spent at least 50 per cent of their time in teaching. Results indicated that measures of burnout largely met Campbell & Fiske's criteria for construct validity: burnout measures possessed adequate to good internal reliability and convergent validity. However, burnout measures also correlated substantially with measures of depression. Results are discussed in terms of possible explanations for the substantial overlap that has been demonstrated among measures of burnout, depression and job satisfaction.     

On the complexity of quantifying construct validity

To validate a measure of a construct is to validate a theory: The process includes theory specification, theory elaboration, choice of methods, choice of research design, reliance on necessary auxiliary theories, and empirical observation. Evaluating the success of the process is likely to be enhanced through quantification. To date, scientists have quantified the final step of empirical observation, but earlier steps in the validation process appear more difficult to measure. In this issue, D. Westen and R. Rosenthal (2005) emphasize that threats to validity are often methodological ones that precede empirical observation. Yet, their earlier attempt to quantify construct validity focused only on the final, empirical observation step of the process. For that reason, it can produce positive results despite real theoretical and methodological threats to validity. Nonetheless, the laudable attempt by these distinguished authors to quantify construct validity reminds us of the complexity of the construct validation process.     

Using working memory theory to investigate the construct validity of multiple-choice reading comprehension tests such as the SAT.

When taking multiple-choice tests of reading comprehension such as the Scholastic Assessment Test (SAT), test takers use a range of strategies that vary in the extent to which they emphasize reading the questions versus reading the passages. Researchers have challenged the construct validity of these tests because test takers can achieve better-than-chance performance even if they do not read the passages at all. By using an individual-differences approach that compares the relative power of working memory span to predict SAT performance for different test-taking strategies, the authors show that the SAT appears to be tapping reading comprehension processes as long as test takers engage in at least some reading of the passages themselves.     

Using temporal information to construct, update, and retrieve situation models of narratives

Four experiments explored how readers use temporal information to construct and update situation models and retrieve them from memory. In Experiment 1, readers spontaneously constructed temporal and spatial situation models of single sentences. In Experiment 2, temporal inconsistencies caused problems in updating situation models similar to those observed previously for other dimensions of situation models. In Experiment 3, merely implied temporal order information was inferred from narratives, affecting comprehension of later sentences like explicitly stated order information. Moreover, inconsistent temporal order information prevented the creation and storage in memory of an integrated situation model. In Experiment 4, a temporal inconsistency increased processing time even if readers were unable to report the inconsistency. These results confirm the significance of the temporal dimension of situation models.     

Examining the construct validity of the Eating Disorder Inventory

The construct validity of the Eating Disorder Inventory (EDI) was examined in 3 samples. An archival clinic sample (n = 318) of women completed the EDI, a structured interview, and the Millon Clinical Multiaxial Inventory-II (MCMI-II). Confirmatory factor analyses (CFAs) indicated that neither null nor 1-factor models of the EDI fit item-level or item-parcel data. The proposed 8-factor model did not fit at the item level but did fit item-parcel data. Reliability estimates of the 8 scales ranged from .82 to .93, and low-to-moderate interscale correlations among the eating and weight-related scales provided partial support for convergent validity. EDI personality scales showed moderate interscale correlations and were associated with MCMI-II scales. A final CFA of the EDI scales supported a 2-factor model (Eating and Weight, Personality) of the 8 EDI scales. Strong associations between depression and several EDI scale scores were found in a treatment study sample (n = 50). The archival clinic sample scored significantly higher on the 8 EDI scales than the nonpatient college comparison sample (n = 487).     

Examining the construct validity of the elemental psychopathy assessment

Lynam and colleagues recently developed a new self-report inventory for the assessment of psychopathy, the Elemental Psychopathy Assessment (EPA). Using a sample of undergraduates (N = 227), the authors examined the construct validity of the EPA by examining its correlations with self and stranger ratings on the Five-Factor Model, as well as self-reported ratings of personality disorders, social cognition, and love styles. The EPA psychopathy scores manifested expected correlations with both self and stranger ratings of the Five-Factor Model, particularly with the domains of Agreeableness and Conscientiousness, and were significantly related to various forms of personality pathology such as narcissism and antisocial personality disorders. The EPA also manifested expected relations with aggressive social cognitions. Finally, the EPA psychopathy scores were correlated with romantic love styles indicative of game playing and infidelity. The current results provide further evidence of the construct validity of the EPA as it manifests relations consistent with the nomological network of psychopathy.     

Reliability and validity of the Basic Depression Questionnaire

Background/ObjectiveDepressive disorders have a high prevalence around the world. They present a great comorbidity with other disorders like anxiety, thereby making a differential diagnosis very difficult. The Basic Depression Questionnaire was designed to palliate this issue by isolating specific depression symptoms. Our aim is to study the reliability, factorial structure, and differential item functioning of this questionnaire. Method: The sample consisted of 1,397 adults without psychological problems (M_age = 29.76, SD = 11.25, 64.78% women) who completed the CBD. Results: We observed that none of the items presented differential functioning. A monofactorial structure was established. In this model a good fit was obtained by confirmatory factor analysis and a strict invariance by sex. The ordinal alpha was used to check the reliability and it fetched an index of .95. Conclusions: The Basic Depression Questionnaire has adequate psychometric properties. The absence of differential item functioning and the invariance by sex are guarantees of an adequate use to diagnose depression for men and women. So, its clinical use can help to differentiate between the specific diagnoses for depressive disorders and anxiety disorders.     

Evidence of construct validity for work values

Despite the importance of work values in the process of career adjustment (Dawis, 2002), little empirical research has focused on articulating the domains represented within the construct of work values and the examination of evidence of validity for the construct has been limited. Furthermore, the larger number of work values measures has made it difficult to determine the key domains that constitute the construct. The current study sought to examine multiple measures of work values to understand domains represented within the construct of work values and to establish evidence of validity for these domains. Principal Components Analysis utilizing scores on the Minnesota Importance Questionnaire (Rounds, Henley, Dawis, Lofquist, & Weiss, 1981), the revised edition of Super's Work Values Inventory (SWVI-R; Zytowski, 2006), and Manhardt's Work Values Inventory (Manhardt, 1972) found that six components best explained the data. These components reflected the importance of: the working environment, having challenging work, opportunities for status and income, autonomy, organizational support, and relationships. Implications for research and practice are discussed.     

The construct validity of depressive personality disorder

This study examined the construct validity of depressive personality disorder (DPD: American Psychiatric Association, 1994). Adult psychiatric outpatients (N = 900) underwent comprehensive Axis I and II evaluations and provided data on 4,768 of their 1st-degree relatives. Despite modest overlap, DPD was not redundant with any Axis I or II disorder. Participants with DPD exhibited more Axis I and Axis II comorbidity, and greater psychosocial dysfunction, than participants without DPD. Relatives of participants with DPD had higher rates of mood disorders, alcohol abuse, and antisocial personality. Results are consistent with findings of several other similar investigations. The authors argue that DPD is a valid construct and should be conceptualized as a personality disorder as opposed to a mood disorder.