An External Construct Validity Study of Rorschach Personality Variables

This study examined (a) hypothesized relationships between Rorschach variables and self-report test measures relating to nominally similar aspects of personality functioning and (b) interrelationships among Rorschach variables. Sixty-two undergraduates were administered the Rorschach, Barron Ego Strength Scale, Kaplan Self-Derogation Scale, Eagly Self-Esteem Scale, Multiple Affective Adjective Checklist (MAACL), Marlowe-Crowne Social Desirability Scale, and the Rotter Locus of Control Scale. Only a few of the predictions received confirmation: inanimate movement (m) correlated, as expected, with MAACL anxiety and hostility, the egocentricity index (3r + 2)/R (R = total responses) correlated significantly with self-esteem, and human movement with minus form level (M -) correlated (inversely) with ego strength. Among the unpredicted findings were some that appear inconsistent with standard Rorschach interpretation. Rorschach variables human movement (M), and experience actual (EA), generally interpreted as reflecting coping resources, related significantly with self-report measures of poor coping and of dysphoric affect. In general, the Rorschach appears better at identifying weaknesses in the ego rather than strengths.     

A Method to Optimize the Response Range While Maintaining Rorschach Comprehensive System Validity

Brief and lengthy Rorschach records have been identified as common problems in protocol administration. Clinicians have debated how to prevent overly short and long records, but they have been reluctant to alter standardized administration for fear of introducing bias. The present study examines a nonintrusive method for constraining responses by prompting for an extra response when only one is offered per card and by removing the card after four responses are given. Among patients who typically produce brief records, consisting of a residential sample of civil and forensic patients with a range of disordered thinking, the alternative administration method demonstrated improved Comprehensive System validity in assessing thought disorder and eliminated the need to readminister the test due to fewer than 14 responses. The findings have clinical implications for protocol administration with thought-disordered populations that typically produce brief records.     

The Construct Validity of Acceptance: A Multitrait-Multimethod Investigation

Despite increasing clinical and empirical attention, the construct validity of acceptance has not been extensively investigated. The present study utilized a multitrait-multimethod design and a correlated trait-correlated method minus one [CT-C(M-1)] confirmatory factor analytic model to assess acceptance's convergent validity across methods and discriminant validity in comparison to cognitive reappraisal and perceived emotional control in a sample of 210 outpatients with anxiety and mood disorders. In addition, the study evaluated acceptance's concurrent validity by investigating the extent to which it was associated with variables of clinical interest over and above the two rival constructs. Results of confirmatory factor analyses supported acceptance's convergent and discriminant validity in comparison to the two neighboring constructs, and thereby provided partial support for its construct validity. However, contrary to prediction, acceptance was not significantly associated with concurrent validation measures. These results are discussed in the context of acceptance's potential therapeutic utility and functional relationships with associated constructs.     

Transparency: A Necessary Requirement for the Construct Validity of Assessment Centres

La validité de construction des centres d'évaluation et la performance perçue des candidats sont-elles sensibles au fait que ceux-ci aient ou non connaissance des dimensions jugées pertinentes? 119 étudiants de 1° cycle ont participéà une session de centre d'évaluation dans des conditions de transparence et de non transparence. II est apparu que la validité de construction était supérieure quand les participants connaissaient les dimensions recherchées et le comportement attendu de leur part. En outre, les notations des sujets de la condition "transparence" qui admettaient avoir soumis leur conduite aux dimensions attendues bénéficiaient d'une validité discriminante et convergente supérieure à celle des notations des sujets qui affirmaient n'avoir tenu aucun compte des dites dimensions. L'impact de la transparence des dimensions recherchées sur la validité de construction des centres d'évaluation est discuté.
The present study tested whether the construct validity of assessment centres and the perceived performance of candidates were influenced by whether or not the requirement dimensions were made transparent for participants. A total of 119 college students participated in an assessment centre under either transparent or nontransparent conditions. Results showed that construct validity was higher when participants knew the requirement dimensions and what behaviour was required of them. In addition, the ratings of subjects in the transparency condition who reported that they had oriented their behaviour towards the requirement dimensions had higher convergent and discriminant validity than the ratings of subjects who reported that they disregarded the requirement dimensions. The consequences of the transparency of requirement dimensions for the construct validity of assessment centres are discussed.     

Six Constructs to Define Rorschach M: A Response

The experimental validity of six constructs, conceptualized to account for Rorschach M, was suggested by (a) step-wise regression analysis on scores from task definitions of each construct and M scores for 45 female subjects, and (b) task correlations with their M scores. Fantasy, time estimation, and intelligence were significantly related to M. Inadequacies of task definitions or initial conceptualization were suggested by the correlational data.     

Meta-Analysis and Construct Validity

It is argued that meta-analysis is a fundamental tool in any construct valida- tion effort. Meta-analytic resuits provide the stable and precise estimates of relationships between variables that are needed for causal modeling and the- ory development. A review of the application of meta-analysis to the area of employment validities is used to show the theoretical and applied benefits this tool can bring to construct validation research. The case is also made that meta-analyses focused on the criterion side of prediction equations would lead to enhanced knowledge of the construct validity of criteria.     

The Rorschach Index of Repressive Style and Scale Checking Style: A Study of Sex Differences

Males and females, subdivided into contrasting groups on the Rorschach Index of Repressive Style (RIRS), completed semantic differentials using themselves and their own art productions as the objects rated. Analysis was made of the relationship between sex and verbal style, and a scale checking style (use of end points versus use of intermediate points) believed to reflect a dimension of rapid, extreme decisions versus careful consideration of nuances. Results showed that males characterized by rich and fluid verbal processes tended toward cautious ratings (use of intermediate points) while females who were verbally free exhibited more extreme ratings (use of end points). It is concluded that a test variable may have different predictive significance in males and females, even though there is no sex difference in the magnitudes of the variables involved. There may be sex differences in the organization of cognitive processes.     

Social Status: Construct and External Validity

Abstract

The present study examined the construct and external validity of social status based on data covering various aspects of the construct, and collected from adolescent samples in Sweden, Australia, and the United States. Using correlation and factor analytic techniques it was found that (a) the various social status variables were, in general, only moderately related within the different countries, (b) the relations among variables were not congruent between countries, (c) two social status factors were revealed in all countries, separating educational-occupational status from social-economic status, and (d) only the educational-occupational factor showed high congruence between all of the countries.     

Single-Sign Rorschach Suicide Indicators: A Validity Study Using a Depressed Inpatient Population

This study attempted to test the validity of using single responses on the Rorschach as indicators of current suicidal risk. Forty-one depressed inpatients were administered the Rorschach along with a concurrent measure of depression and suicidality. Appelbaum and Holzman's (1962) color-shading sign was found to be related to low suicidal risk, whereas Blatt and Ritzler's (1974) transparency sign was found to be unrelated to current suicidal risk, but still related to a past history of suicide attempts. Patients who saw these signs while depressed were also likely to see them when recovered, suggesting that the signs may indicate a "suicidal personality" who may or may not be in any immediate danger of committing suicide.     

Male Reference Group Identity Dependence: Support for Construct Validity

This research study examined correlates of male identity statuses as postulated in Wade's (1998) theory of male reference group identity dependence. The Reference Group Identity Dependence Scale (RGIDS; Wade & Gelso, 1998) was correlated with measures of identity aspects (personal, social, and collective), belongingness, and a universal-diverse orientation. Based on the responses of 172 predominantly middle-class undergraduate college men (59% White, 15% Asian American or Pacific Islander, 13% African American, 4% Hispanic, and 9% other race/ethnicity, e.g., biracial, Arab American, Egyptian American), as predicted, the No Reference Group status negatively related to collective identity and social connectedness; the Reference Group Dependent status positively related to social identity and social connectedness; and the Reference Group Nondependent status positively related to personal identity, collective identity, social connectedness, and a universal-diverse orientation toward others.     

Conceptual Complexity and Construct Validity

Despite a century of methodological and conceptual advances in the technology of psychosocial measurement, poor correspondence between indicators and the constructs they are intended to represent remains a limiting factor to the accumulation of scientific knowledge. Longstanding conventions in measurement may contribute to the failure to develop optimal criteria. These conventions include the focus on complex over simple constructs and the use of multi-item measures of disparate content to represent those constructs. Several arguments suggest that such a measurement model compromises the potential for developing measures that accurately reflect psychosocial phenomena. The article concludes with some preliminary suggestions concerning an alternative model that may address this construct validity problem more effectively.     

Construct Validation of Scales Derived From the Rorschach Method: A Review of issues and Introduction to the Rorschach Rating Scale

I suggest the main goal of Rorschach validation should be a refined understanding of what each score means. Toward this end, I review general issues in construct validity, hurdles unique to the Rorschach, and general limitations with validation criteria. I then recommend two approaches for improving criteria so they can begin approximating the gold standards that are necessary for a refined understanding of what scores actually measure. The first is a method for improving expert clinical judgment, and the second is a method for aggregating data across diverse judges. Finally, the Rorschach Rating Scale (RRS) is presented as a criterion tool to be used with either of these approaches to validation. The RRS is a fairly comprehensive summary of the constructs thought to be measured by various Rorschach scoring systems. The utility of the RRS for research and training are discussed, as are other practical, theoretical, and psychometric issues in its application.     

Transparency in Structured Interviews: Consequences for Construct and Criterion-Related Validity

Although researchers agree on the use of structured interviews in personnel selection, past research has been undecided on whether these interviews need to be conducted nontransparently (i.e., without giving interviewees any indication of the evaluated criteria) or transparently (i.e., by revealing to interviewees the dimensions assessed in the interview). This article presents two independent studies examining the effects of interview transparency on interviewees' performance and on the interview's construct and criterion-related validity in the context of an application training program. Results from both Study 1 (N = 123) and Study 2 (N = 269) indicate an improvement in interviewees' performance under transparent interview conditions. Both studies further support the assumption that transparent interviews show satisfactory construct validity, whereas nontransparent interviews do not. Moreover, Study 2 showed no significant difference between the interview's criterion-related validity under transparent versus nontransparent conditions. Implications and directions for future research are discussed.     

Factors which Improve the Construct Validity of Assessment Centers: A Review

This article reviews 21 studies which manipulated specific variables to determine their impact on the construct validity of assessment centers. This review shows that the studies regarding the impact of different observation, evaluation, and integration procedures yielded mixed results. Conversely, dimension factors (number, conceptual distinctiveness, and transparency), assessor factors (type of assessor and type of assessor training), and exercise factors (exercise form and use of role-players) were found to moderate construct validity. On the basis of the review, practical recommendations are derived to maximize the probability that practitioners design and administer an assessment center with construct validity. Finally, new perspectives for future research are identified.     

The Validity of the Rorschach for Assessing Cognitive and Affective Changes

Exner's (1985) Rorschach norms of children 5 to 16 years old were used to test predictions based on developmental theory, previous cognitive studies, and Achenbach and Edelbrock's (1981) norms on behavior problems in children. In the cognitive realm, the Rorschach scores reflected the predicted increase in complexity, integration, and precision of thinking; richness of ideas; conformity to socially acceptable ways of thinking; and the concomitant decrease in unrealistic, egocentric ideas. In the affective realm, the Rorschach scores reflected the predicted decrease in uncontrolled expression of affect, increase in controlled expression of affect, and increase in inwardness. However, the Rorschach scores failed to reflect the predicted decrease in anxiety and increase in depression. Finally, tin, ere was no evidence of increased accuracy of perception.     

The Selected Response Procedure: A Variation on Appelbaum's Altered Atmosphere Procedure for the Rorschach

This article introduces the Selected Response Procedure, which is a supplementary technique for expanding the scope of the Rorschach test. The procedure is conducted as follows: After the standard administration of the Rorschach test, patients are asked to look through all of the cards a second time and select one more response from any card of their choice. A rationale for this procedure is developed through a comparison to another supplementary Rorschach technique, the Altered Atmosphere Procedure. The importance of understanding the selected response within a theoretical framework, as well as the clinical context of each selected response, is highlighted by a clinical example using object relations theory. Finally, a number of didactic questions are offered as potential ways to query the possible meaning of selected responses.     

Construct Validity of the Acquired Capability for Suicide Scale: Factor Structure,Convergent and Discriminant Validity

The Acquired Capability for Suicide Scale (ACSS) assesses one of three main constructs in the Interpersonal Theory of Suicide but evidence of its validity is limited. In two studies (Ns = 287 and 738) validity of the full 20-item ACSS and its shorter versions (ACSS-5, ACSS-8, ACSS-FAD) were examined in terms of factor structure and relation to indices of self-reported suicidal behaviour and self-harm. Confirmatory factor analysis (CFA) failed to show good fit for one-, two-, or three-factor models of the ACSS in its various versions. Exploratory factor analysis of the 20-item scale in the first study pointed instead to a five-factor structure and this was supported using CFA in the second study. In both studies all scale versions showed moderate negative correlations to fear of death and dying, indicating scale validity for the purpose of assessing fearlessness about death. In the second study, a model in which the five factors were indicators of a latent variable of Capability was found to predict a latent variable of Suicidality as indicated by suicidal behaviours, but the prediction was substantially enhanced by the addition of Item 20 to the model. This single item was also found in the first study to better predict suicidal and self-harming behaviour than the full ACSS or any of its short versions.     

Examining the Construct Validity for the Multiple-Content Testing Programs

The primary objective of this study was to examine the construct validity for the 2 multiple-content testing programs-the multiple-choice Comprehensive Tests of Basic Skills (CTBS/5) together with the performance-based Maryland School Performance Assessment Program (MSPAP)-by evaluating the true-score longitudinal associations among multiple-content scores in 1 school district. Each content area measure in the 2 testing programs was closely examined by the following criterion: The true-score correlation between 2 time-period measures of the same content area is higher than its longitudinal true-score correlations with other content areas. This criterion was achieved in 2 (Reading and Mathematics) of 5 CTBS/5 content subtests, as well as 1 (Language) of 6 MSPAP content subtests. The structural equation modeling has been conducted on a multitrait-multimethod correlation dataset, where the traits of Reading and Mathematics were assessed by MSPAP and the old version of CTBS/4. Although convergent validity existed in these 2 measures, there was little evidence to support discriminant validity in both measures.     

Sociotropy and Autonomy: Preliminary Evidence for Construct Validity Using TAT Narratives

In this investigation, we evaluated the construct validity of sociotropy and autonomy as assessed by the revised Personal Style Inventory (PSI; Robins et al., 1994). Stories given to 6 cards of the Thematic Apperception Test (Murray, 1943) were coded for need for Achievement (McClelland, Atkinson, Clark, & Lowell, 1953) and need for Affiliation (Heyns, Veroff, & Atkinson, 1958). These scores were correlated with PSI Sociotropy and Autonomy, along with their component subscales. The construct validity of Sociotropy, Autonomy, and 5 of 6 component subscales were supported as hypothesized. Consistent with past research, there was no support for the construct validity of the Perfectionism/Self-Criticism subscale of Autonomy. In addition, separate analyses by gender suggested that the construct validity of sociotropy may be greater for women than for men. The results represent an important finding in that nonquestionnaire measures of interpersonal and achievement-related concerns were found to support the validity of the PSI, a need identified by the questionnaire's authors.     

The Interaction Anxiousness Scale: Construct and Criterion-Related Validity

This article presents data regarding the validity and reliability of the Interaction Anxiousness Scale (LAS; Leary 1983c), a self-report measure of dispositional social anxiety. The IAS demonstrates high test-retest and internal reliability. Correlations with measures relevant to social and general anxiety document its convergent and discriminant validity, and it correlates well with measures of anxiety and interpersonal concern in actual interactions.