Problems in Rorschach research and what to do about them

This article identifies many interrelated problems that interfere with progress in Rorschach research. These include vague hypotheses, confounded comparisons, failure to control extraneous variables; misuse of statistics, and distorted interpretation of results. Two crucial solutions to address many of these problems are offered: knowing the data and paling out rival hypotheses. Underlying conceptual confusions are addressed and prototypical examples derived from the literature, are discussed is the hope of improving the scientific foundation of the Rorschach.     

Misuse of Computer Software to Detect Faking on the Rorschach: A Reply to Kahn,Fox, and Rhode

Kahn, Fox, and Rhode (1988) made several errors in their article comparing human judgment versus computer scoring in detecting malingering in Rorschach protocols. The Rorschach interpretation software was designed to make hypotheses based solely on unusual findings among structural variables. It does not make diagnoses concerning psychosis nor is it designed to detect malingering. In claiming that the computer program made such diagnostic statements, Kahn and his associates were attributing to it capacities it does not have. Other problems with their study are discussed in areas of wrong application of Rorschach methodology and poor research design. Given that their study has so many flaws, their results and implications are not valid and can be misleading.     

A replication of Rorschach and MMPI-2 convergent validity

We replicated prior research on Rorschach and MMPI-2 convergent validity by testing 8 hypotheses in a new sample of patients. We also extended prior research by developing criteria to include more patients and by applying the same procedures to 2 self-report tests: the MMPI-2 and the MCMI-II. Results supported our hypotheses and paralleled the prior findings. Furthermore, 3 different tests for methodological artifacts could not account for the results. Thus, the convergence of Rorschach and MMPI-2 constructs seems to be partially a function of how patients interact with the tests. When patients approach each test with a similar style, conceptually aligned constructs tend to correlate. Although this result is less robust, when patients approach each test in an opposing manner, conceptually aligned constructs tend to be negatively correlated. When test interaction styles are ignored, MMPI-2 and Rorschach constructs tend to be uncorrelated, unless a sample just happens to possess a correlation between Rorschach and MMPI-2 stylistic variables. Remaining ambiguities and suggestions for further advances are discussed.     

Personality Variables in Rorschach Scoring

Twenty-three clinical trainees scored a standardized list of 150 Rorschach responses and were administered the EPPS. Ten directional hypotheses were advanced which predicted certain personality attributes of those making scoring errors in various determinant categories. Results showed significant differences between high and low error groups on scores on several EPPS scales, supporting four of the ten hypotheses. Scoring errors in the color, human movement, texture, and vista determinant categories were related to scores on the Exhibition, Affiliation, Autonomy, and Abasement scales, respectively. Implications of these results are discussed regarding the reliability of Rorschach interpretations.     

The Rorschach: does it have a future?

Recent evidence suggests that in spite of an increasingly critical attitude by many clinicians towards the use of projective techniques, the use of these techniques has not faltered over the years. Insofar as the Rorschach continues to be the most popular projective instrument, its scientific status is critically examined in the present paper. The problems inherent in examining an instrument which has engendered a number of quite distinct scoring systems are noted, and the conclusion is advanced that notwithstanding such problems there seems little likelihood that the Rorschach will experience any significantly diminished popularity in the future.     

Color blindness and Rorschach color responsivity

Color vision deficits occur in 10% of the American white male population. Thus, color blindness may invalidate diagnostic hypotheses generated from Rorschach data. The Rorschach protocols of 43 white, college male color-blind subjects were compared to the protocols of normally sighted controls. The color-blind group manifested fewer pure "C" responses. No significant between group differences emerged for any of the other primary Rorschach color variables. Pure "C" responses rarely figure prominently in Rorschach evaluations, and the apparent lowered frequency of these responses by the color-blind is insufficient to warrant modification of current Rorschach practice. The data suggest that color blindness is unlikely to confound Rorschach assessment.     

Psychosexual fixation and defense mechanisms in a sample of young Japanese women: a preliminary study

The present pilot study examined psychosexual fixations and defense mechanisms in a sample of young Japanese women. The Lexical Rorschach count and the Defense Mechanisms Inventory were administered to 24 female college students. Sadism on the Lexical Rorschach count was positively correlated with Reversal of Affect. Phallic fixation on the Lexical Rorschach count was positively correlated with Projection. Psychoanalytic hypotheses about the associations between psychosexual fixations and defense mechanisms were partially confirmed.     

Alcoholism and the Rorschach

This study attempts to cross validate 20 hypotheses reported over the past three decades professing to differentiate alcoholics from non-alcoholics using the Rorschach. Comparison groups (N = 25 each) were matched for age, sex, race, income and education, and diagnosis. Each S received the Rorschach and a test to rule out “organicity”. Rorschach scoring was consensually validated and Chi squares were performed for all twenty hypotheses. Through the careful selection and matching of control and experimental groups, only two significant differences were found, both in the direction opposite to that predicted. Non-alcoholics gave 4 or more water responses significantly more often than alcoholics (p < .05) and significantly more “high CF with C” scores (p < .05).     

Response frequency problems in the rorschach: clinical and research implications with suggestions for the future

This article focuses on clinical and research problems associated with response frequency (R) being a variable in the Rorschach. Despite the fact that variations in R directly contribute to 50% of the explainable variance among Rorschach raw scores, there is a dearth of empirical evidence to document what R actually measures. Furthermore, in the practical use of the Rorschach's structural data, R is considered to be a nuisance variable that is controlled and not deemed interpretively significant. Given this information, two research agendas are proposed. The first is to more thoroughly determine whether R measures anything of substantial clinical importance. The second is to evaluate systematically the relative merits of making R a constant rather than a variable through use of an R-controlled method of Rorschach administration. This strategy would resolve many of the psychometric problems related to R. Introducing greater structure and clearer expectations to the task may also sharpen the Rorschach's ability to assess and predict important aspects of personality. However, significant disadvantages would also result from this change in administration. Both sides of the issue are discussed in some detail.     

Constructivism and the projective assessment of meaning in Rorschach administration

Constructivist perspectives on the Rorschach are outlined. I discuss ways in which constructivism complements and adds to existing Rorschach methodologies. It is suggested hat the constructivist emphasis on personally and socially constructed meanings is very consistent with many of the ways the Rorschach has been used and resonates with recent emphases on the Rorschach as a representational task. Furthermore, constructivist perspectives on Rorschach also provide an opportunity to supplement Exner's (1993, 1995) efforts to standardize and norm the Rorschach in a way that maintains the instrument's historic and admirable attention to relational elements of assessment and psychotherapy. I present a variety of meaning-based techniques for conducting Rorschach assessment, incorporating both the constructivist and social constructionist perspective.     

Relationship of Sex of Examiner to Incidence of Rorschach Responses with Sexual Content

This article focuses on clinical and research problems associated with response frequency (R) being a variable in the Rorschach. Despite the fact that variations in R directly contribute to 50% of the explainable variance among Rorschach raw scores, there is a dearth of empirical evidence to document what R actually measures. Furthermore, in the practical use of the Rorschach's structural data, R is considered to be a nuisance variable that is controlled and not deemed interpretively significant. Given this information, two research agendas are proposed. The first is to more thoroughly determine whether R measures anything of substantial clinical importance. The second is to evaluate systematically the relative merits of making R a constant rather than a variable through use of an R-controlled method of Rorschach administration. This strategy would resolve many of the psychometric problems related to R. Introducing greater structure and clearer expectations to the task may also sharpen the Rorschach's ability to assess and predict important aspects of personality. However, significant disadvantages would also result from this change in administration. Both sides of the issue are discussed in some detail.     

A Psychophysiological Investigation of the Rorschach Colour and Form Determinants

The Rorschach colour-emotion and form-control hypotheses were investigated by determining whether subjects would react differently psychophysiologically while giving colour dominant or form responses. Slides of the Rorschach plates no. II, III, V, VIII, IX and X were presented to 42 subjects while respiration (as control only) vasomotor changes, skin resistance and heart rate were recorded. All physiological changes (except respiration) found in conjunction with Rorschach C, CF, FC, and F responses were transformed to Lacey's autonomic lability scores. Some indications of different physiological reactions to colour and form were found. The results indicated the possible existence of “emotional” and “controlled” groups of subjects who tended to react differently, verbally and physiologically, to the Rorschach stimuli.     

A meta-analysis of the reliability and validity of the Rorschach

The results of a meta-analysis of Rorschach studies indicate that reliabilities in the order of .83 and higher and validity coefficients of .45 or .50 and higher can be expected for the Rorschach--when hypotheses supported by empirical or theoretical rationales are tested using reasonably powerful statistics. Three important determinants of variance accounted for in a variety of Rorschach scores were identified in 530 statistics from 39 papers published in the Journal of Personality Assessment from 1971 to 1980. The a priori theoretical or empirical evidence determining the likelihood of obtaining significant results, and the power of the statistic used to measure the results, as well as the interaction between the likelihood of results and the power of the statistic used, were all significant determinants of the proportion of variance accounted for in the Rorschach measures reported.     

Coming to grips with negative evidence for the Comprehensive System for the Rorschach: a comment on Gacono, Loving, and Bodholdt; Ganellen; and Bornstein

The Comprehensive System (CS; Exner, 1991, 1993) for the Rorschach is currently engulfed in controversy. This comment article responds to 3 articles by Rorschach proponents in this issue of the Journal of Personality Assessment. Contrary to the claims of Gacono, Loving, and Bodholdt (this issue), CS scores do not bear a well-demonstrated relationship to psychopathy, antisocial personality disorder, or conduct disorder. Contrary to the claims of Ganellen (this issue), both the original and the revised CS Depression Index (Exner, 1993) bear little or no relationship to depression diagnoses. Furthermore, the scoring reliability of some CS scores is problematic. Although we agree with Bornstein (this issue) that Rorschach scores generally bear little or no relation to psychiatric diagnoses or self-report questionnaires, we believe this lack of relationship tends to disconfirm hypotheses concerning the validity of the Rorschach. In the spirit of the philosopher Sir Karl Popper, the Rorschach community should not minimize negative evidence or engage in post hoc arguments to immunize the CS against falsification.     

Socioeconomic Status and the Diagnostic Significance of Healthy and Unhealthy Group Rorschach Content

Three hypotheses were put to test, using group Rorschach protocols and a content scoring approach: (a) when neutral content is disregarded, upper social class subjects (Ss) will report predominantly “healthy” group Rorschach content while lower social class Ss will report predominantly “unhealthy” content; (b) perceiving “unhealthy” content will prove an abnormal diagnostic indicant only among upper social class Ss; (c) these findings will hold across racial identity. Rorschach content data and independent measures of personality were obtained from five samples of adolescent Ss differing in race and social class. The experimental hypotheses were supported. A theoretical interpretation making use of social class values is presented to explain the findings.     

An empirical study of seriously disturbed suicidal patients

Aspects of unconscious processes in a group of seriously disturbed psychiatric patients are examined in an effort to predict near-lethal suicide attempts and explore psychoanalytic formulations of suicide. The Rorschach Inkblot Test, the most widely used projective measure in suicide research (Bongar 1991), was chosen for its potential to shed light on specific unconscious processes. Psychic states commonly associated with suicide were measured by psychoanalytic Rorschach analog scales and then subjected to a progression of statistical analyses in order to predict future occurrence and lethality of suicide attempts. On the basis of a priori hypotheses, the authors developed a suicide index comprising four psychoanalytic Rorschach signs that predicted, with considerable accuracy, which patients would later make near-lethal suicide attempts. The best predictors were unconscious processes indicative of penetrating affective overstimulation, disturbance in the capacity to maintain adequate ego boundaries, and depressive affective states characterized by a morbid preoccupation with death and inner decay. These findings provide empirical support for several well-known formulations of the unconscious motivations for suicide.     

Affective expression in children's fantasy play, primary process thinking on the Rorschach, and divergent thinking

The relationships among expression of primary process thinking on the Rorschach, affective expression in fantasy play, and divergent thinking were investigated in first and second grade children. Sixty children received the rorschach (Holt's scoring system), a play task (Affect in Play Scale), and the Alternate Uses Test. Major hypotheses were supported because the amount of primary process thinking on the Rorschach (frequency and percent) was significantly, positively related to amount of affective expression and primary process expression in play. Also, expression of affect in play (frequency, variety, integration, and comfort) was significantly, positively related to divergent thinking, independent of IQ for both boys and girls. On the Rorschach, percent of primary process was significantly related to divergent thinking for boys. The results suggest that the ability to think imaginatively in a free-association style and the ability to have access to affect-laden material are related processes.     

Affective Expression in Children's Fantasy Play,Primary Process Thinking on the Rorschach,and Divergent Thinking

The relationships among expression of primary process thinking on the Rorschach, affective expression in fantasy play, and divergent thinking were investigated in first and second grade children. Sixty children received the Rorschach (Holt's scoring system), a play task (Affect in Play Scale), and the Alternate Uses Test. Major hypotheses were supported because the amount of primary process thinking on the Rorschach (frequency and percent) was significantly, positively related to amount of affective expression and primary process expression in play. Also, expression of affect in play (frequency, variety, integration, and comfort) was significantly, positively related to divergent thinking, independent of IQ for both boys and girls. On the Rorschach, percent of primary process was significantly related to divergent thinking for boys. The results suggest that the ability to think imaginatively in a free-association style and the ability to have access to affect-laden material are related processes.     

On the integration of personality assessment methods: the Rorschach and MMPI

Despite being the most studied and used personality assessment tools, data from the Rorschach and MMPI generally disagree (Archer & Krishnamurthy, 1993a, 1993b). Independence is proposed to result from at least 3 factors: (a) the methods tap unique levels of personality, (b) personality has a complex organization, and (c) response styles generate considerable method variance that must be considered in nomothetic research. These ideas led to 5 hypotheses, each of which received support. Rorschach and MMPI response styles are uncorrelated, although response styles are quite consistent within a method family. MMPI-2 and Rorschach constructs of dysphoria, psychosis, or wariness are uncorrelated when response styles are ignored. However, robust convergent validity is evident when patients have similar response styles on each method (e.g., for dysphoria, M r = .59) and dysphoria is expressed in opposing ways on each method when response styles are discordant (i.e., M r = -.54). Data from the latter analyses were correlated with genuine clinical phenomena and implications were discussed for clinical practice and research.     

Personality dimensions in two types of learning-disabled children: a Rorschach study

Children referred for psychoeducational assessment of learning disabilities (LDs) commonly receive the Rorschach test. yet little is known about the impact of LD on Rorschach response patterns. This study investigated Rorschach response patterns in two groups of 9- to 12-year-old children (n = 41) classified by their respective intellectual abilities. Another group of 9- to 12-year-olds (n = 143) served as a nonclinical comparison group. Rorschach variables indicative of personality dimensions failed to discriminate between the two LD groups. Compared to the nonclinical group, the LD group exhibited several Rorschach characteristics--including problems in perceptual accuracy, inefficient visual scanning and problem-solving strategies, and avoidance of affect-laden stimuli--having implications for successful socioemotional adaptation. Suggestions for further research are discussed.