Interobserver agreement, intraobserver reliability, and the Rorschach Comprehensive System

Interrater agreement and reliability for the Rorschach have recently come under increasing scrutiny. This is the second report examining methods of Comprehensive System reliability using principles derived from observational methodology and applied behavioral analysis. This study examined a previous nonpatient sample of 20 protocols (N = 412 responses) and also examined a new clinical sample of 20 protocols (N = 374 responses) diagnosed with Research Diagnostic Criteria. Reliability was analyzed at multiple levels of Comprehensive System data, including response-level individual codes and coding decisions and ratios, percentages, and derivations from the Structural Summary. With a number of exceptions, most Comprehensive System codes, coding decisions, and summary scores yield acceptable, and in many instances excellent, levels of reliability. Limitations arising from the nature of Rorschach data and Comprehensive System coding criteria are discussed.     

A psychoanalytic view of the Rorschach Comprehensive System "special scores"

We analyzed the contemporary empirical and theoretical literature concerning the two predominant approaches for scoring formal thought disorder on the Rorschach, the Comprehensive System special scores, and the methodology of Rapaport, Gill, and Schafer (1946/1968). The psychoanalytic research related to selected special scores is reviewed, and some linkages to psychoanalytic developmental theory and psychopathology are made. Recommendations are presented to bridge the gap between these two important avenues of Rorschach research, with an emphasis on empirical rigor and intrapsychic contextual meaning.     

A Commentary on DeCato's "On the Rorschach M Response and Monotheism" (1993)

In a recent article, DeCato (1993) posits a fundamental dichotomy between the Comprehensive System (Exner, 1986) Rorschach interpretation, which is based on group norms, and the Perceptanalytic System (Piotrowski, 1957), which advocates validating Rorschach microfacts against the behavior of the individual. Perspective can be gained on this issue by recognizing that these approaches are actually extremes on a continuum where interpretation gradually narrows from the general to the specific. Acknowledging the funnel-shaped character of Rorschach interpretive approaches tins implications for understanding, scoring, and teaching projective techniques.     

A study of nonpatient preadolescent Rorschach protocols

There is a paucity of peer-reviewed, nonpatient Rorschach studies in psychological journals, particularly for children. This study examined 100 preteenage children, using the Comprehensive System to code their Rorschach protocols. The participants were also evaluated with the Conners Parent Rating Scale-93 (Conners, 1989) and 5 exclusionary behavior criteria. The 100 participants demonstrated better than average behaviors. The results presented include all the ratios and indexes found in the nonpatient statistics for the Comprehensive System. We discuss interrater reliability issues and offer recommendations for further cross-validating research.     

Rorschach Comprehensive System data for a sample of 150 adult nonpatients from Israel

This study is composed of 150 adult nonpatients, all from Israel, who were administered the Rorschach. Inclusion/exclusion criteria are described. Senior graduate students from the clinical psychology program at Bar-Ilan University administered the Rorschach and were provided with extensive supervision and ongoing quality control. Interrater reliability statistics at the response level are presented along with scores for the Rorschach Comprehensive System (CS; Exner, 2005).     

Toward a Process-Based Framework for Classifying Personality Tests: Comment on Meyer and Kurtz (2006)

We analyzed the contemporary empirical and theoretical literature concerning the two predominant approaches for scoring formal thought disorder on the Rorschach, the Comprehensive System special scores, and the methodology of Rapaport, Gill, and Schafer (1946/1968). The psychoanalytic research related to selected special scores is reviewed, and some linkages to psychoanalytic developmental theory and psychopathology are made. Recommendations are presented to bridge the gap between these two important avenues of Rorschach research, with an emphasis on empirical rigor and intrapsychic contextual meaning.     

Rorschach Comprehensive System data for a sample of 249 adult nonpatients from Italy

This project provides information on how Italian adult nonpatients perform on the Rorschach test administered and scored following Rorschach Comprehensive System (CS) guidelines (Exner, 1995). Lis, Zennaro, Calvo, and Salcuni (2001) reported previously initial data for 101 of the nonpatients who were administered this instrument between July 1998 and February 2001 by graduate and postgraduate students in a 2-year research course at the Psychotherapy School of the University of Padua. The current study extends that previous work and includes information on an additional 148 participants gathered between April 2001 and March 2004, for a total of 249 individuals. Exclusion criteria are described and interrater reliability statistics at the response level for scoring segments are reported using both percent of agreement and iota. Comprehensive System findings are presented.     

A new U.S. adult nonpatient sample

A project to collect an American adult nonpatient sample for the Rorschach Comprehensive System (CS; Exner, 2001) took place between 1999 and 2005, and this article presents data for 450 participants in the project. Inclusion criteria, demographic information, and interrater agreement statistics are described. Findings for most of the CS variables are similar to earlier Rorschach Workshops samples, but some differences emerged and their implications for modifying interpretive guidelines are discussed.     

Rorschach Comprehensive System data for a sample of 42 nonpatient Mexican American children from the United States

This study is composed of 42 Mexican American children, ages 8 to 10 years, all from the United States. In addition to the children being administered the Rorschach, they also were administered the Children's Hispanic Background Scale (CHBS) and the Children's Personality Questionnaire (CPQ). The principal author was the sole examiner. Inclusion criteria are described. Interrater reliability statistics at the response level are presented along with scores for the Rorschach Comprehensive System (CS; Exner, 1995).     

Rorschach Comprehensive System data for a sample of 240 adult nonpatients from Japan

This article presents Rorschach Comprehensive System (CS; Exner, 1995) results for 240 adult nonpatients living in the central area of Tokyo, Japan. Inclusion/exclusion criteria are described. Interrater reliability statistics at the response level are presented along with scores for CS variables.     

Rorschach Comprehensive System data for a sample of 283 adult nonpatients from the United States

This article presents an update on adult nonpatients living in central California previously described by Shaffer, Erdberg, and Haroian (1999). In this study an additional 160 nonpatients were administered the Rorschach for a total sample size of 283. Graduate students enrolled in a 2-year Rorschach research seminar administered the Rorschach (Exner, 1995), WAIS-R (Weschler, 1981), and MMPI-2 (Butcher, Dahlstrom, Graham, Tellegen, & Kaemmer, 1989), and were provided with extensive supervision and ongoing quality control. All protocols were recoded by the first two authors and a psychologist with extensive Rorschach experience. Exclusion criteria are described. Interrater reliability statistics at the response level are presented along with scores for Rorschach Comprehensive System (CS), WAIS-R, and MMPI-2 variables.     

罗夏综合系统的元分析*

为考察罗夏墨迹测验Exner综合系统常模的客观性和准确性,运用元分析的方法,将来自16个国家的18篇罗夏综合系统正常成人的研究结果,与Exner新版常模进行比较。结果显示,在综合系统的全部113个变量中,有23个变量在联合样本与Exner常模间存在显著差异,包括被试的资源、能力、认知水平和人际关系等方面,且均为Exner常模样本结果更加优秀。结论:新版罗夏综合系统常模具有一定的偏差,存在偏好倾向,使用时应注意避免对被试的低估甚至做出假阳性的诊断。     

Rorschach Comprehensive System data for a sample of 506 adult nonpatients from Argentina

This study is composed of 506 nonpatient adults, ages 18 to 65, all from Argentina. The data were gathered by five examiners, who tested most of the participants at their work site. Inclusion and exclusion criteria are described and interrater reliability statistics at the response level are presented along with findings for the Rorschach Comprehensive System (CS; Exner, 1994).     

The Rorschach Comprehensive System Egocentricity Index in psychiatric inpatients

This paper reports an exploratory study of potential correlates of Exner's Rorschach Egocentricity Index, a measure of self-focusing, in a sample of 70 psychiatric inpatients. We examined the relationship of the Index of the MMPI Ego Strength scale and to other MMPI and Exner Comprehensive System Rorschach variables, using Pearson Product-Moment correlations with partialling of the number of Rorschach responses. There were seven meaningful significant correlations between the Index and Rorschach variables: M, FM, X +%, F +%, Lambda, D, and A%. The Index-MMPI correlations were not significant. Sex differences and differences between these intercorrelations and some reported by Exner (1983) are discussed.     

Rorschach Comprehensive System data for a sample of 517 adults from Spain (Barcelona)

This study is composed of 517 adult voluntary participants, from Barcelona and its surroundings, all of whom are from Spain, Barcelona, and Catalonia. The study builds on a previously published report for a smaller sample (N = 250; see Alvarez, Baeza, Campo, Garcia, Guardia, et al., 1993) and is the result of collaboration between students and professors at the Barcelona Rorschach School (Catalan Rorschach Society). Our aim is to offer local data that should help to understand possible differences with existing reference data for the Rorschach Comprehensive System (CS; Exner, 2005), which is the system that has been taught at this school since 1978. Inclusion and exclusion criteria are described and interrater reliability statistics at the response level are presented, along with scores for the CS, followed by a discussion and very brief comparison with other international reference samples.     

Rorschach Comprehensive System data for a sample of 90 adult nonpatients from Argentina

This study is composed of 90 nonpatient adults, ages 16 to 65, all from Buenos Aires and its suburban area. All of the data were gathered by the author. Inclusion and exclusion criteria are described and interrater reliability statistics at the response level are presented along with findings for the Rorschach Comprehensive System (CS; Exner, 2003). Results show that several variables yield values that deviated from the nonpatient ranges proposed by Exner, and these findings suggest the need for further exploration.     

A critique of Lilienfeld et al.'s (2000) "The scientific status of projective techniques"

Lilienfeld, Wood, and Garb (2000) published a largely negative critique of the validity and reliability of projective methods, concentrating on the Comprehensive System for the Rorschach (Exner, 1993), 3 systems for coding the Thematic Apperception Test (TAT; Murray, 1943) cards, and human figure drawings. This article is an effort to document and correct what I perceive as errors of omission and commission in the Lilienfeld et al. article. When projective measures are viewed in the light of these corrections, the evidence for the validity and clinical usefulness of the Rorschach and TAT methods is more robust than Lilienfeld et al. represented.     

Les Publications essentielles sur le Rorschach en SI Exner

The objective of this article is to provide psychologists interested in using the Rorschach Comprehensive System with the French-language references on this topic as well as those written in other languages by French-speaking specialists. A brief commentary of the works of J. Exner is provided, followed by a presentation of investigations concerning the Comprehensive System addressing particular forms of psychopathology.     

Scoring the Rorschach: a constructive critique of Exner's Comprehensive Rorschach System

John Exner's rationale for scoring the Rorschach and his decision to score "blend" responses by assigning equal weights are critically reviewed. The resultant exclusion of new responses made during the Inquiry of the Free Association responses is viewed as a major deficiency in the Comprehensive Rorschach System. A change to Klopfer's "Main-Additional" scoring method is recommended as a corrective.