Rorschach Comprehensive System data for a sample of 100 adult nonpatients from the Belgian French-speaking community

This article presents normative data for the Rorschach Comprehensive System (CS) on 100 adult nonpatients from the Belgian French-speaking community. We compare our Belgian sample to a French one (Sultan et al., 2004), data of Exner's (Exner & Erdberg, 2005) and a Californian sample (Shaffer, Erdberg, & Haroian, 1999). Each sample's specific characteristics are explored, as well as findings provided by sample-specific comparisons. Exner's data, ultimate normative reference for the CS, differ significantly from the three other samples for many variables. Cultural factors, examiner's level of experience, as well as participants' selection and recruitment, presumably flow into calculated differences between the four samples. Our findings indicate the necessity for constituting normative data for different communities, as well as the indispensability of examiners' familiarity with the CS, in order to provide reliable clinical information.     

Rorschach Comprehensive System data for a sample of 283 adult nonpatients from the United States

This article presents an update on adult nonpatients living in central California previously described by Shaffer, Erdberg, and Haroian (1999). In this study an additional 160 nonpatients were administered the Rorschach for a total sample size of 283. Graduate students enrolled in a 2-year Rorschach research seminar administered the Rorschach (Exner, 1995), WAIS-R (Weschler, 1981), and MMPI-2 (Butcher, Dahlstrom, Graham, Tellegen, & Kaemmer, 1989), and were provided with extensive supervision and ongoing quality control. All protocols were recoded by the first two authors and a psychologist with extensive Rorschach experience. Exclusion criteria are described. Interrater reliability statistics at the response level are presented along with scores for Rorschach Comprehensive System (CS), WAIS-R, and MMPI-2 variables.     

Rorschach Intercoder Reliability for Protocol-Level Comprehensive System Variables in an International Sample

This study examines the intercoder reliability of Rorschach Comprehensive System (CS; Exner, 2001) protocol-level variables. A large international sample was combined to obtain intercoder agreement for 489 Rorschach protocols coded using the CS. Intercoder agreement was calculated using an Iota coefficient, a statistical coefficient similar to kappa that is corrected for chance. Iota values for the variables analyzed ranged from .31 to 1.00, with 2 in the poor range of agreement, 4 in the fair range, 25 in the good range, and 116 in the excellent range of agreement. Discrepancies between variables are discussed.     

Rorschach intercoder reliability for protocol-level comprehensive system variables in an international sample

This study examines the intercoder reliability of Rorschach Comprehensive System (CS; Exner, 2001) protocol-level variables. A large international sample was combined to obtain intercoder agreement for 489 Rorschach protocols coded using the CS. Intercoder agreement was calculated using an Iota coefficient, a statistical coefficient similar to kappa that is corrected for chance. Iota values for the variables analyzed ranged from .31 to 1.00, with 2 in the poor range of agreement, 4 in the fair range, 25 in the good range, and 116 in the excellent range of agreement. Discrepancies between variables are discussed.     

Rorschach Comprehensive System data for a sample of 111 adult nonpatients from Romania

In this study Rorschach data from a Romanian sample of 111 respondents was collected and analyzed in a first attempt to establish national norms. The protocols were collected in a 5-year period (2002-2006) by the author. Interrater reliability statistics are presented for a sample of 20 cases, along with scores for the Rorschach Comprehensive System (CS; Exner, 1993). These results can be used for cross-cultural comparisons of the CS.     

Rorschach Comprehensive System data for a sample of 141 adult nonpatients from Denmark

A sample (n = 141) of Danish nonpatients 25-50 years of age, never hospitalized with a psychiatric diagnosis and currently employed, was demographically representative of two geographical areas of Copenhagen with different social strain. The sample, as well as 45 persons not currently employed, was tested with the Rorschach (Exner, 1995), MMPI-2 (Butcher, Dahlstrom, Graham, Tellegen, & Kaemmer, 1989), Word Association Test (Ivanouw, 1999b), WAIS Comprehension subtest (Hess, 1974), and SCL-90-R (Olsen, Mortenson, & Bech, 2006). Half of the persons contacted volunteered for the study. There was no difference in rate of volunteering between a standard no-feedback condition and a feedback condition; the latter, however, tended to attract more psychologically resourceful persons. The employed persons tended to appear healthier than the not employed. Response style of the subjects, quality of the Rorschach protocols, reliability of scoring, and the effect of the data being grouped on geographical area and examiner were examined. Form level, color, texture, cooperative movement, and EA were lower than in the Comprehensive System (CS; n = 450) sample, but higher than in nine international nonpatient Rorschach studies. Unique for the Danish sample was a low number of animal movement answers. The Rorschach data showed women to be healthier than men. Differences in Rorschach variables based on educational level were small.     

The impact of administration and inquiry on Rorschach Comprehensive System protocols in a national reference sample

We investigated the impact of administration and inquiry skills on Rorschach Comprehensive System (CS; Exner, 1974, 1991, 1993) protocols collected for the Italian adult nonpatient reference sample. The same research team collected CS protocols on two occasions. The initial reference sample (N = 212; Lis, Rossi, & Priha, 1998) was collected under the supervision of experienced psychologists who carefully studied CS administration and scoring procedures (Exner, 1986, 1990, 1993). The second sample (N = 101; Lis, Zennaro, Calvo, & Salcuni, 2001) was collected after the team obtained additional and sustained CS training from Rorschach workshops certified instructors. Both samples were scored, reliably but they showed large differences on many codes, with protocols from the second sample being richer and more complex than the first. The results indicate that administration skills can have a dramatic impact on CS protocols and may contribute to variations in samples collected by different investigators. Training standards should be devised to insure uniform administration procedures are followed when collecting CS protocols.     

Considerations in collecting Rorschach reference data

Recent Rorschach research with nonpatients has yielded reference data that differ in several respects from nonpatient normative data published for the Comprehensive System (Exner, 1995). Conclusions concerning the implications of these new findings are premature, however, pending careful consideration of appropriate guidelines for collecting Rorschach reference data. In proposing guidelines for future research of this kind, I note (a) that the relatively unstructured nature of Rorschach assessment may complicate obtaining useful data from nonpatient volunteers, (b) that normative studies should include various types of patient as well as nonpatient samples, and (c) that identification of psychological disturbance from Rorschach protocols may be guided more accurately by how closely a record resembles the records of patients with certain disturbances than by how much the record differs from the records of nonpatients.     

Rorschach Comprehensive System data for a sample of 41 adult nonpatients from Israel

This study presents data concerning Rorschach protocols of 41 Jewish Israeli students. The sample includes 20 males and 21 females, ranging in age from 19 to 35, who were selected from a larger sample of 50 undergraduates by applying psychiatric exclusion criteria. The results concerning the main Rorschach Comprehensive System's (CS; Exner, 2003) measures of distress (D and Adj D scores, S-Constellation, and DEPI) revealed substantial elevation. These results are analyzed in relation to the constant threat of terror, which the participants are exposed to within the context of the ongoing political conflict in the Middle East. The analysis is supported by data concerning a new Rorschach index, the Reality-Fantasy scale (RFS; Tibon, Handelzalts, & Weinberger, 2005), which applies the CS to psychoanalytic conceptualization of transitional space.     

Addressing Issues in the Development and Use of the Composite International Reference Values as Rorschach Norms for Adults

This article describes 3 studies evaluating normative reference data for the Rorschach Comprehensive System (CS; Exner, 2003, 2007), with a particular focus on the viability of the Composite International Reference Values (CIRVs) that were compiled from 21 adult studies by Meyer, Erdberg, and Shaffer (2007). Study 1 documented how the CIRV norms are virtually identical when organized into 3 groups differentiated by the quality of their data collection effort, including an optimal group of 4 samples that relied on multiple experienced examiners and provided ongoing quality control over administration and coding. Analyses also showed that relative to the group of more optimal samples, the group of less optimal samples did not produce more variability in summary scores within or across samples or lower interrater reliability for coding. Study 2 used the existing CS reference norms to generate T scores for the CIRV means and documented how the CS norms make other samples of healthy nonpatients look psychologically impaired in multiple domains. Study 3 documented with examples from 4 different countries how 2 sets of within-country local norms produced notably different results on some variables, which compromises the ability of local norms to be used instead of the CIRVs. Taken together, the 3 studies provide support for the use of CIRVs in clinical practice as norms that are generalizable across samples, settings, languages, and cultures and that account for the natural variability that is present when clinicians and researchers contend with the ambiguity contained in the standard CS reference materials concerning the proper ways to administer and code. We conclude by urging CS users to rely on the CIRVs when making clinical inferences and to adopt alternative methods of ensuring they are following cohesively standardized administration and coding guidelines.     

One more datum on Rorschach form quality

The central purpose of this work is to examine to what extent Form Quality (FQ) scoring of Rorschach responses, using Exner's (2003) Table A, is the reason for lower FQ to often be found in normative data outside the United States. The Rorschach protocols of 180 Portuguese boys and girls between 6 and 10 years of age were codified with respect to Form Quality in accordance with Exner's table of objects classified as ordinary, unusual, and minus, based on frequencies seen among U.S. adults and on an analogous Portuguese table (Table P) constructed from the protocols of 400 nonpatient children. Mean differences between the various FQ variables of the 2 tables were found to be insignificant. However, use of Janson's (2003) iota coefficient to evaluate agreement between the 2 approaches to scoring on the same protocols revealed that the more striking differences occurred in the FQu variable when agreement was assessed on the basis of each individual response. In view of these results, the authors recognize the possibility of Rorschach normative data to be universally applied, but still consider the possible advantage of each country or culture to build its own FQ table that will permit preservation of its particularities.     

Rorschach Comprehensive System data for 100 nonpatient children from the United States in two age groups

Building on our previously published study (Hamel, Shaffer, & Erdberg, 2000), which provided data on 100 nonpatient children aged 6 to 12 from the United States, we here provide reference data for two more homogeneous age subgroups: 6 to 9 (N = 50) and 10 to 12 (N = 50). Inclusion criteria are described, and expanded interrater reliability statistics at the response level are presented along with scores for the Rorschach Comprehensive System (CS; Exner, 2001) at each age grouping. In addition to the children being administered the Rorschach, their parents were given the Conners' Parent Rating Scale-93 (CPRS-93; Conners, 1989), and these results are presented as well.     

Toward international normative reference data for the comprehensive system

We build on the work of all the authors contributing to this Special Supplement by summarizing findings across their samples of data, and we also draw on samples published elsewhere. Using 21 samples of adult data from 17 countries we create a composite set of internationally-based reference means and standard deviations from which we compute T-scores for each sample. Figures illustrate how the scores in each sample are distributed and how the samples compare across variables in eight Rorschach Comprehensive System (CS; Exner, 2003) clusters. The adult samples from around the world are generally quite similar, and thus we encourage clinicians to integrate the composite international reference values into their clinical interpretation of protocols. However, the 31 child and adolescent samples from 5 countries produce unstable and often quite extreme values on many scores. Until the factors contributing to the variability among these samples are more fully understood, we discourage clinicians from using many CS scores to make nomothetic, score-based inferences about psychopathology in children and adolescents.     

One More Datum on Rorschach Form Quality

The central purpose of this work is to examine to what extent Form Quality (FQ) scoring of Rorschach responses, using Exner's (2003) Table A, is the reason for lower FQ to often be found in normative data outside the United States. The Rorschach protocols of 180 Portuguese boys and girls between 6 and 10 years of age were codified with respect to Form Quality in accordance with Exner's table of objects classified as ordinary, unusual, and minus, based on frequencies seen among U.S. adults and on an analogous Portuguese table (Table P) constructed from the protocols of 400 nonpatient children. Mean differences between the various FQ variables of the 2 tables were found to be insignificant. However, use of Janson's (2003) iota coefficient to evaluate agreement between the 2 approaches to scoring on the same protocols revealed that the more striking differences occurred in the FQu variable when agreement was assessed on the basis of each individual response. In view of these results, the authors recognize the possibility of Rorschach normative data to be universally applied, but still consider the possible advantage of each country or culture to build its own FQ table that will permit preservation of its particularities.     

Rorschach Comprehensive System (CS) reference data for Israeli adolescents

This study presents Rorschach Comprehensive System (CS; Exner, 1974, 2003) data for a sample of 100 Israeli nonpatient adolescents divided into 2 age-based groups: 11-14 (n = 42) and 15-18 (n = 58). The data are compared to those derived from the international project of Meyer, Erdberg, and Shaffer (2007). The results suggest that contemporary Israeli adolescents demonstrate age-appropriate inclination to show excessive self-inspection (FD), to be overly individualistic, perceiving reality in a unique and unconventional manner (elevated Xu%; lowered X+% and P), and to be involved in scientific issues (elevated Sc). The age-based group of 11 to 14, however, also tends to show difficulties in affect modulation (C > 0). Nonetheless, Israeli nonpatient adolescents are quite unlikely and not more than nonpatient adults, to show elevation on the major CS constellations of psychopathological manifestations. Although these observations are mostly in agreement with data collected from their peers around the world, the Israeli youngsters seem to be more similar to adults than to youngsters from other countries as to various CS measures, including those pointing to openness and attentiveness to stimuli (i.e., Lambda, F%). The main conclusion is that with the exception of some age-appropriate deviations, the international reference data for adults can be used for evaluating psychopathology in adolescents.     

The interclinician reliability of Rorschach interpretation in four data sets

To examine agreement on Rorschach Comprehensive System (CS; Exner, 2004) interpretations, 55 patient protocols were interpreted by 3 to 8 clinicians across 4 data sets on a representative set of 29 characteristics. Substantial reliability was observed across data sets, although a problematic design produced lower results in one. Unexpectedly, a Q-sort task had slightly lower reliability than a simple rating task. As expected, scales that summarized judgments had higher agreement than judgments to individual interpretive statements, and some clinicians produced more generalizable inferences than others. Interpretations for all clinicians were more strongly associated with patients' psychometric true scores (aggregated judgment M range = .82 to .92) than with the judgments of other clinicians (range = .76 to .89). Compared to meta-analyses of interrater reliability in psychology and medicine, the findings indicate these clinicians could reliably interpret Rorschach CS data.     

A new U.S. adult nonpatient sample

A project to collect an American adult nonpatient sample for the Rorschach Comprehensive System (CS; Exner, 2001) took place between 1999 and 2005, and this article presents data for 450 participants in the project. Inclusion criteria, demographic information, and interrater agreement statistics are described. Findings for most of the CS variables are similar to earlier Rorschach Workshops samples, but some differences emerged and their implications for modifying interpretive guidelines are discussed.     

Color blindness and Rorschach color responsivity

Color vision deficits occur in 10% of the American white male population. Thus, color blindness may invalidate diagnostic hypotheses generated from Rorschach data. The Rorschach protocols of 43 white, college male color-blind subjects were compared to the protocols of normally sighted controls. The color-blind group manifested fewer pure "C" responses. No significant between group differences emerged for any of the other primary Rorschach color variables. Pure "C" responses rarely figure prominently in Rorschach evaluations, and the apparent lowered frequency of these responses by the color-blind is insufficient to warrant modification of current Rorschach practice. The data suggest that color blindness is unlikely to confound Rorschach assessment.     

Rorschach protocols from children and adolescents with Asperger's disorder

Rorschach protocols from 24 boys with Asperger's Disorder matched by age to 24 boys with other emotional or behavioral disorders (the contrast group) were compared to each other and to Exner' s (1995) normative data. Eight variables based on Diagnostic and Statistical Manual of Mental Disorders (4th ed. [DSM-IV]; American Psychiatric Association, 1994) criteria and a review of the literature for Asperger's Disorder were predicted to discriminate between groups with the Asperger's group having more extreme scores. Five variables (COP, CDI, H, M, and EA) were significantly different from the contrast group and T and WSumC were significantly different from the normative data in both the Asperger's group and the contrast group.