The Centrality of the Response Process in Construct Validity: An Illustration via the Rorschach Space Response

Recently, psychologists have emphasized the response process—that is, the psychological operations and behaviors that lead to test scores—when designing psychological tests, interpreting their results, and refining their validity. To illustrate the centrality of the response process in construct validity and test interpretation, we provide a historical, conceptual, and empirical review of the main uses of the background white space of the Rorschach cards, called space reversal (SR) and space integration (SI) in the Rorschach Performance Assessment System. We show how SR and SI's unique response processes result in different interpretations, and that reviewing their literatures with these distinct interpretations in mind produces the expected patterns of convergent and discriminant validity. That is, SR was uniquely related to measures of oppositionality; SI was uniquely related to measures of cognitive complexity; and both SR and SI were related to measures of creativity. Our review further suggests that the Comprehensive System use of a single space code for all uses of white space likely led to its lack of meta-analytic support as a measure of oppositionality (Mihura, Meyer, Dumitrascu, &; Bombel, 2013 *Mihura, J. L., Meyer, G. J., Dumitrascu, N., &; Bombel, G. (2013). The validity of individual Rorschach variables: Systematic reviews and meta-analyses of the Comprehensive System. Psychological Bulletin, 139, 548–605. doi:10.1037/a0029406[Crossref], [PubMed], [Web of Science ®] , [Google Scholar]). We close by discussing the use of the response process to improve test interpretation, develop better measures, and advance the design of research.     

Well-being in major depression and social phobia with and without comorbidity

Background/Objective: Lower levels in well-being have been observed in individuals with Major Depression (MDD) and Social Phobia (SP), but well-planned direct comparisons with control individuals, not suffering from a mental disorder, are lacking. Furthermore, MDD is highly comorbid with anxiety disorders, and SP with depressive disorders. This study is among the first to examine differences in well-being in individuals with a clinical diagnosis of MDD or SP compared to individuals with no such diagnosis and to test differences in well-being within the combined diagnostic categories respective with and without anxiety-depressive comorbidity. Method: Participants were 119 individuals with a diagnosis of MDD, 47 SP and 118 controls. Results: Results revealed that overall well-being as well as emotional, psychological, and social well-being were lower in the MDD and SP group compared to the control group. Individuals with comorbidity reported lower well-being than individuals without comorbidity. Conclusions: These findings have clinical implications as presence of comorbidity may require a different therapeutic approach than with no comorbidity.     

Modification of expectations in cases with obsessional rituals

Some theoretical issues in relation to the nature of obsessional rituals and the most commonly adopted method of behaviour therapy for this disorder are critically considered. On the basis of these considerations, a different method—“modification of expectations” or “reality testing” is put forward and its successful application to two patients described and discussed.     

Aversion therapy in two cases of obesity

Two cases of obesity associated with overeating are described in relation to their differing responses to aversion therapy directed at the eating behaviour.     

Incremental validity of the Rorschach Prognostic Rating Scale over the MMPI Ego Strength Scale and IQ

A recent meta-analysis found that the Rorschach Prognostic Rating Scale (RPRS) had a strong ability to predict subsequent outcome (r = .44, N = 783; Meyer & Handler, 1997, this issue). However, that review did not directly address questions of incremental validity. This article focuses on the ability of the RPRS to predict outcome after taking into account other sources of data. Across studies that examined both the RPRS and the MMPI Ego Strength scale, the RPRS had a strong ability to predict outcome (r = .40, N = 187), whereas the MMPI scale did not (r = .02, N = 280). Nine studies examined the RPRS along with an intelligence test and allowed direct numerical estimates of incremental validity to be calculated. Across studies, the RPRS demonstrated strong incremental validity after controlling for intelligence (incremental r = .36, N = 358). It is clear that the Rorschach can make unique contributions to understanding clinically relevant processes in ways that self-reports or measured intelligence cannot. Contemporary Rorschach scales should continue to be evaluated for their distinctive and incremental contribution to clinical practice.     

When effect sizes disagree: the case of r and d

The increased use of effect sizes in single studies and meta-analyses raises new questions about statistical inference. Choice of an effect-size index can have a substantial impact on the interpretation of findings. The authors demonstrate the issue by focusing on two popular effect-size measures, the correlation coefficient and the standardized mean difference (e.g., Cohen's d or Hedges's g), both of which can be used when one variable is dichotomous and the other is quantitative. Although the indices are often practically interchangeable, differences in sensitivity to the base rate or variance of the dichotomous variable can alter conclusions about the magnitude of an effect depending on which statistic is used. Because neither statistic is universally superior, researchers should explicitly consider the importance of base rates to formulate correct inferences and justify the selection of a primary effect-size statistic.     

Employee Cynicism and Resistance to Organizational Change

We offer a reconceptualization of employee cynicism and present the results of two studies to test the hypotheses that (a) cynicism about an organizational change is distinguishable from skepticism about the change, more general forms of cynicism (disposition and management), and trust in management, (b) change-specific cynicism and skepticism relate differently to personal and situational antecedent variables, and (c) change-specific cynicism accounts for variance in employees intention to resist change not explained by skepticism, trust, and more general forms of cynicism. Study 1 was conducted with employees (N=65) from several organizations undergoing various changes, and Study 2 with employees (N=701) from a single organization undergoing restructuring and culture change. Results were generally consistent with prediction. Implications for future research and for the management of change are discussed.