Optimum split-half reliabilities for the Rorschach: projective techniques are more reliable than we think

A new technique for optimizing split-half reliability estimates yielded substantial and comparable increases in indexes of internal reliability for some major Rorschach variables across two diverse samples. Practical suggestions for applying this method to other projective tests were advanced. The inadvisability of computing odd-even reliability coefficients without regard to split-half distributional anomalies is addressed.     

Improved reliability estimates for the serial color-word test

Starting from Lennart Sjöberg's serial scoring of the Color-Word Test and his critical review of the test, the possibilities of attaining better reliability estimates are briefly surveyed. As a simple step, the orthogonalization of the regression model is suggested. Ways of maximizing the reliability estimate are demonstrated. On the basis of 261 subjects from five differing subsamples, clinical and control groups, the reliability estimates of the oblique system of the orthogonalized system and of the maximum reliability solutions are compared empirically. The significance of the results for test theoretic evaluation of the Color-Word Test is discussed.     

Considerations in the choice of interobserver reliability estimates

Two types of interobserver reliability values may be needed in treatment studies in which observers constitute the primary data-acquisition system: trial reliability and the reliability of the composite unit or score which is subsequently analyzed, e.g., daily or weekly session totals. Two approaches to determining interobserver reliability are described: percentage agreement and "correlational" measures of reliability. The interpretation of these estimates, factors affecting their magnitude, and the advantages and limitations of each approach are presented.     

Observer agreement for event sequences: Methods and software for sequence alignment and reliability estimates

When sequences of discrete events, or other units, are independently coded by two coders using a set of mutually exclusive and exhaustive codes, but the onset times for the codes are not preserved, it is often unclear how pairs of protocols should be aligned. Yet such alignment is required before Cohen’s kappa, a common agreement statistic, can be computed. Here we describe a method—based on the Needleman and Wunsch (1970) algorithm originally devised for aligning nucleotide sequences—for optimally aligning such sequences; we also offer the results of a simulation study of the behavior of alignment kappa with a number of variables, including number of codes, varying degrees of observer accuracy, sequence length, code variability, and parameters governing the alignment algorithm. We conclude that (1) under most reasonable circumstances, observer accuracies of 90% or better result in alignment kappas of .60 or better; (2) generally, alignment kappas are not strongly affected by sequence length, the number of codes, or the variability in the codes’ probability; (3) alignment kappas are adversely affected when missed events and false alarms are possible; and (4) cost matrices and priority orders used in the algorithm should favor substitutions (i.e., disagreements) over insertions and deletions (i.e., missed events and false alarms). Two computer programs were developed: Global Sequence Alignment, or GSA, for carrying out the simulation study, and Event Alignment, or ELign, a user-oriented program that computes alignment kappa and provides the optimal alignment given a pair of event sequences.     

Maximizing journal impact: Moving from inspections of topics to scans for techniques,populations and actions

The comments offered in this article are intended to maximize the benefits and impact of JOOP content for both practitioners and academicians. Specifically, I argue that because practitioners and academicians alike are ‘time‐poor’ when it comes to reading journal articles, we inevitably end up conducting ‘topical scans’ in which we scan the titles of an issue for relevant topics. In order to maximize the impact of JOOP content, in addition to these topical scans, we also need to include scans for: (a) relevant techniques, (b) relevant populations, and (c) relevant actions that may be applicable even if the specific topic is not. I also discuss the importance of practitioners becoming more involved in the publication process and describe a matchmaking mechanism for research‐practitioner publication collaborations. Finally, I argue that scientist‐practitioners are the true heroes of our profession and should therefore be held in high regard.     

Differentiation of brain damage among low IQ subjects with three projective techniques.

Using a battery of three projective techniques (Rorschach, Hand Test, Bender-Gestalt) only slight discrimination was found between low IQ subjects classified according to the presence or absence of brain trauma (exogenous vs endogenous), while substantial discrimination was obtained between the same subjects categorized in terms of "lower" (60-74) and "higher" (75-89) FS WAIS IQ. All four groups used in this study had been first equated on sex and age. Results were interpreted as supporting the position that some sort of brain impairment underlies most or all retardation. Question was raised concerning the efficacy of projective techniques for diagnosing organicity in subjects of average or better intelligence.     

Maximizing noise energy for noise-masking studies

Noise-masking experiments are widely used to investigate visual functions. To be useful, noise generally needs to be strong enough to noticeably impair performance, but under some conditions, noise does not impair performance even when its contrast approaches the maximal displayable limit of 100 %. To extend the usefulness of noise-masking paradigms over a wider range of conditions, the present study developed a noise with great masking strength. There are two typical ways of increasing masking strength without exceeding the limited contrast range: use binary noise instead of Gaussian noise or filter out frequencies that are not relevant to the task (i.e., which can be removed without affecting performance). The present study combined these two approaches to further increase masking strength. We show that binarizing the noise after the filtering process substantially increases the energy at frequencies within the pass-band of the filter given equated total contrast ranges. A validation experiment showed that similar performances were obtained using binarized-filtered noise and filtered noise (given equated noise energy at the frequencies within the pass-band) suggesting that the binarization operation, which substantially reduced the contrast range, had no significant impact on performance. We conclude that binarized-filtered noise (and more generally, truncated-filtered noise) can substantially increase the energy of the noise at frequencies within the pass-band. Thus, given a limited contrast range, binarized-filtered noise can display higher energy levels than Gaussian noise and thereby widen the range of conditions over which noise-masking paradigms can be useful.