INTERPRETING THE RESULTS OF META-ANALYTIC RESEARCH: A COMMENT ON SCHMITT, GOODING, NOE, AND KIRSCH (1984)

This comment shows that the conclusion of Schmitt, Gooding, Noe, and Kirsch (1984) that their meta-analytic findings are inconsistent with earlier validity generalization work is in error. The findings in their study that less variance than previously reported was due to sampling error are a result of their larger average sample sizes. Their claim that, after sampling error variance was accounted for, much unexplained variance remained, is incorrect. This error is demonstrated to be a result of their exclusive concentration on percentages and consequent failure to examine amount of observed and residual variance.     

ESTIMATION OF EMPLOYMENT VALIDITIES BY LESS EXPERIENCED JUDGES

In a previous study, Schmidt, Hunter, Croll and McKenzie (1983) demonstrated that estimates of the validity of cognitive tests made by highly trained and experienced judges are more accurate than empirical estimates obtained from small-sample validity studies. The present study examined whether less experienced judges could also produce accurate estimates. Twenty-eight recent Ph.D.'s in I/O Psychology estimated observed validities for the same 54 job-test combinations used by Schmidt et al. (1983). The estimates of these judges contained about twice as much random error as the experts' estimates. Systematic error of the less experienced judges was also greater than that of the experts (.0732 vs .019). The systematic errors of the two sets of judges were in opposite directions: less experienced judges overestimated validities, on average, while experts underestimated them. The results show that the estimates of less experienced judges contain less information than those of experts, but also that averages of estimates of several less experienced judges are as accurate as those obtained from small-sample empirical studies.     

After the Shooting Stops

Five pupil service personnel in a small, midwestern school system combined their efforts in responding to student, teacher, and parent needs after a 14-year-old boy wounded two teachers and a student and killed the principal in a shooting spree. It is suggested that schools develop tactical plans for responding to catastrophic situations.     

Elizabeth Adele Greenleaf: Having Some Fun Getting the Job Done

Elizabeth Adele Greenleaf, professor and coordinator of College Student Personnel Administration at Indiana University, made significant contributions to the development of the student affairs profession through her leadership as an educator, administrator, and mentor.     

On the Boundary: Family Therapy in a Long-Term Inpatient Setting

This paper presents a paradigm of family therapy in a long-term inpatient setting. After reviewing literature commenting on the necessity of attending to the needs of families of inpatients, the essential functions of inpatient treatment are discussed and an approach to family therapy, related to and reflecting those functions, is developed. Four functions of inpatient family therapy are delineated: joining, support, intervention, and validation. What distinguishes these from similar functions in outpatient treatment is the family therapist's position on the hospital-family boundary.     

PERSONALITY AND JOB PERFORMANCE: A CRITIQUE OF THE TETT, JACKSON, AND ROTHSTEIN (1991) META-ANALYSIS

Tett, Jackson, and Rothstein (1991) recently presented a meta-analysis of the relationship between personality and job performance. Many of their findings, particularly those pertaining to the Big Five personality dimensions, are at odds with one other large scale meta-analytic study (Barrick & Mount, 1991) investigating the relation between personality and performance. In order to reconcile these new results with previous findings, we examined differences in the sample sizes used, the process for assigning pre-existing scales to personality dimensions, and the nature of the jobs investigated. In addition, we found four technical errors in the Tett et al. moderator meta-analyses in computing sampling error, the bias correction, sampling error for bias corrected correlations, and computing sampling error variance across studies. These errors raise serious questions about the interpretation of their results for various moderators of the personality-job performance relationship.     

The BRIEFER Project: Using Expert Systems as Theory Construction Tools

This article describes the development of BRIEFER I and BRIEFER II, expert systems that advise the therapist on selecting, designing, and developing an intervention at the end of the first therapy session. The process of developing expert systems has aided us in describing what brief therapists do, in modeling the intervention design process, and in training brief therapists.     

A WITHIN SETTING EMPIRICAL TEST OF THE SITUATIONAL SPECIFICITY HYPOTHESIS IN PERSONNEL SELECTION

The situational specificity hypothesis of selection procedure validity makes two predictions. The first is that variation in observed validities across settings is caused by real differences in what constitutes job performance. Validity generalization studies to date have provided disconfirming evidence for this prediction by showing that the observed variation is due to statistical and measurement artifacts. The second prediction is that if the situation (i.e., the organization, the setting, the job, the test and the criterion) is held constant, then validity findings will not vary from study to study. This article tests this prediction empirically using data from a unique series of studies reported by Bender and Loveless (1958). The results are contrary to the situational specificity hypothesis and consistent with the hypothesis that variation in observed validities is due to statistical and measurement artifacts that are unrelated to situations and settings. It is concluded that both major predictions of the situational specificity hypothesis have now been empirically disconfirmed.