METAANALYSES OF VALIDITY STUDIES PUBLISHED BETWEEN 1964 AND 1982 AND THE INVESTIGATION OF STUDY CHARACTERISTICS

Review and metaanalyses of published validation studies for the years 1964-1982 of Journal of Applied Psychology and Personnel Psychology were undertaken to examine the effect of (1) research design; (2) criterion used; (3) type of selection instrument used; (4) occupational group studies; and (5) predictor-criterion combination on the level of observed validity coefficients. Results indicate that concurrent validation designs produce validity coefficients roughly equivalent to those obtained in predictive validation designs and that both of these designs produce higher validity coefficients than does a predictive design which includes use of the selection instrument. Of the criteria examined, performance rating criteria generally produced lower validity coefficients than did the use of other more "objective" criteria. In comparing the validities of various types of predictors, it was found cognitive ability tests were not superior to other predictors such as assessment centers, work samples, and supervisory/peer evaluations as has been found in previous metaanalytic work. Personality measures were clearly less valid. Compared to previous validity generalization work, much unexplained variance in validity coefficients remained after corrections for differences in sample size. Finally, the studies reviewed were deficient for our purposes with respect to the data reported. Selection ratios, standard deviations, reliabilities, predictor and criterion intercorrelations were rarely and inconsistently reported. There are also many predictor-criterion relationships for which very few validation efforts have been undertaken.     

HONESTY TESTING FOR PERSONNEL SELECTION: A REVIEW AND CRITIQUE

Paper and pencil predictors of employee theft are described and studies of validity, reliability, and adverse impact of these tests are examined. Validity studies for 10 tests were grouped into 5 categories: comparisons with polygraph examination results, correlations with admissions of past theft, predictive studies using future job behaviors as criteria, comparisons of shrinkage rates before and after the introduction of a testing program, and comparisons of test scores of groups known to be dishonest with groups representing the general population. While positive correlations were consistently found, a variety of methodological differences between studies were identified which make the direct comparison of test validities suspect. High reliabilities are consistently reported, and test score comparisons by race and sex generally report no differences. Ethical issues in honesty test usage are considered and future research needs are identified.     

Short-Term Stability of Task-Generated,Interactional Patterns in Families of Schizophrenic Patients

Both researchers and therapists who study schizophrenia make inferences about enduring family roles from observed patterns of interactional talking behavior within families. Evidence regarding the stability of these patterns is rarely investigated. The present study examined the short-term stability of intrafamilial speech patterns (who talks to whom) across two consecutive discussions. The sample was composed of families containing a recent-onset, adult schizophrenic patient. All discussions involved two biological parents and a young adult patient (N = 28 ). Families were classified into one of three interactional role-structure categories based on the intrafamilial speech patterns in two 10-minute discussions obtained in the same session. In addition, the affective style ( 4 ) of the content of the discussions was coded. The results indicated that intrafamilial speech patterns were relatively stable across two discussions despite variations in the focus of the problem discussed. Further, when one parent was predominant in the discussion, a higher rate of negative affective statements was observed than when both parents were equal participants. The results provide further support for the use of discussion tasks in generating meaningful family interaction data.     

CORRESPONDENCE BETWEEN ESTIMATES OF CONTENT AND CRITERION-RELATED VALIDITY VALUES

The correspondence between inferences made using two validation strategies–content and criterion-related–were examined in a specific personnel selection application. Empirical validity values and Law-she's (1975) content validity ratios (CVR) were obtained for items from three structured interview guides used in the selection of insurance agents. Ratings of each item by over 300 field managers were used to calculate the CVR values. Statistically significant, yet modest correlations were found between empirical item validities and content validities for an interview guide used to select applicants with prior insurance sales experience. No significant differences were found among these correlations by comparing job experts of different levels of managerial experience and experience in selection. Data for the interview guide used to select experienced applicants also indicated that a content validity approach can be useful in developing a selection instrument with an empirically valid composite rating. The hypotheses were not confirmed for interview guides used to select applicants with no prior insurance sales experience. The practical importance of these results are discussed, as are plans for future research.     

Family Functioning and Mental Illness: A Comparison of Psychiatric and Nonclinical Families

The primary objective of the present investigation was to examine adaptive functioning in the families of patients with a wide range of psychiatric disorders. Seven dimensions of family functioning, as measured by the Family Assessment Device (FAD), were compared across families of patients with a schizophrenia spectrum disorder (n = 61 ), bipolar disorder (n = 60 ), major depression (n = 111 ), anxiety disorder (n = 15 ), eating disorder (n = 26 ), substance abuse disorder (n = 48 ), and adjustment disorder (n = 46 ). Families in each psychiatric group were also compared to a control group of nonclinical families (N = 353 ). Results indicated that regardless of specific diagnosis, having a family member in an acute phase of a psychiatric illness was a risk factor for poor family functioning compared to the functioning of control families. However, with few exceptions, the type of the patient's psychiatric illness did not predict significant differences in family functioning. Thus, having a family member with a psychiatric illness is a general stressor for families, and family interventions should be considered for most patients who require a psychiatric hospitalization for either the onset of, or an acute exacerbation of, any psychiatric disorder.     

Relatives' Perceptions of Their Interactional Behavior with a Schizop/hrenic Family Member

Relatives' (N = 77 ) perceptions of their recent interactional behavior with a schizophrenic family member (N = 51 ), as measured by an adjective checklist, were compared with outside observer ratings of the relatives' Affective Style (AS) and the patients' Coping Style (CS) during a family interaction task. Results indicated that, overall, the relatives in the present sample perceived their own interactional behavior toward the patient, as well as the patients' behavior toward them, in a way that paralleled their affective behavior as assessed by outside raters. Moreover, the relatives' rated their relationship with the patient in a fashion that was more predictive of the observed interactional behavior of both the relatives and the patients than were the outside observers' ratings of the relatives' Expressed Emotion (EE) measured either at the patients' index hospitalization (using the Camberwell Family Interview, CFI-EE) or during the post-discharge period (assessed with a brief Five-Minute Speech Sample method, FMSS-EE).     

THE ABSENT AUTHOR: MAURICE BLANCHOT AND INSPIRATION

But when you are handed over, do not worry about how to speak or what to say; what you are to say will be given to you when the time comes, because it is not you who will be speaking; the Spirit of your Father will be speaking in you (Matt 10:19-20).     

A FIELD STUDY OF PERFORMANCE APPRAISAL PURPOSE: RESEARCH- VERSUS ADMINISTRATIVE- BASED RATINGS

Many researchers have discussed the theoretical and practical importance of rating purpose. Nevertheless, the body of empirical studies, the majority of which were conducted in a laboratory setting, focus on leniency. There has been little research on other effects of rating purpose. The present study examines 223 ratees in a field setting for whom there were both administrative-based performance appraisal ratings (which were actually used for personnel decisions) and research-based performance appraisal ratings (obtained for a validation study). Two of the hypotheses were supported; administrative ratings were more lenient than research-based ratings. The administrative-based ratings demonstrated a statistically significant relationship with ratee seniority, while the research-based ratings did not. There was mixed support for a third hypothesis: Research ratings were significantly correlated with a predictor, while the administrative ratings were not. The difference between the validity coefficients, however, was not significant. Contrary to the hypothesis, the rank order between administrative-based and research-based ratings was relatively high ( r = 33).