THE VALIDITY OF MORAL THEORIES

Abstract. We can usefully draw an analogy between ethics and science, despite the significant differences between them. We can then see the ways in which moral theories can indeed be "tested," not by empirical experience but by moral experience. This can be expected to lead to rival moral theories, but in science also we have rival theories. I argue that we should demand more than coherence of our moral theories, as we do of our scientific theories. I try to show how the "testing" of moral theories can be carried out and how this can allow us to accept some moral theories as valid.     

THE FUTURE OF CRITERION-RELATED VALIDITY1

As a result of rejection by personnel psychologists of the erroneous law of small numbers and of the adoption of correct inferential procedures, the future of criterion-related validity promises to be bright. Probable future developments include: (a) widespread appreciation of the low statistical power characteristic of small samples; (b) rejection of the traditional belief that validities are situationally specific; (c) widespread validity generalization based on new methods; (d) research demonstrations that rational estimates of validity are often superior in accuracy to empirical estimates; (e) widespread acceptance of research findings showing that single-group and differential validity by race are artifactual rather than substantive in origin and that test unfairness by race is a nonproblem; (f) increased application of decision-theoretic dollar utility analyses to selection programs; and (g) progress in the establishment of general principles and theories about trait-performance relations in the world of work.     

THE EFFECT OF CORRELATED ARTIFACTS AND TRUE VALIDITY ON THE ACCURACY OF PARAMETER ESTIMATION IN VALIDITY GENERALIZATION

The effect of non-zero intercorrelations among the three artifacts (criterion reliability, predictor reliability, and range restriction on the predictor) and true validity on the accuracy of estimation in two validity generalization models (Model 1and Model 2) was investigated. Only the Thylor Series Approximation 1(TSA1) procedure from Model 1 and the procedure with complete sample-based artifact data from Model 2 were included in this study. Six intercorrelation conditions (zero, low positive, medium positive, low negative, low negative and positive, and medium negative and positive) and two distributions of artifacts were used in this investigation. The two major conclusions from this study are: (a) Both models yielded reasonably accurate estimates of the mean of true validities (M_ρ) and (b) only Model 2 produced accurate estimates of the variance of true validities (V_ρ). The need for additional research for accurately estimating V_ρ when the three artifacts and true validity are correlated is recommended.     

EYEBALL MEASUREMENT OF DEXTERITY: TESTS AS ALTERNATIVES TO INTERVIEWS

As industry's most popular selection device, the interview is too often misused to measure or predict numerous skills and abilities that can be measured or predicted better by other methods. The authors encountered such an abuse in a recent allegation of sex discrimination. This paper reports a study conducted for this litigation. Couched in a general lens model paradigm, the results demonstrate an inappropriate use of a selection technique to predict an ability that can be better measured by a test. This simple interview analog demonstrates the problems of replacing tests with inappropriate selection devices.     

ON THE VALIDITY OF SUBJECTIVE MEASURES OF COMPANY PERFORMANCE

Subjective measures of company performance are widely used in research and typically are interpreted as equivalent to objective measures. Yet, the assumption of equivalence is open to challenge. We compared the use of both types of measure in 3 separate samples. Findings were consistent in showing that: (a) subjective and objective measures of company performance were positively associated (convergent validity); (b) those relationships were stronger than those between measures of differing aspects of performance using the same method (discriminant validity); and (c) the relationships of subjective and objective company performance measures with a range of independent variables were equivalent (construct validity).     

EFFECT OF SITUATIONAL INTERVIEWS, CONVENTIONAL STRUCTURED INTERVIEWS, AND TRAINING ON INTERVIEW RATING AGREEMENT: AN EXPERIMENTAL ANALYSIS

The present study examines the degree to which agreement in interviewer ratings may be influenced by training, use of structured conventional interviews, or situational interviews. Results of an experimental study conducted among 42 managers who were experienced as interviewers revealed no training effect on rating agreement, but the impact of the situational format on consistency in assessments of applicant suitability was significant. Implications of these findings for usefulness of situational employment interviews and future research investigating the reliability of situational interview formats are discussed.     

VALIDITY OF SELF-ASSESSMENT: A FIELD EVALUATION

This study evaluated the validity of self-assessment in a natural setting. It also addressed the possibility of improving the utility of self-assessment by cautioning subjects that their responses could be compared with other existing data on them. Subjects were 357 males, aged 18–19 years, who were being screened for a prestigious military course. During the screening, they participated in small groups for nine days of tests, class exercises, and field simulations supervised by veteran commanders. On the ninth day, ratings were collected from commanders, peer group members, and the subjects themselves on dimensions related to eventual success in the training course. The experimental group was told their reports would be compared with those from other sources; the control group was not. Predictive and convergent validities were examined on three criteria: course success, commander ratings, and peer evaluations. Self-assessments from both experimental and control group were valid; however, those of the experimental group did not yield consistently higher validities. Findings are discussed in regard to their practical ramifications.     

PERSONALITY CHARACTERISTICS OF JOB APPLICANTS AND SUCCESS IN SCREENING INTERVIEWS

Although there is substantial evidence that personality constructs are valid predictors of job performance, there is less systematic evidence of how personality characteristics relate to success in the interviewing process. Measures of the Big Five personality markers were obtained from a sample of graduating college seniors (n = 83) who were engaged in a job search. At a later time these students reported the strategies used in the job search and success in generating follow-up interviews and job offers. Extraversion, Openness to Experience, and Conscientiousness were positively related to the use of social sources (e.g., talking to others) to prepare for interviews. Conscientiousness was positively related to the use of non-social preparation. Use of social sources for preparation for initial interviews was positively related to the likelihood of receiving follow-up interviews and job offers. The results suggest that personality is related to interviewee's success in part through actions taken well before the interviewing process begins and in part through the interviewers' inferences of the applicants' personality during the interview.     

RELIABILITY AND VALIDITY OF IN-BASKET PERFORMANCE MEASURES

The in-basket test is a frequently used assessment tool for predicting job performance and, to a lesser extent, as a technique for research and development in various human resource applications. While the in-basket test has obvious attractive features for application in the business setting, there is a great degree of uniqueness in each application and relatively little research focusing on critical issues involved in construction or evaluation. In this paper, the literature focusing on the psychometric properties of in-basket measures of performance are reviewed and evaluated. The compiled evidence provides only modest support of the usefulness of the in-basket test as a measurement tool.     

ON THE VALIDITY OF THE RORSCHACH TEST

Rorschach protocols of 20 persons (normals, depressives, and schizophrenics) were analysed, using the inverted, or Q , method of factoring. Three factors emerged from the analysis and corresponded to the three psychiatric categories. Groups of items, allegedly measuring the isolated factors, were applied to a second population of 42 persons resulting in validity values of an encouraging magnitude. Finally, published protocols are cited, together with a list of discriminating items and a score matrix based on such items, so that further verification can be made by the reader.