RELATIONSHIPS BETWEEN GRADUATE TRAINING, PROFESSIONAL AFFILIATION, AND INDIVIDUAL PSYCHOLOGICAL ASSESSMENT PRACTICES FOR PERSONNEL DECISIONS

Survey data on 321 psychologists who conduct individual assessments were analyzed to compare practices and opinions of those with differing graduate training (I/O or non-I/O) and professional affiliation (SIOP or non-SIOP). Differences in practice on the basisof training and affiliation occur in licensing, types of assessments conducted, specific testing instruments used, and knowledge of legal guidelines governing selection practices. However, when purpose of assessment was controlled for by examining only managerial selection assessments, few practice differences related to training and affiliation emerged. Implications for the training of individual assessors are discussed, and several practice variations warranting further research are presented.     

THE EFFECTS OF PERCEIVED SYSTEM KNOWLEDGE ON THE AGREEMENT BETWEEN SELF-RATINGS AND SUPERVISOR RATINGS

The viability of self-assessment in the performance appraisal process has been the focus of recent work. Although some contend that self-appraisals can be beneficial, the consistent finding of lenient and inaccurate self-ratings has led others to discount and doubt their usefulness. Recent research (Farh & Dobbins, 1989a,b) has investigated the influence of a variety of factors in improving the accuracy of self-ratings. The present study was conducted to examine the effect of perceived system knowledge (PSK) on the discrepancy between self- and supervisor ratings. Seventy-three employees of two banking institutions participated by completing a questionnaire on their perceived knowledge of the performance appraisal system. The results of moderated regression analyses suggest that the level of knowledge did in fact influence the agreement among subordinates and supervisors. Self-ratings were more congruent with supervisors'ratings when the subordinates reported high levels of perceived system knowledge. Implications of these findings for organizations and areas for future research are discussed.     

STATISTICAL POWER AND COST IN TRAINING EVALUATION: SOME NEW CONSIDERATIONS

Two ways to reduce the costs of training evaluation are examined. First, we examine the potential for reducing the costs of training evaluation by assigning different numbers of subjects into training and control groups. Given a total N of subjects, statistical power to detect the effectiveness of a training program can be maximized by assigning the subjects equally to training and control groups. If we take into account the costs of training evaluation, however, an unequal-group-size design with a larger total N may achieve the same level of statistical power at lower cost. We derive formulas for the optimal ratios of the control group size to the training group size for both ANOVA and ANCOVA designs, incorporating the differential costs of training and control group participation. Second, we examine the possibility that using a less expensive proxy criterion measure in place of the target criterion measure of interest when evaluating the training effectiveness can pay off. We show that using a proxy criterion increases the sample size needed to achieve a given level of statistical power, and then we describe procedures for examining the tradeoff between the costs saved by using the less expensive proxy criterion and the costs incurred by the larger sample size.     

NEW DEVELOPMENTS IN THE USE OF MEASURES OF HONESTY INTEGRITY, CONSCIENTIOUSNESS, DEPENDABILITY TRUSTWORTHINESS, AND RELIABILITY FOR PERSONNEL SELECTION

This paper is the fourth in a series of reviews of the use of measures of honesty, integrity, conscientiousness, dependability, trustworthiness, and reliability for personnel selection (see Sackett & Decker, 1979; Sackett & Harris, 1984; Sackett, Burris, & Callahan, 1989). New developments reviewed include an examination of professional and congressional inquiry into this area of testing, rapid growth of the validity data base, new insight into similarities and differences between different tests, and links to the Big Five personality dimensions. Inquiries into relationships with other constructs, including cognitive ability, moral reasoning, and social desirability are reviewed, as are applicant reactions to these tests. The effects of the Civil Rights Act of 1991 and the Americans with Disabilities Act are considered.     

Interpersonal attraction as a function of extreme gender role adherence

Although gender-specific constructs of hypertraditionality qualitatively differ (e.g., hyperfemininity and hypermasculinity), we view them as analogous constructs that can predict similarity/attraction effects. The similaritylattraction paradigm showed that individuals find attractive the traits in others that are similar to their own traits. We suggest that this effect applies to levels of hypertraditionality, as measured by the hyperfemininity and hypermasculinity personality scales. The studies were conducted to test this hypothesis. We began by manipulating stranger similarity in an attraction experiment. Results showed that similarity of hypertraditionality led to attraction. Women preferred target persons similar to themselves in hypertraditionality. Data from men revealed an unexpected interaction. Low hypermasculine men preferred women similar to themselves in hypertraditionality, yet high hypermasculine men did not distinguish between female strangers based on the stranger's level of hypertraditionality. We then studied dating couples. These couples provided real-world data that supported and expanded the laboratory observations. We found a significant positive correlation between the partners' levels of hypertraditionality. The implications of attraction based on hypertraditionality may provide insights for future studies of relationship formation and maintenance.     

VIDEO-BASED SITUATIONAL TESTING

In two separate studies, video-based tests of situational judgment were developed and validated against measures of performance for hourly service workers. In the first study, 684 employees were used to develop a test of retail associate judgment and 787 newly hired employees were used to cross-validate the instrument. In the second study, 412 current employees were used to develop a test of nursing home caregiver judgment and 148 newly hired caregivers were used to cross-validate this video-based test. In both studies, responses to video-based situational vignettes were empirically keyed against supervisory ratings of performance. The resulting keys produced uncorrected cross-validities in the low .20s. The video-based test scores were also found to be related to measures of cognitive ability and, to a lesser extent, experience. These results suggest that cognitive ability and possibly experience account for some but not all of the predictiveness of video-based situational tests. Video-based situational tests demonstrated score differences between Whites and non-Whites of roughly one-half a standard deviation, indicating that the use of such tests could produce adverse impact against non-Whites. In the second study, customer preferences regarding desired behavior were also used to develop a rational scoring key. This customer driven key was significantly related to performance ( r = .33) in the cross-validation sample, demonstrating that customers' preferences can provide the basis for developing valid predictors. Potential benefits of video-based situational tests in selection and directions for future research are discussed.