METAANALYSES OF VALIDITY STUDIES PUBLISHED BETWEEN 1964 AND 1982 AND THE INVESTIGATION OF STUDY CHARACTERISTICS

Review and metaanalyses of published validation studies for the years 1964-1982 of Journal of Applied Psychology and Personnel Psychology were undertaken to examine the effect of (1) research design; (2) criterion used; (3) type of selection instrument used; (4) occupational group studies; and (5) predictor-criterion combination on the level of observed validity coefficients. Results indicate that concurrent validation designs produce validity coefficients roughly equivalent to those obtained in predictive validation designs and that both of these designs produce higher validity coefficients than does a predictive design which includes use of the selection instrument. Of the criteria examined, performance rating criteria generally produced lower validity coefficients than did the use of other more "objective" criteria. In comparing the validities of various types of predictors, it was found cognitive ability tests were not superior to other predictors such as assessment centers, work samples, and supervisory/peer evaluations as has been found in previous metaanalytic work. Personality measures were clearly less valid. Compared to previous validity generalization work, much unexplained variance in validity coefficients remained after corrections for differences in sample size. Finally, the studies reviewed were deficient for our purposes with respect to the data reported. Selection ratios, standard deviations, reliabilities, predictor and criterion intercorrelations were rarely and inconsistently reported. There are also many predictor-criterion relationships for which very few validation efforts have been undertaken.     

EXPERIENCE-BASED AND SITUATIONAL INTERVIEW QUESTIONS: STUDIES OF VALIDITY

This research compared the validity of two different types of structured interview questions (i.e., experience-based and situational) under tightly controlled conditions. The experience-based interview questions required that 108 study participants relate how they had handled situations in the past requiring skills and abilities necessary for effective performance on the job. Situational questions, administered to another group of 108 study participants, provided interviewees with hypothetical job-relevant situations and asked them how they would respond if they were confronted with these problems. The experience-based interview questions yielded higher levels of validity than the situational questions. Additional analyses showed that the interview added incrementally to the prediction of performance beyond the variance accounted for by a cognitive ability test. There were small differences in subgroup performance (White, Black, Hispanic, male, and female) on the experience-based interview, though it was equally valid for all subgroups.     

The consequences of high levels of attachment security

Attachment security is known to have various positive outcomes. Recent evidence, however, suggests that security, especially high levels of it, may also have negative outcomes. Three studies tested this possibility. Studies 1 and 2 showed a linear rather than curvilinear trend between security and positive outcomes, suggesting that even at high levels security correlates with positive outcomes. Study 3, which focused on secure behaviors, found that exhibiting high levels of secure behaviors was related to a higher frequency of negative outcomes. However, dispositional attachment security was negatively correlated with negative outcomes, and engaging in secure behaviors strengthened this correlation. These findings suggest that secure behaviors rather than perceptions associated with attachment security (i.e., working models) may be related with negative outcomes.     

new options for college study

In an effort to meet the changing demands American society is placing on educational institutions, colleges and universities have begun reexamining their educational practices and philosophy. Here the author discusses two alternatives to traditional classroom learning: (a) universities' acceptance of standardized examination results as evidence of learning and (b) “external degree” programs, which involve a reorganization of the higher education system. She discusses one such program in detail. Both of these changes will encourage and enable more people to pursue college degrees; they will also demand new or redefined roles for counselors in and out of the academic community.     

Men's sociosexuality is sensitive to changes in mate availability

Correlational research has linked mate availability to human sexual behavior, whereby unrestricted sociosexuality seems to be most common under conditions of female abundance. In this study, 71 heterosexual men were randomly assigned to one of two mate availability priming conditions, mate scarcity or mate abundance, and subsequently completed measures of sociosexuality as well as infidelity intentions. Results indicated that men in the mate abundance condition reported stronger sociosexual attitudes and desires, and among those currently in relationships, stronger infidelity intentions. These findings were contrasted with those from a separate sample of 66 heterosexual undergraduate women. Mate scarcity had no effects on women's sociosexuality or infidelity intentions. Findings suggest that when mates are scarce, men will adopt a sociosexual orientation aimed at maintaining a single partner.     

ARE WE GETTING FOOLED AGAIN? COMING TO TERMS WITH LIMITATIONS IN THE USE OF PERSONALITY TESTS FOR PERSONNEL SELECTION

We recently published an article in which we highlighted a number of issues associated with the use of self-report personality tests in personnel selection contexts ( Morgeson et al., 2007 ). Both Ones, Dilchert, Viswesvaran, and Judge (2007) and Tett and Christiansen (2007) have written responses to this article. In our response to these articles we address many of the issues raised by Ones et al. and Tett and Christiansen. In addition to a detailed response, we make the following 4 key points: (1) Our criticisms of personality testing apply only to the selection context, not to all research on personality; (2) the observed validities of personality tests predicting job performance criteria are low and have not changed much over time; (3) when evaluating the usefulness of using personality tests to select applicants, one must not ignore the observed, uncorrected validity; and (4) when discussing the value of personality tests for selection contexts, the most important criteria are those that reflect job performance. Implications for personality testing research and practice are discussed.