The Validity of the Employment Interview: A Meta-Analysis

The interview is the most widely used personnel selection method, but has revealed low reliability and validity compared with other selection methods (Mayfield 1964; Ulrich and Trumbo 1965; Schmitt 1976; Arvey 1979). Thirty-one studies on the validity of the interview were meta-analyzed. The result was an average validity coefficient of .27. The estimated true validity of the interview was calculated to be .38. These values indicated that the interview has moderate validity as a personnel selection device. Six characteristics of the interview were also examined in relation to the validity of the interview: structure of the interview; number of interviewers; length of the interview; gender of the applicant pool; blue-collar/white-collar jobs; and use of college students versus job applicants. The six study characteristics accounted for 30.9% of the variance in the validity of the interview. Structure of the interview appeared to be the only characteristic that moderated the validity of the interview. The relationship of this study to other meta-analyses of the employment interview is discussed.     

On the relation between personality and job performance of airline pilots

The validity of a personality questionnaire for the prediction of job success of airline pilots is compared to validities of a simulator checkflight and of flying experience data. During selection, 274 pilots applying for employment with a European charter airline were examined with a multidimensional personality questionnaire (Temperature Structure Scales; TSS). Additionally, the applicants were graded in a simulator checkflight. On the basis of training records, the pilots were classified as performing at standard or below standard after about 3 years of employment in the hiring company. In a multiple-regression model, this dichotomous criterion for job success can be predicted with 73.8% accuracy through the simulator checkflight and flying experience prior to employment. By adding the personality questionnaire to the regression equation, the number of correct classifications increases to 79.3%. On average, successful pilots score substantially higher on interpersonal scales and lower on emotional scales of the TSS.     

The impact of corrections for faking on the validity of noncognitive measures in selection settings

In selection research and practice, there have been many attempts to correct scores on noncognitive measures for applicants who may have faked their responses somehow. A related approach with more impact would be identifying and removing faking applicants from consideration for employment entirely, replacing them with high-scoring alternatives. The current study demonstrates that under typical conditions found in selection, even this latter approach has minimal impact on mean performance levels. Results indicate about .1 SD change in mean performance across a range of typical correlations between a faking measure and the criterion. Where trait scores were corrected only for suspected faking, and applicants not removed or replaced, the minimal impact the authors found on mean performance was reduced even further. By comparison, the impact of selection ratio and test validity is much larger across a range of realistic levels of selection ratios and validities. If selection researchers are interested only in maximizing predicted performance or validity, the use of faking measures to correct scores or remove applicants from further employment consideration will produce minimal effects.     

INCREASED ACCURACY FOR RANGE RESTRICTION CORRECTIONS: IMPLICATIONS FOR THE ROLE OF PERSONALITY AND GENERAL MENTAL ABILITY IN JOB AND TRAINING PERFORMANCE

A recently developed procedure produces substantial improvements in the accuracy of corrections for range restriction and reveals that predictive validities of employment selection methods are higher than previously thought. This study applied this procedure to meta‐analytic validities of 2 personality measures (Conscientiousness and Emotional Stability) and general cognitive ability measures. Results show that the increases in validity estimates are greater for cognitive ability than for personality, reducing the relative validity of personality. In addition, the incremental validity of these personality measures over that provided by cognitive ability is smaller than previously estimated. Path analyses based on the more accurate data reveal relatively smaller path coefficients from these personality traits to job and training performance. These findings have implications for theories of job performance and for the practical value in selection of personality measures relative to cognitive ability measures.     

THE IMPACT OF PSYCHOLOGICAL TESTING ON EDUCATIONAL AND PERSONNEL SELECTION IN AFRICA

Psychological testing for Education and Personnel selection is of great importance in the efforts by many African countries to ensure that suitable candidates are selected for education beyond the primary school level and for training for different employment. Major investigations directed to this need have been in the area of adapting tests already available in Western countries and determining the reliability and predictive validity of battery of tests so adapted and their tryout in African schools to determine their efficiency as tools for selection.     

Targeting low career confidence using the career planning confidence scale

The authors describe the development and validation of a test of career planning confidence that makes possible the targeting of specific problem issues in employment counseling. The scale, developed using a rational process and the authors' experience with clients, was tested for criterion‐related validity against 2 other measures. The scale produced a 6‐factor structure that replicates common career planning models: Readiness to Make a Career Decision, Self‐Assessment, Generating Options, Information Seeking, Deciding, and Implementing a Decision. Validity and reliability of the scale are discussed, along with suggestions for employment counseling practice.     

Proactively balancing the validity and legal compliance of personal background measures in personnel management

Despite its proven utility and validity for the prediction of performance, the use of certain biodata questions for selection is being restricted because of fears of charges of discrimination, or of invasion of privacy, arising from increasingly stringent state and federal laws governing employment (Ash, 1989). The objective of this study was to develop alternative items that were valid and also perceived as nondiscriminatory and noninvasive for two biodata subscales in a well-researched biographical inventory. The newly developed subscales had acceptable KR-20 reliability coefficients. Sizeable and significant correlations between the corresponding original and newly developed subscales attested to the latter's construct validity. The performance criterion validity of the new subscales was demonstrated by significant correlations with both salary and with level of organizational functioning, which were regarded as measures of the individual's worth to the organization. The results of the present study encourage the expectation that biodata items can be constructed that are (1) valid, (2) in compliance, and (3) with a sufficiently low level of perceived invasiveness that will allow both the applicant and the test user to be comfortable with their use.     

Sampling behaviour in estimating predictive validity in the context of selection and latent variable modelling: A Monte Carlo study

While the effect of selection in predictive validity studies has long been recognized and discussed in psychometric studies, little consideration has been given to this problem in the context of latent variable models. In a recent paper, Muthén & Hsu (1993) proposed and compared estimators of predictive validity of a multifactorial test. Both selectivity and measurement error were considered in the estimation of predictive validity. The purpose of the present paper is to expand on Muthén & Hsu (1993) by examining and comparing the sampling behaviour of three estimators for predictive validity, LQL (listwise, quasi-likelihood estimator), FQL (full, quasi-likelihood estimator) and FS (factor score estimator), using a Monte Carlo approach. Effects of selection procedures, selection ratios and sample sizes on the sampling behaviours of the estimators are also investigated. The results show that FQL and FS are the two preferred estimators and each has different strengths and weaknesses. A real data application is presented to illustrate the practical implementation of the estimators.     

Racial/ethnic differences in the criterion-related validity of cognitive ability tests: a qualitative and quantitative review

The correlation between cognitive ability test scores and performance was separately meta-analyzed for Asian, Black, Hispanic, and White racial/ethnic subgroups. Compared to the average White observed correlation ( = .33, N = 903,779), average correlations were lower for Black samples ( = .24, N = 112,194) and Hispanic samples ( = .30, N = 51,205) and approximately equal for Asian samples ( = .33, N = 80,705). Despite some moderating effects (e.g., type of performance criterion, decade of data collection, job complexity), validity favored White over Black and Hispanic test takers in almost all conditions that included a sizable number of studies. Black-White validity comparisons were possible both across and within the 3 broad domains that use cognitive ability tests for high-stakes selection and placement: civilian employment, educational admissions, and the military. The trend of lower Black validity was repeated in each domain; however, average Black-White validity differences were largest in military studies and smallest in educational and employment studies. Further investigation of the reasons for these validity differences is warranted.     

RIASEC TYPES AND BIG FIVE TRAITS AS PREDICTORS OF EMPLOYMENT STATUS AND NATURE OF EMPLOYMENT

This prospective study investigated the validity of the Five-Factor Model (FFM) of personality and Holland's RIASEC vocational interest typology in predicting employment status and the nature of employment in a sample of graduating college seniors as they entered the job market. A sample of 934 senior college graduates enrolled in various academic subjects filled in Costa and McCrae's NEO-PI-R (1992) and Holland's Self-Directed Search (1979). One year after graduation, they were requested to describe their labor market positions and jobs, using the Position Classification Inventory (PCI; Gottfredson & Holland, 1991). Six hundred and twelve people responded to the second call, of whom 335 were employed and 66 unemployed. The incremental validity of the 2 models over and above each other was investigated in the sample of employed and unemployed subjects ( N = 401) using stepwise regression analysis. The results showed that Extraversion and Conscientiousness were the only valid predictors of employment status and that vocational interests did not show incremental validity over and above these factors. The RIASEC types, however, were clearly superior in explaining the nature of employment, underscoring the validity of Holland's hexagonal calculus assumptions. Employment reflecting Realistic, Social and Enterprising characteristics was to a limited extent predicted by four of the Big Five, except Neuroticism, over and above the RIASEC types. The findings are discussed in the framework of Schneider's Attraction-Selection-Attrition (ASA) theory (1987) concluding that Holland's RIASEC model is more employee-driven, being better at predicting the nature of employment, whereas the FFM is more employer-oriedted, with greater validity in evaluating the employability and employment status of applicants.     

Personality,Faking, and Convergent Validity: A Warning Concerning Warning Statements

Personality measures continue to be criticized for their susceptibility to faking and socially desirable responding. The present study examined the effects of warning applicants against faking on convergent validity of self-observer ratings. Four hundred sixty-four participants completed personality inventories in either a warned or unwarned condition. Results indicated that warning statements resulted in lower mean scores for some personality dimensions but did not improve convergent validity for any of these dimensions. Implications of these findings are discussed in relation to employment selection and future research.     

Personality and absenteeism: a meta‐analysis of integrity tests

Until recently, research focus has been on a variety of demographic, attitudinal, and organizational variables in predicting and explaining absenteeism. If personality traits predict absenteeism, then it may be possible to use measures of these traits to identify and select job applicants and thereby reduce absenteeism rates. In this research, our goal was to examine whether integrity tests could be used to predict absenteeism. Meta‐analysis was applied to studies of the validity of pre‐employment integrity tests for predicting voluntary absenteeism. Twenty‐eight studies based on a total sample of 13 972 were meta‐analysed. The estimated mean predictive validity of personality‐based integrity tests was 0.33. This operational validity generalized across various predictor scales, organizations, settings, and jobs (SD_ρ = 0.00). Overt integrity tests, however, showed much lower predictive validity for absenteeism and greater variability than personality‐based tests (ρ = 0.09; SD_ρ = 0.16). The results indicate that a personnel selection approach to reducing absenteeism in organizations may be a useful strategy, particularly if personality‐based integrity tests are utilized. Potential explanations for differences between these results and those found for Big Five measures of personality are offered. Future research investigating models of absenteeism should incorporate the personality constructs assessed by integrity tests. Copyright © 2003 John Wiley & Sons, Ltd.     

Construct validity of a personality assessment game in a simulated selection situation and the moderating roles of the ability to identify criteria and dispositional insight

There is scant research on the validity of personality assessment games in selection situations. Therefore, in two experimental simulated selection studies, the construct validity of an assessment game developed to assess honesty-humility was tested. Both studies found no differences between a control condition and a simulated selection condition on honesty-humility game scores. Moreover, convergent and discriminant validity with self-reported personality were not affected by the manipulation. We obtained mixed evidence that individual differences in dispositional insight and the ability to identify criteria influenced the validity of the game. As the validity of the personality assessment game was not significantly affected in the simulated selection context, our findings may imply that well-designed personality assessment games can be used for high-stakes selection assessments.     

Cross Validation of Experimental USAF Pilot Training Performance Models

In a recent study, several experimental computerized tests demonstrated utility for supporting United States Air Force (USAF) pilot candidate selection de- cisions and adding to the predictive validity of the Air Force Officer Qualifying Test (AFOQT), the ability measure currently included in the USAF pilot candidate selection process (Carretta, 1989). Pilot candidates with good hand-eye coordination, who make quick and accurate decisions, and who exhibited a cautious risk-taking style were more likely to complete training successfully. The purpose of this study was to cross validate these results to determine their stability. To perform the cross validation, 885 USAF Undergraduate Pilot Training (UPT) students were assigned randomly to two groups (478 of these students also were used in Carretta, 1989). Pilot candidate selection models were developed independently for each group. The "best fitting" regression weights from each group then were applied to subjects in the other group to determine the stability of the regression solutions. In the model development phase, subjects in both groups who had good hand-eye coordination and who made quick and accurate decisions were more likely to complete pilot training successfully. Although there was some reduc- tion in the validity coefficients in the cross-validation phase, the selection models were related significantly to final training outcome in both groups. These results suggest that the experimental pilot candidate selection models are robust enough to be used as adjuncts to operational USAF pilot candidate selection procedures.     

A Narrative Review of Post-1989 Employment Interview Research

This narrative review covers both selection- and recruitment/com-munication-oriented employment interview research published since 1989. Brief comparisons of older reviews' findings to recent findings are presented. Key topics reviewed include validity and reliability evidence, decision making in the interview, applicant characteristics, applicant reactions, and interview communication processes. Key findings of the present review include: interview validity, under certain conditions, may rival that of mental ability tests; more structure in selection interviews is better; previewing applicant information (e.g., resumes) by the interviewer can harm selection interview effectiveness; and certain recruiter behaviors can influence applicants' willingness to work for the firm.     

Examining the item response process to personality measures in high-stakes situations: Issues of measurement validity and predictive validity

We conducted two experimental studies with between-subjects and within-subjects designs to investigate the item response process for personality measures administered in high- versus low-stakes situations. Apart from assessing measurement validity of the item response process, we examined predictive validity; that is, whether or not different response models entail differential selection outcomes. We found that ideal point response models fit slightly better than dominance response models across high- versus low-stakes situations in both studies. Additionally, fitting ideal point models to the data led to fewer items displaying differential item functioning compared to fitting dominance models. We also identified several items that functioned as intermediate items in both the faking and honest conditions when ideal point models were fitted, suggesting that ideal point model is “theoretically” more suitable across these contexts for personality inventories. However, the use of different response models (dominance vs. ideal point) did not have any substantial impact on the validity of personality measures in high-stakes situations, or the effectiveness of selection decisions such as mean performance or percent of fakers selected. These findings are significant in that although prior research supports the importance and use of ideal point models for measuring personality, we find that in the case of personality faking, though ideal point models seem to have slightly better measurement validity, the use of dominance models may be adequate with no loss to predictive validity.     

Content validity: A neglected strategy for developing managerial selection tests?

There is a lack of quick, valid, and cost effective methods for selection of low-and mid-level managerial personnel. Using content-valid methods to develop managerial selection instruments may reap substantial benefits for applicants as well as for the organizations using such tools. To this end, based upon extensive job analysis, a content-valid managerial selection test was developed. Criterion-based validity collected on the new instrument suggested that an instrument developed using content-valid procedures can also show acceptable levels of criterion validity.     

Content validity: A neglected strategy for developing managerial selection tests?

There is a lack of quick, valid, and cost effective methods for selection of low-and mid-level managerial personnel. Using content-valid methods to develop managerial selection instruments may reap substantial benefits for applicants as well as for the organizations using such tools. To this end, based upon extensive job analysis, a content-valid managerial selection test was developed. Criterion-based validity collected on the new instrument suggested that an instrument developed using content-valid procedures can also show acceptable levels of criterion validity.     

Clarifying Construct Validity: Definitions,Processes, and Models

Despite definitions in standard sources, personnel managers, psychologists, and psychometricians persistently encounter problems that are best referred to as the ambiguous nature of validity. The purpose of this article is to pro- vide an overview of construct validity and personnel testing, to demonstrate its practical utility, and to clarify with concrete examples certain theories and models, as well as to illustrate the meaning of the terminology used by com- mentators on the topic. A brief historical overview of testing and validation is presented; the progress of construct validity and its acceptance by various sec- tors of society is discussed parsimoniously in the section The Seven Wonders of Personnel Psychology. In the past, personnel psychologists have not done a very good job of understanding the constructs that underlie test perform- ance. Some new approaches can help to correct this. A process should be rou- tinely used on all tests in order to develop an understanding of the constructs that underlie performance on an employment test; only by knowing the cor- rect criterion and method of measuring it can we ascertain the intrinsic valid- ity of our measures.