The Role of Cognitive Ability Tests in Employment Selection

Cognitive ability tests correlate with measures of job performance across many jobs. However, cognitive ability tests produce racial differences that are 3 to 5 times larger than other predictors-such as biodata, personality inventories, and the structured interview-that are valid predictors of job performance. Given that (a) cognitive ability tests can be combined with other predictors such that adverse impact is reduced while overall validity is increased, and (b) alternative predictors with less adverse impact can produce validity coefficients comparable to those obtained with cognitive ability tests alone, sole reliance on cognitive ability tests when alternatives are available is unwarranted.     

Using General Mental Ability and Personality Traits to Predict Job Performance in Three Chilean Organizations

Although the field of personnel selection has amounted around 100 years of research, there has been an overrepresentation of American and Western European samples in these studies. In particular, samples from Latin America have been almost entirely absent from industrial and organizational psychology journals. Thus, it is unknown whether well‐documented findings, such as the prediction of job performance based on general mental ability and conscientiousness, replicate in this region. This research intended to address this gap in the literature with three studies conducted in Chilean organizations, using different research designs, and different operationalizations of predictors and criteria. Results are generally consistent with previous studies, showing that conscientiousness and general mental ability significantly predict job performance in these Chilean samples.     

Effects of Personality Characteristics on Knowledge,Skill, and Performance in Servicing Retail Customers

This study tested the idea that some personality variables are related to interpersonal aspects of job performance primarily through interpersonal knowledge and skill, just as cognitive ability has been shown to be related to technical aspects of job performance primarily through technical knowledge and skill. We measured personality factors, cognitive ability, customer service knowledge (through a structured interview), customer service skill (through role‐play simulations), and customer service performance (through supervisory ratings) in a sample of 140 retail store associates. As expected, results showed that interpersonally oriented personality characteristics are related to customer service knowledge even when effects of ability, conscientiousness, and experience are taken into account, and that customer service knowledge and skill together carry the indirect effects of personality characteristics, ability, and experience to customer service performance. We also found that conscientiousness moderates the relation between knowledge and performance such that knowledge predicts performance best for people who are highly conscientious.     

Mind the Gap: Between‐group differences and fair test use

This paper integrates recent meta‐analytical findings regarding group differences in job‐ and educational‐related criteria and cognitive ability measures used as predictors in personnel selection and selection to higher education institutions. The findings suggest that cognitive ability measures reveal much higher group differences than the corresponding between‐group differences in job‐ and educational‐related criteria. One possible explanation for these differential gaps is that cognitive ability measures are objective and standardized while the typical measures used as job‐ and‐educational related criteria are non‐standardized subjective evaluations of job performance and academic achievement. While these findings are consistent with unbiased prediction or over‐prediction for lower scoring groups, they imply that selection is biased against them. Implications and future research are discussed.     

Coping strategies and first year performance in postsecondary education

Coping was hypothesized to explain additional variance in first year grade point averages (GPAs) controlling for cognitive ability and conscientiousness. First year GPAs were assessed as criterion for performance in the first year. Results indicate active coping, denial, behavioral disengagement, and alcohol disengagement are related to first year GPA. Denial and alcohol disengagement coping strategies were significant predictors and negatively related to first year GPA in the final regression equation controlling for cognitive ability and conscientiousness. Latent growth modeling analysis demonstrated cognitive ability predicted both the intercept and slope of first year GPA. Conscientiousness was a predictor of initial GPA but not change. Lastly, coping was a significant predictor of change in GPA. Implications for research and theory are discussed.     

Examining the Incremental Validity and Adverse Impact of Cognitive Ability and Conscientiousness on Job Performance

Using archival data from a large home improvement organization, the current study examined the incremental validity of conscientiousness over cognitive ability in predicting different performance criteria. Also, the study examined the effects of conscientiousness and cognitive ability on adverse impact. Results indicated that conscientiousness provided incremental validity over cognitive ability in the prediction of several performance criteria. Specifically, conscientiousness had the highest increases in validity over cognitive ability in the prediction of contextual performance factors (e.g., contextual performance, customer service orientation, dealing with others). However, the addition of conscientiousness failed to ameliorate the adverse impact associated with cognitive ability. In addition, limitations of the study and future directions of research are addressed.     

The Effects of Cognitive Ability and Conscientiousness on Performance Over Time: A Censored Latent Growth Model

This study examined the extent to which cognitive ability and conscientiousness predicted initial academic performance (i.e., grade point average) and changes in performance over the course of college students' careers. A censored latent growth model that controlled for initial performance was used. Results showed positive effects of cognitive ability and conscientiousness on initial performance, but only positive effects of conscientiousness on performance change. However, because initial performance negatively affected performance change, cognitive ability and conscientiousness negatively indirectly affected performance change through initial performance. In addition, results revealed cognitive ability accounted for more variance in initial performance than conscientiousness, and conscientiousness accounted for more variance in performance change than cognitive ability. Finally, results show that, beyond the third semester, conscientiousness is a better predictor of student performance than cognitive ability.     

PROJECT A VALIDITY RESULTS: THE RELATIONSHIP BETWEEN PREDICTOR AND CRITERION DOMAINS

A predictor battery of cognitive ability, perceptual-psychomotor ability, temperament/personality, interest, and job outcome preference measures was administered to enlisted soldiers in nine Army jobs. These measures were summarized in terms of 24 composite scores. The relationships between the predictor composite scores and five components of job performance were analyzed. Scores from the cognitive and perceptual-psychomotor ability tests provided the best prediction of job-specific and general task proficiency, while the temperament/personality composites were the best predictors of giving extra effort, supporting peers, and exhibiting personal discipline. Composite scores derived from the interest inventory were correlated more highly with task proficiency than with demonstrating effort and peer support. In particular, vocational interests were among the best predictors of task proficiency in combat jobs. The results suggest that the Army can improve the prediction of job performance by adding non-cognitive predictors to its present battery of predictor tests.     

General,Work-Specific,and Work-Role Conscientiousness Measures in Predicting Work Criteria: A Comparative Perspective

The current study compared general, work-specific, and work-role measures of conscientiousness as predictors of job satisfaction, organizational commitment, turnover intention, job engagement, and task performance. As expected, work-role conscientiousness yielded stronger relationships with five of the ten work-related criteria than general conscientiousness, and with six of the ten criteria than work-specific conscientiousness. More importantly, work-role conscientiousness displayed incremental validity in predicting nearly all work-related criteria, when controlling for general and work-specific conscientiousness alone or in combination. It is also worth noting that six of ten analyses found that work-role conscientiousness demonstrated greater relative importance compared to its counterparts. Finally, we found that the context in which the items were completed moderated the relationships between work-role conscientiousness and two work-related criteria (i.e., job satisfaction and organizational commitment). Together, these results suggest that researchers should consider the work-role measure of conscientiousness in the prediction of work criteria.     

Incremental Validity of Locus of Control After Controlling for Cognitive Ability and Conscientiousness

This research examined the criterion-related validity of work-specific locus of control in predicting job performance, including incremental validity after controlling for cognitive ability and conscientiousness. Data from a student sample and from a large employee sample were used to evaluate the scale properties of measures of locus of control, conscientiousness, and cognitive ability. Two concurrent criterion-related validation studies were then conducted to evaluate the incremental validity of locus of control. In both validation studies, locus of control demonstrated overall and incremental relationships with performance after controlling for ability and conscientiousness, such that employees with higher internal locus of control performed more effectively than externals.     

Determining Predictor Weights in Military Selection: An Application of Dominance Analysis

This article illustrates the use of dominance analysis (DA) to identify the most appropriate set of weights for combining predictor data. We used meta-analytic information on cognitive ability, structured interviews, conscientiousness, and emotional stability to determine relative weights in predicting entry-level job performance and turnover. For job performance, the optimal predictor weights were 51% (cognitive ability), 38% (structured interview), 9% conscientiousness, and 2% (emotional stability). The weights differed considerably for turnover: 48% (structured interview), 27% (emotional stability), 13% (conscientiousness), and 11% (cognitive ability). Using a simulated data set, we showed how the rank-order of applicants can change based on DA and traditional regression analysis. The results suggest that DA has wide applicability for military selection.     

The Validity of Conscientiousness for Predicting Job Performance: A meta‐analytic test of two hypotheses

This study examined two hypotheses regarding the moderating effects of job characteristics on the validity of personality. Using meta‐analytic techniques, the authors explored the extent to which the structural characteristics and cognitive ability requirements of jobs influence the role of conscientiousness in predicting performance. The results suggest that conscientiousness is a stronger predictor of performance in jobs that are highly routinized, and a weaker predictor of performance in jobs with high levels of cognitive ability requirements. Implications for theory and future research are discussed.     

Predicting Training and Job Performance for Transit Operators

Although considerable meta‐analytic research has validated the use of cognitive ability tests, structured interviews, and personality tests with training and job performance criteria, few studies have investigated the validity of these measures with transit operators. There are the only two single studies of concurrent validation research specifically with transit operators. This article presents the results of a predictive validation study conducted with transit operator applicants for a large urban transit authority in Canada. Key knowledge, skills, and abilities were determined for the role and used as a basis for the design and choice of predictors and criteria. Four predictors were used in the study: education, cognitive ability, personality assessment, and structured interview. Criteria included training performance (formative and summative), probationary performance, preventable accidents, and lost time injuries. Validation results supported cognitive ability, structured interview, and several personality factors as predictors of training performance, but less so for job performance. The use of formative training ratings greatly augmented the evidence supporting the predictors beyond typical organizational criteria.     

Toward an integrative theory of training motivation: a meta-analytic path analysis of 20 years of research

This article meta-analytically summarizes the literature on training motivation, its antecedents, and its relationships with training outcomes such as declarative knowledge, skill acquisition, and transfer. Significant predictors of training motivation and outcomes included individual characteristics (e.g., locus of control, conscientiousness, anxiety, age, cognitive ability, self-efficacy, valence, job involvement) and situational characteristics (e.g., climate). Moreover, training motivation explained incremental variance in training outcomes beyond the effects of cognitive ability. Meta-analytic path analyses further showed that the effects of personality, climate, and age on training outcomes were only partially mediated by self-efficacy, valence, and job involvement. These findings are discussed in terms of their practical significance and their implications for an integrative theory of training motivation.     

On-the-job embeddedness as a mediator between conscientiousness and school teachers' contextual performance

The recently introduced concept of job embeddedness has been shown to predict various organizational outcomes. In prediction models, its usual role is that of an antecedent explaining variance beyond commonly used attitudinal measures. Using social information processing theory as a framework, the present study examines on-the-job embeddedness (ONJE) as a potential mediator in predicting performance within an educational framework. Analysis of a multisource evaluation scheme applied to 115 school teachers supported the expectation that conscientiousness and ONJE are predictors of task and contextual performance. Moreover, ONJE was found to serve as a mediator by providing a partial explanation for the link between conscientiousness and contextual performance. Future research with other attitudinal and personality measures is suggested to broaden the role that ONJE plays in predicting performance.     

Selection Tests for Firefighters: A Comprehensive Review and Meta-Analysis

This study reviewed and summarized the literature on the use of written tests in the selection of firefighters using a sample of 13,418 individuals drawn from 101 samples. For the prediction of job performance, cognitive tests showed substantial validity (.42), although mechanical comprehension tests showed even higher validity (.54). However, the best prediction was obtained by tests which were composites of cognitive and mechanical predictors (.56). Training criteria was best predicted by cognitive measures (.77), although mechanical comprehension predictors also showed substantial prediction value (.62). Tests which were composites of cognitive and mechanical measures showed validities equal to that of cognitive measures (.77).     

Emotional competence as antecedent to performance: a contingency framework

Emotional intelligence is the ability to monitor one's own and others' thinking and actions. In this integrative review, the author seeks to determine the causes of the weak relationship between emotional intelligence and performance by positing that certain emotional competencies, rather than emotional intelligence, are the true predictors of performance. The author theorizes that emotional competencies (including self-control, resilience, social skills, conscientiousness, reliability, integrity, and motivation) interact with organizational climate and job demands or job autonomy to influence performance, as represented in the form of 5 empirically testable propositions. Self-control and emotional resilience are considered to delay the onset of a decline in performance from excessive job demands. Social skills, conscientiousness, reliability, and integrity assist to promote trust, which in turn may build cohesiveness among the members of work groups. Motivation may fuel job involvement in environments that promise psychological safety and psychological meaningfulness. A combination of superior social skills and conscientiousness may enhance the self-sacrifice of benevolent employees to heightened levels of dependability and consideration. Finally, emotional honesty, self-confidence, and emotional resilience can promote superior performance, if positive feedback is delivered in an informative manner, and can mitigate the adverse effects of negative feedback.     

Developing a biodata measure and situational judgment inventory as predictors of college student performance

This article describes the development and validation of a biographical data (biodata) measure and situational judgment inventory (SJI) as useful predictors of broadly defined college student performance outcomes. These measures provided incremental validity when considered in combination with standardized college-entrance tests (i.e., SAT/ACT) and a measure of Big Five personality constructs. Racial subgroup mean differences were much smaller on the biodata and SJI measures than on the standardized tests and college grade point average. Female students tended to outperform male students on most predictors and outcomes with the exception of the SAT/ACT. The biodata and SJI measures show promise for student development contexts and for selecting students on a wide range of outcomes with reduced adverse impact.     

Revisiting the relationship between impression management and job performance

Although theoretical arguments suggest that impression management should be related to job performance, empirical results have been unsupportive of the association. We argue that this relationship, however, may be found for specific jobs (sales) using a specific objective criterion (sales revenue). We tested this hypothesis across two samples. The first sample utilized a concurrent design and found a significant association between impression management and objective job performance. Furthermore, impression management demonstrated incremental validity over conscientiousness. In the second sample, using a different impression management scale and a predictive design we found that impression management was related to sales revenue, and showed incremental validity over cognitive ability. Implications for research and practice are discussed.     

Perceptions of organizational politics as a moderator of the relationship between conscientiousness and job performance

Meta-analytic studies of the relationships between the five-factor model of personality constructs and job performance indicate that conscientiousness has been the most consistent predictor. Recent research has sought to identify situational factors that may explain additional variance beyond what has been reported by simple bivariate relationships. The authors hypothesized that perceptions of organizational politics would moderate the relationship between conscientiousness and job performance. Data collected from 234 male and 579 female workers in 4 organizations indicated that conscientiousness was related to job performance among workers perceiving average to high levels of organizational politics but unrelated to performance among workers perceiving low levels of organizational politics. Moreover, perceptions of organizational politics were negatively related to job performance only among workers of average to low levels of conscientiousness.