Incremental Validity of Assessment Center Ratings Over Cognitive Ability Tests: A Study at the Executive Management Level

Both tests of cognitive ability and assessment center (AC) ratings of various performance attributes have proven useful in personnel selection and promotion contexts. To be of theoretical or practical value, however, the AC method must show incremental predictive accuracy over cognitive ability tests given the cost disparities between the two predictors. In the present study, we investigated this issue in the context of promotion of managers in German police departments into a training academy for high‐level executive positions. Candidates completed a set of cognitive ability tests and a 2‐day AC. The criterion measure was the final grade at the police academy. Results indicated that AC ratings of managerial abilities were important predictors of training success, even after accounting for cognitive ability test scores. These results confirm that AC ratings provide unique contribution to the understanding and prediction of training performance of high‐level executive positions beyond cognitive ability tests.     

Assessment Center Dimensions: Individual differences correlates and meta‐analytic incremental validity

This study provides an investigation of the nomological net for the seven primary assessment center (AC) dimensions identified by Arthur, Day, McNelly, and Eden (Personnel Psychology, 56, 125–154, 2003). In doing so, the authors provide the first robust estimates of the relationships between all primary AC dimensions with cognitive ability and the Big 5 factors of personality. Additionally, intercorrelations between AC dimensions based on sample sizes much larger than those previously available in the meta‐analytic literature are presented. Data were obtained from two large managerial samples (total N=4985). Primary data on AC dimensions, personality, and cognitive ability interrelationships were subsequently integrated with meta‐analytic data to estimate incremental validity for optimally and unit‐weighted AC dimension composites as well as overall AC ratings over psychometric tests of personality and cognitive ability. Results show that unit‐ and optimally weighted composites of construct‐based AC dimensions add incremental validity over tests of personality and cognitive ability, while overall AC ratings (including those obtained using subjective methods of data combination) do not.     

The relationship between disposition and career success: A British study

The relationship of the Five‐Factor Model of personality and general mental ability with extrinsic and intrinsic career success was investigated in a British sample of 308 white‐collar workers. Extrinsic career success was associated with both experiential variables and dispositional variables, while intrinsic career success was almost exclusively associated with personality traits. General mental ability contributed to eventual, but not to organization‐specific extrinsic career success; and neuroticism reduced both extrinsic career prospects and intrinsic career evaluations, while agreeableness reduced extrinsic career prospects but enhanced intrinsic career evaluations. However, in sharp contrast to hypotheses, conscientiousness primarily and extraversion secondarily were negatively associated with extrinsic career success. The findings are discussed with respect to extant knowledge and the British national cultural context.     

Predicting academic success with the Big 5 rated from different points of view: Self‐rated,other rated and faked

Self‐ratings of personality predict academic success above general intelligence. The present study replicated these findings and investigated the increment of other‐ratings or intentionally distorted self‐ratings. Participants (N = 145) had to compile a personality questionnaire twice. First they were given neutral instructions. The second time they were asked to imagine a specific applicant setting. Furthermore, two peers rated each participant. Additionally, verbal, numerical and figural reasoning scores were obtained. Grades on a statistics exam obtained 2 months later served as the criterion. Results replicated prior findings and showed incremental validity for self‐ and other‐rated personality, which was stable after controlling for intelligence. Faking had no impact on the domain‐score level, but results on the facet‐score level were less encouraging. Copyright © 2010 John Wiley & Sons, Ltd.     

THE INCREMENTAL VALIDITY OF INTERVIEW SCORES OVER AND ABOVE COGNITIVE ABILITY AND CONSCIENTIOUSNESS SCORES

Recent research has suggested that scores on measures of cognitive ability, measures of Conscientiousness, and interview scores are positively correlated with job performance. There remains, however, a question of incremental validity: To what extent do interviews predict above and beyond cognitive ability and Conscientiousness? This question was addressed in this paper by (a) conducting meta‐analyses of the relationships among cognitive ability, Conscientiousness, and interviews, (b) combining these results with predictive validity results from previous meta‐analyses to form a “meta‐correlation matrix” representing the relationships among cognitive ability, Conscientiousness, interviews, and job performance, and (c) performing 9 hierarchical regressions to examine the incremental validity of 3 levels of structured interviews in best, actual, and worst case scenarios for prediction. Results suggested that interview scores contribute to the prediction of job performance over and above cognitive ability and Conscientiousness to the extent that they are structured, with scores from highly structured interviews contributing substantially to prediction. Directions for future research are discussed.     

Ability and Personality Predictors of Salary,Perceived Job Success,and Perceived Career Success in the Initial Career Stage

Using longitudinal data from a sample of recent college graduates, we examined the effects of ability (general mental ability and emotional intelligence) and personality (Big Five and proactive personality) on extrinsic (i.e., salary) and intrinsic (i.e., perceived job and career success) indicators of career success. Results from regression analyses indicated that gender, extroversion, and agreeableness were the strongest predictors of salary. Emotional stability and proactive personality predicted perceived job success, while extroversion was significantly related to perceived career success. Neither of the ability measures significantly predicted our indicators of extrinsic or intrinsic career success. Implications for theory and practice are discussed.     

The Relation of Cognitive Ability and Personality Traits to Assessment Center Performance

The aim of the current study was to examine cognitive ability and personality correlates of assessment center exercise ratings. The sample included 429 individuals who participated in a 2-day management development assessment center during a 5-year period. The assessment center yielded scores on 8 exercises. Assessees also completed a measure of cognitive ability (Watson-Glaser Critical Thinking Appraisal) and the California Psychological Inventory (CPI). The CPI scales were incorporated into 4 of the Big Five personality factors for easier interpretation. Our hypotheses were partially supported since ratings of exercises that were largely interpersonal in nature tended to correlate with interpersonal personality constructs (emotional stability, extraversion, and openness to experience), and ratings of cognitive problem-solving exercises correlated with cognitive ability and conscientiousness.     

Expanding and Reconceptualizing Aberrant Personality at Work: Validity of Five‐Factor Model Aberrant Personality Tendencies to Predict Career Outcomes

This study proposes and tests an alternative methodology to conceptualize and assess aberrant personality tendencies at work beyond the dark triad. A sample of college alumni (N= 247) were administered the NEO PI‐R prior to entering the labor market and 15 years later when their professional careers had unfolded. Drawing on the dimensional perspective on personality functioning, 6 five‐factor model (FFM) aberrant compounds were computed as indicators of aberrant personality tendencies. As expected, FFM aberrant personality tendencies were highly stable across time, with test–retest correlations ranging from .61 (Narcissistic) to .73 (avoidant). With regard to predictive validity, borderline, schizotypal, and avoidant tendencies were negatively associated with extrinsic and intrinsic career outcomes. The obsessive‐compulsive tendency was largely unrelated to career outcomes, whereas individuals with antisocial and narcissistic characteristics tended toward higher hierarchical and financial attainment. In addition, relative importance analyses indicated that (a) FFM aberrant personality tendencies showed incremental validity in the prediction of career outcomes beyond FFM general traits, and that (b) both FFM general and FFM aberrant personality tendencies are important predictors when considered jointly. It is concluded that FFM aberrant personality tendencies suggest interesting avenues for personnel psychologists to form new linear combinations of FFM facets, complementing FFM general domains.     

Emotional Intelligence in Selection Contexts: Measurement method,criterion‐related validity,and vulnerability to response distortion

Two studies examined aspects of the validity of self‐report and performance‐based measures of emotional intelligence (EI) relevant to their use in personnel selection. In Study 1, structural equation modeling indicated that a two‐factor model with separate factors for the two types of EI measures fit better than a one‐factor solution. The performance‐based EI factor was more related to cognitive ability (R=.38) than personality (R=.26), whereas the self‐report EI factor was more related to personality (R=.85) than cognitive ability (R=.09). Although the performance‐based EI factor correlated more strongly with job performance (ρ=.24) than did that of the self‐report (ρ=.05), it provided little incremental validity beyond cognitive ability and conscientiousness. In Study 2, participants were asked to complete the measures as if applying for a job, and mean scores were then compared with those of Study 1. Results indicated that self‐report EI measures were more vulnerable to distortion than were the performance‐based measures. Implications for the assessment of EI in personnel selection contexts are discussed.     

Personality,Intelligence and Assessment Centre Expert Ratings

Just under 3000 middle managers were rated on seven dimensions/competencies by consultants after a 1‐day assessment centre and structured interview. They also completed two cognitive ability tests and two well‐established personality tests (NEO PI‐R; MBTI). Correlational analysis showed that the rated dimensions of ‘drive to achieve’, ‘internal locus of control’ and ‘resilience’ all modestly negatively correlated with Neuroticism. All seven ratings were significantly correlated with Extraversion and three each with Openness and Agreeableness. There were few significant correlations with the MBTI but the Thinking–Feeling dimension correlated significantly with combined ratings. Correlations with the intelligence test scores were mostly non‐significant. The seven ratings factored into three identifiable factors: labelled personal assertiveness, toughness and determination and curiosity. Regressions using both a total, overall computed rating of general aptitude, as well as the three scores as criterion variables and ability, personality, participant‐gender and management level as predictor variables demonstrated that they accounted for between a quarter and a third of the variance. Predictors varied considerably as a function of the different criteria measures but ability and gender accounted for little of the variance.     

A Person-Centered Approach to P-E Fit Questions Using a Multiple-Trait Model

The current study first longitudinally examines the validity of person-environment (P-E) RIASEC congruence, adopting a job analytic method to assess the environment and using P-E difference scores to compute congruence, to predict a range of intrinsic career outcomes—including job satisfaction, skill development, work involvement, and perceived stress—in a sample of 401 college seniors involved in the labor market. Second, the incremental validity of an alternative conceptualization of the P component (i.e., the Five-Factor Model of personality [FFM]) is examined over and beyond RIASEC congruence scores. Congruence across RIASEC types significantly predicted job satisfaction and skill development, but FFM traits significantly and substantially contributed to the prediction of all intrinsic career outcomes. Finally, a person-centered perspective to P-E questions is introduced, demonstrating that cluster analysis of individuals' FFM scores resulted in two clusters (i.e., internalizers/externalizers and resilients) showing very different positions on the labor market and reporting differing initial career outcomes. It is concluded that RIASEC P-E fit congruence studies should be complemented with FFM assessment to increase predictive validity. Applications of an FFM-based, person-centered approach in I/O and P-E fit research and practice are discussed.     

THE BIG FIVE PERSONALITY TRAITS, GENERAL MENTAL ABILITY, AND CAREER SUCCESS ACROSS THE LIFE SPAN

The present study investigated the relationship of traits from the 5-factor model of personality (often termed the "Big Five") and general mental ability with career success. Career success was argued to be comprised of intrinsic success (job satisfaction) and extrinsic success (income and occupational status) dimensions. Data were obtained from the Intergenerational Studies, a set of 3 studies that followed participants from early childhood to retirement. The most general findings were that conscientiousness positively predicted intrinsic and extrinsic career success, neuroticism negatively predicted extrinsic success, and general mental ability positively predicted extrinsic career success. Personality was related to career success controlling for general mental ability and, though adulthood measures of the Big Five traits were more strongly related to career success than were childhood measures, both contributed unique variance in explaining career success.     

The Incremental Validity of Honesty–Humility Over Cognitive Ability and the Big Five Personality Traits

The present study examines the incremental validity of Honesty–Humility (H-H), a measure of the tendency to be fair and genuine in dealing with others, for supervisory ratings of job performance (including both task and contextual performance) over cognitive ability and the Big Five personality traits. Specifically, we explore the incremental validity of H-H in predicting contextual performance. Results based on 217 South Korean military officer candidates are consistent with previous conclusions that Conscientiousness is the strongest predictor of contextual performance and that cognitive ability is the strongest predictor of task performance. More important, our results reveal that H-H offers moderate incremental validity for contextual performance but no incremental validity for task performance over the effects of cognitive ability and the Big Five personality traits.     

LinkedIn as a new selection method: Psychometric properties and assessment approach

Various surveys suggest LinkedIn is used as a screening and selection tool by many hiring managers. Despite this widespread use, fairly little is known about whether LinkedIn meets established selection criteria, such as reliability, validity, and legality (i.e., no adverse impact). We examine the properties of LinkedIn-based assessments in two studies. Study 1 shows that raters reach acceptable levels of consistency in their assessments of applicant skills, personality, and cognitive ability. Initial ratings also correlate with subsequent ratings done 1-year later (i.e., demonstrating temporal stability), with slightly higher correlations when profile updates are taken into account. Initial LinkedIn-based ratings correlate with self-reports for more visible skills (leadership, communication, and planning) and personality traits (Extraversion), and for cognitive ability. LinkedIn-based hiring recommendations are positively associated with indicators of career success. Potential adverse impact is also limited. Profiles that are longer, include a picture, and have more connections are rated more positively. Some of those features are valid cues to applicants’ characteristics (e.g., applicants high on Conscientiousness have longer profiles). In Study 2, we show that an itemized LinkedIn assessment is more effective than a global assessment. Implications of these findings for selection and future research are discussed.     

The Magnitude and Extent of Cheating and Response Distortion Effects on Unproctored Internet‐Based Tests of Cognitive Ability and Personality

The use of unproctored internet‐based testing (UIT) for employee selection is quite widespread. Although this mode of testing has advantages over onsite testing, researchers and practitioners continue to be concerned about potential malfeasance (e.g., cheating and response distortion) under high‐stakes conditions. Therefore, the primary objective of the present study was to investigate the magnitude and extent of high‐ and low‐stakes retest effects on the scores of a UIT speeded cognitive ability test and two UIT personality measures. These data permitted inferences about the magnitude and extent of malfeasant responding. The study objectives were accomplished by implementing two within‐subjects design studies ( Study 1 N=296; Study 2 N=318) in which test takers first completed the tests as job applicants (high‐stakes) or incumbents (low‐stakes) then as research participants (low‐stakes). For the speeded cognitive ability measure, the pattern of test score differences was more consonant with a psychometric practice effect than a malfeasance explanation. This result is likely due to the speeded nature of the test. And for the UIT personality measures, the pattern of higher high‐stakes scores compared with lower low‐stakes scores is similar to those reported for proctored tests in the extant literature. Thus, our results indicate that the use of a UIT administration does not uniquely threaten personality measures in terms of elevated scores under high‐stakes testing that are higher than those observed for proctored tests in the extant literature.     

Personality and career success: Concurrent and longitudinal relations

The present research addresses the dynamic transaction between extrinsic (occupational prestige, income) and intrinsic (job satisfaction) career success and the Five‐Factor Model (FFM) of personality. Participants (N = 731) completed a comprehensive measure of personality and reported their job title, annual income and job satisfaction; a subset of these participants (n = 302) provided the same information approximately 10 years later. Measured concurrently, emotionally stable and conscientious participants reported higher incomes and job satisfaction. Longitudinal analyses revealed that, among younger participants, higher income at baseline predicted decreases in Neuroticism and baseline Extraversion predicted increases in income across the 10 years. Results suggest that the mutual influence of career success and personality is limited to income and occurs early in the career. Copyright © 2009 John Wiley & Sons, Ltd.     

Cognitive versus Non‐Cognitive Individual Differences and the Dynamics of Career Success

We examine the effects of cognitive and non‐cognitive individual differences on the dynamics of career success (i.e. pay, occupational status) by comparing temporal changes in the validities of two measures of personality—Core Self Evaluations and the Big Five personality dimensions—to temporal changes in the validities of two standard intelligence tests. The main finding of two studies based on large representative samples is that the validity of intelligence clearly increases over time, whereas the validity of personality tends to be stable, indicating that intelligence, but not personality, drives career success.     

How Emotional Intelligence Might Get You the Job: The Relationship Between Trait Emotional Intelligence and Faking on Personality Tests

This study examined trait emotional intelligence (EI) in relation to the ability to fake on personality tests. Undergraduate students (N = 129) were first instructed to fill out a personality inventory honestly, and subsequently in such a way as to maximize their chances of obtaining two distinctive job positions (lawyer and file clerk). Participants were able to change their scores in line with the hypothesized job profiles. Regression analyses showed that EI statistically predicted faking ability to an equal degree in both job scenarios. Finally, EI showed incremental validity over general mental ability and the Big Five personality traits in predicting the ability to fake. Possible implications of the results for the predictive validity of personality tests are discussed.     

Controlling your environment and yourself: Implications for career success

Given the complex and rapidly changing nature of the current work environment, individuals' capabilities to effectively influence their environment and regulate their behavior may be critical to career success. Drawing from the model of emergent interactive agency (Bandura, 1989), the current research examines this perspective, focusing on proactive personality and self-control as predictors of extrinsic and intrinsic career success. Although some studies have investigated proactive personality as a predictor of success, less research has focused on factors involved in this relationship and very little work has examined self-control in the context of career success. Study 1 involved a cross-sectional design with 249 full-time employees who completed measures assessing personality and career-related variables. Study 2 involved a longitudinal design with 1568 individuals who were rated on self-control during childhood and completed career-related measures approximately 20 years later. Study 1 results indicated proactive personality and self-control related to extrinsic career success (salary and occupational prestige) through educational attainment. Study 2 results indicated self-control related to extrinsic career success (salary and occupational prestige) through educational attainment and intrinsic career success (career satisfaction) through occupational opportunity for achievement. These findings contribute to the knowledge base regarding career success by highlighting the relevance of active control tendencies that are externally focused (proactive personality) as well as those that are internally focused (self-control) and identifying key factors linking these traits to career success.