SYNTHETIC VALIDITY: PAST, PRESENT, AND FUTURE

Practitioners in the area of personnel selection can be confronted with situations in which the use of traditional validation strategies is not feasible. This situation can result from small numbers of incumbents, rapidly changing jobs, insufficient resources, or the lack of high-quality criterion data. Although traditional strategies are not possible, a set of techniques falling under the rubric of synthetic validity can be used to estimate predictor validity in these situations. Synthetic validity is a logical process of inferring validity on the basis of the relationships between components of a job and tests of the attributes that are needed to perform the job components. Unfortunately, synthetic validity is infrequently used and not well understood. This article provides an overview and conceptualization of synthetic validity, reviews the historical approaches to synthetic validity, describes the recent developments and trends, and suggests future directions for synthetic validity application and research. The relationship of synthetic validity with other validity concepts, the advantages, the limitations, and the legal issues are considered throughout.     

Evidence on the Hierarchical,Multidimensional Nature of Behavioural Job Crafting

While to date job crafting has been conceptualised as consisting of behaviours aiming at seeking more resources, decreasing hindering demands, and seeking more challenges, recent research suggests that individuals may restore the fit between their demands and preferences also by optimising their demands. Accordingly, optimising demands has been introduced in the resource-based perspective to job crafting as an additional strategy that aims at making the work processes more efficient, simplifying procedures and eliminating obstacles. In this paper, we explore and provide evidence for the validity of a four-factor, hierarchical structure of behavioural job crafting constituted by increasing resources, seeking challenges, decreasing demands, and optimising demands. Moreover, our results provide initial evidence suggesting that overall job crafting may be more strongly characterised by effortful actions to expand the work characteristics rather than to reduce them.     

Conscientiousness,Its Facets,and the Prediction of Job Performance Ratings: Evidence against the narrow measures

This study empirically tested the predictions of the three basic perspectives on the bandwidth debate about the relationship between personality and job performance, regarding the validity of conscientiousness and its facets. The sample consisted of 226 police officers. Conscientiousness and three facets (order, industriousness, and self‐control) were correlated with three performance criteria (overall job performance, task performance, and orderliness). A Schmid–Leiman transformation made it possible to residualize the variance of the facets and to isolate their unique contribution to the prediction of performance measures. The results showed that conscientiousness predicted the three criteria (true validities of.25,.28 and.37, respectively) and that the facets neither predicted job performance nor showed incremental validity over conscientiousness. Finally, the implications of the findings for theory and practice are commented on, and future research is suggested.     

“Dark Side” Personality Styles as Predictors of Task,Contextual, and Job Performance

Many meta‐analyses and hundreds of primary studies have been carried out on the criterion‐oriented validity of personality measures for predicting job performance. The Five‐Factor Model of personality has been used as a frame for analyzing the empirical evidence. However, the research in industrial, work and organizational psychology has not examined the relationship between the dysfunctional tendencies of personality and the personality disorders as described in DSM‐IV (Axis II) Diagnostic and Statistical Manual of Mental Disorders and job performance. The present paper examines the relationship between job performance and the dysfunctional personality styles included in a non‐clinical personality inventory developed to assess personality tendencies related to the dysfunctional (normal) personality styles and the personality disorders in work settings. This inventory assesses 14 dysfunctional personality styles and was given to a sample of 85 applicants. The job performance was rated by the direct supervisor 8 months later, and three measures were obtained: task performance, contextual performance, and overall job performance. The results showed that the seven dysfunctional personality styles (suspicious, shy, sad, pessimistic, sufferer, eccentric, and risky) predicted the three measures of job performance. The egocentric personality style negatively predicted contextual performance. Finally, the submitted style predicted task performance. With the exception of the risky personality style, the rest of the styles mainly consisted of Neuroticism. Implications for the research and practice of personnel selection are discussed.     

Capturing autonomy,competence, and relatedness at work: Construction and initial validation of the Work‐related Basic Need Satisfaction scale

The satisfaction of the basic psychological needs for autonomy, competence, and relatedness, as defined in Self‐Determination Theory, has been identified as an important predictor of individuals' optimal functioning in various life domains. The study of work‐related need satisfaction seems, however, hampered by the lack of a validated measure. To assist future research, the present study aimed to develop and validate a Work‐related Basic Need Satisfaction scale (W‐BNS). Using four Dutch‐speaking samples, evidence was found for the three‐factor structure of the scale, the discriminant validity, and the reliability of the three need satisfaction subscales as well as their criterion‐related and predictive validity. The W‐BNS may therefore be considered as a promising tool for future research and practice.     

Mind the Gap: Between‐group differences and fair test use

This paper integrates recent meta‐analytical findings regarding group differences in job‐ and educational‐related criteria and cognitive ability measures used as predictors in personnel selection and selection to higher education institutions. The findings suggest that cognitive ability measures reveal much higher group differences than the corresponding between‐group differences in job‐ and educational‐related criteria. One possible explanation for these differential gaps is that cognitive ability measures are objective and standardized while the typical measures used as job‐ and‐educational related criteria are non‐standardized subjective evaluations of job performance and academic achievement. While these findings are consistent with unbiased prediction or over‐prediction for lower scoring groups, they imply that selection is biased against them. Implications and future research are discussed.     

Using the BIDR to Distinguish the Effects of Impression Management and Self‐Deception on the Criterion Validity of Personality Measures: A Meta‐Analysis

Although the use of personality tests for personnel selection has gained increasing acceptance, researchers have raised concerns that job applicants may distort their responses to inflate their scores. In the present meta‐analysis, we examined the effects of the two dimensions of social desirability, impression management and self‐deception, on the criterion validity of personality constructs using the balanced inventory of desirable responding (BIDR). The results indicate that impression management and self‐deception did not create spurious effects on the relationship between personality measures and performance, nor did they function as performance predictors. Moreover, removing the influence of impression management or self‐deception from personality measures did not substantially attenuate the criterion validity of personality variables. Implications of the results and directions for future research are also discussed.     

THE INCREMENTAL VALIDITY OF INTERVIEW SCORES OVER AND ABOVE COGNITIVE ABILITY AND CONSCIENTIOUSNESS SCORES

Recent research has suggested that scores on measures of cognitive ability, measures of Conscientiousness, and interview scores are positively correlated with job performance. There remains, however, a question of incremental validity: To what extent do interviews predict above and beyond cognitive ability and Conscientiousness? This question was addressed in this paper by (a) conducting meta‐analyses of the relationships among cognitive ability, Conscientiousness, and interviews, (b) combining these results with predictive validity results from previous meta‐analyses to form a “meta‐correlation matrix” representing the relationships among cognitive ability, Conscientiousness, interviews, and job performance, and (c) performing 9 hierarchical regressions to examine the incremental validity of 3 levels of structured interviews in best, actual, and worst case scenarios for prediction. Results suggested that interview scores contribute to the prediction of job performance over and above cognitive ability and Conscientiousness to the extent that they are structured, with scores from highly structured interviews contributing substantially to prediction. Directions for future research are discussed.     

USING A META-ANALYTIC PERSPECTIVE TO ENHANCE JOB COMPONENT VALIDATION

This paper develops synthetic validity estimates based on a meta-analytic-weighted least squares (WLS) approach to job component validity (JCV), using position analysis questionnaire (PAQ) estimates of job characteristics, and the Data, People, & Things ratings from the  Dictionary of Occupational Titles  as indices of job complexity. For the general aptitude test battery database of 40,487 employees, nine validity coefficients were estimated for 192 positions. The predicted validities from the WLS approach had lower estimated variability than would be obtained from either the classic JCV approach or local criterion-related validity studies. Data, People, & Things summary ratings did not consistently moderate validity coefficients, whereas the PAQ data did moderate validity coefficients. In sum, these results suggest that synthetic validity procedures should incorporate a WLS regression approach. Moreover, researchers should consider a comprehensive set of job characteristics when considering job complexity rather than a single aggregated index.     

VALIDATING SYNTHETIC VALIDATION: COMPARING TRADITIONAL AND SYNTHETIC VALIDITY COEFFICIENTS

We describe a unique application of a synthetic validation technique to a selection system development project in a large organization. Job analysis data were collected from 4,725 job incumbents and 619 supervisors, and were used to identify 11 job families and 27 job components. We developed 12 tests to predict performance on these job components and conducted a concurrent validation study to collect test and job component data for 1,926 incumbents. We created a test composite for each job component and then chose a test battery for each job family based on its relevant job components. Synthetic validity coefficients were computed for each test battery and compared to traditional validity coefficients that were computed within job families with large sample sizes. The synthetic validity coefficient was very close to the within-family validity coefficient for most job families and was within the bounds of sampling error for all job families. Validities tended to be highest when predictors were weighted according to the number of job components to which they were relevant and job component criterion measures were unit weighted.     

A longitudinal study of career success,embeddedness, and mobility of early career professionals

The study of voluntary job mobility has traditionally focused on how the present context and individual factors either support or constrain choice of blue and white collar workers. Less attention has been devoted to the relationships among career success, embeddedness, and mobility of early career professionals. How do past career success and job mobility affect job embeddedness, subsequent career success, and future mobility within and between organizations and occupations? Each of these constructs is often studied as a dependent variable, yet the relationships among them, over time, are rarely examined. We explore the effects of past objective career actions (promotions, % salary change, and job mobility) on current job embeddedness and subjective career success, and on job, organizational, and occupational mobility one year later. Results support the positive influence of past promotions, % salary change, and current job embeddedness on subjective career success, and a negative influence for past promotions, job embeddedness, and subjective career success on mobility one year later as people began to ‘settle in’. We also observed small positive relationships of past promotions and % salary change with job embeddedness, and of past job mobility with future mobility — indicating that objective career success contributes to embeddedness, yet those that move more often tend to keep doing so. There were no differences or interaction effects based on gender or years of work experience. We found significantly stronger negative relationships of embeddedness and subjective career success with mobility between occupations than for mobility within organizations. However, the same pattern of findings was observed for job, organization, and occupational mobility.     

The impact of job insecurity and contract type on attitudes,well‐being and behavioural reports: A psychological contract perspective

Research on the impact of job insecurity for temporary employees has been largely exploratory and atheoretical in nature. This paper addresses this issue by considering the role of job insecurity on job satisfaction, organizational commitment, life satisfaction, and self‐rated performance among permanent employees (N = 396) as compared with temporary ones (N = 148). Hypotheses are formulated using the tradition of transactional versus relational psychological contract types. Psychological contract theory assumes (1) that job insecurity effects are due to a violation of the relational psychological contract, and (2) that permanents as compared with temporaries engage more in relational psychological contracting. As a result, job insecurity is expected to be problematic in terms of outcomes for permanents, but not for temporaries. Results validate the assumptions made in psychological contract theory. Furthermore, job insecurity proved problematic for permanents but not for temporaries when job satisfaction and organizational commitment are concerned. No such differential effects are observed for life satisfaction and self‐rated performance. Implications for future research are discussed.     

An Examination of the Validity and Incremental Value of Needed‐at‐Entry Ratings for a Customer Service Job

We examined needed‐at‐entry ratings of knowledge, skills, abilities, and other characteristics (KSAOs) provided by job experts (N= 285) during a job analysis for a customer service manager position. To serve as an external referent, a group of industrial and organisational psychologists (N= 31) rated the perceived trainability of each KSAO. Analyses revealed only limited support for the validity of inferences drawn from job experts' needed‐at‐entry ratings. Consistent with our hypotheses, less validity evidence was found for ratings of the more person‐oriented and abstract “AO” attributes than for the more job‐oriented and concrete “KS” attributes. In general, job experts tended to rate attributes as needed‐at‐entry that psychologists thought could be developed on the job. We also found that failing to collect needed‐at‐entry ratings, and relying on only the more common importance‐to‐the‐job ratings, would have resulted in a rather different set of critical KSAOs identified for assessment during the selection process.     

Why Openness to Experience is not a Good Predictor of Job Performance

Recent meta‐analyses investigating the relationship between personality and job performance have found that openness to experience is the least predictive of the Big Five factors. Unlike other research that has sought to explain the low criterion‐validity with relation to job performance, this study explores the actual construct of openness to experience, suggesting that it consists of two dimensions that relate differentially to job performance thus reducing correlations between overall measures of openness to experience and performance criteria. Exploratory factor analysis of the six sub‐dimensions, or facets, of the NEO PI‐R (a popular measure of the Big Five factors) produced two factors of openness to experience corresponding to different areas to which people are open. A confirmatory factor analysis on a second set of data provided some support for this result. A pattern of differential relationships between the two factors and other variables including personality, biodata and supervisor‐rated performance offered further support for the multidimensionality of openness to experience. The implications of these findings for future research in the selection context are discussed.     

The validity of the Big Five personality traits for job performance: Meta‐analyses of South African studies

Previous meta‐analyses have established the Big Five personality traits as important predictors of job performance around the globe. This study extends the international generalizability of Big Five criterion‐related validity through systematic review and meta‐analyses of personality–performance research conducted in South Africa. We meta‐analyzed data from 33 studies and 6,782 individuals to estimate validities of Big Five traits for various job performance criteria. Results showed that the Big Five traits have similar validity for job performance criteria as found in other cultural contexts. Conscientiousness was the strongest predictor across performance criteria, while other traits showed validity for specific criteria or subsamples. Results demonstrate the importance of psychometric meta‐analysis for building cumulative knowledge and support applied use of personality assessments in South Africa. Consistency of the results of this study with those of previous meta‐analyses in other national contexts supports the argument that personality–performance relations are a cultural universal.     

Doing It All At Once: Multitasking as a predictor of call center agents’ performance and performance‐based dismissal

Multitasking has become an important skill in many jobs. Still, the predictive validity of job‐applicants’ multitasking abilities has rarely been tested empirically. The current study focuses on the multitasking ability of call center applicants. Results from a Dutch call center show that applicants’ multitasking ability as assessed during personnel selection indeed predicts their later job performance as call center agents as well as their likelihood of losing their job for poor performance. While some of these relationships could be explained via applicants’ fluid intelligence, results also support the usefulness of including measures of multitasking ability in the current selection procedure.     

Discriminant validation of measures of organizations commitment,job involvement,and job satisfaction among Swedish army officers

The discriminant validity of measures of job involvement, job satisfaction and organizational commitment was tested with data from 467 army officers in Sweden. Confirmatory-factor analysis showed a close fit between the proposed three-factor model and the data. Further, six of eleven job and health correlates related differently to the three attitude vairables. The results indicate that job involvement, job satisfaction and organizational commitment represent three empirically distinct constructs. Implications for future research discussed.     

Development and validation of the Job Security Index and the Job Security Satisfaction scale: A classical test theory and IRT approach

This study describes the development and validation of two scales measuring job security: the Job Security Index (JSI), measuring an individual's cognitive appraisal of the future of his or her job with respect to the perceived level of stability and continuance of that job, and the Job Security Satisfaction (JSS) scale, measuring employee satisfaction with a perceived level of job security. Item response theory and classical test theory analyses indicate that the scales are highly reliable and exhibit good discriminant and criterion‐related validity. Future researchers are advised to apply confirmatory factor analysis (CFA) to the scales to confirm their factor structures.     

Effects of Self‐Deceptive Enhancement on Personality–Job Performance Relationships

Theoretical and empirical evidence distinguishes between two types of response distortion: impression management (IM) and self‐deceptive enhancement (SDE), although most research in Industrial/Organizational Psychology has focused on the effects of IM. The present study compared the effects of IM and SDE on job performance and personality validity. Two‐hundred and sixty‐one managers completed Big Five Personality, SDE, and IM measures. The managers' supervisors, peers, and subordinates rated their job performance. In accordance with previous research, accounting for managers' IM scores did not increase prediction of job performance. On the other hand, accounting for SDE did increase prediction. Increased prediction was due to an interaction between Extraversion and SDE, and an increase in the predictive validity of Emotional Stability when SDE was held constant. Results suggested that findings from previous research demonstrating that IM does not affect job performance or personality validity cannot be extended to SDE.